From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-4.2 required=3.0 tests=BAYES_00,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,FREEMAIL_FORGED_FROMDOMAIN,FREEMAIL_FROM, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,NICE_REPLY_A,SPF_HELO_NONE, SPF_PASS,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6D049C63798 for ; Thu, 19 Nov 2020 01:17:18 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 21EE822260 for ; Thu, 19 Nov 2020 01:17:18 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=gmail.com header.i=@gmail.com header.b="XQGahpz3" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727245AbgKSBRJ (ORCPT ); Wed, 18 Nov 2020 20:17:09 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:54838 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725947AbgKSBRI (ORCPT ); Wed, 18 Nov 2020 20:17:08 -0500 Received: from mail-io1-xd43.google.com (mail-io1-xd43.google.com [IPv6:2607:f8b0:4864:20::d43]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 51DD5C0613D4; Wed, 18 Nov 2020 17:17:07 -0800 (PST) Received: by mail-io1-xd43.google.com with SMTP id j23so4193895iog.6; Wed, 18 Nov 2020 17:17:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=subject:to:cc:references:from:message-id:date:user-agent :mime-version:in-reply-to:content-language:content-transfer-encoding; bh=1jsKXTlpEi6e+N2Z73mAs09Ft2GKdpOV4PvphAMgkc4=; b=XQGahpz3rmWWtyrT9qZTkbriE3fA9MxDgw0SxZjCHeYzYQGJgwjtE+gY28a+HC0TjW kXlrpbqHe4J8Swb+rXg0YjhxRADqm+1CsFS78GemC8L9NHMNVvrj9tTFHaiw7ncceLwn GgfmudeVP5ha+wDXVq7oUcT2lrzpJT/8UO16d67KnxIGo8u6b3aomjEZw4ju824EXF5V SCpJFHFzRP+gjFk6kZlaBKCH2eVtU5XP5xcka4op95EMq68jOcIewgSObtN6k9n/d0sC eZjfsamqV4nlW5S84+2GTh6Trrfn607hRFOt4Aw8C2uadX5mbdf/Cz6hFdWSEpWIKUqW mehA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:subject:to:cc:references:from:message-id:date :user-agent:mime-version:in-reply-to:content-language :content-transfer-encoding; bh=1jsKXTlpEi6e+N2Z73mAs09Ft2GKdpOV4PvphAMgkc4=; b=CLDah+kxKhPGxVT7xPTTTPDexqvGKomGr96asbQxLQwUoKZ8Uasp0oD6PGpre04Vbp WE4MfKTUN1aCVjhEmmEs0SmiuB1msYvilsaZfD2oQ8lPdqOP46x0M2lWatssGUqARWL7 MwwiljI3CT8IP81/Me3dpnMO4i1JXlpb+P2Gy2VnoYPUC5kYjpHRZbJMd/6EVr6fj0O5 NoO4vIyXo5HjDMsRo0kpRrnRRDs1N82GJ/jHj3JFD1AqKezxD1sinoRUxF511eYw0SCJ VjtcEUq0UKxvJxW8mAfXgRsRMmBRtKtX9GEkSXsUSMcZqeZRlmDvGLMLlFf4GwGpTMwC 7l4A== X-Gm-Message-State: AOAM532QCqBPnBuM+u1IvBb0oPu9+YhX4+s1uIXhZ277SNy3pyfn4QzY hV6Y0zWP/FsD7Lvid5fqDGc= X-Google-Smtp-Source: ABdhPJyJ30Y6BeNZZVkHxzudlvAmX1PcuYieFiiTEAQQQ0ujGfiFwlg67I33StCk67wFxdsblgjHnw== X-Received: by 2002:a5e:a613:: with SMTP id q19mr17897903ioi.110.1605748626632; Wed, 18 Nov 2020 17:17:06 -0800 (PST) Received: from Davids-MacBook-Pro.local ([2601:284:8203:54f0:70e6:174c:7aed:1d19]) by smtp.googlemail.com with ESMTPSA id f18sm14681487ill.22.2020.11.18.17.17.05 (version=TLS1_3 cipher=TLS_AES_128_GCM_SHA256 bits=128/128); Wed, 18 Nov 2020 17:17:05 -0800 (PST) Subject: Re: [PATCH net-next 03/13] devlink: Support add and delete devlink port To: Jacob Keller , Parav Pandit , "netdev@vger.kernel.org" , "linux-rdma@vger.kernel.org" , "gregkh@linuxfoundation.org" Cc: Jiri Pirko , Jason Gunthorpe , "dledford@redhat.com" , Leon Romanovsky , Saeed Mahameed , "kuba@kernel.org" , "davem@davemloft.net" , Vu Pham References: <20201112192424.2742-1-parav@nvidia.com> <20201112192424.2742-4-parav@nvidia.com> From: David Ahern Message-ID: <5ddfcf07-2d3c-17ac-2db8-4f657506c2fd@gmail.com> Date: Wed, 18 Nov 2020 18:17:05 -0700 User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0) Gecko/20100101 Thunderbird/78.4.3 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit Precedence: bulk List-ID: X-Mailing-List: netdev@vger.kernel.org On 11/18/20 5:41 PM, Jacob Keller wrote: > > > On 11/18/2020 11:22 AM, Parav Pandit wrote: >> >> >>> From: David Ahern >>> Sent: Wednesday, November 18, 2020 11:33 PM >>> >>> >>> With Connectx-4 Lx for example the netdev can have at most 63 queues >>> leaving 96 cpu servers a bit short - as an example of the limited number of >>> queues that a nic can handle (or currently exposes to the OS not sure which). >>> If I create a subfunction for ethernet traffic, how many queues are allocated >>> to it by default, is it managed via ethtool like the pf and is there an impact to >>> the resources used by / available to the primary device? >> >> Jason already answered it with details. >> Thanks a lot Jason. >> >> Short answer to ethtool question, yes, ethtool can change num queues for subfunction like PF. >> Default is same number of queues for subfunction as that of PF in this patchset. >> > > But what is the mechanism for partitioning the global resources of the > device into each sub function? > > Is it just evenly divided into the subfunctions? is there some maximum > limit per sub function? > I hope it is not just evenly divided; it should be user controllable. If I create a subfunction for say a container's networking, I may want to only assign 1 Rx and 1 Tx queue pair (or 1 channel depending on terminology where channel includes Rx, Tx and CQ).