From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-13.7 required=3.0 tests=BAYES_00, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_CR_TRAILER,INCLUDES_PATCH, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id B04D0C4707F for ; Thu, 27 May 2021 14:27:25 +0000 (UTC) Received: from mails.dpdk.org (mails.dpdk.org [217.70.189.124]) by mail.kernel.org (Postfix) with ESMTP id 3E0EF600D3 for ; Thu, 27 May 2021 14:27:25 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 3E0EF600D3 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=intel.com Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=dev-bounces@dpdk.org Received: from [217.70.189.124] (localhost [127.0.0.1]) by mails.dpdk.org (Postfix) with ESMTP id 8973A40150; Thu, 27 May 2021 16:27:24 +0200 (CEST) Received: from mga09.intel.com (mga09.intel.com [134.134.136.24]) by mails.dpdk.org (Postfix) with ESMTP id E2FBA40143 for ; Thu, 27 May 2021 16:27:22 +0200 (CEST) IronPort-SDR: MsMLlzX6x6Zb6C/7VLhPfivO2n+f2tIXMLaAFpXhCkVcZHu9Zqfn5EJiz22T6pSoLNE4HKcb8J dDxGqK8DpZQw== X-IronPort-AV: E=McAfee;i="6200,9189,9996"; a="202751123" X-IronPort-AV: E=Sophos;i="5.82,334,1613462400"; d="scan'208";a="202751123" Received: from fmsmga008.fm.intel.com ([10.253.24.58]) by orsmga102.jf.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-GCM-SHA384; 27 May 2021 07:27:21 -0700 IronPort-SDR: lxY7kYtgC3Hrwflf9kYW9ncKSZQaIESUJs0Drew27NddJ73qHmYwNLp7L+2wSxnarfF6+L0+CC +nvQGxHi38NQ== X-IronPort-AV: E=Sophos;i="5.82,334,1613462400"; d="scan'208";a="445034351" Received: from bricha3-mobl.ger.corp.intel.com ([10.252.6.178]) by fmsmga008-auth.fm.intel.com with ESMTP/TLS/ECDHE-RSA-AES256-SHA; 27 May 2021 07:27:20 -0700 Date: Thu, 27 May 2021 15:27:16 +0100 From: Bruce Richardson To: Kevin Laatz Cc: dev@dpdk.org Message-ID: References: <20210527132646.3565721-1-kevin.laatz@intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20210527132646.3565721-1-kevin.laatz@intel.com> Subject: Re: [dpdk-dev] [PATCH] raw/ioat: extend python script functionality X-BeenThere: dev@dpdk.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: DPDK patches and discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dev-bounces@dpdk.org Sender: "dev" On Thu, May 27, 2021 at 02:26:46PM +0100, Kevin Laatz wrote: > Currently the user needs to find the DSA instance number for any DSA > device they would like to configure using this script, which can be > cumbersome and error-prone since the instance numbering changes when > changing the binding of the devices between vfio-pci and idxd. In > addition to this, once the device is configured, there is no option to > reset the device using the script. > > This patch contains two additions to the script: > 1. Add the ability to specify the DSA device to configure using the > device's PCI address instead of the DSA instance number. For example, > "$dpdk_idxd_cfg.py 0" and "$dpdk_idxd_cfg.py 6a:01.0" are both valid > references to the same device (assuming the numbering). > 2. An option to reset the device via the script. For example, > "$dpdk_idxd_cfg.py 6a:01.0 --reset" > > Signed-off-by: Kevin Laatz > --- > drivers/raw/ioat/dpdk_idxd_cfg.py | 38 +++++++++++++++++++++++++++++-- > 1 file changed, 36 insertions(+), 2 deletions(-) > Hi Kevin, since you list out two changes here, it's a good indication that this might be better as two separate patches. Can you please split it, thanks. Couple of minor comments inline below too. Regards, /Bruce > diff --git a/drivers/raw/ioat/dpdk_idxd_cfg.py b/drivers/raw/ioat/dpdk_idxd_cfg.py > index ff06d9e240..7bc33b6ddb 100755 > --- a/drivers/raw/ioat/dpdk_idxd_cfg.py > +++ b/drivers/raw/ioat/dpdk_idxd_cfg.py > @@ -29,6 +29,29 @@ def write_values(self, values): > f.write(str(contents)) > > > +def reset_device(dsa_id): > + "Reset the DSA device and all its queues" > + drv_dir = SysfsDir("/sys/bus/dsa/drivers/dsa") > + drv_dir.write_values({"unbind": f"dsa{dsa_id}"}) > + > + > +def get_pci_dir(pci): > + "Search for the sysfs directory of the PCI device" > + full_pci = pci if pci.startswith("0000:") else f"0000:{pci}" This will limit the script to only working on domains starting with 0000. While I'm not aware of any specific cases where this won't work, for generality sake, can we detect the presence/absense of the 0000: in some other way, e.g. length, or count of ":" characters? > + if os.path.exists(f'/sys/bus/pci/devices/{full_pci}'): > + return f'/sys/bus/pci/devices/{full_pci}' > + return None > + > + > +def get_dsa_id(pci): > + "Get the DSA instance ID using the PCI address of the device" > + pci_dir = get_pci_dir(pci) > + for path, dirs, files in os.walk(pci_dir): What happens if pci_dir is None? > + for dir in dirs: > + if dir.startswith('dsa') and 'wq' not in dir: > + return int(dir[3:]) > + > + > def configure_dsa(dsa_id, queues, prefix): > "Configure the DSA instance with appropriate number of queues" > dsa_dir = SysfsDir(f"/sys/bus/dsa/devices/dsa{dsa_id}") > @@ -68,14 +91,25 @@ def main(args): > "Main function, does arg parsing and calls config function" > arg_p = argparse.ArgumentParser( > description="Configure whole DSA device instance for DPDK use") > - arg_p.add_argument('dsa_id', type=int, help="DSA instance number") > + arg_p.add_argument('dsa_id', > + help="Specify DSA instance either via DSA instance number or PCI address") > arg_p.add_argument('-q', metavar='queues', type=int, default=255, > help="Number of queues to set up") > arg_p.add_argument('--name-prefix', metavar='prefix', dest='prefix', > default="dpdk", > help="Prefix for workqueue name to mark for DPDK use [default: 'dpdk']") > + arg_p.add_argument('--reset', action='store_true', > + help="Reset DSA device and its queues") > parsed_args = arg_p.parse_args(args[1:]) > - configure_dsa(parsed_args.dsa_id, parsed_args.q, parsed_args.prefix) > + > + dsa_id = parsed_args.dsa_id > + dsa_id = get_dsa_id(dsa_id) if ':' in dsa_id else dsa_id > + if parsed_args.reset: > + print(f"Resetting DSA instance {dsa_id}") > + reset_device(dsa_id) > + else: > + print(f"Configuring DSA instance {dsa_id}") > + configure_dsa(dsa_id, parsed_args.q, parsed_args.prefix) > > > if __name__ == "__main__": > -- > 2.30.2 >