From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id C3E69C433F5 for ; Thu, 7 Oct 2021 00:06:01 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 7760E611AE for ; Thu, 7 Oct 2021 00:06:01 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 7760E611AE Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=lists.xenproject.org Received: from list by lists.xenproject.org with outflank-mailman.203222.358296 (Exim 4.92) (envelope-from ) id 1mYGuz-0004B5-R0; Thu, 07 Oct 2021 00:05:49 +0000 X-Outflank-Mailman: Message body and most headers restored to incoming version Received: by outflank-mailman (output) from mailman id 203222.358296; Thu, 07 Oct 2021 00:05:49 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1mYGuz-0004Ax-Nr; Thu, 07 Oct 2021 00:05:49 +0000 Received: by outflank-mailman (input) for mailman id 203222; Thu, 07 Oct 2021 00:05:49 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from ) id 1mYGuz-0004Ar-91 for xen-devel@lists.xenproject.org; Thu, 07 Oct 2021 00:05:49 +0000 Received: from mail.kernel.org (unknown [198.145.29.99]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id b29e4874-3b25-489b-89a8-02544800e891; Thu, 07 Oct 2021 00:05:48 +0000 (UTC) Received: by mail.kernel.org (Postfix) with ESMTPSA id DF2A8611AE; Thu, 7 Oct 2021 00:05:46 +0000 (UTC) X-BeenThere: xen-devel@lists.xenproject.org List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Precedence: list Sender: "Xen-devel" X-Inumbo-ID: b29e4874-3b25-489b-89a8-02544800e891 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1633565147; bh=RFun/EXF6Yo5YOmS5cvmtnE5CXekcf4VjcqYO76nN3Q=; h=Date:From:To:cc:Subject:In-Reply-To:References:From; b=Enbmg8P+SLo3oqyLkjdRi+X2IJO00Gvb3aCSBGTlyWp8k7Oj0NSMAT6thpnus32Mi rCoqYHPzYF2wuIX6i8m6qJw2UsldPJZwyhrIV8Z4t5dA3Uc85ta+Q1Z2h43E1nC3E4 06JO0t9oFVtot0AKkq4xSAV46l97Jtg+QVojtLTwh3QEF15gbG5WowkFRNGrPLzUUi zy37sPreS/r8lZN1dnUNBTfKsKXl67cpl0P/Plp9gJMuB/aJ/YmQ8jKFvpe4qZEm4f ABDv+oQS2h+BPzn9Q2AOQyIJYhJweoPDM+Ph6ozLawZz4EzYP3oChahGQLaD4vT2DB eepVlQoBpvcRQ== Date: Wed, 6 Oct 2021 17:05:45 -0700 (PDT) From: Stefano Stabellini X-X-Sender: sstabellini@sstabellini-ThinkPad-T480s To: Rahul Singh cc: xen-devel@lists.xenproject.org, bertrand.marquis@arm.com, Andre.Przywara@arm.com, Stefano Stabellini , Julien Grall , Volodymyr Babchuk , Andrew Cooper , George Dunlap , Ian Jackson , Jan Beulich , Wei Liu , =?UTF-8?Q?Roger_Pau_Monn=C3=A9?= Subject: Re: [PATCH v5 02/11] xen/arm: Add PHYSDEVOP_pci_device_(*add/remove) support for ARM In-Reply-To: <0dc4423b2e20c1eb40c961b211b18ed041f707b7.1633540842.git.rahul.singh@arm.com> Message-ID: References: <0dc4423b2e20c1eb40c961b211b18ed041f707b7.1633540842.git.rahul.singh@arm.com> User-Agent: Alpine 2.21 (DEB 202 2017-01-01) MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII On Wed, 6 Oct 2021, Rahul Singh wrote: > Hardware domain is in charge of doing the PCI enumeration and will > discover the PCI devices and then will communicate to XEN via hyper > call PHYSDEVOP_pci_device_add(..) to add the PCI devices in XEN. > > Also implement PHYSDEVOP_pci_device_remove(..) to remove the PCI device. > > As most of the code for PHYSDEVOP_pci_device_* is the same between x86 > and ARM, move the code to a common file to avoid duplication. > > There are other PHYSDEVOP_pci_device_* operations to add PCI devices. > Currently implemented PHYSDEVOP_pci_device_remove(..) and > PHYSDEVOP_pci_device_add(..) only as those are minimum required to > support PCI passthrough on ARM. > > Signed-off-by: Rahul Singh Reviewed-by: Stefano Stabellini > --- > Change in v5: > - Move the pci_physdev_op() stub to xen/arch/arm/physdev.c. > Change in v4: > - Move file commom/physdev.c to drivers/pci/physdev.c > - minor comments. > Change in v3: Fixed minor comment. > Change in v2: > - Add support for PHYSDEVOP_pci_device_remove() > - Move code to common code > --- > --- > xen/arch/arm/physdev.c | 6 ++- > xen/arch/x86/physdev.c | 52 +---------------------- > xen/arch/x86/x86_64/physdev.c | 2 +- > xen/drivers/pci/Makefile | 1 + > xen/drivers/pci/physdev.c | 80 +++++++++++++++++++++++++++++++++++ > xen/include/public/arch-arm.h | 4 +- > xen/include/xen/hypercall.h | 4 ++ > 7 files changed, 96 insertions(+), 53 deletions(-) > create mode 100644 xen/drivers/pci/physdev.c > > diff --git a/xen/arch/arm/physdev.c b/xen/arch/arm/physdev.c > index e91355fe22..f9aa274dda 100644 > --- a/xen/arch/arm/physdev.c > +++ b/xen/arch/arm/physdev.c > @@ -8,13 +8,17 @@ > #include > #include > #include > -#include > +#include > > > int do_physdev_op(int cmd, XEN_GUEST_HANDLE_PARAM(void) arg) > { > +#ifdef CONFIG_HAS_PCI > + return pci_physdev_op(cmd, arg); > +#else > gdprintk(XENLOG_DEBUG, "PHYSDEVOP cmd=%d: not implemented\n", cmd); > return -ENOSYS; > +#endif > } > > /* > diff --git a/xen/arch/x86/physdev.c b/xen/arch/x86/physdev.c > index 23465bcd00..ea38be8b79 100644 > --- a/xen/arch/x86/physdev.c > +++ b/xen/arch/x86/physdev.c > @@ -12,7 +12,7 @@ > #include > #include > #include > -#include > +#include > #include > #include > #include > @@ -480,54 +480,6 @@ ret_t do_physdev_op(int cmd, XEN_GUEST_HANDLE_PARAM(void) arg) > break; > } > > - case PHYSDEVOP_pci_device_add: { > - struct physdev_pci_device_add add; > - struct pci_dev_info pdev_info; > - nodeid_t node; > - > - ret = -EFAULT; > - if ( copy_from_guest(&add, arg, 1) != 0 ) > - break; > - > - pdev_info.is_extfn = !!(add.flags & XEN_PCI_DEV_EXTFN); > - if ( add.flags & XEN_PCI_DEV_VIRTFN ) > - { > - pdev_info.is_virtfn = 1; > - pdev_info.physfn.bus = add.physfn.bus; > - pdev_info.physfn.devfn = add.physfn.devfn; > - } > - else > - pdev_info.is_virtfn = 0; > - > - if ( add.flags & XEN_PCI_DEV_PXM ) > - { > - uint32_t pxm; > - size_t optarr_off = offsetof(struct physdev_pci_device_add, optarr) / > - sizeof(add.optarr[0]); > - > - if ( copy_from_guest_offset(&pxm, arg, optarr_off, 1) ) > - break; > - > - node = pxm_to_node(pxm); > - } > - else > - node = NUMA_NO_NODE; > - > - ret = pci_add_device(add.seg, add.bus, add.devfn, &pdev_info, node); > - break; > - } > - > - case PHYSDEVOP_pci_device_remove: { > - struct physdev_pci_device dev; > - > - ret = -EFAULT; > - if ( copy_from_guest(&dev, arg, 1) != 0 ) > - break; > - > - ret = pci_remove_device(dev.seg, dev.bus, dev.devfn); > - break; > - } > - > case PHYSDEVOP_prepare_msix: > case PHYSDEVOP_release_msix: { > struct physdev_pci_device dev; > @@ -663,7 +615,7 @@ ret_t do_physdev_op(int cmd, XEN_GUEST_HANDLE_PARAM(void) arg) > } > > default: > - ret = -ENOSYS; > + ret = pci_physdev_op(cmd, arg); > break; > } > > diff --git a/xen/arch/x86/x86_64/physdev.c b/xen/arch/x86/x86_64/physdev.c > index 0a50cbd4d8..e3cbd5ebcb 100644 > --- a/xen/arch/x86/x86_64/physdev.c > +++ b/xen/arch/x86/x86_64/physdev.c > @@ -9,7 +9,7 @@ EMIT_FILE; > #include > #include > #include > -#include > +#include > > #define do_physdev_op compat_physdev_op > > diff --git a/xen/drivers/pci/Makefile b/xen/drivers/pci/Makefile > index a98035df4c..972c923db0 100644 > --- a/xen/drivers/pci/Makefile > +++ b/xen/drivers/pci/Makefile > @@ -1 +1,2 @@ > obj-y += pci.o > +obj-y += physdev.o > diff --git a/xen/drivers/pci/physdev.c b/xen/drivers/pci/physdev.c > new file mode 100644 > index 0000000000..4f3e1a96c0 > --- /dev/null > +++ b/xen/drivers/pci/physdev.c > @@ -0,0 +1,80 @@ > + > +#include > +#include > +#include > + > +#ifndef COMPAT > +typedef long ret_t; > +#endif > + > +ret_t pci_physdev_op(int cmd, XEN_GUEST_HANDLE_PARAM(void) arg) > +{ > + ret_t ret; > + > + switch ( cmd ) > + { > + case PHYSDEVOP_pci_device_add: { > + struct physdev_pci_device_add add; > + struct pci_dev_info pdev_info; > + nodeid_t node = NUMA_NO_NODE; > + > + ret = -EFAULT; > + if ( copy_from_guest(&add, arg, 1) != 0 ) > + break; > + > + pdev_info.is_extfn = (add.flags & XEN_PCI_DEV_EXTFN); > + if ( add.flags & XEN_PCI_DEV_VIRTFN ) > + { > + pdev_info.is_virtfn = true; > + pdev_info.physfn.bus = add.physfn.bus; > + pdev_info.physfn.devfn = add.physfn.devfn; > + } > + else > + pdev_info.is_virtfn = false; > + > +#ifdef CONFIG_NUMA > + if ( add.flags & XEN_PCI_DEV_PXM ) > + { > + uint32_t pxm; > + size_t optarr_off = offsetof(struct physdev_pci_device_add, optarr) / > + sizeof(add.optarr[0]); > + > + if ( copy_from_guest_offset(&pxm, arg, optarr_off, 1) ) > + break; > + > + node = pxm_to_node(pxm); > + } > +#endif > + > + ret = pci_add_device(add.seg, add.bus, add.devfn, &pdev_info, node); > + break; > + } > + > + case PHYSDEVOP_pci_device_remove: { > + struct physdev_pci_device dev; > + > + ret = -EFAULT; > + if ( copy_from_guest(&dev, arg, 1) != 0 ) > + break; > + > + ret = pci_remove_device(dev.seg, dev.bus, dev.devfn); > + break; > + } > + > + default: > + ret = -ENOSYS; > + break; > + } > + > + return ret; > +} > + > +/* > + * Local variables: > + * mode: C > + * c-file-style: "BSD" > + * c-basic-offset: 4 > + * tab-width: 4 > + * indent-tabs-mode: nil > + * End: > + */ > diff --git a/xen/include/public/arch-arm.h b/xen/include/public/arch-arm.h > index 6b5a5f818a..d46c61fca9 100644 > --- a/xen/include/public/arch-arm.h > +++ b/xen/include/public/arch-arm.h > @@ -107,7 +107,9 @@ > * All generic sub-operations > * > * HYPERVISOR_physdev_op > - * No sub-operations are currenty supported > + * Exactly these sub-operations are supported: > + * PHYSDEVOP_pci_device_add > + * PHYSDEVOP_pci_device_remove > * > * HYPERVISOR_sysctl > * All generic sub-operations, with the exception of: > diff --git a/xen/include/xen/hypercall.h b/xen/include/xen/hypercall.h > index 3771487a30..07b10ec230 100644 > --- a/xen/include/xen/hypercall.h > +++ b/xen/include/xen/hypercall.h > @@ -45,6 +45,10 @@ extern long > do_platform_op( > XEN_GUEST_HANDLE_PARAM(xen_platform_op_t) u_xenpf_op); > > +extern long > +pci_physdev_op( > + int cmd, XEN_GUEST_HANDLE_PARAM(void) arg); > + > /* > * To allow safe resume of do_memory_op() after preemption, we need to know > * at what point in the page list to resume. For this purpose I steal the > -- > 2.25.1 >