From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from [140.186.70.92] (port=59962 helo=eggs.gnu.org) by lists.gnu.org with esmtp (Exim 4.43) id 1PgK1q-000084-Ne for qemu-devel@nongnu.org; Fri, 21 Jan 2011 11:40:04 -0500 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1PgK1p-0001SM-3C for qemu-devel@nongnu.org; Fri, 21 Jan 2011 11:40:02 -0500 Received: from mail.valinux.co.jp ([210.128.90.3]:56058) by eggs.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1PgK1o-0001Rs-Fa for qemu-devel@nongnu.org; Fri, 21 Jan 2011 11:40:01 -0500 Date: Sat, 22 Jan 2011 01:39:57 +0900 From: Isaku Yamahata Message-ID: <20110121163957.GG20801@valinux.co.jp> References: <20110120141548.GC15426@redhat.com> <20110121104416.GE20801@valinux.co.jp> <20110121142940.GB6980@redhat.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20110121142940.GB6980@redhat.com> Subject: [Qemu-devel] Re: [PATCH] pci/pcie: make pci_find_device() ARI aware. List-Id: qemu-devel.nongnu.org List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: "Michael S. Tsirkin" Cc: qemu-devel@nongnu.org On Fri, Jan 21, 2011 at 04:29:41PM +0200, Michael S. Tsirkin wrote: > On Fri, Jan 21, 2011 at 07:44:16PM +0900, Isaku Yamahata wrote: > > On Thu, Jan 20, 2011 at 04:15:48PM +0200, Michael S. Tsirkin wrote: > > > On Thu, Jan 20, 2011 at 03:57:39PM +0900, Isaku Yamahata wrote: > > > > make pci_find_device() ARI aware. > > > > > > > > Signed-off-by: Isaku Yamahata > > > > --- > > > > hw/pci.c | 7 +++++++ > > > > 1 files changed, 7 insertions(+), 0 deletions(-) > > > > > > > > diff --git a/hw/pci.c b/hw/pci.c > > > > index 8d0e3df..851f350 100644 > > > > --- a/hw/pci.c > > > > +++ b/hw/pci.c > > > > @@ -1596,11 +1596,18 @@ PCIBus *pci_find_bus(PCIBus *bus, int bus_num) > > > > > > > > PCIDevice *pci_find_device(PCIBus *bus, int bus_num, int slot, int function) > > > > { > > > > + PCIDevice *d; > > > > bus = pci_find_bus(bus, bus_num); > > > > > > > > if (!bus) > > > > return NULL; > > > > > > > > + d = bus->parent_dev; > > > > + if (d && pci_is_express(d) && > > > > + pcie_cap_get_type(d) == PCI_EXP_TYPE_DOWNSTREAM && > > > > + !pcie_cap_is_ari_enabled(d) && slot > 0) { > > > > + return NULL; > > > > + } > > > > return bus->devices[PCI_DEVFN(slot, function)]; > > > > } > > > > > > I'd like to split this express-specific code out in some way. > > > Further, the downstream port always has a single slot. > > > Maybe it shouldn't be a bus at all, but this needs some thought. > > > > Yes, it needs consideration. > > > > > > > How about we put flag in PCIBus that says that a single > > > slot is supported? Downstream ports would just set it. > > > > So such a flag must be set/clear by something like pcie_cap_ari_write_config() > > depending on ARI bit at runtime. > > Well, to figure it out, could you please describe what is the situation > your patch tries to fix? I would generally would like a reason for the > change to be given in commit logs, please try to avoid just restating > what the patch does. It seems that I should have added the comment to refer the spec. I'd like to implement ARI enable bit correctly. Downstream port(and root port) doesn't forward pci transaction for function > 7 by default for compatibility, Only when ARI forwarding enable bit of downstream/root port is set, the virtual p2p bridge forwards pci transaction for function > 7 (i.e. slot > 0). 6.13 Alternative routing-ID Interpretation(ARI) 7.8.15 Device capabilites 2 register ARI forwarding supproted 7.8.16 Device control 2 register ARI forwarding Enable 5 ARI Forwarding Enable When set, the Downstream Port disables its traditional Device Number field being 0 enforcement when turning a Type 1 Configuration Request into a Type 0 Configuration Request, permitting access to Extended Functions in an ARI Device immediately below the Port. See Section 6.13. Default value of this bit is 0b. Must be hardwired to 0b if the ARI Forwarding Supported bit is 0b. Oh, the patch should check root port in addition to downstream port. > Are you trying to create a device with > 8 functions? > If that is the case I suspect this is not the best way > to do this at all. > > > pcie device can have 256 functions instead of 8. > > Only if it's an ARI device. And note that if you have a device with > 256 functions and disable ARI in the port, it appears as > multiple devices. > > > Maybe we'd like to emulate how p2p bridge transfers pci transaction > > to child pci bus somehow. > > To support > 8 functions per device, some refactoring would be needed: > you can not figure out slot and function from the root bus, > it depends on ARI along the way. So APIs that pass in > decoded slot/function do not make sense anymore, > you must pass in devfn all the way. > > But since everyone decodes and encodes them in the same way, > many things will work even without decoding. I think there are only two issues to address. Configuration space and hot plug. As you already described it, ARI is defined such that APIs can stay same, just interpret slot bits as part of function number. This patch addresses configuration space access. Multifunction hot plug hasn't been addressed even for conventional pci case. Some kind of refactoring would be necessary for it, I think. -- yamahata