* [PATCH] pci/sriov: Hold rescan lock while enumerating @ 2018-08-09 16:33 Keith Busch 2018-08-09 17:58 ` Lukas Wunner 2018-09-05 20:58 ` Bjorn Helgaas 0 siblings, 2 replies; 6+ messages in thread From: Keith Busch @ 2018-08-09 16:33 UTC (permalink / raw) To: Linux PCI, Bjorn Helgaas; +Cc: Keith Busch, stable PCI enumeration/de-enumeration needs to run single threaded to prevent race conditions with other threads changing the topology. Altering the number of virtual functions was not taking the rescan/remove lock hile adding or removing those virtual functions, so this patch adds that. Reported-by: Krzysztof Wierzbicki <krzysztof.wierzbicki@intel.com> Cc: stable@vger.kernel.org Signed-off-by: Keith Busch <keith.busch@intel.com> --- drivers/pci/pci-sysfs.c | 2 ++ 1 file changed, 2 insertions(+) diff --git a/drivers/pci/pci-sysfs.c b/drivers/pci/pci-sysfs.c index 9ecfe13157c0..611abe220b6f 100644 --- a/drivers/pci/pci-sysfs.c +++ b/drivers/pci/pci-sysfs.c @@ -591,6 +591,7 @@ static ssize_t sriov_numvfs_store(struct device *dev, if (num_vfs > pci_sriov_get_totalvfs(pdev)) return -ERANGE; + pci_lock_rescan_remove(); device_lock(&pdev->dev); if (num_vfs == pdev->sriov->num_VFs) @@ -627,6 +628,7 @@ static ssize_t sriov_numvfs_store(struct device *dev, exit: device_unlock(&pdev->dev); + pci_unlock_rescan_remove(); if (ret < 0) return ret; -- 2.14.4 ^ permalink raw reply related [flat|nested] 6+ messages in thread
* Re: [PATCH] pci/sriov: Hold rescan lock while enumerating 2018-08-09 16:33 [PATCH] pci/sriov: Hold rescan lock while enumerating Keith Busch @ 2018-08-09 17:58 ` Lukas Wunner 2018-08-09 18:05 ` Keith Busch 2018-09-05 20:58 ` Bjorn Helgaas 1 sibling, 1 reply; 6+ messages in thread From: Lukas Wunner @ 2018-08-09 17:58 UTC (permalink / raw) To: Keith Busch; +Cc: Linux PCI, Bjorn Helgaas On Thu, Aug 09, 2018 at 10:33:56AM -0600, Keith Busch wrote: > --- a/drivers/pci/pci-sysfs.c > +++ b/drivers/pci/pci-sysfs.c > @@ -591,6 +591,7 @@ static ssize_t sriov_numvfs_store(struct device *dev, > if (num_vfs > pci_sriov_get_totalvfs(pdev)) > return -ERANGE; > > + pci_lock_rescan_remove(); > device_lock(&pdev->dev); Doesn't this obviate the need to hold the device_lock()? What could otherwise run concurrently that doesn't hold pci_lock_rescan_remove() and would cause a race condition? Thanks, Lukas ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH] pci/sriov: Hold rescan lock while enumerating 2018-08-09 17:58 ` Lukas Wunner @ 2018-08-09 18:05 ` Keith Busch 0 siblings, 0 replies; 6+ messages in thread From: Keith Busch @ 2018-08-09 18:05 UTC (permalink / raw) To: Lukas Wunner; +Cc: Linux PCI, Bjorn Helgaas On Thu, Aug 09, 2018 at 07:58:19PM +0200, Lukas Wunner wrote: > On Thu, Aug 09, 2018 at 10:33:56AM -0600, Keith Busch wrote: > > --- a/drivers/pci/pci-sysfs.c > > +++ b/drivers/pci/pci-sysfs.c > > @@ -591,6 +591,7 @@ static ssize_t sriov_numvfs_store(struct device *dev, > > if (num_vfs > pci_sriov_get_totalvfs(pdev)) > > return -ERANGE; > > > > + pci_lock_rescan_remove(); > > device_lock(&pdev->dev); > > Doesn't this obviate the need to hold the device_lock()? What could > otherwise run concurrently that doesn't hold pci_lock_rescan_remove() > and would cause a race condition? The device_lock is still needed to protect against concurrent pci_reset_function. ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH] pci/sriov: Hold rescan lock while enumerating 2018-08-09 16:33 [PATCH] pci/sriov: Hold rescan lock while enumerating Keith Busch 2018-08-09 17:58 ` Lukas Wunner @ 2018-09-05 20:58 ` Bjorn Helgaas 2018-09-05 21:12 ` Keith Busch 1 sibling, 1 reply; 6+ messages in thread From: Bjorn Helgaas @ 2018-09-05 20:58 UTC (permalink / raw) To: Keith Busch; +Cc: Linux PCI, Bjorn Helgaas, Lukas Wunner [+cc Lukas, -stable] On Thu, Aug 09, 2018 at 10:33:56AM -0600, Keith Busch wrote: > PCI enumeration/de-enumeration needs to run single threaded to prevent > race conditions with other threads changing the topology. Altering the > number of virtual functions was not taking the rescan/remove lock hile > adding or removing those virtual functions, so this patch adds that. > > Reported-by: Krzysztof Wierzbicki <krzysztof.wierzbicki@intel.com> > Cc: stable@vger.kernel.org > Signed-off-by: Keith Busch <keith.busch@intel.com> > --- > drivers/pci/pci-sysfs.c | 2 ++ > 1 file changed, 2 insertions(+) > > diff --git a/drivers/pci/pci-sysfs.c b/drivers/pci/pci-sysfs.c > index 9ecfe13157c0..611abe220b6f 100644 > --- a/drivers/pci/pci-sysfs.c > +++ b/drivers/pci/pci-sysfs.c > @@ -591,6 +591,7 @@ static ssize_t sriov_numvfs_store(struct device *dev, > if (num_vfs > pci_sriov_get_totalvfs(pdev)) > return -ERANGE; > > + pci_lock_rescan_remove(); I assume the usual path is something like this, where we end up in pci_enable_sriov(): sriov_numvfs_store + pci_lock_rescan_remove pdev->driver->sriov_configure ... pci_enable_sriov sriov_enable pci_iov_add_virtfn pci_alloc_dev pci_device_add But what about the other paths leading to pci_iov_add_virtfn()? Don't we need similar locking for all of them? > device_lock(&pdev->dev); > > if (num_vfs == pdev->sriov->num_VFs) > @@ -627,6 +628,7 @@ static ssize_t sriov_numvfs_store(struct device *dev, > > exit: > device_unlock(&pdev->dev); > + pci_unlock_rescan_remove(); > > if (ret < 0) > return ret; > -- > 2.14.4 > ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH] pci/sriov: Hold rescan lock while enumerating 2018-09-05 20:58 ` Bjorn Helgaas @ 2018-09-05 21:12 ` Keith Busch 2018-09-05 22:13 ` Bjorn Helgaas 0 siblings, 1 reply; 6+ messages in thread From: Keith Busch @ 2018-09-05 21:12 UTC (permalink / raw) To: Bjorn Helgaas; +Cc: Linux PCI, Bjorn Helgaas, Lukas Wunner On Wed, Sep 05, 2018 at 03:58:40PM -0500, Bjorn Helgaas wrote: > [+cc Lukas, -stable] > > On Thu, Aug 09, 2018 at 10:33:56AM -0600, Keith Busch wrote: > > PCI enumeration/de-enumeration needs to run single threaded to prevent > > race conditions with other threads changing the topology. Altering the > > number of virtual functions was not taking the rescan/remove lock hile > > adding or removing those virtual functions, so this patch adds that. > > > > Reported-by: Krzysztof Wierzbicki <krzysztof.wierzbicki@intel.com> > > Cc: stable@vger.kernel.org > > Signed-off-by: Keith Busch <keith.busch@intel.com> > > --- > > drivers/pci/pci-sysfs.c | 2 ++ > > 1 file changed, 2 insertions(+) > > > > diff --git a/drivers/pci/pci-sysfs.c b/drivers/pci/pci-sysfs.c > > index 9ecfe13157c0..611abe220b6f 100644 > > --- a/drivers/pci/pci-sysfs.c > > +++ b/drivers/pci/pci-sysfs.c > > @@ -591,6 +591,7 @@ static ssize_t sriov_numvfs_store(struct device *dev, > > if (num_vfs > pci_sriov_get_totalvfs(pdev)) > > return -ERANGE; > > > > + pci_lock_rescan_remove(); > > I assume the usual path is something like this, where we end up in > pci_enable_sriov(): > > sriov_numvfs_store > + pci_lock_rescan_remove > pdev->driver->sriov_configure > ... > pci_enable_sriov > sriov_enable > pci_iov_add_virtfn > pci_alloc_dev > pci_device_add > > But what about the other paths leading to pci_iov_add_virtfn()? Don't > we need similar locking for all of them? Good point. It looks like the only other path to pci_iov_add_virtfn is through PPC eeh_reset_device, which coincidently enough already holds pci_lock_rescan_remove. It's not just pci_iov_add_virtfn, though. We also need to hold it during pci_iov_remove_virtfn. PPC eeh_rmv_device is not holding the lock in that path. I'll never be able to test with that h/w, but I'll look at it. > > device_lock(&pdev->dev); > > > > if (num_vfs == pdev->sriov->num_VFs) > > @@ -627,6 +628,7 @@ static ssize_t sriov_numvfs_store(struct device *dev, > > > > exit: > > device_unlock(&pdev->dev); > > + pci_unlock_rescan_remove(); > > > > if (ret < 0) > > return ret; > > -- > > 2.14.4 > > ^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [PATCH] pci/sriov: Hold rescan lock while enumerating 2018-09-05 21:12 ` Keith Busch @ 2018-09-05 22:13 ` Bjorn Helgaas 0 siblings, 0 replies; 6+ messages in thread From: Bjorn Helgaas @ 2018-09-05 22:13 UTC (permalink / raw) To: Keith Busch; +Cc: Linux PCI, Bjorn Helgaas, Lukas Wunner On Wed, Sep 05, 2018 at 03:12:41PM -0600, Keith Busch wrote: > On Wed, Sep 05, 2018 at 03:58:40PM -0500, Bjorn Helgaas wrote: > > [+cc Lukas, -stable] > > > > On Thu, Aug 09, 2018 at 10:33:56AM -0600, Keith Busch wrote: > > > PCI enumeration/de-enumeration needs to run single threaded to prevent > > > race conditions with other threads changing the topology. Altering the > > > number of virtual functions was not taking the rescan/remove lock hile > > > adding or removing those virtual functions, so this patch adds that. > > > > > > Reported-by: Krzysztof Wierzbicki <krzysztof.wierzbicki@intel.com> > > > Cc: stable@vger.kernel.org > > > Signed-off-by: Keith Busch <keith.busch@intel.com> > > > --- > > > drivers/pci/pci-sysfs.c | 2 ++ > > > 1 file changed, 2 insertions(+) > > > > > > diff --git a/drivers/pci/pci-sysfs.c b/drivers/pci/pci-sysfs.c > > > index 9ecfe13157c0..611abe220b6f 100644 > > > --- a/drivers/pci/pci-sysfs.c > > > +++ b/drivers/pci/pci-sysfs.c > > > @@ -591,6 +591,7 @@ static ssize_t sriov_numvfs_store(struct device *dev, > > > if (num_vfs > pci_sriov_get_totalvfs(pdev)) > > > return -ERANGE; > > > > > > + pci_lock_rescan_remove(); > > > > I assume the usual path is something like this, where we end up in > > pci_enable_sriov(): > > > > sriov_numvfs_store > > + pci_lock_rescan_remove > > pdev->driver->sriov_configure > > ... > > pci_enable_sriov > > sriov_enable > > pci_iov_add_virtfn > > pci_alloc_dev > > pci_device_add > > > > But what about the other paths leading to pci_iov_add_virtfn()? Don't > > we need similar locking for all of them? > > Good point. It looks like the only other path to pci_iov_add_virtfn is > through PPC eeh_reset_device, which coincidently enough already holds > pci_lock_rescan_remove. There are a few .probe() methods that call pci_enable_sriov(), which leads to pci_iov_add_virtfn(): cavium_rng_probe cpt_probe enic_probe be_probe -> be_setup -> be_vf_setup igb_probe -> igb_sw_init -> igb_probe_vfs -> igb_enable_sriov ... > It's not just pci_iov_add_virtfn, though. We also need to hold it during > pci_iov_remove_virtfn. PPC eeh_rmv_device is not holding the lock in > that path. I'll never be able to test with that h/w, but I'll look at it. > > > > device_lock(&pdev->dev); > > > > > > if (num_vfs == pdev->sriov->num_VFs) > > > @@ -627,6 +628,7 @@ static ssize_t sriov_numvfs_store(struct device *dev, > > > > > > exit: > > > device_unlock(&pdev->dev); > > > + pci_unlock_rescan_remove(); > > > > > > if (ret < 0) > > > return ret; > > > -- > > > 2.14.4 > > > ^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2018-09-06 2:45 UTC | newest] Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2018-08-09 16:33 [PATCH] pci/sriov: Hold rescan lock while enumerating Keith Busch 2018-08-09 17:58 ` Lukas Wunner 2018-08-09 18:05 ` Keith Busch 2018-09-05 20:58 ` Bjorn Helgaas 2018-09-05 21:12 ` Keith Busch 2018-09-05 22:13 ` Bjorn Helgaas
This is a public inbox, see mirroring instructions for how to clone and mirror all data and code used for this inbox; as well as URLs for NNTP newsgroup(s).