From: Jason Gunthorpe <jgg@nvidia.com> To: Alex Williamson <alex.williamson@redhat.com> Cc: ankita@nvidia.com, maz@kernel.org, oliver.upton@linux.dev, james.morse@arm.com, suzuki.poulose@arm.com, yuzenghui@huawei.com, reinette.chatre@intel.com, surenb@google.com, stefanha@redhat.com, brauner@kernel.org, catalin.marinas@arm.com, will@kernel.org, mark.rutland@arm.com, kevin.tian@intel.com, yi.l.liu@intel.com, ardb@kernel.org, akpm@linux-foundation.org, andreyknvl@gmail.com, wangjinchao@xfusion.com, gshan@redhat.com, ricarkol@google.com, linux-mm@kvack.org, lpieralisi@kernel.org, rananta@google.com, ryan.roberts@arm.com, aniketa@nvidia.com, cjia@nvidia.com, kwankhede@nvidia.com, targupta@nvidia.com, vsethi@nvidia.com, acurrid@nvidia.com, apopple@nvidia.com, jhubbard@nvidia.com, danw@nvidia.com, kvmarm@lists.linux.dev, mochs@nvidia.com, zhiw@nvidia.com, kvm@vger.kernel.org, linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org Subject: Re: [PATCH v6 4/4] vfio: convey kvm that the vfio-pci device is wc safe Date: Thu, 8 Feb 2024 13:54:37 -0400 [thread overview] Message-ID: <20240208175437.GN10476@nvidia.com> (raw) In-Reply-To: <20240208103022.452a1ba3.alex.williamson@redhat.com> On Thu, Feb 08, 2024 at 10:30:22AM -0700, Alex Williamson wrote: > On Thu, 8 Feb 2024 02:16:52 +0530 > <ankita@nvidia.com> wrote: > > > From: Ankit Agrawal <ankita@nvidia.com> > > > > The code to map the MMIO in S2 as NormalNC is enabled when conveyed > > that the device is WC safe using a new flag VM_VFIO_ALLOW_WC. > > > > Make vfio-pci set the VM_VFIO_ALLOW_WC flag. > > > > This could be extended to other devices in the future once that > > is deemed safe. > > > > Signed-off-by: Ankit Agrawal <ankita@nvidia.com> > > Suggested-by: Catalin Marinas <catalin.marinas@arm.com> > > Acked-by: Jason Gunthorpe <jgg@nvidia.com> > > --- > > drivers/vfio/pci/vfio_pci_core.c | 3 ++- > > 1 file changed, 2 insertions(+), 1 deletion(-) > > > > diff --git a/drivers/vfio/pci/vfio_pci_core.c b/drivers/vfio/pci/vfio_pci_core.c > > index 1cbc990d42e0..c3f95ec7fc3a 100644 > > --- a/drivers/vfio/pci/vfio_pci_core.c > > +++ b/drivers/vfio/pci/vfio_pci_core.c > > @@ -1863,7 +1863,8 @@ int vfio_pci_core_mmap(struct vfio_device *core_vdev, struct vm_area_struct *vma > > * See remap_pfn_range(), called from vfio_pci_fault() but we can't > > * change vm_flags within the fault handler. Set them now. > > */ > > - vm_flags_set(vma, VM_IO | VM_PFNMAP | VM_DONTEXPAND | VM_DONTDUMP); > > + vm_flags_set(vma, VM_VFIO_ALLOW_WC | VM_IO | VM_PFNMAP | > > + VM_DONTEXPAND | VM_DONTDUMP); > > vma->vm_ops = &vfio_pci_mmap_ops; > > > > return 0; > > The comment above this is justifying the flags as equivalent to those > set by the remap_pfn_range() path. That's no longer the case and the > additional flag needs to be described there. > > I'm honestly surprised that a vm_flags bit named so specifically for a > single driver has gotten this far. IIRC there was a small bike shed and this is what we came up with. Realistically it should not be used by anything but VFIO and KVM together. Generic names do sometimes invite abuse :) > It seems like the vfio use case for > this and associated FUD for other use cases could all be encompassed > in I think Ankit is talking about vfio-platform drivers by "other devices". This is largely why it exists at all, there is a fear that the non-PCI VFIO devices will not be implemented the same as the PCI devices. If any platform devices have workloads that require WC and have HW that is safe then they will set the flag somehow in the vfio platform drivers. > the comment where the bit is defined and we could use a name like > VM_ALLOW_ANY_UNCACHED or VM_IO_ANY. Thanks, I'd pick VM_ALLOW_ANY_UNCACHED of those two Thanks, Jason
WARNING: multiple messages have this Message-ID (diff)
From: Jason Gunthorpe <jgg@nvidia.com> To: Alex Williamson <alex.williamson@redhat.com> Cc: ankita@nvidia.com, maz@kernel.org, oliver.upton@linux.dev, james.morse@arm.com, suzuki.poulose@arm.com, yuzenghui@huawei.com, reinette.chatre@intel.com, surenb@google.com, stefanha@redhat.com, brauner@kernel.org, catalin.marinas@arm.com, will@kernel.org, mark.rutland@arm.com, kevin.tian@intel.com, yi.l.liu@intel.com, ardb@kernel.org, akpm@linux-foundation.org, andreyknvl@gmail.com, wangjinchao@xfusion.com, gshan@redhat.com, ricarkol@google.com, linux-mm@kvack.org, lpieralisi@kernel.org, rananta@google.com, ryan.roberts@arm.com, aniketa@nvidia.com, cjia@nvidia.com, kwankhede@nvidia.com, targupta@nvidia.com, vsethi@nvidia.com, acurrid@nvidia.com, apopple@nvidia.com, jhubbard@nvidia.com, danw@nvidia.com, kvmarm@lists.linux.dev, mochs@nvidia.com, zhiw@nvidia.com, kvm@vger.kernel.org, linux-kernel@vger.kernel.org, linux-arm-kernel@lists.infradead.org Subject: Re: [PATCH v6 4/4] vfio: convey kvm that the vfio-pci device is wc safe Date: Thu, 8 Feb 2024 13:54:37 -0400 [thread overview] Message-ID: <20240208175437.GN10476@nvidia.com> (raw) In-Reply-To: <20240208103022.452a1ba3.alex.williamson@redhat.com> On Thu, Feb 08, 2024 at 10:30:22AM -0700, Alex Williamson wrote: > On Thu, 8 Feb 2024 02:16:52 +0530 > <ankita@nvidia.com> wrote: > > > From: Ankit Agrawal <ankita@nvidia.com> > > > > The code to map the MMIO in S2 as NormalNC is enabled when conveyed > > that the device is WC safe using a new flag VM_VFIO_ALLOW_WC. > > > > Make vfio-pci set the VM_VFIO_ALLOW_WC flag. > > > > This could be extended to other devices in the future once that > > is deemed safe. > > > > Signed-off-by: Ankit Agrawal <ankita@nvidia.com> > > Suggested-by: Catalin Marinas <catalin.marinas@arm.com> > > Acked-by: Jason Gunthorpe <jgg@nvidia.com> > > --- > > drivers/vfio/pci/vfio_pci_core.c | 3 ++- > > 1 file changed, 2 insertions(+), 1 deletion(-) > > > > diff --git a/drivers/vfio/pci/vfio_pci_core.c b/drivers/vfio/pci/vfio_pci_core.c > > index 1cbc990d42e0..c3f95ec7fc3a 100644 > > --- a/drivers/vfio/pci/vfio_pci_core.c > > +++ b/drivers/vfio/pci/vfio_pci_core.c > > @@ -1863,7 +1863,8 @@ int vfio_pci_core_mmap(struct vfio_device *core_vdev, struct vm_area_struct *vma > > * See remap_pfn_range(), called from vfio_pci_fault() but we can't > > * change vm_flags within the fault handler. Set them now. > > */ > > - vm_flags_set(vma, VM_IO | VM_PFNMAP | VM_DONTEXPAND | VM_DONTDUMP); > > + vm_flags_set(vma, VM_VFIO_ALLOW_WC | VM_IO | VM_PFNMAP | > > + VM_DONTEXPAND | VM_DONTDUMP); > > vma->vm_ops = &vfio_pci_mmap_ops; > > > > return 0; > > The comment above this is justifying the flags as equivalent to those > set by the remap_pfn_range() path. That's no longer the case and the > additional flag needs to be described there. > > I'm honestly surprised that a vm_flags bit named so specifically for a > single driver has gotten this far. IIRC there was a small bike shed and this is what we came up with. Realistically it should not be used by anything but VFIO and KVM together. Generic names do sometimes invite abuse :) > It seems like the vfio use case for > this and associated FUD for other use cases could all be encompassed > in I think Ankit is talking about vfio-platform drivers by "other devices". This is largely why it exists at all, there is a fear that the non-PCI VFIO devices will not be implemented the same as the PCI devices. If any platform devices have workloads that require WC and have HW that is safe then they will set the flag somehow in the vfio platform drivers. > the comment where the bit is defined and we could use a name like > VM_ALLOW_ANY_UNCACHED or VM_IO_ANY. Thanks, I'd pick VM_ALLOW_ANY_UNCACHED of those two Thanks, Jason _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel
next prev parent reply other threads:[~2024-02-08 17:54 UTC|newest] Thread overview: 38+ messages / expand[flat|nested] mbox.gz Atom feed top 2024-02-07 20:46 [PATCH v6 0/4] kvm: arm64: allow the VM to select DEVICE_* and NORMAL_NC for IO memory ankita 2024-02-07 20:46 ` ankita 2024-02-07 20:46 ` [PATCH v6 1/4] kvm: arm64: introduce new flag for non-cacheable " ankita 2024-02-07 20:46 ` ankita 2024-02-08 13:00 ` Catalin Marinas 2024-02-08 13:00 ` Catalin Marinas 2024-02-08 13:24 ` Oliver Upton 2024-02-08 13:24 ` Oliver Upton 2024-02-09 14:10 ` Ankit Agrawal 2024-02-09 14:10 ` Ankit Agrawal 2024-02-08 13:19 ` Will Deacon 2024-02-08 13:19 ` Will Deacon 2024-02-09 14:12 ` Ankit Agrawal 2024-02-09 14:12 ` Ankit Agrawal 2024-02-07 20:46 ` [PATCH v6 2/4] mm: introduce new flag to indicate wc safe ankita 2024-02-07 20:46 ` ankita 2024-02-08 13:03 ` Catalin Marinas 2024-02-08 13:03 ` Catalin Marinas 2024-02-08 14:34 ` Jason Gunthorpe 2024-02-08 14:34 ` Jason Gunthorpe 2024-02-07 20:46 ` [PATCH v6 3/4] kvm: arm64: set io memory s2 pte as normalnc for vfio pci device ankita 2024-02-07 20:46 ` ankita 2024-02-08 13:26 ` Oliver Upton 2024-02-08 13:26 ` Oliver Upton 2024-02-08 14:51 ` Catalin Marinas 2024-02-08 14:51 ` Catalin Marinas 2024-02-09 14:05 ` Ankit Agrawal 2024-02-09 14:05 ` Ankit Agrawal 2024-02-07 20:46 ` [PATCH v6 4/4] vfio: convey kvm that the vfio-pci device is wc safe ankita 2024-02-07 20:46 ` ankita 2024-02-08 14:53 ` Catalin Marinas 2024-02-08 14:53 ` Catalin Marinas 2024-02-08 17:30 ` Alex Williamson 2024-02-08 17:30 ` Alex Williamson 2024-02-08 17:54 ` Jason Gunthorpe [this message] 2024-02-08 17:54 ` Jason Gunthorpe 2024-02-09 14:02 ` Ankit Agrawal 2024-02-09 14:02 ` Ankit Agrawal
Reply instructions: You may reply publicly to this message via plain-text email using any one of the following methods: * Save the following mbox file, import it into your mail client, and reply-to-all from there: mbox Avoid top-posting and favor interleaved quoting: https://en.wikipedia.org/wiki/Posting_style#Interleaved_style * Reply using the --to, --cc, and --in-reply-to switches of git-send-email(1): git send-email \ --in-reply-to=20240208175437.GN10476@nvidia.com \ --to=jgg@nvidia.com \ --cc=acurrid@nvidia.com \ --cc=akpm@linux-foundation.org \ --cc=alex.williamson@redhat.com \ --cc=andreyknvl@gmail.com \ --cc=aniketa@nvidia.com \ --cc=ankita@nvidia.com \ --cc=apopple@nvidia.com \ --cc=ardb@kernel.org \ --cc=brauner@kernel.org \ --cc=catalin.marinas@arm.com \ --cc=cjia@nvidia.com \ --cc=danw@nvidia.com \ --cc=gshan@redhat.com \ --cc=james.morse@arm.com \ --cc=jhubbard@nvidia.com \ --cc=kevin.tian@intel.com \ --cc=kvm@vger.kernel.org \ --cc=kvmarm@lists.linux.dev \ --cc=kwankhede@nvidia.com \ --cc=linux-arm-kernel@lists.infradead.org \ --cc=linux-kernel@vger.kernel.org \ --cc=linux-mm@kvack.org \ --cc=lpieralisi@kernel.org \ --cc=mark.rutland@arm.com \ --cc=maz@kernel.org \ --cc=mochs@nvidia.com \ --cc=oliver.upton@linux.dev \ --cc=rananta@google.com \ --cc=reinette.chatre@intel.com \ --cc=ricarkol@google.com \ --cc=ryan.roberts@arm.com \ --cc=stefanha@redhat.com \ --cc=surenb@google.com \ --cc=suzuki.poulose@arm.com \ --cc=targupta@nvidia.com \ --cc=vsethi@nvidia.com \ --cc=wangjinchao@xfusion.com \ --cc=will@kernel.org \ --cc=yi.l.liu@intel.com \ --cc=yuzenghui@huawei.com \ --cc=zhiw@nvidia.com \ /path/to/YOUR_REPLY https://kernel.org/pub/software/scm/git/docs/git-send-email.html * If your mail client supports setting the In-Reply-To header via mailto: links, try the mailto: linkBe sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.