From: Kirti Wankhede <kwankhede@nvidia.com>
To: Alexey Kardashevskiy <aik@ozlabs.ru>,
<alex.williamson@redhat.com>, <pbonzini@redhat.com>,
<kraxel@redhat.com>, <cjia@nvidia.com>
Cc: <qemu-devel@nongnu.org>, <kvm@vger.kernel.org>,
<kevin.tian@intel.com>, <jike.song@intel.com>,
<bjsdjshi@linux.vnet.ibm.com>, <linux-kernel@vger.kernel.org>
Subject: Re: [PATCH v11 00/22] Add Mediated device support
Date: Mon, 7 Nov 2016 09:29:32 +0530 [thread overview]
Message-ID: <40bfdbe9-1070-b5e6-fba2-6b97999b558b@nvidia.com> (raw)
In-Reply-To: <e15a424c-15ca-3937-2b5e-2317d46ffb15@ozlabs.ru>
On 11/7/2016 9:00 AM, Alexey Kardashevskiy wrote:
> On 05/11/16 08:10, Kirti Wankhede wrote:
>> This series adds Mediated device support to Linux host kernel. Purpose
>> of this series is to provide a common interface for mediated device
>> management that can be used by different devices. This series introduces
>> Mdev core module that creates and manages mediated devices, VFIO based
>> driver for mediated devices that are created by mdev core module and
>> update VFIO type1 IOMMU module to support pinning & unpinning for mediated
>> devices.
>>
>> What changed in v11?
>> mdev core:
>> Register mdev_bus class when first device is registed to avoid panic if
>> any vendor driver and mdev driver are selected as built-in but vendor
>> driver loads first and then mdev module.
>> vfio_mdev:
>> Added notifier callback function to mdev parent's ops so that notifer
>> is registered from vfio_mdev module during device open and unregistered
>> it from device close call. This is a optional callback. Some drivers
>> using mdev framework might not pin or unpin pages, for example the
>> sample mtty driver that simulates serial port. Vendor driver who need to
>> pin/unpin pages should provide this callback. Otherwise pin request
>> would fail.
>> vfio_iommu_type1:
>> Updated to keep track of who (task and address space) mapped iova range.
>> During DMA_UNMAP, same task who mapped it or other task who shares same
>> address space is allowed to unmap, otherwise unmap fails.
>> QEMU maps few iova ranges initially, then fork threads and from the child
>> thread calls DMA_UNMAP on previously mapped iova. Since child shares same
>> address space, DMA_UNMAP is successful.
>> Address space keeps track of pages pinned (pfn_list) by external user /
>> mdev devices. This pfn_list is used to verify pfn during unpin_request,
>> re-accounting of pages when direct device assigned in hot-unplugged and
>> mdev device is present in same container.
>> When the container is released, all mapped iova from all tasks are
>> unmapped and removed.
>>
>> Tested by assigning below combinations of devices to a single VM:
>> - GPU pass through only
>> - vGPU device only
>> - One GPU pass through and one vGPU device
>> - Linux VM hot plug and unplug vGPU device while GPU pass through device
>> exist
>> - Linux VM hot plug and unplug GPU pass through device while vGPU device
>> exist
>>
>> Patch series tested with linux-next upto commit 14970f204b19 @Fri Oct 28
>> Resolved against conflicting change:
>
> Patch 11/22 does not apply if the patchset is applied on top of 14970f204b19.
>
>
Pull commit 05692d7005a3 (below) commit.
>
>> 05692d7005a3 vfio/pci: Fix integer overflows, bitmask check
>>
Thanks,
Kirti
>>
>> Kirti Wankhede (22):
>> vfio: Mediated device Core driver
>> vfio: VFIO based driver for Mediated devices
>> vfio: Rearrange functions to get vfio_group from dev
>> vfio: Common function to increment container_users
>> vfio iommu: Added pin and unpin callback functions to
>> vfio_iommu_driver_ops
>> vfio iommu type1: Update arguments of vfio_lock_acct
>> vfio iommu type1: Update argument of vaddr_get_pfn()
>> vfio iommu type1: Add find_iommu_group() function
>> vfio iommu type1: Add task structure to vfio_dma
>> vfio iommu type1: Add support for mediated devices
>> vfio iommu: Add blocking notifier to notify DMA_UNMAP
>> vfio: Add notifier callback to parent's ops structure of mdev
>> vfio: Introduce common function to add capabilities
>> vfio_pci: Update vfio_pci to use vfio_info_add_capability()
>> vfio: Introduce vfio_set_irqs_validate_and_prepare()
>> vfio_pci: Updated to use vfio_set_irqs_validate_and_prepare()
>> vfio_platform: Updated to use vfio_set_irqs_validate_and_prepare()
>> vfio: Define device_api strings
>> docs: Add Documentation for Mediated devices
>> docs: Sysfs ABI for mediated device framework
>> docs: Sample driver to demonstrate how to use Mediated device
>> framework.
>> MAINTAINERS: Add entry VFIO based Mediated device drivers
>>
>> Documentation/ABI/testing/sysfs-bus-vfio-mdev | 111 ++
>> Documentation/vfio-mediated-device.txt | 399 +++++++
>> MAINTAINERS | 9 +
>> drivers/vfio/Kconfig | 1 +
>> drivers/vfio/Makefile | 1 +
>> drivers/vfio/mdev/Kconfig | 17 +
>> drivers/vfio/mdev/Makefile | 5 +
>> drivers/vfio/mdev/mdev_core.c | 388 +++++++
>> drivers/vfio/mdev/mdev_driver.c | 122 ++
>> drivers/vfio/mdev/mdev_private.h | 41 +
>> drivers/vfio/mdev/mdev_sysfs.c | 286 +++++
>> drivers/vfio/mdev/vfio_mdev.c | 167 +++
>> drivers/vfio/pci/vfio_pci.c | 83 +-
>> drivers/vfio/platform/vfio_platform_common.c | 31 +-
>> drivers/vfio/vfio.c | 334 +++++-
>> drivers/vfio/vfio_iommu_type1.c | 831 ++++++++++++--
>> include/linux/mdev.h | 176 +++
>> include/linux/vfio.h | 32 +-
>> include/uapi/linux/vfio.h | 10 +
>> samples/vfio-mdev/Makefile | 13 +
>> samples/vfio-mdev/mtty.c | 1503 +++++++++++++++++++++++++
>> 21 files changed, 4342 insertions(+), 218 deletions(-)
>> create mode 100644 Documentation/ABI/testing/sysfs-bus-vfio-mdev
>> create mode 100644 Documentation/vfio-mediated-device.txt
>> create mode 100644 drivers/vfio/mdev/Kconfig
>> create mode 100644 drivers/vfio/mdev/Makefile
>> create mode 100644 drivers/vfio/mdev/mdev_core.c
>> create mode 100644 drivers/vfio/mdev/mdev_driver.c
>> create mode 100644 drivers/vfio/mdev/mdev_private.h
>> create mode 100644 drivers/vfio/mdev/mdev_sysfs.c
>> create mode 100644 drivers/vfio/mdev/vfio_mdev.c
>> create mode 100644 include/linux/mdev.h
>> create mode 100644 samples/vfio-mdev/Makefile
>> create mode 100644 samples/vfio-mdev/mtty.c
>>
>
>
next prev parent reply other threads:[~2016-11-07 3:59 UTC|newest]
Thread overview: 68+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-11-04 21:10 [PATCH v11 00/22] Add Mediated device support Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 01/22] vfio: Mediated device Core driver Kirti Wankhede
2016-11-07 6:40 ` Tian, Kevin
[not found] ` <20161108092552.GA2090@bjsdjshi@linux.vnet.ibm.com>
2016-11-08 21:06 ` Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 02/22] vfio: VFIO based driver for Mediated devices Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 03/22] vfio: Rearrange functions to get vfio_group from dev Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 04/22] vfio: Common function to increment container_users Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 05/22] vfio iommu: Added pin and unpin callback functions to vfio_iommu_driver_ops Kirti Wankhede
2016-11-07 19:36 ` Alex Williamson
2016-11-08 13:55 ` Kirti Wankhede
2016-11-08 16:39 ` Alex Williamson
2016-11-08 18:47 ` Kirti Wankhede
2016-11-08 19:14 ` Alex Williamson
2016-11-04 21:10 ` [PATCH v11 06/22] vfio iommu type1: Update arguments of vfio_lock_acct Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 07/22] vfio iommu type1: Update argument of vaddr_get_pfn() Kirti Wankhede
2016-11-07 8:42 ` Alexey Kardashevskiy
2016-11-04 21:10 ` [PATCH v11 08/22] vfio iommu type1: Add find_iommu_group() function Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 09/22] vfio iommu type1: Add task structure to vfio_dma Kirti Wankhede
2016-11-07 21:03 ` Alex Williamson
2016-11-08 14:13 ` Kirti Wankhede
2016-11-08 16:43 ` Alex Williamson
2016-11-04 21:10 ` [PATCH v11 10/22] vfio iommu type1: Add support for mediated devices Kirti Wankhede
2016-11-07 23:16 ` Alex Williamson
2016-11-08 2:20 ` Jike Song
2016-11-08 16:18 ` Alex Williamson
2016-11-08 15:06 ` Kirti Wankhede
2016-11-08 17:05 ` Alex Williamson
2016-11-08 6:52 ` Alexey Kardashevskiy
2016-11-15 5:17 ` Alexey Kardashevskiy
2016-11-15 6:33 ` Kirti Wankhede
2016-11-15 7:27 ` Alexey Kardashevskiy
2016-11-15 7:56 ` Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 11/22] vfio iommu: Add blocking notifier to notify DMA_UNMAP Kirti Wankhede
2016-11-07 23:45 ` Alex Williamson
2016-11-08 16:26 ` Kirti Wankhede
2016-11-08 17:46 ` Alex Williamson
2016-11-08 19:59 ` Kirti Wankhede
2016-11-08 21:28 ` Alex Williamson
2016-11-14 7:52 ` Kirti Wankhede
2016-11-14 15:37 ` Alex Williamson
2016-11-04 21:10 ` [PATCH v11 12/22] vfio: Add notifier callback to parent's ops structure of mdev Kirti Wankhede
2016-11-07 23:51 ` Alex Williamson
2016-11-04 21:10 ` [PATCH v11 13/22] vfio: Introduce common function to add capabilities Kirti Wankhede
2016-11-08 7:29 ` Alexey Kardashevskiy
2016-11-08 20:46 ` Kirti Wankhede
2016-11-08 21:42 ` Alex Williamson
2016-11-09 2:23 ` Alexey Kardashevskiy
2016-11-04 21:10 ` [PATCH v11 14/22] vfio_pci: Update vfio_pci to use vfio_info_add_capability() Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 15/22] vfio: Introduce vfio_set_irqs_validate_and_prepare() Kirti Wankhede
2016-11-08 8:46 ` Alexey Kardashevskiy
2016-11-08 20:22 ` Kirti Wankhede
2016-11-09 3:07 ` Alexey Kardashevskiy
2016-11-09 3:35 ` Alex Williamson
2016-11-04 21:10 ` [PATCH v11 16/22] vfio_pci: Updated to use vfio_set_irqs_validate_and_prepare() Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 17/22] vfio_platform: " Kirti Wankhede
2016-11-08 8:52 ` Alexey Kardashevskiy
2016-11-08 20:41 ` Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 18/22] vfio: Define device_api strings Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 19/22] docs: Add Documentation for Mediated devices Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 20/22] docs: Sysfs ABI for mediated device framework Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 21/22] docs: Sample driver to demonstrate how to use Mediated " Kirti Wankhede
2016-11-04 21:10 ` [PATCH v11 22/22] MAINTAINERS: Add entry VFIO based Mediated device drivers Kirti Wankhede
2016-11-07 3:30 ` [PATCH v11 00/22] Add Mediated device support Alexey Kardashevskiy
2016-11-07 3:59 ` Kirti Wankhede [this message]
2016-11-07 5:06 ` Kirti Wankhede
2016-11-07 6:15 ` Alexey Kardashevskiy
2016-11-07 6:36 ` Kirti Wankhede
2016-11-07 6:46 ` Alexey Kardashevskiy
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=40bfdbe9-1070-b5e6-fba2-6b97999b558b@nvidia.com \
--to=kwankhede@nvidia.com \
--cc=aik@ozlabs.ru \
--cc=alex.williamson@redhat.com \
--cc=bjsdjshi@linux.vnet.ibm.com \
--cc=cjia@nvidia.com \
--cc=jike.song@intel.com \
--cc=kevin.tian@intel.com \
--cc=kraxel@redhat.com \
--cc=kvm@vger.kernel.org \
--cc=linux-kernel@vger.kernel.org \
--cc=pbonzini@redhat.com \
--cc=qemu-devel@nongnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).