From: "Eugenio Pérez" <eperezma@redhat.com>
To: qemu-devel@nongnu.org
Cc: Laurent Vivier <lvivier@redhat.com>,
Parav Pandit <parav@mellanox.com>, Cindy Lu <lulu@redhat.com>,
"Michael S. Tsirkin" <mst@redhat.com>,
Jason Wang <jasowang@redhat.com>,
Juan Quintela <quintela@redhat.com>,
Richard Henderson <richard.henderson@linaro.org>,
Markus Armbruster <armbru@redhat.com>,
Gautam Dawar <gdawar@xilinx.com>,
virtualization@lists.linux-foundation.org,
Eduardo Habkost <ehabkost@redhat.com>,
Harpreet Singh Anand <hanand@xilinx.com>,
Xiao W Wang <xiao.w.wang@intel.com>, Peter Xu <peterx@redhat.com>,
Stefan Hajnoczi <stefanha@redhat.com>,
Eli Cohen <eli@mellanox.com>, Paolo Bonzini <pbonzini@redhat.com>,
Zhu Lingshan <lingshan.zhu@intel.com>,
Eric Blake <eblake@redhat.com>,
Stefano Garzarella <sgarzare@redhat.com>
Subject: [PATCH 00/31] vDPA shadow virtqueue
Date: Fri, 21 Jan 2022 21:27:02 +0100 [thread overview]
Message-ID: <20220121202733.404989-1-eperezma@redhat.com> (raw)
This series enables shadow virtqueue (SVQ) for vhost-vdpa devices. This
is intended as a new method of tracking the memory the devices touch
during a migration process: Instead of relay on vhost device's dirty
logging capability, SVQ intercepts the VQ dataplane forwarding the
descriptors between VM and device. This way qemu is the effective
writer of guests memory, like in qemu's emulated virtio device
operation.
When SVQ is enabled qemu offers a new virtual address space to the
device to read and write into, and it maps new vrings and the guest
memory in it. SVQ also intercepts kicks and calls between the device
and the guest. Used buffers relay would cause dirty memory being
tracked, but at this RFC SVQ is not enabled on migration automatically.
Thanks of being a buffers relay system, SVQ can be used also to
communicate devices and drivers with different capabilities, like
devices that only support packed vring and not split and old guests with
no driver packed support.
It is based on the ideas of DPDK SW assisted LM, in the series of
DPDK's https://patchwork.dpdk.org/cover/48370/ . However, these does
not map the shadow vq in guest's VA, but in qemu's.
This version of SVQ is limited in the amount of features it can use with
guest and device, because this series is already very big otherwise.
Features like indirect or event_idx will be addressed in future series.
SVQ needs to be enabled with cmdline parameter x-svq, like:
-netdev type=vhost-vdpa,vhostdev=/dev/vhost-vdpa-0,id=vhost-vdpa0,x-svq=true
In this version it cannot be enabled or disabled in runtime. Further
series will remove this limitation and will enable it only for migration
time.
Some patches are intentionally very small to ease review, but they can
be squashed if preferred.
Patches 1-10 prepares the SVQ and QEMU to support both guest to device
and device to guest notifications forwarding, with the extra qemu hop.
That part can be tested in isolation if cmdline change is reproduced.
Patches from 11 to 18 implement the actual buffer forwarding, but with
no IOMMU support. It requires a vdpa device capable of addressing all
qemu vaddr.
Patches 19 to 23 adds the iommu support, so the device with address
range limitations can access SVQ through this new virtual address space
created.
The rest of the series add the last pieces needed for migration.
Comments are welcome.
TODO:
* Event, indirect, packed, and other features of virtio.
* To separate buffers forwarding in its own AIO context, so we can
throw more threads to that task and we don't need to stop the main
event loop.
* Support virtio-net control vq.
* Proper documentation.
Changes from v5 RFC:
* Remove dynamic enablement of SVQ, making less dependent of the device.
* Enable live migration if SVQ is enabled.
* Fix SVQ when driver reset.
* Comments addressed, specially in the iova area.
* Rebase on latest master, adding multiqueue support (but no networking
control vq processing).
v5 link:
https://lists.gnu.org/archive/html/qemu-devel/2021-10/msg07250.html
Changes from v4 RFC:
* Support of allocating / freeing iova ranges in IOVA tree. Extending
already present iova-tree for that.
* Proper validation of guest features. Now SVQ can negotiate a
different set of features with the device when enabled.
* Support of host notifiers memory regions
* Handling of SVQ full queue in case guest's descriptors span to
different memory regions (qemu's VA chunks).
* Flush pending used buffers at end of SVQ operation.
* QMP command now looks by NetClientState name. Other devices will need
to implement it's way to enable vdpa.
* Rename QMP command to set, so it looks more like a way of working
* Better use of qemu error system
* Make a few assertions proper error-handling paths.
* Add more documentation
* Less coupling of virtio / vhost, that could cause friction on changes
* Addressed many other small comments and small fixes.
Changes from v3 RFC:
* Move everything to vhost-vdpa backend. A big change, this allowed
some cleanup but more code has been added in other places.
* More use of glib utilities, especially to manage memory.
v3 link:
https://lists.nongnu.org/archive/html/qemu-devel/2021-05/msg06032.html
Changes from v2 RFC:
* Adding vhost-vdpa devices support
* Fixed some memory leaks pointed by different comments
v2 link:
https://lists.nongnu.org/archive/html/qemu-devel/2021-03/msg05600.html
Changes from v1 RFC:
* Use QMP instead of migration to start SVQ mode.
* Only accepting IOMMU devices, closer behavior with target devices
(vDPA)
* Fix invalid masking/unmasking of vhost call fd.
* Use of proper methods for synchronization.
* No need to modify VirtIO device code, all of the changes are
contained in vhost code.
* Delete superfluous code.
* An intermediate RFC was sent with only the notifications forwarding
changes. It can be seen in
https://patchew.org/QEMU/20210129205415.876290-1-eperezma@redhat.com/
v1 link:
https://lists.gnu.org/archive/html/qemu-devel/2020-11/msg05372.html
Eugenio Pérez (20):
virtio: Add VIRTIO_F_QUEUE_STATE
virtio-net: Honor VIRTIO_CONFIG_S_DEVICE_STOPPED
virtio: Add virtio_queue_is_host_notifier_enabled
vhost: Make vhost_virtqueue_{start,stop} public
vhost: Add x-vhost-enable-shadow-vq qmp
vhost: Add VhostShadowVirtqueue
vdpa: Register vdpa devices in a list
vhost: Route guest->host notification through shadow virtqueue
Add vhost_svq_get_svq_call_notifier
Add vhost_svq_set_guest_call_notifier
vdpa: Save call_fd in vhost-vdpa
vhost-vdpa: Take into account SVQ in vhost_vdpa_set_vring_call
vhost: Route host->guest notification through shadow virtqueue
virtio: Add vhost_shadow_vq_get_vring_addr
vdpa: Save host and guest features
vhost: Add vhost_svq_valid_device_features to shadow vq
vhost: Shadow virtqueue buffers forwarding
vhost: Add VhostIOVATree
vhost: Use a tree to store memory mappings
vdpa: Add custom IOTLB translations to SVQ
Eugenio Pérez (31):
vdpa: Reorder virtio/vhost-vdpa.c functions
vhost: Add VhostShadowVirtqueue
vdpa: Add vhost_svq_get_dev_kick_notifier
vdpa: Add vhost_svq_set_svq_kick_fd
vhost: Add Shadow VirtQueue kick forwarding capabilities
vhost: Route guest->host notification through shadow virtqueue
vhost: dd vhost_svq_get_svq_call_notifier
vhost: Add vhost_svq_set_guest_call_notifier
vhost-vdpa: Take into account SVQ in vhost_vdpa_set_vring_call
vhost: Route host->guest notification through shadow virtqueue
vhost: Add vhost_svq_valid_device_features to shadow vq
vhost: Add vhost_svq_valid_guest_features to shadow vq
vhost: Add vhost_svq_ack_guest_features to shadow vq
virtio: Add vhost_shadow_vq_get_vring_addr
vdpa: Add vhost_svq_get_num
vhost: pass queue index to vhost_vq_get_addr
vdpa: adapt vhost_ops callbacks to svq
vhost: Shadow virtqueue buffers forwarding
utils: Add internal DMAMap to iova-tree
util: Store DMA entries in a list
util: Add iova_tree_alloc
vhost: Add VhostIOVATree
vdpa: Add custom IOTLB translations to SVQ
vhost: Add vhost_svq_get_last_used_idx
vdpa: Adapt vhost_vdpa_get_vring_base to SVQ
vdpa: Clear VHOST_VRING_F_LOG at vhost_vdpa_set_vring_addr in SVQ
vdpa: Never set log_base addr if SVQ is enabled
vdpa: Expose VHOST_F_LOG_ALL on SVQ
vdpa: Make ncs autofree
vdpa: Move vhost_vdpa_get_iova_range to net/vhost-vdpa.c
vdpa: Add x-svq to NetdevVhostVDPAOptions
qapi/net.json | 5 +-
hw/virtio/vhost-iova-tree.h | 27 +
hw/virtio/vhost-shadow-virtqueue.h | 46 ++
include/hw/virtio/vhost-vdpa.h | 7 +
include/qemu/iova-tree.h | 17 +
hw/virtio/vhost-iova-tree.c | 157 ++++++
hw/virtio/vhost-shadow-virtqueue.c | 761 +++++++++++++++++++++++++++++
hw/virtio/vhost-vdpa.c | 740 ++++++++++++++++++++++++----
hw/virtio/vhost.c | 6 +-
net/vhost-vdpa.c | 58 ++-
util/iova-tree.c | 161 +++++-
hw/virtio/meson.build | 2 +-
12 files changed, 1852 insertions(+), 135 deletions(-)
create mode 100644 hw/virtio/vhost-iova-tree.h
create mode 100644 hw/virtio/vhost-shadow-virtqueue.h
create mode 100644 hw/virtio/vhost-iova-tree.c
create mode 100644 hw/virtio/vhost-shadow-virtqueue.c
--
2.27.0
next reply other threads:[~2022-01-21 20:39 UTC|newest]
Thread overview: 182+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-01-21 20:27 Eugenio Pérez [this message]
2022-01-21 20:27 ` [PATCH 01/31] vdpa: Reorder virtio/vhost-vdpa.c functions Eugenio Pérez
2022-01-28 5:59 ` Jason Wang
2022-01-28 5:59 ` Jason Wang
2022-01-28 7:57 ` Eugenio Perez Martin
2022-02-21 7:31 ` Jason Wang
2022-02-21 7:31 ` Jason Wang
2022-02-21 7:42 ` Eugenio Perez Martin
2022-01-21 20:27 ` [PATCH 02/31] vhost: Add VhostShadowVirtqueue Eugenio Pérez
2022-01-26 8:53 ` Eugenio Perez Martin
2022-01-28 6:00 ` Jason Wang
2022-01-28 6:00 ` Jason Wang
2022-01-28 8:10 ` Eugenio Perez Martin
2022-01-21 20:27 ` [PATCH 03/31] vdpa: Add vhost_svq_get_dev_kick_notifier Eugenio Pérez
2022-01-28 6:03 ` Jason Wang
2022-01-28 6:03 ` Jason Wang
2022-01-31 9:33 ` Eugenio Perez Martin
2022-01-21 20:27 ` [PATCH 04/31] vdpa: Add vhost_svq_set_svq_kick_fd Eugenio Pérez
2022-01-28 6:29 ` Jason Wang
2022-01-28 6:29 ` Jason Wang
2022-01-31 10:18 ` Eugenio Perez Martin
2022-02-08 8:47 ` Jason Wang
2022-02-08 8:47 ` Jason Wang
2022-02-18 18:22 ` Eugenio Perez Martin
2022-01-21 20:27 ` [PATCH 05/31] vhost: Add Shadow VirtQueue kick forwarding capabilities Eugenio Pérez
2022-01-28 6:32 ` Jason Wang
2022-01-28 6:32 ` Jason Wang
2022-01-31 10:48 ` Eugenio Perez Martin
2022-01-21 20:27 ` [PATCH 06/31] vhost: Route guest->host notification through shadow virtqueue Eugenio Pérez
2022-01-28 6:56 ` Jason Wang
2022-01-28 6:56 ` Jason Wang
2022-01-31 11:33 ` Eugenio Perez Martin
2022-02-08 9:02 ` Jason Wang
2022-02-08 9:02 ` Jason Wang
2022-01-21 20:27 ` [PATCH 07/31] vhost: dd vhost_svq_get_svq_call_notifier Eugenio Pérez
2022-01-29 7:57 ` Jason Wang
2022-01-29 7:57 ` Jason Wang
2022-01-29 17:49 ` Eugenio Perez Martin
2022-01-21 20:27 ` [PATCH 08/31] vhost: Add vhost_svq_set_guest_call_notifier Eugenio Pérez
2022-01-21 20:27 ` [PATCH 09/31] vhost-vdpa: Take into account SVQ in vhost_vdpa_set_vring_call Eugenio Pérez
2022-01-29 8:05 ` Jason Wang
2022-01-29 8:05 ` Jason Wang
2022-01-31 15:34 ` Eugenio Perez Martin
2022-02-08 3:23 ` Jason Wang
2022-02-08 3:23 ` Jason Wang
2022-02-18 12:35 ` Eugenio Perez Martin
2022-02-21 7:39 ` Jason Wang
2022-02-21 7:39 ` Jason Wang
2022-02-21 8:01 ` Eugenio Perez Martin
2022-02-22 7:18 ` Jason Wang
2022-02-22 7:18 ` Jason Wang
2022-01-21 20:27 ` [PATCH 10/31] vhost: Route host->guest notification through shadow virtqueue Eugenio Pérez
2022-01-21 20:27 ` [PATCH 11/31] vhost: Add vhost_svq_valid_device_features to shadow vq Eugenio Pérez
2022-01-29 8:11 ` Jason Wang
2022-01-29 8:11 ` Jason Wang
2022-01-31 15:49 ` Eugenio Perez Martin
2022-02-01 10:57 ` Eugenio Perez Martin
2022-02-08 3:37 ` Jason Wang
2022-02-08 3:37 ` Jason Wang
2022-02-26 9:11 ` Liuxiangdong via
2022-02-26 11:12 ` Eugenio Perez Martin
2022-01-21 20:27 ` [PATCH 12/31] vhost: Add vhost_svq_valid_guest_features " Eugenio Pérez
2022-01-21 20:27 ` [PATCH 13/31] vhost: Add vhost_svq_ack_guest_features " Eugenio Pérez
2022-01-21 20:27 ` [PATCH 14/31] virtio: Add vhost_shadow_vq_get_vring_addr Eugenio Pérez
2022-01-21 20:27 ` [PATCH 15/31] vdpa: Add vhost_svq_get_num Eugenio Pérez
2022-01-29 8:14 ` Jason Wang
2022-01-29 8:14 ` Jason Wang
2022-01-31 16:36 ` Eugenio Perez Martin
2022-01-21 20:27 ` [PATCH 16/31] vhost: pass queue index to vhost_vq_get_addr Eugenio Pérez
2022-01-29 8:20 ` Jason Wang
2022-01-29 8:20 ` Jason Wang
2022-01-31 17:44 ` Eugenio Perez Martin
2022-02-08 6:58 ` Jason Wang
2022-02-08 6:58 ` Jason Wang
2022-01-21 20:27 ` [PATCH 17/31] vdpa: adapt vhost_ops callbacks to svq Eugenio Pérez
2022-01-30 4:03 ` Jason Wang
2022-01-30 4:03 ` Jason Wang
2022-01-31 18:58 ` Eugenio Perez Martin
2022-02-08 3:57 ` Jason Wang
2022-02-08 3:57 ` Jason Wang
2022-02-17 17:13 ` Eugenio Perez Martin
2022-02-21 7:15 ` Jason Wang
2022-02-21 7:15 ` Jason Wang
2022-02-21 17:22 ` Eugenio Perez Martin
2022-02-22 3:16 ` Jason Wang
2022-02-22 3:16 ` Jason Wang
2022-02-22 7:42 ` Eugenio Perez Martin
2022-02-22 7:59 ` Jason Wang
2022-02-22 7:59 ` Jason Wang
2022-01-21 20:27 ` [PATCH 18/31] vhost: Shadow virtqueue buffers forwarding Eugenio Pérez
2022-01-30 4:42 ` Jason Wang
2022-01-30 4:42 ` Jason Wang
2022-02-01 17:08 ` Eugenio Perez Martin
2022-02-08 8:11 ` Jason Wang
2022-02-08 8:11 ` Jason Wang
2022-02-22 19:01 ` Eugenio Perez Martin
2022-02-23 2:03 ` Jason Wang
2022-02-23 2:03 ` Jason Wang
2022-01-30 6:46 ` Jason Wang
2022-01-30 6:46 ` Jason Wang
2022-02-01 11:25 ` Eugenio Perez Martin
2022-02-08 8:15 ` Jason Wang
2022-02-08 8:15 ` Jason Wang
2022-02-17 12:48 ` Eugenio Perez Martin
2022-02-21 7:43 ` Jason Wang
2022-02-21 7:43 ` Jason Wang
2022-02-21 8:15 ` Eugenio Perez Martin
2022-02-22 7:26 ` Jason Wang
2022-02-22 7:26 ` Jason Wang
2022-02-22 8:55 ` Eugenio Perez Martin
2022-02-23 2:26 ` Jason Wang
2022-02-23 2:26 ` Jason Wang
2022-01-21 20:27 ` [PATCH 19/31] utils: Add internal DMAMap to iova-tree Eugenio Pérez
2022-01-21 20:27 ` [PATCH 20/31] util: Store DMA entries in a list Eugenio Pérez
2022-01-21 20:27 ` [PATCH 21/31] util: Add iova_tree_alloc Eugenio Pérez
2022-01-24 4:32 ` Peter Xu
2022-01-24 4:32 ` Peter Xu
2022-01-24 9:20 ` Eugenio Perez Martin
2022-01-24 11:07 ` Peter Xu
2022-01-24 11:07 ` Peter Xu
2022-01-25 9:40 ` Eugenio Perez Martin
2022-01-27 8:06 ` Peter Xu
2022-01-27 8:06 ` Peter Xu
2022-01-27 9:24 ` Eugenio Perez Martin
2022-01-28 3:57 ` Peter Xu
2022-01-28 3:57 ` Peter Xu
2022-01-28 5:55 ` Jason Wang
2022-01-28 5:55 ` Jason Wang
2022-01-28 7:48 ` Eugenio Perez Martin
2022-02-15 19:34 ` Eugenio Pérez
2022-02-15 19:34 ` [PATCH] util: Add iova_tree_alloc Eugenio Pérez
2022-02-16 7:25 ` Peter Xu
2022-01-30 5:06 ` [PATCH 21/31] " Jason Wang
2022-01-30 5:06 ` Jason Wang
2022-01-21 20:27 ` [PATCH 22/31] vhost: Add VhostIOVATree Eugenio Pérez
2022-01-30 5:21 ` Jason Wang
2022-01-30 5:21 ` Jason Wang
2022-02-01 17:27 ` Eugenio Perez Martin
2022-02-08 8:17 ` Jason Wang
2022-02-08 8:17 ` Jason Wang
2022-01-21 20:27 ` [PATCH 23/31] vdpa: Add custom IOTLB translations to SVQ Eugenio Pérez
2022-01-30 5:57 ` Jason Wang
2022-01-30 5:57 ` Jason Wang
2022-01-31 19:11 ` Eugenio Perez Martin
2022-02-08 8:19 ` Jason Wang
2022-02-08 8:19 ` Jason Wang
2022-01-21 20:27 ` [PATCH 24/31] vhost: Add vhost_svq_get_last_used_idx Eugenio Pérez
2022-01-21 20:27 ` [PATCH 25/31] vdpa: Adapt vhost_vdpa_get_vring_base to SVQ Eugenio Pérez
2022-01-21 20:27 ` [PATCH 26/31] vdpa: Clear VHOST_VRING_F_LOG at vhost_vdpa_set_vring_addr in SVQ Eugenio Pérez
2022-01-21 20:27 ` [PATCH 27/31] vdpa: Never set log_base addr if SVQ is enabled Eugenio Pérez
2022-01-21 20:27 ` [PATCH 28/31] vdpa: Expose VHOST_F_LOG_ALL on SVQ Eugenio Pérez
2022-01-30 6:50 ` Jason Wang
2022-01-30 6:50 ` Jason Wang
2022-02-01 11:45 ` Eugenio Perez Martin
2022-02-08 8:25 ` Jason Wang
2022-02-08 8:25 ` Jason Wang
2022-02-16 15:53 ` Eugenio Perez Martin
2022-02-17 6:02 ` Jason Wang
2022-02-17 6:02 ` Jason Wang
2022-02-17 8:22 ` Eugenio Perez Martin
2022-02-22 7:41 ` Jason Wang
2022-02-22 7:41 ` Jason Wang
2022-02-22 8:05 ` Eugenio Perez Martin
2022-02-23 3:46 ` Jason Wang
2022-02-23 3:46 ` Jason Wang
2022-02-23 8:06 ` Eugenio Perez Martin
2022-02-24 3:45 ` Jason Wang
2022-02-24 3:45 ` Jason Wang
2022-01-21 20:27 ` [PATCH 29/31] vdpa: Make ncs autofree Eugenio Pérez
2022-01-30 6:51 ` Jason Wang
2022-01-30 6:51 ` Jason Wang
2022-02-01 17:10 ` Eugenio Perez Martin
2022-01-21 20:27 ` [PATCH 30/31] vdpa: Move vhost_vdpa_get_iova_range to net/vhost-vdpa.c Eugenio Pérez
2022-01-30 6:53 ` Jason Wang
2022-01-30 6:53 ` Jason Wang
2022-02-01 17:11 ` Eugenio Perez Martin
2022-01-21 20:27 ` [PATCH 31/31] vdpa: Add x-svq to NetdevVhostVDPAOptions Eugenio Pérez
2022-01-28 6:02 ` [PATCH 00/31] vDPA shadow virtqueue Jason Wang
2022-01-28 6:02 ` Jason Wang
2022-01-31 9:15 ` Eugenio Perez Martin
2022-02-08 8:27 ` Jason Wang
2022-02-08 8:27 ` Jason Wang
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=20220121202733.404989-1-eperezma@redhat.com \
--to=eperezma@redhat.com \
--cc=armbru@redhat.com \
--cc=eblake@redhat.com \
--cc=ehabkost@redhat.com \
--cc=eli@mellanox.com \
--cc=gdawar@xilinx.com \
--cc=hanand@xilinx.com \
--cc=jasowang@redhat.com \
--cc=lingshan.zhu@intel.com \
--cc=lulu@redhat.com \
--cc=lvivier@redhat.com \
--cc=mst@redhat.com \
--cc=parav@mellanox.com \
--cc=pbonzini@redhat.com \
--cc=peterx@redhat.com \
--cc=qemu-devel@nongnu.org \
--cc=quintela@redhat.com \
--cc=richard.henderson@linaro.org \
--cc=sgarzare@redhat.com \
--cc=stefanha@redhat.com \
--cc=virtualization@lists.linux-foundation.org \
--cc=xiao.w.wang@intel.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.