All of lore.kernel.org
 help / color / mirror / Atom feed
From: Jason Wang <jasowang@redhat.com>
To: Max Gurtovoy <mgurtovoy@nvidia.com>,
	Cornelia Huck <cohuck@redhat.com>,
	virtio-comment@lists.oasis-open.org, mst@redhat.com
Cc: eperezma@redhat.com, aadam@redhat.com, oren@nvidia.com,
	shahafs@nvidia.com, parav@nvidia.com, bodong@nvidia.com,
	amikheev@nvidia.com, stefanha@redhat.com
Subject: Re: [virtio-comment] [PATCH 1/1] live_migration: initial support for migrating virtio devices
Date: Wed, 7 Jul 2021 22:08:40 +0800	[thread overview]
Message-ID: <6cfe2983-ad08-3b82-b92b-8447e81c0017@redhat.com> (raw)
In-Reply-To: <6229141e-2604-d941-dfc4-2d8f414f4011@nvidia.com>


在 2021/7/7 下午8:51, Max Gurtovoy 写道:
>>>
>>> +
>>> +This document will describe the needed updates to the virtio
>>> specification for adding live migration support for various
>>> devices. Live migration is one of the most important features of
>>> virtualization and virtio devices are oftenly found in virtual
>>> environments so setting a standard mechanism for this feature will
>>> allow virtio providers to develop compliant devices that will use
>>> standard drivers for that matter.
>> Is this supposed to happen on the device side? Do drivers need to get
>> involved, or is it transparent to them?
>
> Guest drivers should be involved.
>
> Hypervisor drivers should have the vfio re-design that we're doing now 
> in parallel.
>
> We'll develop new virtio_vfio_pci driver that will implement the 
> specification.


Well, this sounds like a partial re-invention of my mdev-vDPA approach 
which has been rejected by the community. The only difference is that 
it's PCI specific but I don't think it change anything fundamentally. I 
agree on the hardware design but not the software part.

This software part should be done in the vDPA (via a new parent) instead 
of VFIO:

1) dedicated to virtio
2) capable for live migration, thanks to the vhost, vhost-vDPA has the 
uAPI to support live migration, actually the device state 
synchronization part is ready, what missed in the dirty page tracking, 
it would be not hard to introduce the bitmap support, migration 
compatibility support from the hypervisor(Qemu)
3) compatible with the existing virtio software stack
4) management API support
5) container ready
6) MicroVM ready, datapath assignment without PCI in the guest

...

Anything that blocks you from using the current mlx5 vDPA parent? It's 
mature for live migration, switch, representors and a lot features that 
virtio doesn't have. What's the value of using virtio PF in this case? 
(Do you plan to invent all those features in the spec?)

Thanks


>
> Like we're doing for mlx5 NIC, the PF will be the communication 
> channel for the migration process.
>
> The virtio pci PF admin queue will be used for that matter. The PF 
> will not be migratable. It will manage the migration process for its VFs. 


This publicly archived list offers a means to provide input to the
OASIS Virtual I/O Device (VIRTIO) TC.

In order to verify user consent to the Feedback License terms and
to minimize spam in the list archive, subscription is required
before posting.

Subscribe: virtio-comment-subscribe@lists.oasis-open.org
Unsubscribe: virtio-comment-unsubscribe@lists.oasis-open.org
List help: virtio-comment-help@lists.oasis-open.org
List archive: https://lists.oasis-open.org/archives/virtio-comment/
Feedback License: https://www.oasis-open.org/who/ipr/feedback_license.pdf
List Guidelines: https://www.oasis-open.org/policies-guidelines/mailing-lists
Committee: https://www.oasis-open.org/committees/virtio/
Join OASIS: https://www.oasis-open.org/join/


  reply	other threads:[~2021-07-07 14:08 UTC|newest]

Thread overview: 10+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-06-24  8:20 [virtio-comment] [RFC PATCH v2 0/1] Live migration for VIRTIO Max Gurtovoy
2021-06-24  8:20 ` [virtio-comment] [PATCH 1/1] live_migration: initial support for migrating virtio devices Max Gurtovoy
2021-06-28 15:22   ` Cornelia Huck
2021-07-07 12:51     ` Max Gurtovoy
2021-07-07 14:08       ` Jason Wang [this message]
2021-07-07 14:09       ` Michael S. Tsirkin
2021-07-07 14:15         ` Max Gurtovoy
2021-07-07 17:01       ` Cornelia Huck
2021-07-05 15:45   ` Stefan Hajnoczi
2021-07-06  2:45     ` Jason Wang

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=6cfe2983-ad08-3b82-b92b-8447e81c0017@redhat.com \
    --to=jasowang@redhat.com \
    --cc=aadam@redhat.com \
    --cc=amikheev@nvidia.com \
    --cc=bodong@nvidia.com \
    --cc=cohuck@redhat.com \
    --cc=eperezma@redhat.com \
    --cc=mgurtovoy@nvidia.com \
    --cc=mst@redhat.com \
    --cc=oren@nvidia.com \
    --cc=parav@nvidia.com \
    --cc=shahafs@nvidia.com \
    --cc=stefanha@redhat.com \
    --cc=virtio-comment@lists.oasis-open.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.