From: Laine Stump <laine@redhat.com>
To: Michal Privoznik <mprivozn@redhat.com>,
Alex Williamson <alex.williamson@redhat.com>,
"libvir-list@redhat.com" <libvir-list@redhat.com>
Cc: Paolo Bonzini <pbonzini@redhat.com>,
John Ferlan <jferlan@redhat.com>,
Kirti Wankhede <kwankhede@nvidia.com>,
"Song, Jike" <jike.song@intel.com>,
"cjia@nvidia.com" <cjia@nvidia.com>,
"kvm@vger.kernel.org" <kvm@vger.kernel.org>,
"Tian, Kevin" <kevin.tian@intel.com>,
"qemu-devel@nongnu.org" <qemu-devel@nongnu.org>,
"kraxel@redhat.com" <kraxel@redhat.com>,
"bjsdjshi@linux.vnet.ibm.com" <bjsdjshi@linux.vnet.ibm.com>
Subject: Re: [libvirt] [Qemu-devel] [PATCH v7 0/4] Add Mediated device support
Date: Fri, 2 Sep 2016 19:57:28 -0400 [thread overview]
Message-ID: <ab0de6ed-bee3-25b1-e3f7-a2ba28ce41b3@redhat.com> (raw)
In-Reply-To: <22097a95-21c6-3aec-f0ff-717181a705f8@redhat.com>
On 09/02/2016 05:44 PM, Paolo Bonzini wrote:
>
>
> On 02/09/2016 22:19, John Ferlan wrote:
>> We don't have such a pool for GPU's (yet) - although I suppose they
>> could just become a class of storage pools.
>>
>> The issue being nodedev device objects are not saved between reboots.
>> They are generated on the fly. Hence the "create-nodedev' API - notice
>> there's no "define-nodedev' API, although I suppose one could be
>> created. It's just more work to get this all to work properly.
>
> It can all be made transient to begin with. The VM can be defined but
> won't start unless the mdev(s) exist with the right UUIDs.
>
>>> After creating the vGPU, if required by the host driver, all the other
>>> type ids would disappear from "virsh nodedev-dumpxml pci_0000_86_00_0" too.
>>
>> Not wanting to make assumptions, but this reads as if I create one type
>> 11 vGPU, then I can create no others on the host. Maybe I'm reading it
>> wrong - it's been a long week.
>
> Correct, at least for NVIDIA.
>
>> PCI devices have the "managed='yes|no'" attribute as well. That's what
>> determines whether the device is to be detached from the host or not.
>> That's been something very painful to manage for vfio and well libvirt!
>
> mdevs do not exist on the host (they do not have a driver on the host
> because they are not PCI devices) so they do need any management. At
> least I hope that's good news. :)
What's your definition of "management"? They don't need the same type of
management as a traditional hostdev, but they certainly don't just
appear by magic! :-)
For standard PCI devices, the managed attribute says whether or not the
device needs to be detached from the host driver and attached to
vfio-pci. For other kinds of hostdev devices, we could decide that it
meant something different. In this case, perhaps managed='yes' could
mean that the vGPU will be created as needed, and destroyed when the
guest is finished with it, and managed='no' could mean that we expect a
vGPU to already exist, and just need starting.
Or not. Maybe that's a pointless distinction in this case. Just pointing
out the option...
WARNING: multiple messages have this Message-ID (diff)
From: Laine Stump <laine@redhat.com>
To: Michal Privoznik <mprivozn@redhat.com>,
Alex Williamson <alex.williamson@redhat.com>,
"libvir-list@redhat.com" <libvir-list@redhat.com>
Cc: Paolo Bonzini <pbonzini@redhat.com>,
John Ferlan <jferlan@redhat.com>,
Kirti Wankhede <kwankhede@nvidia.com>,
"Song, Jike" <jike.song@intel.com>,
"cjia@nvidia.com" <cjia@nvidia.com>,
"kvm@vger.kernel.org" <kvm@vger.kernel.org>,
"Tian, Kevin" <kevin.tian@intel.com>,
"qemu-devel@nongnu.org" <qemu-devel@nongnu.org>,
"kraxel@redhat.com" <kraxel@redhat.com>,
"bjsdjshi@linux.vnet.ibm.com" <bjsdjshi@linux.vnet.ibm.com>
Subject: Re: [Qemu-devel] [libvirt] [PATCH v7 0/4] Add Mediated device support
Date: Fri, 2 Sep 2016 19:57:28 -0400 [thread overview]
Message-ID: <ab0de6ed-bee3-25b1-e3f7-a2ba28ce41b3@redhat.com> (raw)
In-Reply-To: <22097a95-21c6-3aec-f0ff-717181a705f8@redhat.com>
On 09/02/2016 05:44 PM, Paolo Bonzini wrote:
>
>
> On 02/09/2016 22:19, John Ferlan wrote:
>> We don't have such a pool for GPU's (yet) - although I suppose they
>> could just become a class of storage pools.
>>
>> The issue being nodedev device objects are not saved between reboots.
>> They are generated on the fly. Hence the "create-nodedev' API - notice
>> there's no "define-nodedev' API, although I suppose one could be
>> created. It's just more work to get this all to work properly.
>
> It can all be made transient to begin with. The VM can be defined but
> won't start unless the mdev(s) exist with the right UUIDs.
>
>>> After creating the vGPU, if required by the host driver, all the other
>>> type ids would disappear from "virsh nodedev-dumpxml pci_0000_86_00_0" too.
>>
>> Not wanting to make assumptions, but this reads as if I create one type
>> 11 vGPU, then I can create no others on the host. Maybe I'm reading it
>> wrong - it's been a long week.
>
> Correct, at least for NVIDIA.
>
>> PCI devices have the "managed='yes|no'" attribute as well. That's what
>> determines whether the device is to be detached from the host or not.
>> That's been something very painful to manage for vfio and well libvirt!
>
> mdevs do not exist on the host (they do not have a driver on the host
> because they are not PCI devices) so they do need any management. At
> least I hope that's good news. :)
What's your definition of "management"? They don't need the same type of
management as a traditional hostdev, but they certainly don't just
appear by magic! :-)
For standard PCI devices, the managed attribute says whether or not the
device needs to be detached from the host driver and attached to
vfio-pci. For other kinds of hostdev devices, we could decide that it
meant something different. In this case, perhaps managed='yes' could
mean that the vGPU will be created as needed, and destroyed when the
guest is finished with it, and managed='no' could mean that we expect a
vGPU to already exist, and just need starting.
Or not. Maybe that's a pointless distinction in this case. Just pointing
out the option...
next prev parent reply other threads:[~2016-09-02 23:57 UTC|newest]
Thread overview: 162+ messages / expand[flat|nested] mbox.gz Atom feed top
2016-08-25 3:53 [PATCH v7 0/4] Add Mediated device support Kirti Wankhede
2016-08-25 3:53 ` [Qemu-devel] " Kirti Wankhede
2016-08-25 3:53 ` [PATCH v7 1/4] vfio: Mediated device Core driver Kirti Wankhede
2016-08-25 3:53 ` [Qemu-devel] " Kirti Wankhede
2016-09-08 8:09 ` Jike Song
2016-09-08 8:09 ` [Qemu-devel] " Jike Song
2016-09-08 9:38 ` Neo Jia
2016-09-08 9:38 ` [Qemu-devel] " Neo Jia
2016-09-09 6:26 ` Jike Song
2016-09-09 6:26 ` [Qemu-devel] " Jike Song
2016-09-09 17:48 ` Kirti Wankhede
2016-09-09 17:48 ` [Qemu-devel] " Kirti Wankhede
2016-09-09 18:42 ` Alex Williamson
2016-09-09 18:42 ` [Qemu-devel] " Alex Williamson
2016-09-09 19:55 ` Kirti Wankhede
2016-09-09 19:55 ` [Qemu-devel] " Kirti Wankhede
2016-09-12 5:10 ` Jike Song
2016-09-12 5:10 ` [Qemu-devel] " Jike Song
2016-09-12 7:49 ` Kirti Wankhede
2016-09-12 7:49 ` [Qemu-devel] " Kirti Wankhede
2016-09-12 15:53 ` Alex Williamson
2016-09-12 15:53 ` [Qemu-devel] " Alex Williamson
2016-09-19 7:08 ` Jike Song
2016-09-19 7:08 ` [Qemu-devel] " Jike Song
2016-09-19 17:29 ` Kirti Wankhede
2016-09-19 17:29 ` [Qemu-devel] " Kirti Wankhede
2016-09-19 18:11 ` Alex Williamson
2016-09-19 18:11 ` [Qemu-devel] " Alex Williamson
2016-09-19 20:09 ` Kirti Wankhede
2016-09-19 20:09 ` [Qemu-devel] " Kirti Wankhede
2016-09-19 20:59 ` Alex Williamson
2016-09-20 12:48 ` Jike Song
2016-09-20 12:48 ` [Qemu-devel] " Jike Song
2016-08-25 3:53 ` [PATCH v7 2/4] vfio: VFIO driver for mediated devices Kirti Wankhede
2016-08-25 3:53 ` [Qemu-devel] " Kirti Wankhede
2016-08-25 9:22 ` Dong Jia
2016-08-25 9:22 ` [Qemu-devel] " Dong Jia
2016-08-26 14:13 ` Kirti Wankhede
2016-08-26 14:13 ` [Qemu-devel] " Kirti Wankhede
2016-09-08 2:38 ` Jike Song
2016-09-08 2:38 ` [Qemu-devel] " Jike Song
2016-09-19 18:22 ` Kirti Wankhede
2016-09-19 18:22 ` Kirti Wankhede
2016-09-19 18:36 ` Alex Williamson
2016-09-19 18:36 ` Alex Williamson
2016-09-19 19:13 ` Kirti Wankhede
2016-09-19 19:13 ` Kirti Wankhede
2016-09-19 20:03 ` Alex Williamson
2016-09-19 20:03 ` Alex Williamson
2016-09-20 2:50 ` Jike Song
2016-09-20 16:24 ` Alex Williamson
2016-09-21 3:19 ` Jike Song
2016-09-21 4:51 ` Alex Williamson
2016-09-21 5:02 ` Jike Song
2016-09-08 2:45 ` Jike Song
2016-09-08 2:45 ` [Qemu-devel] " Jike Song
2016-09-13 2:35 ` Jike Song
2016-09-13 2:35 ` [Qemu-devel] " Jike Song
2016-09-20 5:48 ` Dong Jia Shi
2016-09-20 5:48 ` [Qemu-devel] " Dong Jia Shi
2016-09-20 6:37 ` Jike Song
2016-09-20 6:37 ` [Qemu-devel] " Jike Song
2016-09-20 12:53 ` Jike Song
2016-09-20 12:53 ` [Qemu-devel] " Jike Song
2016-08-25 3:53 ` [PATCH v7 3/4] vfio iommu: Add support " Kirti Wankhede
2016-08-25 3:53 ` [Qemu-devel] " Kirti Wankhede
2016-08-25 7:29 ` Dong Jia
2016-08-25 7:29 ` [Qemu-devel] " Dong Jia
2016-08-26 13:50 ` Kirti Wankhede
2016-08-26 13:50 ` [Qemu-devel] " Kirti Wankhede
2016-09-29 2:17 ` Jike Song
2016-09-29 2:17 ` [Qemu-devel] " Jike Song
2016-09-29 15:06 ` Kirti Wankhede
2016-09-29 15:06 ` [Qemu-devel] " Kirti Wankhede
2016-09-30 2:58 ` Jike Song
2016-09-30 2:58 ` [Qemu-devel] " Jike Song
2016-09-30 3:10 ` Jike Song
2016-09-30 3:10 ` [Qemu-devel] " Jike Song
2016-09-30 11:44 ` Kirti Wankhede
2016-09-30 11:44 ` [Qemu-devel] " Kirti Wankhede
2016-10-08 7:09 ` Jike Song
2016-10-08 7:09 ` [Qemu-devel] " Jike Song
2016-08-25 3:53 ` [PATCH v7 4/4] docs: Add Documentation for Mediated devices Kirti Wankhede
2016-08-25 3:53 ` [Qemu-devel] " Kirti Wankhede
2016-09-03 16:40 ` Kirti Wankhede
2016-09-03 16:40 ` [Qemu-devel] " Kirti Wankhede
2016-08-30 16:16 ` [PATCH v7 0/4] Add Mediated device support Alex Williamson
2016-08-30 16:16 ` [Qemu-devel] " Alex Williamson
2016-08-31 6:12 ` Tian, Kevin
2016-08-31 6:12 ` [Qemu-devel] " Tian, Kevin
2016-08-31 7:04 ` Jike Song
2016-08-31 7:04 ` [Qemu-devel] " Jike Song
2016-08-31 15:48 ` Alex Williamson
2016-08-31 15:48 ` [Qemu-devel] " Alex Williamson
2016-09-01 4:09 ` Tian, Kevin
2016-09-01 4:09 ` [Qemu-devel] " Tian, Kevin
2016-09-01 4:10 ` Tian, Kevin
2016-09-01 4:10 ` [Qemu-devel] " Tian, Kevin
2016-09-01 18:22 ` Kirti Wankhede
2016-09-01 18:22 ` [Qemu-devel] " Kirti Wankhede
2016-09-01 20:01 ` Alex Williamson
2016-09-01 20:01 ` [Qemu-devel] " Alex Williamson
2016-09-02 6:17 ` Kirti Wankhede
2016-09-02 6:17 ` [Qemu-devel] " Kirti Wankhede
2016-09-01 16:47 ` Michal Privoznik
2016-09-01 16:59 ` Alex Williamson
2016-09-01 16:59 ` [Qemu-devel] " Alex Williamson
2016-09-02 4:48 ` Michal Privoznik
2016-09-02 5:21 ` Kirti Wankhede
2016-09-02 10:05 ` Paolo Bonzini
2016-09-02 17:15 ` Kirti Wankhede
2016-09-02 17:25 ` Paolo Bonzini
2016-09-02 18:33 ` Kirti Wankhede
2016-09-02 20:29 ` [libvirt] " John Ferlan
2016-09-02 20:29 ` [Qemu-devel] [libvirt] " John Ferlan
2016-09-03 16:31 ` Kirti Wankhede
2016-09-03 16:31 ` [Qemu-devel] " Kirti Wankhede
2016-09-06 17:54 ` [libvirt] [Qemu-devel] " Alex Williamson
2016-09-06 17:54 ` [Qemu-devel] [libvirt] " Alex Williamson
2016-09-02 21:48 ` [Qemu-devel] " Paolo Bonzini
2016-09-03 11:56 ` [libvirt] " John Ferlan
2016-09-03 11:56 ` [Qemu-devel] [libvirt] " John Ferlan
2016-09-03 13:07 ` [libvirt] [Qemu-devel] " Paolo Bonzini
2016-09-03 13:07 ` [Qemu-devel] [libvirt] " Paolo Bonzini
2016-09-03 17:47 ` Kirti Wankhede
2016-09-03 17:47 ` [Qemu-devel] " Kirti Wankhede
2016-09-03 16:34 ` [Qemu-devel] " Kirti Wankhede
2016-09-06 17:40 ` Alex Williamson
2016-09-06 19:35 ` Kirti Wankhede
2016-09-06 21:28 ` Alex Williamson
2016-09-07 8:22 ` Tian, Kevin
2016-09-07 8:22 ` Tian, Kevin
2016-09-07 16:00 ` Alex Williamson
2016-09-07 16:15 ` Kirti Wankhede
2016-09-07 16:44 ` Alex Williamson
2016-09-07 18:06 ` Kirti Wankhede
2016-09-07 22:13 ` Alex Williamson
2016-09-08 18:48 ` Kirti Wankhede
2016-09-08 20:51 ` Alex Williamson
2016-09-07 18:17 ` Neo Jia
2016-09-07 18:27 ` Daniel P. Berrange
2016-09-07 18:32 ` Neo Jia
2016-09-07 6:48 ` Tian, Kevin
2016-09-07 6:48 ` Tian, Kevin
2016-09-02 20:19 ` [libvirt] " John Ferlan
2016-09-02 20:19 ` [Qemu-devel] [libvirt] " John Ferlan
2016-09-02 21:44 ` [libvirt] [Qemu-devel] " Paolo Bonzini
2016-09-02 21:44 ` [Qemu-devel] [libvirt] " Paolo Bonzini
2016-09-02 23:57 ` Laine Stump [this message]
2016-09-02 23:57 ` Laine Stump
2016-09-03 16:49 ` [libvirt] [Qemu-devel] " Kirti Wankhede
2016-09-03 16:49 ` [Qemu-devel] [libvirt] " Kirti Wankhede
2016-09-05 7:52 ` [libvirt] [Qemu-devel] " Paolo Bonzini
2016-09-05 7:52 ` [Qemu-devel] [libvirt] " Paolo Bonzini
2016-09-03 11:57 ` [libvirt] [Qemu-devel] " John Ferlan
2016-09-03 11:57 ` [Qemu-devel] [libvirt] " John Ferlan
2016-09-05 7:54 ` [libvirt] [Qemu-devel] " Paolo Bonzini
2016-09-05 7:54 ` [Qemu-devel] [libvirt] " Paolo Bonzini
2016-09-02 17:55 ` [libvirt] [Qemu-devel] " Laine Stump
2016-09-02 17:55 ` [Qemu-devel] [libvirt] " Laine Stump
2016-09-02 19:15 ` Alex Williamson
2016-09-02 19:15 ` [Qemu-devel] " Alex Williamson
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=ab0de6ed-bee3-25b1-e3f7-a2ba28ce41b3@redhat.com \
--to=laine@redhat.com \
--cc=alex.williamson@redhat.com \
--cc=bjsdjshi@linux.vnet.ibm.com \
--cc=cjia@nvidia.com \
--cc=jferlan@redhat.com \
--cc=jike.song@intel.com \
--cc=kevin.tian@intel.com \
--cc=kraxel@redhat.com \
--cc=kvm@vger.kernel.org \
--cc=kwankhede@nvidia.com \
--cc=libvir-list@redhat.com \
--cc=mprivozn@redhat.com \
--cc=pbonzini@redhat.com \
--cc=qemu-devel@nongnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.