From: geoff@hostfission.com
To: "Dr. David Alan Gilbert" <dgilbert@redhat.com>
Cc: marcandre.lureau@redhat.com, maxime.coquelin@redhat.com,
Peter Maydell <peter.maydell@linaro.org>,
QEMU Developers <qemu-devel@nongnu.org>
Subject: Re: RFC: New device for zero-copy VM memory access
Date: Mon, 04 Nov 2019 23:05:18 +1100 [thread overview]
Message-ID: <9b49de1379825ac1445766f4a8d198dc@hostfission.com> (raw)
In-Reply-To: <20191104115546.GB3420@work-vm>
On 2019-11-04 22:55, Dr. David Alan Gilbert wrote:
> * geoff@hostfission.com (geoff@hostfission.com) wrote:
>>
>>
>> On 2019-11-03 21:10, geoff@hostfission.com wrote:
>> > On 2019-11-01 02:52, Dr. David Alan Gilbert wrote:
>> > > * geoff@hostfission.com (geoff@hostfission.com) wrote:
>> > > >
>> > > >
>> > > > On 2019-11-01 01:52, Peter Maydell wrote:
>> > > > > On Thu, 31 Oct 2019 at 14:26, <geoff@hostfission.com> wrote:
>> > > > > > As the author of Looking Glass, I also have to consider the
>> > > > > > maintenance
>> > > > > > and the complexity of implementing the vhost protocol into the
>> > > > > > project.
>> > > > > > At this time a complete Porthole client can be implemented in 150
>> > > > > > lines
>> > > > > > of C without external dependencies, and most of that is boilerplate
>> > > > > > socket code. This IMO is a major factor in deciding to avoid
>> > > > > > vhost-user.
>> > > > >
>> > > > > This is essentially a proposal that we should make our project and
>> > > > > code more complicated so that your project and code can be simpler.
>> > > > > I hope you can see why this isn't necessarily an argument that will hold
>> > > > > very much weight for us :-)
>> > > >
>> > > > Certainly, I do which is why I am still going to see about using
>> > > > vhost,
>> > > > however, a device that uses vhost is likely more complex then
>> > > > the device
>> > > > as it stands right now and as such more maintenance would be
>> > > > involved on
>> > > > your end also. Or have I missed something in that vhost-user can
>> > > > be used
>> > > > directly as a device?
>> > >
>> > > The basic vhost-user stuff isn't actually that hard; if you aren't
>> > > actually shuffling commands over the queues you should find it pretty
>> > > simple - so I think your assumption about it being simpler if you
>> > > avoid
>> > > it might be wrong. It might be easier if you use it!
>> >
>> > I have been looking into this and I am yet to find some decent
>> > documentation or a simple device example I can use to understand how to
>> > create such a device. Do you know of any reading or examples I can
>> > obtain
>> > on how to get an initial do nothing device up and running?
>> >
>> > -Geoff
>>
>> Scratch that, the design just solidified for me and I am now making
>> progress, however it seems that vhost-user can't do what we need here:
>>
>> 1) I dont see any way to recieve notification of socket disconnection,
>> in
>> our use case the client app needs to be able to be (re)connected
>> dynamically. It might be possible to get this event by registering it
>> on
>> the chardev manually but this seems like it would be a kludge.
>
> My understanding was that someone added support for reconnection of
> vhost-user; I'm not sure of the detail - cc'ing in Maxime and
> Marc-Andre.
>
>> 2) I don't see any method of notifying the vhost-user client of the
>> removal of a shared memory mapping. Again, these may not be
>> persistently
>> mapped in the guest as we have no control over the buffer allocation,
>> and
>> as such, we need a method to notify the client that the mapping has
>> become
>> invalid.
>>
>> 3) VHOST_USER_SET_MEM_TABLE is a one time request, again this breaks
>> our
>> usage as we need to change this dynamically at runtime.
>
> I've seen (3) being sent multiple times (It's messy but it happens); so
> I think that fixes (2) as well for you.
Yes, but it's ignored.
/*
* For non-vring specific requests, like VHOST_USER_SET_MEM_TABLE,
* we just need send it once in the first time. For later such
* request, we just ignore it.
*/
if (vhost_user_one_time_request(msg->hdr.request) && dev->vq_index
!= 0) {
msg->hdr.flags &= ~VHOST_USER_NEED_REPLY_MASK;
return 0;
}
>
> Dave
>
>> Unless there are viable solutions to these problems there is no way
>> that
>> vhost-user can be used for this kind of a device.
>>
>> -Geoff
>>
>> >
>> > >
>> > > Dave
>> > >
>> > > > >
>> > > > > thanks
>> > > > > -- PMM
>> > > --
>> > > Dr. David Alan Gilbert / dgilbert@redhat.com / Manchester, UK
> --
> Dr. David Alan Gilbert / dgilbert@redhat.com / Manchester, UK
next prev parent reply other threads:[~2019-11-04 12:08 UTC|newest]
Thread overview: 22+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-10-29 14:31 RFC: New device for zero-copy VM memory access geoff
2019-10-29 22:53 ` geoff
2019-10-30 8:10 ` geoff
2019-10-30 18:52 ` Dr. David Alan Gilbert
2019-10-31 2:55 ` geoff
2019-10-31 11:52 ` geoff
2019-10-31 12:36 ` Peter Maydell
2019-10-31 13:24 ` Dr. David Alan Gilbert
2019-10-31 14:18 ` geoff
2019-10-31 14:52 ` Peter Maydell
2019-10-31 15:21 ` geoff
2019-10-31 15:52 ` Dr. David Alan Gilbert
2019-11-03 10:10 ` geoff
2019-11-03 11:03 ` geoff
2019-11-04 11:55 ` Dr. David Alan Gilbert
2019-11-04 12:05 ` geoff [this message]
2019-11-04 16:35 ` Dr. David Alan Gilbert
2019-11-05 10:05 ` Marc-André Lureau
2019-11-26 18:25 ` Dr. David Alan Gilbert
2019-11-04 10:26 ` Gerd Hoffmann
2019-11-04 10:31 ` geoff
2019-11-05 9:38 ` Gerd Hoffmann
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=9b49de1379825ac1445766f4a8d198dc@hostfission.com \
--to=geoff@hostfission.com \
--cc=dgilbert@redhat.com \
--cc=marcandre.lureau@redhat.com \
--cc=maxime.coquelin@redhat.com \
--cc=peter.maydell@linaro.org \
--cc=qemu-devel@nongnu.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).