All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Michael S. Tsirkin" <mst@redhat.com>
To: Rusty Russell <rusty@rustcorp.com.au>
Cc: linux-kernel@vger.kernel.org, Carsten Otte <cotte@de.ibm.com>,
	Christian Borntraeger <borntraeger@de.ibm.com>,
	linux390@de.ibm.com, Martin Schwidefsky <schwidefsky@de.ibm.com>,
	Heiko Carstens <heiko.carstens@de.ibm.com>,
	Shirley Ma <xma@us.ibm.com>,
	lguest@lists.ozlabs.org,
	virtualization@lists.linux-foundation.org,
	netdev@vger.kernel.org, linux-s390@vger.kernel.org,
	kvm@vger.kernel.org, Krishna Kumar <krkumar2@in.ibm.com>,
	Tom Lendacky <tahm@linux.vnet.ibm.com>,
	steved@us.ibm.com, habanero@linux.vnet.ibm.com
Subject: Re: [PATCH 14/18] virtio: add api for delayed callbacks
Date: Thu, 19 May 2011 10:24:12 +0300	[thread overview]
Message-ID: <20110519072412.GA31253@redhat.com> (raw)
In-Reply-To: <87boz3dsoe.fsf@rustcorp.com.au>

On Mon, May 16, 2011 at 04:43:21PM +0930, Rusty Russell wrote:
> On Sun, 15 May 2011 15:48:18 +0300, "Michael S. Tsirkin" <mst@redhat.com> wrote:
> > On Mon, May 09, 2011 at 03:27:33PM +0930, Rusty Russell wrote:
> > > On Wed, 4 May 2011 23:52:33 +0300, "Michael S. Tsirkin" <mst@redhat.com> wrote:
> > > > Add an API that tells the other side that callbacks
> > > > should be delayed until a lot of work has been done.
> > > > Implement using the new used_event feature.
> > > 
> > > Since you're going to add a capacity query anyway, why not add the
> > > threshold argument here?
> > 
> > I thought that if we keep the API kind of generic
> > there might be more of a chance that future transports
> > will be able to implement it. For example, with an
> > old host we can't commit to a specific index.
> 
> No, it's always a hint anyway: you can be notified before the threshold
> is reached.  But best make it explicit I think.
> 
> Cheers,
> Rusty.


I tried doing that and remembered the real reason I went for this API:

capacity is limited by descriptor table space, not
used ring space: each entry in the used ring frees up multiple entries
in the descriptor ring. Thus the ring can't provide
callback after capacity is N: capacity is only available
after we get bufs.

We could try and make the API pass in the number of freed bufs, however:
- this is not really what virtio-net cares about (it cares about
  capacity)
- if the driver passes a number > number of outstanding bufs, it will
  never get a callback. So to stay correct the driver will need to
  track number of outstanding requests. The simpler API avoids that. 


APIs are easy to change so I'm guessing it's not a major blocker:
we can change later when e.g. block tries to
pass in some kind of extra hint: we'll be smarter
about how this API can change then.

Right?

-- 
MST

WARNING: multiple messages have this Message-ID (diff)
From: "Michael S. Tsirkin" <mst-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org>
To: Rusty Russell <rusty-8n+1lVoiYb80n/F98K4Iww@public.gmane.org>
Cc: Krishna Kumar <krkumar2-xthvdsQ13ZrQT0dZR+AlfA@public.gmane.org>,
	Carsten Otte <cotte-tA70FqPdS9bQT0dZR+AlfA@public.gmane.org>,
	lguest-uLR06cmDAlY/bJ5BZ2RsiQ@public.gmane.org,
	Shirley Ma <xma-r/Jw6+rmf7HQT0dZR+AlfA@public.gmane.org>,
	kvm-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	linux-s390-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	netdev-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	habanero-23VcF4HTsmIX0ybBhKVfKdBPR1lH4CV8@public.gmane.org,
	Heiko Carstens
	<heiko.carstens-tA70FqPdS9bQT0dZR+AlfA@public.gmane.org>,
	linux-kernel-u79uwXL29TY76Z2rM5mHXA@public.gmane.org,
	virtualization-cunTk1MwBs9QetFLy7KEm3xJsTq8ys+cHZ5vskTnxNA@public.gmane.org,
	steved-r/Jw6+rmf7HQT0dZR+AlfA@public.gmane.org,
	Christian Borntraeger
	<borntraeger-tA70FqPdS9bQT0dZR+AlfA@public.gmane.org>,
	Tom Lendacky
	<tahm-23VcF4HTsmIX0ybBhKVfKdBPR1lH4CV8@public.gmane.org>,
	Martin Schwidefsky
	<schwidefsky-tA70FqPdS9bQT0dZR+AlfA@public.gmane.org>,
	linux390-tA70FqPdS9bQT0dZR+AlfA@public.gmane.org
Subject: Re: [PATCH 14/18] virtio: add api for delayed callbacks
Date: Thu, 19 May 2011 10:24:12 +0300	[thread overview]
Message-ID: <20110519072412.GA31253@redhat.com> (raw)
In-Reply-To: <87boz3dsoe.fsf-8n+1lVoiYb80n/F98K4Iww@public.gmane.org>

On Mon, May 16, 2011 at 04:43:21PM +0930, Rusty Russell wrote:
> On Sun, 15 May 2011 15:48:18 +0300, "Michael S. Tsirkin" <mst-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org> wrote:
> > On Mon, May 09, 2011 at 03:27:33PM +0930, Rusty Russell wrote:
> > > On Wed, 4 May 2011 23:52:33 +0300, "Michael S. Tsirkin" <mst-H+wXaHxf7aLQT0dZR+AlfA@public.gmane.org> wrote:
> > > > Add an API that tells the other side that callbacks
> > > > should be delayed until a lot of work has been done.
> > > > Implement using the new used_event feature.
> > > 
> > > Since you're going to add a capacity query anyway, why not add the
> > > threshold argument here?
> > 
> > I thought that if we keep the API kind of generic
> > there might be more of a chance that future transports
> > will be able to implement it. For example, with an
> > old host we can't commit to a specific index.
> 
> No, it's always a hint anyway: you can be notified before the threshold
> is reached.  But best make it explicit I think.
> 
> Cheers,
> Rusty.


I tried doing that and remembered the real reason I went for this API:

capacity is limited by descriptor table space, not
used ring space: each entry in the used ring frees up multiple entries
in the descriptor ring. Thus the ring can't provide
callback after capacity is N: capacity is only available
after we get bufs.

We could try and make the API pass in the number of freed bufs, however:
- this is not really what virtio-net cares about (it cares about
  capacity)
- if the driver passes a number > number of outstanding bufs, it will
  never get a callback. So to stay correct the driver will need to
  track number of outstanding requests. The simpler API avoids that. 


APIs are easy to change so I'm guessing it's not a major blocker:
we can change later when e.g. block tries to
pass in some kind of extra hint: we'll be smarter
about how this API can change then.

Right?

-- 
MST

  reply	other threads:[~2011-05-19  7:24 UTC|newest]

Thread overview: 144+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2011-05-04 20:50 [PATCH 00/18] virtio and vhost-net performance enhancements Michael S. Tsirkin
2011-05-04 20:50 ` Michael S. Tsirkin
2011-05-04 20:50 ` [PATCH 01/18] virtio: 64 bit features Michael S. Tsirkin
2011-05-04 20:50 ` Michael S. Tsirkin
2011-05-04 20:50   ` Michael S. Tsirkin
2011-05-04 20:50 ` [PATCH 02/18] virtio_test: update for " Michael S. Tsirkin
2011-05-04 20:50   ` Michael S. Tsirkin
2011-05-04 20:50   ` Michael S. Tsirkin
2011-05-04 20:50 ` [PATCH 03/18] vhost: fix " Michael S. Tsirkin
2011-05-04 20:50   ` Michael S. Tsirkin
2011-05-04 20:50   ` Michael S. Tsirkin
2011-05-04 20:51 ` [PATCH 04/18] virtio: don't delay avail index update Michael S. Tsirkin
2011-05-04 20:51 ` Michael S. Tsirkin
2011-05-04 20:51   ` Michael S. Tsirkin
2011-05-04 20:51 ` [PATCH 05/18] virtio: used event index interface Michael S. Tsirkin
2011-05-04 20:51   ` Michael S. Tsirkin
2011-05-04 20:51   ` Michael S. Tsirkin
2011-05-04 21:56   ` Tom Lendacky
2011-05-04 21:56   ` Tom Lendacky
2011-05-05  9:38     ` Michael S. Tsirkin
2011-05-05  9:38     ` Michael S. Tsirkin
2011-05-04 20:51 ` [PATCH 06/18] virtio_ring: avail " Michael S. Tsirkin
2011-05-04 20:51   ` Michael S. Tsirkin
2011-05-04 20:51   ` Michael S. Tsirkin
2011-05-09  4:13   ` Rusty Russell
2011-05-09  4:13   ` Rusty Russell
2011-05-09  4:13     ` Rusty Russell
2011-05-15 12:47     ` Michael S. Tsirkin
2011-05-15 12:47     ` Michael S. Tsirkin
2011-05-15 12:47       ` Michael S. Tsirkin
2011-05-16  6:23       ` Rusty Russell
2011-05-16  6:23       ` Rusty Russell
2011-05-16  6:23         ` Rusty Russell
2011-05-17  6:00         ` Michael S. Tsirkin
2011-05-17  6:00         ` Michael S. Tsirkin
2011-05-17  6:00           ` Michael S. Tsirkin
2011-05-18  0:08           ` Rusty Russell
2011-05-18  0:08           ` Rusty Russell
2011-05-18  0:08             ` Rusty Russell
2011-05-04 20:51 ` [PATCH 07/18] virtio ring: inline function to check for events Michael S. Tsirkin
2011-05-04 20:51 ` Michael S. Tsirkin
2011-05-04 20:51   ` Michael S. Tsirkin
2011-05-05  8:34   ` Stefan Hajnoczi
2011-05-05  8:56     ` Michael S. Tsirkin
2011-05-05  8:56     ` Michael S. Tsirkin
2011-05-05  8:34   ` Stefan Hajnoczi
2011-05-04 20:51 ` [PATCH 08/18] virtio_ring: support for used_event idx feature Michael S. Tsirkin
2011-05-04 20:51   ` Michael S. Tsirkin
2011-05-04 20:51   ` Michael S. Tsirkin
2011-05-09  4:17   ` Rusty Russell
2011-05-09  4:17   ` Rusty Russell
2011-05-09  4:17     ` Rusty Russell
2011-05-15 12:47     ` Michael S. Tsirkin
2011-05-15 12:47     ` Michael S. Tsirkin
2011-05-15 12:47       ` Michael S. Tsirkin
2011-05-04 20:51 ` [PATCH 09/18] virtio: use avail_event index Michael S. Tsirkin
2011-05-04 20:51   ` Michael S. Tsirkin
2011-05-04 20:51   ` Michael S. Tsirkin
2011-05-04 21:58   ` Tom Lendacky
2011-05-04 21:58   ` Tom Lendacky
2011-05-05  9:34     ` Michael S. Tsirkin
2011-05-05  9:34     ` Michael S. Tsirkin
2011-05-09  4:33   ` Rusty Russell
2011-05-09  4:33   ` Rusty Russell
2011-05-09  4:33     ` Rusty Russell
2011-05-15 13:55     ` Michael S. Tsirkin
2011-05-15 13:55     ` Michael S. Tsirkin
2011-05-15 13:55       ` Michael S. Tsirkin
2011-05-16  7:12       ` Rusty Russell
2011-05-16  7:12       ` Rusty Russell
2011-05-16  7:12         ` Rusty Russell
2011-05-17  6:10         ` Michael S. Tsirkin
2011-05-17  6:10           ` Michael S. Tsirkin
2011-05-18  0:19           ` Rusty Russell
2011-05-18  0:19           ` Rusty Russell
2011-05-18  0:19             ` Rusty Russell
2011-05-18  5:43             ` Michael S. Tsirkin
2011-05-18  5:43             ` Michael S. Tsirkin
2011-05-18  5:43               ` Michael S. Tsirkin
2011-05-19  7:27             ` Michael S. Tsirkin
2011-05-19  7:27             ` Michael S. Tsirkin
2011-05-19  7:27               ` Michael S. Tsirkin
2011-05-17  6:10         ` Michael S. Tsirkin
2011-05-17 16:23         ` Tom Lendacky
2011-05-17 16:23         ` Tom Lendacky
2011-05-04 20:51 ` [PATCH 10/18] vhost: utilize used_event index Michael S. Tsirkin
2011-05-04 20:51   ` Michael S. Tsirkin
2011-05-04 20:51   ` Michael S. Tsirkin
2011-05-04 20:52 ` [PATCH 11/18] vhost: support avail_event idx Michael S. Tsirkin
2011-05-04 20:52   ` Michael S. Tsirkin
2011-05-04 20:52   ` Michael S. Tsirkin
2011-05-04 20:52 ` [PATCH 12/18] virtio_test: support used_event index Michael S. Tsirkin
2011-05-04 20:52   ` Michael S. Tsirkin
2011-05-04 20:52   ` Michael S. Tsirkin
2011-05-04 20:52 ` [PATCH 13/18] virtio_test: avail_event index support Michael S. Tsirkin
2011-05-04 20:52 ` Michael S. Tsirkin
2011-05-04 20:52   ` Michael S. Tsirkin
2011-05-04 20:52 ` [PATCH 14/18] virtio: add api for delayed callbacks Michael S. Tsirkin
2011-05-04 20:52   ` Michael S. Tsirkin
2011-05-04 20:52   ` Michael S. Tsirkin
2011-05-09  5:57   ` Rusty Russell
2011-05-09  5:57   ` Rusty Russell
2011-05-09  5:57     ` Rusty Russell
2011-05-15 12:48     ` Michael S. Tsirkin
2011-05-15 12:48     ` Michael S. Tsirkin
2011-05-15 12:48       ` Michael S. Tsirkin
2011-05-16  7:13       ` Rusty Russell
2011-05-16  7:13       ` Rusty Russell
2011-05-16  7:13         ` Rusty Russell
2011-05-19  7:24         ` Michael S. Tsirkin [this message]
2011-05-19  7:24           ` Michael S. Tsirkin
2011-05-20  7:43           ` Rusty Russell
2011-05-20  7:43           ` Rusty Russell
2011-05-20  7:43             ` Rusty Russell
2011-05-19  7:24         ` Michael S. Tsirkin
2011-05-04 20:52 ` [PATCH 15/18] virtio_net: delay TX callbacks Michael S. Tsirkin
2011-05-04 20:52   ` Michael S. Tsirkin
2011-05-04 20:52 ` Michael S. Tsirkin
2011-05-04 20:52 ` [PATCH 16/18] virtio_ring: Add capacity check API Michael S. Tsirkin
2011-05-04 20:52   ` Michael S. Tsirkin
2011-05-04 20:52   ` Michael S. Tsirkin
2011-05-04 20:53 ` [PATCH 17/18] virtio_net: fix TX capacity checks using new API Michael S. Tsirkin
2011-05-04 20:53   ` Michael S. Tsirkin
2011-05-04 20:53   ` Michael S. Tsirkin
2011-05-04 20:53 ` [PATCH 18/18] virtio_net: limit xmit polling Michael S. Tsirkin
2011-05-04 20:53   ` Michael S. Tsirkin
2011-05-04 20:53   ` Michael S. Tsirkin
2011-05-05 15:07 ` [PATCH 0/3] virtio and vhost-net performance enhancements Michael S. Tsirkin
2011-05-05 15:07   ` Michael S. Tsirkin
2011-05-05 15:08   ` [PATCH 1/3] virtio: fix avail event support Michael S. Tsirkin
2011-05-05 15:08   ` Michael S. Tsirkin
2011-05-05 15:08     ` Michael S. Tsirkin
2011-05-05 15:08   ` [PATCH 2/3] virtio_ring: check used_event offset Michael S. Tsirkin
2011-05-05 15:08     ` Michael S. Tsirkin
2011-05-05 15:08   ` Michael S. Tsirkin
2011-05-05 15:08   ` [PATCH 3/3] virtio_ring: need_event api comment fix Michael S. Tsirkin
2011-05-05 15:08   ` Michael S. Tsirkin
2011-05-05 15:08     ` Michael S. Tsirkin
2011-05-09  5:59     ` Rusty Russell
2011-05-09  5:59     ` Rusty Russell
2011-05-09  5:59       ` Rusty Russell
2011-05-05 15:07 ` [PATCH 0/3] virtio and vhost-net performance enhancements Michael S. Tsirkin
2011-05-11 17:10 ` [PATCH 00/18] " Krishna Kumar2
2011-05-11 17:10 ` Krishna Kumar2

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20110519072412.GA31253@redhat.com \
    --to=mst@redhat.com \
    --cc=borntraeger@de.ibm.com \
    --cc=cotte@de.ibm.com \
    --cc=habanero@linux.vnet.ibm.com \
    --cc=heiko.carstens@de.ibm.com \
    --cc=krkumar2@in.ibm.com \
    --cc=kvm@vger.kernel.org \
    --cc=lguest@lists.ozlabs.org \
    --cc=linux-kernel@vger.kernel.org \
    --cc=linux-s390@vger.kernel.org \
    --cc=linux390@de.ibm.com \
    --cc=netdev@vger.kernel.org \
    --cc=rusty@rustcorp.com.au \
    --cc=schwidefsky@de.ibm.com \
    --cc=steved@us.ibm.com \
    --cc=tahm@linux.vnet.ibm.com \
    --cc=virtualization@lists.linux-foundation.org \
    --cc=xma@us.ibm.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.