From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752659AbdHICiU (ORCPT ); Tue, 8 Aug 2017 22:38:20 -0400 Received: from mx1.redhat.com ([209.132.183.28]:50986 "EHLO mx1.redhat.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1752466AbdHICiS (ORCPT ); Tue, 8 Aug 2017 22:38:18 -0400 DMARC-Filter: OpenDMARC Filter v1.3.2 mx1.redhat.com A78975AFED Authentication-Results: ext-mx10.extmail.prod.ext.phx2.redhat.com; dmarc=none (p=none dis=none) header.from=redhat.com Authentication-Results: ext-mx10.extmail.prod.ext.phx2.redhat.com; spf=fail smtp.mailfrom=jasowang@redhat.com Subject: Re: [PATCH net] Revert "vhost: cache used event for better performance" To: "K. Den" , "Michael S. Tsirkin" Cc: virtualization@lists.linux-foundation.org, kvm@vger.kernel.org, netdev@vger.kernel.org, linux-kernel@vger.kernel.org References: <1501056197-3368-1-git-send-email-jasowang@redhat.com> <20170726155435-mutt-send-email-mst@kernel.org> <117542fc-eef9-c043-7c9e-daafceb7db4e@redhat.com> <6b3a9a98-c095-1729-3528-dd521f136797@redhat.com> <20170726190745-mutt-send-email-mst@kernel.org> <1501396011.21001.11.camel@klaipeden.com> From: Jason Wang Message-ID: <6698b85c-18f4-17e6-db70-7708692fb761@redhat.com> Date: Wed, 9 Aug 2017 10:38:10 +0800 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1 MIME-Version: 1.0 In-Reply-To: <1501396011.21001.11.camel@klaipeden.com> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 8bit Content-Language: en-US X-Greylist: Sender IP whitelisted, not delayed by milter-greylist-4.5.16 (mx1.redhat.com [10.5.110.39]); Wed, 09 Aug 2017 02:38:18 +0000 (UTC) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 2017年07月30日 14:26, K. Den wrote: > On Wed, 2017-07-26 at 19:08 +0300, Michael S. Tsirkin wrote: >> On Wed, Jul 26, 2017 at 09:37:15PM +0800, Jason Wang wrote: >>> >>> On 2017年07月26日 21:18, Jason Wang wrote: >>>> >>>> On 2017年07月26日 20:57, Michael S. Tsirkin wrote: >>>>> On Wed, Jul 26, 2017 at 04:03:17PM +0800, Jason Wang wrote: >>>>>> This reverts commit 809ecb9bca6a9424ccd392d67e368160f8b76c92. Since it >>>>>> was reported to break vhost_net. We want to cache used event and use >>>>>> it to check for notification. We try to valid cached used event by >>>>>> checking whether or not it was ahead of new, but this is not correct >>>>>> all the time, it could be stale and there's no way to know about this. >>>>>> >>>>>> Signed-off-by: Jason Wang >>>>> Could you supply a bit more data here please? How does it get stale? >>>>> What does guest need to do to make it stale? This will be helpful if >>>>> anyone wants to bring it back, or if we want to extend the protocol. >>>>> >>>> The problem we don't know whether or not guest has published a new used >>>> event. The check vring_need_event(vq->last_used_event, new + vq->num, >>>> new) is not sufficient to check for this. >>>> >>>> Thanks >>> More notes, the previous assumption is that we don't move used event back, >>> but this could happen in fact if idx is wrapper around. >> You mean if the 16 bit index wraps around after 64K entries. >> Makes sense. >> >>> Will repost and add >>> this into commit log. >>> >>> Thanks > Hi, Hi, sorry for the late reply, was on vacation last week. > > I am just curious but I have got a question: > AFAIU, if you wanted to keep the caching mechanism alive in the code base, > the following two changes could clear off the issue, or not?: > (1) Always fetch the latest event value from guest when signalled_used event is > invalid, which includes last_used_idx wraps-around case. Otherwise we might need > changes which would complicate too much the logic to properly decide whether or > not to skip signalling in the next vhost_notify round. > (2) On top of that, split the signal-postponing logic to three cases like: > * if the interval of vq.num is [2^16, UINT_MAX]: > any cached event is in should-postpone-signalling interval, so paradoxically > must always do signalling. I think don't think current code can work well if vq.num is grater than 2^15. Since all cached idx is u16. This looks like a bug which needs to be fixed. > * else if the interval of vq.num is [2^15, 2^16): > the logic in the original patch (809ecb9bca6a9) suffices > * else (= less than 2^15) (optional): > checking only (vring_need_event(vq->last_used_event, new + vq->num, new) > would suffice. > > Am I missing something, or is this irrelevant? Looks not, I think this may work. Let me do some test. Thanks > I would appreciate if you could elaborate a bit more how the situation where > event idx wraps around and moves back would make trouble. > > Thanks. > From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jason Wang Subject: Re: [PATCH net] Revert "vhost: cache used event for better performance" Date: Wed, 9 Aug 2017 10:38:10 +0800 Message-ID: <6698b85c-18f4-17e6-db70-7708692fb761@redhat.com> References: <1501056197-3368-1-git-send-email-jasowang@redhat.com> <20170726155435-mutt-send-email-mst@kernel.org> <117542fc-eef9-c043-7c9e-daafceb7db4e@redhat.com> <6b3a9a98-c095-1729-3528-dd521f136797@redhat.com> <20170726190745-mutt-send-email-mst@kernel.org> <1501396011.21001.11.camel@klaipeden.com> Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8"; Format="flowed" Content-Transfer-Encoding: base64 Cc: netdev@vger.kernel.org, linux-kernel@vger.kernel.org, kvm@vger.kernel.org, virtualization@lists.linux-foundation.org To: "K. Den" , "Michael S. Tsirkin" Return-path: In-Reply-To: <1501396011.21001.11.camel@klaipeden.com> Content-Language: en-US List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Sender: virtualization-bounces@lists.linux-foundation.org Errors-To: virtualization-bounces@lists.linux-foundation.org List-Id: netdev.vger.kernel.org CgpPbiAyMDE35bm0MDfmnIgzMOaXpSAxNDoyNiwgSy4gRGVuIHdyb3RlOgo+IE9uIFdlZCwgMjAx Ny0wNy0yNiBhdCAxOTowOCArMDMwMCwgTWljaGFlbCBTLiBUc2lya2luIHdyb3RlOgo+PiBPbiBX ZWQsIEp1bCAyNiwgMjAxNyBhdCAwOTozNzoxNVBNICswODAwLCBKYXNvbiBXYW5nIHdyb3RlOgo+ Pj4KPj4+IE9uIDIwMTflubQwN+aciDI25pelIDIxOjE4LCBKYXNvbiBXYW5nIHdyb3RlOgo+Pj4+ Cj4+Pj4gT24gMjAxN+W5tDA35pyIMjbml6UgMjA6NTcsIE1pY2hhZWwgUy4gVHNpcmtpbiB3cm90 ZToKPj4+Pj4gT24gV2VkLCBKdWwgMjYsIDIwMTcgYXQgMDQ6MDM6MTdQTSArMDgwMCwgSmFzb24g V2FuZyB3cm90ZToKPj4+Pj4+IFRoaXMgcmV2ZXJ0cyBjb21taXQgODA5ZWNiOWJjYTZhOTQyNGNj ZDM5MmQ2N2UzNjgxNjBmOGI3NmM5Mi4gU2luY2UgaXQKPj4+Pj4+IHdhcyByZXBvcnRlZCB0byBi cmVhayB2aG9zdF9uZXQuIFdlIHdhbnQgdG8gY2FjaGUgdXNlZCBldmVudCBhbmQgdXNlCj4+Pj4+ PiBpdCB0byBjaGVjayBmb3Igbm90aWZpY2F0aW9uLiBXZSB0cnkgdG8gdmFsaWQgY2FjaGVkIHVz ZWQgZXZlbnQgYnkKPj4+Pj4+IGNoZWNraW5nIHdoZXRoZXIgb3Igbm90IGl0IHdhcyBhaGVhZCBv ZiBuZXcsIGJ1dCB0aGlzIGlzIG5vdCBjb3JyZWN0Cj4+Pj4+PiBhbGwgdGhlIHRpbWUsIGl0IGNv dWxkIGJlIHN0YWxlIGFuZCB0aGVyZSdzIG5vIHdheSB0byBrbm93IGFib3V0IHRoaXMuCj4+Pj4+ Pgo+Pj4+Pj4gU2lnbmVkLW9mZi1ieTogSmFzb24gV2FuZzxqYXNvd2FuZ0ByZWRoYXQuY29tPgo+ Pj4+PiBDb3VsZCB5b3Ugc3VwcGx5IGEgYml0IG1vcmUgZGF0YSBoZXJlIHBsZWFzZT8gIEhvdyBk b2VzIGl0IGdldCBzdGFsZT8KPj4+Pj4gV2hhdCBkb2VzIGd1ZXN0IG5lZWQgdG8gZG8gdG8gbWFr ZSBpdCBzdGFsZT8gIFRoaXMgd2lsbCBiZSBoZWxwZnVsIGlmCj4+Pj4+IGFueW9uZSB3YW50cyB0 byBicmluZyBpdCBiYWNrLCBvciBpZiB3ZSB3YW50IHRvIGV4dGVuZCB0aGUgcHJvdG9jb2wuCj4+ Pj4+Cj4+Pj4gVGhlIHByb2JsZW0gd2UgZG9uJ3Qga25vdyB3aGV0aGVyIG9yIG5vdCBndWVzdCBo YXMgcHVibGlzaGVkIGEgbmV3IHVzZWQKPj4+PiBldmVudC4gVGhlIGNoZWNrIHZyaW5nX25lZWRf ZXZlbnQodnEtPmxhc3RfdXNlZF9ldmVudCwgbmV3ICsgdnEtPm51bSwKPj4+PiBuZXcpIGlzIG5v dCBzdWZmaWNpZW50IHRvIGNoZWNrIGZvciB0aGlzLgo+Pj4+Cj4+Pj4gVGhhbmtzCj4+PiBNb3Jl IG5vdGVzLCB0aGUgcHJldmlvdXMgYXNzdW1wdGlvbiBpcyB0aGF0IHdlIGRvbid0IG1vdmUgdXNl ZCBldmVudCBiYWNrLAo+Pj4gYnV0IHRoaXMgY291bGQgaGFwcGVuIGluIGZhY3QgaWYgaWR4IGlz IHdyYXBwZXIgYXJvdW5kLgo+PiBZb3UgbWVhbiBpZiB0aGUgMTYgYml0IGluZGV4IHdyYXBzIGFy b3VuZCBhZnRlciA2NEsgZW50cmllcy4KPj4gTWFrZXMgc2Vuc2UuCj4+Cj4+PiBXaWxsIHJlcG9z dCBhbmQgYWRkCj4+PiB0aGlzIGludG8gY29tbWl0IGxvZy4KPj4+Cj4+PiBUaGFua3MKPiBIaSwK CkhpLCBzb3JyeSBmb3IgdGhlIGxhdGUgcmVwbHksIHdhcyBvbiB2YWNhdGlvbiBsYXN0IHdlZWsu Cgo+Cj4gSSBhbSBqdXN0IGN1cmlvdXMgYnV0IEkgaGF2ZSBnb3QgYSBxdWVzdGlvbjoKPiBBRkFJ VSwgaWYgeW91IHdhbnRlZCB0byBrZWVwIHRoZSBjYWNoaW5nIG1lY2hhbmlzbSBhbGl2ZSBpbiB0 aGUgY29kZSBiYXNlLAo+IHRoZSBmb2xsb3dpbmcgdHdvIGNoYW5nZXMgY291bGQgY2xlYXIgb2Zm IHRoZSBpc3N1ZSwgb3Igbm90PzoKPiAoMSkgQWx3YXlzIGZldGNoIHRoZSBsYXRlc3QgZXZlbnQg dmFsdWUgZnJvbSBndWVzdCB3aGVuIHNpZ25hbGxlZF91c2VkIGV2ZW50IGlzCj4gaW52YWxpZCwg d2hpY2ggaW5jbHVkZXMgbGFzdF91c2VkX2lkeCB3cmFwcy1hcm91bmQgY2FzZS4gT3RoZXJ3aXNl IHdlIG1pZ2h0IG5lZWQKPiBjaGFuZ2VzIHdoaWNoIHdvdWxkIGNvbXBsaWNhdGUgdG9vIG11Y2gg dGhlIGxvZ2ljIHRvIHByb3Blcmx5IGRlY2lkZSB3aGV0aGVyIG9yCj4gbm90IHRvIHNraXAgc2ln bmFsbGluZyBpbiB0aGUgbmV4dCB2aG9zdF9ub3RpZnkgcm91bmQuCj4gKDIpIE9uIHRvcCBvZiB0 aGF0LCBzcGxpdCB0aGUgc2lnbmFsLXBvc3Rwb25pbmcgbG9naWMgdG8gdGhyZWUgY2FzZXMgbGlr ZToKPiAqIGlmIHRoZSBpbnRlcnZhbCBvZiB2cS5udW0gaXMgWzJeMTYsIFVJTlRfTUFYXToKPiBh bnkgY2FjaGVkIGV2ZW50IGlzIGluIHNob3VsZC1wb3N0cG9uZS1zaWduYWxsaW5nIGludGVydmFs LCBzbyBwYXJhZG94aWNhbGx5Cj4gbXVzdCBhbHdheXMgZG8gc2lnbmFsbGluZy4KCkkgdGhpbmsg ZG9uJ3QgdGhpbmsgY3VycmVudCBjb2RlIGNhbiB3b3JrIHdlbGwgaWYgdnEubnVtIGlzIGdyYXRl ciB0aGFuIAoyXjE1LiBTaW5jZSBhbGwgY2FjaGVkIGlkeCBpcyB1MTYuIFRoaXMgbG9va3MgbGlr ZSBhIGJ1ZyB3aGljaCBuZWVkcyB0byAKYmUgZml4ZWQuCgo+ICogZWxzZSBpZiB0aGUgaW50ZXJ2 YWwgb2YgdnEubnVtIGlzIFsyXjE1LCAyXjE2KToKPiB0aGUgbG9naWMgaW4gdGhlIG9yaWdpbmFs IHBhdGNoICg4MDllY2I5YmNhNmE5KSBzdWZmaWNlcwo+ICogZWxzZSAoPSBsZXNzIHRoYW4gMl4x NSkgKG9wdGlvbmFsKToKPiBjaGVja2luZyBvbmx5ICh2cmluZ19uZWVkX2V2ZW50KHZxLT5sYXN0 X3VzZWRfZXZlbnQsIG5ldyArIHZxLT5udW0sIG5ldykKPiB3b3VsZCBzdWZmaWNlLgo+Cj4gQW0g SSBtaXNzaW5nIHNvbWV0aGluZywgb3IgaXMgdGhpcyBpcnJlbGV2YW50PwoKTG9va3Mgbm90LCBJ IHRoaW5rIHRoaXMgbWF5IHdvcmsuIExldCBtZSBkbyBzb21lIHRlc3QuCgpUaGFua3MKCj4gSSB3 b3VsZCBhcHByZWNpYXRlIGlmIHlvdSBjb3VsZCBlbGFib3JhdGUgYSBiaXQgbW9yZSBob3cgdGhl IHNpdHVhdGlvbiB3aGVyZQo+IGV2ZW50IGlkeCB3cmFwcyBhcm91bmQgYW5kIG1vdmVzIGJhY2sg d291bGQgbWFrZSB0cm91YmxlLgo+Cj4gVGhhbmtzLgo+CgoKX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX18KVmlydHVhbGl6YXRpb24gbWFpbGluZyBsaXN0ClZp cnR1YWxpemF0aW9uQGxpc3RzLmxpbnV4LWZvdW5kYXRpb24ub3JnCmh0dHBzOi8vbGlzdHMubGlu dXhmb3VuZGF0aW9uLm9yZy9tYWlsbWFuL2xpc3RpbmZvL3ZpcnR1YWxpemF0aW9u