From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752193AbdFUDZp (ORCPT ); Tue, 20 Jun 2017 23:25:45 -0400 Received: from mga03.intel.com ([134.134.136.65]:49579 "EHLO mga03.intel.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751135AbdFUDZn (ORCPT ); Tue, 20 Jun 2017 23:25:43 -0400 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.39,367,1493708400"; d="scan'208";a="1185068952" Message-ID: <5949E7C0.3050106@intel.com> Date: Wed, 21 Jun 2017 11:28:00 +0800 From: Wei Wang User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:31.0) Gecko/20100101 Thunderbird/31.7.0 MIME-Version: 1.0 To: "Michael S. Tsirkin" CC: virtio-dev@lists.oasis-open.org, linux-kernel@vger.kernel.org, qemu-devel@nongnu.org, virtualization@lists.linux-foundation.org, kvm@vger.kernel.org, linux-mm@kvack.org, david@redhat.com, dave.hansen@intel.com, cornelia.huck@de.ibm.com, akpm@linux-foundation.org, mgorman@techsingularity.net, aarcange@redhat.com, amit.shah@redhat.com, pbonzini@redhat.com, liliang.opensource@gmail.com Subject: Re: [virtio-dev] Re: [PATCH v11 6/6] virtio-balloon: VIRTIO_BALLOON_F_CMD_VQ References: <1497004901-30593-1-git-send-email-wei.w.wang@intel.com> <1497004901-30593-7-git-send-email-wei.w.wang@intel.com> <20170620190343-mutt-send-email-mst@kernel.org> In-Reply-To: <20170620190343-mutt-send-email-mst@kernel.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 06/21/2017 12:18 AM, Michael S. Tsirkin wrote: > On Fri, Jun 09, 2017 at 06:41:41PM +0800, Wei Wang wrote: >> - if (!virtqueue_indirect_desc_table_add(vq, desc, num)) { >> + if (!virtqueue_indirect_desc_table_add(vq, desc, *num)) { >> virtqueue_kick(vq); >> - wait_event(vb->acked, virtqueue_get_buf(vq, &len)); >> - vb->balloon_page_chunk.chunk_num = 0; >> + if (busy_wait) >> + while (!virtqueue_get_buf(vq, &len) && >> + !virtqueue_is_broken(vq)) >> + cpu_relax(); >> + else >> + wait_event(vb->acked, virtqueue_get_buf(vq, &len)); > > This is something I didn't previously notice. > As you always keep a single buffer in flight, you do not > really need indirect at all. Just add all descriptors > in the ring directly, then kick. > > E.g. > virtqueue_add_first > virtqueue_add_next > virtqueue_add_last > > ? > > You also want a flag to avoid allocations but there's no need to do it > per descriptor, set it on vq. > Without using the indirect table, I'm thinking about changing to use the standard sg (i.e. struct scatterlist), instead of vring_desc, so that we don't need to modify or add any new functions of virtqueue_add(). In this case, we will kmalloc an array of sgs in probe(), and we can add the sgs one by one to the vq, which won't trigger the allocation of an indirect table inside virtqueue_add(), and then kick when all are added. Best, Wei From mboxrd@z Thu Jan 1 00:00:00 1970 From: Wei Wang Subject: Re: Re: [PATCH v11 6/6] virtio-balloon: VIRTIO_BALLOON_F_CMD_VQ Date: Wed, 21 Jun 2017 11:28:00 +0800 Message-ID: <5949E7C0.3050106@intel.com> References: <1497004901-30593-1-git-send-email-wei.w.wang@intel.com> <1497004901-30593-7-git-send-email-wei.w.wang@intel.com> <20170620190343-mutt-send-email-mst@kernel.org> Mime-Version: 1.0 Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Cc: virtio-dev@lists.oasis-open.org, linux-kernel@vger.kernel.org, qemu-devel@nongnu.org, virtualization@lists.linux-foundation.org, kvm@vger.kernel.org, linux-mm@kvack.org, david@redhat.com, dave.hansen@intel.com, cornelia.huck@de.ibm.com, akpm@linux-foundation.org, mgorman@techsingularity.net, aarcange@redhat.com, amit.shah@redhat.com, pbonzini@redhat.com, liliang.opensource@gmail.com To: "Michael S. Tsirkin" Return-path: Sender: List-Post: List-Help: List-Unsubscribe: List-Subscribe: In-Reply-To: <20170620190343-mutt-send-email-mst@kernel.org> List-Id: kvm.vger.kernel.org On 06/21/2017 12:18 AM, Michael S. Tsirkin wrote: > On Fri, Jun 09, 2017 at 06:41:41PM +0800, Wei Wang wrote: >> - if (!virtqueue_indirect_desc_table_add(vq, desc, num)) { >> + if (!virtqueue_indirect_desc_table_add(vq, desc, *num)) { >> virtqueue_kick(vq); >> - wait_event(vb->acked, virtqueue_get_buf(vq, &len)); >> - vb->balloon_page_chunk.chunk_num = 0; >> + if (busy_wait) >> + while (!virtqueue_get_buf(vq, &len) && >> + !virtqueue_is_broken(vq)) >> + cpu_relax(); >> + else >> + wait_event(vb->acked, virtqueue_get_buf(vq, &len)); > > This is something I didn't previously notice. > As you always keep a single buffer in flight, you do not > really need indirect at all. Just add all descriptors > in the ring directly, then kick. > > E.g. > virtqueue_add_first > virtqueue_add_next > virtqueue_add_last > > ? > > You also want a flag to avoid allocations but there's no need to do it > per descriptor, set it on vq. > Without using the indirect table, I'm thinking about changing to use the standard sg (i.e. struct scatterlist), instead of vring_desc, so that we don't need to modify or add any new functions of virtqueue_add(). In this case, we will kmalloc an array of sgs in probe(), and we can add the sgs one by one to the vq, which won't trigger the allocation of an indirect table inside virtqueue_add(), and then kick when all are added. Best, Wei From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-pg0-f72.google.com (mail-pg0-f72.google.com [74.125.83.72]) by kanga.kvack.org (Postfix) with ESMTP id 33F1B6B0279 for ; Tue, 20 Jun 2017 23:25:44 -0400 (EDT) Received: by mail-pg0-f72.google.com with SMTP id u62so55563082pgb.13 for ; Tue, 20 Jun 2017 20:25:44 -0700 (PDT) Received: from mga14.intel.com (mga14.intel.com. [192.55.52.115]) by mx.google.com with ESMTPS id r3si13130671plb.313.2017.06.20.20.25.42 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 20 Jun 2017 20:25:43 -0700 (PDT) Message-ID: <5949E7C0.3050106@intel.com> Date: Wed, 21 Jun 2017 11:28:00 +0800 From: Wei Wang MIME-Version: 1.0 Subject: Re: [virtio-dev] Re: [PATCH v11 6/6] virtio-balloon: VIRTIO_BALLOON_F_CMD_VQ References: <1497004901-30593-1-git-send-email-wei.w.wang@intel.com> <1497004901-30593-7-git-send-email-wei.w.wang@intel.com> <20170620190343-mutt-send-email-mst@kernel.org> In-Reply-To: <20170620190343-mutt-send-email-mst@kernel.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Sender: owner-linux-mm@kvack.org List-ID: To: "Michael S. Tsirkin" Cc: virtio-dev@lists.oasis-open.org, linux-kernel@vger.kernel.org, qemu-devel@nongnu.org, virtualization@lists.linux-foundation.org, kvm@vger.kernel.org, linux-mm@kvack.org, david@redhat.com, dave.hansen@intel.com, cornelia.huck@de.ibm.com, akpm@linux-foundation.org, mgorman@techsingularity.net, aarcange@redhat.com, amit.shah@redhat.com, pbonzini@redhat.com, liliang.opensource@gmail.com On 06/21/2017 12:18 AM, Michael S. Tsirkin wrote: > On Fri, Jun 09, 2017 at 06:41:41PM +0800, Wei Wang wrote: >> - if (!virtqueue_indirect_desc_table_add(vq, desc, num)) { >> + if (!virtqueue_indirect_desc_table_add(vq, desc, *num)) { >> virtqueue_kick(vq); >> - wait_event(vb->acked, virtqueue_get_buf(vq, &len)); >> - vb->balloon_page_chunk.chunk_num = 0; >> + if (busy_wait) >> + while (!virtqueue_get_buf(vq, &len) && >> + !virtqueue_is_broken(vq)) >> + cpu_relax(); >> + else >> + wait_event(vb->acked, virtqueue_get_buf(vq, &len)); > > This is something I didn't previously notice. > As you always keep a single buffer in flight, you do not > really need indirect at all. Just add all descriptors > in the ring directly, then kick. > > E.g. > virtqueue_add_first > virtqueue_add_next > virtqueue_add_last > > ? > > You also want a flag to avoid allocations but there's no need to do it > per descriptor, set it on vq. > Without using the indirect table, I'm thinking about changing to use the standard sg (i.e. struct scatterlist), instead of vring_desc, so that we don't need to modify or add any new functions of virtqueue_add(). In this case, we will kmalloc an array of sgs in probe(), and we can add the sgs one by one to the vq, which won't trigger the allocation of an indirect table inside virtqueue_add(), and then kick when all are added. Best, Wei -- To unsubscribe, send a message with 'unsubscribe linux-mm' in the body to majordomo@kvack.org. For more info on Linux MM, see: http://www.linux-mm.org/ . Don't email: email@kvack.org From mboxrd@z Thu Jan 1 00:00:00 1970 Received: from eggs.gnu.org ([2001:4830:134:3::10]:40346) by lists.gnu.org with esmtp (Exim 4.71) (envelope-from ) id 1dNWH8-0007lF-3y for qemu-devel@nongnu.org; Tue, 20 Jun 2017 23:25:50 -0400 Received: from Debian-exim by eggs.gnu.org with spam-scanned (Exim 4.71) (envelope-from ) id 1dNWH4-0007XG-4n for qemu-devel@nongnu.org; Tue, 20 Jun 2017 23:25:50 -0400 Received: from mga04.intel.com ([192.55.52.120]:21924) by eggs.gnu.org with esmtps (TLS1.0:DHE_RSA_AES_256_CBC_SHA1:32) (Exim 4.71) (envelope-from ) id 1dNWH3-0007WS-Qx for qemu-devel@nongnu.org; Tue, 20 Jun 2017 23:25:46 -0400 Message-ID: <5949E7C0.3050106@intel.com> Date: Wed, 21 Jun 2017 11:28:00 +0800 From: Wei Wang MIME-Version: 1.0 References: <1497004901-30593-1-git-send-email-wei.w.wang@intel.com> <1497004901-30593-7-git-send-email-wei.w.wang@intel.com> <20170620190343-mutt-send-email-mst@kernel.org> In-Reply-To: <20170620190343-mutt-send-email-mst@kernel.org> Content-Type: text/plain; charset=windows-1252; format=flowed Content-Transfer-Encoding: 7bit Subject: Re: [Qemu-devel] [virtio-dev] Re: [PATCH v11 6/6] virtio-balloon: VIRTIO_BALLOON_F_CMD_VQ List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , To: "Michael S. Tsirkin" Cc: virtio-dev@lists.oasis-open.org, linux-kernel@vger.kernel.org, qemu-devel@nongnu.org, virtualization@lists.linux-foundation.org, kvm@vger.kernel.org, linux-mm@kvack.org, david@redhat.com, dave.hansen@intel.com, cornelia.huck@de.ibm.com, akpm@linux-foundation.org, mgorman@techsingularity.net, aarcange@redhat.com, amit.shah@redhat.com, pbonzini@redhat.com, liliang.opensource@gmail.com On 06/21/2017 12:18 AM, Michael S. Tsirkin wrote: > On Fri, Jun 09, 2017 at 06:41:41PM +0800, Wei Wang wrote: >> - if (!virtqueue_indirect_desc_table_add(vq, desc, num)) { >> + if (!virtqueue_indirect_desc_table_add(vq, desc, *num)) { >> virtqueue_kick(vq); >> - wait_event(vb->acked, virtqueue_get_buf(vq, &len)); >> - vb->balloon_page_chunk.chunk_num = 0; >> + if (busy_wait) >> + while (!virtqueue_get_buf(vq, &len) && >> + !virtqueue_is_broken(vq)) >> + cpu_relax(); >> + else >> + wait_event(vb->acked, virtqueue_get_buf(vq, &len)); > > This is something I didn't previously notice. > As you always keep a single buffer in flight, you do not > really need indirect at all. Just add all descriptors > in the ring directly, then kick. > > E.g. > virtqueue_add_first > virtqueue_add_next > virtqueue_add_last > > ? > > You also want a flag to avoid allocations but there's no need to do it > per descriptor, set it on vq. > Without using the indirect table, I'm thinking about changing to use the standard sg (i.e. struct scatterlist), instead of vring_desc, so that we don't need to modify or add any new functions of virtqueue_add(). In this case, we will kmalloc an array of sgs in probe(), and we can add the sgs one by one to the vq, which won't trigger the allocation of an indirect table inside virtqueue_add(), and then kick when all are added. Best, Wei