From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-7.5 required=3.0 tests=BAYES_00,DKIMWL_WL_HIGH, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id B3F2DC433EF for ; Wed, 22 Sep 2021 13:59:40 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 9C9DB6120C for ; Wed, 22 Sep 2021 13:59:40 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S232243AbhIVOBJ (ORCPT ); Wed, 22 Sep 2021 10:01:09 -0400 Received: from mail.kernel.org ([198.145.29.99]:38672 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S232199AbhIVOBJ (ORCPT ); Wed, 22 Sep 2021 10:01:09 -0400 Received: by mail.kernel.org (Postfix) with ESMTPSA id 7DB94611C9; Wed, 22 Sep 2021 13:59:38 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1632319179; bh=36IWk6It8GnKx4IJa/NIBW4AEPYji1iLwvfilDyjCXs=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=pekUNLVhn+YYL/CO9fT43ZTrfotwbsqxmeiiHiPuOBIeanmiMbOApgFDPqoNg+gAi FNfFzj4CVqKEkpWuEoityr4Fee26sPBLpdCW39J/fCQEof/s14b+FPdM/QbKO0vPyo mdSeGCVBCTeMvzIkPSLrKd0d4dAJTVt0TG1x2DifZ3HpedfaMgO3YSeDZYjyc41pqE +ynfgXqeKMTFJyJPIXU3ubLtBvCUSwAbLWtUjZWVRAmReoXHHKPsgq2use649Fq3Mu YcRyiBs2S/5gpSCSaQtZHwJwQ93fUbCD5ariOReFV469g6gw2K8SBJBO5JFRJDR8wU XbbWiNMzFfhpQ== Date: Wed, 22 Sep 2021 16:59:35 +0300 From: Leon Romanovsky To: =?utf-8?B?6a2P5L+K5ZCJ?= Cc: Jason Gunthorpe , Doug Ledford , mst , Jason Wang , yuval.shaia.ml@gmail.com, marcel.apfelbaum@gmail.com, Cornelia Huck , Hannes Reinecke , Yongji Xie , =?utf-8?B?5p+056iz?= , RDMA mailing list , virtualization , qemu-devel Subject: Re: Re: [RFC 0/5] VirtIO RDMA Message-ID: References: <20210902130625.25277-1-weijunji@bytedance.com> <20210915134301.GA211485@nvidia.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: Precedence: bulk List-ID: X-Mailing-List: linux-rdma@vger.kernel.org On Wed, Sep 22, 2021 at 09:37:37PM +0800, 魏俊吉 wrote: > On Wed, Sep 22, 2021 at 9:06 PM Leon Romanovsky wrote: > > > > On Wed, Sep 22, 2021 at 08:08:44PM +0800, Junji Wei wrote: > > > > On Sep 15, 2021, at 9:43 PM, Jason Gunthorpe wrote: > > > > <...> > > > > > >> 4. The FRMR api need to set key of MR through IB_WR_REG_MR. > > > >> But it is impossible to change a key of mr using uverbs. > > > > > > > > FRMR is more like memory windows in user space, you can't support it > > > > using just regular MRs. > > > > > > It is hard to support this using uverbs, but it is easy to support > > > with uRDMA that we can get full control of mrs. > > > > What is uRDMA? > > uRDMA is a software implementation of the RoCEv2 protocol like rxe. > We will implement it in QEMU with VFIO or DPDK. ok, thanks > > Thanks. > Junji From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.8 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 76B90C433EF for ; Wed, 22 Sep 2021 13:59:46 +0000 (UTC) Received: from smtp2.osuosl.org (smtp2.osuosl.org [140.211.166.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 2865B611C9 for ; Wed, 22 Sep 2021 13:59:46 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 2865B611C9 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=lists.linux-foundation.org Received: from localhost (localhost [127.0.0.1]) by smtp2.osuosl.org (Postfix) with ESMTP id 7A2AE40581; Wed, 22 Sep 2021 13:59:45 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp2.osuosl.org ([127.0.0.1]) by localhost (smtp2.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id 2WpBxAlV03wW; Wed, 22 Sep 2021 13:59:43 +0000 (UTC) Received: from lists.linuxfoundation.org (lf-lists.osuosl.org [IPv6:2605:bc80:3010:104::8cd3:938]) by smtp2.osuosl.org (Postfix) with ESMTPS id 3F36140480; Wed, 22 Sep 2021 13:59:43 +0000 (UTC) Received: from lf-lists.osuosl.org (localhost [127.0.0.1]) by lists.linuxfoundation.org (Postfix) with ESMTP id 0BB0FC000F; Wed, 22 Sep 2021 13:59:43 +0000 (UTC) Received: from smtp2.osuosl.org (smtp2.osuosl.org [IPv6:2605:bc80:3010::133]) by lists.linuxfoundation.org (Postfix) with ESMTP id AD9CBC000D for ; Wed, 22 Sep 2021 13:59:41 +0000 (UTC) Received: from localhost (localhost [127.0.0.1]) by smtp2.osuosl.org (Postfix) with ESMTP id 90D0C4056A for ; Wed, 22 Sep 2021 13:59:41 +0000 (UTC) X-Virus-Scanned: amavisd-new at osuosl.org Received: from smtp2.osuosl.org ([127.0.0.1]) by localhost (smtp2.osuosl.org [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id WDxXvAEQ7-tm for ; Wed, 22 Sep 2021 13:59:39 +0000 (UTC) X-Greylist: domain auto-whitelisted by SQLgrey-1.8.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp2.osuosl.org (Postfix) with ESMTPS id 992A140480 for ; Wed, 22 Sep 2021 13:59:39 +0000 (UTC) Received: by mail.kernel.org (Postfix) with ESMTPSA id 7DB94611C9; Wed, 22 Sep 2021 13:59:38 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1632319179; bh=36IWk6It8GnKx4IJa/NIBW4AEPYji1iLwvfilDyjCXs=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=pekUNLVhn+YYL/CO9fT43ZTrfotwbsqxmeiiHiPuOBIeanmiMbOApgFDPqoNg+gAi FNfFzj4CVqKEkpWuEoityr4Fee26sPBLpdCW39J/fCQEof/s14b+FPdM/QbKO0vPyo mdSeGCVBCTeMvzIkPSLrKd0d4dAJTVt0TG1x2DifZ3HpedfaMgO3YSeDZYjyc41pqE +ynfgXqeKMTFJyJPIXU3ubLtBvCUSwAbLWtUjZWVRAmReoXHHKPsgq2use649Fq3Mu YcRyiBs2S/5gpSCSaQtZHwJwQ93fUbCD5ariOReFV469g6gw2K8SBJBO5JFRJDR8wU XbbWiNMzFfhpQ== Date: Wed, 22 Sep 2021 16:59:35 +0300 From: Leon Romanovsky To: =?utf-8?B?6a2P5L+K5ZCJ?= Subject: Re: Re: [RFC 0/5] VirtIO RDMA Message-ID: References: <20210902130625.25277-1-weijunji@bytedance.com> <20210915134301.GA211485@nvidia.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: Cc: qemu-devel , Jason Gunthorpe , mst , RDMA mailing list , Cornelia Huck , yuval.shaia.ml@gmail.com, virtualization , Yongji Xie , Doug Ledford , =?utf-8?B?5p+056iz?= X-BeenThere: virtualization@lists.linux-foundation.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: Linux virtualization List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: virtualization-bounces@lists.linux-foundation.org Sender: "Virtualization" T24gV2VkLCBTZXAgMjIsIDIwMjEgYXQgMDk6Mzc6MzdQTSArMDgwMCwg6a2P5L+K5ZCJIHdyb3Rl Ogo+IE9uIFdlZCwgU2VwIDIyLCAyMDIxIGF0IDk6MDYgUE0gTGVvbiBSb21hbm92c2t5IDxsZW9u QGtlcm5lbC5vcmc+IHdyb3RlOgo+ID4KPiA+IE9uIFdlZCwgU2VwIDIyLCAyMDIxIGF0IDA4OjA4 OjQ0UE0gKzA4MDAsIEp1bmppIFdlaSB3cm90ZToKPiA+ID4gPiBPbiBTZXAgMTUsIDIwMjEsIGF0 IDk6NDMgUE0sIEphc29uIEd1bnRob3JwZSA8amdnQG52aWRpYS5jb20+IHdyb3RlOgo+ID4KPiA+ IDwuLi4+Cj4gPgo+ID4gPiA+PiA0LiBUaGUgRlJNUiBhcGkgbmVlZCB0byBzZXQga2V5IG9mIE1S IHRocm91Z2ggSUJfV1JfUkVHX01SLgo+ID4gPiA+PiAgIEJ1dCBpdCBpcyBpbXBvc3NpYmxlIHRv IGNoYW5nZSBhIGtleSBvZiBtciB1c2luZyB1dmVyYnMuCj4gPiA+ID4KPiA+ID4gPiBGUk1SIGlz IG1vcmUgbGlrZSBtZW1vcnkgd2luZG93cyBpbiB1c2VyIHNwYWNlLCB5b3UgY2FuJ3Qgc3VwcG9y dCBpdAo+ID4gPiA+IHVzaW5nIGp1c3QgcmVndWxhciBNUnMuCj4gPiA+Cj4gPiA+IEl0IGlzIGhh cmQgdG8gc3VwcG9ydCB0aGlzIHVzaW5nIHV2ZXJicywgYnV0IGl0IGlzIGVhc3kgdG8gc3VwcG9y dAo+ID4gPiB3aXRoIHVSRE1BIHRoYXQgd2UgY2FuIGdldCBmdWxsIGNvbnRyb2wgb2YgbXJzLgo+ ID4KPiA+IFdoYXQgaXMgdVJETUE/Cj4gCj4gdVJETUEgaXMgYSBzb2Z0d2FyZSBpbXBsZW1lbnRh dGlvbiBvZiB0aGUgUm9DRXYyIHByb3RvY29sIGxpa2UgcnhlLgo+IFdlIHdpbGwgaW1wbGVtZW50 IGl0IGluIFFFTVUgd2l0aCBWRklPIG9yIERQREsuCgpvaywgdGhhbmtzCgo+IAo+IFRoYW5rcy4K PiBKdW5qaQpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpW aXJ0dWFsaXphdGlvbiBtYWlsaW5nIGxpc3QKVmlydHVhbGl6YXRpb25AbGlzdHMubGludXgtZm91 bmRhdGlvbi5vcmcKaHR0cHM6Ly9saXN0cy5saW51eGZvdW5kYXRpb24ub3JnL21haWxtYW4vbGlz dGluZm8vdmlydHVhbGl6YXRpb24= From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.8 required=3.0 tests=BAYES_00,DKIM_INVALID, DKIM_SIGNED,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 6ADD6C433EF for ; Wed, 22 Sep 2021 14:02:27 +0000 (UTC) Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 017DF60F44 for ; Wed, 22 Sep 2021 14:02:26 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 017DF60F44 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=kernel.org Authentication-Results: mail.kernel.org; spf=pass smtp.mailfrom=nongnu.org Received: from localhost ([::1]:59460 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mT2pO-0008Tv-1P for qemu-devel@archiver.kernel.org; Wed, 22 Sep 2021 10:02:26 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]:34246) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mT2ml-0007CX-5w for qemu-devel@nongnu.org; Wed, 22 Sep 2021 09:59:43 -0400 Received: from mail.kernel.org ([198.145.29.99]:52576) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mT2mi-0003YP-Nm for qemu-devel@nongnu.org; Wed, 22 Sep 2021 09:59:42 -0400 Received: by mail.kernel.org (Postfix) with ESMTPSA id 7DB94611C9; Wed, 22 Sep 2021 13:59:38 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=k20201202; t=1632319179; bh=36IWk6It8GnKx4IJa/NIBW4AEPYji1iLwvfilDyjCXs=; h=Date:From:To:Cc:Subject:References:In-Reply-To:From; b=pekUNLVhn+YYL/CO9fT43ZTrfotwbsqxmeiiHiPuOBIeanmiMbOApgFDPqoNg+gAi FNfFzj4CVqKEkpWuEoityr4Fee26sPBLpdCW39J/fCQEof/s14b+FPdM/QbKO0vPyo mdSeGCVBCTeMvzIkPSLrKd0d4dAJTVt0TG1x2DifZ3HpedfaMgO3YSeDZYjyc41pqE +ynfgXqeKMTFJyJPIXU3ubLtBvCUSwAbLWtUjZWVRAmReoXHHKPsgq2use649Fq3Mu YcRyiBs2S/5gpSCSaQtZHwJwQ93fUbCD5ariOReFV469g6gw2K8SBJBO5JFRJDR8wU XbbWiNMzFfhpQ== Date: Wed, 22 Sep 2021 16:59:35 +0300 From: Leon Romanovsky To: =?utf-8?B?6a2P5L+K5ZCJ?= Subject: Re: Re: [RFC 0/5] VirtIO RDMA Message-ID: References: <20210902130625.25277-1-weijunji@bytedance.com> <20210915134301.GA211485@nvidia.com> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: Received-SPF: pass client-ip=198.145.29.99; envelope-from=leon@kernel.org; helo=mail.kernel.org X-Spam_score_int: -85 X-Spam_score: -8.6 X-Spam_bar: -------- X-Spam_report: (-8.6 / 5.0 requ) BAYES_00=-1.9, DKIMWL_WL_HIGH=-1.472, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_HI=-5, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: qemu-devel@nongnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: qemu-devel , Jason Gunthorpe , mst , RDMA mailing list , Jason Wang , Cornelia Huck , yuval.shaia.ml@gmail.com, virtualization , Yongji Xie , Doug Ledford , =?utf-8?B?5p+056iz?= , Hannes Reinecke Errors-To: qemu-devel-bounces+qemu-devel=archiver.kernel.org@nongnu.org Sender: "Qemu-devel" On Wed, Sep 22, 2021 at 09:37:37PM +0800, 魏俊吉 wrote: > On Wed, Sep 22, 2021 at 9:06 PM Leon Romanovsky wrote: > > > > On Wed, Sep 22, 2021 at 08:08:44PM +0800, Junji Wei wrote: > > > > On Sep 15, 2021, at 9:43 PM, Jason Gunthorpe wrote: > > > > <...> > > > > > >> 4. The FRMR api need to set key of MR through IB_WR_REG_MR. > > > >> But it is impossible to change a key of mr using uverbs. > > > > > > > > FRMR is more like memory windows in user space, you can't support it > > > > using just regular MRs. > > > > > > It is hard to support this using uverbs, but it is easy to support > > > with uRDMA that we can get full control of mrs. > > > > What is uRDMA? > > uRDMA is a software implementation of the RoCEv2 protocol like rxe. > We will implement it in QEMU with VFIO or DPDK. ok, thanks > > Thanks. > Junji