From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.9 required=3.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id EEE2ACA9ECF for ; Fri, 1 Nov 2019 17:48:35 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id BB2FE217D9 for ; Fri, 1 Nov 2019 17:48:35 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=Mellanox.com header.i=@Mellanox.com header.b="FvCWpY72" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1726902AbfKARsf (ORCPT ); Fri, 1 Nov 2019 13:48:35 -0400 Received: from mail-eopbgr00087.outbound.protection.outlook.com ([40.107.0.87]:53635 "EHLO EUR02-AM5-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1726554AbfKARse (ORCPT ); Fri, 1 Nov 2019 13:48:34 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=F616PnDasdRhilz2Kc6qSBSImWwZldAPBk2MoucstrbO33xqeD34L+gHY1s6qonatRhw1WSWiK7h9DuvBWDXbxq855BA3gO33b9rt6iu6agzY10GvNpgYIZ8IvhNSaCQ0q4CJCYlatlk3IPuGwRlb4ne8o8f9XzUvEvDb/efSa1xU0Ea94EzZD6z+FKXFP+5ZfUs8P9FC+0Mi3eI/pdwJwgGv7AHx2pmeGBnbdc2EnCmjelCwG9xIbTmb160RQ4SDrBfQqG6kYG55LextOJOs+zzzo3gF7SSonV3t1UAsi4KpZvb3uJdY2g7OWab/oNEfuPHq/nfyMXnx0hAAmJkow== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=JxvmHyR/kc6JFGRvJosAQPdPJXSBBjtnI1g5Hj/KEws=; b=ZoAnhDjBJTbNwVGnmwyYuReLO2RrvGVYijtVfaFg5FgFS2pzak35WpWAMS4V6zCmCy+VFSOOzUEfOzwjcUTyMMtZCHKbhkkl5x1uSFbrO047Fd8lXwTUG9m7PG+QZDNZ7CsLTLOlpZgz8JsELyGRmhaVer9JA1JCMxFvb2td9nnV7YfQUlSloyw6NSoP4lUMRMJ8v1XMkTckdTOYv/NUyVMUYg5HvYjFJ335qVkuvuHc1d1IOmRYct5sz9xmQXdUmnelW0PoM+9yW55H9PKdgKPXB9NHe+t0tXDCIVdtasinaSOrMWjiJTUfoN1sPQgOi84W5ql3mAmPRyd+Dgon3g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=mellanox.com; dmarc=pass action=none header.from=mellanox.com; dkim=pass header.d=mellanox.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=JxvmHyR/kc6JFGRvJosAQPdPJXSBBjtnI1g5Hj/KEws=; b=FvCWpY72ABDpFQg0glTnf9M5C7IHGwioTuTcCLUyFHeA6BAjgMHR03MjEIJg8H+IAB5wnw1c2HwmRifd+QG6uEk9HEISlC1BnqJp0kWmwElDZDXEazhp0eygF6B/V/oNtW2amsmRxkgE/8LvPXsasIb+c3J21i+SnXWqdF4PJQI= Received: from VI1PR05MB4141.eurprd05.prod.outlook.com (52.133.14.15) by VI1PR05MB6142.eurprd05.prod.outlook.com (20.178.127.213) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2408.17; Fri, 1 Nov 2019 17:48:28 +0000 Received: from VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d]) by VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d%5]) with mapi id 15.20.2387.028; Fri, 1 Nov 2019 17:48:28 +0000 From: Jason Gunthorpe To: Boris Ostrovsky CC: "linux-mm@kvack.org" , Jerome Glisse , Ralph Campbell , John Hubbard , "Felix.Kuehling@amd.com" , "linux-rdma@vger.kernel.org" , "dri-devel@lists.freedesktop.org" , "amd-gfx@lists.freedesktop.org" , Alex Deucher , Ben Skeggs , =?iso-8859-1?Q?Christian_K=F6nig?= , David Zhou , Dennis Dalessandro , Juergen Gross , Mike Marciniszyn , Oleksandr Andrushchenko , Petr Cvek , Stefano Stabellini , "nouveau@lists.freedesktop.org" , "xen-devel@lists.xenproject.org" , Christoph Hellwig Subject: Re: [PATCH v2 09/15] xen/gntdev: use mmu_range_notifier_insert Thread-Topic: [PATCH v2 09/15] xen/gntdev: use mmu_range_notifier_insert Thread-Index: AQHVjcvKV253DVP8r0WB5NYgPgZcBadzahyAgAMzaQA= Date: Fri, 1 Nov 2019 17:48:27 +0000 Message-ID: <20191101174824.GP22766@mellanox.com> References: <20191028201032.6352-1-jgg@ziepe.ca> <20191028201032.6352-10-jgg@ziepe.ca> <0355257f-6a3a-cdcd-d206-aec3df97dded@oracle.com> In-Reply-To: <0355257f-6a3a-cdcd-d206-aec3df97dded@oracle.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-clientproxiedby: BN8PR16CA0030.namprd16.prod.outlook.com (2603:10b6:408:4c::43) To VI1PR05MB4141.eurprd05.prod.outlook.com (2603:10a6:803:44::15) authentication-results: spf=none (sender IP is ) smtp.mailfrom=jgg@mellanox.com; x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [142.162.113.180] x-ms-publictraffictype: Email x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: afffd79b-5541-4515-1c81-08d75ef3b36e x-ms-traffictypediagnostic: VI1PR05MB6142: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:10000; x-forefront-prvs: 020877E0CB x-forefront-antispam-report: SFV:NSPM;SFS:(10009020)(4636009)(136003)(366004)(396003)(39860400002)(346002)(376002)(189003)(199004)(305945005)(66066001)(1076003)(71200400001)(6436002)(316002)(76176011)(52116002)(14454004)(478600001)(81156014)(6486002)(99286004)(4326008)(81166006)(8936002)(2906002)(8676002)(5660300002)(229853002)(186003)(26005)(54906003)(36756003)(66446008)(66556008)(64756008)(256004)(5024004)(6512007)(7416002)(6916009)(2616005)(476003)(446003)(11346002)(486006)(25786009)(386003)(102836004)(3846002)(66476007)(6506007)(71190400001)(6116002)(86362001)(7736002)(33656002)(6246003)(53546011)(66946007);DIR:OUT;SFP:1101;SCL:1;SRVR:VI1PR05MB6142;H:VI1PR05MB4141.eurprd05.prod.outlook.com;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;MX:1;A:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: sWvQLHUb+Zb2MqMU27umQP6TPY+fVpmmlSrKM8hH4imTr1ThxhA8raoNuDVUeuUxvxntgq+OmEuZ+t/7fvl9DVZRKB75KG+Jeu8NSpkVYXGspFpszg7aubns7VxCPp45sZo/s2pmsiIYnOltwEnCaRSFIl3ydCLIpm4K5dhy3UUlDhRlKwyPncZJJ/LJk8JgH6eyYCTUJ7z1mSWDCLqOLZjFO2o4QdtyXsGOvclRAHx1BWuF8QrkPWmbnwYs/wjOAQ5OASWMOcS2JBEr7NhAmOeWjyJ8vvcj/De69djZUrsvoZBiVsifdkAfcvqVg2M8hnNZZl3cM4q9gVss9e/BJS+f8lF3zJBdI3P7cBz1Ht+w+Vydm3jA4kJzvEY5eYXUsLkadiQ0GLTjosKDBmIOXPbwsjRDM4OjinlqfIIEkC6F4YEPStpj3SCDgclJRgs2 x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="iso-8859-1" Content-ID: <2C63294D1F7ACD45826E5FDF1BD65982@eurprd05.prod.outlook.com> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: afffd79b-5541-4515-1c81-08d75ef3b36e X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Nov 2019 17:48:28.0304 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: gyKI+02UfkBQHTmFxuAfM6DkrkNGORrCrDW6vdZJ4IdeeO8yWCAvE76jBUBTuwWTulA1i4/hktSr4WPCk2XMvQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR05MB6142 Sender: linux-rdma-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-rdma@vger.kernel.org On Wed, Oct 30, 2019 at 12:55:37PM -0400, Boris Ostrovsky wrote: > On 10/28/19 4:10 PM, Jason Gunthorpe wrote: > > From: Jason Gunthorpe > > > > gntdev simply wants to monitor a specific VMA for any notifier events, > > this can be done straightforwardly using mmu_range_notifier_insert() ov= er > > the VMA's VA range. > > > > The notifier should be attached until the original VMA is destroyed. > > > > It is unclear if any of this is even sane, but at least a lot of duplic= ate > > code is removed. >=20 > I didn't have a chance to look at the patch itself yet but as a heads-up > --- it crashes dom0. Thanks Boris. I spent a bit of time and got a VM running with a xen 4.9 hypervisor and a kernel with this patch series. It a ubuntu bionic VM with the distro's xen stuff. Can you give some guidance how you made it crash? I see the VM autoloaded gntdev: Module Size Used by xen_gntdev 24576 2 xen_evtchn 16384 1 xenfs 16384 1 xen_privcmd 24576 16 xenfs And lsof says several xen processes have the chardev open: xenstored 819 root 13u CHR 10,53 = 0t0 19595 /dev/xen/gntdev xenconsol 857 root 8u CHR 10,53 = 0t0 19595 /dev/xen/gntdev xenconsol 857 860 root 8u CHR 10,53 = 0t0 19595 /dev/xen/gntdev But no crashing.. However, I wasn't able to get my usual debug kernel .config to boot with the xen hypervisor, it crashes on early boot with: (XEN) Dom0 has maximum 8 VCPUs (XEN) Scrubbing Free RAM on 1 nodes using 8 CPUs (XEN) .done. (XEN) Initial low memory virq threshold set at 0x1000 pages. (XEN) Std. Loglevel: All (XEN) Guest Loglevel: All (XEN) *** Serial input -> DOM0 (type 'CTRL-a' three times to switch input t= o Xen) (XEN) Freed 468kB init memory (XEN) d0v0 Unhandled page fault fault/trap [#14, ec=3D0002] (XEN) Pagetable walk from fffffbfff0480fbe: (XEN) L4[0x1f7] =3D 0000000000000000 ffffffffffffffff (XEN) domain_crash_sync called from entry.S: fault at ffff82d080348a06 entr= y.o#create_bounce_frame+0x135/0x15f (XEN) Domain 0 (vcpu#0) crashed on cpu#0: (XEN) ----[ Xen-4.9.2 x86_64 debug=3Dn Not tainted ]---- (XEN) CPU: 0 (XEN) RIP: e033:[] (XEN) RFLAGS: 0000000000000296 EM: 1 CONTEXT: pv guest (d0v0) (XEN) rax: fffffbfff0480fbe rbx: 0000000000000000 rcx: 00000000c0000101 (XEN) rdx: 00000000ffffffff rsi: ffffffff84026000 rdi: ffffffff82cb4a20 (XEN) rbp: ffffffff82407ff8 rsp: ffffffff82407da0 r8: 0000000000000000 (XEN) r9: 0000000000000000 r10: 0000000000000000 r11: 0000000000000000 (XEN) r12: 0000000000000000 r13: 1ffffffff0480fbe r14: 0000000000000000 (XEN) r15: 0000000000000000 cr0: 000000008005003b cr4: 00000000003506e0 (XEN) cr3: 0000000034027000 cr2: fffffbfff0480fbe (XEN) fsb: 0000000000000000 gsb: ffffffff82b61000 gss: 0000000000000000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: e02b cs: e033 Which is surely some .config issue, but I didn't figure out what. Jason From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jason Gunthorpe Subject: Re: [PATCH v2 09/15] xen/gntdev: use mmu_range_notifier_insert Date: Fri, 1 Nov 2019 17:48:27 +0000 Message-ID: <20191101174824.GP22766@mellanox.com> References: <20191028201032.6352-1-jgg@ziepe.ca> <20191028201032.6352-10-jgg@ziepe.ca> <0355257f-6a3a-cdcd-d206-aec3df97dded@oracle.com> Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Return-path: In-Reply-To: <0355257f-6a3a-cdcd-d206-aec3df97dded@oracle.com> Content-Language: en-US Content-ID: <2C63294D1F7ACD45826E5FDF1BD65982@eurprd05.prod.outlook.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" To: Boris Ostrovsky Cc: Juergen Gross , David Zhou , Ralph Campbell , Stefano Stabellini , Oleksandr Andrushchenko , "linux-rdma@vger.kernel.org" , John Hubbard , "Felix.Kuehling@amd.com" , Mike Marciniszyn , "dri-devel@lists.freedesktop.org" , Christoph Hellwig , "linux-mm@kvack.org" , Jerome Glisse , "amd-gfx@lists.freedesktop.org" , "nouveau@lists.freedesktop.org" , Alex Deucher , "xen-devel@lists.xenproject.org" , Dennis Dalessandro List-Id: nouveau.vger.kernel.org T24gV2VkLCBPY3QgMzAsIDIwMTkgYXQgMTI6NTU6MzdQTSAtMDQwMCwgQm9yaXMgT3N0cm92c2t5 IHdyb3RlOgo+IE9uIDEwLzI4LzE5IDQ6MTAgUE0sIEphc29uIEd1bnRob3JwZSB3cm90ZToKPiA+ IEZyb206IEphc29uIEd1bnRob3JwZSA8amdnQG1lbGxhbm94LmNvbT4KPiA+Cj4gPiBnbnRkZXYg c2ltcGx5IHdhbnRzIHRvIG1vbml0b3IgYSBzcGVjaWZpYyBWTUEgZm9yIGFueSBub3RpZmllciBl dmVudHMsCj4gPiB0aGlzIGNhbiBiZSBkb25lIHN0cmFpZ2h0Zm9yd2FyZGx5IHVzaW5nIG1tdV9y YW5nZV9ub3RpZmllcl9pbnNlcnQoKSBvdmVyCj4gPiB0aGUgVk1BJ3MgVkEgcmFuZ2UuCj4gPgo+ ID4gVGhlIG5vdGlmaWVyIHNob3VsZCBiZSBhdHRhY2hlZCB1bnRpbCB0aGUgb3JpZ2luYWwgVk1B IGlzIGRlc3Ryb3llZC4KPiA+Cj4gPiBJdCBpcyB1bmNsZWFyIGlmIGFueSBvZiB0aGlzIGlzIGV2 ZW4gc2FuZSwgYnV0IGF0IGxlYXN0IGEgbG90IG9mIGR1cGxpY2F0ZQo+ID4gY29kZSBpcyByZW1v dmVkLgo+IAo+IEkgZGlkbid0IGhhdmUgYSBjaGFuY2UgdG8gbG9vayBhdCB0aGUgcGF0Y2ggaXRz ZWxmIHlldCBidXQgYXMgYSBoZWFkcy11cAo+IC0tLSBpdCBjcmFzaGVzIGRvbTAuCgpUaGFua3Mg Qm9yaXMuIEkgc3BlbnQgYSBiaXQgb2YgdGltZSBhbmQgZ290IGEgVk0gcnVubmluZyB3aXRoIGEg eGVuCjQuOSBoeXBlcnZpc29yIGFuZCBhIGtlcm5lbCB3aXRoIHRoaXMgcGF0Y2ggc2VyaWVzLiBJ dCBhIHVidW50dSBiaW9uaWMKVk0gd2l0aCB0aGUgZGlzdHJvJ3MgeGVuIHN0dWZmLgoKQ2FuIHlv dSBnaXZlIHNvbWUgZ3VpZGFuY2UgaG93IHlvdSBtYWRlIGl0IGNyYXNoPyBJIHNlZSB0aGUgVk0K YXV0b2xvYWRlZCBnbnRkZXY6CgpNb2R1bGUgICAgICAgICAgICAgICAgICBTaXplICBVc2VkIGJ5 Cnhlbl9nbnRkZXYgICAgICAgICAgICAgMjQ1NzYgIDIKeGVuX2V2dGNobiAgICAgICAgICAgICAx NjM4NCAgMQp4ZW5mcyAgICAgICAgICAgICAgICAgIDE2Mzg0ICAxCnhlbl9wcml2Y21kICAgICAg ICAgICAgMjQ1NzYgIDE2IHhlbmZzCgpBbmQgbHNvZiBzYXlzIHNldmVyYWwgeGVuIHByb2Nlc3Nl cyBoYXZlIHRoZSBjaGFyZGV2IG9wZW46Cgp4ZW5zdG9yZWQgIDgxOSAgICAgICAgICAgICAgICAg cm9vdCAgIDEzdSAgICAgIENIUiAgICAgICAgICAgICAgMTAsNTMgICAgICAwdDAgICAgICAxOTU5 NSAvZGV2L3hlbi9nbnRkZXYKeGVuY29uc29sICA4NTcgICAgICAgICAgICAgICAgIHJvb3QgICAg OHUgICAgICBDSFIgICAgICAgICAgICAgIDEwLDUzICAgICAgMHQwICAgICAgMTk1OTUgL2Rldi94 ZW4vZ250ZGV2CnhlbmNvbnNvbCAgODU3IDg2MCAgICAgICAgICAgICByb290ICAgIDh1ICAgICAg Q0hSICAgICAgICAgICAgICAxMCw1MyAgICAgIDB0MCAgICAgIDE5NTk1IC9kZXYveGVuL2dudGRl dgoKQnV0IG5vIGNyYXNoaW5nLi4KCkhvd2V2ZXIsIEkgd2Fzbid0IGFibGUgdG8gZ2V0IG15IHVz dWFsIGRlYnVnIGtlcm5lbCAuY29uZmlnIHRvIGJvb3QKd2l0aCB0aGUgeGVuIGh5cGVydmlzb3Is IGl0IGNyYXNoZXMgb24gZWFybHkgYm9vdCB3aXRoOgoKKFhFTikgRG9tMCBoYXMgbWF4aW11bSA4 IFZDUFVzCihYRU4pIFNjcnViYmluZyBGcmVlIFJBTSBvbiAxIG5vZGVzIHVzaW5nIDggQ1BVcwoo WEVOKSAuZG9uZS4KKFhFTikgSW5pdGlhbCBsb3cgbWVtb3J5IHZpcnEgdGhyZXNob2xkIHNldCBh dCAweDEwMDAgcGFnZXMuCihYRU4pIFN0ZC4gTG9nbGV2ZWw6IEFsbAooWEVOKSBHdWVzdCBMb2ds ZXZlbDogQWxsCihYRU4pICoqKiBTZXJpYWwgaW5wdXQgLT4gRE9NMCAodHlwZSAnQ1RSTC1hJyB0 aHJlZSB0aW1lcyB0byBzd2l0Y2ggaW5wdXQgdG8gWGVuKQooWEVOKSBGcmVlZCA0NjhrQiBpbml0 IG1lbW9yeQooWEVOKSBkMHYwIFVuaGFuZGxlZCBwYWdlIGZhdWx0IGZhdWx0L3RyYXAgWyMxNCwg ZWM9MDAwMl0KKFhFTikgUGFnZXRhYmxlIHdhbGsgZnJvbSBmZmZmZmJmZmYwNDgwZmJlOgooWEVO KSAgTDRbMHgxZjddID0gMDAwMDAwMDAwMDAwMDAwMCBmZmZmZmZmZmZmZmZmZmZmCihYRU4pIGRv bWFpbl9jcmFzaF9zeW5jIGNhbGxlZCBmcm9tIGVudHJ5LlM6IGZhdWx0IGF0IGZmZmY4MmQwODAz NDhhMDYgZW50cnkubyNjcmVhdGVfYm91bmNlX2ZyYW1lKzB4MTM1LzB4MTVmCihYRU4pIERvbWFp biAwICh2Y3B1IzApIGNyYXNoZWQgb24gY3B1IzA6CihYRU4pIC0tLS1bIFhlbi00LjkuMiAgeDg2 XzY0ICBkZWJ1Zz1uICAgTm90IHRhaW50ZWQgXS0tLS0KKFhFTikgQ1BVOiAgICAwCihYRU4pIFJJ UDogICAgZTAzMzpbPGZmZmZmZmZmODJiOWY3MzE+XQooWEVOKSBSRkxBR1M6IDAwMDAwMDAwMDAw MDAyOTYgICBFTTogMSAgIENPTlRFWFQ6IHB2IGd1ZXN0IChkMHYwKQooWEVOKSByYXg6IGZmZmZm YmZmZjA0ODBmYmUgICByYng6IDAwMDAwMDAwMDAwMDAwMDAgICByY3g6IDAwMDAwMDAwYzAwMDAx MDEKKFhFTikgcmR4OiAwMDAwMDAwMGZmZmZmZmZmICAgcnNpOiBmZmZmZmZmZjg0MDI2MDAwICAg cmRpOiBmZmZmZmZmZjgyY2I0YTIwCihYRU4pIHJicDogZmZmZmZmZmY4MjQwN2ZmOCAgIHJzcDog ZmZmZmZmZmY4MjQwN2RhMCAgIHI4OiAgMDAwMDAwMDAwMDAwMDAwMAooWEVOKSByOTogIDAwMDAw MDAwMDAwMDAwMDAgICByMTA6IDAwMDAwMDAwMDAwMDAwMDAgICByMTE6IDAwMDAwMDAwMDAwMDAw MDAKKFhFTikgcjEyOiAwMDAwMDAwMDAwMDAwMDAwICAgcjEzOiAxZmZmZmZmZmYwNDgwZmJlICAg cjE0OiAwMDAwMDAwMDAwMDAwMDAwCihYRU4pIHIxNTogMDAwMDAwMDAwMDAwMDAwMCAgIGNyMDog MDAwMDAwMDA4MDA1MDAzYiAgIGNyNDogMDAwMDAwMDAwMDM1MDZlMAooWEVOKSBjcjM6IDAwMDAw MDAwMzQwMjcwMDAgICBjcjI6IGZmZmZmYmZmZjA0ODBmYmUKKFhFTikgZnNiOiAwMDAwMDAwMDAw MDAwMDAwICAgZ3NiOiBmZmZmZmZmZjgyYjYxMDAwICAgZ3NzOiAwMDAwMDAwMDAwMDAwMDAwCihY RU4pIGRzOiAwMDAwICAgZXM6IDAwMDAgICBmczogMDAwMCAgIGdzOiAwMDAwICAgc3M6IGUwMmIg ICBjczogZTAzMwoKV2hpY2ggaXMgc3VyZWx5IHNvbWUgLmNvbmZpZyBpc3N1ZSwgYnV0IEkgZGlk bid0IGZpZ3VyZSBvdXQgd2hhdC4KCkphc29uCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fXwpYZW4tZGV2ZWwgbWFpbGluZyBsaXN0Clhlbi1kZXZlbEBsaXN0 cy54ZW5wcm9qZWN0Lm9yZwpodHRwczovL2xpc3RzLnhlbnByb2plY3Qub3JnL21haWxtYW4vbGlz dGluZm8veGVuLWRldmVs From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.6 required=3.0 tests=DKIM_INVALID,DKIM_SIGNED, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 66343CA9ECF for ; Fri, 1 Nov 2019 17:49:00 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 2AAE621734 for ; Fri, 1 Nov 2019 17:49:00 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (1024-bit key) header.d=Mellanox.com header.i=@Mellanox.com header.b="FvCWpY72" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 2AAE621734 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=mellanox.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iQb2I-0003Vu-Hi; Fri, 01 Nov 2019 17:48:34 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57] helo=us1-amaz-eas2.inumbo.com) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iQb2H-0003Vp-Eq for xen-devel@lists.xenproject.org; Fri, 01 Nov 2019 17:48:33 +0000 X-Inumbo-ID: d095ef10-fccf-11e9-9569-12813bfff9fa Received: from EUR02-AM5-obe.outbound.protection.outlook.com (unknown [40.107.0.76]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS id d095ef10-fccf-11e9-9569-12813bfff9fa; Fri, 01 Nov 2019 17:48:31 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=F616PnDasdRhilz2Kc6qSBSImWwZldAPBk2MoucstrbO33xqeD34L+gHY1s6qonatRhw1WSWiK7h9DuvBWDXbxq855BA3gO33b9rt6iu6agzY10GvNpgYIZ8IvhNSaCQ0q4CJCYlatlk3IPuGwRlb4ne8o8f9XzUvEvDb/efSa1xU0Ea94EzZD6z+FKXFP+5ZfUs8P9FC+0Mi3eI/pdwJwgGv7AHx2pmeGBnbdc2EnCmjelCwG9xIbTmb160RQ4SDrBfQqG6kYG55LextOJOs+zzzo3gF7SSonV3t1UAsi4KpZvb3uJdY2g7OWab/oNEfuPHq/nfyMXnx0hAAmJkow== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=JxvmHyR/kc6JFGRvJosAQPdPJXSBBjtnI1g5Hj/KEws=; b=ZoAnhDjBJTbNwVGnmwyYuReLO2RrvGVYijtVfaFg5FgFS2pzak35WpWAMS4V6zCmCy+VFSOOzUEfOzwjcUTyMMtZCHKbhkkl5x1uSFbrO047Fd8lXwTUG9m7PG+QZDNZ7CsLTLOlpZgz8JsELyGRmhaVer9JA1JCMxFvb2td9nnV7YfQUlSloyw6NSoP4lUMRMJ8v1XMkTckdTOYv/NUyVMUYg5HvYjFJ335qVkuvuHc1d1IOmRYct5sz9xmQXdUmnelW0PoM+9yW55H9PKdgKPXB9NHe+t0tXDCIVdtasinaSOrMWjiJTUfoN1sPQgOi84W5ql3mAmPRyd+Dgon3g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=mellanox.com; dmarc=pass action=none header.from=mellanox.com; dkim=pass header.d=mellanox.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=JxvmHyR/kc6JFGRvJosAQPdPJXSBBjtnI1g5Hj/KEws=; b=FvCWpY72ABDpFQg0glTnf9M5C7IHGwioTuTcCLUyFHeA6BAjgMHR03MjEIJg8H+IAB5wnw1c2HwmRifd+QG6uEk9HEISlC1BnqJp0kWmwElDZDXEazhp0eygF6B/V/oNtW2amsmRxkgE/8LvPXsasIb+c3J21i+SnXWqdF4PJQI= Received: from VI1PR05MB4141.eurprd05.prod.outlook.com (52.133.14.15) by VI1PR05MB6142.eurprd05.prod.outlook.com (20.178.127.213) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2408.17; Fri, 1 Nov 2019 17:48:28 +0000 Received: from VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d]) by VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d%5]) with mapi id 15.20.2387.028; Fri, 1 Nov 2019 17:48:28 +0000 From: Jason Gunthorpe To: Boris Ostrovsky Thread-Topic: [PATCH v2 09/15] xen/gntdev: use mmu_range_notifier_insert Thread-Index: AQHVjcvKV253DVP8r0WB5NYgPgZcBadzahyAgAMzaQA= Date: Fri, 1 Nov 2019 17:48:27 +0000 Message-ID: <20191101174824.GP22766@mellanox.com> References: <20191028201032.6352-1-jgg@ziepe.ca> <20191028201032.6352-10-jgg@ziepe.ca> <0355257f-6a3a-cdcd-d206-aec3df97dded@oracle.com> In-Reply-To: <0355257f-6a3a-cdcd-d206-aec3df97dded@oracle.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-clientproxiedby: BN8PR16CA0030.namprd16.prod.outlook.com (2603:10b6:408:4c::43) To VI1PR05MB4141.eurprd05.prod.outlook.com (2603:10a6:803:44::15) authentication-results: spf=none (sender IP is ) smtp.mailfrom=jgg@mellanox.com; x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [142.162.113.180] x-ms-publictraffictype: Email x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: afffd79b-5541-4515-1c81-08d75ef3b36e x-ms-traffictypediagnostic: VI1PR05MB6142: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:10000; x-forefront-prvs: 020877E0CB x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(136003)(366004)(396003)(39860400002)(346002)(376002)(189003)(199004)(305945005)(66066001)(1076003)(71200400001)(6436002)(316002)(76176011)(52116002)(14454004)(478600001)(81156014)(6486002)(99286004)(4326008)(81166006)(8936002)(2906002)(8676002)(5660300002)(229853002)(186003)(26005)(54906003)(36756003)(66446008)(66556008)(64756008)(256004)(5024004)(6512007)(7416002)(6916009)(2616005)(476003)(446003)(11346002)(486006)(25786009)(386003)(102836004)(3846002)(66476007)(6506007)(71190400001)(6116002)(86362001)(7736002)(33656002)(6246003)(53546011)(66946007); DIR:OUT; SFP:1101; SCL:1; SRVR:VI1PR05MB6142; H:VI1PR05MB4141.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: sWvQLHUb+Zb2MqMU27umQP6TPY+fVpmmlSrKM8hH4imTr1ThxhA8raoNuDVUeuUxvxntgq+OmEuZ+t/7fvl9DVZRKB75KG+Jeu8NSpkVYXGspFpszg7aubns7VxCPp45sZo/s2pmsiIYnOltwEnCaRSFIl3ydCLIpm4K5dhy3UUlDhRlKwyPncZJJ/LJk8JgH6eyYCTUJ7z1mSWDCLqOLZjFO2o4QdtyXsGOvclRAHx1BWuF8QrkPWmbnwYs/wjOAQ5OASWMOcS2JBEr7NhAmOeWjyJ8vvcj/De69djZUrsvoZBiVsifdkAfcvqVg2M8hnNZZl3cM4q9gVss9e/BJS+f8lF3zJBdI3P7cBz1Ht+w+Vydm3jA4kJzvEY5eYXUsLkadiQ0GLTjosKDBmIOXPbwsjRDM4OjinlqfIIEkC6F4YEPStpj3SCDgclJRgs2 x-ms-exchange-transport-forked: True Content-ID: <2C63294D1F7ACD45826E5FDF1BD65982@eurprd05.prod.outlook.com> MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: afffd79b-5541-4515-1c81-08d75ef3b36e X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Nov 2019 17:48:28.0304 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: gyKI+02UfkBQHTmFxuAfM6DkrkNGORrCrDW6vdZJ4IdeeO8yWCAvE76jBUBTuwWTulA1i4/hktSr4WPCk2XMvQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR05MB6142 Subject: Re: [Xen-devel] [PATCH v2 09/15] xen/gntdev: use mmu_range_notifier_insert X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: Juergen Gross , David Zhou , Ralph Campbell , Stefano Stabellini , Oleksandr Andrushchenko , "linux-rdma@vger.kernel.org" , John Hubbard , "Felix.Kuehling@amd.com" , Mike Marciniszyn , "dri-devel@lists.freedesktop.org" , Christoph Hellwig , "linux-mm@kvack.org" , Jerome Glisse , "amd-gfx@lists.freedesktop.org" , "nouveau@lists.freedesktop.org" , Alex Deucher , "xen-devel@lists.xenproject.org" , Dennis Dalessandro , Petr Cvek , =?iso-8859-1?Q?Christian_K=F6nig?= , Ben Skeggs Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" T24gV2VkLCBPY3QgMzAsIDIwMTkgYXQgMTI6NTU6MzdQTSAtMDQwMCwgQm9yaXMgT3N0cm92c2t5 IHdyb3RlOgo+IE9uIDEwLzI4LzE5IDQ6MTAgUE0sIEphc29uIEd1bnRob3JwZSB3cm90ZToKPiA+ IEZyb206IEphc29uIEd1bnRob3JwZSA8amdnQG1lbGxhbm94LmNvbT4KPiA+Cj4gPiBnbnRkZXYg c2ltcGx5IHdhbnRzIHRvIG1vbml0b3IgYSBzcGVjaWZpYyBWTUEgZm9yIGFueSBub3RpZmllciBl dmVudHMsCj4gPiB0aGlzIGNhbiBiZSBkb25lIHN0cmFpZ2h0Zm9yd2FyZGx5IHVzaW5nIG1tdV9y YW5nZV9ub3RpZmllcl9pbnNlcnQoKSBvdmVyCj4gPiB0aGUgVk1BJ3MgVkEgcmFuZ2UuCj4gPgo+ ID4gVGhlIG5vdGlmaWVyIHNob3VsZCBiZSBhdHRhY2hlZCB1bnRpbCB0aGUgb3JpZ2luYWwgVk1B IGlzIGRlc3Ryb3llZC4KPiA+Cj4gPiBJdCBpcyB1bmNsZWFyIGlmIGFueSBvZiB0aGlzIGlzIGV2 ZW4gc2FuZSwgYnV0IGF0IGxlYXN0IGEgbG90IG9mIGR1cGxpY2F0ZQo+ID4gY29kZSBpcyByZW1v dmVkLgo+IAo+IEkgZGlkbid0IGhhdmUgYSBjaGFuY2UgdG8gbG9vayBhdCB0aGUgcGF0Y2ggaXRz ZWxmIHlldCBidXQgYXMgYSBoZWFkcy11cAo+IC0tLSBpdCBjcmFzaGVzIGRvbTAuCgpUaGFua3Mg Qm9yaXMuIEkgc3BlbnQgYSBiaXQgb2YgdGltZSBhbmQgZ290IGEgVk0gcnVubmluZyB3aXRoIGEg eGVuCjQuOSBoeXBlcnZpc29yIGFuZCBhIGtlcm5lbCB3aXRoIHRoaXMgcGF0Y2ggc2VyaWVzLiBJ dCBhIHVidW50dSBiaW9uaWMKVk0gd2l0aCB0aGUgZGlzdHJvJ3MgeGVuIHN0dWZmLgoKQ2FuIHlv dSBnaXZlIHNvbWUgZ3VpZGFuY2UgaG93IHlvdSBtYWRlIGl0IGNyYXNoPyBJIHNlZSB0aGUgVk0K YXV0b2xvYWRlZCBnbnRkZXY6CgpNb2R1bGUgICAgICAgICAgICAgICAgICBTaXplICBVc2VkIGJ5 Cnhlbl9nbnRkZXYgICAgICAgICAgICAgMjQ1NzYgIDIKeGVuX2V2dGNobiAgICAgICAgICAgICAx NjM4NCAgMQp4ZW5mcyAgICAgICAgICAgICAgICAgIDE2Mzg0ICAxCnhlbl9wcml2Y21kICAgICAg ICAgICAgMjQ1NzYgIDE2IHhlbmZzCgpBbmQgbHNvZiBzYXlzIHNldmVyYWwgeGVuIHByb2Nlc3Nl cyBoYXZlIHRoZSBjaGFyZGV2IG9wZW46Cgp4ZW5zdG9yZWQgIDgxOSAgICAgICAgICAgICAgICAg cm9vdCAgIDEzdSAgICAgIENIUiAgICAgICAgICAgICAgMTAsNTMgICAgICAwdDAgICAgICAxOTU5 NSAvZGV2L3hlbi9nbnRkZXYKeGVuY29uc29sICA4NTcgICAgICAgICAgICAgICAgIHJvb3QgICAg OHUgICAgICBDSFIgICAgICAgICAgICAgIDEwLDUzICAgICAgMHQwICAgICAgMTk1OTUgL2Rldi94 ZW4vZ250ZGV2CnhlbmNvbnNvbCAgODU3IDg2MCAgICAgICAgICAgICByb290ICAgIDh1ICAgICAg Q0hSICAgICAgICAgICAgICAxMCw1MyAgICAgIDB0MCAgICAgIDE5NTk1IC9kZXYveGVuL2dudGRl dgoKQnV0IG5vIGNyYXNoaW5nLi4KCkhvd2V2ZXIsIEkgd2Fzbid0IGFibGUgdG8gZ2V0IG15IHVz dWFsIGRlYnVnIGtlcm5lbCAuY29uZmlnIHRvIGJvb3QKd2l0aCB0aGUgeGVuIGh5cGVydmlzb3Is IGl0IGNyYXNoZXMgb24gZWFybHkgYm9vdCB3aXRoOgoKKFhFTikgRG9tMCBoYXMgbWF4aW11bSA4 IFZDUFVzCihYRU4pIFNjcnViYmluZyBGcmVlIFJBTSBvbiAxIG5vZGVzIHVzaW5nIDggQ1BVcwoo WEVOKSAuZG9uZS4KKFhFTikgSW5pdGlhbCBsb3cgbWVtb3J5IHZpcnEgdGhyZXNob2xkIHNldCBh dCAweDEwMDAgcGFnZXMuCihYRU4pIFN0ZC4gTG9nbGV2ZWw6IEFsbAooWEVOKSBHdWVzdCBMb2ds ZXZlbDogQWxsCihYRU4pICoqKiBTZXJpYWwgaW5wdXQgLT4gRE9NMCAodHlwZSAnQ1RSTC1hJyB0 aHJlZSB0aW1lcyB0byBzd2l0Y2ggaW5wdXQgdG8gWGVuKQooWEVOKSBGcmVlZCA0NjhrQiBpbml0 IG1lbW9yeQooWEVOKSBkMHYwIFVuaGFuZGxlZCBwYWdlIGZhdWx0IGZhdWx0L3RyYXAgWyMxNCwg ZWM9MDAwMl0KKFhFTikgUGFnZXRhYmxlIHdhbGsgZnJvbSBmZmZmZmJmZmYwNDgwZmJlOgooWEVO KSAgTDRbMHgxZjddID0gMDAwMDAwMDAwMDAwMDAwMCBmZmZmZmZmZmZmZmZmZmZmCihYRU4pIGRv bWFpbl9jcmFzaF9zeW5jIGNhbGxlZCBmcm9tIGVudHJ5LlM6IGZhdWx0IGF0IGZmZmY4MmQwODAz NDhhMDYgZW50cnkubyNjcmVhdGVfYm91bmNlX2ZyYW1lKzB4MTM1LzB4MTVmCihYRU4pIERvbWFp biAwICh2Y3B1IzApIGNyYXNoZWQgb24gY3B1IzA6CihYRU4pIC0tLS1bIFhlbi00LjkuMiAgeDg2 XzY0ICBkZWJ1Zz1uICAgTm90IHRhaW50ZWQgXS0tLS0KKFhFTikgQ1BVOiAgICAwCihYRU4pIFJJ UDogICAgZTAzMzpbPGZmZmZmZmZmODJiOWY3MzE+XQooWEVOKSBSRkxBR1M6IDAwMDAwMDAwMDAw MDAyOTYgICBFTTogMSAgIENPTlRFWFQ6IHB2IGd1ZXN0IChkMHYwKQooWEVOKSByYXg6IGZmZmZm YmZmZjA0ODBmYmUgICByYng6IDAwMDAwMDAwMDAwMDAwMDAgICByY3g6IDAwMDAwMDAwYzAwMDAx MDEKKFhFTikgcmR4OiAwMDAwMDAwMGZmZmZmZmZmICAgcnNpOiBmZmZmZmZmZjg0MDI2MDAwICAg cmRpOiBmZmZmZmZmZjgyY2I0YTIwCihYRU4pIHJicDogZmZmZmZmZmY4MjQwN2ZmOCAgIHJzcDog ZmZmZmZmZmY4MjQwN2RhMCAgIHI4OiAgMDAwMDAwMDAwMDAwMDAwMAooWEVOKSByOTogIDAwMDAw MDAwMDAwMDAwMDAgICByMTA6IDAwMDAwMDAwMDAwMDAwMDAgICByMTE6IDAwMDAwMDAwMDAwMDAw MDAKKFhFTikgcjEyOiAwMDAwMDAwMDAwMDAwMDAwICAgcjEzOiAxZmZmZmZmZmYwNDgwZmJlICAg cjE0OiAwMDAwMDAwMDAwMDAwMDAwCihYRU4pIHIxNTogMDAwMDAwMDAwMDAwMDAwMCAgIGNyMDog MDAwMDAwMDA4MDA1MDAzYiAgIGNyNDogMDAwMDAwMDAwMDM1MDZlMAooWEVOKSBjcjM6IDAwMDAw MDAwMzQwMjcwMDAgICBjcjI6IGZmZmZmYmZmZjA0ODBmYmUKKFhFTikgZnNiOiAwMDAwMDAwMDAw MDAwMDAwICAgZ3NiOiBmZmZmZmZmZjgyYjYxMDAwICAgZ3NzOiAwMDAwMDAwMDAwMDAwMDAwCihY RU4pIGRzOiAwMDAwICAgZXM6IDAwMDAgICBmczogMDAwMCAgIGdzOiAwMDAwICAgc3M6IGUwMmIg ICBjczogZTAzMwoKV2hpY2ggaXMgc3VyZWx5IHNvbWUgLmNvbmZpZyBpc3N1ZSwgYnV0IEkgZGlk bid0IGZpZ3VyZSBvdXQgd2hhdC4KCkphc29uCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fXwpYZW4tZGV2ZWwgbWFpbGluZyBsaXN0Clhlbi1kZXZlbEBsaXN0 cy54ZW5wcm9qZWN0Lm9yZwpodHRwczovL2xpc3RzLnhlbnByb2plY3Qub3JnL21haWxtYW4vbGlz dGluZm8veGVuLWRldmVs From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id D3CBCCA9ECF for ; Fri, 1 Nov 2019 17:51:49 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id B048F21734 for ; Fri, 1 Nov 2019 17:51:49 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org B048F21734 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=mellanox.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=amd-gfx-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 7E2F0882B5; Fri, 1 Nov 2019 17:51:49 +0000 (UTC) Received: from EUR02-AM5-obe.outbound.protection.outlook.com (mail-eopbgr00076.outbound.protection.outlook.com [40.107.0.76]) by gabe.freedesktop.org (Postfix) with ESMTPS id 4CE21882B5; Fri, 1 Nov 2019 17:48:31 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=F616PnDasdRhilz2Kc6qSBSImWwZldAPBk2MoucstrbO33xqeD34L+gHY1s6qonatRhw1WSWiK7h9DuvBWDXbxq855BA3gO33b9rt6iu6agzY10GvNpgYIZ8IvhNSaCQ0q4CJCYlatlk3IPuGwRlb4ne8o8f9XzUvEvDb/efSa1xU0Ea94EzZD6z+FKXFP+5ZfUs8P9FC+0Mi3eI/pdwJwgGv7AHx2pmeGBnbdc2EnCmjelCwG9xIbTmb160RQ4SDrBfQqG6kYG55LextOJOs+zzzo3gF7SSonV3t1UAsi4KpZvb3uJdY2g7OWab/oNEfuPHq/nfyMXnx0hAAmJkow== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=JxvmHyR/kc6JFGRvJosAQPdPJXSBBjtnI1g5Hj/KEws=; b=ZoAnhDjBJTbNwVGnmwyYuReLO2RrvGVYijtVfaFg5FgFS2pzak35WpWAMS4V6zCmCy+VFSOOzUEfOzwjcUTyMMtZCHKbhkkl5x1uSFbrO047Fd8lXwTUG9m7PG+QZDNZ7CsLTLOlpZgz8JsELyGRmhaVer9JA1JCMxFvb2td9nnV7YfQUlSloyw6NSoP4lUMRMJ8v1XMkTckdTOYv/NUyVMUYg5HvYjFJ335qVkuvuHc1d1IOmRYct5sz9xmQXdUmnelW0PoM+9yW55H9PKdgKPXB9NHe+t0tXDCIVdtasinaSOrMWjiJTUfoN1sPQgOi84W5ql3mAmPRyd+Dgon3g== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=mellanox.com; dmarc=pass action=none header.from=mellanox.com; dkim=pass header.d=mellanox.com; arc=none Received: from VI1PR05MB4141.eurprd05.prod.outlook.com (52.133.14.15) by VI1PR05MB6142.eurprd05.prod.outlook.com (20.178.127.213) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2408.17; Fri, 1 Nov 2019 17:48:28 +0000 Received: from VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d]) by VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d%5]) with mapi id 15.20.2387.028; Fri, 1 Nov 2019 17:48:28 +0000 From: Jason Gunthorpe To: Boris Ostrovsky Subject: Re: [PATCH v2 09/15] xen/gntdev: use mmu_range_notifier_insert Thread-Topic: [PATCH v2 09/15] xen/gntdev: use mmu_range_notifier_insert Thread-Index: AQHVjcvKV253DVP8r0WB5NYgPgZcBadzahyAgAMzaQA= Date: Fri, 1 Nov 2019 17:48:27 +0000 Message-ID: <20191101174824.GP22766@mellanox.com> References: <20191028201032.6352-1-jgg@ziepe.ca> <20191028201032.6352-10-jgg@ziepe.ca> <0355257f-6a3a-cdcd-d206-aec3df97dded@oracle.com> In-Reply-To: <0355257f-6a3a-cdcd-d206-aec3df97dded@oracle.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-clientproxiedby: BN8PR16CA0030.namprd16.prod.outlook.com (2603:10b6:408:4c::43) To VI1PR05MB4141.eurprd05.prod.outlook.com (2603:10a6:803:44::15) x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [142.162.113.180] x-ms-publictraffictype: Email x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: afffd79b-5541-4515-1c81-08d75ef3b36e x-ms-traffictypediagnostic: VI1PR05MB6142: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:10000; x-forefront-prvs: 020877E0CB x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(136003)(366004)(396003)(39860400002)(346002)(376002)(189003)(199004)(305945005)(66066001)(1076003)(71200400001)(6436002)(316002)(76176011)(52116002)(14454004)(478600001)(81156014)(6486002)(99286004)(4326008)(81166006)(8936002)(2906002)(8676002)(5660300002)(229853002)(186003)(26005)(54906003)(36756003)(66446008)(66556008)(64756008)(256004)(5024004)(6512007)(7416002)(6916009)(2616005)(476003)(446003)(11346002)(486006)(25786009)(386003)(102836004)(3846002)(66476007)(6506007)(71190400001)(6116002)(86362001)(7736002)(33656002)(6246003)(53546011)(66946007); DIR:OUT; SFP:1101; SCL:1; SRVR:VI1PR05MB6142; H:VI1PR05MB4141.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; MX:1; A:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: sWvQLHUb+Zb2MqMU27umQP6TPY+fVpmmlSrKM8hH4imTr1ThxhA8raoNuDVUeuUxvxntgq+OmEuZ+t/7fvl9DVZRKB75KG+Jeu8NSpkVYXGspFpszg7aubns7VxCPp45sZo/s2pmsiIYnOltwEnCaRSFIl3ydCLIpm4K5dhy3UUlDhRlKwyPncZJJ/LJk8JgH6eyYCTUJ7z1mSWDCLqOLZjFO2o4QdtyXsGOvclRAHx1BWuF8QrkPWmbnwYs/wjOAQ5OASWMOcS2JBEr7NhAmOeWjyJ8vvcj/De69djZUrsvoZBiVsifdkAfcvqVg2M8hnNZZl3cM4q9gVss9e/BJS+f8lF3zJBdI3P7cBz1Ht+w+Vydm3jA4kJzvEY5eYXUsLkadiQ0GLTjosKDBmIOXPbwsjRDM4OjinlqfIIEkC6F4YEPStpj3SCDgclJRgs2 x-ms-exchange-transport-forked: True Content-ID: <2C63294D1F7ACD45826E5FDF1BD65982@eurprd05.prod.outlook.com> MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: afffd79b-5541-4515-1c81-08d75ef3b36e X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Nov 2019 17:48:28.0304 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: gyKI+02UfkBQHTmFxuAfM6DkrkNGORrCrDW6vdZJ4IdeeO8yWCAvE76jBUBTuwWTulA1i4/hktSr4WPCk2XMvQ== X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR05MB6142 X-Mailman-Approved-At: Fri, 01 Nov 2019 17:51:48 +0000 X-Mailman-Original-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=JxvmHyR/kc6JFGRvJosAQPdPJXSBBjtnI1g5Hj/KEws=; b=FvCWpY72ABDpFQg0glTnf9M5C7IHGwioTuTcCLUyFHeA6BAjgMHR03MjEIJg8H+IAB5wnw1c2HwmRifd+QG6uEk9HEISlC1BnqJp0kWmwElDZDXEazhp0eygF6B/V/oNtW2amsmRxkgE/8LvPXsasIb+c3J21i+SnXWqdF4PJQI= X-Mailman-Original-Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=jgg@mellanox.com; X-BeenThere: amd-gfx@lists.freedesktop.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion list for AMD gfx List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Juergen Gross , David Zhou , Ralph Campbell , Stefano Stabellini , Oleksandr Andrushchenko , "linux-rdma@vger.kernel.org" , John Hubbard , "Felix.Kuehling@amd.com" , Mike Marciniszyn , "dri-devel@lists.freedesktop.org" , Christoph Hellwig , "linux-mm@kvack.org" , Jerome Glisse , "amd-gfx@lists.freedesktop.org" , "nouveau@lists.freedesktop.org" , Alex Deucher , "xen-devel@lists.xenproject.org" , Dennis Dalessandro , Petr Cvek , =?iso-8859-1?Q?Christian_K=F6nig?= , Ben Skeggs Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: amd-gfx-bounces@lists.freedesktop.org Sender: "amd-gfx" Message-ID: <20191101174827.Szw6XjK-UT_hTwjP_ij7xm8eKJ_7ZTHl0dfqzCISRmw@z> T24gV2VkLCBPY3QgMzAsIDIwMTkgYXQgMTI6NTU6MzdQTSAtMDQwMCwgQm9yaXMgT3N0cm92c2t5 IHdyb3RlOgo+IE9uIDEwLzI4LzE5IDQ6MTAgUE0sIEphc29uIEd1bnRob3JwZSB3cm90ZToKPiA+ IEZyb206IEphc29uIEd1bnRob3JwZSA8amdnQG1lbGxhbm94LmNvbT4KPiA+Cj4gPiBnbnRkZXYg c2ltcGx5IHdhbnRzIHRvIG1vbml0b3IgYSBzcGVjaWZpYyBWTUEgZm9yIGFueSBub3RpZmllciBl dmVudHMsCj4gPiB0aGlzIGNhbiBiZSBkb25lIHN0cmFpZ2h0Zm9yd2FyZGx5IHVzaW5nIG1tdV9y YW5nZV9ub3RpZmllcl9pbnNlcnQoKSBvdmVyCj4gPiB0aGUgVk1BJ3MgVkEgcmFuZ2UuCj4gPgo+ ID4gVGhlIG5vdGlmaWVyIHNob3VsZCBiZSBhdHRhY2hlZCB1bnRpbCB0aGUgb3JpZ2luYWwgVk1B IGlzIGRlc3Ryb3llZC4KPiA+Cj4gPiBJdCBpcyB1bmNsZWFyIGlmIGFueSBvZiB0aGlzIGlzIGV2 ZW4gc2FuZSwgYnV0IGF0IGxlYXN0IGEgbG90IG9mIGR1cGxpY2F0ZQo+ID4gY29kZSBpcyByZW1v dmVkLgo+IAo+IEkgZGlkbid0IGhhdmUgYSBjaGFuY2UgdG8gbG9vayBhdCB0aGUgcGF0Y2ggaXRz ZWxmIHlldCBidXQgYXMgYSBoZWFkcy11cAo+IC0tLSBpdCBjcmFzaGVzIGRvbTAuCgpUaGFua3Mg Qm9yaXMuIEkgc3BlbnQgYSBiaXQgb2YgdGltZSBhbmQgZ290IGEgVk0gcnVubmluZyB3aXRoIGEg eGVuCjQuOSBoeXBlcnZpc29yIGFuZCBhIGtlcm5lbCB3aXRoIHRoaXMgcGF0Y2ggc2VyaWVzLiBJ dCBhIHVidW50dSBiaW9uaWMKVk0gd2l0aCB0aGUgZGlzdHJvJ3MgeGVuIHN0dWZmLgoKQ2FuIHlv dSBnaXZlIHNvbWUgZ3VpZGFuY2UgaG93IHlvdSBtYWRlIGl0IGNyYXNoPyBJIHNlZSB0aGUgVk0K YXV0b2xvYWRlZCBnbnRkZXY6CgpNb2R1bGUgICAgICAgICAgICAgICAgICBTaXplICBVc2VkIGJ5 Cnhlbl9nbnRkZXYgICAgICAgICAgICAgMjQ1NzYgIDIKeGVuX2V2dGNobiAgICAgICAgICAgICAx NjM4NCAgMQp4ZW5mcyAgICAgICAgICAgICAgICAgIDE2Mzg0ICAxCnhlbl9wcml2Y21kICAgICAg ICAgICAgMjQ1NzYgIDE2IHhlbmZzCgpBbmQgbHNvZiBzYXlzIHNldmVyYWwgeGVuIHByb2Nlc3Nl cyBoYXZlIHRoZSBjaGFyZGV2IG9wZW46Cgp4ZW5zdG9yZWQgIDgxOSAgICAgICAgICAgICAgICAg cm9vdCAgIDEzdSAgICAgIENIUiAgICAgICAgICAgICAgMTAsNTMgICAgICAwdDAgICAgICAxOTU5 NSAvZGV2L3hlbi9nbnRkZXYKeGVuY29uc29sICA4NTcgICAgICAgICAgICAgICAgIHJvb3QgICAg OHUgICAgICBDSFIgICAgICAgICAgICAgIDEwLDUzICAgICAgMHQwICAgICAgMTk1OTUgL2Rldi94 ZW4vZ250ZGV2CnhlbmNvbnNvbCAgODU3IDg2MCAgICAgICAgICAgICByb290ICAgIDh1ICAgICAg Q0hSICAgICAgICAgICAgICAxMCw1MyAgICAgIDB0MCAgICAgIDE5NTk1IC9kZXYveGVuL2dudGRl dgoKQnV0IG5vIGNyYXNoaW5nLi4KCkhvd2V2ZXIsIEkgd2Fzbid0IGFibGUgdG8gZ2V0IG15IHVz dWFsIGRlYnVnIGtlcm5lbCAuY29uZmlnIHRvIGJvb3QKd2l0aCB0aGUgeGVuIGh5cGVydmlzb3Is IGl0IGNyYXNoZXMgb24gZWFybHkgYm9vdCB3aXRoOgoKKFhFTikgRG9tMCBoYXMgbWF4aW11bSA4 IFZDUFVzCihYRU4pIFNjcnViYmluZyBGcmVlIFJBTSBvbiAxIG5vZGVzIHVzaW5nIDggQ1BVcwoo WEVOKSAuZG9uZS4KKFhFTikgSW5pdGlhbCBsb3cgbWVtb3J5IHZpcnEgdGhyZXNob2xkIHNldCBh dCAweDEwMDAgcGFnZXMuCihYRU4pIFN0ZC4gTG9nbGV2ZWw6IEFsbAooWEVOKSBHdWVzdCBMb2ds ZXZlbDogQWxsCihYRU4pICoqKiBTZXJpYWwgaW5wdXQgLT4gRE9NMCAodHlwZSAnQ1RSTC1hJyB0 aHJlZSB0aW1lcyB0byBzd2l0Y2ggaW5wdXQgdG8gWGVuKQooWEVOKSBGcmVlZCA0NjhrQiBpbml0 IG1lbW9yeQooWEVOKSBkMHYwIFVuaGFuZGxlZCBwYWdlIGZhdWx0IGZhdWx0L3RyYXAgWyMxNCwg ZWM9MDAwMl0KKFhFTikgUGFnZXRhYmxlIHdhbGsgZnJvbSBmZmZmZmJmZmYwNDgwZmJlOgooWEVO KSAgTDRbMHgxZjddID0gMDAwMDAwMDAwMDAwMDAwMCBmZmZmZmZmZmZmZmZmZmZmCihYRU4pIGRv bWFpbl9jcmFzaF9zeW5jIGNhbGxlZCBmcm9tIGVudHJ5LlM6IGZhdWx0IGF0IGZmZmY4MmQwODAz NDhhMDYgZW50cnkubyNjcmVhdGVfYm91bmNlX2ZyYW1lKzB4MTM1LzB4MTVmCihYRU4pIERvbWFp biAwICh2Y3B1IzApIGNyYXNoZWQgb24gY3B1IzA6CihYRU4pIC0tLS1bIFhlbi00LjkuMiAgeDg2 XzY0ICBkZWJ1Zz1uICAgTm90IHRhaW50ZWQgXS0tLS0KKFhFTikgQ1BVOiAgICAwCihYRU4pIFJJ UDogICAgZTAzMzpbPGZmZmZmZmZmODJiOWY3MzE+XQooWEVOKSBSRkxBR1M6IDAwMDAwMDAwMDAw MDAyOTYgICBFTTogMSAgIENPTlRFWFQ6IHB2IGd1ZXN0IChkMHYwKQooWEVOKSByYXg6IGZmZmZm YmZmZjA0ODBmYmUgICByYng6IDAwMDAwMDAwMDAwMDAwMDAgICByY3g6IDAwMDAwMDAwYzAwMDAx MDEKKFhFTikgcmR4OiAwMDAwMDAwMGZmZmZmZmZmICAgcnNpOiBmZmZmZmZmZjg0MDI2MDAwICAg cmRpOiBmZmZmZmZmZjgyY2I0YTIwCihYRU4pIHJicDogZmZmZmZmZmY4MjQwN2ZmOCAgIHJzcDog ZmZmZmZmZmY4MjQwN2RhMCAgIHI4OiAgMDAwMDAwMDAwMDAwMDAwMAooWEVOKSByOTogIDAwMDAw MDAwMDAwMDAwMDAgICByMTA6IDAwMDAwMDAwMDAwMDAwMDAgICByMTE6IDAwMDAwMDAwMDAwMDAw MDAKKFhFTikgcjEyOiAwMDAwMDAwMDAwMDAwMDAwICAgcjEzOiAxZmZmZmZmZmYwNDgwZmJlICAg cjE0OiAwMDAwMDAwMDAwMDAwMDAwCihYRU4pIHIxNTogMDAwMDAwMDAwMDAwMDAwMCAgIGNyMDog MDAwMDAwMDA4MDA1MDAzYiAgIGNyNDogMDAwMDAwMDAwMDM1MDZlMAooWEVOKSBjcjM6IDAwMDAw MDAwMzQwMjcwMDAgICBjcjI6IGZmZmZmYmZmZjA0ODBmYmUKKFhFTikgZnNiOiAwMDAwMDAwMDAw MDAwMDAwICAgZ3NiOiBmZmZmZmZmZjgyYjYxMDAwICAgZ3NzOiAwMDAwMDAwMDAwMDAwMDAwCihY RU4pIGRzOiAwMDAwICAgZXM6IDAwMDAgICBmczogMDAwMCAgIGdzOiAwMDAwICAgc3M6IGUwMmIg ICBjczogZTAzMwoKV2hpY2ggaXMgc3VyZWx5IHNvbWUgLmNvbmZpZyBpc3N1ZSwgYnV0IEkgZGlk bid0IGZpZ3VyZSBvdXQgd2hhdC4KCkphc29uCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fCmFtZC1nZnggbWFpbGluZyBsaXN0CmFtZC1nZnhAbGlzdHMuZnJl ZWRlc2t0b3Aub3JnCmh0dHBzOi8vbGlzdHMuZnJlZWRlc2t0b3Aub3JnL21haWxtYW4vbGlzdGlu Zm8vYW1kLWdmeA==