From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.9 required=3.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH,MAILING_LIST_MULTI, SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 82FCBCA9ECF for ; Fri, 1 Nov 2019 15:12:33 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 4106C21734 for ; Fri, 1 Nov 2019 15:12:33 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (1024-bit key) header.d=Mellanox.com header.i=@Mellanox.com header.b="bDHwJTdq" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727984AbfKAPMc (ORCPT ); Fri, 1 Nov 2019 11:12:32 -0400 Received: from mail-eopbgr50072.outbound.protection.outlook.com ([40.107.5.72]:45726 "EHLO EUR03-VE1-obe.outbound.protection.outlook.com" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1727326AbfKAPMc (ORCPT ); Fri, 1 Nov 2019 11:12:32 -0400 ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=XgdC4d24Rdtu00wf76tr/TjDTx2aWKmDIzVNYGp5ljjpdhopFRK9GZbf0JfB5tok5L9rh3aoQI4VRmjBQVigpNBNc97tFv5QhSx3mAOWZr6brmy+Mndg0n09rRgcOpr4ihHtxRUl3hkfekp+e25Z1ioiBmjA4chhX8r03Xrmwz+DzI0z7f+cJVl3cya4U++b+PhuzmiOe6b0UR5doPtLZClyz0D249PtqnrlY+6cmRWtn1DfU0VAGK6W8oPa4fYhbymrzc/LVDrlagpcDWZBPmp//XmMICAy1zCcjKEKzogs4Rl4JBDBBw58bXO7okn5aJn1QoZm+zGqI9poxxaP4g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bBkO4Aj0byn7s6Bm0dFVLfpXWPn4l83nSzrjzVuIjYM=; b=cVHZJRIGZr9UlfgrqZBAOZlvrPTJSuatYApR3bYE2bRumC3sUFFk7Y2L7FMkZQf6oW8ozX0LUTqxknMoW00QMlPh+25T8tVL4e2BtCTaDthLsy6lR+N0ex9Vp6Y/MO7fazndK7grryy59ECQU8vALxxwmFsshkspOufk4Dv3Im1H7tkAy/q/HowhDTMwVmEVQWWK+m2mlNx7l78x34iU7QmdGjyIB97vJL01uczSDTGu3MHn2UzsABL0qb+CoPYhxl97jAOY6S5QjLhYSoNHEAEaMU5UwoCfH649qi2QAm+onspqx4z2E9sxvGv4nPb1JOSwM6fg5LgHWLsPNCMdpQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=mellanox.com; dmarc=pass action=none header.from=mellanox.com; dkim=pass header.d=mellanox.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bBkO4Aj0byn7s6Bm0dFVLfpXWPn4l83nSzrjzVuIjYM=; b=bDHwJTdqflJxu7YIoWqMyjjeiyB25GsQ4j55aDhprJ65AXQxtK17c3ZyQDS4jBt3NqEFRR2LSlV9756M/MxeSLmPYTkowS+zZaNzQTRxP6VJNyMqD7VZO4snXRypdIaojIykpeYFPNJM8GvMHI001h0fNW849iHfj9T+rtypnxE= Received: from VI1PR05MB4141.eurprd05.prod.outlook.com (52.133.14.15) by VI1PR05MB6272.eurprd05.prod.outlook.com (20.177.52.97) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2387.25; Fri, 1 Nov 2019 15:12:27 +0000 Received: from VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d]) by VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d%5]) with mapi id 15.20.2387.028; Fri, 1 Nov 2019 15:12:27 +0000 From: Jason Gunthorpe To: "Yang, Philip" CC: "linux-mm@kvack.org" , Jerome Glisse , Ralph Campbell , John Hubbard , "Kuehling, Felix" , Juergen Gross , "Zhou, David(ChunMing)" , Mike Marciniszyn , Stefano Stabellini , Oleksandr Andrushchenko , "linux-rdma@vger.kernel.org" , "nouveau@lists.freedesktop.org" , Dennis Dalessandro , "amd-gfx@lists.freedesktop.org" , Christoph Hellwig , "dri-devel@lists.freedesktop.org" , "Deucher, Alexander" , "xen-devel@lists.xenproject.org" , Boris Ostrovsky , Petr Cvek , "Koenig, Christian" , Ben Skeggs Subject: Re: [PATCH v2 14/15] drm/amdgpu: Use mmu_range_notifier instead of hmm_mirror Thread-Topic: [PATCH v2 14/15] drm/amdgpu: Use mmu_range_notifier instead of hmm_mirror Thread-Index: AQHVjcvOUfhzqykxXkO0v7SQaQq3BKdyANqAgAAA3wCABGiEgIAAB7AA Date: Fri, 1 Nov 2019 15:12:27 +0000 Message-ID: <20191101151222.GN22766@mellanox.com> References: <20191028201032.6352-1-jgg@ziepe.ca> <20191028201032.6352-15-jgg@ziepe.ca> <20191029192544.GU22766@mellanox.com> <30b2f569-bf7a-5166-c98d-4a4a13d1351f@amd.com> In-Reply-To: <30b2f569-bf7a-5166-c98d-4a4a13d1351f@amd.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-clientproxiedby: BN6PR22CA0046.namprd22.prod.outlook.com (2603:10b6:404:37::32) To VI1PR05MB4141.eurprd05.prod.outlook.com (2603:10a6:803:44::15) authentication-results: spf=none (sender IP is ) smtp.mailfrom=jgg@mellanox.com; x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [142.162.113.180] x-ms-publictraffictype: Email x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: 2778cc13-f4ca-4bcf-a336-08d75edde7fe x-ms-traffictypediagnostic: VI1PR05MB6272: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:4941; x-forefront-prvs: 020877E0CB x-forefront-antispam-report: SFV:NSPM;SFS:(10009020)(4636009)(376002)(396003)(136003)(366004)(39860400002)(346002)(199004)(189003)(71200400001)(3846002)(71190400001)(229853002)(7416002)(6436002)(36756003)(8936002)(4326008)(6916009)(6246003)(81166006)(4001150100001)(81156014)(256004)(6486002)(14444005)(6512007)(305945005)(316002)(8676002)(5024004)(54906003)(7736002)(1076003)(11346002)(476003)(2616005)(52116002)(33656002)(446003)(25786009)(66946007)(386003)(66476007)(66446008)(64756008)(6506007)(186003)(66556008)(99286004)(66066001)(86362001)(5660300002)(53546011)(14454004)(76176011)(102836004)(26005)(6116002)(2906002)(486006)(478600001);DIR:OUT;SFP:1101;SCL:1;SRVR:VI1PR05MB6272;H:VI1PR05MB4141.eurprd05.prod.outlook.com;FPR:;SPF:None;LANG:en;PTR:InfoNoRecords;A:1;MX:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 0PHZo1jiT1pkz33nCJj8So/VbYak/n14O0cbehhz3RR1ym22xMr9KmU+ZWIpMKKp1GJiXGv4CBcItN+k5mMgzadBxM4wqZ2otHp/FbvhGjL377p2XLoFgCwJMsPYcBIzqtZBQ8DeS3k0Zo+H1EtxytFNEGiaTmf5kKrTheDqgxmJSc6+thxaBdeO8THCsrvQPn6kFFUeS7R0/Uybm2ll/MRiQOL19dudiVLo94i+BjLenM2l90VDSfxjaQglwfhR3TIX3nQ4aMSm/HbtjsGgw2Lu3zto2kBGEB5G2AY4FSXjDG0rjtRW0Gw7X50RXwtSQjCFgoHylb9NK75usq4GiwBGrkm44kf4Sv3+SE3xDXHbIClXiaGswYGw14ROASHeGkWtVjB7DwFSZvI/fjMTRwjzZKGq3Q1Q61j+KSQyA+b1R4vq1u9UUOuEqZ0epj2b x-ms-exchange-transport-forked: True Content-Type: text/plain; charset="us-ascii" Content-ID: <57BD06A1E1219245833195A807EB8970@eurprd05.prod.outlook.com> Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: 2778cc13-f4ca-4bcf-a336-08d75edde7fe X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Nov 2019 15:12:27.2730 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: IAUkTm1jGhsDFiwCZ1GCJfQdaQdau5qLwgyjoO3DI3luUvfYVzzuKVYtAwoTn37NQaBhgOUxb+jgb9QRdBIpOw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR05MB6272 Sender: linux-rdma-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-rdma@vger.kernel.org On Fri, Nov 01, 2019 at 02:44:51PM +0000, Yang, Philip wrote: >=20 >=20 > On 2019-10-29 3:25 p.m., Jason Gunthorpe wrote: > > On Tue, Oct 29, 2019 at 07:22:37PM +0000, Yang, Philip wrote: > >> Hi Jason, > >> > >> I did quick test after merging amd-staging-drm-next with the > >> mmu_notifier branch, which includes this set changes. The test result > >> has different failures, app stuck intermittently, GUI no display etc. = I > >> am understanding the changes and will try to figure out the cause. > >=20 > > Thanks! I'm not surprised by this given how difficult this patch was > > to make. Let me know if I can assist in any way > >=20 > > Please ensure to run with lockdep enabled.. Your symptops sounds sort > > of like deadlocking? > >=20 > Hi Jason, >=20 > Attached patch fix several issues in amdgpu driver, maybe you can squash= =20 > this into patch 14. With this is done, patch 12, 13, 14 is Reviewed-by=20 > and Tested-by Philip Yang Wow, this is great thanks! Can you clarify what the problems you found were? Was the bug the 'return !r' below? I'll also add your signed off by Here are some remarks: > diff --git a/drivers/gpu/drm/amd/amdgpu/amdgpu_mn.c b/drivers/gpu/drm/amd= /amdgpu/amdgpu_mn.c > index cb718a064eb4..c8bbd06f1009 100644 > +++ b/drivers/gpu/drm/amd/amdgpu/amdgpu_mn.c > @@ -67,21 +67,15 @@ static bool amdgpu_mn_invalidate_gfx(struct mmu_range= _notifier *mrn, > struct amdgpu_device *adev =3D amdgpu_ttm_adev(bo->tbo.bdev); > long r; > =20 > - /* > - * FIXME: Must hold some lock shared with > - * amdgpu_ttm_tt_get_user_pages_done() > - */ > - mmu_range_set_seq(mrn, cur_seq); > + mutex_lock(&adev->notifier_lock); > =20 > - /* FIXME: Is this necessary? */ > - if (!amdgpu_ttm_tt_affect_userptr(bo->tbo.ttm, range->start, > - range->end)) > - return true; > + mmu_range_set_seq(mrn, cur_seq); > =20 > - if (!mmu_notifier_range_blockable(range)) > + if (!mmu_notifier_range_blockable(range)) { > + mutex_unlock(&adev->notifier_lock); > return false; This test for range_blockable should be before mutex_lock, I can move it up Also, do you know if notifier_lock is held while calling amdgpu_ttm_tt_get_user_pages_done()? Can we add a 'lock assert held' to amdgpu_ttm_tt_get_user_pages_done()? > @@ -854,12 +853,20 @@ int amdgpu_ttm_tt_get_user_pages(struct amdgpu_bo *= bo, struct page **pages) > r =3D -EPERM; > goto out_unlock; > } > + up_read(&mm->mmap_sem); > + timeout =3D jiffies + msecs_to_jiffies(HMM_RANGE_DEFAULT_TIMEOUT); > + > +retry: > + range->notifier_seq =3D mmu_range_read_begin(&bo->notifier); > =20 > + down_read(&mm->mmap_sem); > r =3D hmm_range_fault(range, 0); > up_read(&mm->mmap_sem); > - > - if (unlikely(r < 0)) > + if (unlikely(r <=3D 0)) { > + if ((r =3D=3D 0 || r =3D=3D -EBUSY) && !time_after(jiffies, timeout)) > + goto retry; > goto out_free_pfns; > + } This isn't really right, a retry loop like this needs to go all the way to mmu_range_read_retry() and done under the notifier_lock. ie mmu_range_read_retry() can fail just as likely as hmm_range_fault() can, and drivers are supposed to retry in both cases, with a single timeout. AFAICT it is a major bug that many places ignore the return code of amdgpu_ttm_tt_get_user_pages_done() ??? However, this is all pre-existing bugs, so I'm OK go ahead with this patch as modified. I advise AMD to make a followup patch .. I'll add a FIXME note to this effect. > for (i =3D 0; i < ttm->num_pages; i++) { > pages[i] =3D hmm_device_entry_to_page(range, range->pfns[i]); > @@ -916,7 +923,7 @@ bool amdgpu_ttm_tt_get_user_pages_done(struct ttm_tt = *ttm) > gtt->range =3D NULL; > } > =20 > - return r; > + return !r; Ah is this the major error? hmm_range_valid() is inverted vs mmu_range_read_retry()? > } > #endif > =20 > @@ -997,10 +1004,18 @@ static void amdgpu_ttm_tt_unpin_userptr(struct ttm= _tt *ttm) > sg_free_table(ttm->sg); > =20 > #if IS_ENABLED(CONFIG_DRM_AMDGPU_USERPTR) > - if (gtt->range && > - ttm->pages[0] =3D=3D hmm_device_entry_to_page(gtt->range, > - gtt->range->pfns[0])) > - WARN_ONCE(1, "Missing get_user_page_done\n"); > + if (gtt->range) { > + unsigned long i; > + > + for (i =3D 0; i < ttm->num_pages; i++) { > + if (ttm->pages[i] !=3D > + hmm_device_entry_to_page(gtt->range, > + gtt->range->pfns[i])) > + break; > + } > + > + WARN((i =3D=3D ttm->num_pages), "Missing get_user_page_done\n"); > + } Is this related/necessary? I can put it in another patch if it is just debugging improvement? Please advise Thanks a lot, Jason From mboxrd@z Thu Jan 1 00:00:00 1970 From: Jason Gunthorpe Subject: Re: [PATCH v2 14/15] drm/amdgpu: Use mmu_range_notifier instead of hmm_mirror Date: Fri, 1 Nov 2019 15:12:27 +0000 Message-ID: <20191101151222.GN22766@mellanox.com> References: <20191028201032.6352-1-jgg@ziepe.ca> <20191028201032.6352-15-jgg@ziepe.ca> <20191029192544.GU22766@mellanox.com> <30b2f569-bf7a-5166-c98d-4a4a13d1351f@amd.com> Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Return-path: In-Reply-To: <30b2f569-bf7a-5166-c98d-4a4a13d1351f@amd.com> Content-Language: en-US Content-ID: <57BD06A1E1219245833195A807EB8970@eurprd05.prod.outlook.com> List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" To: "Yang, Philip" Cc: "nouveau@lists.freedesktop.org" , "dri-devel@lists.freedesktop.org" , "linux-mm@kvack.org" , "Zhou, David(ChunMing)" , Stefano Stabellini , Oleksandr Andrushchenko , "linux-rdma@vger.kernel.org" , "amd-gfx@lists.freedesktop.org" , Christoph Hellwig , Ben Skeggs , "xen-devel@lists.xenproject.org" , Ralph Campbell , John Hubbard , Jerome Glisse , Dennis Dalessandro , Boris Ostrovsky , Petr Cvek , Juergen Gross , Mike List-Id: nouveau.vger.kernel.org T24gRnJpLCBOb3YgMDEsIDIwMTkgYXQgMDI6NDQ6NTFQTSArMDAwMCwgWWFuZywgUGhpbGlwIHdy b3RlOgo+IAo+IAo+IE9uIDIwMTktMTAtMjkgMzoyNSBwLm0uLCBKYXNvbiBHdW50aG9ycGUgd3Jv dGU6Cj4gPiBPbiBUdWUsIE9jdCAyOSwgMjAxOSBhdCAwNzoyMjozN1BNICswMDAwLCBZYW5nLCBQ aGlsaXAgd3JvdGU6Cj4gPj4gSGkgSmFzb24sCj4gPj4KPiA+PiBJIGRpZCBxdWljayB0ZXN0IGFm dGVyIG1lcmdpbmcgYW1kLXN0YWdpbmctZHJtLW5leHQgd2l0aCB0aGUKPiA+PiBtbXVfbm90aWZp ZXIgYnJhbmNoLCB3aGljaCBpbmNsdWRlcyB0aGlzIHNldCBjaGFuZ2VzLiBUaGUgdGVzdCByZXN1 bHQKPiA+PiBoYXMgZGlmZmVyZW50IGZhaWx1cmVzLCBhcHAgc3R1Y2sgaW50ZXJtaXR0ZW50bHks IEdVSSBubyBkaXNwbGF5IGV0Yy4gSQo+ID4+IGFtIHVuZGVyc3RhbmRpbmcgdGhlIGNoYW5nZXMg YW5kIHdpbGwgdHJ5IHRvIGZpZ3VyZSBvdXQgdGhlIGNhdXNlLgo+ID4gCj4gPiBUaGFua3MhIEkn bSBub3Qgc3VycHJpc2VkIGJ5IHRoaXMgZ2l2ZW4gaG93IGRpZmZpY3VsdCB0aGlzIHBhdGNoIHdh cwo+ID4gdG8gbWFrZS4gTGV0IG1lIGtub3cgaWYgSSBjYW4gYXNzaXN0IGluIGFueSB3YXkKPiA+ IAo+ID4gUGxlYXNlIGVuc3VyZSB0byBydW4gd2l0aCBsb2NrZGVwIGVuYWJsZWQuLiBZb3VyIHN5 bXB0b3BzIHNvdW5kcyBzb3J0Cj4gPiBvZiBsaWtlIGRlYWRsb2NraW5nPwo+ID4gCj4gSGkgSmFz b24sCj4gCj4gQXR0YWNoZWQgcGF0Y2ggZml4IHNldmVyYWwgaXNzdWVzIGluIGFtZGdwdSBkcml2 ZXIsIG1heWJlIHlvdSBjYW4gc3F1YXNoIAo+IHRoaXMgaW50byBwYXRjaCAxNC4gV2l0aCB0aGlz IGlzIGRvbmUsIHBhdGNoIDEyLCAxMywgMTQgaXMgUmV2aWV3ZWQtYnkgCj4gYW5kIFRlc3RlZC1i eSBQaGlsaXAgWWFuZyA8cGhpbGlwLnlhbmdAYW1kLmNvbT4KCldvdywgdGhpcyBpcyBncmVhdCB0 aGFua3MhIENhbiB5b3UgY2xhcmlmeSB3aGF0IHRoZSBwcm9ibGVtcyB5b3UgZm91bmQKd2VyZT8g V2FzIHRoZSBidWcgdGhlICdyZXR1cm4gIXInIGJlbG93PwoKSSdsbCBhbHNvIGFkZCB5b3VyIHNp Z25lZCBvZmYgYnkKCkhlcmUgYXJlIHNvbWUgcmVtYXJrczoKCj4gZGlmZiAtLWdpdCBhL2RyaXZl cnMvZ3B1L2RybS9hbWQvYW1kZ3B1L2FtZGdwdV9tbi5jIGIvZHJpdmVycy9ncHUvZHJtL2FtZC9h bWRncHUvYW1kZ3B1X21uLmMKPiBpbmRleCBjYjcxOGEwNjRlYjQuLmM4YmJkMDZmMTAwOSAxMDA2 NDQKPiArKysgYi9kcml2ZXJzL2dwdS9kcm0vYW1kL2FtZGdwdS9hbWRncHVfbW4uYwo+IEBAIC02 NywyMSArNjcsMTUgQEAgc3RhdGljIGJvb2wgYW1kZ3B1X21uX2ludmFsaWRhdGVfZ2Z4KHN0cnVj dCBtbXVfcmFuZ2Vfbm90aWZpZXIgKm1ybiwKPiAgCXN0cnVjdCBhbWRncHVfZGV2aWNlICphZGV2 ID0gYW1kZ3B1X3R0bV9hZGV2KGJvLT50Ym8uYmRldik7Cj4gIAlsb25nIHI7Cj4gIAo+IC0JLyoK PiAtCSAqIEZJWE1FOiBNdXN0IGhvbGQgc29tZSBsb2NrIHNoYXJlZCB3aXRoCj4gLQkgKiBhbWRn cHVfdHRtX3R0X2dldF91c2VyX3BhZ2VzX2RvbmUoKQo+IC0JICovCj4gLQltbXVfcmFuZ2Vfc2V0 X3NlcShtcm4sIGN1cl9zZXEpOwo+ICsJbXV0ZXhfbG9jaygmYWRldi0+bm90aWZpZXJfbG9jayk7 Cj4gIAo+IC0JLyogRklYTUU6IElzIHRoaXMgbmVjZXNzYXJ5PyAqLwo+IC0JaWYgKCFhbWRncHVf dHRtX3R0X2FmZmVjdF91c2VycHRyKGJvLT50Ym8udHRtLCByYW5nZS0+c3RhcnQsCj4gLQkJCQkJ ICByYW5nZS0+ZW5kKSkKPiAtCQlyZXR1cm4gdHJ1ZTsKPiArCW1tdV9yYW5nZV9zZXRfc2VxKG1y biwgY3VyX3NlcSk7Cj4gIAo+IC0JaWYgKCFtbXVfbm90aWZpZXJfcmFuZ2VfYmxvY2thYmxlKHJh bmdlKSkKPiArCWlmICghbW11X25vdGlmaWVyX3JhbmdlX2Jsb2NrYWJsZShyYW5nZSkpIHsKPiAr CQltdXRleF91bmxvY2soJmFkZXYtPm5vdGlmaWVyX2xvY2spOwo+ICAJCXJldHVybiBmYWxzZTsK ClRoaXMgdGVzdCBmb3IgcmFuZ2VfYmxvY2thYmxlIHNob3VsZCBiZSBiZWZvcmUgbXV0ZXhfbG9j aywgSSBjYW4gbW92ZQppdCB1cAoKQWxzbywgZG8geW91IGtub3cgaWYgbm90aWZpZXJfbG9jayBp cyBoZWxkIHdoaWxlIGNhbGxpbmcKYW1kZ3B1X3R0bV90dF9nZXRfdXNlcl9wYWdlc19kb25lKCk/ IENhbiB3ZSBhZGQgYSAnbG9jayBhc3NlcnQgaGVsZCcKdG8gYW1kZ3B1X3R0bV90dF9nZXRfdXNl cl9wYWdlc19kb25lKCk/Cgo+IEBAIC04NTQsMTIgKzg1MywyMCBAQCBpbnQgYW1kZ3B1X3R0bV90 dF9nZXRfdXNlcl9wYWdlcyhzdHJ1Y3QgYW1kZ3B1X2JvICpibywgc3RydWN0IHBhZ2UgKipwYWdl cykKPiAgCQlyID0gLUVQRVJNOwo+ICAJCWdvdG8gb3V0X3VubG9jazsKPiAgCX0KPiArCXVwX3Jl YWQoJm1tLT5tbWFwX3NlbSk7Cj4gKwl0aW1lb3V0ID0gamlmZmllcyArIG1zZWNzX3RvX2ppZmZp ZXMoSE1NX1JBTkdFX0RFRkFVTFRfVElNRU9VVCk7Cj4gKwo+ICtyZXRyeToKPiArCXJhbmdlLT5u b3RpZmllcl9zZXEgPSBtbXVfcmFuZ2VfcmVhZF9iZWdpbigmYm8tPm5vdGlmaWVyKTsKPiAgCj4g Kwlkb3duX3JlYWQoJm1tLT5tbWFwX3NlbSk7Cj4gIAlyID0gaG1tX3JhbmdlX2ZhdWx0KHJhbmdl LCAwKTsKPiAgCXVwX3JlYWQoJm1tLT5tbWFwX3NlbSk7Cj4gLQo+IC0JaWYgKHVubGlrZWx5KHIg PCAwKSkKPiArCWlmICh1bmxpa2VseShyIDw9IDApKSB7Cj4gKwkJaWYgKChyID09IDAgfHwgciA9 PSAtRUJVU1kpICYmICF0aW1lX2FmdGVyKGppZmZpZXMsIHRpbWVvdXQpKQo+ICsJCQlnb3RvIHJl dHJ5Owo+ICAJCWdvdG8gb3V0X2ZyZWVfcGZuczsKPiArCX0KClRoaXMgaXNuJ3QgcmVhbGx5IHJp Z2h0LCBhIHJldHJ5IGxvb3AgbGlrZSB0aGlzIG5lZWRzIHRvIGdvIGFsbCB0aGUKd2F5IHRvIG1t dV9yYW5nZV9yZWFkX3JldHJ5KCkgYW5kIGRvbmUgdW5kZXIgdGhlIG5vdGlmaWVyX2xvY2suIGll Cm1tdV9yYW5nZV9yZWFkX3JldHJ5KCkgY2FuIGZhaWwganVzdCBhcyBsaWtlbHkgYXMgaG1tX3Jh bmdlX2ZhdWx0KCkKY2FuLCBhbmQgZHJpdmVycyBhcmUgc3VwcG9zZWQgdG8gcmV0cnkgaW4gYm90 aCBjYXNlcywgd2l0aCBhIHNpbmdsZQp0aW1lb3V0LgoKQUZBSUNUIGl0IGlzIGEgbWFqb3IgYnVn IHRoYXQgbWFueSBwbGFjZXMgaWdub3JlIHRoZSByZXR1cm4gY29kZSBvZgphbWRncHVfdHRtX3R0 X2dldF91c2VyX3BhZ2VzX2RvbmUoKSA/Pz8KCkhvd2V2ZXIsIHRoaXMgaXMgYWxsIHByZS1leGlz dGluZyBidWdzLCBzbyBJJ20gT0sgZ28gYWhlYWQgd2l0aCB0aGlzCnBhdGNoIGFzIG1vZGlmaWVk LiBJIGFkdmlzZSBBTUQgdG8gbWFrZSBhIGZvbGxvd3VwIHBhdGNoIC4uCgpJJ2xsIGFkZCBhIEZJ WE1FIG5vdGUgdG8gdGhpcyBlZmZlY3QuCgo+ICAJZm9yIChpID0gMDsgaSA8IHR0bS0+bnVtX3Bh Z2VzOyBpKyspIHsKPiAgCQlwYWdlc1tpXSA9IGhtbV9kZXZpY2VfZW50cnlfdG9fcGFnZShyYW5n ZSwgcmFuZ2UtPnBmbnNbaV0pOwo+IEBAIC05MTYsNyArOTIzLDcgQEAgYm9vbCBhbWRncHVfdHRt X3R0X2dldF91c2VyX3BhZ2VzX2RvbmUoc3RydWN0IHR0bV90dCAqdHRtKQo+ICAJCWd0dC0+cmFu Z2UgPSBOVUxMOwo+ICAJfQo+ICAKPiAtCXJldHVybiByOwo+ICsJcmV0dXJuICFyOwoKQWggaXMg dGhpcyB0aGUgbWFqb3IgZXJyb3I/IGhtbV9yYW5nZV92YWxpZCgpIGlzIGludmVydGVkIHZzCm1t dV9yYW5nZV9yZWFkX3JldHJ5KCk/Cgo+ICB9Cj4gICNlbmRpZgo+ICAKPiBAQCAtOTk3LDEwICsx MDA0LDE4IEBAIHN0YXRpYyB2b2lkIGFtZGdwdV90dG1fdHRfdW5waW5fdXNlcnB0cihzdHJ1Y3Qg dHRtX3R0ICp0dG0pCj4gIAlzZ19mcmVlX3RhYmxlKHR0bS0+c2cpOwo+ICAKPiAgI2lmIElTX0VO QUJMRUQoQ09ORklHX0RSTV9BTURHUFVfVVNFUlBUUikKPiAtCWlmIChndHQtPnJhbmdlICYmCj4g LQkgICAgdHRtLT5wYWdlc1swXSA9PSBobW1fZGV2aWNlX2VudHJ5X3RvX3BhZ2UoZ3R0LT5yYW5n ZSwKPiAtCQkJCQkJICAgICAgZ3R0LT5yYW5nZS0+cGZuc1swXSkpCj4gLQkJV0FSTl9PTkNFKDEs ICJNaXNzaW5nIGdldF91c2VyX3BhZ2VfZG9uZVxuIik7Cj4gKwlpZiAoZ3R0LT5yYW5nZSkgewo+ ICsJCXVuc2lnbmVkIGxvbmcgaTsKPiArCj4gKwkJZm9yIChpID0gMDsgaSA8IHR0bS0+bnVtX3Bh Z2VzOyBpKyspIHsKPiArCQkJaWYgKHR0bS0+cGFnZXNbaV0gIT0KPiArCQkJCWhtbV9kZXZpY2Vf ZW50cnlfdG9fcGFnZShndHQtPnJhbmdlLAo+ICsJCQkJCSAgICAgIGd0dC0+cmFuZ2UtPnBmbnNb aV0pKQo+ICsJCQkJYnJlYWs7Cj4gKwkJfQo+ICsKPiArCQlXQVJOKChpID09IHR0bS0+bnVtX3Bh Z2VzKSwgIk1pc3NpbmcgZ2V0X3VzZXJfcGFnZV9kb25lXG4iKTsKPiArCX0KCklzIHRoaXMgcmVs YXRlZC9uZWNlc3Nhcnk/IEkgY2FuIHB1dCBpdCBpbiBhbm90aGVyIHBhdGNoIGlmIGl0IGlzIGp1 c3QKZGVidWdnaW5nIGltcHJvdmVtZW50PyBQbGVhc2UgYWR2aXNlCgpUaGFua3MgYSBsb3QsCkph c29uCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpYZW4t ZGV2ZWwgbWFpbGluZyBsaXN0Clhlbi1kZXZlbEBsaXN0cy54ZW5wcm9qZWN0Lm9yZwpodHRwczov L2xpc3RzLnhlbnByb2plY3Qub3JnL21haWxtYW4vbGlzdGluZm8veGVuLWRldmVs From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.8 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 0C84ACA9ECF for ; Fri, 1 Nov 2019 22:49:44 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id E0972217D9 for ; Fri, 1 Nov 2019 22:49:43 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org E0972217D9 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=mellanox.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=dri-devel-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 933496F88C; Fri, 1 Nov 2019 22:49:39 +0000 (UTC) Received: from EUR03-VE1-obe.outbound.protection.outlook.com (mail-eopbgr50060.outbound.protection.outlook.com [40.107.5.60]) by gabe.freedesktop.org (Postfix) with ESMTPS id BB8D36E22F; Fri, 1 Nov 2019 15:12:30 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=XgdC4d24Rdtu00wf76tr/TjDTx2aWKmDIzVNYGp5ljjpdhopFRK9GZbf0JfB5tok5L9rh3aoQI4VRmjBQVigpNBNc97tFv5QhSx3mAOWZr6brmy+Mndg0n09rRgcOpr4ihHtxRUl3hkfekp+e25Z1ioiBmjA4chhX8r03Xrmwz+DzI0z7f+cJVl3cya4U++b+PhuzmiOe6b0UR5doPtLZClyz0D249PtqnrlY+6cmRWtn1DfU0VAGK6W8oPa4fYhbymrzc/LVDrlagpcDWZBPmp//XmMICAy1zCcjKEKzogs4Rl4JBDBBw58bXO7okn5aJn1QoZm+zGqI9poxxaP4g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bBkO4Aj0byn7s6Bm0dFVLfpXWPn4l83nSzrjzVuIjYM=; b=cVHZJRIGZr9UlfgrqZBAOZlvrPTJSuatYApR3bYE2bRumC3sUFFk7Y2L7FMkZQf6oW8ozX0LUTqxknMoW00QMlPh+25T8tVL4e2BtCTaDthLsy6lR+N0ex9Vp6Y/MO7fazndK7grryy59ECQU8vALxxwmFsshkspOufk4Dv3Im1H7tkAy/q/HowhDTMwVmEVQWWK+m2mlNx7l78x34iU7QmdGjyIB97vJL01uczSDTGu3MHn2UzsABL0qb+CoPYhxl97jAOY6S5QjLhYSoNHEAEaMU5UwoCfH649qi2QAm+onspqx4z2E9sxvGv4nPb1JOSwM6fg5LgHWLsPNCMdpQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=mellanox.com; dmarc=pass action=none header.from=mellanox.com; dkim=pass header.d=mellanox.com; arc=none Received: from VI1PR05MB4141.eurprd05.prod.outlook.com (52.133.14.15) by VI1PR05MB6272.eurprd05.prod.outlook.com (20.177.52.97) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2387.25; Fri, 1 Nov 2019 15:12:27 +0000 Received: from VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d]) by VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d%5]) with mapi id 15.20.2387.028; Fri, 1 Nov 2019 15:12:27 +0000 From: Jason Gunthorpe To: "Yang, Philip" Subject: Re: [PATCH v2 14/15] drm/amdgpu: Use mmu_range_notifier instead of hmm_mirror Thread-Topic: [PATCH v2 14/15] drm/amdgpu: Use mmu_range_notifier instead of hmm_mirror Thread-Index: AQHVjcvOUfhzqykxXkO0v7SQaQq3BKdyANqAgAAA3wCABGiEgIAAB7AA Date: Fri, 1 Nov 2019 15:12:27 +0000 Message-ID: <20191101151222.GN22766@mellanox.com> References: <20191028201032.6352-1-jgg@ziepe.ca> <20191028201032.6352-15-jgg@ziepe.ca> <20191029192544.GU22766@mellanox.com> <30b2f569-bf7a-5166-c98d-4a4a13d1351f@amd.com> In-Reply-To: <30b2f569-bf7a-5166-c98d-4a4a13d1351f@amd.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-clientproxiedby: BN6PR22CA0046.namprd22.prod.outlook.com (2603:10b6:404:37::32) To VI1PR05MB4141.eurprd05.prod.outlook.com (2603:10a6:803:44::15) x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [142.162.113.180] x-ms-publictraffictype: Email x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: 2778cc13-f4ca-4bcf-a336-08d75edde7fe x-ms-traffictypediagnostic: VI1PR05MB6272: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:4941; x-forefront-prvs: 020877E0CB x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(376002)(396003)(136003)(366004)(39860400002)(346002)(199004)(189003)(71200400001)(3846002)(71190400001)(229853002)(7416002)(6436002)(36756003)(8936002)(4326008)(6916009)(6246003)(81166006)(4001150100001)(81156014)(256004)(6486002)(14444005)(6512007)(305945005)(316002)(8676002)(5024004)(54906003)(7736002)(1076003)(11346002)(476003)(2616005)(52116002)(33656002)(446003)(25786009)(66946007)(386003)(66476007)(66446008)(64756008)(6506007)(186003)(66556008)(99286004)(66066001)(86362001)(5660300002)(53546011)(14454004)(76176011)(102836004)(26005)(6116002)(2906002)(486006)(478600001); DIR:OUT; SFP:1101; SCL:1; SRVR:VI1PR05MB6272; H:VI1PR05MB4141.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 0PHZo1jiT1pkz33nCJj8So/VbYak/n14O0cbehhz3RR1ym22xMr9KmU+ZWIpMKKp1GJiXGv4CBcItN+k5mMgzadBxM4wqZ2otHp/FbvhGjL377p2XLoFgCwJMsPYcBIzqtZBQ8DeS3k0Zo+H1EtxytFNEGiaTmf5kKrTheDqgxmJSc6+thxaBdeO8THCsrvQPn6kFFUeS7R0/Uybm2ll/MRiQOL19dudiVLo94i+BjLenM2l90VDSfxjaQglwfhR3TIX3nQ4aMSm/HbtjsGgw2Lu3zto2kBGEB5G2AY4FSXjDG0rjtRW0Gw7X50RXwtSQjCFgoHylb9NK75usq4GiwBGrkm44kf4Sv3+SE3xDXHbIClXiaGswYGw14ROASHeGkWtVjB7DwFSZvI/fjMTRwjzZKGq3Q1Q61j+KSQyA+b1R4vq1u9UUOuEqZ0epj2b x-ms-exchange-transport-forked: True Content-ID: <57BD06A1E1219245833195A807EB8970@eurprd05.prod.outlook.com> MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: 2778cc13-f4ca-4bcf-a336-08d75edde7fe X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Nov 2019 15:12:27.2730 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: IAUkTm1jGhsDFiwCZ1GCJfQdaQdau5qLwgyjoO3DI3luUvfYVzzuKVYtAwoTn37NQaBhgOUxb+jgb9QRdBIpOw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR05MB6272 X-Mailman-Approved-At: Fri, 01 Nov 2019 22:49:38 +0000 X-Mailman-Original-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bBkO4Aj0byn7s6Bm0dFVLfpXWPn4l83nSzrjzVuIjYM=; b=bDHwJTdqflJxu7YIoWqMyjjeiyB25GsQ4j55aDhprJ65AXQxtK17c3ZyQDS4jBt3NqEFRR2LSlV9756M/MxeSLmPYTkowS+zZaNzQTRxP6VJNyMqD7VZO4snXRypdIaojIykpeYFPNJM8GvMHI001h0fNW849iHfj9T+rtypnxE= X-Mailman-Original-Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=jgg@mellanox.com; X-BeenThere: dri-devel@lists.freedesktop.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Direct Rendering Infrastructure - Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: "nouveau@lists.freedesktop.org" , "dri-devel@lists.freedesktop.org" , "linux-mm@kvack.org" , Stefano Stabellini , Oleksandr Andrushchenko , "linux-rdma@vger.kernel.org" , "amd-gfx@lists.freedesktop.org" , Christoph Hellwig , Ben Skeggs , "xen-devel@lists.xenproject.org" , Ralph Campbell , John Hubbard , Jerome Glisse , Dennis Dalessandro , Boris Ostrovsky , Petr Cvek , Juergen Gross , Mike Marciniszyn , "Kuehling, Felix" , "Deucher, Alexander" , "Koenig, Christian" Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: dri-devel-bounces@lists.freedesktop.org Sender: "dri-devel" Message-ID: <20191101151227.mevzJ5qqPt4ovLWvkjvX-0qaanAg-GxHLfB6lHoA4Bs@z> T24gRnJpLCBOb3YgMDEsIDIwMTkgYXQgMDI6NDQ6NTFQTSArMDAwMCwgWWFuZywgUGhpbGlwIHdy b3RlOgo+IAo+IAo+IE9uIDIwMTktMTAtMjkgMzoyNSBwLm0uLCBKYXNvbiBHdW50aG9ycGUgd3Jv dGU6Cj4gPiBPbiBUdWUsIE9jdCAyOSwgMjAxOSBhdCAwNzoyMjozN1BNICswMDAwLCBZYW5nLCBQ aGlsaXAgd3JvdGU6Cj4gPj4gSGkgSmFzb24sCj4gPj4KPiA+PiBJIGRpZCBxdWljayB0ZXN0IGFm dGVyIG1lcmdpbmcgYW1kLXN0YWdpbmctZHJtLW5leHQgd2l0aCB0aGUKPiA+PiBtbXVfbm90aWZp ZXIgYnJhbmNoLCB3aGljaCBpbmNsdWRlcyB0aGlzIHNldCBjaGFuZ2VzLiBUaGUgdGVzdCByZXN1 bHQKPiA+PiBoYXMgZGlmZmVyZW50IGZhaWx1cmVzLCBhcHAgc3R1Y2sgaW50ZXJtaXR0ZW50bHks IEdVSSBubyBkaXNwbGF5IGV0Yy4gSQo+ID4+IGFtIHVuZGVyc3RhbmRpbmcgdGhlIGNoYW5nZXMg YW5kIHdpbGwgdHJ5IHRvIGZpZ3VyZSBvdXQgdGhlIGNhdXNlLgo+ID4gCj4gPiBUaGFua3MhIEkn bSBub3Qgc3VycHJpc2VkIGJ5IHRoaXMgZ2l2ZW4gaG93IGRpZmZpY3VsdCB0aGlzIHBhdGNoIHdh cwo+ID4gdG8gbWFrZS4gTGV0IG1lIGtub3cgaWYgSSBjYW4gYXNzaXN0IGluIGFueSB3YXkKPiA+ IAo+ID4gUGxlYXNlIGVuc3VyZSB0byBydW4gd2l0aCBsb2NrZGVwIGVuYWJsZWQuLiBZb3VyIHN5 bXB0b3BzIHNvdW5kcyBzb3J0Cj4gPiBvZiBsaWtlIGRlYWRsb2NraW5nPwo+ID4gCj4gSGkgSmFz b24sCj4gCj4gQXR0YWNoZWQgcGF0Y2ggZml4IHNldmVyYWwgaXNzdWVzIGluIGFtZGdwdSBkcml2 ZXIsIG1heWJlIHlvdSBjYW4gc3F1YXNoIAo+IHRoaXMgaW50byBwYXRjaCAxNC4gV2l0aCB0aGlz IGlzIGRvbmUsIHBhdGNoIDEyLCAxMywgMTQgaXMgUmV2aWV3ZWQtYnkgCj4gYW5kIFRlc3RlZC1i eSBQaGlsaXAgWWFuZyA8cGhpbGlwLnlhbmdAYW1kLmNvbT4KCldvdywgdGhpcyBpcyBncmVhdCB0 aGFua3MhIENhbiB5b3UgY2xhcmlmeSB3aGF0IHRoZSBwcm9ibGVtcyB5b3UgZm91bmQKd2VyZT8g V2FzIHRoZSBidWcgdGhlICdyZXR1cm4gIXInIGJlbG93PwoKSSdsbCBhbHNvIGFkZCB5b3VyIHNp Z25lZCBvZmYgYnkKCkhlcmUgYXJlIHNvbWUgcmVtYXJrczoKCj4gZGlmZiAtLWdpdCBhL2RyaXZl cnMvZ3B1L2RybS9hbWQvYW1kZ3B1L2FtZGdwdV9tbi5jIGIvZHJpdmVycy9ncHUvZHJtL2FtZC9h bWRncHUvYW1kZ3B1X21uLmMKPiBpbmRleCBjYjcxOGEwNjRlYjQuLmM4YmJkMDZmMTAwOSAxMDA2 NDQKPiArKysgYi9kcml2ZXJzL2dwdS9kcm0vYW1kL2FtZGdwdS9hbWRncHVfbW4uYwo+IEBAIC02 NywyMSArNjcsMTUgQEAgc3RhdGljIGJvb2wgYW1kZ3B1X21uX2ludmFsaWRhdGVfZ2Z4KHN0cnVj dCBtbXVfcmFuZ2Vfbm90aWZpZXIgKm1ybiwKPiAgCXN0cnVjdCBhbWRncHVfZGV2aWNlICphZGV2 ID0gYW1kZ3B1X3R0bV9hZGV2KGJvLT50Ym8uYmRldik7Cj4gIAlsb25nIHI7Cj4gIAo+IC0JLyoK PiAtCSAqIEZJWE1FOiBNdXN0IGhvbGQgc29tZSBsb2NrIHNoYXJlZCB3aXRoCj4gLQkgKiBhbWRn cHVfdHRtX3R0X2dldF91c2VyX3BhZ2VzX2RvbmUoKQo+IC0JICovCj4gLQltbXVfcmFuZ2Vfc2V0 X3NlcShtcm4sIGN1cl9zZXEpOwo+ICsJbXV0ZXhfbG9jaygmYWRldi0+bm90aWZpZXJfbG9jayk7 Cj4gIAo+IC0JLyogRklYTUU6IElzIHRoaXMgbmVjZXNzYXJ5PyAqLwo+IC0JaWYgKCFhbWRncHVf dHRtX3R0X2FmZmVjdF91c2VycHRyKGJvLT50Ym8udHRtLCByYW5nZS0+c3RhcnQsCj4gLQkJCQkJ ICByYW5nZS0+ZW5kKSkKPiAtCQlyZXR1cm4gdHJ1ZTsKPiArCW1tdV9yYW5nZV9zZXRfc2VxKG1y biwgY3VyX3NlcSk7Cj4gIAo+IC0JaWYgKCFtbXVfbm90aWZpZXJfcmFuZ2VfYmxvY2thYmxlKHJh bmdlKSkKPiArCWlmICghbW11X25vdGlmaWVyX3JhbmdlX2Jsb2NrYWJsZShyYW5nZSkpIHsKPiAr CQltdXRleF91bmxvY2soJmFkZXYtPm5vdGlmaWVyX2xvY2spOwo+ICAJCXJldHVybiBmYWxzZTsK ClRoaXMgdGVzdCBmb3IgcmFuZ2VfYmxvY2thYmxlIHNob3VsZCBiZSBiZWZvcmUgbXV0ZXhfbG9j aywgSSBjYW4gbW92ZQppdCB1cAoKQWxzbywgZG8geW91IGtub3cgaWYgbm90aWZpZXJfbG9jayBp cyBoZWxkIHdoaWxlIGNhbGxpbmcKYW1kZ3B1X3R0bV90dF9nZXRfdXNlcl9wYWdlc19kb25lKCk/ IENhbiB3ZSBhZGQgYSAnbG9jayBhc3NlcnQgaGVsZCcKdG8gYW1kZ3B1X3R0bV90dF9nZXRfdXNl cl9wYWdlc19kb25lKCk/Cgo+IEBAIC04NTQsMTIgKzg1MywyMCBAQCBpbnQgYW1kZ3B1X3R0bV90 dF9nZXRfdXNlcl9wYWdlcyhzdHJ1Y3QgYW1kZ3B1X2JvICpibywgc3RydWN0IHBhZ2UgKipwYWdl cykKPiAgCQlyID0gLUVQRVJNOwo+ICAJCWdvdG8gb3V0X3VubG9jazsKPiAgCX0KPiArCXVwX3Jl YWQoJm1tLT5tbWFwX3NlbSk7Cj4gKwl0aW1lb3V0ID0gamlmZmllcyArIG1zZWNzX3RvX2ppZmZp ZXMoSE1NX1JBTkdFX0RFRkFVTFRfVElNRU9VVCk7Cj4gKwo+ICtyZXRyeToKPiArCXJhbmdlLT5u b3RpZmllcl9zZXEgPSBtbXVfcmFuZ2VfcmVhZF9iZWdpbigmYm8tPm5vdGlmaWVyKTsKPiAgCj4g Kwlkb3duX3JlYWQoJm1tLT5tbWFwX3NlbSk7Cj4gIAlyID0gaG1tX3JhbmdlX2ZhdWx0KHJhbmdl LCAwKTsKPiAgCXVwX3JlYWQoJm1tLT5tbWFwX3NlbSk7Cj4gLQo+IC0JaWYgKHVubGlrZWx5KHIg PCAwKSkKPiArCWlmICh1bmxpa2VseShyIDw9IDApKSB7Cj4gKwkJaWYgKChyID09IDAgfHwgciA9 PSAtRUJVU1kpICYmICF0aW1lX2FmdGVyKGppZmZpZXMsIHRpbWVvdXQpKQo+ICsJCQlnb3RvIHJl dHJ5Owo+ICAJCWdvdG8gb3V0X2ZyZWVfcGZuczsKPiArCX0KClRoaXMgaXNuJ3QgcmVhbGx5IHJp Z2h0LCBhIHJldHJ5IGxvb3AgbGlrZSB0aGlzIG5lZWRzIHRvIGdvIGFsbCB0aGUKd2F5IHRvIG1t dV9yYW5nZV9yZWFkX3JldHJ5KCkgYW5kIGRvbmUgdW5kZXIgdGhlIG5vdGlmaWVyX2xvY2suIGll Cm1tdV9yYW5nZV9yZWFkX3JldHJ5KCkgY2FuIGZhaWwganVzdCBhcyBsaWtlbHkgYXMgaG1tX3Jh bmdlX2ZhdWx0KCkKY2FuLCBhbmQgZHJpdmVycyBhcmUgc3VwcG9zZWQgdG8gcmV0cnkgaW4gYm90 aCBjYXNlcywgd2l0aCBhIHNpbmdsZQp0aW1lb3V0LgoKQUZBSUNUIGl0IGlzIGEgbWFqb3IgYnVn IHRoYXQgbWFueSBwbGFjZXMgaWdub3JlIHRoZSByZXR1cm4gY29kZSBvZgphbWRncHVfdHRtX3R0 X2dldF91c2VyX3BhZ2VzX2RvbmUoKSA/Pz8KCkhvd2V2ZXIsIHRoaXMgaXMgYWxsIHByZS1leGlz dGluZyBidWdzLCBzbyBJJ20gT0sgZ28gYWhlYWQgd2l0aCB0aGlzCnBhdGNoIGFzIG1vZGlmaWVk LiBJIGFkdmlzZSBBTUQgdG8gbWFrZSBhIGZvbGxvd3VwIHBhdGNoIC4uCgpJJ2xsIGFkZCBhIEZJ WE1FIG5vdGUgdG8gdGhpcyBlZmZlY3QuCgo+ICAJZm9yIChpID0gMDsgaSA8IHR0bS0+bnVtX3Bh Z2VzOyBpKyspIHsKPiAgCQlwYWdlc1tpXSA9IGhtbV9kZXZpY2VfZW50cnlfdG9fcGFnZShyYW5n ZSwgcmFuZ2UtPnBmbnNbaV0pOwo+IEBAIC05MTYsNyArOTIzLDcgQEAgYm9vbCBhbWRncHVfdHRt X3R0X2dldF91c2VyX3BhZ2VzX2RvbmUoc3RydWN0IHR0bV90dCAqdHRtKQo+ICAJCWd0dC0+cmFu Z2UgPSBOVUxMOwo+ICAJfQo+ICAKPiAtCXJldHVybiByOwo+ICsJcmV0dXJuICFyOwoKQWggaXMg dGhpcyB0aGUgbWFqb3IgZXJyb3I/IGhtbV9yYW5nZV92YWxpZCgpIGlzIGludmVydGVkIHZzCm1t dV9yYW5nZV9yZWFkX3JldHJ5KCk/Cgo+ICB9Cj4gICNlbmRpZgo+ICAKPiBAQCAtOTk3LDEwICsx MDA0LDE4IEBAIHN0YXRpYyB2b2lkIGFtZGdwdV90dG1fdHRfdW5waW5fdXNlcnB0cihzdHJ1Y3Qg dHRtX3R0ICp0dG0pCj4gIAlzZ19mcmVlX3RhYmxlKHR0bS0+c2cpOwo+ICAKPiAgI2lmIElTX0VO QUJMRUQoQ09ORklHX0RSTV9BTURHUFVfVVNFUlBUUikKPiAtCWlmIChndHQtPnJhbmdlICYmCj4g LQkgICAgdHRtLT5wYWdlc1swXSA9PSBobW1fZGV2aWNlX2VudHJ5X3RvX3BhZ2UoZ3R0LT5yYW5n ZSwKPiAtCQkJCQkJICAgICAgZ3R0LT5yYW5nZS0+cGZuc1swXSkpCj4gLQkJV0FSTl9PTkNFKDEs ICJNaXNzaW5nIGdldF91c2VyX3BhZ2VfZG9uZVxuIik7Cj4gKwlpZiAoZ3R0LT5yYW5nZSkgewo+ ICsJCXVuc2lnbmVkIGxvbmcgaTsKPiArCj4gKwkJZm9yIChpID0gMDsgaSA8IHR0bS0+bnVtX3Bh Z2VzOyBpKyspIHsKPiArCQkJaWYgKHR0bS0+cGFnZXNbaV0gIT0KPiArCQkJCWhtbV9kZXZpY2Vf ZW50cnlfdG9fcGFnZShndHQtPnJhbmdlLAo+ICsJCQkJCSAgICAgIGd0dC0+cmFuZ2UtPnBmbnNb aV0pKQo+ICsJCQkJYnJlYWs7Cj4gKwkJfQo+ICsKPiArCQlXQVJOKChpID09IHR0bS0+bnVtX3Bh Z2VzKSwgIk1pc3NpbmcgZ2V0X3VzZXJfcGFnZV9kb25lXG4iKTsKPiArCX0KCklzIHRoaXMgcmVs YXRlZC9uZWNlc3Nhcnk/IEkgY2FuIHB1dCBpdCBpbiBhbm90aGVyIHBhdGNoIGlmIGl0IGlzIGp1 c3QKZGVidWdnaW5nIGltcHJvdmVtZW50PyBQbGVhc2UgYWR2aXNlCgpUaGFua3MgYSBsb3QsCkph c29uCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCmRyaS1k ZXZlbCBtYWlsaW5nIGxpc3QKZHJpLWRldmVsQGxpc3RzLmZyZWVkZXNrdG9wLm9yZwpodHRwczov L2xpc3RzLmZyZWVkZXNrdG9wLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2RyaS1kZXZlbA== From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.5 required=3.0 tests=DKIM_INVALID,DKIM_SIGNED, HEADER_FROM_DIFFERENT_DOMAINS,INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id AAB5ECA9ECF for ; Fri, 1 Nov 2019 15:13:04 +0000 (UTC) Received: from lists.xenproject.org (lists.xenproject.org [192.237.175.120]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 6A8B421734 for ; Fri, 1 Nov 2019 15:13:04 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (1024-bit key) header.d=Mellanox.com header.i=@Mellanox.com header.b="bDHwJTdq" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 6A8B421734 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=mellanox.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=xen-devel-bounces@lists.xenproject.org Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iQYbI-0007DZ-F2; Fri, 01 Nov 2019 15:12:32 +0000 Received: from us1-rack-iad1.inumbo.com ([172.99.69.81]) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1iQYbH-0007DU-9L for xen-devel@lists.xenproject.org; Fri, 01 Nov 2019 15:12:31 +0000 X-Inumbo-ID: 0522b620-fcba-11e9-862d-bc764e2007e4 Received: from EUR03-VE1-obe.outbound.protection.outlook.com (unknown [2a01:111:f400:fe09::629]) by us1-rack-iad1.inumbo.com (Halon) with ESMTPS id 0522b620-fcba-11e9-862d-bc764e2007e4; Fri, 01 Nov 2019 15:12:29 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=XgdC4d24Rdtu00wf76tr/TjDTx2aWKmDIzVNYGp5ljjpdhopFRK9GZbf0JfB5tok5L9rh3aoQI4VRmjBQVigpNBNc97tFv5QhSx3mAOWZr6brmy+Mndg0n09rRgcOpr4ihHtxRUl3hkfekp+e25Z1ioiBmjA4chhX8r03Xrmwz+DzI0z7f+cJVl3cya4U++b+PhuzmiOe6b0UR5doPtLZClyz0D249PtqnrlY+6cmRWtn1DfU0VAGK6W8oPa4fYhbymrzc/LVDrlagpcDWZBPmp//XmMICAy1zCcjKEKzogs4Rl4JBDBBw58bXO7okn5aJn1QoZm+zGqI9poxxaP4g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bBkO4Aj0byn7s6Bm0dFVLfpXWPn4l83nSzrjzVuIjYM=; b=cVHZJRIGZr9UlfgrqZBAOZlvrPTJSuatYApR3bYE2bRumC3sUFFk7Y2L7FMkZQf6oW8ozX0LUTqxknMoW00QMlPh+25T8tVL4e2BtCTaDthLsy6lR+N0ex9Vp6Y/MO7fazndK7grryy59ECQU8vALxxwmFsshkspOufk4Dv3Im1H7tkAy/q/HowhDTMwVmEVQWWK+m2mlNx7l78x34iU7QmdGjyIB97vJL01uczSDTGu3MHn2UzsABL0qb+CoPYhxl97jAOY6S5QjLhYSoNHEAEaMU5UwoCfH649qi2QAm+onspqx4z2E9sxvGv4nPb1JOSwM6fg5LgHWLsPNCMdpQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=mellanox.com; dmarc=pass action=none header.from=mellanox.com; dkim=pass header.d=mellanox.com; arc=none DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bBkO4Aj0byn7s6Bm0dFVLfpXWPn4l83nSzrjzVuIjYM=; b=bDHwJTdqflJxu7YIoWqMyjjeiyB25GsQ4j55aDhprJ65AXQxtK17c3ZyQDS4jBt3NqEFRR2LSlV9756M/MxeSLmPYTkowS+zZaNzQTRxP6VJNyMqD7VZO4snXRypdIaojIykpeYFPNJM8GvMHI001h0fNW849iHfj9T+rtypnxE= Received: from VI1PR05MB4141.eurprd05.prod.outlook.com (52.133.14.15) by VI1PR05MB6272.eurprd05.prod.outlook.com (20.177.52.97) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2387.25; Fri, 1 Nov 2019 15:12:27 +0000 Received: from VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d]) by VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d%5]) with mapi id 15.20.2387.028; Fri, 1 Nov 2019 15:12:27 +0000 From: Jason Gunthorpe To: "Yang, Philip" Thread-Topic: [PATCH v2 14/15] drm/amdgpu: Use mmu_range_notifier instead of hmm_mirror Thread-Index: AQHVjcvOUfhzqykxXkO0v7SQaQq3BKdyANqAgAAA3wCABGiEgIAAB7AA Date: Fri, 1 Nov 2019 15:12:27 +0000 Message-ID: <20191101151222.GN22766@mellanox.com> References: <20191028201032.6352-1-jgg@ziepe.ca> <20191028201032.6352-15-jgg@ziepe.ca> <20191029192544.GU22766@mellanox.com> <30b2f569-bf7a-5166-c98d-4a4a13d1351f@amd.com> In-Reply-To: <30b2f569-bf7a-5166-c98d-4a4a13d1351f@amd.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-clientproxiedby: BN6PR22CA0046.namprd22.prod.outlook.com (2603:10b6:404:37::32) To VI1PR05MB4141.eurprd05.prod.outlook.com (2603:10a6:803:44::15) authentication-results: spf=none (sender IP is ) smtp.mailfrom=jgg@mellanox.com; x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [142.162.113.180] x-ms-publictraffictype: Email x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: 2778cc13-f4ca-4bcf-a336-08d75edde7fe x-ms-traffictypediagnostic: VI1PR05MB6272: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:4941; x-forefront-prvs: 020877E0CB x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(376002)(396003)(136003)(366004)(39860400002)(346002)(199004)(189003)(71200400001)(3846002)(71190400001)(229853002)(7416002)(6436002)(36756003)(8936002)(4326008)(6916009)(6246003)(81166006)(4001150100001)(81156014)(256004)(6486002)(14444005)(6512007)(305945005)(316002)(8676002)(5024004)(54906003)(7736002)(1076003)(11346002)(476003)(2616005)(52116002)(33656002)(446003)(25786009)(66946007)(386003)(66476007)(66446008)(64756008)(6506007)(186003)(66556008)(99286004)(66066001)(86362001)(5660300002)(53546011)(14454004)(76176011)(102836004)(26005)(6116002)(2906002)(486006)(478600001); DIR:OUT; SFP:1101; SCL:1; SRVR:VI1PR05MB6272; H:VI1PR05MB4141.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 0PHZo1jiT1pkz33nCJj8So/VbYak/n14O0cbehhz3RR1ym22xMr9KmU+ZWIpMKKp1GJiXGv4CBcItN+k5mMgzadBxM4wqZ2otHp/FbvhGjL377p2XLoFgCwJMsPYcBIzqtZBQ8DeS3k0Zo+H1EtxytFNEGiaTmf5kKrTheDqgxmJSc6+thxaBdeO8THCsrvQPn6kFFUeS7R0/Uybm2ll/MRiQOL19dudiVLo94i+BjLenM2l90VDSfxjaQglwfhR3TIX3nQ4aMSm/HbtjsGgw2Lu3zto2kBGEB5G2AY4FSXjDG0rjtRW0Gw7X50RXwtSQjCFgoHylb9NK75usq4GiwBGrkm44kf4Sv3+SE3xDXHbIClXiaGswYGw14ROASHeGkWtVjB7DwFSZvI/fjMTRwjzZKGq3Q1Q61j+KSQyA+b1R4vq1u9UUOuEqZ0epj2b x-ms-exchange-transport-forked: True Content-ID: <57BD06A1E1219245833195A807EB8970@eurprd05.prod.outlook.com> MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: 2778cc13-f4ca-4bcf-a336-08d75edde7fe X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Nov 2019 15:12:27.2730 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: IAUkTm1jGhsDFiwCZ1GCJfQdaQdau5qLwgyjoO3DI3luUvfYVzzuKVYtAwoTn37NQaBhgOUxb+jgb9QRdBIpOw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR05MB6272 Subject: Re: [Xen-devel] [PATCH v2 14/15] drm/amdgpu: Use mmu_range_notifier instead of hmm_mirror X-BeenThere: xen-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Xen developer discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: "nouveau@lists.freedesktop.org" , "dri-devel@lists.freedesktop.org" , "linux-mm@kvack.org" , "Zhou, David\(ChunMing\)" , Stefano Stabellini , Oleksandr Andrushchenko , "linux-rdma@vger.kernel.org" , "amd-gfx@lists.freedesktop.org" , Christoph Hellwig , Ben Skeggs , "xen-devel@lists.xenproject.org" , Ralph Campbell , John Hubbard , Jerome Glisse , Dennis Dalessandro , Boris Ostrovsky , Petr Cvek , Juergen Gross , Mike Marciniszyn , "Kuehling, Felix" , "Deucher, Alexander" , "Koenig, Christian" Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: xen-devel-bounces@lists.xenproject.org Sender: "Xen-devel" T24gRnJpLCBOb3YgMDEsIDIwMTkgYXQgMDI6NDQ6NTFQTSArMDAwMCwgWWFuZywgUGhpbGlwIHdy b3RlOgo+IAo+IAo+IE9uIDIwMTktMTAtMjkgMzoyNSBwLm0uLCBKYXNvbiBHdW50aG9ycGUgd3Jv dGU6Cj4gPiBPbiBUdWUsIE9jdCAyOSwgMjAxOSBhdCAwNzoyMjozN1BNICswMDAwLCBZYW5nLCBQ aGlsaXAgd3JvdGU6Cj4gPj4gSGkgSmFzb24sCj4gPj4KPiA+PiBJIGRpZCBxdWljayB0ZXN0IGFm dGVyIG1lcmdpbmcgYW1kLXN0YWdpbmctZHJtLW5leHQgd2l0aCB0aGUKPiA+PiBtbXVfbm90aWZp ZXIgYnJhbmNoLCB3aGljaCBpbmNsdWRlcyB0aGlzIHNldCBjaGFuZ2VzLiBUaGUgdGVzdCByZXN1 bHQKPiA+PiBoYXMgZGlmZmVyZW50IGZhaWx1cmVzLCBhcHAgc3R1Y2sgaW50ZXJtaXR0ZW50bHks IEdVSSBubyBkaXNwbGF5IGV0Yy4gSQo+ID4+IGFtIHVuZGVyc3RhbmRpbmcgdGhlIGNoYW5nZXMg YW5kIHdpbGwgdHJ5IHRvIGZpZ3VyZSBvdXQgdGhlIGNhdXNlLgo+ID4gCj4gPiBUaGFua3MhIEkn bSBub3Qgc3VycHJpc2VkIGJ5IHRoaXMgZ2l2ZW4gaG93IGRpZmZpY3VsdCB0aGlzIHBhdGNoIHdh cwo+ID4gdG8gbWFrZS4gTGV0IG1lIGtub3cgaWYgSSBjYW4gYXNzaXN0IGluIGFueSB3YXkKPiA+ IAo+ID4gUGxlYXNlIGVuc3VyZSB0byBydW4gd2l0aCBsb2NrZGVwIGVuYWJsZWQuLiBZb3VyIHN5 bXB0b3BzIHNvdW5kcyBzb3J0Cj4gPiBvZiBsaWtlIGRlYWRsb2NraW5nPwo+ID4gCj4gSGkgSmFz b24sCj4gCj4gQXR0YWNoZWQgcGF0Y2ggZml4IHNldmVyYWwgaXNzdWVzIGluIGFtZGdwdSBkcml2 ZXIsIG1heWJlIHlvdSBjYW4gc3F1YXNoIAo+IHRoaXMgaW50byBwYXRjaCAxNC4gV2l0aCB0aGlz IGlzIGRvbmUsIHBhdGNoIDEyLCAxMywgMTQgaXMgUmV2aWV3ZWQtYnkgCj4gYW5kIFRlc3RlZC1i eSBQaGlsaXAgWWFuZyA8cGhpbGlwLnlhbmdAYW1kLmNvbT4KCldvdywgdGhpcyBpcyBncmVhdCB0 aGFua3MhIENhbiB5b3UgY2xhcmlmeSB3aGF0IHRoZSBwcm9ibGVtcyB5b3UgZm91bmQKd2VyZT8g V2FzIHRoZSBidWcgdGhlICdyZXR1cm4gIXInIGJlbG93PwoKSSdsbCBhbHNvIGFkZCB5b3VyIHNp Z25lZCBvZmYgYnkKCkhlcmUgYXJlIHNvbWUgcmVtYXJrczoKCj4gZGlmZiAtLWdpdCBhL2RyaXZl cnMvZ3B1L2RybS9hbWQvYW1kZ3B1L2FtZGdwdV9tbi5jIGIvZHJpdmVycy9ncHUvZHJtL2FtZC9h bWRncHUvYW1kZ3B1X21uLmMKPiBpbmRleCBjYjcxOGEwNjRlYjQuLmM4YmJkMDZmMTAwOSAxMDA2 NDQKPiArKysgYi9kcml2ZXJzL2dwdS9kcm0vYW1kL2FtZGdwdS9hbWRncHVfbW4uYwo+IEBAIC02 NywyMSArNjcsMTUgQEAgc3RhdGljIGJvb2wgYW1kZ3B1X21uX2ludmFsaWRhdGVfZ2Z4KHN0cnVj dCBtbXVfcmFuZ2Vfbm90aWZpZXIgKm1ybiwKPiAgCXN0cnVjdCBhbWRncHVfZGV2aWNlICphZGV2 ID0gYW1kZ3B1X3R0bV9hZGV2KGJvLT50Ym8uYmRldik7Cj4gIAlsb25nIHI7Cj4gIAo+IC0JLyoK PiAtCSAqIEZJWE1FOiBNdXN0IGhvbGQgc29tZSBsb2NrIHNoYXJlZCB3aXRoCj4gLQkgKiBhbWRn cHVfdHRtX3R0X2dldF91c2VyX3BhZ2VzX2RvbmUoKQo+IC0JICovCj4gLQltbXVfcmFuZ2Vfc2V0 X3NlcShtcm4sIGN1cl9zZXEpOwo+ICsJbXV0ZXhfbG9jaygmYWRldi0+bm90aWZpZXJfbG9jayk7 Cj4gIAo+IC0JLyogRklYTUU6IElzIHRoaXMgbmVjZXNzYXJ5PyAqLwo+IC0JaWYgKCFhbWRncHVf dHRtX3R0X2FmZmVjdF91c2VycHRyKGJvLT50Ym8udHRtLCByYW5nZS0+c3RhcnQsCj4gLQkJCQkJ ICByYW5nZS0+ZW5kKSkKPiAtCQlyZXR1cm4gdHJ1ZTsKPiArCW1tdV9yYW5nZV9zZXRfc2VxKG1y biwgY3VyX3NlcSk7Cj4gIAo+IC0JaWYgKCFtbXVfbm90aWZpZXJfcmFuZ2VfYmxvY2thYmxlKHJh bmdlKSkKPiArCWlmICghbW11X25vdGlmaWVyX3JhbmdlX2Jsb2NrYWJsZShyYW5nZSkpIHsKPiAr CQltdXRleF91bmxvY2soJmFkZXYtPm5vdGlmaWVyX2xvY2spOwo+ICAJCXJldHVybiBmYWxzZTsK ClRoaXMgdGVzdCBmb3IgcmFuZ2VfYmxvY2thYmxlIHNob3VsZCBiZSBiZWZvcmUgbXV0ZXhfbG9j aywgSSBjYW4gbW92ZQppdCB1cAoKQWxzbywgZG8geW91IGtub3cgaWYgbm90aWZpZXJfbG9jayBp cyBoZWxkIHdoaWxlIGNhbGxpbmcKYW1kZ3B1X3R0bV90dF9nZXRfdXNlcl9wYWdlc19kb25lKCk/ IENhbiB3ZSBhZGQgYSAnbG9jayBhc3NlcnQgaGVsZCcKdG8gYW1kZ3B1X3R0bV90dF9nZXRfdXNl cl9wYWdlc19kb25lKCk/Cgo+IEBAIC04NTQsMTIgKzg1MywyMCBAQCBpbnQgYW1kZ3B1X3R0bV90 dF9nZXRfdXNlcl9wYWdlcyhzdHJ1Y3QgYW1kZ3B1X2JvICpibywgc3RydWN0IHBhZ2UgKipwYWdl cykKPiAgCQlyID0gLUVQRVJNOwo+ICAJCWdvdG8gb3V0X3VubG9jazsKPiAgCX0KPiArCXVwX3Jl YWQoJm1tLT5tbWFwX3NlbSk7Cj4gKwl0aW1lb3V0ID0gamlmZmllcyArIG1zZWNzX3RvX2ppZmZp ZXMoSE1NX1JBTkdFX0RFRkFVTFRfVElNRU9VVCk7Cj4gKwo+ICtyZXRyeToKPiArCXJhbmdlLT5u b3RpZmllcl9zZXEgPSBtbXVfcmFuZ2VfcmVhZF9iZWdpbigmYm8tPm5vdGlmaWVyKTsKPiAgCj4g Kwlkb3duX3JlYWQoJm1tLT5tbWFwX3NlbSk7Cj4gIAlyID0gaG1tX3JhbmdlX2ZhdWx0KHJhbmdl LCAwKTsKPiAgCXVwX3JlYWQoJm1tLT5tbWFwX3NlbSk7Cj4gLQo+IC0JaWYgKHVubGlrZWx5KHIg PCAwKSkKPiArCWlmICh1bmxpa2VseShyIDw9IDApKSB7Cj4gKwkJaWYgKChyID09IDAgfHwgciA9 PSAtRUJVU1kpICYmICF0aW1lX2FmdGVyKGppZmZpZXMsIHRpbWVvdXQpKQo+ICsJCQlnb3RvIHJl dHJ5Owo+ICAJCWdvdG8gb3V0X2ZyZWVfcGZuczsKPiArCX0KClRoaXMgaXNuJ3QgcmVhbGx5IHJp Z2h0LCBhIHJldHJ5IGxvb3AgbGlrZSB0aGlzIG5lZWRzIHRvIGdvIGFsbCB0aGUKd2F5IHRvIG1t dV9yYW5nZV9yZWFkX3JldHJ5KCkgYW5kIGRvbmUgdW5kZXIgdGhlIG5vdGlmaWVyX2xvY2suIGll Cm1tdV9yYW5nZV9yZWFkX3JldHJ5KCkgY2FuIGZhaWwganVzdCBhcyBsaWtlbHkgYXMgaG1tX3Jh bmdlX2ZhdWx0KCkKY2FuLCBhbmQgZHJpdmVycyBhcmUgc3VwcG9zZWQgdG8gcmV0cnkgaW4gYm90 aCBjYXNlcywgd2l0aCBhIHNpbmdsZQp0aW1lb3V0LgoKQUZBSUNUIGl0IGlzIGEgbWFqb3IgYnVn IHRoYXQgbWFueSBwbGFjZXMgaWdub3JlIHRoZSByZXR1cm4gY29kZSBvZgphbWRncHVfdHRtX3R0 X2dldF91c2VyX3BhZ2VzX2RvbmUoKSA/Pz8KCkhvd2V2ZXIsIHRoaXMgaXMgYWxsIHByZS1leGlz dGluZyBidWdzLCBzbyBJJ20gT0sgZ28gYWhlYWQgd2l0aCB0aGlzCnBhdGNoIGFzIG1vZGlmaWVk LiBJIGFkdmlzZSBBTUQgdG8gbWFrZSBhIGZvbGxvd3VwIHBhdGNoIC4uCgpJJ2xsIGFkZCBhIEZJ WE1FIG5vdGUgdG8gdGhpcyBlZmZlY3QuCgo+ICAJZm9yIChpID0gMDsgaSA8IHR0bS0+bnVtX3Bh Z2VzOyBpKyspIHsKPiAgCQlwYWdlc1tpXSA9IGhtbV9kZXZpY2VfZW50cnlfdG9fcGFnZShyYW5n ZSwgcmFuZ2UtPnBmbnNbaV0pOwo+IEBAIC05MTYsNyArOTIzLDcgQEAgYm9vbCBhbWRncHVfdHRt X3R0X2dldF91c2VyX3BhZ2VzX2RvbmUoc3RydWN0IHR0bV90dCAqdHRtKQo+ICAJCWd0dC0+cmFu Z2UgPSBOVUxMOwo+ICAJfQo+ICAKPiAtCXJldHVybiByOwo+ICsJcmV0dXJuICFyOwoKQWggaXMg dGhpcyB0aGUgbWFqb3IgZXJyb3I/IGhtbV9yYW5nZV92YWxpZCgpIGlzIGludmVydGVkIHZzCm1t dV9yYW5nZV9yZWFkX3JldHJ5KCk/Cgo+ICB9Cj4gICNlbmRpZgo+ICAKPiBAQCAtOTk3LDEwICsx MDA0LDE4IEBAIHN0YXRpYyB2b2lkIGFtZGdwdV90dG1fdHRfdW5waW5fdXNlcnB0cihzdHJ1Y3Qg dHRtX3R0ICp0dG0pCj4gIAlzZ19mcmVlX3RhYmxlKHR0bS0+c2cpOwo+ICAKPiAgI2lmIElTX0VO QUJMRUQoQ09ORklHX0RSTV9BTURHUFVfVVNFUlBUUikKPiAtCWlmIChndHQtPnJhbmdlICYmCj4g LQkgICAgdHRtLT5wYWdlc1swXSA9PSBobW1fZGV2aWNlX2VudHJ5X3RvX3BhZ2UoZ3R0LT5yYW5n ZSwKPiAtCQkJCQkJICAgICAgZ3R0LT5yYW5nZS0+cGZuc1swXSkpCj4gLQkJV0FSTl9PTkNFKDEs ICJNaXNzaW5nIGdldF91c2VyX3BhZ2VfZG9uZVxuIik7Cj4gKwlpZiAoZ3R0LT5yYW5nZSkgewo+ ICsJCXVuc2lnbmVkIGxvbmcgaTsKPiArCj4gKwkJZm9yIChpID0gMDsgaSA8IHR0bS0+bnVtX3Bh Z2VzOyBpKyspIHsKPiArCQkJaWYgKHR0bS0+cGFnZXNbaV0gIT0KPiArCQkJCWhtbV9kZXZpY2Vf ZW50cnlfdG9fcGFnZShndHQtPnJhbmdlLAo+ICsJCQkJCSAgICAgIGd0dC0+cmFuZ2UtPnBmbnNb aV0pKQo+ICsJCQkJYnJlYWs7Cj4gKwkJfQo+ICsKPiArCQlXQVJOKChpID09IHR0bS0+bnVtX3Bh Z2VzKSwgIk1pc3NpbmcgZ2V0X3VzZXJfcGFnZV9kb25lXG4iKTsKPiArCX0KCklzIHRoaXMgcmVs YXRlZC9uZWNlc3Nhcnk/IEkgY2FuIHB1dCBpdCBpbiBhbm90aGVyIHBhdGNoIGlmIGl0IGlzIGp1 c3QKZGVidWdnaW5nIGltcHJvdmVtZW50PyBQbGVhc2UgYWR2aXNlCgpUaGFua3MgYSBsb3QsCkph c29uCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpYZW4t ZGV2ZWwgbWFpbGluZyBsaXN0Clhlbi1kZXZlbEBsaXN0cy54ZW5wcm9qZWN0Lm9yZwpodHRwczov L2xpc3RzLnhlbnByb2plY3Qub3JnL21haWxtYW4vbGlzdGluZm8veGVuLWRldmVs From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.8 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 3782ACA9ECF for ; Fri, 1 Nov 2019 17:39:24 +0000 (UTC) Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 0BAD020862 for ; Fri, 1 Nov 2019 17:39:23 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 0BAD020862 Authentication-Results: mail.kernel.org; dmarc=fail (p=none dis=none) header.from=mellanox.com Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=amd-gfx-bounces@lists.freedesktop.org Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id A21796E286; Fri, 1 Nov 2019 17:39:23 +0000 (UTC) Received: from EUR03-VE1-obe.outbound.protection.outlook.com (mail-eopbgr50060.outbound.protection.outlook.com [40.107.5.60]) by gabe.freedesktop.org (Postfix) with ESMTPS id BB8D36E22F; Fri, 1 Nov 2019 15:12:30 +0000 (UTC) ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=XgdC4d24Rdtu00wf76tr/TjDTx2aWKmDIzVNYGp5ljjpdhopFRK9GZbf0JfB5tok5L9rh3aoQI4VRmjBQVigpNBNc97tFv5QhSx3mAOWZr6brmy+Mndg0n09rRgcOpr4ihHtxRUl3hkfekp+e25Z1ioiBmjA4chhX8r03Xrmwz+DzI0z7f+cJVl3cya4U++b+PhuzmiOe6b0UR5doPtLZClyz0D249PtqnrlY+6cmRWtn1DfU0VAGK6W8oPa4fYhbymrzc/LVDrlagpcDWZBPmp//XmMICAy1zCcjKEKzogs4Rl4JBDBBw58bXO7okn5aJn1QoZm+zGqI9poxxaP4g== ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bBkO4Aj0byn7s6Bm0dFVLfpXWPn4l83nSzrjzVuIjYM=; b=cVHZJRIGZr9UlfgrqZBAOZlvrPTJSuatYApR3bYE2bRumC3sUFFk7Y2L7FMkZQf6oW8ozX0LUTqxknMoW00QMlPh+25T8tVL4e2BtCTaDthLsy6lR+N0ex9Vp6Y/MO7fazndK7grryy59ECQU8vALxxwmFsshkspOufk4Dv3Im1H7tkAy/q/HowhDTMwVmEVQWWK+m2mlNx7l78x34iU7QmdGjyIB97vJL01uczSDTGu3MHn2UzsABL0qb+CoPYhxl97jAOY6S5QjLhYSoNHEAEaMU5UwoCfH649qi2QAm+onspqx4z2E9sxvGv4nPb1JOSwM6fg5LgHWLsPNCMdpQ== ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=mellanox.com; dmarc=pass action=none header.from=mellanox.com; dkim=pass header.d=mellanox.com; arc=none Received: from VI1PR05MB4141.eurprd05.prod.outlook.com (52.133.14.15) by VI1PR05MB6272.eurprd05.prod.outlook.com (20.177.52.97) with Microsoft SMTP Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.2387.25; Fri, 1 Nov 2019 15:12:27 +0000 Received: from VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d]) by VI1PR05MB4141.eurprd05.prod.outlook.com ([fe80::b179:e8bf:22d4:bf8d%5]) with mapi id 15.20.2387.028; Fri, 1 Nov 2019 15:12:27 +0000 From: Jason Gunthorpe To: "Yang, Philip" Subject: Re: [PATCH v2 14/15] drm/amdgpu: Use mmu_range_notifier instead of hmm_mirror Thread-Topic: [PATCH v2 14/15] drm/amdgpu: Use mmu_range_notifier instead of hmm_mirror Thread-Index: AQHVjcvOUfhzqykxXkO0v7SQaQq3BKdyANqAgAAA3wCABGiEgIAAB7AA Date: Fri, 1 Nov 2019 15:12:27 +0000 Message-ID: <20191101151222.GN22766@mellanox.com> References: <20191028201032.6352-1-jgg@ziepe.ca> <20191028201032.6352-15-jgg@ziepe.ca> <20191029192544.GU22766@mellanox.com> <30b2f569-bf7a-5166-c98d-4a4a13d1351f@amd.com> In-Reply-To: <30b2f569-bf7a-5166-c98d-4a4a13d1351f@amd.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-clientproxiedby: BN6PR22CA0046.namprd22.prod.outlook.com (2603:10b6:404:37::32) To VI1PR05MB4141.eurprd05.prod.outlook.com (2603:10a6:803:44::15) x-ms-exchange-messagesentrepresentingtype: 1 x-originating-ip: [142.162.113.180] x-ms-publictraffictype: Email x-ms-office365-filtering-ht: Tenant x-ms-office365-filtering-correlation-id: 2778cc13-f4ca-4bcf-a336-08d75edde7fe x-ms-traffictypediagnostic: VI1PR05MB6272: x-microsoft-antispam-prvs: x-ms-oob-tlc-oobclassifiers: OLM:4941; x-forefront-prvs: 020877E0CB x-forefront-antispam-report: SFV:NSPM; SFS:(10009020)(4636009)(376002)(396003)(136003)(366004)(39860400002)(346002)(199004)(189003)(71200400001)(3846002)(71190400001)(229853002)(7416002)(6436002)(36756003)(8936002)(4326008)(6916009)(6246003)(81166006)(4001150100001)(81156014)(256004)(6486002)(14444005)(6512007)(305945005)(316002)(8676002)(5024004)(54906003)(7736002)(1076003)(11346002)(476003)(2616005)(52116002)(33656002)(446003)(25786009)(66946007)(386003)(66476007)(66446008)(64756008)(6506007)(186003)(66556008)(99286004)(66066001)(86362001)(5660300002)(53546011)(14454004)(76176011)(102836004)(26005)(6116002)(2906002)(486006)(478600001); DIR:OUT; SFP:1101; SCL:1; SRVR:VI1PR05MB6272; H:VI1PR05MB4141.eurprd05.prod.outlook.com; FPR:; SPF:None; LANG:en; PTR:InfoNoRecords; A:1; MX:1; received-spf: None (protection.outlook.com: mellanox.com does not designate permitted sender hosts) x-ms-exchange-senderadcheck: 1 x-microsoft-antispam: BCL:0; x-microsoft-antispam-message-info: 0PHZo1jiT1pkz33nCJj8So/VbYak/n14O0cbehhz3RR1ym22xMr9KmU+ZWIpMKKp1GJiXGv4CBcItN+k5mMgzadBxM4wqZ2otHp/FbvhGjL377p2XLoFgCwJMsPYcBIzqtZBQ8DeS3k0Zo+H1EtxytFNEGiaTmf5kKrTheDqgxmJSc6+thxaBdeO8THCsrvQPn6kFFUeS7R0/Uybm2ll/MRiQOL19dudiVLo94i+BjLenM2l90VDSfxjaQglwfhR3TIX3nQ4aMSm/HbtjsGgw2Lu3zto2kBGEB5G2AY4FSXjDG0rjtRW0Gw7X50RXwtSQjCFgoHylb9NK75usq4GiwBGrkm44kf4Sv3+SE3xDXHbIClXiaGswYGw14ROASHeGkWtVjB7DwFSZvI/fjMTRwjzZKGq3Q1Q61j+KSQyA+b1R4vq1u9UUOuEqZ0epj2b x-ms-exchange-transport-forked: True Content-ID: <57BD06A1E1219245833195A807EB8970@eurprd05.prod.outlook.com> MIME-Version: 1.0 X-OriginatorOrg: Mellanox.com X-MS-Exchange-CrossTenant-Network-Message-Id: 2778cc13-f4ca-4bcf-a336-08d75edde7fe X-MS-Exchange-CrossTenant-originalarrivaltime: 01 Nov 2019 15:12:27.2730 (UTC) X-MS-Exchange-CrossTenant-fromentityheader: Hosted X-MS-Exchange-CrossTenant-id: a652971c-7d2e-4d9b-a6a4-d149256f461b X-MS-Exchange-CrossTenant-mailboxtype: HOSTED X-MS-Exchange-CrossTenant-userprincipalname: IAUkTm1jGhsDFiwCZ1GCJfQdaQdau5qLwgyjoO3DI3luUvfYVzzuKVYtAwoTn37NQaBhgOUxb+jgb9QRdBIpOw== X-MS-Exchange-Transport-CrossTenantHeadersStamped: VI1PR05MB6272 X-Mailman-Approved-At: Fri, 01 Nov 2019 17:39:22 +0000 X-Mailman-Original-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=Mellanox.com; s=selector2; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck; bh=bBkO4Aj0byn7s6Bm0dFVLfpXWPn4l83nSzrjzVuIjYM=; b=bDHwJTdqflJxu7YIoWqMyjjeiyB25GsQ4j55aDhprJ65AXQxtK17c3ZyQDS4jBt3NqEFRR2LSlV9756M/MxeSLmPYTkowS+zZaNzQTRxP6VJNyMqD7VZO4snXRypdIaojIykpeYFPNJM8GvMHI001h0fNW849iHfj9T+rtypnxE= X-Mailman-Original-Authentication-Results: spf=none (sender IP is ) smtp.mailfrom=jgg@mellanox.com; X-BeenThere: amd-gfx@lists.freedesktop.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Discussion list for AMD gfx List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: "nouveau@lists.freedesktop.org" , "dri-devel@lists.freedesktop.org" , "linux-mm@kvack.org" , "Zhou, David\(ChunMing\)" , Stefano Stabellini , Oleksandr Andrushchenko , "linux-rdma@vger.kernel.org" , "amd-gfx@lists.freedesktop.org" , Christoph Hellwig , Ben Skeggs , "xen-devel@lists.xenproject.org" , Ralph Campbell , John Hubbard , Jerome Glisse , Dennis Dalessandro , Boris Ostrovsky , Petr Cvek , Juergen Gross , Mike Marciniszyn , "Kuehling, Felix" , "Deucher, Alexander" , "Koenig, Christian" Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: amd-gfx-bounces@lists.freedesktop.org Sender: "amd-gfx" Message-ID: <20191101151227.MuR1oDzHUC6iXGGtMpBYsf4O2j_utdfvpGNrWynaero@z> T24gRnJpLCBOb3YgMDEsIDIwMTkgYXQgMDI6NDQ6NTFQTSArMDAwMCwgWWFuZywgUGhpbGlwIHdy b3RlOgo+IAo+IAo+IE9uIDIwMTktMTAtMjkgMzoyNSBwLm0uLCBKYXNvbiBHdW50aG9ycGUgd3Jv dGU6Cj4gPiBPbiBUdWUsIE9jdCAyOSwgMjAxOSBhdCAwNzoyMjozN1BNICswMDAwLCBZYW5nLCBQ aGlsaXAgd3JvdGU6Cj4gPj4gSGkgSmFzb24sCj4gPj4KPiA+PiBJIGRpZCBxdWljayB0ZXN0IGFm dGVyIG1lcmdpbmcgYW1kLXN0YWdpbmctZHJtLW5leHQgd2l0aCB0aGUKPiA+PiBtbXVfbm90aWZp ZXIgYnJhbmNoLCB3aGljaCBpbmNsdWRlcyB0aGlzIHNldCBjaGFuZ2VzLiBUaGUgdGVzdCByZXN1 bHQKPiA+PiBoYXMgZGlmZmVyZW50IGZhaWx1cmVzLCBhcHAgc3R1Y2sgaW50ZXJtaXR0ZW50bHks IEdVSSBubyBkaXNwbGF5IGV0Yy4gSQo+ID4+IGFtIHVuZGVyc3RhbmRpbmcgdGhlIGNoYW5nZXMg YW5kIHdpbGwgdHJ5IHRvIGZpZ3VyZSBvdXQgdGhlIGNhdXNlLgo+ID4gCj4gPiBUaGFua3MhIEkn bSBub3Qgc3VycHJpc2VkIGJ5IHRoaXMgZ2l2ZW4gaG93IGRpZmZpY3VsdCB0aGlzIHBhdGNoIHdh cwo+ID4gdG8gbWFrZS4gTGV0IG1lIGtub3cgaWYgSSBjYW4gYXNzaXN0IGluIGFueSB3YXkKPiA+ IAo+ID4gUGxlYXNlIGVuc3VyZSB0byBydW4gd2l0aCBsb2NrZGVwIGVuYWJsZWQuLiBZb3VyIHN5 bXB0b3BzIHNvdW5kcyBzb3J0Cj4gPiBvZiBsaWtlIGRlYWRsb2NraW5nPwo+ID4gCj4gSGkgSmFz b24sCj4gCj4gQXR0YWNoZWQgcGF0Y2ggZml4IHNldmVyYWwgaXNzdWVzIGluIGFtZGdwdSBkcml2 ZXIsIG1heWJlIHlvdSBjYW4gc3F1YXNoIAo+IHRoaXMgaW50byBwYXRjaCAxNC4gV2l0aCB0aGlz IGlzIGRvbmUsIHBhdGNoIDEyLCAxMywgMTQgaXMgUmV2aWV3ZWQtYnkgCj4gYW5kIFRlc3RlZC1i eSBQaGlsaXAgWWFuZyA8cGhpbGlwLnlhbmdAYW1kLmNvbT4KCldvdywgdGhpcyBpcyBncmVhdCB0 aGFua3MhIENhbiB5b3UgY2xhcmlmeSB3aGF0IHRoZSBwcm9ibGVtcyB5b3UgZm91bmQKd2VyZT8g V2FzIHRoZSBidWcgdGhlICdyZXR1cm4gIXInIGJlbG93PwoKSSdsbCBhbHNvIGFkZCB5b3VyIHNp Z25lZCBvZmYgYnkKCkhlcmUgYXJlIHNvbWUgcmVtYXJrczoKCj4gZGlmZiAtLWdpdCBhL2RyaXZl cnMvZ3B1L2RybS9hbWQvYW1kZ3B1L2FtZGdwdV9tbi5jIGIvZHJpdmVycy9ncHUvZHJtL2FtZC9h bWRncHUvYW1kZ3B1X21uLmMKPiBpbmRleCBjYjcxOGEwNjRlYjQuLmM4YmJkMDZmMTAwOSAxMDA2 NDQKPiArKysgYi9kcml2ZXJzL2dwdS9kcm0vYW1kL2FtZGdwdS9hbWRncHVfbW4uYwo+IEBAIC02 NywyMSArNjcsMTUgQEAgc3RhdGljIGJvb2wgYW1kZ3B1X21uX2ludmFsaWRhdGVfZ2Z4KHN0cnVj dCBtbXVfcmFuZ2Vfbm90aWZpZXIgKm1ybiwKPiAgCXN0cnVjdCBhbWRncHVfZGV2aWNlICphZGV2 ID0gYW1kZ3B1X3R0bV9hZGV2KGJvLT50Ym8uYmRldik7Cj4gIAlsb25nIHI7Cj4gIAo+IC0JLyoK PiAtCSAqIEZJWE1FOiBNdXN0IGhvbGQgc29tZSBsb2NrIHNoYXJlZCB3aXRoCj4gLQkgKiBhbWRn cHVfdHRtX3R0X2dldF91c2VyX3BhZ2VzX2RvbmUoKQo+IC0JICovCj4gLQltbXVfcmFuZ2Vfc2V0 X3NlcShtcm4sIGN1cl9zZXEpOwo+ICsJbXV0ZXhfbG9jaygmYWRldi0+bm90aWZpZXJfbG9jayk7 Cj4gIAo+IC0JLyogRklYTUU6IElzIHRoaXMgbmVjZXNzYXJ5PyAqLwo+IC0JaWYgKCFhbWRncHVf dHRtX3R0X2FmZmVjdF91c2VycHRyKGJvLT50Ym8udHRtLCByYW5nZS0+c3RhcnQsCj4gLQkJCQkJ ICByYW5nZS0+ZW5kKSkKPiAtCQlyZXR1cm4gdHJ1ZTsKPiArCW1tdV9yYW5nZV9zZXRfc2VxKG1y biwgY3VyX3NlcSk7Cj4gIAo+IC0JaWYgKCFtbXVfbm90aWZpZXJfcmFuZ2VfYmxvY2thYmxlKHJh bmdlKSkKPiArCWlmICghbW11X25vdGlmaWVyX3JhbmdlX2Jsb2NrYWJsZShyYW5nZSkpIHsKPiAr CQltdXRleF91bmxvY2soJmFkZXYtPm5vdGlmaWVyX2xvY2spOwo+ICAJCXJldHVybiBmYWxzZTsK ClRoaXMgdGVzdCBmb3IgcmFuZ2VfYmxvY2thYmxlIHNob3VsZCBiZSBiZWZvcmUgbXV0ZXhfbG9j aywgSSBjYW4gbW92ZQppdCB1cAoKQWxzbywgZG8geW91IGtub3cgaWYgbm90aWZpZXJfbG9jayBp cyBoZWxkIHdoaWxlIGNhbGxpbmcKYW1kZ3B1X3R0bV90dF9nZXRfdXNlcl9wYWdlc19kb25lKCk/ IENhbiB3ZSBhZGQgYSAnbG9jayBhc3NlcnQgaGVsZCcKdG8gYW1kZ3B1X3R0bV90dF9nZXRfdXNl cl9wYWdlc19kb25lKCk/Cgo+IEBAIC04NTQsMTIgKzg1MywyMCBAQCBpbnQgYW1kZ3B1X3R0bV90 dF9nZXRfdXNlcl9wYWdlcyhzdHJ1Y3QgYW1kZ3B1X2JvICpibywgc3RydWN0IHBhZ2UgKipwYWdl cykKPiAgCQlyID0gLUVQRVJNOwo+ICAJCWdvdG8gb3V0X3VubG9jazsKPiAgCX0KPiArCXVwX3Jl YWQoJm1tLT5tbWFwX3NlbSk7Cj4gKwl0aW1lb3V0ID0gamlmZmllcyArIG1zZWNzX3RvX2ppZmZp ZXMoSE1NX1JBTkdFX0RFRkFVTFRfVElNRU9VVCk7Cj4gKwo+ICtyZXRyeToKPiArCXJhbmdlLT5u b3RpZmllcl9zZXEgPSBtbXVfcmFuZ2VfcmVhZF9iZWdpbigmYm8tPm5vdGlmaWVyKTsKPiAgCj4g Kwlkb3duX3JlYWQoJm1tLT5tbWFwX3NlbSk7Cj4gIAlyID0gaG1tX3JhbmdlX2ZhdWx0KHJhbmdl LCAwKTsKPiAgCXVwX3JlYWQoJm1tLT5tbWFwX3NlbSk7Cj4gLQo+IC0JaWYgKHVubGlrZWx5KHIg PCAwKSkKPiArCWlmICh1bmxpa2VseShyIDw9IDApKSB7Cj4gKwkJaWYgKChyID09IDAgfHwgciA9 PSAtRUJVU1kpICYmICF0aW1lX2FmdGVyKGppZmZpZXMsIHRpbWVvdXQpKQo+ICsJCQlnb3RvIHJl dHJ5Owo+ICAJCWdvdG8gb3V0X2ZyZWVfcGZuczsKPiArCX0KClRoaXMgaXNuJ3QgcmVhbGx5IHJp Z2h0LCBhIHJldHJ5IGxvb3AgbGlrZSB0aGlzIG5lZWRzIHRvIGdvIGFsbCB0aGUKd2F5IHRvIG1t dV9yYW5nZV9yZWFkX3JldHJ5KCkgYW5kIGRvbmUgdW5kZXIgdGhlIG5vdGlmaWVyX2xvY2suIGll Cm1tdV9yYW5nZV9yZWFkX3JldHJ5KCkgY2FuIGZhaWwganVzdCBhcyBsaWtlbHkgYXMgaG1tX3Jh bmdlX2ZhdWx0KCkKY2FuLCBhbmQgZHJpdmVycyBhcmUgc3VwcG9zZWQgdG8gcmV0cnkgaW4gYm90 aCBjYXNlcywgd2l0aCBhIHNpbmdsZQp0aW1lb3V0LgoKQUZBSUNUIGl0IGlzIGEgbWFqb3IgYnVn IHRoYXQgbWFueSBwbGFjZXMgaWdub3JlIHRoZSByZXR1cm4gY29kZSBvZgphbWRncHVfdHRtX3R0 X2dldF91c2VyX3BhZ2VzX2RvbmUoKSA/Pz8KCkhvd2V2ZXIsIHRoaXMgaXMgYWxsIHByZS1leGlz dGluZyBidWdzLCBzbyBJJ20gT0sgZ28gYWhlYWQgd2l0aCB0aGlzCnBhdGNoIGFzIG1vZGlmaWVk LiBJIGFkdmlzZSBBTUQgdG8gbWFrZSBhIGZvbGxvd3VwIHBhdGNoIC4uCgpJJ2xsIGFkZCBhIEZJ WE1FIG5vdGUgdG8gdGhpcyBlZmZlY3QuCgo+ICAJZm9yIChpID0gMDsgaSA8IHR0bS0+bnVtX3Bh Z2VzOyBpKyspIHsKPiAgCQlwYWdlc1tpXSA9IGhtbV9kZXZpY2VfZW50cnlfdG9fcGFnZShyYW5n ZSwgcmFuZ2UtPnBmbnNbaV0pOwo+IEBAIC05MTYsNyArOTIzLDcgQEAgYm9vbCBhbWRncHVfdHRt X3R0X2dldF91c2VyX3BhZ2VzX2RvbmUoc3RydWN0IHR0bV90dCAqdHRtKQo+ICAJCWd0dC0+cmFu Z2UgPSBOVUxMOwo+ICAJfQo+ICAKPiAtCXJldHVybiByOwo+ICsJcmV0dXJuICFyOwoKQWggaXMg dGhpcyB0aGUgbWFqb3IgZXJyb3I/IGhtbV9yYW5nZV92YWxpZCgpIGlzIGludmVydGVkIHZzCm1t dV9yYW5nZV9yZWFkX3JldHJ5KCk/Cgo+ICB9Cj4gICNlbmRpZgo+ICAKPiBAQCAtOTk3LDEwICsx MDA0LDE4IEBAIHN0YXRpYyB2b2lkIGFtZGdwdV90dG1fdHRfdW5waW5fdXNlcnB0cihzdHJ1Y3Qg dHRtX3R0ICp0dG0pCj4gIAlzZ19mcmVlX3RhYmxlKHR0bS0+c2cpOwo+ICAKPiAgI2lmIElTX0VO QUJMRUQoQ09ORklHX0RSTV9BTURHUFVfVVNFUlBUUikKPiAtCWlmIChndHQtPnJhbmdlICYmCj4g LQkgICAgdHRtLT5wYWdlc1swXSA9PSBobW1fZGV2aWNlX2VudHJ5X3RvX3BhZ2UoZ3R0LT5yYW5n ZSwKPiAtCQkJCQkJICAgICAgZ3R0LT5yYW5nZS0+cGZuc1swXSkpCj4gLQkJV0FSTl9PTkNFKDEs ICJNaXNzaW5nIGdldF91c2VyX3BhZ2VfZG9uZVxuIik7Cj4gKwlpZiAoZ3R0LT5yYW5nZSkgewo+ ICsJCXVuc2lnbmVkIGxvbmcgaTsKPiArCj4gKwkJZm9yIChpID0gMDsgaSA8IHR0bS0+bnVtX3Bh Z2VzOyBpKyspIHsKPiArCQkJaWYgKHR0bS0+cGFnZXNbaV0gIT0KPiArCQkJCWhtbV9kZXZpY2Vf ZW50cnlfdG9fcGFnZShndHQtPnJhbmdlLAo+ICsJCQkJCSAgICAgIGd0dC0+cmFuZ2UtPnBmbnNb aV0pKQo+ICsJCQkJYnJlYWs7Cj4gKwkJfQo+ICsKPiArCQlXQVJOKChpID09IHR0bS0+bnVtX3Bh Z2VzKSwgIk1pc3NpbmcgZ2V0X3VzZXJfcGFnZV9kb25lXG4iKTsKPiArCX0KCklzIHRoaXMgcmVs YXRlZC9uZWNlc3Nhcnk/IEkgY2FuIHB1dCBpdCBpbiBhbm90aGVyIHBhdGNoIGlmIGl0IGlzIGp1 c3QKZGVidWdnaW5nIGltcHJvdmVtZW50PyBQbGVhc2UgYWR2aXNlCgpUaGFua3MgYSBsb3QsCkph c29uCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCmFtZC1n ZnggbWFpbGluZyBsaXN0CmFtZC1nZnhAbGlzdHMuZnJlZWRlc2t0b3Aub3JnCmh0dHBzOi8vbGlz dHMuZnJlZWRlc2t0b3Aub3JnL21haWxtYW4vbGlzdGluZm8vYW1kLWdmeA==