From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.3 required=3.0 tests=DKIM_INVALID,DKIM_SIGNED, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_PASS, URIBL_BLOCKED,USER_AGENT_MUTT autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8B9C2C43441 for ; Thu, 22 Nov 2018 14:31:11 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 3991D20685 for ; Thu, 22 Nov 2018 14:31:11 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=fail reason="signature verification failed" (1024-bit key) header.d=ffwll.ch header.i=@ffwll.ch header.b="c/zY8oCC" DMARC-Filter: OpenDMARC Filter v1.3.2 mail.kernel.org 3991D20685 Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=ffwll.ch Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=linux-kernel-owner@vger.kernel.org Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2437447AbeKWBKq (ORCPT ); Thu, 22 Nov 2018 20:10:46 -0500 Received: from mail-ed1-f66.google.com ([209.85.208.66]:42806 "EHLO mail-ed1-f66.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S2388795AbeKWBKp (ORCPT ); Thu, 22 Nov 2018 20:10:45 -0500 Received: by mail-ed1-f66.google.com with SMTP id j6so7862389edp.9 for ; Thu, 22 Nov 2018 06:31:07 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=ffwll.ch; s=google; h=sender:date:from:to:cc:subject:message-id:mail-followup-to :references:mime-version:content-disposition :content-transfer-encoding:in-reply-to:user-agent; bh=9NNs2bPnIF0J9e1VjXBtE16QDMcausS9Z9XExmE1C6s=; b=c/zY8oCCrXQzifH44p6KAW42GU0zr3HtF8oTt7JajzVEDJp0n+JW70wHPb1kgfw0nS KFD69R8BcGE7eGNAExW/EgM8/Gdc3LnUHHqpeE8YQvcYUENLDcZNxjF+xEowUpbsHYpz UuG5CDew4D29+NpuhNqEWXt7u8BCWLnLGBqHk= X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:from:to:cc:subject:message-id :mail-followup-to:references:mime-version:content-disposition :content-transfer-encoding:in-reply-to:user-agent; bh=9NNs2bPnIF0J9e1VjXBtE16QDMcausS9Z9XExmE1C6s=; b=rzQ2Bp1OzST3I8beNCDskVcTrVbejoi3VfryYEGBIH0kL6qx/p/7FoklAo+EH8mEek Da/SNmIlYjtwo9NUdpFVNjo3EjG0hhwmReEVrjxBjyhXWjCwsGLjY4y7YkAXRleQuxLb JLTL6re6/3n/Qzqmh6s3jnqmCdeIfRzOvhPinRtsjcmDkL6Mhi12xykyN3uWfoMYcbJ9 r+aQINjAein4YsSo/Ia4u6hGrB6+O4/lVnz7hAE/aIn9hxem55bjYmKEG2jUuaPWcWR+ g3PYs6NhpW+1V45bTpgiTjey7tSsiefU/lrOm/iOU2bjUyjhTecoF5wF04Ppl3wypSww V0Tg== X-Gm-Message-State: AA+aEWZXolhIgMnwl5PlXzgi9IYj5jpkv8YL1lUzMFHijg/lHEVFjUOH wUZtJEALJ7/NsLTTNljjvC1ycg== X-Google-Smtp-Source: AFSGD/VlX1Tqfa4UxNkct7uC7mvJHfyMC+XyHejrIU5rfRJAf8thoxPZ0weMxVzNOyfURo21UuyMAg== X-Received: by 2002:a50:9472:: with SMTP id q47mr9791998eda.251.1542897067267; Thu, 22 Nov 2018 06:31:07 -0800 (PST) Received: from phenom.ffwll.local ([2a02:168:569e:0:3106:d637:d723:e855]) by smtp.gmail.com with ESMTPSA id r46sm1287466edd.18.2018.11.22.06.31.05 (version=TLS1_2 cipher=ECDHE-RSA-CHACHA20-POLY1305 bits=256/256); Thu, 22 Nov 2018 06:31:06 -0800 (PST) Date: Thu, 22 Nov 2018 15:31:04 +0100 From: Daniel Vetter To: Joonas Lahtinen Cc: jglisse@redhat.com, linux-kernel@vger.kernel.org, dri-devel@lists.freedesktop.org, David Airlie , Daniel Vetter , Chris Wilson , Lionel Landwerlin , Jani Nikula , Rodrigo Vivi , intel-gfx@lists.freedesktop.org Subject: Re: [PATCH 2/2] gpu/i915: use HMM mirror for userptr buffer object. Message-ID: <20181122143104.GF4266@phenom.ffwll.local> Mail-Followup-To: Joonas Lahtinen , jglisse@redhat.com, linux-kernel@vger.kernel.org, dri-devel@lists.freedesktop.org, David Airlie , Chris Wilson , Lionel Landwerlin , Jani Nikula , Rodrigo Vivi , intel-gfx@lists.freedesktop.org References: <20180910005736.5805-1-jglisse@redhat.com> <20180910005736.5805-3-jglisse@redhat.com> <154289518994.19402.3481838548028068213@jlahtine-desk.ger.corp.intel.com> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-1 Content-Disposition: inline Content-Transfer-Encoding: 8bit In-Reply-To: <154289518994.19402.3481838548028068213@jlahtine-desk.ger.corp.intel.com> X-Operating-System: Linux phenom 4.18.0-2-amd64 User-Agent: Mutt/1.10.1 (2018-07-13) Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Nov 22, 2018 at 03:59:50PM +0200, Joonas Lahtinen wrote: > Hi Jerome, > > Bit late reply, but here goes :) > > We're working quite hard to avoid pinning any pages unless they're in > the GPU page tables. And when they are in the GPU page tables, they must > be pinned for whole of that duration, for the reason that our GPUs can > not take a fault. And to avoid thrashing GPU page tables, we do leave > objects in page tables with the expectation that smart userspace > recycles buffers. > > So what I understand of your proposal, it wouldn't really make a > difference for us in the amount of pinned pages (which I agree, > we'd love to see going down). When we're unable to take a fault, > the first use effectively forces us to pin any pages and keep them > pinned to avoid thrashing GPU page tables. > > So from i915 perspective, it just seems to be mostly an exchange of > an API to an another for getting the pages. You already mentioned > the fast path is being worked on, which is an obvious difference. > But is there some other improvement one would be expecting, beyond > the page pinning? > > Also, is the requirement for a single non-file-backed VMA in the > plans of being eliminated or is that inherent restriction of the > HMM_MIRROR feature? We're currently not imposing such a limitation. I think a clear plus for HMM would be if this helps us fix the deadlocks and races we're seeing. But I have no idea whether this gets us any closer here or not. -Daniel > > Regards, Joonas > > Quoting jglisse@redhat.com (2018-09-10 03:57:36) > > From: Jérôme Glisse > > > > This replace existing code that rely on get_user_page() aka GUP with > > code that now use HMM mirror to mirror a range of virtual address as > > a buffer object accessible by the GPU. There is no functional changes > > from userspace point of view. > > > > From kernel point of view we no longer pin pages for userptr buffer > > object which is a welcome change (i am assuming that everyone dislike > > page pin as i do). > > > > Another change, from kernel point of view, is that it does no longer > > have a fast path with get_user_pages_fast() this can eventually added > > back through HMM. > > > > Signed-off-by: Jérôme Glisse > > Cc: dri-devel@lists.freedesktop.org > > Cc: David Airlie > > Cc: Daniel Vetter > > Cc: Chris Wilson > > Cc: Lionel Landwerlin > > Cc: Jani Nikula > > Cc: Joonas Lahtinen > > Cc: Rodrigo Vivi > > Cc: intel-gfx@lists.freedesktop.org -- Daniel Vetter Software Engineer, Intel Corporation http://blog.ffwll.ch From mboxrd@z Thu Jan 1 00:00:00 1970 From: Daniel Vetter Subject: Re: [PATCH 2/2] gpu/i915: use HMM mirror for userptr buffer object. Date: Thu, 22 Nov 2018 15:31:04 +0100 Message-ID: <20181122143104.GF4266@phenom.ffwll.local> References: <20180910005736.5805-1-jglisse@redhat.com> <20180910005736.5805-3-jglisse@redhat.com> <154289518994.19402.3481838548028068213@jlahtine-desk.ger.corp.intel.com> Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Return-path: Received: from mail-ed1-x541.google.com (mail-ed1-x541.google.com [IPv6:2a00:1450:4864:20::541]) by gabe.freedesktop.org (Postfix) with ESMTPS id ADF876E3A6 for ; Thu, 22 Nov 2018 14:31:08 +0000 (UTC) Received: by mail-ed1-x541.google.com with SMTP id h50so7885617ede.5 for ; Thu, 22 Nov 2018 06:31:08 -0800 (PST) Content-Disposition: inline In-Reply-To: <154289518994.19402.3481838548028068213@jlahtine-desk.ger.corp.intel.com> List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: dri-devel-bounces@lists.freedesktop.org Sender: "dri-devel" To: Joonas Lahtinen Cc: David Airlie , Daniel Vetter , intel-gfx@lists.freedesktop.org, linux-kernel@vger.kernel.org, dri-devel@lists.freedesktop.org, jglisse@redhat.com, Rodrigo Vivi List-Id: dri-devel@lists.freedesktop.org T24gVGh1LCBOb3YgMjIsIDIwMTggYXQgMDM6NTk6NTBQTSArMDIwMCwgSm9vbmFzIExhaHRpbmVu IHdyb3RlOgo+IEhpIEplcm9tZSwKPiAKPiBCaXQgbGF0ZSByZXBseSwgYnV0IGhlcmUgZ29lcyA6 KQo+IAo+IFdlJ3JlIHdvcmtpbmcgcXVpdGUgaGFyZCB0byBhdm9pZCBwaW5uaW5nIGFueSBwYWdl cyB1bmxlc3MgdGhleSdyZSBpbgo+IHRoZSBHUFUgcGFnZSB0YWJsZXMuIEFuZCB3aGVuIHRoZXkg YXJlIGluIHRoZSBHUFUgcGFnZSB0YWJsZXMsIHRoZXkgbXVzdAo+IGJlIHBpbm5lZCBmb3Igd2hv bGUgb2YgdGhhdCBkdXJhdGlvbiwgZm9yIHRoZSByZWFzb24gdGhhdCBvdXIgR1BVcyBjYW4KPiBu b3QgdGFrZSBhIGZhdWx0LiBBbmQgdG8gYXZvaWQgdGhyYXNoaW5nIEdQVSBwYWdlIHRhYmxlcywg d2UgZG8gbGVhdmUKPiBvYmplY3RzIGluIHBhZ2UgdGFibGVzIHdpdGggdGhlIGV4cGVjdGF0aW9u IHRoYXQgc21hcnQgdXNlcnNwYWNlCj4gcmVjeWNsZXMgYnVmZmVycy4KPiAKPiBTbyB3aGF0IEkg dW5kZXJzdGFuZCBvZiB5b3VyIHByb3Bvc2FsLCBpdCB3b3VsZG4ndCByZWFsbHkgbWFrZSBhCj4g ZGlmZmVyZW5jZSBmb3IgdXMgaW4gdGhlIGFtb3VudCBvZiBwaW5uZWQgcGFnZXMgKHdoaWNoIEkg YWdyZWUsCj4gd2UnZCBsb3ZlIHRvIHNlZSBnb2luZyBkb3duKS4gV2hlbiB3ZSdyZSB1bmFibGUg dG8gdGFrZSBhIGZhdWx0LAo+IHRoZSBmaXJzdCB1c2UgZWZmZWN0aXZlbHkgZm9yY2VzIHVzIHRv IHBpbiBhbnkgcGFnZXMgYW5kIGtlZXAgdGhlbQo+IHBpbm5lZCB0byBhdm9pZCB0aHJhc2hpbmcg R1BVIHBhZ2UgdGFibGVzLgo+IAo+IFNvIGZyb20gaTkxNSBwZXJzcGVjdGl2ZSwgaXQganVzdCBz ZWVtcyB0byBiZSBtb3N0bHkgYW4gZXhjaGFuZ2Ugb2YKPiBhbiBBUEkgdG8gYW4gYW5vdGhlciBm b3IgZ2V0dGluZyB0aGUgcGFnZXMuIFlvdSBhbHJlYWR5IG1lbnRpb25lZAo+IHRoZSBmYXN0IHBh dGggaXMgYmVpbmcgd29ya2VkIG9uLCB3aGljaCBpcyBhbiBvYnZpb3VzIGRpZmZlcmVuY2UuCj4g QnV0IGlzIHRoZXJlIHNvbWUgb3RoZXIgaW1wcm92ZW1lbnQgb25lIHdvdWxkIGJlIGV4cGVjdGlu ZywgYmV5b25kCj4gdGhlIHBhZ2UgcGlubmluZz8KPiAKPiBBbHNvLCBpcyB0aGUgcmVxdWlyZW1l bnQgZm9yIGEgc2luZ2xlIG5vbi1maWxlLWJhY2tlZCBWTUEgaW4gdGhlCj4gcGxhbnMgb2YgYmVp bmcgZWxpbWluYXRlZCBvciBpcyB0aGF0IGluaGVyZW50IHJlc3RyaWN0aW9uIG9mIHRoZQo+IEhN TV9NSVJST1IgZmVhdHVyZT8gV2UncmUgY3VycmVudGx5IG5vdCBpbXBvc2luZyBzdWNoIGEgbGlt aXRhdGlvbi4KCkkgdGhpbmsgYSBjbGVhciBwbHVzIGZvciBITU0gd291bGQgYmUgaWYgdGhpcyBo ZWxwcyB1cyBmaXggdGhlIGRlYWRsb2NrcwphbmQgcmFjZXMgd2UncmUgc2VlaW5nLiBCdXQgSSBo YXZlIG5vIGlkZWEgd2hldGhlciB0aGlzIGdldHMgdXMgYW55IGNsb3NlcgpoZXJlIG9yIG5vdC4K LURhbmllbAoKPiAKPiBSZWdhcmRzLCBKb29uYXMKPiAKPiBRdW90aW5nIGpnbGlzc2VAcmVkaGF0 LmNvbSAoMjAxOC0wOS0xMCAwMzo1NzozNikKPiA+IEZyb206IErDqXLDtG1lIEdsaXNzZSA8amds aXNzZUByZWRoYXQuY29tPgo+ID4gCj4gPiBUaGlzIHJlcGxhY2UgZXhpc3RpbmcgY29kZSB0aGF0 IHJlbHkgb24gZ2V0X3VzZXJfcGFnZSgpIGFrYSBHVVAgd2l0aAo+ID4gY29kZSB0aGF0IG5vdyB1 c2UgSE1NIG1pcnJvciB0byBtaXJyb3IgYSByYW5nZSBvZiB2aXJ0dWFsIGFkZHJlc3MgYXMKPiA+ IGEgYnVmZmVyIG9iamVjdCBhY2Nlc3NpYmxlIGJ5IHRoZSBHUFUuIFRoZXJlIGlzIG5vIGZ1bmN0 aW9uYWwgY2hhbmdlcwo+ID4gZnJvbSB1c2Vyc3BhY2UgcG9pbnQgb2Ygdmlldy4KPiA+IAo+ID4g RnJvbSBrZXJuZWwgcG9pbnQgb2YgdmlldyB3ZSBubyBsb25nZXIgcGluIHBhZ2VzIGZvciB1c2Vy cHRyIGJ1ZmZlcgo+ID4gb2JqZWN0IHdoaWNoIGlzIGEgd2VsY29tZSBjaGFuZ2UgKGkgYW0gYXNz dW1pbmcgdGhhdCBldmVyeW9uZSBkaXNsaWtlCj4gPiBwYWdlIHBpbiBhcyBpIGRvKS4KPiA+IAo+ ID4gQW5vdGhlciBjaGFuZ2UsIGZyb20ga2VybmVsIHBvaW50IG9mIHZpZXcsIGlzIHRoYXQgaXQg ZG9lcyBubyBsb25nZXIKPiA+IGhhdmUgYSBmYXN0IHBhdGggd2l0aCBnZXRfdXNlcl9wYWdlc19m YXN0KCkgdGhpcyBjYW4gZXZlbnR1YWxseSBhZGRlZAo+ID4gYmFjayB0aHJvdWdoIEhNTS4KPiA+ IAo+ID4gU2lnbmVkLW9mZi1ieTogSsOpcsO0bWUgR2xpc3NlIDxqZ2xpc3NlQHJlZGhhdC5jb20+ Cj4gPiBDYzogZHJpLWRldmVsQGxpc3RzLmZyZWVkZXNrdG9wLm9yZwo+ID4gQ2M6IERhdmlkIEFp cmxpZSA8YWlybGllZEBsaW51eC5pZT4KPiA+IENjOiBEYW5pZWwgVmV0dGVyIDxkYW5pZWwudmV0 dGVyQGZmd2xsLmNoPgo+ID4gQ2M6IENocmlzIFdpbHNvbiA8Y2hyaXNAY2hyaXMtd2lsc29uLmNv LnVrPgo+ID4gQ2M6IExpb25lbCBMYW5kd2VybGluIDxsaW9uZWwuZy5sYW5kd2VybGluQGludGVs LmNvbT4KPiA+IENjOiBKYW5pIE5pa3VsYSA8amFuaS5uaWt1bGFAbGludXguaW50ZWwuY29tPgo+ ID4gQ2M6IEpvb25hcyBMYWh0aW5lbiA8am9vbmFzLmxhaHRpbmVuQGxpbnV4LmludGVsLmNvbT4K PiA+IENjOiBSb2RyaWdvIFZpdmkgPHJvZHJpZ28udml2aUBpbnRlbC5jb20+Cj4gPiBDYzogaW50 ZWwtZ2Z4QGxpc3RzLmZyZWVkZXNrdG9wLm9yZwoKLS0gCkRhbmllbCBWZXR0ZXIKU29mdHdhcmUg RW5naW5lZXIsIEludGVsIENvcnBvcmF0aW9uCmh0dHA6Ly9ibG9nLmZmd2xsLmNoCl9fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fCmRyaS1kZXZlbCBtYWlsaW5n IGxpc3QKZHJpLWRldmVsQGxpc3RzLmZyZWVkZXNrdG9wLm9yZwpodHRwczovL2xpc3RzLmZyZWVk ZXNrdG9wLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2RyaS1kZXZlbAo=