From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1753870AbeDTHNT (ORCPT ); Fri, 20 Apr 2018 03:13:19 -0400 Received: from mail-wr0-f171.google.com ([209.85.128.171]:45854 "EHLO mail-wr0-f171.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1753529AbeDTHNQ (ORCPT ); Fri, 20 Apr 2018 03:13:16 -0400 X-Google-Smtp-Source: AIpwx4/PVgsm2t2jrBsk9PtbCOaZk1Fo/KNjY3AYi/02GZ9o1ahsc6TNUlzT/TBndygDj+FlYceHJw== Date: Fri, 20 Apr 2018 09:13:12 +0200 From: Daniel Vetter To: Christoph Hellwig Cc: Daniel Vetter , Jerome Glisse , Christian =?iso-8859-1?Q?K=F6nig?= , "moderated list:DMA BUFFER SHARING FRAMEWORK" , "open list:DMA BUFFER SHARING FRAMEWORK" , dri-devel , amd-gfx list , Linux Kernel Mailing List , Logan Gunthorpe , Dan Williams Subject: Re: [PATCH 4/8] dma-buf: add peer2peer flag Message-ID: <20180420071312.GF31310@phenom.ffwll.local> Mail-Followup-To: Christoph Hellwig , Jerome Glisse , Christian =?iso-8859-1?Q?K=F6nig?= , "moderated list:DMA BUFFER SHARING FRAMEWORK" , "open list:DMA BUFFER SHARING FRAMEWORK" , dri-devel , amd-gfx list , Linux Kernel Mailing List , Logan Gunthorpe , Dan Williams References: <20180325110000.2238-1-christian.koenig@amd.com> <20180325110000.2238-4-christian.koenig@amd.com> <20180329065753.GD3881@phenom.ffwll.local> <8b823458-8bdc-3217-572b-509a28aae742@gmail.com> <20180403090909.GN3881@phenom.ffwll.local> <20180403170645.GB5935@redhat.com> <20180403180832.GZ3881@phenom.ffwll.local> <20180416123937.GA9073@infradead.org> <20180419081657.GA16735@infradead.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20180419081657.GA16735@infradead.org> X-Operating-System: Linux phenom 4.15.0-1-amd64 User-Agent: Mutt/1.9.4 (2018-02-28) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Thu, Apr 19, 2018 at 01:16:57AM -0700, Christoph Hellwig wrote: > On Mon, Apr 16, 2018 at 03:38:56PM +0200, Daniel Vetter wrote: > > We've broken that assumption in i915 years ago. Not struct page backed > > gpu memory is very real. > > > > Of course we'll never feed such a strange sg table to a driver which > > doesn't understand it, but allowing sg_page == NULL works perfectly > > fine. At least for gpu drivers. > > For GPU drivers on x86 with no dma coherency problems, sure. But not > all the world is x86. We already have problems due to dmabugs use > of the awkward get_sgtable interface (see the common on > arm_dma_get_sgtable that I fully agree with), and doing this for memory > that doesn't have a struct page at all will make things even worse. x86 dma isn't coherent either, if you're a GPU :-) Flushing gpu caches tends to be too expensive, so there's pci-e support and chipset support to forgo it. Plus drivers flushing caches themselves. The dma_get_sgtable thing is indeed fun, right solution would probably be to push the dma-buf export down into the dma layer. The comment for arm_dma_get_sgtable is also not a realy concern, because dma-buf also abstracts away the flushing (or well is supposed to), so there really shouldn't be anyone calling the streaming apis on the returned sg table. That's why dma-buf gives you an sg table that's mapped already. > > If that's not acceptable then I guess we could go over the entire tree > > and frob all the gpu related code to switch over to a new struct > > sg_table_might_not_be_struct_page_backed, including all the other > > functions we added over the past few years to iterate over sg tables. > > But seems slightly silly, given that sg tables seem to do exactly what > > we need. > > It isn't silly. We will have to do some surgery like that anyway > because the current APIs don't work. So relax, sit back and come up > with an API that solves the existing issues and serves us well in > the future. So we should just implement a copy of sg table for dma-buf, since I still think it does exactly what we need for gpus? Yes there's a bit a layering violation insofar that drivers really shouldn't each have their own copy of "how do I convert a piece of dma memory into dma-buf", but that doesn't render the interface a bad idea. -Daniel -- Daniel Vetter Software Engineer, Intel Corporation http://blog.ffwll.ch From mboxrd@z Thu Jan 1 00:00:00 1970 From: Daniel Vetter Subject: Re: [PATCH 4/8] dma-buf: add peer2peer flag Date: Fri, 20 Apr 2018 09:13:12 +0200 Message-ID: <20180420071312.GF31310@phenom.ffwll.local> References: <20180325110000.2238-1-christian.koenig@amd.com> <20180325110000.2238-4-christian.koenig@amd.com> <20180329065753.GD3881@phenom.ffwll.local> <8b823458-8bdc-3217-572b-509a28aae742@gmail.com> <20180403090909.GN3881@phenom.ffwll.local> <20180403170645.GB5935@redhat.com> <20180403180832.GZ3881@phenom.ffwll.local> <20180416123937.GA9073@infradead.org> <20180419081657.GA16735@infradead.org> Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Return-path: Content-Disposition: inline In-Reply-To: <20180419081657.GA16735-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org> List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: amd-gfx-bounces-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org Sender: "amd-gfx" To: Christoph Hellwig Cc: Linux Kernel Mailing List , dri-devel , "moderated list:DMA BUFFER SHARING FRAMEWORK" , Jerome Glisse , amd-gfx list , Daniel Vetter , Dan Williams , Logan Gunthorpe , Christian =?iso-8859-1?Q?K=F6nig?= , "open list:DMA BUFFER SHARING FRAMEWORK" List-Id: dri-devel@lists.freedesktop.org T24gVGh1LCBBcHIgMTksIDIwMTggYXQgMDE6MTY6NTdBTSAtMDcwMCwgQ2hyaXN0b3BoIEhlbGx3 aWcgd3JvdGU6Cj4gT24gTW9uLCBBcHIgMTYsIDIwMTggYXQgMDM6Mzg6NTZQTSArMDIwMCwgRGFu aWVsIFZldHRlciB3cm90ZToKPiA+IFdlJ3ZlIGJyb2tlbiB0aGF0IGFzc3VtcHRpb24gaW4gaTkx NSB5ZWFycyBhZ28uIE5vdCBzdHJ1Y3QgcGFnZSBiYWNrZWQKPiA+IGdwdSBtZW1vcnkgaXMgdmVy eSByZWFsLgo+ID4gCj4gPiBPZiBjb3Vyc2Ugd2UnbGwgbmV2ZXIgZmVlZCBzdWNoIGEgc3RyYW5n ZSBzZyB0YWJsZSB0byBhIGRyaXZlciB3aGljaAo+ID4gZG9lc24ndCB1bmRlcnN0YW5kIGl0LCBi dXQgYWxsb3dpbmcgc2dfcGFnZSA9PSBOVUxMIHdvcmtzIHBlcmZlY3RseQo+ID4gZmluZS4gQXQg bGVhc3QgZm9yIGdwdSBkcml2ZXJzLgo+IAo+IEZvciBHUFUgZHJpdmVycyBvbiB4ODYgd2l0aCBu byBkbWEgY29oZXJlbmN5IHByb2JsZW1zLCBzdXJlLiAgQnV0IG5vdAo+IGFsbCB0aGUgd29ybGQg aXMgeDg2LiAgV2UgYWxyZWFkeSBoYXZlIHByb2JsZW1zIGR1ZSB0byBkbWFidWdzIHVzZQo+IG9m IHRoZSBhd2t3YXJkIGdldF9zZ3RhYmxlIGludGVyZmFjZSAoc2VlIHRoZSBjb21tb24gb24KPiBh cm1fZG1hX2dldF9zZ3RhYmxlIHRoYXQgSSBmdWxseSBhZ3JlZSB3aXRoKSwgYW5kIGRvaW5nIHRo aXMgZm9yIG1lbW9yeQo+IHRoYXQgZG9lc24ndCBoYXZlIGEgc3RydWN0IHBhZ2UgYXQgYWxsIHdp bGwgbWFrZSB0aGluZ3MgZXZlbiB3b3JzZS4KCng4NiBkbWEgaXNuJ3QgY29oZXJlbnQgZWl0aGVy LCBpZiB5b3UncmUgYSBHUFUgOi0pIEZsdXNoaW5nIGdwdSBjYWNoZXMKdGVuZHMgdG8gYmUgdG9v IGV4cGVuc2l2ZSwgc28gdGhlcmUncyBwY2ktZSBzdXBwb3J0IGFuZCBjaGlwc2V0IHN1cHBvcnQg dG8KZm9yZ28gaXQuIFBsdXMgZHJpdmVycyBmbHVzaGluZyBjYWNoZXMgdGhlbXNlbHZlcy4KClRo ZSBkbWFfZ2V0X3NndGFibGUgdGhpbmcgaXMgaW5kZWVkIGZ1biwgcmlnaHQgc29sdXRpb24gd291 bGQgcHJvYmFibHkgYmUKdG8gcHVzaCB0aGUgZG1hLWJ1ZiBleHBvcnQgZG93biBpbnRvIHRoZSBk bWEgbGF5ZXIuIFRoZSBjb21tZW50IGZvcgphcm1fZG1hX2dldF9zZ3RhYmxlIGlzIGFsc28gbm90 IGEgcmVhbHkgY29uY2VybiwgYmVjYXVzZSBkbWEtYnVmIGFsc28KYWJzdHJhY3RzIGF3YXkgdGhl IGZsdXNoaW5nIChvciB3ZWxsIGlzIHN1cHBvc2VkIHRvKSwgc28gdGhlcmUgcmVhbGx5CnNob3Vs ZG4ndCBiZSBhbnlvbmUgY2FsbGluZyB0aGUgc3RyZWFtaW5nIGFwaXMgb24gdGhlIHJldHVybmVk IHNnIHRhYmxlLgpUaGF0J3Mgd2h5IGRtYS1idWYgZ2l2ZXMgeW91IGFuIHNnIHRhYmxlIHRoYXQn cyBtYXBwZWQgYWxyZWFkeS4KCj4gPiBJZiB0aGF0J3Mgbm90IGFjY2VwdGFibGUgdGhlbiBJIGd1 ZXNzIHdlIGNvdWxkIGdvIG92ZXIgdGhlIGVudGlyZSB0cmVlCj4gPiBhbmQgZnJvYiBhbGwgdGhl IGdwdSByZWxhdGVkIGNvZGUgdG8gc3dpdGNoIG92ZXIgdG8gYSBuZXcgc3RydWN0Cj4gPiBzZ190 YWJsZV9taWdodF9ub3RfYmVfc3RydWN0X3BhZ2VfYmFja2VkLCBpbmNsdWRpbmcgYWxsIHRoZSBv dGhlcgo+ID4gZnVuY3Rpb25zIHdlIGFkZGVkIG92ZXIgdGhlIHBhc3QgZmV3IHllYXJzIHRvIGl0 ZXJhdGUgb3ZlciBzZyB0YWJsZXMuCj4gPiBCdXQgc2VlbXMgc2xpZ2h0bHkgc2lsbHksIGdpdmVu IHRoYXQgc2cgdGFibGVzIHNlZW0gdG8gZG8gZXhhY3RseSB3aGF0Cj4gPiB3ZSBuZWVkLgo+IAo+ IEl0IGlzbid0IHNpbGx5LiAgV2Ugd2lsbCBoYXZlIHRvIGRvIHNvbWUgc3VyZ2VyeSBsaWtlIHRo YXQgYW55d2F5Cj4gYmVjYXVzZSB0aGUgY3VycmVudCBBUElzIGRvbid0IHdvcmsuICBTbyByZWxh eCwgc2l0IGJhY2sgYW5kIGNvbWUgdXAKPiB3aXRoIGFuIEFQSSB0aGF0IHNvbHZlcyB0aGUgZXhp c3RpbmcgaXNzdWVzIGFuZCBzZXJ2ZXMgdXMgd2VsbCBpbgo+IHRoZSBmdXR1cmUuCgpTbyB3ZSBz aG91bGQganVzdCBpbXBsZW1lbnQgYSBjb3B5IG9mIHNnIHRhYmxlIGZvciBkbWEtYnVmLCBzaW5j ZSBJIHN0aWxsCnRoaW5rIGl0IGRvZXMgZXhhY3RseSB3aGF0IHdlIG5lZWQgZm9yIGdwdXM/CgpZ ZXMgdGhlcmUncyBhIGJpdCBhIGxheWVyaW5nIHZpb2xhdGlvbiBpbnNvZmFyIHRoYXQgZHJpdmVy cyByZWFsbHkKc2hvdWxkbid0IGVhY2ggaGF2ZSB0aGVpciBvd24gY29weSBvZiAiaG93IGRvIEkg Y29udmVydCBhIHBpZWNlIG9mIGRtYQptZW1vcnkgaW50byAgZG1hLWJ1ZiIsIGJ1dCB0aGF0IGRv ZXNuJ3QgcmVuZGVyIHRoZSBpbnRlcmZhY2UgYSBiYWQgaWRlYS4KLURhbmllbAotLSAKRGFuaWVs IFZldHRlcgpTb2Z0d2FyZSBFbmdpbmVlciwgSW50ZWwgQ29ycG9yYXRpb24KaHR0cDovL2Jsb2cu ZmZ3bGwuY2gKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18K YW1kLWdmeCBtYWlsaW5nIGxpc3QKYW1kLWdmeEBsaXN0cy5mcmVlZGVza3RvcC5vcmcKaHR0cHM6 Ly9saXN0cy5mcmVlZGVza3RvcC5vcmcvbWFpbG1hbi9saXN0aW5mby9hbWQtZ2Z4Cg==