From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1754431AbeDTI64 (ORCPT ); Fri, 20 Apr 2018 04:58:56 -0400 Received: from mail-wr0-f177.google.com ([209.85.128.177]:44024 "EHLO mail-wr0-f177.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1754414AbeDTI6x (ORCPT ); Fri, 20 Apr 2018 04:58:53 -0400 X-Google-Smtp-Source: AIpwx4/Dxx+ht8lM9bB0ERSaiaWh37CezCcX+lp0uCGKyecll5yJ1Qwb57AoWUoYn34TVpiuJYPjUA== Reply-To: christian.koenig@amd.com Subject: Re: [PATCH 4/8] dma-buf: add peer2peer flag To: Christoph Hellwig , Jerome Glisse , =?UTF-8?Q?Christian_K=c3=b6nig?= , "moderated list:DMA BUFFER SHARING FRAMEWORK" , "open list:DMA BUFFER SHARING FRAMEWORK" , dri-devel , amd-gfx list , Linux Kernel Mailing List , Logan Gunthorpe , Dan Williams References: <20180325110000.2238-1-christian.koenig@amd.com> <20180325110000.2238-4-christian.koenig@amd.com> <20180329065753.GD3881@phenom.ffwll.local> <8b823458-8bdc-3217-572b-509a28aae742@gmail.com> <20180403090909.GN3881@phenom.ffwll.local> <20180403170645.GB5935@redhat.com> <20180403180832.GZ3881@phenom.ffwll.local> <20180416123937.GA9073@infradead.org> <20180419081657.GA16735@infradead.org> <20180420071312.GF31310@phenom.ffwll.local> From: =?UTF-8?Q?Christian_K=c3=b6nig?= Message-ID: <3e17afc5-7d6c-5795-07bd-f23e34cf8d4b@gmail.com> Date: Fri, 20 Apr 2018 10:58:50 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: <20180420071312.GF31310@phenom.ffwll.local> Content-Type: text/plain; charset=utf-8; format=flowed Content-Transfer-Encoding: 7bit Content-Language: en-US Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Am 20.04.2018 um 09:13 schrieb Daniel Vetter: > On Thu, Apr 19, 2018 at 01:16:57AM -0700, Christoph Hellwig wrote: >> On Mon, Apr 16, 2018 at 03:38:56PM +0200, Daniel Vetter wrote: >>> We've broken that assumption in i915 years ago. Not struct page backed >>> gpu memory is very real. >>> >>> Of course we'll never feed such a strange sg table to a driver which >>> doesn't understand it, but allowing sg_page == NULL works perfectly >>> fine. At least for gpu drivers. >> For GPU drivers on x86 with no dma coherency problems, sure. But not >> all the world is x86. We already have problems due to dmabugs use >> of the awkward get_sgtable interface (see the common on >> arm_dma_get_sgtable that I fully agree with), and doing this for memory >> that doesn't have a struct page at all will make things even worse. > x86 dma isn't coherent either, if you're a GPU :-) Flushing gpu caches > tends to be too expensive, so there's pci-e support and chipset support to > forgo it. Plus drivers flushing caches themselves. > > The dma_get_sgtable thing is indeed fun, right solution would probably be > to push the dma-buf export down into the dma layer. The comment for > arm_dma_get_sgtable is also not a realy concern, because dma-buf also > abstracts away the flushing (or well is supposed to), so there really > shouldn't be anyone calling the streaming apis on the returned sg table. > That's why dma-buf gives you an sg table that's mapped already. > >>> If that's not acceptable then I guess we could go over the entire tree >>> and frob all the gpu related code to switch over to a new struct >>> sg_table_might_not_be_struct_page_backed, including all the other >>> functions we added over the past few years to iterate over sg tables. >>> But seems slightly silly, given that sg tables seem to do exactly what >>> we need. >> It isn't silly. We will have to do some surgery like that anyway >> because the current APIs don't work. So relax, sit back and come up >> with an API that solves the existing issues and serves us well in >> the future. > So we should just implement a copy of sg table for dma-buf, since I still > think it does exactly what we need for gpus? > > Yes there's a bit a layering violation insofar that drivers really > shouldn't each have their own copy of "how do I convert a piece of dma > memory into dma-buf", but that doesn't render the interface a bad idea. Completely agree on that. What we need is an sg_alloc_table_from_resources(dev, resources, num_resources) which does the handling common to all drivers. Christian. > -Daniel From mboxrd@z Thu Jan 1 00:00:00 1970 From: =?UTF-8?Q?Christian_K=c3=b6nig?= Subject: Re: [PATCH 4/8] dma-buf: add peer2peer flag Date: Fri, 20 Apr 2018 10:58:50 +0200 Message-ID: <3e17afc5-7d6c-5795-07bd-f23e34cf8d4b@gmail.com> References: <20180325110000.2238-1-christian.koenig@amd.com> <20180325110000.2238-4-christian.koenig@amd.com> <20180329065753.GD3881@phenom.ffwll.local> <8b823458-8bdc-3217-572b-509a28aae742@gmail.com> <20180403090909.GN3881@phenom.ffwll.local> <20180403170645.GB5935@redhat.com> <20180403180832.GZ3881@phenom.ffwll.local> <20180416123937.GA9073@infradead.org> <20180419081657.GA16735@infradead.org> <20180420071312.GF31310@phenom.ffwll.local> Reply-To: christian.koenig-5C7GfCeVMHo@public.gmane.org Mime-Version: 1.0 Content-Type: text/plain; charset="utf-8"; Format="flowed" Content-Transfer-Encoding: base64 Return-path: In-Reply-To: <20180420071312.GF31310-dv86pmgwkMBes7Z6vYuT8azUEOm+Xw19@public.gmane.org> Content-Language: en-US List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: amd-gfx-bounces-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org Sender: "amd-gfx" To: Christoph Hellwig , Jerome Glisse , =?UTF-8?Q?Christian_K=c3=b6nig?= , "moderated list:DMA BUFFER SHARING FRAMEWORK" , "open list:DMA BUFFER SHARING FRAMEWORK" , dri-devel , amd-gfx list , Linux Kernel Mailing List , Logan Gunthorpe , Dan Williams List-Id: dri-devel@lists.freedesktop.org QW0gMjAuMDQuMjAxOCB1bSAwOToxMyBzY2hyaWViIERhbmllbCBWZXR0ZXI6Cj4gT24gVGh1LCBB cHIgMTksIDIwMTggYXQgMDE6MTY6NTdBTSAtMDcwMCwgQ2hyaXN0b3BoIEhlbGx3aWcgd3JvdGU6 Cj4+IE9uIE1vbiwgQXByIDE2LCAyMDE4IGF0IDAzOjM4OjU2UE0gKzAyMDAsIERhbmllbCBWZXR0 ZXIgd3JvdGU6Cj4+PiBXZSd2ZSBicm9rZW4gdGhhdCBhc3N1bXB0aW9uIGluIGk5MTUgeWVhcnMg YWdvLiBOb3Qgc3RydWN0IHBhZ2UgYmFja2VkCj4+PiBncHUgbWVtb3J5IGlzIHZlcnkgcmVhbC4K Pj4+Cj4+PiBPZiBjb3Vyc2Ugd2UnbGwgbmV2ZXIgZmVlZCBzdWNoIGEgc3RyYW5nZSBzZyB0YWJs ZSB0byBhIGRyaXZlciB3aGljaAo+Pj4gZG9lc24ndCB1bmRlcnN0YW5kIGl0LCBidXQgYWxsb3dp bmcgc2dfcGFnZSA9PSBOVUxMIHdvcmtzIHBlcmZlY3RseQo+Pj4gZmluZS4gQXQgbGVhc3QgZm9y IGdwdSBkcml2ZXJzLgo+PiBGb3IgR1BVIGRyaXZlcnMgb24geDg2IHdpdGggbm8gZG1hIGNvaGVy ZW5jeSBwcm9ibGVtcywgc3VyZS4gIEJ1dCBub3QKPj4gYWxsIHRoZSB3b3JsZCBpcyB4ODYuICBX ZSBhbHJlYWR5IGhhdmUgcHJvYmxlbXMgZHVlIHRvIGRtYWJ1Z3MgdXNlCj4+IG9mIHRoZSBhd2t3 YXJkIGdldF9zZ3RhYmxlIGludGVyZmFjZSAoc2VlIHRoZSBjb21tb24gb24KPj4gYXJtX2RtYV9n ZXRfc2d0YWJsZSB0aGF0IEkgZnVsbHkgYWdyZWUgd2l0aCksIGFuZCBkb2luZyB0aGlzIGZvciBt ZW1vcnkKPj4gdGhhdCBkb2Vzbid0IGhhdmUgYSBzdHJ1Y3QgcGFnZSBhdCBhbGwgd2lsbCBtYWtl IHRoaW5ncyBldmVuIHdvcnNlLgo+IHg4NiBkbWEgaXNuJ3QgY29oZXJlbnQgZWl0aGVyLCBpZiB5 b3UncmUgYSBHUFUgOi0pIEZsdXNoaW5nIGdwdSBjYWNoZXMKPiB0ZW5kcyB0byBiZSB0b28gZXhw ZW5zaXZlLCBzbyB0aGVyZSdzIHBjaS1lIHN1cHBvcnQgYW5kIGNoaXBzZXQgc3VwcG9ydCB0bwo+ IGZvcmdvIGl0LiBQbHVzIGRyaXZlcnMgZmx1c2hpbmcgY2FjaGVzIHRoZW1zZWx2ZXMuCj4KPiBU aGUgZG1hX2dldF9zZ3RhYmxlIHRoaW5nIGlzIGluZGVlZCBmdW4sIHJpZ2h0IHNvbHV0aW9uIHdv dWxkIHByb2JhYmx5IGJlCj4gdG8gcHVzaCB0aGUgZG1hLWJ1ZiBleHBvcnQgZG93biBpbnRvIHRo ZSBkbWEgbGF5ZXIuIFRoZSBjb21tZW50IGZvcgo+IGFybV9kbWFfZ2V0X3NndGFibGUgaXMgYWxz byBub3QgYSByZWFseSBjb25jZXJuLCBiZWNhdXNlIGRtYS1idWYgYWxzbwo+IGFic3RyYWN0cyBh d2F5IHRoZSBmbHVzaGluZyAob3Igd2VsbCBpcyBzdXBwb3NlZCB0byksIHNvIHRoZXJlIHJlYWxs eQo+IHNob3VsZG4ndCBiZSBhbnlvbmUgY2FsbGluZyB0aGUgc3RyZWFtaW5nIGFwaXMgb24gdGhl IHJldHVybmVkIHNnIHRhYmxlLgo+IFRoYXQncyB3aHkgZG1hLWJ1ZiBnaXZlcyB5b3UgYW4gc2cg dGFibGUgdGhhdCdzIG1hcHBlZCBhbHJlYWR5Lgo+Cj4+PiBJZiB0aGF0J3Mgbm90IGFjY2VwdGFi bGUgdGhlbiBJIGd1ZXNzIHdlIGNvdWxkIGdvIG92ZXIgdGhlIGVudGlyZSB0cmVlCj4+PiBhbmQg ZnJvYiBhbGwgdGhlIGdwdSByZWxhdGVkIGNvZGUgdG8gc3dpdGNoIG92ZXIgdG8gYSBuZXcgc3Ry dWN0Cj4+PiBzZ190YWJsZV9taWdodF9ub3RfYmVfc3RydWN0X3BhZ2VfYmFja2VkLCBpbmNsdWRp bmcgYWxsIHRoZSBvdGhlcgo+Pj4gZnVuY3Rpb25zIHdlIGFkZGVkIG92ZXIgdGhlIHBhc3QgZmV3 IHllYXJzIHRvIGl0ZXJhdGUgb3ZlciBzZyB0YWJsZXMuCj4+PiBCdXQgc2VlbXMgc2xpZ2h0bHkg c2lsbHksIGdpdmVuIHRoYXQgc2cgdGFibGVzIHNlZW0gdG8gZG8gZXhhY3RseSB3aGF0Cj4+PiB3 ZSBuZWVkLgo+PiBJdCBpc24ndCBzaWxseS4gIFdlIHdpbGwgaGF2ZSB0byBkbyBzb21lIHN1cmdl cnkgbGlrZSB0aGF0IGFueXdheQo+PiBiZWNhdXNlIHRoZSBjdXJyZW50IEFQSXMgZG9uJ3Qgd29y ay4gIFNvIHJlbGF4LCBzaXQgYmFjayBhbmQgY29tZSB1cAo+PiB3aXRoIGFuIEFQSSB0aGF0IHNv bHZlcyB0aGUgZXhpc3RpbmcgaXNzdWVzIGFuZCBzZXJ2ZXMgdXMgd2VsbCBpbgo+PiB0aGUgZnV0 dXJlLgo+IFNvIHdlIHNob3VsZCBqdXN0IGltcGxlbWVudCBhIGNvcHkgb2Ygc2cgdGFibGUgZm9y IGRtYS1idWYsIHNpbmNlIEkgc3RpbGwKPiB0aGluayBpdCBkb2VzIGV4YWN0bHkgd2hhdCB3ZSBu ZWVkIGZvciBncHVzPwo+Cj4gWWVzIHRoZXJlJ3MgYSBiaXQgYSBsYXllcmluZyB2aW9sYXRpb24g aW5zb2ZhciB0aGF0IGRyaXZlcnMgcmVhbGx5Cj4gc2hvdWxkbid0IGVhY2ggaGF2ZSB0aGVpciBv d24gY29weSBvZiAiaG93IGRvIEkgY29udmVydCBhIHBpZWNlIG9mIGRtYQo+IG1lbW9yeSBpbnRv ICBkbWEtYnVmIiwgYnV0IHRoYXQgZG9lc24ndCByZW5kZXIgdGhlIGludGVyZmFjZSBhIGJhZCBp ZGVhLgoKQ29tcGxldGVseSBhZ3JlZSBvbiB0aGF0LgoKV2hhdCB3ZSBuZWVkIGlzIGFuIHNnX2Fs bG9jX3RhYmxlX2Zyb21fcmVzb3VyY2VzKGRldiwgcmVzb3VyY2VzLCAKbnVtX3Jlc291cmNlcykg d2hpY2ggZG9lcyB0aGUgaGFuZGxpbmcgY29tbW9uIHRvIGFsbCBkcml2ZXJzLgoKQ2hyaXN0aWFu LgoKPiAtRGFuaWVsCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fXwphbWQtZ2Z4IG1haWxpbmcgbGlzdAphbWQtZ2Z4QGxpc3RzLmZyZWVkZXNrdG9wLm9yZwpo dHRwczovL2xpc3RzLmZyZWVkZXNrdG9wLm9yZy9tYWlsbWFuL2xpc3RpbmZvL2FtZC1nZngK