From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752401AbaEBSfF (ORCPT ); Fri, 2 May 2014 14:35:05 -0400 Received: from mail-ie0-f170.google.com ([209.85.223.170]:38103 "EHLO mail-ie0-f170.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1751965AbaEBSfB (ORCPT ); Fri, 2 May 2014 14:35:01 -0400 Date: Fri, 2 May 2014 12:34:58 -0600 From: Bjorn Helgaas To: James Bottomley Cc: "rdunlap@infradead.org" , "linux-pci@vger.kernel.org" , "gregkh@linuxfoundation.org" , "arnd@arndb.de" , "linux-doc@vger.kernel.org" , "linux-kernel@vger.kernel.org" , Magnus Damm Subject: Re: [PATCH] DMA-API: Change dma_declare_coherent_memory() CPU address to phys_addr_t Message-ID: <20140502183458.GB29511@google.com> References: <20140430203321.30056.14833.stgit@bhelgaas-glaptop.roam.corp.google.com> <1398953290.2313.15.camel@dabdike.int.hansenpartnership.com> <1399011100.2174.45.camel@dabdike> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <1399011100.2174.45.camel@dabdike> User-Agent: Mutt/1.5.21 (2010-09-15) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org [+cc Magnus] On Fri, May 02, 2014 at 06:11:42AM +0000, James Bottomley wrote: > On Thu, 2014-05-01 at 13:05 -0600, Bjorn Helgaas wrote: > > On Thu, May 1, 2014 at 8:08 AM, James Bottomley > > wrote: > > > On Wed, 2014-04-30 at 14:33 -0600, Bjorn Helgaas wrote: > > >> dma_declare_coherent_memory() takes two addresses for a region of memory: a > > >> "bus_addr" and a "device_addr". I think the intent is that "bus_addr" is > > >> the physical address a *CPU* would use to access the region, and > > >> "device_addr" is the bus address the *device* would use to address the > > >> region. > > >> > > >> Rename "bus_addr" to "phys_addr" and change its type to phys_addr_t. > > > > > > Remind me what the difference between phys_addr_t and dma_addr_t are. > > > > > > I thought phys_addr_t was the maximum address the CPU could reach after > > > address translation and dma_addr_t was the maximum physical address any > > > bus attached memory mapped devices could appear at. (of course, mostly > > > they're the same). > > > > I assumed phys_addr_t was for physical addresses generated by a CPU > > and dma_addr_t was for addresses generated by a device, e.g., > > addresses you would see with a PCI bus analyzer or in a PCI BAR. But > > ARCH_DMA_ADDR_T_64BIT does seem more connected to processor-specific > > things, e.g., ARM_LPAE, than to device bus properties like "support > > 64-bit PCI, not just 32-bit PCI." > > OK, but even in your definition dma_declare_coherent_memory() should > operate on dma_addr_t because the input is a region of memory you got > from the device. Somehow you generate and idea from the device > configuration of where this piece of memory sits on the device and > that's what you feed into dma_declare_coherent_memory(). It maps that > region and makes it available to the CPU allocators. The device configuration tells you where the region is on the bus. To find the corresponding CPU physical address, we have to know about any address translation performed by the host bridge. That's a bus- specific concept, so maybe it belongs in the driver. The only user of dma_declare_coherent_memory() on a PCI device is gapspci_fixup_resources(), so we could leave dma_declare_coherent_memory() alone and do something like this: - dma_declare_coherent_memory(&dev->dev, GAPSPCI_DMA_BASE, GAPSPCI_DMA_BASE, + struct pci_bus_region region; + struct resource res; + region.start = GAPSPCI_DMA_BASE; + region.end = GAPSPCI_DMA_BASE + GAPSPCI_DMA_SIZE - 1; + pcibios_bus_to_resource(dev->bus, &res, ®ion); + dma_declare_coherent_memory(&dev->dev, res->start, GAPSPCI_DMA_BASE, But res->size is a resource_size_t, which is the same as phys_addr_t and theoretically might not fit in dma_addr_t. If we had some generic way of doing pcibios_bus_to_resource(), we could pass just a single address (the current "device_addr") and compute the CPU physical address inside dma_declare_coherent_memory(). The other users implicitly assume the CPU physical address is the same as the bus address. I'm a little uneasy because I assume it's possible to have a platform_device behind an address-translating bridge, too. But maybe nobody actually does that. Bjorn