From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by smtp.lore.kernel.org (Postfix) with ESMTP id A24B1C433FE for ; Tue, 15 Feb 2022 17:43:51 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S242653AbiBORoA convert rfc822-to-8bit (ORCPT ); Tue, 15 Feb 2022 12:44:00 -0500 Received: from mxb-00190b01.gslb.pphosted.com ([23.128.96.19]:35366 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S229508AbiBORn7 (ORCPT ); Tue, 15 Feb 2022 12:43:59 -0500 Received: from aposti.net (aposti.net [89.234.176.197]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id 4BF77E5406; Tue, 15 Feb 2022 09:43:48 -0800 (PST) Date: Tue, 15 Feb 2022 17:43:35 +0000 From: Paul Cercueil Subject: Re: [PATCH v2 00/12] iio: buffer-dma: write() and new DMABUF based API To: Jonathan Cameron Cc: Michael Hennerich , Lars-Peter Clausen , Christian =?iso-8859-1?b?S/ZuaWc=?= , Sumit Semwal , Jonathan Corbet , Alexandru Ardelean , dri-devel@lists.freedesktop.org, linaro-mm-sig@lists.linaro.org, linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, linux-iio@vger.kernel.org Message-Id: In-Reply-To: <20220213184616.669b490b@jic23-huawei> References: <20220207125933.81634-1-paul@crapouillou.net> <20220213184616.669b490b@jic23-huawei> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-13; format=flowed Content-Transfer-Encoding: 8BIT Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Jonathan, Le dim., févr. 13 2022 at 18:46:16 +0000, Jonathan Cameron a écrit : > On Mon, 7 Feb 2022 12:59:21 +0000 > Paul Cercueil wrote: > >> Hi Jonathan, >> >> This is the V2 of my patchset that introduces a new userspace >> interface >> based on DMABUF objects to complement the fileio API, and adds >> write() >> support to the existing fileio API. > > Hi Paul, > > It's been a little while. Perhaps you could summarize the various view > points around the appropriateness of using DMABUF for this? > I appreciate it is a tricky topic to distil into a brief summary but > I know I would find it useful even if no one else does! So we want to have a high-speed interface where buffers of samples are passed around between IIO devices and other devices (e.g. USB or network), or made available to userspace without copying the data. DMABUF is, at least in theory, exactly what we need. Quoting the documentation (https://www.kernel.org/doc/html/v5.15/driver-api/dma-buf.html): "The dma-buf subsystem provides the framework for sharing buffers for hardware (DMA) access across multiple device drivers and subsystems, and for synchronizing asynchronous hardware access. This is used, for example, by drm ´prime¡ multi-GPU support, but is of course not limited to GPU use cases." The problem is that right now DMABUF is only really used by DRM, and to quote Daniel, "dma-buf looks like something super generic and useful, until you realize that there's a metric ton of gpu/accelerator bagage piled in". Still, it seems to be the only viable option. We could add a custom buffer-passing interface, but that would mean implementing the same buffer-passing interface on the network and USB stacks, and before we know it we re-invented DMABUFs. Cheers, -Paul >> >> Changes since v1: >> >> - the patches that were merged in v1 have been (obviously) dropped >> from >> this patchset; >> - the patch that was setting the write-combine cache setting has >> been >> dropped as well, as it was simply not useful. >> - [01/12]: >> * Only remove the outgoing queue, and keep the incoming queue, >> as we >> want the buffer to start streaming data as soon as it is >> enabled. >> * Remove IIO_BLOCK_STATE_DEQUEUED, since it is now functionally >> the >> same as IIO_BLOCK_STATE_DONE. >> - [02/12]: >> * Fix block->state not being reset in >> iio_dma_buffer_request_update() for output buffers. >> * Only update block->bytes_used once and add a comment about >> why we >> update it. >> * Add a comment about why we're setting a different state for >> output >> buffers in iio_dma_buffer_request_update() >> * Remove useless cast to bool (!!) in iio_dma_buffer_io() >> - [05/12]: >> Only allow the new IOCTLs on the buffer FD created with >> IIO_BUFFER_GET_FD_IOCTL(). >> - [12/12]: >> * Explicitly state that the new interface is optional and is >> not implemented by all drivers. >> * The IOCTLs can now only be called on the buffer FD returned by >> IIO_BUFFER_GET_FD_IOCTL. >> * Move the page up a bit in the index since it is core stuff >> and not >> driver-specific. >> >> The patches not listed here have not been modified since v1. >> >> Cheers, >> -Paul >> >> Alexandru Ardelean (1): >> iio: buffer-dma: split iio_dma_buffer_fileio_free() function >> >> Paul Cercueil (11): >> iio: buffer-dma: Get rid of outgoing queue >> iio: buffer-dma: Enable buffer write support >> iio: buffer-dmaengine: Support specifying buffer direction >> iio: buffer-dmaengine: Enable write support >> iio: core: Add new DMABUF interface infrastructure >> iio: buffer-dma: Use DMABUFs instead of custom solution >> iio: buffer-dma: Implement new DMABUF based userspace API >> iio: buffer-dmaengine: Support new DMABUF based userspace API >> iio: core: Add support for cyclic buffers >> iio: buffer-dmaengine: Add support for cyclic buffers >> Documentation: iio: Document high-speed DMABUF based API >> >> Documentation/driver-api/dma-buf.rst | 2 + >> Documentation/iio/dmabuf_api.rst | 94 +++ >> Documentation/iio/index.rst | 2 + >> drivers/iio/adc/adi-axi-adc.c | 3 +- >> drivers/iio/buffer/industrialio-buffer-dma.c | 610 >> ++++++++++++++---- >> .../buffer/industrialio-buffer-dmaengine.c | 42 +- >> drivers/iio/industrialio-buffer.c | 60 ++ >> include/linux/iio/buffer-dma.h | 38 +- >> include/linux/iio/buffer-dmaengine.h | 5 +- >> include/linux/iio/buffer_impl.h | 8 + >> include/uapi/linux/iio/buffer.h | 30 + >> 11 files changed, 749 insertions(+), 145 deletions(-) >> create mode 100644 Documentation/iio/dmabuf_api.rst >> > From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from gabe.freedesktop.org (gabe.freedesktop.org [131.252.210.177]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by smtp.lore.kernel.org (Postfix) with ESMTPS id 9F7B3C433EF for ; Tue, 15 Feb 2022 17:43:49 +0000 (UTC) Received: from gabe.freedesktop.org (localhost [127.0.0.1]) by gabe.freedesktop.org (Postfix) with ESMTP id 9680210E520; Tue, 15 Feb 2022 17:43:48 +0000 (UTC) Received: from aposti.net (aposti.net [89.234.176.197]) by gabe.freedesktop.org (Postfix) with ESMTPS id A186A10E48B for ; Tue, 15 Feb 2022 17:43:47 +0000 (UTC) Date: Tue, 15 Feb 2022 17:43:35 +0000 From: Paul Cercueil Subject: Re: [PATCH v2 00/12] iio: buffer-dma: write() and new DMABUF based API To: Jonathan Cameron Message-Id: In-Reply-To: <20220213184616.669b490b@jic23-huawei> References: <20220207125933.81634-1-paul@crapouillou.net> <20220213184616.669b490b@jic23-huawei> MIME-Version: 1.0 Content-Type: text/plain; charset=iso-8859-13; format=flowed Content-Transfer-Encoding: quoted-printable X-BeenThere: dri-devel@lists.freedesktop.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: Direct Rendering Infrastructure - Development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Cc: Michael Hennerich , Jonathan Corbet , linux-iio@vger.kernel.org, linux-doc@vger.kernel.org, linux-kernel@vger.kernel.org, dri-devel@lists.freedesktop.org, Sumit Semwal , linaro-mm-sig@lists.linaro.org, Alexandru Ardelean , Christian =?iso-8859-1?b?S/ZuaWc=?= Errors-To: dri-devel-bounces@lists.freedesktop.org Sender: "dri-devel" Hi Jonathan, Le dim., f=E9vr. 13 2022 at 18:46:16 +0000, Jonathan Cameron=20 a =E9crit : > On Mon, 7 Feb 2022 12:59:21 +0000 > Paul Cercueil wrote: >=20 >> Hi Jonathan, >>=20 >> This is the V2 of my patchset that introduces a new userspace=20 >> interface >> based on DMABUF objects to complement the fileio API, and adds=20 >> write() >> support to the existing fileio API. >=20 > Hi Paul, >=20 > It's been a little while. Perhaps you could summarize the various view > points around the appropriateness of using DMABUF for this? > I appreciate it is a tricky topic to distil into a brief summary but > I know I would find it useful even if no one else does! So we want to have a high-speed interface where buffers of samples are=20 passed around between IIO devices and other devices (e.g. USB or=20 network), or made available to userspace without copying the data. DMABUF is, at least in theory, exactly what we need. Quoting the=20 documentation=20 (https://www.kernel.org/doc/html/v5.15/driver-api/dma-buf.html): "The dma-buf subsystem provides the framework for sharing buffers for=20 hardware (DMA) access across multiple device drivers and subsystems,=20 and for synchronizing asynchronous hardware access. This is used, for=20 example, by drm =B4prime=A1 multi-GPU support, but is of course not=20 limited to GPU use cases." The problem is that right now DMABUF is only really used by DRM, and to=20 quote Daniel, "dma-buf looks like something super generic and useful,=20 until you realize that there's a metric ton of gpu/accelerator bagage=20 piled in". Still, it seems to be the only viable option. We could add a custom=20 buffer-passing interface, but that would mean implementing the same=20 buffer-passing interface on the network and USB stacks, and before we=20 know it we re-invented DMABUFs. Cheers, -Paul >>=20 >> Changes since v1: >>=20 >> - the patches that were merged in v1 have been (obviously) dropped=20 >> from >> this patchset; >> - the patch that was setting the write-combine cache setting has=20 >> been >> dropped as well, as it was simply not useful. >> - [01/12]: >> * Only remove the outgoing queue, and keep the incoming queue,=20 >> as we >> want the buffer to start streaming data as soon as it is=20 >> enabled. >> * Remove IIO_BLOCK_STATE_DEQUEUED, since it is now functionally=20 >> the >> same as IIO_BLOCK_STATE_DONE. >> - [02/12]: >> * Fix block->state not being reset in >> iio_dma_buffer_request_update() for output buffers. >> * Only update block->bytes_used once and add a comment about=20 >> why we >> update it. >> * Add a comment about why we're setting a different state for=20 >> output >> buffers in iio_dma_buffer_request_update() >> * Remove useless cast to bool (!!) in iio_dma_buffer_io() >> - [05/12]: >> Only allow the new IOCTLs on the buffer FD created with >> IIO_BUFFER_GET_FD_IOCTL(). >> - [12/12]: >> * Explicitly state that the new interface is optional and is >> not implemented by all drivers. >> * The IOCTLs can now only be called on the buffer FD returned by >> IIO_BUFFER_GET_FD_IOCTL. >> * Move the page up a bit in the index since it is core stuff=20 >> and not >> driver-specific. >>=20 >> The patches not listed here have not been modified since v1. >>=20 >> Cheers, >> -Paul >>=20 >> Alexandru Ardelean (1): >> iio: buffer-dma: split iio_dma_buffer_fileio_free() function >>=20 >> Paul Cercueil (11): >> iio: buffer-dma: Get rid of outgoing queue >> iio: buffer-dma: Enable buffer write support >> iio: buffer-dmaengine: Support specifying buffer direction >> iio: buffer-dmaengine: Enable write support >> iio: core: Add new DMABUF interface infrastructure >> iio: buffer-dma: Use DMABUFs instead of custom solution >> iio: buffer-dma: Implement new DMABUF based userspace API >> iio: buffer-dmaengine: Support new DMABUF based userspace API >> iio: core: Add support for cyclic buffers >> iio: buffer-dmaengine: Add support for cyclic buffers >> Documentation: iio: Document high-speed DMABUF based API >>=20 >> Documentation/driver-api/dma-buf.rst | 2 + >> Documentation/iio/dmabuf_api.rst | 94 +++ >> Documentation/iio/index.rst | 2 + >> drivers/iio/adc/adi-axi-adc.c | 3 +- >> drivers/iio/buffer/industrialio-buffer-dma.c | 610=20 >> ++++++++++++++---- >> .../buffer/industrialio-buffer-dmaengine.c | 42 +- >> drivers/iio/industrialio-buffer.c | 60 ++ >> include/linux/iio/buffer-dma.h | 38 +- >> include/linux/iio/buffer-dmaengine.h | 5 +- >> include/linux/iio/buffer_impl.h | 8 + >> include/uapi/linux/iio/buffer.h | 30 + >> 11 files changed, 749 insertions(+), 145 deletions(-) >> create mode 100644 Documentation/iio/dmabuf_api.rst >>=20 >=20