From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id E6845C433F5 for ; Tue, 19 Oct 2021 18:06:01 +0000 (UTC) Received: from bombadil.infradead.org (bombadil.infradead.org [198.137.202.133]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPS id 9F9FA6135F for ; Tue, 19 Oct 2021 18:06:01 +0000 (UTC) DMARC-Filter: OpenDMARC Filter v1.4.1 mail.kernel.org 9F9FA6135F Authentication-Results: mail.kernel.org; dmarc=none (p=none dis=none) header.from=vanguardiasur.com.ar Authentication-Results: mail.kernel.org; spf=none smtp.mailfrom=lists.infradead.org DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.infradead.org; s=bombadil.20210309; h=Sender: Content-Transfer-Encoding:Content-Type:List-Subscribe:List-Help:List-Post: List-Archive:List-Unsubscribe:List-Id:Cc:To:Subject:Message-ID:Date:From: In-Reply-To:References:MIME-Version:Reply-To:Content-ID:Content-Description: Resent-Date:Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID: List-Owner; bh=6W579f/r7feOUPtpFlhdw8ngcY9eldpoKBu3F2sFHMQ=; b=w0o73GggUP4odq cysgVUoBVBiZ+M4demcuptd+/qapUedXqjAbUS9xGep2yHcuH5B9vyK+b95yOg+/Y5qkhY+L+Zr77 hBzL8p03J0grkGdxrGEalNU6CWvy48ebH0OtFPZO+7mnFZvqzEfB4YajolxhvC0OUfPCQAKSir8ud yaluL8OVM0BE2Z1qDR7udc8O9O5Ma63eF7502TFjxAULwZ1B7cydN5UUSFZxSYqXW88UlqzNo3r31 vWUp28ObEd6+alBYmjn4mKBgsvCgL5aCw7qN9EtQefftjZ5QCZD2z8PYQeDFe/2JAYxsaKWkLMMBc 8c7hcK2wtwOexIVlBEqw==; Received: from localhost ([::1] helo=bombadil.infradead.org) by bombadil.infradead.org with esmtp (Exim 4.94.2 #2 (Red Hat Linux)) id 1mctSi-002LEd-JM; Tue, 19 Oct 2021 18:03:45 +0000 Received: from mail-ed1-x533.google.com ([2a00:1450:4864:20::533]) by bombadil.infradead.org with esmtps (Exim 4.94.2 #2 (Red Hat Linux)) id 1mctL5-002Hvk-DL for linux-arm-kernel@lists.infradead.org; Tue, 19 Oct 2021 17:55:53 +0000 Received: by mail-ed1-x533.google.com with SMTP id t16so16032491eds.9 for ; Tue, 19 Oct 2021 10:55:49 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=vanguardiasur-com-ar.20210112.gappssmtp.com; s=20210112; h=mime-version:references:in-reply-to:from:date:message-id:subject:to :cc; bh=PXb52J6hd7BomyN/PmEWdejyn+jCuQ3g/t9Vn3q/0lw=; b=d+xL8PP56n6UdZKFTacrQjs8kaEuxkY9aLVPXq3DnxZBm3XH+QS2qmXxOU6cbZNyBa m29jK9EZLHz4ahgQXf7HE0aWI7F+IovrEAdF+7KWAWULGJ+V4eq/UTd6eL61M0wSEJNo q61PK6jfIXr6vzFGDWGON82eDZjmy7xuG9yf/M2dJTog4+8C9TqoASbRtjDHwBHfmr/b GNuCHfoJ3H10DvfiGkdu3C3g4dDPpb8D4oZe2C8tg2zlXtvUKBuymytmlQSbBd2DI6Em 2+e1JsPtysGHykjUe4/EIKgfvNYNyTi91v0lRG5Bqs3poOApdLWANOElOePpGFq+7ESu BFYA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20210112; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to:cc; bh=PXb52J6hd7BomyN/PmEWdejyn+jCuQ3g/t9Vn3q/0lw=; b=K+Q6hxOMjr5UZLYgKuyrg80yqP/k0OWmT94R474XYHlyBC5Q3ARpUByXeHqT+mvd6f tVc7JLc2QBw0qoqdR+8Mi+mwO8n7OHpjQAMxxz65/VykHtmWGhMxprbig0/P6JApPwl9 SL+cKZyctqYWUWNZB+fvip+wj6AEtOv+etUivWDYCA2QbTcZmDd+eawnifEzjX5YAOBe KQOzC6kr6kvF3IJDDaMUqGLhX4J4kEJg0CaYOQjcF3xidGwQZmddA8WsgP3+AQLTn/Oo QK83yk6rwpcvgqGsP+uFhLtDyIogvgEeDj13t6uIg4nSesv+ZInyjTc7kjmOYN5YHS18 V9vA== X-Gm-Message-State: AOAM533G68ZtWEVKIziCJsNx3SVxjYHe9h2ooLg5paN939k+K/VKfsyg px9sCVta9C8Ek1OBCcoRY57cppj2AMsN87w5eBntuA== X-Google-Smtp-Source: ABdhPJxtangUHUcDocBPElcYQS9Fixn3Yfl5F0okILILSk35Cn5QwVN+Lv1aOo4WOQ5Jz+AapqExQS1mtgdftoIR+vg= X-Received: by 2002:a17:906:b782:: with SMTP id dt2mr41003181ejb.310.1634666148180; Tue, 19 Oct 2021 10:55:48 -0700 (PDT) MIME-Version: 1.0 References: <20210929160439.6601-1-andrzej.p@collabora.com> In-Reply-To: <20210929160439.6601-1-andrzej.p@collabora.com> From: Ezequiel Garcia Date: Tue, 19 Oct 2021 13:55:36 -0400 Message-ID: Subject: Re: [PATCH v7 00/11] VP9 codec V4L2 control interface To: Andrzej Pietrasiewicz , Jernej Skrabec , Nicolas Dufresne , Daniel Almeida Cc: linux-media , linux-arm-kernel , Linux Kernel Mailing List , "open list:ARM/Rockchip SoC..." , "open list:STAGING SUBSYSTEM" , Benjamin Gaignard , Boris Brezillon , Fabio Estevam , Greg Kroah-Hartman , Hans Verkuil , Heiko Stuebner , Mauro Carvalho Chehab , NXP Linux Team , Pengutronix Kernel Team , Philipp Zabel , Sascha Hauer , Shawn Guo , Collabora Kernel ML X-CRM114-Version: 20100106-BlameMichelson ( TRE 0.8.0 (BSD) ) MR-646709E3 X-CRM114-CacheID: sfid-20211019_105551_615268_1065CB18 X-CRM114-Status: GOOD ( 38.27 ) X-BeenThere: linux-arm-kernel@lists.infradead.org X-Mailman-Version: 2.1.34 Precedence: list List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: "linux-arm-kernel" Errors-To: linux-arm-kernel-bounces+linux-arm-kernel=archiver.kernel.org@lists.infradead.org Hi everyone, On Wed, 29 Sept 2021 at 12:04, Andrzej Pietrasiewicz wrote: > > Dear all, > > This patch series adds VP9 codec V4L2 control interface and two drivers > using the new controls. It is a follow-up of previous v6 series [1]. > > In this iteration, we've implemented VP9 hardware decoding on two devices: > Rockchip VDEC and Hantro G2, and tested on RK3399, i.MX8MQ and i.MX8MP. > The i.MX8M driver needs proper power domains support, though, which is a > subject of a different effort, but in all 3 cases we were able to run the > drivers. > > GStreamer support is also available, the needed changes have been submitted > by Daniel Almeida [2]. This MR is ready to be merged, and just needs the > VP9 V4L2 controls to be merged and released. > > Both rkvdec and hantro drivers are passing a significant number of VP9 tests > using Fluster[3]. There are still a few tests that are not passing, due to > dynamic frame resize (not yet supported by V4L2) and small size videos > (due to IP block limitations). > > The series adds the VP9 codec V4L2 control API as uAPI, so it aims at being > merged without passing through staging, as agreed[4]. The ABI has been checked > for padding and verified to contain no holes. > I took another look at this, and I'm fairly happy with it. I'd just like to have an A-b or R-b from Nicolas Dufresne and Daniel Almeida, given they've done a lot of work on the client side of the API. Another option would be to wait until Jernej finishes the work on Allwinner H6, so we have another hardware supported. Thanks, Ezequiel > [1] https://patchwork.linuxtv.org/project/linux-media/list/?series=6377 > [2] https://gitlab.freedesktop.org/gstreamer/gst-plugins-bad/-/merge_requests/2144 > [3] https://github.com/fluendo/fluster > [4] https://lore.kernel.org/linux-media/b8f83c93-67fd-09f5-9314-15746cbfdc61@xs4all.nl/ > > The series depends on the YUV tiled format support prepared by Ezequiel: > https://www.spinics.net/lists/linux-media/msg197047.html > > Rebased onto latest media_tree. > > Changes related to v6: > - moved setting tile filter and tile bsd auxiliary buffer addresses so > that they are always set, even if no tiles are used (thanks, Jernej) > - added a comment near the place where the 32-bit DMA mask is applied > (thanks, Nicolas) > - improved consistency in register names (thanks, Nicolas) > > Changes related to v5: > - improved the doc comments as per Ezequiel's review (thanks, Ezequiel) > - improved pdf output of documentation > - added Benjamin's Reviewed-by (thanks, Benjamin) > > Changes related to v4: > - removed unused enum v4l2_vp9_intra_prediction_mode > - converted remaining enums to defines to follow the convention > - improved the documentation, in particular better documented how to use segmentation > features > > Changes related to v3: > > Apply suggestions from Jernej's review (thanks, Jernej): > - renamed a control and two structs: > V4L2_CTRL_TYPE_VP9_COMPRESSED_HDR_PROBS => > V4L2_CTRL_TYPE_VP9_COMPRESSED_HDR > v4l2_ctrl_vp9_compressed_hdr_probs => > v4l2_ctrl_vp9_compressed_hdr > v4l2_vp9_mv_compressed_hdr_probs => v4l2_vp9_mv_probs > - moved tx_mode to v4l2_ctrl_vp9_compressed_hdr > - fixed enum v4l2_vp9_ref_frame_sign_bias values (which are used to test a bitfield) > - explicitly assigned values to all other vp9 enums > > Apply suggestion from Nicolas's review (thanks, Nicolas): > - explicitly stated that the v4l2_ctrl_vp9_compressed_hdr control is optional > and implemented only by drivers which need it > > Changes related to the RFC v2: > > - added another driver including a postprocessor to de-tile > codec-specific tiling > - reworked uAPI structs layout to follow VP8 style > - changed validation of loop filter params > - changed validation of segmentation params > - changed validation of VP9 frame params > - removed level lookup array from loop filter struct > (can be computed by drivers) > - renamed some enum values to match the spec more closely > - V4L2 VP9 library changed the 'eob' member of > 'struct v4l2_vp9_frame_symbol_counts' so that it is an array > of pointers instead of an array of pointers to arrays > (IPs such as g2 creatively pass parts of the 'eob' counts in > the 'coeff' counts) > - factored out several repeated portions of code > - minor nitpicks and cleanups > > Andrzej Pietrasiewicz (6): > media: uapi: Add VP9 stateless decoder controls > media: Add VP9 v4l2 library > media: hantro: Rename registers > media: hantro: Prepare for other G2 codecs > media: hantro: Support VP9 on the G2 core > media: hantro: Support NV12 on the G2 core > > Boris Brezillon (1): > media: rkvdec: Add the VP9 backend > > Ezequiel Garcia (4): > hantro: postproc: Fix motion vector space size > hantro: postproc: Introduce struct hantro_postproc_ops > hantro: Simplify postprocessor > hantro: Add quirk for NV12/NV12_4L4 capture format > > .../userspace-api/media/v4l/biblio.rst | 10 + > .../media/v4l/ext-ctrls-codec-stateless.rst | 573 +++++ > .../media/v4l/pixfmt-compressed.rst | 15 + > .../media/v4l/vidioc-g-ext-ctrls.rst | 8 + > .../media/v4l/vidioc-queryctrl.rst | 12 + > .../media/videodev2.h.rst.exceptions | 2 + > drivers/media/v4l2-core/Kconfig | 4 + > drivers/media/v4l2-core/Makefile | 1 + > drivers/media/v4l2-core/v4l2-ctrls-core.c | 180 ++ > drivers/media/v4l2-core/v4l2-ctrls-defs.c | 8 + > drivers/media/v4l2-core/v4l2-ioctl.c | 1 + > drivers/media/v4l2-core/v4l2-vp9.c | 1850 +++++++++++++++++ > drivers/staging/media/hantro/Kconfig | 1 + > drivers/staging/media/hantro/Makefile | 7 +- > drivers/staging/media/hantro/hantro.h | 40 +- > drivers/staging/media/hantro/hantro_drv.c | 23 +- > drivers/staging/media/hantro/hantro_g2.c | 27 + > .../staging/media/hantro/hantro_g2_hevc_dec.c | 69 +- > drivers/staging/media/hantro/hantro_g2_regs.h | 132 +- > .../staging/media/hantro/hantro_g2_vp9_dec.c | 980 +++++++++ > drivers/staging/media/hantro/hantro_hw.h | 83 +- > .../staging/media/hantro/hantro_postproc.c | 79 +- > drivers/staging/media/hantro/hantro_v4l2.c | 20 + > drivers/staging/media/hantro/hantro_vp9.c | 240 +++ > drivers/staging/media/hantro/hantro_vp9.h | 103 + > drivers/staging/media/hantro/imx8m_vpu_hw.c | 38 +- > .../staging/media/hantro/rockchip_vpu_hw.c | 7 +- > .../staging/media/hantro/sama5d4_vdec_hw.c | 3 +- > drivers/staging/media/rkvdec/Kconfig | 1 + > drivers/staging/media/rkvdec/Makefile | 2 +- > drivers/staging/media/rkvdec/rkvdec-vp9.c | 1078 ++++++++++ > drivers/staging/media/rkvdec/rkvdec.c | 52 +- > drivers/staging/media/rkvdec/rkvdec.h | 12 +- > include/media/v4l2-ctrls.h | 4 + > include/media/v4l2-vp9.h | 182 ++ > include/uapi/linux/v4l2-controls.h | 284 +++ > include/uapi/linux/videodev2.h | 6 + > 37 files changed, 6033 insertions(+), 104 deletions(-) > create mode 100644 drivers/media/v4l2-core/v4l2-vp9.c > create mode 100644 drivers/staging/media/hantro/hantro_g2.c > create mode 100644 drivers/staging/media/hantro/hantro_g2_vp9_dec.c > create mode 100644 drivers/staging/media/hantro/hantro_vp9.c > create mode 100644 drivers/staging/media/hantro/hantro_vp9.h > create mode 100644 drivers/staging/media/rkvdec/rkvdec-vp9.c > create mode 100644 include/media/v4l2-vp9.h > > > base-commit: e4e737bb5c170df6135a127739a9e6148ee3da82 > -- > 2.17.1 > _______________________________________________ linux-arm-kernel mailing list linux-arm-kernel@lists.infradead.org http://lists.infradead.org/mailman/listinfo/linux-arm-kernel