* [RFC PATCH v2] media: Add AV1 uAPI
@ 2022-03-22 16:01 daniel.almeida
2022-03-22 19:29 ` kernel test robot
2022-05-10 0:04 ` Steve Cho
0 siblings, 2 replies; 10+ messages in thread
From: daniel.almeida @ 2022-03-22 16:01 UTC (permalink / raw)
To: hverkuil; +Cc: Daniel Almeida, linux-media, Nicolas Dufresne
From: Daniel Almeida <daniel.almeida@collabora.com>
This patch adds the AOMedia Video 1 (AV1) kernel uAPI.
This design is based on currently available AV1 API implementations and
aims to support the development of AV1 stateless video codecs
on Linux.
Signed-off-by: Daniel Almeida <daniel.almeida@collabora.com>
Signed-off-by: Nicolas Dufresne <nicolas.dufresne@collabora.com>
---
A quick reminder that this patch needs the V4L2_CTRL_FLAG_DYNAMIC_ARRAY patchset
by Hans.
Changes from v1:
- Fixed the issues pointed out by Hans in his review (Thanks, Hans)
- Fixed the sign for ref_deltas and mode_deltas
These are signed values and will otherwise fail the validation in
v4l2-ctrls-core.c.
- Fix film grain y/cb/cr points validation
We were controlling the entire array, but there is a subset of points
being set, which lead to the validation to fail. Fix this by limiting
the test to the number of points. The number of point is already
controlled in the previous check so should be safe.
- Fix validation for Su(n) syntax
The Su(n) AV1 syntax ranges from -2^n/2 to 2^n/2 - 1, while the previous code
was only validating values from -2^n/2 + 1 to 2^n/2 - 1.
- Fix order_hints and buffer_removal_time
The buffer_removal_time should have been 32 bit and the
ref_order_hint got confused with order_hints. We want the
second one, as the first one is only used as a backup to
fill the second on missing last frame.
- Fix off by one error in validation code
There are 5 segmentation flags, so any code that sets the most significant
flag would automatically fail.
- Feature data can be negative
Feature data can be negative if Segmentation_Feature_Signed[j] == 1, in which
case it is read with the Su(n) syntax.
Reflect that by changing the data type to s16.
- Remove large scale mode controls
Large scale mode is not supported. Remove all controls associated with it.
This means that all TILE_LIST_* controls are gone.
- Split v4l2_av1_film_grain into its own control
Split v4l2_av1_film_grain into its own control, as not all accelerators
might support it. This control is now optional.
- Fix broken docs for v4l2_av1_interpolation_filter
Docs mention VP9 instead of AV1. This is a typo.
- Fix broken docs for v4l2_ctrl_av1_tile_group_entry
Fix a small typo in the docs.
- Fix AV1 reference lists
We need both all the references and the per frame references. This is
because unlike VP9, show_existing_frame that are key frame will refresh
the frame slots, which prevents the driver from keeping track since
these frame are not signalled to the driver.
Instead mimic other API (like VA and DXVA) and provide a complete list
of active references. The driver can then cleanup any data it was
storing for references that are no longer in use, saving previous
memory.
- Fix broken docs in ext-ctrls-codec-stateless.rst
:c:type:`struct v4l2_ctrl_av1_tile_group_entry` would not resolve, it would
also produce a warning when making the docs. Fix this by changing this to
:c:type:`v4l2_ctrl_av1_tile_group_entry` instead.
TODO:
This patch is work in progress as we do not have two drivers using it yet. More
implementations are needed before the final design is settled. In particular, we
have moved into reorganizing the parts for the purposes of ergonomy and
efficiency.
---
.../userspace-api/media/v4l/biblio.rst | 10 +
.../media/v4l/ext-ctrls-codec-stateless.rst | 1245 +++++++++++++++++
.../media/v4l/pixfmt-compressed.rst | 17 +
.../media/v4l/vidioc-g-ext-ctrls.rst | 28 +
.../media/v4l/vidioc-queryctrl.rst | 36 +
.../media/videodev2.h.rst.exceptions | 7 +
drivers/media/v4l2-core/v4l2-ctrls-core.c | 280 +++-
drivers/media/v4l2-core/v4l2-ctrls-defs.c | 64 +
drivers/media/v4l2-core/v4l2-ioctl.c | 1 +
include/media/v4l2-ctrls.h | 10 +
include/uapi/linux/v4l2-controls.h | 743 ++++++++++
include/uapi/linux/videodev2.h | 13 +
12 files changed, 2453 insertions(+), 1 deletion(-)
diff --git a/Documentation/userspace-api/media/v4l/biblio.rst b/Documentation/userspace-api/media/v4l/biblio.rst
index 9cd18c153d19..3e21e51ba329 100644
--- a/Documentation/userspace-api/media/v4l/biblio.rst
+++ b/Documentation/userspace-api/media/v4l/biblio.rst
@@ -427,3 +427,13 @@ VP9
:title: VP9 Bitstream & Decoding Process Specification
:author: Adrian Grange (Google), Peter de Rivaz (Argon Design), Jonathan Hunt (Argon Design)
+
+.. _av1:
+
+AV1
+===
+
+
+:title: AV1 Bitstream & Decoding Process Specification
+
+:author: Peter de Rivaz, Argon Design Ltd, Jack Haughton, Argon Design Ltd
diff --git a/Documentation/userspace-api/media/v4l/ext-ctrls-codec-stateless.rst b/Documentation/userspace-api/media/v4l/ext-ctrls-codec-stateless.rst
index 6541e4c32b26..606a2aadbc30 100644
--- a/Documentation/userspace-api/media/v4l/ext-ctrls-codec-stateless.rst
+++ b/Documentation/userspace-api/media/v4l/ext-ctrls-codec-stateless.rst
@@ -2042,3 +2042,1248 @@ This structure contains all loop filter related parameters. See sections
- 0x2
- When set, the bitstream contains additional syntax elements that
specify which mode and reference frame deltas are to be updated.
+
+
+.. _v4l2-codec-stateless-av1:
+
+``V4L2_CID_STATELESS_AV1_SEQUENCE (struct)``
+ Represents an AV1 Sequence OBU. See section 5.5. "Sequence header OBU syntax"
+ in :ref:`av1` for more details.
+
+.. c:type:: v4l2_ctrl_av1_sequence
+
+.. cssclass:: longtable
+
+.. tabularcolumns:: |p{5.8cm}|p{4.8cm}|p{6.6cm}|
+
+.. flat-table:: struct v4l2_ctrl_av1_sequence
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - __u32
+ - ``flags``
+ - See :ref:`AV1 Sequence Flags <av1_sequence_flags>`.
+ * - __u8
+ - ``seq_profile``
+ - Specifies the features that can be used in the coded video sequence.
+ * - __u8
+ - ``order_hint_bits``
+ - Specifies the number of bits used for the order_hint field at each frame.
+ * - __u8
+ - ``bit_depth``
+ - the bitdepth to use for the sequence as described in section 5.5.2
+ "Color config syntax" in :ref:`av1` for more details.
+ * - __u16
+ - ``max_frame_width_minus_1``
+ - specifies the maximum frame width minus 1 for the frames represented by
+ this sequence header.
+
+.. _av1_sequence_flags:
+
+``AV1 Sequence Flags``
+
+.. cssclass:: longtable
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_SEQUENCE_FLAG_STILL_PICTURE``
+ - 0x00000001
+ - If set, specifies that the coded video sequence contains only one coded
+ frame. If not set, specifies that the coded video sequence contains one or
+ more coded frames.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_USE_128X128_SUPERBLOCK``
+ - 0x00000002
+ - If set, indicates that superblocks contain 128x128 luma samples.
+ When equal to 0, it indicates that superblocks contain 64x64 luma samples.
+ (The number of contained chroma samples depends on subsampling_x and
+ subsampling_y).
+ * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_FILTER_INTRA``
+ - 0x00000004
+ - If set, specifies that the use_filter_intra syntax element may be
+ present. If not set, specifies that the use_filter_intra syntax element will
+ not be present.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_INTRA_EDGE_FILTER``
+ - 0x00000008
+ - Specifies whether the intra edge filtering process should be enabled.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_INTERINTRA_COMPOUND``
+ - 0x00000010
+ - If set, specifies that the mode info for inter blocks may contain the
+ syntax element interintra. If not set, specifies that the syntax element
+ interintra will not be present.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_MASKED_COMPOUND``
+ - 0x00000020
+ - If set, specifies that the mode info for inter blocks may contain the
+ syntax element compound_type. If not set, specifies that the syntax element
+ compound_type will not be present.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_WARPED_MOTION``
+ - 0x00000040
+ - If set, indicates that the allow_warped_motion syntax element may be
+ present. If not set, indicates that the allow_warped_motion syntax element
+ will not be present.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_DUAL_FILTER``
+ - 0x00000080
+ - If set, indicates that the inter prediction filter type may be specified
+ independently in the horizontal and vertical directions. If the flag is
+ equal to 0, only one filter type may be specified, which is then used in
+ both directions.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_ORDER_HINT``
+ - 0x00000100
+ - If set, indicates that tools based on the values of order hints may be
+ used. If not set, indicates that tools based on order hints are disabled.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_JNT_COMP``
+ - 0x00000200
+ - If set, indicates that the distance weights process may be used for
+ inter prediction.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_REF_FRAME_MVS``
+ - 0x00000400
+ - If set, indicates that the use_ref_frame_mvs syntax element may be
+ present. If not set, indicates that the use_ref_frame_mvs syntax element
+ will not be present.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_SUPERRES``
+ - 0x00000800
+ - If set, specifies that the use_superres syntax element will be present
+ in the uncompressed header. If not set, specifies that the use_superres
+ syntax element will not be present (instead use_superres will be set to 0
+ in the uncompressed header without being read).
+ * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_CDEF``
+ - 0x00001000
+ - If set, specifies that cdef filtering may be enabled. If not set,
+ specifies that cdef filtering is disabled.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_RESTORATION``
+ - 0x00002000
+ - If set, specifies that loop restoration filtering may be enabled. If not
+ set, specifies that loop restoration filtering is disabled.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_MONO_CHROME``
+ - 0x00004000
+ - If set, indicates that the video does not contain U and V color planes.
+ If not set, indicates that the video contains Y, U, and V color planes.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_COLOR_RANGE``
+ - 0x00008000
+ - If set, signals full swing representation. If not set, signals studio
+ swing representation.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_SUBSAMPLING_X``
+ - 0x00010000
+ - Specify the chroma subsampling format.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_SUBSAMPLING_Y``
+ - 0x00020000
+ - Specify the chroma subsampling format.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_FILM_GRAIN_PARAMS_PRESENT``
+ - 0x00040000
+ - Specifies whether film grain parameters are present in the coded video
+ sequence.
+ * - ``V4L2_AV1_SEQUENCE_FLAG_SEPARATE_UV_DELTA_Q``
+ - 0x00080000
+ - If set, indicates that the U and V planes may have separate delta
+ quantizer values. If not set, indicates that the U and V planes will share
+ the same delta quantizer value.
+
+``V4L2_CID_STATELESS_AV1_TILE_GROUP (struct)``
+ Represents a tile group as seen in an AV1 Tile Group OBU or Frame OBU. A
+ v4l2_ctrl_av1_tile_group instance will refer to tg_end - tg_start instances
+ of struct :c:type:`v4l2_ctrl_av1_tile_group_entry`. See section
+ 6.10.1 "General tile group OBU semantics" in :ref:`av1` for more details.
+
+.. c:type:: v4l2_ctrl_av1_tile_group
+
+.. cssclass:: longtable
+
+.. tabularcolumns:: |p{5.8cm}|p{4.8cm}|p{6.6cm}|
+
+.. flat-table:: struct v4l2_ctrl_av1_tile_group
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - __u8
+ - ``flags``
+ - See :ref:`AV1 Tile Group Flags <av1_tile_group_flags>`.
+ * - __u8
+ - ``tg_start``
+ - Specifies the zero-based index of the first tile in the current tile
+ group.
+ * - __u8
+ - ``tg_end``
+ - Specifies the zero-based index of the last tile in the current tile
+ group.
+
+.. _av1_tile_group_flags:
+
+``AV1 Tile Group Flags``
+
+.. cssclass:: longtable
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_TILE_GROUP_FLAG_START_AND_END_PRESENT``
+ - 0x00000001
+ - Specifies whether tg_start and tg_end are present. If tg_start and
+ tg_end are not present, this tile group covers the entire frame.
+
+``V4L2_CID_STATELESS_AV1_TILE_GROUP_ENTRY (struct)``
+ Represents a single AV1 tile inside an AV1 Tile Group. Note that MiRowStart,
+ MiRowEnd, MiColStart and MiColEnd can be retrieved from struct
+ v4l2_av1_tile_info in struct v4l2_ctrl_av1_frame_header using tile_row and
+ tile_col. See section 6.10.1 "General tile group OBU semantics" in
+ :ref:`av1` for more details.
+
+.. c:type:: v4l2_ctrl_av1_tile_group_entry
+
+.. cssclass:: longtable
+
+.. tabularcolumns:: |p{5.8cm}|p{4.8cm}|p{6.6cm}|
+
+.. flat-table:: struct v4l2_ctrl_av1_tile_group_entry
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - __u32
+ - ``tile_offset``
+ - Offset from the OBU data, i.e. where the coded tile data actually starts.
+ * - __u32
+ - ``tile_size``
+ - Specifies the size in bytes of the coded tile. Equivalent to "TileSize"
+ in :ref:`av1`.
+ * - __u32
+ - ``tile_row``
+ - Specifies the row of the current tile. Equivalent to "TileRow" in
+ :ref:`av1`.
+ * - __u32
+ - ``tile_col``
+ - Specifies the column of the current tile. Equivalent to "TileColumn" in
+ :ref:`av1`.
+
+.. c:type:: v4l2_av1_warp_model
+
+ AV1 Warp Model as described in section 3 "Symbols and abbreviated terms" of
+ :ref:`av1`.
+
+.. raw:: latex
+
+ \scriptsize
+
+.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_WARP_MODEL_IDENTITY``
+ - 0
+ - Warp model is just an identity transform.
+ * - ``V4L2_AV1_WARP_MODEL_TRANSLATION``
+ - 1
+ - Warp model is a pure translation.
+ * - ``V4L2_AV1_WARP_MODEL_ROTZOOM``
+ - 2
+ - Warp model is a rotation + symmetric zoom + translation.
+ * - ``V4L2_AV1_WARP_MODEL_AFFINE``
+ - 3
+ - Warp model is a general affine transform.
+
+.. c:type:: v4l2_av1_reference_frame
+
+AV1 Reference Frames as described in section 6.10.24. "Ref frames semantics"
+of :ref:`av1`.
+
+.. raw:: latex
+
+ \scriptsize
+
+.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_REF_INTRA_FRAME``
+ - 0
+ - Intra Frame Reference.
+ * - ``V4L2_AV1_REF_LAST_FRAME``
+ - 1
+ - Last Frame Reference.
+ * - ``V4L2_AV1_REF_LAST2_FRAME``
+ - 2
+ - Last2 Frame Reference.
+ * - ``V4L2_AV1_REF_LAST3_FRAME``
+ - 3
+ - Last3 Frame Reference.
+ * - ``V4L2_AV1_REF_GOLDEN_FRAME``
+ - 4
+ - Golden Frame Reference.
+ * - ``V4L2_AV1_REF_BWDREF_FRAME``
+ - 5
+ - BWD Frame Reference.
+ * - ``V4L2_AV1_REF_ALTREF2_FRAME``
+ - 6
+ - ALTREF2 Frame Reference.
+ * - ``V4L2_AV1_REF_ALTREF_FRAME``
+ - 7
+ - ALTREF Frame Reference.
+ * - ``V4L2_AV1_NUM_REF_FRAMES``
+ - 8
+ - Total number of reference frames.
+
+.. c:type:: v4l2_av1_global_motion
+
+AV1 Global Motion parameters as described in section 6.8.17
+"Global motion params semantics" of :ref:`av1` for more details.
+
+.. cssclass:: longtable
+
+.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
+
+.. flat-table:: struct v4l2_av1_global_motion
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - __u8
+ - ``flags[V4L2_AV1_TOTAL_REFS_PER_FRAME]``
+ - A bitfield containing the flags per reference frame. See
+ :ref:`AV1 Global Motion Flags <av1_global_motion_flags>` for more
+ details.
+ * - enum :c:type:`v4l2_av1_warp_model`
+ - ``type[V4L2_AV1_TOTAL_REFS_PER_FRAME]``
+ - The type of global motion transform used.
+ * - __u32
+ - ``params[V4L2_AV1_TOTAL_REFS_PER_FRAME][6]``
+ - This field has the same meaning as "gm_params" in :ref:`av1`.
+ * - __u8
+ - ``invalid``
+ - Bitfield indicating whether the global motion params are invalid for a
+ given reference frame. See section 7.11.3.6. Setup shear process and the
+ variable "warpValid". Use V4L2_AV1_GLOBAL_MOTION_IS_INVALID(ref) to
+ create a suitable mask.
+
+.. _av1_global_motion_flags:
+
+``AV1 Global Motion Flags``
+
+.. cssclass:: longtable
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_GLOBAL_MOTION_FLAG_IS_GLOBAL``
+ - 0x00000001
+ - Specifies whether global motion parameters are present for a particular
+ reference frame.
+ * - ``V4L2_AV1_GLOBAL_MOTION_FLAG_IS_ROT_ZOOM``
+ - 0x00000002
+ - Specifies whether a particular reference frame uses rotation and zoom
+ global motion.
+ * - ``V4L2_AV1_GLOBAL_MOTION_FLAG_IS_TRANSLATION``
+ - 0x00000004
+ - Specifies whether a particular reference frame uses rotation and zoom
+ global motion.
+
+.. c:type:: v4l2_av1_frame_restoration_type
+
+AV1 Frame Restoration Type.
+
+.. raw:: latex
+
+ \scriptsize
+
+.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_FRAME_RESTORE_NONE``
+ - 0
+ - No filtering is applied.
+ * - ``V4L2_AV1_FRAME_RESTORE_WIENER``
+ - 1
+ - Wiener filter process is invoked.
+ * - ``V4L2_AV1_FRAME_RESTORE_SGRPROJ``
+ - 2
+ - Self guided filter process is invoked.
+ * - ``V4L2_AV1_FRAME_RESTORE_SWITCHABLE``
+ - 3
+ - Restoration filter is swichtable.
+
+.. c:type:: v4l2_av1_loop_restoration
+
+AV1 Loop Restauration as described in section 6.10.15 "Loop restoration params
+semantics" of :ref:`av1`.
+
+.. cssclass:: longtable
+
+.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
+
+.. flat-table:: struct v4l2_av1_loop_restoration
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - __u8
+ - ``flags``
+ - See :ref:`AV1 Loop Restoration Flags <av1_loop_restoration_flags>`.
+ * - :c:type:`v4l2_av1_frame_restoration_type`
+ - ``frame_restoration_type[V4L2_AV1_NUM_PLANES_MAX]``
+ - Specifies the type of restoration used for each plane.
+ * - __u8
+ - ``lr_unit_shift``
+ - Specifies if the luma restoration size should be halved.
+ * - __u8
+ - ``lr_uv_shift``
+ - Specifies if the chroma size should be half the luma size.
+ * - __u8
+ - ``loop_restoration_size[V4L2_AV1_MAX_NUM_PLANES]``
+ - specifies the size of loop restoration units in units of samples in the
+ current plane.
+
+.. _av1_loop_restoration_flags:
+
+``AV1 Loop Restoration Flags``
+
+.. cssclass:: longtable
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_LOOP_RESTORATION_FLAG_USES_LR``
+ - 0x00000001
+ - Retains the same meaning as UsesLr in :ref:`av1`.
+ * - ``V4L2_AV1_LOOP_RESTORATION_FLAG_USES_CHROMA_LR``
+ - 0x00000002
+ - Retains the same meaning as UsesChromaLr in :ref:`av1`.
+
+.. c:type:: v4l2_av1_cdef
+
+AV1 CDEF params semantics as described in section 6.10.14. "CDEF params
+semantics" of :ref:`av1`.
+
+.. cssclass:: longtable
+
+.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
+
+.. flat-table:: struct v4l2_av1_cdef
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - __u8
+ - ``damping_minus_3``
+ - Controls the amount of damping in the deringing filter.
+ * - __u8
+ - ``bits``
+ - Specifies the number of bits needed to specify which CDEF filter to
+ apply.
+ * - __u8
+ - ``y_pri_strength[V4L2_AV1_CDEF_MAX]``
+ - Specifies the strength of the primary filter.
+ * - __u8
+ - ``y_sec_strength[V4L2_AV1_CDEF_MAX]``
+ - Specifies the strength of the secondary filter.
+ * - __u8
+ - ``uv_pri_strength[V4L2_AV1_CDEF_MAX]``
+ - Specifies the strength of the primary filter.
+ * - __u8
+ - ``uv_secondary_strength[V4L2_AV1_CDEF_MAX]``
+ - Specifies the strength of the secondary filter.
+
+.. c:type:: v4l2_av1_segment_feature
+
+AV1 segment features as described in section 3 "Symbols and abbreviated terms"
+of :ref:`av1`.
+
+.. raw:: latex
+
+ \scriptsize
+
+.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_SEG_LVL_ALT_Q``
+ - 0
+ - Index for quantizer segment feature.
+ * - ``V4L2_AV1_SEG_LVL_ALT_LF_Y_V``
+ - 1
+ - Index for vertical luma loop filter segment feature.
+ * - ``V4L2_AV1_SEG_LVL_REF_FRAME``
+ - 5
+ - Index for reference frame segment feature.
+ * - ``V4L2_AV1_SEG_LVL_REF_SKIP``
+ - 6
+ - Index for skip segment feature.
+ * - ``V4L2_AV1_SEG_LVL_REF_GLOBALMV``
+ - 7
+ - Index for global mv feature.
+ * - ``V4L2_AV1_SEG_LVL_MAX``
+ - 8
+ - Number of segment features.
+
+.. c:type:: v4l2_av1_segmentation
+
+AV1 Segmentation params as defined in section 6.8.13. "Segmentation params
+semantics" of :ref:`av1`.
+
+.. cssclass:: longtable
+
+.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
+
+.. flat-table:: struct v4l2_av1_film_grain
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - __u8
+ - ``flags``
+ - See :ref:`AV1 Segmentation Flags <av1_segmentation_flags>`
+ * - __u8
+ - ``feature_enabled[V4L2_AV1_MAX_SEGMENTS]``
+ - Bitmask defining which features are enabled in each segment. Use
+ V4L2_AV1_SEGMENT_FEATURE_ENABLED to build a suitable mask.
+ * - __u16
+ - `feature_data[V4L2_AV1_MAX_SEGMENTS][V4L2_AV1_SEG_LVL_MAX]``
+ - Data attached to each feature. Data entry is only valid if the feature
+ is enabled
+ * - __u8
+ - ``last_active_seg_id``
+ - Indicates the highest numbered segment id that has some
+ enabled feature. This is used when decoding the segment id to only decode
+ choices corresponding to used segments.
+
+.. _av1_segmentation_flags:
+
+``AV1 Segmentation Flags``
+
+.. cssclass:: longtable
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_SEGMENTATION_FLAG_ENABLED``
+ - 0x00000001
+ - If set, indicates that this frame makes use of the segmentation tool. If
+ not set, indicates that the frame does not use segmentation.
+ * - ``V4L2_AV1_SEGMENTATION_FLAG_UPDATE_MAP``
+ - 0x00000002
+ - If set, indicates that the segmentation map are updated during the
+ decoding of this frame. If not set, indicates that the segmentation map
+ from the previous frame is used.
+ * - ``V4L2_AV1_SEGMENTATION_FLAG_TEMPORAL_UPDATE``
+ - 0x00000004
+ - If set, indicates that the updates to the segmentation map are coded
+ relative to the existing segmentation map. If not set, indicates that
+ the new segmentation map is coded without reference to the existing
+ segmentation map.
+ * - ``V4L2_AV1_SEGMENTATION_FLAG_UPDATE_DATA``
+ - 0x00000008
+ - If set, indicates that the updates to the segmentation map are coded
+ relative to the existing segmentation map. If not set, indicates that
+ the new segmentation map is coded without reference to the existing
+ segmentation map.
+ * - ``V4L2_AV1_SEGMENTATION_FLAG_SEG_ID_PRE_SKIP``
+ - 0x00000010
+ - If set, indicates that the segment id will be read before the skip
+ syntax element. If not set, indicates that the skip syntax element will
+ be read first.
+
+.. c:type:: v4l2_av1_loop_filter
+
+AV1 Loop filter params as defined in section 6.8.10. "Loop filter semantics" of
+:ref:`av1`.
+
+.. cssclass:: longtable
+
+.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
+
+.. flat-table:: struct v4l2_av1_global_motion
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - __u8
+ - ``flags``
+ - See
+ :ref:`AV1 Loop Filter flags <av1_loop_filter_flags>` for more details.
+ * - __u8
+ - ``level[4]``
+ - an array containing loop filter strength values. Different loop
+ filter strength values from the array are used depending on the image
+ plane being filtered, and the edge direction (vertical or horizontal)
+ being filtered.
+ * - __u8
+ - ``sharpness``
+ - indicates the sharpness level. The loop_filter_level and
+ loop_filter_sharpness together determine when a block edge is filtered,
+ and by how much the filtering can change the sample values. The loop
+ filter process is described in section 7.14 of :ref:`av1`.
+ * - __u8
+ - ``ref_deltas[V4L2_AV1_TOTAL_REFS_PER_FRAME]``
+ - contains the adjustment needed for the filter level based on the
+ chosen reference frame. If this syntax element is not present, it
+ maintains its previous value.
+ * - __u8
+ - ``mode_deltas[2]``
+ - contains the adjustment needed for the filter level based on
+ the chosen mode. If this syntax element is not present, it maintains its
+ previous value.
+ * - __u8
+ - ``delta_lf_res``
+ - specifies the left shift which should be applied to decoded loop filter
+ delta values.
+ * - __u8
+ - ``delta_lf_multi``
+ - a value equal to 1 specifies that separate loop filter
+ deltas are sent for horizontal luma edges, vertical luma edges, the U
+ edges, and the V edges. A value of delta_lf_multi equal to 0 specifies
+ that the same loop filter delta is used for all edges.
+
+.. _av1_loop_filter_flags:
+
+``AV1 Loop Filter Flags``
+
+.. cssclass:: longtable
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_LOOP_FILTER_FLAG_DELTA_ENABLED``
+ - 0x00000001
+ - If set, means that the filter level depends on the mode and reference
+ frame used to predict a block. If not set, means that the filter level
+ does not depend on the mode and reference frame.
+ * - ``V4L2_AV1_LOOP_FILTER_FLAG_DELTA_UPDATE``
+ - 0x00000002
+ - If set, means that additional syntax elements are present that specify
+ which mode and reference frame deltas are to be updated. If not set,
+ means that these syntax elements are not present.
+ * - ``V4L2_AV1_LOOP_FILTER_FLAG_DELTA_LF_PRESENT``
+ - 0x00000004
+ - Specifies whether loop filter delta values are present
+
+.. c:type:: v4l2_av1_quantization
+
+AV1 Quantization params as defined in section 6.8.11 "Quantization params
+semantics" of :ref:`av1`.
+
+.. cssclass:: longtable
+
+.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
+
+.. flat-table:: struct v4l2_av1_quantization
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - __u8
+ - ``flags``
+ - See
+ :ref:`AV1 Loop Filter flags <av1_quantization_flags>` for more details.
+ * - __u8
+ - ``base_q_idx``
+ - Indicates the base frame qindex. This is used for Y AC coefficients and
+ as the base value for the other quantizers.
+ * - __u8
+ - ``delta_q_y_dc``
+ - Indicates the Y DC quantizer relative to base_q_idx.
+ * - __u8
+ - ``delta_q_u_dc``
+ - Indicates the U DC quantizer relative to base_q_idx.
+ * - __u8
+ - ``delta_q_u_ac``
+ - Indicates the U AC quantizer relative to base_q_idx.
+ * - __u8
+ - ``delta_q_v_dc``
+ - Indicates the V DC quantizer relative to base_q_idx.
+ * - __u8
+ - ``delta_q_v_dc``
+ - Indicates the V DC quantizer relative to base_q_idx.
+ * - __u8
+ - ``qm_y``
+ - Specifies the level in the quantizer matrix that should be used for
+ luma plane decoding.
+ * - __u8
+ - ``qm_u``
+ - Specifies the level in the quantizer matrix that should be used for
+ chroma U plane decoding.
+ * - __u8
+ - ``qm_y``
+ - Specifies the level in the quantizer matrix that should be used for
+ chroma V plane decoding.
+ * - __u8
+ - ``delta_q_res``
+ - Specifies the left shift which should be applied to decoded quantizer
+ index delta values.
+
+.. _av1_quantization_flags:
+
+``AV1 Quantization Flags``
+
+.. cssclass:: longtable
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_QUANTIZATION_FLAG_DIFF_UV_DELTA``
+ - 0x00000001
+ - If set, indicates that the U and V delta quantizer values are coded
+ separately. If not set, indicates that the U and V delta quantizer
+ values share a common value.
+ * - ``V4L2_AV1_QUANTIZATION_FLAG_USING_QMATRIX``
+ - 0x00000002
+ - If set, specifies that the quantizer matrix will be used to compute
+ quantizers.
+ * - ``V4L2_AV1_QUANTIZATION_FLAG_DELTA_Q_PRESENT``
+ - 0x00000004
+ - Specifies whether quantizer index delta values are present.
+
+.. c:type:: v4l2_av1_tile_info
+
+AV1 Tile info as defined in section 6.8.14. "Tile info semantics" of ref:`av1`.
+
+.. cssclass:: longtable
+
+.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
+
+.. flat-table:: struct v4l2_av1_film_grain
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - __u8
+ - ``flags``
+ - See
+ :ref:`AV1 Tile Info flags <av1_tile_info_flags>` for more details.
+ * - __u32
+ - ``mi_col_starts[V4L2_AV1_MAX_TILE_COLS + 1]``
+ - An array specifying the start column (in units of 4x4 luma
+ samples) for each tile across the image.
+ * - __u32
+ - ``mi_row_starts[V4L2_AV1_MAX_TILE_ROWS + 1]``
+ - An array specifying the start row (in units of 4x4 luma
+ samples) for each tile across the image.
+ * - __u32
+ - ``width_in_sbs_minus_1[V4L2_AV1_MAX_TILE_COLS]``
+ - Specifies the width of a tile minus 1 in units of superblocks.
+ * - __u32
+ - ``height_in_sbs_minus_1[V4L2_AV1_MAX_TILE_ROWS]``
+ - Specifies the height of a tile minus 1 in units of superblocks.
+ * - __u8
+ - ``tile_size_bytes``
+ - Specifies the number of bytes needed to code each tile size.
+ * - __u8
+ - ``context_update_tile_id``
+ - Specifies which tile to use for the CDF update.
+ * - __u8
+ - ``tile_rows``
+ - Specifies the number of tiles down the frame.
+ * - __u8
+ - ``tile_rows``
+ - Specifies the number of tiles across the frame.
+
+.. _av1_tile_info_flags:
+
+``AV1 Tile Info Flags``
+
+.. cssclass:: longtable
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_TILE_INFO_FLAG_UNIFORM_TILE_SPACING``
+ - 0x00000001
+ - If set, means that the tiles are uniformly spaced across the frame. (In
+ other words, all tiles are the same size except for the ones at the
+ right and bottom edge which can be smaller). If not set means that the
+ tile sizes are coded.
+
+.. c:type:: v4l2_av1_frame_type
+
+AV1 Frame Type
+
+.. raw:: latex
+
+ \scriptsize
+
+.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_KEY_FRAME``
+ - 0
+ - Key frame.
+ * - ``V4L2_AV1_INTER_FRAME``
+ - 1
+ - Inter frame.
+ * - ``V4L2_AV1_INTRA_ONLY_FRAME``
+ - 2
+ - Intra-only frame.
+ * - ``V4L2_AV1_SWITCH_FRAME``
+ - 3
+ - Switch frame.
+
+.. c:type:: v4l2_av1_interpolation_filter
+
+AV1 Interpolation Filter
+
+.. raw:: latex
+
+ \scriptsize
+
+.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP``
+ - 0
+ - Eight tap filter.
+ * - ``V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP_SMOOTH``
+ - 1
+ - Eight tap smooth filter.
+ * - ``V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP_SHARP``
+ - 2
+ - Eight tap sharp filter.
+ * - ``V4L2_AV1_INTERPOLATION_FILTER_BILINEAR``
+ - 3
+ - Bilinear filter.
+ * - ``V4L2_AV1_INTERPOLATION_FILTER_SWITCHABLE``
+ - 4
+ - Filter selection is signaled at the block level.
+
+.. c:type:: v4l2_av1_tx_mode
+
+AV1 Tx mode as described in section 6.8.21 "TX mode semantics" of :ref:`av1`.
+
+.. raw:: latex
+
+ \scriptsize
+
+.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_TX_MODE_ONLY_4X4``
+ - 0
+ - The inverse transform will use only 4x4 transforms.
+ * - ``V4L2_AV1_TX_MODE_LARGEST``
+ - 1
+ - The inverse transform will use the largest transform size that fits
+ inside the block.
+ * - ``V4L2_AV1_TX_MODE_SELECT``
+ - 2
+ - The choice of transform size is specified explicitly for each block.
+
+``V4L2_CID_STATELESS_AV1_FRAME_HEADER (struct)``
+ Represents a tile list entry as seen in an AV1 Tile List OBU. See section
+ 6.11.2. "Tile list entry semantics" of :ref:`av1` for more details.
+
+.. c:type:: v4l2_ctrl_av1_frame_header
+
+.. cssclass:: longtable
+
+.. tabularcolumns:: |p{5.8cm}|p{4.8cm}|p{6.6cm}|
+
+.. flat-table:: struct v4l2_ctrl_av1_frame_header
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - struct :c:type:`v4l2_av1_tile_info`
+ - ``tile_info``
+ - Tile info
+ * - struct :c:type:`v4l2_av1_quantization`
+ - ``quantization``
+ - Quantization params
+ * - struct :c:type:`v4l2_av1_segmentation`
+ - ``segmentation``
+ - Segmentation params
+ * - struct :c:type:`v4l2_av1_loop_filter`
+ - ``loop_filter``
+ - Loop filter params
+ * - struct :c:type:`v4l2_av1_cdef`
+ - ``cdef``
+ - CDEF params
+ * - struct :c:type:`v4l2_av1_loop_restoration`
+ - ``loop_restoration``
+ - Loop restoration params
+ * - struct :c:type:`v4l2_av1_loop_restoration`
+ - ``loop_restoration``
+ - Loop restoration params
+ * - struct :c:type:`v4l2_av1_loop_global_motion`
+ - ``global_motion``
+ - Global motion params
+ * - __u32
+ - ``flags``
+ - See
+ :ref:`AV1 Tile Info flags <av1_frame_header_flags>` for more details.
+ * - enum :c:type:`v4l2_av1_frame_type`
+ - ``frame_type``
+ - Specifies the AV1 frame type
+ * - __u32
+ - ``order_hint``
+ - Specifies OrderHintBits least significant bits of the expected output
+ order for this frame.
+ * - __u8
+ - ``superres_denom``
+ - The denominator for the upscaling ratio.
+ * - __u32
+ - ``upscaled_width``
+ - The upscaled width.
+ * - enum :c:type:`v4l2_av1_interpolation_filter`
+ - ``interpolation_filter``
+ - Specifies the filter selection used for performing inter prediction.
+ * - enum :c:type:`v4l2_av1_tx_mode`
+ - ``tx_mode``
+ - Specifies how the transform size is determined.
+ * - __u32
+ - ``frame_width_minus_1``
+ - Add 1 to get the frame's width.
+ * - __u32
+ - ``frame_height_minus_1``
+ - Add 1 to get the frame's height.
+ * - __u16
+ - ``render_width_minus_1``
+ - Add 1 to get the render width of the frame in luma samples.
+ * - __u16
+ - ``render_height_minus_1``
+ - Add 1 to get the render height of the frame in luma samples.
+ * - __u32
+ - ``current_frame_id``
+ - Specifies the frame id number for the current frame. Frame
+ id numbers are additional information that do not affect the decoding
+ process, but provide decoders with a way of detecting missing reference
+ frames so that appropriate action can be taken.
+ * - __u8
+ - ``primary_ref_frame``
+ - Specifies which reference frame contains the CDF values and other state
+ that should be loaded at the start of the frame..
+ * - __u8
+ - ``buffer_removal_time[V4L2_AV1_MAX_OPERATING_POINTS]``
+ - Specifies the frame removal time in units of DecCT clock ticks counted
+ from the removal time of the last random access point for operating point
+ opNum.
+ * - __u8
+ - ``refresh_frame_flags[V4L2_AV1_MAX_OPERATING_POINTS]``
+ - Contains a bitmask that specifies which reference frame slots will be
+ updated with the current frame after it is decoded.
+ * - __u32
+ - ``ref_order_hint[V4L2_AV1_NUM_REF_FRAMES]``
+ - Specifies the expected output order hint for each reference frame.
+ * - __s8
+ - ``last_frame_idx``
+ - Specifies the reference frame to use for LAST_FRAME.
+ * - __s8
+ - ``gold_frame_idx``
+ - Specifies the reference frame to use for GOLDEN_FRAME.
+ * - __u64
+ - ``reference_frame_ts[V4L2_AV1_TOTAL_REFS_PER_FRAME]``
+ - the V4L2 timestamp for each of the reference frames enumerated in
+ enum :c:type:`v4l2_av1_reference_frame` starting at
+ ``V4L2_AV1_REF_LAST_FRAME``. This represent the state of reference
+ slot as describe in the spec and updated by userland through the
+ `Reference frame update process` in section 7.20. The timestamp refers
+ to the ``timestamp`` field in struct :c:type:`v4l2_buffer`. Use the
+ :c:func:`v4l2_timeval_to_ns()` function to convert the struct
+ :c:type:`timeval` in struct :c:type:`v4l2_buffer` to a __u64.
+ * - __u8
+ - ``ref_frame_idx[V4L2_AV1_REFS_PER_FRAME]``
+ - an index into ``reference_frame_ts`` representing the ordered list of
+ references used by inter-frame. Matches the bitstream syntax
+ element of the same name.
+ * - __u8
+ - ``skip_mode_frame[2]``
+ - Specifies the frames to use for compound prediction when skip_mode is
+ equal to 1.
+
+.. _av1_frame_header_flags:
+
+``AV1 Frame Header Flags``
+
+.. cssclass:: longtable
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_SHOW_FRAME``
+ - 0x00000001
+ - If set, specifies that this frame should be immediately output once
+ decoded. If not set, specifies that this frame should not be immediately
+ output. (It may be output later if a later uncompressed header uses
+ show_existing_frame equal to 1).
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_SHOWABLE_FRAME``
+ - 0x00000002
+ - If set, specifies that the frame may be output using the
+ show_existing_frame mechanism. If not set, specifies that this frame
+ will not be output using the show_existing_frame mechanism.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_ERROR_RESILIENT_MODE``
+ - 0x00000004
+ - Specifies whether error resilient mode is enabled.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_DISABLE_CDF_UPDATE``
+ - 0x00000008
+ - Specifies whether the CDF update in the symbol decoding process should
+ be disabled.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_SCREEN_CONTENT_TOOLS``
+ - 0x00000010
+ - Specifies whether the CDF update in the symbol decoding process should
+ be disabled.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_FORCE_INTEGER_MV``
+ - 0x00000020
+ - If set, specifies that motion vectors will always be integers. If not
+ set, specifies that motion vectors can contain fractional bits.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_INTRABC``
+ - 0x00000040
+ - If set, indicates that intra block copy may be used in this frame. If
+ not set, indicates that intra block copy is not allowed in this frame.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_USE_SUPERRES``
+ - 0x00000080
+ - If set, indicates that upscaling is needed.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_HIGH_PRECISION_MV``
+ - 0x00000100
+ - If set, specifies that motion vectors are specified to eighth pel
+ precision. If not set, specifies that motion vectors are specified to
+ quarter pel precision;
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_IS_MOTION_MODE_SWITCHABLE``
+ - 0x00000200
+ - If not set, specifies that only the SIMPLE motion mode will be used.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_USE_REF_FRAME_MVS``
+ - 0x00000400
+ - If set specifies that motion vector information from a previous frame
+ can be used when decoding the current frame. If not set, specifies that
+ this information will not be used.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_DISABLE_FRAME_END_UPDATE_CDF``
+ - 0x00000800
+ - If set indicates that the end of frame CDF update is disabled. If not
+ set, indicates that the end of frame CDF update is enabled
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_UNIFORM_TILE_SPACING``
+ - 0x00001000
+ - If set, means that the tiles are uniformly spaced across the frame. (In
+ other words, all tiles are the same size except for the ones at the
+ right and bottom edge which can be smaller). If not set, means that the
+ tile sizes are coded
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_WARPED_MOTION``
+ - 0x00002000
+ - If set, indicates that the syntax element motion_mode may be present, if
+ not set, indicates that the syntax element motion_mode will not be
+ present.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_REFERENCE_SELECT``
+ - 0x00004000
+ - If set, specifies that the mode info for inter blocks contains the
+ syntax element comp_mode that indicates whether to use single or
+ compound reference prediction. If not set, specifies that all inter
+ blocks will use single prediction.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_REDUCED_TX_SET``
+ - 0x00008000
+ - If set, specifies that the frame is restricted to a reduced subset of
+ the full set of transform types.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_SKIP_MODE_ALLOWED``
+ - 0x00010000
+ - This flag retains the same meaning as SkipModeAllowed in :ref:`av1`.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_SKIP_MODE_PRESENT``
+ - 0x00020000
+ - If set, specifies that the syntax element skip_mode will be present, if
+ not set, specifies that skip_mode will not be used for this frame.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_FRAME_SIZE_OVERRIDE``
+ - 0x00040000
+ - If set, specifies that the frame size will either be specified as the
+ size of one of the reference frames, or computed from the
+ frame_width_minus_1 and frame_height_minus_1 syntax elements. If not
+ set, specifies that the frame size is equal to the size in the sequence
+ header.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_BUFFER_REMOVAL_TIME_PRESENT``
+ - 0x00080000
+ - If set, specifies that buffer_removal_time is present. If not set,
+ specifies that buffer_removal_time is not present.
+ * - ``V4L2_AV1_FRAME_HEADER_FLAG_FRAME_REFS_SHORT_SIGNALING``
+ - 0x00100000
+ - If set, indicates that only two reference frames are explicitly
+ signaled. If not set, indicates that all reference frames are explicitly
+ signaled.
+
+``V4L2_CID_STATELESS_AV1_FILM_GRAIN (struct)``
+ Represents the optional film grain parameters. See section
+ 6.8.20. "Film grain params semantics" of :ref:`av1` for more details.
+
+.. c:type:: v4l2_ctrl_av1_film_grain
+
+.. cssclass:: longtable
+
+.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
+
+.. flat-table:: struct v4l2_av1_film_grain
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - __u8
+ - ``flags``
+ - See :ref:`AV1 Film Grain Flags <av1_film_grain_flags>`.
+ * - __u16
+ - ``grain_seed``
+ - Specifies the starting value for the pseudo-random numbers used during
+ film grain synthesis.
+ * - __u8
+ - ``film_grain_params_ref_idx``
+ - Indicates which reference frame contains the film grain parameters to be
+ used for this frame.
+ * - __u8
+ - ``num_y_points``
+ - Specifies the number of points for the piece-wise linear scaling
+ function of the luma component.
+ * - __u8
+ - ``point_y_value[V4L2_AV1_MAX_NUM_Y_POINTS]``
+ - Represents the x (luma value) coordinate for the i-th point
+ of the piecewise linear scaling function for luma component. The values
+ are signaled on the scale of 0..255. (In case of 10 bit video, these
+ values correspond to luma values divided by 4. In case of 12 bit video,
+ these values correspond to luma values divided by 16.).
+ * - __u8
+ - ``point_y_scaling[V4L2_AV1_MAX_NUM_Y_POINTS]``
+ - Represents the scaling (output) value for the i-th point
+ of the piecewise linear scaling function for luma component.
+ * - __u8
+ - ``num_cb_points``
+ - Specifies the number of points for the piece-wise linear scaling
+ function of the cb component.
+ * - __u8
+ - ``point_cb_value[V4L2_AV1_MAX_NUM_CB_POINTS]``
+ - Represents the x coordinate for the i-th point of the
+ piece-wise linear scaling function for cb component. The values are
+ signaled on the scale of 0..255.
+ * - __u8
+ - ``point_cb_scaling[V4L2_AV1_MAX_NUM_CB_POINTS]``
+ - Represents the scaling (output) value for the i-th point of the
+ piecewise linear scaling function for cb component.
+ * - __u8
+ - ``num_cr_points``
+ - Represents the number of points for the piece-wise
+ linear scaling function of the cr component.
+ * - __u8
+ - ``point_cr_value[V4L2_AV1_MAX_NUM_CR_POINTS]``
+ - Represents the x coordinate for the i-th point of the
+ piece-wise linear scaling function for cr component. The values are
+ signaled on the scale of 0..255.
+ * - __u8
+ - ``point_cr_scaling[V4L2_AV1_MAX_NUM_CR_POINTS]``
+ - Represents the scaling (output) value for the i-th point of the
+ piecewise linear scaling function for cr component.
+ * - __u8
+ - ``grain_scaling_minus_8``
+ - Represents the shift – 8 applied to the values of the chroma component.
+ The grain_scaling_minus_8 can take values of 0..3 and determines the
+ range and quantization step of the standard deviation of film grain.
+ * - __u8
+ - ``ar_coeff_lag``
+ - Specifies the number of auto-regressive coefficients for luma and
+ chroma.
+ * - __u8
+ - ``ar_coeffs_y_plus_128[V4L2_AV1_MAX_NUM_POS_LUMA]``
+ - Specifies auto-regressive coefficients used for the Y plane.
+ * - __u8
+ - ``ar_coeffs_cb_plus_128[V4L2_AV1_MAX_NUM_POS_LUMA]``
+ - Specifies auto-regressive coefficients used for the U plane.
+ * - __u8
+ - ``ar_coeffs_cr_plus_128[V4L2_AV1_MAX_NUM_POS_LUMA]``
+ - Specifies auto-regressive coefficients used for the V plane.
+ * - __u8
+ - ``ar_coeff_shift_minus_6``
+ - Specifies the range of the auto-regressive coefficients. Values of 0,
+ 1, 2, and 3 correspond to the ranges for auto-regressive coefficients of
+ [-2, 2), [-1, 1), [-0.5, 0.5) and [-0.25, 0.25) respectively.
+ * - __u8
+ - ``grain_scale_shift``
+ - Specifies how much the Gaussian random numbers should be scaled down
+ during the grain synthesis process.
+ * - __u8
+ - ``cb_mult``
+ - Represents a multiplier for the cb component used in derivation of the
+ input index to the cb component scaling function.
+ * - __u8
+ - ``cb_luma_mult``
+ - Represents a multiplier for the average luma component used in
+ derivation of the input index to the cb component scaling function..
+ * - __u16
+ - ``cb_offset``
+ - Represents an offset used in derivation of the input index to the
+ cb component scaling function.
+ * - __u8
+ - ``cr_mult``
+ - Represents a multiplier for the cb component used in derivation of the
+ input index to the cr component scaling function.
+ * - __u8
+ - ``cr_luma_mult``
+ - Represents a multiplier for the average luma component used in
+ derivation of the input index to the cr component scaling function.
+ * - __u16
+ - ``cr_offset``
+ - Represents an offset used in derivation of the input index to the
+ cr component scaling function.
+
+.. _av1_film_grain_flags:
+
+``AV1 Film Grain Flags``
+
+.. cssclass:: longtable
+
+.. flat-table::
+ :header-rows: 0
+ :stub-columns: 0
+ :widths: 1 1 2
+
+ * - ``V4L2_AV1_FILM_GRAIN_FLAG_APPLY_GRAIN``
+ - 0x00000001
+ - If set, specifies that film grain should be added to this frame. If not
+ set, specifies that film grain should not be added.
+ * - ``V4L2_AV1_FILM_GRAIN_FLAG_UPDATE_GRAIN``
+ - 0x00000002
+ - If set, means that a new set of parameters should be sent. If not set,
+ specifies that the previous set of parameters should be used.
+ * - ``V4L2_AV1_FILM_GRAIN_FLAG_CHROMA_SCALING_FROM_LUMA``
+ - 0x00000004
+ - If set, specifies that the chroma scaling is inferred from the luma
+ scaling.
+ * - ``V4L2_AV1_FILM_GRAIN_FLAG_OVERLAP``
+ - 0x00000008
+ - If set, indicates that the overlap between film grain blocks shall be
+ applied. If not set, indicates that the overlap between film grain blocks
+ shall not be applied.
+ * - ``V4L2_AV1_FILM_GRAIN_FLAG_CLIP_TO_RESTRICTED_RANGE``
+ - 0x00000010
+ - If set, indicates that clipping to the restricted (studio) range shall
+ be applied to the sample values after adding the film grain (see the
+ semantics for color_range for an explanation of studio swing). If not
+ set, indicates that clipping to the full range shall be applied to the
+ sample values after adding the film grain.
diff --git a/Documentation/userspace-api/media/v4l/pixfmt-compressed.rst b/Documentation/userspace-api/media/v4l/pixfmt-compressed.rst
index 967fc803ef94..46d3f9b46b59 100644
--- a/Documentation/userspace-api/media/v4l/pixfmt-compressed.rst
+++ b/Documentation/userspace-api/media/v4l/pixfmt-compressed.rst
@@ -238,6 +238,23 @@ Compressed Formats
through the ``V4L2_CID_STATELESS_FWHT_PARAMS`` control.
See the :ref:`associated Codec Control ID <codec-stateless-fwht>`.
+ * .. _V4L2-PIX-FMT-AV1-FRAME:
+
+ - ``V4L2_PIX_FMT_AV1_FRAME``
+ - 'AV1F'
+ - AV1 parsed frame, including the frame header, as extracted from the container.
+ This format is adapted for stateless video decoders that implement a AV1
+ pipeline with the :ref:`stateless_decoder`. Metadata associated with the
+ frame to decode is required to be passed through the
+ ``V4L2_CID_STATELESS_AV1_SEQUENCE``, ``V4L2_CID_STATELESS_AV1_FRAME``,
+ ``V4L2_CID_STATELESS_AV1_TILE_GROUP`` and
+ ``V4L2_CID_STATELESS_AV1_TILE_GROUP_ENTRY`` controls.
+ See the :ref:`associated Codec Control IDs <v4l2-codec-stateless-av1>`.
+ Exactly one output and one capture buffer must be provided for use with
+ this pixel format. The output buffer must contain the appropriate number
+ of macroblocks to decode a full corresponding frame to the matching
+ capture buffer.
+
.. raw:: latex
\normalsize
diff --git a/Documentation/userspace-api/media/v4l/vidioc-g-ext-ctrls.rst b/Documentation/userspace-api/media/v4l/vidioc-g-ext-ctrls.rst
index 29971a45a2d4..2771a455eb77 100644
--- a/Documentation/userspace-api/media/v4l/vidioc-g-ext-ctrls.rst
+++ b/Documentation/userspace-api/media/v4l/vidioc-g-ext-ctrls.rst
@@ -241,6 +241,34 @@ still cause this situation.
- ``p_vp9_frame``
- A pointer to a struct :c:type:`v4l2_ctrl_vp9_frame`. Valid if this
control is of type ``V4L2_CTRL_TYPE_VP9_FRAME``.
+ * - struct :c:type:`v4l2_ctrl_av1_sequence` *
+ - ``p_av1_sequence``
+ - A pointer to a struct :c:type:`v4l2_ctrl_av1_sequence`. Valid if this control is
+ of type ``V4L2_CTRL_TYPE_AV1_SEQUENCE``.
+ * - struct :c:type:`v4l2_ctrl_av1_tile_group` *
+ - ``p_av1_tile_group``
+ - A pointer to a struct :c:type:`v4l2_ctrl_av1_tile_group`. Valid if this control is
+ of type ``V4L2_CTRL_TYPE_AV1_TILE_GROUP``.
+ * - struct :c:type:`v4l2_ctrl_av1_tile_group_entry` *
+ - ``p_av1_tile_group_entry``
+ - A pointer to a struct :c:type:`v4l2_ctrl_av1_tile_group_entry`. Valid if this control is
+ of type ``V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY``.
+ * - struct :c:type:`v4l2_ctrl_av1_frame_header` *
+ - ``p_av1_frame_header``
+ - A pointer to a struct :c:type:`v4l2_ctrl_av1_frame_header`. Valid if this control is
+ of type ``V4L2_CTRL_TYPE_AV1_FRAME_HEADER``.
+ * - struct :c:type:`v4l2_ctrl_av1_profile` *
+ - ``p_av1_profile``
+ - A pointer to a struct :c:type:`v4l2_ctrl_av1_profile`. Valid if this control is
+ of type ``V4L2_CTRL_TYPE_AV1_PROFILE``.
+ * - struct :c:type:`v4l2_ctrl_av1_level` *
+ - ``p_av1_level``
+ - A pointer to a struct :c:type:`v4l2_ctrl_av1_level`. Valid if this control is
+ of type ``V4L2_CTRL_TYPE_AV1_LEVEL``.
+ * - struct :c:type:`v4l2_ctrl_av1_film_grain` *
+ - ``p_av1_film_grain``
+ - A pointer to a struct :c:type:`v4l2_ctrl_av1_film_grain`. Valid if this control is
+ of type ``V4L2_CTRL_TYPE_AV1_FILM_GRAIN``.
* - struct :c:type:`v4l2_ctrl_hdr10_cll_info` *
- ``p_hdr10_cll``
- A pointer to a struct :c:type:`v4l2_ctrl_hdr10_cll_info`. Valid if this control is
diff --git a/Documentation/userspace-api/media/v4l/vidioc-queryctrl.rst b/Documentation/userspace-api/media/v4l/vidioc-queryctrl.rst
index a20dfa2a933b..c02d9d11b0dc 100644
--- a/Documentation/userspace-api/media/v4l/vidioc-queryctrl.rst
+++ b/Documentation/userspace-api/media/v4l/vidioc-queryctrl.rst
@@ -525,6 +525,42 @@ See also the examples in :ref:`control`.
- n/a
- A struct :c:type:`v4l2_ctrl_vp9_frame`, containing VP9
frame decode parameters for stateless video decoders.
+ * - ``V4L2_CTRL_TYPE_AV1_SEQUENCE``
+ - n/a
+ - n/a
+ - n/a
+ - A struct :c:type:`v4l2_ctrl_av1_sequence`, containing AV1 Sequence OBU
+ decoding parameters for stateless video decoders.
+ * - ``V4L2_CTRL_TYPE_AV1_TILE_GROUP``
+ - n/a
+ - n/a
+ - n/a
+ - A struct :c:type:`v4l2_ctrl_av1_tile_group`, containing AV1 Tile Group
+ OBU decoding parameters for stateless video decoders.
+ * - ``V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY``
+ - n/a
+ - n/a
+ - n/a
+ - A struct :c:type:`v4l2_ctrl_av1_tile_group_entry`, containing AV1 Tile Group
+ OBU decoding parameters for stateless video decoders.
+ * - ``V4L2_CTRL_TYPE_AV1_FRAME_HEADER``
+ - n/a
+ - n/a
+ - n/a
+ - A struct :c:type:`v4l2_ctrl_av1_frame_header`, containing AV1 Frame/Frame
+ Header OBU decoding parameters for stateless video decoders.
+ * - ``V4L2_CTRL_TYPE_AV1_PROFILE``
+ - n/a
+ - n/a
+ - n/a
+ - A enum :c:type:`v4l2_ctrl_av1_profile`, indicating what AV1 profiles
+ an AV1 stateless decoder might support.
+ * - ``V4L2_CTRL_TYPE_AV1_LEVEL``
+ - n/a
+ - n/a
+ - n/a
+ - A enum :c:type:`v4l2_ctrl_av1_level`, indicating what AV1 levels
+ an AV1 stateless decoder might support.
.. raw:: latex
diff --git a/Documentation/userspace-api/media/videodev2.h.rst.exceptions b/Documentation/userspace-api/media/videodev2.h.rst.exceptions
index 9cbb7a0c354a..38f748228616 100644
--- a/Documentation/userspace-api/media/videodev2.h.rst.exceptions
+++ b/Documentation/userspace-api/media/videodev2.h.rst.exceptions
@@ -146,6 +146,13 @@ replace symbol V4L2_CTRL_TYPE_H264_DECODE_PARAMS :c:type:`v4l2_ctrl_type`
replace symbol V4L2_CTRL_TYPE_HEVC_SPS :c:type:`v4l2_ctrl_type`
replace symbol V4L2_CTRL_TYPE_HEVC_PPS :c:type:`v4l2_ctrl_type`
replace symbol V4L2_CTRL_TYPE_HEVC_SLICE_PARAMS :c:type:`v4l2_ctrl_type`
+replace symbol V4L2_CTRL_TYPE_AV1_SEQUENCE :c:type:`v4l2_ctrl_type`
+replace symbol V4L2_CTRL_TYPE_AV1_TILE_GROUP :c:type:`v4l2_ctrl_type`
+replace symbol V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY :c:type:`v4l2_ctrl_type`
+replace symbol V4L2_CTRL_TYPE_AV1_FRAME_HEADER :c:type:`v4l2_ctrl_type`
+replace symbol V4L2_CTRL_TYPE_AV1_PROFILE :c:type:`v4l2_ctrl_type`
+replace symbol V4L2_CTRL_TYPE_AV1_LEVEL :c:type:`v4l2_ctrl_type`
+replace symbol V4L2_CTRL_TYPE_AV1_FILM_GRAIN :c:type:`v4l2_ctrl_type`
replace symbol V4L2_CTRL_TYPE_AREA :c:type:`v4l2_ctrl_type`
replace symbol V4L2_CTRL_TYPE_FWHT_PARAMS :c:type:`v4l2_ctrl_type`
replace symbol V4L2_CTRL_TYPE_VP8_FRAME :c:type:`v4l2_ctrl_type`
diff --git a/drivers/media/v4l2-core/v4l2-ctrls-core.c b/drivers/media/v4l2-core/v4l2-ctrls-core.c
index cb709c74e01e..7f443e1ed50d 100644
--- a/drivers/media/v4l2-core/v4l2-ctrls-core.c
+++ b/drivers/media/v4l2-core/v4l2-ctrls-core.c
@@ -307,6 +307,22 @@ static void std_log(const struct v4l2_ctrl *ctrl)
case V4L2_CTRL_TYPE_VP9_FRAME:
pr_cont("VP9_FRAME");
break;
+ case V4L2_CTRL_TYPE_AV1_SEQUENCE:
+ pr_cont("AV1_SEQUENCE");
+ break;
+ case V4L2_CTRL_TYPE_AV1_TILE_GROUP:
+ pr_cont("AV1_TILE_GROUP");
+ break;
+ case V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY:
+ pr_cont("AV1_TILE_GROUP_ENTRY");
+ break;
+ case V4L2_CTRL_TYPE_AV1_FRAME_HEADER:
+ pr_cont("AV1_FRAME_HEADER");
+ break;
+ case V4L2_CTRL_TYPE_AV1_FILM_GRAIN:
+ pr_cont("AV1_FILM_GRAIN");
+ break;
+
default:
pr_cont("unknown type %d", ctrl->type);
break;
@@ -503,6 +519,243 @@ validate_vp9_frame(struct v4l2_ctrl_vp9_frame *frame)
return 0;
}
+static int validate_av1_quantization(struct v4l2_av1_quantization *q)
+{
+ if (q->flags > GENMASK(2, 0))
+ return -EINVAL;
+
+ if (q->delta_q_y_dc < -64 || q->delta_q_y_dc > 63 ||
+ q->delta_q_u_dc < -64 || q->delta_q_u_dc > 63 ||
+ q->delta_q_v_dc < -64 || q->delta_q_v_dc > 63 ||
+ q->delta_q_u_ac < -64 || q->delta_q_u_ac > 63 ||
+ q->delta_q_v_ac < -64 || q->delta_q_v_ac > 63 ||
+ q->delta_q_res > GENMASK(1, 0))
+ return -EINVAL;
+
+ if (q->qm_y > GENMASK(3, 0) ||
+ q->qm_u > GENMASK(3, 0) ||
+ q->qm_v > GENMASK(3, 0))
+ return -EINVAL;
+
+ return 0;
+}
+
+static int validate_av1_segmentation(struct v4l2_av1_segmentation *s)
+{
+ u32 i;
+ u32 j;
+ s32 limit;
+
+ if (s->flags > GENMASK(4, 0))
+ return -EINVAL;
+
+ for (i = 0; i < ARRAY_SIZE(s->feature_data); i++) {
+ const int segmentation_feature_signed[] = { 1, 1, 1, 1, 1, 0, 0, 0 };
+ const int segmentation_feature_max[] = { 255, 63, 63, 63, 63, 7, 0, 0};
+
+ for (j = 0; j < ARRAY_SIZE(s->feature_data[j]); j++) {
+ if (segmentation_feature_signed[j]) {
+ limit = segmentation_feature_max[j];
+
+ if (s->feature_data[i][j] < -limit ||
+ s->feature_data[i][j] > limit)
+ return -EINVAL;
+ } else {
+ if (s->feature_data[i][j] > limit)
+ return -EINVAL;
+ }
+ }
+ }
+
+ return 0;
+}
+
+static int validate_av1_loop_filter(struct v4l2_av1_loop_filter *lf)
+{
+ u32 i;
+
+ if (lf->flags > GENMASK(2, 0))
+ return -EINVAL;
+
+ for (i = 0; i < ARRAY_SIZE(lf->level); i++) {
+ if (lf->level[i] > GENMASK(5, 0))
+ return -EINVAL;
+ }
+
+ if (lf->sharpness > GENMASK(2, 0))
+ return -EINVAL;
+
+ for (i = 0; i < ARRAY_SIZE(lf->ref_deltas); i++) {
+ if (lf->ref_deltas[i] < -64 || lf->ref_deltas[i] > 63)
+ return -EINVAL;
+ }
+
+ for (i = 0; i < ARRAY_SIZE(lf->mode_deltas); i++) {
+ if (lf->mode_deltas[i] < -64 || lf->mode_deltas[i] > 63)
+ return -EINVAL;
+ }
+
+ return 0;
+}
+
+static int validate_av1_cdef(struct v4l2_av1_cdef *cdef)
+{
+ u32 i;
+
+ if (cdef->damping_minus_3 > GENMASK(1, 0) ||
+ cdef->bits > GENMASK(1, 0))
+ return -EINVAL;
+
+ for (i = 0; i < 1 << cdef->bits; i++) {
+ if (cdef->y_pri_strength[i] > GENMASK(3, 0) ||
+ cdef->y_sec_strength[i] > 4 ||
+ cdef->uv_pri_strength[i] > GENMASK(3, 0) ||
+ cdef->uv_sec_strength[i] > 4)
+ return -EINVAL;
+ }
+
+ return 0;
+}
+
+static int validate_av1_loop_restauration(struct v4l2_av1_loop_restoration *lr)
+{
+ if (lr->lr_unit_shift > 3 || lr->lr_uv_shift > 1)
+ return -EINVAL;
+
+ return 0;
+}
+
+static int validate_av1_film_grain(struct v4l2_ctrl_av1_film_grain *fg)
+{
+ u32 i;
+
+ if (fg->flags > GENMASK(4, 0))
+ return -EINVAL;
+
+ if (fg->film_grain_params_ref_idx > GENMASK(2, 0) ||
+ fg->num_y_points > 14 ||
+ fg->num_cb_points > 10 ||
+ fg->num_cr_points > GENMASK(3, 0) ||
+ fg->grain_scaling_minus_8 > GENMASK(1, 0) ||
+ fg->ar_coeff_lag > GENMASK(1, 0) ||
+ fg->ar_coeff_shift_minus_6 > GENMASK(1, 0) ||
+ fg->grain_scale_shift > GENMASK(1, 0))
+ return -EINVAL;
+
+ if (!(fg->flags & V4L2_AV1_FILM_GRAIN_FLAG_APPLY_GRAIN))
+ return 0;
+
+ for (i = 1; i < fg->num_y_points; i++)
+ if (fg->point_y_value[i] <= fg->point_y_value[i - 1])
+ return -EINVAL;
+
+ for (i = 1; i < fg->num_cb_points; i++)
+ if (fg->point_cb_value[i] <= fg->point_cb_value[i - 1])
+ return -EINVAL;
+
+ for (i = 1; i < fg->num_cr_points; i++)
+ if (fg->point_cr_value[i] <= fg->point_cr_value[i - 1])
+ return -EINVAL;
+
+ return 0;
+}
+
+static int validate_av1_frame_header(struct v4l2_ctrl_av1_frame_header *f)
+{
+ int ret = 0;
+
+ ret = validate_av1_quantization(&f->quantization);
+ if (ret)
+ return ret;
+ ret = validate_av1_segmentation(&f->segmentation);
+ if (ret)
+ return ret;
+ ret = validate_av1_loop_filter(&f->loop_filter);
+ if (ret)
+ return ret;
+ ret = validate_av1_cdef(&f->cdef);
+ if (ret)
+ return ret;
+ ret = validate_av1_loop_restauration(&f->loop_restoration);
+ if (ret)
+ return ret;
+
+ if (f->flags &
+ ~(V4L2_AV1_FRAME_HEADER_FLAG_SHOW_FRAME |
+ V4L2_AV1_FRAME_HEADER_FLAG_SHOWABLE_FRAME |
+ V4L2_AV1_FRAME_HEADER_FLAG_ERROR_RESILIENT_MODE |
+ V4L2_AV1_FRAME_HEADER_FLAG_DISABLE_CDF_UPDATE |
+ V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_SCREEN_CONTENT_TOOLS |
+ V4L2_AV1_FRAME_HEADER_FLAG_FORCE_INTEGER_MV |
+ V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_INTRABC |
+ V4L2_AV1_FRAME_HEADER_FLAG_USE_SUPERRES |
+ V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_HIGH_PRECISION_MV |
+ V4L2_AV1_FRAME_HEADER_FLAG_IS_MOTION_MODE_SWITCHABLE |
+ V4L2_AV1_FRAME_HEADER_FLAG_USE_REF_FRAME_MVS |
+ V4L2_AV1_FRAME_HEADER_FLAG_DISABLE_FRAME_END_UPDATE_CDF |
+ V4L2_AV1_FRAME_HEADER_FLAG_UNIFORM_TILE_SPACING |
+ V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_WARPED_MOTION |
+ V4L2_AV1_FRAME_HEADER_FLAG_REFERENCE_SELECT |
+ V4L2_AV1_FRAME_HEADER_FLAG_REDUCED_TX_SET |
+ V4L2_AV1_FRAME_HEADER_FLAG_SKIP_MODE_ALLOWED |
+ V4L2_AV1_FRAME_HEADER_FLAG_SKIP_MODE_PRESENT |
+ V4L2_AV1_FRAME_HEADER_FLAG_FRAME_SIZE_OVERRIDE |
+ V4L2_AV1_FRAME_HEADER_FLAG_BUFFER_REMOVAL_TIME_PRESENT |
+ V4L2_AV1_FRAME_HEADER_FLAG_FRAME_REFS_SHORT_SIGNALING))
+ return -EINVAL;
+
+ if (f->superres_denom > GENMASK(2, 0) + 9)
+ return -EINVAL;
+
+ return 0;
+}
+
+static int validate_av1_sequence(struct v4l2_ctrl_av1_sequence *s)
+{
+ if (s->flags &
+ ~(V4L2_AV1_SEQUENCE_FLAG_STILL_PICTURE |
+ V4L2_AV1_SEQUENCE_FLAG_USE_128X128_SUPERBLOCK |
+ V4L2_AV1_SEQUENCE_FLAG_ENABLE_FILTER_INTRA |
+ V4L2_AV1_SEQUENCE_FLAG_ENABLE_INTRA_EDGE_FILTER |
+ V4L2_AV1_SEQUENCE_FLAG_ENABLE_INTERINTRA_COMPOUND |
+ V4L2_AV1_SEQUENCE_FLAG_ENABLE_MASKED_COMPOUND |
+ V4L2_AV1_SEQUENCE_FLAG_ENABLE_WARPED_MOTION |
+ V4L2_AV1_SEQUENCE_FLAG_ENABLE_DUAL_FILTER |
+ V4L2_AV1_SEQUENCE_FLAG_ENABLE_ORDER_HINT |
+ V4L2_AV1_SEQUENCE_FLAG_ENABLE_JNT_COMP |
+ V4L2_AV1_SEQUENCE_FLAG_ENABLE_REF_FRAME_MVS |
+ V4L2_AV1_SEQUENCE_FLAG_ENABLE_SUPERRES |
+ V4L2_AV1_SEQUENCE_FLAG_ENABLE_CDEF |
+ V4L2_AV1_SEQUENCE_FLAG_ENABLE_RESTORATION |
+ V4L2_AV1_SEQUENCE_FLAG_MONO_CHROME |
+ V4L2_AV1_SEQUENCE_FLAG_COLOR_RANGE |
+ V4L2_AV1_SEQUENCE_FLAG_SUBSAMPLING_X |
+ V4L2_AV1_SEQUENCE_FLAG_SUBSAMPLING_Y |
+ V4L2_AV1_SEQUENCE_FLAG_FILM_GRAIN_PARAMS_PRESENT |
+ V4L2_AV1_SEQUENCE_FLAG_SEPARATE_UV_DELTA_Q))
+ return -EINVAL;
+
+ if (s->seq_profile == 1 && s->flags & V4L2_AV1_SEQUENCE_FLAG_MONO_CHROME)
+ return -EINVAL;
+
+ /* reserved */
+ if (s->seq_profile > 2)
+ return -EINVAL;
+
+ /* TODO: PROFILES */
+ return 0;
+}
+
+static int validate_av1_tile_group(struct v4l2_ctrl_av1_tile_group *t)
+{
+ if (t->flags & ~(V4L2_AV1_TILE_GROUP_FLAG_START_AND_END_PRESENT))
+ return -EINVAL;
+ if (t->tg_start > t->tg_end)
+ return -EINVAL;
+
+ return 0;
+}
+
/*
* Compound controls validation requires setting unused fields/flags to zero
* in order to properly detect unchanged controls with std_equal's memcmp.
@@ -759,7 +1012,17 @@ static int std_validate_compound(const struct v4l2_ctrl *ctrl, u32 idx,
zero_padding(p_vp8_frame->entropy);
zero_padding(p_vp8_frame->coder_state);
break;
-
+ case V4L2_CTRL_TYPE_AV1_FRAME_HEADER:
+ return validate_av1_frame_header(p);
+ case V4L2_CTRL_TYPE_AV1_SEQUENCE:
+ return validate_av1_sequence(p);
+ case V4L2_CTRL_TYPE_AV1_TILE_GROUP:
+ return validate_av1_tile_group(p);
+ case V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY:
+ break;
+ case V4L2_CTRL_TYPE_AV1_FILM_GRAIN:
+ return validate_av1_film_grain(p);
+ break;
case V4L2_CTRL_TYPE_HEVC_SPS:
p_hevc_sps = p;
@@ -1508,6 +1771,21 @@ static struct v4l2_ctrl *v4l2_ctrl_new(struct v4l2_ctrl_handler *hdl,
case V4L2_CTRL_TYPE_VP8_FRAME:
elem_size = sizeof(struct v4l2_ctrl_vp8_frame);
break;
+ case V4L2_CTRL_TYPE_AV1_SEQUENCE:
+ elem_size = sizeof(struct v4l2_ctrl_av1_sequence);
+ break;
+ case V4L2_CTRL_TYPE_AV1_TILE_GROUP:
+ elem_size = sizeof(struct v4l2_ctrl_av1_tile_group);
+ break;
+ case V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY:
+ elem_size = sizeof(struct v4l2_ctrl_av1_tile_group_entry);
+ break;
+ case V4L2_CTRL_TYPE_AV1_FRAME_HEADER:
+ elem_size = sizeof(struct v4l2_ctrl_av1_frame_header);
+ break;
+ case V4L2_CTRL_TYPE_AV1_FILM_GRAIN:
+ elem_size = sizeof(struct v4l2_ctrl_av1_film_grain);
+ break;
case V4L2_CTRL_TYPE_HEVC_SPS:
elem_size = sizeof(struct v4l2_ctrl_hevc_sps);
break;
diff --git a/drivers/media/v4l2-core/v4l2-ctrls-defs.c b/drivers/media/v4l2-core/v4l2-ctrls-defs.c
index 54ca4e6b820b..7bb80192b592 100644
--- a/drivers/media/v4l2-core/v4l2-ctrls-defs.c
+++ b/drivers/media/v4l2-core/v4l2-ctrls-defs.c
@@ -499,6 +499,40 @@ const char * const *v4l2_ctrl_get_menu(u32 id)
NULL,
};
+ static const char * const av1_profile[] = {
+ "Main",
+ "High",
+ "Professional",
+ NULL,
+ };
+ static const char * const av1_level[] = {
+ "2.0",
+ "2.1",
+ "2.2",
+ "2.3",
+ "3.0",
+ "3.1",
+ "3.2",
+ "3.3",
+ "4.0",
+ "4.1",
+ "4.2",
+ "4.3",
+ "5.0",
+ "5.1",
+ "5.2",
+ "5.3",
+ "6.0",
+ "6.1",
+ "6.2",
+ "6.3",
+ "7.0",
+ "7.1",
+ "7.2",
+ "7.3",
+ NULL,
+ };
+
static const char * const hevc_profile[] = {
"Main",
"Main Still Picture",
@@ -685,6 +719,10 @@ const char * const *v4l2_ctrl_get_menu(u32 id)
return dv_it_content_type;
case V4L2_CID_DETECT_MD_MODE:
return detect_md_mode;
+ case V4L2_CID_STATELESS_AV1_PROFILE:
+ return av1_profile;
+ case V4L2_CID_STATELESS_AV1_LEVEL:
+ return av1_level;
case V4L2_CID_MPEG_VIDEO_HEVC_PROFILE:
return hevc_profile;
case V4L2_CID_MPEG_VIDEO_HEVC_LEVEL:
@@ -1180,6 +1218,13 @@ const char *v4l2_ctrl_get_name(u32 id)
case V4L2_CID_STATELESS_MPEG2_QUANTISATION: return "MPEG-2 Quantisation Matrices";
case V4L2_CID_STATELESS_VP9_COMPRESSED_HDR: return "VP9 Probabilities Updates";
case V4L2_CID_STATELESS_VP9_FRAME: return "VP9 Frame Decode Parameters";
+ case V4L2_CID_STATELESS_AV1_SEQUENCE: return "AV1 Sequence parameters";
+ case V4L2_CID_STATELESS_AV1_TILE_GROUP: return "AV1 Tile Group";
+ case V4L2_CID_STATELESS_AV1_TILE_GROUP_ENTRY: return "AV1 Tile Group Entry";
+ case V4L2_CID_STATELESS_AV1_FRAME_HEADER: return "AV1 Frame Header parameters";
+ case V4L2_CID_STATELESS_AV1_PROFILE: return "AV1 Profile";
+ case V4L2_CID_STATELESS_AV1_LEVEL: return "AV1 Level";
+ case V4L2_CID_STATELESS_AV1_FILM_GRAIN: return "AV1 Film Grain";
/* Colorimetry controls */
/* Keep the order of the 'case's the same as in v4l2-controls.h! */
@@ -1348,6 +1393,8 @@ void v4l2_ctrl_fill(u32 id, const char **name, enum v4l2_ctrl_type *type,
case V4L2_CID_MPEG_VIDEO_VP9_PROFILE:
case V4L2_CID_MPEG_VIDEO_VP9_LEVEL:
case V4L2_CID_DETECT_MD_MODE:
+ case V4L2_CID_STATELESS_AV1_PROFILE:
+ case V4L2_CID_STATELESS_AV1_LEVEL:
case V4L2_CID_MPEG_VIDEO_HEVC_PROFILE:
case V4L2_CID_MPEG_VIDEO_HEVC_LEVEL:
case V4L2_CID_MPEG_VIDEO_HEVC_HIER_CODING_TYPE:
@@ -1493,6 +1540,23 @@ void v4l2_ctrl_fill(u32 id, const char **name, enum v4l2_ctrl_type *type,
case V4L2_CID_STATELESS_VP8_FRAME:
*type = V4L2_CTRL_TYPE_VP8_FRAME;
break;
+ case V4L2_CID_STATELESS_AV1_SEQUENCE:
+ *type = V4L2_CTRL_TYPE_AV1_SEQUENCE;
+ break;
+ case V4L2_CID_STATELESS_AV1_TILE_GROUP:
+ *type = V4L2_CTRL_TYPE_AV1_TILE_GROUP;
+ *flags |= V4L2_CTRL_FLAG_DYNAMIC_ARRAY;
+ break;
+ case V4L2_CID_STATELESS_AV1_TILE_GROUP_ENTRY:
+ *type = V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY;
+ *flags |= V4L2_CTRL_FLAG_DYNAMIC_ARRAY;
+ break;
+ case V4L2_CID_STATELESS_AV1_FRAME_HEADER:
+ *type = V4L2_CTRL_TYPE_AV1_FRAME_HEADER;
+ break;
+ case V4L2_CID_STATELESS_AV1_FILM_GRAIN:
+ *type = V4L2_CTRL_TYPE_AV1_FILM_GRAIN;
+ break;
case V4L2_CID_MPEG_VIDEO_HEVC_SPS:
*type = V4L2_CTRL_TYPE_HEVC_SPS;
break;
diff --git a/drivers/media/v4l2-core/v4l2-ioctl.c b/drivers/media/v4l2-core/v4l2-ioctl.c
index 96e307fe3aab..b9720028e57d 100644
--- a/drivers/media/v4l2-core/v4l2-ioctl.c
+++ b/drivers/media/v4l2-core/v4l2-ioctl.c
@@ -1441,6 +1441,7 @@ static void v4l_fill_fmtdesc(struct v4l2_fmtdesc *fmt)
case V4L2_PIX_FMT_SE401: descr = "GSPCA SE401"; break;
case V4L2_PIX_FMT_S5C_UYVY_JPG: descr = "S5C73MX interleaved UYVY/JPEG"; break;
case V4L2_PIX_FMT_MT21C: descr = "Mediatek Compressed Format"; break;
+ case V4L2_PIX_FMT_AV1_FRAME: descr = "AV1 Frame"; break;
default:
if (fmt->description[0])
return;
diff --git a/include/media/v4l2-ctrls.h b/include/media/v4l2-ctrls.h
index f4105de8a8d2..6dcaeeee774e 100644
--- a/include/media/v4l2-ctrls.h
+++ b/include/media/v4l2-ctrls.h
@@ -58,6 +58,11 @@ struct video_device;
* @p_hdr10_cll: Pointer to an HDR10 Content Light Level structure.
* @p_hdr10_mastering: Pointer to an HDR10 Mastering Display structure.
* @p_area: Pointer to an area.
+ * @p_av1_sequence: Pointer to an AV1 sequence.
+ * @p_av1_tile_group: Pointer to an AV1 tile group.
+ * @p_av1_tile_group_entry: Pointer to an AV1 tile group entry.
+ * @p_av1_frame_header: Pointer to an AV1 frame header.
+ * @p_av1_film_grain: Pointer to an AV1 film_grain.
* @p: Pointer to a compound value.
* @p_const: Pointer to a constant compound value.
*/
@@ -87,6 +92,11 @@ union v4l2_ctrl_ptr {
struct v4l2_ctrl_hdr10_cll_info *p_hdr10_cll;
struct v4l2_ctrl_hdr10_mastering_display *p_hdr10_mastering;
struct v4l2_area *p_area;
+ struct v4l2_ctrl_av1_sequence *p_av1_sequence;
+ struct v4l2_ctrl_av1_tile_group *p_av1_tile_group;
+ struct v4l2_ctrl_av1_tile_group_entry *p_av1_tile_group_entry;
+ struct v4l2_ctrl_av1_frame_header *p_av1_frame_header;
+ struct v4l2_ctrl_av1_film_grain *p_av1_film_grain;
void *p;
const void *p_const;
};
diff --git a/include/uapi/linux/v4l2-controls.h b/include/uapi/linux/v4l2-controls.h
index bb40129446d4..03eb16099c9f 100644
--- a/include/uapi/linux/v4l2-controls.h
+++ b/include/uapi/linux/v4l2-controls.h
@@ -1992,6 +1992,749 @@ struct v4l2_ctrl_mpeg2_quantisation {
__u8 chroma_non_intra_quantiser_matrix[64];
};
+/* Stateless AV1 controls */
+
+#define V4L2_AV1_TOTAL_REFS_PER_FRAME 8
+#define V4L2_AV1_CDEF_MAX 8
+#define V4L2_AV1_NUM_PLANES_MAX 3 /* 1 if monochrome, 3 otherwise */
+#define V4L2_AV1_MAX_SEGMENTS 8
+#define V4L2_AV1_MAX_OPERATING_POINTS (1 << 5) /* 5 bits to encode */
+#define V4L2_AV1_REFS_PER_FRAME 7
+#define V4L2_AV1_MAX_NUM_Y_POINTS (1 << 4) /* 4 bits to encode */
+#define V4L2_AV1_MAX_NUM_CB_POINTS (1 << 4) /* 4 bits to encode */
+#define V4L2_AV1_MAX_NUM_CR_POINTS (1 << 4) /* 4 bits to encode */
+#define V4L2_AV1_MAX_NUM_POS_LUMA 25 /* (2 * 3 * (3 + 1)) + 1 */
+#define V4L2_AV1_MAX_NUM_PLANES 3
+#define V4L2_AV1_MAX_TILE_COLS 64
+#define V4L2_AV1_MAX_TILE_ROWS 64
+#define V4L2_AV1_MAX_TILE_COUNT 512
+
+#define V4L2_AV1_SEQUENCE_FLAG_STILL_PICTURE BIT(0)
+#define V4L2_AV1_SEQUENCE_FLAG_USE_128X128_SUPERBLOCK BIT(1)
+#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_FILTER_INTRA BIT(2)
+#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_INTRA_EDGE_FILTER BIT(3)
+#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_INTERINTRA_COMPOUND BIT(4)
+#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_MASKED_COMPOUND BIT(5)
+#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_WARPED_MOTION BIT(6)
+#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_DUAL_FILTER BIT(7)
+#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_ORDER_HINT BIT(8)
+#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_JNT_COMP BIT(9)
+#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_REF_FRAME_MVS BIT(10)
+#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_SUPERRES BIT(11)
+#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_CDEF BIT(12)
+#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_RESTORATION BIT(13)
+#define V4L2_AV1_SEQUENCE_FLAG_MONO_CHROME BIT(14)
+#define V4L2_AV1_SEQUENCE_FLAG_COLOR_RANGE BIT(15)
+#define V4L2_AV1_SEQUENCE_FLAG_SUBSAMPLING_X BIT(16)
+#define V4L2_AV1_SEQUENCE_FLAG_SUBSAMPLING_Y BIT(17)
+#define V4L2_AV1_SEQUENCE_FLAG_FILM_GRAIN_PARAMS_PRESENT BIT(18)
+#define V4L2_AV1_SEQUENCE_FLAG_SEPARATE_UV_DELTA_Q BIT(19)
+
+#define V4L2_CID_STATELESS_AV1_SEQUENCE (V4L2_CID_CODEC_STATELESS_BASE + 401)
+/**
+ * struct v4l2_ctrl_av1_sequence - AV1 Sequence
+ *
+ * Represents an AV1 Sequence OBU. See section 5.5. "Sequence header OBU syntax"
+ * for more details.
+ *
+ * @flags: See V4L2_AV1_SEQUENCE_FLAG_{}.
+ * @seq_profile: specifies the features that can be used in the coded video
+ * sequence.
+ * @order_hint_bits: specifies the number of bits used for the order_hint field
+ * at each frame.
+ * @bit_depth: the bitdepth to use for the sequence as described in section
+ * 5.5.2 "Color config syntax".
+ * @max_frame_width_minus_1: specifies the maximum frame width minus 1 for the
+ * frames represented by this sequence header.
+ * @max_frame_height_minus_1: specifies the maximum frame height minus 1 for the
+ * frames represented by this sequence header.
+ */
+struct v4l2_ctrl_av1_sequence {
+ __u32 flags;
+ __u8 seq_profile;
+ __u8 order_hint_bits;
+ __u8 bit_depth;
+ __u16 max_frame_width_minus_1;
+ __u16 max_frame_height_minus_1;
+};
+
+#define V4L2_AV1_TILE_GROUP_FLAG_START_AND_END_PRESENT BIT(0)
+
+#define V4L2_CID_STATELESS_AV1_TILE_GROUP (V4L2_CID_CODEC_STATELESS_BASE + 402)
+/**
+ * struct v4l2_ctrl_av1_tile_group - AV1 Tile Group header.
+ *
+ * Represents a tile group as seen in an AV1 Tile Group OBU or Frame OBU. A
+ * v4l2_ctrl_av1_tile_group instance will refer to tg_end - tg_start instances
+ * of v4l2_ctrl_tile_group_entry. See section 6.10.1 "General tile group OBU
+ * semantics" for more details.
+ *
+ * @flags: see V4L2_AV1_TILE_GROUP_FLAG_{}.
+ * @tg_start: specifies the zero-based index of the first tile in the current
+ * tile group.
+ * @tg_end: specifies the zero-based index of the last tile in the current tile
+ * group.
+ */
+struct v4l2_ctrl_av1_tile_group {
+ __u8 flags;
+ __u32 tg_start;
+ __u32 tg_end;
+};
+
+#define V4L2_CID_STATELESS_AV1_TILE_GROUP_ENTRY (V4L2_CID_CODEC_STATELESS_BASE + 403)
+/**
+ * struct v4l2_ctrl_av1_tile_group_entry - AV1 Tile Group entry
+ *
+ * Represents a single AV1 tile inside an AV1 Tile Group. Note that MiRowStart,
+ * MiRowEnd, MiColStart and MiColEnd can be retrieved from struct
+ * v4l2_av1_tile_info in struct v4l2_ctrl_av1_frame_header using tile_row and
+ * tile_col. See section 6.10.1 "General tile group OBU semantics" for more
+ * details.
+ *
+ * @tile_offset: offset from the OBU data, i.e. where the coded tile data
+ * actually starts.
+ * @tile_size: specifies the size in bytes of the coded tile. Equivalent to
+ * "TileSize" in the AV1 Specification.
+ * @tile_row: specifies the row of the current tile. Equivalent to "TileRow" in
+ * the AV1 Specification.
+ * @tile_col: specifies the col of the current tile. Equivalent to "TileCol" in
+ * the AV1 Specification.
+ */
+struct v4l2_ctrl_av1_tile_group_entry {
+ __u32 tile_offset;
+ __u32 tile_size;
+ __u32 tile_row;
+ __u32 tile_col;
+};
+
+/**
+ * enum v4l2_av1_warp_model - AV1 Warp Model as described in section 3
+ * "Symbols and abbreviated terms" of the AV1 Specification.
+ *
+ * @V4L2_AV1_WARP_MODEL_IDENTITY: Warp model is just an identity transform.
+ * @V4L2_AV1_WARP_MODEL_TRANSLATION: Warp model is a pure translation.
+ * @V4L2_AV1_WARP_MODEL_ROTZOOM: Warp model is a rotation + symmetric zoom +
+ * translation.
+ * @V4L2_AV1_WARP_MODEL_AFFINE: Warp model is a general affine transform.
+ */
+enum v4l2_av1_warp_model {
+ V4L2_AV1_WARP_MODEL_IDENTITY = 0,
+ V4L2_AV1_WARP_MODEL_TRANSLATION = 1,
+ V4L2_AV1_WARP_MODEL_ROTZOOM = 2,
+ V4L2_AV1_WARP_MODEL_AFFINE = 3,
+};
+
+/**
+ * enum v4l2_av1_reference_frame - AV1 reference frames
+ *
+ * @V4L2_AV1_REF_INTRA_FRAME: Intra Frame Reference
+ * @V4L2_AV1_REF_LAST_FRAME: Last Reference Frame
+ * @V4L2_AV1_REF_LAST2_FRAME: Last2 Reference Frame
+ * @V4L2_AV1_REF_LAST3_FRAME: Last3 Reference Frame
+ * @V4L2_AV1_REF_GOLDEN_FRAME: Golden Reference Frame
+ * @V4L2_AV1_REF_BWDREF_FRAME: BWD Reference Frame
+ * @V4L2_AV1_REF_ALTREF2_FRAME: Alternative2 Reference Frame
+ * @V4L2_AV1_REF_ALTREF_FRAME: Alternative Reference Frame
+ * @V4L2_AV1_NUM_REF_FRAMES: Total Reference Frame Number
+ */
+enum v4l2_av1_reference_frame {
+ V4L2_AV1_REF_INTRA_FRAME = 0,
+ V4L2_AV1_REF_LAST_FRAME = 1,
+ V4L2_AV1_REF_LAST2_FRAME = 2,
+ V4L2_AV1_REF_LAST3_FRAME = 3,
+ V4L2_AV1_REF_GOLDEN_FRAME = 4,
+ V4L2_AV1_REF_BWDREF_FRAME = 5,
+ V4L2_AV1_REF_ALTREF2_FRAME = 6,
+ V4L2_AV1_REF_ALTREF_FRAME = 7,
+ V4L2_AV1_NUM_REF_FRAMES,
+};
+
+#define V4L2_AV1_GLOBAL_MOTION_IS_INVALID(ref) (1 << (ref))
+
+#define V4L2_AV1_GLOBAL_MOTION_FLAG_IS_GLOBAL BIT(0)
+#define V4L2_AV1_GLOBAL_MOTION_FLAG_IS_ROT_ZOOM BIT(1)
+#define V4L2_AV1_GLOBAL_MOTION_FLAG_IS_TRANSLATION BIT(2)
+/**
+ * struct v4l2_av1_global_motion - AV1 Global Motion parameters as described in
+ * section 6.8.17 "Global motion params semantics" of the AV1 specification.
+ *
+ * @flags: A bitfield containing the flags per reference frame. See
+ * V4L2_AV1_GLOBAL_MOTION_FLAG_{}
+ * @type: The type of global motion transform used.
+ * @params: this field has the same meaning as "gm_params" in the AV1
+ * specification.
+ * @invalid: bitfield indicating whether the global motion params are invalid
+ * for a given reference frame. See section 7.11.3.6. Setup shear process and
+ * the variable "warpValid". Use V4L2_AV1_GLOBAL_MOTION_IS_INVALID(ref) to
+ * create a suitable mask.
+ */
+
+struct v4l2_av1_global_motion {
+ __u8 flags[V4L2_AV1_TOTAL_REFS_PER_FRAME];
+ enum v4l2_av1_warp_model type[V4L2_AV1_TOTAL_REFS_PER_FRAME];
+ __u32 params[V4L2_AV1_TOTAL_REFS_PER_FRAME][6];
+ __u8 invalid;
+};
+
+/**
+ * enum v4l2_av1_frame_restoration_type - AV1 Frame Restoration Type
+ * @V4L2_AV1_FRAME_RESTORE_NONE: no filtering is applied.
+ * @V4L2_AV1_FRAME_RESTORE_WIENER: Wiener filter process is invoked.
+ * @V4L2_AV1_FRAME_RESTORE_SGRPROJ: self guided filter process is invoked.
+ * @V4L2_AV1_FRAME_RESTORE_SWITCHABLE: restoration filter is swichtable.
+ */
+enum v4l2_av1_frame_restoration_type {
+ V4L2_AV1_FRAME_RESTORE_NONE = 0,
+ V4L2_AV1_FRAME_RESTORE_WIENER = 1,
+ V4L2_AV1_FRAME_RESTORE_SGRPROJ = 2,
+ V4L2_AV1_FRAME_RESTORE_SWITCHABLE = 3,
+};
+
+#define V4L2_AV1_LOOP_RESTORATION_FLAG_USES_LR BIT(0)
+#define V4L2_AV1_LOOP_RESTORATION_FLAG_USES_CHROMA_LR BIT(1)
+
+/**
+ * struct v4l2_av1_loop_restoration - AV1 Loop Restauration as described in
+ * section 6.10.15 "Loop restoration params semantics" of the AV1 specification.
+ *
+ * @flags: See V4L2_AV1_LOOP_RESTORATION_FLAG_{}.
+ * @frame_restoration_type: specifies the type of restoration used for each
+ * plane. See enum_v4l2_av1_frame_restoration_type.
+ * @lr_unit_shift: specifies if the luma restoration size should be halved.
+ * @lr_uv_shift: specifies if the chroma size should be half the luma size.
+ * @loop_restoration_size: specifies the size of loop restoration units in units
+ * of samples in the current plane.
+ */
+struct v4l2_av1_loop_restoration {
+ u8 flags;
+ enum v4l2_av1_frame_restoration_type frame_restoration_type[V4L2_AV1_NUM_PLANES_MAX];
+ __u8 lr_unit_shift;
+ __u8 lr_uv_shift;
+ __u32 loop_restoration_size[V4L2_AV1_MAX_NUM_PLANES];
+};
+
+/**
+ * struct v4l2_av1_cdef - AV1 CDEF params semantics as described in section
+ * 6.10.14. "CDEF params semantics" of the AV1 specification
+ *
+ * @damping_minus_3: controls the amount of damping in the deringing filter.
+ * @bits: specifies the number of bits needed to specify which CDEF filter to
+ * apply.
+ * @y_pri_strength: specifies the strength of the primary filter.
+ * @y_sec_strength: specifies the strength of the secondary filter.
+ * @uv_pri_strength: specifies the strength of the primary filter.
+ * @uv_sec_strength: specifies the strength of the secondary filter.
+ */
+struct v4l2_av1_cdef {
+ __u8 damping_minus_3;
+ __u8 bits;
+ __u8 y_pri_strength[V4L2_AV1_CDEF_MAX];
+ __u8 y_sec_strength[V4L2_AV1_CDEF_MAX];
+ __u8 uv_pri_strength[V4L2_AV1_CDEF_MAX];
+ __u8 uv_sec_strength[V4L2_AV1_CDEF_MAX];
+};
+
+#define V4L2_AV1_SEGMENTATION_FLAG_ENABLED BIT(0)
+#define V4L2_AV1_SEGMENTATION_FLAG_UPDATE_MAP BIT(1)
+#define V4L2_AV1_SEGMENTATION_FLAG_TEMPORAL_UPDATE BIT(2)
+#define V4L2_AV1_SEGMENTATION_FLAG_UPDATE_DATA BIT(3)
+#define V4L2_AV1_SEGMENTATION_FLAG_SEG_ID_PRE_SKIP BIT(4)
+
+/**
+ * enum v4l2_av1_segment_feature - AV1 segment features as described in section
+ * 3 "Symbols and abbreviated terms" of the AV1 specification.
+ *
+ * @V4L2_AV1_SEG_LVL_ALT_Q: Index for quantizer segment feature.
+ * @V4L2_AV1_SEG_LVL_ALT_LF_Y_V: Index for vertical luma loop filter segment
+ * feature.
+ * @V4L2_AV1_SEG_LVL_REF_FRAME: Index for reference frame segment feature.
+ * @V4L2_AV1_SEG_LVL_SKIP: Index for skip segment feature.
+ * @V4L2_AV1_SEG_LVL_GLOBALMV: Index for global mv feature.
+ * @V4L2_AV1_SEG_LVL_MAX: Number of segment features.
+ */
+enum v4l2_av1_segment_feature {
+ V4L2_AV1_SEG_LVL_ALT_Q = 0,
+ V4L2_AV1_SEG_LVL_ALT_LF_Y_V = 1,
+ V4L2_AV1_SEG_LVL_REF_FRAME = 5,
+ V4L2_AV1_SEG_LVL_REF_SKIP = 6,
+ V4L2_AV1_SEG_LVL_REF_GLOBALMV = 7,
+ V4L2_AV1_SEG_LVL_MAX = 8
+};
+
+#define V4L2_AV1_SEGMENT_FEATURE_ENABLED(id) (1 << (id))
+
+/**
+ * struct v4l2_av1_segmentation - AV1 Segmentation params as defined in section
+ * 6.8.13. "Segmentation params semantics" of the AV1 specification.
+ *
+ * @flags: see V4L2_AV1_SEGMENTATION_FLAG_{}.
+ * @feature_enabled: bitmask defining which features are enabled in each segment.
+ * Use V4L2_AV1_SEGMENT_FEATURE_ENABLED to build a suitable mask.
+ * @feature_data: data attached to each feature. Data entry is only valid if the
+ * feature is enabled
+ * @last_active_seg_id: indicates the highest numbered segment id that has some
+ * enabled feature. This is used when decoding the segment id to only decode
+ * choices corresponding to used segments.
+ */
+struct v4l2_av1_segmentation {
+ __u8 flags;
+ __u8 feature_enabled[V4L2_AV1_MAX_SEGMENTS];
+ __s16 feature_data[V4L2_AV1_MAX_SEGMENTS][V4L2_AV1_SEG_LVL_MAX];
+ __u8 last_active_seg_id;
+};
+
+#define V4L2_AV1_LOOP_FILTER_FLAG_DELTA_ENABLED BIT(0)
+#define V4L2_AV1_LOOP_FILTER_FLAG_DELTA_UPDATE BIT(1)
+#define V4L2_AV1_LOOP_FILTER_FLAG_DELTA_LF_PRESENT BIT(2)
+
+/**
+ * struct v4l2_av1_loop_filter - AV1 Loop filter params as defined in section
+ * 6.8.10. "Loop filter semantics" of the AV1 specification.
+ *
+ * @flags: see V4L2_AV1_LOOP_FILTER_FLAG_{}
+ * @level: an array containing loop filter strength values. Different loop
+ * filter strength values from the array are used depending on the image plane
+ * being filtered, and the edge direction (vertical or horizontal) being
+ * filtered.
+ * @sharpness: indicates the sharpness level. The loop_filter_level and
+ * loop_filter_sharpness together determine when a block edge is filtered, and
+ * by how much the filtering can change the sample values. The loop filter
+ * process is described in section 7.14 of the AV1 specification.
+ * @ref_deltas: contains the adjustment needed for the filter level based on the
+ * chosen reference frame. If this syntax element is not present, it maintains
+ * its previous value.
+ * @mode_deltas: contains the adjustment needed for the filter level based on
+ * the chosen mode. If this syntax element is not present, it maintains its
+ * previous value.
+ * @delta_lf_res: specifies the left shift which should be applied to decoded
+ * loop filter delta values.
+ * @delta_lf_multi: a value equal to 1 specifies that separate loop filter
+ * deltas are sent for horizontal luma edges, vertical luma edges,
+ * the U edges, and the V edges. A value of delta_lf_multi equal to 0 specifies
+ * that the same loop filter delta is used for all edges.
+ */
+struct v4l2_av1_loop_filter {
+ __u8 flags;
+ __u8 level[4];
+ __u8 sharpness;
+ __s8 ref_deltas[V4L2_AV1_TOTAL_REFS_PER_FRAME];
+ __s8 mode_deltas[2];
+ __u8 delta_lf_res;
+ __u8 delta_lf_multi;
+};
+
+#define V4L2_AV1_QUANTIZATION_FLAG_DIFF_UV_DELTA BIT(0)
+#define V4L2_AV1_QUANTIZATION_FLAG_USING_QMATRIX BIT(1)
+#define V4L2_AV1_QUANTIZATION_FLAG_DELTA_Q_PRESENT BIT(2)
+
+/**
+ * struct v4l2_av1_quantization - AV1 Quantization params as defined in section
+ * 6.8.11 "Quantization params semantics" of the AV1 specification.
+ *
+ * @flags: see V4L2_AV1_QUANTIZATION_FLAG_{}
+ * @base_q_idx: indicates the base frame qindex. This is used for Y AC
+ * coefficients and as the base value for the other quantizers.
+ * @delta_q_y_dc: indicates the Y DC quantizer relative to base_q_idx.
+ * @delta_q_u_dc: indicates the U DC quantizer relative to base_q_idx.
+ * @delta_q_u_ac: indicates the U AC quantizer relative to base_q_idx.
+ * @delta_q_v_dc: indicates the V DC quantizer relative to base_q_idx.
+ * @delta_q_v_ac: indicates the V AC quantizer relative to base_q_idx.
+ * @qm_y: specifies the level in the quantizer matrix that should be used for
+ * luma plane decoding.
+ * @qm_u: specifies the level in the quantizer matrix that should be used for
+ * chroma U plane decoding.
+ * @qm_v: specifies the level in the quantizer matrix that should be used for
+ * chroma V plane decoding.
+ * @delta_q_res: specifies the left shift which should be applied to decoded
+ * quantizer index delta values.
+ */
+struct v4l2_av1_quantization {
+ __u8 flags;
+ __u8 base_q_idx;
+ __s8 delta_q_y_dc;
+ __s8 delta_q_u_dc;
+ __s8 delta_q_u_ac;
+ __s8 delta_q_v_dc;
+ __s8 delta_q_v_ac;
+ __u8 qm_y;
+ __u8 qm_u;
+ __u8 qm_v;
+ __u8 delta_q_res;
+};
+
+#define V4L2_AV1_TILE_INFO_FLAG_UNIFORM_TILE_SPACING BIT(0)
+
+/**
+ * struct v4l2_av1_tile_info - AV1 Tile info as defined in section 6.8.14. "Tile
+ * info semantics" of the AV1 specification.
+ *
+ * @flags: see V4L2_AV1_TILE_INFO_FLAG_{}
+ * @mi_col_starts: an array specifying the start column (in units of 4x4 luma
+ * samples) for each tile across the image.
+ * @mi_row_starts: an array specifying the start row (in units of 4x4 luma
+ * samples) for each tile down the image.
+ * @width_in_sbs_minus_1: specifies the width of a tile minus 1 in units of
+ * superblocks.
+ * @height_in_sbs_minus_1: specifies the height of a tile minus 1 in units of
+ * superblocks.
+ * @tile_size_bytes: specifies the number of bytes needed to code each tile
+ * size.
+ * @context_update_tile_id: specifies which tile to use for the CDF update.
+ * @tile_rows: specifies the number of tiles down the frame.
+ * @tile_cols: specifies the number of tiles across the frame.
+ */
+struct v4l2_av1_tile_info {
+ __u8 flags;
+ __u32 mi_col_starts[V4L2_AV1_MAX_TILE_COLS + 1];
+ __u32 mi_row_starts[V4L2_AV1_MAX_TILE_ROWS + 1];
+ __u32 width_in_sbs_minus_1[V4L2_AV1_MAX_TILE_COLS];
+ __u32 height_in_sbs_minus_1[V4L2_AV1_MAX_TILE_ROWS];
+ __u8 tile_size_bytes;
+ __u8 context_update_tile_id;
+ __u8 tile_cols;
+ __u8 tile_rows;
+};
+
+/**
+ * enum v4l2_av1_frame_type - AV1 Frame Type
+ *
+ * @V4L2_AV1_KEY_FRAME: Key frame
+ * @V4L2_AV1_INTER_FRAME: Inter frame
+ * @V4L2_AV1_INTRA_ONLY_FRAME: Intra-only frame
+ * @V4L2_AV1_SWITCH_FRAME: Switch frame
+ */
+enum v4l2_av1_frame_type {
+ V4L2_AV1_KEY_FRAME = 0,
+ V4L2_AV1_INTER_FRAME = 1,
+ V4L2_AV1_INTRA_ONLY_FRAME = 2,
+ V4L2_AV1_SWITCH_FRAME = 3
+};
+
+/**
+ * enum v4l2_av1_interpolation_filter - AV1 interpolation filter types
+ *
+ * @V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP: eight tap filter
+ * @V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP_SMOOTH: eight tap smooth filter
+ * @V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP_SHARP: eight tap sharp filter
+ * @V4L2_AV1_INTERPOLATION_FILTER_BILINEAR: bilinear filter
+ * @V4L2_AV1_INTERPOLATION_FILTER_SWITCHABLE: filter selection is signaled at
+ * the block level
+ *
+ * See section 6.8.9 "Interpolation filter semantics" of the AV1 specification
+ * for more details.
+ */
+enum v4l2_av1_interpolation_filter {
+ V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP = 0,
+ V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP_SMOOTH = 1,
+ V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP_SHARP = 2,
+ V4L2_AV1_INTERPOLATION_FILTER_BILINEAR = 3,
+ V4L2_AV1_INTERPOLATION_FILTER_SWITCHABLE = 4,
+};
+
+/**
+ * enum v4l2_av1_tx_mode - AV1 Tx mode as described in section 6.8.21 "TX mode
+ * semantics" of the AV1 specification.
+ * @V4L2_AV1_TX_MODE_ONLY_4X4: the inverse transform will use only 4x4
+ * transforms
+ * @V4L2_AV1_TX_MODE_LARGEST: the inverse transform will use the largest
+ * transform size that fits inside the block
+ * @V4L2_AV1_TX_MODE_SELECT: the choice of transform size is specified
+ * explicitly for each block.
+ */
+enum v4l2_av1_tx_mode {
+ V4L2_AV1_TX_MODE_ONLY_4X4 = 0,
+ V4L2_AV1_TX_MODE_LARGEST = 1,
+ V4L2_AV1_TX_MODE_SELECT = 2
+};
+
+#define V4L2_AV1_FRAME_HEADER_FLAG_SHOW_FRAME BIT(0)
+#define V4L2_AV1_FRAME_HEADER_FLAG_SHOWABLE_FRAME BIT(1)
+#define V4L2_AV1_FRAME_HEADER_FLAG_ERROR_RESILIENT_MODE BIT(2)
+#define V4L2_AV1_FRAME_HEADER_FLAG_DISABLE_CDF_UPDATE BIT(3)
+#define V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_SCREEN_CONTENT_TOOLS BIT(4)
+#define V4L2_AV1_FRAME_HEADER_FLAG_FORCE_INTEGER_MV BIT(5)
+#define V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_INTRABC BIT(6)
+#define V4L2_AV1_FRAME_HEADER_FLAG_USE_SUPERRES BIT(7)
+#define V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_HIGH_PRECISION_MV BIT(8)
+#define V4L2_AV1_FRAME_HEADER_FLAG_IS_MOTION_MODE_SWITCHABLE BIT(9)
+#define V4L2_AV1_FRAME_HEADER_FLAG_USE_REF_FRAME_MVS BIT(10)
+#define V4L2_AV1_FRAME_HEADER_FLAG_DISABLE_FRAME_END_UPDATE_CDF BIT(11)
+#define V4L2_AV1_FRAME_HEADER_FLAG_UNIFORM_TILE_SPACING BIT(12)
+#define V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_WARPED_MOTION BIT(13)
+#define V4L2_AV1_FRAME_HEADER_FLAG_REFERENCE_SELECT BIT(14)
+#define V4L2_AV1_FRAME_HEADER_FLAG_REDUCED_TX_SET BIT(15)
+#define V4L2_AV1_FRAME_HEADER_FLAG_SKIP_MODE_ALLOWED BIT(16)
+#define V4L2_AV1_FRAME_HEADER_FLAG_SKIP_MODE_PRESENT BIT(17)
+#define V4L2_AV1_FRAME_HEADER_FLAG_FRAME_SIZE_OVERRIDE BIT(18)
+#define V4L2_AV1_FRAME_HEADER_FLAG_BUFFER_REMOVAL_TIME_PRESENT BIT(19)
+#define V4L2_AV1_FRAME_HEADER_FLAG_FRAME_REFS_SHORT_SIGNALING BIT(20)
+
+#define V4L2_CID_STATELESS_AV1_FRAME_HEADER (V4L2_CID_CODEC_STATELESS_BASE + 406)
+/**
+ * struct v4l2_ctrl_av1_frame_header - Represents an AV1 Frame Header OBU.
+ *
+ * @tile_info: tile info
+ * @quantization: quantization params
+ * @segmentation: segmentation params
+ * @loop_filter: loop filter params
+ * @cdef: cdef params
+ * @loop_restoration: loop restoration params
+ * @global_motion: global motion params
+ * @film_grain: film grain params
+ * @flags: see V4L2_AV1_FRAME_HEADER_FLAG_{}
+ * @frame_type: specifies the AV1 frame type
+ * @order_hint: specifies OrderHintBits least significant bits of the expected
+ * output order for this frame.
+ * @superres_denom: the denominator for the upscaling ratio.
+ * @upscaled_width: the upscaled width.
+ * @interpolation_filter: specifies the filter selection used for performing
+ * inter prediction.
+ * @tx_mode: specifies how the transform size is determined.
+ * @frame_width_minus_1: add 1 to get the frame's width.
+ * @frame_height_minus_1: add 1 to get the frame's height
+ * @render_width_minus_1: add 1 to get the render width of the frame in luma
+ * samples.
+ * @render_height_minus_1: add 1 to get the render height of the frame in luma
+ * samples.
+ * @current_frame_id: specifies the frame id number for the current frame. Frame
+ * id numbers are additional information that do not affect the decoding
+ * process, but provide decoders with a way of detecting missing reference
+ * frames so that appropriate action can be taken.
+ * @primary_ref_frame: specifies which reference frame contains the CDF values
+ * and other state that should be loaded at the start of the frame.
+ * @buf_removal_time: specifies the frame removal time in units of DecCT clock
+ * ticks counted from the removal time of the last random access point for
+ * operating point opNum.
+ * @refresh_frame_flags: contains a bitmask that specifies which reference frame
+ * slots will be updated with the current frame after it is decoded.
+ * @order_hints: specifies the expected output order hint for each reference
+ * frame.
+ * @last_frame_idx: specifies the reference frame to use for LAST_FRAME.
+ * @gold_frame_idx: specifies the reference frame to use for GOLDEN_FRAME.
+ * refs
+ * @reference_frame_ts: the V4L2 timestamp of the reference frame slots.
+ * @ref_frame_idx: index into @reference_frame_ts fo the frames used by
+ * inter-frames.
+ * enumerated in &v4l2_av1_reference_frame. The timestamp refers to the
+ * timestamp field in struct v4l2_buffer. Use v4l2_timeval_to_ns() to convert
+ * the struct timeval to a __u64.
+ * @skip_mode_frame: specifies the frames to use for compound prediction when
+ * skip_mode is equal to 1.
+ */
+struct v4l2_ctrl_av1_frame_header {
+ struct v4l2_av1_tile_info tile_info;
+ struct v4l2_av1_quantization quantization;
+ struct v4l2_av1_segmentation segmentation;
+ struct v4l2_av1_loop_filter loop_filter;
+ struct v4l2_av1_cdef cdef;
+ struct v4l2_av1_loop_restoration loop_restoration;
+ struct v4l2_av1_global_motion global_motion;
+ __u32 flags;
+ enum v4l2_av1_frame_type frame_type;
+ __u32 order_hint;
+ __u8 superres_denom;
+ __u32 upscaled_width;
+ enum v4l2_av1_interpolation_filter interpolation_filter;
+ enum v4l2_av1_tx_mode tx_mode;
+ __u32 frame_width_minus_1;
+ __u32 frame_height_minus_1;
+ __u16 render_width_minus_1;
+ __u16 render_height_minus_1;
+
+ __u32 current_frame_id;
+ __u8 primary_ref_frame;
+ __u32 buffer_removal_time[V4L2_AV1_MAX_OPERATING_POINTS];
+ __u8 refresh_frame_flags;
+ __u32 order_hints[V4L2_AV1_NUM_REF_FRAMES];
+ __s8 last_frame_idx;
+ __s8 gold_frame_idx;
+ __u64 reference_frame_ts[V4L2_AV1_TOTAL_REFS_PER_FRAME];
+ __u8 ref_frame_idx[V4L2_AV1_REFS_PER_FRAME];
+ __u8 skip_mode_frame[2];
+};
+
+/**
+ * enum v4l2_stateless_av1_profile - AV1 profiles
+ *
+ * @V4L2_STATELESS_AV1_PROFILE_MAIN: compliant decoders must be able to decode
+ * streams with seq_profile equal to 0.
+ * @V4L2_STATELESS_PROFILE_HIGH: compliant decoders must be able to decode
+ * streams with seq_profile equal to 0.
+ * @V4L2_STATELESS_PROFILE_PROFESSIONAL: compliant decoders must be able to
+ * decode streams with seq_profile equal to 0.
+ *
+ * Conveys the highest profile a decoder can work with.
+ */
+#define V4L2_CID_STATELESS_AV1_PROFILE (V4L2_CID_CODEC_STATELESS_BASE + 407)
+enum v4l2_stateless_av1_profile {
+ V4L2_STATELESS_AV1_PROFILE_MAIN = 0,
+ V4L2_STATELESS_AV1_PROFILE_HIGH = 1,
+ V4L2_STATELESS_AV1_PROFILE_PROFESSIONAL = 2,
+};
+
+/**
+ * enum v4l2_stateless_av1_level - AV1 levels
+ *
+ * @V4L2_STATELESS_AV1_LEVEL_2_0: Level 2.0.
+ * @V4L2_STATELESS_AV1_LEVEL_2_1: Level 2.1.
+ * @V4L2_STATELESS_AV1_LEVEL_2_2: Level 2.2.
+ * @V4L2_STATELESS_AV1_LEVEL_2_3: Level 2.3.
+ * @V4L2_STATELESS_AV1_LEVEL_3_0: Level 3.0.
+ * @V4L2_STATELESS_AV1_LEVEL_3_1: Level 3.1.
+ * @V4L2_STATELESS_AV1_LEVEL_3_2: Level 3.2.
+ * @V4L2_STATELESS_AV1_LEVEL_3_3: Level 3.3.
+ * @V4L2_STATELESS_AV1_LEVEL_4_0: Level 4.0.
+ * @V4L2_STATELESS_AV1_LEVEL_4_1: Level 4.1.
+ * @V4L2_STATELESS_AV1_LEVEL_4_2: Level 4.2.
+ * @V4L2_STATELESS_AV1_LEVEL_4_3: Level 4.3.
+ * @V4L2_STATELESS_AV1_LEVEL_5_0: Level 5.0.
+ * @V4L2_STATELESS_AV1_LEVEL_5_1: Level 5.1.
+ * @V4L2_STATELESS_AV1_LEVEL_5_2: Level 5.2.
+ * @V4L2_STATELESS_AV1_LEVEL_5_3: Level 5.3.
+ * @V4L2_STATELESS_AV1_LEVEL_6_0: Level 6.0.
+ * @V4L2_STATELESS_AV1_LEVEL_6_1: Level 6.1.
+ * @V4L2_STATELESS_AV1_LEVEL_6_2: Level 6.2.
+ * @V4L2_STATELESS_AV1_LEVEL_6_3: Level 6.3.
+ * @V4L2_STATELESS_AV1_LEVEL_7_0: Level 7.0.
+ * @V4L2_STATELESS_AV1_LEVEL_7_2: Level 7.2.
+ * @V4L2_STATELESS_AV1_LEVEL_7_3: Level 7.3.
+ *
+ * Conveys the highest level a decoder can work with.
+ */
+#define V4L2_CID_STATELESS_AV1_LEVEL (V4L2_CID_CODEC_STATELESS_BASE + 408)
+enum v4l2_stateless_av1_level {
+ V4L2_STATELESS_AV1_LEVEL_2_0 = 0,
+ V4L2_STATELESS_AV1_LEVEL_2_1 = 1,
+ V4L2_STATELESS_AV1_LEVEL_2_2 = 2,
+ V4L2_STATELESS_AV1_LEVEL_2_3 = 3,
+
+ V4L2_STATELESS_AV1_LEVEL_3_0 = 4,
+ V4L2_STATELESS_AV1_LEVEL_3_1 = 5,
+ V4L2_STATELESS_AV1_LEVEL_3_2 = 6,
+ V4L2_STATELESS_AV1_LEVEL_3_3 = 7,
+
+ V4L2_STATELESS_AV1_LEVEL_4_0 = 8,
+ V4L2_STATELESS_AV1_LEVEL_4_1 = 9,
+ V4L2_STATELESS_AV1_LEVEL_4_2 = 10,
+ V4L2_STATELESS_AV1_LEVEL_4_3 = 11,
+
+ V4L2_STATELESS_AV1_LEVEL_5_0 = 12,
+ V4L2_STATELESS_AV1_LEVEL_5_1 = 13,
+ V4L2_STATELESS_AV1_LEVEL_5_2 = 14,
+ V4L2_STATELESS_AV1_LEVEL_5_3 = 15,
+
+ V4L2_STATELESS_AV1_LEVEL_6_0 = 16,
+ V4L2_STATELESS_AV1_LEVEL_6_1 = 17,
+ V4L2_STATELESS_AV1_LEVEL_6_2 = 18,
+ V4L2_STATELESS_AV1_LEVEL_6_3 = 19,
+
+ V4L2_STATELESS_AV1_LEVEL_7_0 = 20,
+ V4L2_STATELESS_AV1_LEVEL_7_1 = 21,
+ V4L2_STATELESS_AV1_LEVEL_7_2 = 22,
+ V4L2_STATELESS_AV1_LEVEL_7_3 = 23
+};
+
+#define V4L2_AV1_FILM_GRAIN_FLAG_APPLY_GRAIN BIT(0)
+#define V4L2_AV1_FILM_GRAIN_FLAG_UPDATE_GRAIN BIT(1)
+#define V4L2_AV1_FILM_GRAIN_FLAG_CHROMA_SCALING_FROM_LUMA BIT(2)
+#define V4L2_AV1_FILM_GRAIN_FLAG_OVERLAP BIT(3)
+#define V4L2_AV1_FILM_GRAIN_FLAG_CLIP_TO_RESTRICTED_RANGE BIT(4)
+
+/**
+ * struct v4l2_av1_film_grain - AV1 Film Grain parameters.
+ *
+ * Film grain parameters as specified by section 6.8.20 of the AV1
+ Specification.
+ *
+ * @flags: see V4L2_AV1_FILM_GRAIN_{}.
+ * @grain_seed: specifies the starting value for the pseudo-random numbers used
+ * during film grain synthesis.
+ * @film_grain_params_ref_idx: indicates which reference frame contains the
+ * film grain parameters to be used for this frame.
+ * @num_y_points: specifies the number of points for the piece-wise linear
+ * scaling function of the luma component.
+ * @point_y_value: represents the x (luma value) coordinate for the i-th point
+ * of the piecewise linear scaling function for luma component. The values are
+ * signaled on the scale of 0..255. (In case of 10 bit video, these values
+ * correspond to luma values divided by 4. In case of 12 bit video, these values
+ * correspond to luma values divided by 16.).
+ * @point_y_scaling: represents the scaling (output) value for the i-th point
+ * of the piecewise linear scaling function for luma component.
+ * @num_cb_points: specifies the number of points for the piece-wise linear
+ * scaling function of the cb component.
+ * @point_cb_value: represents the x coordinate for the i-th point of the
+ * piece-wise linear scaling function for cb component. The values are signaled
+ * on the scale of 0..255.
+ * @point_cb_scaling: represents the scaling (output) value for the i-th point
+ * of the piecewise linear scaling function for cb component.
+ * @num_cr_points: specifies represents the number of points for the piece-wise
+ * linear scaling function of the cr component.
+ * @point_cr_value: represents the x coordinate for the i-th point of the
+ * piece-wise linear scaling function for cr component. The values are signaled
+ * on the scale of 0..255.
+ * @point_cr_scaling: represents the scaling (output) value for the i-th point
+ * of the piecewise linear scaling function for cr component.
+ * @grain_scaling_minus_8: represents the shift – 8 applied to the values of the
+ * chroma component. The grain_scaling_minus_8 can take values of 0..3 and
+ * determines the range and quantization step of the standard deviation of film
+ * grain.
+ * @ar_coeff_lag: specifies the number of auto-regressive coefficients for luma
+ * and chroma.
+ * @ar_coeffs_y_plus_128: specifies auto-regressive coefficients used for the Y
+ * plane.
+ * @ar_coeffs_cb_plus_128: specifies auto-regressive coefficients used for the U
+ * plane.
+ * @ar_coeffs_cr_plus_128: specifies auto-regressive coefficients used for the V
+ * plane.
+ * @ar_coeff_shift_minus_6: specifies the range of the auto-regressive
+ * coefficients. Values of 0, 1, 2, and 3 correspond to the ranges for
+ * auto-regressive coefficients of [-2, 2), [-1, 1), [-0.5, 0.5) and [-0.25,
+ * 0.25) respectively.
+ * @grain_scale_shift: specifies how much the Gaussian random numbers should be
+ * scaled down during the grain synthesis process.
+ * @cb_mult: represents a multiplier for the cb component used in derivation of
+ * the input index to the cb component scaling function.
+ * @cb_luma_mult: represents a multiplier for the average luma component used in
+ * derivation of the input index to the cb component scaling function.
+ * @cb_offset: represents an offset used in derivation of the input index to the
+ * cb component scaling function.
+ * @cr_mult: represents a multiplier for the cr component used in derivation of
+ * the input index to the cr component scaling function.
+ * @cr_luma_mult: represents a multiplier for the average luma component used in
+ * derivation of the input index to the cr component scaling function.
+ * @cr_offset: represents an offset used in derivation of the input index to the
+ * cr component scaling function.
+ */
+#define V4L2_CID_STATELESS_AV1_FILM_GRAIN (V4L2_CID_CODEC_STATELESS_BASE + 409)
+struct v4l2_ctrl_av1_film_grain {
+ __u8 flags;
+ __u16 grain_seed;
+ __u8 film_grain_params_ref_idx;
+ __u8 num_y_points;
+ __u8 point_y_value[V4L2_AV1_MAX_NUM_Y_POINTS];
+ __u8 point_y_scaling[V4L2_AV1_MAX_NUM_Y_POINTS];
+ __u8 num_cb_points;
+ __u8 point_cb_value[V4L2_AV1_MAX_NUM_CB_POINTS];
+ __u8 point_cb_scaling[V4L2_AV1_MAX_NUM_CB_POINTS];
+ __u8 num_cr_points;
+ __u8 point_cr_value[V4L2_AV1_MAX_NUM_CR_POINTS];
+ __u8 point_cr_scaling[V4L2_AV1_MAX_NUM_CR_POINTS];
+ __u8 grain_scaling_minus_8;
+ __u8 ar_coeff_lag;
+ __u8 ar_coeffs_y_plus_128[V4L2_AV1_MAX_NUM_POS_LUMA];
+ __u8 ar_coeffs_cb_plus_128[V4L2_AV1_MAX_NUM_POS_LUMA];
+ __u8 ar_coeffs_cr_plus_128[V4L2_AV1_MAX_NUM_POS_LUMA];
+ __u8 ar_coeff_shift_minus_6;
+ __u8 grain_scale_shift;
+ __u8 cb_mult;
+ __u8 cb_luma_mult;
+ __u16 cb_offset;
+ __u8 cr_mult;
+ __u8 cr_luma_mult;
+ __u16 cr_offset;
+};
+
+
#define V4L2_CID_COLORIMETRY_CLASS_BASE (V4L2_CTRL_CLASS_COLORIMETRY | 0x900)
#define V4L2_CID_COLORIMETRY_CLASS (V4L2_CTRL_CLASS_COLORIMETRY | 1)
diff --git a/include/uapi/linux/videodev2.h b/include/uapi/linux/videodev2.h
index 8df13defde75..ad6ab6114fdc 100644
--- a/include/uapi/linux/videodev2.h
+++ b/include/uapi/linux/videodev2.h
@@ -710,6 +710,7 @@ struct v4l2_pix_format {
#define V4L2_PIX_FMT_FWHT v4l2_fourcc('F', 'W', 'H', 'T') /* Fast Walsh Hadamard Transform (vicodec) */
#define V4L2_PIX_FMT_FWHT_STATELESS v4l2_fourcc('S', 'F', 'W', 'H') /* Stateless FWHT (vicodec) */
#define V4L2_PIX_FMT_H264_SLICE v4l2_fourcc('S', '2', '6', '4') /* H264 parsed slices */
+#define V4L2_PIX_FMT_AV1_FRAME v4l2_fourcc('A', 'V', '1', 'F') /* AV1 parsed frame */
/* Vendor-specific formats */
#define V4L2_PIX_FMT_CPIA1 v4l2_fourcc('C', 'P', 'I', 'A') /* cpia1 YUV */
@@ -1764,6 +1765,12 @@ struct v4l2_ext_control {
struct v4l2_ctrl_mpeg2_quantisation __user *p_mpeg2_quantisation;
struct v4l2_ctrl_vp9_compressed_hdr __user *p_vp9_compressed_hdr_probs;
struct v4l2_ctrl_vp9_frame __user *p_vp9_frame;
+
+ struct v4l2_ctrl_av1_sequence __user *p_av1_sequence;
+ struct v4l2_ctrl_av1_tile_group __user *p_av1_tile_group;
+ struct v4l2_ctrl_av1_tile_group_entry __user *p_av1_tile_group_entry;
+ struct v4l2_ctrl_av1_frame_header __user *p_av1_frame_header;
+ struct v4l2_ctrl_av1_film_grain __user *p_av1_film_grain;
void __user *ptr;
};
} __attribute__ ((packed));
@@ -1831,6 +1838,12 @@ enum v4l2_ctrl_type {
V4L2_CTRL_TYPE_VP9_COMPRESSED_HDR = 0x0260,
V4L2_CTRL_TYPE_VP9_FRAME = 0x0261,
+
+ V4L2_CTRL_TYPE_AV1_SEQUENCE = 0x280,
+ V4L2_CTRL_TYPE_AV1_TILE_GROUP = 0x281,
+ V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY = 0x282,
+ V4L2_CTRL_TYPE_AV1_FRAME_HEADER = 0x283,
+ V4L2_CTRL_TYPE_AV1_FILM_GRAIN = 0x284,
};
/* Used in the VIDIOC_QUERYCTRL ioctl for querying controls */
--
2.35.1
^ permalink raw reply related [flat|nested] 10+ messages in thread
* Re: [RFC PATCH v2] media: Add AV1 uAPI
2022-03-22 16:01 [RFC PATCH v2] media: Add AV1 uAPI daniel.almeida
@ 2022-03-22 19:29 ` kernel test robot
2022-05-10 0:04 ` Steve Cho
1 sibling, 0 replies; 10+ messages in thread
From: kernel test robot @ 2022-03-22 19:29 UTC (permalink / raw)
To: daniel.almeida; +Cc: llvm, kbuild-all
Hi,
[FYI, it's a private test report for your RFC patch.]
[auto build test ERROR on media-tree/master]
[also build test ERROR on v5.17 next-20220322]
[If your patch is applied to the wrong git tree, kindly drop us a note.
And when submitting patch, we suggest to use '--base' as documented in
https://git-scm.com/docs/git-format-patch]
url: https://github.com/0day-ci/linux/commits/daniel-almeida-collabora-com/media-Add-AV1-uAPI/20220323-000213
base: git://linuxtv.org/media_tree.git master
config: hexagon-randconfig-r005-20220320 (https://download.01.org/0day-ci/archive/20220323/202203230341.mMBnQJB8-lkp@intel.com/config)
compiler: clang version 15.0.0 (https://github.com/llvm/llvm-project 85e9b2687a13d1908aa86d1b89c5ce398a06cd39)
reproduce (this is a W=1 build):
wget https://raw.githubusercontent.com/intel/lkp-tests/master/sbin/make.cross -O ~/bin/make.cross
chmod +x ~/bin/make.cross
# https://github.com/0day-ci/linux/commit/8779a727424842161cc9099ce3d6fd493d170f90
git remote add linux-review https://github.com/0day-ci/linux
git fetch --no-tags linux-review daniel-almeida-collabora-com/media-Add-AV1-uAPI/20220323-000213
git checkout 8779a727424842161cc9099ce3d6fd493d170f90
# save the config file to linux build tree
mkdir build_dir
COMPILER_INSTALL_PATH=$HOME/0day COMPILER=clang make.cross W=1 O=build_dir ARCH=hexagon SHELL=/bin/bash drivers/media/v4l2-core/
If you fix the issue, kindly add following tag as appropriate
Reported-by: kernel test robot <lkp@intel.com>
All errors (new ones prefixed by >>):
>> drivers/media/v4l2-core/v4l2-ctrls-defs.c:1548:13: error: use of undeclared identifier 'V4L2_CTRL_FLAG_DYNAMIC_ARRAY'
*flags |= V4L2_CTRL_FLAG_DYNAMIC_ARRAY;
^
drivers/media/v4l2-core/v4l2-ctrls-defs.c:1552:13: error: use of undeclared identifier 'V4L2_CTRL_FLAG_DYNAMIC_ARRAY'
*flags |= V4L2_CTRL_FLAG_DYNAMIC_ARRAY;
^
2 errors generated.
vim +/V4L2_CTRL_FLAG_DYNAMIC_ARRAY +1548 drivers/media/v4l2-core/v4l2-ctrls-defs.c
1239
1240 void v4l2_ctrl_fill(u32 id, const char **name, enum v4l2_ctrl_type *type,
1241 s64 *min, s64 *max, u64 *step, s64 *def, u32 *flags)
1242 {
1243 *name = v4l2_ctrl_get_name(id);
1244 *flags = 0;
1245
1246 switch (id) {
1247 case V4L2_CID_AUDIO_MUTE:
1248 case V4L2_CID_AUDIO_LOUDNESS:
1249 case V4L2_CID_AUTO_WHITE_BALANCE:
1250 case V4L2_CID_AUTOGAIN:
1251 case V4L2_CID_HFLIP:
1252 case V4L2_CID_VFLIP:
1253 case V4L2_CID_HUE_AUTO:
1254 case V4L2_CID_CHROMA_AGC:
1255 case V4L2_CID_COLOR_KILLER:
1256 case V4L2_CID_AUTOBRIGHTNESS:
1257 case V4L2_CID_MPEG_AUDIO_MUTE:
1258 case V4L2_CID_MPEG_VIDEO_MUTE:
1259 case V4L2_CID_MPEG_VIDEO_GOP_CLOSURE:
1260 case V4L2_CID_MPEG_VIDEO_PULLDOWN:
1261 case V4L2_CID_EXPOSURE_AUTO_PRIORITY:
1262 case V4L2_CID_FOCUS_AUTO:
1263 case V4L2_CID_PRIVACY:
1264 case V4L2_CID_AUDIO_LIMITER_ENABLED:
1265 case V4L2_CID_AUDIO_COMPRESSION_ENABLED:
1266 case V4L2_CID_PILOT_TONE_ENABLED:
1267 case V4L2_CID_ILLUMINATORS_1:
1268 case V4L2_CID_ILLUMINATORS_2:
1269 case V4L2_CID_FLASH_STROBE_STATUS:
1270 case V4L2_CID_FLASH_CHARGE:
1271 case V4L2_CID_FLASH_READY:
1272 case V4L2_CID_MPEG_VIDEO_DECODER_MPEG4_DEBLOCK_FILTER:
1273 case V4L2_CID_MPEG_VIDEO_DECODER_SLICE_INTERFACE:
1274 case V4L2_CID_MPEG_VIDEO_DEC_DISPLAY_DELAY_ENABLE:
1275 case V4L2_CID_MPEG_VIDEO_FRAME_RC_ENABLE:
1276 case V4L2_CID_MPEG_VIDEO_MB_RC_ENABLE:
1277 case V4L2_CID_MPEG_VIDEO_H264_8X8_TRANSFORM:
1278 case V4L2_CID_MPEG_VIDEO_H264_VUI_SAR_ENABLE:
1279 case V4L2_CID_MPEG_VIDEO_MPEG4_QPEL:
1280 case V4L2_CID_MPEG_VIDEO_REPEAT_SEQ_HEADER:
1281 case V4L2_CID_MPEG_VIDEO_AU_DELIMITER:
1282 case V4L2_CID_WIDE_DYNAMIC_RANGE:
1283 case V4L2_CID_IMAGE_STABILIZATION:
1284 case V4L2_CID_RDS_RECEPTION:
1285 case V4L2_CID_RF_TUNER_LNA_GAIN_AUTO:
1286 case V4L2_CID_RF_TUNER_MIXER_GAIN_AUTO:
1287 case V4L2_CID_RF_TUNER_IF_GAIN_AUTO:
1288 case V4L2_CID_RF_TUNER_BANDWIDTH_AUTO:
1289 case V4L2_CID_RF_TUNER_PLL_LOCK:
1290 case V4L2_CID_RDS_TX_MONO_STEREO:
1291 case V4L2_CID_RDS_TX_ARTIFICIAL_HEAD:
1292 case V4L2_CID_RDS_TX_COMPRESSED:
1293 case V4L2_CID_RDS_TX_DYNAMIC_PTY:
1294 case V4L2_CID_RDS_TX_TRAFFIC_ANNOUNCEMENT:
1295 case V4L2_CID_RDS_TX_TRAFFIC_PROGRAM:
1296 case V4L2_CID_RDS_TX_MUSIC_SPEECH:
1297 case V4L2_CID_RDS_TX_ALT_FREQS_ENABLE:
1298 case V4L2_CID_RDS_RX_TRAFFIC_ANNOUNCEMENT:
1299 case V4L2_CID_RDS_RX_TRAFFIC_PROGRAM:
1300 case V4L2_CID_RDS_RX_MUSIC_SPEECH:
1301 *type = V4L2_CTRL_TYPE_BOOLEAN;
1302 *min = 0;
1303 *max = *step = 1;
1304 break;
1305 case V4L2_CID_ROTATE:
1306 *type = V4L2_CTRL_TYPE_INTEGER;
1307 *flags |= V4L2_CTRL_FLAG_MODIFY_LAYOUT;
1308 break;
1309 case V4L2_CID_MPEG_VIDEO_MV_H_SEARCH_RANGE:
1310 case V4L2_CID_MPEG_VIDEO_MV_V_SEARCH_RANGE:
1311 case V4L2_CID_MPEG_VIDEO_DEC_DISPLAY_DELAY:
1312 case V4L2_CID_MPEG_VIDEO_INTRA_REFRESH_PERIOD:
1313 *type = V4L2_CTRL_TYPE_INTEGER;
1314 break;
1315 case V4L2_CID_MPEG_VIDEO_LTR_COUNT:
1316 *type = V4L2_CTRL_TYPE_INTEGER;
1317 break;
1318 case V4L2_CID_MPEG_VIDEO_FRAME_LTR_INDEX:
1319 *type = V4L2_CTRL_TYPE_INTEGER;
1320 *flags |= V4L2_CTRL_FLAG_EXECUTE_ON_WRITE;
1321 break;
1322 case V4L2_CID_MPEG_VIDEO_USE_LTR_FRAMES:
1323 *type = V4L2_CTRL_TYPE_BITMASK;
1324 *flags |= V4L2_CTRL_FLAG_EXECUTE_ON_WRITE;
1325 break;
1326 case V4L2_CID_MPEG_VIDEO_FORCE_KEY_FRAME:
1327 case V4L2_CID_PAN_RESET:
1328 case V4L2_CID_TILT_RESET:
1329 case V4L2_CID_FLASH_STROBE:
1330 case V4L2_CID_FLASH_STROBE_STOP:
1331 case V4L2_CID_AUTO_FOCUS_START:
1332 case V4L2_CID_AUTO_FOCUS_STOP:
1333 case V4L2_CID_DO_WHITE_BALANCE:
1334 *type = V4L2_CTRL_TYPE_BUTTON;
1335 *flags |= V4L2_CTRL_FLAG_WRITE_ONLY |
1336 V4L2_CTRL_FLAG_EXECUTE_ON_WRITE;
1337 *min = *max = *step = *def = 0;
1338 break;
1339 case V4L2_CID_POWER_LINE_FREQUENCY:
1340 case V4L2_CID_MPEG_AUDIO_SAMPLING_FREQ:
1341 case V4L2_CID_MPEG_AUDIO_ENCODING:
1342 case V4L2_CID_MPEG_AUDIO_L1_BITRATE:
1343 case V4L2_CID_MPEG_AUDIO_L2_BITRATE:
1344 case V4L2_CID_MPEG_AUDIO_L3_BITRATE:
1345 case V4L2_CID_MPEG_AUDIO_AC3_BITRATE:
1346 case V4L2_CID_MPEG_AUDIO_MODE:
1347 case V4L2_CID_MPEG_AUDIO_MODE_EXTENSION:
1348 case V4L2_CID_MPEG_AUDIO_EMPHASIS:
1349 case V4L2_CID_MPEG_AUDIO_CRC:
1350 case V4L2_CID_MPEG_AUDIO_DEC_PLAYBACK:
1351 case V4L2_CID_MPEG_AUDIO_DEC_MULTILINGUAL_PLAYBACK:
1352 case V4L2_CID_MPEG_VIDEO_ENCODING:
1353 case V4L2_CID_MPEG_VIDEO_ASPECT:
1354 case V4L2_CID_MPEG_VIDEO_BITRATE_MODE:
1355 case V4L2_CID_MPEG_STREAM_TYPE:
1356 case V4L2_CID_MPEG_STREAM_VBI_FMT:
1357 case V4L2_CID_EXPOSURE_AUTO:
1358 case V4L2_CID_AUTO_FOCUS_RANGE:
1359 case V4L2_CID_COLORFX:
1360 case V4L2_CID_AUTO_N_PRESET_WHITE_BALANCE:
1361 case V4L2_CID_TUNE_PREEMPHASIS:
1362 case V4L2_CID_FLASH_LED_MODE:
1363 case V4L2_CID_FLASH_STROBE_SOURCE:
1364 case V4L2_CID_MPEG_VIDEO_HEADER_MODE:
1365 case V4L2_CID_MPEG_VIDEO_FRAME_SKIP_MODE:
1366 case V4L2_CID_MPEG_VIDEO_MULTI_SLICE_MODE:
1367 case V4L2_CID_MPEG_VIDEO_H264_ENTROPY_MODE:
1368 case V4L2_CID_MPEG_VIDEO_H264_LEVEL:
1369 case V4L2_CID_MPEG_VIDEO_H264_LOOP_FILTER_MODE:
1370 case V4L2_CID_MPEG_VIDEO_H264_PROFILE:
1371 case V4L2_CID_MPEG_VIDEO_H264_VUI_SAR_IDC:
1372 case V4L2_CID_MPEG_VIDEO_H264_SEI_FP_ARRANGEMENT_TYPE:
1373 case V4L2_CID_MPEG_VIDEO_H264_FMO_MAP_TYPE:
1374 case V4L2_CID_MPEG_VIDEO_H264_HIERARCHICAL_CODING_TYPE:
1375 case V4L2_CID_MPEG_VIDEO_MPEG2_LEVEL:
1376 case V4L2_CID_MPEG_VIDEO_MPEG2_PROFILE:
1377 case V4L2_CID_MPEG_VIDEO_MPEG4_LEVEL:
1378 case V4L2_CID_MPEG_VIDEO_MPEG4_PROFILE:
1379 case V4L2_CID_JPEG_CHROMA_SUBSAMPLING:
1380 case V4L2_CID_ISO_SENSITIVITY_AUTO:
1381 case V4L2_CID_EXPOSURE_METERING:
1382 case V4L2_CID_SCENE_MODE:
1383 case V4L2_CID_DV_TX_MODE:
1384 case V4L2_CID_DV_TX_RGB_RANGE:
1385 case V4L2_CID_DV_TX_IT_CONTENT_TYPE:
1386 case V4L2_CID_DV_RX_RGB_RANGE:
1387 case V4L2_CID_DV_RX_IT_CONTENT_TYPE:
1388 case V4L2_CID_TEST_PATTERN:
1389 case V4L2_CID_DEINTERLACING_MODE:
1390 case V4L2_CID_TUNE_DEEMPHASIS:
1391 case V4L2_CID_MPEG_VIDEO_VPX_GOLDEN_FRAME_SEL:
1392 case V4L2_CID_MPEG_VIDEO_VP8_PROFILE:
1393 case V4L2_CID_MPEG_VIDEO_VP9_PROFILE:
1394 case V4L2_CID_MPEG_VIDEO_VP9_LEVEL:
1395 case V4L2_CID_DETECT_MD_MODE:
1396 case V4L2_CID_STATELESS_AV1_PROFILE:
1397 case V4L2_CID_STATELESS_AV1_LEVEL:
1398 case V4L2_CID_MPEG_VIDEO_HEVC_PROFILE:
1399 case V4L2_CID_MPEG_VIDEO_HEVC_LEVEL:
1400 case V4L2_CID_MPEG_VIDEO_HEVC_HIER_CODING_TYPE:
1401 case V4L2_CID_MPEG_VIDEO_HEVC_REFRESH_TYPE:
1402 case V4L2_CID_MPEG_VIDEO_HEVC_SIZE_OF_LENGTH_FIELD:
1403 case V4L2_CID_MPEG_VIDEO_HEVC_TIER:
1404 case V4L2_CID_MPEG_VIDEO_HEVC_LOOP_FILTER_MODE:
1405 case V4L2_CID_MPEG_VIDEO_HEVC_DECODE_MODE:
1406 case V4L2_CID_MPEG_VIDEO_HEVC_START_CODE:
1407 case V4L2_CID_STATELESS_H264_DECODE_MODE:
1408 case V4L2_CID_STATELESS_H264_START_CODE:
1409 case V4L2_CID_CAMERA_ORIENTATION:
1410 *type = V4L2_CTRL_TYPE_MENU;
1411 break;
1412 case V4L2_CID_LINK_FREQ:
1413 *type = V4L2_CTRL_TYPE_INTEGER_MENU;
1414 break;
1415 case V4L2_CID_RDS_TX_PS_NAME:
1416 case V4L2_CID_RDS_TX_RADIO_TEXT:
1417 case V4L2_CID_RDS_RX_PS_NAME:
1418 case V4L2_CID_RDS_RX_RADIO_TEXT:
1419 *type = V4L2_CTRL_TYPE_STRING;
1420 break;
1421 case V4L2_CID_ISO_SENSITIVITY:
1422 case V4L2_CID_AUTO_EXPOSURE_BIAS:
1423 case V4L2_CID_MPEG_VIDEO_VPX_NUM_PARTITIONS:
1424 case V4L2_CID_MPEG_VIDEO_VPX_NUM_REF_FRAMES:
1425 *type = V4L2_CTRL_TYPE_INTEGER_MENU;
1426 break;
1427 case V4L2_CID_USER_CLASS:
1428 case V4L2_CID_CAMERA_CLASS:
1429 case V4L2_CID_CODEC_CLASS:
1430 case V4L2_CID_FM_TX_CLASS:
1431 case V4L2_CID_FLASH_CLASS:
1432 case V4L2_CID_JPEG_CLASS:
1433 case V4L2_CID_IMAGE_SOURCE_CLASS:
1434 case V4L2_CID_IMAGE_PROC_CLASS:
1435 case V4L2_CID_DV_CLASS:
1436 case V4L2_CID_FM_RX_CLASS:
1437 case V4L2_CID_RF_TUNER_CLASS:
1438 case V4L2_CID_DETECT_CLASS:
1439 case V4L2_CID_CODEC_STATELESS_CLASS:
1440 case V4L2_CID_COLORIMETRY_CLASS:
1441 *type = V4L2_CTRL_TYPE_CTRL_CLASS;
1442 /* You can neither read nor write these */
1443 *flags |= V4L2_CTRL_FLAG_READ_ONLY | V4L2_CTRL_FLAG_WRITE_ONLY;
1444 *min = *max = *step = *def = 0;
1445 break;
1446 case V4L2_CID_BG_COLOR:
1447 case V4L2_CID_COLORFX_RGB:
1448 *type = V4L2_CTRL_TYPE_INTEGER;
1449 *step = 1;
1450 *min = 0;
1451 /* Max is calculated as RGB888 that is 2^24 - 1 */
1452 *max = 0xffffff;
1453 break;
1454 case V4L2_CID_COLORFX_CBCR:
1455 *type = V4L2_CTRL_TYPE_INTEGER;
1456 *step = 1;
1457 *min = 0;
1458 *max = 0xffff;
1459 break;
1460 case V4L2_CID_FLASH_FAULT:
1461 case V4L2_CID_JPEG_ACTIVE_MARKER:
1462 case V4L2_CID_3A_LOCK:
1463 case V4L2_CID_AUTO_FOCUS_STATUS:
1464 case V4L2_CID_DV_TX_HOTPLUG:
1465 case V4L2_CID_DV_TX_RXSENSE:
1466 case V4L2_CID_DV_TX_EDID_PRESENT:
1467 case V4L2_CID_DV_RX_POWER_PRESENT:
1468 *type = V4L2_CTRL_TYPE_BITMASK;
1469 break;
1470 case V4L2_CID_MIN_BUFFERS_FOR_CAPTURE:
1471 case V4L2_CID_MIN_BUFFERS_FOR_OUTPUT:
1472 *type = V4L2_CTRL_TYPE_INTEGER;
1473 *flags |= V4L2_CTRL_FLAG_READ_ONLY;
1474 break;
1475 case V4L2_CID_MPEG_VIDEO_DEC_PTS:
1476 *type = V4L2_CTRL_TYPE_INTEGER64;
1477 *flags |= V4L2_CTRL_FLAG_VOLATILE | V4L2_CTRL_FLAG_READ_ONLY;
1478 *min = *def = 0;
1479 *max = 0x1ffffffffLL;
1480 *step = 1;
1481 break;
1482 case V4L2_CID_MPEG_VIDEO_DEC_FRAME:
1483 *type = V4L2_CTRL_TYPE_INTEGER64;
1484 *flags |= V4L2_CTRL_FLAG_VOLATILE | V4L2_CTRL_FLAG_READ_ONLY;
1485 *min = *def = 0;
1486 *max = 0x7fffffffffffffffLL;
1487 *step = 1;
1488 break;
1489 case V4L2_CID_MPEG_VIDEO_DEC_CONCEAL_COLOR:
1490 *type = V4L2_CTRL_TYPE_INTEGER64;
1491 *min = 0;
1492 /* default for 8 bit black, luma is 16, chroma is 128 */
1493 *def = 0x8000800010LL;
1494 *max = 0xffffffffffffLL;
1495 *step = 1;
1496 break;
1497 case V4L2_CID_PIXEL_RATE:
1498 *type = V4L2_CTRL_TYPE_INTEGER64;
1499 *flags |= V4L2_CTRL_FLAG_READ_ONLY;
1500 break;
1501 case V4L2_CID_DETECT_MD_REGION_GRID:
1502 *type = V4L2_CTRL_TYPE_U8;
1503 break;
1504 case V4L2_CID_DETECT_MD_THRESHOLD_GRID:
1505 *type = V4L2_CTRL_TYPE_U16;
1506 break;
1507 case V4L2_CID_RDS_TX_ALT_FREQS:
1508 *type = V4L2_CTRL_TYPE_U32;
1509 break;
1510 case V4L2_CID_STATELESS_MPEG2_SEQUENCE:
1511 *type = V4L2_CTRL_TYPE_MPEG2_SEQUENCE;
1512 break;
1513 case V4L2_CID_STATELESS_MPEG2_PICTURE:
1514 *type = V4L2_CTRL_TYPE_MPEG2_PICTURE;
1515 break;
1516 case V4L2_CID_STATELESS_MPEG2_QUANTISATION:
1517 *type = V4L2_CTRL_TYPE_MPEG2_QUANTISATION;
1518 break;
1519 case V4L2_CID_STATELESS_FWHT_PARAMS:
1520 *type = V4L2_CTRL_TYPE_FWHT_PARAMS;
1521 break;
1522 case V4L2_CID_STATELESS_H264_SPS:
1523 *type = V4L2_CTRL_TYPE_H264_SPS;
1524 break;
1525 case V4L2_CID_STATELESS_H264_PPS:
1526 *type = V4L2_CTRL_TYPE_H264_PPS;
1527 break;
1528 case V4L2_CID_STATELESS_H264_SCALING_MATRIX:
1529 *type = V4L2_CTRL_TYPE_H264_SCALING_MATRIX;
1530 break;
1531 case V4L2_CID_STATELESS_H264_SLICE_PARAMS:
1532 *type = V4L2_CTRL_TYPE_H264_SLICE_PARAMS;
1533 break;
1534 case V4L2_CID_STATELESS_H264_DECODE_PARAMS:
1535 *type = V4L2_CTRL_TYPE_H264_DECODE_PARAMS;
1536 break;
1537 case V4L2_CID_STATELESS_H264_PRED_WEIGHTS:
1538 *type = V4L2_CTRL_TYPE_H264_PRED_WEIGHTS;
1539 break;
1540 case V4L2_CID_STATELESS_VP8_FRAME:
1541 *type = V4L2_CTRL_TYPE_VP8_FRAME;
1542 break;
1543 case V4L2_CID_STATELESS_AV1_SEQUENCE:
1544 *type = V4L2_CTRL_TYPE_AV1_SEQUENCE;
1545 break;
1546 case V4L2_CID_STATELESS_AV1_TILE_GROUP:
1547 *type = V4L2_CTRL_TYPE_AV1_TILE_GROUP;
> 1548 *flags |= V4L2_CTRL_FLAG_DYNAMIC_ARRAY;
--
0-DAY CI Kernel Test Service
https://01.org/lkp
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC PATCH v2] media: Add AV1 uAPI
2022-03-22 16:01 [RFC PATCH v2] media: Add AV1 uAPI daniel.almeida
2022-03-22 19:29 ` kernel test robot
@ 2022-05-10 0:04 ` Steve Cho
2022-05-10 16:30 ` Daniel Almeida
1 sibling, 1 reply; 10+ messages in thread
From: Steve Cho @ 2022-05-10 0:04 UTC (permalink / raw)
To: daniel.almeida; +Cc: hverkuil, linux-media, Nicolas Dufresne
Hi Daniel,
Found a minor typo.
> See enum_v4l2_av1_frame_restoration_type.
Assume you meant v4l2_av1_frame_restoration_type instead here.
Steve
On Tue, Mar 22, 2022 at 9:01 AM <daniel.almeida@collabora.com> wrote:
>
> From: Daniel Almeida <daniel.almeida@collabora.com>
>
> This patch adds the AOMedia Video 1 (AV1) kernel uAPI.
>
> This design is based on currently available AV1 API implementations and
> aims to support the development of AV1 stateless video codecs
> on Linux.
>
> Signed-off-by: Daniel Almeida <daniel.almeida@collabora.com>
> Signed-off-by: Nicolas Dufresne <nicolas.dufresne@collabora.com>
> ---
> A quick reminder that this patch needs the V4L2_CTRL_FLAG_DYNAMIC_ARRAY patchset
> by Hans.
>
> Changes from v1:
>
> - Fixed the issues pointed out by Hans in his review (Thanks, Hans)
> - Fixed the sign for ref_deltas and mode_deltas
> These are signed values and will otherwise fail the validation in
> v4l2-ctrls-core.c.
> - Fix film grain y/cb/cr points validation
> We were controlling the entire array, but there is a subset of points
> being set, which lead to the validation to fail. Fix this by limiting
> the test to the number of points. The number of point is already
> controlled in the previous check so should be safe.
> - Fix validation for Su(n) syntax
> The Su(n) AV1 syntax ranges from -2^n/2 to 2^n/2 - 1, while the previous code
> was only validating values from -2^n/2 + 1 to 2^n/2 - 1.
> - Fix order_hints and buffer_removal_time
> The buffer_removal_time should have been 32 bit and the
> ref_order_hint got confused with order_hints. We want the
> second one, as the first one is only used as a backup to
> fill the second on missing last frame.
> - Fix off by one error in validation code
> There are 5 segmentation flags, so any code that sets the most significant
> flag would automatically fail.
> - Feature data can be negative
> Feature data can be negative if Segmentation_Feature_Signed[j] == 1, in which
> case it is read with the Su(n) syntax.
> Reflect that by changing the data type to s16.
> - Remove large scale mode controls
> Large scale mode is not supported. Remove all controls associated with it.
> This means that all TILE_LIST_* controls are gone.
> - Split v4l2_av1_film_grain into its own control
> Split v4l2_av1_film_grain into its own control, as not all accelerators
> might support it. This control is now optional.
> - Fix broken docs for v4l2_av1_interpolation_filter
> Docs mention VP9 instead of AV1. This is a typo.
> - Fix broken docs for v4l2_ctrl_av1_tile_group_entry
> Fix a small typo in the docs.
> - Fix AV1 reference lists
> We need both all the references and the per frame references. This is
> because unlike VP9, show_existing_frame that are key frame will refresh
> the frame slots, which prevents the driver from keeping track since
> these frame are not signalled to the driver.
>
> Instead mimic other API (like VA and DXVA) and provide a complete list
> of active references. The driver can then cleanup any data it was
> storing for references that are no longer in use, saving previous
> memory.
> - Fix broken docs in ext-ctrls-codec-stateless.rst
> :c:type:`struct v4l2_ctrl_av1_tile_group_entry` would not resolve, it would
> also produce a warning when making the docs. Fix this by changing this to
> :c:type:`v4l2_ctrl_av1_tile_group_entry` instead.
>
> TODO:
>
> This patch is work in progress as we do not have two drivers using it yet. More
> implementations are needed before the final design is settled. In particular, we
> have moved into reorganizing the parts for the purposes of ergonomy and
> efficiency.
>
>
> ---
> .../userspace-api/media/v4l/biblio.rst | 10 +
> .../media/v4l/ext-ctrls-codec-stateless.rst | 1245 +++++++++++++++++
> .../media/v4l/pixfmt-compressed.rst | 17 +
> .../media/v4l/vidioc-g-ext-ctrls.rst | 28 +
> .../media/v4l/vidioc-queryctrl.rst | 36 +
> .../media/videodev2.h.rst.exceptions | 7 +
> drivers/media/v4l2-core/v4l2-ctrls-core.c | 280 +++-
> drivers/media/v4l2-core/v4l2-ctrls-defs.c | 64 +
> drivers/media/v4l2-core/v4l2-ioctl.c | 1 +
> include/media/v4l2-ctrls.h | 10 +
> include/uapi/linux/v4l2-controls.h | 743 ++++++++++
> include/uapi/linux/videodev2.h | 13 +
> 12 files changed, 2453 insertions(+), 1 deletion(-)
>
> diff --git a/Documentation/userspace-api/media/v4l/biblio.rst b/Documentation/userspace-api/media/v4l/biblio.rst
> index 9cd18c153d19..3e21e51ba329 100644
> --- a/Documentation/userspace-api/media/v4l/biblio.rst
> +++ b/Documentation/userspace-api/media/v4l/biblio.rst
> @@ -427,3 +427,13 @@ VP9
> :title: VP9 Bitstream & Decoding Process Specification
>
> :author: Adrian Grange (Google), Peter de Rivaz (Argon Design), Jonathan Hunt (Argon Design)
> +
> +.. _av1:
> +
> +AV1
> +===
> +
> +
> +:title: AV1 Bitstream & Decoding Process Specification
> +
> +:author: Peter de Rivaz, Argon Design Ltd, Jack Haughton, Argon Design Ltd
> diff --git a/Documentation/userspace-api/media/v4l/ext-ctrls-codec-stateless.rst b/Documentation/userspace-api/media/v4l/ext-ctrls-codec-stateless.rst
> index 6541e4c32b26..606a2aadbc30 100644
> --- a/Documentation/userspace-api/media/v4l/ext-ctrls-codec-stateless.rst
> +++ b/Documentation/userspace-api/media/v4l/ext-ctrls-codec-stateless.rst
> @@ -2042,3 +2042,1248 @@ This structure contains all loop filter related parameters. See sections
> - 0x2
> - When set, the bitstream contains additional syntax elements that
> specify which mode and reference frame deltas are to be updated.
> +
> +
> +.. _v4l2-codec-stateless-av1:
> +
> +``V4L2_CID_STATELESS_AV1_SEQUENCE (struct)``
> + Represents an AV1 Sequence OBU. See section 5.5. "Sequence header OBU syntax"
> + in :ref:`av1` for more details.
> +
> +.. c:type:: v4l2_ctrl_av1_sequence
> +
> +.. cssclass:: longtable
> +
> +.. tabularcolumns:: |p{5.8cm}|p{4.8cm}|p{6.6cm}|
> +
> +.. flat-table:: struct v4l2_ctrl_av1_sequence
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - __u32
> + - ``flags``
> + - See :ref:`AV1 Sequence Flags <av1_sequence_flags>`.
> + * - __u8
> + - ``seq_profile``
> + - Specifies the features that can be used in the coded video sequence.
> + * - __u8
> + - ``order_hint_bits``
> + - Specifies the number of bits used for the order_hint field at each frame.
> + * - __u8
> + - ``bit_depth``
> + - the bitdepth to use for the sequence as described in section 5.5.2
> + "Color config syntax" in :ref:`av1` for more details.
> + * - __u16
> + - ``max_frame_width_minus_1``
> + - specifies the maximum frame width minus 1 for the frames represented by
> + this sequence header.
> +
> +.. _av1_sequence_flags:
> +
> +``AV1 Sequence Flags``
> +
> +.. cssclass:: longtable
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_SEQUENCE_FLAG_STILL_PICTURE``
> + - 0x00000001
> + - If set, specifies that the coded video sequence contains only one coded
> + frame. If not set, specifies that the coded video sequence contains one or
> + more coded frames.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_USE_128X128_SUPERBLOCK``
> + - 0x00000002
> + - If set, indicates that superblocks contain 128x128 luma samples.
> + When equal to 0, it indicates that superblocks contain 64x64 luma samples.
> + (The number of contained chroma samples depends on subsampling_x and
> + subsampling_y).
> + * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_FILTER_INTRA``
> + - 0x00000004
> + - If set, specifies that the use_filter_intra syntax element may be
> + present. If not set, specifies that the use_filter_intra syntax element will
> + not be present.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_INTRA_EDGE_FILTER``
> + - 0x00000008
> + - Specifies whether the intra edge filtering process should be enabled.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_INTERINTRA_COMPOUND``
> + - 0x00000010
> + - If set, specifies that the mode info for inter blocks may contain the
> + syntax element interintra. If not set, specifies that the syntax element
> + interintra will not be present.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_MASKED_COMPOUND``
> + - 0x00000020
> + - If set, specifies that the mode info for inter blocks may contain the
> + syntax element compound_type. If not set, specifies that the syntax element
> + compound_type will not be present.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_WARPED_MOTION``
> + - 0x00000040
> + - If set, indicates that the allow_warped_motion syntax element may be
> + present. If not set, indicates that the allow_warped_motion syntax element
> + will not be present.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_DUAL_FILTER``
> + - 0x00000080
> + - If set, indicates that the inter prediction filter type may be specified
> + independently in the horizontal and vertical directions. If the flag is
> + equal to 0, only one filter type may be specified, which is then used in
> + both directions.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_ORDER_HINT``
> + - 0x00000100
> + - If set, indicates that tools based on the values of order hints may be
> + used. If not set, indicates that tools based on order hints are disabled.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_JNT_COMP``
> + - 0x00000200
> + - If set, indicates that the distance weights process may be used for
> + inter prediction.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_REF_FRAME_MVS``
> + - 0x00000400
> + - If set, indicates that the use_ref_frame_mvs syntax element may be
> + present. If not set, indicates that the use_ref_frame_mvs syntax element
> + will not be present.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_SUPERRES``
> + - 0x00000800
> + - If set, specifies that the use_superres syntax element will be present
> + in the uncompressed header. If not set, specifies that the use_superres
> + syntax element will not be present (instead use_superres will be set to 0
> + in the uncompressed header without being read).
> + * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_CDEF``
> + - 0x00001000
> + - If set, specifies that cdef filtering may be enabled. If not set,
> + specifies that cdef filtering is disabled.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_ENABLE_RESTORATION``
> + - 0x00002000
> + - If set, specifies that loop restoration filtering may be enabled. If not
> + set, specifies that loop restoration filtering is disabled.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_MONO_CHROME``
> + - 0x00004000
> + - If set, indicates that the video does not contain U and V color planes.
> + If not set, indicates that the video contains Y, U, and V color planes.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_COLOR_RANGE``
> + - 0x00008000
> + - If set, signals full swing representation. If not set, signals studio
> + swing representation.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_SUBSAMPLING_X``
> + - 0x00010000
> + - Specify the chroma subsampling format.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_SUBSAMPLING_Y``
> + - 0x00020000
> + - Specify the chroma subsampling format.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_FILM_GRAIN_PARAMS_PRESENT``
> + - 0x00040000
> + - Specifies whether film grain parameters are present in the coded video
> + sequence.
> + * - ``V4L2_AV1_SEQUENCE_FLAG_SEPARATE_UV_DELTA_Q``
> + - 0x00080000
> + - If set, indicates that the U and V planes may have separate delta
> + quantizer values. If not set, indicates that the U and V planes will share
> + the same delta quantizer value.
> +
> +``V4L2_CID_STATELESS_AV1_TILE_GROUP (struct)``
> + Represents a tile group as seen in an AV1 Tile Group OBU or Frame OBU. A
> + v4l2_ctrl_av1_tile_group instance will refer to tg_end - tg_start instances
> + of struct :c:type:`v4l2_ctrl_av1_tile_group_entry`. See section
> + 6.10.1 "General tile group OBU semantics" in :ref:`av1` for more details.
> +
> +.. c:type:: v4l2_ctrl_av1_tile_group
> +
> +.. cssclass:: longtable
> +
> +.. tabularcolumns:: |p{5.8cm}|p{4.8cm}|p{6.6cm}|
> +
> +.. flat-table:: struct v4l2_ctrl_av1_tile_group
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - __u8
> + - ``flags``
> + - See :ref:`AV1 Tile Group Flags <av1_tile_group_flags>`.
> + * - __u8
> + - ``tg_start``
> + - Specifies the zero-based index of the first tile in the current tile
> + group.
> + * - __u8
> + - ``tg_end``
> + - Specifies the zero-based index of the last tile in the current tile
> + group.
> +
> +.. _av1_tile_group_flags:
> +
> +``AV1 Tile Group Flags``
> +
> +.. cssclass:: longtable
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_TILE_GROUP_FLAG_START_AND_END_PRESENT``
> + - 0x00000001
> + - Specifies whether tg_start and tg_end are present. If tg_start and
> + tg_end are not present, this tile group covers the entire frame.
> +
> +``V4L2_CID_STATELESS_AV1_TILE_GROUP_ENTRY (struct)``
> + Represents a single AV1 tile inside an AV1 Tile Group. Note that MiRowStart,
> + MiRowEnd, MiColStart and MiColEnd can be retrieved from struct
> + v4l2_av1_tile_info in struct v4l2_ctrl_av1_frame_header using tile_row and
> + tile_col. See section 6.10.1 "General tile group OBU semantics" in
> + :ref:`av1` for more details.
> +
> +.. c:type:: v4l2_ctrl_av1_tile_group_entry
> +
> +.. cssclass:: longtable
> +
> +.. tabularcolumns:: |p{5.8cm}|p{4.8cm}|p{6.6cm}|
> +
> +.. flat-table:: struct v4l2_ctrl_av1_tile_group_entry
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - __u32
> + - ``tile_offset``
> + - Offset from the OBU data, i.e. where the coded tile data actually starts.
> + * - __u32
> + - ``tile_size``
> + - Specifies the size in bytes of the coded tile. Equivalent to "TileSize"
> + in :ref:`av1`.
> + * - __u32
> + - ``tile_row``
> + - Specifies the row of the current tile. Equivalent to "TileRow" in
> + :ref:`av1`.
> + * - __u32
> + - ``tile_col``
> + - Specifies the column of the current tile. Equivalent to "TileColumn" in
> + :ref:`av1`.
> +
> +.. c:type:: v4l2_av1_warp_model
> +
> + AV1 Warp Model as described in section 3 "Symbols and abbreviated terms" of
> + :ref:`av1`.
> +
> +.. raw:: latex
> +
> + \scriptsize
> +
> +.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_WARP_MODEL_IDENTITY``
> + - 0
> + - Warp model is just an identity transform.
> + * - ``V4L2_AV1_WARP_MODEL_TRANSLATION``
> + - 1
> + - Warp model is a pure translation.
> + * - ``V4L2_AV1_WARP_MODEL_ROTZOOM``
> + - 2
> + - Warp model is a rotation + symmetric zoom + translation.
> + * - ``V4L2_AV1_WARP_MODEL_AFFINE``
> + - 3
> + - Warp model is a general affine transform.
> +
> +.. c:type:: v4l2_av1_reference_frame
> +
> +AV1 Reference Frames as described in section 6.10.24. "Ref frames semantics"
> +of :ref:`av1`.
> +
> +.. raw:: latex
> +
> + \scriptsize
> +
> +.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_REF_INTRA_FRAME``
> + - 0
> + - Intra Frame Reference.
> + * - ``V4L2_AV1_REF_LAST_FRAME``
> + - 1
> + - Last Frame Reference.
> + * - ``V4L2_AV1_REF_LAST2_FRAME``
> + - 2
> + - Last2 Frame Reference.
> + * - ``V4L2_AV1_REF_LAST3_FRAME``
> + - 3
> + - Last3 Frame Reference.
> + * - ``V4L2_AV1_REF_GOLDEN_FRAME``
> + - 4
> + - Golden Frame Reference.
> + * - ``V4L2_AV1_REF_BWDREF_FRAME``
> + - 5
> + - BWD Frame Reference.
> + * - ``V4L2_AV1_REF_ALTREF2_FRAME``
> + - 6
> + - ALTREF2 Frame Reference.
> + * - ``V4L2_AV1_REF_ALTREF_FRAME``
> + - 7
> + - ALTREF Frame Reference.
> + * - ``V4L2_AV1_NUM_REF_FRAMES``
> + - 8
> + - Total number of reference frames.
> +
> +.. c:type:: v4l2_av1_global_motion
> +
> +AV1 Global Motion parameters as described in section 6.8.17
> +"Global motion params semantics" of :ref:`av1` for more details.
> +
> +.. cssclass:: longtable
> +
> +.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
> +
> +.. flat-table:: struct v4l2_av1_global_motion
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - __u8
> + - ``flags[V4L2_AV1_TOTAL_REFS_PER_FRAME]``
> + - A bitfield containing the flags per reference frame. See
> + :ref:`AV1 Global Motion Flags <av1_global_motion_flags>` for more
> + details.
> + * - enum :c:type:`v4l2_av1_warp_model`
> + - ``type[V4L2_AV1_TOTAL_REFS_PER_FRAME]``
> + - The type of global motion transform used.
> + * - __u32
> + - ``params[V4L2_AV1_TOTAL_REFS_PER_FRAME][6]``
> + - This field has the same meaning as "gm_params" in :ref:`av1`.
> + * - __u8
> + - ``invalid``
> + - Bitfield indicating whether the global motion params are invalid for a
> + given reference frame. See section 7.11.3.6. Setup shear process and the
> + variable "warpValid". Use V4L2_AV1_GLOBAL_MOTION_IS_INVALID(ref) to
> + create a suitable mask.
> +
> +.. _av1_global_motion_flags:
> +
> +``AV1 Global Motion Flags``
> +
> +.. cssclass:: longtable
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_GLOBAL_MOTION_FLAG_IS_GLOBAL``
> + - 0x00000001
> + - Specifies whether global motion parameters are present for a particular
> + reference frame.
> + * - ``V4L2_AV1_GLOBAL_MOTION_FLAG_IS_ROT_ZOOM``
> + - 0x00000002
> + - Specifies whether a particular reference frame uses rotation and zoom
> + global motion.
> + * - ``V4L2_AV1_GLOBAL_MOTION_FLAG_IS_TRANSLATION``
> + - 0x00000004
> + - Specifies whether a particular reference frame uses rotation and zoom
> + global motion.
> +
> +.. c:type:: v4l2_av1_frame_restoration_type
> +
> +AV1 Frame Restoration Type.
> +
> +.. raw:: latex
> +
> + \scriptsize
> +
> +.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_FRAME_RESTORE_NONE``
> + - 0
> + - No filtering is applied.
> + * - ``V4L2_AV1_FRAME_RESTORE_WIENER``
> + - 1
> + - Wiener filter process is invoked.
> + * - ``V4L2_AV1_FRAME_RESTORE_SGRPROJ``
> + - 2
> + - Self guided filter process is invoked.
> + * - ``V4L2_AV1_FRAME_RESTORE_SWITCHABLE``
> + - 3
> + - Restoration filter is swichtable.
> +
> +.. c:type:: v4l2_av1_loop_restoration
> +
> +AV1 Loop Restauration as described in section 6.10.15 "Loop restoration params
> +semantics" of :ref:`av1`.
> +
> +.. cssclass:: longtable
> +
> +.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
> +
> +.. flat-table:: struct v4l2_av1_loop_restoration
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - __u8
> + - ``flags``
> + - See :ref:`AV1 Loop Restoration Flags <av1_loop_restoration_flags>`.
> + * - :c:type:`v4l2_av1_frame_restoration_type`
> + - ``frame_restoration_type[V4L2_AV1_NUM_PLANES_MAX]``
> + - Specifies the type of restoration used for each plane.
> + * - __u8
> + - ``lr_unit_shift``
> + - Specifies if the luma restoration size should be halved.
> + * - __u8
> + - ``lr_uv_shift``
> + - Specifies if the chroma size should be half the luma size.
> + * - __u8
> + - ``loop_restoration_size[V4L2_AV1_MAX_NUM_PLANES]``
> + - specifies the size of loop restoration units in units of samples in the
> + current plane.
> +
> +.. _av1_loop_restoration_flags:
> +
> +``AV1 Loop Restoration Flags``
> +
> +.. cssclass:: longtable
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_LOOP_RESTORATION_FLAG_USES_LR``
> + - 0x00000001
> + - Retains the same meaning as UsesLr in :ref:`av1`.
> + * - ``V4L2_AV1_LOOP_RESTORATION_FLAG_USES_CHROMA_LR``
> + - 0x00000002
> + - Retains the same meaning as UsesChromaLr in :ref:`av1`.
> +
> +.. c:type:: v4l2_av1_cdef
> +
> +AV1 CDEF params semantics as described in section 6.10.14. "CDEF params
> +semantics" of :ref:`av1`.
> +
> +.. cssclass:: longtable
> +
> +.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
> +
> +.. flat-table:: struct v4l2_av1_cdef
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - __u8
> + - ``damping_minus_3``
> + - Controls the amount of damping in the deringing filter.
> + * - __u8
> + - ``bits``
> + - Specifies the number of bits needed to specify which CDEF filter to
> + apply.
> + * - __u8
> + - ``y_pri_strength[V4L2_AV1_CDEF_MAX]``
> + - Specifies the strength of the primary filter.
> + * - __u8
> + - ``y_sec_strength[V4L2_AV1_CDEF_MAX]``
> + - Specifies the strength of the secondary filter.
> + * - __u8
> + - ``uv_pri_strength[V4L2_AV1_CDEF_MAX]``
> + - Specifies the strength of the primary filter.
> + * - __u8
> + - ``uv_secondary_strength[V4L2_AV1_CDEF_MAX]``
> + - Specifies the strength of the secondary filter.
> +
> +.. c:type:: v4l2_av1_segment_feature
> +
> +AV1 segment features as described in section 3 "Symbols and abbreviated terms"
> +of :ref:`av1`.
> +
> +.. raw:: latex
> +
> + \scriptsize
> +
> +.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_SEG_LVL_ALT_Q``
> + - 0
> + - Index for quantizer segment feature.
> + * - ``V4L2_AV1_SEG_LVL_ALT_LF_Y_V``
> + - 1
> + - Index for vertical luma loop filter segment feature.
> + * - ``V4L2_AV1_SEG_LVL_REF_FRAME``
> + - 5
> + - Index for reference frame segment feature.
> + * - ``V4L2_AV1_SEG_LVL_REF_SKIP``
> + - 6
> + - Index for skip segment feature.
> + * - ``V4L2_AV1_SEG_LVL_REF_GLOBALMV``
> + - 7
> + - Index for global mv feature.
> + * - ``V4L2_AV1_SEG_LVL_MAX``
> + - 8
> + - Number of segment features.
> +
> +.. c:type:: v4l2_av1_segmentation
> +
> +AV1 Segmentation params as defined in section 6.8.13. "Segmentation params
> +semantics" of :ref:`av1`.
> +
> +.. cssclass:: longtable
> +
> +.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
> +
> +.. flat-table:: struct v4l2_av1_film_grain
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - __u8
> + - ``flags``
> + - See :ref:`AV1 Segmentation Flags <av1_segmentation_flags>`
> + * - __u8
> + - ``feature_enabled[V4L2_AV1_MAX_SEGMENTS]``
> + - Bitmask defining which features are enabled in each segment. Use
> + V4L2_AV1_SEGMENT_FEATURE_ENABLED to build a suitable mask.
> + * - __u16
> + - `feature_data[V4L2_AV1_MAX_SEGMENTS][V4L2_AV1_SEG_LVL_MAX]``
> + - Data attached to each feature. Data entry is only valid if the feature
> + is enabled
> + * - __u8
> + - ``last_active_seg_id``
> + - Indicates the highest numbered segment id that has some
> + enabled feature. This is used when decoding the segment id to only decode
> + choices corresponding to used segments.
> +
> +.. _av1_segmentation_flags:
> +
> +``AV1 Segmentation Flags``
> +
> +.. cssclass:: longtable
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_SEGMENTATION_FLAG_ENABLED``
> + - 0x00000001
> + - If set, indicates that this frame makes use of the segmentation tool. If
> + not set, indicates that the frame does not use segmentation.
> + * - ``V4L2_AV1_SEGMENTATION_FLAG_UPDATE_MAP``
> + - 0x00000002
> + - If set, indicates that the segmentation map are updated during the
> + decoding of this frame. If not set, indicates that the segmentation map
> + from the previous frame is used.
> + * - ``V4L2_AV1_SEGMENTATION_FLAG_TEMPORAL_UPDATE``
> + - 0x00000004
> + - If set, indicates that the updates to the segmentation map are coded
> + relative to the existing segmentation map. If not set, indicates that
> + the new segmentation map is coded without reference to the existing
> + segmentation map.
> + * - ``V4L2_AV1_SEGMENTATION_FLAG_UPDATE_DATA``
> + - 0x00000008
> + - If set, indicates that the updates to the segmentation map are coded
> + relative to the existing segmentation map. If not set, indicates that
> + the new segmentation map is coded without reference to the existing
> + segmentation map.
> + * - ``V4L2_AV1_SEGMENTATION_FLAG_SEG_ID_PRE_SKIP``
> + - 0x00000010
> + - If set, indicates that the segment id will be read before the skip
> + syntax element. If not set, indicates that the skip syntax element will
> + be read first.
> +
> +.. c:type:: v4l2_av1_loop_filter
> +
> +AV1 Loop filter params as defined in section 6.8.10. "Loop filter semantics" of
> +:ref:`av1`.
> +
> +.. cssclass:: longtable
> +
> +.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
> +
> +.. flat-table:: struct v4l2_av1_global_motion
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - __u8
> + - ``flags``
> + - See
> + :ref:`AV1 Loop Filter flags <av1_loop_filter_flags>` for more details.
> + * - __u8
> + - ``level[4]``
> + - an array containing loop filter strength values. Different loop
> + filter strength values from the array are used depending on the image
> + plane being filtered, and the edge direction (vertical or horizontal)
> + being filtered.
> + * - __u8
> + - ``sharpness``
> + - indicates the sharpness level. The loop_filter_level and
> + loop_filter_sharpness together determine when a block edge is filtered,
> + and by how much the filtering can change the sample values. The loop
> + filter process is described in section 7.14 of :ref:`av1`.
> + * - __u8
> + - ``ref_deltas[V4L2_AV1_TOTAL_REFS_PER_FRAME]``
> + - contains the adjustment needed for the filter level based on the
> + chosen reference frame. If this syntax element is not present, it
> + maintains its previous value.
> + * - __u8
> + - ``mode_deltas[2]``
> + - contains the adjustment needed for the filter level based on
> + the chosen mode. If this syntax element is not present, it maintains its
> + previous value.
> + * - __u8
> + - ``delta_lf_res``
> + - specifies the left shift which should be applied to decoded loop filter
> + delta values.
> + * - __u8
> + - ``delta_lf_multi``
> + - a value equal to 1 specifies that separate loop filter
> + deltas are sent for horizontal luma edges, vertical luma edges, the U
> + edges, and the V edges. A value of delta_lf_multi equal to 0 specifies
> + that the same loop filter delta is used for all edges.
> +
> +.. _av1_loop_filter_flags:
> +
> +``AV1 Loop Filter Flags``
> +
> +.. cssclass:: longtable
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_LOOP_FILTER_FLAG_DELTA_ENABLED``
> + - 0x00000001
> + - If set, means that the filter level depends on the mode and reference
> + frame used to predict a block. If not set, means that the filter level
> + does not depend on the mode and reference frame.
> + * - ``V4L2_AV1_LOOP_FILTER_FLAG_DELTA_UPDATE``
> + - 0x00000002
> + - If set, means that additional syntax elements are present that specify
> + which mode and reference frame deltas are to be updated. If not set,
> + means that these syntax elements are not present.
> + * - ``V4L2_AV1_LOOP_FILTER_FLAG_DELTA_LF_PRESENT``
> + - 0x00000004
> + - Specifies whether loop filter delta values are present
> +
> +.. c:type:: v4l2_av1_quantization
> +
> +AV1 Quantization params as defined in section 6.8.11 "Quantization params
> +semantics" of :ref:`av1`.
> +
> +.. cssclass:: longtable
> +
> +.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
> +
> +.. flat-table:: struct v4l2_av1_quantization
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - __u8
> + - ``flags``
> + - See
> + :ref:`AV1 Loop Filter flags <av1_quantization_flags>` for more details.
> + * - __u8
> + - ``base_q_idx``
> + - Indicates the base frame qindex. This is used for Y AC coefficients and
> + as the base value for the other quantizers.
> + * - __u8
> + - ``delta_q_y_dc``
> + - Indicates the Y DC quantizer relative to base_q_idx.
> + * - __u8
> + - ``delta_q_u_dc``
> + - Indicates the U DC quantizer relative to base_q_idx.
> + * - __u8
> + - ``delta_q_u_ac``
> + - Indicates the U AC quantizer relative to base_q_idx.
> + * - __u8
> + - ``delta_q_v_dc``
> + - Indicates the V DC quantizer relative to base_q_idx.
> + * - __u8
> + - ``delta_q_v_dc``
> + - Indicates the V DC quantizer relative to base_q_idx.
> + * - __u8
> + - ``qm_y``
> + - Specifies the level in the quantizer matrix that should be used for
> + luma plane decoding.
> + * - __u8
> + - ``qm_u``
> + - Specifies the level in the quantizer matrix that should be used for
> + chroma U plane decoding.
> + * - __u8
> + - ``qm_y``
> + - Specifies the level in the quantizer matrix that should be used for
> + chroma V plane decoding.
> + * - __u8
> + - ``delta_q_res``
> + - Specifies the left shift which should be applied to decoded quantizer
> + index delta values.
> +
> +.. _av1_quantization_flags:
> +
> +``AV1 Quantization Flags``
> +
> +.. cssclass:: longtable
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_QUANTIZATION_FLAG_DIFF_UV_DELTA``
> + - 0x00000001
> + - If set, indicates that the U and V delta quantizer values are coded
> + separately. If not set, indicates that the U and V delta quantizer
> + values share a common value.
> + * - ``V4L2_AV1_QUANTIZATION_FLAG_USING_QMATRIX``
> + - 0x00000002
> + - If set, specifies that the quantizer matrix will be used to compute
> + quantizers.
> + * - ``V4L2_AV1_QUANTIZATION_FLAG_DELTA_Q_PRESENT``
> + - 0x00000004
> + - Specifies whether quantizer index delta values are present.
> +
> +.. c:type:: v4l2_av1_tile_info
> +
> +AV1 Tile info as defined in section 6.8.14. "Tile info semantics" of ref:`av1`.
> +
> +.. cssclass:: longtable
> +
> +.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
> +
> +.. flat-table:: struct v4l2_av1_film_grain
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - __u8
> + - ``flags``
> + - See
> + :ref:`AV1 Tile Info flags <av1_tile_info_flags>` for more details.
> + * - __u32
> + - ``mi_col_starts[V4L2_AV1_MAX_TILE_COLS + 1]``
> + - An array specifying the start column (in units of 4x4 luma
> + samples) for each tile across the image.
> + * - __u32
> + - ``mi_row_starts[V4L2_AV1_MAX_TILE_ROWS + 1]``
> + - An array specifying the start row (in units of 4x4 luma
> + samples) for each tile across the image.
> + * - __u32
> + - ``width_in_sbs_minus_1[V4L2_AV1_MAX_TILE_COLS]``
> + - Specifies the width of a tile minus 1 in units of superblocks.
> + * - __u32
> + - ``height_in_sbs_minus_1[V4L2_AV1_MAX_TILE_ROWS]``
> + - Specifies the height of a tile minus 1 in units of superblocks.
> + * - __u8
> + - ``tile_size_bytes``
> + - Specifies the number of bytes needed to code each tile size.
> + * - __u8
> + - ``context_update_tile_id``
> + - Specifies which tile to use for the CDF update.
> + * - __u8
> + - ``tile_rows``
> + - Specifies the number of tiles down the frame.
> + * - __u8
> + - ``tile_rows``
> + - Specifies the number of tiles across the frame.
> +
> +.. _av1_tile_info_flags:
> +
> +``AV1 Tile Info Flags``
> +
> +.. cssclass:: longtable
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_TILE_INFO_FLAG_UNIFORM_TILE_SPACING``
> + - 0x00000001
> + - If set, means that the tiles are uniformly spaced across the frame. (In
> + other words, all tiles are the same size except for the ones at the
> + right and bottom edge which can be smaller). If not set means that the
> + tile sizes are coded.
> +
> +.. c:type:: v4l2_av1_frame_type
> +
> +AV1 Frame Type
> +
> +.. raw:: latex
> +
> + \scriptsize
> +
> +.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_KEY_FRAME``
> + - 0
> + - Key frame.
> + * - ``V4L2_AV1_INTER_FRAME``
> + - 1
> + - Inter frame.
> + * - ``V4L2_AV1_INTRA_ONLY_FRAME``
> + - 2
> + - Intra-only frame.
> + * - ``V4L2_AV1_SWITCH_FRAME``
> + - 3
> + - Switch frame.
> +
> +.. c:type:: v4l2_av1_interpolation_filter
> +
> +AV1 Interpolation Filter
> +
> +.. raw:: latex
> +
> + \scriptsize
> +
> +.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP``
> + - 0
> + - Eight tap filter.
> + * - ``V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP_SMOOTH``
> + - 1
> + - Eight tap smooth filter.
> + * - ``V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP_SHARP``
> + - 2
> + - Eight tap sharp filter.
> + * - ``V4L2_AV1_INTERPOLATION_FILTER_BILINEAR``
> + - 3
> + - Bilinear filter.
> + * - ``V4L2_AV1_INTERPOLATION_FILTER_SWITCHABLE``
> + - 4
> + - Filter selection is signaled at the block level.
> +
> +.. c:type:: v4l2_av1_tx_mode
> +
> +AV1 Tx mode as described in section 6.8.21 "TX mode semantics" of :ref:`av1`.
> +
> +.. raw:: latex
> +
> + \scriptsize
> +
> +.. tabularcolumns:: |p{7.4cm}|p{0.3cm}|p{9.6cm}|
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_TX_MODE_ONLY_4X4``
> + - 0
> + - The inverse transform will use only 4x4 transforms.
> + * - ``V4L2_AV1_TX_MODE_LARGEST``
> + - 1
> + - The inverse transform will use the largest transform size that fits
> + inside the block.
> + * - ``V4L2_AV1_TX_MODE_SELECT``
> + - 2
> + - The choice of transform size is specified explicitly for each block.
> +
> +``V4L2_CID_STATELESS_AV1_FRAME_HEADER (struct)``
> + Represents a tile list entry as seen in an AV1 Tile List OBU. See section
> + 6.11.2. "Tile list entry semantics" of :ref:`av1` for more details.
> +
> +.. c:type:: v4l2_ctrl_av1_frame_header
> +
> +.. cssclass:: longtable
> +
> +.. tabularcolumns:: |p{5.8cm}|p{4.8cm}|p{6.6cm}|
> +
> +.. flat-table:: struct v4l2_ctrl_av1_frame_header
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - struct :c:type:`v4l2_av1_tile_info`
> + - ``tile_info``
> + - Tile info
> + * - struct :c:type:`v4l2_av1_quantization`
> + - ``quantization``
> + - Quantization params
> + * - struct :c:type:`v4l2_av1_segmentation`
> + - ``segmentation``
> + - Segmentation params
> + * - struct :c:type:`v4l2_av1_loop_filter`
> + - ``loop_filter``
> + - Loop filter params
> + * - struct :c:type:`v4l2_av1_cdef`
> + - ``cdef``
> + - CDEF params
> + * - struct :c:type:`v4l2_av1_loop_restoration`
> + - ``loop_restoration``
> + - Loop restoration params
> + * - struct :c:type:`v4l2_av1_loop_restoration`
> + - ``loop_restoration``
> + - Loop restoration params
> + * - struct :c:type:`v4l2_av1_loop_global_motion`
> + - ``global_motion``
> + - Global motion params
> + * - __u32
> + - ``flags``
> + - See
> + :ref:`AV1 Tile Info flags <av1_frame_header_flags>` for more details.
> + * - enum :c:type:`v4l2_av1_frame_type`
> + - ``frame_type``
> + - Specifies the AV1 frame type
> + * - __u32
> + - ``order_hint``
> + - Specifies OrderHintBits least significant bits of the expected output
> + order for this frame.
> + * - __u8
> + - ``superres_denom``
> + - The denominator for the upscaling ratio.
> + * - __u32
> + - ``upscaled_width``
> + - The upscaled width.
> + * - enum :c:type:`v4l2_av1_interpolation_filter`
> + - ``interpolation_filter``
> + - Specifies the filter selection used for performing inter prediction.
> + * - enum :c:type:`v4l2_av1_tx_mode`
> + - ``tx_mode``
> + - Specifies how the transform size is determined.
> + * - __u32
> + - ``frame_width_minus_1``
> + - Add 1 to get the frame's width.
> + * - __u32
> + - ``frame_height_minus_1``
> + - Add 1 to get the frame's height.
> + * - __u16
> + - ``render_width_minus_1``
> + - Add 1 to get the render width of the frame in luma samples.
> + * - __u16
> + - ``render_height_minus_1``
> + - Add 1 to get the render height of the frame in luma samples.
> + * - __u32
> + - ``current_frame_id``
> + - Specifies the frame id number for the current frame. Frame
> + id numbers are additional information that do not affect the decoding
> + process, but provide decoders with a way of detecting missing reference
> + frames so that appropriate action can be taken.
> + * - __u8
> + - ``primary_ref_frame``
> + - Specifies which reference frame contains the CDF values and other state
> + that should be loaded at the start of the frame..
> + * - __u8
> + - ``buffer_removal_time[V4L2_AV1_MAX_OPERATING_POINTS]``
> + - Specifies the frame removal time in units of DecCT clock ticks counted
> + from the removal time of the last random access point for operating point
> + opNum.
> + * - __u8
> + - ``refresh_frame_flags[V4L2_AV1_MAX_OPERATING_POINTS]``
> + - Contains a bitmask that specifies which reference frame slots will be
> + updated with the current frame after it is decoded.
> + * - __u32
> + - ``ref_order_hint[V4L2_AV1_NUM_REF_FRAMES]``
> + - Specifies the expected output order hint for each reference frame.
> + * - __s8
> + - ``last_frame_idx``
> + - Specifies the reference frame to use for LAST_FRAME.
> + * - __s8
> + - ``gold_frame_idx``
> + - Specifies the reference frame to use for GOLDEN_FRAME.
> + * - __u64
> + - ``reference_frame_ts[V4L2_AV1_TOTAL_REFS_PER_FRAME]``
> + - the V4L2 timestamp for each of the reference frames enumerated in
> + enum :c:type:`v4l2_av1_reference_frame` starting at
> + ``V4L2_AV1_REF_LAST_FRAME``. This represent the state of reference
> + slot as describe in the spec and updated by userland through the
> + `Reference frame update process` in section 7.20. The timestamp refers
> + to the ``timestamp`` field in struct :c:type:`v4l2_buffer`. Use the
> + :c:func:`v4l2_timeval_to_ns()` function to convert the struct
> + :c:type:`timeval` in struct :c:type:`v4l2_buffer` to a __u64.
> + * - __u8
> + - ``ref_frame_idx[V4L2_AV1_REFS_PER_FRAME]``
> + - an index into ``reference_frame_ts`` representing the ordered list of
> + references used by inter-frame. Matches the bitstream syntax
> + element of the same name.
> + * - __u8
> + - ``skip_mode_frame[2]``
> + - Specifies the frames to use for compound prediction when skip_mode is
> + equal to 1.
> +
> +.. _av1_frame_header_flags:
> +
> +``AV1 Frame Header Flags``
> +
> +.. cssclass:: longtable
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_SHOW_FRAME``
> + - 0x00000001
> + - If set, specifies that this frame should be immediately output once
> + decoded. If not set, specifies that this frame should not be immediately
> + output. (It may be output later if a later uncompressed header uses
> + show_existing_frame equal to 1).
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_SHOWABLE_FRAME``
> + - 0x00000002
> + - If set, specifies that the frame may be output using the
> + show_existing_frame mechanism. If not set, specifies that this frame
> + will not be output using the show_existing_frame mechanism.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_ERROR_RESILIENT_MODE``
> + - 0x00000004
> + - Specifies whether error resilient mode is enabled.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_DISABLE_CDF_UPDATE``
> + - 0x00000008
> + - Specifies whether the CDF update in the symbol decoding process should
> + be disabled.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_SCREEN_CONTENT_TOOLS``
> + - 0x00000010
> + - Specifies whether the CDF update in the symbol decoding process should
> + be disabled.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_FORCE_INTEGER_MV``
> + - 0x00000020
> + - If set, specifies that motion vectors will always be integers. If not
> + set, specifies that motion vectors can contain fractional bits.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_INTRABC``
> + - 0x00000040
> + - If set, indicates that intra block copy may be used in this frame. If
> + not set, indicates that intra block copy is not allowed in this frame.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_USE_SUPERRES``
> + - 0x00000080
> + - If set, indicates that upscaling is needed.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_HIGH_PRECISION_MV``
> + - 0x00000100
> + - If set, specifies that motion vectors are specified to eighth pel
> + precision. If not set, specifies that motion vectors are specified to
> + quarter pel precision;
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_IS_MOTION_MODE_SWITCHABLE``
> + - 0x00000200
> + - If not set, specifies that only the SIMPLE motion mode will be used.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_USE_REF_FRAME_MVS``
> + - 0x00000400
> + - If set specifies that motion vector information from a previous frame
> + can be used when decoding the current frame. If not set, specifies that
> + this information will not be used.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_DISABLE_FRAME_END_UPDATE_CDF``
> + - 0x00000800
> + - If set indicates that the end of frame CDF update is disabled. If not
> + set, indicates that the end of frame CDF update is enabled
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_UNIFORM_TILE_SPACING``
> + - 0x00001000
> + - If set, means that the tiles are uniformly spaced across the frame. (In
> + other words, all tiles are the same size except for the ones at the
> + right and bottom edge which can be smaller). If not set, means that the
> + tile sizes are coded
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_WARPED_MOTION``
> + - 0x00002000
> + - If set, indicates that the syntax element motion_mode may be present, if
> + not set, indicates that the syntax element motion_mode will not be
> + present.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_REFERENCE_SELECT``
> + - 0x00004000
> + - If set, specifies that the mode info for inter blocks contains the
> + syntax element comp_mode that indicates whether to use single or
> + compound reference prediction. If not set, specifies that all inter
> + blocks will use single prediction.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_REDUCED_TX_SET``
> + - 0x00008000
> + - If set, specifies that the frame is restricted to a reduced subset of
> + the full set of transform types.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_SKIP_MODE_ALLOWED``
> + - 0x00010000
> + - This flag retains the same meaning as SkipModeAllowed in :ref:`av1`.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_SKIP_MODE_PRESENT``
> + - 0x00020000
> + - If set, specifies that the syntax element skip_mode will be present, if
> + not set, specifies that skip_mode will not be used for this frame.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_FRAME_SIZE_OVERRIDE``
> + - 0x00040000
> + - If set, specifies that the frame size will either be specified as the
> + size of one of the reference frames, or computed from the
> + frame_width_minus_1 and frame_height_minus_1 syntax elements. If not
> + set, specifies that the frame size is equal to the size in the sequence
> + header.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_BUFFER_REMOVAL_TIME_PRESENT``
> + - 0x00080000
> + - If set, specifies that buffer_removal_time is present. If not set,
> + specifies that buffer_removal_time is not present.
> + * - ``V4L2_AV1_FRAME_HEADER_FLAG_FRAME_REFS_SHORT_SIGNALING``
> + - 0x00100000
> + - If set, indicates that only two reference frames are explicitly
> + signaled. If not set, indicates that all reference frames are explicitly
> + signaled.
> +
> +``V4L2_CID_STATELESS_AV1_FILM_GRAIN (struct)``
> + Represents the optional film grain parameters. See section
> + 6.8.20. "Film grain params semantics" of :ref:`av1` for more details.
> +
> +.. c:type:: v4l2_ctrl_av1_film_grain
> +
> +.. cssclass:: longtable
> +
> +.. tabularcolumns:: |p{1.5cm}|p{5.8cm}|p{10.0cm}|
> +
> +.. flat-table:: struct v4l2_av1_film_grain
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - __u8
> + - ``flags``
> + - See :ref:`AV1 Film Grain Flags <av1_film_grain_flags>`.
> + * - __u16
> + - ``grain_seed``
> + - Specifies the starting value for the pseudo-random numbers used during
> + film grain synthesis.
> + * - __u8
> + - ``film_grain_params_ref_idx``
> + - Indicates which reference frame contains the film grain parameters to be
> + used for this frame.
> + * - __u8
> + - ``num_y_points``
> + - Specifies the number of points for the piece-wise linear scaling
> + function of the luma component.
> + * - __u8
> + - ``point_y_value[V4L2_AV1_MAX_NUM_Y_POINTS]``
> + - Represents the x (luma value) coordinate for the i-th point
> + of the piecewise linear scaling function for luma component. The values
> + are signaled on the scale of 0..255. (In case of 10 bit video, these
> + values correspond to luma values divided by 4. In case of 12 bit video,
> + these values correspond to luma values divided by 16.).
> + * - __u8
> + - ``point_y_scaling[V4L2_AV1_MAX_NUM_Y_POINTS]``
> + - Represents the scaling (output) value for the i-th point
> + of the piecewise linear scaling function for luma component.
> + * - __u8
> + - ``num_cb_points``
> + - Specifies the number of points for the piece-wise linear scaling
> + function of the cb component.
> + * - __u8
> + - ``point_cb_value[V4L2_AV1_MAX_NUM_CB_POINTS]``
> + - Represents the x coordinate for the i-th point of the
> + piece-wise linear scaling function for cb component. The values are
> + signaled on the scale of 0..255.
> + * - __u8
> + - ``point_cb_scaling[V4L2_AV1_MAX_NUM_CB_POINTS]``
> + - Represents the scaling (output) value for the i-th point of the
> + piecewise linear scaling function for cb component.
> + * - __u8
> + - ``num_cr_points``
> + - Represents the number of points for the piece-wise
> + linear scaling function of the cr component.
> + * - __u8
> + - ``point_cr_value[V4L2_AV1_MAX_NUM_CR_POINTS]``
> + - Represents the x coordinate for the i-th point of the
> + piece-wise linear scaling function for cr component. The values are
> + signaled on the scale of 0..255.
> + * - __u8
> + - ``point_cr_scaling[V4L2_AV1_MAX_NUM_CR_POINTS]``
> + - Represents the scaling (output) value for the i-th point of the
> + piecewise linear scaling function for cr component.
> + * - __u8
> + - ``grain_scaling_minus_8``
> + - Represents the shift – 8 applied to the values of the chroma component.
> + The grain_scaling_minus_8 can take values of 0..3 and determines the
> + range and quantization step of the standard deviation of film grain.
> + * - __u8
> + - ``ar_coeff_lag``
> + - Specifies the number of auto-regressive coefficients for luma and
> + chroma.
> + * - __u8
> + - ``ar_coeffs_y_plus_128[V4L2_AV1_MAX_NUM_POS_LUMA]``
> + - Specifies auto-regressive coefficients used for the Y plane.
> + * - __u8
> + - ``ar_coeffs_cb_plus_128[V4L2_AV1_MAX_NUM_POS_LUMA]``
> + - Specifies auto-regressive coefficients used for the U plane.
> + * - __u8
> + - ``ar_coeffs_cr_plus_128[V4L2_AV1_MAX_NUM_POS_LUMA]``
> + - Specifies auto-regressive coefficients used for the V plane.
> + * - __u8
> + - ``ar_coeff_shift_minus_6``
> + - Specifies the range of the auto-regressive coefficients. Values of 0,
> + 1, 2, and 3 correspond to the ranges for auto-regressive coefficients of
> + [-2, 2), [-1, 1), [-0.5, 0.5) and [-0.25, 0.25) respectively.
> + * - __u8
> + - ``grain_scale_shift``
> + - Specifies how much the Gaussian random numbers should be scaled down
> + during the grain synthesis process.
> + * - __u8
> + - ``cb_mult``
> + - Represents a multiplier for the cb component used in derivation of the
> + input index to the cb component scaling function.
> + * - __u8
> + - ``cb_luma_mult``
> + - Represents a multiplier for the average luma component used in
> + derivation of the input index to the cb component scaling function..
> + * - __u16
> + - ``cb_offset``
> + - Represents an offset used in derivation of the input index to the
> + cb component scaling function.
> + * - __u8
> + - ``cr_mult``
> + - Represents a multiplier for the cb component used in derivation of the
> + input index to the cr component scaling function.
> + * - __u8
> + - ``cr_luma_mult``
> + - Represents a multiplier for the average luma component used in
> + derivation of the input index to the cr component scaling function.
> + * - __u16
> + - ``cr_offset``
> + - Represents an offset used in derivation of the input index to the
> + cr component scaling function.
> +
> +.. _av1_film_grain_flags:
> +
> +``AV1 Film Grain Flags``
> +
> +.. cssclass:: longtable
> +
> +.. flat-table::
> + :header-rows: 0
> + :stub-columns: 0
> + :widths: 1 1 2
> +
> + * - ``V4L2_AV1_FILM_GRAIN_FLAG_APPLY_GRAIN``
> + - 0x00000001
> + - If set, specifies that film grain should be added to this frame. If not
> + set, specifies that film grain should not be added.
> + * - ``V4L2_AV1_FILM_GRAIN_FLAG_UPDATE_GRAIN``
> + - 0x00000002
> + - If set, means that a new set of parameters should be sent. If not set,
> + specifies that the previous set of parameters should be used.
> + * - ``V4L2_AV1_FILM_GRAIN_FLAG_CHROMA_SCALING_FROM_LUMA``
> + - 0x00000004
> + - If set, specifies that the chroma scaling is inferred from the luma
> + scaling.
> + * - ``V4L2_AV1_FILM_GRAIN_FLAG_OVERLAP``
> + - 0x00000008
> + - If set, indicates that the overlap between film grain blocks shall be
> + applied. If not set, indicates that the overlap between film grain blocks
> + shall not be applied.
> + * - ``V4L2_AV1_FILM_GRAIN_FLAG_CLIP_TO_RESTRICTED_RANGE``
> + - 0x00000010
> + - If set, indicates that clipping to the restricted (studio) range shall
> + be applied to the sample values after adding the film grain (see the
> + semantics for color_range for an explanation of studio swing). If not
> + set, indicates that clipping to the full range shall be applied to the
> + sample values after adding the film grain.
> diff --git a/Documentation/userspace-api/media/v4l/pixfmt-compressed.rst b/Documentation/userspace-api/media/v4l/pixfmt-compressed.rst
> index 967fc803ef94..46d3f9b46b59 100644
> --- a/Documentation/userspace-api/media/v4l/pixfmt-compressed.rst
> +++ b/Documentation/userspace-api/media/v4l/pixfmt-compressed.rst
> @@ -238,6 +238,23 @@ Compressed Formats
> through the ``V4L2_CID_STATELESS_FWHT_PARAMS`` control.
> See the :ref:`associated Codec Control ID <codec-stateless-fwht>`.
>
> + * .. _V4L2-PIX-FMT-AV1-FRAME:
> +
> + - ``V4L2_PIX_FMT_AV1_FRAME``
> + - 'AV1F'
> + - AV1 parsed frame, including the frame header, as extracted from the container.
> + This format is adapted for stateless video decoders that implement a AV1
> + pipeline with the :ref:`stateless_decoder`. Metadata associated with the
> + frame to decode is required to be passed through the
> + ``V4L2_CID_STATELESS_AV1_SEQUENCE``, ``V4L2_CID_STATELESS_AV1_FRAME``,
> + ``V4L2_CID_STATELESS_AV1_TILE_GROUP`` and
> + ``V4L2_CID_STATELESS_AV1_TILE_GROUP_ENTRY`` controls.
> + See the :ref:`associated Codec Control IDs <v4l2-codec-stateless-av1>`.
> + Exactly one output and one capture buffer must be provided for use with
> + this pixel format. The output buffer must contain the appropriate number
> + of macroblocks to decode a full corresponding frame to the matching
> + capture buffer.
> +
> .. raw:: latex
>
> \normalsize
> diff --git a/Documentation/userspace-api/media/v4l/vidioc-g-ext-ctrls.rst b/Documentation/userspace-api/media/v4l/vidioc-g-ext-ctrls.rst
> index 29971a45a2d4..2771a455eb77 100644
> --- a/Documentation/userspace-api/media/v4l/vidioc-g-ext-ctrls.rst
> +++ b/Documentation/userspace-api/media/v4l/vidioc-g-ext-ctrls.rst
> @@ -241,6 +241,34 @@ still cause this situation.
> - ``p_vp9_frame``
> - A pointer to a struct :c:type:`v4l2_ctrl_vp9_frame`. Valid if this
> control is of type ``V4L2_CTRL_TYPE_VP9_FRAME``.
> + * - struct :c:type:`v4l2_ctrl_av1_sequence` *
> + - ``p_av1_sequence``
> + - A pointer to a struct :c:type:`v4l2_ctrl_av1_sequence`. Valid if this control is
> + of type ``V4L2_CTRL_TYPE_AV1_SEQUENCE``.
> + * - struct :c:type:`v4l2_ctrl_av1_tile_group` *
> + - ``p_av1_tile_group``
> + - A pointer to a struct :c:type:`v4l2_ctrl_av1_tile_group`. Valid if this control is
> + of type ``V4L2_CTRL_TYPE_AV1_TILE_GROUP``.
> + * - struct :c:type:`v4l2_ctrl_av1_tile_group_entry` *
> + - ``p_av1_tile_group_entry``
> + - A pointer to a struct :c:type:`v4l2_ctrl_av1_tile_group_entry`. Valid if this control is
> + of type ``V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY``.
> + * - struct :c:type:`v4l2_ctrl_av1_frame_header` *
> + - ``p_av1_frame_header``
> + - A pointer to a struct :c:type:`v4l2_ctrl_av1_frame_header`. Valid if this control is
> + of type ``V4L2_CTRL_TYPE_AV1_FRAME_HEADER``.
> + * - struct :c:type:`v4l2_ctrl_av1_profile` *
> + - ``p_av1_profile``
> + - A pointer to a struct :c:type:`v4l2_ctrl_av1_profile`. Valid if this control is
> + of type ``V4L2_CTRL_TYPE_AV1_PROFILE``.
> + * - struct :c:type:`v4l2_ctrl_av1_level` *
> + - ``p_av1_level``
> + - A pointer to a struct :c:type:`v4l2_ctrl_av1_level`. Valid if this control is
> + of type ``V4L2_CTRL_TYPE_AV1_LEVEL``.
> + * - struct :c:type:`v4l2_ctrl_av1_film_grain` *
> + - ``p_av1_film_grain``
> + - A pointer to a struct :c:type:`v4l2_ctrl_av1_film_grain`. Valid if this control is
> + of type ``V4L2_CTRL_TYPE_AV1_FILM_GRAIN``.
> * - struct :c:type:`v4l2_ctrl_hdr10_cll_info` *
> - ``p_hdr10_cll``
> - A pointer to a struct :c:type:`v4l2_ctrl_hdr10_cll_info`. Valid if this control is
> diff --git a/Documentation/userspace-api/media/v4l/vidioc-queryctrl.rst b/Documentation/userspace-api/media/v4l/vidioc-queryctrl.rst
> index a20dfa2a933b..c02d9d11b0dc 100644
> --- a/Documentation/userspace-api/media/v4l/vidioc-queryctrl.rst
> +++ b/Documentation/userspace-api/media/v4l/vidioc-queryctrl.rst
> @@ -525,6 +525,42 @@ See also the examples in :ref:`control`.
> - n/a
> - A struct :c:type:`v4l2_ctrl_vp9_frame`, containing VP9
> frame decode parameters for stateless video decoders.
> + * - ``V4L2_CTRL_TYPE_AV1_SEQUENCE``
> + - n/a
> + - n/a
> + - n/a
> + - A struct :c:type:`v4l2_ctrl_av1_sequence`, containing AV1 Sequence OBU
> + decoding parameters for stateless video decoders.
> + * - ``V4L2_CTRL_TYPE_AV1_TILE_GROUP``
> + - n/a
> + - n/a
> + - n/a
> + - A struct :c:type:`v4l2_ctrl_av1_tile_group`, containing AV1 Tile Group
> + OBU decoding parameters for stateless video decoders.
> + * - ``V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY``
> + - n/a
> + - n/a
> + - n/a
> + - A struct :c:type:`v4l2_ctrl_av1_tile_group_entry`, containing AV1 Tile Group
> + OBU decoding parameters for stateless video decoders.
> + * - ``V4L2_CTRL_TYPE_AV1_FRAME_HEADER``
> + - n/a
> + - n/a
> + - n/a
> + - A struct :c:type:`v4l2_ctrl_av1_frame_header`, containing AV1 Frame/Frame
> + Header OBU decoding parameters for stateless video decoders.
> + * - ``V4L2_CTRL_TYPE_AV1_PROFILE``
> + - n/a
> + - n/a
> + - n/a
> + - A enum :c:type:`v4l2_ctrl_av1_profile`, indicating what AV1 profiles
> + an AV1 stateless decoder might support.
> + * - ``V4L2_CTRL_TYPE_AV1_LEVEL``
> + - n/a
> + - n/a
> + - n/a
> + - A enum :c:type:`v4l2_ctrl_av1_level`, indicating what AV1 levels
> + an AV1 stateless decoder might support.
>
> .. raw:: latex
>
> diff --git a/Documentation/userspace-api/media/videodev2.h.rst.exceptions b/Documentation/userspace-api/media/videodev2.h.rst.exceptions
> index 9cbb7a0c354a..38f748228616 100644
> --- a/Documentation/userspace-api/media/videodev2.h.rst.exceptions
> +++ b/Documentation/userspace-api/media/videodev2.h.rst.exceptions
> @@ -146,6 +146,13 @@ replace symbol V4L2_CTRL_TYPE_H264_DECODE_PARAMS :c:type:`v4l2_ctrl_type`
> replace symbol V4L2_CTRL_TYPE_HEVC_SPS :c:type:`v4l2_ctrl_type`
> replace symbol V4L2_CTRL_TYPE_HEVC_PPS :c:type:`v4l2_ctrl_type`
> replace symbol V4L2_CTRL_TYPE_HEVC_SLICE_PARAMS :c:type:`v4l2_ctrl_type`
> +replace symbol V4L2_CTRL_TYPE_AV1_SEQUENCE :c:type:`v4l2_ctrl_type`
> +replace symbol V4L2_CTRL_TYPE_AV1_TILE_GROUP :c:type:`v4l2_ctrl_type`
> +replace symbol V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY :c:type:`v4l2_ctrl_type`
> +replace symbol V4L2_CTRL_TYPE_AV1_FRAME_HEADER :c:type:`v4l2_ctrl_type`
> +replace symbol V4L2_CTRL_TYPE_AV1_PROFILE :c:type:`v4l2_ctrl_type`
> +replace symbol V4L2_CTRL_TYPE_AV1_LEVEL :c:type:`v4l2_ctrl_type`
> +replace symbol V4L2_CTRL_TYPE_AV1_FILM_GRAIN :c:type:`v4l2_ctrl_type`
> replace symbol V4L2_CTRL_TYPE_AREA :c:type:`v4l2_ctrl_type`
> replace symbol V4L2_CTRL_TYPE_FWHT_PARAMS :c:type:`v4l2_ctrl_type`
> replace symbol V4L2_CTRL_TYPE_VP8_FRAME :c:type:`v4l2_ctrl_type`
> diff --git a/drivers/media/v4l2-core/v4l2-ctrls-core.c b/drivers/media/v4l2-core/v4l2-ctrls-core.c
> index cb709c74e01e..7f443e1ed50d 100644
> --- a/drivers/media/v4l2-core/v4l2-ctrls-core.c
> +++ b/drivers/media/v4l2-core/v4l2-ctrls-core.c
> @@ -307,6 +307,22 @@ static void std_log(const struct v4l2_ctrl *ctrl)
> case V4L2_CTRL_TYPE_VP9_FRAME:
> pr_cont("VP9_FRAME");
> break;
> + case V4L2_CTRL_TYPE_AV1_SEQUENCE:
> + pr_cont("AV1_SEQUENCE");
> + break;
> + case V4L2_CTRL_TYPE_AV1_TILE_GROUP:
> + pr_cont("AV1_TILE_GROUP");
> + break;
> + case V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY:
> + pr_cont("AV1_TILE_GROUP_ENTRY");
> + break;
> + case V4L2_CTRL_TYPE_AV1_FRAME_HEADER:
> + pr_cont("AV1_FRAME_HEADER");
> + break;
> + case V4L2_CTRL_TYPE_AV1_FILM_GRAIN:
> + pr_cont("AV1_FILM_GRAIN");
> + break;
> +
> default:
> pr_cont("unknown type %d", ctrl->type);
> break;
> @@ -503,6 +519,243 @@ validate_vp9_frame(struct v4l2_ctrl_vp9_frame *frame)
> return 0;
> }
>
> +static int validate_av1_quantization(struct v4l2_av1_quantization *q)
> +{
> + if (q->flags > GENMASK(2, 0))
> + return -EINVAL;
> +
> + if (q->delta_q_y_dc < -64 || q->delta_q_y_dc > 63 ||
> + q->delta_q_u_dc < -64 || q->delta_q_u_dc > 63 ||
> + q->delta_q_v_dc < -64 || q->delta_q_v_dc > 63 ||
> + q->delta_q_u_ac < -64 || q->delta_q_u_ac > 63 ||
> + q->delta_q_v_ac < -64 || q->delta_q_v_ac > 63 ||
> + q->delta_q_res > GENMASK(1, 0))
> + return -EINVAL;
> +
> + if (q->qm_y > GENMASK(3, 0) ||
> + q->qm_u > GENMASK(3, 0) ||
> + q->qm_v > GENMASK(3, 0))
> + return -EINVAL;
> +
> + return 0;
> +}
> +
> +static int validate_av1_segmentation(struct v4l2_av1_segmentation *s)
> +{
> + u32 i;
> + u32 j;
> + s32 limit;
> +
> + if (s->flags > GENMASK(4, 0))
> + return -EINVAL;
> +
> + for (i = 0; i < ARRAY_SIZE(s->feature_data); i++) {
> + const int segmentation_feature_signed[] = { 1, 1, 1, 1, 1, 0, 0, 0 };
> + const int segmentation_feature_max[] = { 255, 63, 63, 63, 63, 7, 0, 0};
> +
> + for (j = 0; j < ARRAY_SIZE(s->feature_data[j]); j++) {
> + if (segmentation_feature_signed[j]) {
> + limit = segmentation_feature_max[j];
> +
> + if (s->feature_data[i][j] < -limit ||
> + s->feature_data[i][j] > limit)
> + return -EINVAL;
> + } else {
> + if (s->feature_data[i][j] > limit)
> + return -EINVAL;
> + }
> + }
> + }
> +
> + return 0;
> +}
> +
> +static int validate_av1_loop_filter(struct v4l2_av1_loop_filter *lf)
> +{
> + u32 i;
> +
> + if (lf->flags > GENMASK(2, 0))
> + return -EINVAL;
> +
> + for (i = 0; i < ARRAY_SIZE(lf->level); i++) {
> + if (lf->level[i] > GENMASK(5, 0))
> + return -EINVAL;
> + }
> +
> + if (lf->sharpness > GENMASK(2, 0))
> + return -EINVAL;
> +
> + for (i = 0; i < ARRAY_SIZE(lf->ref_deltas); i++) {
> + if (lf->ref_deltas[i] < -64 || lf->ref_deltas[i] > 63)
> + return -EINVAL;
> + }
> +
> + for (i = 0; i < ARRAY_SIZE(lf->mode_deltas); i++) {
> + if (lf->mode_deltas[i] < -64 || lf->mode_deltas[i] > 63)
> + return -EINVAL;
> + }
> +
> + return 0;
> +}
> +
> +static int validate_av1_cdef(struct v4l2_av1_cdef *cdef)
> +{
> + u32 i;
> +
> + if (cdef->damping_minus_3 > GENMASK(1, 0) ||
> + cdef->bits > GENMASK(1, 0))
> + return -EINVAL;
> +
> + for (i = 0; i < 1 << cdef->bits; i++) {
> + if (cdef->y_pri_strength[i] > GENMASK(3, 0) ||
> + cdef->y_sec_strength[i] > 4 ||
> + cdef->uv_pri_strength[i] > GENMASK(3, 0) ||
> + cdef->uv_sec_strength[i] > 4)
> + return -EINVAL;
> + }
> +
> + return 0;
> +}
> +
> +static int validate_av1_loop_restauration(struct v4l2_av1_loop_restoration *lr)
> +{
> + if (lr->lr_unit_shift > 3 || lr->lr_uv_shift > 1)
> + return -EINVAL;
> +
> + return 0;
> +}
> +
> +static int validate_av1_film_grain(struct v4l2_ctrl_av1_film_grain *fg)
> +{
> + u32 i;
> +
> + if (fg->flags > GENMASK(4, 0))
> + return -EINVAL;
> +
> + if (fg->film_grain_params_ref_idx > GENMASK(2, 0) ||
> + fg->num_y_points > 14 ||
> + fg->num_cb_points > 10 ||
> + fg->num_cr_points > GENMASK(3, 0) ||
> + fg->grain_scaling_minus_8 > GENMASK(1, 0) ||
> + fg->ar_coeff_lag > GENMASK(1, 0) ||
> + fg->ar_coeff_shift_minus_6 > GENMASK(1, 0) ||
> + fg->grain_scale_shift > GENMASK(1, 0))
> + return -EINVAL;
> +
> + if (!(fg->flags & V4L2_AV1_FILM_GRAIN_FLAG_APPLY_GRAIN))
> + return 0;
> +
> + for (i = 1; i < fg->num_y_points; i++)
> + if (fg->point_y_value[i] <= fg->point_y_value[i - 1])
> + return -EINVAL;
> +
> + for (i = 1; i < fg->num_cb_points; i++)
> + if (fg->point_cb_value[i] <= fg->point_cb_value[i - 1])
> + return -EINVAL;
> +
> + for (i = 1; i < fg->num_cr_points; i++)
> + if (fg->point_cr_value[i] <= fg->point_cr_value[i - 1])
> + return -EINVAL;
> +
> + return 0;
> +}
> +
> +static int validate_av1_frame_header(struct v4l2_ctrl_av1_frame_header *f)
> +{
> + int ret = 0;
> +
> + ret = validate_av1_quantization(&f->quantization);
> + if (ret)
> + return ret;
> + ret = validate_av1_segmentation(&f->segmentation);
> + if (ret)
> + return ret;
> + ret = validate_av1_loop_filter(&f->loop_filter);
> + if (ret)
> + return ret;
> + ret = validate_av1_cdef(&f->cdef);
> + if (ret)
> + return ret;
> + ret = validate_av1_loop_restauration(&f->loop_restoration);
> + if (ret)
> + return ret;
> +
> + if (f->flags &
> + ~(V4L2_AV1_FRAME_HEADER_FLAG_SHOW_FRAME |
> + V4L2_AV1_FRAME_HEADER_FLAG_SHOWABLE_FRAME |
> + V4L2_AV1_FRAME_HEADER_FLAG_ERROR_RESILIENT_MODE |
> + V4L2_AV1_FRAME_HEADER_FLAG_DISABLE_CDF_UPDATE |
> + V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_SCREEN_CONTENT_TOOLS |
> + V4L2_AV1_FRAME_HEADER_FLAG_FORCE_INTEGER_MV |
> + V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_INTRABC |
> + V4L2_AV1_FRAME_HEADER_FLAG_USE_SUPERRES |
> + V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_HIGH_PRECISION_MV |
> + V4L2_AV1_FRAME_HEADER_FLAG_IS_MOTION_MODE_SWITCHABLE |
> + V4L2_AV1_FRAME_HEADER_FLAG_USE_REF_FRAME_MVS |
> + V4L2_AV1_FRAME_HEADER_FLAG_DISABLE_FRAME_END_UPDATE_CDF |
> + V4L2_AV1_FRAME_HEADER_FLAG_UNIFORM_TILE_SPACING |
> + V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_WARPED_MOTION |
> + V4L2_AV1_FRAME_HEADER_FLAG_REFERENCE_SELECT |
> + V4L2_AV1_FRAME_HEADER_FLAG_REDUCED_TX_SET |
> + V4L2_AV1_FRAME_HEADER_FLAG_SKIP_MODE_ALLOWED |
> + V4L2_AV1_FRAME_HEADER_FLAG_SKIP_MODE_PRESENT |
> + V4L2_AV1_FRAME_HEADER_FLAG_FRAME_SIZE_OVERRIDE |
> + V4L2_AV1_FRAME_HEADER_FLAG_BUFFER_REMOVAL_TIME_PRESENT |
> + V4L2_AV1_FRAME_HEADER_FLAG_FRAME_REFS_SHORT_SIGNALING))
> + return -EINVAL;
> +
> + if (f->superres_denom > GENMASK(2, 0) + 9)
> + return -EINVAL;
> +
> + return 0;
> +}
> +
> +static int validate_av1_sequence(struct v4l2_ctrl_av1_sequence *s)
> +{
> + if (s->flags &
> + ~(V4L2_AV1_SEQUENCE_FLAG_STILL_PICTURE |
> + V4L2_AV1_SEQUENCE_FLAG_USE_128X128_SUPERBLOCK |
> + V4L2_AV1_SEQUENCE_FLAG_ENABLE_FILTER_INTRA |
> + V4L2_AV1_SEQUENCE_FLAG_ENABLE_INTRA_EDGE_FILTER |
> + V4L2_AV1_SEQUENCE_FLAG_ENABLE_INTERINTRA_COMPOUND |
> + V4L2_AV1_SEQUENCE_FLAG_ENABLE_MASKED_COMPOUND |
> + V4L2_AV1_SEQUENCE_FLAG_ENABLE_WARPED_MOTION |
> + V4L2_AV1_SEQUENCE_FLAG_ENABLE_DUAL_FILTER |
> + V4L2_AV1_SEQUENCE_FLAG_ENABLE_ORDER_HINT |
> + V4L2_AV1_SEQUENCE_FLAG_ENABLE_JNT_COMP |
> + V4L2_AV1_SEQUENCE_FLAG_ENABLE_REF_FRAME_MVS |
> + V4L2_AV1_SEQUENCE_FLAG_ENABLE_SUPERRES |
> + V4L2_AV1_SEQUENCE_FLAG_ENABLE_CDEF |
> + V4L2_AV1_SEQUENCE_FLAG_ENABLE_RESTORATION |
> + V4L2_AV1_SEQUENCE_FLAG_MONO_CHROME |
> + V4L2_AV1_SEQUENCE_FLAG_COLOR_RANGE |
> + V4L2_AV1_SEQUENCE_FLAG_SUBSAMPLING_X |
> + V4L2_AV1_SEQUENCE_FLAG_SUBSAMPLING_Y |
> + V4L2_AV1_SEQUENCE_FLAG_FILM_GRAIN_PARAMS_PRESENT |
> + V4L2_AV1_SEQUENCE_FLAG_SEPARATE_UV_DELTA_Q))
> + return -EINVAL;
> +
> + if (s->seq_profile == 1 && s->flags & V4L2_AV1_SEQUENCE_FLAG_MONO_CHROME)
> + return -EINVAL;
> +
> + /* reserved */
> + if (s->seq_profile > 2)
> + return -EINVAL;
> +
> + /* TODO: PROFILES */
> + return 0;
> +}
> +
> +static int validate_av1_tile_group(struct v4l2_ctrl_av1_tile_group *t)
> +{
> + if (t->flags & ~(V4L2_AV1_TILE_GROUP_FLAG_START_AND_END_PRESENT))
> + return -EINVAL;
> + if (t->tg_start > t->tg_end)
> + return -EINVAL;
> +
> + return 0;
> +}
> +
> /*
> * Compound controls validation requires setting unused fields/flags to zero
> * in order to properly detect unchanged controls with std_equal's memcmp.
> @@ -759,7 +1012,17 @@ static int std_validate_compound(const struct v4l2_ctrl *ctrl, u32 idx,
> zero_padding(p_vp8_frame->entropy);
> zero_padding(p_vp8_frame->coder_state);
> break;
> -
> + case V4L2_CTRL_TYPE_AV1_FRAME_HEADER:
> + return validate_av1_frame_header(p);
> + case V4L2_CTRL_TYPE_AV1_SEQUENCE:
> + return validate_av1_sequence(p);
> + case V4L2_CTRL_TYPE_AV1_TILE_GROUP:
> + return validate_av1_tile_group(p);
> + case V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY:
> + break;
> + case V4L2_CTRL_TYPE_AV1_FILM_GRAIN:
> + return validate_av1_film_grain(p);
> + break;
> case V4L2_CTRL_TYPE_HEVC_SPS:
> p_hevc_sps = p;
>
> @@ -1508,6 +1771,21 @@ static struct v4l2_ctrl *v4l2_ctrl_new(struct v4l2_ctrl_handler *hdl,
> case V4L2_CTRL_TYPE_VP8_FRAME:
> elem_size = sizeof(struct v4l2_ctrl_vp8_frame);
> break;
> + case V4L2_CTRL_TYPE_AV1_SEQUENCE:
> + elem_size = sizeof(struct v4l2_ctrl_av1_sequence);
> + break;
> + case V4L2_CTRL_TYPE_AV1_TILE_GROUP:
> + elem_size = sizeof(struct v4l2_ctrl_av1_tile_group);
> + break;
> + case V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY:
> + elem_size = sizeof(struct v4l2_ctrl_av1_tile_group_entry);
> + break;
> + case V4L2_CTRL_TYPE_AV1_FRAME_HEADER:
> + elem_size = sizeof(struct v4l2_ctrl_av1_frame_header);
> + break;
> + case V4L2_CTRL_TYPE_AV1_FILM_GRAIN:
> + elem_size = sizeof(struct v4l2_ctrl_av1_film_grain);
> + break;
> case V4L2_CTRL_TYPE_HEVC_SPS:
> elem_size = sizeof(struct v4l2_ctrl_hevc_sps);
> break;
> diff --git a/drivers/media/v4l2-core/v4l2-ctrls-defs.c b/drivers/media/v4l2-core/v4l2-ctrls-defs.c
> index 54ca4e6b820b..7bb80192b592 100644
> --- a/drivers/media/v4l2-core/v4l2-ctrls-defs.c
> +++ b/drivers/media/v4l2-core/v4l2-ctrls-defs.c
> @@ -499,6 +499,40 @@ const char * const *v4l2_ctrl_get_menu(u32 id)
> NULL,
> };
>
> + static const char * const av1_profile[] = {
> + "Main",
> + "High",
> + "Professional",
> + NULL,
> + };
> + static const char * const av1_level[] = {
> + "2.0",
> + "2.1",
> + "2.2",
> + "2.3",
> + "3.0",
> + "3.1",
> + "3.2",
> + "3.3",
> + "4.0",
> + "4.1",
> + "4.2",
> + "4.3",
> + "5.0",
> + "5.1",
> + "5.2",
> + "5.3",
> + "6.0",
> + "6.1",
> + "6.2",
> + "6.3",
> + "7.0",
> + "7.1",
> + "7.2",
> + "7.3",
> + NULL,
> + };
> +
> static const char * const hevc_profile[] = {
> "Main",
> "Main Still Picture",
> @@ -685,6 +719,10 @@ const char * const *v4l2_ctrl_get_menu(u32 id)
> return dv_it_content_type;
> case V4L2_CID_DETECT_MD_MODE:
> return detect_md_mode;
> + case V4L2_CID_STATELESS_AV1_PROFILE:
> + return av1_profile;
> + case V4L2_CID_STATELESS_AV1_LEVEL:
> + return av1_level;
> case V4L2_CID_MPEG_VIDEO_HEVC_PROFILE:
> return hevc_profile;
> case V4L2_CID_MPEG_VIDEO_HEVC_LEVEL:
> @@ -1180,6 +1218,13 @@ const char *v4l2_ctrl_get_name(u32 id)
> case V4L2_CID_STATELESS_MPEG2_QUANTISATION: return "MPEG-2 Quantisation Matrices";
> case V4L2_CID_STATELESS_VP9_COMPRESSED_HDR: return "VP9 Probabilities Updates";
> case V4L2_CID_STATELESS_VP9_FRAME: return "VP9 Frame Decode Parameters";
> + case V4L2_CID_STATELESS_AV1_SEQUENCE: return "AV1 Sequence parameters";
> + case V4L2_CID_STATELESS_AV1_TILE_GROUP: return "AV1 Tile Group";
> + case V4L2_CID_STATELESS_AV1_TILE_GROUP_ENTRY: return "AV1 Tile Group Entry";
> + case V4L2_CID_STATELESS_AV1_FRAME_HEADER: return "AV1 Frame Header parameters";
> + case V4L2_CID_STATELESS_AV1_PROFILE: return "AV1 Profile";
> + case V4L2_CID_STATELESS_AV1_LEVEL: return "AV1 Level";
> + case V4L2_CID_STATELESS_AV1_FILM_GRAIN: return "AV1 Film Grain";
>
> /* Colorimetry controls */
> /* Keep the order of the 'case's the same as in v4l2-controls.h! */
> @@ -1348,6 +1393,8 @@ void v4l2_ctrl_fill(u32 id, const char **name, enum v4l2_ctrl_type *type,
> case V4L2_CID_MPEG_VIDEO_VP9_PROFILE:
> case V4L2_CID_MPEG_VIDEO_VP9_LEVEL:
> case V4L2_CID_DETECT_MD_MODE:
> + case V4L2_CID_STATELESS_AV1_PROFILE:
> + case V4L2_CID_STATELESS_AV1_LEVEL:
> case V4L2_CID_MPEG_VIDEO_HEVC_PROFILE:
> case V4L2_CID_MPEG_VIDEO_HEVC_LEVEL:
> case V4L2_CID_MPEG_VIDEO_HEVC_HIER_CODING_TYPE:
> @@ -1493,6 +1540,23 @@ void v4l2_ctrl_fill(u32 id, const char **name, enum v4l2_ctrl_type *type,
> case V4L2_CID_STATELESS_VP8_FRAME:
> *type = V4L2_CTRL_TYPE_VP8_FRAME;
> break;
> + case V4L2_CID_STATELESS_AV1_SEQUENCE:
> + *type = V4L2_CTRL_TYPE_AV1_SEQUENCE;
> + break;
> + case V4L2_CID_STATELESS_AV1_TILE_GROUP:
> + *type = V4L2_CTRL_TYPE_AV1_TILE_GROUP;
> + *flags |= V4L2_CTRL_FLAG_DYNAMIC_ARRAY;
> + break;
> + case V4L2_CID_STATELESS_AV1_TILE_GROUP_ENTRY:
> + *type = V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY;
> + *flags |= V4L2_CTRL_FLAG_DYNAMIC_ARRAY;
> + break;
> + case V4L2_CID_STATELESS_AV1_FRAME_HEADER:
> + *type = V4L2_CTRL_TYPE_AV1_FRAME_HEADER;
> + break;
> + case V4L2_CID_STATELESS_AV1_FILM_GRAIN:
> + *type = V4L2_CTRL_TYPE_AV1_FILM_GRAIN;
> + break;
> case V4L2_CID_MPEG_VIDEO_HEVC_SPS:
> *type = V4L2_CTRL_TYPE_HEVC_SPS;
> break;
> diff --git a/drivers/media/v4l2-core/v4l2-ioctl.c b/drivers/media/v4l2-core/v4l2-ioctl.c
> index 96e307fe3aab..b9720028e57d 100644
> --- a/drivers/media/v4l2-core/v4l2-ioctl.c
> +++ b/drivers/media/v4l2-core/v4l2-ioctl.c
> @@ -1441,6 +1441,7 @@ static void v4l_fill_fmtdesc(struct v4l2_fmtdesc *fmt)
> case V4L2_PIX_FMT_SE401: descr = "GSPCA SE401"; break;
> case V4L2_PIX_FMT_S5C_UYVY_JPG: descr = "S5C73MX interleaved UYVY/JPEG"; break;
> case V4L2_PIX_FMT_MT21C: descr = "Mediatek Compressed Format"; break;
> + case V4L2_PIX_FMT_AV1_FRAME: descr = "AV1 Frame"; break;
> default:
> if (fmt->description[0])
> return;
> diff --git a/include/media/v4l2-ctrls.h b/include/media/v4l2-ctrls.h
> index f4105de8a8d2..6dcaeeee774e 100644
> --- a/include/media/v4l2-ctrls.h
> +++ b/include/media/v4l2-ctrls.h
> @@ -58,6 +58,11 @@ struct video_device;
> * @p_hdr10_cll: Pointer to an HDR10 Content Light Level structure.
> * @p_hdr10_mastering: Pointer to an HDR10 Mastering Display structure.
> * @p_area: Pointer to an area.
> + * @p_av1_sequence: Pointer to an AV1 sequence.
> + * @p_av1_tile_group: Pointer to an AV1 tile group.
> + * @p_av1_tile_group_entry: Pointer to an AV1 tile group entry.
> + * @p_av1_frame_header: Pointer to an AV1 frame header.
> + * @p_av1_film_grain: Pointer to an AV1 film_grain.
> * @p: Pointer to a compound value.
> * @p_const: Pointer to a constant compound value.
> */
> @@ -87,6 +92,11 @@ union v4l2_ctrl_ptr {
> struct v4l2_ctrl_hdr10_cll_info *p_hdr10_cll;
> struct v4l2_ctrl_hdr10_mastering_display *p_hdr10_mastering;
> struct v4l2_area *p_area;
> + struct v4l2_ctrl_av1_sequence *p_av1_sequence;
> + struct v4l2_ctrl_av1_tile_group *p_av1_tile_group;
> + struct v4l2_ctrl_av1_tile_group_entry *p_av1_tile_group_entry;
> + struct v4l2_ctrl_av1_frame_header *p_av1_frame_header;
> + struct v4l2_ctrl_av1_film_grain *p_av1_film_grain;
> void *p;
> const void *p_const;
> };
> diff --git a/include/uapi/linux/v4l2-controls.h b/include/uapi/linux/v4l2-controls.h
> index bb40129446d4..03eb16099c9f 100644
> --- a/include/uapi/linux/v4l2-controls.h
> +++ b/include/uapi/linux/v4l2-controls.h
> @@ -1992,6 +1992,749 @@ struct v4l2_ctrl_mpeg2_quantisation {
> __u8 chroma_non_intra_quantiser_matrix[64];
> };
>
> +/* Stateless AV1 controls */
> +
> +#define V4L2_AV1_TOTAL_REFS_PER_FRAME 8
> +#define V4L2_AV1_CDEF_MAX 8
> +#define V4L2_AV1_NUM_PLANES_MAX 3 /* 1 if monochrome, 3 otherwise */
> +#define V4L2_AV1_MAX_SEGMENTS 8
> +#define V4L2_AV1_MAX_OPERATING_POINTS (1 << 5) /* 5 bits to encode */
> +#define V4L2_AV1_REFS_PER_FRAME 7
> +#define V4L2_AV1_MAX_NUM_Y_POINTS (1 << 4) /* 4 bits to encode */
> +#define V4L2_AV1_MAX_NUM_CB_POINTS (1 << 4) /* 4 bits to encode */
> +#define V4L2_AV1_MAX_NUM_CR_POINTS (1 << 4) /* 4 bits to encode */
> +#define V4L2_AV1_MAX_NUM_POS_LUMA 25 /* (2 * 3 * (3 + 1)) + 1 */
> +#define V4L2_AV1_MAX_NUM_PLANES 3
> +#define V4L2_AV1_MAX_TILE_COLS 64
> +#define V4L2_AV1_MAX_TILE_ROWS 64
> +#define V4L2_AV1_MAX_TILE_COUNT 512
> +
> +#define V4L2_AV1_SEQUENCE_FLAG_STILL_PICTURE BIT(0)
> +#define V4L2_AV1_SEQUENCE_FLAG_USE_128X128_SUPERBLOCK BIT(1)
> +#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_FILTER_INTRA BIT(2)
> +#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_INTRA_EDGE_FILTER BIT(3)
> +#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_INTERINTRA_COMPOUND BIT(4)
> +#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_MASKED_COMPOUND BIT(5)
> +#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_WARPED_MOTION BIT(6)
> +#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_DUAL_FILTER BIT(7)
> +#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_ORDER_HINT BIT(8)
> +#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_JNT_COMP BIT(9)
> +#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_REF_FRAME_MVS BIT(10)
> +#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_SUPERRES BIT(11)
> +#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_CDEF BIT(12)
> +#define V4L2_AV1_SEQUENCE_FLAG_ENABLE_RESTORATION BIT(13)
> +#define V4L2_AV1_SEQUENCE_FLAG_MONO_CHROME BIT(14)
> +#define V4L2_AV1_SEQUENCE_FLAG_COLOR_RANGE BIT(15)
> +#define V4L2_AV1_SEQUENCE_FLAG_SUBSAMPLING_X BIT(16)
> +#define V4L2_AV1_SEQUENCE_FLAG_SUBSAMPLING_Y BIT(17)
> +#define V4L2_AV1_SEQUENCE_FLAG_FILM_GRAIN_PARAMS_PRESENT BIT(18)
> +#define V4L2_AV1_SEQUENCE_FLAG_SEPARATE_UV_DELTA_Q BIT(19)
> +
> +#define V4L2_CID_STATELESS_AV1_SEQUENCE (V4L2_CID_CODEC_STATELESS_BASE + 401)
> +/**
> + * struct v4l2_ctrl_av1_sequence - AV1 Sequence
> + *
> + * Represents an AV1 Sequence OBU. See section 5.5. "Sequence header OBU syntax"
> + * for more details.
> + *
> + * @flags: See V4L2_AV1_SEQUENCE_FLAG_{}.
> + * @seq_profile: specifies the features that can be used in the coded video
> + * sequence.
> + * @order_hint_bits: specifies the number of bits used for the order_hint field
> + * at each frame.
> + * @bit_depth: the bitdepth to use for the sequence as described in section
> + * 5.5.2 "Color config syntax".
> + * @max_frame_width_minus_1: specifies the maximum frame width minus 1 for the
> + * frames represented by this sequence header.
> + * @max_frame_height_minus_1: specifies the maximum frame height minus 1 for the
> + * frames represented by this sequence header.
> + */
> +struct v4l2_ctrl_av1_sequence {
> + __u32 flags;
> + __u8 seq_profile;
> + __u8 order_hint_bits;
> + __u8 bit_depth;
> + __u16 max_frame_width_minus_1;
> + __u16 max_frame_height_minus_1;
> +};
> +
> +#define V4L2_AV1_TILE_GROUP_FLAG_START_AND_END_PRESENT BIT(0)
> +
> +#define V4L2_CID_STATELESS_AV1_TILE_GROUP (V4L2_CID_CODEC_STATELESS_BASE + 402)
> +/**
> + * struct v4l2_ctrl_av1_tile_group - AV1 Tile Group header.
> + *
> + * Represents a tile group as seen in an AV1 Tile Group OBU or Frame OBU. A
> + * v4l2_ctrl_av1_tile_group instance will refer to tg_end - tg_start instances
> + * of v4l2_ctrl_tile_group_entry. See section 6.10.1 "General tile group OBU
> + * semantics" for more details.
> + *
> + * @flags: see V4L2_AV1_TILE_GROUP_FLAG_{}.
> + * @tg_start: specifies the zero-based index of the first tile in the current
> + * tile group.
> + * @tg_end: specifies the zero-based index of the last tile in the current tile
> + * group.
> + */
> +struct v4l2_ctrl_av1_tile_group {
> + __u8 flags;
> + __u32 tg_start;
> + __u32 tg_end;
> +};
> +
> +#define V4L2_CID_STATELESS_AV1_TILE_GROUP_ENTRY (V4L2_CID_CODEC_STATELESS_BASE + 403)
> +/**
> + * struct v4l2_ctrl_av1_tile_group_entry - AV1 Tile Group entry
> + *
> + * Represents a single AV1 tile inside an AV1 Tile Group. Note that MiRowStart,
> + * MiRowEnd, MiColStart and MiColEnd can be retrieved from struct
> + * v4l2_av1_tile_info in struct v4l2_ctrl_av1_frame_header using tile_row and
> + * tile_col. See section 6.10.1 "General tile group OBU semantics" for more
> + * details.
> + *
> + * @tile_offset: offset from the OBU data, i.e. where the coded tile data
> + * actually starts.
> + * @tile_size: specifies the size in bytes of the coded tile. Equivalent to
> + * "TileSize" in the AV1 Specification.
> + * @tile_row: specifies the row of the current tile. Equivalent to "TileRow" in
> + * the AV1 Specification.
> + * @tile_col: specifies the col of the current tile. Equivalent to "TileCol" in
> + * the AV1 Specification.
> + */
> +struct v4l2_ctrl_av1_tile_group_entry {
> + __u32 tile_offset;
> + __u32 tile_size;
> + __u32 tile_row;
> + __u32 tile_col;
> +};
> +
> +/**
> + * enum v4l2_av1_warp_model - AV1 Warp Model as described in section 3
> + * "Symbols and abbreviated terms" of the AV1 Specification.
> + *
> + * @V4L2_AV1_WARP_MODEL_IDENTITY: Warp model is just an identity transform.
> + * @V4L2_AV1_WARP_MODEL_TRANSLATION: Warp model is a pure translation.
> + * @V4L2_AV1_WARP_MODEL_ROTZOOM: Warp model is a rotation + symmetric zoom +
> + * translation.
> + * @V4L2_AV1_WARP_MODEL_AFFINE: Warp model is a general affine transform.
> + */
> +enum v4l2_av1_warp_model {
> + V4L2_AV1_WARP_MODEL_IDENTITY = 0,
> + V4L2_AV1_WARP_MODEL_TRANSLATION = 1,
> + V4L2_AV1_WARP_MODEL_ROTZOOM = 2,
> + V4L2_AV1_WARP_MODEL_AFFINE = 3,
> +};
> +
> +/**
> + * enum v4l2_av1_reference_frame - AV1 reference frames
> + *
> + * @V4L2_AV1_REF_INTRA_FRAME: Intra Frame Reference
> + * @V4L2_AV1_REF_LAST_FRAME: Last Reference Frame
> + * @V4L2_AV1_REF_LAST2_FRAME: Last2 Reference Frame
> + * @V4L2_AV1_REF_LAST3_FRAME: Last3 Reference Frame
> + * @V4L2_AV1_REF_GOLDEN_FRAME: Golden Reference Frame
> + * @V4L2_AV1_REF_BWDREF_FRAME: BWD Reference Frame
> + * @V4L2_AV1_REF_ALTREF2_FRAME: Alternative2 Reference Frame
> + * @V4L2_AV1_REF_ALTREF_FRAME: Alternative Reference Frame
> + * @V4L2_AV1_NUM_REF_FRAMES: Total Reference Frame Number
> + */
> +enum v4l2_av1_reference_frame {
> + V4L2_AV1_REF_INTRA_FRAME = 0,
> + V4L2_AV1_REF_LAST_FRAME = 1,
> + V4L2_AV1_REF_LAST2_FRAME = 2,
> + V4L2_AV1_REF_LAST3_FRAME = 3,
> + V4L2_AV1_REF_GOLDEN_FRAME = 4,
> + V4L2_AV1_REF_BWDREF_FRAME = 5,
> + V4L2_AV1_REF_ALTREF2_FRAME = 6,
> + V4L2_AV1_REF_ALTREF_FRAME = 7,
> + V4L2_AV1_NUM_REF_FRAMES,
> +};
> +
> +#define V4L2_AV1_GLOBAL_MOTION_IS_INVALID(ref) (1 << (ref))
> +
> +#define V4L2_AV1_GLOBAL_MOTION_FLAG_IS_GLOBAL BIT(0)
> +#define V4L2_AV1_GLOBAL_MOTION_FLAG_IS_ROT_ZOOM BIT(1)
> +#define V4L2_AV1_GLOBAL_MOTION_FLAG_IS_TRANSLATION BIT(2)
> +/**
> + * struct v4l2_av1_global_motion - AV1 Global Motion parameters as described in
> + * section 6.8.17 "Global motion params semantics" of the AV1 specification.
> + *
> + * @flags: A bitfield containing the flags per reference frame. See
> + * V4L2_AV1_GLOBAL_MOTION_FLAG_{}
> + * @type: The type of global motion transform used.
> + * @params: this field has the same meaning as "gm_params" in the AV1
> + * specification.
> + * @invalid: bitfield indicating whether the global motion params are invalid
> + * for a given reference frame. See section 7.11.3.6. Setup shear process and
> + * the variable "warpValid". Use V4L2_AV1_GLOBAL_MOTION_IS_INVALID(ref) to
> + * create a suitable mask.
> + */
> +
> +struct v4l2_av1_global_motion {
> + __u8 flags[V4L2_AV1_TOTAL_REFS_PER_FRAME];
> + enum v4l2_av1_warp_model type[V4L2_AV1_TOTAL_REFS_PER_FRAME];
> + __u32 params[V4L2_AV1_TOTAL_REFS_PER_FRAME][6];
> + __u8 invalid;
> +};
> +
> +/**
> + * enum v4l2_av1_frame_restoration_type - AV1 Frame Restoration Type
> + * @V4L2_AV1_FRAME_RESTORE_NONE: no filtering is applied.
> + * @V4L2_AV1_FRAME_RESTORE_WIENER: Wiener filter process is invoked.
> + * @V4L2_AV1_FRAME_RESTORE_SGRPROJ: self guided filter process is invoked.
> + * @V4L2_AV1_FRAME_RESTORE_SWITCHABLE: restoration filter is swichtable.
> + */
> +enum v4l2_av1_frame_restoration_type {
> + V4L2_AV1_FRAME_RESTORE_NONE = 0,
> + V4L2_AV1_FRAME_RESTORE_WIENER = 1,
> + V4L2_AV1_FRAME_RESTORE_SGRPROJ = 2,
> + V4L2_AV1_FRAME_RESTORE_SWITCHABLE = 3,
> +};
> +
> +#define V4L2_AV1_LOOP_RESTORATION_FLAG_USES_LR BIT(0)
> +#define V4L2_AV1_LOOP_RESTORATION_FLAG_USES_CHROMA_LR BIT(1)
> +
> +/**
> + * struct v4l2_av1_loop_restoration - AV1 Loop Restauration as described in
> + * section 6.10.15 "Loop restoration params semantics" of the AV1 specification.
> + *
> + * @flags: See V4L2_AV1_LOOP_RESTORATION_FLAG_{}.
> + * @frame_restoration_type: specifies the type of restoration used for each
> + * plane. See enum_v4l2_av1_frame_restoration_type.
> + * @lr_unit_shift: specifies if the luma restoration size should be halved.
> + * @lr_uv_shift: specifies if the chroma size should be half the luma size.
> + * @loop_restoration_size: specifies the size of loop restoration units in units
> + * of samples in the current plane.
> + */
> +struct v4l2_av1_loop_restoration {
> + u8 flags;
> + enum v4l2_av1_frame_restoration_type frame_restoration_type[V4L2_AV1_NUM_PLANES_MAX];
> + __u8 lr_unit_shift;
> + __u8 lr_uv_shift;
> + __u32 loop_restoration_size[V4L2_AV1_MAX_NUM_PLANES];
> +};
> +
> +/**
> + * struct v4l2_av1_cdef - AV1 CDEF params semantics as described in section
> + * 6.10.14. "CDEF params semantics" of the AV1 specification
> + *
> + * @damping_minus_3: controls the amount of damping in the deringing filter.
> + * @bits: specifies the number of bits needed to specify which CDEF filter to
> + * apply.
> + * @y_pri_strength: specifies the strength of the primary filter.
> + * @y_sec_strength: specifies the strength of the secondary filter.
> + * @uv_pri_strength: specifies the strength of the primary filter.
> + * @uv_sec_strength: specifies the strength of the secondary filter.
> + */
> +struct v4l2_av1_cdef {
> + __u8 damping_minus_3;
> + __u8 bits;
> + __u8 y_pri_strength[V4L2_AV1_CDEF_MAX];
> + __u8 y_sec_strength[V4L2_AV1_CDEF_MAX];
> + __u8 uv_pri_strength[V4L2_AV1_CDEF_MAX];
> + __u8 uv_sec_strength[V4L2_AV1_CDEF_MAX];
> +};
> +
> +#define V4L2_AV1_SEGMENTATION_FLAG_ENABLED BIT(0)
> +#define V4L2_AV1_SEGMENTATION_FLAG_UPDATE_MAP BIT(1)
> +#define V4L2_AV1_SEGMENTATION_FLAG_TEMPORAL_UPDATE BIT(2)
> +#define V4L2_AV1_SEGMENTATION_FLAG_UPDATE_DATA BIT(3)
> +#define V4L2_AV1_SEGMENTATION_FLAG_SEG_ID_PRE_SKIP BIT(4)
> +
> +/**
> + * enum v4l2_av1_segment_feature - AV1 segment features as described in section
> + * 3 "Symbols and abbreviated terms" of the AV1 specification.
> + *
> + * @V4L2_AV1_SEG_LVL_ALT_Q: Index for quantizer segment feature.
> + * @V4L2_AV1_SEG_LVL_ALT_LF_Y_V: Index for vertical luma loop filter segment
> + * feature.
> + * @V4L2_AV1_SEG_LVL_REF_FRAME: Index for reference frame segment feature.
> + * @V4L2_AV1_SEG_LVL_SKIP: Index for skip segment feature.
> + * @V4L2_AV1_SEG_LVL_GLOBALMV: Index for global mv feature.
> + * @V4L2_AV1_SEG_LVL_MAX: Number of segment features.
> + */
> +enum v4l2_av1_segment_feature {
> + V4L2_AV1_SEG_LVL_ALT_Q = 0,
> + V4L2_AV1_SEG_LVL_ALT_LF_Y_V = 1,
> + V4L2_AV1_SEG_LVL_REF_FRAME = 5,
> + V4L2_AV1_SEG_LVL_REF_SKIP = 6,
> + V4L2_AV1_SEG_LVL_REF_GLOBALMV = 7,
> + V4L2_AV1_SEG_LVL_MAX = 8
> +};
> +
> +#define V4L2_AV1_SEGMENT_FEATURE_ENABLED(id) (1 << (id))
> +
> +/**
> + * struct v4l2_av1_segmentation - AV1 Segmentation params as defined in section
> + * 6.8.13. "Segmentation params semantics" of the AV1 specification.
> + *
> + * @flags: see V4L2_AV1_SEGMENTATION_FLAG_{}.
> + * @feature_enabled: bitmask defining which features are enabled in each segment.
> + * Use V4L2_AV1_SEGMENT_FEATURE_ENABLED to build a suitable mask.
> + * @feature_data: data attached to each feature. Data entry is only valid if the
> + * feature is enabled
> + * @last_active_seg_id: indicates the highest numbered segment id that has some
> + * enabled feature. This is used when decoding the segment id to only decode
> + * choices corresponding to used segments.
> + */
> +struct v4l2_av1_segmentation {
> + __u8 flags;
> + __u8 feature_enabled[V4L2_AV1_MAX_SEGMENTS];
> + __s16 feature_data[V4L2_AV1_MAX_SEGMENTS][V4L2_AV1_SEG_LVL_MAX];
> + __u8 last_active_seg_id;
> +};
> +
> +#define V4L2_AV1_LOOP_FILTER_FLAG_DELTA_ENABLED BIT(0)
> +#define V4L2_AV1_LOOP_FILTER_FLAG_DELTA_UPDATE BIT(1)
> +#define V4L2_AV1_LOOP_FILTER_FLAG_DELTA_LF_PRESENT BIT(2)
> +
> +/**
> + * struct v4l2_av1_loop_filter - AV1 Loop filter params as defined in section
> + * 6.8.10. "Loop filter semantics" of the AV1 specification.
> + *
> + * @flags: see V4L2_AV1_LOOP_FILTER_FLAG_{}
> + * @level: an array containing loop filter strength values. Different loop
> + * filter strength values from the array are used depending on the image plane
> + * being filtered, and the edge direction (vertical or horizontal) being
> + * filtered.
> + * @sharpness: indicates the sharpness level. The loop_filter_level and
> + * loop_filter_sharpness together determine when a block edge is filtered, and
> + * by how much the filtering can change the sample values. The loop filter
> + * process is described in section 7.14 of the AV1 specification.
> + * @ref_deltas: contains the adjustment needed for the filter level based on the
> + * chosen reference frame. If this syntax element is not present, it maintains
> + * its previous value.
> + * @mode_deltas: contains the adjustment needed for the filter level based on
> + * the chosen mode. If this syntax element is not present, it maintains its
> + * previous value.
> + * @delta_lf_res: specifies the left shift which should be applied to decoded
> + * loop filter delta values.
> + * @delta_lf_multi: a value equal to 1 specifies that separate loop filter
> + * deltas are sent for horizontal luma edges, vertical luma edges,
> + * the U edges, and the V edges. A value of delta_lf_multi equal to 0 specifies
> + * that the same loop filter delta is used for all edges.
> + */
> +struct v4l2_av1_loop_filter {
> + __u8 flags;
> + __u8 level[4];
> + __u8 sharpness;
> + __s8 ref_deltas[V4L2_AV1_TOTAL_REFS_PER_FRAME];
> + __s8 mode_deltas[2];
> + __u8 delta_lf_res;
> + __u8 delta_lf_multi;
> +};
> +
> +#define V4L2_AV1_QUANTIZATION_FLAG_DIFF_UV_DELTA BIT(0)
> +#define V4L2_AV1_QUANTIZATION_FLAG_USING_QMATRIX BIT(1)
> +#define V4L2_AV1_QUANTIZATION_FLAG_DELTA_Q_PRESENT BIT(2)
> +
> +/**
> + * struct v4l2_av1_quantization - AV1 Quantization params as defined in section
> + * 6.8.11 "Quantization params semantics" of the AV1 specification.
> + *
> + * @flags: see V4L2_AV1_QUANTIZATION_FLAG_{}
> + * @base_q_idx: indicates the base frame qindex. This is used for Y AC
> + * coefficients and as the base value for the other quantizers.
> + * @delta_q_y_dc: indicates the Y DC quantizer relative to base_q_idx.
> + * @delta_q_u_dc: indicates the U DC quantizer relative to base_q_idx.
> + * @delta_q_u_ac: indicates the U AC quantizer relative to base_q_idx.
> + * @delta_q_v_dc: indicates the V DC quantizer relative to base_q_idx.
> + * @delta_q_v_ac: indicates the V AC quantizer relative to base_q_idx.
> + * @qm_y: specifies the level in the quantizer matrix that should be used for
> + * luma plane decoding.
> + * @qm_u: specifies the level in the quantizer matrix that should be used for
> + * chroma U plane decoding.
> + * @qm_v: specifies the level in the quantizer matrix that should be used for
> + * chroma V plane decoding.
> + * @delta_q_res: specifies the left shift which should be applied to decoded
> + * quantizer index delta values.
> + */
> +struct v4l2_av1_quantization {
> + __u8 flags;
> + __u8 base_q_idx;
> + __s8 delta_q_y_dc;
> + __s8 delta_q_u_dc;
> + __s8 delta_q_u_ac;
> + __s8 delta_q_v_dc;
> + __s8 delta_q_v_ac;
> + __u8 qm_y;
> + __u8 qm_u;
> + __u8 qm_v;
> + __u8 delta_q_res;
> +};
> +
> +#define V4L2_AV1_TILE_INFO_FLAG_UNIFORM_TILE_SPACING BIT(0)
> +
> +/**
> + * struct v4l2_av1_tile_info - AV1 Tile info as defined in section 6.8.14. "Tile
> + * info semantics" of the AV1 specification.
> + *
> + * @flags: see V4L2_AV1_TILE_INFO_FLAG_{}
> + * @mi_col_starts: an array specifying the start column (in units of 4x4 luma
> + * samples) for each tile across the image.
> + * @mi_row_starts: an array specifying the start row (in units of 4x4 luma
> + * samples) for each tile down the image.
> + * @width_in_sbs_minus_1: specifies the width of a tile minus 1 in units of
> + * superblocks.
> + * @height_in_sbs_minus_1: specifies the height of a tile minus 1 in units of
> + * superblocks.
> + * @tile_size_bytes: specifies the number of bytes needed to code each tile
> + * size.
> + * @context_update_tile_id: specifies which tile to use for the CDF update.
> + * @tile_rows: specifies the number of tiles down the frame.
> + * @tile_cols: specifies the number of tiles across the frame.
> + */
> +struct v4l2_av1_tile_info {
> + __u8 flags;
> + __u32 mi_col_starts[V4L2_AV1_MAX_TILE_COLS + 1];
> + __u32 mi_row_starts[V4L2_AV1_MAX_TILE_ROWS + 1];
> + __u32 width_in_sbs_minus_1[V4L2_AV1_MAX_TILE_COLS];
> + __u32 height_in_sbs_minus_1[V4L2_AV1_MAX_TILE_ROWS];
> + __u8 tile_size_bytes;
> + __u8 context_update_tile_id;
> + __u8 tile_cols;
> + __u8 tile_rows;
> +};
> +
> +/**
> + * enum v4l2_av1_frame_type - AV1 Frame Type
> + *
> + * @V4L2_AV1_KEY_FRAME: Key frame
> + * @V4L2_AV1_INTER_FRAME: Inter frame
> + * @V4L2_AV1_INTRA_ONLY_FRAME: Intra-only frame
> + * @V4L2_AV1_SWITCH_FRAME: Switch frame
> + */
> +enum v4l2_av1_frame_type {
> + V4L2_AV1_KEY_FRAME = 0,
> + V4L2_AV1_INTER_FRAME = 1,
> + V4L2_AV1_INTRA_ONLY_FRAME = 2,
> + V4L2_AV1_SWITCH_FRAME = 3
> +};
> +
> +/**
> + * enum v4l2_av1_interpolation_filter - AV1 interpolation filter types
> + *
> + * @V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP: eight tap filter
> + * @V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP_SMOOTH: eight tap smooth filter
> + * @V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP_SHARP: eight tap sharp filter
> + * @V4L2_AV1_INTERPOLATION_FILTER_BILINEAR: bilinear filter
> + * @V4L2_AV1_INTERPOLATION_FILTER_SWITCHABLE: filter selection is signaled at
> + * the block level
> + *
> + * See section 6.8.9 "Interpolation filter semantics" of the AV1 specification
> + * for more details.
> + */
> +enum v4l2_av1_interpolation_filter {
> + V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP = 0,
> + V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP_SMOOTH = 1,
> + V4L2_AV1_INTERPOLATION_FILTER_EIGHTTAP_SHARP = 2,
> + V4L2_AV1_INTERPOLATION_FILTER_BILINEAR = 3,
> + V4L2_AV1_INTERPOLATION_FILTER_SWITCHABLE = 4,
> +};
> +
> +/**
> + * enum v4l2_av1_tx_mode - AV1 Tx mode as described in section 6.8.21 "TX mode
> + * semantics" of the AV1 specification.
> + * @V4L2_AV1_TX_MODE_ONLY_4X4: the inverse transform will use only 4x4
> + * transforms
> + * @V4L2_AV1_TX_MODE_LARGEST: the inverse transform will use the largest
> + * transform size that fits inside the block
> + * @V4L2_AV1_TX_MODE_SELECT: the choice of transform size is specified
> + * explicitly for each block.
> + */
> +enum v4l2_av1_tx_mode {
> + V4L2_AV1_TX_MODE_ONLY_4X4 = 0,
> + V4L2_AV1_TX_MODE_LARGEST = 1,
> + V4L2_AV1_TX_MODE_SELECT = 2
> +};
> +
> +#define V4L2_AV1_FRAME_HEADER_FLAG_SHOW_FRAME BIT(0)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_SHOWABLE_FRAME BIT(1)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_ERROR_RESILIENT_MODE BIT(2)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_DISABLE_CDF_UPDATE BIT(3)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_SCREEN_CONTENT_TOOLS BIT(4)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_FORCE_INTEGER_MV BIT(5)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_INTRABC BIT(6)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_USE_SUPERRES BIT(7)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_HIGH_PRECISION_MV BIT(8)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_IS_MOTION_MODE_SWITCHABLE BIT(9)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_USE_REF_FRAME_MVS BIT(10)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_DISABLE_FRAME_END_UPDATE_CDF BIT(11)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_UNIFORM_TILE_SPACING BIT(12)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_ALLOW_WARPED_MOTION BIT(13)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_REFERENCE_SELECT BIT(14)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_REDUCED_TX_SET BIT(15)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_SKIP_MODE_ALLOWED BIT(16)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_SKIP_MODE_PRESENT BIT(17)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_FRAME_SIZE_OVERRIDE BIT(18)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_BUFFER_REMOVAL_TIME_PRESENT BIT(19)
> +#define V4L2_AV1_FRAME_HEADER_FLAG_FRAME_REFS_SHORT_SIGNALING BIT(20)
> +
> +#define V4L2_CID_STATELESS_AV1_FRAME_HEADER (V4L2_CID_CODEC_STATELESS_BASE + 406)
> +/**
> + * struct v4l2_ctrl_av1_frame_header - Represents an AV1 Frame Header OBU.
> + *
> + * @tile_info: tile info
> + * @quantization: quantization params
> + * @segmentation: segmentation params
> + * @loop_filter: loop filter params
> + * @cdef: cdef params
> + * @loop_restoration: loop restoration params
> + * @global_motion: global motion params
> + * @film_grain: film grain params
> + * @flags: see V4L2_AV1_FRAME_HEADER_FLAG_{}
> + * @frame_type: specifies the AV1 frame type
> + * @order_hint: specifies OrderHintBits least significant bits of the expected
> + * output order for this frame.
> + * @superres_denom: the denominator for the upscaling ratio.
> + * @upscaled_width: the upscaled width.
> + * @interpolation_filter: specifies the filter selection used for performing
> + * inter prediction.
> + * @tx_mode: specifies how the transform size is determined.
> + * @frame_width_minus_1: add 1 to get the frame's width.
> + * @frame_height_minus_1: add 1 to get the frame's height
> + * @render_width_minus_1: add 1 to get the render width of the frame in luma
> + * samples.
> + * @render_height_minus_1: add 1 to get the render height of the frame in luma
> + * samples.
> + * @current_frame_id: specifies the frame id number for the current frame. Frame
> + * id numbers are additional information that do not affect the decoding
> + * process, but provide decoders with a way of detecting missing reference
> + * frames so that appropriate action can be taken.
> + * @primary_ref_frame: specifies which reference frame contains the CDF values
> + * and other state that should be loaded at the start of the frame.
> + * @buf_removal_time: specifies the frame removal time in units of DecCT clock
> + * ticks counted from the removal time of the last random access point for
> + * operating point opNum.
> + * @refresh_frame_flags: contains a bitmask that specifies which reference frame
> + * slots will be updated with the current frame after it is decoded.
> + * @order_hints: specifies the expected output order hint for each reference
> + * frame.
> + * @last_frame_idx: specifies the reference frame to use for LAST_FRAME.
> + * @gold_frame_idx: specifies the reference frame to use for GOLDEN_FRAME.
> + * refs
> + * @reference_frame_ts: the V4L2 timestamp of the reference frame slots.
> + * @ref_frame_idx: index into @reference_frame_ts fo the frames used by
> + * inter-frames.
> + * enumerated in &v4l2_av1_reference_frame. The timestamp refers to the
> + * timestamp field in struct v4l2_buffer. Use v4l2_timeval_to_ns() to convert
> + * the struct timeval to a __u64.
> + * @skip_mode_frame: specifies the frames to use for compound prediction when
> + * skip_mode is equal to 1.
> + */
> +struct v4l2_ctrl_av1_frame_header {
> + struct v4l2_av1_tile_info tile_info;
> + struct v4l2_av1_quantization quantization;
> + struct v4l2_av1_segmentation segmentation;
> + struct v4l2_av1_loop_filter loop_filter;
> + struct v4l2_av1_cdef cdef;
> + struct v4l2_av1_loop_restoration loop_restoration;
> + struct v4l2_av1_global_motion global_motion;
> + __u32 flags;
> + enum v4l2_av1_frame_type frame_type;
> + __u32 order_hint;
> + __u8 superres_denom;
> + __u32 upscaled_width;
> + enum v4l2_av1_interpolation_filter interpolation_filter;
> + enum v4l2_av1_tx_mode tx_mode;
> + __u32 frame_width_minus_1;
> + __u32 frame_height_minus_1;
> + __u16 render_width_minus_1;
> + __u16 render_height_minus_1;
> +
> + __u32 current_frame_id;
> + __u8 primary_ref_frame;
> + __u32 buffer_removal_time[V4L2_AV1_MAX_OPERATING_POINTS];
> + __u8 refresh_frame_flags;
> + __u32 order_hints[V4L2_AV1_NUM_REF_FRAMES];
> + __s8 last_frame_idx;
> + __s8 gold_frame_idx;
> + __u64 reference_frame_ts[V4L2_AV1_TOTAL_REFS_PER_FRAME];
> + __u8 ref_frame_idx[V4L2_AV1_REFS_PER_FRAME];
> + __u8 skip_mode_frame[2];
> +};
> +
> +/**
> + * enum v4l2_stateless_av1_profile - AV1 profiles
> + *
> + * @V4L2_STATELESS_AV1_PROFILE_MAIN: compliant decoders must be able to decode
> + * streams with seq_profile equal to 0.
> + * @V4L2_STATELESS_PROFILE_HIGH: compliant decoders must be able to decode
> + * streams with seq_profile equal to 0.
> + * @V4L2_STATELESS_PROFILE_PROFESSIONAL: compliant decoders must be able to
> + * decode streams with seq_profile equal to 0.
> + *
> + * Conveys the highest profile a decoder can work with.
> + */
> +#define V4L2_CID_STATELESS_AV1_PROFILE (V4L2_CID_CODEC_STATELESS_BASE + 407)
> +enum v4l2_stateless_av1_profile {
> + V4L2_STATELESS_AV1_PROFILE_MAIN = 0,
> + V4L2_STATELESS_AV1_PROFILE_HIGH = 1,
> + V4L2_STATELESS_AV1_PROFILE_PROFESSIONAL = 2,
> +};
> +
> +/**
> + * enum v4l2_stateless_av1_level - AV1 levels
> + *
> + * @V4L2_STATELESS_AV1_LEVEL_2_0: Level 2.0.
> + * @V4L2_STATELESS_AV1_LEVEL_2_1: Level 2.1.
> + * @V4L2_STATELESS_AV1_LEVEL_2_2: Level 2.2.
> + * @V4L2_STATELESS_AV1_LEVEL_2_3: Level 2.3.
> + * @V4L2_STATELESS_AV1_LEVEL_3_0: Level 3.0.
> + * @V4L2_STATELESS_AV1_LEVEL_3_1: Level 3.1.
> + * @V4L2_STATELESS_AV1_LEVEL_3_2: Level 3.2.
> + * @V4L2_STATELESS_AV1_LEVEL_3_3: Level 3.3.
> + * @V4L2_STATELESS_AV1_LEVEL_4_0: Level 4.0.
> + * @V4L2_STATELESS_AV1_LEVEL_4_1: Level 4.1.
> + * @V4L2_STATELESS_AV1_LEVEL_4_2: Level 4.2.
> + * @V4L2_STATELESS_AV1_LEVEL_4_3: Level 4.3.
> + * @V4L2_STATELESS_AV1_LEVEL_5_0: Level 5.0.
> + * @V4L2_STATELESS_AV1_LEVEL_5_1: Level 5.1.
> + * @V4L2_STATELESS_AV1_LEVEL_5_2: Level 5.2.
> + * @V4L2_STATELESS_AV1_LEVEL_5_3: Level 5.3.
> + * @V4L2_STATELESS_AV1_LEVEL_6_0: Level 6.0.
> + * @V4L2_STATELESS_AV1_LEVEL_6_1: Level 6.1.
> + * @V4L2_STATELESS_AV1_LEVEL_6_2: Level 6.2.
> + * @V4L2_STATELESS_AV1_LEVEL_6_3: Level 6.3.
> + * @V4L2_STATELESS_AV1_LEVEL_7_0: Level 7.0.
> + * @V4L2_STATELESS_AV1_LEVEL_7_2: Level 7.2.
> + * @V4L2_STATELESS_AV1_LEVEL_7_3: Level 7.3.
> + *
> + * Conveys the highest level a decoder can work with.
> + */
> +#define V4L2_CID_STATELESS_AV1_LEVEL (V4L2_CID_CODEC_STATELESS_BASE + 408)
> +enum v4l2_stateless_av1_level {
> + V4L2_STATELESS_AV1_LEVEL_2_0 = 0,
> + V4L2_STATELESS_AV1_LEVEL_2_1 = 1,
> + V4L2_STATELESS_AV1_LEVEL_2_2 = 2,
> + V4L2_STATELESS_AV1_LEVEL_2_3 = 3,
> +
> + V4L2_STATELESS_AV1_LEVEL_3_0 = 4,
> + V4L2_STATELESS_AV1_LEVEL_3_1 = 5,
> + V4L2_STATELESS_AV1_LEVEL_3_2 = 6,
> + V4L2_STATELESS_AV1_LEVEL_3_3 = 7,
> +
> + V4L2_STATELESS_AV1_LEVEL_4_0 = 8,
> + V4L2_STATELESS_AV1_LEVEL_4_1 = 9,
> + V4L2_STATELESS_AV1_LEVEL_4_2 = 10,
> + V4L2_STATELESS_AV1_LEVEL_4_3 = 11,
> +
> + V4L2_STATELESS_AV1_LEVEL_5_0 = 12,
> + V4L2_STATELESS_AV1_LEVEL_5_1 = 13,
> + V4L2_STATELESS_AV1_LEVEL_5_2 = 14,
> + V4L2_STATELESS_AV1_LEVEL_5_3 = 15,
> +
> + V4L2_STATELESS_AV1_LEVEL_6_0 = 16,
> + V4L2_STATELESS_AV1_LEVEL_6_1 = 17,
> + V4L2_STATELESS_AV1_LEVEL_6_2 = 18,
> + V4L2_STATELESS_AV1_LEVEL_6_3 = 19,
> +
> + V4L2_STATELESS_AV1_LEVEL_7_0 = 20,
> + V4L2_STATELESS_AV1_LEVEL_7_1 = 21,
> + V4L2_STATELESS_AV1_LEVEL_7_2 = 22,
> + V4L2_STATELESS_AV1_LEVEL_7_3 = 23
> +};
> +
> +#define V4L2_AV1_FILM_GRAIN_FLAG_APPLY_GRAIN BIT(0)
> +#define V4L2_AV1_FILM_GRAIN_FLAG_UPDATE_GRAIN BIT(1)
> +#define V4L2_AV1_FILM_GRAIN_FLAG_CHROMA_SCALING_FROM_LUMA BIT(2)
> +#define V4L2_AV1_FILM_GRAIN_FLAG_OVERLAP BIT(3)
> +#define V4L2_AV1_FILM_GRAIN_FLAG_CLIP_TO_RESTRICTED_RANGE BIT(4)
> +
> +/**
> + * struct v4l2_av1_film_grain - AV1 Film Grain parameters.
> + *
> + * Film grain parameters as specified by section 6.8.20 of the AV1
> + Specification.
> + *
> + * @flags: see V4L2_AV1_FILM_GRAIN_{}.
> + * @grain_seed: specifies the starting value for the pseudo-random numbers used
> + * during film grain synthesis.
> + * @film_grain_params_ref_idx: indicates which reference frame contains the
> + * film grain parameters to be used for this frame.
> + * @num_y_points: specifies the number of points for the piece-wise linear
> + * scaling function of the luma component.
> + * @point_y_value: represents the x (luma value) coordinate for the i-th point
> + * of the piecewise linear scaling function for luma component. The values are
> + * signaled on the scale of 0..255. (In case of 10 bit video, these values
> + * correspond to luma values divided by 4. In case of 12 bit video, these values
> + * correspond to luma values divided by 16.).
> + * @point_y_scaling: represents the scaling (output) value for the i-th point
> + * of the piecewise linear scaling function for luma component.
> + * @num_cb_points: specifies the number of points for the piece-wise linear
> + * scaling function of the cb component.
> + * @point_cb_value: represents the x coordinate for the i-th point of the
> + * piece-wise linear scaling function for cb component. The values are signaled
> + * on the scale of 0..255.
> + * @point_cb_scaling: represents the scaling (output) value for the i-th point
> + * of the piecewise linear scaling function for cb component.
> + * @num_cr_points: specifies represents the number of points for the piece-wise
> + * linear scaling function of the cr component.
> + * @point_cr_value: represents the x coordinate for the i-th point of the
> + * piece-wise linear scaling function for cr component. The values are signaled
> + * on the scale of 0..255.
> + * @point_cr_scaling: represents the scaling (output) value for the i-th point
> + * of the piecewise linear scaling function for cr component.
> + * @grain_scaling_minus_8: represents the shift – 8 applied to the values of the
> + * chroma component. The grain_scaling_minus_8 can take values of 0..3 and
> + * determines the range and quantization step of the standard deviation of film
> + * grain.
> + * @ar_coeff_lag: specifies the number of auto-regressive coefficients for luma
> + * and chroma.
> + * @ar_coeffs_y_plus_128: specifies auto-regressive coefficients used for the Y
> + * plane.
> + * @ar_coeffs_cb_plus_128: specifies auto-regressive coefficients used for the U
> + * plane.
> + * @ar_coeffs_cr_plus_128: specifies auto-regressive coefficients used for the V
> + * plane.
> + * @ar_coeff_shift_minus_6: specifies the range of the auto-regressive
> + * coefficients. Values of 0, 1, 2, and 3 correspond to the ranges for
> + * auto-regressive coefficients of [-2, 2), [-1, 1), [-0.5, 0.5) and [-0.25,
> + * 0.25) respectively.
> + * @grain_scale_shift: specifies how much the Gaussian random numbers should be
> + * scaled down during the grain synthesis process.
> + * @cb_mult: represents a multiplier for the cb component used in derivation of
> + * the input index to the cb component scaling function.
> + * @cb_luma_mult: represents a multiplier for the average luma component used in
> + * derivation of the input index to the cb component scaling function.
> + * @cb_offset: represents an offset used in derivation of the input index to the
> + * cb component scaling function.
> + * @cr_mult: represents a multiplier for the cr component used in derivation of
> + * the input index to the cr component scaling function.
> + * @cr_luma_mult: represents a multiplier for the average luma component used in
> + * derivation of the input index to the cr component scaling function.
> + * @cr_offset: represents an offset used in derivation of the input index to the
> + * cr component scaling function.
> + */
> +#define V4L2_CID_STATELESS_AV1_FILM_GRAIN (V4L2_CID_CODEC_STATELESS_BASE + 409)
> +struct v4l2_ctrl_av1_film_grain {
> + __u8 flags;
> + __u16 grain_seed;
> + __u8 film_grain_params_ref_idx;
> + __u8 num_y_points;
> + __u8 point_y_value[V4L2_AV1_MAX_NUM_Y_POINTS];
> + __u8 point_y_scaling[V4L2_AV1_MAX_NUM_Y_POINTS];
> + __u8 num_cb_points;
> + __u8 point_cb_value[V4L2_AV1_MAX_NUM_CB_POINTS];
> + __u8 point_cb_scaling[V4L2_AV1_MAX_NUM_CB_POINTS];
> + __u8 num_cr_points;
> + __u8 point_cr_value[V4L2_AV1_MAX_NUM_CR_POINTS];
> + __u8 point_cr_scaling[V4L2_AV1_MAX_NUM_CR_POINTS];
> + __u8 grain_scaling_minus_8;
> + __u8 ar_coeff_lag;
> + __u8 ar_coeffs_y_plus_128[V4L2_AV1_MAX_NUM_POS_LUMA];
> + __u8 ar_coeffs_cb_plus_128[V4L2_AV1_MAX_NUM_POS_LUMA];
> + __u8 ar_coeffs_cr_plus_128[V4L2_AV1_MAX_NUM_POS_LUMA];
> + __u8 ar_coeff_shift_minus_6;
> + __u8 grain_scale_shift;
> + __u8 cb_mult;
> + __u8 cb_luma_mult;
> + __u16 cb_offset;
> + __u8 cr_mult;
> + __u8 cr_luma_mult;
> + __u16 cr_offset;
> +};
> +
> +
> #define V4L2_CID_COLORIMETRY_CLASS_BASE (V4L2_CTRL_CLASS_COLORIMETRY | 0x900)
> #define V4L2_CID_COLORIMETRY_CLASS (V4L2_CTRL_CLASS_COLORIMETRY | 1)
>
> diff --git a/include/uapi/linux/videodev2.h b/include/uapi/linux/videodev2.h
> index 8df13defde75..ad6ab6114fdc 100644
> --- a/include/uapi/linux/videodev2.h
> +++ b/include/uapi/linux/videodev2.h
> @@ -710,6 +710,7 @@ struct v4l2_pix_format {
> #define V4L2_PIX_FMT_FWHT v4l2_fourcc('F', 'W', 'H', 'T') /* Fast Walsh Hadamard Transform (vicodec) */
> #define V4L2_PIX_FMT_FWHT_STATELESS v4l2_fourcc('S', 'F', 'W', 'H') /* Stateless FWHT (vicodec) */
> #define V4L2_PIX_FMT_H264_SLICE v4l2_fourcc('S', '2', '6', '4') /* H264 parsed slices */
> +#define V4L2_PIX_FMT_AV1_FRAME v4l2_fourcc('A', 'V', '1', 'F') /* AV1 parsed frame */
>
> /* Vendor-specific formats */
> #define V4L2_PIX_FMT_CPIA1 v4l2_fourcc('C', 'P', 'I', 'A') /* cpia1 YUV */
> @@ -1764,6 +1765,12 @@ struct v4l2_ext_control {
> struct v4l2_ctrl_mpeg2_quantisation __user *p_mpeg2_quantisation;
> struct v4l2_ctrl_vp9_compressed_hdr __user *p_vp9_compressed_hdr_probs;
> struct v4l2_ctrl_vp9_frame __user *p_vp9_frame;
> +
> + struct v4l2_ctrl_av1_sequence __user *p_av1_sequence;
> + struct v4l2_ctrl_av1_tile_group __user *p_av1_tile_group;
> + struct v4l2_ctrl_av1_tile_group_entry __user *p_av1_tile_group_entry;
> + struct v4l2_ctrl_av1_frame_header __user *p_av1_frame_header;
> + struct v4l2_ctrl_av1_film_grain __user *p_av1_film_grain;
> void __user *ptr;
> };
> } __attribute__ ((packed));
> @@ -1831,6 +1838,12 @@ enum v4l2_ctrl_type {
>
> V4L2_CTRL_TYPE_VP9_COMPRESSED_HDR = 0x0260,
> V4L2_CTRL_TYPE_VP9_FRAME = 0x0261,
> +
> + V4L2_CTRL_TYPE_AV1_SEQUENCE = 0x280,
> + V4L2_CTRL_TYPE_AV1_TILE_GROUP = 0x281,
> + V4L2_CTRL_TYPE_AV1_TILE_GROUP_ENTRY = 0x282,
> + V4L2_CTRL_TYPE_AV1_FRAME_HEADER = 0x283,
> + V4L2_CTRL_TYPE_AV1_FILM_GRAIN = 0x284,
> };
>
> /* Used in the VIDIOC_QUERYCTRL ioctl for querying controls */
> --
> 2.35.1
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC PATCH v2] media: Add AV1 uAPI
2022-05-10 0:04 ` Steve Cho
@ 2022-05-10 16:30 ` Daniel Almeida
2022-05-11 20:59 ` Steve Cho
0 siblings, 1 reply; 10+ messages in thread
From: Daniel Almeida @ 2022-05-10 16:30 UTC (permalink / raw)
To: Steve Cho; +Cc: hverkuil, linux-media, Nicolas Dufresne, Steve Cho
Hi Steve,
> Hi Daniel,
>
> Found a minor typo.
>
>> See enum_v4l2_av1_frame_restoration_type.
> Assume you meant v4l2_av1_frame_restoration_type instead here.
Thanks for the heads up, this will be fixed in v3.
-- Daniel
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC PATCH v2] media: Add AV1 uAPI
2022-05-10 16:30 ` Daniel Almeida
@ 2022-05-11 20:59 ` Steve Cho
2022-05-16 17:42 ` Steve Cho
0 siblings, 1 reply; 10+ messages in thread
From: Steve Cho @ 2022-05-11 20:59 UTC (permalink / raw)
To: Daniel Almeida; +Cc: hverkuil, linux-media, Nicolas Dufresne
Hi Daniel,
I think the below definition is expected to cause a build error.
+struct v4l2_av1_loop_restoration {
+ u8 flags;
s/u8/__u8/ is needed.
At least, this change was needed to fix this build error on Chromium
build environment.
Steve
On Tue, May 10, 2022 at 9:30 AM Daniel Almeida
<daniel.almeida@collabora.com> wrote:
>
> Hi Steve,
>
> > Hi Daniel,
> >
> > Found a minor typo.
> >
> >> See enum_v4l2_av1_frame_restoration_type.
> > Assume you meant v4l2_av1_frame_restoration_type instead here.
>
>
> Thanks for the heads up, this will be fixed in v3.
>
> -- Daniel
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC PATCH v2] media: Add AV1 uAPI
2022-05-11 20:59 ` Steve Cho
@ 2022-05-16 17:42 ` Steve Cho
2022-05-18 16:41 ` Steve Cho
0 siblings, 1 reply; 10+ messages in thread
From: Steve Cho @ 2022-05-16 17:42 UTC (permalink / raw)
To: Daniel Almeida; +Cc: hverkuil, linux-media, Nicolas Dufresne
Hi Daniel,
Question about tile info structure.
struct v4l2_av1_tile_info {
__u8 flags;
__u32 mi_col_starts[V4L2_AV1_MAX_TILE_COLS + 1];
__u32 mi_row_starts[V4L2_AV1_MAX_TILE_ROWS + 1];
__u32 width_in_sbs_minus_1[V4L2_AV1_MAX_TILE_COLS];
__u32 height_in_sbs_minus_1[V4L2_AV1_MAX_TILE_ROWS];
I see below from the spec and gstreamer implementation
for width_in_sbs_minus_1 and height_in_sbs_minus_1 computation.
sb_cols = seq_header->use_128x128_superblock ?
((parser->state.mi_cols + 31) >> 5) : ((parser->state.mi_cols + 15) >> 4);
sb_rows = seq_header->use_128x128_superblock ? ((parser->state.mi_rows +
31) >> 5) : ((parser->state.mi_rows + 15) >> 4);
Are we confident that V4L2_AV1_MAX_TILE_COLS is good enough size for
width_in_sbs_minus_1?
Or does it potentially need to be V4L2_AV1_MAX_TILE_COLS+1?
I am asking to double check because I see V4L2_AV1_MAX_TILE_COLS+1
used for corresponding field in libgav1.
int tile_column_width_in_superblocks[kMaxTileColumns + 1];
https://source.chromium.org/chromium/chromium/src/+/main:third_party/libgav1/src/src/utils/types.h;l=291
Steve
On Wed, May 11, 2022 at 1:59 PM Steve Cho <stevecho@chromium.org> wrote:
>
> Hi Daniel,
>
> I think the below definition is expected to cause a build error.
>
> +struct v4l2_av1_loop_restoration {
> + u8 flags;
>
> s/u8/__u8/ is needed.
>
> At least, this change was needed to fix this build error on Chromium
> build environment.
>
> Steve
>
> On Tue, May 10, 2022 at 9:30 AM Daniel Almeida
> <daniel.almeida@collabora.com> wrote:
> >
> > Hi Steve,
> >
> > > Hi Daniel,
> > >
> > > Found a minor typo.
> > >
> > >> See enum_v4l2_av1_frame_restoration_type.
> > > Assume you meant v4l2_av1_frame_restoration_type instead here.
> >
> >
> > Thanks for the heads up, this will be fixed in v3.
> >
> > -- Daniel
> >
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC PATCH v2] media: Add AV1 uAPI
2022-05-16 17:42 ` Steve Cho
@ 2022-05-18 16:41 ` Steve Cho
[not found] ` <CAN0yncHrY6jfk6owTEue8PqGmxffU612UgccvPc9Y6XOz38LRA@mail.gmail.com>
0 siblings, 1 reply; 10+ messages in thread
From: Steve Cho @ 2022-05-18 16:41 UTC (permalink / raw)
To: Daniel Almeida; +Cc: hverkuil, linux-media, Nicolas Dufresne
Optional: one comment about "v4l2_ctrl_av1_frame_header".
struct v4l2_ctrl_av1_frame_header {
struct v4l2_av1_tile_info tile_info;
struct v4l2_av1_quantization quantization;
struct v4l2_av1_segmentation segmentation;
struct v4l2_av1_loop_filter loop_filter;
struct v4l2_av1_cdef cdef;
struct v4l2_av1_loop_restoration loop_restoration;
struct v4l2_av1_global_motion global_motion;
We used "v4l2_ctrl_vp9_frame" for the similar purpose.
I thought "_header" can be confusing in a sense that these are
parameters setup from parsing av1 frame header,
not necessarily "header" itself.
How about making it "v4l2_ctrl_av1_frame" similar to vp9,
or "v4l2_ctrl_av1_frame_params"?
I don't think this alone justify for another update, but if we need to
have an update anyway,
then I thought it was worthwhile considering.
Steve
On Mon, May 16, 2022 at 10:42 AM Steve Cho <stevecho@chromium.org> wrote:
>
> Hi Daniel,
>
> Question about tile info structure.
>
> struct v4l2_av1_tile_info {
> __u8 flags;
> __u32 mi_col_starts[V4L2_AV1_MAX_TILE_COLS + 1];
> __u32 mi_row_starts[V4L2_AV1_MAX_TILE_ROWS + 1];
> __u32 width_in_sbs_minus_1[V4L2_AV1_MAX_TILE_COLS];
> __u32 height_in_sbs_minus_1[V4L2_AV1_MAX_TILE_ROWS];
>
> I see below from the spec and gstreamer implementation
> for width_in_sbs_minus_1 and height_in_sbs_minus_1 computation.
>
> sb_cols = seq_header->use_128x128_superblock ?
> ((parser->state.mi_cols + 31) >> 5) : ((parser->state.mi_cols + 15) >> 4);
> sb_rows = seq_header->use_128x128_superblock ? ((parser->state.mi_rows +
> 31) >> 5) : ((parser->state.mi_rows + 15) >> 4);
>
> Are we confident that V4L2_AV1_MAX_TILE_COLS is good enough size for
> width_in_sbs_minus_1?
> Or does it potentially need to be V4L2_AV1_MAX_TILE_COLS+1?
>
> I am asking to double check because I see V4L2_AV1_MAX_TILE_COLS+1
> used for corresponding field in libgav1.
> int tile_column_width_in_superblocks[kMaxTileColumns + 1];
>
> https://source.chromium.org/chromium/chromium/src/+/main:third_party/libgav1/src/src/utils/types.h;l=291
>
> Steve
>
> On Wed, May 11, 2022 at 1:59 PM Steve Cho <stevecho@chromium.org> wrote:
> >
> > Hi Daniel,
> >
> > I think the below definition is expected to cause a build error.
> >
> > +struct v4l2_av1_loop_restoration {
> > + u8 flags;
> >
> > s/u8/__u8/ is needed.
> >
> > At least, this change was needed to fix this build error on Chromium
> > build environment.
> >
> > Steve
> >
> > On Tue, May 10, 2022 at 9:30 AM Daniel Almeida
> > <daniel.almeida@collabora.com> wrote:
> > >
> > > Hi Steve,
> > >
> > > > Hi Daniel,
> > > >
> > > > Found a minor typo.
> > > >
> > > >> See enum_v4l2_av1_frame_restoration_type.
> > > > Assume you meant v4l2_av1_frame_restoration_type instead here.
> > >
> > >
> > > Thanks for the heads up, this will be fixed in v3.
> > >
> > > -- Daniel
> > >
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC PATCH v2] media: Add AV1 uAPI
[not found] ` <CAN0yncHrY6jfk6owTEue8PqGmxffU612UgccvPc9Y6XOz38LRA@mail.gmail.com>
@ 2022-05-19 15:54 ` Steve Cho
[not found] ` <CAC-pXoNHRxqe6tzg3++TqYRZE-nocxiz-iPh5vPXC07iA_BaSw@mail.gmail.com>
0 siblings, 1 reply; 10+ messages in thread
From: Steve Cho @ 2022-05-19 15:54 UTC (permalink / raw)
To: Daniel Almeida; +Cc: hverkuil, linux-media, Nicolas Dufresne
Hi Daniel,
Few more style related comments.
1. "tab" seems to be used before "descr = ". […] for other cases.
+++ b/drivers/media/v4l2-core/v4l2-ioctl.c
@@ -1441,6 +1441,7 @@ static void v4l_fill_fmtdesc(struct v4l2_fmtdesc *fmt)
case V4L2_PIX_FMT_MT21C: descr = "Mediatek
Compressed Format"; break;
+ case V4L2_PIX_FMT_AV1_FRAME: descr = "AV1 Frame"; break;
2. nit: s/the AOMedia/the AOMedia/
This patch adds the AOMedia Video 1 (AV1) kernel uAPI.
3. nit: s/AV1 film_gram/AV1 film grain/ ?
+++ b/include/media/v4l2-ctrls.h
+ * @p_av1_film_grain: Pointer to an AV1 film_grain.
I found these issues while reviewing Chen-Yu's change, which backports
this change to 5.10 kernel.
https://chromium-review.googlesource.com/c/chromiumos/third_party/kernel/+/3650151
Steve
On Wed, May 18, 2022 at 4:26 PM Steve Cho <stevecho@google.com> wrote:
>
> Hi Daniel,
>
> Don't we also need V4L2_PIX_FMT_AV1 in addition to V4L2_PIX_FMT_AV1_FRAME
> as we do with both VP8 and VP9? I see V4L2_PIX_FMT_AV1 is missing.
>
> I think V4L2_PIX_FMT_VP9 is for compressed video frame
> and V4L2_PIX_FMT_VP9_FRAME is for parsed video frame.
>
> https://www.kernel.org/doc/html/latest/userspace-api/media/v4l/pixfmt-compressed.html
>
> Thanks,
> Steve
>
> On Wed, May 18, 2022 at 2:42 PM Steve Cho <stevecho@chromium.org> wrote:
>>
>> Optional: one comment about "v4l2_ctrl_av1_frame_header".
>>
>> struct v4l2_ctrl_av1_frame_header {
>> struct v4l2_av1_tile_info tile_info;
>> struct v4l2_av1_quantization quantization;
>> struct v4l2_av1_segmentation segmentation;
>> struct v4l2_av1_loop_filter loop_filter;
>> struct v4l2_av1_cdef cdef;
>> struct v4l2_av1_loop_restoration loop_restoration;
>> struct v4l2_av1_global_motion global_motion;
>>
>> We used "v4l2_ctrl_vp9_frame" for the similar purpose.
>>
>> I thought "_header" can be confusing in a sense that these are
>> parameters setup from parsing av1 frame header,
>> not necessarily "header" itself.
>>
>> How about making it "v4l2_ctrl_av1_frame" similar to vp9,
>> or "v4l2_ctrl_av1_frame_params"?
>>
>> I don't think this alone justify for another update, but if we need to
>> have an update anyway,
>> then I thought it was worthwhile considering.
>>
>> Steve
>>
>> On Mon, May 16, 2022 at 10:42 AM Steve Cho <stevecho@chromium.org> wrote:
>> >
>> > Hi Daniel,
>> >
>> > Question about tile info structure.
>> >
>> > struct v4l2_av1_tile_info {
>> > __u8 flags;
>> > __u32 mi_col_starts[V4L2_AV1_MAX_TILE_COLS + 1];
>> > __u32 mi_row_starts[V4L2_AV1_MAX_TILE_ROWS + 1];
>> > __u32 width_in_sbs_minus_1[V4L2_AV1_MAX_TILE_COLS];
>> > __u32 height_in_sbs_minus_1[V4L2_AV1_MAX_TILE_ROWS];
>> >
>> > I see below from the spec and gstreamer implementation
>> > for width_in_sbs_minus_1 and height_in_sbs_minus_1 computation.
>> >
>> > sb_cols = seq_header->use_128x128_superblock ?
>> > ((parser->state.mi_cols + 31) >> 5) : ((parser->state.mi_cols + 15) >> 4);
>> > sb_rows = seq_header->use_128x128_superblock ? ((parser->state.mi_rows +
>> > 31) >> 5) : ((parser->state.mi_rows + 15) >> 4);
>> >
>> > Are we confident that V4L2_AV1_MAX_TILE_COLS is good enough size for
>> > width_in_sbs_minus_1?
>> > Or does it potentially need to be V4L2_AV1_MAX_TILE_COLS+1?
>> >
>> > I am asking to double check because I see V4L2_AV1_MAX_TILE_COLS+1
>> > used for corresponding field in libgav1.
>> > int tile_column_width_in_superblocks[kMaxTileColumns + 1];
>> >
>> > https://source.chromium.org/chromium/chromium/src/+/main:third_party/libgav1/src/src/utils/types.h;l=291
>> >
>> > Steve
>> >
>> > On Wed, May 11, 2022 at 1:59 PM Steve Cho <stevecho@chromium.org> wrote:
>> > >
>> > > Hi Daniel,
>> > >
>> > > I think the below definition is expected to cause a build error.
>> > >
>> > > +struct v4l2_av1_loop_restoration {
>> > > + u8 flags;
>> > >
>> > > s/u8/__u8/ is needed.
>> > >
>> > > At least, this change was needed to fix this build error on Chromium
>> > > build environment.
>> > >
>> > > Steve
>> > >
>> > > On Tue, May 10, 2022 at 9:30 AM Daniel Almeida
>> > > <daniel.almeida@collabora.com> wrote:
>> > > >
>> > > > Hi Steve,
>> > > >
>> > > > > Hi Daniel,
>> > > > >
>> > > > > Found a minor typo.
>> > > > >
>> > > > >> See enum_v4l2_av1_frame_restoration_type.
>> > > > > Assume you meant v4l2_av1_frame_restoration_type instead here.
>> > > >
>> > > >
>> > > > Thanks for the heads up, this will be fixed in v3.
>> > > >
>> > > > -- Daniel
>> > > >
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC PATCH v2] media: Add AV1 uAPI
[not found] ` <CAC-pXoMVKmAZ=9iM7ivuo8rvnL=KQWHnopWharDz-eDky0QS-g@mail.gmail.com>
@ 2022-05-31 16:42 ` Daniel Almeida
[not found] ` <CAC-pXoPvkwowiBsrEo4w2kjE9geDEP=qPQ2ntkgAQxiwuc123w@mail.gmail.com>
0 siblings, 1 reply; 10+ messages in thread
From: Daniel Almeida @ 2022-05-31 16:42 UTC (permalink / raw)
To: Steve Cho; +Cc: hverkuil, linux-media, Nicolas Dufresne
Sending this again, as apparently my last submission contained some HTML
that prevented it from being sent on the media ML
---
Hi Steve,
> I think the below definition is expected to cause a build error.
>
> +struct v4l2_av1_loop_restoration {
> + u8 flags;
>
> s/u8/__u8/ is needed.
>
> At least, this change was needed to fix this build error on Chromium
> build environment.
This will be fixed in RFC v3
> Question about tile info structure.
>
> struct v4l2_av1_tile_info {
> __u8 flags;
> __u32 mi_col_starts[V4L2_AV1_MAX_TILE_COLS + 1];
> __u32 mi_row_starts[V4L2_AV1_MAX_TILE_ROWS + 1];
> __u32 width_in_sbs_minus_1[V4L2_AV1_MAX_TILE_COLS];
> __u32 height_in_sbs_minus_1[V4L2_AV1_MAX_TILE_ROWS];
>
> I see below from the spec and gstreamer implementation
> for width_in_sbs_minus_1 and height_in_sbs_minus_1 computation.
>
> sb_cols = seq_header->use_128x128_superblock ?
> ((parser->state.mi_cols + 31) >> 5) : ((parser->state.mi_cols +
15) >> 4);
> sb_rows = seq_header->use_128x128_superblock ?
((parser->state.mi_rows +
> 31) >> 5) : ((parser->state.mi_rows + 15) >> 4);
>
> Are we confident that V4L2_AV1_MAX_TILE_COLS is good enough size for
> width_in_sbs_minus_1?
> Or does it potentially need to be V4L2_AV1_MAX_TILE_COLS+1?
>
> I am asking to double check because I see V4L2_AV1_MAX_TILE_COLS+1
> used for corresponding field in libgav1.
> int tile_column_width_in_superblocks[kMaxTileColumns + 1];
I have checked with a few other APIs to be on the safe side.
In VA-API they use a trick to save space on the last element, therefore
these two arrays will only be 63 members wide.
In NVDEC, these two arrays are 64 members wide, which is the same as our
V4L2 stateless implementation.
In DXVA, these two arrays are also 64 members wide
While going through the spec alongside with the libgav1 source code, I
notice that the index used to index into the two arrays eventually gets
assigned to tile_info->tile_rows and tile_info->tile_cols, i.e.
https://source.chromium.org/chromium/chromium/src/+/main:third_party/libgav1/src/src/obu_parser.cc;l=1704;drc=242da5037807dde3daf097ba74f875db83b8b613
https://source.chromium.org/chromium/chromium/src/+/main:third_party/libgav1/src/src/obu_parser.cc;drc=242da5037807dde3daf097ba74f875db83b8b613;l=1729
But the spec says that these variables must be less than or equal to
MAX_TILE_ROWS (i.e. 64) and MAX_TILE_COLS (i.e. 64), respectively, i.e.:
> TileCols specifies the number of tiles across the frame. It is a
requirement of bitstream conformance that TileCols is less
> than or equal to MAX_TILE_COLS.
> TileRows specifies the number of tiles down the frame. It is a
requirement of bitstream conformance that TileRows is less
> than or equal to MAX_TILE_ROWS.
In which case only the first 64 members would be filled when actually
submitting to the accelerator, i.e.:
https://source.chromium.org/chromium/chromium/src/+/main:media/gpu/windows/d3d11_av1_accelerator.cc;drc=242da5037807dde3daf097ba74f875db83b8b613;l=316
Given what I said above, I feel confident with the current implementation.
> struct v4l2_ctrl_av1_frame_header {
> struct v4l2_av1_tile_info tile_info;
> struct v4l2_av1_quantization quantization;
> struct v4l2_av1_segmentation segmentation;
> struct v4l2_av1_loop_filter loop_filter;
> struct v4l2_av1_cdef cdef;
> struct v4l2_av1_loop_restoration loop_restoration;
> struct v4l2_av1_global_motion global_motion;
>
> We used "v4l2_ctrl_vp9_frame" for the similar purpose.
>
> I thought "_header" can be confusing in a sense that these are
> parameters setup from parsing av1 frame header,
> not necessarily "header" itself.
>
> How about making it "v4l2_ctrl_av1_frame" similar to vp9,
> or "v4l2_ctrl_av1_frame_params"?
Ok, expect this change on RFC v3.
> Don't we also need V4L2_PIX_FMT_AV1 in addition to V4L2_PIX_FMT_AV1_FRAME
> as we do with both VP8 and VP9? I see V4L2_PIX_FMT_AV1 is missing.
No, as the non "_FRAME" pixformats are used for the stateful interface.
> 1. "tab" seems to be used before "descr = ". […] for other cases.
> +++ b/drivers/media/v4l2-core/v4l2-ioctl.c
> @@ -1441,6 +1441,7 @@ static void v4l_fill_fmtdesc(struct
v4l2_fmtdesc *fmt)
> case V4L2_PIX_FMT_MT21C: descr = "Mediatek
> Compressed Format"; break;
> + case V4L2_PIX_FMT_AV1_FRAME: descr = "AV1 Frame"; break;
>
> 2. nit: s/the AOMedia/the AOMedia/
>
> This patch adds the AOMedia Video 1 (AV1) kernel uAPI.
>
> 3. nit: s/AV1 film_gram/AV1 film grain/ ?
> +++ b/include/media/v4l2-ctrls.h
>
> + * @p_av1_film_grain: Pointer to an AV1 film_grain.
Will be fixed in v3.
>
> #define V4L2_AV1_LOOP_FILTER_FLAG_DELTA_LF_PRESENT BIT(2)
>
> /**
> * struct v4l2_av1_loop_filter - AV1 Loop filter params as defined in
section
> * 6.8.10. "Loop filter semantics" of the AV1 specification.
> ......
>
> struct v4l2_av1_loop_filter {
> ......
> __u8 delta_lf_res;
> __u8 delta_lf_multi;
> };
>
> - I think we should mention "6.8.16. Loop filter delta parameters
semantics" in the comment too.
>
Ok
> - What was the reason "delta_lf_present" is defined with
V4L2_AV1_LOOP_FILTER_FLAG_DELTA_LF_PRESENT
> instead of being inside of "v4l2_av1_loop_filter"?
> In other words, why do we want to treat it differently from
delta_lf_res or delta_lf_multi?
> I am asking this question as this was confusing to me.
Usually we try to keep single-bit flags into a single "flags" field to
save space. It is not a rule, but tends to get applied most of the time
(by almost all codec APIs, not only V4L2 stateless)
I did fail to see that delta_lf_multi is only a single bit wide though,
so by RFC v3 I will possibly have a flag for it as well.
> AV1 uAPI is using BIT() macro, which is probably from a kernel
internal header <linux/bits.h>.
> Is this planned usage? We think we can't include it from userspace.
>
> Thank you Chen-Yu for sharing his thought on the issue.
Looking at the other codec APIs in V4L2 stateless, apparently the
default is to declare the flag using a literal. I will convert the flags
in AV1 to not use the BIT macro anymore.
> Question about update_ref_delta, update_mode_delta flags for loop
filter params in the spec.
>
> I don't see these flags in v4l2_av1_loop_filter struct.
>
> After looking at gstreamer implementation, I think arrays ref_deltas,
mode_deltas are only filled in when these flags are 1.
>
> Is this correct understanding?
> If not, can you explain the background why these flags are omitted?
Possibly forgotten. Will fix in RFC v3.
> I am not sure how to setup loop_restoration_size[0] in
v4l2_av1_loop_restoration struct,
> which seems to use RESTORATION_TILESIZE_MAX = 256 at least for
gstreamer implementation.
>
> Is this RESTORATION_TILESIZE_MAX something potentially needs to be
added in the API by any chance?
> I do see this from the AV1 spec.
I usually only #define constants if they're used in the actual uAPI code
somehow as opposed to in intermediary steps such as parsing. You can
still define the spec constants as needed in userspace code. In this
particular case, you can compute loop_restoration_size[0] by following
the spec implementation, i.e.:
LoopRestorationSize[ 0 ] = RESTORATION_TILESIZE_MAX >> (2 - lr_unit_shift);
Where you can #define RESTORATION_TILESIZE_MAX 256 in your own userspace
code without it having to be part of the uAPI. I don't believe that
drivers will ever use that constant, but those that do may #define it on
their own code.
> could you have the V4L2 CID stuff inserted consistently? In some
places they are inserted before stateless HEVC / after VP8_FRAME, while
in others they are after VP9_FRAME. I'd expect them all to be at the
very end of the stateless block, after VP9_FRAME,
>
I am adding this feedback from Chen-Yu ^ as a sign that the issue it
talks about will be fixed in RFC v3.
-- Daniel
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC PATCH v2] media: Add AV1 uAPI
[not found] ` <CAC-pXoPvkwowiBsrEo4w2kjE9geDEP=qPQ2ntkgAQxiwuc123w@mail.gmail.com>
@ 2022-06-07 17:43 ` Daniel Almeida
0 siblings, 0 replies; 10+ messages in thread
From: Daniel Almeida @ 2022-06-07 17:43 UTC (permalink / raw)
To: Steve Cho; +Cc: hverkuil, linux-media, Nicolas Dufresne
Hi Steve.
> > Question about update_ref_delta, update_mode_delta flags for loop
> filter params in the spec.
> >
> > I don't see these flags in v4l2_av1_loop_filter struct.
> >
> > After looking at gstreamer implementation, I think arrays ref_deltas,
> mode_deltas are only filled in when these flags are 1.
> >
> > Is this correct understanding?
> > If not, can you explain the background why these flags are omitted?
>
> Possibly forgotten. Will fix in RFC v3.
I looked into this issue again. Apparently the other codec APIs do not
convey these flags either. Let's wait until we get a second driver to
see whether they will be necessary.
-- Daniel
^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2022-06-07 18:03 UTC | newest]
Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-03-22 16:01 [RFC PATCH v2] media: Add AV1 uAPI daniel.almeida
2022-03-22 19:29 ` kernel test robot
2022-05-10 0:04 ` Steve Cho
2022-05-10 16:30 ` Daniel Almeida
2022-05-11 20:59 ` Steve Cho
2022-05-16 17:42 ` Steve Cho
2022-05-18 16:41 ` Steve Cho
[not found] ` <CAN0yncHrY6jfk6owTEue8PqGmxffU612UgccvPc9Y6XOz38LRA@mail.gmail.com>
2022-05-19 15:54 ` Steve Cho
[not found] ` <CAC-pXoNHRxqe6tzg3++TqYRZE-nocxiz-iPh5vPXC07iA_BaSw@mail.gmail.com>
[not found] ` <CAC-pXoNRoqT_Fse_3Z8cO-SDwtMTm3fzScpDWvi5sNVr1N1Dzg@mail.gmail.com>
[not found] ` <CAC-pXoOon18axGdT_+V38sdAWDh+t4jZetXqte7BCwO09YG+2w@mail.gmail.com>
[not found] ` <CAC-pXoMVKmAZ=9iM7ivuo8rvnL=KQWHnopWharDz-eDky0QS-g@mail.gmail.com>
2022-05-31 16:42 ` Daniel Almeida
[not found] ` <CAC-pXoPvkwowiBsrEo4w2kjE9geDEP=qPQ2ntkgAQxiwuc123w@mail.gmail.com>
2022-06-07 17:43 ` Daniel Almeida
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.