linux-media.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Maarten Vanraes <maarten@rmail.be>
To: Raspberry Pi Kernel Maintenance <kernel-list@raspberrypi.com>,
	linux-media@vger.kernel.org
Cc: Kieran Bingham <kbingham@kernel.org>,
	Laurent Pinchart <laurent.pinchart@ideasonboard.com>,
	Umang Jain <umang.jain@ideasonboard.com>,
	Maarten Vanraes <maarten@rmail.be>
Subject: [RFC PATCH 00/13] bcm2835-codec: driver for HW codecs
Date: Sun,  3 Mar 2024 16:09:55 +0100	[thread overview]
Message-ID: <20240303152635.2762696-1-maarten@rmail.be> (raw)

These patches add a bcm2835-codec driver in order to use the hw codecs.
This makes eg playing a h264 1080p movie playable with some cpu cycles
to spare, instead of dropping frames and 100% cpu usage.

I tested with ffmpeg encode and decode, and I'm using it on my RPI4
mediabox.

I cherry-picked some patches from the rpi kernel and put these on top of
Umang's git tree (to have bcm2835-isp driver) and then rebased the whole
thing to media_stage and then squashed it a bit to these 13 patches.

The reason I put this on top of Umang's patches for bcm2835-isp is
because of common dependencies.

I know that this will not be accepted until the vchiq is unstaged, but
I'd like some comments on these patches in order to have this accepted
faster after vchiq is unstaged.

Umang's git tree I based it on: https://git.uk.ideasonboard.com/uajain/linux/src/branch/uajain/rpi4/staging-next/isp

I pushed my work on github if anyone wishes to try it out: https://github.com/alien999999999/linux/tree/rpi4-codec/media_stage/v1

Thanks in advance for any comment,

Maarten Vanraes (AL13N on #linux-media )


Dave Stevenson (11):
  staging: mmal-vchiq: Avoid use of bool in structures
  staging: mmal-vchiq: Update mmal_parameters.h with recently defined
    params
  staging: mmal-vchiq: Fix memory leak in error path
  media: videodev2.h: Add a format for column YUV4:2:0 modes
  staging/vchiq-mmal: Add buffer flags for interlaced video
  staging/vchiq-mmal: Add parameters for interlaced video support
  staging/vchiq-mmal: Add the deinterlace image effects enums
  staging/mmal-vchiq: Rationalise included headers
  staging: mmal-vchiq: Reset buffers_with_vpu on port_enable
  vc04_services: vchiq-mmal: Add defines for mmal_es_format flags
  staging: vc04_services: Add a V4L2 M2M codec driver

Phil Elwell (1):
  staging: vchiq_arm: Add 36-bit address support

detule (1):
  staging: vchiq_arm: Usa a DMA pool for small bulks

 .../media/v4l/pixfmt-nv12-col128.rst          |  215 +
 .../media/v4l/pixfmt-yuv-planar.rst           |   12 +
 .../userspace-api/media/v4l/yuv-formats.rst   |   19 +
 drivers/media/v4l2-core/v4l2-ioctl.c          |    2 +
 drivers/staging/vc04_services/Kconfig         |    2 +
 drivers/staging/vc04_services/Makefile        |    2 +
 .../vc04_services/bcm2835-codec/Kconfig       |   11 +
 .../vc04_services/bcm2835-codec/Makefile      |    5 +
 .../bcm2835-codec/bcm2835-v4l2-codec.c        | 3973 +++++++++++++++++
 .../interface/vchiq_arm/vchiq_arm.c           |  147 +-
 .../vchiq-mmal/mmal-msg-format.h              |   10 +
 .../vc04_services/vchiq-mmal/mmal-msg.h       |   19 +
 .../vchiq-mmal/mmal-parameters.h              |   86 +-
 .../vc04_services/vchiq-mmal/mmal-vchiq.c     |   40 +-
 include/uapi/linux/videodev2.h                |    4 +
 15 files changed, 4509 insertions(+), 38 deletions(-)
 create mode 100644 Documentation/userspace-api/media/v4l/pixfmt-nv12-col128.rst
 create mode 100644 drivers/staging/vc04_services/bcm2835-codec/Kconfig
 create mode 100644 drivers/staging/vc04_services/bcm2835-codec/Makefile
 create mode 100644 drivers/staging/vc04_services/bcm2835-codec/bcm2835-v4l2-codec.c

-- 
2.41.0


             reply	other threads:[~2024-03-03 15:27 UTC|newest]

Thread overview: 33+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2024-03-03 15:09 Maarten Vanraes [this message]
2024-03-03 15:09 ` [RFC PATCH 01/13] staging: mmal-vchiq: Avoid use of bool in structures Maarten Vanraes
2024-03-04  7:30   ` Andrzej Pietrasiewicz
2024-03-05 18:00     ` Maarten
2024-03-03 15:09 ` [RFC PATCH 02/13] staging: mmal-vchiq: Update mmal_parameters.h with recently defined params Maarten Vanraes
2024-03-03 15:09 ` [RFC PATCH 03/13] staging: mmal-vchiq: Fix memory leak in error path Maarten Vanraes
2024-03-04  7:38   ` Andrzej Pietrasiewicz
2024-03-05 18:02     ` Maarten
2024-03-03 15:09 ` [RFC PATCH 04/13] media: videodev2.h: Add a format for column YUV4:2:0 modes Maarten Vanraes
2024-03-04 18:10   ` Nicolas Dufresne
2024-03-05 18:14     ` Maarten
2024-03-06 20:46       ` Nicolas Dufresne
2024-03-05 18:53     ` Dave Stevenson
2024-03-05 19:43       ` Maarten
2024-03-10 12:42       ` Maarten
2024-03-10 12:54   ` Maarten
2024-03-03 15:10 ` [RFC PATCH 05/13] staging: vchiq_arm: Add 36-bit address support Maarten Vanraes
2024-03-07 10:19   ` Krzysztof Kozlowski
2024-03-07 10:23     ` Maarten
2024-03-03 15:10 ` [RFC PATCH 06/13] staging: vchiq_arm: Usa a DMA pool for small bulks Maarten Vanraes
2024-03-03 15:10 ` [RFC PATCH 07/13] staging/vchiq-mmal: Add buffer flags for interlaced video Maarten Vanraes
2024-03-03 15:10 ` [RFC PATCH 08/13] staging/vchiq-mmal: Add parameters for interlaced video support Maarten Vanraes
2024-03-03 15:10 ` [RFC PATCH 09/13] staging/vchiq-mmal: Add the deinterlace image effects enums Maarten Vanraes
2024-03-03 15:10 ` [RFC PATCH 10/13] staging/mmal-vchiq: Rationalise included headers Maarten Vanraes
2024-03-03 15:10 ` [RFC PATCH 11/13] staging: mmal-vchiq: Reset buffers_with_vpu on port_enable Maarten Vanraes
2024-03-03 15:10 ` [RFC PATCH 12/13] vc04_services: vchiq-mmal: Add defines for mmal_es_format flags Maarten Vanraes
2024-03-03 15:10 ` [RFC PATCH 13/13] staging: vc04_services: Add a V4L2 M2M codec driver Maarten Vanraes
2024-03-04 17:58   ` Nicolas Dufresne
2024-03-05 19:35     ` Maarten
2024-03-06 21:14       ` Nicolas Dufresne
2024-03-24 12:35         ` Maarten
2024-04-01  9:45           ` Maarten
2024-04-01  9:56   ` Maarten

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20240303152635.2762696-1-maarten@rmail.be \
    --to=maarten@rmail.be \
    --cc=kbingham@kernel.org \
    --cc=kernel-list@raspberrypi.com \
    --cc=laurent.pinchart@ideasonboard.com \
    --cc=linux-media@vger.kernel.org \
    --cc=umang.jain@ideasonboard.com \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).