From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=DKIM_SIGNED,DKIM_VALID, DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE, SPF_PASS,URIBL_BLOCKED,USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id B7118C433DF for ; Tue, 30 Jun 2020 15:13:42 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 8778A20720 for ; Tue, 30 Jun 2020 15:13:42 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=xs4all.nl header.i=@xs4all.nl header.b="OOZu4ibD" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S2389293AbgF3PNl (ORCPT ); Tue, 30 Jun 2020 11:13:41 -0400 Received: from lb3-smtp-cloud7.xs4all.net ([194.109.24.31]:57079 "EHLO lb3-smtp-cloud7.xs4all.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1732495AbgF3PNk (ORCPT ); Tue, 30 Jun 2020 11:13:40 -0400 Received: from cust-b5b5937f ([IPv6:fc0c:c16d:66b8:757f:c639:739b:9d66:799d]) by smtp-cloud7.xs4all.net with ESMTPA id qHwzjrsIScVLFqHx2jf41t; Tue, 30 Jun 2020 17:13:37 +0200 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=xs4all.nl; s=s1; t=1593530017; bh=p9ZlDMf7joOlpkJNrJR8xvhVlpaUeJzTRbSA+7EbrwA=; h=Subject:To:From:Message-ID:Date:MIME-Version:Content-Type:From: Subject; b=OOZu4ibDiGHWYohLULSxl7snkOTeTxKE8QHbBhqbHLuJI9gsviOUGcum2mh3Ws0yx VvAZ7TbJ6CIuXCedrK1vqNyDKph340psXTuQ9NXYL40c3lZw4zE/ZSex2ZZD6wto6s 6A6Z5Ok1mNxde793ERwPEZX/RboU7OWPkflNJB7vwTaxWArdQ2YZ65WsdhBUG7r32T B1eSvtGvKi9p4G185OQ7Fq4J3hOs5R4hi7Q+UCAa0SbLmjQ8DHGGs67Q0Ed3WpJa18 ii78TvrJ9DEILlhksNo00dXhQUvuTmUDdulqQGW6j3yOucL2q8OsRdf3vRZXBW+v0j o0n/FZDfwlzjA== Subject: Re: [RFC PATCH v2 00/18] Support for Tegra video capture from external sensor To: Sowjanya Komatineni , thierry.reding@gmail.com, jonathanh@nvidia.com, frankc@nvidia.com, sakari.ailus@iki.fi, robh+dt@kernel.org, helen.koike@collabora.com Cc: digetx@gmail.com, sboyd@kernel.org, gregkh@linuxfoundation.org, linux-media@vger.kernel.org, devicetree@vger.kernel.org, linux-tegra@vger.kernel.org, linux-kernel@vger.kernel.org, linux-i2c@vger.kernel.org References: <1592358094-23459-1-git-send-email-skomatineni@nvidia.com> From: Hans Verkuil Message-ID: Date: Tue, 30 Jun 2020 17:13:33 +0200 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:68.0) Gecko/20100101 Thunderbird/68.9.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8 Content-Language: en-US Content-Transfer-Encoding: 7bit X-CMAE-Envelope: MS4wfIrIILr6mjajrX4qxQ5REZAOwj1tnDKOsyH6P04Jie5fZe4RIbCbP41MihSiP6CRzI67vjRvgg5Y+XnPm0jHNc441e7tOmozP/YnaGcI/HA3diFwEgPc LKY2hkzS1/fuVwNFFZQpM9xGNvBAzubF2EFXyG5SokH7RlYywD9bDOEvXxn/7DeD9eb0I8SPFkXHofpkwuvR0tAmk1OyJVZOIyQmw+OUl9iLG5ZFHGb8n1f4 t/YaqgmyINkhzYUDRPR9V0EOkeW5dpV6AaybzDnaTVahsDhkar5v5+mqC82D44bfub5/7Utrdyzbiju6EFHRUiAeBLbJFB7iW7+0uKzS4ruG4ZNK6VbMil5X pDZeoYwAvn+O8n/k4SB80kAC9AV/nvhfGex/RzT0XPhprYYLPeYDINvoaNZK1L2P+lslUCDJ4dQi8ZDqmUE/OwiL6eQdtf5eNkXQfhsG8d2i1QZGO5EzdLZw wYrpEaWWZ3uDLfUyhIkfw9mTPbSvsFl4bFCGIcfs0B9LPorN1P9b61JFDEUbKJj8uYsCr3/iRfY5ZxDPoD3F5hczj2a8CKPR7LlolLjtoale2hcFBglQZbO2 jKD8VKt9waN96U2J186HczCWGNu4TvplCMxC1RonzS4NuGKWZS9SG3AzFKZk+k8EdA+n+W/l5bK1CXOQhoMBgaEw Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On 30/06/2020 16:58, Sowjanya Komatineni wrote: > > On 6/30/20 2:21 AM, Hans Verkuil wrote: >> On 17/06/2020 03:41, Sowjanya Komatineni wrote: >>> This series adds support for video capture from external camera sensor to >>> Tegra video driver. >>> >>> Jetson TX1 has camera expansion connector and supports custom camera module >>> designed as per TX1 design specification. >>> >>> This series also enables camera capture support for Jetson Nano which has >>> Raspberry PI camera header. >>> >>> This series is tested with IMX219 camera sensor. >> Which tree did you base this on? The media_tree master? Or the mainline kernel? > These patches are with linux-next base at the time I sent them out which > are on 20200616 >> >> I now have the imx219 detected, but if I try to stream I get this: >> >> $ v4l2-ctl --stream-mmap >> <[ 512.840944] video4linux video0: MW_ACK_DONE syncpt timeout: -11 >> [ 512.972975] video4linux video0: frame start syncpt timeout: -11 >> > [ 513.180770] video4linux video0: MW_ACK_DONE syncpt timeout: -11 >> >> And then everything hangs and I need to reset. >> >> I'm testing with the media_tree master with your patches on top. >> >> Regards, >> >> Hans > > Are you using same device tree as I sent offline? It uses CSI A for IMX219. > > Does you setup also uses CSI-A as x2 for IMX219? > > I tested them on Jetson Nano + IMX219 rasp PI module and also on Jetson > TX1 + IMX274. > > I did not see any issue and am able to capture from both. > > Will try again on my side with today's latest linux-next and update result. Please use the media_tree master, that's what I use as well. I did some more testing and there is something weird going on. I have a Leopard Imaging camera expansion board (LI-JTX1-MIPI-ADPT) with three camera connectors. See here for the datasheet: https://www.leopardimaging.com/uploads/LI-TX1-KIT-IMX274M12-T_datasheet.pdf The first connector (with an IMX274) causes this error: $ v4l2-ctl -d1 --stream-mmap [ 599.265885] video4linux video1: MW_ACK_DONE syncpt timeout: -11 [ 599.473883] video4linux video1: MW_ACK_DONE syncpt timeout: -11 [ 599.681904] video4linux video1: frame start syncpt timeout: -11 [ 599.681909] video4linux video1: MW_ACK_DONE syncpt timeout: -11 >> >>> This series include, >>> >>> VI I2C related fixes >>> - Camera sensor programming happens through VI I2C which is on host1x bus. >>> - These patches includes device tree and I2C driver fixes for VI I2C. >>> >>> Tegra video driver updates >>> - TPG Vs Non-TPG based on Kconfig >>> - Support for external sensor video capture based on device graph from DT. >>> - Support for selection ioctl operations >>> - Tegra MIPI CSI pads calibration >>> - CSI T-CLK and T-HS settle time computation based on clock rates. >>> >>> Host1x driver updates >>> - Adds API to allow creating mipi device for specific device node. >>> - Splits MIPI pads calibrate start and waiting for calibration to be done. >>> >>> Device tree updates >>> - Adds camera connector 2V8, 1V8, 1V2 regulator supplies to Jetson TX1 DT. >>> - Enabled VI and CSI support in Jetson Nano DT. >>> >>> >>> Delta between patch versions: >>> >>> [v2]: Includes below changes based on v1 feedback >>> - dt-binding document and the driver update for device graph to use >>> separate ports for sink endpoint and source endpoint for csi. >>> - Use data-lanes endpoint property for csi. >>> - Update tegra_mipi_request() to take device node pointer argument >>> rather than adding extra API. >>> - Remove checking for clk pointer before clk_disable. >>> >>> >>> Sowjanya Komatineni (18): >>> dt-bindings: i2c: tegra: Document Tegra210 VI I2C clocks and >>> power-domains >>> arm64: tegra: Add missing clocks and power-domains to Tegra210 VI I2C >>> i2c: tegra: Don't mark VI I2C as IRQ safe runtime PM >>> i2c: tegra: Fix the error path in tegra_i2c_runtime_resume >>> i2c: tegra: Fix runtime resume to re-init VI I2C >>> i2c: tegra: Avoid tegra_i2c_init_dma() for Tegra210 vi i2c >>> media: tegra-video: Fix channel format alignment >>> media: tegra-video: Enable TPG based on kernel config >>> media: tegra-video: Update format lookup to offset based >>> dt-bindings: tegra: Update VI and CSI bindings with port info >>> media: tegra-video: Add support for external sensor capture >>> media: tegra-video: Add support for selection ioctl ops >>> gpu: host1x: mipi: Update tegra_mipi_request() to be node based >>> gpu: host1x: mipi: Split tegra_mipi_calibrate and tegra_mipi_wait >>> media: tegra-video: Add CSI MIPI pads calibration >>> media: tegra-video: Compute settle times based on the clock rate >>> arm64: tegra: jetson-tx1: Add camera supplies >>> arm64: tegra: Enable Tegra VI CSI support for Jetson Nano >>> >>> .../display/tegra/nvidia,tegra20-host1x.txt | 92 ++- >>> .../devicetree/bindings/i2c/nvidia,tegra20-i2c.txt | 19 +- >>> arch/arm64/boot/dts/nvidia/tegra210-p2597.dtsi | 41 ++ >>> arch/arm64/boot/dts/nvidia/tegra210-p3450-0000.dts | 10 + >>> arch/arm64/boot/dts/nvidia/tegra210.dtsi | 6 + >>> drivers/gpu/drm/tegra/dsi.c | 9 +- >>> drivers/gpu/host1x/mipi.c | 30 +- >>> drivers/i2c/busses/i2c-tegra.c | 39 +- >>> drivers/staging/media/tegra-video/Kconfig | 7 + >>> drivers/staging/media/tegra-video/csi.c | 245 ++++++- >>> drivers/staging/media/tegra-video/csi.h | 8 + >>> drivers/staging/media/tegra-video/tegra210.c | 25 +- >>> drivers/staging/media/tegra-video/vi.c | 770 +++++++++++++++++++-- >>> drivers/staging/media/tegra-video/vi.h | 23 +- >>> drivers/staging/media/tegra-video/video.c | 23 +- >>> include/linux/host1x.h | 4 +- >>> 16 files changed, 1251 insertions(+), 100 deletions(-) >>>