dri-devel.lists.freedesktop.org archive mirror
 help / color / mirror / Atom feed
* [PATCH v5 0/9] drm: ci: fixes
@ 2023-10-19  7:06 Vignesh Raman
  2023-10-19  7:06 ` [PATCH v5 1/9] drm: ci: igt_runner: Remove todo Vignesh Raman
                   ` (8 more replies)
  0 siblings, 9 replies; 15+ messages in thread
From: Vignesh Raman @ 2023-10-19  7:06 UTC (permalink / raw)
  To: helen.koike, airlied, daniel
  Cc: daniels, emma, gustavo.padovan, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	david.heidelberg, linux-mediatek

The patch series contains improvements, enabling new ci jobs which
enables testing for Mediatek MT8173, Qualcomm APQ 8016 and VirtIO GPU,
fixing issues with the ci jobs and updating the expectation files.

This series depends on the below patches,
[PATCH 0/9] drm/ci: fixes and improvements
https://www.spinics.net/lists/kernel/msg4959629.html

v2:
  - Use fdtoverlay command to merge overlay dtbo with the base dtb instead of modifying the kernel sources
  - Reworded the commit message for enabling jobs
  - Added a new patch in the series to use scripts/config to enable/disable configs

v3:
  - New patch in the series to add device tree overlay in arch/arm64/boot/dts/qcom
  - drm-ci scripts to use device tree overlay from arch/arm64/boot/dts/qcom and compile base device tree with overlay support
  - New patch in the series to enable CONFIG_REGULATOR_DA9211 in defconfig
  - Remove CONFIG_RTC_DRV_MT6397=y as it is already enabled in defconfig

v4:
  - Drop 'enable CONFIG_REGULATOR_DA9211 in defconfig' patch as it is sent upstream as a seperate patch
  - Use apq8016-sbc-usb-host.dtb which allows the USB controllers to work in host mode.
    This patch depends on https://lore.kernel.org/lkml/20230911161518.650726-1-vignesh.raman@collabora.com/

v5:
  - Added a new patch in the series to set IGT_FORCE_DRIVER to 'mediatek' for mt8173
  - Added a new patch in the series to make artifacts available for virtio jobs
  - Added a new patch in the series to add pipeline url to fails and flakes files
  - Generate fails and flakes file with the updated xfails script - https://www.spinics.net/lists/kernel/msg4959630.html
  - Drop 'virtio: Update ci variables' patch as the tests which causes the malloc issue are skipped

Vignesh Raman (9):
  drm: ci: igt_runner: Remove todo
  drm: ci: Force db410c to host mode
  drm: ci: Enable regulator
  drm: ci: Enable new jobs
  drm: ci: Use scripts/config to enable/disable configs
  drm: ci: mediatek: Set IGT_FORCE_DRIVER for mt8173
  drm: ci: virtio: Make artifacts available
  drm: ci: Add pipeline url to fails and flakes files
  drm: ci: Update xfails

 drivers/gpu/drm/ci/arm64.config               |   1 +
 drivers/gpu/drm/ci/build.sh                   |  16 +-
 drivers/gpu/drm/ci/igt_runner.sh              |   5 +-
 drivers/gpu/drm/ci/test.yml                   |  13 +-
 .../drm/ci/xfails/mediatek-mt8173-fails.txt   |  24 +-
 .../drm/ci/xfails/mediatek-mt8173-flakes.txt  |   9 +
 .../gpu/drm/ci/xfails/msm-apq8016-fails.txt   |  17 +-
 drivers/gpu/drm/ci/xfails/update-xfails.py    |   6 +
 .../drm/ci/xfails/virtio_gpu-none-fails.txt   |  65 +-
 .../drm/ci/xfails/virtio_gpu-none-skips.txt   | 632 +++++++++++++++++-
 10 files changed, 704 insertions(+), 84 deletions(-)
 create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt

-- 
2.40.1


^ permalink raw reply	[flat|nested] 15+ messages in thread

* [PATCH v5 1/9] drm: ci: igt_runner: Remove todo
  2023-10-19  7:06 [PATCH v5 0/9] drm: ci: fixes Vignesh Raman
@ 2023-10-19  7:06 ` Vignesh Raman
  2023-10-19  7:06 ` [PATCH v5 2/9] drm: ci: Force db410c to host mode Vignesh Raman
                   ` (7 subsequent siblings)
  8 siblings, 0 replies; 15+ messages in thread
From: Vignesh Raman @ 2023-10-19  7:06 UTC (permalink / raw)
  To: helen.koike, airlied, daniel
  Cc: daniels, emma, gustavo.padovan, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	david.heidelberg, linux-mediatek

/sys/kernel/debug/dri/*/state exist for every atomic KMS driver.
We do not test non-atomic drivers, so remove the todo.

Acked-by: Helen Koike <helen.koike@collabora.com>
Signed-off-by: Vignesh Raman <vignesh.raman@collabora.com>
---

v2:
  - No changes

v3:
  - No changes

v4:
  - No changes

v5:
  - No changes
  
---
 drivers/gpu/drm/ci/igt_runner.sh | 1 -
 1 file changed, 1 deletion(-)

diff --git a/drivers/gpu/drm/ci/igt_runner.sh b/drivers/gpu/drm/ci/igt_runner.sh
index 2f815ee3a8a3..c6cf963592c5 100755
--- a/drivers/gpu/drm/ci/igt_runner.sh
+++ b/drivers/gpu/drm/ci/igt_runner.sh
@@ -15,7 +15,6 @@ cat /sys/kernel/debug/device_component/*
 '
 
 # Dump drm state to confirm that kernel was able to find a connected display:
-# TODO this path might not exist for all drivers.. maybe run modetest instead?
 set +e
 cat /sys/kernel/debug/dri/*/state
 set -e
-- 
2.40.1


^ permalink raw reply related	[flat|nested] 15+ messages in thread

* [PATCH v5 2/9] drm: ci: Force db410c to host mode
  2023-10-19  7:06 [PATCH v5 0/9] drm: ci: fixes Vignesh Raman
  2023-10-19  7:06 ` [PATCH v5 1/9] drm: ci: igt_runner: Remove todo Vignesh Raman
@ 2023-10-19  7:06 ` Vignesh Raman
  2023-10-19  7:06 ` [PATCH v5 3/9] drm: ci: Enable regulator Vignesh Raman
                   ` (6 subsequent siblings)
  8 siblings, 0 replies; 15+ messages in thread
From: Vignesh Raman @ 2023-10-19  7:06 UTC (permalink / raw)
  To: helen.koike, airlied, daniel
  Cc: daniels, emma, gustavo.padovan, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	david.heidelberg, linux-mediatek

Force db410c to host mode to fix network issue which results in failure
to mount root fs via NFS.
See https://gitlab.freedesktop.org/gfx-ci/linux/-/commit/cb72a629b8c15c80a54dda510743cefd1c4b65b8

Use apq8016-sbc-usb-host.dtb which allows the USB controllers
to work in host mode.

Acked-by: Helen Koike <helen.koike@collabora.com>
Signed-off-by: Vignesh Raman <vignesh.raman@collabora.com>
---

v2:
  - Use fdtoverlay command to merge overlay dtbo with the base dtb instead of modifying the kernel sources

v3:
  - drm-ci scripts to use device tree overlay from arch/arm64/boot/dts/qcom and compile base device tree with overlay support

v4:
  - Use apq8016-sbc-usb-host.dtb which allows the USB controllers to work in host mode.
    This patch depends on https://lore.kernel.org/lkml/20230911161518.650726-1-vignesh.raman@collabora.com/

v5:
  - No chaanges

---
 drivers/gpu/drm/ci/build.sh | 2 +-
 drivers/gpu/drm/ci/test.yml | 2 +-
 2 files changed, 2 insertions(+), 2 deletions(-)

diff --git a/drivers/gpu/drm/ci/build.sh b/drivers/gpu/drm/ci/build.sh
index 740b5008be2e..b1ea9b458922 100644
--- a/drivers/gpu/drm/ci/build.sh
+++ b/drivers/gpu/drm/ci/build.sh
@@ -19,7 +19,7 @@ if [[ "$KERNEL_ARCH" = "arm64" ]]; then
     DEVICE_TREES+=" arch/arm64/boot/dts/amlogic/meson-gxl-s805x-libretech-ac.dtb"
     DEVICE_TREES+=" arch/arm64/boot/dts/allwinner/sun50i-h6-pine-h64.dtb"
     DEVICE_TREES+=" arch/arm64/boot/dts/amlogic/meson-gxm-khadas-vim2.dtb"
-    DEVICE_TREES+=" arch/arm64/boot/dts/qcom/apq8016-sbc.dtb"
+    DEVICE_TREES+=" arch/arm64/boot/dts/qcom/apq8016-sbc-usb-host.dtb"
     DEVICE_TREES+=" arch/arm64/boot/dts/qcom/apq8096-db820c.dtb"
     DEVICE_TREES+=" arch/arm64/boot/dts/amlogic/meson-g12b-a311d-khadas-vim3.dtb"
     DEVICE_TREES+=" arch/arm64/boot/dts/mediatek/mt8173-elm-hana.dtb"
diff --git a/drivers/gpu/drm/ci/test.yml b/drivers/gpu/drm/ci/test.yml
index a94af2f99d75..9d58c0e3bbab 100644
--- a/drivers/gpu/drm/ci/test.yml
+++ b/drivers/gpu/drm/ci/test.yml
@@ -102,7 +102,7 @@ msm:apq8016:
   stage: msm
   variables:
     DRIVER_NAME: msm
-    BM_DTB: https://${PIPELINE_ARTIFACTS_BASE}/arm64/apq8016-sbc.dtb
+    BM_DTB: https://${PIPELINE_ARTIFACTS_BASE}/arm64/apq8016-sbc-usb-host.dtb
     GPU_VERSION: apq8016
     BM_CMDLINE: "ip=dhcp console=ttyMSM0,115200n8 $BM_KERNEL_EXTRA_ARGS root=/dev/nfs rw nfsrootdebug nfsroot=,tcp,nfsvers=4.2 init=/init $BM_KERNELARGS"
     RUNNER_TAG: google-freedreno-db410c
-- 
2.40.1


^ permalink raw reply related	[flat|nested] 15+ messages in thread

* [PATCH v5 3/9] drm: ci: Enable regulator
  2023-10-19  7:06 [PATCH v5 0/9] drm: ci: fixes Vignesh Raman
  2023-10-19  7:06 ` [PATCH v5 1/9] drm: ci: igt_runner: Remove todo Vignesh Raman
  2023-10-19  7:06 ` [PATCH v5 2/9] drm: ci: Force db410c to host mode Vignesh Raman
@ 2023-10-19  7:06 ` Vignesh Raman
  2023-10-19  7:06 ` [PATCH v5 4/9] drm: ci: Enable new jobs Vignesh Raman
                   ` (5 subsequent siblings)
  8 siblings, 0 replies; 15+ messages in thread
From: Vignesh Raman @ 2023-10-19  7:06 UTC (permalink / raw)
  To: helen.koike, airlied, daniel
  Cc: daniels, emma, gustavo.padovan, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	david.heidelberg, linux-mediatek

Enable CONFIG_REGULATOR_DA9211=y to fix mt8173 boot issue.

Acked-by: Helen Koike <helen.koike@collabora.com>
Signed-off-by: Vignesh Raman <vignesh.raman@collabora.com>
---

v2:
  - No changes

v3:
  - Remove CONFIG_RTC_DRV_MT6397=y as it is already enabled in defconfig

v4:
  - No changes

v5:
  - No changes

---
 drivers/gpu/drm/ci/arm64.config | 1 +
 1 file changed, 1 insertion(+)

diff --git a/drivers/gpu/drm/ci/arm64.config b/drivers/gpu/drm/ci/arm64.config
index b4f653417883..8dbce9919a57 100644
--- a/drivers/gpu/drm/ci/arm64.config
+++ b/drivers/gpu/drm/ci/arm64.config
@@ -186,6 +186,7 @@ CONFIG_HW_RANDOM_MTK=y
 CONFIG_MTK_DEVAPC=y
 CONFIG_PWM_MTK_DISP=y
 CONFIG_MTK_CMDQ=y
+CONFIG_REGULATOR_DA9211=y
 
 # For nouveau.  Note that DRM must be a module so that it's loaded after NFS is up to provide the firmware.
 CONFIG_ARCH_TEGRA=y
-- 
2.40.1


^ permalink raw reply related	[flat|nested] 15+ messages in thread

* [PATCH v5 4/9] drm: ci: Enable new jobs
  2023-10-19  7:06 [PATCH v5 0/9] drm: ci: fixes Vignesh Raman
                   ` (2 preceding siblings ...)
  2023-10-19  7:06 ` [PATCH v5 3/9] drm: ci: Enable regulator Vignesh Raman
@ 2023-10-19  7:06 ` Vignesh Raman
  2023-10-19  7:06 ` [PATCH v5 5/9] drm: ci: Use scripts/config to enable/disable configs Vignesh Raman
                   ` (4 subsequent siblings)
  8 siblings, 0 replies; 15+ messages in thread
From: Vignesh Raman @ 2023-10-19  7:06 UTC (permalink / raw)
  To: helen.koike, airlied, daniel
  Cc: daniels, emma, gustavo.padovan, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	david.heidelberg, linux-mediatek

Enable the following jobs, as the issues noted in the
TODO comments have been resolved. This will ensure that these jobs
are now included and executed as part of the CI/CD pipeline.

msm:apq8016:
TODO: current issue: it is not fiding the NFS root. Fix and remove this rule.

mediatek:mt8173:
TODO: current issue: device is hanging. Fix and remove this rule.

virtio_gpu:none:
TODO: current issue: malloc(): corrupted top size. Fix and remove this rule.

Acked-by: Helen Koike <helen.koike@collabora.com>
Signed-off-by: Vignesh Raman <vignesh.raman@collabora.com>
---

v2:
  - Reworded the commit message

v3:
  - No changes

v4:
  - No changes

v5:
  - No changes

---
 drivers/gpu/drm/ci/test.yml | 9 ---------
 1 file changed, 9 deletions(-)

diff --git a/drivers/gpu/drm/ci/test.yml b/drivers/gpu/drm/ci/test.yml
index 9d58c0e3bbab..763aef28010e 100644
--- a/drivers/gpu/drm/ci/test.yml
+++ b/drivers/gpu/drm/ci/test.yml
@@ -108,9 +108,6 @@ msm:apq8016:
     RUNNER_TAG: google-freedreno-db410c
   script:
     - ./install/bare-metal/fastboot.sh
-  rules:
-    # TODO: current issue: it is not fiding the NFS root. Fix and remove this rule.
-    - when: never
 
 msm:apq8096:
   extends:
@@ -274,9 +271,6 @@ mediatek:mt8173:
     DEVICE_TYPE: mt8173-elm-hana
     GPU_VERSION: mt8173
     RUNNER_TAG: mesa-ci-x86-64-lava-mt8173-elm-hana
-  rules:
-    # TODO: current issue: device is hanging. Fix and remove this rule.
-    - when: never
 
 mediatek:mt8183:
   extends:
@@ -331,6 +325,3 @@ virtio_gpu:none:
     - debian/x86_64_test-gl
     - testing:x86_64
     - igt:x86_64
-  rules:
-    # TODO: current issue: malloc(): corrupted top size. Fix and remove this rule.
-    - when: never
\ No newline at end of file
-- 
2.40.1


^ permalink raw reply related	[flat|nested] 15+ messages in thread

* [PATCH v5 5/9] drm: ci: Use scripts/config to enable/disable configs
  2023-10-19  7:06 [PATCH v5 0/9] drm: ci: fixes Vignesh Raman
                   ` (3 preceding siblings ...)
  2023-10-19  7:06 ` [PATCH v5 4/9] drm: ci: Enable new jobs Vignesh Raman
@ 2023-10-19  7:06 ` Vignesh Raman
  2023-10-19  7:06 ` [PATCH v5 6/9] drm: ci: mediatek: Set IGT_FORCE_DRIVER for mt8173 Vignesh Raman
                   ` (3 subsequent siblings)
  8 siblings, 0 replies; 15+ messages in thread
From: Vignesh Raman @ 2023-10-19  7:06 UTC (permalink / raw)
  To: helen.koike, airlied, daniel
  Cc: daniels, emma, gustavo.padovan, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	david.heidelberg, linux-mediatek

Instead of modifying files in git to enable/disable
configs, use scripts/config on the .config file which
will be used for building the kernel.

Suggested-by: Jani Nikula <jani.nikula@intel.com>
Acked-by: Helen Koike <helen.koike@collabora.com>
Signed-off-by: Vignesh Raman <vignesh.raman@collabora.com>
---

v2:
  - Added a new patch in the series to use scripts/config to enable/disable configs

v3:
  - No changes

v4:
  - No changes

v5:
  - No changes

---
 drivers/gpu/drm/ci/build.sh | 14 +++++++-------
 1 file changed, 7 insertions(+), 7 deletions(-)

diff --git a/drivers/gpu/drm/ci/build.sh b/drivers/gpu/drm/ci/build.sh
index b1ea9b458922..614111b7670b 100644
--- a/drivers/gpu/drm/ci/build.sh
+++ b/drivers/gpu/drm/ci/build.sh
@@ -70,19 +70,19 @@ if [ -z "$CI_MERGE_REQUEST_PROJECT_PATH" ]; then
     fi
 fi
 
-for opt in $ENABLE_KCONFIGS; do
-  echo CONFIG_$opt=y >> drivers/gpu/drm/ci/${KERNEL_ARCH}.config
-done
-for opt in $DISABLE_KCONFIGS; do
-  echo CONFIG_$opt=n >> drivers/gpu/drm/ci/${KERNEL_ARCH}.config
-done
-
 if [[ -n "${MERGE_FRAGMENT}" ]]; then
     ./scripts/kconfig/merge_config.sh ${DEFCONFIG} drivers/gpu/drm/ci/${MERGE_FRAGMENT}
 else
     make `basename ${DEFCONFIG}`
 fi
 
+for opt in $ENABLE_KCONFIGS; do
+    ./scripts/config --enable CONFIG_$opt
+done
+for opt in $DISABLE_KCONFIGS; do
+    ./scripts/config --disable CONFIG_$opt
+done
+
 make ${KERNEL_IMAGE_NAME}
 
 mkdir -p /lava-files/
-- 
2.40.1


^ permalink raw reply related	[flat|nested] 15+ messages in thread

* [PATCH v5 6/9] drm: ci: mediatek: Set IGT_FORCE_DRIVER for mt8173
  2023-10-19  7:06 [PATCH v5 0/9] drm: ci: fixes Vignesh Raman
                   ` (4 preceding siblings ...)
  2023-10-19  7:06 ` [PATCH v5 5/9] drm: ci: Use scripts/config to enable/disable configs Vignesh Raman
@ 2023-10-19  7:06 ` Vignesh Raman
  2023-10-19  7:06 ` [PATCH v5 7/9] drm: ci: virtio: Make artifacts available Vignesh Raman
                   ` (2 subsequent siblings)
  8 siblings, 0 replies; 15+ messages in thread
From: Vignesh Raman @ 2023-10-19  7:06 UTC (permalink / raw)
  To: helen.koike, airlied, daniel
  Cc: daniels, emma, gustavo.padovan, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	david.heidelberg, linux-mediatek

Expected driver for mt8173 is "mediatek" and for mt8183
it is "panfrost". Set IGT_FORCE_DRIVER to 'mediatek' as
the expected driver for mt8173.

Signed-off-by: Vignesh Raman <vignesh.raman@collabora.com>
---

v5:
  - Added a new patch in the series to set IGT_FORCE_DRIVER to 'mediatek' for mt8173.

---
 drivers/gpu/drm/ci/igt_runner.sh | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/drivers/gpu/drm/ci/igt_runner.sh b/drivers/gpu/drm/ci/igt_runner.sh
index c6cf963592c5..2b9f710438a2 100755
--- a/drivers/gpu/drm/ci/igt_runner.sh
+++ b/drivers/gpu/drm/ci/igt_runner.sh
@@ -30,6 +30,10 @@ case "$DRIVER_NAME" in
         ;;
 esac
 
+if [ "$CI_JOB_NAME" = "mediatek:mt8173" ]; then
+    export IGT_FORCE_DRIVER=${DRIVER_NAME}
+fi
+
 if [ -e "/install/xfails/$DRIVER_NAME-$GPU_VERSION-skips.txt" ]; then
     IGT_SKIPS="--skips /install/xfails/$DRIVER_NAME-$GPU_VERSION-skips.txt"
 fi
-- 
2.40.1


^ permalink raw reply related	[flat|nested] 15+ messages in thread

* [PATCH v5 7/9] drm: ci: virtio: Make artifacts available
  2023-10-19  7:06 [PATCH v5 0/9] drm: ci: fixes Vignesh Raman
                   ` (5 preceding siblings ...)
  2023-10-19  7:06 ` [PATCH v5 6/9] drm: ci: mediatek: Set IGT_FORCE_DRIVER for mt8173 Vignesh Raman
@ 2023-10-19  7:06 ` Vignesh Raman
  2023-10-19  7:06 ` [PATCH v5 8/9] drm: ci: Add pipeline url to fails and flakes files Vignesh Raman
  2023-10-19  7:06 ` [PATCH v5 9/9] drm: ci: Update xfails Vignesh Raman
  8 siblings, 0 replies; 15+ messages in thread
From: Vignesh Raman @ 2023-10-19  7:06 UTC (permalink / raw)
  To: helen.koike, airlied, daniel
  Cc: daniels, emma, gustavo.padovan, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	david.heidelberg, linux-mediatek

There were no artifacts available for virtio job.
So make the artifacts available in the pipeline job.

Signed-off-by: Vignesh Raman <vignesh.raman@collabora.com>
---

v5:
  - Added a new patch in the series to make artifacts available for virtio jobs

---
 drivers/gpu/drm/ci/test.yml | 2 ++
 1 file changed, 2 insertions(+)

diff --git a/drivers/gpu/drm/ci/test.yml b/drivers/gpu/drm/ci/test.yml
index 763aef28010e..39f5910fdc0a 100644
--- a/drivers/gpu/drm/ci/test.yml
+++ b/drivers/gpu/drm/ci/test.yml
@@ -320,6 +320,8 @@ virtio_gpu:none:
   script:
     - ln -sf $CI_PROJECT_DIR/install /install
     - mv install/bzImage /lava-files/bzImage
+    - mkdir -p $CI_PROJECT_DIR/results
+    - ln -sf $CI_PROJECT_DIR/results /results
     - install/crosvm-runner.sh install/igt_runner.sh
   needs:
     - debian/x86_64_test-gl
-- 
2.40.1


^ permalink raw reply related	[flat|nested] 15+ messages in thread

* [PATCH v5 8/9] drm: ci: Add pipeline url to fails and flakes files
  2023-10-19  7:06 [PATCH v5 0/9] drm: ci: fixes Vignesh Raman
                   ` (6 preceding siblings ...)
  2023-10-19  7:06 ` [PATCH v5 7/9] drm: ci: virtio: Make artifacts available Vignesh Raman
@ 2023-10-19  7:06 ` Vignesh Raman
  2023-10-19  7:06 ` [PATCH v5 9/9] drm: ci: Update xfails Vignesh Raman
  8 siblings, 0 replies; 15+ messages in thread
From: Vignesh Raman @ 2023-10-19  7:06 UTC (permalink / raw)
  To: helen.koike, airlied, daniel
  Cc: daniels, emma, gustavo.padovan, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	david.heidelberg, linux-mediatek

Add or update pipeline url in the fails and flakes files.
It helps to check the pipeline where the failure was seen
and check artifacts for failure cases.

Signed-off-by: Vignesh Raman <vignesh.raman@collabora.com>
---

v5:
  - Added a new patch in the series to add pipeline url to fails and flakes files.

---
 drivers/gpu/drm/ci/xfails/update-xfails.py | 6 ++++++
 1 file changed, 6 insertions(+)

diff --git a/drivers/gpu/drm/ci/xfails/update-xfails.py b/drivers/gpu/drm/ci/xfails/update-xfails.py
index c401004ffd45..651f804721f2 100755
--- a/drivers/gpu/drm/ci/xfails/update-xfails.py
+++ b/drivers/gpu/drm/ci/xfails/update-xfails.py
@@ -63,6 +63,10 @@ def remove_unit_test_if_present(lines, unit_test_name):
         return
     lines[:] = [line for line in lines if unit_test_name not in line]
 
+def add_pipeline_url(lines, pipelines_urls):
+    for url in pipelines_urls:
+        pipeline_url = "# " + url + "\n"
+        lines.insert(0, pipeline_url)
 
 def add_unit_test_if_not_present(lines, unit_test_name, file_name):
     # core_getversion is mandatory
@@ -185,9 +189,11 @@ def main(pipelines_urls, only_flakes):
         flakes_txt.sort()
 
         if fails_txt != fails_txt_original:
+            add_pipeline_url(fails_txt, pipelines_urls)
             save_file(fails_txt, fails_txt_path)
             print_diff(fails_txt_original, fails_txt, os.path.basename(fails_txt_path))
         if flakes_txt != flakes_txt_original:
+            add_pipeline_url(flakes_txt, pipelines_urls)
             save_file(flakes_txt, flakes_txt_path)
             print_diff(flakes_txt_original, flakes_txt, os.path.basename(flakes_txt_path))
 
-- 
2.40.1


^ permalink raw reply related	[flat|nested] 15+ messages in thread

* [PATCH v5 9/9] drm: ci: Update xfails
  2023-10-19  7:06 [PATCH v5 0/9] drm: ci: fixes Vignesh Raman
                   ` (7 preceding siblings ...)
  2023-10-19  7:06 ` [PATCH v5 8/9] drm: ci: Add pipeline url to fails and flakes files Vignesh Raman
@ 2023-10-19  7:06 ` Vignesh Raman
  2023-10-19  8:20   ` Maxime Ripard
                     ` (2 more replies)
  8 siblings, 3 replies; 15+ messages in thread
From: Vignesh Raman @ 2023-10-19  7:06 UTC (permalink / raw)
  To: helen.koike, airlied, daniel
  Cc: daniels, emma, gustavo.padovan, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	david.heidelberg, linux-mediatek

Update msm-apq8016-fails, mediatek-mt8173-fails and
virtio_gpu-none-fails to include the tests which fail.
Update mediatek-mt8173-flakes to include the tests which flakes.
Update virtio_gpu-none-skips to include the tests that need to be skipped.

Signed-off-by: Vignesh Raman <vignesh.raman@collabora.com>
---

v2:
  - No changes

v3:
  - No changes

v4:
  - No changes

v5:
  - Generate fails and flakes file with the updated xfails script - https://www.spinics.net/lists/kernel/msg4959630.html

---
 .../drm/ci/xfails/mediatek-mt8173-fails.txt   |  24 +-
 .../drm/ci/xfails/mediatek-mt8173-flakes.txt  |   9 +
 .../gpu/drm/ci/xfails/msm-apq8016-fails.txt   |  17 +-
 .../drm/ci/xfails/virtio_gpu-none-fails.txt   |  65 +-
 .../drm/ci/xfails/virtio_gpu-none-skips.txt   | 632 +++++++++++++++++-
 5 files changed, 682 insertions(+), 65 deletions(-)
 create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt

diff --git a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt
index 671916067dba..d2261a40db11 100644
--- a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt
+++ b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt
@@ -1,5 +1,7 @@
+# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013011
+# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012894
+# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012949
 kms_3d,Fail
-kms_addfb_basic@addfb25-bad-modifier,Fail
 kms_bw@linear-tiling-1-displays-1920x1080p,Fail
 kms_bw@linear-tiling-1-displays-2560x1440p,Fail
 kms_bw@linear-tiling-1-displays-3840x2160p,Fail
@@ -9,20 +11,22 @@ kms_bw@linear-tiling-2-displays-3840x2160p,Fail
 kms_bw@linear-tiling-3-displays-1920x1080p,Fail
 kms_bw@linear-tiling-3-displays-2560x1440p,Fail
 kms_bw@linear-tiling-3-displays-3840x2160p,Fail
-kms_color@pipe-A-invalid-gamma-lut-sizes,Fail
-kms_color@pipe-B-invalid-gamma-lut-sizes,Fail
-kms_force_connector_basic@force-connector-state,Fail
-kms_force_connector_basic@force-edid,Fail
-kms_force_connector_basic@force-load-detect,Fail
-kms_force_connector_basic@prune-stale-modes,Fail
+kms_color@invalid-gamma-lut-sizes,Fail
+kms_cursor_legacy@cursor-vs-flip-atomic,Fail
+kms_cursor_legacy@cursor-vs-flip-legacy,Fail
+kms_flip@flip-vs-modeset-vs-hang,Fail
+kms_flip@flip-vs-panning-vs-hang,Fail
+kms_flip@flip-vs-suspend,Fail
+kms_flip@flip-vs-suspend-interruptible,Fail
+kms_hdmi_inject@inject-4k,Fail
 kms_invalid_mode@int-max-clock,Fail
+kms_plane_scaling@planes-downscale-factor-0-25-upscale-20x20,Fail
+kms_plane_scaling@planes-downscale-factor-0-5-upscale-20x20,Fail
+kms_plane_scaling@planes-downscale-factor-0-75-upscale-20x20,Fail
 kms_plane_scaling@planes-upscale-20x20,Fail
 kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-25,Fail
 kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-5,Fail
 kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-75,Fail
-kms_plane_scaling@upscale-with-modifier-20x20,Fail
-kms_plane_scaling@upscale-with-pixel-format-20x20,Fail
-kms_plane_scaling@upscale-with-rotation-20x20,Fail
 kms_properties@get_properties-sanity-atomic,Fail
 kms_properties@plane-properties-atomic,Fail
 kms_properties@plane-properties-legacy,Fail
diff --git a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
new file mode 100644
index 000000000000..8b12e97d59f3
--- /dev/null
+++ b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
@@ -0,0 +1,9 @@
+# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013138
+# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012894
+# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013011
+# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013055
+kms_cursor_legacy@cursor-vs-flip-atomic-transitions
+kms_force_connector_basic@force-edid
+kms_force_connector_basic@prune-stale-modes
+kms_prop_blob@invalid-set-prop
+kms_prop_blob@invalid-set-prop-any
diff --git a/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt b/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt
index 9981682feab2..dcc49d560cef 100644
--- a/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt
+++ b/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt
@@ -1,15 +1,8 @@
+# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012932
+# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012894
 kms_3d,Fail
 kms_addfb_basic@addfb25-bad-modifier,Fail
-kms_cursor_legacy@all-pipes-forked-bo,Fail
-kms_cursor_legacy@all-pipes-forked-move,Fail
-kms_cursor_legacy@all-pipes-single-bo,Fail
-kms_cursor_legacy@all-pipes-single-move,Fail
-kms_cursor_legacy@all-pipes-torture-bo,Fail
-kms_cursor_legacy@all-pipes-torture-move,Fail
-kms_cursor_legacy@pipe-A-forked-bo,Fail
-kms_cursor_legacy@pipe-A-forked-move,Fail
-kms_cursor_legacy@pipe-A-single-bo,Fail
-kms_cursor_legacy@pipe-A-single-move,Fail
-kms_cursor_legacy@pipe-A-torture-bo,Fail
-kms_cursor_legacy@pipe-A-torture-move,Fail
+kms_cursor_legacy@forked-bo,Fail
+kms_cursor_legacy@forked-move,Fail
+kms_force_connector_basic@force-edid,Fail
 kms_hdmi_inject@inject-4k,Fail
diff --git a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt
index 9586b2339f6f..4281bc25303f 100644
--- a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt
+++ b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt
@@ -1,38 +1,27 @@
-kms_addfb_basic@addfb25-bad-modifier,Fail
-kms_addfb_basic@bad-pitch-65536,Fail
-kms_addfb_basic@bo-too-small,Fail
-kms_addfb_basic@size-max,Fail
-kms_addfb_basic@too-high,Fail
-kms_atomic_transition@plane-primary-toggle-with-vblank-wait,Fail
-kms_bw@linear-tiling-1-displays-1920x1080p,Fail
-kms_bw@linear-tiling-1-displays-2560x1440p,Fail
-kms_bw@linear-tiling-1-displays-3840x2160p,Fail
-kms_bw@linear-tiling-2-displays-1920x1080p,Fail
-kms_bw@linear-tiling-2-displays-2560x1440p,Fail
-kms_bw@linear-tiling-2-displays-3840x2160p,Fail
-kms_invalid_mode@int-max-clock,Fail
-kms_plane_scaling@downscale-with-modifier-factor-0-25,Fail
-kms_plane_scaling@downscale-with-rotation-factor-0-25,Fail
-kms_plane_scaling@planes-upscale-20x20,Fail
-kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-25,Fail
-kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-5,Fail
-kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-75,Fail
-kms_plane_scaling@upscale-with-modifier-20x20,Fail
-kms_plane_scaling@upscale-with-modifier-factor-0-25,Fail
-kms_plane_scaling@upscale-with-pixel-format-20x20,Fail
-kms_plane_scaling@upscale-with-pixel-format-factor-0-25,Fail
-kms_plane_scaling@upscale-with-rotation-20x20,Fail
-kms_vblank@crtc-id,Fail
-kms_vblank@invalid,Fail
-kms_vblank@pipe-A-accuracy-idle,Fail
-kms_vblank@pipe-A-query-busy,Fail
-kms_vblank@pipe-A-query-forked,Fail
-kms_vblank@pipe-A-query-forked-busy,Fail
-kms_vblank@pipe-A-query-idle,Fail
-kms_vblank@pipe-A-ts-continuation-idle,Fail
-kms_vblank@pipe-A-ts-continuation-modeset,Fail
-kms_vblank@pipe-A-ts-continuation-suspend,Fail
-kms_vblank@pipe-A-wait-busy,Fail
-kms_vblank@pipe-A-wait-forked,Fail
-kms_vblank@pipe-A-wait-forked-busy,Fail
-kms_vblank@pipe-A-wait-idle,Fail
+# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013138
+kms_flip@absolute-wf_vblank,Fail
+kms_flip@absolute-wf_vblank-interruptible,Fail
+kms_flip@basic-flip-vs-wf_vblank,Fail
+kms_flip@blocking-absolute-wf_vblank,Fail
+kms_flip@blocking-absolute-wf_vblank-interruptible,Fail
+kms_flip@blocking-wf_vblank,Fail
+kms_flip@busy-flip,Fail
+kms_flip@dpms-vs-vblank-race,Fail
+kms_flip@dpms-vs-vblank-race-interruptible,Fail
+kms_flip@flip-vs-absolute-wf_vblank,Fail
+kms_flip@flip-vs-absolute-wf_vblank-interruptible,Fail
+kms_flip@flip-vs-blocking-wf-vblank,Fail
+kms_flip@flip-vs-expired-vblank,Fail
+kms_flip@flip-vs-expired-vblank-interruptible,Fail
+kms_flip@flip-vs-modeset-vs-hang,Fail
+kms_flip@flip-vs-panning-vs-hang,Fail
+kms_flip@flip-vs-wf_vblank-interruptible,Fail
+kms_flip@modeset-vs-vblank-race,Fail
+kms_flip@modeset-vs-vblank-race-interruptible,Fail
+kms_flip@plain-flip-fb-recreate,Fail
+kms_flip@plain-flip-fb-recreate-interruptible,Fail
+kms_flip@plain-flip-ts-check,Fail
+kms_flip@plain-flip-ts-check-interruptible,Fail
+kms_flip@wf_vblank-ts-check,Fail
+kms_flip@wf_vblank-ts-check-interruptible,Fail
+kms_setmode@basic,Fail
diff --git a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt
index 78be18174012..e40bd2cac849 100644
--- a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt
+++ b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt
@@ -1,6 +1,628 @@
-# Hits a "refcount_t: underflow; use-after-free" in virtio_gpu_fence_event_process
-# When run in a particular order with other tests
-kms_cursor_legacy.*
-
 # Job just hangs without any output
-kms_flip@flip-vs-suspend.*
\ No newline at end of file
+kms_flip@flip-vs-suspend.*
+
+# Some tests crashes with malloc error and IGT tests floods
+# the CI log with error messages and we end up with a warning message
+# Job's log exceeded limit of 4194304 bytes.
+# Job execution will continue but no more output will be collected.
+# Below is the error log:
+# malloc(): corrupted top size
+# Received signal SIGABRT.
+# Stack trace:
+#  #0 [fatal_sig_handler+0x17b]
+#  #1 [__sigaction+0x40]
+#  #2 [pthread_key_delete+0x14c]
+#  #3 [gsignal+0x12]
+#  #4 [abort+0xd3]
+#  #5 [__fsetlocking+0x290]
+#  #6 [timer_settime+0x37a]
+#  #7 [__default_morecore+0x1f1b]
+#  #8 [__libc_calloc+0x161]
+#  #9 [drmModeGetPlaneResources+0x44]
+#  #10 [igt_display_require+0x194]
+#  #11 [__igt_unique____real_main1356+0x93c]
+#  #12 [main+0x3f]
+#  #13 [__libc_init_first+0x8a]
+#  #14 [__libc_start_main+0x85]
+#  #15 [_start+0x21]
+# malloc(): corrupted top size
+# So skip these tests until the issue is fixed.
+drm_read@empty-block
+drm_read@empty-nonblock
+drm_read@fault-buffer
+drm_read@invalid-buffer
+drm_read@short-buffer-block
+drm_read@short-buffer-nonblock
+drm_read@short-buffer-wakeup
+kms_addfb_basic@addfb25-4-tiled
+kms_addfb_basic@addfb25-bad-modifier
+kms_addfb_basic@addfb25-framebuffer-vs-set-tiling
+kms_addfb_basic@addfb25-modifier-no-flag
+kms_addfb_basic@addfb25-x-tiled-legacy
+kms_addfb_basic@addfb25-x-tiled-mismatch-legacy
+kms_addfb_basic@addfb25-y-tiled-legacy
+kms_addfb_basic@addfb25-y-tiled-small-legacy
+kms_addfb_basic@addfb25-yf-tiled-legacy
+kms_addfb_basic@bad-pitch-0
+kms_addfb_basic@bad-pitch-1024
+kms_addfb_basic@bad-pitch-128
+kms_addfb_basic@bad-pitch-256
+kms_addfb_basic@bad-pitch-32
+kms_addfb_basic@bad-pitch-63
+kms_addfb_basic@bad-pitch-65536
+kms_addfb_basic@bad-pitch-999
+kms_addfb_basic@basic
+kms_addfb_basic@basic-x-tiled-legacy
+kms_addfb_basic@basic-y-tiled-legacy
+kms_addfb_basic@bo-too-small
+kms_addfb_basic@bo-too-small-due-to-tiling
+kms_addfb_basic@clobberred-modifier
+kms_addfb_basic@framebuffer-vs-set-tiling
+kms_addfb_basic@invalid-get-prop
+kms_addfb_basic@invalid-get-prop-any
+kms_addfb_basic@invalid-set-prop
+kms_addfb_basic@invalid-set-prop-any
+kms_addfb_basic@invalid-smem-bo-on-discrete
+kms_addfb_basic@legacy-format
+kms_addfb_basic@master-rmfb
+kms_addfb_basic@no-handle
+kms_addfb_basic@size-max
+kms_addfb_basic@small-bo
+kms_addfb_basic@tile-pitch-mismatch
+kms_addfb_basic@too-high
+kms_addfb_basic@too-wide
+kms_addfb_basic@unused-handle
+kms_addfb_basic@unused-modifier
+kms_addfb_basic@unused-offsets
+kms_addfb_basic@unused-pitches
+kms_async_flips@alternate-sync-async-flip
+kms_async_flips@async-flip-with-page-flip-events
+kms_async_flips@crc
+kms_async_flips@invalid-async-flip
+kms_async_flips@test-cursor
+kms_async_flips@test-time-stamp
+kms_atomic@atomic-invalid-params
+kms_atomic@atomic_plane_damage
+kms_atomic@crtc-invalid-params
+kms_atomic@crtc-invalid-params-fence
+kms_atomic@plane-cursor-legacy
+kms_atomic@plane-immutable-zpos
+kms_atomic@plane-invalid-params
+kms_atomic@plane-invalid-params-fence
+kms_atomic@plane-overlay-legacy
+kms_atomic@plane-primary-legacy
+kms_atomic@plane-primary-overlay-mutable-zpos
+kms_atomic@test-only
+kms_atomic_interruptible@atomic-setmode
+kms_atomic_interruptible@legacy-cursor
+kms_atomic_interruptible@legacy-dpms
+kms_atomic_interruptible@legacy-pageflip
+kms_atomic_interruptible@legacy-setmode
+kms_atomic_interruptible@universal-setplane-cursor
+kms_atomic_interruptible@universal-setplane-primary
+kms_atomic_transition@modeset-transition
+kms_atomic_transition@modeset-transition-fencing
+kms_atomic_transition@modeset-transition-nonblocking
+kms_atomic_transition@modeset-transition-nonblocking-fencing
+kms_atomic_transition@plane-all-modeset-transition
+kms_atomic_transition@plane-all-modeset-transition-fencing
+kms_atomic_transition@plane-all-modeset-transition-fencing-internal-panels
+kms_atomic_transition@plane-all-modeset-transition-internal-panels
+kms_atomic_transition@plane-all-transition
+kms_atomic_transition@plane-all-transition-fencing
+kms_atomic_transition@plane-all-transition-nonblocking
+kms_atomic_transition@plane-all-transition-nonblocking-fencing
+kms_atomic_transition@plane-primary-toggle-with-vblank-wait
+kms_atomic_transition@plane-toggle-modeset-transition
+kms_atomic_transition@plane-use-after-nonblocking-unbind
+kms_atomic_transition@plane-use-after-nonblocking-unbind-fencing
+kms_bw@linear-tiling-1-displays-1920x1080p
+kms_bw@linear-tiling-1-displays-2560x1440p
+kms_bw@linear-tiling-1-displays-3840x2160p
+kms_bw@linear-tiling-2-displays-1920x1080p
+kms_bw@linear-tiling-2-displays-2560x1440p
+kms_bw@linear-tiling-2-displays-3840x2160p
+kms_bw@linear-tiling-3-displays-1920x1080p
+kms_bw@linear-tiling-3-displays-2560x1440p
+kms_bw@linear-tiling-3-displays-3840x2160p
+kms_bw@linear-tiling-4-displays-1920x1080p
+kms_bw@linear-tiling-4-displays-2560x1440p
+kms_bw@linear-tiling-4-displays-3840x2160p
+kms_bw@linear-tiling-5-displays-1920x1080p
+kms_bw@linear-tiling-5-displays-2560x1440p
+kms_bw@linear-tiling-5-displays-3840x2160p
+kms_bw@linear-tiling-6-displays-1920x1080p
+kms_bw@linear-tiling-6-displays-2560x1440p
+kms_bw@linear-tiling-6-displays-3840x2160p
+kms_bw@linear-tiling-7-displays-1920x1080p
+kms_bw@linear-tiling-7-displays-2560x1440p
+kms_bw@linear-tiling-7-displays-3840x2160p
+kms_bw@linear-tiling-8-displays-1920x1080p
+kms_bw@linear-tiling-8-displays-2560x1440p
+kms_bw@linear-tiling-8-displays-3840x2160p
+kms_color@ctm-0-25
+kms_color@ctm-0-50
+kms_color@ctm-0-75
+kms_color@ctm-blue-to-red
+kms_color@ctm-green-to-red
+kms_color@ctm-max
+kms_color@ctm-negative
+kms_color@ctm-red-to-blue
+kms_color@ctm-signed
+kms_color@deep-color
+kms_color@degamma
+kms_color@gamma
+kms_color@invalid-ctm-matrix-sizes
+kms_color@invalid-degamma-lut-sizes
+kms_color@invalid-gamma-lut-sizes
+kms_color@legacy-gamma
+kms_color@legacy-gamma-reset
+kms_concurrent@pipe-A
+kms_concurrent@pipe-B
+kms_concurrent@pipe-C
+kms_concurrent@pipe-D
+kms_concurrent@pipe-E
+kms_concurrent@pipe-F
+kms_concurrent@pipe-G
+kms_concurrent@pipe-H
+kms_content_protection@LIC
+kms_content_protection@atomic
+kms_content_protection@atomic-dpms
+kms_content_protection@content_type_change
+kms_content_protection@dp-mst-lic-type-0
+kms_content_protection@dp-mst-lic-type-1
+kms_content_protection@dp-mst-type-0
+kms_content_protection@dp-mst-type-1
+kms_content_protection@legacy
+kms_content_protection@mei_interface
+kms_content_protection@srm
+kms_content_protection@type1
+kms_content_protection@uevent
+kms_cursor_crc@cursor-alpha-opaque
+kms_cursor_crc@cursor-alpha-transparent
+kms_cursor_crc@cursor-dpms
+kms_cursor_crc@cursor-offscreen-128x128
+kms_cursor_crc@cursor-offscreen-128x42
+kms_cursor_crc@cursor-offscreen-256x256
+kms_cursor_crc@cursor-offscreen-256x85
+kms_cursor_crc@cursor-offscreen-32x10
+kms_cursor_crc@cursor-offscreen-32x32
+kms_cursor_crc@cursor-offscreen-512x170
+kms_cursor_crc@cursor-offscreen-512x512
+kms_cursor_crc@cursor-offscreen-64x21
+kms_cursor_crc@cursor-offscreen-64x64
+kms_cursor_crc@cursor-offscreen-max-size
+kms_cursor_crc@cursor-onscreen-128x128
+kms_cursor_crc@cursor-onscreen-128x42
+kms_cursor_crc@cursor-onscreen-256x256
+kms_cursor_crc@cursor-onscreen-256x85
+kms_cursor_crc@cursor-onscreen-32x10
+kms_cursor_crc@cursor-onscreen-32x32
+kms_cursor_crc@cursor-onscreen-512x170
+kms_cursor_crc@cursor-onscreen-512x512
+kms_cursor_crc@cursor-onscreen-64x21
+kms_cursor_crc@cursor-onscreen-64x64
+kms_cursor_crc@cursor-onscreen-max-size
+kms_cursor_crc@cursor-random-128x128
+kms_cursor_crc@cursor-random-128x42
+kms_cursor_crc@cursor-random-256x256
+kms_cursor_crc@cursor-random-256x85
+kms_cursor_crc@cursor-random-32x10
+kms_cursor_crc@cursor-random-32x32
+kms_cursor_crc@cursor-random-512x170
+kms_cursor_crc@cursor-random-512x512
+kms_cursor_crc@cursor-random-64x21
+kms_cursor_crc@cursor-random-64x64
+kms_cursor_crc@cursor-random-max-size
+kms_cursor_crc@cursor-rapid-movement-128x128
+kms_cursor_crc@cursor-rapid-movement-128x42
+kms_cursor_crc@cursor-rapid-movement-256x256
+kms_cursor_crc@cursor-rapid-movement-256x85
+kms_cursor_crc@cursor-rapid-movement-32x10
+kms_cursor_crc@cursor-rapid-movement-32x32
+kms_cursor_crc@cursor-rapid-movement-512x170
+kms_cursor_crc@cursor-rapid-movement-512x512
+kms_cursor_crc@cursor-rapid-movement-64x21
+kms_cursor_crc@cursor-rapid-movement-64x64
+kms_cursor_crc@cursor-rapid-movement-max-size
+kms_cursor_crc@cursor-size-change
+kms_cursor_crc@cursor-sliding-128x128
+kms_cursor_crc@cursor-sliding-128x42
+kms_cursor_crc@cursor-sliding-256x256
+kms_cursor_crc@cursor-sliding-256x85
+kms_cursor_crc@cursor-sliding-32x10
+kms_cursor_crc@cursor-sliding-32x32
+kms_cursor_crc@cursor-sliding-512x170
+kms_cursor_crc@cursor-sliding-512x512
+kms_cursor_crc@cursor-sliding-64x21
+kms_cursor_crc@cursor-sliding-64x64
+kms_cursor_crc@cursor-sliding-max-size
+kms_cursor_crc@cursor-suspend
+kms_cursor_legacy@2x-cursor-vs-flip-atomic
+kms_cursor_legacy@2x-cursor-vs-flip-legacy
+kms_cursor_legacy@2x-flip-vs-cursor-atomic
+kms_cursor_legacy@2x-flip-vs-cursor-legacy
+kms_cursor_legacy@2x-long-cursor-vs-flip-atomic
+kms_cursor_legacy@2x-long-cursor-vs-flip-legacy
+kms_cursor_legacy@2x-long-flip-vs-cursor-atomic
+kms_cursor_legacy@2x-long-flip-vs-cursor-legacy
+kms_cursor_legacy@2x-long-nonblocking-modeset-vs-cursor-atomic
+kms_cursor_legacy@2x-nonblocking-modeset-vs-cursor-atomic
+kms_cursor_legacy@basic-busy-flip-before-cursor-atomic
+kms_cursor_legacy@basic-busy-flip-before-cursor-legacy
+kms_cursor_legacy@basic-busy-flip-before-cursor-varying-size
+kms_cursor_legacy@basic-flip-after-cursor-atomic
+kms_cursor_legacy@basic-flip-after-cursor-legacy
+kms_cursor_legacy@basic-flip-after-cursor-varying-size
+kms_cursor_legacy@basic-flip-before-cursor-atomic
+kms_cursor_legacy@basic-flip-before-cursor-legacy
+kms_cursor_legacy@basic-flip-before-cursor-varying-size
+kms_cursor_legacy@cursor-vs-flip-atomic
+kms_cursor_legacy@cursor-vs-flip-atomic-transitions
+kms_cursor_legacy@cursor-vs-flip-atomic-transitions-varying-size
+kms_cursor_legacy@cursor-vs-flip-legacy
+kms_cursor_legacy@cursor-vs-flip-toggle
+kms_cursor_legacy@cursor-vs-flip-varying-size
+kms_cursor_legacy@cursorA-vs-flipA-atomic
+kms_cursor_legacy@cursorA-vs-flipA-atomic-transitions
+kms_cursor_legacy@cursorA-vs-flipA-atomic-transitions-varying-size
+kms_cursor_legacy@cursorA-vs-flipA-legacy
+kms_cursor_legacy@cursorA-vs-flipA-toggle
+kms_cursor_legacy@cursorA-vs-flipA-varying-size
+kms_cursor_legacy@cursorA-vs-flipB-atomic
+kms_cursor_legacy@cursorA-vs-flipB-atomic-transitions
+kms_cursor_legacy@cursorA-vs-flipB-atomic-transitions-varying-size
+kms_cursor_legacy@cursorA-vs-flipB-legacy
+kms_cursor_legacy@cursorA-vs-flipB-toggle
+kms_cursor_legacy@cursorA-vs-flipB-varying-size
+kms_cursor_legacy@cursorB-vs-flipA-atomic
+kms_cursor_legacy@cursorB-vs-flipA-atomic-transitions
+kms_cursor_legacy@cursorB-vs-flipA-atomic-transitions-varying-size
+kms_cursor_legacy@cursorB-vs-flipA-legacy
+kms_cursor_legacy@cursorB-vs-flipA-toggle
+kms_cursor_legacy@cursorB-vs-flipA-varying-size
+kms_cursor_legacy@cursorB-vs-flipB-atomic
+kms_cursor_legacy@cursorB-vs-flipB-atomic-transitions
+kms_cursor_legacy@cursorB-vs-flipB-atomic-transitions-varying-size
+kms_cursor_legacy@cursorB-vs-flipB-legacy
+kms_cursor_legacy@cursorB-vs-flipB-toggle
+kms_cursor_legacy@cursorB-vs-flipB-varying-size
+kms_cursor_legacy@flip-vs-cursor-atomic
+kms_cursor_legacy@flip-vs-cursor-atomic-transitions
+kms_cursor_legacy@flip-vs-cursor-atomic-transitions-varying-size
+kms_cursor_legacy@flip-vs-cursor-busy-crc-atomic
+kms_cursor_legacy@flip-vs-cursor-busy-crc-legacy
+kms_cursor_legacy@flip-vs-cursor-crc-atomic
+kms_cursor_legacy@flip-vs-cursor-crc-legacy
+kms_cursor_legacy@flip-vs-cursor-legacy
+kms_cursor_legacy@flip-vs-cursor-toggle
+kms_cursor_legacy@flip-vs-cursor-varying-size
+kms_cursor_legacy@forked-bo
+kms_cursor_legacy@forked-move
+kms_cursor_legacy@long-nonblocking-modeset-vs-cursor-atomic
+kms_cursor_legacy@nonblocking-modeset-vs-cursor-atomic
+kms_cursor_legacy@short-busy-flip-before-cursor-atomic-transitions
+kms_cursor_legacy@short-busy-flip-before-cursor-atomic-transitions-varying-size
+kms_cursor_legacy@short-busy-flip-before-cursor-toggle
+kms_cursor_legacy@short-flip-after-cursor-atomic-transitions
+kms_cursor_legacy@short-flip-after-cursor-atomic-transitions-varying-size
+kms_cursor_legacy@short-flip-after-cursor-toggle
+kms_cursor_legacy@short-flip-before-cursor-atomic-transitions
+kms_cursor_legacy@short-flip-before-cursor-atomic-transitions-varying-size
+kms_cursor_legacy@short-flip-before-cursor-toggle
+kms_cursor_legacy@single-bo
+kms_cursor_legacy@single-move
+kms_cursor_legacy@torture-bo
+kms_cursor_legacy@torture-move
+kms_dither@FB-8BPC-Vs-Panel-6BPC
+kms_dither@FB-8BPC-Vs-Panel-8BPC
+kms_flip_event_leak@basic
+kms_getfb@getfb-handle-not-fb
+kms_getfb@getfb2-handle-not-fb
+kms_hdr@bpc-switch
+kms_hdr@bpc-switch-dpms
+kms_hdr@bpc-switch-suspend
+kms_hdr@invalid-hdr
+kms_hdr@invalid-metadata-sizes
+kms_hdr@static-swap
+kms_hdr@static-toggle
+kms_hdr@static-toggle-dpms
+kms_hdr@static-toggle-suspend
+kms_invalid_mode@bad-hsync-end
+kms_invalid_mode@bad-hsync-start
+kms_invalid_mode@bad-htotal
+kms_invalid_mode@bad-vsync-end
+kms_invalid_mode@bad-vsync-start
+kms_invalid_mode@bad-vtotal
+kms_invalid_mode@clock-too-high
+kms_invalid_mode@int-max-clock
+kms_invalid_mode@uint-max-clock
+kms_invalid_mode@zero-clock
+kms_invalid_mode@zero-hdisplay
+kms_invalid_mode@zero-vdisplay
+kms_panel_fitting@atomic-fastset
+kms_panel_fitting@legacy
+kms_plane_cursor@overlay
+kms_plane_cursor@primary
+kms_plane_cursor@viewport
+kms_plane_scaling@2x-scaler-multi-pipe
+kms_plane_scaling@intel-max-src-size
+kms_plane_scaling@invalid-num-scalers
+kms_plane_scaling@invalid-parameters
+kms_plane_scaling@plane-downscale-with-modifiers-factor-0-25
+kms_plane_scaling@plane-downscale-with-modifiers-factor-0-5
+kms_plane_scaling@plane-downscale-with-modifiers-factor-0-75
+kms_plane_scaling@plane-downscale-with-pixel-format-factor-0-25
+kms_plane_scaling@plane-downscale-with-pixel-format-factor-0-5
+kms_plane_scaling@plane-downscale-with-pixel-format-factor-0-75
+kms_plane_scaling@plane-downscale-with-rotation-factor-0-25
+kms_plane_scaling@plane-downscale-with-rotation-factor-0-5
+kms_plane_scaling@plane-downscale-with-rotation-factor-0-75
+kms_plane_scaling@plane-scaler-with-clipping-clamping-modifiers
+kms_plane_scaling@plane-scaler-with-clipping-clamping-pixel-formats
+kms_plane_scaling@plane-scaler-with-clipping-clamping-rotation
+kms_plane_scaling@plane-scaler-with-modifiers-unity-scaling
+kms_plane_scaling@plane-scaler-with-pixel-format-unity-scaling
+kms_plane_scaling@plane-scaler-with-rotation-unity-scaling
+kms_plane_scaling@plane-upscale-with-modifiers-20x20
+kms_plane_scaling@plane-upscale-with-modifiers-factor-0-25
+kms_plane_scaling@plane-upscale-with-pixel-format-20x20
+kms_plane_scaling@plane-upscale-with-pixel-format-factor-0-25
+kms_plane_scaling@plane-upscale-with-rotation-20x20
+kms_plane_scaling@plane-upscale-with-rotation-factor-0-25
+kms_plane_scaling@planes-downscale-factor-0-25
+kms_plane_scaling@planes-downscale-factor-0-25-unity-scaling
+kms_plane_scaling@planes-downscale-factor-0-25-upscale-20x20
+kms_plane_scaling@planes-downscale-factor-0-25-upscale-factor-0-25
+kms_plane_scaling@planes-downscale-factor-0-5
+kms_plane_scaling@planes-downscale-factor-0-5-unity-scaling
+kms_plane_scaling@planes-downscale-factor-0-5-upscale-20x20
+kms_plane_scaling@planes-downscale-factor-0-5-upscale-factor-0-25
+kms_plane_scaling@planes-downscale-factor-0-75
+kms_plane_scaling@planes-downscale-factor-0-75-unity-scaling
+kms_plane_scaling@planes-downscale-factor-0-75-upscale-20x20
+kms_plane_scaling@planes-downscale-factor-0-75-upscale-factor-0-25
+kms_plane_scaling@planes-scaler-unity-scaling
+kms_plane_scaling@planes-unity-scaling-downscale-factor-0-25
+kms_plane_scaling@planes-unity-scaling-downscale-factor-0-5
+kms_plane_scaling@planes-unity-scaling-downscale-factor-0-75
+kms_plane_scaling@planes-upscale-20x20
+kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-25
+kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-5
+kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-75
+kms_plane_scaling@planes-upscale-factor-0-25
+kms_plane_scaling@planes-upscale-factor-0-25-downscale-factor-0-25
+kms_plane_scaling@planes-upscale-factor-0-25-downscale-factor-0-5
+kms_plane_scaling@planes-upscale-factor-0-25-downscale-factor-0-75
+kms_prime@D3hot
+kms_prime@basic-crc-hybrid
+kms_prime@basic-crc-vgem
+kms_prime@basic-modeset-hybrid
+kms_properties@connector-properties-atomic
+kms_properties@connector-properties-legacy
+kms_properties@crtc-properties-atomic
+kms_properties@crtc-properties-legacy
+kms_properties@get_properties-sanity-atomic
+kms_properties@get_properties-sanity-non-atomic
+kms_properties@invalid-properties-atomic
+kms_properties@invalid-properties-legacy
+kms_properties@plane-properties-atomic
+kms_properties@plane-properties-legacy
+kms_rmfb@close-fd
+kms_rmfb@rmfb-ioctl
+kms_scaling_modes@scaling-mode-center
+kms_scaling_modes@scaling-mode-full
+kms_scaling_modes@scaling-mode-full-aspect
+kms_scaling_modes@scaling-mode-none
+kms_tiled_display@basic-test-pattern
+kms_tiled_display@basic-test-pattern-with-chamelium
+kms_vblank@crtc-id
+kms_vblank@invalid
+kms_vblank@pipe-A-accuracy-idle
+kms_vblank@pipe-A-query-busy
+kms_vblank@pipe-A-query-busy-hang
+kms_vblank@pipe-A-query-forked
+kms_vblank@pipe-A-query-forked-busy
+kms_vblank@pipe-A-query-forked-busy-hang
+kms_vblank@pipe-A-query-forked-hang
+kms_vblank@pipe-A-query-idle
+kms_vblank@pipe-A-query-idle-hang
+kms_vblank@pipe-A-ts-continuation-dpms-rpm
+kms_vblank@pipe-A-ts-continuation-dpms-suspend
+kms_vblank@pipe-A-ts-continuation-idle
+kms_vblank@pipe-A-ts-continuation-idle-hang
+kms_vblank@pipe-A-ts-continuation-modeset
+kms_vblank@pipe-A-ts-continuation-modeset-hang
+kms_vblank@pipe-A-ts-continuation-modeset-rpm
+kms_vblank@pipe-A-ts-continuation-suspend
+kms_vblank@pipe-A-wait-busy
+kms_vblank@pipe-A-wait-busy-hang
+kms_vblank@pipe-A-wait-forked
+kms_vblank@pipe-A-wait-forked-busy
+kms_vblank@pipe-A-wait-forked-busy-hang
+kms_vblank@pipe-A-wait-forked-hang
+kms_vblank@pipe-A-wait-idle
+kms_vblank@pipe-A-wait-idle-hang
+kms_vblank@pipe-B-accuracy-idle
+kms_vblank@pipe-B-query-busy
+kms_vblank@pipe-B-query-busy-hang
+kms_vblank@pipe-B-query-forked
+kms_vblank@pipe-B-query-forked-busy
+kms_vblank@pipe-B-query-forked-busy-hang
+kms_vblank@pipe-B-query-forked-hang
+kms_vblank@pipe-B-query-idle
+kms_vblank@pipe-B-query-idle-hang
+kms_vblank@pipe-B-ts-continuation-dpms-rpm
+kms_vblank@pipe-B-ts-continuation-dpms-suspend
+kms_vblank@pipe-B-ts-continuation-idle
+kms_vblank@pipe-B-ts-continuation-idle-hang
+kms_vblank@pipe-B-ts-continuation-modeset
+kms_vblank@pipe-B-ts-continuation-modeset-hang
+kms_vblank@pipe-B-ts-continuation-modeset-rpm
+kms_vblank@pipe-B-ts-continuation-suspend
+kms_vblank@pipe-B-wait-busy
+kms_vblank@pipe-B-wait-busy-hang
+kms_vblank@pipe-B-wait-forked
+kms_vblank@pipe-B-wait-forked-busy
+kms_vblank@pipe-B-wait-forked-busy-hang
+kms_vblank@pipe-B-wait-forked-hang
+kms_vblank@pipe-B-wait-idle
+kms_vblank@pipe-B-wait-idle-hang
+kms_vblank@pipe-C-accuracy-idle
+kms_vblank@pipe-C-query-idle
+kms_vblank@pipe-C-query-busy
+kms_vblank@pipe-C-query-busy-hang
+kms_vblank@pipe-C-query-forked
+kms_vblank@pipe-C-query-forked-busy
+kms_vblank@pipe-C-query-forked-busy-hang
+kms_vblank@pipe-C-query-forked-hang
+kms_vblank@pipe-C-ts-continuation-dpms-rpm
+kms_vblank@pipe-C-ts-continuation-dpms-suspend
+kms_vblank@pipe-C-ts-continuation-idle
+kms_vblank@pipe-C-ts-continuation-idle-hang
+kms_vblank@pipe-C-ts-continuation-modeset
+kms_vblank@pipe-C-ts-continuation-modeset-hang
+kms_vblank@pipe-C-ts-continuation-modeset-rpm
+kms_vblank@pipe-C-ts-continuation-suspend
+kms_vblank@pipe-C-wait-busy
+kms_vblank@pipe-C-wait-busy-hang
+kms_vblank@pipe-C-wait-forked
+kms_vblank@pipe-C-wait-forked-busy
+kms_vblank@pipe-C-wait-forked-busy-hang
+kms_vblank@pipe-C-wait-forked-hang
+kms_vblank@pipe-C-wait-idle
+kms_vblank@pipe-C-wait-idle-hang
+kms_vblank@pipe-D-accuracy-idle
+kms_vblank@pipe-D-query-busy
+kms_vblank@pipe-D-query-busy-hang
+kms_vblank@pipe-D-query-forked
+kms_vblank@pipe-D-query-forked-busy
+kms_vblank@pipe-D-query-forked-busy-hang
+kms_vblank@pipe-D-query-forked-hang
+kms_vblank@pipe-D-query-idle
+kms_vblank@pipe-D-query-idle-hang
+kms_vblank@pipe-D-ts-continuation-dpms-rpm
+kms_vblank@pipe-D-ts-continuation-dpms-suspend
+kms_vblank@pipe-D-ts-continuation-idle
+kms_vblank@pipe-D-ts-continuation-idle-hang
+kms_vblank@pipe-D-ts-continuation-modeset
+kms_vblank@pipe-D-ts-continuation-modeset-hang
+kms_vblank@pipe-D-ts-continuation-modeset-rpm
+kms_vblank@pipe-D-ts-continuation-suspend
+kms_vblank@pipe-D-wait-busy
+kms_vblank@pipe-D-wait-busy-hang
+kms_vblank@pipe-D-wait-forked
+kms_vblank@pipe-D-wait-forked-busy
+kms_vblank@pipe-D-wait-forked-busy-hang
+kms_vblank@pipe-D-wait-forked-hang
+kms_vblank@pipe-D-wait-idle
+kms_vblank@pipe-D-wait-idle-hang
+kms_vblank@pipe-E-accuracy-idle
+kms_vblank@pipe-E-query-busy
+kms_vblank@pipe-E-query-busy-hang
+kms_vblank@pipe-E-query-forked
+kms_vblank@pipe-E-query-forked-busy
+kms_vblank@pipe-E-query-forked-busy-hang
+kms_vblank@pipe-E-query-forked-hang
+kms_vblank@pipe-E-query-idle
+kms_vblank@pipe-E-query-idle-hang
+kms_vblank@pipe-E-ts-continuation-dpms-rpm
+kms_vblank@pipe-E-ts-continuation-dpms-suspend
+kms_vblank@pipe-E-ts-continuation-idle
+kms_vblank@pipe-E-ts-continuation-idle-hang
+kms_vblank@pipe-E-ts-continuation-modeset
+kms_vblank@pipe-E-ts-continuation-modeset-hang
+kms_vblank@pipe-E-ts-continuation-modeset-rpm
+kms_vblank@pipe-E-ts-continuation-suspend
+kms_vblank@pipe-E-wait-busy
+kms_vblank@pipe-E-wait-busy-hang
+kms_vblank@pipe-E-wait-forked
+kms_vblank@pipe-E-wait-forked-busy
+kms_vblank@pipe-E-wait-forked-busy-hang
+kms_vblank@pipe-E-wait-forked-hang
+kms_vblank@pipe-E-wait-idle
+kms_vblank@pipe-E-wait-idle-hang
+kms_vblank@pipe-F-accuracy-idle
+kms_vblank@pipe-F-query-busy
+kms_vblank@pipe-F-query-busy-hang
+kms_vblank@pipe-F-query-forked
+kms_vblank@pipe-F-query-forked-busy
+kms_vblank@pipe-F-query-forked-busy-hang
+kms_vblank@pipe-F-query-forked-hang
+kms_vblank@pipe-F-query-idle
+kms_vblank@pipe-F-query-idle-hang
+kms_vblank@pipe-F-ts-continuation-dpms-rpm
+kms_vblank@pipe-F-ts-continuation-dpms-suspend
+kms_vblank@pipe-F-ts-continuation-idle
+kms_vblank@pipe-F-ts-continuation-idle-hang
+kms_vblank@pipe-F-ts-continuation-modeset
+kms_vblank@pipe-F-ts-continuation-modeset-hang
+kms_vblank@pipe-F-ts-continuation-modeset-rpm
+kms_vblank@pipe-F-ts-continuation-suspend
+kms_vblank@pipe-F-wait-busy
+kms_vblank@pipe-F-wait-busy-hang
+kms_vblank@pipe-F-wait-forked
+kms_vblank@pipe-F-wait-forked-busy
+kms_vblank@pipe-F-wait-forked-busy-hang
+kms_vblank@pipe-F-wait-forked-hang
+kms_vblank@pipe-F-wait-idle
+kms_vblank@pipe-F-wait-idle-hang
+kms_vblank@pipe-G-accuracy-idle
+kms_vblank@pipe-G-query-busy
+kms_vblank@pipe-G-query-busy-hang
+kms_vblank@pipe-G-query-forked
+kms_vblank@pipe-G-query-forked-busy
+kms_vblank@pipe-G-query-forked-busy-hang
+kms_vblank@pipe-G-query-forked-hang
+kms_vblank@pipe-G-query-idle
+kms_vblank@pipe-G-query-idle-hang
+kms_vblank@pipe-G-ts-continuation-dpms-rpm
+kms_vblank@pipe-G-ts-continuation-dpms-suspend
+kms_vblank@pipe-G-ts-continuation-idle
+kms_vblank@pipe-G-ts-continuation-idle-hang
+kms_vblank@pipe-G-ts-continuation-modeset
+kms_vblank@pipe-G-ts-continuation-modeset-hang
+kms_vblank@pipe-G-ts-continuation-modeset-rpm
+kms_vblank@pipe-G-ts-continuation-suspend
+kms_vblank@pipe-G-wait-busy
+kms_vblank@pipe-G-wait-busy-hang
+kms_vblank@pipe-G-wait-forked
+kms_vblank@pipe-G-wait-forked-busy
+kms_vblank@pipe-G-wait-forked-busy-hang
+kms_vblank@pipe-G-wait-forked-hang
+kms_vblank@pipe-G-wait-idle
+kms_vblank@pipe-G-wait-idle-hang
+kms_vblank@pipe-H-accuracy-idle
+kms_vblank@pipe-H-query-busy
+kms_vblank@pipe-H-query-busy-hang
+kms_vblank@pipe-H-query-forked
+kms_vblank@pipe-H-query-forked-busy
+kms_vblank@pipe-H-query-forked-busy-hang
+kms_vblank@pipe-H-query-forked-hang
+kms_vblank@pipe-H-query-idle
+kms_vblank@pipe-H-query-idle-hang
+kms_vblank@pipe-H-ts-continuation-dpms-rpm
+kms_vblank@pipe-H-ts-continuation-dpms-suspend
+kms_vblank@pipe-H-ts-continuation-idle
+kms_vblank@pipe-H-ts-continuation-idle-hang
+kms_vblank@pipe-H-ts-continuation-modeset
+kms_vblank@pipe-H-ts-continuation-modeset-hang
+kms_vblank@pipe-H-ts-continuation-modeset-rpm
+kms_vblank@pipe-H-ts-continuation-suspend
+kms_vblank@pipe-H-wait-busy
+kms_vblank@pipe-H-wait-busy-hang
+kms_vblank@pipe-H-wait-forked
+kms_vblank@pipe-H-wait-forked-busy
+kms_vblank@pipe-H-wait-forked-busy-hang
+kms_vblank@pipe-H-wait-forked-hang
+kms_vblank@pipe-H-wait-idle
+kms_vblank@pipe-H-wait-idle-hang
+kms_vrr@flip-basic
+kms_vrr@flip-dpms
+kms_vrr@flip-suspend
+kms_vrr@flipline
+kms_vrr@negative-basic
+kms_writeback@writeback-check-output
+kms_writeback@writeback-fb-id
+kms_writeback@writeback-invalid-parameters
+kms_writeback@writeback-pixel-formats
-- 
2.40.1


^ permalink raw reply related	[flat|nested] 15+ messages in thread

* Re: [PATCH v5 9/9] drm: ci: Update xfails
  2023-10-19  7:06 ` [PATCH v5 9/9] drm: ci: Update xfails Vignesh Raman
@ 2023-10-19  8:20   ` Maxime Ripard
  2023-10-19  8:25   ` Daniel Stone
  2023-10-19 16:42   ` Helen Koike
  2 siblings, 0 replies; 15+ messages in thread
From: Maxime Ripard @ 2023-10-19  8:20 UTC (permalink / raw)
  To: Vignesh Raman
  Cc: daniels, emma, gustavo.padovan, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, dri-devel, linux-kernel, david.heidelberg,
	helen.koike, linux-mediatek, virtualization

Hi,

On Thu, Oct 19, 2023 at 12:36:50PM +0530, Vignesh Raman wrote:
> diff --git a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
> new file mode 100644
> index 000000000000..8b12e97d59f3
> --- /dev/null
> +++ b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
> @@ -0,0 +1,9 @@
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013138
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012894
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013011
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013055
> +kms_cursor_legacy@cursor-vs-flip-atomic-transitions
> +kms_force_connector_basic@force-edid
> +kms_force_connector_basic@prune-stale-modes
> +kms_prop_blob@invalid-set-prop
> +kms_prop_blob@invalid-set-prop-any

We agreed recently to provide more context to flakes going forward, see:
https://lore.kernel.org/dri-devel/ax6tspeffujmk2vpvh6rwclqkkavpezvcubra25vs2ev7f5njs@2rpnycg2rgnj/

I'll send a doc update to make that formal (and discuss it at XDC if needed)

Maxime


^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [PATCH v5 9/9] drm: ci: Update xfails
  2023-10-19  7:06 ` [PATCH v5 9/9] drm: ci: Update xfails Vignesh Raman
  2023-10-19  8:20   ` Maxime Ripard
@ 2023-10-19  8:25   ` Daniel Stone
  2023-11-24  7:46     ` Vignesh Raman
  2023-10-19 16:42   ` Helen Koike
  2 siblings, 1 reply; 15+ messages in thread
From: Daniel Stone @ 2023-10-19  8:25 UTC (permalink / raw)
  To: Vignesh Raman
  Cc: daniels, emma, david.heidelberg, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	gustavo.padovan, helen.koike, linux-mediatek

Hi Vignesh,

On Thu, 19 Oct 2023 at 09:07, Vignesh Raman <vignesh.raman@collabora.com> wrote:
> +# Some tests crashes with malloc error and IGT tests floods
> +# the CI log with error messages and we end up with a warning message
> +# Job's log exceeded limit of 4194304 bytes.
> +# Job execution will continue but no more output will be collected.

This is just from GitLab warning that we have a huge log, so not
related to the actual fails here.

> +# Below is the error log:
> +# malloc(): corrupted top size
> +# Received signal SIGABRT.
> +# Stack trace:
> +#  #0 [fatal_sig_handler+0x17b]
> +#  #1 [__sigaction+0x40]
> +#  #2 [pthread_key_delete+0x14c]
> +#  #3 [gsignal+0x12]
> +#  #4 [abort+0xd3]
> +#  #5 [__fsetlocking+0x290]
> +#  #6 [timer_settime+0x37a]
> +#  #7 [__default_morecore+0x1f1b]
> +#  #8 [__libc_calloc+0x161]
> +#  #9 [drmModeGetPlaneResources+0x44]
> +#  #10 [igt_display_require+0x194]
> +#  #11 [__igt_unique____real_main1356+0x93c]
> +#  #12 [main+0x3f]
> +#  #13 [__libc_init_first+0x8a]
> +#  #14 [__libc_start_main+0x85]
> +#  #15 [_start+0x21]
> +# malloc(): corrupted top size

By the time we get this error, it indicates that there was previously
memory corruption, but it is only being noticed at a later point. The
skip lists here are way too big - stuff like drm_read is common
testing not affected by virtio at all - so we really need to isolate
the test which is actually breaking things.

The way to do this would be to use valgrind to detect where the memory
corruption is. VirtIO can be run locally so this is something you can
do on your machine.

Cheers,
Daniel

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [PATCH v5 9/9] drm: ci: Update xfails
  2023-10-19  7:06 ` [PATCH v5 9/9] drm: ci: Update xfails Vignesh Raman
  2023-10-19  8:20   ` Maxime Ripard
  2023-10-19  8:25   ` Daniel Stone
@ 2023-10-19 16:42   ` Helen Koike
  2023-10-19 16:45     ` Helen Koike
  2 siblings, 1 reply; 15+ messages in thread
From: Helen Koike @ 2023-10-19 16:42 UTC (permalink / raw)
  To: Vignesh Raman, airlied, daniel
  Cc: daniels, emma, gustavo.padovan, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	david.heidelberg, linux-mediatek



On 19/10/2023 04:06, Vignesh Raman wrote:
> Update msm-apq8016-fails, mediatek-mt8173-fails and
> virtio_gpu-none-fails to include the tests which fail.
> Update mediatek-mt8173-flakes to include the tests which flakes.
> Update virtio_gpu-none-skips to include the tests that need to be skipped.
> 
> Signed-off-by: Vignesh Raman <vignesh.raman@collabora.com>
> ---
> 
> v2:
>    - No changes
> 
> v3:
>    - No changes
> 
> v4:
>    - No changes
> 
> v5:
>    - Generate fails and flakes file with the updated xfails script - https://www.spinics.net/lists/kernel/msg4959630.html
> 
> ---
>   .../drm/ci/xfails/mediatek-mt8173-fails.txt   |  24 +-
>   .../drm/ci/xfails/mediatek-mt8173-flakes.txt  |   9 +
>   .../gpu/drm/ci/xfails/msm-apq8016-fails.txt   |  17 +-
>   .../drm/ci/xfails/virtio_gpu-none-fails.txt   |  65 +-
>   .../drm/ci/xfails/virtio_gpu-none-skips.txt   | 632 +++++++++++++++++-
>   5 files changed, 682 insertions(+), 65 deletions(-)
>   create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
> 
> diff --git a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt
> index 671916067dba..d2261a40db11 100644
> --- a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt
> +++ b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt
> @@ -1,5 +1,7 @@
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013011
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012894
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012949
>   kms_3d,Fail
> -kms_addfb_basic@addfb25-bad-modifier,Fail
>   kms_bw@linear-tiling-1-displays-1920x1080p,Fail
>   kms_bw@linear-tiling-1-displays-2560x1440p,Fail
>   kms_bw@linear-tiling-1-displays-3840x2160p,Fail
> @@ -9,20 +11,22 @@ kms_bw@linear-tiling-2-displays-3840x2160p,Fail
>   kms_bw@linear-tiling-3-displays-1920x1080p,Fail
>   kms_bw@linear-tiling-3-displays-2560x1440p,Fail
>   kms_bw@linear-tiling-3-displays-3840x2160p,Fail
> -kms_color@pipe-A-invalid-gamma-lut-sizes,Fail
> -kms_color@pipe-B-invalid-gamma-lut-sizes,Fail
> -kms_force_connector_basic@force-connector-state,Fail
> -kms_force_connector_basic@force-edid,Fail
> -kms_force_connector_basic@force-load-detect,Fail
> -kms_force_connector_basic@prune-stale-modes,Fail
> +kms_color@invalid-gamma-lut-sizes,Fail
> +kms_cursor_legacy@cursor-vs-flip-atomic,Fail
> +kms_cursor_legacy@cursor-vs-flip-legacy,Fail
> +kms_flip@flip-vs-modeset-vs-hang,Fail
> +kms_flip@flip-vs-panning-vs-hang,Fail
> +kms_flip@flip-vs-suspend,Fail
> +kms_flip@flip-vs-suspend-interruptible,Fail
> +kms_hdmi_inject@inject-4k,Fail
>   kms_invalid_mode@int-max-clock,Fail
> +kms_plane_scaling@planes-downscale-factor-0-25-upscale-20x20,Fail
> +kms_plane_scaling@planes-downscale-factor-0-5-upscale-20x20,Fail
> +kms_plane_scaling@planes-downscale-factor-0-75-upscale-20x20,Fail
>   kms_plane_scaling@planes-upscale-20x20,Fail
>   kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-25,Fail
>   kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-5,Fail
>   kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-75,Fail
> -kms_plane_scaling@upscale-with-modifier-20x20,Fail
> -kms_plane_scaling@upscale-with-pixel-format-20x20,Fail
> -kms_plane_scaling@upscale-with-rotation-20x20,Fail
>   kms_properties@get_properties-sanity-atomic,Fail
>   kms_properties@plane-properties-atomic,Fail
>   kms_properties@plane-properties-legacy,Fail
> diff --git a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
> new file mode 100644
> index 000000000000..8b12e97d59f3
> --- /dev/null
> +++ b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
> @@ -0,0 +1,9 @@
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013138
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012894
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013011
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013055
> +kms_cursor_legacy@cursor-vs-flip-atomic-transitions
> +kms_force_connector_basic@force-edid
> +kms_force_connector_basic@prune-stale-modes
> +kms_prop_blob@invalid-set-prop
> +kms_prop_blob@invalid-set-prop-any
> diff --git a/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt b/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt
> index 9981682feab2..dcc49d560cef 100644
> --- a/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt
> +++ b/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt
> @@ -1,15 +1,8 @@
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012932
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012894
>   kms_3d,Fail
>   kms_addfb_basic@addfb25-bad-modifier,Fail
> -kms_cursor_legacy@all-pipes-forked-bo,Fail
> -kms_cursor_legacy@all-pipes-forked-move,Fail
> -kms_cursor_legacy@all-pipes-single-bo,Fail
> -kms_cursor_legacy@all-pipes-single-move,Fail
> -kms_cursor_legacy@all-pipes-torture-bo,Fail
> -kms_cursor_legacy@all-pipes-torture-move,Fail
> -kms_cursor_legacy@pipe-A-forked-bo,Fail
> -kms_cursor_legacy@pipe-A-forked-move,Fail
> -kms_cursor_legacy@pipe-A-single-bo,Fail
> -kms_cursor_legacy@pipe-A-single-move,Fail
> -kms_cursor_legacy@pipe-A-torture-bo,Fail
> -kms_cursor_legacy@pipe-A-torture-move,Fail
> +kms_cursor_legacy@forked-bo,Fail
> +kms_cursor_legacy@forked-move,Fail
> +kms_force_connector_basic@force-edid,Fail
>   kms_hdmi_inject@inject-4k,Fail
> diff --git a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt
> index 9586b2339f6f..4281bc25303f 100644
> --- a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt
> +++ b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt
> @@ -1,38 +1,27 @@
> -kms_addfb_basic@addfb25-bad-modifier,Fail
> -kms_addfb_basic@bad-pitch-65536,Fail
> -kms_addfb_basic@bo-too-small,Fail
> -kms_addfb_basic@size-max,Fail
> -kms_addfb_basic@too-high,Fail
> -kms_atomic_transition@plane-primary-toggle-with-vblank-wait,Fail
> -kms_bw@linear-tiling-1-displays-1920x1080p,Fail
> -kms_bw@linear-tiling-1-displays-2560x1440p,Fail
> -kms_bw@linear-tiling-1-displays-3840x2160p,Fail
> -kms_bw@linear-tiling-2-displays-1920x1080p,Fail
> -kms_bw@linear-tiling-2-displays-2560x1440p,Fail
> -kms_bw@linear-tiling-2-displays-3840x2160p,Fail
> -kms_invalid_mode@int-max-clock,Fail
> -kms_plane_scaling@downscale-with-modifier-factor-0-25,Fail
> -kms_plane_scaling@downscale-with-rotation-factor-0-25,Fail
> -kms_plane_scaling@planes-upscale-20x20,Fail
> -kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-25,Fail
> -kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-5,Fail
> -kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-75,Fail
> -kms_plane_scaling@upscale-with-modifier-20x20,Fail
> -kms_plane_scaling@upscale-with-modifier-factor-0-25,Fail
> -kms_plane_scaling@upscale-with-pixel-format-20x20,Fail
> -kms_plane_scaling@upscale-with-pixel-format-factor-0-25,Fail
> -kms_plane_scaling@upscale-with-rotation-20x20,Fail
> -kms_vblank@crtc-id,Fail
> -kms_vblank@invalid,Fail
> -kms_vblank@pipe-A-accuracy-idle,Fail
> -kms_vblank@pipe-A-query-busy,Fail
> -kms_vblank@pipe-A-query-forked,Fail
> -kms_vblank@pipe-A-query-forked-busy,Fail
> -kms_vblank@pipe-A-query-idle,Fail
> -kms_vblank@pipe-A-ts-continuation-idle,Fail
> -kms_vblank@pipe-A-ts-continuation-modeset,Fail
> -kms_vblank@pipe-A-ts-continuation-suspend,Fail
> -kms_vblank@pipe-A-wait-busy,Fail
> -kms_vblank@pipe-A-wait-forked,Fail
> -kms_vblank@pipe-A-wait-forked-busy,Fail
> -kms_vblank@pipe-A-wait-idle,Fail
> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013138
> +kms_flip@absolute-wf_vblank,Fail
> +kms_flip@absolute-wf_vblank-interruptible,Fail
> +kms_flip@basic-flip-vs-wf_vblank,Fail
> +kms_flip@blocking-absolute-wf_vblank,Fail
> +kms_flip@blocking-absolute-wf_vblank-interruptible,Fail
> +kms_flip@blocking-wf_vblank,Fail
> +kms_flip@busy-flip,Fail
> +kms_flip@dpms-vs-vblank-race,Fail
> +kms_flip@dpms-vs-vblank-race-interruptible,Fail
> +kms_flip@flip-vs-absolute-wf_vblank,Fail
> +kms_flip@flip-vs-absolute-wf_vblank-interruptible,Fail
> +kms_flip@flip-vs-blocking-wf-vblank,Fail
> +kms_flip@flip-vs-expired-vblank,Fail
> +kms_flip@flip-vs-expired-vblank-interruptible,Fail
> +kms_flip@flip-vs-modeset-vs-hang,Fail
> +kms_flip@flip-vs-panning-vs-hang,Fail
> +kms_flip@flip-vs-wf_vblank-interruptible,Fail
> +kms_flip@modeset-vs-vblank-race,Fail
> +kms_flip@modeset-vs-vblank-race-interruptible,Fail
> +kms_flip@plain-flip-fb-recreate,Fail
> +kms_flip@plain-flip-fb-recreate-interruptible,Fail
> +kms_flip@plain-flip-ts-check,Fail
> +kms_flip@plain-flip-ts-check-interruptible,Fail
> +kms_flip@wf_vblank-ts-check,Fail
> +kms_flip@wf_vblank-ts-check-interruptible,Fail
> +kms_setmode@basic,Fail
> diff --git a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt
> index 78be18174012..e40bd2cac849 100644
> --- a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt
> +++ b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt
> @@ -1,6 +1,628 @@
> -# Hits a "refcount_t: underflow; use-after-free" in virtio_gpu_fence_event_process
> -# When run in a particular order with other tests
> -kms_cursor_legacy.*
> -
>   # Job just hangs without any output
> -kms_flip@flip-vs-suspend.*
> \ No newline at end of file
> +kms_flip@flip-vs-suspend.*
> +
> +# Some tests crashes with malloc error and IGT tests floods
> +# the CI log with error messages and we end up with a warning message
> +# Job's log exceeded limit of 4194304 bytes.
> +# Job execution will continue but no more output will be collected.
> +# Below is the error log:
> +# malloc(): corrupted top size
> +# Received signal SIGABRT.
> +# Stack trace:
> +#  #0 [fatal_sig_handler+0x17b]
> +#  #1 [__sigaction+0x40]
> +#  #2 [pthread_key_delete+0x14c]
> +#  #3 [gsignal+0x12]
> +#  #4 [abort+0xd3]
> +#  #5 [__fsetlocking+0x290]
> +#  #6 [timer_settime+0x37a]
> +#  #7 [__default_morecore+0x1f1b]
> +#  #8 [__libc_calloc+0x161]
> +#  #9 [drmModeGetPlaneResources+0x44]
> +#  #10 [igt_display_require+0x194]
> +#  #11 [__igt_unique____real_main1356+0x93c]
> +#  #12 [main+0x3f]
> +#  #13 [__libc_init_first+0x8a]
> +#  #14 [__libc_start_main+0x85]
> +#  #15 [_start+0x21]
> +# malloc(): corrupted top size
> +# So skip these tests until the issue is fixed.
> +drm_read@empty-block
> +drm_read@empty-nonblock
> +drm_read@fault-buffer
> +drm_read@invalid-buffer
> +drm_read@short-buffer-block
> +drm_read@short-buffer-nonblock
> +drm_read@short-buffer-wakeup
> +kms_addfb_basic@addfb25-4-tiled
> +kms_addfb_basic@addfb25-bad-modifier
> +kms_addfb_basic@addfb25-framebuffer-vs-set-tiling
> +kms_addfb_basic@addfb25-modifier-no-flag
> +kms_addfb_basic@addfb25-x-tiled-legacy
> +kms_addfb_basic@addfb25-x-tiled-mismatch-legacy
> +kms_addfb_basic@addfb25-y-tiled-legacy
> +kms_addfb_basic@addfb25-y-tiled-small-legacy
> +kms_addfb_basic@addfb25-yf-tiled-legacy
> +kms_addfb_basic@bad-pitch-0
> +kms_addfb_basic@bad-pitch-1024
> +kms_addfb_basic@bad-pitch-128
> +kms_addfb_basic@bad-pitch-256
> +kms_addfb_basic@bad-pitch-32
> +kms_addfb_basic@bad-pitch-63
> +kms_addfb_basic@bad-pitch-65536
> +kms_addfb_basic@bad-pitch-999
> +kms_addfb_basic@basic
> +kms_addfb_basic@basic-x-tiled-legacy
> +kms_addfb_basic@basic-y-tiled-legacy
> +kms_addfb_basic@bo-too-small
> +kms_addfb_basic@bo-too-small-due-to-tiling
> +kms_addfb_basic@clobberred-modifier
> +kms_addfb_basic@framebuffer-vs-set-tiling
> +kms_addfb_basic@invalid-get-prop
> +kms_addfb_basic@invalid-get-prop-any
> +kms_addfb_basic@invalid-set-prop
> +kms_addfb_basic@invalid-set-prop-any
> +kms_addfb_basic@invalid-smem-bo-on-discrete
> +kms_addfb_basic@legacy-format
> +kms_addfb_basic@master-rmfb
> +kms_addfb_basic@no-handle
> +kms_addfb_basic@size-max
> +kms_addfb_basic@small-bo
> +kms_addfb_basic@tile-pitch-mismatch
> +kms_addfb_basic@too-high
> +kms_addfb_basic@too-wide
> +kms_addfb_basic@unused-handle
> +kms_addfb_basic@unused-modifier
> +kms_addfb_basic@unused-offsets
> +kms_addfb_basic@unused-pitches
> +kms_async_flips@alternate-sync-async-flip
> +kms_async_flips@async-flip-with-page-flip-events
> +kms_async_flips@crc
> +kms_async_flips@invalid-async-flip
> +kms_async_flips@test-cursor
> +kms_async_flips@test-time-stamp
> +kms_atomic@atomic-invalid-params
> +kms_atomic@atomic_plane_damage
> +kms_atomic@crtc-invalid-params
> +kms_atomic@crtc-invalid-params-fence
> +kms_atomic@plane-cursor-legacy
> +kms_atomic@plane-immutable-zpos
> +kms_atomic@plane-invalid-params
> +kms_atomic@plane-invalid-params-fence
> +kms_atomic@plane-overlay-legacy
> +kms_atomic@plane-primary-legacy
> +kms_atomic@plane-primary-overlay-mutable-zpos
> +kms_atomic@test-only
> +kms_atomic_interruptible@atomic-setmode
> +kms_atomic_interruptible@legacy-cursor
> +kms_atomic_interruptible@legacy-dpms
> +kms_atomic_interruptible@legacy-pageflip
> +kms_atomic_interruptible@legacy-setmode
> +kms_atomic_interruptible@universal-setplane-cursor
> +kms_atomic_interruptible@universal-setplane-primary
> +kms_atomic_transition@modeset-transition
> +kms_atomic_transition@modeset-transition-fencing
> +kms_atomic_transition@modeset-transition-nonblocking
> +kms_atomic_transition@modeset-transition-nonblocking-fencing
> +kms_atomic_transition@plane-all-modeset-transition
> +kms_atomic_transition@plane-all-modeset-transition-fencing
> +kms_atomic_transition@plane-all-modeset-transition-fencing-internal-panels
> +kms_atomic_transition@plane-all-modeset-transition-internal-panels
> +kms_atomic_transition@plane-all-transition
> +kms_atomic_transition@plane-all-transition-fencing
> +kms_atomic_transition@plane-all-transition-nonblocking
> +kms_atomic_transition@plane-all-transition-nonblocking-fencing
> +kms_atomic_transition@plane-primary-toggle-with-vblank-wait
> +kms_atomic_transition@plane-toggle-modeset-transition
> +kms_atomic_transition@plane-use-after-nonblocking-unbind
> +kms_atomic_transition@plane-use-after-nonblocking-unbind-fencing
> +kms_bw@linear-tiling-1-displays-1920x1080p
> +kms_bw@linear-tiling-1-displays-2560x1440p
> +kms_bw@linear-tiling-1-displays-3840x2160p
> +kms_bw@linear-tiling-2-displays-1920x1080p
> +kms_bw@linear-tiling-2-displays-2560x1440p
> +kms_bw@linear-tiling-2-displays-3840x2160p
> +kms_bw@linear-tiling-3-displays-1920x1080p
> +kms_bw@linear-tiling-3-displays-2560x1440p
> +kms_bw@linear-tiling-3-displays-3840x2160p
> +kms_bw@linear-tiling-4-displays-1920x1080p
> +kms_bw@linear-tiling-4-displays-2560x1440p
> +kms_bw@linear-tiling-4-displays-3840x2160p
> +kms_bw@linear-tiling-5-displays-1920x1080p
> +kms_bw@linear-tiling-5-displays-2560x1440p
> +kms_bw@linear-tiling-5-displays-3840x2160p
> +kms_bw@linear-tiling-6-displays-1920x1080p
> +kms_bw@linear-tiling-6-displays-2560x1440p
> +kms_bw@linear-tiling-6-displays-3840x2160p
> +kms_bw@linear-tiling-7-displays-1920x1080p
> +kms_bw@linear-tiling-7-displays-2560x1440p
> +kms_bw@linear-tiling-7-displays-3840x2160p
> +kms_bw@linear-tiling-8-displays-1920x1080p
> +kms_bw@linear-tiling-8-displays-2560x1440p
> +kms_bw@linear-tiling-8-displays-3840x2160p
> +kms_color@ctm-0-25
> +kms_color@ctm-0-50
> +kms_color@ctm-0-75
> +kms_color@ctm-blue-to-red
> +kms_color@ctm-green-to-red
> +kms_color@ctm-max
> +kms_color@ctm-negative
> +kms_color@ctm-red-to-blue
> +kms_color@ctm-signed
> +kms_color@deep-color
> +kms_color@degamma
> +kms_color@gamma
> +kms_color@invalid-ctm-matrix-sizes
> +kms_color@invalid-degamma-lut-sizes
> +kms_color@invalid-gamma-lut-sizes
> +kms_color@legacy-gamma
> +kms_color@legacy-gamma-reset
> +kms_concurrent@pipe-A
> +kms_concurrent@pipe-B
> +kms_concurrent@pipe-C
> +kms_concurrent@pipe-D
> +kms_concurrent@pipe-E
> +kms_concurrent@pipe-F
> +kms_concurrent@pipe-G
> +kms_concurrent@pipe-H
> +kms_content_protection@LIC
> +kms_content_protection@atomic
> +kms_content_protection@atomic-dpms
> +kms_content_protection@content_type_change
> +kms_content_protection@dp-mst-lic-type-0
> +kms_content_protection@dp-mst-lic-type-1
> +kms_content_protection@dp-mst-type-0
> +kms_content_protection@dp-mst-type-1
> +kms_content_protection@legacy
> +kms_content_protection@mei_interface
> +kms_content_protection@srm
> +kms_content_protection@type1
> +kms_content_protection@uevent
> +kms_cursor_crc@cursor-alpha-opaque
> +kms_cursor_crc@cursor-alpha-transparent
> +kms_cursor_crc@cursor-dpms
> +kms_cursor_crc@cursor-offscreen-128x128
> +kms_cursor_crc@cursor-offscreen-128x42
> +kms_cursor_crc@cursor-offscreen-256x256
> +kms_cursor_crc@cursor-offscreen-256x85
> +kms_cursor_crc@cursor-offscreen-32x10
> +kms_cursor_crc@cursor-offscreen-32x32
> +kms_cursor_crc@cursor-offscreen-512x170
> +kms_cursor_crc@cursor-offscreen-512x512
> +kms_cursor_crc@cursor-offscreen-64x21
> +kms_cursor_crc@cursor-offscreen-64x64
> +kms_cursor_crc@cursor-offscreen-max-size
> +kms_cursor_crc@cursor-onscreen-128x128
> +kms_cursor_crc@cursor-onscreen-128x42
> +kms_cursor_crc@cursor-onscreen-256x256
> +kms_cursor_crc@cursor-onscreen-256x85
> +kms_cursor_crc@cursor-onscreen-32x10
> +kms_cursor_crc@cursor-onscreen-32x32
> +kms_cursor_crc@cursor-onscreen-512x170
> +kms_cursor_crc@cursor-onscreen-512x512
> +kms_cursor_crc@cursor-onscreen-64x21
> +kms_cursor_crc@cursor-onscreen-64x64
> +kms_cursor_crc@cursor-onscreen-max-size
> +kms_cursor_crc@cursor-random-128x128
> +kms_cursor_crc@cursor-random-128x42
> +kms_cursor_crc@cursor-random-256x256
> +kms_cursor_crc@cursor-random-256x85
> +kms_cursor_crc@cursor-random-32x10
> +kms_cursor_crc@cursor-random-32x32
> +kms_cursor_crc@cursor-random-512x170
> +kms_cursor_crc@cursor-random-512x512
> +kms_cursor_crc@cursor-random-64x21
> +kms_cursor_crc@cursor-random-64x64
> +kms_cursor_crc@cursor-random-max-size
> +kms_cursor_crc@cursor-rapid-movement-128x128
> +kms_cursor_crc@cursor-rapid-movement-128x42
> +kms_cursor_crc@cursor-rapid-movement-256x256
> +kms_cursor_crc@cursor-rapid-movement-256x85
> +kms_cursor_crc@cursor-rapid-movement-32x10
> +kms_cursor_crc@cursor-rapid-movement-32x32
> +kms_cursor_crc@cursor-rapid-movement-512x170
> +kms_cursor_crc@cursor-rapid-movement-512x512
> +kms_cursor_crc@cursor-rapid-movement-64x21
> +kms_cursor_crc@cursor-rapid-movement-64x64
> +kms_cursor_crc@cursor-rapid-movement-max-size
> +kms_cursor_crc@cursor-size-change
> +kms_cursor_crc@cursor-sliding-128x128
> +kms_cursor_crc@cursor-sliding-128x42
> +kms_cursor_crc@cursor-sliding-256x256
> +kms_cursor_crc@cursor-sliding-256x85
> +kms_cursor_crc@cursor-sliding-32x10
> +kms_cursor_crc@cursor-sliding-32x32
> +kms_cursor_crc@cursor-sliding-512x170
> +kms_cursor_crc@cursor-sliding-512x512
> +kms_cursor_crc@cursor-sliding-64x21
> +kms_cursor_crc@cursor-sliding-64x64
> +kms_cursor_crc@cursor-sliding-max-size
> +kms_cursor_crc@cursor-suspend
> +kms_cursor_legacy@2x-cursor-vs-flip-atomic
> +kms_cursor_legacy@2x-cursor-vs-flip-legacy
> +kms_cursor_legacy@2x-flip-vs-cursor-atomic
> +kms_cursor_legacy@2x-flip-vs-cursor-legacy
> +kms_cursor_legacy@2x-long-cursor-vs-flip-atomic
> +kms_cursor_legacy@2x-long-cursor-vs-flip-legacy
> +kms_cursor_legacy@2x-long-flip-vs-cursor-atomic
> +kms_cursor_legacy@2x-long-flip-vs-cursor-legacy
> +kms_cursor_legacy@2x-long-nonblocking-modeset-vs-cursor-atomic
> +kms_cursor_legacy@2x-nonblocking-modeset-vs-cursor-atomic
> +kms_cursor_legacy@basic-busy-flip-before-cursor-atomic
> +kms_cursor_legacy@basic-busy-flip-before-cursor-legacy
> +kms_cursor_legacy@basic-busy-flip-before-cursor-varying-size
> +kms_cursor_legacy@basic-flip-after-cursor-atomic
> +kms_cursor_legacy@basic-flip-after-cursor-legacy
> +kms_cursor_legacy@basic-flip-after-cursor-varying-size
> +kms_cursor_legacy@basic-flip-before-cursor-atomic
> +kms_cursor_legacy@basic-flip-before-cursor-legacy
> +kms_cursor_legacy@basic-flip-before-cursor-varying-size
> +kms_cursor_legacy@cursor-vs-flip-atomic
> +kms_cursor_legacy@cursor-vs-flip-atomic-transitions
> +kms_cursor_legacy@cursor-vs-flip-atomic-transitions-varying-size
> +kms_cursor_legacy@cursor-vs-flip-legacy
> +kms_cursor_legacy@cursor-vs-flip-toggle
> +kms_cursor_legacy@cursor-vs-flip-varying-size
> +kms_cursor_legacy@cursorA-vs-flipA-atomic
> +kms_cursor_legacy@cursorA-vs-flipA-atomic-transitions
> +kms_cursor_legacy@cursorA-vs-flipA-atomic-transitions-varying-size
> +kms_cursor_legacy@cursorA-vs-flipA-legacy
> +kms_cursor_legacy@cursorA-vs-flipA-toggle
> +kms_cursor_legacy@cursorA-vs-flipA-varying-size
> +kms_cursor_legacy@cursorA-vs-flipB-atomic
> +kms_cursor_legacy@cursorA-vs-flipB-atomic-transitions
> +kms_cursor_legacy@cursorA-vs-flipB-atomic-transitions-varying-size
> +kms_cursor_legacy@cursorA-vs-flipB-legacy
> +kms_cursor_legacy@cursorA-vs-flipB-toggle
> +kms_cursor_legacy@cursorA-vs-flipB-varying-size
> +kms_cursor_legacy@cursorB-vs-flipA-atomic
> +kms_cursor_legacy@cursorB-vs-flipA-atomic-transitions
> +kms_cursor_legacy@cursorB-vs-flipA-atomic-transitions-varying-size
> +kms_cursor_legacy@cursorB-vs-flipA-legacy
> +kms_cursor_legacy@cursorB-vs-flipA-toggle
> +kms_cursor_legacy@cursorB-vs-flipA-varying-size
> +kms_cursor_legacy@cursorB-vs-flipB-atomic
> +kms_cursor_legacy@cursorB-vs-flipB-atomic-transitions
> +kms_cursor_legacy@cursorB-vs-flipB-atomic-transitions-varying-size
> +kms_cursor_legacy@cursorB-vs-flipB-legacy
> +kms_cursor_legacy@cursorB-vs-flipB-toggle
> +kms_cursor_legacy@cursorB-vs-flipB-varying-size
> +kms_cursor_legacy@flip-vs-cursor-atomic
> +kms_cursor_legacy@flip-vs-cursor-atomic-transitions
> +kms_cursor_legacy@flip-vs-cursor-atomic-transitions-varying-size
> +kms_cursor_legacy@flip-vs-cursor-busy-crc-atomic
> +kms_cursor_legacy@flip-vs-cursor-busy-crc-legacy
> +kms_cursor_legacy@flip-vs-cursor-crc-atomic
> +kms_cursor_legacy@flip-vs-cursor-crc-legacy
> +kms_cursor_legacy@flip-vs-cursor-legacy
> +kms_cursor_legacy@flip-vs-cursor-toggle
> +kms_cursor_legacy@flip-vs-cursor-varying-size
> +kms_cursor_legacy@forked-bo
> +kms_cursor_legacy@forked-move
> +kms_cursor_legacy@long-nonblocking-modeset-vs-cursor-atomic
> +kms_cursor_legacy@nonblocking-modeset-vs-cursor-atomic
> +kms_cursor_legacy@short-busy-flip-before-cursor-atomic-transitions
> +kms_cursor_legacy@short-busy-flip-before-cursor-atomic-transitions-varying-size
> +kms_cursor_legacy@short-busy-flip-before-cursor-toggle
> +kms_cursor_legacy@short-flip-after-cursor-atomic-transitions
> +kms_cursor_legacy@short-flip-after-cursor-atomic-transitions-varying-size
> +kms_cursor_legacy@short-flip-after-cursor-toggle
> +kms_cursor_legacy@short-flip-before-cursor-atomic-transitions
> +kms_cursor_legacy@short-flip-before-cursor-atomic-transitions-varying-size
> +kms_cursor_legacy@short-flip-before-cursor-toggle
> +kms_cursor_legacy@single-bo
> +kms_cursor_legacy@single-move
> +kms_cursor_legacy@torture-bo
> +kms_cursor_legacy@torture-move
> +kms_dither@FB-8BPC-Vs-Panel-6BPC
> +kms_dither@FB-8BPC-Vs-Panel-8BPC
> +kms_flip_event_leak@basic
> +kms_getfb@getfb-handle-not-fb
> +kms_getfb@getfb2-handle-not-fb
> +kms_hdr@bpc-switch
> +kms_hdr@bpc-switch-dpms
> +kms_hdr@bpc-switch-suspend
> +kms_hdr@invalid-hdr
> +kms_hdr@invalid-metadata-sizes
> +kms_hdr@static-swap
> +kms_hdr@static-toggle
> +kms_hdr@static-toggle-dpms
> +kms_hdr@static-toggle-suspend
> +kms_invalid_mode@bad-hsync-end
> +kms_invalid_mode@bad-hsync-start
> +kms_invalid_mode@bad-htotal
> +kms_invalid_mode@bad-vsync-end
> +kms_invalid_mode@bad-vsync-start
> +kms_invalid_mode@bad-vtotal
> +kms_invalid_mode@clock-too-high
> +kms_invalid_mode@int-max-clock
> +kms_invalid_mode@uint-max-clock
> +kms_invalid_mode@zero-clock
> +kms_invalid_mode@zero-hdisplay
> +kms_invalid_mode@zero-vdisplay
> +kms_panel_fitting@atomic-fastset
> +kms_panel_fitting@legacy
> +kms_plane_cursor@overlay
> +kms_plane_cursor@primary
> +kms_plane_cursor@viewport
> +kms_plane_scaling@2x-scaler-multi-pipe
> +kms_plane_scaling@intel-max-src-size
> +kms_plane_scaling@invalid-num-scalers
> +kms_plane_scaling@invalid-parameters
> +kms_plane_scaling@plane-downscale-with-modifiers-factor-0-25
> +kms_plane_scaling@plane-downscale-with-modifiers-factor-0-5
> +kms_plane_scaling@plane-downscale-with-modifiers-factor-0-75
> +kms_plane_scaling@plane-downscale-with-pixel-format-factor-0-25
> +kms_plane_scaling@plane-downscale-with-pixel-format-factor-0-5
> +kms_plane_scaling@plane-downscale-with-pixel-format-factor-0-75
> +kms_plane_scaling@plane-downscale-with-rotation-factor-0-25
> +kms_plane_scaling@plane-downscale-with-rotation-factor-0-5
> +kms_plane_scaling@plane-downscale-with-rotation-factor-0-75
> +kms_plane_scaling@plane-scaler-with-clipping-clamping-modifiers
> +kms_plane_scaling@plane-scaler-with-clipping-clamping-pixel-formats
> +kms_plane_scaling@plane-scaler-with-clipping-clamping-rotation
> +kms_plane_scaling@plane-scaler-with-modifiers-unity-scaling
> +kms_plane_scaling@plane-scaler-with-pixel-format-unity-scaling
> +kms_plane_scaling@plane-scaler-with-rotation-unity-scaling
> +kms_plane_scaling@plane-upscale-with-modifiers-20x20
> +kms_plane_scaling@plane-upscale-with-modifiers-factor-0-25
> +kms_plane_scaling@plane-upscale-with-pixel-format-20x20
> +kms_plane_scaling@plane-upscale-with-pixel-format-factor-0-25
> +kms_plane_scaling@plane-upscale-with-rotation-20x20
> +kms_plane_scaling@plane-upscale-with-rotation-factor-0-25
> +kms_plane_scaling@planes-downscale-factor-0-25
> +kms_plane_scaling@planes-downscale-factor-0-25-unity-scaling
> +kms_plane_scaling@planes-downscale-factor-0-25-upscale-20x20
> +kms_plane_scaling@planes-downscale-factor-0-25-upscale-factor-0-25
> +kms_plane_scaling@planes-downscale-factor-0-5
> +kms_plane_scaling@planes-downscale-factor-0-5-unity-scaling
> +kms_plane_scaling@planes-downscale-factor-0-5-upscale-20x20
> +kms_plane_scaling@planes-downscale-factor-0-5-upscale-factor-0-25
> +kms_plane_scaling@planes-downscale-factor-0-75
> +kms_plane_scaling@planes-downscale-factor-0-75-unity-scaling
> +kms_plane_scaling@planes-downscale-factor-0-75-upscale-20x20
> +kms_plane_scaling@planes-downscale-factor-0-75-upscale-factor-0-25
> +kms_plane_scaling@planes-scaler-unity-scaling
> +kms_plane_scaling@planes-unity-scaling-downscale-factor-0-25
> +kms_plane_scaling@planes-unity-scaling-downscale-factor-0-5
> +kms_plane_scaling@planes-unity-scaling-downscale-factor-0-75
> +kms_plane_scaling@planes-upscale-20x20
> +kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-25
> +kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-5
> +kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-75
> +kms_plane_scaling@planes-upscale-factor-0-25
> +kms_plane_scaling@planes-upscale-factor-0-25-downscale-factor-0-25
> +kms_plane_scaling@planes-upscale-factor-0-25-downscale-factor-0-5
> +kms_plane_scaling@planes-upscale-factor-0-25-downscale-factor-0-75
> +kms_prime@D3hot
> +kms_prime@basic-crc-hybrid
> +kms_prime@basic-crc-vgem
> +kms_prime@basic-modeset-hybrid
> +kms_properties@connector-properties-atomic
> +kms_properties@connector-properties-legacy
> +kms_properties@crtc-properties-atomic
> +kms_properties@crtc-properties-legacy
> +kms_properties@get_properties-sanity-atomic
> +kms_properties@get_properties-sanity-non-atomic
> +kms_properties@invalid-properties-atomic
> +kms_properties@invalid-properties-legacy
> +kms_properties@plane-properties-atomic
> +kms_properties@plane-properties-legacy
> +kms_rmfb@close-fd
> +kms_rmfb@rmfb-ioctl
> +kms_scaling_modes@scaling-mode-center
> +kms_scaling_modes@scaling-mode-full
> +kms_scaling_modes@scaling-mode-full-aspect
> +kms_scaling_modes@scaling-mode-none
> +kms_tiled_display@basic-test-pattern
> +kms_tiled_display@basic-test-pattern-with-chamelium
> +kms_vblank@crtc-id
> +kms_vblank@invalid
> +kms_vblank@pipe-A-accuracy-idle
> +kms_vblank@pipe-A-query-busy
> +kms_vblank@pipe-A-query-busy-hang
> +kms_vblank@pipe-A-query-forked
> +kms_vblank@pipe-A-query-forked-busy
> +kms_vblank@pipe-A-query-forked-busy-hang
> +kms_vblank@pipe-A-query-forked-hang
> +kms_vblank@pipe-A-query-idle
> +kms_vblank@pipe-A-query-idle-hang
> +kms_vblank@pipe-A-ts-continuation-dpms-rpm
> +kms_vblank@pipe-A-ts-continuation-dpms-suspend
> +kms_vblank@pipe-A-ts-continuation-idle
> +kms_vblank@pipe-A-ts-continuation-idle-hang
> +kms_vblank@pipe-A-ts-continuation-modeset
> +kms_vblank@pipe-A-ts-continuation-modeset-hang
> +kms_vblank@pipe-A-ts-continuation-modeset-rpm
> +kms_vblank@pipe-A-ts-continuation-suspend
> +kms_vblank@pipe-A-wait-busy
> +kms_vblank@pipe-A-wait-busy-hang
> +kms_vblank@pipe-A-wait-forked
> +kms_vblank@pipe-A-wait-forked-busy
> +kms_vblank@pipe-A-wait-forked-busy-hang
> +kms_vblank@pipe-A-wait-forked-hang
> +kms_vblank@pipe-A-wait-idle
> +kms_vblank@pipe-A-wait-idle-hang
> +kms_vblank@pipe-B-accuracy-idle
> +kms_vblank@pipe-B-query-busy
> +kms_vblank@pipe-B-query-busy-hang
> +kms_vblank@pipe-B-query-forked
> +kms_vblank@pipe-B-query-forked-busy
> +kms_vblank@pipe-B-query-forked-busy-hang
> +kms_vblank@pipe-B-query-forked-hang
> +kms_vblank@pipe-B-query-idle
> +kms_vblank@pipe-B-query-idle-hang
> +kms_vblank@pipe-B-ts-continuation-dpms-rpm
> +kms_vblank@pipe-B-ts-continuation-dpms-suspend
> +kms_vblank@pipe-B-ts-continuation-idle
> +kms_vblank@pipe-B-ts-continuation-idle-hang
> +kms_vblank@pipe-B-ts-continuation-modeset
> +kms_vblank@pipe-B-ts-continuation-modeset-hang
> +kms_vblank@pipe-B-ts-continuation-modeset-rpm
> +kms_vblank@pipe-B-ts-continuation-suspend
> +kms_vblank@pipe-B-wait-busy
> +kms_vblank@pipe-B-wait-busy-hang
> +kms_vblank@pipe-B-wait-forked
> +kms_vblank@pipe-B-wait-forked-busy
> +kms_vblank@pipe-B-wait-forked-busy-hang
> +kms_vblank@pipe-B-wait-forked-hang
> +kms_vblank@pipe-B-wait-idle
> +kms_vblank@pipe-B-wait-idle-hang
> +kms_vblank@pipe-C-accuracy-idle
> +kms_vblank@pipe-C-query-idle
> +kms_vblank@pipe-C-query-busy
> +kms_vblank@pipe-C-query-busy-hang
> +kms_vblank@pipe-C-query-forked
> +kms_vblank@pipe-C-query-forked-busy
> +kms_vblank@pipe-C-query-forked-busy-hang
> +kms_vblank@pipe-C-query-forked-hang
> +kms_vblank@pipe-C-ts-continuation-dpms-rpm
> +kms_vblank@pipe-C-ts-continuation-dpms-suspend
> +kms_vblank@pipe-C-ts-continuation-idle
> +kms_vblank@pipe-C-ts-continuation-idle-hang
> +kms_vblank@pipe-C-ts-continuation-modeset
> +kms_vblank@pipe-C-ts-continuation-modeset-hang
> +kms_vblank@pipe-C-ts-continuation-modeset-rpm
> +kms_vblank@pipe-C-ts-continuation-suspend
> +kms_vblank@pipe-C-wait-busy
> +kms_vblank@pipe-C-wait-busy-hang
> +kms_vblank@pipe-C-wait-forked
> +kms_vblank@pipe-C-wait-forked-busy
> +kms_vblank@pipe-C-wait-forked-busy-hang
> +kms_vblank@pipe-C-wait-forked-hang
> +kms_vblank@pipe-C-wait-idle
> +kms_vblank@pipe-C-wait-idle-hang
> +kms_vblank@pipe-D-accuracy-idle
> +kms_vblank@pipe-D-query-busy
> +kms_vblank@pipe-D-query-busy-hang
> +kms_vblank@pipe-D-query-forked
> +kms_vblank@pipe-D-query-forked-busy
> +kms_vblank@pipe-D-query-forked-busy-hang
> +kms_vblank@pipe-D-query-forked-hang
> +kms_vblank@pipe-D-query-idle
> +kms_vblank@pipe-D-query-idle-hang
> +kms_vblank@pipe-D-ts-continuation-dpms-rpm
> +kms_vblank@pipe-D-ts-continuation-dpms-suspend
> +kms_vblank@pipe-D-ts-continuation-idle
> +kms_vblank@pipe-D-ts-continuation-idle-hang
> +kms_vblank@pipe-D-ts-continuation-modeset
> +kms_vblank@pipe-D-ts-continuation-modeset-hang
> +kms_vblank@pipe-D-ts-continuation-modeset-rpm
> +kms_vblank@pipe-D-ts-continuation-suspend
> +kms_vblank@pipe-D-wait-busy
> +kms_vblank@pipe-D-wait-busy-hang
> +kms_vblank@pipe-D-wait-forked
> +kms_vblank@pipe-D-wait-forked-busy
> +kms_vblank@pipe-D-wait-forked-busy-hang
> +kms_vblank@pipe-D-wait-forked-hang
> +kms_vblank@pipe-D-wait-idle
> +kms_vblank@pipe-D-wait-idle-hang
> +kms_vblank@pipe-E-accuracy-idle
> +kms_vblank@pipe-E-query-busy
> +kms_vblank@pipe-E-query-busy-hang
> +kms_vblank@pipe-E-query-forked
> +kms_vblank@pipe-E-query-forked-busy
> +kms_vblank@pipe-E-query-forked-busy-hang
> +kms_vblank@pipe-E-query-forked-hang
> +kms_vblank@pipe-E-query-idle
> +kms_vblank@pipe-E-query-idle-hang
> +kms_vblank@pipe-E-ts-continuation-dpms-rpm
> +kms_vblank@pipe-E-ts-continuation-dpms-suspend
> +kms_vblank@pipe-E-ts-continuation-idle
> +kms_vblank@pipe-E-ts-continuation-idle-hang
> +kms_vblank@pipe-E-ts-continuation-modeset
> +kms_vblank@pipe-E-ts-continuation-modeset-hang
> +kms_vblank@pipe-E-ts-continuation-modeset-rpm
> +kms_vblank@pipe-E-ts-continuation-suspend
> +kms_vblank@pipe-E-wait-busy
> +kms_vblank@pipe-E-wait-busy-hang
> +kms_vblank@pipe-E-wait-forked
> +kms_vblank@pipe-E-wait-forked-busy
> +kms_vblank@pipe-E-wait-forked-busy-hang
> +kms_vblank@pipe-E-wait-forked-hang
> +kms_vblank@pipe-E-wait-idle
> +kms_vblank@pipe-E-wait-idle-hang
> +kms_vblank@pipe-F-accuracy-idle
> +kms_vblank@pipe-F-query-busy
> +kms_vblank@pipe-F-query-busy-hang
> +kms_vblank@pipe-F-query-forked
> +kms_vblank@pipe-F-query-forked-busy
> +kms_vblank@pipe-F-query-forked-busy-hang
> +kms_vblank@pipe-F-query-forked-hang
> +kms_vblank@pipe-F-query-idle
> +kms_vblank@pipe-F-query-idle-hang
> +kms_vblank@pipe-F-ts-continuation-dpms-rpm
> +kms_vblank@pipe-F-ts-continuation-dpms-suspend
> +kms_vblank@pipe-F-ts-continuation-idle
> +kms_vblank@pipe-F-ts-continuation-idle-hang
> +kms_vblank@pipe-F-ts-continuation-modeset
> +kms_vblank@pipe-F-ts-continuation-modeset-hang
> +kms_vblank@pipe-F-ts-continuation-modeset-rpm
> +kms_vblank@pipe-F-ts-continuation-suspend
> +kms_vblank@pipe-F-wait-busy
> +kms_vblank@pipe-F-wait-busy-hang
> +kms_vblank@pipe-F-wait-forked
> +kms_vblank@pipe-F-wait-forked-busy
> +kms_vblank@pipe-F-wait-forked-busy-hang
> +kms_vblank@pipe-F-wait-forked-hang
> +kms_vblank@pipe-F-wait-idle
> +kms_vblank@pipe-F-wait-idle-hang
> +kms_vblank@pipe-G-accuracy-idle
> +kms_vblank@pipe-G-query-busy
> +kms_vblank@pipe-G-query-busy-hang
> +kms_vblank@pipe-G-query-forked
> +kms_vblank@pipe-G-query-forked-busy
> +kms_vblank@pipe-G-query-forked-busy-hang
> +kms_vblank@pipe-G-query-forked-hang
> +kms_vblank@pipe-G-query-idle
> +kms_vblank@pipe-G-query-idle-hang
> +kms_vblank@pipe-G-ts-continuation-dpms-rpm
> +kms_vblank@pipe-G-ts-continuation-dpms-suspend
> +kms_vblank@pipe-G-ts-continuation-idle
> +kms_vblank@pipe-G-ts-continuation-idle-hang
> +kms_vblank@pipe-G-ts-continuation-modeset
> +kms_vblank@pipe-G-ts-continuation-modeset-hang
> +kms_vblank@pipe-G-ts-continuation-modeset-rpm
> +kms_vblank@pipe-G-ts-continuation-suspend
> +kms_vblank@pipe-G-wait-busy
> +kms_vblank@pipe-G-wait-busy-hang
> +kms_vblank@pipe-G-wait-forked
> +kms_vblank@pipe-G-wait-forked-busy
> +kms_vblank@pipe-G-wait-forked-busy-hang
> +kms_vblank@pipe-G-wait-forked-hang
> +kms_vblank@pipe-G-wait-idle
> +kms_vblank@pipe-G-wait-idle-hang
> +kms_vblank@pipe-H-accuracy-idle
> +kms_vblank@pipe-H-query-busy
> +kms_vblank@pipe-H-query-busy-hang
> +kms_vblank@pipe-H-query-forked
> +kms_vblank@pipe-H-query-forked-busy
> +kms_vblank@pipe-H-query-forked-busy-hang
> +kms_vblank@pipe-H-query-forked-hang
> +kms_vblank@pipe-H-query-idle
> +kms_vblank@pipe-H-query-idle-hang
> +kms_vblank@pipe-H-ts-continuation-dpms-rpm
> +kms_vblank@pipe-H-ts-continuation-dpms-suspend
> +kms_vblank@pipe-H-ts-continuation-idle
> +kms_vblank@pipe-H-ts-continuation-idle-hang
> +kms_vblank@pipe-H-ts-continuation-modeset
> +kms_vblank@pipe-H-ts-continuation-modeset-hang
> +kms_vblank@pipe-H-ts-continuation-modeset-rpm
> +kms_vblank@pipe-H-ts-continuation-suspend
> +kms_vblank@pipe-H-wait-busy
> +kms_vblank@pipe-H-wait-busy-hang
> +kms_vblank@pipe-H-wait-forked
> +kms_vblank@pipe-H-wait-forked-busy
> +kms_vblank@pipe-H-wait-forked-busy-hang
> +kms_vblank@pipe-H-wait-forked-hang
> +kms_vblank@pipe-H-wait-idle
> +kms_vblank@pipe-H-wait-idle-hang
> +kms_vrr@flip-basic
> +kms_vrr@flip-dpms
> +kms_vrr@flip-suspend
> +kms_vrr@flipline
> +kms_vrr@negative-basic
> +kms_writeback@writeback-check-output
> +kms_writeback@writeback-fb-id
> +kms_writeback@writeback-invalid-parameters
> +kms_writeback@writeback-pixel-formats

I wonder if we could just do

drm_read.*
kms_addfb_basic.*
kms_atomic.*
kms_bw.*
kms_color.*
kms_concurrent.*
kms_content_protection.*
kms_cursor_crc.*
kms_cursor_legacy.*

... (and so on)

to simplify this list (in case most of the tests with that prefix are 
provoking that issue).

Regards,
Helen

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [PATCH v5 9/9] drm: ci: Update xfails
  2023-10-19 16:42   ` Helen Koike
@ 2023-10-19 16:45     ` Helen Koike
  0 siblings, 0 replies; 15+ messages in thread
From: Helen Koike @ 2023-10-19 16:45 UTC (permalink / raw)
  To: Vignesh Raman, airlied, daniel
  Cc: daniels, emma, david.heidelberg, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	gustavo.padovan, linux-mediatek



On 19/10/2023 13:42, Helen Koike wrote:
> 
> 
> On 19/10/2023 04:06, Vignesh Raman wrote:
>> Update msm-apq8016-fails, mediatek-mt8173-fails and
>> virtio_gpu-none-fails to include the tests which fail.
>> Update mediatek-mt8173-flakes to include the tests which flakes.
>> Update virtio_gpu-none-skips to include the tests that need to be 
>> skipped.
>>
>> Signed-off-by: Vignesh Raman <vignesh.raman@collabora.com>
>> ---
>>
>> v2:
>>    - No changes
>>
>> v3:
>>    - No changes
>>
>> v4:
>>    - No changes
>>
>> v5:
>>    - Generate fails and flakes file with the updated xfails script - 
>> https://www.spinics.net/lists/kernel/msg4959630.html
>>
>> ---
>>   .../drm/ci/xfails/mediatek-mt8173-fails.txt   |  24 +-
>>   .../drm/ci/xfails/mediatek-mt8173-flakes.txt  |   9 +
>>   .../gpu/drm/ci/xfails/msm-apq8016-fails.txt   |  17 +-
>>   .../drm/ci/xfails/virtio_gpu-none-fails.txt   |  65 +-
>>   .../drm/ci/xfails/virtio_gpu-none-skips.txt   | 632 +++++++++++++++++-
>>   5 files changed, 682 insertions(+), 65 deletions(-)
>>   create mode 100644 drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
>>
>> diff --git a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt 
>> b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt
>> index 671916067dba..d2261a40db11 100644
>> --- a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-fails.txt
>> @@ -1,5 +1,7 @@
>> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013011
>> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012894
>> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012949
>>   kms_3d,Fail
>> -kms_addfb_basic@addfb25-bad-modifier,Fail
>>   kms_bw@linear-tiling-1-displays-1920x1080p,Fail
>>   kms_bw@linear-tiling-1-displays-2560x1440p,Fail
>>   kms_bw@linear-tiling-1-displays-3840x2160p,Fail
>> @@ -9,20 +11,22 @@ kms_bw@linear-tiling-2-displays-3840x2160p,Fail
>>   kms_bw@linear-tiling-3-displays-1920x1080p,Fail
>>   kms_bw@linear-tiling-3-displays-2560x1440p,Fail
>>   kms_bw@linear-tiling-3-displays-3840x2160p,Fail
>> -kms_color@pipe-A-invalid-gamma-lut-sizes,Fail
>> -kms_color@pipe-B-invalid-gamma-lut-sizes,Fail
>> -kms_force_connector_basic@force-connector-state,Fail
>> -kms_force_connector_basic@force-edid,Fail
>> -kms_force_connector_basic@force-load-detect,Fail
>> -kms_force_connector_basic@prune-stale-modes,Fail
>> +kms_color@invalid-gamma-lut-sizes,Fail
>> +kms_cursor_legacy@cursor-vs-flip-atomic,Fail
>> +kms_cursor_legacy@cursor-vs-flip-legacy,Fail
>> +kms_flip@flip-vs-modeset-vs-hang,Fail
>> +kms_flip@flip-vs-panning-vs-hang,Fail
>> +kms_flip@flip-vs-suspend,Fail
>> +kms_flip@flip-vs-suspend-interruptible,Fail
>> +kms_hdmi_inject@inject-4k,Fail
>>   kms_invalid_mode@int-max-clock,Fail
>> +kms_plane_scaling@planes-downscale-factor-0-25-upscale-20x20,Fail
>> +kms_plane_scaling@planes-downscale-factor-0-5-upscale-20x20,Fail
>> +kms_plane_scaling@planes-downscale-factor-0-75-upscale-20x20,Fail
>>   kms_plane_scaling@planes-upscale-20x20,Fail
>>   kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-25,Fail
>>   kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-5,Fail
>>   kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-75,Fail
>> -kms_plane_scaling@upscale-with-modifier-20x20,Fail
>> -kms_plane_scaling@upscale-with-pixel-format-20x20,Fail
>> -kms_plane_scaling@upscale-with-rotation-20x20,Fail
>>   kms_properties@get_properties-sanity-atomic,Fail
>>   kms_properties@plane-properties-atomic,Fail
>>   kms_properties@plane-properties-legacy,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt 
>> b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
>> new file mode 100644
>> index 000000000000..8b12e97d59f3
>> --- /dev/null
>> +++ b/drivers/gpu/drm/ci/xfails/mediatek-mt8173-flakes.txt
>> @@ -0,0 +1,9 @@
>> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013138
>> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012894
>> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013011
>> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013055
>> +kms_cursor_legacy@cursor-vs-flip-atomic-transitions
>> +kms_force_connector_basic@force-edid
>> +kms_force_connector_basic@prune-stale-modes
>> +kms_prop_blob@invalid-set-prop
>> +kms_prop_blob@invalid-set-prop-any
>> diff --git a/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt 
>> b/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt
>> index 9981682feab2..dcc49d560cef 100644
>> --- a/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/msm-apq8016-fails.txt
>> @@ -1,15 +1,8 @@
>> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012932
>> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1012894
>>   kms_3d,Fail
>>   kms_addfb_basic@addfb25-bad-modifier,Fail
>> -kms_cursor_legacy@all-pipes-forked-bo,Fail
>> -kms_cursor_legacy@all-pipes-forked-move,Fail
>> -kms_cursor_legacy@all-pipes-single-bo,Fail
>> -kms_cursor_legacy@all-pipes-single-move,Fail
>> -kms_cursor_legacy@all-pipes-torture-bo,Fail
>> -kms_cursor_legacy@all-pipes-torture-move,Fail
>> -kms_cursor_legacy@pipe-A-forked-bo,Fail
>> -kms_cursor_legacy@pipe-A-forked-move,Fail
>> -kms_cursor_legacy@pipe-A-single-bo,Fail
>> -kms_cursor_legacy@pipe-A-single-move,Fail
>> -kms_cursor_legacy@pipe-A-torture-bo,Fail
>> -kms_cursor_legacy@pipe-A-torture-move,Fail
>> +kms_cursor_legacy@forked-bo,Fail
>> +kms_cursor_legacy@forked-move,Fail
>> +kms_force_connector_basic@force-edid,Fail
>>   kms_hdmi_inject@inject-4k,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt 
>> b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt
>> index 9586b2339f6f..4281bc25303f 100644
>> --- a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt
>> +++ b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-fails.txt
>> @@ -1,38 +1,27 @@
>> -kms_addfb_basic@addfb25-bad-modifier,Fail
>> -kms_addfb_basic@bad-pitch-65536,Fail
>> -kms_addfb_basic@bo-too-small,Fail
>> -kms_addfb_basic@size-max,Fail
>> -kms_addfb_basic@too-high,Fail
>> -kms_atomic_transition@plane-primary-toggle-with-vblank-wait,Fail
>> -kms_bw@linear-tiling-1-displays-1920x1080p,Fail
>> -kms_bw@linear-tiling-1-displays-2560x1440p,Fail
>> -kms_bw@linear-tiling-1-displays-3840x2160p,Fail
>> -kms_bw@linear-tiling-2-displays-1920x1080p,Fail
>> -kms_bw@linear-tiling-2-displays-2560x1440p,Fail
>> -kms_bw@linear-tiling-2-displays-3840x2160p,Fail
>> -kms_invalid_mode@int-max-clock,Fail
>> -kms_plane_scaling@downscale-with-modifier-factor-0-25,Fail
>> -kms_plane_scaling@downscale-with-rotation-factor-0-25,Fail
>> -kms_plane_scaling@planes-upscale-20x20,Fail
>> -kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-25,Fail
>> -kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-5,Fail
>> -kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-75,Fail
>> -kms_plane_scaling@upscale-with-modifier-20x20,Fail
>> -kms_plane_scaling@upscale-with-modifier-factor-0-25,Fail
>> -kms_plane_scaling@upscale-with-pixel-format-20x20,Fail
>> -kms_plane_scaling@upscale-with-pixel-format-factor-0-25,Fail
>> -kms_plane_scaling@upscale-with-rotation-20x20,Fail
>> -kms_vblank@crtc-id,Fail
>> -kms_vblank@invalid,Fail
>> -kms_vblank@pipe-A-accuracy-idle,Fail
>> -kms_vblank@pipe-A-query-busy,Fail
>> -kms_vblank@pipe-A-query-forked,Fail
>> -kms_vblank@pipe-A-query-forked-busy,Fail
>> -kms_vblank@pipe-A-query-idle,Fail
>> -kms_vblank@pipe-A-ts-continuation-idle,Fail
>> -kms_vblank@pipe-A-ts-continuation-modeset,Fail
>> -kms_vblank@pipe-A-ts-continuation-suspend,Fail
>> -kms_vblank@pipe-A-wait-busy,Fail
>> -kms_vblank@pipe-A-wait-forked,Fail
>> -kms_vblank@pipe-A-wait-forked-busy,Fail
>> -kms_vblank@pipe-A-wait-idle,Fail
>> +# https://gitlab.freedesktop.org/vigneshraman/linux/-/pipelines/1013138
>> +kms_flip@absolute-wf_vblank,Fail
>> +kms_flip@absolute-wf_vblank-interruptible,Fail
>> +kms_flip@basic-flip-vs-wf_vblank,Fail
>> +kms_flip@blocking-absolute-wf_vblank,Fail
>> +kms_flip@blocking-absolute-wf_vblank-interruptible,Fail
>> +kms_flip@blocking-wf_vblank,Fail
>> +kms_flip@busy-flip,Fail
>> +kms_flip@dpms-vs-vblank-race,Fail
>> +kms_flip@dpms-vs-vblank-race-interruptible,Fail
>> +kms_flip@flip-vs-absolute-wf_vblank,Fail
>> +kms_flip@flip-vs-absolute-wf_vblank-interruptible,Fail
>> +kms_flip@flip-vs-blocking-wf-vblank,Fail
>> +kms_flip@flip-vs-expired-vblank,Fail
>> +kms_flip@flip-vs-expired-vblank-interruptible,Fail
>> +kms_flip@flip-vs-modeset-vs-hang,Fail
>> +kms_flip@flip-vs-panning-vs-hang,Fail
>> +kms_flip@flip-vs-wf_vblank-interruptible,Fail
>> +kms_flip@modeset-vs-vblank-race,Fail
>> +kms_flip@modeset-vs-vblank-race-interruptible,Fail
>> +kms_flip@plain-flip-fb-recreate,Fail
>> +kms_flip@plain-flip-fb-recreate-interruptible,Fail
>> +kms_flip@plain-flip-ts-check,Fail
>> +kms_flip@plain-flip-ts-check-interruptible,Fail
>> +kms_flip@wf_vblank-ts-check,Fail
>> +kms_flip@wf_vblank-ts-check-interruptible,Fail
>> +kms_setmode@basic,Fail
>> diff --git a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt 
>> b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt
>> index 78be18174012..e40bd2cac849 100644
>> --- a/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt
>> +++ b/drivers/gpu/drm/ci/xfails/virtio_gpu-none-skips.txt
>> @@ -1,6 +1,628 @@
>> -# Hits a "refcount_t: underflow; use-after-free" in 
>> virtio_gpu_fence_event_process
>> -# When run in a particular order with other tests
>> -kms_cursor_legacy.*
>> -
>>   # Job just hangs without any output
>> -kms_flip@flip-vs-suspend.*
>> \ No newline at end of file
>> +kms_flip@flip-vs-suspend.*
>> +
>> +# Some tests crashes with malloc error and IGT tests floods
>> +# the CI log with error messages and we end up with a warning message
>> +# Job's log exceeded limit of 4194304 bytes.
>> +# Job execution will continue but no more output will be collected.
>> +# Below is the error log:
>> +# malloc(): corrupted top size
>> +# Received signal SIGABRT.
>> +# Stack trace:
>> +#  #0 [fatal_sig_handler+0x17b]
>> +#  #1 [__sigaction+0x40]
>> +#  #2 [pthread_key_delete+0x14c]
>> +#  #3 [gsignal+0x12]
>> +#  #4 [abort+0xd3]
>> +#  #5 [__fsetlocking+0x290]
>> +#  #6 [timer_settime+0x37a]
>> +#  #7 [__default_morecore+0x1f1b]
>> +#  #8 [__libc_calloc+0x161]
>> +#  #9 [drmModeGetPlaneResources+0x44]
>> +#  #10 [igt_display_require+0x194]
>> +#  #11 [__igt_unique____real_main1356+0x93c]
>> +#  #12 [main+0x3f]
>> +#  #13 [__libc_init_first+0x8a]
>> +#  #14 [__libc_start_main+0x85]
>> +#  #15 [_start+0x21]
>> +# malloc(): corrupted top size
>> +# So skip these tests until the issue is fixed.
>> +drm_read@empty-block
>> +drm_read@empty-nonblock
>> +drm_read@fault-buffer
>> +drm_read@invalid-buffer
>> +drm_read@short-buffer-block
>> +drm_read@short-buffer-nonblock
>> +drm_read@short-buffer-wakeup
>> +kms_addfb_basic@addfb25-4-tiled
>> +kms_addfb_basic@addfb25-bad-modifier
>> +kms_addfb_basic@addfb25-framebuffer-vs-set-tiling
>> +kms_addfb_basic@addfb25-modifier-no-flag
>> +kms_addfb_basic@addfb25-x-tiled-legacy
>> +kms_addfb_basic@addfb25-x-tiled-mismatch-legacy
>> +kms_addfb_basic@addfb25-y-tiled-legacy
>> +kms_addfb_basic@addfb25-y-tiled-small-legacy
>> +kms_addfb_basic@addfb25-yf-tiled-legacy
>> +kms_addfb_basic@bad-pitch-0
>> +kms_addfb_basic@bad-pitch-1024
>> +kms_addfb_basic@bad-pitch-128
>> +kms_addfb_basic@bad-pitch-256
>> +kms_addfb_basic@bad-pitch-32
>> +kms_addfb_basic@bad-pitch-63
>> +kms_addfb_basic@bad-pitch-65536
>> +kms_addfb_basic@bad-pitch-999
>> +kms_addfb_basic@basic
>> +kms_addfb_basic@basic-x-tiled-legacy
>> +kms_addfb_basic@basic-y-tiled-legacy
>> +kms_addfb_basic@bo-too-small
>> +kms_addfb_basic@bo-too-small-due-to-tiling
>> +kms_addfb_basic@clobberred-modifier
>> +kms_addfb_basic@framebuffer-vs-set-tiling
>> +kms_addfb_basic@invalid-get-prop
>> +kms_addfb_basic@invalid-get-prop-any
>> +kms_addfb_basic@invalid-set-prop
>> +kms_addfb_basic@invalid-set-prop-any
>> +kms_addfb_basic@invalid-smem-bo-on-discrete
>> +kms_addfb_basic@legacy-format
>> +kms_addfb_basic@master-rmfb
>> +kms_addfb_basic@no-handle
>> +kms_addfb_basic@size-max
>> +kms_addfb_basic@small-bo
>> +kms_addfb_basic@tile-pitch-mismatch
>> +kms_addfb_basic@too-high
>> +kms_addfb_basic@too-wide
>> +kms_addfb_basic@unused-handle
>> +kms_addfb_basic@unused-modifier
>> +kms_addfb_basic@unused-offsets
>> +kms_addfb_basic@unused-pitches
>> +kms_async_flips@alternate-sync-async-flip
>> +kms_async_flips@async-flip-with-page-flip-events
>> +kms_async_flips@crc
>> +kms_async_flips@invalid-async-flip
>> +kms_async_flips@test-cursor
>> +kms_async_flips@test-time-stamp
>> +kms_atomic@atomic-invalid-params
>> +kms_atomic@atomic_plane_damage
>> +kms_atomic@crtc-invalid-params
>> +kms_atomic@crtc-invalid-params-fence
>> +kms_atomic@plane-cursor-legacy
>> +kms_atomic@plane-immutable-zpos
>> +kms_atomic@plane-invalid-params
>> +kms_atomic@plane-invalid-params-fence
>> +kms_atomic@plane-overlay-legacy
>> +kms_atomic@plane-primary-legacy
>> +kms_atomic@plane-primary-overlay-mutable-zpos
>> +kms_atomic@test-only
>> +kms_atomic_interruptible@atomic-setmode
>> +kms_atomic_interruptible@legacy-cursor
>> +kms_atomic_interruptible@legacy-dpms
>> +kms_atomic_interruptible@legacy-pageflip
>> +kms_atomic_interruptible@legacy-setmode
>> +kms_atomic_interruptible@universal-setplane-cursor
>> +kms_atomic_interruptible@universal-setplane-primary
>> +kms_atomic_transition@modeset-transition
>> +kms_atomic_transition@modeset-transition-fencing
>> +kms_atomic_transition@modeset-transition-nonblocking
>> +kms_atomic_transition@modeset-transition-nonblocking-fencing
>> +kms_atomic_transition@plane-all-modeset-transition
>> +kms_atomic_transition@plane-all-modeset-transition-fencing
>> +kms_atomic_transition@plane-all-modeset-transition-fencing-internal-panels
>> +kms_atomic_transition@plane-all-modeset-transition-internal-panels
>> +kms_atomic_transition@plane-all-transition
>> +kms_atomic_transition@plane-all-transition-fencing
>> +kms_atomic_transition@plane-all-transition-nonblocking
>> +kms_atomic_transition@plane-all-transition-nonblocking-fencing
>> +kms_atomic_transition@plane-primary-toggle-with-vblank-wait
>> +kms_atomic_transition@plane-toggle-modeset-transition
>> +kms_atomic_transition@plane-use-after-nonblocking-unbind
>> +kms_atomic_transition@plane-use-after-nonblocking-unbind-fencing
>> +kms_bw@linear-tiling-1-displays-1920x1080p
>> +kms_bw@linear-tiling-1-displays-2560x1440p
>> +kms_bw@linear-tiling-1-displays-3840x2160p
>> +kms_bw@linear-tiling-2-displays-1920x1080p
>> +kms_bw@linear-tiling-2-displays-2560x1440p
>> +kms_bw@linear-tiling-2-displays-3840x2160p
>> +kms_bw@linear-tiling-3-displays-1920x1080p
>> +kms_bw@linear-tiling-3-displays-2560x1440p
>> +kms_bw@linear-tiling-3-displays-3840x2160p
>> +kms_bw@linear-tiling-4-displays-1920x1080p
>> +kms_bw@linear-tiling-4-displays-2560x1440p
>> +kms_bw@linear-tiling-4-displays-3840x2160p
>> +kms_bw@linear-tiling-5-displays-1920x1080p
>> +kms_bw@linear-tiling-5-displays-2560x1440p
>> +kms_bw@linear-tiling-5-displays-3840x2160p
>> +kms_bw@linear-tiling-6-displays-1920x1080p
>> +kms_bw@linear-tiling-6-displays-2560x1440p
>> +kms_bw@linear-tiling-6-displays-3840x2160p
>> +kms_bw@linear-tiling-7-displays-1920x1080p
>> +kms_bw@linear-tiling-7-displays-2560x1440p
>> +kms_bw@linear-tiling-7-displays-3840x2160p
>> +kms_bw@linear-tiling-8-displays-1920x1080p
>> +kms_bw@linear-tiling-8-displays-2560x1440p
>> +kms_bw@linear-tiling-8-displays-3840x2160p
>> +kms_color@ctm-0-25
>> +kms_color@ctm-0-50
>> +kms_color@ctm-0-75
>> +kms_color@ctm-blue-to-red
>> +kms_color@ctm-green-to-red
>> +kms_color@ctm-max
>> +kms_color@ctm-negative
>> +kms_color@ctm-red-to-blue
>> +kms_color@ctm-signed
>> +kms_color@deep-color
>> +kms_color@degamma
>> +kms_color@gamma
>> +kms_color@invalid-ctm-matrix-sizes
>> +kms_color@invalid-degamma-lut-sizes
>> +kms_color@invalid-gamma-lut-sizes
>> +kms_color@legacy-gamma
>> +kms_color@legacy-gamma-reset
>> +kms_concurrent@pipe-A
>> +kms_concurrent@pipe-B
>> +kms_concurrent@pipe-C
>> +kms_concurrent@pipe-D
>> +kms_concurrent@pipe-E
>> +kms_concurrent@pipe-F
>> +kms_concurrent@pipe-G
>> +kms_concurrent@pipe-H
>> +kms_content_protection@LIC
>> +kms_content_protection@atomic
>> +kms_content_protection@atomic-dpms
>> +kms_content_protection@content_type_change
>> +kms_content_protection@dp-mst-lic-type-0
>> +kms_content_protection@dp-mst-lic-type-1
>> +kms_content_protection@dp-mst-type-0
>> +kms_content_protection@dp-mst-type-1
>> +kms_content_protection@legacy
>> +kms_content_protection@mei_interface
>> +kms_content_protection@srm
>> +kms_content_protection@type1
>> +kms_content_protection@uevent
>> +kms_cursor_crc@cursor-alpha-opaque
>> +kms_cursor_crc@cursor-alpha-transparent
>> +kms_cursor_crc@cursor-dpms
>> +kms_cursor_crc@cursor-offscreen-128x128
>> +kms_cursor_crc@cursor-offscreen-128x42
>> +kms_cursor_crc@cursor-offscreen-256x256
>> +kms_cursor_crc@cursor-offscreen-256x85
>> +kms_cursor_crc@cursor-offscreen-32x10
>> +kms_cursor_crc@cursor-offscreen-32x32
>> +kms_cursor_crc@cursor-offscreen-512x170
>> +kms_cursor_crc@cursor-offscreen-512x512
>> +kms_cursor_crc@cursor-offscreen-64x21
>> +kms_cursor_crc@cursor-offscreen-64x64
>> +kms_cursor_crc@cursor-offscreen-max-size
>> +kms_cursor_crc@cursor-onscreen-128x128
>> +kms_cursor_crc@cursor-onscreen-128x42
>> +kms_cursor_crc@cursor-onscreen-256x256
>> +kms_cursor_crc@cursor-onscreen-256x85
>> +kms_cursor_crc@cursor-onscreen-32x10
>> +kms_cursor_crc@cursor-onscreen-32x32
>> +kms_cursor_crc@cursor-onscreen-512x170
>> +kms_cursor_crc@cursor-onscreen-512x512
>> +kms_cursor_crc@cursor-onscreen-64x21
>> +kms_cursor_crc@cursor-onscreen-64x64
>> +kms_cursor_crc@cursor-onscreen-max-size
>> +kms_cursor_crc@cursor-random-128x128
>> +kms_cursor_crc@cursor-random-128x42
>> +kms_cursor_crc@cursor-random-256x256
>> +kms_cursor_crc@cursor-random-256x85
>> +kms_cursor_crc@cursor-random-32x10
>> +kms_cursor_crc@cursor-random-32x32
>> +kms_cursor_crc@cursor-random-512x170
>> +kms_cursor_crc@cursor-random-512x512
>> +kms_cursor_crc@cursor-random-64x21
>> +kms_cursor_crc@cursor-random-64x64
>> +kms_cursor_crc@cursor-random-max-size
>> +kms_cursor_crc@cursor-rapid-movement-128x128
>> +kms_cursor_crc@cursor-rapid-movement-128x42
>> +kms_cursor_crc@cursor-rapid-movement-256x256
>> +kms_cursor_crc@cursor-rapid-movement-256x85
>> +kms_cursor_crc@cursor-rapid-movement-32x10
>> +kms_cursor_crc@cursor-rapid-movement-32x32
>> +kms_cursor_crc@cursor-rapid-movement-512x170
>> +kms_cursor_crc@cursor-rapid-movement-512x512
>> +kms_cursor_crc@cursor-rapid-movement-64x21
>> +kms_cursor_crc@cursor-rapid-movement-64x64
>> +kms_cursor_crc@cursor-rapid-movement-max-size
>> +kms_cursor_crc@cursor-size-change
>> +kms_cursor_crc@cursor-sliding-128x128
>> +kms_cursor_crc@cursor-sliding-128x42
>> +kms_cursor_crc@cursor-sliding-256x256
>> +kms_cursor_crc@cursor-sliding-256x85
>> +kms_cursor_crc@cursor-sliding-32x10
>> +kms_cursor_crc@cursor-sliding-32x32
>> +kms_cursor_crc@cursor-sliding-512x170
>> +kms_cursor_crc@cursor-sliding-512x512
>> +kms_cursor_crc@cursor-sliding-64x21
>> +kms_cursor_crc@cursor-sliding-64x64
>> +kms_cursor_crc@cursor-sliding-max-size
>> +kms_cursor_crc@cursor-suspend
>> +kms_cursor_legacy@2x-cursor-vs-flip-atomic
>> +kms_cursor_legacy@2x-cursor-vs-flip-legacy
>> +kms_cursor_legacy@2x-flip-vs-cursor-atomic
>> +kms_cursor_legacy@2x-flip-vs-cursor-legacy
>> +kms_cursor_legacy@2x-long-cursor-vs-flip-atomic
>> +kms_cursor_legacy@2x-long-cursor-vs-flip-legacy
>> +kms_cursor_legacy@2x-long-flip-vs-cursor-atomic
>> +kms_cursor_legacy@2x-long-flip-vs-cursor-legacy
>> +kms_cursor_legacy@2x-long-nonblocking-modeset-vs-cursor-atomic
>> +kms_cursor_legacy@2x-nonblocking-modeset-vs-cursor-atomic
>> +kms_cursor_legacy@basic-busy-flip-before-cursor-atomic
>> +kms_cursor_legacy@basic-busy-flip-before-cursor-legacy
>> +kms_cursor_legacy@basic-busy-flip-before-cursor-varying-size
>> +kms_cursor_legacy@basic-flip-after-cursor-atomic
>> +kms_cursor_legacy@basic-flip-after-cursor-legacy
>> +kms_cursor_legacy@basic-flip-after-cursor-varying-size
>> +kms_cursor_legacy@basic-flip-before-cursor-atomic
>> +kms_cursor_legacy@basic-flip-before-cursor-legacy
>> +kms_cursor_legacy@basic-flip-before-cursor-varying-size
>> +kms_cursor_legacy@cursor-vs-flip-atomic
>> +kms_cursor_legacy@cursor-vs-flip-atomic-transitions
>> +kms_cursor_legacy@cursor-vs-flip-atomic-transitions-varying-size
>> +kms_cursor_legacy@cursor-vs-flip-legacy
>> +kms_cursor_legacy@cursor-vs-flip-toggle
>> +kms_cursor_legacy@cursor-vs-flip-varying-size
>> +kms_cursor_legacy@cursorA-vs-flipA-atomic
>> +kms_cursor_legacy@cursorA-vs-flipA-atomic-transitions
>> +kms_cursor_legacy@cursorA-vs-flipA-atomic-transitions-varying-size
>> +kms_cursor_legacy@cursorA-vs-flipA-legacy
>> +kms_cursor_legacy@cursorA-vs-flipA-toggle
>> +kms_cursor_legacy@cursorA-vs-flipA-varying-size
>> +kms_cursor_legacy@cursorA-vs-flipB-atomic
>> +kms_cursor_legacy@cursorA-vs-flipB-atomic-transitions
>> +kms_cursor_legacy@cursorA-vs-flipB-atomic-transitions-varying-size
>> +kms_cursor_legacy@cursorA-vs-flipB-legacy
>> +kms_cursor_legacy@cursorA-vs-flipB-toggle
>> +kms_cursor_legacy@cursorA-vs-flipB-varying-size
>> +kms_cursor_legacy@cursorB-vs-flipA-atomic
>> +kms_cursor_legacy@cursorB-vs-flipA-atomic-transitions
>> +kms_cursor_legacy@cursorB-vs-flipA-atomic-transitions-varying-size
>> +kms_cursor_legacy@cursorB-vs-flipA-legacy
>> +kms_cursor_legacy@cursorB-vs-flipA-toggle
>> +kms_cursor_legacy@cursorB-vs-flipA-varying-size
>> +kms_cursor_legacy@cursorB-vs-flipB-atomic
>> +kms_cursor_legacy@cursorB-vs-flipB-atomic-transitions
>> +kms_cursor_legacy@cursorB-vs-flipB-atomic-transitions-varying-size
>> +kms_cursor_legacy@cursorB-vs-flipB-legacy
>> +kms_cursor_legacy@cursorB-vs-flipB-toggle
>> +kms_cursor_legacy@cursorB-vs-flipB-varying-size
>> +kms_cursor_legacy@flip-vs-cursor-atomic
>> +kms_cursor_legacy@flip-vs-cursor-atomic-transitions
>> +kms_cursor_legacy@flip-vs-cursor-atomic-transitions-varying-size
>> +kms_cursor_legacy@flip-vs-cursor-busy-crc-atomic
>> +kms_cursor_legacy@flip-vs-cursor-busy-crc-legacy
>> +kms_cursor_legacy@flip-vs-cursor-crc-atomic
>> +kms_cursor_legacy@flip-vs-cursor-crc-legacy
>> +kms_cursor_legacy@flip-vs-cursor-legacy
>> +kms_cursor_legacy@flip-vs-cursor-toggle
>> +kms_cursor_legacy@flip-vs-cursor-varying-size
>> +kms_cursor_legacy@forked-bo
>> +kms_cursor_legacy@forked-move
>> +kms_cursor_legacy@long-nonblocking-modeset-vs-cursor-atomic
>> +kms_cursor_legacy@nonblocking-modeset-vs-cursor-atomic
>> +kms_cursor_legacy@short-busy-flip-before-cursor-atomic-transitions
>> +kms_cursor_legacy@short-busy-flip-before-cursor-atomic-transitions-varying-size
>> +kms_cursor_legacy@short-busy-flip-before-cursor-toggle
>> +kms_cursor_legacy@short-flip-after-cursor-atomic-transitions
>> +kms_cursor_legacy@short-flip-after-cursor-atomic-transitions-varying-size
>> +kms_cursor_legacy@short-flip-after-cursor-toggle
>> +kms_cursor_legacy@short-flip-before-cursor-atomic-transitions
>> +kms_cursor_legacy@short-flip-before-cursor-atomic-transitions-varying-size
>> +kms_cursor_legacy@short-flip-before-cursor-toggle
>> +kms_cursor_legacy@single-bo
>> +kms_cursor_legacy@single-move
>> +kms_cursor_legacy@torture-bo
>> +kms_cursor_legacy@torture-move
>> +kms_dither@FB-8BPC-Vs-Panel-6BPC
>> +kms_dither@FB-8BPC-Vs-Panel-8BPC
>> +kms_flip_event_leak@basic
>> +kms_getfb@getfb-handle-not-fb
>> +kms_getfb@getfb2-handle-not-fb
>> +kms_hdr@bpc-switch
>> +kms_hdr@bpc-switch-dpms
>> +kms_hdr@bpc-switch-suspend
>> +kms_hdr@invalid-hdr
>> +kms_hdr@invalid-metadata-sizes
>> +kms_hdr@static-swap
>> +kms_hdr@static-toggle
>> +kms_hdr@static-toggle-dpms
>> +kms_hdr@static-toggle-suspend
>> +kms_invalid_mode@bad-hsync-end
>> +kms_invalid_mode@bad-hsync-start
>> +kms_invalid_mode@bad-htotal
>> +kms_invalid_mode@bad-vsync-end
>> +kms_invalid_mode@bad-vsync-start
>> +kms_invalid_mode@bad-vtotal
>> +kms_invalid_mode@clock-too-high
>> +kms_invalid_mode@int-max-clock
>> +kms_invalid_mode@uint-max-clock
>> +kms_invalid_mode@zero-clock
>> +kms_invalid_mode@zero-hdisplay
>> +kms_invalid_mode@zero-vdisplay
>> +kms_panel_fitting@atomic-fastset
>> +kms_panel_fitting@legacy
>> +kms_plane_cursor@overlay
>> +kms_plane_cursor@primary
>> +kms_plane_cursor@viewport
>> +kms_plane_scaling@2x-scaler-multi-pipe
>> +kms_plane_scaling@intel-max-src-size
>> +kms_plane_scaling@invalid-num-scalers
>> +kms_plane_scaling@invalid-parameters
>> +kms_plane_scaling@plane-downscale-with-modifiers-factor-0-25
>> +kms_plane_scaling@plane-downscale-with-modifiers-factor-0-5
>> +kms_plane_scaling@plane-downscale-with-modifiers-factor-0-75
>> +kms_plane_scaling@plane-downscale-with-pixel-format-factor-0-25
>> +kms_plane_scaling@plane-downscale-with-pixel-format-factor-0-5
>> +kms_plane_scaling@plane-downscale-with-pixel-format-factor-0-75
>> +kms_plane_scaling@plane-downscale-with-rotation-factor-0-25
>> +kms_plane_scaling@plane-downscale-with-rotation-factor-0-5
>> +kms_plane_scaling@plane-downscale-with-rotation-factor-0-75
>> +kms_plane_scaling@plane-scaler-with-clipping-clamping-modifiers
>> +kms_plane_scaling@plane-scaler-with-clipping-clamping-pixel-formats
>> +kms_plane_scaling@plane-scaler-with-clipping-clamping-rotation
>> +kms_plane_scaling@plane-scaler-with-modifiers-unity-scaling
>> +kms_plane_scaling@plane-scaler-with-pixel-format-unity-scaling
>> +kms_plane_scaling@plane-scaler-with-rotation-unity-scaling
>> +kms_plane_scaling@plane-upscale-with-modifiers-20x20
>> +kms_plane_scaling@plane-upscale-with-modifiers-factor-0-25
>> +kms_plane_scaling@plane-upscale-with-pixel-format-20x20
>> +kms_plane_scaling@plane-upscale-with-pixel-format-factor-0-25
>> +kms_plane_scaling@plane-upscale-with-rotation-20x20
>> +kms_plane_scaling@plane-upscale-with-rotation-factor-0-25
>> +kms_plane_scaling@planes-downscale-factor-0-25
>> +kms_plane_scaling@planes-downscale-factor-0-25-unity-scaling
>> +kms_plane_scaling@planes-downscale-factor-0-25-upscale-20x20
>> +kms_plane_scaling@planes-downscale-factor-0-25-upscale-factor-0-25
>> +kms_plane_scaling@planes-downscale-factor-0-5
>> +kms_plane_scaling@planes-downscale-factor-0-5-unity-scaling
>> +kms_plane_scaling@planes-downscale-factor-0-5-upscale-20x20
>> +kms_plane_scaling@planes-downscale-factor-0-5-upscale-factor-0-25
>> +kms_plane_scaling@planes-downscale-factor-0-75
>> +kms_plane_scaling@planes-downscale-factor-0-75-unity-scaling
>> +kms_plane_scaling@planes-downscale-factor-0-75-upscale-20x20
>> +kms_plane_scaling@planes-downscale-factor-0-75-upscale-factor-0-25
>> +kms_plane_scaling@planes-scaler-unity-scaling
>> +kms_plane_scaling@planes-unity-scaling-downscale-factor-0-25
>> +kms_plane_scaling@planes-unity-scaling-downscale-factor-0-5
>> +kms_plane_scaling@planes-unity-scaling-downscale-factor-0-75
>> +kms_plane_scaling@planes-upscale-20x20
>> +kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-25
>> +kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-5
>> +kms_plane_scaling@planes-upscale-20x20-downscale-factor-0-75
>> +kms_plane_scaling@planes-upscale-factor-0-25
>> +kms_plane_scaling@planes-upscale-factor-0-25-downscale-factor-0-25
>> +kms_plane_scaling@planes-upscale-factor-0-25-downscale-factor-0-5
>> +kms_plane_scaling@planes-upscale-factor-0-25-downscale-factor-0-75
>> +kms_prime@D3hot
>> +kms_prime@basic-crc-hybrid
>> +kms_prime@basic-crc-vgem
>> +kms_prime@basic-modeset-hybrid
>> +kms_properties@connector-properties-atomic
>> +kms_properties@connector-properties-legacy
>> +kms_properties@crtc-properties-atomic
>> +kms_properties@crtc-properties-legacy
>> +kms_properties@get_properties-sanity-atomic
>> +kms_properties@get_properties-sanity-non-atomic
>> +kms_properties@invalid-properties-atomic
>> +kms_properties@invalid-properties-legacy
>> +kms_properties@plane-properties-atomic
>> +kms_properties@plane-properties-legacy
>> +kms_rmfb@close-fd
>> +kms_rmfb@rmfb-ioctl
>> +kms_scaling_modes@scaling-mode-center
>> +kms_scaling_modes@scaling-mode-full
>> +kms_scaling_modes@scaling-mode-full-aspect
>> +kms_scaling_modes@scaling-mode-none
>> +kms_tiled_display@basic-test-pattern
>> +kms_tiled_display@basic-test-pattern-with-chamelium
>> +kms_vblank@crtc-id
>> +kms_vblank@invalid
>> +kms_vblank@pipe-A-accuracy-idle
>> +kms_vblank@pipe-A-query-busy
>> +kms_vblank@pipe-A-query-busy-hang
>> +kms_vblank@pipe-A-query-forked
>> +kms_vblank@pipe-A-query-forked-busy
>> +kms_vblank@pipe-A-query-forked-busy-hang
>> +kms_vblank@pipe-A-query-forked-hang
>> +kms_vblank@pipe-A-query-idle
>> +kms_vblank@pipe-A-query-idle-hang
>> +kms_vblank@pipe-A-ts-continuation-dpms-rpm
>> +kms_vblank@pipe-A-ts-continuation-dpms-suspend
>> +kms_vblank@pipe-A-ts-continuation-idle
>> +kms_vblank@pipe-A-ts-continuation-idle-hang
>> +kms_vblank@pipe-A-ts-continuation-modeset
>> +kms_vblank@pipe-A-ts-continuation-modeset-hang
>> +kms_vblank@pipe-A-ts-continuation-modeset-rpm
>> +kms_vblank@pipe-A-ts-continuation-suspend
>> +kms_vblank@pipe-A-wait-busy
>> +kms_vblank@pipe-A-wait-busy-hang
>> +kms_vblank@pipe-A-wait-forked
>> +kms_vblank@pipe-A-wait-forked-busy
>> +kms_vblank@pipe-A-wait-forked-busy-hang
>> +kms_vblank@pipe-A-wait-forked-hang
>> +kms_vblank@pipe-A-wait-idle
>> +kms_vblank@pipe-A-wait-idle-hang
>> +kms_vblank@pipe-B-accuracy-idle
>> +kms_vblank@pipe-B-query-busy
>> +kms_vblank@pipe-B-query-busy-hang
>> +kms_vblank@pipe-B-query-forked
>> +kms_vblank@pipe-B-query-forked-busy
>> +kms_vblank@pipe-B-query-forked-busy-hang
>> +kms_vblank@pipe-B-query-forked-hang
>> +kms_vblank@pipe-B-query-idle
>> +kms_vblank@pipe-B-query-idle-hang
>> +kms_vblank@pipe-B-ts-continuation-dpms-rpm
>> +kms_vblank@pipe-B-ts-continuation-dpms-suspend
>> +kms_vblank@pipe-B-ts-continuation-idle
>> +kms_vblank@pipe-B-ts-continuation-idle-hang
>> +kms_vblank@pipe-B-ts-continuation-modeset
>> +kms_vblank@pipe-B-ts-continuation-modeset-hang
>> +kms_vblank@pipe-B-ts-continuation-modeset-rpm
>> +kms_vblank@pipe-B-ts-continuation-suspend
>> +kms_vblank@pipe-B-wait-busy
>> +kms_vblank@pipe-B-wait-busy-hang
>> +kms_vblank@pipe-B-wait-forked
>> +kms_vblank@pipe-B-wait-forked-busy
>> +kms_vblank@pipe-B-wait-forked-busy-hang
>> +kms_vblank@pipe-B-wait-forked-hang
>> +kms_vblank@pipe-B-wait-idle
>> +kms_vblank@pipe-B-wait-idle-hang
>> +kms_vblank@pipe-C-accuracy-idle
>> +kms_vblank@pipe-C-query-idle
>> +kms_vblank@pipe-C-query-busy
>> +kms_vblank@pipe-C-query-busy-hang
>> +kms_vblank@pipe-C-query-forked
>> +kms_vblank@pipe-C-query-forked-busy
>> +kms_vblank@pipe-C-query-forked-busy-hang
>> +kms_vblank@pipe-C-query-forked-hang
>> +kms_vblank@pipe-C-ts-continuation-dpms-rpm
>> +kms_vblank@pipe-C-ts-continuation-dpms-suspend
>> +kms_vblank@pipe-C-ts-continuation-idle
>> +kms_vblank@pipe-C-ts-continuation-idle-hang
>> +kms_vblank@pipe-C-ts-continuation-modeset
>> +kms_vblank@pipe-C-ts-continuation-modeset-hang
>> +kms_vblank@pipe-C-ts-continuation-modeset-rpm
>> +kms_vblank@pipe-C-ts-continuation-suspend
>> +kms_vblank@pipe-C-wait-busy
>> +kms_vblank@pipe-C-wait-busy-hang
>> +kms_vblank@pipe-C-wait-forked
>> +kms_vblank@pipe-C-wait-forked-busy
>> +kms_vblank@pipe-C-wait-forked-busy-hang
>> +kms_vblank@pipe-C-wait-forked-hang
>> +kms_vblank@pipe-C-wait-idle
>> +kms_vblank@pipe-C-wait-idle-hang
>> +kms_vblank@pipe-D-accuracy-idle
>> +kms_vblank@pipe-D-query-busy
>> +kms_vblank@pipe-D-query-busy-hang
>> +kms_vblank@pipe-D-query-forked
>> +kms_vblank@pipe-D-query-forked-busy
>> +kms_vblank@pipe-D-query-forked-busy-hang
>> +kms_vblank@pipe-D-query-forked-hang
>> +kms_vblank@pipe-D-query-idle
>> +kms_vblank@pipe-D-query-idle-hang
>> +kms_vblank@pipe-D-ts-continuation-dpms-rpm
>> +kms_vblank@pipe-D-ts-continuation-dpms-suspend
>> +kms_vblank@pipe-D-ts-continuation-idle
>> +kms_vblank@pipe-D-ts-continuation-idle-hang
>> +kms_vblank@pipe-D-ts-continuation-modeset
>> +kms_vblank@pipe-D-ts-continuation-modeset-hang
>> +kms_vblank@pipe-D-ts-continuation-modeset-rpm
>> +kms_vblank@pipe-D-ts-continuation-suspend
>> +kms_vblank@pipe-D-wait-busy
>> +kms_vblank@pipe-D-wait-busy-hang
>> +kms_vblank@pipe-D-wait-forked
>> +kms_vblank@pipe-D-wait-forked-busy
>> +kms_vblank@pipe-D-wait-forked-busy-hang
>> +kms_vblank@pipe-D-wait-forked-hang
>> +kms_vblank@pipe-D-wait-idle
>> +kms_vblank@pipe-D-wait-idle-hang
>> +kms_vblank@pipe-E-accuracy-idle
>> +kms_vblank@pipe-E-query-busy
>> +kms_vblank@pipe-E-query-busy-hang
>> +kms_vblank@pipe-E-query-forked
>> +kms_vblank@pipe-E-query-forked-busy
>> +kms_vblank@pipe-E-query-forked-busy-hang
>> +kms_vblank@pipe-E-query-forked-hang
>> +kms_vblank@pipe-E-query-idle
>> +kms_vblank@pipe-E-query-idle-hang
>> +kms_vblank@pipe-E-ts-continuation-dpms-rpm
>> +kms_vblank@pipe-E-ts-continuation-dpms-suspend
>> +kms_vblank@pipe-E-ts-continuation-idle
>> +kms_vblank@pipe-E-ts-continuation-idle-hang
>> +kms_vblank@pipe-E-ts-continuation-modeset
>> +kms_vblank@pipe-E-ts-continuation-modeset-hang
>> +kms_vblank@pipe-E-ts-continuation-modeset-rpm
>> +kms_vblank@pipe-E-ts-continuation-suspend
>> +kms_vblank@pipe-E-wait-busy
>> +kms_vblank@pipe-E-wait-busy-hang
>> +kms_vblank@pipe-E-wait-forked
>> +kms_vblank@pipe-E-wait-forked-busy
>> +kms_vblank@pipe-E-wait-forked-busy-hang
>> +kms_vblank@pipe-E-wait-forked-hang
>> +kms_vblank@pipe-E-wait-idle
>> +kms_vblank@pipe-E-wait-idle-hang
>> +kms_vblank@pipe-F-accuracy-idle
>> +kms_vblank@pipe-F-query-busy
>> +kms_vblank@pipe-F-query-busy-hang
>> +kms_vblank@pipe-F-query-forked
>> +kms_vblank@pipe-F-query-forked-busy
>> +kms_vblank@pipe-F-query-forked-busy-hang
>> +kms_vblank@pipe-F-query-forked-hang
>> +kms_vblank@pipe-F-query-idle
>> +kms_vblank@pipe-F-query-idle-hang
>> +kms_vblank@pipe-F-ts-continuation-dpms-rpm
>> +kms_vblank@pipe-F-ts-continuation-dpms-suspend
>> +kms_vblank@pipe-F-ts-continuation-idle
>> +kms_vblank@pipe-F-ts-continuation-idle-hang
>> +kms_vblank@pipe-F-ts-continuation-modeset
>> +kms_vblank@pipe-F-ts-continuation-modeset-hang
>> +kms_vblank@pipe-F-ts-continuation-modeset-rpm
>> +kms_vblank@pipe-F-ts-continuation-suspend
>> +kms_vblank@pipe-F-wait-busy
>> +kms_vblank@pipe-F-wait-busy-hang
>> +kms_vblank@pipe-F-wait-forked
>> +kms_vblank@pipe-F-wait-forked-busy
>> +kms_vblank@pipe-F-wait-forked-busy-hang
>> +kms_vblank@pipe-F-wait-forked-hang
>> +kms_vblank@pipe-F-wait-idle
>> +kms_vblank@pipe-F-wait-idle-hang
>> +kms_vblank@pipe-G-accuracy-idle
>> +kms_vblank@pipe-G-query-busy
>> +kms_vblank@pipe-G-query-busy-hang
>> +kms_vblank@pipe-G-query-forked
>> +kms_vblank@pipe-G-query-forked-busy
>> +kms_vblank@pipe-G-query-forked-busy-hang
>> +kms_vblank@pipe-G-query-forked-hang
>> +kms_vblank@pipe-G-query-idle
>> +kms_vblank@pipe-G-query-idle-hang
>> +kms_vblank@pipe-G-ts-continuation-dpms-rpm
>> +kms_vblank@pipe-G-ts-continuation-dpms-suspend
>> +kms_vblank@pipe-G-ts-continuation-idle
>> +kms_vblank@pipe-G-ts-continuation-idle-hang
>> +kms_vblank@pipe-G-ts-continuation-modeset
>> +kms_vblank@pipe-G-ts-continuation-modeset-hang
>> +kms_vblank@pipe-G-ts-continuation-modeset-rpm
>> +kms_vblank@pipe-G-ts-continuation-suspend
>> +kms_vblank@pipe-G-wait-busy
>> +kms_vblank@pipe-G-wait-busy-hang
>> +kms_vblank@pipe-G-wait-forked
>> +kms_vblank@pipe-G-wait-forked-busy
>> +kms_vblank@pipe-G-wait-forked-busy-hang
>> +kms_vblank@pipe-G-wait-forked-hang
>> +kms_vblank@pipe-G-wait-idle
>> +kms_vblank@pipe-G-wait-idle-hang
>> +kms_vblank@pipe-H-accuracy-idle
>> +kms_vblank@pipe-H-query-busy
>> +kms_vblank@pipe-H-query-busy-hang
>> +kms_vblank@pipe-H-query-forked
>> +kms_vblank@pipe-H-query-forked-busy
>> +kms_vblank@pipe-H-query-forked-busy-hang
>> +kms_vblank@pipe-H-query-forked-hang
>> +kms_vblank@pipe-H-query-idle
>> +kms_vblank@pipe-H-query-idle-hang
>> +kms_vblank@pipe-H-ts-continuation-dpms-rpm
>> +kms_vblank@pipe-H-ts-continuation-dpms-suspend
>> +kms_vblank@pipe-H-ts-continuation-idle
>> +kms_vblank@pipe-H-ts-continuation-idle-hang
>> +kms_vblank@pipe-H-ts-continuation-modeset
>> +kms_vblank@pipe-H-ts-continuation-modeset-hang
>> +kms_vblank@pipe-H-ts-continuation-modeset-rpm
>> +kms_vblank@pipe-H-ts-continuation-suspend
>> +kms_vblank@pipe-H-wait-busy
>> +kms_vblank@pipe-H-wait-busy-hang
>> +kms_vblank@pipe-H-wait-forked
>> +kms_vblank@pipe-H-wait-forked-busy
>> +kms_vblank@pipe-H-wait-forked-busy-hang
>> +kms_vblank@pipe-H-wait-forked-hang
>> +kms_vblank@pipe-H-wait-idle
>> +kms_vblank@pipe-H-wait-idle-hang
>> +kms_vrr@flip-basic
>> +kms_vrr@flip-dpms
>> +kms_vrr@flip-suspend
>> +kms_vrr@flipline
>> +kms_vrr@negative-basic
>> +kms_writeback@writeback-check-output
>> +kms_writeback@writeback-fb-id
>> +kms_writeback@writeback-invalid-parameters
>> +kms_writeback@writeback-pixel-formats
> 
> I wonder if we could just do
> 
> drm_read.*
> kms_addfb_basic.*
> kms_atomic.*
> kms_bw.*
> kms_color.*
> kms_concurrent.*
> kms_content_protection.*
> kms_cursor_crc.*
> kms_cursor_legacy.*
> 
> ... (and so on)
> 
> to simplify this list (in case most of the tests with that prefix are 
> provoking that issue).
> 
> Regards,
> Helen

Sorry, I just saw Daniel's reply about Valgrind, agreed there (so just 
ignore my comment above).

Regards,
Helen

^ permalink raw reply	[flat|nested] 15+ messages in thread

* Re: [PATCH v5 9/9] drm: ci: Update xfails
  2023-10-19  8:25   ` Daniel Stone
@ 2023-11-24  7:46     ` Vignesh Raman
  0 siblings, 0 replies; 15+ messages in thread
From: Vignesh Raman @ 2023-11-24  7:46 UTC (permalink / raw)
  To: Daniel Stone
  Cc: daniels, emma, david.heidelberg, linux-arm-msm, guilherme.gallo,
	sergi.blanch.torne, linux-kernel, dri-devel, virtualization,
	gustavo.padovan, helen.koike, linux-mediatek

Hi Daniel,

On 19/10/23 13:55, Daniel Stone wrote:
> 
> By the time we get this error, it indicates that there was previously
> memory corruption, but it is only being noticed at a later point. The
> skip lists here are way too big - stuff like drm_read is common
> testing not affected by virtio at all - so we really need to isolate
> the test which is actually breaking things.
> 
> The way to do this would be to use valgrind to detect where the memory
> corruption is. VirtIO can be run locally so this is something you can
> do on your machine.

Thank you for the hints and suggestions. This is now fixed in 
igt-gpu-tools, and the patches are merged. I will uprev igt in drm-ci 
and rerun the tests.

Also will drop the tests from virtio_gpu-none-skips.txt and send an 
updated version.

Regards,
Vignesh


^ permalink raw reply	[flat|nested] 15+ messages in thread

end of thread, other threads:[~2023-11-24  7:46 UTC | newest]

Thread overview: 15+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2023-10-19  7:06 [PATCH v5 0/9] drm: ci: fixes Vignesh Raman
2023-10-19  7:06 ` [PATCH v5 1/9] drm: ci: igt_runner: Remove todo Vignesh Raman
2023-10-19  7:06 ` [PATCH v5 2/9] drm: ci: Force db410c to host mode Vignesh Raman
2023-10-19  7:06 ` [PATCH v5 3/9] drm: ci: Enable regulator Vignesh Raman
2023-10-19  7:06 ` [PATCH v5 4/9] drm: ci: Enable new jobs Vignesh Raman
2023-10-19  7:06 ` [PATCH v5 5/9] drm: ci: Use scripts/config to enable/disable configs Vignesh Raman
2023-10-19  7:06 ` [PATCH v5 6/9] drm: ci: mediatek: Set IGT_FORCE_DRIVER for mt8173 Vignesh Raman
2023-10-19  7:06 ` [PATCH v5 7/9] drm: ci: virtio: Make artifacts available Vignesh Raman
2023-10-19  7:06 ` [PATCH v5 8/9] drm: ci: Add pipeline url to fails and flakes files Vignesh Raman
2023-10-19  7:06 ` [PATCH v5 9/9] drm: ci: Update xfails Vignesh Raman
2023-10-19  8:20   ` Maxime Ripard
2023-10-19  8:25   ` Daniel Stone
2023-11-24  7:46     ` Vignesh Raman
2023-10-19 16:42   ` Helen Koike
2023-10-19 16:45     ` Helen Koike

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).