* kernelci/staging.kernelci.org baseline: 167 runs, 7 regressions (staging-20200514.0)
[not found] <5ebce8ce.1c69fb81.c274.4b92@mx.google.com>
@ 2020-05-14 6:55 ` Guillaume Tucker
2020-05-14 14:07 ` Guenter Roeck
0 siblings, 1 reply; 3+ messages in thread
From: Guillaume Tucker @ 2020-05-14 6:55 UTC (permalink / raw)
To: kernelci
Please see below an example of the reduced test email format
which only shows regressions but also has links to all the
results, and more details on the frontend. As a result, these
email reports are not sent if there were no regressions.
This is what is expected to be deployed in production on Monday
to go hand-in-hand with the new web frontend. Please let us know
if you find any issues. More sample test email reports can be
found on the staging results mailing list:
https://groups.io/g/kernelci-results-staging/topics
Emails up to revision staging-20200514.0 are using the previous
detailed format, newer reports will be like this one.
Note: In this case, one same regression was found in 2 labs and
was listed twice. This is probably something that can be
improved in the report to avoid showing duplicated information.
Still it's important to track it this way in the database.
Thanks,
Guillaume
-------- Forwarded Message --------
Subject: kernelci/staging.kernelci.org baseline: 167 runs, 7 regressions (staging-20200514.0)
Date: Wed, 13 May 2020 23:44:30 -0700 (PDT)
From: staging.kernelci.org bot <bot@kernelci.org>
To: gtucker@collabora.com, debug011@gtucker.io
kernelci/staging.kernelci.org baseline: 167 runs, 7 regressions (staging-20200514.0)
Regressions Summary
-------------------
platform | arch | lab | compiler | defconfig | results
---------------------+------+---------------+----------+--------------------+--------
exynos5422-odroidxu3 | arm | lab-collabora | clang-9 | multi_v7_defconfig | 0/1
tegra124-jetson-tk1 | arm | lab-baylibre | clang-9 | multi_v7_defconfig | 0/1
tegra124-jetson-tk1 | arm | lab-collabora | clang-9 | multi_v7_defconfig | 0/1
tegra124-jetson-tk1 | arm | lab-baylibre | gcc-8 | multi_v7_defconfig | 0/1
tegra124-jetson-tk1 | arm | lab-collabora | gcc-8 | multi_v7_defconfig | 0/1
tegra124-nyan-big | arm | lab-collabora | clang-9 | multi_v7_defconfig | 0/1
tegra124-nyan-big | arm | lab-collabora | gcc-8 | multi_v7_defconfig | 0/1
Details: https://staging.kernelci.org/test/job/kernelci/branch/staging.kernelci.org/kernel/staging-20200514.0/plan/baseline/
Test: baseline
Tree: kernelci
Branch: staging.kernelci.org
Describe: staging-20200514.0
URL: https://github.com/kernelci/linux.git
SHA: a3b0fec31a5d6d3cb9c327318cd4c88fab5e28d5
Test Regressions
----------------
platform | arch | lab | compiler | defconfig | results
---------------------+------+---------------+----------+--------------------+--------
exynos5422-odroidxu3 | arm | lab-collabora | clang-9 | multi_v7_defconfig | 0/1
Details: https://staging.kernelci.org/test/plan/id/5ebc9a0d1f955c12235afc44
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: multi_v7_defconfig
Compiler: clang-9 (clang version 9.0.1-+20191211082622+c1a0a213378-1~exp1~20191211193200.102 )
Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-exynos5422-odroidxu3.txt
HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-exynos5422-odroidxu3.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
* baseline.login: https://staging.kernelci.org/test/case/id/5ebc9a0d1f955c12235afc45
new failure (last pass: staging-20200513.1)
platform | arch | lab | compiler | defconfig | results
---------------------+------+---------------+----------+--------------------+--------
tegra124-jetson-tk1 | arm | lab-baylibre | clang-9 | multi_v7_defconfig | 0/1
Details: https://staging.kernelci.org/test/plan/id/5ebc98f751b2987fcc5afc57
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: multi_v7_defconfig
Compiler: clang-9 (clang version 9.0.1-+20191211082622+c1a0a213378-1~exp1~20191211193200.102 )
Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-baylibre/baseline-tegra124-jetson-tk1.txt
HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-baylibre/baseline-tegra124-jetson-tk1.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
* baseline.login: https://staging.kernelci.org/test/case/id/5ebc98f751b2987fcc5afc58
failing since 5 days (last pass: staging-20200507.1, first fail: staging-20200507.2)
platform | arch | lab | compiler | defconfig | results
---------------------+------+---------------+----------+--------------------+--------
tegra124-jetson-tk1 | arm | lab-collabora | clang-9 | multi_v7_defconfig | 0/1
Details: https://staging.kernelci.org/test/plan/id/5ebc9927d3812770235afc47
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: multi_v7_defconfig
Compiler: clang-9 (clang version 9.0.1-+20191211082622+c1a0a213378-1~exp1~20191211193200.102 )
Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-tegra124-jetson-tk1.txt
HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-tegra124-jetson-tk1.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
* baseline.login: https://staging.kernelci.org/test/case/id/5ebc9927d3812770235afc48
failing since 5 days (last pass: staging-20200507.1, first fail: staging-20200507.2)
platform | arch | lab | compiler | defconfig | results
---------------------+------+---------------+----------+--------------------+--------
tegra124-jetson-tk1 | arm | lab-baylibre | gcc-8 | multi_v7_defconfig | 0/1
Details: https://staging.kernelci.org/test/plan/id/5ebc9dc223d592f42b5afc3c
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: multi_v7_defconfig
Compiler: gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-baylibre/baseline-tegra124-jetson-tk1.txt
HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-baylibre/baseline-tegra124-jetson-tk1.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
* baseline.login: https://staging.kernelci.org/test/case/id/5ebc9dc223d592f42b5afc3d
failing since 5 days (last pass: staging-20200507.1, first fail: staging-20200507.2)
platform | arch | lab | compiler | defconfig | results
---------------------+------+---------------+----------+--------------------+--------
tegra124-jetson-tk1 | arm | lab-collabora | gcc-8 | multi_v7_defconfig | 0/1
Details: https://staging.kernelci.org/test/plan/id/5ebc9dfde601dc356c5afc42
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: multi_v7_defconfig
Compiler: gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-tegra124-jetson-tk1.txt
HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-tegra124-jetson-tk1.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
* baseline.login: https://staging.kernelci.org/test/case/id/5ebc9dfde601dc356c5afc43
failing since 5 days (last pass: staging-20200507.1, first fail: staging-20200507.2)
platform | arch | lab | compiler | defconfig | results
---------------------+------+---------------+----------+--------------------+--------
tegra124-nyan-big | arm | lab-collabora | clang-9 | multi_v7_defconfig | 0/1
Details: https://staging.kernelci.org/test/plan/id/5ebc999b9f2ef087745afc49
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: multi_v7_defconfig
Compiler: clang-9 (clang version 9.0.1-+20191211082622+c1a0a213378-1~exp1~20191211193200.102 )
Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-tegra124-nyan-big.txt
HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-tegra124-nyan-big.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
* baseline.login: https://staging.kernelci.org/test/case/id/5ebc999b9f2ef087745afc4a
failing since 6 days (last pass: staging-20200507.1, first fail: staging-20200507.2)
platform | arch | lab | compiler | defconfig | results
---------------------+------+---------------+----------+--------------------+--------
tegra124-nyan-big | arm | lab-collabora | gcc-8 | multi_v7_defconfig | 0/1
Details: https://staging.kernelci.org/test/plan/id/5ebca0489a7d9a3bbe5afc45
Results: 0 PASS, 1 FAIL, 0 SKIP
Full config: multi_v7_defconfig
Compiler: gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-tegra124-nyan-big.txt
HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-tegra124-nyan-big.html
Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
* baseline.login: https://staging.kernelci.org/test/case/id/5ebca0489a7d9a3bbe5afc46
failing since 6 days (last pass: staging-20200507.1, first fail: staging-20200507.2)
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: kernelci/staging.kernelci.org baseline: 167 runs, 7 regressions (staging-20200514.0)
2020-05-14 6:55 ` kernelci/staging.kernelci.org baseline: 167 runs, 7 regressions (staging-20200514.0) Guillaume Tucker
@ 2020-05-14 14:07 ` Guenter Roeck
2020-05-14 14:27 ` Guillaume Tucker
0 siblings, 1 reply; 3+ messages in thread
From: Guenter Roeck @ 2020-05-14 14:07 UTC (permalink / raw)
To: kernelci, Guillaume Tucker
On Wed, May 13, 2020 at 11:55 PM Guillaume Tucker
<guillaume.tucker@gmail.com> wrote:
>
> Please see below an example of the reduced test email format
> which only shows regressions but also has links to all the
> results, and more details on the frontend. As a result, these
> email reports are not sent if there were no regressions.
>
> This is what is expected to be deployed in production on Monday
> to go hand-in-hand with the new web frontend. Please let us know
> if you find any issues. More sample test email reports can be
> found on the staging results mailing list:
>
> https://groups.io/g/kernelci-results-staging/topics
>
> Emails up to revision staging-20200514.0 are using the previous
> detailed format, newer reports will be like this one.
>
> Note: In this case, one same regression was found in 2 labs and
> was listed twice. This is probably something that can be
> improved in the report to avoid showing duplicated information.
> Still it's important to track it this way in the database.
>
Any chance to report the actual regression (afaics a crash in iommu code) ?
Thanks,
Guenter
> Thanks,
> Guillaume
>
>
> -------- Forwarded Message --------
> Subject: kernelci/staging.kernelci.org baseline: 167 runs, 7 regressions (staging-20200514.0)
> Date: Wed, 13 May 2020 23:44:30 -0700 (PDT)
> From: staging.kernelci.org bot <bot@kernelci.org>
> To: gtucker@collabora.com, debug011@gtucker.io
>
> kernelci/staging.kernelci.org baseline: 167 runs, 7 regressions (staging-20200514.0)
>
> Regressions Summary
> -------------------
>
> platform | arch | lab | compiler | defconfig | results
> ---------------------+------+---------------+----------+--------------------+--------
> exynos5422-odroidxu3 | arm | lab-collabora | clang-9 | multi_v7_defconfig | 0/1
> tegra124-jetson-tk1 | arm | lab-baylibre | clang-9 | multi_v7_defconfig | 0/1
> tegra124-jetson-tk1 | arm | lab-collabora | clang-9 | multi_v7_defconfig | 0/1
> tegra124-jetson-tk1 | arm | lab-baylibre | gcc-8 | multi_v7_defconfig | 0/1
> tegra124-jetson-tk1 | arm | lab-collabora | gcc-8 | multi_v7_defconfig | 0/1
> tegra124-nyan-big | arm | lab-collabora | clang-9 | multi_v7_defconfig | 0/1
> tegra124-nyan-big | arm | lab-collabora | gcc-8 | multi_v7_defconfig | 0/1
>
> Details: https://staging.kernelci.org/test/job/kernelci/branch/staging.kernelci.org/kernel/staging-20200514.0/plan/baseline/
>
> Test: baseline
> Tree: kernelci
> Branch: staging.kernelci.org
> Describe: staging-20200514.0
> URL: https://github.com/kernelci/linux.git
> SHA: a3b0fec31a5d6d3cb9c327318cd4c88fab5e28d5
>
>
> Test Regressions
> ----------------
>
>
> platform | arch | lab | compiler | defconfig | results
> ---------------------+------+---------------+----------+--------------------+--------
> exynos5422-odroidxu3 | arm | lab-collabora | clang-9 | multi_v7_defconfig | 0/1
>
> Details: https://staging.kernelci.org/test/plan/id/5ebc9a0d1f955c12235afc44
>
> Results: 0 PASS, 1 FAIL, 0 SKIP
> Full config: multi_v7_defconfig
> Compiler: clang-9 (clang version 9.0.1-+20191211082622+c1a0a213378-1~exp1~20191211193200.102 )
> Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-exynos5422-odroidxu3.txt
> HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-exynos5422-odroidxu3.html
> Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
>
> * baseline.login: https://staging.kernelci.org/test/case/id/5ebc9a0d1f955c12235afc45
> new failure (last pass: staging-20200513.1)
>
>
> platform | arch | lab | compiler | defconfig | results
> ---------------------+------+---------------+----------+--------------------+--------
> tegra124-jetson-tk1 | arm | lab-baylibre | clang-9 | multi_v7_defconfig | 0/1
>
> Details: https://staging.kernelci.org/test/plan/id/5ebc98f751b2987fcc5afc57
>
> Results: 0 PASS, 1 FAIL, 0 SKIP
> Full config: multi_v7_defconfig
> Compiler: clang-9 (clang version 9.0.1-+20191211082622+c1a0a213378-1~exp1~20191211193200.102 )
> Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-baylibre/baseline-tegra124-jetson-tk1.txt
> HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-baylibre/baseline-tegra124-jetson-tk1.html
> Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
>
> * baseline.login: https://staging.kernelci.org/test/case/id/5ebc98f751b2987fcc5afc58
> failing since 5 days (last pass: staging-20200507.1, first fail: staging-20200507.2)
>
>
> platform | arch | lab | compiler | defconfig | results
> ---------------------+------+---------------+----------+--------------------+--------
> tegra124-jetson-tk1 | arm | lab-collabora | clang-9 | multi_v7_defconfig | 0/1
>
> Details: https://staging.kernelci.org/test/plan/id/5ebc9927d3812770235afc47
>
> Results: 0 PASS, 1 FAIL, 0 SKIP
> Full config: multi_v7_defconfig
> Compiler: clang-9 (clang version 9.0.1-+20191211082622+c1a0a213378-1~exp1~20191211193200.102 )
> Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-tegra124-jetson-tk1.txt
> HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-tegra124-jetson-tk1.html
> Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
>
> * baseline.login: https://staging.kernelci.org/test/case/id/5ebc9927d3812770235afc48
> failing since 5 days (last pass: staging-20200507.1, first fail: staging-20200507.2)
>
>
> platform | arch | lab | compiler | defconfig | results
> ---------------------+------+---------------+----------+--------------------+--------
> tegra124-jetson-tk1 | arm | lab-baylibre | gcc-8 | multi_v7_defconfig | 0/1
>
> Details: https://staging.kernelci.org/test/plan/id/5ebc9dc223d592f42b5afc3c
>
> Results: 0 PASS, 1 FAIL, 0 SKIP
> Full config: multi_v7_defconfig
> Compiler: gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
> Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-baylibre/baseline-tegra124-jetson-tk1.txt
> HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-baylibre/baseline-tegra124-jetson-tk1.html
> Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
>
> * baseline.login: https://staging.kernelci.org/test/case/id/5ebc9dc223d592f42b5afc3d
> failing since 5 days (last pass: staging-20200507.1, first fail: staging-20200507.2)
>
>
> platform | arch | lab | compiler | defconfig | results
> ---------------------+------+---------------+----------+--------------------+--------
> tegra124-jetson-tk1 | arm | lab-collabora | gcc-8 | multi_v7_defconfig | 0/1
>
> Details: https://staging.kernelci.org/test/plan/id/5ebc9dfde601dc356c5afc42
>
> Results: 0 PASS, 1 FAIL, 0 SKIP
> Full config: multi_v7_defconfig
> Compiler: gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
> Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-tegra124-jetson-tk1.txt
> HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-tegra124-jetson-tk1.html
> Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
>
> * baseline.login: https://staging.kernelci.org/test/case/id/5ebc9dfde601dc356c5afc43
> failing since 5 days (last pass: staging-20200507.1, first fail: staging-20200507.2)
>
>
> platform | arch | lab | compiler | defconfig | results
> ---------------------+------+---------------+----------+--------------------+--------
> tegra124-nyan-big | arm | lab-collabora | clang-9 | multi_v7_defconfig | 0/1
>
> Details: https://staging.kernelci.org/test/plan/id/5ebc999b9f2ef087745afc49
>
> Results: 0 PASS, 1 FAIL, 0 SKIP
> Full config: multi_v7_defconfig
> Compiler: clang-9 (clang version 9.0.1-+20191211082622+c1a0a213378-1~exp1~20191211193200.102 )
> Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-tegra124-nyan-big.txt
> HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-tegra124-nyan-big.html
> Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
>
> * baseline.login: https://staging.kernelci.org/test/case/id/5ebc999b9f2ef087745afc4a
> failing since 6 days (last pass: staging-20200507.1, first fail: staging-20200507.2)
>
>
> platform | arch | lab | compiler | defconfig | results
> ---------------------+------+---------------+----------+--------------------+--------
> tegra124-nyan-big | arm | lab-collabora | gcc-8 | multi_v7_defconfig | 0/1
>
> Details: https://staging.kernelci.org/test/plan/id/5ebca0489a7d9a3bbe5afc45
>
> Results: 0 PASS, 1 FAIL, 0 SKIP
> Full config: multi_v7_defconfig
> Compiler: gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
> Plain log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-tegra124-nyan-big.txt
> HTML log: https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-tegra124-nyan-big.html
> Rootfs: http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
>
> * baseline.login: https://staging.kernelci.org/test/case/id/5ebca0489a7d9a3bbe5afc46
> failing since 6 days (last pass: staging-20200507.1, first fail: staging-20200507.2)
>
>
>
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: kernelci/staging.kernelci.org baseline: 167 runs, 7 regressions (staging-20200514.0)
2020-05-14 14:07 ` Guenter Roeck
@ 2020-05-14 14:27 ` Guillaume Tucker
0 siblings, 0 replies; 3+ messages in thread
From: Guillaume Tucker @ 2020-05-14 14:27 UTC (permalink / raw)
To: Guenter Roeck; +Cc: kernelci
On Thu, May 14, 2020 at 3:07 PM Guenter Roeck <groeck@google.com> wrote:
> On Wed, May 13, 2020 at 11:55 PM Guillaume Tucker
> <guillaume.tucker@gmail.com> wrote:
> >
> > Please see below an example of the reduced test email format
> > which only shows regressions but also has links to all the
> > results, and more details on the frontend. As a result, these
> > email reports are not sent if there were no regressions.
> >
> > This is what is expected to be deployed in production on Monday
> > to go hand-in-hand with the new web frontend. Please let us know
> > if you find any issues. More sample test email reports can be
> > found on the staging results mailing list:
> >
> > https://groups.io/g/kernelci-results-staging/topics
> >
> > Emails up to revision staging-20200514.0 are using the previous
> > detailed format, newer reports will be like this one.
> >
> > Note: In this case, one same regression was found in 2 labs and
> > was listed twice. This is probably something that can be
> > improved in the report to avoid showing duplicated information.
> > Still it's important to track it this way in the database.
> >
>
> Any chance to report the actual regression (afaics a crash in iommu code) ?
Yes, there are some pending changes to show the lines from the
log associated with each test case. Kernel errors are currently
only checked with dmesg at runtime on the device so it will not
cover crashes before reaching a login prompt. Some more specific
log parsing can also be done when post-processing the logs in the
backend, to detect earlier kernel crashes, but that will come as
a follow-up once the general case has been implemented.
Guillaume
> > -------- Forwarded Message --------
> > Subject: kernelci/staging.kernelci.org baseline: 167 runs, 7
> regressions (staging-20200514.0)
> > Date: Wed, 13 May 2020 23:44:30 -0700 (PDT)
> > From: staging.kernelci.org bot <bot@kernelci.org>
> > To: gtucker@collabora.com, debug011@gtucker.io
> >
> > kernelci/staging.kernelci.org baseline: 167 runs, 7 regressions
> (staging-20200514.0)
> >
> > Regressions Summary
> > -------------------
> >
> > platform | arch | lab | compiler | defconfig
> | results
> >
> ---------------------+------+---------------+----------+--------------------+--------
> > exynos5422-odroidxu3 | arm | lab-collabora | clang-9 |
> multi_v7_defconfig | 0/1
> > tegra124-jetson-tk1 | arm | lab-baylibre | clang-9 |
> multi_v7_defconfig | 0/1
> > tegra124-jetson-tk1 | arm | lab-collabora | clang-9 |
> multi_v7_defconfig | 0/1
> > tegra124-jetson-tk1 | arm | lab-baylibre | gcc-8 |
> multi_v7_defconfig | 0/1
> > tegra124-jetson-tk1 | arm | lab-collabora | gcc-8 |
> multi_v7_defconfig | 0/1
> > tegra124-nyan-big | arm | lab-collabora | clang-9 |
> multi_v7_defconfig | 0/1
> > tegra124-nyan-big | arm | lab-collabora | gcc-8 |
> multi_v7_defconfig | 0/1
> >
> > Details:
> https://staging.kernelci.org/test/job/kernelci/branch/staging.kernelci.org/kernel/staging-20200514.0/plan/baseline/
> >
> > Test: baseline
> > Tree: kernelci
> > Branch: staging.kernelci.org
> > Describe: staging-20200514.0
> > URL: https://github.com/kernelci/linux.git
> > SHA: a3b0fec31a5d6d3cb9c327318cd4c88fab5e28d5
> >
> >
> > Test Regressions
> > ----------------
> >
> >
> > platform | arch | lab | compiler | defconfig
> | results
> >
> ---------------------+------+---------------+----------+--------------------+--------
> > exynos5422-odroidxu3 | arm | lab-collabora | clang-9 |
> multi_v7_defconfig | 0/1
> >
> > Details:
> https://staging.kernelci.org/test/plan/id/5ebc9a0d1f955c12235afc44
> >
> > Results: 0 PASS, 1 FAIL, 0 SKIP
> > Full config: multi_v7_defconfig
> > Compiler: clang-9 (clang version
> 9.0.1-+20191211082622+c1a0a213378-1~exp1~20191211193200.102 )
> > Plain log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-exynos5422-odroidxu3.txt
> > HTML log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-exynos5422-odroidxu3.html
> > Rootfs:
> http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
> >
> > * baseline.login:
> https://staging.kernelci.org/test/case/id/5ebc9a0d1f955c12235afc45
> > new failure (last pass: staging-20200513.1)
> >
> >
> > platform | arch | lab | compiler | defconfig
> | results
> >
> ---------------------+------+---------------+----------+--------------------+--------
> > tegra124-jetson-tk1 | arm | lab-baylibre | clang-9 |
> multi_v7_defconfig | 0/1
> >
> > Details:
> https://staging.kernelci.org/test/plan/id/5ebc98f751b2987fcc5afc57
> >
> > Results: 0 PASS, 1 FAIL, 0 SKIP
> > Full config: multi_v7_defconfig
> > Compiler: clang-9 (clang version
> 9.0.1-+20191211082622+c1a0a213378-1~exp1~20191211193200.102 )
> > Plain log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-baylibre/baseline-tegra124-jetson-tk1.txt
> > HTML log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-baylibre/baseline-tegra124-jetson-tk1.html
> > Rootfs:
> http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
> >
> > * baseline.login:
> https://staging.kernelci.org/test/case/id/5ebc98f751b2987fcc5afc58
> > failing since 5 days (last pass: staging-20200507.1, first fail:
> staging-20200507.2)
> >
> >
> > platform | arch | lab | compiler | defconfig
> | results
> >
> ---------------------+------+---------------+----------+--------------------+--------
> > tegra124-jetson-tk1 | arm | lab-collabora | clang-9 |
> multi_v7_defconfig | 0/1
> >
> > Details:
> https://staging.kernelci.org/test/plan/id/5ebc9927d3812770235afc47
> >
> > Results: 0 PASS, 1 FAIL, 0 SKIP
> > Full config: multi_v7_defconfig
> > Compiler: clang-9 (clang version
> 9.0.1-+20191211082622+c1a0a213378-1~exp1~20191211193200.102 )
> > Plain log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-tegra124-jetson-tk1.txt
> > HTML log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-tegra124-jetson-tk1.html
> > Rootfs:
> http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
> >
> > * baseline.login:
> https://staging.kernelci.org/test/case/id/5ebc9927d3812770235afc48
> > failing since 5 days (last pass: staging-20200507.1, first fail:
> staging-20200507.2)
> >
> >
> > platform | arch | lab | compiler | defconfig
> | results
> >
> ---------------------+------+---------------+----------+--------------------+--------
> > tegra124-jetson-tk1 | arm | lab-baylibre | gcc-8 |
> multi_v7_defconfig | 0/1
> >
> > Details:
> https://staging.kernelci.org/test/plan/id/5ebc9dc223d592f42b5afc3c
> >
> > Results: 0 PASS, 1 FAIL, 0 SKIP
> > Full config: multi_v7_defconfig
> > Compiler: gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
> > Plain log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-baylibre/baseline-tegra124-jetson-tk1.txt
> > HTML log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-baylibre/baseline-tegra124-jetson-tk1.html
> > Rootfs:
> http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
> >
> > * baseline.login:
> https://staging.kernelci.org/test/case/id/5ebc9dc223d592f42b5afc3d
> > failing since 5 days (last pass: staging-20200507.1, first fail:
> staging-20200507.2)
> >
> >
> > platform | arch | lab | compiler | defconfig
> | results
> >
> ---------------------+------+---------------+----------+--------------------+--------
> > tegra124-jetson-tk1 | arm | lab-collabora | gcc-8 |
> multi_v7_defconfig | 0/1
> >
> > Details:
> https://staging.kernelci.org/test/plan/id/5ebc9dfde601dc356c5afc42
> >
> > Results: 0 PASS, 1 FAIL, 0 SKIP
> > Full config: multi_v7_defconfig
> > Compiler: gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
> > Plain log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-tegra124-jetson-tk1.txt
> > HTML log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-tegra124-jetson-tk1.html
> > Rootfs:
> http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
> >
> > * baseline.login:
> https://staging.kernelci.org/test/case/id/5ebc9dfde601dc356c5afc43
> > failing since 5 days (last pass: staging-20200507.1, first fail:
> staging-20200507.2)
> >
> >
> > platform | arch | lab | compiler | defconfig
> | results
> >
> ---------------------+------+---------------+----------+--------------------+--------
> > tegra124-nyan-big | arm | lab-collabora | clang-9 |
> multi_v7_defconfig | 0/1
> >
> > Details:
> https://staging.kernelci.org/test/plan/id/5ebc999b9f2ef087745afc49
> >
> > Results: 0 PASS, 1 FAIL, 0 SKIP
> > Full config: multi_v7_defconfig
> > Compiler: clang-9 (clang version
> 9.0.1-+20191211082622+c1a0a213378-1~exp1~20191211193200.102 )
> > Plain log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-tegra124-nyan-big.txt
> > HTML log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/clang-9/lab-collabora/baseline-tegra124-nyan-big.html
> > Rootfs:
> http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
> >
> > * baseline.login:
> https://staging.kernelci.org/test/case/id/5ebc999b9f2ef087745afc4a
> > failing since 6 days (last pass: staging-20200507.1, first fail:
> staging-20200507.2)
> >
> >
> > platform | arch | lab | compiler | defconfig
> | results
> >
> ---------------------+------+---------------+----------+--------------------+--------
> > tegra124-nyan-big | arm | lab-collabora | gcc-8 |
> multi_v7_defconfig | 0/1
> >
> > Details:
> https://staging.kernelci.org/test/plan/id/5ebca0489a7d9a3bbe5afc45
> >
> > Results: 0 PASS, 1 FAIL, 0 SKIP
> > Full config: multi_v7_defconfig
> > Compiler: gcc-8 (arm-linux-gnueabihf-gcc (Debian 8.3.0-2) 8.3.0)
> > Plain log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-tegra124-nyan-big.txt
> > HTML log:
> https://storage.staging.kernelci.org//kernelci/staging.kernelci.org/staging-20200514.0/arm/multi_v7_defconfig/gcc-8/lab-collabora/baseline-tegra124-nyan-big.html
> > Rootfs:
> http://storage.kernelci.org/images/rootfs/buildroot/kci-2019.02-11-g17e793fa4728/armel/baseline/rootfs.cpio.gz
> >
> > * baseline.login:
> https://staging.kernelci.org/test/case/id/5ebca0489a7d9a3bbe5afc46
> > failing since 6 days (last pass: staging-20200507.1, first fail:
> staging-20200507.2)
> >
> >
> >
>
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2020-05-14 14:27 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
[not found] <5ebce8ce.1c69fb81.c274.4b92@mx.google.com>
2020-05-14 6:55 ` kernelci/staging.kernelci.org baseline: 167 runs, 7 regressions (staging-20200514.0) Guillaume Tucker
2020-05-14 14:07 ` Guenter Roeck
2020-05-14 14:27 ` Guillaume Tucker
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.