All of lore.kernel.org
 help / color / mirror / Atom feed
* QA cycle report for 2.7 M3 RC1
@ 2019-04-02  5:02 Jain, Sangeeta
  2019-04-02 10:11 ` Jain, Sangeeta
  2019-04-02 18:32 ` richard.purdie
  0 siblings, 2 replies; 5+ messages in thread
From: Jain, Sangeeta @ 2019-04-02  5:02 UTC (permalink / raw)
  To: 'yocto@yoctoproject.org',
	Eggleton, Paul, richard.purdie, 'Michael Halstead',
	Erway, Tracey M, sjolley.yp.pm
  Cc: OTC Embedded Malaysia


[-- Attachment #1.1: Type: text/plain, Size: 3019 bytes --]

QA cycle report for 2.7 M3 RC1:



  1.  No high milestone defects.
  2.  This is completion of first QA cycle after adoption of new QA process. Test results are available at following location:

*        For results of all automated tests, please refer to results at public AB [1].

*        For other test results, refer to attachment [2].

*        For test report for test cases run by Intel and WR team, refer attachment [3]

*        For full test report, refer attachment [4]

  1.  2 new defects are found in this cycle, oe-selftest [5] and qemu-shutdown[6].
  2.  Number of existing issues observed in this release is 3- toaster [7], Build-appliance [8] and Beaglebone [9]
  3.  For ptest, 3 package tests are failing in this release which were passing in previous release: python [10], python3[11] and strace[12]. 3 packages are facing timeout issues: lttng-tools [13], openssh [14] and python3 [15].



======= Links ========



Link to testresults:



[1] - https://autobuilder.yocto.io/pub/releases/yocto-2.7_M3.rc1/testresults/



[2] - 2.7_M3_RC1_results_merged.zip



[3] - 2.7_m3_rc1_intel_wr_merged_report



[4] - 2.7_m3_rc1_full_report



New Bugs :


[5] Bug 13237 - [2.7 M3 RC1][OE-selftest][Opensuseleap 15.0][Public AB]:"test_wic_cp_ext" failing for Opensuseleap 15.0.
https://bugzilla.yoctoproject.org/show_bug.cgi?id=13237

[6] Bug 13234 - [2.7 M3 RC1] qemumips & qemumips64: failed to shutdown
https://bugzilla.yoctoproject.org/show_bug.cgi?id=13234



Previous Bugs observed in this release:



[7] Bug 13191 - [Test Case 1439] Build Failure after adding or removing packages with and without dependencies

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13191



[8] Bug 12991<https://bugzilla.yoctoproject.org/show_bug.cgi?id=12991> - [Bug] [2.6 M4 RC1][Build-Appliance] Bitbake build-appliance-image getting failed during building image due to webkitgtk package.

https://bugzilla.yoctoproject.org/show_bug.cgi?id=12991



[9] Bug 13153 - [2.7 M2 RC1] Systemtap doesn't work on beaglebone

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13153



ptest Bugs:



[10] Bug 13249 - [2.7 M3 RC1] python ptest failure

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13249



[11] Bug 13253<https://bugzilla.yoctoproject.org/show_bug.cgi?id=12991> - [2.7 M3 RC1] python3 ptest failure

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13253



[12] Bug 13254 - [2.7 M3 RC1] strace ptest failure

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13254



[13] Bug 13255 - [2.7 M3 rc1] lttng-tools ptest facing timeout issue

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13255



[14] Bug 13256 - [2.7 M3 rc1] openssh ptest facing timeout issue

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13256



[15] Bug 13257 - [2.7 M3 rc1] python3 ptest facing timeout issue

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13257


Thanks & Regards,
Sangeeta Jain


[-- Attachment #1.2: Type: text/html, Size: 16721 bytes --]

[-- Attachment #2: 2.7_m3_rc1_full_report --]
[-- Type: application/octet-stream, Size: 96009 bytes --]

==============================================================================================================
Test Result Status Summary (Counts/Percentages sorted by testseries, ID)
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
Test Series        | ID                                                           | Passed      | Failed   | Skipped  
--------------------------------------------------------------------------------------------------------------
a-full             | oeselftest_ubuntu-18.04_qemux86_20190320000043               | 1 (100%)    | 0 (0%)   | 0 (0%)   
a-quick            | oeselftest_ubuntu-16.04_qemux86_20190321010316               | 1 (100%)    | 0 (0%)   | 0 (0%)   
a-quick            | oeselftest_ubuntu-18.04_qemux86_20190320010256               | 1 (100%)    | 0 (0%)   | 0 (0%)   
beaglebone         | manual_bsps-hw_20190325085141                                | 22 (48%)    | 0 (0%)   | 24 (52%) 
beaglebone         | manual_compliance-test_20190326135217                        | 4 (67%)     | 0 (0%)   | 2 (33%)  
beaglebone         | runtime_core-image-sato-sdk_beaglebone-yocto_20190322023018  | 46 (77%)    | 2 (3%)   | 12 (20%) 
beaglebone         | sdk_core-image-sato_i686_beaglebone-yocto_20190320003619     | 11 (92%)    | 0 (0%)   | 1 (8%)   
beaglebone         | sdk_core-image-sato_i686_beaglebone-yocto_20190320012809     | 11 (92%)    | 0 (0%)   | 1 (8%)   
beaglebone         | sdk_core-image-sato_i686_beaglebone-yocto_20190321012126     | 11 (92%)    | 0 (0%)   | 1 (8%)   
bitbake            | manual_oe-core_20190321085120                                | 7 (100%)    | 0 (0%)   | 0 (0%)   
build-appliance    | manual_build-appliance_20190328132020                        | 1 (33%)     | 1 (33%)  | 1 (33%)  
crops              | sdkext_core-image-sato-sdk_x86_64_qemux86_20190325045401     | 17 (81%)    | 0 (0%)   | 4 (19%)  
eclipse-plugin     | manual_eclipse-plugin_20190326132957                         | 6 (100%)    | 0 (0%)   | 0 (0%)   
eclipse-plugin     | manual_eclipse-plugin_20190326170756                         | 6 (100%)    | 0 (0%)   | 0 (0%)   
edgerouter         | manual_bsps-hw_20190325101748                                | 11 (24%)    | 0 (0%)   | 35 (76%) 
edgerouter         | manual_compliance-test_20190326135938                        | 2 (33%)     | 0 (0%)   | 4 (67%)  
edgerouter         | runtime_core-image-sato-sdk_edgerouter_20190321002604        | 45 (75%)    | 3 (5%)   | 12 (20%) 
edgerouter         | sdk_core-image-sato_i686_edgerouter_20190320003659           | 11 (92%)    | 0 (0%)   | 1 (8%)   
edgerouter         | sdk_core-image-sato_i686_edgerouter_20190320014349           | 11 (92%)    | 0 (0%)   | 1 (8%)   
edgerouter         | sdk_core-image-sato_i686_edgerouter_20190321011621           | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86-64      | sdk_core-image-sato_i686_genericx86-64_20190320004116        | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86-64      | sdk_core-image-sato_i686_genericx86-64_20190320012810        | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86-64      | sdk_core-image-sato_i686_genericx86-64_20190321014104        | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86         | sdk_core-image-sato_i686_genericx86_20190320004117           | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86         | sdk_core-image-sato_i686_genericx86_20190320015758           | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86         | sdk_core-image-sato_i686_genericx86_20190321012453           | 11 (92%)    | 0 (0%)   | 1 (8%)   
kernel-dev         | manual_kernel-dev_20190321132956                             | 9 (100%)    | 0 (0%)   | 0 (0%)   
meta-mingw         | sdk_core-image-minimal_x86_64-mingw32_qemux86_20190320001222 | 13 (100%)   | 0 (0%)   | 0 (0%)   
meta-mingw         | sdk_core-image-minimal_x86_64-mingw32_qemux86_20190320011132 | 13 (100%)   | 0 (0%)   | 0 (0%)   
meta-mingw         | sdk_core-image-minimal_x86_64-mingw32_qemux86_20190321011834 | 13 (100%)   | 0 (0%)   | 0 (0%)   
minnowboard        | manual_bsps-hw_20190322172915                                | 46 (100%)   | 0 (0%)   | 0 (0%)   
minnowboard        | runtime_core-image-lsb-sdk_genericx86-64_20190323060918      | 47 (78%)    | 0 (0%)   | 13 (22%) 
minnowboard        | runtime_core-image-lsb-sdk_genericx86_20190323091640         | 47 (78%)    | 0 (0%)   | 13 (22%) 
minnowboard        | runtime_core-image-sato-sdk_genericx86-64_20190322072832     | 48 (80%)    | 0 (0%)   | 12 (20%) 
minnowboard        | runtime_core-image-sato-sdk_genericx86_20190323072551        | 48 (80%)    | 0 (0%)   | 12 (20%) 
mpc8315e-rdb       | manual_bsps-hw_20190325093903                                | 15 (33%)    | 0 (0%)   | 31 (67%) 
mpc8315e-rdb       | manual_compliance-test_20190326135811                        | 2 (33%)     | 0 (0%)   | 4 (67%)  
mpc8315e-rdb       | runtime_core-image-sato-sdk_mpc8315e-rdb_20190321011257      | 47 (78%)    | 1 (2%)   | 12 (20%) 
mpc8315e-rdb       | sdk_core-image-sato_i686_mpc8315e-rdb_20190320011448         | 11 (92%)    | 0 (0%)   | 1 (8%)   
mpc8315e-rdb       | sdk_core-image-sato_i686_mpc8315e-rdb_20190320014404         | 11 (92%)    | 0 (0%)   | 1 (8%)   
mpc8315e-rdb       | sdk_core-image-sato_i686_mpc8315e-rdb_20190321015124         | 11 (92%)    | 0 (0%)   | 1 (8%)   
multilib           | runtime_core-image-minimal_qemumips64_20190320010845         | 1 (2%)      | 0 (0%)   | 56 (98%) 
multilib           | runtime_core-image-minimal_qemumips64_20190320015007         | 1 (2%)      | 0 (0%)   | 56 (98%) 
multilib           | runtime_core-image-minimal_qemumips64_20190321013835         | 1 (2%)      | 0 (0%)   | 56 (98%) 
multilib           | runtime_core-image-sato_qemux86-64_20190320004209            | 36 (58%)    | 0 (0%)   | 26 (42%) 
multilib           | runtime_core-image-sato_qemux86-64_20190320004656            | 15 (24%)    | 0 (0%)   | 47 (76%) 
multilib           | runtime_core-image-sato_qemux86-64_20190320012355            | 36 (58%)    | 0 (0%)   | 26 (42%) 
multilib           | runtime_core-image-sato_qemux86-64_20190320012736            | 15 (24%)    | 0 (0%)   | 47 (76%) 
multilib           | runtime_core-image-sato_qemux86-64_20190321011838            | 36 (58%)    | 0 (0%)   | 26 (42%) 
multilib           | runtime_core-image-sato_qemux86-64_20190321012312            | 15 (24%)    | 0 (0%)   | 47 (76%) 
multilib           | runtime_lib32-core-image-minimal_qemux86-64_20190320001649   | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib           | runtime_lib32-core-image-minimal_qemux86-64_20190320001854   | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib           | runtime_lib32-core-image-minimal_qemux86-64_20190320010717   | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib           | runtime_lib32-core-image-minimal_qemux86-64_20190320010828   | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib           | runtime_lib32-core-image-minimal_qemux86-64_20190321011048   | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib           | runtime_lib32-core-image-minimal_qemux86-64_20190321011222   | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib           | sdk_core-image-minimal_x86_64_qemumips64_20190320010845      | 10 (83%)    | 0 (0%)   | 2 (17%)  
multilib           | sdk_core-image-minimal_x86_64_qemumips64_20190320015007      | 10 (83%)    | 0 (0%)   | 2 (17%)  
multilib           | sdk_core-image-minimal_x86_64_qemumips64_20190321013835      | 10 (83%)    | 0 (0%)   | 2 (17%)  
musl-qemux86-64    | runtime_core-image-full-cmdline_qemux86-64_20190320014601    | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86-64    | runtime_core-image-full-cmdline_qemux86-64_20190320014906    | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86-64    | runtime_core-image-full-cmdline_qemux86-64_20190321012326    | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86-64    | runtime_core-image-minimal_qemux86-64_20190320014601         | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86-64    | runtime_core-image-minimal_qemux86-64_20190320014906         | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86-64    | runtime_core-image-minimal_qemux86-64_20190321012326         | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86-64    | runtime_core-image-sato-sdk_qemux86-64_20190320014601        | 46 (78%)    | 0 (0%)   | 13 (22%) 
musl-qemux86-64    | runtime_core-image-sato-sdk_qemux86-64_20190320014906        | 46 (78%)    | 0 (0%)   | 13 (22%) 
musl-qemux86-64    | runtime_core-image-sato-sdk_qemux86-64_20190321012326        | 46 (78%)    | 0 (0%)   | 13 (22%) 
musl-qemux86       | runtime_core-image-full-cmdline_qemux86_20190320005951       | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86       | runtime_core-image-full-cmdline_qemux86_20190320014618       | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86       | runtime_core-image-full-cmdline_qemux86_20190321011714       | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86       | runtime_core-image-minimal_qemux86_20190320005951            | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86       | runtime_core-image-minimal_qemux86_20190320014618            | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86       | runtime_core-image-minimal_qemux86_20190321011714            | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86       | runtime_core-image-sato-sdk_qemux86_20190320005951           | 46 (78%)    | 0 (0%)   | 13 (22%) 
musl-qemux86       | runtime_core-image-sato-sdk_qemux86_20190320014618           | 46 (78%)    | 0 (0%)   | 13 (22%) 
musl-qemux86       | runtime_core-image-sato-sdk_qemux86_20190321011714           | 46 (78%)    | 0 (0%)   | 13 (22%) 
no-x11             | runtime_core-image-full-cmdline_qemux86-64_20190320003507    | 12 (20%)    | 0 (0%)   | 48 (80%) 
no-x11             | runtime_core-image-full-cmdline_qemux86-64_20190320014341    | 12 (20%)    | 0 (0%)   | 48 (80%) 
no-x11             | runtime_core-image-full-cmdline_qemux86-64_20190321011912    | 12 (20%)    | 0 (0%)   | 48 (80%) 
no-x11             | runtime_core-image-weston_qemux86-64_20190320003507          | 32 (53%)    | 0 (0%)   | 28 (47%) 
no-x11             | runtime_core-image-weston_qemux86-64_20190320014341          | 32 (53%)    | 0 (0%)   | 28 (47%) 
no-x11             | runtime_core-image-weston_qemux86-64_20190321011912          | 32 (53%)    | 0 (0%)   | 28 (47%) 
nuc6               | manual_compliance-test_20190327151229                        | 4 (67%)     | 0 (0%)   | 2 (33%)  
nuc6               | runtime_core-image-lsb-sdk_genericx86-64_20190325064425      | 47 (78%)    | 0 (0%)   | 13 (22%) 
nuc6               | runtime_core-image-sato-sdk_genericx86-64_20190325021647     | 48 (80%)    | 0 (0%)   | 12 (20%) 
nuc7               | manual_bsps-hw_20190321143341                                | 46 (100%)   | 0 (0%)   | 0 (0%)   
nuc7               | runtime_core-image-lsb-sdk_genericx86-64_20190322031806      | 47 (78%)    | 0 (0%)   | 13 (22%) 
nuc7               | runtime_core-image-sato-sdk_genericx86-64_20190322051029     | 48 (80%)    | 0 (0%)   | 12 (20%) 
oe-selftest-centos | oeselftest_centos-7_qemux86-64_20190320000812                | 343 (99%)   | 0 (0%)   | 3 (1%)   
oe-selftest-debian | oeselftest_debian-8_qemux86-64_20190320000813                | 342 (99%)   | 0 (0%)   | 4 (1%)   
oe-selftest-fedora | oeselftest_fedora-28_qemux86-64_20190320000756               | 343 (99%)   | 0 (0%)   | 3 (1%)   
oe-selftest-ubuntu | oeselftest_ubuntu-16.04_qemux86-64_20190320000741            | 343 (99%)   | 0 (0%)   | 3 (1%)   
oe-selftest        | oeselftest_opensuseleap-15.0_qemux86-64_20190320011444       | 342 (99%)   | 1 (0%)   | 3 (1%)   
oe-selftest        | oeselftest_ubuntu-18.04_qemux86-64_20190321011956            | 343 (99%)   | 0 (0%)   | 3 (1%)   
pkgman-deb-non-deb | runtime_core-image-minimal_qemux86_20190320004108            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-deb-non-deb | runtime_core-image-minimal_qemux86_20190320013439            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-deb-non-deb | runtime_core-image-minimal_qemux86_20190321012732            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-deb-non-deb | runtime_core-image-sato-sdk_qemux86_20190320004108           | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-deb-non-deb | runtime_core-image-sato-sdk_qemux86_20190320013439           | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-deb-non-deb | runtime_core-image-sato-sdk_qemux86_20190321012732           | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-deb-non-deb | runtime_core-image-sato_qemux86_20190320004108               | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-deb-non-deb | runtime_core-image-sato_qemux86_20190320013439               | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-deb-non-deb | runtime_core-image-sato_qemux86_20190321012732               | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-non-rpm     | runtime_core-image-minimal_qemux86_20190320003415            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm     | runtime_core-image-minimal_qemux86_20190320004631            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm     | runtime_core-image-minimal_qemux86_20190320013118            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm     | runtime_core-image-minimal_qemux86_20190320015302            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm     | runtime_core-image-minimal_qemux86_20190321012600            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm     | runtime_core-image-minimal_qemux86_20190321013528            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm     | runtime_core-image-sato-sdk_qemux86_20190320003415           | 30 (50%)    | 0 (0%)   | 30 (50%) 
pkgman-non-rpm     | runtime_core-image-sato-sdk_qemux86_20190320004631           | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-non-rpm     | runtime_core-image-sato-sdk_qemux86_20190320013118           | 30 (50%)    | 0 (0%)   | 30 (50%) 
pkgman-non-rpm     | runtime_core-image-sato-sdk_qemux86_20190320015302           | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-non-rpm     | runtime_core-image-sato-sdk_qemux86_20190321012600           | 30 (50%)    | 0 (0%)   | 30 (50%) 
pkgman-non-rpm     | runtime_core-image-sato-sdk_qemux86_20190321013528           | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-non-rpm     | runtime_core-image-sato_qemux86_20190320003415               | 14 (23%)    | 0 (0%)   | 46 (77%) 
pkgman-non-rpm     | runtime_core-image-sato_qemux86_20190320004631               | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-non-rpm     | runtime_core-image-sato_qemux86_20190320013118               | 14 (23%)    | 0 (0%)   | 46 (77%) 
pkgman-non-rpm     | runtime_core-image-sato_qemux86_20190320015302               | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-non-rpm     | runtime_core-image-sato_qemux86_20190321012600               | 14 (23%)    | 0 (0%)   | 46 (77%) 
pkgman-non-rpm     | runtime_core-image-sato_qemux86_20190321013528               | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-rpm-non-rpm | runtime_core-image-minimal_qemux86_20190320003248            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-rpm-non-rpm | runtime_core-image-minimal_qemux86_20190320012838            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-rpm-non-rpm | runtime_core-image-minimal_qemux86_20190321012649            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-rpm-non-rpm | runtime_core-image-sato-sdk_qemux86_20190320003248           | 48 (80%)    | 0 (0%)   | 12 (20%) 
pkgman-rpm-non-rpm | runtime_core-image-sato-sdk_qemux86_20190320012838           | 48 (80%)    | 0 (0%)   | 12 (20%) 
pkgman-rpm-non-rpm | runtime_core-image-sato-sdk_qemux86_20190321012649           | 48 (80%)    | 0 (0%)   | 12 (20%) 
pkgman-rpm-non-rpm | runtime_core-image-sato_qemux86_20190320003248               | 35 (58%)    | 0 (0%)   | 25 (42%) 
pkgman-rpm-non-rpm | runtime_core-image-sato_qemux86_20190320012838               | 35 (58%)    | 0 (0%)   | 25 (42%) 
pkgman-rpm-non-rpm | runtime_core-image-sato_qemux86_20190321012649               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320003634            | 37 (62%)    | 0 (0%)   | 23 (38%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320004750            | 36 (60%)    | 0 (0%)   | 24 (40%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320005031            | 37 (60%)    | 0 (0%)   | 25 (40%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320010218            | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320010519            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320012341            | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320014406            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320022514            | 37 (62%)    | 0 (0%)   | 23 (38%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320023747            | 36 (60%)    | 0 (0%)   | 24 (40%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320024047            | 37 (60%)    | 0 (0%)   | 25 (40%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320025417            | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320025715            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320031056            | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320032557            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321014704            | 37 (62%)    | 0 (0%)   | 23 (38%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321015016            | 36 (60%)    | 0 (0%)   | 24 (40%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321015322            | 37 (60%)    | 0 (0%)   | 25 (40%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321015747            | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321020036            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321020443            | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321021008            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemu-shutdown      | oeselftest_ubuntu-16.04_qemuarm64_20190322141035             | 2 (100%)    | 0 (0%)   | 0 (0%)   
qemu-shutdown      | oeselftest_ubuntu-16.04_qemuarm_20190321134048               | 2 (100%)    | 0 (0%)   | 0 (0%)   
qemu-shutdown      | oeselftest_ubuntu-16.04_qemumips64_20190321162351            | 0 (0%)      | 2 (100%) | 0 (0%)   
qemu-shutdown      | oeselftest_ubuntu-16.04_qemumips_20190322103433              | 0 (0%)      | 2 (100%) | 0 (0%)   
qemu-shutdown      | oeselftest_ubuntu-16.04_qemuppc_20190322160004               | 2 (100%)    | 0 (0%)   | 0 (0%)   
qemu-shutdown      | oeselftest_ubuntu-16.04_qemux86-64_20190321174637            | 2 (100%)    | 0 (0%)   | 0 (0%)   
qemu-shutdown      | oeselftest_ubuntu-16.04_qemux86_20190321170535               | 2 (100%)    | 0 (0%)   | 0 (0%)   
qemuarm-lsb        | runtime_core-image-lsb-sdk_qemuarm_20190320004525            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemuarm-lsb        | runtime_core-image-lsb-sdk_qemuarm_20190320013902            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemuarm-lsb        | runtime_core-image-lsb-sdk_qemuarm_20190321013341            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemuarm-lsb        | runtime_core-image-lsb_qemuarm_20190320004525                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm-lsb        | runtime_core-image-lsb_qemuarm_20190320013902                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm-lsb        | runtime_core-image-lsb_qemuarm_20190321013341                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm64          | manual_bsps-qemu_20190326165610                              | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemuarm64          | runtime_core-image-minimal_qemuarm64_20190320003103          | 1 (2%)      | 0 (0%)   | 58 (98%) 
qemuarm64          | runtime_core-image-minimal_qemuarm64_20190320013055          | 1 (2%)      | 0 (0%)   | 58 (98%) 
qemuarm64          | runtime_core-image-minimal_qemuarm64_20190321013017          | 1 (2%)      | 0 (0%)   | 58 (98%) 
qemuarm64          | runtime_core-image-sato-sdk_qemuarm64_20190320003103         | 47 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm64          | runtime_core-image-sato-sdk_qemuarm64_20190320013055         | 47 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm64          | runtime_core-image-sato-sdk_qemuarm64_20190321013017         | 47 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm64          | runtime_core-image-sato_qemuarm64_20190320003103             | 34 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm64          | runtime_core-image-sato_qemuarm64_20190320013055             | 34 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm64          | runtime_core-image-sato_qemuarm64_20190321013017             | 34 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm64          | sdk_core-image-sato_i686_qemuarm64_20190320003103            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64          | sdk_core-image-sato_i686_qemuarm64_20190320013055            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64          | sdk_core-image-sato_i686_qemuarm64_20190321013017            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64          | sdk_core-image-sato_x86_64_qemuarm64_20190320013337          | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64          | sdk_core-image-sato_x86_64_qemuarm64_20190320023024          | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64          | sdk_core-image-sato_x86_64_qemuarm64_20190321022038          | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64          | sdkext_core-image-minimal_x86_64_qemuarm64_20190320013337    | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm64          | sdkext_core-image-minimal_x86_64_qemuarm64_20190320023024    | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm64          | sdkext_core-image-minimal_x86_64_qemuarm64_20190321022038    | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm64          | sdkext_core-image-sato_x86_64_qemuarm64_20190320013337       | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm64          | sdkext_core-image-sato_x86_64_qemuarm64_20190320023024       | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm64          | sdkext_core-image-sato_x86_64_qemuarm64_20190321022038       | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm            | manual_bsps-qemu_20190326165419                              | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemuarm            | runtime_core-image-minimal_qemuarm_20190320002906            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuarm            | runtime_core-image-minimal_qemuarm_20190320013652            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuarm            | runtime_core-image-minimal_qemuarm_20190321013347            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuarm            | runtime_core-image-sato-sdk_qemuarm_20190320002906           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm            | runtime_core-image-sato-sdk_qemuarm_20190320013652           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm            | runtime_core-image-sato-sdk_qemuarm_20190321013347           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm            | runtime_core-image-sato_qemuarm_20190320002906               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm            | runtime_core-image-sato_qemuarm_20190320013652               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm            | runtime_core-image-sato_qemuarm_20190321013347               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm            | sdk_core-image-sato_i686_qemuarm_20190320002906              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm            | sdk_core-image-sato_i686_qemuarm_20190320013652              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm            | sdk_core-image-sato_i686_qemuarm_20190321013347              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm            | sdk_core-image-sato_x86_64_qemuarm_20190320013802            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm            | sdk_core-image-sato_x86_64_qemuarm_20190320023307            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm            | sdk_core-image-sato_x86_64_qemuarm_20190321023313            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm            | sdkext_core-image-minimal_x86_64_qemuarm_20190320013802      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm            | sdkext_core-image-minimal_x86_64_qemuarm_20190320023307      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm            | sdkext_core-image-minimal_x86_64_qemuarm_20190321023313      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm            | sdkext_core-image-sato_x86_64_qemuarm_20190320013802         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm            | sdkext_core-image-sato_x86_64_qemuarm_20190320023307         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm            | sdkext_core-image-sato_x86_64_qemuarm_20190321023313         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips-lsb       | runtime_core-image-lsb-sdk_qemumips_20190320005905           | 44 (77%)    | 0 (0%)   | 13 (23%) 
qemumips-lsb       | runtime_core-image-lsb_qemumips_20190320005905               | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips64         | manual_bsps-qemu_20190326170202                              | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemumips64         | runtime_core-image-minimal_qemumips64_20190320002442         | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips64         | runtime_core-image-minimal_qemumips64_20190320015340         | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips64         | runtime_core-image-minimal_qemumips64_20190321011857         | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips64         | runtime_core-image-sato-sdk_qemumips64_20190320002442        | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips64         | runtime_core-image-sato-sdk_qemumips64_20190320015340        | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips64         | runtime_core-image-sato-sdk_qemumips64_20190321011857        | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips64         | runtime_core-image-sato_qemumips64_20190320002442            | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips64         | runtime_core-image-sato_qemumips64_20190320015340            | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips64         | runtime_core-image-sato_qemumips64_20190321011857            | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips64         | sdk_core-image-sato_i686_qemumips64_20190320002442           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64         | sdk_core-image-sato_i686_qemumips64_20190320015340           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64         | sdk_core-image-sato_i686_qemumips64_20190321011857           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64         | sdk_core-image-sato_x86_64_qemumips64_20190320013826         | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64         | sdk_core-image-sato_x86_64_qemumips64_20190320032444         | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64         | sdk_core-image-sato_x86_64_qemumips64_20190321023751         | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64         | sdkext_core-image-minimal_x86_64_qemumips64_20190320013826   | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips64         | sdkext_core-image-minimal_x86_64_qemumips64_20190320032444   | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips64         | sdkext_core-image-minimal_x86_64_qemumips64_20190321023751   | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips64         | sdkext_core-image-sato_x86_64_qemumips64_20190320013826      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips64         | sdkext_core-image-sato_x86_64_qemumips64_20190320032444      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips64         | sdkext_core-image-sato_x86_64_qemumips64_20190321023751      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips           | manual_bsps-qemu_20190326165809                              | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemumips           | runtime_core-image-minimal_qemumips_20190320004630           | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips           | runtime_core-image-minimal_qemumips_20190320020613           | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips           | runtime_core-image-minimal_qemumips_20190321012859           | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips           | runtime_core-image-sato-sdk_qemumips_20190320004630          | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips           | runtime_core-image-sato-sdk_qemumips_20190320020613          | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips           | runtime_core-image-sato-sdk_qemumips_20190321012859          | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips           | runtime_core-image-sato_qemumips_20190320004630              | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips           | runtime_core-image-sato_qemumips_20190320020613              | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips           | runtime_core-image-sato_qemumips_20190321012859              | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips           | sdk_core-image-sato_i686_qemumips_20190320004630             | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips           | sdk_core-image-sato_i686_qemumips_20190320020613             | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips           | sdk_core-image-sato_i686_qemumips_20190321012859             | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips           | sdk_core-image-sato_x86_64_qemumips_20190320024214           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips           | sdk_core-image-sato_x86_64_qemumips_20190320044745           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips           | sdk_core-image-sato_x86_64_qemumips_20190321030351           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips           | sdkext_core-image-minimal_x86_64_qemumips_20190320024214     | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips           | sdkext_core-image-minimal_x86_64_qemumips_20190320044745     | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips           | sdkext_core-image-minimal_x86_64_qemumips_20190321030351     | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips           | sdkext_core-image-sato_x86_64_qemumips_20190320024214        | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips           | sdkext_core-image-sato_x86_64_qemumips_20190320044745        | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips           | sdkext_core-image-sato_x86_64_qemumips_20190321030351        | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc-lsb        | runtime_core-image-lsb-sdk_qemuppc_20190320005717            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemuppc-lsb        | runtime_core-image-lsb_qemuppc_20190320005717                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuppc            | manual_bsps-qemu_20190326165942                              | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemuppc            | runtime_core-image-minimal_qemuppc_20190320004027            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuppc            | runtime_core-image-minimal_qemuppc_20190320015824            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuppc            | runtime_core-image-minimal_qemuppc_20190321013113            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuppc            | runtime_core-image-sato-sdk_qemuppc_20190320004027           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuppc            | runtime_core-image-sato-sdk_qemuppc_20190320015824           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuppc            | runtime_core-image-sato-sdk_qemuppc_20190321013113           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuppc            | runtime_core-image-sato_qemuppc_20190320004027               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuppc            | runtime_core-image-sato_qemuppc_20190320015824               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuppc            | runtime_core-image-sato_qemuppc_20190321013113               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuppc            | sdk_core-image-sato_i686_qemuppc_20190320004027              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc            | sdk_core-image-sato_i686_qemuppc_20190320015824              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc            | sdk_core-image-sato_i686_qemuppc_20190321013113              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc            | sdk_core-image-sato_x86_64_qemuppc_20190320020046            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc            | sdk_core-image-sato_x86_64_qemuppc_20190320033044            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc            | sdk_core-image-sato_x86_64_qemuppc_20190321024637            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc            | sdkext_core-image-minimal_x86_64_qemuppc_20190320020046      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc            | sdkext_core-image-minimal_x86_64_qemuppc_20190320033044      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc            | sdkext_core-image-minimal_x86_64_qemuppc_20190321024637      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc            | sdkext_core-image-sato_x86_64_qemuppc_20190320020046         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc            | sdkext_core-image-sato_x86_64_qemuppc_20190320033044         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc            | sdkext_core-image-sato_x86_64_qemuppc_20190321024637         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64-ptest   | runtime_core-image-sato-sdk-ptest_qemux86-64_20190320002354  | 41207 (95%) | 790 (2%) | 1587 (4%)
qemux86-64-x32     | runtime_core-image-minimal_qemux86-64_20190320003140         | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64-x32     | runtime_core-image-minimal_qemux86-64_20190320014444         | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64-x32     | runtime_core-image-minimal_qemux86-64_20190321013143         | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64-x32     | runtime_core-image-sato_qemux86-64_20190320003217            | 36 (59%)    | 0 (0%)   | 25 (41%) 
qemux86-64-x32     | runtime_core-image-sato_qemux86-64_20190320014509            | 36 (59%)    | 0 (0%)   | 25 (41%) 
qemux86-64-x32     | runtime_core-image-sato_qemux86-64_20190321013209            | 36 (59%)    | 0 (0%)   | 25 (41%) 
qemux86-64         | manual_bsps-qemu_20190326165126                              | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemux86-64         | runtime_core-image-minimal_qemux86-64_20190320002957         | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64         | runtime_core-image-minimal_qemux86-64_20190320015705         | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64         | runtime_core-image-minimal_qemux86-64_20190321012136         | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64         | runtime_core-image-sato-sdk_qemux86-64_20190320002957        | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86-64         | runtime_core-image-sato-sdk_qemux86-64_20190320015705        | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86-64         | runtime_core-image-sato-sdk_qemux86-64_20190321012136        | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86-64         | runtime_core-image-sato_qemux86-64_20190320002957            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86-64         | runtime_core-image-sato_qemux86-64_20190320015705            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86-64         | runtime_core-image-sato_qemux86-64_20190321012136            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86-64         | sdk_core-image-sato_i686_qemux86-64_20190320002957           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64         | sdk_core-image-sato_i686_qemux86-64_20190320015705           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64         | sdk_core-image-sato_i686_qemux86-64_20190321012136           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64         | sdk_core-image-sato_x86_64_qemux86-64_20190320003915         | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64         | sdk_core-image-sato_x86_64_qemux86-64_20190320022543         | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64         | sdk_core-image-sato_x86_64_qemux86-64_20190321014915         | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64         | sdkext_core-image-minimal_x86_64_qemux86-64_20190320003915   | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64         | sdkext_core-image-minimal_x86_64_qemux86-64_20190320022543   | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64         | sdkext_core-image-minimal_x86_64_qemux86-64_20190321014915   | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64         | sdkext_core-image-sato_x86_64_qemux86-64_20190320003915      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64         | sdkext_core-image-sato_x86_64_qemux86-64_20190320022543      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64         | sdkext_core-image-sato_x86_64_qemux86-64_20190321014915      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-lsb        | runtime_core-image-lsb-sdk_qemux86_20190320002717            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemux86-lsb        | runtime_core-image-lsb-sdk_qemux86_20190320013539            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemux86-lsb        | runtime_core-image-lsb-sdk_qemux86_20190321011900            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemux86-lsb        | runtime_core-image-lsb_qemux86_20190320002717                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86-lsb        | runtime_core-image-lsb_qemux86_20190320013539                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86-lsb        | runtime_core-image-lsb_qemux86_20190321011900                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86            | manual_bsps-qemu_20190326164713                              | 8 (100%)    | 0 (0%)   | 0 (0%)   
qemux86            | runtime_core-image-minimal_qemux86_20190320003934            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86            | runtime_core-image-minimal_qemux86_20190320013728            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86            | runtime_core-image-minimal_qemux86_20190321013441            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86            | runtime_core-image-sato-sdk_qemux86_20190320003934           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86            | runtime_core-image-sato-sdk_qemux86_20190320013728           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86            | runtime_core-image-sato-sdk_qemux86_20190321013441           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86            | runtime_core-image-sato_qemux86_20190320003934               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86            | runtime_core-image-sato_qemux86_20190320013728               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86            | runtime_core-image-sato_qemux86_20190321013441               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86            | sdk_core-image-sato_i686_qemux86_20190320003934              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86            | sdk_core-image-sato_i686_qemux86_20190320013728              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86            | sdk_core-image-sato_i686_qemux86_20190321013441              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86            | sdk_core-image-sato_x86_64_qemux86_20190320005823            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86            | sdk_core-image-sato_x86_64_qemux86_20190320022215            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86            | sdk_core-image-sato_x86_64_qemux86_20190321020138            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86            | sdkext_core-image-minimal_x86_64_qemux86_20190320005823      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86            | sdkext_core-image-minimal_x86_64_qemux86_20190320022215      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86            | sdkext_core-image-minimal_x86_64_qemux86_20190321020138      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86            | sdkext_core-image-sato_x86_64_qemux86_20190320005823         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86            | sdkext_core-image-sato_x86_64_qemux86_20190320022215         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86            | sdkext_core-image-sato_x86_64_qemux86_20190321020138         | 15 (71%)    | 0 (0%)   | 6 (29%)  
sdk-extras         | manual_sdk_20190321125223                                    | 1 (100%)    | 0 (0%)   | 0 (0%)   
sdk-extras         | manual_sdk_20190328103341                                    | 1 (100%)    | 0 (0%)   | 0 (0%)   
sdk-extras         | oeselftest_ubuntu-16.04_qemuarm_20190322123322               | 3 (100%)    | 0 (0%)   | 0 (0%)   
sdk-extras         | oeselftest_ubuntu-16.04_qemumips_20190322130951              | 3 (100%)    | 0 (0%)   | 0 (0%)   
sdk-extras         | oeselftest_ubuntu-16.04_qemuppc_20190322134920               | 3 (100%)    | 0 (0%)   | 0 (0%)   
sdk-extras         | oeselftest_ubuntu-16.04_qemux86_20190322102002               | 3 (100%)    | 0 (0%)   | 0 (0%)   
toaster            | manual_toaster-managed-mode_20190328115523                   | 62 (95%)    | 3 (5%)   | 0 (0%)   
toaster            | manual_toaster-unmanaged-mode_20190328115015                 | 28 (100%)   | 0 (0%)   | 0 (0%)   
--------------------------------------------------------------------------------------------------------------

==============================================================================================================
PTest Result Summary
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
Recipe             | Passed      | Failed   | Skipped   | Time(s)   
--------------------------------------------------------------------------------------------------------------
acl                | 222         | 0        | 0         | 1
attr               | 108         | 0        | 0         | 1
bash               | 75          | 4        | 0         | 155
bluez5             | 25          | 0        | 0         | 6
busybox            | 528         | 6        | 74        | 83
bzip2              | 6           | 0        | 0         | 0
dbus-test          | 18          | 3        | 2         | 22
diffstat           | 439         | 0        | 0         | 2
diffutils          | 21          | 0        | 0         | 3
e2fsprogs          | 326         | 0        | 28        | 1656
flex               | 114         | 0        | 0         | 1
gawk               | 342         | 0        | 0         | 14
gdbm               | 24          | 0        | 0         | 0
gdk-pixbuf         | 20          | 0        | 0         | 28
glib-2.0           | 276         | 1        | 0         | 381
gstreamer1.0       | 101         | 3        | 0         | 104
gzip               | 22          | 0        | 0         | 3
libpcre            | 3           | 0        | 0         | 0
libusb1            | 4           | 0        | 0         | 4
libxml-parser-perl | 15          | 0        | 0         | 1
libxml2            | 134         | 0        | 0         | 12
lttng-tools        | 3994        | 5        | 0         | 682 T
lzo                | 5           | 0        | 0         | 3
nettle             | 96          | 1        | 2         | 25
openssh            | 53          | 0        | 3         | 671 T
openssl            | 146         | 1        | 8         | 104
pango              | 12          | 0        | 0         | 0
perl               | 2440        | 19       | 232       | 1042
python             | 16219       | 21       | 725       | 324
python3            | 14801       | 1        | 358       | 679 T
quilt              | 57          | 0        | 0         | 26
sed                | 86          | 0        | 0         | 3
slang              | 97          | 0        | 0         | 20
strace             | 227         | 297      | 107       | 30
tcl                | 149         | 0        | 0         | 3
util-linux         | 0           | 427      | 48        | -
--------------------------------------------------------------------------------------------------------------


==============================================================================================================
Failed test cases (sorted by testseries, ID)
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
testseries | result_id : beaglebone | runtime_core-image-sato-sdk_beaglebone-yocto_20190322023018
    stap.StapTest.test_stap
    parselogs.ParseLogsTest.test_parselogs
testseries | result_id : build-appliance | manual_build-appliance_20190328132020
    build-appliance.build-appliance.Create_core-image-sato-sdk_using_build_appliance
testseries | result_id : edgerouter | runtime_core-image-sato-sdk_edgerouter_20190321002604
    xorg.XorgTest.test_xorg_running
    buildcpio.BuildCpioTest.test_cpio
    parselogs.ParseLogsTest.test_parselogs
testseries | result_id : mpc8315e-rdb | runtime_core-image-sato-sdk_mpc8315e-rdb_20190321011257
    xorg.XorgTest.test_xorg_running
testseries | result_id : oe-selftest | oeselftest_opensuseleap-15.0_qemux86-64_20190320011444
    wic.Wic2.test_wic_cp_ext
testseries | result_id : qemu-shutdown | oeselftest_ubuntu-16.04_qemumips64_20190321162351
    runqemu.QemuTest.test_qemu_can_boot_nfs_and_shutdown
    runqemu.QemuTest.test_qemu_can_shutdown
testseries | result_id : qemu-shutdown | oeselftest_ubuntu-16.04_qemumips_20190322103433
    runqemu.QemuTest.test_qemu_can_boot_nfs_and_shutdown
    runqemu.QemuTest.test_qemu_can_shutdown
testseries | result_id : qemux86-64-ptest | runtime_core-image-sato-sdk-ptest_qemux86-64_20190320002354
    ptestresult.strace.shmxt.gen.test
    ptestresult.util-linux.cal:_1sw-year__cal/sep1752-1sw-year_
    ptestresult.util-linux.cal:_3sw-month__cal/bigyear-3sw-month_
    ptestresult.util-linux.blkid:_bcache-C__blkid/low-probe-bcache-C_
    ptestresult.util-linux.blkid:_befs__blkid/low-probe-befs_
    ptestresult.util-linux.lscpu:_ppc64-POWER7__lscpu/lscpu-ppc64-POWER7_
    ptestresult.util-linux.lsmem:_x86_64-16g__lsmem/lsmem-x86_64-16g_
    ptestresult.util-linux.cramfs:_mkfs_checksums__ul_cd:_/usr/lib/util-linux/ptest/tests/output/cramfs/mkfs-data:_no_such_directory_
    ptestresult.util-linux.cal:_3m-week40-color__cal/weekarg-3m-week40-color_
    ptestresult.strace.printstrn-umoven-undumpable.gen.test
    ptestresult.util-linux.partx:_sgi__partx/partx-image-sgi_
    ptestresult.util-linux.libfdisk:_gpt-space-gap__libfdisk/mkpart-full-gpt-space-gap_
    ptestresult.util-linux.script:_buffering_race__script/buffering-race_
    ptestresult.util-linux.hexdump:_2b_dec-2__hexdump/highlighting-2b_dec-2_
    ptestresult.strace.sockopt-sol_netlink.gen.test
    ptestresult.strace.sched_xetscheduler.gen.test
    ptestresult.util-linux.dmesg:_facilities__dmesg/facilities_
    ptestresult.strace.netlink_sock_diag.test
    ptestresult.util-linux.cal:_1mj-week53-color__cal/weekarg-1mj-week53-color_
    ptestresult.strace.setuid.gen.test
    ptestresult.util-linux.blkid:_ext3__blkid/low-probe-ext3_
    ptestresult.strace.sigsuspend.gen.test
    ptestresult.strace.count-f.test
    ptestresult.util-linux.getopt:_name_option_long__getopt/options-name_option_long_
    ptestresult.util-linux.rename:_overwrite__ul_cd:_/usr/lib/util-linux/ptest/tests/output/rename:_no_such_directory_
    ptestresult.util-linux.lscpu:_x86_64-64cpu__lscpu/lscpu-x86_64-64cpu_
    ptestresult.strace.futex.test
    ptestresult.util-linux.blkid:_hpt37x-raid__blkid/low-probe-hpt37x-raid_
    ptestresult.python.test_directory_compiled__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpBHl9SI':
    ptestresult.util-linux.cramfs:_mkfs_doubles__cramfs/doubles_
    ptestresult.strace.net-y-unix.test
    ptestresult.strace.umoven-illptr.gen.test
    ptestresult.util-linux.libsmartcols:_tree__libsmartcols/fromfile-tree_
    ptestresult.strace.ioctl_evdev-success.test
    ptestresult.perl.cpan/Win32/t/GetOSVersion
    ptestresult.util-linux.cal:_1mjw__cal/month-1mjw_
    ptestresult.strace.xattr-strings.gen.test
    ptestresult.util-linux.cal:_ysjw__cal/year-ysjw_
    ptestresult.strace.btrfs-vX.test
    ptestresult.util-linux.cal:_1sj__cal/month-1sj_
    ptestresult.strace.regex.gen.test
    ptestresult.strace.prctl-tsc.test
    ptestresult.util-linux.blkid:_ubi_mkdir:_cannot_create_directory_'/usr/lib/util-linux/ptest/tests/output':_No_space_left_on_device
    ptestresult.util-linux.findmnt:_options-nameval__findmnt/filter-options-nameval_
    ptestresult.strace.waitid.gen.test
    ptestresult.util-linux.mount:_by_devname__fstab_uuid___mount/fstab-devname2uuid_
    ptestresult.util-linux.hexdump:_1b_char-1__hexdump/highlighting-1b_char-1_
    ptestresult.util-linux.cal:_1mj-month__cal/sep1752-1mj-month_
    ptestresult.strace.getuid.test
    ptestresult.strace.userfaultfd.gen.test
    ptestresult.strace.sock_filter-v-Xabbrev.gen.test
    ptestresult.util-linux.blkid:_tuxonice__blkid/low-probe-tuxonice_
    ptestresult.strace.utimensat.gen.test
    ptestresult.util-linux.cal:_color_with_week_numbers__cal/colorw_
    ptestresult.util-linux.blkid:_fat32_label_64MB__blkid/low-probe-fat32_label_64MB_
    ptestresult.util-linux.findmnt:_options-nameval-neg__findmnt/filter-options-nameval-neg_
    ptestresult.python.test_module_in_package_in_zipfile__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpY5l9gL/launch.py':
    ptestresult.strace.strace-S.test
    ptestresult.util-linux.findmnt:_root__findmnt/target-root_
    ptestresult.util-linux.cal:_3s-week40__cal/weekarg-3s-week40_
    ptestresult.util-linux.fdisk:_MBR_-_dos_mode__fdisk/mbr-dos-mode_
    ptestresult.strace.recvmsg.gen.test
    ptestresult.util-linux.blkid:_luks1__blkid/low-probe-luks1_
    ptestresult.util-linux.isosize:_sector_output__isosize/print-size-sector_output_
    ptestresult.util-linux.cramfs:_nopad-4K-le__cramfs/fsck-bad-header-nopad-4K-le_
    ptestresult.util-linux.blkid:_via-raid__blkid/low-probe-via-raid_
    ptestresult.strace.bexecve.test
    ptestresult.util-linux.libfdisk:_gpt-err-overlap__libfdisk/mkpart-full-gpt-err-overlap_
    ptestresult.util-linux.cal:_3mj__cal/month-3mj_
    ptestresult.strace.inject-nf.test
    ptestresult.strace.setfsgid.gen.test
    ptestresult.util-linux.colcrt:_half-lines__colcrt/functional-half-lines_
    ptestresult.util-linux.md5:_md5__md5/md5_
    ptestresult.util-linux.mount:_btrfs__fstab___mount/fstab-btrfs_
    ptestresult.util-linux.cramfs:_pad-64K-le__cramfs/fsck-bad-header-pad-64K-le_
    ptestresult.util-linux.mount:_fs_lists__mount/fslists_
    ptestresult.strace.timer_create.gen.test
    ptestresult.strace.unlink.gen.test
    ptestresult.util-linux.libfdisk:_mbr-primary-nopartno__libfdisk/mkpart-full-mbr-primary-nopartno_
    ptestresult.strace.process_vm_writev.gen.test
    ptestresult.strace.umask.gen.test
    ptestresult.util-linux.findmnt:_kernel__findmnt/outputs-kernel_
    ptestresult.util-linux.getopt:_posix_correctly__getopt/options-posix_correctly_
    ptestresult.python.test_doctest_main_issue4197__test.test_zipimport_support.ZipSupportTests__..._Expected_line_File_"/var/volatile/tmp/tmp2YTA6n/script.py",_line_2,_in___main__.Test
    ptestresult.util-linux.login:_islocal__login/islocal_
    ptestresult.util-linux.dmesg:_colors__dmesg/colors_
    ptestresult.strace.so_peercred.gen.test
    ptestresult.util-linux.lsns:_NSFS_for_ip-netns-add__ul_cd:_/usr/lib/util-linux/ptest/tests/output/lsns:_no_such_directory_
    ptestresult.strace.sigpending.gen.test
    ptestresult.strace.poll-P.test
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-2__blkid/low-probe-udf-hdd-mkudffs-1.3-2_
    ptestresult.strace.recvfrom.gen.test
    ptestresult.util-linux.blkid:_udf-hdd-win7__blkid/low-probe-udf-hdd-win7_
    ptestresult.strace.termsig.test
    ptestresult.util-linux.libsmartcols:_wrap__libsmartcols/fromfile-wrap_
    ptestresult.strace.nsyscalls.test
    ptestresult.util-linux.mount:_by_label__mount/label_
    ptestresult.util-linux.misc:_flock__misc/flock_
    ptestresult.strace.quotactl-Xabbrev.gen.test
    ptestresult.strace.net-yy-netlink.test
    ptestresult.strace.process_vm_readv.gen.test
    ptestresult.strace.statx.gen.test
    ptestresult.util-linux.hexdump:_4b_dec-4__hexdump/highlighting-4b_dec-4_
    ptestresult.util-linux.getopt:_unquoted_option_bash__getopt/options-unquoted_option_bash_
    ptestresult.util-linux.getopt:_test_for_enhanced_getopt__getopt/options-test_for_enhanced_getopt_
    ptestresult.strace.waitid-v.gen.test
    ptestresult.busybox.wget-handles-empty-path
    ptestresult.util-linux.fdisk:_gpt-resize__fdisk/gpt-resize_
    ptestresult.perl.cpan/Win32/t/CodePage
    ptestresult.util-linux.hexdump:_2b_dec-6__hexdump/highlighting-2b_dec-6_
    ptestresult.strace.setns.gen.test
    ptestresult.util-linux.libfdisk:_gpt__libfdisk/mkpart-gpt_
    ptestresult.strace.trace_statfs_like.gen.test
    ptestresult.strace.qual_inject-signal-syscall.test
    ptestresult.strace.sync_file_range.gen.test
    ptestresult.util-linux.cal:_1mj__cal/month-1mj_
    ptestresult.util-linux.hexdump:_canon__hexdump/format-strings-canon_
    ptestresult.util-linux.findmnt:_messy-mountinfo__findmnt/outputs-messy-mountinfo_
    ptestresult.util-linux.cal:_ymw__cal/year-ymw_
    ptestresult.util-linux.fdisk:_MBR_-_id__fdisk/id_
    ptestresult.util-linux.findmnt:_submounts__findmnt/outputs-submounts_
    ptestresult.strace.sched_get_priority_mxx.gen.test
    ptestresult.strace.prlimit64.gen.test
    ptestresult.util-linux.libfdisk:_mbr-err-primary__libfdisk/mkpart-full-mbr-err-primary_
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-5__blkid/low-probe-udf-hdd-mkudffs-1.3-5_
    ptestresult.util-linux.getopt:_invocation_model_one__getopt/options-invocation_model_one_
    ptestresult.util-linux.mount:_by_uuid__fstab_devname___mount/fstab-uuid2devname_
    ptestresult.util-linux.blkid:_udf-hdd-udfclient-0.7.5__blkid/low-probe-udf-hdd-udfclient-0.7.5_
    ptestresult.util-linux.findmnt:_options-neg__findmnt/filter-options-neg_
    ptestresult.util-linux.cal:_3mw__cal/weeknum-3mw_
    ptestresult.strace.quotactl-v.gen.test
    ptestresult.busybox.wget-retrieves-google-index
    ptestresult.util-linux.misc:_ionice__misc/ionice_
    ptestresult.util-linux.hexdump:_2b_dec__hexdump/format-strings-2b_dec_
    ptestresult.strace.sigign.test
    ptestresult.util-linux.findmnt:_types-multi__findmnt/filter-types-multi_
    ptestresult.strace.unlinkat.gen.test
    ptestresult.strace.qual_syscall.test
    ptestresult.util-linux.blkid:_luks2__blkid/low-probe-luks2_
    ptestresult.strace.fflush.test
    ptestresult.util-linux.libsmartcols:_noextremes__libsmartcols/fromfile-noextremes_
    ptestresult.python.test_zipfile_compiled__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpi4fzwl/test_zip.zip':
    ptestresult.strace.wait4.gen.test
    ptestresult.util-linux.cal:_1m-year__cal/bigyear-1m-year_
    ptestresult.strace.sock_filter-v.gen.test
    ptestresult.util-linux.blkid:_silicon-raid__blkid/low-probe-silicon-raid_
    ptestresult.strace.rt_sigtimedwait.gen.test
    ptestresult.strace.setgid32.gen.test
    ptestresult.strace.clock.gen.test
    ptestresult.strace.utime.gen.test
    ptestresult.strace.count.test
    ptestresult.util-linux.colcrt:_no-options__colcrt/functional-no-options_
    ptestresult.strace.threads-execve.test
    ptestresult.util-linux.cal:_3mjw-month__cal/bigyear-3mjw-month_
    ptestresult.util-linux.blkid:_udf-bdr-2.60-nero__blkid/low-probe-udf-bdr-2.60-nero_
    ptestresult.util-linux.findmnt:_force-tree__findmnt/outputs-force-tree_
    ptestresult.gstreamer1.0.gst/gstsystemclock
    ptestresult.strace.times-fail.gen.test
    ptestresult.strace.quotactl-Xverbose.gen.test
    ptestresult.util-linux.schedutils:_cpuset__schedutils/cpuset_
    ptestresult.strace.sigprocmask.gen.test
    ptestresult.strace.ptrace_syscall_info.gen.test
    ptestresult.util-linux.cal:_1sjw-month__cal/bigyear-1sjw-month_
    ptestresult.strace.trace_stat_like.gen.test
    ptestresult.strace.caps-abbrev.test
    ptestresult.util-linux.cal:_1m-month__cal/sep1752-1m-month_
    ptestresult.util-linux.cal:_m3w__cal/jan1753-m3w_
    ptestresult.util-linux.blkid:_nvidia-raid__blkid/low-probe-nvidia-raid_
    ptestresult.util-linux.cramfs:_pad-4K-be__cramfs/fsck-bad-header-pad-4K-be_
    ptestresult.util-linux.findmnt:_options-nameval-multi__findmnt/filter-options-nameval-multi_
    ptestresult.strace.symlinkat.gen.test
    ptestresult.util-linux.blkid:_promise-raid__blkid/low-probe-promise-raid_
    ptestresult.perl.cpan/Win32/t/Names
    ptestresult.util-linux.hexdump:_empty-format__hexdump/format-strings-empty-format_
    ptestresult.util-linux.misc:_options__misc/setarch-options_
    ptestresult.util-linux.cal:_1sjw-year__cal/bigyear-1sjw-year_
    ptestresult.strace.remap_file_pages-Xverbose.gen.test
    ptestresult.util-linux.fdisk:_nested_BSD__fdisk/bsd_
    ptestresult.util-linux.getopt:_sh__getopt/options-sh_
    ptestresult.strace.ugetrlimit.gen.test
    ptestresult.strace.splice.gen.test
    ptestresult.util-linux.login:_defs__login/logindefs_
    ptestresult.strace.seccomp-strict.test
    ptestresult.util-linux.mount:_by_devname__fstab___mount/fstab-devname_
    ptestresult.strace.read-write.gen.test
    ptestresult.strace.qual_fault-exit_group.test
    ptestresult.strace.sigaction.gen.test
    ptestresult.util-linux.column:_multiple_files__ul_cd:_/usr/lib/util-linux/ptest/tests/output/column:_no_such_directory_
    ptestresult.strace.statfs.gen.test
    ptestresult.strace.remap_file_pages.gen.test
    ptestresult.util-linux.rename:_exit_codes__ul_cd:_/usr/lib/util-linux/ptest/tests/output/rename:_no_such_directory_
    ptestresult.strace.bpf-success-v.test
    ptestresult.util-linux.misc:_setsid__misc/setsid_
    ptestresult.strace.execve-v.test
    ptestresult.util-linux.cal:_3m-week40__cal/weekarg-3m-week40_
    ptestresult.strace.wait4-v.gen.test
    ptestresult.util-linux.findmnt:_types__findmnt/filter-types_
    ptestresult.util-linux.cal:_1sw__cal/month-1sw_
    ptestresult.strace.s390_pci_mmio_read_write.gen.test
    ptestresult.util-linux.colrm:_basic_check__colrm/rm2-2_
    ptestresult.strace.delay.test
    ptestresult.strace.mmap.test
    ptestresult.strace.strace-T.test
    ptestresult.util-linux.cal:_1mjw-month__cal/sep1752-1mjw-month_
    ptestresult.util-linux.blkid:_ddf-raid__blkid/low-probe-ddf-raid_
    ptestresult.strace.stat.gen.test
    ptestresult.util-linux.libsmartcols:_tree-json__libsmartcols/fromfile-tree-json_
    ptestresult.util-linux.cal:_1mw-month__cal/sep1752-1mw-month_
    ptestresult.strace.prctl-pdeathsig.test
    ptestresult.util-linux.cal:_1s-year__cal/sep1752-1s-year_
    ptestresult.python3.test_start_tls_server_1__test.test_asyncio.test_sslproto.SelectorStartTLSTests_
    ptestresult.util-linux.fdisk:_MBR_-_sort__fdisk/mbr-sort_
    ptestresult.util-linux.cal:_3mj-week40__cal/weekarg-3mj-week40_
    ptestresult.util-linux.dmesg:_levels__dmesg/console-levels_
    ptestresult.strace.setfsuid32.gen.test
    ptestresult.util-linux.hexdump:_4b_dec-2__hexdump/highlighting-4b_dec-2_
    ptestresult.strace.strace-E.test
    ptestresult.strace.sigreturn.gen.test
    ptestresult.util-linux.libsmartcols:_wrapnl__libsmartcols/fromfile-wrapnl_
    ptestresult.strace.strace-r.test
    ptestresult.strace.attach-p-cmd.test
    ptestresult.util-linux.blkid:_jmicron-raid__blkid/low-probe-jmicron-raid_
    ptestresult.util-linux.blkid:_nilfs2__blkid/low-probe-nilfs2_
    ptestresult.strace.remap_file_pages-Xabbrev.gen.test
    ptestresult.strace.execve.test
    ptestresult.util-linux.libfdisk:_mbr-nopartno__libfdisk/mkpart-full-mbr-nopartno_
    ptestresult.strace.qual_signal.test
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-3__blkid/low-probe-udf-hdd-mkudffs-1.3-3_
    ptestresult.util-linux.cal:_3sjw-month__cal/sep1752-3sjw-month_
    ptestresult.dbus-test.test/test-bus
    ptestresult.strace.truncate.gen.test
    ptestresult.util-linux.blkid:_fat32_cp850_O_tilde__blkid/low-probe-fat32_cp850_O_tilde_
    ptestresult.util-linux.ipcs:_mk-rm-msg__ipcs/mk-rm-msg_
    ptestresult.util-linux.partx:_dos+bsd__partx/partx-image-dos+bsd_
    ptestresult.bash.run-new-exp
    ptestresult.util-linux.cal:_3s-month__cal/sep1752-3s-month_
    ptestresult.util-linux.rename:_subdir_check__ul_cd:_/usr/lib/util-linux/ptest/tests/output/rename:_no_such_directory_
    ptestresult.util-linux.hexdump:_2b_hex__hexdump/format-strings-2b_hex_
    ptestresult.util-linux.cal:_ymj__cal/year-ymj_
    ptestresult.util-linux.hexdump:_1b_octal-9__hexdump/highlighting-1b_octal-9_
    ptestresult.strace.setregid.gen.test
    ptestresult.strace.signal_receive.gen.test
    ptestresult.util-linux.cal:_ymjw__cal/weeknum-ymjw_
    ptestresult.util-linux.cal:_ys__cal/year-ys_
    ptestresult.strace.printstrn-umoven.gen.test
    ptestresult.util-linux.cal:_3sj-month__cal/bigyear-3sj-month_
    ptestresult.gstreamer1.0.pipelines/parse-launch
    ptestresult.util-linux.cal:_1mj-week53__cal/weekarg-1mj-week53_
    ptestresult.util-linux.cal:_ym__cal/year-ym_
    ptestresult.strace.prctl-no-args.test
    ptestresult.util-linux.blkid:_mdraid__blkid/low-probe-mdraid_
    ptestresult.util-linux.blkid:_iso-joliet__blkid/low-probe-iso-joliet_
    ptestresult.util-linux.hexdump:_1b_octal-3__hexdump/highlighting-1b_octal-3_
    ptestresult.strace.select.gen.test
    ptestresult.util-linux.lscpu:_x86_64-dell_e4310__lscpu/lscpu-x86_64-dell_e4310_
    ptestresult.util-linux.findmnt:_non-root__findmnt/target-non-root_
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-7__blkid/low-probe-udf-hdd-mkudffs-1.3-7_
    ptestresult.dbus-test.test/test-dbus-daemon
    ptestresult.util-linux.cal:_1mj-year__cal/bigyear-1mj-year_
    ptestresult.util-linux.getopt:_invocation_without_parameters__getopt/options-invocation_without_parameters_
    ptestresult.strace.prctl-seccomp-strict.test
    ptestresult.util-linux.cal:_1m-week53-color__cal/weekarg-1m-week53-color_
    ptestresult.python.test_script_compiled__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpFYd0pV/script.pyc':
    ptestresult.strace.quotactl-Xraw.gen.test
    ptestresult.util-linux.libsmartcols:_tree-middle__libsmartcols/fromfile-tree-middle_
    ptestresult.strace.s390_sthyi-v.gen.test
    ptestresult.util-linux.libsmartcols:_strictwidth__libsmartcols/fromfile-strictwidth_
    ptestresult.strace.xattr.gen.test
    ptestresult.util-linux.hexdump:_2b_dec-1__hexdump/highlighting-2b_dec-1_
    ptestresult.strace.rmdir.gen.test
    ptestresult.util-linux.lscpu:_sparc64__lscpu/lscpu-sparc64_
    ptestresult.util-linux.blkid:_bcache-B__blkid/low-probe-bcache-B_
    ptestresult.strace.printpath-umovestr-legacy.test
    ptestresult.strace.fadvise64.test
    ptestresult.util-linux.cal:_1sw-month__cal/bigyear-1sw-month_
    ptestresult.util-linux.blkid:_hfsplus__blkid/low-probe-hfsplus_
    ptestresult.python.testing_import_hangers_..._OK.
    ptestresult.util-linux.partx:_sun__partx/partx-image-sun_
    ptestresult.strace.eventfd.test
    ptestresult.util-linux.getopt:_basic__getopt/basic_
    ptestresult.strace.ipc_msgbuf.test
    ptestresult.strace.remap_file_pages-Xraw.gen.test
    ptestresult.strace.prctl-spec-inject.test
    ptestresult.strace.s390_guarded_storage.gen.test
    ptestresult.strace.pselect6.gen.test
    ptestresult.util-linux.getopt:_weird_quoting_tcsh__getopt/options-weird_quoting_tcsh_
    ptestresult.util-linux.partx:_atari-icd__partx/partx-image-atari-icd_
    ptestresult.util-linux.cal:_3mj-month__cal/sep1752-3mj-month_
    ptestresult.util-linux.lscpu:_s390-zvm__lscpu/lscpu-s390-zvm_
    ptestresult.strace.readv.test
    ptestresult.util-linux.blkid:_atari-xgm__blkid/lowprobe-pt-atari-xgm_
    ptestresult.strace.trace_fstatfs.gen.test
    ptestresult.util-linux.misc:_uname26__unsupported_--uname-2.6:_echo_true_
    ptestresult.util-linux.libmount:_losetup-loop__libmount/loop_
    ptestresult.strace.time.gen.test
    ptestresult.util-linux.dmesg:_indentation__dmesg/indentation_
    ptestresult.util-linux.blkid:_exfat__blkid/low-probe-exfat_
    ptestresult.util-linux.dmesg:_delta__dmesg/delta_
    ptestresult.util-linux.fdisk:_GPT__fdisk/gpt_
    ptestresult.util-linux.libfdisk:_mbr__libfdisk/mkpart-mbr_
    ptestresult.util-linux.cal:_3sj__cal/month-3sj_
    ptestresult.strace.uio.test
    ptestresult.util-linux.blkid:_xfs__blkid/low-probe-xfs_
    ptestresult.util-linux.hexdump:_2b_dec-3__hexdump/highlighting-2b_dec-3_
    ptestresult.util-linux.cal:_ysj__cal/year-ysj_
    ptestresult.strace.umovestr.test
    ptestresult.strace.quotactl-xfs-v.gen.test
    ptestresult.strace.brk.test
    ptestresult.strace.nsyscalls-d.test
    ptestresult.util-linux.hexdump:_1b_octal-5__hexdump/highlighting-1b_octal-5_
    ptestresult.util-linux.blkid:_small-fat32__blkid/low-probe-small-fat32_
    ptestresult.util-linux.blkid:_lvm2__blkid/low-probe-lvm2_
    ptestresult.util-linux.blkid:_bsd__blkid/lowprobe-pt-bsd_
    ptestresult.util-linux.isosize:_divisor_output__isosize/print-size-divisor_output_
    ptestresult.strace.sched_xetattr.gen.test
    ptestresult.util-linux.blkid:_hpfs__blkid/low-probe-hpfs_
    ptestresult.strace.detach-stopped.test
    ptest.PtestRunnerTest.test_ptestrunner
    ptestresult.util-linux.getopt:_quiet_output_option_long__getopt/options-quiet_output_option_long_
    ptestresult.strace.statfs64.gen.test
    ptestresult.util-linux.dmesg:_decode__dmesg/decode_
    ptestresult.util-linux.cal:_1sw-year__cal/bigyear-1sw-year_
    ptestresult.util-linux.libsmartcols:_raw__libsmartcols/fromfile-raw_
    ptestresult.strace.trace_personality_64.gen.test
    ptestresult.strace.quotactl-xfs-success.test
    ptestresult.util-linux.cal:_color__cal/color_
    ptestresult.util-linux.cal:_3s-month__cal/bigyear-3s-month_
    ptestresult.util-linux.cal:_1sj-month__cal/sep1752-1sj-month_
    ptestresult.strace.setfsgid32.gen.test
    ptestresult.strace.redirect-fds.test
    ptestresult.util-linux.blkdiscard:_offsets__blkdiscard/offsets_
    ptestresult.util-linux.getopt:_same_long_short_options__getopt/options-same_long_short_options_
    ptestresult.lttng-tools.test_utils_expand_path_26_-_symlink_tree_test_case:_[tmppath/]a/g/../l/../
    ptestresult.perl.t/op/stat
    ptestresult.strace.qual_inject-error-signal-syscall.test
    ptestresult.util-linux.blkid:_vmfs__blkid/low-probe-vmfs_
    ptestresult.perl.cpan/Win32/t/CreateFile
    ptestresult.util-linux.mount:_call_mount.<type>__mount/special_
    ptestresult.strace.sendfile64.gen.test
    ptestresult.perl.cpan/Win32/t/GetFullPathName
    ptestresult.util-linux.blkid:_udf-hdd-udfclient-0.7.7__blkid/low-probe-udf-hdd-udfclient-0.7.7_
    ptestresult.util-linux.mount:_by_uuid__mount/uuid_
    ptestresult.strace.rt_sigsuspend.gen.test
    ptestresult.util-linux.cal:_ymjw__cal/year-ymjw_
    ptestresult.strace.trace_personality_regex_32.gen.test
    ptestresult.util-linux.hexdump:_1b_octal-6__hexdump/highlighting-1b_octal-6_
    ptestresult.util-linux.blkid:_sun__blkid/lowprobe-pt-sun_
    ptestresult.util-linux.blkid:_udf-cd-nero-6__blkid/low-probe-udf-cd-nero-6_
    ptestresult.util-linux.misc:_fallocate__misc/fallocate_
    ptestresult.util-linux.cal:_m-week40__cal/weekarg-m-week40_
    ptestresult.strace.readahead.gen.test
    ptestresult.strace.qual_fault-syntax.test
    ptestresult.util-linux.mount:_shared-subtree__mount/shared-subtree_
    ptestresult.util-linux.cal:_3s-week54-color__cal/weekarg-3s-week54-color_
    ptestresult.util-linux.cal:_3m-week53-color__cal/weekarg-3m-week53-color_
    ptestresult.util-linux.cal:_3s__cal/month-3s_
    ptestresult.util-linux.hexdump:_4b_dec-5__hexdump/highlighting-4b_dec-5_
    ptestresult.util-linux.cal:_ysjw__cal/weeknum-ysjw_
    ptestresult.strace.readlinkat.gen.test
    ptestresult.strace.net-tpacket_stats-success.test
    ptestresult.strace.signalfd4.gen.test
    ptestresult.strace.trace_stat.gen.test
    ptestresult.util-linux.colcrt:_crash2__colcrt/regressions-crash2_
    ptestresult.strace.umovestr2.test
    ptestresult.util-linux.getopt:_name_option_short__getopt/options-name_option_short_
    ptestresult.util-linux.blkid:_gfs2__blkid/low-probe-gfs2_
    ptestresult.util-linux.cal:_sj-week40__cal/weekarg-sj-week40_
    ptestresult.strace.sched_yield.gen.test
    ptestresult.util-linux.hexdump:_2b_octal__hexdump/format-strings-2b_octal_
    ptestresult.util-linux.blkid:_minix-BE__blkid/low-probe-minix-BE_
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-8__blkid/low-probe-udf-hdd-mkudffs-1.3-8_
    ptestresult.util-linux.getopt:_longopts__getopt/options-longopts_
    ptestresult.util-linux.cal:_1mw-year__cal/bigyear-1mw-year_
    ptestresult.python.test_module_in_package__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpG6RT6x/launch.py':
    ptestresult.util-linux.lsns:_NETNSID_compare_to_ip-link__ul_cd:_/usr/lib/util-linux/ptest/tests/output/lsns:_no_such_directory_
    ptestresult.util-linux.libfdisk:_gpt-nopartno__libfdisk/mkpart-full-gpt-nopartno_
    ptestresult.util-linux.hexdump:_1b_octal-1__hexdump/highlighting-1b_octal-1_
    ptestresult.bash.run-vredir
    ptestresult.util-linux.cal:_1mjw-year__cal/sep1752-1mjw-year_
    ptestresult.util-linux.cal:_1sj-year__cal/sep1752-1sj-year_
    ptestresult.util-linux.cal:_3m-month__cal/sep1752-3m-month_
    ptestresult.util-linux.cal:_3mjw__cal/month-3mjw_
    ptestresult.strace.xetpriority.gen.test
    ptestresult.util-linux.blkid:_drbdmanage-control-volume__blkid/low-probe-drbdmanage-control-volume_
    ptestresult.strace.recvmmsg-timeout.gen.test
    ptestresult.util-linux.lscpu:_s390-lpar__lscpu/lscpu-s390-lpar_
    ptestresult.strace.detach-running.test
    ptestresult.strace.so_linger.gen.test
    ptestresult.util-linux.blkid:_atari-icd__blkid/lowprobe-pt-atari-icd_
    ptestresult.strace.setresgid32.gen.test
    ptestresult.util-linux.cal:_1mj-year__cal/sep1752-1mj-year_
    ptestresult.strace.opipe.test
    ptestresult.strace.qual_inject-syntax.test
    ptestresult.strace.seccomp-filter.gen.test
    ptestresult.util-linux.blkid:_minix-LE__blkid/low-probe-minix-LE_
    ptestresult.util-linux.blkid:_reiser4__blkid/low-probe-reiser4_
    ptestresult.strace.select-P.gen.test
    ptestresult.util-linux.hexdump:_1b_octal-4__hexdump/highlighting-1b_octal-4_
    ptestresult.strace.timer_xettime.gen.test
    ptestresult.util-linux.column:_table__ul_cd:_/usr/lib/util-linux/ptest/tests/output/column:_no_such_directory_
    ptestresult.util-linux.cal:_ysw__cal/weeknum-ysw_
    ptestresult.strace.sxetmask.gen.test
    ptestresult.util-linux.look:_separator__look/separator_
    ptestresult.util-linux.hexdump:_4b_dec-3__hexdump/highlighting-4b_dec-3_
    ptestresult.python.test_directory_error__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpkKLzNs':
    ptestresult.util-linux.mount:_loop__fstab___mount/fstab-loop_
    ptestresult.strace.lseek.test
    ptestresult.strace.sock_filter-v-Xraw.gen.test
    ptestresult.util-linux.cal:_3sw__cal/weeknum-3sw_
    ptestresult.strace.setgid.gen.test
    ptestresult.strace.net-yy-inet.test
    ptestresult.perl.cpan/Win32/t/GetOSName
    ptestresult.util-linux.cal:_1mw-month__cal/bigyear-1mw-month_
    ptestresult.util-linux.libsmartcols:_title__libsmartcols/title_
    ptestresult.strace.get_regs.test
    ptestresult.util-linux.cal:_3sjw__cal/month-3sjw_
    ptestresult.perl.ext/VMS-Stdio/t/vms_stdio
    ptestresult.util-linux.getopt:_quiet_output_option_short__getopt/options-quiet_output_option_short_
    ptestresult.util-linux.hexdump:_1b_octal__hexdump/format-strings-1b_octal_
    ptestresult.strace.pipe.test
    ptestresult.strace.quotactl-success-v.test
    ptestresult.util-linux.getopt:_quiet_option_short__getopt/options-quiet_option_short_
    ptestresult.util-linux.partx:_bsd__partx/partx-image-bsd_
    ptestresult.util-linux.blkid:_ntfs__blkid/low-probe-ntfs_
    ptestresult.strace.prctl-securebits.test
    ptestresult.util-linux.cal:_3m__cal/month-3m_
    ptestresult.strace.trace_personality_regex_x32.gen.test
    ptestresult.strace.vfork-f.gen.test
    ptestresult.util-linux.cal:_1m-week53__cal/weekarg-1m-week53_
    ptestresult.util-linux.blkid:_isw-raid__blkid/low-probe-isw-raid_
    ptestresult.util-linux.cal:_1mjw-month__cal/bigyear-1mjw-month_
    ptestresult.util-linux.isosize:_default_output__isosize/print-size-default_output_
    ptestresult.strace.unix-pair-send-recv.test
    ptestresult.util-linux.blkid:_fat__blkid/low-probe-fat_
    ptestresult.strace.unshare.gen.test
    ptestresult.strace.strace-ttt.test
    ptestresult.strace.utimensat-Xabbrev.gen.test
    ptestresult.strace.xet_robust_list.gen.test
    ptestresult.util-linux.getopt:_invocation_model_two_as_one__getopt/options-invocation_model_two_as_one_
    ptestresult.util-linux.cal:_3mjw__cal/weeknum-3mjw_
    ptestresult.perl.cpan/Win32/t/GetLongPathName
    ptestresult.util-linux.mount:_by_devname__mount/devname_
    ptestresult.util-linux.libsmartcols:_right-maxout__libsmartcols/fromfile-right-maxout_
    ptestresult.util-linux.misc:_rev__misc/rev_
    ptestresult.strace.rt_sigaction.test
    ptestresult.lttng-tools.test_utils_expand_path_23_-_symlink_tree_test_case:_[tmppath/]a/g/../l/.
    ptestresult.util-linux.lscpu:_s390-lpar-drawer__lscpu/lscpu-s390-lpar-drawer_
    ptestresult.util-linux.blkid:_gpt__blkid/lowprobe-pt-gpt_
    ptestresult.util-linux.cal:_3sw-month__cal/sep1752-3sw-month_
    ptestresult.perl.cpan/Win32/t/Unicode
    ptestresult.util-linux.cal:_week-iso__cal/sep1752-week-iso_
    ptestresult.strace.setgroups32.gen.test
    ptestresult.util-linux.hexdump:_1b_octal-7__hexdump/highlighting-1b_octal-7_
    ptestresult.util-linux.libfdisk:_gpt-partno-gap__libfdisk/mkpart-full-gpt-partno-gap_
    ptestresult.util-linux.mount:_by_label__fstab_uuid___mount/fstab-label2uuid_
    ptestresult.strace.timerfd_xettime.gen.test
    ptestresult.util-linux.blkid:_hfs__blkid/low-probe-hfs_
    ptestresult.util-linux.mount:_by_label__fstab_devname___mount/fstab-label2devname_
    ptestresult.util-linux.getopt:_no-arguments__getopt/options-no-arguments_
    ptestresult.util-linux.cal:_1sj-year__cal/bigyear-1sj-year_
    ptestresult.util-linux.getopt:_unknown_options__getopt/options-unknown_options_
    ptestresult.strace.trace_personality_regex_64.gen.test
    ptestresult.util-linux.blkid:_reiser3__blkid/low-probe-reiser3_
    ptestresult.strace.prctl-arg2-intptr.test
    ptestresult.strace.bpf-success.test
    ptestresult.util-linux.mount:_move__mount/move_
    ptestresult.strace.sched_rr_get_interval.gen.test
    ptestresult.util-linux.cal:_1m__cal/month-1m_
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.0.0-2__blkid/low-probe-udf-hdd-mkudffs-1.0.0-2_
    ptestresult.strace.seccomp_get_action_avail.gen.test
    ptestresult.strace.semop.gen.test
    ptestresult.util-linux.cal:_1sjw__cal/month-1sjw_
    ptestresult.util-linux.blkid:_vmfs_volume__blkid/low-probe-vmfs_volume_
    ptestresult.strace.redirect.test
    ptestresult.strace.btrfs-X.test
    ptestresult.util-linux.cal:_1s__cal/month-1s_
    ptestresult.busybox.wget-supports--P
    ptestresult.util-linux.hexdump:_1b_char-3__hexdump/highlighting-1b_char-3_
    ptestresult.strace.sysinfo.gen.test
    ptestresult.strace.swap.gen.test
    ptestresult.util-linux.cal:_3mjw-month__cal/sep1752-3mjw-month_
    ptestresult.perl.cpan/Win32/t/GetFolderPath
    ptestresult.util-linux.blkid:_mpool__blkid/low-probe-mpool_
    ptestresult.util-linux.libsmartcols:_wrap-tree__libsmartcols/fromfile-wrap-tree_
    ptestresult.strace.uname.test
    ptestresult.util-linux.libsmartcols:_tree-end__libsmartcols/fromfile-tree-end_
    ptestresult.strace.sun_path.test
    ptestresult.strace.renameat.gen.test
    ptestresult.strace.setresgid.gen.test
    ptestresult.python.test_basic_script__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpo1fWLC/script.py':
    ptestresult.util-linux.findmnt:_options__findmnt/filter-options_
    ptestresult.util-linux.hexdump:_2b_dec-4__hexdump/highlighting-2b_dec-4_
    ptestresult.strace.strace-ff.test
    ptestresult.strace.setuid32.gen.test
    ptestresult.strace.reboot.gen.test
    ptestresult.util-linux.cal:_3sjw-month__cal/bigyear-3sjw-month_
    ptestresult.strace.quotactl-success.test
    ptestresult.strace.xet_thread_area_x86.test
    ptestresult.strace.kern_features-fault.test
    ptestresult.strace.sync.gen.test
    ptestresult.strace.prctl-tid_address.test
    ptestresult.util-linux.cal:_3sj-month__cal/sep1752-3sj-month_
    ptestresult.strace.set_mempolicy.gen.test
    ptestresult.strace.ioctl.test
    ptestresult.strace.qual_inject-signal.test
    ptestresult.strace.filter-unavailable.test
    ptestresult.strace.sock_filter-v-Xverbose.gen.test
    ptestresult.python.test_pipe_cloexec__test.test_subprocess.POSIXProcessTestCase_
    ptestresult.python.Trying_50_threads_..._OK.
    ptestresult.util-linux.findmnt:_types-neg__findmnt/filter-types-neg_
    ptestresult.util-linux.libsmartcols:_hidden__libsmartcols/fromfile-hidden_
    ptestresult.util-linux.cal:_1sw-month__cal/sep1752-1sw-month_
    ptestresult.strace.printstrn-umoven-legacy.test
    ptestresult.strace.rt_sigprocmask.gen.test
    ptestresult.util-linux.mount:_by_devname__fstab_label___mount/fstab-devname2label_
    ptestresult.util-linux.blkid:_swap0__blkid/low-probe-swap0_
    ptestresult.util-linux.cramfs:_pad-64K-be__cramfs/fsck-bad-header-pad-64K-be_
    ptestresult.lttng-tools.test_utils_expand_path_27_-_symlink_tree_test_case:_[tmppath/]a/b/h/g/
    ptestresult.util-linux.rename:_basic_check__ul_cd:_/usr/lib/util-linux/ptest/tests/output/rename:_no_such_directory_
    ptestresult.util-linux.libfdisk:_gpt__libfdisk/mkpart-full-gpt_
    ptestresult.util-linux.getopt:_invalid_getopt_option__getopt/options-invalid_getopt_option_
    ptestresult.strace.quotactl-xfs-success-v.test
    ptestresult.strace.trace_personality_32.gen.test
    ptestresult.util-linux.ipcs:_headers__ipcs/headers_
    ptestresult.python.test_package__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpuTVLpX/launch.py':
    ptestresult.strace.setregid32.gen.test
    ptestresult.util-linux.getopt:_weird_quoting_bash__getopt/options-weird_quoting_bash_
    ptestresult.strace.s390_runtime_instr.gen.test
    ptestresult.util-linux.blkid:_dos+bsd__blkid/lowprobe-pt-dos+bsd_
    ptestresult.util-linux.blkid:_fat16_noheads__blkid/low-probe-fat16_noheads_
    ptestresult.strace.strace-V.test
    ptestresult.strace.net.test
    ptestresult.util-linux.cal:_1sjw-month__cal/sep1752-1sjw-month_
    ptestresult.util-linux.bitops:_swap_bytes__bitops/swapbytes_
    ptestresult.python.test_zipfile_error__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmp0ziZ8e/test_zip.zip':
    ptestresult.util-linux.cal:_s-week40__cal/weekarg-s-week40_
    ptestresult.util-linux.blkid:_iso-rr-joliet__blkid/low-probe-iso-rr-joliet_
    ptestresult.python.test_zipfile__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpWpOk_A/test_zip.zip':
    ptestresult.util-linux.lscpu:_ppc-qemu__lscpu/lscpu-ppc-qemu_
    ptestresult.util-linux.cramfs:_fsck_endianness__cramfs/fsck-endianness_
    ptestresult.strace.s390_sthyi.gen.test
    ptestresult.strace.rt_sigreturn.gen.test
    ptestresult.strace.so_peercred-Xverbose.gen.test
    ptestresult.util-linux.blkid:_xfs-log__blkid/low-probe-xfs-log_
    ptestresult.strace.setfsuid.gen.test
    ptestresult.strace.sched_xetparam.gen.test
    ptestresult.strace.waitpid.gen.test
    ptestresult.perl.cpan/Win32/t/ExpandEnvironmentStrings
    ptestresult.strace.qual_inject-retval-syscall.test
    ptestresult.util-linux.blkid:_ubifs__blkid/low-probe-ubifs_
    ptestresult.util-linux.mount:_remount__mount/remount_
    ptestresult.util-linux.partx:_gpt__partx/partx-image-gpt_
    ptestresult.util-linux.blkid:_netware__blkid/low-probe-netware_
    ptestresult.strace.signal.gen.test
    ptestresult.glib-2.0.glib/gdatetime.test__Child_process_killed_by_signal_6_
    ptestresult.util-linux.hexdump:_canon-2__hexdump/highlighting-canon-2_
    ptestresult.util-linux.colcrt:_crash1__colcrt/regressions-crash1_
    ptestresult.util-linux.libfdisk:_mbr-nopartno__libfdisk/mkpart-mbr-nopartno_
    ptestresult.strace.request_key.gen.test
    ptestresult.util-linux.losetup:_losetup__losetup/losetup_
    ptestresult.strace.times.gen.test
    ptestresult.util-linux.hexdump:_2b_dec-7__hexdump/highlighting-2b_dec-7_
    ptestresult.strace.sched_xetaffinity.gen.test
    ptestresult.strace.socketcall.gen.test
    ptestresult.strace.restart_syscall.test
    ptestresult.strace.xetitimer.gen.test
    ptestresult.perl.cpan/Win32/t/GuidGen
    ptestresult.util-linux.fdisk:_MBR_-_non-dos_mode__fdisk/mbr-nondos-mode_
    ptestresult.util-linux.getopt:_long_option_ambiguous_1__getopt/options-long_option_ambiguous_1_
    ptestresult.util-linux.libfdisk:_mbr-err-logical__libfdisk/mkpart-full-mbr-err-logical_
    ptestresult.strace.vhangup.gen.test
    ptestresult.util-linux.cal:_3mj-month__cal/bigyear-3mj-month_
    ptestresult.python.test_package_recursion__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpI8ZgvU/launch.py':
    ptestresult.strace.trace_personality_x32.gen.test
    ptestresult.util-linux.cal:_mj-week40__cal/weekarg-mj-week40_
    ptestresult.util-linux.misc:_whereis__misc/whereis_
    ptestresult.util-linux.hexdump:_4b_dec-6__hexdump/highlighting-4b_dec-6_
    ptestresult.util-linux.libsmartcols:_column-separator__libsmartcols/fromfile-column-separator_
    ptestresult.util-linux.cal:_1m-month__cal/bigyear-1m-month_
    ptestresult.util-linux.cal:_1sj-month__cal/bigyear-1sj-month_
    ptestresult.strace.strace-C.test
    ptestresult.strace.rt_tgsigqueueinfo.gen.test
    ptestresult.util-linux.blkid:_jbd__blkid/low-probe-jbd_
    ptestresult.python.test_package_error__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpNFHiSx/launch.py':
    ptestresult.strace.unix-pair-sendto-recvfrom.test
    ptestresult.strace.trace_question.gen.test
    ptestresult.python.test_directory__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpPB3CXm':
    ptestresult.perl.cpan/Win32/t/GetFileVersion
    ptestresult.strace.umount2.test
    ptestresult.util-linux.blkid:_ext2__blkid/low-probe-ext2_
    ptestresult.strace.renameat2.gen.test
    ptestresult.util-linux.cal:_ysw__cal/year-ysw_
    ptestresult.util-linux.blkid:_sgi__blkid/lowprobe-pt-sgi_
    ptestresult.util-linux.ipcs:_mk-rm-sem__ipcs/mk-rm-sem_
    ptestresult.util-linux.mount:_by_uuid__fstab___mount/fstab-uuid_
    ptestresult.strace.shutdown.gen.test
    ptestresult.util-linux.namei:_basic_functionality__ul_cd:_/usr/lib/util-linux/ptest/tests/output/namei:_no_such_directory_
    ptestresult.util-linux.cal:_1mj-month__cal/bigyear-1mj-month_
    ptestresult.strace.stat64.gen.test
    ptestresult.strace.sigblock.test
    ptestresult.util-linux.libfdisk:_mbr-err-nospace__libfdisk/mkpart-full-mbr-err-nospace_
    ptestresult.util-linux.partx:_atari-xgm__partx/partx-image-atari-xgm_
    ptestresult.strace.symlink.gen.test
    ptestresult.strace.net-yy-unix.test
    ptestresult.strace.s390_guarded_storage-v.gen.test
    ptestresult.strace.setreuid32.gen.test
    ptestresult.util-linux.cal:_3mw-month__cal/sep1752-3mw-month_
    ptestresult.util-linux.cal:_3sw__cal/month-3sw_
    ptestresult.strace.ioctl_evdev-success-v.test
    ptestresult.strace.btrfs-v.test
    ptestresult.util-linux.cal:_3sjw__cal/weeknum-3sjw_
    ptestresult.util-linux.blkid:_iso__blkid/low-probe-iso_
    ptestresult.util-linux.blkid:_udf__blkid/low-probe-udf_
    ptestresult.strace.qual_fault.test
    ptestresult.util-linux.libmount:_loop_overlay__libmount/loop-overlay_
    ptestresult.strace.qual_fault-syscall.test
    ptestresult.util-linux.cal:_3m-month__cal/bigyear-3m-month_
    ptestresult.util-linux.column:_invalid_multibyte__ul_cd:_/usr/lib/util-linux/ptest/tests/output/column:_no_such_directory_
    ptestresult.util-linux.blkid:_lsi-raid__blkid/low-probe-lsi-raid_
    ptestresult.util-linux.getopt:_alternative_option_short__getopt/options-alternative_option_short_
    ptestresult.strace.umount.test
    ptestresult.util-linux.cal:_1mjw-year__cal/bigyear-1mjw-year_
    ptestresult.strace.readdir.gen.test
    ptestresult.strace.rename.gen.test
    ptestresult.util-linux.hexdump:_1b_char-2__hexdump/highlighting-1b_char-2_
    ptestresult.util-linux.findmnt:_options-name__findmnt/filter-options-name_
    ptestresult.perl.ext/VMS-DCLsym/t/vms_dclsym
    ptestresult.util-linux.hexdump:_2b_dec-8__hexdump/highlighting-2b_dec-8_
    ptestresult.strace.siginfo.gen.test
    ptestresult.util-linux.blkid:_jfs__blkid/low-probe-jfs_
    ptestresult.util-linux.cal:_3m-week52-color__cal/weekarg-3m-week52-color_
    ptestresult.strace.pwritev.gen.test
    ptestresult.busybox.wget--O-overrides--P
    ptestresult.util-linux.mount:_by_label__fstab___mount/fstab-label_
    ptestresult.strace.pc.test
    ptestresult.util-linux.cal:_3mw-month__cal/bigyear-3mw-month_
    ptestresult.strace.prctl-dumpable.test
    ptestresult.strace.riscv_flush_icache.gen.test
    ptestresult.util-linux.getopt:_quiet_option_long__getopt/options-quiet_option_long_
    ptestresult.python.Trying_20_threads_..._OK.
    ptestresult.util-linux.fdisk:_sunlabel_tests__fdisk/sunlabel_
    ptestresult.strace.xettimeofday.gen.test
    ptestresult.util-linux.hexdump:_canon-1__hexdump/highlighting-canon-1_
    ptestresult.util-linux.colcrt:_hang1__colcrt/regressions-hang1_
    ptestresult.util-linux.getopt:_alternative_option_long__getopt/options-alternative_option_long_
    ptestresult.strace.setgroups.gen.test
    ptestresult.strace.seccomp-filter-v.gen.test
    ptestresult.util-linux.getopt:_invocation_model_three_as_one__getopt/options-invocation_model_three_as_one_
    ptestresult.util-linux.cal:_ymw__cal/weeknum-ymw_
    ptestresult.strace.so_peercred-Xabbrev.gen.test
    ptestresult.util-linux.getopt:_alternative_option_clash__getopt/options-alternative_option_clash_
    ptestresult.util-linux.blkid:_romfs__blkid/low-probe-romfs_
    ptestresult.python.test_package_compiled__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpMrhV6p/launch.py':
    ptestresult.strace.setreuid.gen.test
    ptestresult.util-linux.blkid:_cramfs__blkid/low-probe-cramfs_
    ptestresult.strace.prctl-seccomp-filter-v.test
    ptestresult.strace.utimensat-Xverbose.gen.test
    ptestresult.util-linux.blkid:_vdo__blkid/low-probe-vdo_
    ptestresult.strace.trace_statfs.gen.test
    ptestresult.strace.readlink.gen.test
    ptestresult.strace.umovestr3.gen.test
    ptestresult.strace.nsyscalls-nd.test
    ptestresult.util-linux.findmnt:_default__findmnt/outputs-default_
    ptestresult.util-linux.cal:_3w__cal/jan1753-3w_
    ptestresult.strace.quotactl-xfs.gen.test
    ptestresult.util-linux.mount:_by_devname__fstab_symlink___mount/fstab-symlink_
    ptestresult.strace.rt_sigqueueinfo.gen.test
    ptestresult.strace.setdomainname.gen.test
    ptestresult.strace.qual_inject-error-signal.test
    ptestresult.strace.attach-f-p.test
    ptestresult.util-linux.hexdump:_1b_char__hexdump/format-strings-1b_char_
    ptestresult.util-linux.libfdisk:_mbr-logic__libfdisk/mkpart-mbr-logic_
    ptestresult.util-linux.cal:_1mw-year__cal/sep1752-1mw-year_
    ptestresult.util-linux.cal:_1sjw-year__cal/sep1752-1sjw-year_
    ptestresult.util-linux.blkid:_bfs__blkid/low-probe-bfs_
    ptestresult.util-linux.misc:_ul__misc/ul_
    ptestresult.util-linux.getopt:_non-option__getopt/options-non-option_
    ptestresult.util-linux.hexdump:_1b_octal-2__hexdump/highlighting-1b_octal-2_
    ptestresult.util-linux.lscpu:_vbox-win__lscpu/lscpu-vbox-win_
    ptestresult.util-linux.mount:_regular_file__mount/regfile_
    ptestresult.strace.setresuid32.gen.test
    ptestresult.util-linux.mount:_by_uuid__fstab_label___mount/fstab-uuid2label_
    ptestresult.util-linux.rename:_symlink_check__ul_cd:_/usr/lib/util-linux/ptest/tests/output/rename:_no_such_directory_
    ptestresult.util-linux.fdisk:_align_512/512__fdisk/align-512-512_
    ptestresult.strace.poll.test
    ptestresult.util-linux.cal:_3mw__cal/month-3mw_
    ptestresult.strace.setresuid.gen.test
    ptestresult.util-linux.libsmartcols:_export__libsmartcols/fromfile-export_
    ptestresult.bash.run-read
    ptestresult.strace.so_error.gen.test
    ptestresult.lttng-tools.test_utils_expand_path_24_-_symlink_tree_test_case:_[tmppath/]a/g/../l/./
    ptestresult.strace.xetpgid.gen.test
    ptestresult.perl.ext/VMS-Filespec/t/filespec
    ptestresult.strace.tee.gen.test
    ptestresult.strace.truncate64.gen.test
    ptestresult.strace.trace_fstat.gen.test
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-6__blkid/low-probe-udf-hdd-mkudffs-1.3-6_
    ptestresult.strace.clone_ptrace.test
    ptestresult.util-linux.more:_squeeze__more/squeeze_
    ptestresult.util-linux.findmnt:_options-no-multi__findmnt/filter-options-no-multi_
    ptestresult.util-linux.misc:_mcookie__misc/mcookie_
    ptestresult.openssl.test/recipes/90-test_shlibload.t,_test_returned_9__wstat_2304,_0x900_
    ptestresult.util-linux.colcrt:_no-underlining__colcrt/functional-no-underlining_
    ptestresult.util-linux.lscpu:_ppc64-POWER7-64cpu__lscpu/lscpu-ppc64-POWER7-64cpu_
    ptestresult.util-linux.misc:_strtosize__misc/strtosize_
    ptestresult.util-linux.hexdump:_4b_dec-7__hexdump/highlighting-4b_dec-7_
    ptestresult.python.test_getsetlocale_issue1813__test.test_locale.TestMiscellaneous_
    ptestresult.strace.rt_sigpending.gen.test
    ptestresult.util-linux.hexdump:_4b_dec-1__hexdump/highlighting-4b_dec-1_
    ptestresult.util-linux.blkid:_zfs__blkid/low-probe-zfs_
    ptestresult.util-linux.more:_regexp__more/regexp_
    ptestresult.strace.umovestr-illptr.gen.test
    ptestresult.strace.sendfile.gen.test
    ptestresult.strace.interactive_block.test
    ptestresult.strace.sync_file_range2.gen.test
    ptestresult.strace.caps.test
    ptestresult.util-linux.lscpu:_armv7__lscpu/lscpu-armv7_
    ptestresult.util-linux.getopt:_csh__getopt/options-csh_
    ptestresult.util-linux.col:_multibyte_input__col/multibyte_
    ptestresult.util-linux.ipcs:_mk-rm-shm__ipcs/mk-rm-shm_
    ptestresult.util-linux.cramfs:_nopad-4K-be__cramfs/fsck-bad-header-nopad-4K-be_
    ptestresult.strace.vmsplice.gen.test
    ptestresult.util-linux.getopt:_compatible__getopt/options-compatible_
    ptestresult.strace.syslog.gen.test
    ptestresult.strace.so_peercred-Xraw.gen.test
    ptestresult.util-linux.cal:_3sj-week40__cal/weekarg-3sj-week40_
    ptestresult.util-linux.libfdisk:_mbr-logical__libfdisk/mkpart-full-mbr-logical_
    ptestresult.util-linux.hexdump:_2b_dec-5__hexdump/highlighting-2b_dec-5_
    ptestresult.util-linux.fdisk:_invalid_input_tests__fdisk/oddinput_
    ptestresult.util-linux.libfdisk:_mbr-primary__libfdisk/mkpart-full-mbr-primary_
    ptestresult.util-linux.libfdisk:_mbr-space-gap__libfdisk/mkpart-full-mbr-space-gap_
    ptestresult.util-linux.cal:_1s-year__cal/bigyear-1s-year_
    ptestresult.util-linux.libsmartcols:_wrapnl-tree__libsmartcols/fromfile-wrapnl-tree_
    ptestresult.util-linux.cramfs:_mkfs_endianness__cramfs/mkfs-endianness_
    ptestresult.gstreamer1.0.gst/gsturi
    ptestresult.strace.sched.gen.test
    ptestresult.strace.quotactl.gen.test
    ptestresult.util-linux.findmnt:_options-no__findmnt/filter-options-no_
    ptestresult.util-linux.lsmem:_s390-zvm-6g__lsmem/lsmem-s390-zvm-6g_
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.0.0-1__blkid/low-probe-udf-hdd-mkudffs-1.0.0-1_
    ptestresult.util-linux.cal:_1s-month__cal/sep1752-1s-month_
    ptestresult.perl.cpan/Win32/t/GetCurrentThreadId
    ptestresult.util-linux.hexdump:_1b_octal-8__hexdump/highlighting-1b_octal-8_
    ptestresult.util-linux.blkid:_ufs__blkid/low-probe-ufs_
    ptestresult.util-linux.blkid:_udf-cd-mkudfiso-20100208__blkid/low-probe-udf-cd-mkudfiso-20100208_
    ptestresult.util-linux.cal:_3mj-week40-color__cal/weekarg-3mj-week40-color_
    ptestresult.util-linux.blkid:_hpt45x-raid__blkid/low-probe-hpt45x-raid_
    ptestresult.bash.run-trap
    ptestresult.util-linux.libsmartcols:_trunc__libsmartcols/fromfile-trunc_
    ptestresult.perl.cpan/Win32/t/GetShortPathName
    ptestresult.busybox.dc_read
    ptestresult.util-linux.cal:_1m-year__cal/sep1752-1m-year_
    ptestresult.strace.qual_inject-retval.test
    ptestresult.busybox.dc_read_string
    ptestresult.strace.detach-sleeping.test
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-4__blkid/low-probe-udf-hdd-mkudffs-1.3-4_
    ptestresult.strace.ioctl_perf-success.test
    ptestresult.util-linux.libsmartcols:_right__libsmartcols/fromfile-right_
    ptestresult.perl.ext/GDBM_File/t/fatal
    ptestresult.util-linux.cal:_1s-month__cal/bigyear-1s-month_
    ptestresult.strace.personality.test
    ptestresult.util-linux.getopt:_unquoted_option_tcsh__getopt/options-unquoted_option_tcsh_
    ptestresult.strace.prctl-name.test
    ptestresult.util-linux.cal:_1mw__cal/month-1mw_
    ptestresult.util-linux.blkid:_ocfs2__blkid/low-probe-ocfs2_
    ptestresult.util-linux.blkid:_adaptec-raid__blkid/low-probe-adaptec-raid_
    ptestresult.strace.sigaltstack.test
    ptestresult.dbus-test.test/test-names
    ptestresult.strace.ptrace.gen.test
    ptestresult.strace.printstrn-umoven-peekdata.gen.test
    ptestresult.nettle.nettle-pbkdf2-test
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-1__blkid/low-probe-udf-hdd-mkudffs-1.3-1_
    ptestresult.strace.utimes.gen.test
    ptestresult.strace.llseek.test
    ptestresult.util-linux.blkid:_f2fs__blkid/low-probe-f2fs_
    ptestresult.python.test_module_in_subpackage_in_zipfile__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpHdNwBy/launch.py':
    ptestresult.util-linux.fsck:_is_mounted__fsck/ismounted_
    ptestresult.strace.clone_parent.test
    ptestresult.lttng-tools.test_utils_expand_path_25_-_symlink_tree_test_case:_[tmppath/]a/g/../l/..
    ptestresult.strace.setrlimit.gen.test
    ptestresult.strace.sethostname.gen.test
    ptestresult.strace.utimensat-Xraw.gen.test
    ptestresult.util-linux.column:_columnate__ul_cd:_/usr/lib/util-linux/ptest/tests/output/column:_no_such_directory_
    ptestresult.util-linux.blkid:_swap1__blkid/low-probe-swap1_
    ptestresult.strace.ustat.gen.test
    ptestresult.strace.first_exec_failure.test
    ptestresult.util-linux.lscpu:_s390-kvm__lscpu/lscpu-s390-kvm_
    ptestresult.util-linux.cramfs:_pad-4K-le__cramfs/fsck-bad-header-pad-4K-le_
    ptestresult.strace.trace_lstat.gen.test
    ptestresult.util-linux.colcrt:_short-options__colcrt/functional-short-options_
testseries | result_id : toaster | manual_toaster-managed-mode_20190328115523
    toaster-managed-mode.toaster-managed.Adding_packages_with_dependencies
    toaster-managed-mode.toaster-managed.Adding_packages_without_dependencies_from_custom_images
    toaster-managed-mode.toaster-managed.Removing_packages_without_and_with_dependencies__from_custom_images
--------------------------------------------------------------------------------------------------------------


[-- Attachment #3: 2.7_M3_RC1_results_merged.zip --]
[-- Type: application/x-zip-compressed, Size: 39192 bytes --]

[-- Attachment #4: 2.7_m3_rc1_intel_wr_merged_report --]
[-- Type: application/octet-stream, Size: 8644 bytes --]

==============================================================================================================
Test Result Status Summary (Counts/Percentages sorted by testseries, ID)
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
Test Series     | ID                                                          | Passed    | Failed   | Skipped 
--------------------------------------------------------------------------------------------------------------
beaglebone      | manual_bsps-hw_20190325085141                               | 22 (48%)  | 0 (0%)   | 24 (52%)
beaglebone      | manual_compliance-test_20190326135217                       | 4 (67%)   | 0 (0%)   | 2 (33%) 
beaglebone      | runtime_core-image-sato-sdk_beaglebone-yocto_20190322023018 | 46 (77%)  | 2 (3%)   | 12 (20%)
bitbake         | manual_oe-core_20190321085120                               | 7 (100%)  | 0 (0%)   | 0 (0%)  
build-appliance | manual_build-appliance_20190328132020                       | 1 (33%)   | 1 (33%)  | 1 (33%) 
crops           | sdkext_core-image-sato-sdk_x86_64_qemux86_20190325045401    | 17 (81%)  | 0 (0%)   | 4 (19%) 
eclipse-plugin  | manual_eclipse-plugin_20190326132957                        | 6 (100%)  | 0 (0%)   | 0 (0%)  
eclipse-plugin  | manual_eclipse-plugin_20190326170756                        | 6 (100%)  | 0 (0%)   | 0 (0%)  
edgerouter      | manual_bsps-hw_20190325101748                               | 11 (24%)  | 0 (0%)   | 35 (76%)
edgerouter      | manual_compliance-test_20190326135938                       | 2 (33%)   | 0 (0%)   | 4 (67%) 
edgerouter      | runtime_core-image-sato-sdk_edgerouter_20190321002604       | 45 (75%)  | 3 (5%)   | 12 (20%)
kernel-dev      | manual_kernel-dev_20190321132956                            | 9 (100%)  | 0 (0%)   | 0 (0%)  
minnowboard     | manual_bsps-hw_20190322172915                               | 46 (100%) | 0 (0%)   | 0 (0%)  
minnowboard     | runtime_core-image-lsb-sdk_genericx86-64_20190323060918     | 47 (78%)  | 0 (0%)   | 13 (22%)
minnowboard     | runtime_core-image-lsb-sdk_genericx86_20190323091640        | 47 (78%)  | 0 (0%)   | 13 (22%)
minnowboard     | runtime_core-image-sato-sdk_genericx86-64_20190322072832    | 48 (80%)  | 0 (0%)   | 12 (20%)
minnowboard     | runtime_core-image-sato-sdk_genericx86_20190323072551       | 48 (80%)  | 0 (0%)   | 12 (20%)
mpc8315e-rdb    | manual_bsps-hw_20190325093903                               | 15 (33%)  | 0 (0%)   | 31 (67%)
mpc8315e-rdb    | manual_compliance-test_20190326135811                       | 2 (33%)   | 0 (0%)   | 4 (67%) 
mpc8315e-rdb    | runtime_core-image-sato-sdk_mpc8315e-rdb_20190321011257     | 47 (78%)  | 1 (2%)   | 12 (20%)
nuc6            | manual_compliance-test_20190327151229                       | 4 (67%)   | 0 (0%)   | 2 (33%) 
nuc6            | runtime_core-image-lsb-sdk_genericx86-64_20190325064425     | 47 (78%)  | 0 (0%)   | 13 (22%)
nuc6            | runtime_core-image-sato-sdk_genericx86-64_20190325021647    | 48 (80%)  | 0 (0%)   | 12 (20%)
nuc7            | manual_bsps-hw_20190321143341                               | 46 (100%) | 0 (0%)   | 0 (0%)  
nuc7            | runtime_core-image-lsb-sdk_genericx86-64_20190322031806     | 47 (78%)  | 0 (0%)   | 13 (22%)
nuc7            | runtime_core-image-sato-sdk_genericx86-64_20190322051029    | 48 (80%)  | 0 (0%)   | 12 (20%)
qemu-shutdown   | oeselftest_ubuntu-16.04_qemuarm64_20190322141035            | 2 (100%)  | 0 (0%)   | 0 (0%)  
qemu-shutdown   | oeselftest_ubuntu-16.04_qemuarm_20190321134048              | 2 (100%)  | 0 (0%)   | 0 (0%)  
qemu-shutdown   | oeselftest_ubuntu-16.04_qemumips64_20190321162351           | 0 (0%)    | 2 (100%) | 0 (0%)  
qemu-shutdown   | oeselftest_ubuntu-16.04_qemumips_20190322103433             | 0 (0%)    | 2 (100%) | 0 (0%)  
qemu-shutdown   | oeselftest_ubuntu-16.04_qemuppc_20190322160004              | 2 (100%)  | 0 (0%)   | 0 (0%)  
qemu-shutdown   | oeselftest_ubuntu-16.04_qemux86-64_20190321174637           | 2 (100%)  | 0 (0%)   | 0 (0%)  
qemu-shutdown   | oeselftest_ubuntu-16.04_qemux86_20190321170535              | 2 (100%)  | 0 (0%)   | 0 (0%)  
qemuarm64       | manual_bsps-qemu_20190326165610                             | 5 (62%)   | 0 (0%)   | 3 (38%) 
qemuarm         | manual_bsps-qemu_20190326165419                             | 5 (62%)   | 0 (0%)   | 3 (38%) 
qemumips64      | manual_bsps-qemu_20190326170202                             | 5 (62%)   | 0 (0%)   | 3 (38%) 
qemumips        | manual_bsps-qemu_20190326165809                             | 5 (62%)   | 0 (0%)   | 3 (38%) 
qemuppc         | manual_bsps-qemu_20190326165942                             | 5 (62%)   | 0 (0%)   | 3 (38%) 
qemux86-64      | manual_bsps-qemu_20190326165126                             | 5 (62%)   | 0 (0%)   | 3 (38%) 
qemux86         | manual_bsps-qemu_20190326164713                             | 8 (100%)  | 0 (0%)   | 0 (0%)  
sdk-extras      | manual_sdk_20190321125223                                   | 1 (100%)  | 0 (0%)   | 0 (0%)  
sdk-extras      | manual_sdk_20190328103341                                   | 1 (100%)  | 0 (0%)   | 0 (0%)  
sdk-extras      | oeselftest_ubuntu-16.04_qemuarm_20190322123322              | 3 (100%)  | 0 (0%)   | 0 (0%)  
sdk-extras      | oeselftest_ubuntu-16.04_qemumips_20190322130951             | 3 (100%)  | 0 (0%)   | 0 (0%)  
sdk-extras      | oeselftest_ubuntu-16.04_qemuppc_20190322134920              | 3 (100%)  | 0 (0%)   | 0 (0%)  
sdk-extras      | oeselftest_ubuntu-16.04_qemux86_20190322102002              | 3 (100%)  | 0 (0%)   | 0 (0%)  
toaster         | manual_toaster-managed-mode_20190328115523                  | 62 (95%)  | 3 (5%)   | 0 (0%)  
toaster         | manual_toaster-unmanaged-mode_20190328115015                | 28 (100%) | 0 (0%)   | 0 (0%)  
--------------------------------------------------------------------------------------------------------------

There was no ptest data

==============================================================================================================
Failed test cases (sorted by testseries, ID)
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
testseries | result_id : beaglebone | runtime_core-image-sato-sdk_beaglebone-yocto_20190322023018
    stap.StapTest.test_stap
	##[QA comment]: Bug 13153
    parselogs.ParseLogsTest.test_parselogs
	##[QA comment]: WR team is investigating more on this issue. Bo bug filed as this is not a real Yocto bug.
testseries | result_id : build-appliance | manual_build-appliance_20190328132020
    build-appliance.build-appliance.Create_core-image-sato-sdk_using_build_appliance
	##[QA comment]: Bug 12991
testseries | result_id : edgerouter | runtime_core-image-sato-sdk_edgerouter_20190321002604
    xorg.XorgTest.test_xorg_running
	## [QA Comment]: This is an expected failure due to hw limitation.
	parselogs.ParseLogsTest.test_parselogs
	##[QA comment]: WR team is investigating more on this issue. Bo bug filed as this is not a real Yocto bug.
    buildcpio.BuildCpioTest.test_cpio
	## [QA Comment]: This is an expected failure due to hw limitation.
testseries | result_id : mpc8315e-rdb | runtime_core-image-sato-sdk_mpc8315e-rdb_20190321011257
    xorg.XorgTest.test_xorg_running
	## [QA Comment]: This is an expected failure due to hw limitation.
testseries | result_id : qemu-shutdown | oeselftest_ubuntu-16.04_qemumips64_20190321162351
    runqemu.QemuTest.test_qemu_can_boot_nfs_and_shutdown
    runqemu.QemuTest.test_qemu_can_shutdown
	## [QA Comment]: 2 failures - Bug 13234 
testseries | result_id : qemu-shutdown | oeselftest_ubuntu-16.04_qemumips_20190322103433
    runqemu.QemuTest.test_qemu_can_boot_nfs_and_shutdown
    runqemu.QemuTest.test_qemu_can_shutdown
	## [QA Comment]: 2 failures - Bug 13234
testseries | result_id : toaster | manual_toaster-managed-mode_20190328115523
    toaster-managed-mode.toaster-managed.Adding_packages_without_dependencies_from_custom_images
    toaster-managed-mode.toaster-managed.Removing_packages_without_and_with_dependencies__from_custom_images
    toaster-managed-mode.toaster-managed.Adding_packages_with_dependencies
	## [QA Comment]: 3 failures - Bug 13191
--------------------------------------------------------------------------------------------------------------


^ permalink raw reply	[flat|nested] 5+ messages in thread

* QA cycle report for 2.7 M3 RC1
  2019-04-02  5:02 QA cycle report for 2.7 M3 RC1 Jain, Sangeeta
@ 2019-04-02 10:11 ` Jain, Sangeeta
  2019-04-02 18:32 ` richard.purdie
  1 sibling, 0 replies; 5+ messages in thread
From: Jain, Sangeeta @ 2019-04-02 10:11 UTC (permalink / raw)
  To: 'yocto@yoctoproject.org'; +Cc: openembedded-devel


[-- Attachment #1.1: Type: text/plain, Size: 3023 bytes --]



QA cycle report for 2.7 M3 RC1:



  1.  No high milestone defects.
  2.  This is completion of first QA cycle after adoption of new QA process. Test results are available at following location:

*        For results of all automated tests, please refer to results at public AB [1].

*        For other test results, refer to attachment [2].

*        For test report for test cases run by Intel and WR team, refer attachment [3]

*        For full test report, refer attachment [4]

  1.  2 new defects are found in this cycle, oe-selftest [5] and qemu-shutdown[6].
  2.  Number of existing issues observed in this release is 3- toaster [7], Build-appliance [8] and Beaglebone [9]
  3.  For ptest, 3 package tests are failing in this release which were passing in previous release: python [10], python3[11] and strace[12]. 3 packages are facing timeout issues: lttng-tools [13], openssh [14] and python3 [15].



======= Links ========



Link to testresults:



[1] - https://autobuilder.yocto.io/pub/releases/yocto-2.7_M3.rc1/testresults/



[2] - 2.7_M3_RC1_results_merged.zip



[3] - 2.7_m3_rc1_intel_wr_merged_report



[4] - 2.7_m3_rc1_full_report



New Bugs :


[5] Bug 13237 - [2.7 M3 RC1][OE-selftest][Opensuseleap 15.0][Public AB]:"test_wic_cp_ext" failing for Opensuseleap 15.0.
https://bugzilla.yoctoproject.org/show_bug.cgi?id=13237

[6] Bug 13234 - [2.7 M3 RC1] qemumips & qemumips64: failed to shutdown
https://bugzilla.yoctoproject.org/show_bug.cgi?id=13234



Previous Bugs observed in this release:



[7] Bug 13191 - [Test Case 1439] Build Failure after adding or removing packages with and without dependencies

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13191



[8] Bug 12991<https://bugzilla.yoctoproject.org/show_bug.cgi?id=12991> - [Bug] [2.6 M4 RC1][Build-Appliance] Bitbake build-appliance-image getting failed during building image due to webkitgtk package.

https://bugzilla.yoctoproject.org/show_bug.cgi?id=12991



[9] Bug 13153 - [2.7 M2 RC1] Systemtap doesn't work on beaglebone

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13153



ptest Bugs:



[10] Bug 13249 - [2.7 M3 RC1] python ptest failure

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13249



[11] Bug 13253<https://bugzilla.yoctoproject.org/show_bug.cgi?id=12991> - [2.7 M3 RC1] python3 ptest failure

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13253



[12] Bug 13254 - [2.7 M3 RC1] strace ptest failure

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13254



[13] Bug 13255 - [2.7 M3 rc1] lttng-tools ptest facing timeout issue

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13255



[14] Bug 13256 - [2.7 M3 rc1] openssh ptest facing timeout issue

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13256



[15] Bug 13257 - [2.7 M3 rc1] python3 ptest facing timeout issue

https://bugzilla.yoctoproject.org/show_bug.cgi?id=13257


Thanks & Regards,
Sangeeta Jain


[-- Attachment #1.2: Type: text/html, Size: 16868 bytes --]

[-- Attachment #2: 2.7_m3_rc1_full_report --]
[-- Type: application/octet-stream, Size: 96009 bytes --]

==============================================================================================================
Test Result Status Summary (Counts/Percentages sorted by testseries, ID)
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
Test Series        | ID                                                           | Passed      | Failed   | Skipped  
--------------------------------------------------------------------------------------------------------------
a-full             | oeselftest_ubuntu-18.04_qemux86_20190320000043               | 1 (100%)    | 0 (0%)   | 0 (0%)   
a-quick            | oeselftest_ubuntu-16.04_qemux86_20190321010316               | 1 (100%)    | 0 (0%)   | 0 (0%)   
a-quick            | oeselftest_ubuntu-18.04_qemux86_20190320010256               | 1 (100%)    | 0 (0%)   | 0 (0%)   
beaglebone         | manual_bsps-hw_20190325085141                                | 22 (48%)    | 0 (0%)   | 24 (52%) 
beaglebone         | manual_compliance-test_20190326135217                        | 4 (67%)     | 0 (0%)   | 2 (33%)  
beaglebone         | runtime_core-image-sato-sdk_beaglebone-yocto_20190322023018  | 46 (77%)    | 2 (3%)   | 12 (20%) 
beaglebone         | sdk_core-image-sato_i686_beaglebone-yocto_20190320003619     | 11 (92%)    | 0 (0%)   | 1 (8%)   
beaglebone         | sdk_core-image-sato_i686_beaglebone-yocto_20190320012809     | 11 (92%)    | 0 (0%)   | 1 (8%)   
beaglebone         | sdk_core-image-sato_i686_beaglebone-yocto_20190321012126     | 11 (92%)    | 0 (0%)   | 1 (8%)   
bitbake            | manual_oe-core_20190321085120                                | 7 (100%)    | 0 (0%)   | 0 (0%)   
build-appliance    | manual_build-appliance_20190328132020                        | 1 (33%)     | 1 (33%)  | 1 (33%)  
crops              | sdkext_core-image-sato-sdk_x86_64_qemux86_20190325045401     | 17 (81%)    | 0 (0%)   | 4 (19%)  
eclipse-plugin     | manual_eclipse-plugin_20190326132957                         | 6 (100%)    | 0 (0%)   | 0 (0%)   
eclipse-plugin     | manual_eclipse-plugin_20190326170756                         | 6 (100%)    | 0 (0%)   | 0 (0%)   
edgerouter         | manual_bsps-hw_20190325101748                                | 11 (24%)    | 0 (0%)   | 35 (76%) 
edgerouter         | manual_compliance-test_20190326135938                        | 2 (33%)     | 0 (0%)   | 4 (67%)  
edgerouter         | runtime_core-image-sato-sdk_edgerouter_20190321002604        | 45 (75%)    | 3 (5%)   | 12 (20%) 
edgerouter         | sdk_core-image-sato_i686_edgerouter_20190320003659           | 11 (92%)    | 0 (0%)   | 1 (8%)   
edgerouter         | sdk_core-image-sato_i686_edgerouter_20190320014349           | 11 (92%)    | 0 (0%)   | 1 (8%)   
edgerouter         | sdk_core-image-sato_i686_edgerouter_20190321011621           | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86-64      | sdk_core-image-sato_i686_genericx86-64_20190320004116        | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86-64      | sdk_core-image-sato_i686_genericx86-64_20190320012810        | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86-64      | sdk_core-image-sato_i686_genericx86-64_20190321014104        | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86         | sdk_core-image-sato_i686_genericx86_20190320004117           | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86         | sdk_core-image-sato_i686_genericx86_20190320015758           | 11 (92%)    | 0 (0%)   | 1 (8%)   
genericx86         | sdk_core-image-sato_i686_genericx86_20190321012453           | 11 (92%)    | 0 (0%)   | 1 (8%)   
kernel-dev         | manual_kernel-dev_20190321132956                             | 9 (100%)    | 0 (0%)   | 0 (0%)   
meta-mingw         | sdk_core-image-minimal_x86_64-mingw32_qemux86_20190320001222 | 13 (100%)   | 0 (0%)   | 0 (0%)   
meta-mingw         | sdk_core-image-minimal_x86_64-mingw32_qemux86_20190320011132 | 13 (100%)   | 0 (0%)   | 0 (0%)   
meta-mingw         | sdk_core-image-minimal_x86_64-mingw32_qemux86_20190321011834 | 13 (100%)   | 0 (0%)   | 0 (0%)   
minnowboard        | manual_bsps-hw_20190322172915                                | 46 (100%)   | 0 (0%)   | 0 (0%)   
minnowboard        | runtime_core-image-lsb-sdk_genericx86-64_20190323060918      | 47 (78%)    | 0 (0%)   | 13 (22%) 
minnowboard        | runtime_core-image-lsb-sdk_genericx86_20190323091640         | 47 (78%)    | 0 (0%)   | 13 (22%) 
minnowboard        | runtime_core-image-sato-sdk_genericx86-64_20190322072832     | 48 (80%)    | 0 (0%)   | 12 (20%) 
minnowboard        | runtime_core-image-sato-sdk_genericx86_20190323072551        | 48 (80%)    | 0 (0%)   | 12 (20%) 
mpc8315e-rdb       | manual_bsps-hw_20190325093903                                | 15 (33%)    | 0 (0%)   | 31 (67%) 
mpc8315e-rdb       | manual_compliance-test_20190326135811                        | 2 (33%)     | 0 (0%)   | 4 (67%)  
mpc8315e-rdb       | runtime_core-image-sato-sdk_mpc8315e-rdb_20190321011257      | 47 (78%)    | 1 (2%)   | 12 (20%) 
mpc8315e-rdb       | sdk_core-image-sato_i686_mpc8315e-rdb_20190320011448         | 11 (92%)    | 0 (0%)   | 1 (8%)   
mpc8315e-rdb       | sdk_core-image-sato_i686_mpc8315e-rdb_20190320014404         | 11 (92%)    | 0 (0%)   | 1 (8%)   
mpc8315e-rdb       | sdk_core-image-sato_i686_mpc8315e-rdb_20190321015124         | 11 (92%)    | 0 (0%)   | 1 (8%)   
multilib           | runtime_core-image-minimal_qemumips64_20190320010845         | 1 (2%)      | 0 (0%)   | 56 (98%) 
multilib           | runtime_core-image-minimal_qemumips64_20190320015007         | 1 (2%)      | 0 (0%)   | 56 (98%) 
multilib           | runtime_core-image-minimal_qemumips64_20190321013835         | 1 (2%)      | 0 (0%)   | 56 (98%) 
multilib           | runtime_core-image-sato_qemux86-64_20190320004209            | 36 (58%)    | 0 (0%)   | 26 (42%) 
multilib           | runtime_core-image-sato_qemux86-64_20190320004656            | 15 (24%)    | 0 (0%)   | 47 (76%) 
multilib           | runtime_core-image-sato_qemux86-64_20190320012355            | 36 (58%)    | 0 (0%)   | 26 (42%) 
multilib           | runtime_core-image-sato_qemux86-64_20190320012736            | 15 (24%)    | 0 (0%)   | 47 (76%) 
multilib           | runtime_core-image-sato_qemux86-64_20190321011838            | 36 (58%)    | 0 (0%)   | 26 (42%) 
multilib           | runtime_core-image-sato_qemux86-64_20190321012312            | 15 (24%)    | 0 (0%)   | 47 (76%) 
multilib           | runtime_lib32-core-image-minimal_qemux86-64_20190320001649   | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib           | runtime_lib32-core-image-minimal_qemux86-64_20190320001854   | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib           | runtime_lib32-core-image-minimal_qemux86-64_20190320010717   | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib           | runtime_lib32-core-image-minimal_qemux86-64_20190320010828   | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib           | runtime_lib32-core-image-minimal_qemux86-64_20190321011048   | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib           | runtime_lib32-core-image-minimal_qemux86-64_20190321011222   | 1 (100%)    | 0 (0%)   | 0 (0%)   
multilib           | sdk_core-image-minimal_x86_64_qemumips64_20190320010845      | 10 (83%)    | 0 (0%)   | 2 (17%)  
multilib           | sdk_core-image-minimal_x86_64_qemumips64_20190320015007      | 10 (83%)    | 0 (0%)   | 2 (17%)  
multilib           | sdk_core-image-minimal_x86_64_qemumips64_20190321013835      | 10 (83%)    | 0 (0%)   | 2 (17%)  
musl-qemux86-64    | runtime_core-image-full-cmdline_qemux86-64_20190320014601    | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86-64    | runtime_core-image-full-cmdline_qemux86-64_20190320014906    | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86-64    | runtime_core-image-full-cmdline_qemux86-64_20190321012326    | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86-64    | runtime_core-image-minimal_qemux86-64_20190320014601         | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86-64    | runtime_core-image-minimal_qemux86-64_20190320014906         | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86-64    | runtime_core-image-minimal_qemux86-64_20190321012326         | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86-64    | runtime_core-image-sato-sdk_qemux86-64_20190320014601        | 46 (78%)    | 0 (0%)   | 13 (22%) 
musl-qemux86-64    | runtime_core-image-sato-sdk_qemux86-64_20190320014906        | 46 (78%)    | 0 (0%)   | 13 (22%) 
musl-qemux86-64    | runtime_core-image-sato-sdk_qemux86-64_20190321012326        | 46 (78%)    | 0 (0%)   | 13 (22%) 
musl-qemux86       | runtime_core-image-full-cmdline_qemux86_20190320005951       | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86       | runtime_core-image-full-cmdline_qemux86_20190320014618       | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86       | runtime_core-image-full-cmdline_qemux86_20190321011714       | 12 (20%)    | 0 (0%)   | 47 (80%) 
musl-qemux86       | runtime_core-image-minimal_qemux86_20190320005951            | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86       | runtime_core-image-minimal_qemux86_20190320014618            | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86       | runtime_core-image-minimal_qemux86_20190321011714            | 1 (2%)      | 0 (0%)   | 58 (98%) 
musl-qemux86       | runtime_core-image-sato-sdk_qemux86_20190320005951           | 46 (78%)    | 0 (0%)   | 13 (22%) 
musl-qemux86       | runtime_core-image-sato-sdk_qemux86_20190320014618           | 46 (78%)    | 0 (0%)   | 13 (22%) 
musl-qemux86       | runtime_core-image-sato-sdk_qemux86_20190321011714           | 46 (78%)    | 0 (0%)   | 13 (22%) 
no-x11             | runtime_core-image-full-cmdline_qemux86-64_20190320003507    | 12 (20%)    | 0 (0%)   | 48 (80%) 
no-x11             | runtime_core-image-full-cmdline_qemux86-64_20190320014341    | 12 (20%)    | 0 (0%)   | 48 (80%) 
no-x11             | runtime_core-image-full-cmdline_qemux86-64_20190321011912    | 12 (20%)    | 0 (0%)   | 48 (80%) 
no-x11             | runtime_core-image-weston_qemux86-64_20190320003507          | 32 (53%)    | 0 (0%)   | 28 (47%) 
no-x11             | runtime_core-image-weston_qemux86-64_20190320014341          | 32 (53%)    | 0 (0%)   | 28 (47%) 
no-x11             | runtime_core-image-weston_qemux86-64_20190321011912          | 32 (53%)    | 0 (0%)   | 28 (47%) 
nuc6               | manual_compliance-test_20190327151229                        | 4 (67%)     | 0 (0%)   | 2 (33%)  
nuc6               | runtime_core-image-lsb-sdk_genericx86-64_20190325064425      | 47 (78%)    | 0 (0%)   | 13 (22%) 
nuc6               | runtime_core-image-sato-sdk_genericx86-64_20190325021647     | 48 (80%)    | 0 (0%)   | 12 (20%) 
nuc7               | manual_bsps-hw_20190321143341                                | 46 (100%)   | 0 (0%)   | 0 (0%)   
nuc7               | runtime_core-image-lsb-sdk_genericx86-64_20190322031806      | 47 (78%)    | 0 (0%)   | 13 (22%) 
nuc7               | runtime_core-image-sato-sdk_genericx86-64_20190322051029     | 48 (80%)    | 0 (0%)   | 12 (20%) 
oe-selftest-centos | oeselftest_centos-7_qemux86-64_20190320000812                | 343 (99%)   | 0 (0%)   | 3 (1%)   
oe-selftest-debian | oeselftest_debian-8_qemux86-64_20190320000813                | 342 (99%)   | 0 (0%)   | 4 (1%)   
oe-selftest-fedora | oeselftest_fedora-28_qemux86-64_20190320000756               | 343 (99%)   | 0 (0%)   | 3 (1%)   
oe-selftest-ubuntu | oeselftest_ubuntu-16.04_qemux86-64_20190320000741            | 343 (99%)   | 0 (0%)   | 3 (1%)   
oe-selftest        | oeselftest_opensuseleap-15.0_qemux86-64_20190320011444       | 342 (99%)   | 1 (0%)   | 3 (1%)   
oe-selftest        | oeselftest_ubuntu-18.04_qemux86-64_20190321011956            | 343 (99%)   | 0 (0%)   | 3 (1%)   
pkgman-deb-non-deb | runtime_core-image-minimal_qemux86_20190320004108            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-deb-non-deb | runtime_core-image-minimal_qemux86_20190320013439            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-deb-non-deb | runtime_core-image-minimal_qemux86_20190321012732            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-deb-non-deb | runtime_core-image-sato-sdk_qemux86_20190320004108           | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-deb-non-deb | runtime_core-image-sato-sdk_qemux86_20190320013439           | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-deb-non-deb | runtime_core-image-sato-sdk_qemux86_20190321012732           | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-deb-non-deb | runtime_core-image-sato_qemux86_20190320004108               | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-deb-non-deb | runtime_core-image-sato_qemux86_20190320013439               | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-deb-non-deb | runtime_core-image-sato_qemux86_20190321012732               | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-non-rpm     | runtime_core-image-minimal_qemux86_20190320003415            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm     | runtime_core-image-minimal_qemux86_20190320004631            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm     | runtime_core-image-minimal_qemux86_20190320013118            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm     | runtime_core-image-minimal_qemux86_20190320015302            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm     | runtime_core-image-minimal_qemux86_20190321012600            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm     | runtime_core-image-minimal_qemux86_20190321013528            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-non-rpm     | runtime_core-image-sato-sdk_qemux86_20190320003415           | 30 (50%)    | 0 (0%)   | 30 (50%) 
pkgman-non-rpm     | runtime_core-image-sato-sdk_qemux86_20190320004631           | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-non-rpm     | runtime_core-image-sato-sdk_qemux86_20190320013118           | 30 (50%)    | 0 (0%)   | 30 (50%) 
pkgman-non-rpm     | runtime_core-image-sato-sdk_qemux86_20190320015302           | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-non-rpm     | runtime_core-image-sato-sdk_qemux86_20190321012600           | 30 (50%)    | 0 (0%)   | 30 (50%) 
pkgman-non-rpm     | runtime_core-image-sato-sdk_qemux86_20190321013528           | 29 (48%)    | 0 (0%)   | 31 (52%) 
pkgman-non-rpm     | runtime_core-image-sato_qemux86_20190320003415               | 14 (23%)    | 0 (0%)   | 46 (77%) 
pkgman-non-rpm     | runtime_core-image-sato_qemux86_20190320004631               | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-non-rpm     | runtime_core-image-sato_qemux86_20190320013118               | 14 (23%)    | 0 (0%)   | 46 (77%) 
pkgman-non-rpm     | runtime_core-image-sato_qemux86_20190320015302               | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-non-rpm     | runtime_core-image-sato_qemux86_20190321012600               | 14 (23%)    | 0 (0%)   | 46 (77%) 
pkgman-non-rpm     | runtime_core-image-sato_qemux86_20190321013528               | 15 (25%)    | 0 (0%)   | 45 (75%) 
pkgman-rpm-non-rpm | runtime_core-image-minimal_qemux86_20190320003248            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-rpm-non-rpm | runtime_core-image-minimal_qemux86_20190320012838            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-rpm-non-rpm | runtime_core-image-minimal_qemux86_20190321012649            | 1 (2%)      | 0 (0%)   | 59 (98%) 
pkgman-rpm-non-rpm | runtime_core-image-sato-sdk_qemux86_20190320003248           | 48 (80%)    | 0 (0%)   | 12 (20%) 
pkgman-rpm-non-rpm | runtime_core-image-sato-sdk_qemux86_20190320012838           | 48 (80%)    | 0 (0%)   | 12 (20%) 
pkgman-rpm-non-rpm | runtime_core-image-sato-sdk_qemux86_20190321012649           | 48 (80%)    | 0 (0%)   | 12 (20%) 
pkgman-rpm-non-rpm | runtime_core-image-sato_qemux86_20190320003248               | 35 (58%)    | 0 (0%)   | 25 (42%) 
pkgman-rpm-non-rpm | runtime_core-image-sato_qemux86_20190320012838               | 35 (58%)    | 0 (0%)   | 25 (42%) 
pkgman-rpm-non-rpm | runtime_core-image-sato_qemux86_20190321012649               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320003634            | 37 (62%)    | 0 (0%)   | 23 (38%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320004750            | 36 (60%)    | 0 (0%)   | 24 (40%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320005031            | 37 (60%)    | 0 (0%)   | 25 (40%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320010218            | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320010519            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320012341            | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320014406            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320022514            | 37 (62%)    | 0 (0%)   | 23 (38%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320023747            | 36 (60%)    | 0 (0%)   | 24 (40%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320024047            | 37 (60%)    | 0 (0%)   | 25 (40%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320025417            | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320025715            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320031056            | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190320032557            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321014704            | 37 (62%)    | 0 (0%)   | 23 (38%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321015016            | 36 (60%)    | 0 (0%)   | 24 (40%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321015322            | 37 (60%)    | 0 (0%)   | 25 (40%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321015747            | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321020036            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321020443            | 42 (70%)    | 0 (0%)   | 18 (30%) 
qa-extras2         | runtime_core-image-sato_qemux86-64_20190321021008            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemu-shutdown      | oeselftest_ubuntu-16.04_qemuarm64_20190322141035             | 2 (100%)    | 0 (0%)   | 0 (0%)   
qemu-shutdown      | oeselftest_ubuntu-16.04_qemuarm_20190321134048               | 2 (100%)    | 0 (0%)   | 0 (0%)   
qemu-shutdown      | oeselftest_ubuntu-16.04_qemumips64_20190321162351            | 0 (0%)      | 2 (100%) | 0 (0%)   
qemu-shutdown      | oeselftest_ubuntu-16.04_qemumips_20190322103433              | 0 (0%)      | 2 (100%) | 0 (0%)   
qemu-shutdown      | oeselftest_ubuntu-16.04_qemuppc_20190322160004               | 2 (100%)    | 0 (0%)   | 0 (0%)   
qemu-shutdown      | oeselftest_ubuntu-16.04_qemux86-64_20190321174637            | 2 (100%)    | 0 (0%)   | 0 (0%)   
qemu-shutdown      | oeselftest_ubuntu-16.04_qemux86_20190321170535               | 2 (100%)    | 0 (0%)   | 0 (0%)   
qemuarm-lsb        | runtime_core-image-lsb-sdk_qemuarm_20190320004525            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemuarm-lsb        | runtime_core-image-lsb-sdk_qemuarm_20190320013902            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemuarm-lsb        | runtime_core-image-lsb-sdk_qemuarm_20190321013341            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemuarm-lsb        | runtime_core-image-lsb_qemuarm_20190320004525                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm-lsb        | runtime_core-image-lsb_qemuarm_20190320013902                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm-lsb        | runtime_core-image-lsb_qemuarm_20190321013341                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm64          | manual_bsps-qemu_20190326165610                              | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemuarm64          | runtime_core-image-minimal_qemuarm64_20190320003103          | 1 (2%)      | 0 (0%)   | 58 (98%) 
qemuarm64          | runtime_core-image-minimal_qemuarm64_20190320013055          | 1 (2%)      | 0 (0%)   | 58 (98%) 
qemuarm64          | runtime_core-image-minimal_qemuarm64_20190321013017          | 1 (2%)      | 0 (0%)   | 58 (98%) 
qemuarm64          | runtime_core-image-sato-sdk_qemuarm64_20190320003103         | 47 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm64          | runtime_core-image-sato-sdk_qemuarm64_20190320013055         | 47 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm64          | runtime_core-image-sato-sdk_qemuarm64_20190321013017         | 47 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm64          | runtime_core-image-sato_qemuarm64_20190320003103             | 34 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm64          | runtime_core-image-sato_qemuarm64_20190320013055             | 34 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm64          | runtime_core-image-sato_qemuarm64_20190321013017             | 34 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm64          | sdk_core-image-sato_i686_qemuarm64_20190320003103            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64          | sdk_core-image-sato_i686_qemuarm64_20190320013055            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64          | sdk_core-image-sato_i686_qemuarm64_20190321013017            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64          | sdk_core-image-sato_x86_64_qemuarm64_20190320013337          | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64          | sdk_core-image-sato_x86_64_qemuarm64_20190320023024          | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64          | sdk_core-image-sato_x86_64_qemuarm64_20190321022038          | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm64          | sdkext_core-image-minimal_x86_64_qemuarm64_20190320013337    | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm64          | sdkext_core-image-minimal_x86_64_qemuarm64_20190320023024    | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm64          | sdkext_core-image-minimal_x86_64_qemuarm64_20190321022038    | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm64          | sdkext_core-image-sato_x86_64_qemuarm64_20190320013337       | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm64          | sdkext_core-image-sato_x86_64_qemuarm64_20190320023024       | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm64          | sdkext_core-image-sato_x86_64_qemuarm64_20190321022038       | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm            | manual_bsps-qemu_20190326165419                              | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemuarm            | runtime_core-image-minimal_qemuarm_20190320002906            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuarm            | runtime_core-image-minimal_qemuarm_20190320013652            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuarm            | runtime_core-image-minimal_qemuarm_20190321013347            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuarm            | runtime_core-image-sato-sdk_qemuarm_20190320002906           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm            | runtime_core-image-sato-sdk_qemuarm_20190320013652           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm            | runtime_core-image-sato-sdk_qemuarm_20190321013347           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuarm            | runtime_core-image-sato_qemuarm_20190320002906               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm            | runtime_core-image-sato_qemuarm_20190320013652               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm            | runtime_core-image-sato_qemuarm_20190321013347               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuarm            | sdk_core-image-sato_i686_qemuarm_20190320002906              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm            | sdk_core-image-sato_i686_qemuarm_20190320013652              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm            | sdk_core-image-sato_i686_qemuarm_20190321013347              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm            | sdk_core-image-sato_x86_64_qemuarm_20190320013802            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm            | sdk_core-image-sato_x86_64_qemuarm_20190320023307            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm            | sdk_core-image-sato_x86_64_qemuarm_20190321023313            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuarm            | sdkext_core-image-minimal_x86_64_qemuarm_20190320013802      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm            | sdkext_core-image-minimal_x86_64_qemuarm_20190320023307      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm            | sdkext_core-image-minimal_x86_64_qemuarm_20190321023313      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm            | sdkext_core-image-sato_x86_64_qemuarm_20190320013802         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm            | sdkext_core-image-sato_x86_64_qemuarm_20190320023307         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuarm            | sdkext_core-image-sato_x86_64_qemuarm_20190321023313         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips-lsb       | runtime_core-image-lsb-sdk_qemumips_20190320005905           | 44 (77%)    | 0 (0%)   | 13 (23%) 
qemumips-lsb       | runtime_core-image-lsb_qemumips_20190320005905               | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips64         | manual_bsps-qemu_20190326170202                              | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemumips64         | runtime_core-image-minimal_qemumips64_20190320002442         | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips64         | runtime_core-image-minimal_qemumips64_20190320015340         | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips64         | runtime_core-image-minimal_qemumips64_20190321011857         | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips64         | runtime_core-image-sato-sdk_qemumips64_20190320002442        | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips64         | runtime_core-image-sato-sdk_qemumips64_20190320015340        | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips64         | runtime_core-image-sato-sdk_qemumips64_20190321011857        | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips64         | runtime_core-image-sato_qemumips64_20190320002442            | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips64         | runtime_core-image-sato_qemumips64_20190320015340            | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips64         | runtime_core-image-sato_qemumips64_20190321011857            | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips64         | sdk_core-image-sato_i686_qemumips64_20190320002442           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64         | sdk_core-image-sato_i686_qemumips64_20190320015340           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64         | sdk_core-image-sato_i686_qemumips64_20190321011857           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64         | sdk_core-image-sato_x86_64_qemumips64_20190320013826         | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64         | sdk_core-image-sato_x86_64_qemumips64_20190320032444         | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64         | sdk_core-image-sato_x86_64_qemumips64_20190321023751         | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips64         | sdkext_core-image-minimal_x86_64_qemumips64_20190320013826   | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips64         | sdkext_core-image-minimal_x86_64_qemumips64_20190320032444   | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips64         | sdkext_core-image-minimal_x86_64_qemumips64_20190321023751   | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips64         | sdkext_core-image-sato_x86_64_qemumips64_20190320013826      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips64         | sdkext_core-image-sato_x86_64_qemumips64_20190320032444      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips64         | sdkext_core-image-sato_x86_64_qemumips64_20190321023751      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips           | manual_bsps-qemu_20190326165809                              | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemumips           | runtime_core-image-minimal_qemumips_20190320004630           | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips           | runtime_core-image-minimal_qemumips_20190320020613           | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips           | runtime_core-image-minimal_qemumips_20190321012859           | 1 (2%)      | 0 (0%)   | 56 (98%) 
qemumips           | runtime_core-image-sato-sdk_qemumips_20190320004630          | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips           | runtime_core-image-sato-sdk_qemumips_20190320020613          | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips           | runtime_core-image-sato-sdk_qemumips_20190321012859          | 45 (79%)    | 0 (0%)   | 12 (21%) 
qemumips           | runtime_core-image-sato_qemumips_20190320004630              | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips           | runtime_core-image-sato_qemumips_20190320020613              | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips           | runtime_core-image-sato_qemumips_20190321012859              | 35 (61%)    | 0 (0%)   | 22 (39%) 
qemumips           | sdk_core-image-sato_i686_qemumips_20190320004630             | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips           | sdk_core-image-sato_i686_qemumips_20190320020613             | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips           | sdk_core-image-sato_i686_qemumips_20190321012859             | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips           | sdk_core-image-sato_x86_64_qemumips_20190320024214           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips           | sdk_core-image-sato_x86_64_qemumips_20190320044745           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips           | sdk_core-image-sato_x86_64_qemumips_20190321030351           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemumips           | sdkext_core-image-minimal_x86_64_qemumips_20190320024214     | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips           | sdkext_core-image-minimal_x86_64_qemumips_20190320044745     | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips           | sdkext_core-image-minimal_x86_64_qemumips_20190321030351     | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips           | sdkext_core-image-sato_x86_64_qemumips_20190320024214        | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips           | sdkext_core-image-sato_x86_64_qemumips_20190320044745        | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemumips           | sdkext_core-image-sato_x86_64_qemumips_20190321030351        | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc-lsb        | runtime_core-image-lsb-sdk_qemuppc_20190320005717            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemuppc-lsb        | runtime_core-image-lsb_qemuppc_20190320005717                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuppc            | manual_bsps-qemu_20190326165942                              | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemuppc            | runtime_core-image-minimal_qemuppc_20190320004027            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuppc            | runtime_core-image-minimal_qemuppc_20190320015824            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuppc            | runtime_core-image-minimal_qemuppc_20190321013113            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemuppc            | runtime_core-image-sato-sdk_qemuppc_20190320004027           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuppc            | runtime_core-image-sato-sdk_qemuppc_20190320015824           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuppc            | runtime_core-image-sato-sdk_qemuppc_20190321013113           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemuppc            | runtime_core-image-sato_qemuppc_20190320004027               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuppc            | runtime_core-image-sato_qemuppc_20190320015824               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuppc            | runtime_core-image-sato_qemuppc_20190321013113               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemuppc            | sdk_core-image-sato_i686_qemuppc_20190320004027              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc            | sdk_core-image-sato_i686_qemuppc_20190320015824              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc            | sdk_core-image-sato_i686_qemuppc_20190321013113              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc            | sdk_core-image-sato_x86_64_qemuppc_20190320020046            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc            | sdk_core-image-sato_x86_64_qemuppc_20190320033044            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc            | sdk_core-image-sato_x86_64_qemuppc_20190321024637            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemuppc            | sdkext_core-image-minimal_x86_64_qemuppc_20190320020046      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc            | sdkext_core-image-minimal_x86_64_qemuppc_20190320033044      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc            | sdkext_core-image-minimal_x86_64_qemuppc_20190321024637      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc            | sdkext_core-image-sato_x86_64_qemuppc_20190320020046         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc            | sdkext_core-image-sato_x86_64_qemuppc_20190320033044         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemuppc            | sdkext_core-image-sato_x86_64_qemuppc_20190321024637         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64-ptest   | runtime_core-image-sato-sdk-ptest_qemux86-64_20190320002354  | 41207 (95%) | 790 (2%) | 1587 (4%)
qemux86-64-x32     | runtime_core-image-minimal_qemux86-64_20190320003140         | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64-x32     | runtime_core-image-minimal_qemux86-64_20190320014444         | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64-x32     | runtime_core-image-minimal_qemux86-64_20190321013143         | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64-x32     | runtime_core-image-sato_qemux86-64_20190320003217            | 36 (59%)    | 0 (0%)   | 25 (41%) 
qemux86-64-x32     | runtime_core-image-sato_qemux86-64_20190320014509            | 36 (59%)    | 0 (0%)   | 25 (41%) 
qemux86-64-x32     | runtime_core-image-sato_qemux86-64_20190321013209            | 36 (59%)    | 0 (0%)   | 25 (41%) 
qemux86-64         | manual_bsps-qemu_20190326165126                              | 5 (62%)     | 0 (0%)   | 3 (38%)  
qemux86-64         | runtime_core-image-minimal_qemux86-64_20190320002957         | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64         | runtime_core-image-minimal_qemux86-64_20190320015705         | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64         | runtime_core-image-minimal_qemux86-64_20190321012136         | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86-64         | runtime_core-image-sato-sdk_qemux86-64_20190320002957        | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86-64         | runtime_core-image-sato-sdk_qemux86-64_20190320015705        | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86-64         | runtime_core-image-sato-sdk_qemux86-64_20190321012136        | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86-64         | runtime_core-image-sato_qemux86-64_20190320002957            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86-64         | runtime_core-image-sato_qemux86-64_20190320015705            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86-64         | runtime_core-image-sato_qemux86-64_20190321012136            | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86-64         | sdk_core-image-sato_i686_qemux86-64_20190320002957           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64         | sdk_core-image-sato_i686_qemux86-64_20190320015705           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64         | sdk_core-image-sato_i686_qemux86-64_20190321012136           | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64         | sdk_core-image-sato_x86_64_qemux86-64_20190320003915         | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64         | sdk_core-image-sato_x86_64_qemux86-64_20190320022543         | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64         | sdk_core-image-sato_x86_64_qemux86-64_20190321014915         | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86-64         | sdkext_core-image-minimal_x86_64_qemux86-64_20190320003915   | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64         | sdkext_core-image-minimal_x86_64_qemux86-64_20190320022543   | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64         | sdkext_core-image-minimal_x86_64_qemux86-64_20190321014915   | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64         | sdkext_core-image-sato_x86_64_qemux86-64_20190320003915      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64         | sdkext_core-image-sato_x86_64_qemux86-64_20190320022543      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-64         | sdkext_core-image-sato_x86_64_qemux86-64_20190321014915      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86-lsb        | runtime_core-image-lsb-sdk_qemux86_20190320002717            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemux86-lsb        | runtime_core-image-lsb-sdk_qemux86_20190320013539            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemux86-lsb        | runtime_core-image-lsb-sdk_qemux86_20190321011900            | 47 (78%)    | 0 (0%)   | 13 (22%) 
qemux86-lsb        | runtime_core-image-lsb_qemux86_20190320002717                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86-lsb        | runtime_core-image-lsb_qemux86_20190320013539                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86-lsb        | runtime_core-image-lsb_qemux86_20190321011900                | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86            | manual_bsps-qemu_20190326164713                              | 8 (100%)    | 0 (0%)   | 0 (0%)   
qemux86            | runtime_core-image-minimal_qemux86_20190320003934            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86            | runtime_core-image-minimal_qemux86_20190320013728            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86            | runtime_core-image-minimal_qemux86_20190321013441            | 1 (2%)      | 0 (0%)   | 59 (98%) 
qemux86            | runtime_core-image-sato-sdk_qemux86_20190320003934           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86            | runtime_core-image-sato-sdk_qemux86_20190320013728           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86            | runtime_core-image-sato-sdk_qemux86_20190321013441           | 48 (80%)    | 0 (0%)   | 12 (20%) 
qemux86            | runtime_core-image-sato_qemux86_20190320003934               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86            | runtime_core-image-sato_qemux86_20190320013728               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86            | runtime_core-image-sato_qemux86_20190321013441               | 35 (58%)    | 0 (0%)   | 25 (42%) 
qemux86            | sdk_core-image-sato_i686_qemux86_20190320003934              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86            | sdk_core-image-sato_i686_qemux86_20190320013728              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86            | sdk_core-image-sato_i686_qemux86_20190321013441              | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86            | sdk_core-image-sato_x86_64_qemux86_20190320005823            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86            | sdk_core-image-sato_x86_64_qemux86_20190320022215            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86            | sdk_core-image-sato_x86_64_qemux86_20190321020138            | 11 (92%)    | 0 (0%)   | 1 (8%)   
qemux86            | sdkext_core-image-minimal_x86_64_qemux86_20190320005823      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86            | sdkext_core-image-minimal_x86_64_qemux86_20190320022215      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86            | sdkext_core-image-minimal_x86_64_qemux86_20190321020138      | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86            | sdkext_core-image-sato_x86_64_qemux86_20190320005823         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86            | sdkext_core-image-sato_x86_64_qemux86_20190320022215         | 15 (71%)    | 0 (0%)   | 6 (29%)  
qemux86            | sdkext_core-image-sato_x86_64_qemux86_20190321020138         | 15 (71%)    | 0 (0%)   | 6 (29%)  
sdk-extras         | manual_sdk_20190321125223                                    | 1 (100%)    | 0 (0%)   | 0 (0%)   
sdk-extras         | manual_sdk_20190328103341                                    | 1 (100%)    | 0 (0%)   | 0 (0%)   
sdk-extras         | oeselftest_ubuntu-16.04_qemuarm_20190322123322               | 3 (100%)    | 0 (0%)   | 0 (0%)   
sdk-extras         | oeselftest_ubuntu-16.04_qemumips_20190322130951              | 3 (100%)    | 0 (0%)   | 0 (0%)   
sdk-extras         | oeselftest_ubuntu-16.04_qemuppc_20190322134920               | 3 (100%)    | 0 (0%)   | 0 (0%)   
sdk-extras         | oeselftest_ubuntu-16.04_qemux86_20190322102002               | 3 (100%)    | 0 (0%)   | 0 (0%)   
toaster            | manual_toaster-managed-mode_20190328115523                   | 62 (95%)    | 3 (5%)   | 0 (0%)   
toaster            | manual_toaster-unmanaged-mode_20190328115015                 | 28 (100%)   | 0 (0%)   | 0 (0%)   
--------------------------------------------------------------------------------------------------------------

==============================================================================================================
PTest Result Summary
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
Recipe             | Passed      | Failed   | Skipped   | Time(s)   
--------------------------------------------------------------------------------------------------------------
acl                | 222         | 0        | 0         | 1
attr               | 108         | 0        | 0         | 1
bash               | 75          | 4        | 0         | 155
bluez5             | 25          | 0        | 0         | 6
busybox            | 528         | 6        | 74        | 83
bzip2              | 6           | 0        | 0         | 0
dbus-test          | 18          | 3        | 2         | 22
diffstat           | 439         | 0        | 0         | 2
diffutils          | 21          | 0        | 0         | 3
e2fsprogs          | 326         | 0        | 28        | 1656
flex               | 114         | 0        | 0         | 1
gawk               | 342         | 0        | 0         | 14
gdbm               | 24          | 0        | 0         | 0
gdk-pixbuf         | 20          | 0        | 0         | 28
glib-2.0           | 276         | 1        | 0         | 381
gstreamer1.0       | 101         | 3        | 0         | 104
gzip               | 22          | 0        | 0         | 3
libpcre            | 3           | 0        | 0         | 0
libusb1            | 4           | 0        | 0         | 4
libxml-parser-perl | 15          | 0        | 0         | 1
libxml2            | 134         | 0        | 0         | 12
lttng-tools        | 3994        | 5        | 0         | 682 T
lzo                | 5           | 0        | 0         | 3
nettle             | 96          | 1        | 2         | 25
openssh            | 53          | 0        | 3         | 671 T
openssl            | 146         | 1        | 8         | 104
pango              | 12          | 0        | 0         | 0
perl               | 2440        | 19       | 232       | 1042
python             | 16219       | 21       | 725       | 324
python3            | 14801       | 1        | 358       | 679 T
quilt              | 57          | 0        | 0         | 26
sed                | 86          | 0        | 0         | 3
slang              | 97          | 0        | 0         | 20
strace             | 227         | 297      | 107       | 30
tcl                | 149         | 0        | 0         | 3
util-linux         | 0           | 427      | 48        | -
--------------------------------------------------------------------------------------------------------------


==============================================================================================================
Failed test cases (sorted by testseries, ID)
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
testseries | result_id : beaglebone | runtime_core-image-sato-sdk_beaglebone-yocto_20190322023018
    stap.StapTest.test_stap
    parselogs.ParseLogsTest.test_parselogs
testseries | result_id : build-appliance | manual_build-appliance_20190328132020
    build-appliance.build-appliance.Create_core-image-sato-sdk_using_build_appliance
testseries | result_id : edgerouter | runtime_core-image-sato-sdk_edgerouter_20190321002604
    xorg.XorgTest.test_xorg_running
    buildcpio.BuildCpioTest.test_cpio
    parselogs.ParseLogsTest.test_parselogs
testseries | result_id : mpc8315e-rdb | runtime_core-image-sato-sdk_mpc8315e-rdb_20190321011257
    xorg.XorgTest.test_xorg_running
testseries | result_id : oe-selftest | oeselftest_opensuseleap-15.0_qemux86-64_20190320011444
    wic.Wic2.test_wic_cp_ext
testseries | result_id : qemu-shutdown | oeselftest_ubuntu-16.04_qemumips64_20190321162351
    runqemu.QemuTest.test_qemu_can_boot_nfs_and_shutdown
    runqemu.QemuTest.test_qemu_can_shutdown
testseries | result_id : qemu-shutdown | oeselftest_ubuntu-16.04_qemumips_20190322103433
    runqemu.QemuTest.test_qemu_can_boot_nfs_and_shutdown
    runqemu.QemuTest.test_qemu_can_shutdown
testseries | result_id : qemux86-64-ptest | runtime_core-image-sato-sdk-ptest_qemux86-64_20190320002354
    ptestresult.strace.shmxt.gen.test
    ptestresult.util-linux.cal:_1sw-year__cal/sep1752-1sw-year_
    ptestresult.util-linux.cal:_3sw-month__cal/bigyear-3sw-month_
    ptestresult.util-linux.blkid:_bcache-C__blkid/low-probe-bcache-C_
    ptestresult.util-linux.blkid:_befs__blkid/low-probe-befs_
    ptestresult.util-linux.lscpu:_ppc64-POWER7__lscpu/lscpu-ppc64-POWER7_
    ptestresult.util-linux.lsmem:_x86_64-16g__lsmem/lsmem-x86_64-16g_
    ptestresult.util-linux.cramfs:_mkfs_checksums__ul_cd:_/usr/lib/util-linux/ptest/tests/output/cramfs/mkfs-data:_no_such_directory_
    ptestresult.util-linux.cal:_3m-week40-color__cal/weekarg-3m-week40-color_
    ptestresult.strace.printstrn-umoven-undumpable.gen.test
    ptestresult.util-linux.partx:_sgi__partx/partx-image-sgi_
    ptestresult.util-linux.libfdisk:_gpt-space-gap__libfdisk/mkpart-full-gpt-space-gap_
    ptestresult.util-linux.script:_buffering_race__script/buffering-race_
    ptestresult.util-linux.hexdump:_2b_dec-2__hexdump/highlighting-2b_dec-2_
    ptestresult.strace.sockopt-sol_netlink.gen.test
    ptestresult.strace.sched_xetscheduler.gen.test
    ptestresult.util-linux.dmesg:_facilities__dmesg/facilities_
    ptestresult.strace.netlink_sock_diag.test
    ptestresult.util-linux.cal:_1mj-week53-color__cal/weekarg-1mj-week53-color_
    ptestresult.strace.setuid.gen.test
    ptestresult.util-linux.blkid:_ext3__blkid/low-probe-ext3_
    ptestresult.strace.sigsuspend.gen.test
    ptestresult.strace.count-f.test
    ptestresult.util-linux.getopt:_name_option_long__getopt/options-name_option_long_
    ptestresult.util-linux.rename:_overwrite__ul_cd:_/usr/lib/util-linux/ptest/tests/output/rename:_no_such_directory_
    ptestresult.util-linux.lscpu:_x86_64-64cpu__lscpu/lscpu-x86_64-64cpu_
    ptestresult.strace.futex.test
    ptestresult.util-linux.blkid:_hpt37x-raid__blkid/low-probe-hpt37x-raid_
    ptestresult.python.test_directory_compiled__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpBHl9SI':
    ptestresult.util-linux.cramfs:_mkfs_doubles__cramfs/doubles_
    ptestresult.strace.net-y-unix.test
    ptestresult.strace.umoven-illptr.gen.test
    ptestresult.util-linux.libsmartcols:_tree__libsmartcols/fromfile-tree_
    ptestresult.strace.ioctl_evdev-success.test
    ptestresult.perl.cpan/Win32/t/GetOSVersion
    ptestresult.util-linux.cal:_1mjw__cal/month-1mjw_
    ptestresult.strace.xattr-strings.gen.test
    ptestresult.util-linux.cal:_ysjw__cal/year-ysjw_
    ptestresult.strace.btrfs-vX.test
    ptestresult.util-linux.cal:_1sj__cal/month-1sj_
    ptestresult.strace.regex.gen.test
    ptestresult.strace.prctl-tsc.test
    ptestresult.util-linux.blkid:_ubi_mkdir:_cannot_create_directory_'/usr/lib/util-linux/ptest/tests/output':_No_space_left_on_device
    ptestresult.util-linux.findmnt:_options-nameval__findmnt/filter-options-nameval_
    ptestresult.strace.waitid.gen.test
    ptestresult.util-linux.mount:_by_devname__fstab_uuid___mount/fstab-devname2uuid_
    ptestresult.util-linux.hexdump:_1b_char-1__hexdump/highlighting-1b_char-1_
    ptestresult.util-linux.cal:_1mj-month__cal/sep1752-1mj-month_
    ptestresult.strace.getuid.test
    ptestresult.strace.userfaultfd.gen.test
    ptestresult.strace.sock_filter-v-Xabbrev.gen.test
    ptestresult.util-linux.blkid:_tuxonice__blkid/low-probe-tuxonice_
    ptestresult.strace.utimensat.gen.test
    ptestresult.util-linux.cal:_color_with_week_numbers__cal/colorw_
    ptestresult.util-linux.blkid:_fat32_label_64MB__blkid/low-probe-fat32_label_64MB_
    ptestresult.util-linux.findmnt:_options-nameval-neg__findmnt/filter-options-nameval-neg_
    ptestresult.python.test_module_in_package_in_zipfile__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpY5l9gL/launch.py':
    ptestresult.strace.strace-S.test
    ptestresult.util-linux.findmnt:_root__findmnt/target-root_
    ptestresult.util-linux.cal:_3s-week40__cal/weekarg-3s-week40_
    ptestresult.util-linux.fdisk:_MBR_-_dos_mode__fdisk/mbr-dos-mode_
    ptestresult.strace.recvmsg.gen.test
    ptestresult.util-linux.blkid:_luks1__blkid/low-probe-luks1_
    ptestresult.util-linux.isosize:_sector_output__isosize/print-size-sector_output_
    ptestresult.util-linux.cramfs:_nopad-4K-le__cramfs/fsck-bad-header-nopad-4K-le_
    ptestresult.util-linux.blkid:_via-raid__blkid/low-probe-via-raid_
    ptestresult.strace.bexecve.test
    ptestresult.util-linux.libfdisk:_gpt-err-overlap__libfdisk/mkpart-full-gpt-err-overlap_
    ptestresult.util-linux.cal:_3mj__cal/month-3mj_
    ptestresult.strace.inject-nf.test
    ptestresult.strace.setfsgid.gen.test
    ptestresult.util-linux.colcrt:_half-lines__colcrt/functional-half-lines_
    ptestresult.util-linux.md5:_md5__md5/md5_
    ptestresult.util-linux.mount:_btrfs__fstab___mount/fstab-btrfs_
    ptestresult.util-linux.cramfs:_pad-64K-le__cramfs/fsck-bad-header-pad-64K-le_
    ptestresult.util-linux.mount:_fs_lists__mount/fslists_
    ptestresult.strace.timer_create.gen.test
    ptestresult.strace.unlink.gen.test
    ptestresult.util-linux.libfdisk:_mbr-primary-nopartno__libfdisk/mkpart-full-mbr-primary-nopartno_
    ptestresult.strace.process_vm_writev.gen.test
    ptestresult.strace.umask.gen.test
    ptestresult.util-linux.findmnt:_kernel__findmnt/outputs-kernel_
    ptestresult.util-linux.getopt:_posix_correctly__getopt/options-posix_correctly_
    ptestresult.python.test_doctest_main_issue4197__test.test_zipimport_support.ZipSupportTests__..._Expected_line_File_"/var/volatile/tmp/tmp2YTA6n/script.py",_line_2,_in___main__.Test
    ptestresult.util-linux.login:_islocal__login/islocal_
    ptestresult.util-linux.dmesg:_colors__dmesg/colors_
    ptestresult.strace.so_peercred.gen.test
    ptestresult.util-linux.lsns:_NSFS_for_ip-netns-add__ul_cd:_/usr/lib/util-linux/ptest/tests/output/lsns:_no_such_directory_
    ptestresult.strace.sigpending.gen.test
    ptestresult.strace.poll-P.test
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-2__blkid/low-probe-udf-hdd-mkudffs-1.3-2_
    ptestresult.strace.recvfrom.gen.test
    ptestresult.util-linux.blkid:_udf-hdd-win7__blkid/low-probe-udf-hdd-win7_
    ptestresult.strace.termsig.test
    ptestresult.util-linux.libsmartcols:_wrap__libsmartcols/fromfile-wrap_
    ptestresult.strace.nsyscalls.test
    ptestresult.util-linux.mount:_by_label__mount/label_
    ptestresult.util-linux.misc:_flock__misc/flock_
    ptestresult.strace.quotactl-Xabbrev.gen.test
    ptestresult.strace.net-yy-netlink.test
    ptestresult.strace.process_vm_readv.gen.test
    ptestresult.strace.statx.gen.test
    ptestresult.util-linux.hexdump:_4b_dec-4__hexdump/highlighting-4b_dec-4_
    ptestresult.util-linux.getopt:_unquoted_option_bash__getopt/options-unquoted_option_bash_
    ptestresult.util-linux.getopt:_test_for_enhanced_getopt__getopt/options-test_for_enhanced_getopt_
    ptestresult.strace.waitid-v.gen.test
    ptestresult.busybox.wget-handles-empty-path
    ptestresult.util-linux.fdisk:_gpt-resize__fdisk/gpt-resize_
    ptestresult.perl.cpan/Win32/t/CodePage
    ptestresult.util-linux.hexdump:_2b_dec-6__hexdump/highlighting-2b_dec-6_
    ptestresult.strace.setns.gen.test
    ptestresult.util-linux.libfdisk:_gpt__libfdisk/mkpart-gpt_
    ptestresult.strace.trace_statfs_like.gen.test
    ptestresult.strace.qual_inject-signal-syscall.test
    ptestresult.strace.sync_file_range.gen.test
    ptestresult.util-linux.cal:_1mj__cal/month-1mj_
    ptestresult.util-linux.hexdump:_canon__hexdump/format-strings-canon_
    ptestresult.util-linux.findmnt:_messy-mountinfo__findmnt/outputs-messy-mountinfo_
    ptestresult.util-linux.cal:_ymw__cal/year-ymw_
    ptestresult.util-linux.fdisk:_MBR_-_id__fdisk/id_
    ptestresult.util-linux.findmnt:_submounts__findmnt/outputs-submounts_
    ptestresult.strace.sched_get_priority_mxx.gen.test
    ptestresult.strace.prlimit64.gen.test
    ptestresult.util-linux.libfdisk:_mbr-err-primary__libfdisk/mkpart-full-mbr-err-primary_
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-5__blkid/low-probe-udf-hdd-mkudffs-1.3-5_
    ptestresult.util-linux.getopt:_invocation_model_one__getopt/options-invocation_model_one_
    ptestresult.util-linux.mount:_by_uuid__fstab_devname___mount/fstab-uuid2devname_
    ptestresult.util-linux.blkid:_udf-hdd-udfclient-0.7.5__blkid/low-probe-udf-hdd-udfclient-0.7.5_
    ptestresult.util-linux.findmnt:_options-neg__findmnt/filter-options-neg_
    ptestresult.util-linux.cal:_3mw__cal/weeknum-3mw_
    ptestresult.strace.quotactl-v.gen.test
    ptestresult.busybox.wget-retrieves-google-index
    ptestresult.util-linux.misc:_ionice__misc/ionice_
    ptestresult.util-linux.hexdump:_2b_dec__hexdump/format-strings-2b_dec_
    ptestresult.strace.sigign.test
    ptestresult.util-linux.findmnt:_types-multi__findmnt/filter-types-multi_
    ptestresult.strace.unlinkat.gen.test
    ptestresult.strace.qual_syscall.test
    ptestresult.util-linux.blkid:_luks2__blkid/low-probe-luks2_
    ptestresult.strace.fflush.test
    ptestresult.util-linux.libsmartcols:_noextremes__libsmartcols/fromfile-noextremes_
    ptestresult.python.test_zipfile_compiled__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpi4fzwl/test_zip.zip':
    ptestresult.strace.wait4.gen.test
    ptestresult.util-linux.cal:_1m-year__cal/bigyear-1m-year_
    ptestresult.strace.sock_filter-v.gen.test
    ptestresult.util-linux.blkid:_silicon-raid__blkid/low-probe-silicon-raid_
    ptestresult.strace.rt_sigtimedwait.gen.test
    ptestresult.strace.setgid32.gen.test
    ptestresult.strace.clock.gen.test
    ptestresult.strace.utime.gen.test
    ptestresult.strace.count.test
    ptestresult.util-linux.colcrt:_no-options__colcrt/functional-no-options_
    ptestresult.strace.threads-execve.test
    ptestresult.util-linux.cal:_3mjw-month__cal/bigyear-3mjw-month_
    ptestresult.util-linux.blkid:_udf-bdr-2.60-nero__blkid/low-probe-udf-bdr-2.60-nero_
    ptestresult.util-linux.findmnt:_force-tree__findmnt/outputs-force-tree_
    ptestresult.gstreamer1.0.gst/gstsystemclock
    ptestresult.strace.times-fail.gen.test
    ptestresult.strace.quotactl-Xverbose.gen.test
    ptestresult.util-linux.schedutils:_cpuset__schedutils/cpuset_
    ptestresult.strace.sigprocmask.gen.test
    ptestresult.strace.ptrace_syscall_info.gen.test
    ptestresult.util-linux.cal:_1sjw-month__cal/bigyear-1sjw-month_
    ptestresult.strace.trace_stat_like.gen.test
    ptestresult.strace.caps-abbrev.test
    ptestresult.util-linux.cal:_1m-month__cal/sep1752-1m-month_
    ptestresult.util-linux.cal:_m3w__cal/jan1753-m3w_
    ptestresult.util-linux.blkid:_nvidia-raid__blkid/low-probe-nvidia-raid_
    ptestresult.util-linux.cramfs:_pad-4K-be__cramfs/fsck-bad-header-pad-4K-be_
    ptestresult.util-linux.findmnt:_options-nameval-multi__findmnt/filter-options-nameval-multi_
    ptestresult.strace.symlinkat.gen.test
    ptestresult.util-linux.blkid:_promise-raid__blkid/low-probe-promise-raid_
    ptestresult.perl.cpan/Win32/t/Names
    ptestresult.util-linux.hexdump:_empty-format__hexdump/format-strings-empty-format_
    ptestresult.util-linux.misc:_options__misc/setarch-options_
    ptestresult.util-linux.cal:_1sjw-year__cal/bigyear-1sjw-year_
    ptestresult.strace.remap_file_pages-Xverbose.gen.test
    ptestresult.util-linux.fdisk:_nested_BSD__fdisk/bsd_
    ptestresult.util-linux.getopt:_sh__getopt/options-sh_
    ptestresult.strace.ugetrlimit.gen.test
    ptestresult.strace.splice.gen.test
    ptestresult.util-linux.login:_defs__login/logindefs_
    ptestresult.strace.seccomp-strict.test
    ptestresult.util-linux.mount:_by_devname__fstab___mount/fstab-devname_
    ptestresult.strace.read-write.gen.test
    ptestresult.strace.qual_fault-exit_group.test
    ptestresult.strace.sigaction.gen.test
    ptestresult.util-linux.column:_multiple_files__ul_cd:_/usr/lib/util-linux/ptest/tests/output/column:_no_such_directory_
    ptestresult.strace.statfs.gen.test
    ptestresult.strace.remap_file_pages.gen.test
    ptestresult.util-linux.rename:_exit_codes__ul_cd:_/usr/lib/util-linux/ptest/tests/output/rename:_no_such_directory_
    ptestresult.strace.bpf-success-v.test
    ptestresult.util-linux.misc:_setsid__misc/setsid_
    ptestresult.strace.execve-v.test
    ptestresult.util-linux.cal:_3m-week40__cal/weekarg-3m-week40_
    ptestresult.strace.wait4-v.gen.test
    ptestresult.util-linux.findmnt:_types__findmnt/filter-types_
    ptestresult.util-linux.cal:_1sw__cal/month-1sw_
    ptestresult.strace.s390_pci_mmio_read_write.gen.test
    ptestresult.util-linux.colrm:_basic_check__colrm/rm2-2_
    ptestresult.strace.delay.test
    ptestresult.strace.mmap.test
    ptestresult.strace.strace-T.test
    ptestresult.util-linux.cal:_1mjw-month__cal/sep1752-1mjw-month_
    ptestresult.util-linux.blkid:_ddf-raid__blkid/low-probe-ddf-raid_
    ptestresult.strace.stat.gen.test
    ptestresult.util-linux.libsmartcols:_tree-json__libsmartcols/fromfile-tree-json_
    ptestresult.util-linux.cal:_1mw-month__cal/sep1752-1mw-month_
    ptestresult.strace.prctl-pdeathsig.test
    ptestresult.util-linux.cal:_1s-year__cal/sep1752-1s-year_
    ptestresult.python3.test_start_tls_server_1__test.test_asyncio.test_sslproto.SelectorStartTLSTests_
    ptestresult.util-linux.fdisk:_MBR_-_sort__fdisk/mbr-sort_
    ptestresult.util-linux.cal:_3mj-week40__cal/weekarg-3mj-week40_
    ptestresult.util-linux.dmesg:_levels__dmesg/console-levels_
    ptestresult.strace.setfsuid32.gen.test
    ptestresult.util-linux.hexdump:_4b_dec-2__hexdump/highlighting-4b_dec-2_
    ptestresult.strace.strace-E.test
    ptestresult.strace.sigreturn.gen.test
    ptestresult.util-linux.libsmartcols:_wrapnl__libsmartcols/fromfile-wrapnl_
    ptestresult.strace.strace-r.test
    ptestresult.strace.attach-p-cmd.test
    ptestresult.util-linux.blkid:_jmicron-raid__blkid/low-probe-jmicron-raid_
    ptestresult.util-linux.blkid:_nilfs2__blkid/low-probe-nilfs2_
    ptestresult.strace.remap_file_pages-Xabbrev.gen.test
    ptestresult.strace.execve.test
    ptestresult.util-linux.libfdisk:_mbr-nopartno__libfdisk/mkpart-full-mbr-nopartno_
    ptestresult.strace.qual_signal.test
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-3__blkid/low-probe-udf-hdd-mkudffs-1.3-3_
    ptestresult.util-linux.cal:_3sjw-month__cal/sep1752-3sjw-month_
    ptestresult.dbus-test.test/test-bus
    ptestresult.strace.truncate.gen.test
    ptestresult.util-linux.blkid:_fat32_cp850_O_tilde__blkid/low-probe-fat32_cp850_O_tilde_
    ptestresult.util-linux.ipcs:_mk-rm-msg__ipcs/mk-rm-msg_
    ptestresult.util-linux.partx:_dos+bsd__partx/partx-image-dos+bsd_
    ptestresult.bash.run-new-exp
    ptestresult.util-linux.cal:_3s-month__cal/sep1752-3s-month_
    ptestresult.util-linux.rename:_subdir_check__ul_cd:_/usr/lib/util-linux/ptest/tests/output/rename:_no_such_directory_
    ptestresult.util-linux.hexdump:_2b_hex__hexdump/format-strings-2b_hex_
    ptestresult.util-linux.cal:_ymj__cal/year-ymj_
    ptestresult.util-linux.hexdump:_1b_octal-9__hexdump/highlighting-1b_octal-9_
    ptestresult.strace.setregid.gen.test
    ptestresult.strace.signal_receive.gen.test
    ptestresult.util-linux.cal:_ymjw__cal/weeknum-ymjw_
    ptestresult.util-linux.cal:_ys__cal/year-ys_
    ptestresult.strace.printstrn-umoven.gen.test
    ptestresult.util-linux.cal:_3sj-month__cal/bigyear-3sj-month_
    ptestresult.gstreamer1.0.pipelines/parse-launch
    ptestresult.util-linux.cal:_1mj-week53__cal/weekarg-1mj-week53_
    ptestresult.util-linux.cal:_ym__cal/year-ym_
    ptestresult.strace.prctl-no-args.test
    ptestresult.util-linux.blkid:_mdraid__blkid/low-probe-mdraid_
    ptestresult.util-linux.blkid:_iso-joliet__blkid/low-probe-iso-joliet_
    ptestresult.util-linux.hexdump:_1b_octal-3__hexdump/highlighting-1b_octal-3_
    ptestresult.strace.select.gen.test
    ptestresult.util-linux.lscpu:_x86_64-dell_e4310__lscpu/lscpu-x86_64-dell_e4310_
    ptestresult.util-linux.findmnt:_non-root__findmnt/target-non-root_
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-7__blkid/low-probe-udf-hdd-mkudffs-1.3-7_
    ptestresult.dbus-test.test/test-dbus-daemon
    ptestresult.util-linux.cal:_1mj-year__cal/bigyear-1mj-year_
    ptestresult.util-linux.getopt:_invocation_without_parameters__getopt/options-invocation_without_parameters_
    ptestresult.strace.prctl-seccomp-strict.test
    ptestresult.util-linux.cal:_1m-week53-color__cal/weekarg-1m-week53-color_
    ptestresult.python.test_script_compiled__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpFYd0pV/script.pyc':
    ptestresult.strace.quotactl-Xraw.gen.test
    ptestresult.util-linux.libsmartcols:_tree-middle__libsmartcols/fromfile-tree-middle_
    ptestresult.strace.s390_sthyi-v.gen.test
    ptestresult.util-linux.libsmartcols:_strictwidth__libsmartcols/fromfile-strictwidth_
    ptestresult.strace.xattr.gen.test
    ptestresult.util-linux.hexdump:_2b_dec-1__hexdump/highlighting-2b_dec-1_
    ptestresult.strace.rmdir.gen.test
    ptestresult.util-linux.lscpu:_sparc64__lscpu/lscpu-sparc64_
    ptestresult.util-linux.blkid:_bcache-B__blkid/low-probe-bcache-B_
    ptestresult.strace.printpath-umovestr-legacy.test
    ptestresult.strace.fadvise64.test
    ptestresult.util-linux.cal:_1sw-month__cal/bigyear-1sw-month_
    ptestresult.util-linux.blkid:_hfsplus__blkid/low-probe-hfsplus_
    ptestresult.python.testing_import_hangers_..._OK.
    ptestresult.util-linux.partx:_sun__partx/partx-image-sun_
    ptestresult.strace.eventfd.test
    ptestresult.util-linux.getopt:_basic__getopt/basic_
    ptestresult.strace.ipc_msgbuf.test
    ptestresult.strace.remap_file_pages-Xraw.gen.test
    ptestresult.strace.prctl-spec-inject.test
    ptestresult.strace.s390_guarded_storage.gen.test
    ptestresult.strace.pselect6.gen.test
    ptestresult.util-linux.getopt:_weird_quoting_tcsh__getopt/options-weird_quoting_tcsh_
    ptestresult.util-linux.partx:_atari-icd__partx/partx-image-atari-icd_
    ptestresult.util-linux.cal:_3mj-month__cal/sep1752-3mj-month_
    ptestresult.util-linux.lscpu:_s390-zvm__lscpu/lscpu-s390-zvm_
    ptestresult.strace.readv.test
    ptestresult.util-linux.blkid:_atari-xgm__blkid/lowprobe-pt-atari-xgm_
    ptestresult.strace.trace_fstatfs.gen.test
    ptestresult.util-linux.misc:_uname26__unsupported_--uname-2.6:_echo_true_
    ptestresult.util-linux.libmount:_losetup-loop__libmount/loop_
    ptestresult.strace.time.gen.test
    ptestresult.util-linux.dmesg:_indentation__dmesg/indentation_
    ptestresult.util-linux.blkid:_exfat__blkid/low-probe-exfat_
    ptestresult.util-linux.dmesg:_delta__dmesg/delta_
    ptestresult.util-linux.fdisk:_GPT__fdisk/gpt_
    ptestresult.util-linux.libfdisk:_mbr__libfdisk/mkpart-mbr_
    ptestresult.util-linux.cal:_3sj__cal/month-3sj_
    ptestresult.strace.uio.test
    ptestresult.util-linux.blkid:_xfs__blkid/low-probe-xfs_
    ptestresult.util-linux.hexdump:_2b_dec-3__hexdump/highlighting-2b_dec-3_
    ptestresult.util-linux.cal:_ysj__cal/year-ysj_
    ptestresult.strace.umovestr.test
    ptestresult.strace.quotactl-xfs-v.gen.test
    ptestresult.strace.brk.test
    ptestresult.strace.nsyscalls-d.test
    ptestresult.util-linux.hexdump:_1b_octal-5__hexdump/highlighting-1b_octal-5_
    ptestresult.util-linux.blkid:_small-fat32__blkid/low-probe-small-fat32_
    ptestresult.util-linux.blkid:_lvm2__blkid/low-probe-lvm2_
    ptestresult.util-linux.blkid:_bsd__blkid/lowprobe-pt-bsd_
    ptestresult.util-linux.isosize:_divisor_output__isosize/print-size-divisor_output_
    ptestresult.strace.sched_xetattr.gen.test
    ptestresult.util-linux.blkid:_hpfs__blkid/low-probe-hpfs_
    ptestresult.strace.detach-stopped.test
    ptest.PtestRunnerTest.test_ptestrunner
    ptestresult.util-linux.getopt:_quiet_output_option_long__getopt/options-quiet_output_option_long_
    ptestresult.strace.statfs64.gen.test
    ptestresult.util-linux.dmesg:_decode__dmesg/decode_
    ptestresult.util-linux.cal:_1sw-year__cal/bigyear-1sw-year_
    ptestresult.util-linux.libsmartcols:_raw__libsmartcols/fromfile-raw_
    ptestresult.strace.trace_personality_64.gen.test
    ptestresult.strace.quotactl-xfs-success.test
    ptestresult.util-linux.cal:_color__cal/color_
    ptestresult.util-linux.cal:_3s-month__cal/bigyear-3s-month_
    ptestresult.util-linux.cal:_1sj-month__cal/sep1752-1sj-month_
    ptestresult.strace.setfsgid32.gen.test
    ptestresult.strace.redirect-fds.test
    ptestresult.util-linux.blkdiscard:_offsets__blkdiscard/offsets_
    ptestresult.util-linux.getopt:_same_long_short_options__getopt/options-same_long_short_options_
    ptestresult.lttng-tools.test_utils_expand_path_26_-_symlink_tree_test_case:_[tmppath/]a/g/../l/../
    ptestresult.perl.t/op/stat
    ptestresult.strace.qual_inject-error-signal-syscall.test
    ptestresult.util-linux.blkid:_vmfs__blkid/low-probe-vmfs_
    ptestresult.perl.cpan/Win32/t/CreateFile
    ptestresult.util-linux.mount:_call_mount.<type>__mount/special_
    ptestresult.strace.sendfile64.gen.test
    ptestresult.perl.cpan/Win32/t/GetFullPathName
    ptestresult.util-linux.blkid:_udf-hdd-udfclient-0.7.7__blkid/low-probe-udf-hdd-udfclient-0.7.7_
    ptestresult.util-linux.mount:_by_uuid__mount/uuid_
    ptestresult.strace.rt_sigsuspend.gen.test
    ptestresult.util-linux.cal:_ymjw__cal/year-ymjw_
    ptestresult.strace.trace_personality_regex_32.gen.test
    ptestresult.util-linux.hexdump:_1b_octal-6__hexdump/highlighting-1b_octal-6_
    ptestresult.util-linux.blkid:_sun__blkid/lowprobe-pt-sun_
    ptestresult.util-linux.blkid:_udf-cd-nero-6__blkid/low-probe-udf-cd-nero-6_
    ptestresult.util-linux.misc:_fallocate__misc/fallocate_
    ptestresult.util-linux.cal:_m-week40__cal/weekarg-m-week40_
    ptestresult.strace.readahead.gen.test
    ptestresult.strace.qual_fault-syntax.test
    ptestresult.util-linux.mount:_shared-subtree__mount/shared-subtree_
    ptestresult.util-linux.cal:_3s-week54-color__cal/weekarg-3s-week54-color_
    ptestresult.util-linux.cal:_3m-week53-color__cal/weekarg-3m-week53-color_
    ptestresult.util-linux.cal:_3s__cal/month-3s_
    ptestresult.util-linux.hexdump:_4b_dec-5__hexdump/highlighting-4b_dec-5_
    ptestresult.util-linux.cal:_ysjw__cal/weeknum-ysjw_
    ptestresult.strace.readlinkat.gen.test
    ptestresult.strace.net-tpacket_stats-success.test
    ptestresult.strace.signalfd4.gen.test
    ptestresult.strace.trace_stat.gen.test
    ptestresult.util-linux.colcrt:_crash2__colcrt/regressions-crash2_
    ptestresult.strace.umovestr2.test
    ptestresult.util-linux.getopt:_name_option_short__getopt/options-name_option_short_
    ptestresult.util-linux.blkid:_gfs2__blkid/low-probe-gfs2_
    ptestresult.util-linux.cal:_sj-week40__cal/weekarg-sj-week40_
    ptestresult.strace.sched_yield.gen.test
    ptestresult.util-linux.hexdump:_2b_octal__hexdump/format-strings-2b_octal_
    ptestresult.util-linux.blkid:_minix-BE__blkid/low-probe-minix-BE_
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-8__blkid/low-probe-udf-hdd-mkudffs-1.3-8_
    ptestresult.util-linux.getopt:_longopts__getopt/options-longopts_
    ptestresult.util-linux.cal:_1mw-year__cal/bigyear-1mw-year_
    ptestresult.python.test_module_in_package__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpG6RT6x/launch.py':
    ptestresult.util-linux.lsns:_NETNSID_compare_to_ip-link__ul_cd:_/usr/lib/util-linux/ptest/tests/output/lsns:_no_such_directory_
    ptestresult.util-linux.libfdisk:_gpt-nopartno__libfdisk/mkpart-full-gpt-nopartno_
    ptestresult.util-linux.hexdump:_1b_octal-1__hexdump/highlighting-1b_octal-1_
    ptestresult.bash.run-vredir
    ptestresult.util-linux.cal:_1mjw-year__cal/sep1752-1mjw-year_
    ptestresult.util-linux.cal:_1sj-year__cal/sep1752-1sj-year_
    ptestresult.util-linux.cal:_3m-month__cal/sep1752-3m-month_
    ptestresult.util-linux.cal:_3mjw__cal/month-3mjw_
    ptestresult.strace.xetpriority.gen.test
    ptestresult.util-linux.blkid:_drbdmanage-control-volume__blkid/low-probe-drbdmanage-control-volume_
    ptestresult.strace.recvmmsg-timeout.gen.test
    ptestresult.util-linux.lscpu:_s390-lpar__lscpu/lscpu-s390-lpar_
    ptestresult.strace.detach-running.test
    ptestresult.strace.so_linger.gen.test
    ptestresult.util-linux.blkid:_atari-icd__blkid/lowprobe-pt-atari-icd_
    ptestresult.strace.setresgid32.gen.test
    ptestresult.util-linux.cal:_1mj-year__cal/sep1752-1mj-year_
    ptestresult.strace.opipe.test
    ptestresult.strace.qual_inject-syntax.test
    ptestresult.strace.seccomp-filter.gen.test
    ptestresult.util-linux.blkid:_minix-LE__blkid/low-probe-minix-LE_
    ptestresult.util-linux.blkid:_reiser4__blkid/low-probe-reiser4_
    ptestresult.strace.select-P.gen.test
    ptestresult.util-linux.hexdump:_1b_octal-4__hexdump/highlighting-1b_octal-4_
    ptestresult.strace.timer_xettime.gen.test
    ptestresult.util-linux.column:_table__ul_cd:_/usr/lib/util-linux/ptest/tests/output/column:_no_such_directory_
    ptestresult.util-linux.cal:_ysw__cal/weeknum-ysw_
    ptestresult.strace.sxetmask.gen.test
    ptestresult.util-linux.look:_separator__look/separator_
    ptestresult.util-linux.hexdump:_4b_dec-3__hexdump/highlighting-4b_dec-3_
    ptestresult.python.test_directory_error__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpkKLzNs':
    ptestresult.util-linux.mount:_loop__fstab___mount/fstab-loop_
    ptestresult.strace.lseek.test
    ptestresult.strace.sock_filter-v-Xraw.gen.test
    ptestresult.util-linux.cal:_3sw__cal/weeknum-3sw_
    ptestresult.strace.setgid.gen.test
    ptestresult.strace.net-yy-inet.test
    ptestresult.perl.cpan/Win32/t/GetOSName
    ptestresult.util-linux.cal:_1mw-month__cal/bigyear-1mw-month_
    ptestresult.util-linux.libsmartcols:_title__libsmartcols/title_
    ptestresult.strace.get_regs.test
    ptestresult.util-linux.cal:_3sjw__cal/month-3sjw_
    ptestresult.perl.ext/VMS-Stdio/t/vms_stdio
    ptestresult.util-linux.getopt:_quiet_output_option_short__getopt/options-quiet_output_option_short_
    ptestresult.util-linux.hexdump:_1b_octal__hexdump/format-strings-1b_octal_
    ptestresult.strace.pipe.test
    ptestresult.strace.quotactl-success-v.test
    ptestresult.util-linux.getopt:_quiet_option_short__getopt/options-quiet_option_short_
    ptestresult.util-linux.partx:_bsd__partx/partx-image-bsd_
    ptestresult.util-linux.blkid:_ntfs__blkid/low-probe-ntfs_
    ptestresult.strace.prctl-securebits.test
    ptestresult.util-linux.cal:_3m__cal/month-3m_
    ptestresult.strace.trace_personality_regex_x32.gen.test
    ptestresult.strace.vfork-f.gen.test
    ptestresult.util-linux.cal:_1m-week53__cal/weekarg-1m-week53_
    ptestresult.util-linux.blkid:_isw-raid__blkid/low-probe-isw-raid_
    ptestresult.util-linux.cal:_1mjw-month__cal/bigyear-1mjw-month_
    ptestresult.util-linux.isosize:_default_output__isosize/print-size-default_output_
    ptestresult.strace.unix-pair-send-recv.test
    ptestresult.util-linux.blkid:_fat__blkid/low-probe-fat_
    ptestresult.strace.unshare.gen.test
    ptestresult.strace.strace-ttt.test
    ptestresult.strace.utimensat-Xabbrev.gen.test
    ptestresult.strace.xet_robust_list.gen.test
    ptestresult.util-linux.getopt:_invocation_model_two_as_one__getopt/options-invocation_model_two_as_one_
    ptestresult.util-linux.cal:_3mjw__cal/weeknum-3mjw_
    ptestresult.perl.cpan/Win32/t/GetLongPathName
    ptestresult.util-linux.mount:_by_devname__mount/devname_
    ptestresult.util-linux.libsmartcols:_right-maxout__libsmartcols/fromfile-right-maxout_
    ptestresult.util-linux.misc:_rev__misc/rev_
    ptestresult.strace.rt_sigaction.test
    ptestresult.lttng-tools.test_utils_expand_path_23_-_symlink_tree_test_case:_[tmppath/]a/g/../l/.
    ptestresult.util-linux.lscpu:_s390-lpar-drawer__lscpu/lscpu-s390-lpar-drawer_
    ptestresult.util-linux.blkid:_gpt__blkid/lowprobe-pt-gpt_
    ptestresult.util-linux.cal:_3sw-month__cal/sep1752-3sw-month_
    ptestresult.perl.cpan/Win32/t/Unicode
    ptestresult.util-linux.cal:_week-iso__cal/sep1752-week-iso_
    ptestresult.strace.setgroups32.gen.test
    ptestresult.util-linux.hexdump:_1b_octal-7__hexdump/highlighting-1b_octal-7_
    ptestresult.util-linux.libfdisk:_gpt-partno-gap__libfdisk/mkpart-full-gpt-partno-gap_
    ptestresult.util-linux.mount:_by_label__fstab_uuid___mount/fstab-label2uuid_
    ptestresult.strace.timerfd_xettime.gen.test
    ptestresult.util-linux.blkid:_hfs__blkid/low-probe-hfs_
    ptestresult.util-linux.mount:_by_label__fstab_devname___mount/fstab-label2devname_
    ptestresult.util-linux.getopt:_no-arguments__getopt/options-no-arguments_
    ptestresult.util-linux.cal:_1sj-year__cal/bigyear-1sj-year_
    ptestresult.util-linux.getopt:_unknown_options__getopt/options-unknown_options_
    ptestresult.strace.trace_personality_regex_64.gen.test
    ptestresult.util-linux.blkid:_reiser3__blkid/low-probe-reiser3_
    ptestresult.strace.prctl-arg2-intptr.test
    ptestresult.strace.bpf-success.test
    ptestresult.util-linux.mount:_move__mount/move_
    ptestresult.strace.sched_rr_get_interval.gen.test
    ptestresult.util-linux.cal:_1m__cal/month-1m_
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.0.0-2__blkid/low-probe-udf-hdd-mkudffs-1.0.0-2_
    ptestresult.strace.seccomp_get_action_avail.gen.test
    ptestresult.strace.semop.gen.test
    ptestresult.util-linux.cal:_1sjw__cal/month-1sjw_
    ptestresult.util-linux.blkid:_vmfs_volume__blkid/low-probe-vmfs_volume_
    ptestresult.strace.redirect.test
    ptestresult.strace.btrfs-X.test
    ptestresult.util-linux.cal:_1s__cal/month-1s_
    ptestresult.busybox.wget-supports--P
    ptestresult.util-linux.hexdump:_1b_char-3__hexdump/highlighting-1b_char-3_
    ptestresult.strace.sysinfo.gen.test
    ptestresult.strace.swap.gen.test
    ptestresult.util-linux.cal:_3mjw-month__cal/sep1752-3mjw-month_
    ptestresult.perl.cpan/Win32/t/GetFolderPath
    ptestresult.util-linux.blkid:_mpool__blkid/low-probe-mpool_
    ptestresult.util-linux.libsmartcols:_wrap-tree__libsmartcols/fromfile-wrap-tree_
    ptestresult.strace.uname.test
    ptestresult.util-linux.libsmartcols:_tree-end__libsmartcols/fromfile-tree-end_
    ptestresult.strace.sun_path.test
    ptestresult.strace.renameat.gen.test
    ptestresult.strace.setresgid.gen.test
    ptestresult.python.test_basic_script__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpo1fWLC/script.py':
    ptestresult.util-linux.findmnt:_options__findmnt/filter-options_
    ptestresult.util-linux.hexdump:_2b_dec-4__hexdump/highlighting-2b_dec-4_
    ptestresult.strace.strace-ff.test
    ptestresult.strace.setuid32.gen.test
    ptestresult.strace.reboot.gen.test
    ptestresult.util-linux.cal:_3sjw-month__cal/bigyear-3sjw-month_
    ptestresult.strace.quotactl-success.test
    ptestresult.strace.xet_thread_area_x86.test
    ptestresult.strace.kern_features-fault.test
    ptestresult.strace.sync.gen.test
    ptestresult.strace.prctl-tid_address.test
    ptestresult.util-linux.cal:_3sj-month__cal/sep1752-3sj-month_
    ptestresult.strace.set_mempolicy.gen.test
    ptestresult.strace.ioctl.test
    ptestresult.strace.qual_inject-signal.test
    ptestresult.strace.filter-unavailable.test
    ptestresult.strace.sock_filter-v-Xverbose.gen.test
    ptestresult.python.test_pipe_cloexec__test.test_subprocess.POSIXProcessTestCase_
    ptestresult.python.Trying_50_threads_..._OK.
    ptestresult.util-linux.findmnt:_types-neg__findmnt/filter-types-neg_
    ptestresult.util-linux.libsmartcols:_hidden__libsmartcols/fromfile-hidden_
    ptestresult.util-linux.cal:_1sw-month__cal/sep1752-1sw-month_
    ptestresult.strace.printstrn-umoven-legacy.test
    ptestresult.strace.rt_sigprocmask.gen.test
    ptestresult.util-linux.mount:_by_devname__fstab_label___mount/fstab-devname2label_
    ptestresult.util-linux.blkid:_swap0__blkid/low-probe-swap0_
    ptestresult.util-linux.cramfs:_pad-64K-be__cramfs/fsck-bad-header-pad-64K-be_
    ptestresult.lttng-tools.test_utils_expand_path_27_-_symlink_tree_test_case:_[tmppath/]a/b/h/g/
    ptestresult.util-linux.rename:_basic_check__ul_cd:_/usr/lib/util-linux/ptest/tests/output/rename:_no_such_directory_
    ptestresult.util-linux.libfdisk:_gpt__libfdisk/mkpart-full-gpt_
    ptestresult.util-linux.getopt:_invalid_getopt_option__getopt/options-invalid_getopt_option_
    ptestresult.strace.quotactl-xfs-success-v.test
    ptestresult.strace.trace_personality_32.gen.test
    ptestresult.util-linux.ipcs:_headers__ipcs/headers_
    ptestresult.python.test_package__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpuTVLpX/launch.py':
    ptestresult.strace.setregid32.gen.test
    ptestresult.util-linux.getopt:_weird_quoting_bash__getopt/options-weird_quoting_bash_
    ptestresult.strace.s390_runtime_instr.gen.test
    ptestresult.util-linux.blkid:_dos+bsd__blkid/lowprobe-pt-dos+bsd_
    ptestresult.util-linux.blkid:_fat16_noheads__blkid/low-probe-fat16_noheads_
    ptestresult.strace.strace-V.test
    ptestresult.strace.net.test
    ptestresult.util-linux.cal:_1sjw-month__cal/sep1752-1sjw-month_
    ptestresult.util-linux.bitops:_swap_bytes__bitops/swapbytes_
    ptestresult.python.test_zipfile_error__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmp0ziZ8e/test_zip.zip':
    ptestresult.util-linux.cal:_s-week40__cal/weekarg-s-week40_
    ptestresult.util-linux.blkid:_iso-rr-joliet__blkid/low-probe-iso-rr-joliet_
    ptestresult.python.test_zipfile__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpWpOk_A/test_zip.zip':
    ptestresult.util-linux.lscpu:_ppc-qemu__lscpu/lscpu-ppc-qemu_
    ptestresult.util-linux.cramfs:_fsck_endianness__cramfs/fsck-endianness_
    ptestresult.strace.s390_sthyi.gen.test
    ptestresult.strace.rt_sigreturn.gen.test
    ptestresult.strace.so_peercred-Xverbose.gen.test
    ptestresult.util-linux.blkid:_xfs-log__blkid/low-probe-xfs-log_
    ptestresult.strace.setfsuid.gen.test
    ptestresult.strace.sched_xetparam.gen.test
    ptestresult.strace.waitpid.gen.test
    ptestresult.perl.cpan/Win32/t/ExpandEnvironmentStrings
    ptestresult.strace.qual_inject-retval-syscall.test
    ptestresult.util-linux.blkid:_ubifs__blkid/low-probe-ubifs_
    ptestresult.util-linux.mount:_remount__mount/remount_
    ptestresult.util-linux.partx:_gpt__partx/partx-image-gpt_
    ptestresult.util-linux.blkid:_netware__blkid/low-probe-netware_
    ptestresult.strace.signal.gen.test
    ptestresult.glib-2.0.glib/gdatetime.test__Child_process_killed_by_signal_6_
    ptestresult.util-linux.hexdump:_canon-2__hexdump/highlighting-canon-2_
    ptestresult.util-linux.colcrt:_crash1__colcrt/regressions-crash1_
    ptestresult.util-linux.libfdisk:_mbr-nopartno__libfdisk/mkpart-mbr-nopartno_
    ptestresult.strace.request_key.gen.test
    ptestresult.util-linux.losetup:_losetup__losetup/losetup_
    ptestresult.strace.times.gen.test
    ptestresult.util-linux.hexdump:_2b_dec-7__hexdump/highlighting-2b_dec-7_
    ptestresult.strace.sched_xetaffinity.gen.test
    ptestresult.strace.socketcall.gen.test
    ptestresult.strace.restart_syscall.test
    ptestresult.strace.xetitimer.gen.test
    ptestresult.perl.cpan/Win32/t/GuidGen
    ptestresult.util-linux.fdisk:_MBR_-_non-dos_mode__fdisk/mbr-nondos-mode_
    ptestresult.util-linux.getopt:_long_option_ambiguous_1__getopt/options-long_option_ambiguous_1_
    ptestresult.util-linux.libfdisk:_mbr-err-logical__libfdisk/mkpart-full-mbr-err-logical_
    ptestresult.strace.vhangup.gen.test
    ptestresult.util-linux.cal:_3mj-month__cal/bigyear-3mj-month_
    ptestresult.python.test_package_recursion__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpI8ZgvU/launch.py':
    ptestresult.strace.trace_personality_x32.gen.test
    ptestresult.util-linux.cal:_mj-week40__cal/weekarg-mj-week40_
    ptestresult.util-linux.misc:_whereis__misc/whereis_
    ptestresult.util-linux.hexdump:_4b_dec-6__hexdump/highlighting-4b_dec-6_
    ptestresult.util-linux.libsmartcols:_column-separator__libsmartcols/fromfile-column-separator_
    ptestresult.util-linux.cal:_1m-month__cal/bigyear-1m-month_
    ptestresult.util-linux.cal:_1sj-month__cal/bigyear-1sj-month_
    ptestresult.strace.strace-C.test
    ptestresult.strace.rt_tgsigqueueinfo.gen.test
    ptestresult.util-linux.blkid:_jbd__blkid/low-probe-jbd_
    ptestresult.python.test_package_error__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpNFHiSx/launch.py':
    ptestresult.strace.unix-pair-sendto-recvfrom.test
    ptestresult.strace.trace_question.gen.test
    ptestresult.python.test_directory__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpPB3CXm':
    ptestresult.perl.cpan/Win32/t/GetFileVersion
    ptestresult.strace.umount2.test
    ptestresult.util-linux.blkid:_ext2__blkid/low-probe-ext2_
    ptestresult.strace.renameat2.gen.test
    ptestresult.util-linux.cal:_ysw__cal/year-ysw_
    ptestresult.util-linux.blkid:_sgi__blkid/lowprobe-pt-sgi_
    ptestresult.util-linux.ipcs:_mk-rm-sem__ipcs/mk-rm-sem_
    ptestresult.util-linux.mount:_by_uuid__fstab___mount/fstab-uuid_
    ptestresult.strace.shutdown.gen.test
    ptestresult.util-linux.namei:_basic_functionality__ul_cd:_/usr/lib/util-linux/ptest/tests/output/namei:_no_such_directory_
    ptestresult.util-linux.cal:_1mj-month__cal/bigyear-1mj-month_
    ptestresult.strace.stat64.gen.test
    ptestresult.strace.sigblock.test
    ptestresult.util-linux.libfdisk:_mbr-err-nospace__libfdisk/mkpart-full-mbr-err-nospace_
    ptestresult.util-linux.partx:_atari-xgm__partx/partx-image-atari-xgm_
    ptestresult.strace.symlink.gen.test
    ptestresult.strace.net-yy-unix.test
    ptestresult.strace.s390_guarded_storage-v.gen.test
    ptestresult.strace.setreuid32.gen.test
    ptestresult.util-linux.cal:_3mw-month__cal/sep1752-3mw-month_
    ptestresult.util-linux.cal:_3sw__cal/month-3sw_
    ptestresult.strace.ioctl_evdev-success-v.test
    ptestresult.strace.btrfs-v.test
    ptestresult.util-linux.cal:_3sjw__cal/weeknum-3sjw_
    ptestresult.util-linux.blkid:_iso__blkid/low-probe-iso_
    ptestresult.util-linux.blkid:_udf__blkid/low-probe-udf_
    ptestresult.strace.qual_fault.test
    ptestresult.util-linux.libmount:_loop_overlay__libmount/loop-overlay_
    ptestresult.strace.qual_fault-syscall.test
    ptestresult.util-linux.cal:_3m-month__cal/bigyear-3m-month_
    ptestresult.util-linux.column:_invalid_multibyte__ul_cd:_/usr/lib/util-linux/ptest/tests/output/column:_no_such_directory_
    ptestresult.util-linux.blkid:_lsi-raid__blkid/low-probe-lsi-raid_
    ptestresult.util-linux.getopt:_alternative_option_short__getopt/options-alternative_option_short_
    ptestresult.strace.umount.test
    ptestresult.util-linux.cal:_1mjw-year__cal/bigyear-1mjw-year_
    ptestresult.strace.readdir.gen.test
    ptestresult.strace.rename.gen.test
    ptestresult.util-linux.hexdump:_1b_char-2__hexdump/highlighting-1b_char-2_
    ptestresult.util-linux.findmnt:_options-name__findmnt/filter-options-name_
    ptestresult.perl.ext/VMS-DCLsym/t/vms_dclsym
    ptestresult.util-linux.hexdump:_2b_dec-8__hexdump/highlighting-2b_dec-8_
    ptestresult.strace.siginfo.gen.test
    ptestresult.util-linux.blkid:_jfs__blkid/low-probe-jfs_
    ptestresult.util-linux.cal:_3m-week52-color__cal/weekarg-3m-week52-color_
    ptestresult.strace.pwritev.gen.test
    ptestresult.busybox.wget--O-overrides--P
    ptestresult.util-linux.mount:_by_label__fstab___mount/fstab-label_
    ptestresult.strace.pc.test
    ptestresult.util-linux.cal:_3mw-month__cal/bigyear-3mw-month_
    ptestresult.strace.prctl-dumpable.test
    ptestresult.strace.riscv_flush_icache.gen.test
    ptestresult.util-linux.getopt:_quiet_option_long__getopt/options-quiet_option_long_
    ptestresult.python.Trying_20_threads_..._OK.
    ptestresult.util-linux.fdisk:_sunlabel_tests__fdisk/sunlabel_
    ptestresult.strace.xettimeofday.gen.test
    ptestresult.util-linux.hexdump:_canon-1__hexdump/highlighting-canon-1_
    ptestresult.util-linux.colcrt:_hang1__colcrt/regressions-hang1_
    ptestresult.util-linux.getopt:_alternative_option_long__getopt/options-alternative_option_long_
    ptestresult.strace.setgroups.gen.test
    ptestresult.strace.seccomp-filter-v.gen.test
    ptestresult.util-linux.getopt:_invocation_model_three_as_one__getopt/options-invocation_model_three_as_one_
    ptestresult.util-linux.cal:_ymw__cal/weeknum-ymw_
    ptestresult.strace.so_peercred-Xabbrev.gen.test
    ptestresult.util-linux.getopt:_alternative_option_clash__getopt/options-alternative_option_clash_
    ptestresult.util-linux.blkid:_romfs__blkid/low-probe-romfs_
    ptestresult.python.test_package_compiled__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpMrhV6p/launch.py':
    ptestresult.strace.setreuid.gen.test
    ptestresult.util-linux.blkid:_cramfs__blkid/low-probe-cramfs_
    ptestresult.strace.prctl-seccomp-filter-v.test
    ptestresult.strace.utimensat-Xverbose.gen.test
    ptestresult.util-linux.blkid:_vdo__blkid/low-probe-vdo_
    ptestresult.strace.trace_statfs.gen.test
    ptestresult.strace.readlink.gen.test
    ptestresult.strace.umovestr3.gen.test
    ptestresult.strace.nsyscalls-nd.test
    ptestresult.util-linux.findmnt:_default__findmnt/outputs-default_
    ptestresult.util-linux.cal:_3w__cal/jan1753-3w_
    ptestresult.strace.quotactl-xfs.gen.test
    ptestresult.util-linux.mount:_by_devname__fstab_symlink___mount/fstab-symlink_
    ptestresult.strace.rt_sigqueueinfo.gen.test
    ptestresult.strace.setdomainname.gen.test
    ptestresult.strace.qual_inject-error-signal.test
    ptestresult.strace.attach-f-p.test
    ptestresult.util-linux.hexdump:_1b_char__hexdump/format-strings-1b_char_
    ptestresult.util-linux.libfdisk:_mbr-logic__libfdisk/mkpart-mbr-logic_
    ptestresult.util-linux.cal:_1mw-year__cal/sep1752-1mw-year_
    ptestresult.util-linux.cal:_1sjw-year__cal/sep1752-1sjw-year_
    ptestresult.util-linux.blkid:_bfs__blkid/low-probe-bfs_
    ptestresult.util-linux.misc:_ul__misc/ul_
    ptestresult.util-linux.getopt:_non-option__getopt/options-non-option_
    ptestresult.util-linux.hexdump:_1b_octal-2__hexdump/highlighting-1b_octal-2_
    ptestresult.util-linux.lscpu:_vbox-win__lscpu/lscpu-vbox-win_
    ptestresult.util-linux.mount:_regular_file__mount/regfile_
    ptestresult.strace.setresuid32.gen.test
    ptestresult.util-linux.mount:_by_uuid__fstab_label___mount/fstab-uuid2label_
    ptestresult.util-linux.rename:_symlink_check__ul_cd:_/usr/lib/util-linux/ptest/tests/output/rename:_no_such_directory_
    ptestresult.util-linux.fdisk:_align_512/512__fdisk/align-512-512_
    ptestresult.strace.poll.test
    ptestresult.util-linux.cal:_3mw__cal/month-3mw_
    ptestresult.strace.setresuid.gen.test
    ptestresult.util-linux.libsmartcols:_export__libsmartcols/fromfile-export_
    ptestresult.bash.run-read
    ptestresult.strace.so_error.gen.test
    ptestresult.lttng-tools.test_utils_expand_path_24_-_symlink_tree_test_case:_[tmppath/]a/g/../l/./
    ptestresult.strace.xetpgid.gen.test
    ptestresult.perl.ext/VMS-Filespec/t/filespec
    ptestresult.strace.tee.gen.test
    ptestresult.strace.truncate64.gen.test
    ptestresult.strace.trace_fstat.gen.test
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-6__blkid/low-probe-udf-hdd-mkudffs-1.3-6_
    ptestresult.strace.clone_ptrace.test
    ptestresult.util-linux.more:_squeeze__more/squeeze_
    ptestresult.util-linux.findmnt:_options-no-multi__findmnt/filter-options-no-multi_
    ptestresult.util-linux.misc:_mcookie__misc/mcookie_
    ptestresult.openssl.test/recipes/90-test_shlibload.t,_test_returned_9__wstat_2304,_0x900_
    ptestresult.util-linux.colcrt:_no-underlining__colcrt/functional-no-underlining_
    ptestresult.util-linux.lscpu:_ppc64-POWER7-64cpu__lscpu/lscpu-ppc64-POWER7-64cpu_
    ptestresult.util-linux.misc:_strtosize__misc/strtosize_
    ptestresult.util-linux.hexdump:_4b_dec-7__hexdump/highlighting-4b_dec-7_
    ptestresult.python.test_getsetlocale_issue1813__test.test_locale.TestMiscellaneous_
    ptestresult.strace.rt_sigpending.gen.test
    ptestresult.util-linux.hexdump:_4b_dec-1__hexdump/highlighting-4b_dec-1_
    ptestresult.util-linux.blkid:_zfs__blkid/low-probe-zfs_
    ptestresult.util-linux.more:_regexp__more/regexp_
    ptestresult.strace.umovestr-illptr.gen.test
    ptestresult.strace.sendfile.gen.test
    ptestresult.strace.interactive_block.test
    ptestresult.strace.sync_file_range2.gen.test
    ptestresult.strace.caps.test
    ptestresult.util-linux.lscpu:_armv7__lscpu/lscpu-armv7_
    ptestresult.util-linux.getopt:_csh__getopt/options-csh_
    ptestresult.util-linux.col:_multibyte_input__col/multibyte_
    ptestresult.util-linux.ipcs:_mk-rm-shm__ipcs/mk-rm-shm_
    ptestresult.util-linux.cramfs:_nopad-4K-be__cramfs/fsck-bad-header-nopad-4K-be_
    ptestresult.strace.vmsplice.gen.test
    ptestresult.util-linux.getopt:_compatible__getopt/options-compatible_
    ptestresult.strace.syslog.gen.test
    ptestresult.strace.so_peercred-Xraw.gen.test
    ptestresult.util-linux.cal:_3sj-week40__cal/weekarg-3sj-week40_
    ptestresult.util-linux.libfdisk:_mbr-logical__libfdisk/mkpart-full-mbr-logical_
    ptestresult.util-linux.hexdump:_2b_dec-5__hexdump/highlighting-2b_dec-5_
    ptestresult.util-linux.fdisk:_invalid_input_tests__fdisk/oddinput_
    ptestresult.util-linux.libfdisk:_mbr-primary__libfdisk/mkpart-full-mbr-primary_
    ptestresult.util-linux.libfdisk:_mbr-space-gap__libfdisk/mkpart-full-mbr-space-gap_
    ptestresult.util-linux.cal:_1s-year__cal/bigyear-1s-year_
    ptestresult.util-linux.libsmartcols:_wrapnl-tree__libsmartcols/fromfile-wrapnl-tree_
    ptestresult.util-linux.cramfs:_mkfs_endianness__cramfs/mkfs-endianness_
    ptestresult.gstreamer1.0.gst/gsturi
    ptestresult.strace.sched.gen.test
    ptestresult.strace.quotactl.gen.test
    ptestresult.util-linux.findmnt:_options-no__findmnt/filter-options-no_
    ptestresult.util-linux.lsmem:_s390-zvm-6g__lsmem/lsmem-s390-zvm-6g_
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.0.0-1__blkid/low-probe-udf-hdd-mkudffs-1.0.0-1_
    ptestresult.util-linux.cal:_1s-month__cal/sep1752-1s-month_
    ptestresult.perl.cpan/Win32/t/GetCurrentThreadId
    ptestresult.util-linux.hexdump:_1b_octal-8__hexdump/highlighting-1b_octal-8_
    ptestresult.util-linux.blkid:_ufs__blkid/low-probe-ufs_
    ptestresult.util-linux.blkid:_udf-cd-mkudfiso-20100208__blkid/low-probe-udf-cd-mkudfiso-20100208_
    ptestresult.util-linux.cal:_3mj-week40-color__cal/weekarg-3mj-week40-color_
    ptestresult.util-linux.blkid:_hpt45x-raid__blkid/low-probe-hpt45x-raid_
    ptestresult.bash.run-trap
    ptestresult.util-linux.libsmartcols:_trunc__libsmartcols/fromfile-trunc_
    ptestresult.perl.cpan/Win32/t/GetShortPathName
    ptestresult.busybox.dc_read
    ptestresult.util-linux.cal:_1m-year__cal/sep1752-1m-year_
    ptestresult.strace.qual_inject-retval.test
    ptestresult.busybox.dc_read_string
    ptestresult.strace.detach-sleeping.test
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-4__blkid/low-probe-udf-hdd-mkudffs-1.3-4_
    ptestresult.strace.ioctl_perf-success.test
    ptestresult.util-linux.libsmartcols:_right__libsmartcols/fromfile-right_
    ptestresult.perl.ext/GDBM_File/t/fatal
    ptestresult.util-linux.cal:_1s-month__cal/bigyear-1s-month_
    ptestresult.strace.personality.test
    ptestresult.util-linux.getopt:_unquoted_option_tcsh__getopt/options-unquoted_option_tcsh_
    ptestresult.strace.prctl-name.test
    ptestresult.util-linux.cal:_1mw__cal/month-1mw_
    ptestresult.util-linux.blkid:_ocfs2__blkid/low-probe-ocfs2_
    ptestresult.util-linux.blkid:_adaptec-raid__blkid/low-probe-adaptec-raid_
    ptestresult.strace.sigaltstack.test
    ptestresult.dbus-test.test/test-names
    ptestresult.strace.ptrace.gen.test
    ptestresult.strace.printstrn-umoven-peekdata.gen.test
    ptestresult.nettle.nettle-pbkdf2-test
    ptestresult.util-linux.blkid:_udf-hdd-mkudffs-1.3-1__blkid/low-probe-udf-hdd-mkudffs-1.3-1_
    ptestresult.strace.utimes.gen.test
    ptestresult.strace.llseek.test
    ptestresult.util-linux.blkid:_f2fs__blkid/low-probe-f2fs_
    ptestresult.python.test_module_in_subpackage_in_zipfile__test.test_cmd_line_script.CmdLineTest__..._Output_from_test_script_'/var/volatile/tmp/tmpHdNwBy/launch.py':
    ptestresult.util-linux.fsck:_is_mounted__fsck/ismounted_
    ptestresult.strace.clone_parent.test
    ptestresult.lttng-tools.test_utils_expand_path_25_-_symlink_tree_test_case:_[tmppath/]a/g/../l/..
    ptestresult.strace.setrlimit.gen.test
    ptestresult.strace.sethostname.gen.test
    ptestresult.strace.utimensat-Xraw.gen.test
    ptestresult.util-linux.column:_columnate__ul_cd:_/usr/lib/util-linux/ptest/tests/output/column:_no_such_directory_
    ptestresult.util-linux.blkid:_swap1__blkid/low-probe-swap1_
    ptestresult.strace.ustat.gen.test
    ptestresult.strace.first_exec_failure.test
    ptestresult.util-linux.lscpu:_s390-kvm__lscpu/lscpu-s390-kvm_
    ptestresult.util-linux.cramfs:_pad-4K-le__cramfs/fsck-bad-header-pad-4K-le_
    ptestresult.strace.trace_lstat.gen.test
    ptestresult.util-linux.colcrt:_short-options__colcrt/functional-short-options_
testseries | result_id : toaster | manual_toaster-managed-mode_20190328115523
    toaster-managed-mode.toaster-managed.Adding_packages_with_dependencies
    toaster-managed-mode.toaster-managed.Adding_packages_without_dependencies_from_custom_images
    toaster-managed-mode.toaster-managed.Removing_packages_without_and_with_dependencies__from_custom_images
--------------------------------------------------------------------------------------------------------------


[-- Attachment #3: 2.7_M3_RC1_results_merged.zip --]
[-- Type: application/x-zip-compressed, Size: 39192 bytes --]

[-- Attachment #4: 2.7_m3_rc1_intel_wr_merged_report --]
[-- Type: application/octet-stream, Size: 8644 bytes --]

==============================================================================================================
Test Result Status Summary (Counts/Percentages sorted by testseries, ID)
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
Test Series     | ID                                                          | Passed    | Failed   | Skipped 
--------------------------------------------------------------------------------------------------------------
beaglebone      | manual_bsps-hw_20190325085141                               | 22 (48%)  | 0 (0%)   | 24 (52%)
beaglebone      | manual_compliance-test_20190326135217                       | 4 (67%)   | 0 (0%)   | 2 (33%) 
beaglebone      | runtime_core-image-sato-sdk_beaglebone-yocto_20190322023018 | 46 (77%)  | 2 (3%)   | 12 (20%)
bitbake         | manual_oe-core_20190321085120                               | 7 (100%)  | 0 (0%)   | 0 (0%)  
build-appliance | manual_build-appliance_20190328132020                       | 1 (33%)   | 1 (33%)  | 1 (33%) 
crops           | sdkext_core-image-sato-sdk_x86_64_qemux86_20190325045401    | 17 (81%)  | 0 (0%)   | 4 (19%) 
eclipse-plugin  | manual_eclipse-plugin_20190326132957                        | 6 (100%)  | 0 (0%)   | 0 (0%)  
eclipse-plugin  | manual_eclipse-plugin_20190326170756                        | 6 (100%)  | 0 (0%)   | 0 (0%)  
edgerouter      | manual_bsps-hw_20190325101748                               | 11 (24%)  | 0 (0%)   | 35 (76%)
edgerouter      | manual_compliance-test_20190326135938                       | 2 (33%)   | 0 (0%)   | 4 (67%) 
edgerouter      | runtime_core-image-sato-sdk_edgerouter_20190321002604       | 45 (75%)  | 3 (5%)   | 12 (20%)
kernel-dev      | manual_kernel-dev_20190321132956                            | 9 (100%)  | 0 (0%)   | 0 (0%)  
minnowboard     | manual_bsps-hw_20190322172915                               | 46 (100%) | 0 (0%)   | 0 (0%)  
minnowboard     | runtime_core-image-lsb-sdk_genericx86-64_20190323060918     | 47 (78%)  | 0 (0%)   | 13 (22%)
minnowboard     | runtime_core-image-lsb-sdk_genericx86_20190323091640        | 47 (78%)  | 0 (0%)   | 13 (22%)
minnowboard     | runtime_core-image-sato-sdk_genericx86-64_20190322072832    | 48 (80%)  | 0 (0%)   | 12 (20%)
minnowboard     | runtime_core-image-sato-sdk_genericx86_20190323072551       | 48 (80%)  | 0 (0%)   | 12 (20%)
mpc8315e-rdb    | manual_bsps-hw_20190325093903                               | 15 (33%)  | 0 (0%)   | 31 (67%)
mpc8315e-rdb    | manual_compliance-test_20190326135811                       | 2 (33%)   | 0 (0%)   | 4 (67%) 
mpc8315e-rdb    | runtime_core-image-sato-sdk_mpc8315e-rdb_20190321011257     | 47 (78%)  | 1 (2%)   | 12 (20%)
nuc6            | manual_compliance-test_20190327151229                       | 4 (67%)   | 0 (0%)   | 2 (33%) 
nuc6            | runtime_core-image-lsb-sdk_genericx86-64_20190325064425     | 47 (78%)  | 0 (0%)   | 13 (22%)
nuc6            | runtime_core-image-sato-sdk_genericx86-64_20190325021647    | 48 (80%)  | 0 (0%)   | 12 (20%)
nuc7            | manual_bsps-hw_20190321143341                               | 46 (100%) | 0 (0%)   | 0 (0%)  
nuc7            | runtime_core-image-lsb-sdk_genericx86-64_20190322031806     | 47 (78%)  | 0 (0%)   | 13 (22%)
nuc7            | runtime_core-image-sato-sdk_genericx86-64_20190322051029    | 48 (80%)  | 0 (0%)   | 12 (20%)
qemu-shutdown   | oeselftest_ubuntu-16.04_qemuarm64_20190322141035            | 2 (100%)  | 0 (0%)   | 0 (0%)  
qemu-shutdown   | oeselftest_ubuntu-16.04_qemuarm_20190321134048              | 2 (100%)  | 0 (0%)   | 0 (0%)  
qemu-shutdown   | oeselftest_ubuntu-16.04_qemumips64_20190321162351           | 0 (0%)    | 2 (100%) | 0 (0%)  
qemu-shutdown   | oeselftest_ubuntu-16.04_qemumips_20190322103433             | 0 (0%)    | 2 (100%) | 0 (0%)  
qemu-shutdown   | oeselftest_ubuntu-16.04_qemuppc_20190322160004              | 2 (100%)  | 0 (0%)   | 0 (0%)  
qemu-shutdown   | oeselftest_ubuntu-16.04_qemux86-64_20190321174637           | 2 (100%)  | 0 (0%)   | 0 (0%)  
qemu-shutdown   | oeselftest_ubuntu-16.04_qemux86_20190321170535              | 2 (100%)  | 0 (0%)   | 0 (0%)  
qemuarm64       | manual_bsps-qemu_20190326165610                             | 5 (62%)   | 0 (0%)   | 3 (38%) 
qemuarm         | manual_bsps-qemu_20190326165419                             | 5 (62%)   | 0 (0%)   | 3 (38%) 
qemumips64      | manual_bsps-qemu_20190326170202                             | 5 (62%)   | 0 (0%)   | 3 (38%) 
qemumips        | manual_bsps-qemu_20190326165809                             | 5 (62%)   | 0 (0%)   | 3 (38%) 
qemuppc         | manual_bsps-qemu_20190326165942                             | 5 (62%)   | 0 (0%)   | 3 (38%) 
qemux86-64      | manual_bsps-qemu_20190326165126                             | 5 (62%)   | 0 (0%)   | 3 (38%) 
qemux86         | manual_bsps-qemu_20190326164713                             | 8 (100%)  | 0 (0%)   | 0 (0%)  
sdk-extras      | manual_sdk_20190321125223                                   | 1 (100%)  | 0 (0%)   | 0 (0%)  
sdk-extras      | manual_sdk_20190328103341                                   | 1 (100%)  | 0 (0%)   | 0 (0%)  
sdk-extras      | oeselftest_ubuntu-16.04_qemuarm_20190322123322              | 3 (100%)  | 0 (0%)   | 0 (0%)  
sdk-extras      | oeselftest_ubuntu-16.04_qemumips_20190322130951             | 3 (100%)  | 0 (0%)   | 0 (0%)  
sdk-extras      | oeselftest_ubuntu-16.04_qemuppc_20190322134920              | 3 (100%)  | 0 (0%)   | 0 (0%)  
sdk-extras      | oeselftest_ubuntu-16.04_qemux86_20190322102002              | 3 (100%)  | 0 (0%)   | 0 (0%)  
toaster         | manual_toaster-managed-mode_20190328115523                  | 62 (95%)  | 3 (5%)   | 0 (0%)  
toaster         | manual_toaster-unmanaged-mode_20190328115015                | 28 (100%) | 0 (0%)   | 0 (0%)  
--------------------------------------------------------------------------------------------------------------

There was no ptest data

==============================================================================================================
Failed test cases (sorted by testseries, ID)
==============================================================================================================
--------------------------------------------------------------------------------------------------------------
testseries | result_id : beaglebone | runtime_core-image-sato-sdk_beaglebone-yocto_20190322023018
    stap.StapTest.test_stap
	##[QA comment]: Bug 13153
    parselogs.ParseLogsTest.test_parselogs
	##[QA comment]: WR team is investigating more on this issue. Bo bug filed as this is not a real Yocto bug.
testseries | result_id : build-appliance | manual_build-appliance_20190328132020
    build-appliance.build-appliance.Create_core-image-sato-sdk_using_build_appliance
	##[QA comment]: Bug 12991
testseries | result_id : edgerouter | runtime_core-image-sato-sdk_edgerouter_20190321002604
    xorg.XorgTest.test_xorg_running
	## [QA Comment]: This is an expected failure due to hw limitation.
	parselogs.ParseLogsTest.test_parselogs
	##[QA comment]: WR team is investigating more on this issue. Bo bug filed as this is not a real Yocto bug.
    buildcpio.BuildCpioTest.test_cpio
	## [QA Comment]: This is an expected failure due to hw limitation.
testseries | result_id : mpc8315e-rdb | runtime_core-image-sato-sdk_mpc8315e-rdb_20190321011257
    xorg.XorgTest.test_xorg_running
	## [QA Comment]: This is an expected failure due to hw limitation.
testseries | result_id : qemu-shutdown | oeselftest_ubuntu-16.04_qemumips64_20190321162351
    runqemu.QemuTest.test_qemu_can_boot_nfs_and_shutdown
    runqemu.QemuTest.test_qemu_can_shutdown
	## [QA Comment]: 2 failures - Bug 13234 
testseries | result_id : qemu-shutdown | oeselftest_ubuntu-16.04_qemumips_20190322103433
    runqemu.QemuTest.test_qemu_can_boot_nfs_and_shutdown
    runqemu.QemuTest.test_qemu_can_shutdown
	## [QA Comment]: 2 failures - Bug 13234
testseries | result_id : toaster | manual_toaster-managed-mode_20190328115523
    toaster-managed-mode.toaster-managed.Adding_packages_without_dependencies_from_custom_images
    toaster-managed-mode.toaster-managed.Removing_packages_without_and_with_dependencies__from_custom_images
    toaster-managed-mode.toaster-managed.Adding_packages_with_dependencies
	## [QA Comment]: 3 failures - Bug 13191
--------------------------------------------------------------------------------------------------------------


^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: QA cycle report for 2.7 M3 RC1
  2019-04-02  5:02 QA cycle report for 2.7 M3 RC1 Jain, Sangeeta
  2019-04-02 10:11 ` Jain, Sangeeta
@ 2019-04-02 18:32 ` richard.purdie
  2019-04-03  6:06   ` Jain, Sangeeta
  2019-04-06 10:11   ` Alexander Kanavin
  1 sibling, 2 replies; 5+ messages in thread
From: richard.purdie @ 2019-04-02 18:32 UTC (permalink / raw)
  To: Jain, Sangeeta, 'yocto@yoctoproject.org',
	Eggleton, Paul, 'Michael Halstead',
	Erway, Tracey M, sjolley.yp.pm, Ross Burton
  Cc: OTC Embedded Malaysia

Hi Sangeeta/Ee Peng,

On Tue, 2019-04-02 at 05:02 +0000, Jain, Sangeeta wrote:
> QA cycle report for 2.7 M3 RC1:
>  
> No high milestone defects. 
> This is completion of first QA cycle after adoption of new QA
> process. Test results are available at following location:
> ·        For results of all automated tests, please refer to results
> at public AB [1].
> ·        For other test results, refer to attachment [2].
> ·        For test report for test cases run by Intel and WR team,
> refer attachment [3]
> ·        For full test report, refer attachment [4]
> 2 new defects are found in this cycle, oe-selftest [5] and qemu-
> shutdown[6].
> Number of existing issues observed in this release is 3- toaster [7],
> Build-appliance [8] and Beaglebone [9]
> For ptest, 3 package tests are failing in this release which were
> passing in previous release: python [10], python3[11] and strace[12].
> 3 packages are facing timeout issues: lttng-tools [13], openssh [14]
> and python3 [15].

Thanks for this. I have some questions/observations.

Looking at the Intel/WR report, I see tests which start oeselftest_XXX
for sdk-extras and qemu-shutdown. I think this means you have some QA
test infrastructure running "oe-selftest -r runqemu,meta_ide",
iterating over MACHINE=qemuppc, qemumips, qemuarm, qemux86?

Is this some automation we're missing in the autobuilder configuration?
We all other tests covered and this is the only remaining automated
piece we haven't covered? What configuration are we missing exactly for
the missing tests?

I'm partly wondering how you found the shutdown issue but this would
explain that.

I think going forward we need to add some kind of "who" identifier to
the test results so we can say where/who they came from (main
autobuilder, Intel, WR, anywhere else). We could add a resulttool
command to "stamp" a set of test results with this, maybe as a
parameter to the store command?

Of the bugs, I didn't see any which I think should block M3, I think we
probably should release that and move forward to M4. I do want to see
some of these fixed before we build M4 though. I've made comments on
them below.
 
> New Bugs :
>  
> [5] Bug 13237 - [2.7 M3 RC1][OE-selftest][Opensuseleap 15.0][Public
> AB]:"test_wic_cp_ext" failing for Opensuseleap 15.0.
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13237

Ross: Are you looking into that one?

> [6] Bug 13234 - [2.7 M3 RC1] qemumips & qemumips64: failed to
> shutdown
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13234

This needs looking into and fixing, as well as figuring out why the
autobuilder doesn't see this (see above for my hypothesis).

> Previous Bugs observed in this release:
>  
> [7] Bug 13191 – [Test Case 1439] Build Failure after adding or
> removing packages with and without dependencies
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13191
>  
> [8] Bug 12991 - [Bug] [2.6 M4 RC1][Build-Appliance] Bitbake build-
> appliance-image getting failed during building image due to webkitgtk
> package.
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=12991

We need to do something about this. I believe its related to resource
starvation in the VM.

> [9] Bug 13153 – [2.7 M2 RC1] Systemtap doesn't work on beaglebone
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13153

I'm hoping a SRCREV bump for beaglebone-yocto fixes this.

> ptest Bugs:
>  
> [10] Bug 13249 - [2.7 M3 RC1] python ptest failure
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13249

I'm hoping a patch from Ross in master fixes this, need to retest ptest
with this applied.
 
> [11] Bug 13253 - [2.7 M3 RC1] python3 ptest failure
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13253

I'm hoping a patch from Ross in master fixes this, need to retest ptest
with this applied.

> [12] Bug 13254 - [2.7 M3 RC1] strace ptest failure
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13254

No ideas on this one yet.
 
> [13] Bug 13255 - [2.7 M3 rc1] lttng-tools ptest facing timeout issue
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13255

There are patches which are due to arrive soon which should address
this.

> [14] Bug 13256 - [2.7 M3 rc1] openssh ptest facing timeout issue
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13256

No ideas on this one yet.

> [15] Bug 13257 - [2.7 M3 rc1] python3 ptest facing timeout issue
> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13257

I'm hoping a patch from Ross in master fixes this, need to retest ptest
with this applied.

Cheers,

Richard



^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: QA cycle report for 2.7 M3 RC1
  2019-04-02 18:32 ` richard.purdie
@ 2019-04-03  6:06   ` Jain, Sangeeta
  2019-04-06 10:11   ` Alexander Kanavin
  1 sibling, 0 replies; 5+ messages in thread
From: Jain, Sangeeta @ 2019-04-03  6:06 UTC (permalink / raw)
  To: richard.purdie, 'yocto@yoctoproject.org',
	Eggleton, Paul, 'Michael Halstead',
	Erway, Tracey M, sjolley.yp.pm, Burton, Ross

Hi Richard,

For oe-selftest -r runqemu,meta_ide, configuration we are using is only changing the machine type.

For adding "who" identifier in resulttool command, we can take it up as an enhancement.

Thanks & Regards,
Sangeeta Jain

>-----Original Message-----
>From: richard.purdie@linuxfoundation.org <richard.purdie@linuxfoundation.org>
>Sent: Wednesday, 3 April, 2019 2:32 AM
>To: Jain, Sangeeta <sangeeta.jain@intel.com>; 'yocto@yoctoproject.org'
><yocto@yoctoproject.org>; Eggleton, Paul <paul.eggleton@intel.com>; 'Michael
>Halstead' <mhalstead@linuxfoundation.org>; Erway, Tracey M
><tracey.m.erway@intel.com>; sjolley.yp.pm@gmail.com; Burton, Ross
><ross.burton@intel.com>
>Cc: OTC Embedded Malaysia <otc.embedded.malaysia@intel.com>
>Subject: Re: QA cycle report for 2.7 M3 RC1
>
>Hi Sangeeta/Ee Peng,
>
>On Tue, 2019-04-02 at 05:02 +0000, Jain, Sangeeta wrote:
>> QA cycle report for 2.7 M3 RC1:
>>
>> No high milestone defects.
>> This is completion of first QA cycle after adoption of new QA process.
>> Test results are available at following location:
>> ·        For results of all automated tests, please refer to results
>> at public AB [1].
>> ·        For other test results, refer to attachment [2].
>> ·        For test report for test cases run by Intel and WR team,
>> refer attachment [3]
>> ·        For full test report, refer attachment [4]
>> 2 new defects are found in this cycle, oe-selftest [5] and qemu-
>> shutdown[6].
>> Number of existing issues observed in this release is 3- toaster [7],
>> Build-appliance [8] and Beaglebone [9] For ptest, 3 package tests are
>> failing in this release which were passing in previous release: python
>> [10], python3[11] and strace[12].
>> 3 packages are facing timeout issues: lttng-tools [13], openssh [14]
>> and python3 [15].
>
>Thanks for this. I have some questions/observations.
>
>Looking at the Intel/WR report, I see tests which start oeselftest_XXX for sdk-
>extras and qemu-shutdown. I think this means you have some QA test
>infrastructure running "oe-selftest -r runqemu,meta_ide", iterating over
>MACHINE=qemuppc, qemumips, qemuarm, qemux86?
>
>Is this some automation we're missing in the autobuilder configuration?
>We all other tests covered and this is the only remaining automated piece we
>haven't covered? What configuration are we missing exactly for the missing
>tests?

Just run for MACHINE=qemuppc /qemumips / qemuarm / qemux86

>
>I'm partly wondering how you found the shutdown issue but this would explain
>that.
>
>I think going forward we need to add some kind of "who" identifier to the test
>results so we can say where/who they came from (main autobuilder, Intel, WR,
>anywhere else). We could add a resulttool command to "stamp" a set of test
>results with this, maybe as a parameter to the store command?

Will work on resulttool to add this enhancement. Though not sure about timeline as of now.

>
>Of the bugs, I didn't see any which I think should block M3, I think we probably
>should release that and move forward to M4. I do want to see some of these
>fixed before we build M4 though. I've made comments on them below.
>
>> New Bugs :
>>
>> [5] Bug 13237 - [2.7 M3 RC1][OE-selftest][Opensuseleap 15.0][Public
>> AB]:"test_wic_cp_ext" failing for Opensuseleap 15.0.
>> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13237
>
>Ross: Are you looking into that one?
>
>> [6] Bug 13234 - [2.7 M3 RC1] qemumips & qemumips64: failed to shutdown
>> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13234
>
>This needs looking into and fixing, as well as figuring out why the autobuilder
>doesn't see this (see above for my hypothesis).
>
>> Previous Bugs observed in this release:
>>
>> [7] Bug 13191 – [Test Case 1439] Build Failure after adding or
>> removing packages with and without dependencies
>> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13191
>>
>> [8] Bug 12991 - [Bug] [2.6 M4 RC1][Build-Appliance] Bitbake build-
>> appliance-image getting failed during building image due to webkitgtk
>> package.
>> https://bugzilla.yoctoproject.org/show_bug.cgi?id=12991
>
>We need to do something about this. I believe its related to resource starvation in
>the VM.
>
>> [9] Bug 13153 – [2.7 M2 RC1] Systemtap doesn't work on beaglebone
>> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13153
>
>I'm hoping a SRCREV bump for beaglebone-yocto fixes this.
>
>> ptest Bugs:
>>
>> [10] Bug 13249 - [2.7 M3 RC1] python ptest failure
>> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13249
>
>I'm hoping a patch from Ross in master fixes this, need to retest ptest with this
>applied.
>
>> [11] Bug 13253 - [2.7 M3 RC1] python3 ptest failure
>> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13253
>
>I'm hoping a patch from Ross in master fixes this, need to retest ptest with this
>applied.
>
>> [12] Bug 13254 - [2.7 M3 RC1] strace ptest failure
>> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13254
>
>No ideas on this one yet.
>
>> [13] Bug 13255 - [2.7 M3 rc1] lttng-tools ptest facing timeout issue
>> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13255
>
>There are patches which are due to arrive soon which should address this.
>
>> [14] Bug 13256 - [2.7 M3 rc1] openssh ptest facing timeout issue
>> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13256
>
>No ideas on this one yet.
>
>> [15] Bug 13257 - [2.7 M3 rc1] python3 ptest facing timeout issue
>> https://bugzilla.yoctoproject.org/show_bug.cgi?id=13257
>
>I'm hoping a patch from Ross in master fixes this, need to retest ptest with this
>applied.
>
>Cheers,
>
>Richard


^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: QA cycle report for 2.7 M3 RC1
  2019-04-02 18:32 ` richard.purdie
  2019-04-03  6:06   ` Jain, Sangeeta
@ 2019-04-06 10:11   ` Alexander Kanavin
  1 sibling, 0 replies; 5+ messages in thread
From: Alexander Kanavin @ 2019-04-06 10:11 UTC (permalink / raw)
  To: Richard Purdie
  Cc: yocto, Erway, Tracey M, OTC Embedded Malaysia, Eggleton, Paul

On Tue, 2 Apr 2019 at 20:33, <richard.purdie@linuxfoundation.org> wrote:
> > [15] Bug 13257 - [2.7 M3 rc1] python3 ptest facing timeout issue
> > https://bugzilla.yoctoproject.org/show_bug.cgi?id=13257
>
> I'm hoping a patch from Ross in master fixes this, need to retest ptest
> with this applied.

Sadly I have narrowed this down to the 5.0 kernel update. More
information in the bug, would be good to have this independently
confirmed. Updating python to 3.7.3 does not help.

Alex


^ permalink raw reply	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2019-04-06 10:11 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-04-02  5:02 QA cycle report for 2.7 M3 RC1 Jain, Sangeeta
2019-04-02 10:11 ` Jain, Sangeeta
2019-04-02 18:32 ` richard.purdie
2019-04-03  6:06   ` Jain, Sangeeta
2019-04-06 10:11   ` Alexander Kanavin

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.