QA Test Report for Yocto Project Release 2.3 rc2

QA Test Report for Yocto Project Release 2.3 rc2

[Perez Carranza, Jose]

[-- Attachment #1: Type: text/plain, Size: 3682 bytes --]

Hello All,



Here is the report for the Full QA Cycle on Release 2.3 M3 rc2



Full Report : https://wiki.yoctoproject.org/wiki/WW17_-_2017-04-21_-_Full_Test_Cycle_2.3_rc2



======== Summary ========



The QA cycle for release 2.3 rc2 is complete, There are 3 new issues found, 2 related to COROPS eSDK and another one related to runqemu. Bug 11409 is the most important found during this validation that is affecting qemu and Eclipse plugin components.  All High bugs found during M3 were verified and are working correctly. Regarding to performances there were improvements on eSDK and roofs on both machines. Ptest shows also 100% of pass rate on quilt and openssl components.





=========================





======== Details ========



QA Hints



There are two concerns form QA perspective about this release, first one is bug 11409 that is blocking 70% of the test cases of eclipse plugin and a series of bugs about multimedia not working correctly found on Meta-Intel validation cycle that derives on more specific bug 11410[1]





Bugs

      * New

-   11409 - runqemu-extract-sdk doesn't work in toolchain for 2.3 rc2 build [2]

-   11421 - Crops-ESDK: devtool build v4l2loopback-driver, fails when trying to access /lib/modules/ [3]

-   11431 - Crops-ESDK: devtool is unable to add recipe for nodejs-native recipe [4]



      * High / M+ Not New



           -  11300 - selftest: do_populate_sdk_ext task failing on eSDK test on GDC Abs [5]



Full Bug Report : https://wiki.yoctoproject.org/wiki/WW17_-_2017-04-21_-_Full_Test_Cycle_2.3_rc2#Bugs_Found_during_QA_Test



=========================





====== Performance ======



Improvements on roofs on both machines of about 6%, extracting eSDK was improved about 12% on Ubuntu and 9% in fedora. Fedora shows an improvement of 10% on building kernel. There was a slight regression of 4% when building sato image on Ubuntu.



-        Ubuntu



Test           2.3 M3 rc2    2.3 rc2           %

sato           1:10:00            1:12:54          4.14

rootfs         2:26          2:17                  -6.16

rmwork         1:04:47            1:05:33          1.18

kernel         5:12          5:14                   0.64

eSDK           3:07          2:44                  -12.30





-        Fedora



Test           2.3 M3 rc2    2.3 rc2           %

Sato           1:14:57             1:12:49         -2.85

rootfs         2:44:00             2:34            -6.10

rmwork         1:06:45             1:06:45          0.00

kernel         6:38:00             5:56            -10.55

eSDK           3:20:00             3:02            -9.00





Performance Charts : https://wiki.yoctoproject.org/charts/perf_milestone_GDC/performance_test.html



========================





========= pTest ========



    -  There were improvements on pass rates for the quilt and openssl modules, both are now with 100% PASS rate

    -  There rest of the components remain with the same % of pass rate.





pTest full report : https://wiki.yoctoproject.org/wiki/WW17_-_2017-04-21_-_Full_Test_Cycle_2.3_rc2#pTest_for_genericx86-64_on_NUC



========================





======== Links =========

1. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11410

2. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11409

3. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11421

4. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11431

5. https://bugzilla.yoctoproject.org/show_bug.cgi?id=11300



========================

Regards
José


[-- Attachment #2: Type: text/html, Size: 26380 bytes --]