From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: by yocto-www.yoctoproject.org (Postfix, from userid 118) id 7206DE00BAB; Mon, 5 Jun 2017 15:30:41 -0700 (PDT) X-Spam-Checker-Version: SpamAssassin 3.3.1 (2010-03-16) on yocto-www.yoctoproject.org X-Spam-Level: X-Spam-Status: No, score=-6.9 required=5.0 tests=BAYES_00,HTML_MESSAGE, RCVD_IN_DNSWL_HI autolearn=ham version=3.3.1 X-Spam-HAM-Report: * -5.0 RCVD_IN_DNSWL_HI RBL: Sender listed at http://www.dnswl.org/, high * trust * [192.55.52.88 listed in list.dnswl.org] * -1.9 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.0 HTML_MESSAGE BODY: HTML included in message Received: from mga01.intel.com (mga01.intel.com [192.55.52.88]) by yocto-www.yoctoproject.org (Postfix) with ESMTP id 08C4FE00BA2 for ; Mon, 5 Jun 2017 15:30:37 -0700 (PDT) Received: from fmsmga005.fm.intel.com ([10.253.24.32]) by fmsmga101.fm.intel.com with ESMTP/TLS/DHE-RSA-AES256-GCM-SHA384; 05 Jun 2017 15:30:22 -0700 X-ExtLoop1: 1 X-IronPort-AV: E=Sophos;i="5.39,303,1493708400"; d="scan'208,217";a="110739814" Received: from fmsmsx108.amr.corp.intel.com ([10.18.124.206]) by fmsmga005.fm.intel.com with ESMTP; 05 Jun 2017 15:30:21 -0700 Received: from fmsmsx102.amr.corp.intel.com (10.18.124.200) by FMSMSX108.amr.corp.intel.com (10.18.124.206) with Microsoft SMTP Server (TLS) id 14.3.319.2; Mon, 5 Jun 2017 15:30:21 -0700 Received: from fmsmsx104.amr.corp.intel.com ([169.254.3.23]) by FMSMSX102.amr.corp.intel.com ([169.254.10.151]) with mapi id 14.03.0319.002; Mon, 5 Jun 2017 15:30:21 -0700 From: "Cruz, Libertad" To: "yocto@yoctoproject.org" , "Jolley, Stephen K" Thread-Topic: QA Test Report for Yocto Project Point Release 2.2.2. rc1 Thread-Index: AdLeHVSRvwp6Um48SzOdimD/cu9HWAAH2Xeg Date: Mon, 5 Jun 2017 22:30:19 +0000 Message-ID: <58D9E2E50A021A45AD740492365FCDC531E980B9@fmsmsx104.amr.corp.intel.com> References: <0A5D9A624DF90343892F8F3FE7DE525A16981432@fmsmsx101.amr.corp.intel.com> In-Reply-To: <0A5D9A624DF90343892F8F3FE7DE525A16981432@fmsmsx101.amr.corp.intel.com> Accept-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-titus-metadata-40: eyJDYXRlZ29yeUxhYmVscyI6IiIsIk1ldGFkYXRhIjp7Im5zIjoiaHR0cDpcL1wvd3d3LnRpdHVzLmNvbVwvbnNcL0ludGVsMyIsImlkIjoiNzgxNGY3ZmQtMDdmZC00NjE1LTk2MWEtMDJiZmEzZTYxYmIxIiwicHJvcHMiOlt7Im4iOiJDVFBDbGFzc2lmaWNhdGlvbiIsInZhbHMiOlt7InZhbHVlIjoiQ1RQX0lDIn1dfV19LCJTdWJqZWN0TGFiZWxzIjpbXSwiVE1DVmVyc2lvbiI6IjE1LjkuNi42IiwiVHJ1c3RlZExhYmVsSGFzaCI6Ikpza3YrdHBnSzNXUVwvTnBOVWJSZkQ2SGVHNVU4bEV5WHI3d2JhbkJhTEZvPSJ9 x-ctpclassification: CTP_IC dlp-product: dlpe-windows dlp-version: 10.0.102.7 dlp-reaction: no-action x-originating-ip: [10.1.200.107] MIME-Version: 1.0 Cc: "Purdie, Richard" , "Cobbley, David A" , "Cruz Alcaraz, Juan M" Subject: QA Test Report for Yocto Project Point Release 2.2.2. rc1 X-BeenThere: yocto@yoctoproject.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Discussion of all things Yocto Project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 05 Jun 2017 22:30:41 -0000 Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_58D9E2E50A021A45AD740492365FCDC531E980B9fmsmsx104amrcor_" --_000_58D9E2E50A021A45AD740492365FCDC531E980B9fmsmsx104amrcor_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Hello All, Here is the report for the 2.2.2 rc1 full point release test cycle. Full Report : https://wiki.yoctoproject.org/wiki/WW22_-_2017-06-05_-_Full_P= oint_Release_Test_Cycle_2.2.2_rc1 =3D=3D=3D=3D=3D=3D=3D=3D Summary =3D=3D=3D=3D=3D=3D=3D=3D The QA cycle for release 2.2.2 rc1 is complete, there were 6 new issues. Two of this are related to testimage, one to compliance test, one to self-= test, one to OE-Core and finally "11604 [Yocto 2.2.2] crosstap doesn't work= " [1] this is a recurring issue that has been fixed on 10990[9]. Also the b= ugs 5948[10], 6016[11], 6118[12], 6122[13] are just a few that have been m= arked duplicated of 10990[9]. Performance metrics showed a 16% improvement on Ubuntu machine, Fedora mach= ine showed an improvement of 9%. =3D=3D=3D=3D=3D=3D=3D=3D Details =3D=3D=3D=3D=3D=3D=3D=3D QA Hints QA test cycle seems to have been executed smoothly no apparent blockers or = high priority bugs. It would be worthwhile that before deciding if this bu= ild can be release, the following bugs have been reviewed and assigned prio= rity 11611[4], 11607[3], 11604[1], 11606[6]. We are concern about the recur= ring issue on Crosstap not working, not sure if there can be a strategy so = that this issue is fixed on all environments. Even though it seems that 116= 04[1] is not a blocker it does require reporting, retesting and development= analysis time whenever its present. Bugs * New - Bug 11598 - [morty]testimage quemux86-64 lsb genericx86-64 getty[1309]: tcgeta= ttr: Input/output error^M[2] - Bug 11604 - [Yocto 2.2.2] crosstap doesn't work[1] - Bug 11607 - [morty] Testimage lsb image trow multiple smart errors[3] - Bug 11611 - [morty] Compliance test lsb-setup-4.1.0-1.noarch.rpm download fail= [4] - Bug 11565 - morty self-test errors[5] - Bug 11606 - [morty] OE-Core test_recipetool_create (oeqa.selftest.recipetool.R= ecipetoolTests)[6] * High / M+ Not New - Bug 10456 - X can not launch on qemumips64[7] - Bug 11064 - [Yocto 2.2.1] kernel version mismatched when using yocto-bsp to cr= eate custom qemu bsp[8] Full Bug Report : https://wiki.yoctoproject.org/wiki/WW22_-_2017-06-05_-_Fu= ll_Point_Release_Test_Cycle_2.2.2_rc1#Bugs_Found_during_QA_Test =3D=3D=3D=3D=3D=3D Performance =3D=3D=3D=3D=3D=3D All performance metrics showed improvements on Ubuntu machine, exceling 16%= on rootfs creation, Fedora machine showed an improvement of 9% on extracti= ng eSDK the other metrics where on the same level compared to 2.2.1 release= . Ubuntu Test 2.2.1_rc1 2.2.2_rc1 % sato 1:02:41 1:00:42 -3.16 rootfs 2:43 2:16 -16.56 rmwork 1:01:13 0:59:29 -2.83 kernel 5:05 5:01 -1.31 eSDK 3:28 3:22 -2.88 Fedora Test 2.2.1_rc1 2.2.2_rc1 % sato 1:00:26 1:00:43 0.47 rootfs 2:18 2:16 -1.45 rmwork 0:59:17 0:59:29 0.34 kernel 5:22 5:01 -6.52 eSDK 3:42 3:22 -9.01 Performance Charts : https://wiki.yoctoproject.org/charts/perf_milestone_G= DC/performance_test.html =3D=3D=3D=3D=3D=3D=3D=3D Links =3D=3D=3D=3D=3D=3D=3D=3D=3D 1. https://bugzilla.yoctoproject.org/show_bug.cgi?id=3D11604 2. https://bugzilla.yoctoproject.org/show_bug.cgi?id=3D11598 3. https://bugzilla.yoctoproject.org/show_bug.cgi?id=3D11607 4. https://bugzilla.yoctoproject.org/show_bug.cgi?id=3D11611 5. https://bugzilla.yoctoproject.org/show_bug.cgi?id=3D11565 6. https://bugzilla.yoctoproject.org/show_bug.cgi?id=3D11606 7. https://bugzilla.yoctoproject.org/show_bug.cgi?id=3D10456 8. https://bugzilla.yoctoproject.org/show_bug.cgi?id=3D11064 9. https://bugzilla.yoctoproject.org/show_bug.cgi?id=3D10990 10. https://bugzilla.yoctoproject.org/show_bug.cgi?id=3D5948 11. https://bugzilla.yoctoproject.org/show_bug.cgi?id=3D6016 12. https://bugzilla.yoctoproject.org/show_bug.cgi?id=3D6118 13. https://bugzilla.yoctoproject.org/show_bug.cgi?id=3D6122 Regards Libertad G. --_000_58D9E2E50A021A45AD740492365FCDC531E980B9fmsmsx104amrcor_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Hello All,

 

Here is the report for the 2.2.2 rc1 full point release test cycle.=

 

Full Report : https://wiki.yoctoproject.org/wiki/WW22_-_201= 7-06-05_-_Full_Point_Release_Test_Cycle_2.2.2_rc1<= /span>

 

 

=3D=3D=3D=3D=3D=3D=3D=3D Summary =3D=3D=3D=3D=3D=3D=3D=3D

 

The QA cycle for release 2.2.2 rc1 is complete, there were 6 n= ew issues.

Two of this are related  to testimage, one to compliance test, one = to self-test, one to OE-Core and finally “11604 [Yocto 2.2.2] crosstap doesn’t work” [1] th= is is a recurring issue that has been fixed on 10990[9]. Also the bu= gs 5948[10], 6016[11], 6118[12], 6122[13]  = ;are just a few that have been marked duplicated of 10990[9].

 

Performance metrics showed a 16% improvement on Ubuntu machine, Fedora m= achine showed an improvement of 9%.

 

 

=3D=3D=3D=3D=3D=3D=3D=3D Details =3D=3D=3D=3D=3D=3D=3D=3D

 

QA Hints

 

QA test cycle seems to have been executed smo= othly no apparent blockers or high priority bugs.  It would be worthwh= ile that before deciding if this build can be release, the following bugs have been reviewed and assigned priority 11611[4], 11607[3], 11604[1], 11606[6]. We are concern about = the recurring issue on Crosstap not working, not sure if there can be a str= ategy so that this issue is fixed on all environments. Even though it seems that 11604[1] is not a bl= ocker it does require reporting, retesting and development analysis time wh= enever its present.

 

 

Bugs

      * New

 

           - Bug 11598=  - [morty]testimage quemux86-64 lsb genericx86-64 getty[1309]= : tcgetattr: Input/output error^M[2]

           - Bug 11604=  - [Yocto 2.2.2] crosstap doesn't work[1]

           - Bug 11607=  - [morty] Testimage lsb image trow multiple smart errors[= 3]

           - Bug 11611=  - [morty] Compliance test lsb-setup-4.1.0-1.noarch.rpm downl= oad fail[4]

           - Bug 11565=  - morty self-test errors[5]

           - Bug 11606=  - [morty] OE-Core test_recipetool_create (oeqa.selftest.reci= petool.RecipetoolTests)[6]

 

      

      * High / M+ Not New

            =

           - Bug 10456 - X can not launch on qemumips64[7]

           - Bug 11064=  - [Yocto 2.2.1] kernel version mismatched when using yocto-b= sp to create custom qemu bsp[8]

 

Full Bug Report : https://wiki.yoctoproject.org/wiki/WW22_-_2017-06-05_-_Full_Po= int_Release_Test_Cycle_2.2.2_rc1#Bugs_Found_during_QA_Test<= /o:p>

 

 

=3D=3D=3D=3D=3D=3D Performance =3D=3D=3D=3D=3D=3D

 

All performance metrics showed improvements on Ubuntu machine, exceling = 16% on rootfs creation, Fedora machine showed an improvement of 9% on extra= cting eSDK the other metrics where on the same level compared to 2.2.1 release.  

 

 

Ubuntu      Test      = 2.2.1_rc1     2.2.2_rc1     %<= /o:p>

            sato&= nbsp;     1:02:41       1= :00:42       -3.16

            rootf= s    2:43        &nb= sp; 2:16          -16.56<= /o:p>

            rmwor= k    1:01:13       0:59:29&nbs= p;      -2.83

            kerne= l    5:05        &nb= sp; 5:01          -1.31

            eSDK&= nbsp;     3:28       = ;   3:22          -2= .88

       

Fedora      Test      = 2.2.1_rc1     2.2.2_rc1     %<= /o:p>

            sato&= nbsp;     1:00:26       1= :00:43       0.47

            rootf= s    2:18        &nb= sp; 2:16          -1.45

            rmwor= k    0:59:17       0:59:29&nbs= p;      0.34

            kerne= l    5:22        &nb= sp; 5:01          -6.52

            eSDK&= nbsp;     3:42       = ;   3:22          -9= .01

 

 

 

Performance Charts :  https://wiki.yocto= project.org/charts/perf_milestone_GDC/performance_test.html

 

 

=3D=3D=3D=3D=3D=3D=3D=3D Links =3D=3D=3D=3D=3D=3D=3D=3D=3D

 

    1.    https://bugzilla.yoctopr= oject.org/show_bug.cgi?id=3D11604

    2.    https://bugzilla.yoctopr= oject.org/show_bug.cgi?id=3D11598

    3.    https://bugzilla.yoctopr= oject.org/show_bug.cgi?id=3D11607

    4.    https://bugzilla.yoctopr= oject.org/show_bug.cgi?id=3D11611

    5.    https://bugzilla.yoctopr= oject.org/show_bug.cgi?id=3D11565

    6.    https://bugzilla.yoctopr= oject.org/show_bug.cgi?id=3D11606

    7.    https://bugzilla.yoctopr= oject.org/show_bug.cgi?id=3D10456

    8.    https://bugzilla.yoctopr= oject.org/show_bug.cgi?id=3D11064

    9.    https://bugzilla.yo= ctoproject.org/show_bug.cgi?id=3D10990

    10.    https://bugzilla.y= octoproject.org/show_bug.cgi?id=3D5948

    11.    https://bugzilla.y= octoproject.org/show_bug.cgi?id=3D6016

    12.    https://bugzilla.yoctopr= oject.org/show_bug.cgi?id=3D6118

    13.    https://bugzilla.yoctopr= oject.org/show_bug.cgi?id=3D6122

 

 

= Regards

Libertad G.

 

--_000_58D9E2E50A021A45AD740492365FCDC531E980B9fmsmsx104amrcor_--