All of lore.kernel.org
 help / color / mirror / Atom feed
* 1.2.1 full pass results
@ 2012-07-10  1:20 Serban, Laurentiu
  2012-07-10  1:28 ` Serban, Laurentiu
  0 siblings, 1 reply; 3+ messages in thread
From: Serban, Laurentiu @ 2012-07-10  1:20 UTC (permalink / raw)
  To: yocto

[-- Attachment #1: Type: text/plain, Size: 5575 bytes --]

Hello,

This is the full pass report for 1.2.1. Most of the issues were found in Core Build System (7) and a two bugs for e-menlow and n450. The build performance of the system on a Core i7 for core-image-sato is 112 minutes. FRI2 could not be tested - no sato image was built.
There are 17 bugs related to 1.2.1 in bugzilla without resolution.
The commit is 73cdebf60df225ee10f2eb215935be3b61e1b831

More details below:
  

Critical bugs, more than 50% test cases are blocked

 

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

 

Normal, Major and Critical bugs, and more than 10% test cases failed


Test Summary
Test Result Summary

Component

Target

Status

Comments

BSP

eMenlow

GOOD

1 bugs (2634) - 2 test cases failed

Blacksand

GOOD

1 bug (2646) - 1 test case failed

Crownbay-emgd

GOOD

connman-gnome do_configure fail on autobuilder for several BSPs

Sugarbay

GOOD

connman-gnome do_configure fail on autobuilder for several BSPs

Fish River Island

BLOCK

Autobuilder failed to deliver a sato image

HuronRiver-sato-sdk

GOOD

connman-gnome do_configure fail on autobuilder for several BSPs

Jasperforest-lsb

GOOD

Everything runs well

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

QEMU

qemux86

GOOD

Everything runs well

qemux86-64

GOOD

Everything runs well

qemuarm

GOOD

Everything runs well

qemuppc

GOOD

Everything runs well

qemumips

GOOD

Everything runs well

ADT

 

GOOD

Everything runs well

Core Build System

 

BUGGY

https://bugzilla.yoctoproject.org/show_bug.cgi?id=2590
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2572
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2571
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2559
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2517
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2519

HOB



BUGGY

https://bugzilla.yoctoproject.org/show_bug.cgi?id=2695 (2 test cases fail)
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2698

Distribution Support



GOOD

Everything runs well

Stress Testing



GOOD

Everything runs well

Compliance



GOOD

Everything runs well

Power and Performance



GOOD

Core-image-sato built in 112 minutes


Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

eMenlow Sato-SDK

66

0

65

1 (bug 2700)

0

n450 Sato-SDK

64

1

62

1(bug 2464)

0

FRI2

86

0

0

0

86 (2572)

Crownbay-Sato-SDK

66

0

66

0

0

Sugarbay Sato-SDK

70

0

70

0

0

HuronRiver Sato-SDK

61

0

61

0

0

Jasperforest lsb-SDK

32

0

32

0

0

Beagleboard Sato-SDK

40

0

40

0

0

Routerstationpro Sato-SDK

33

0

33

0

0

Mpc8315e-rdb Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

37

0

37

0

0

Qemux86-64 Sato-SDK

37

0

37

0

0

Qemux86 Sato

37

0

37

0

0

Qemux86 Sato-SDK

37

0

37

0

0

Qemuarm Sato

32

0

32

0

0

Qemuarm Sato-SDK

37

0

37

0

0

Qemumips Sato

32

0

32

0

0

Qemumips Sato-SDK

37

0

37

0

0

Qemuppc Sato

32

0

32

0

0

Qemuppc Sato-SDK

37

0

37

0

0

ADT

49

0

49

0

0

Distribution Support

3

0

3

0

0

Stress Testing

2

0

2

0

0

Compliance

2

0

2

0

0

Core Build System

58

0

50

7(2590, 2572, 2571, 2589, 2559, 2617, 2619)

1

Power and Performance

5

0

5

0

0

Total

1028

1

931

9

87


Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 2700 cannot reconnect to x11vnc

Bug 2646 Windows switching failure

Bug 2527 grub-efi-native fails due to help2man script

Bug 2590 [multilib]do_rootfs failed for lib32-connman-gnome with ipk

Bug 2572 [multilib] failed dependency for util-linux with multilib build

Bug 2571 [multilib] failed dependency for util-linux with multilib build

Bug 2589  [yocto-kernel] fail to build core-image-sato when add patch into the kernel

Bug 2559 [yocto-bsp]X can't start in sato image built by yocto-bsp tool

Bug 2617 Incremental RPM image generation doesn't work with 1.3 M1 RC1

Bug 2519 mklibs: Does not work with compiler from sstate cache

HOB

New! Bug 2695 [HOB]Settings are not saved

New! Bug 2698 [Hob] pk-gtk-module fails to load on fedora 17

Core Build System

Bug 2474 eglibc do_package_write_deb fails



New! Bug 2590 [multilib]do_rootfs failed for lib32-connman-gnome with ipk



Bug 2572 [multilib] failed dependency for util-linux with multilib build



Bug 2571 [multilib] failed dependency for util-linux with multilib build



Bug 2589  [yocto-kernel] fail to build core-image-sato when add patch into the kernel



Bug 2559 [yocto-bsp]X can't start in sato image built by yocto-bsp tool



New! Bug 2617 Incremental RPM image generation doesn't work with 1.3 M1 RC1



Bug 2519 mklibs: Does not work with compiler from sstate cache





Best regards,
Laurentiu Serban
QA Engineer
Open Source Technology Center
System Software Division Romania
Desk: +40 31 8604742
iNET: 88451042


[-- Attachment #2: Type: text/html, Size: 177855 bytes --]

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: 1.2.1 full pass results
  2012-07-10  1:20 1.2.1 full pass results Serban, Laurentiu
@ 2012-07-10  1:28 ` Serban, Laurentiu
  2012-07-10 20:12   ` Serban, Laurentiu
  0 siblings, 1 reply; 3+ messages in thread
From: Serban, Laurentiu @ 2012-07-10  1:28 UTC (permalink / raw)
  To: yocto


[-- Attachment #1.1: Type: text/plain, Size: 5978 bytes --]


Hello,

I corrected a mistake below and also added the xls with the test cases results.
The test cases used are from 1.3 M1 test plan.

Best regards,
Laurentiu

From: yocto-bounces@yoctoproject.org [mailto:yocto-bounces@yoctoproject.org] On Behalf Of Serban, Laurentiu
Sent: Tuesday, July 10, 2012 4:20 AM
To: yocto@yoctoproject.org
Subject: [yocto] 1.2.1 full pass results

Hello,

This is the full pass report for 1.2.1. Most of the issues were found in Core Build System (7) and a two bugs for e-menlow and n450. The build performance of the system on a Core i7 for core-image-sato is 112 minutes. FRI2 could not be tested - no sato image was built.
There are 17 bugs related to 1.2.1 in bugzilla without resolution.
The commit is 73cdebf60df225ee10f2eb215935be3b61e1b831

More details below:
  

Critical bugs, more than 50% test cases are blocked

 

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

 

Normal, Major and Critical bugs, and more than 10% test cases failed


Test Summary
Test Result Summary

Component

Target

Status

Comments

BSP

eMenlow

GOOD

1 bugs (2634) - 2 test cases failed

Blacksand

GOOD

1 bug (2646) - 1 test case failed

Crownbay-emgd

GOOD

connman-gnome do_configure fail on autobuilder for several BSPs

Sugarbay

GOOD

connman-gnome do_configure fail on autobuilder for several BSPs

Fish River Island

BLOCK

Autobuilder failed to deliver a sato image

HuronRiver-sato-sdk

GOOD

connman-gnome do_configure fail on autobuilder for several BSPs

Jasperforest-lsb

GOOD

Everything runs well

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

QEMU

qemux86

GOOD

Everything runs well

qemux86-64

GOOD

1 zypper bug/3 test cases failed

qemuarm

GOOD

Everything runs well

qemuppc

GOOD

Everything runs well

qemumips

GOOD

Everything runs well

ADT

 

GOOD

Everything runs well

Core Build System

 

BUGGY

https://bugzilla.yoctoproject.org/show_bug.cgi?id=2590
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2572
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2571
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2559
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2517
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2519

HOB



BUGGY

https://bugzilla.yoctoproject.org/show_bug.cgi?id=2695 (2 test cases fail)
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2698

Distribution Support



GOOD

Everything runs well

Stress Testing



GOOD

Everything runs well

Compliance



GOOD

Everything runs well

Power and Performance



GOOD

Core-image-sato built in 112 minutes


Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

eMenlow Sato-SDK

66

0

65

1 (bug 2700)

0

n450 Sato-SDK

64

1

62

1(bug 2464)

0

FRI2

86

0

0

0

86 (2572)

Crownbay-Sato-SDK

66

0

66

0

0

Sugarbay Sato-SDK

70

0

70

0

0

HuronRiver Sato-SDK

61

0

61

0

0

Jasperforest lsb-SDK

32

0

32

0

0

Beagleboard Sato-SDK

40

0

40

0

0

Routerstationpro Sato-SDK

33

0

33

0

0

Mpc8315e-rdb Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

37

0

34

3

0

Qemux86-64 Sato-SDK

37

0

34

3

0

Qemux86 Sato

37

0

37

0

0

Qemux86 Sato-SDK

37

0

37

0

0

Qemuarm Sato

32

0

32

0

0

Qemuarm Sato-SDK

37

0

37

0

0

Qemumips Sato

32

0

32

0

0

Qemumips Sato-SDK

37

0

37

0

0

Qemuppc Sato

32

0

32

0

0

Qemuppc Sato-SDK

37

0

37

0

0

ADT

49

0

49

0

0

Distribution Support

3

0

3

0

0

Stress Testing

2

0

2

0

0

Compliance

2

0

2

0

0

Core Build System

58

0

50

7(2590, 2572, 2571, 2589, 2559, 2617, 2619)

1

Power and Performance

5

0

5

0

0

Total

1028

1

925

15

87


Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 2700 cannot reconnect to x11vnc

Bug 2646 Windows switching failure

Bug 2527 grub-efi-native fails due to help2man script

Bug 2590 [multilib]do_rootfs failed for lib32-connman-gnome with ipk

Bug 2572 [multilib] failed dependency for util-linux with multilib build

Bug 2571 [multilib] failed dependency for util-linux with multilib build

Bug 2589  [yocto-kernel] fail to build core-image-sato when add patch into the kernel

Bug 2559 [yocto-bsp]X can't start in sato image built by yocto-bsp tool

Bug 2617 Incremental RPM image generation doesn't work with 1.3 M1 RC1

Bug 2519 mklibs: Does not work with compiler from sstate cache

HOB

New! Bug 2695 [HOB]Settings are not saved

New! Bug 2698 [Hob] pk-gtk-module fails to load on fedora 17

Core Build System

Bug 2474 eglibc do_package_write_deb fails



New! Bug 2590 [multilib]do_rootfs failed for lib32-connman-gnome with ipk



Bug 2572 [multilib] failed dependency for util-linux with multilib build



Bug 2571 [multilib] failed dependency for util-linux with multilib build



Bug 2589  [yocto-kernel] fail to build core-image-sato when add patch into the kernel



Bug 2559 [yocto-bsp]X can't start in sato image built by yocto-bsp tool



New! Bug 2617 Incremental RPM image generation doesn't work with 1.3 M1 RC1



Bug 2519 mklibs: Does not work with compiler from sstate cache





Best regards,
Laurentiu Serban
QA Engineer
Open Source Technology Center
System Software Division Romania
Desk: +40 31 8604742
iNET: 88451042


[-- Attachment #1.2: Type: text/html, Size: 153880 bytes --]

[-- Attachment #2: Yocto 1.2.1 detailed_testreport_Full_Pass.xlsx --]
[-- Type: application/vnd.openxmlformats-officedocument.spreadsheetml.sheet, Size: 437912 bytes --]

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: 1.2.1 full pass results
  2012-07-10  1:28 ` Serban, Laurentiu
@ 2012-07-10 20:12   ` Serban, Laurentiu
  0 siblings, 0 replies; 3+ messages in thread
From: Serban, Laurentiu @ 2012-07-10 20:12 UTC (permalink / raw)
  To: 'yocto@yoctoproject.org'

[-- Attachment #1: Type: text/plain, Size: 6295 bytes --]

Hello,
The page below was created
https://wiki.yoctoproject.org/wiki/Yocto_1.2.1_Test_Report

Br,
Laurentiu

From: Serban, Laurentiu
Sent: Tuesday, July 10, 2012 4:28 AM
To: yocto@yoctoproject.org
Subject: RE: 1.2.1 full pass results


Hello,

I corrected a mistake below and also added the xls with the test cases results.
The test cases used are from 1.3 M1 test plan.

Best regards,
Laurentiu

From: yocto-bounces@yoctoproject.org<mailto:yocto-bounces@yoctoproject.org> [mailto:yocto-bounces@yoctoproject.org] On Behalf Of Serban, Laurentiu
Sent: Tuesday, July 10, 2012 4:20 AM
To: yocto@yoctoproject.org<mailto:yocto@yoctoproject.org>
Subject: [yocto] 1.2.1 full pass results

Hello,

This is the full pass report for 1.2.1. Most of the issues were found in Core Build System (7) and a two bugs for e-menlow and n450. The build performance of the system on a Core i7 for core-image-sato is 112 minutes. FRI2 could not be tested - no sato image was built.
There are 17 bugs related to 1.2.1 in bugzilla without resolution.
The commit is 73cdebf60df225ee10f2eb215935be3b61e1b831

More details below:
  

Critical bugs, more than 50% test cases are blocked

 

Only Normal, Minor or Enhancement bugs, or less than 10% test cases failed

 

Normal, Major and Critical bugs, and more than 10% test cases failed


Test Summary
Test Result Summary

Component

Target

Status

Comments

BSP

eMenlow

GOOD

1 bugs (2634) - 2 test cases failed

Blacksand

GOOD

1 bug (2646) - 1 test case failed

Crownbay-emgd

GOOD

connman-gnome do_configure fail on autobuilder for several BSPs

Sugarbay

GOOD

connman-gnome do_configure fail on autobuilder for several BSPs

Fish River Island

BLOCK

Autobuilder failed to deliver a sato image

HuronRiver-sato-sdk

GOOD

connman-gnome do_configure fail on autobuilder for several BSPs

Jasperforest-lsb

GOOD

Everything runs well

Beagleboard

GOOD

Everything runs well

Routerstationpro

GOOD

Everything runs well

Mpc8315e-rdb

GOOD

Everything runs well

QEMU

qemux86

GOOD

Everything runs well

qemux86-64

GOOD

1 zypper bug/3 test cases failed

qemuarm

GOOD

Everything runs well

qemuppc

GOOD

Everything runs well

qemumips

GOOD

Everything runs well

ADT

 

GOOD

Everything runs well

Core Build System

 

BUGGY

https://bugzilla.yoctoproject.org/show_bug.cgi?id=2590
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2572
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2571
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2559
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2517
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2519

HOB



BUGGY

https://bugzilla.yoctoproject.org/show_bug.cgi?id=2695 (2 test cases fail)
https://bugzilla.yoctoproject.org/show_bug.cgi?id=2698

Distribution Support



GOOD

Everything runs well

Stress Testing



GOOD

Everything runs well

Compliance



GOOD

Everything runs well

Power and Performance



GOOD

Core-image-sato built in 112 minutes


Detailed Test Result for each component

Target

Total TCs

Not Run

Passed

Failed

Not testable (Blocked)

eMenlow Sato-SDK

66

0

65

1 (bug 2700)

0

n450 Sato-SDK

64

1

62

1(bug 2464)

0

FRI2

86

0

0

0

86 (2572)

Crownbay-Sato-SDK

66

0

66

0

0

Sugarbay Sato-SDK

70

0

70

0

0

HuronRiver Sato-SDK

61

0

61

0

0

Jasperforest lsb-SDK

32

0

32

0

0

Beagleboard Sato-SDK

40

0

40

0

0

Routerstationpro Sato-SDK

33

0

33

0

0

Mpc8315e-rdb Sato-SDK

36

0

36

0

0

Qemux86-64 Sato

37

0

34

3

0

Qemux86-64 Sato-SDK

37

0

34

3

0

Qemux86 Sato

37

0

37

0

0

Qemux86 Sato-SDK

37

0

37

0

0

Qemuarm Sato

32

0

32

0

0

Qemuarm Sato-SDK

37

0

37

0

0

Qemumips Sato

32

0

32

0

0

Qemumips Sato-SDK

37

0

37

0

0

Qemuppc Sato

32

0

32

0

0

Qemuppc Sato-SDK

37

0

37

0

0

ADT

49

0

49

0

0

Distribution Support

3

0

3

0

0

Stress Testing

2

0

2

0

0

Compliance

2

0

2

0

0

Core Build System

58

0

50

7(2590, 2572, 2571, 2589, 2559, 2617, 2619)

1

Power and Performance

5

0

5

0

0

Total

1028

1

925

15

87


Component

Bug Number

Target Milestone

System & Core OS

System Usage

Bug 2700 cannot reconnect to x11vnc

Bug 2646 Windows switching failure

Bug 2527 grub-efi-native fails due to help2man script

Bug 2590 [multilib]do_rootfs failed for lib32-connman-gnome with ipk

Bug 2572 [multilib] failed dependency for util-linux with multilib build

Bug 2571 [multilib] failed dependency for util-linux with multilib build

Bug 2589  [yocto-kernel] fail to build core-image-sato when add patch into the kernel

Bug 2559 [yocto-bsp]X can't start in sato image built by yocto-bsp tool

Bug 2617 Incremental RPM image generation doesn't work with 1.3 M1 RC1

Bug 2519 mklibs: Does not work with compiler from sstate cache

HOB

New! Bug 2695 [HOB]Settings are not saved

New! Bug 2698 [Hob] pk-gtk-module fails to load on fedora 17

Core Build System

Bug 2474 eglibc do_package_write_deb fails



New! Bug 2590 [multilib]do_rootfs failed for lib32-connman-gnome with ipk



Bug 2572 [multilib] failed dependency for util-linux with multilib build



Bug 2571 [multilib] failed dependency for util-linux with multilib build



Bug 2589  [yocto-kernel] fail to build core-image-sato when add patch into the kernel



Bug 2559 [yocto-bsp]X can't start in sato image built by yocto-bsp tool



New! Bug 2617 Incremental RPM image generation doesn't work with 1.3 M1 RC1



Bug 2519 mklibs: Does not work with compiler from sstate cache





Best regards,
Laurentiu Serban
QA Engineer
Open Source Technology Center
System Software Division Romania
Desk: +40 31 8604742
iNET: 88451042


[-- Attachment #2: Type: text/html, Size: 155723 bytes --]

^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2012-07-10 20:13 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2012-07-10  1:20 1.2.1 full pass results Serban, Laurentiu
2012-07-10  1:28 ` Serban, Laurentiu
2012-07-10 20:12   ` Serban, Laurentiu

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.