All of lore.kernel.org
 help / color / mirror / Atom feed
* [linux-next test] 56810: regressions - FAIL
@ 2015-05-21  2:40 osstest service user
  2015-05-21 13:58 ` Roger Pau Monné
  0 siblings, 1 reply; 5+ messages in thread
From: osstest service user @ 2015-05-21  2:40 UTC (permalink / raw)
  To: xen-devel; +Cc: ian.jackson

flight 56810 linux-next real [real]
http://logs.test-lab.xenproject.org/osstest/logs/56810/

Regressions :-(

Tests which did not succeed and are blocking,
including tests which could not be run:
 test-amd64-i386-rumpuserxen-i386 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail REGR. vs. 56718

Regressions which are regarded as allowable (not blocking):
 test-armhf-armhf-libvirt     11 guest-start               fail REGR. vs. 56718
 test-amd64-i386-freebsd10-i386  9 freebsd-install              fail like 56718
 test-amd64-i386-freebsd10-amd64  9 freebsd-install             fail like 56718
 test-amd64-amd64-libvirt     11 guest-start                  fail   like 56718
 test-amd64-i386-xl-qemut-win7-amd64 16 guest-stop              fail like 56718
 test-amd64-i386-xl-qemuu-win7-amd64 16 guest-stop              fail like 56718

Tests which did not succeed, but are not blocking:
 test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm 9 debian-hvm-install fail never pass
 test-amd64-i386-xl-xsm       11 guest-start                  fail   never pass
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm 9 debian-hvm-install fail never pass
 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 9 debian-hvm-install fail never pass
 test-amd64-i386-libvirt-xsm  11 guest-start                  fail   never pass
 test-amd64-amd64-xl-pvh-amd  11 guest-start                  fail   never pass
 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm 9 debian-hvm-install fail never pass
 test-amd64-amd64-libvirt-xsm 11 guest-start                  fail   never pass
 test-amd64-amd64-xl-pvh-intel 11 guest-start                  fail  never pass
 test-amd64-amd64-xl-xsm      11 guest-start                  fail   never pass
 test-armhf-armhf-libvirt-xsm 11 guest-start                  fail   never pass
 test-armhf-armhf-xl-xsm      11 guest-start                  fail   never pass
 test-armhf-armhf-xl-sedf-pin 12 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt      12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-arndale  12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-sedf     12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-multivcpu 12 migrate-support-check        fail  never pass
 test-armhf-armhf-xl-credit2  12 migrate-support-check        fail   never pass
 test-armhf-armhf-xl-cubietruck 12 migrate-support-check        fail never pass
 test-armhf-armhf-xl          12 migrate-support-check        fail   never pass
 test-amd64-amd64-xl-qemut-win7-amd64 16 guest-stop             fail never pass

version targeted for testing:
 linux                0ebc274769c2defec75283dce930e887ead25abd
baseline version:
 linux                e26081808edadfd257c6c9d81014e3b25e9a6118

jobs:
 build-amd64-xsm                                              pass    
 build-armhf-xsm                                              pass    
 build-i386-xsm                                               pass    
 build-amd64                                                  pass    
 build-armhf                                                  pass    
 build-i386                                                   pass    
 build-amd64-libvirt                                          pass    
 build-armhf-libvirt                                          pass    
 build-i386-libvirt                                           pass    
 build-amd64-pvops                                            pass    
 build-armhf-pvops                                            pass    
 build-i386-pvops                                             pass    
 build-amd64-rumpuserxen                                      pass    
 build-i386-rumpuserxen                                       pass    
 test-amd64-amd64-xl                                          pass    
 test-armhf-armhf-xl                                          pass    
 test-amd64-i386-xl                                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm                fail    
 test-amd64-i386-xl-qemut-debianhvm-amd64-xsm                 fail    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm                fail    
 test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm                 fail    
 test-amd64-amd64-libvirt-xsm                                 fail    
 test-armhf-armhf-libvirt-xsm                                 fail    
 test-amd64-i386-libvirt-xsm                                  fail    
 test-amd64-amd64-xl-xsm                                      fail    
 test-armhf-armhf-xl-xsm                                      fail    
 test-amd64-i386-xl-xsm                                       fail    
 test-amd64-amd64-xl-pvh-amd                                  fail    
 test-amd64-i386-qemut-rhel6hvm-amd                           pass    
 test-amd64-i386-qemuu-rhel6hvm-amd                           pass    
 test-amd64-amd64-xl-qemut-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemut-debianhvm-amd64                     pass    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64                    pass    
 test-amd64-i386-xl-qemuu-debianhvm-amd64                     pass    
 test-amd64-i386-freebsd10-amd64                              fail    
 test-amd64-amd64-xl-qemuu-ovmf-amd64                         pass    
 test-amd64-i386-xl-qemuu-ovmf-amd64                          pass    
 test-amd64-amd64-rumpuserxen-amd64                           pass    
 test-amd64-amd64-xl-qemut-win7-amd64                         fail    
 test-amd64-i386-xl-qemut-win7-amd64                          fail    
 test-amd64-amd64-xl-qemuu-win7-amd64                         pass    
 test-amd64-i386-xl-qemuu-win7-amd64                          fail    
 test-armhf-armhf-xl-arndale                                  pass    
 test-amd64-amd64-xl-credit2                                  pass    
 test-armhf-armhf-xl-credit2                                  pass    
 test-armhf-armhf-xl-cubietruck                               pass    
 test-amd64-i386-freebsd10-i386                               fail    
 test-amd64-i386-rumpuserxen-i386                             fail    
 test-amd64-amd64-xl-pvh-intel                                fail    
 test-amd64-i386-qemut-rhel6hvm-intel                         pass    
 test-amd64-i386-qemuu-rhel6hvm-intel                         pass    
 test-amd64-amd64-libvirt                                     fail    
 test-armhf-armhf-libvirt                                     fail    
 test-amd64-i386-libvirt                                      pass    
 test-amd64-amd64-xl-multivcpu                                pass    
 test-armhf-armhf-xl-multivcpu                                pass    
 test-amd64-amd64-pair                                        pass    
 test-amd64-i386-pair                                         pass    
 test-amd64-amd64-xl-sedf-pin                                 pass    
 test-armhf-armhf-xl-sedf-pin                                 pass    
 test-amd64-amd64-xl-sedf                                     pass    
 test-armhf-armhf-xl-sedf                                     pass    
 test-amd64-i386-xl-qemut-winxpsp3-vcpus1                     pass    
 test-amd64-i386-xl-qemuu-winxpsp3-vcpus1                     pass    
 test-amd64-amd64-xl-qemut-winxpsp3                           pass    
 test-amd64-i386-xl-qemut-winxpsp3                            pass    
 test-amd64-amd64-xl-qemuu-winxpsp3                           pass    
 test-amd64-i386-xl-qemuu-winxpsp3                            pass    


------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images

Logs, config files, etc. are available at
    http://logs.test-lab.xenproject.org/osstest/logs

Test harness code can be found at
    http://xenbits.xen.org/gitweb?p=osstest.git;a=summary


Push not applicable.

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [linux-next test] 56810: regressions - FAIL
  2015-05-21  2:40 [linux-next test] 56810: regressions - FAIL osstest service user
@ 2015-05-21 13:58 ` Roger Pau Monné
  2015-05-21 15:24   ` Ian Campbell
  0 siblings, 1 reply; 5+ messages in thread
From: Roger Pau Monné @ 2015-05-21 13:58 UTC (permalink / raw)
  To: osstest service user, xen-devel; +Cc: ian.jackson, Ian Campbell

El 21/05/15 a les 4.40, osstest service user ha escrit:
> flight 56810 linux-next real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/56810/
> 
> Regressions :-(
> 
> Tests which did not succeed and are blocking,
> including tests which could not be run:
>  test-amd64-i386-rumpuserxen-i386 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail REGR. vs. 56718
> 
> Regressions which are regarded as allowable (not blocking):
>  test-armhf-armhf-libvirt     11 guest-start               fail REGR. vs. 56718
>  test-amd64-i386-freebsd10-i386  9 freebsd-install              fail like 56718
>  test-amd64-i386-freebsd10-amd64  9 freebsd-install             fail like 56718

Hello,

Is there any chance we could bisect this before it makes its way into
stable kernels?

Thanks, Roger.

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [linux-next test] 56810: regressions - FAIL
  2015-05-21 13:58 ` Roger Pau Monné
@ 2015-05-21 15:24   ` Ian Campbell
  2015-05-21 17:05     ` Ian Campbell
  0 siblings, 1 reply; 5+ messages in thread
From: Ian Campbell @ 2015-05-21 15:24 UTC (permalink / raw)
  To: Roger Pau Monné; +Cc: xen-devel, ian.jackson

On Thu, 2015-05-21 at 15:58 +0200, Roger Pau Monné wrote:
> El 21/05/15 a les 4.40, osstest service user ha escrit:
> > flight 56810 linux-next real [real]
> > http://logs.test-lab.xenproject.org/osstest/logs/56810/
> > 
> > Regressions :-(
> > 
> > Tests which did not succeed and are blocking,
> > including tests which could not be run:
> >  test-amd64-i386-rumpuserxen-i386 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail REGR. vs. 56718
> > 
> > Regressions which are regarded as allowable (not blocking):
> >  test-armhf-armhf-libvirt     11 guest-start               fail REGR. vs. 56718
> >  test-amd64-i386-freebsd10-i386  9 freebsd-install              fail like 56718
> >  test-amd64-i386-freebsd10-amd64  9 freebsd-install             fail like 56718

> Is there any chance we could bisect this before it makes its way into
> stable kernels?

linux-next isn't fast forwarding so I expect the automatic bisector
won't even try.

I was going to suggest that it may be possible to use a recent
linux-linus result as a baseline for an ad-hoc bisection, by finding one
with a pass on a revision which was an ancestor of 0ebc274769c (that is
the linux-next revision under test here).

But when I went to look I found that this is is already also failing in
linux-linus, and seems to have been for as long as these urls go back to
(which extends to the old Cambridge instance too):

http://logs.test-lab.xenproject.org/osstest/results/history.test-amd64-i386-freebsd10-amd64.linux-next.html
http://logs.test-lab.xenproject.org/osstest/results/history.test-amd64-i386-freebsd10-amd64.linux-linus.html

In fact it seems to have already been broken in

http://logs.test-lab.xenproject.org/osstest/results/history.test-amd64-i386-freebsd10-amd64.linux-3.16.html

The first set of successful tests appear in

http://logs.test-lab.xenproject.org/osstest/results/history.test-amd64-i386-freebsd10-amd64.linux-3.14.html

Figuring this out will probably involve a few adhoc test runs to
establish some baselines and then taking it from there.

Ian.


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [linux-next test] 56810: regressions - FAIL
  2015-05-21 15:24   ` Ian Campbell
@ 2015-05-21 17:05     ` Ian Campbell
       [not found]       ` <1432286246.10746.152.camel@citrix.com>
  0 siblings, 1 reply; 5+ messages in thread
From: Ian Campbell @ 2015-05-21 17:05 UTC (permalink / raw)
  To: Roger Pau Monné; +Cc: xen-devel, ian.jackson

On Thu, 2015-05-21 at 16:24 +0100, Ian Campbell wrote:
> Figuring this out will probably involve a few adhoc test runs to
> establish some baselines and then taking it from there.

I've kicked off an adhoc test (hopefully correctly) of v3.14 using the
template failure from flight 31795. It's easiest to do this in the
Cambridge instance because that has the oldest (and therefore nearest
the actual bug) flight.

I had to bodge it slightly by changing the freebsd_image to a raw one
since the templates used a qcow2 but the current harness seems to no
longer support that.

Assuming this flight produces something useful (i.e. a pass) then I'll
look into a bisect.

Ian.


http://logs.test-lab.xenproject.org/osstest/results/history.test-amd64-i386-freebsd10-amd64.linux-linus.html

oldest fail in 31795 Linux 8a84e01e147f, on leaf-beetle
$ git describe --contains 8a84e01e147f
v3.18-rc6~9

http://logs.test-lab.xenproject.org/osstest/results/history.test-amd64-i386-freebsd10-amd64.linux-3.14.html
closest pass to mainline is the first one in flight 29572 Linux
735fbc72bee7, on bush-cricket
(later ones are v3.14.X for X > 16, i.e. further from Linus' mainline)

$ git describe --contains 735fbc72bee7
v3.14.15^0

$ git merge-base 8a84e01e147f 735fbc72bee7
455c6fdbd219161bd09b1165f11699d6d73de11c
$ git describe --contains 455c6fdbd219161bd09b1165f11699d6d73de11c
v3.14^0

flight=`./cs-flight-create adhoc linux-linus`
echo $flight
./cs-adjust-flight $flight copy-jobs 31795 test-amd64-i386-freebsd10-amd64
./cs-adjust-flight $flight copy-jobs 31795 build-i386
./cs-adjust-flight $flight copy-jobs 31795 build-amd64
./cs-adjust-flight $flight copy-jobs 31795 build-i386-pvops
./cs-adjust-flight $flight runvar-set test-amd64-i386-freebsd10-amd64 host leaf-beetle
./cs-adjust-flight $flight runvar-set test-amd64-i386-freebsd10-amd64 freebsd_image FreeBSD-10.1-RELEASE-amd64.raw.xz
./cs-adjust-flight $flight runvar-set build-i386-pvops revision_linux 455c6fdbd219161bd09b1165f11699d6d73de11c
./mg-execute-flight -Badhoc -Eian.campbell@citrix.com,roger.pau@citrix.com $flight

^ permalink raw reply	[flat|nested] 5+ messages in thread

* Re: [linux-next test] 56810: regressions - FAIL
       [not found]       ` <1432286246.10746.152.camel@citrix.com>
@ 2015-05-22 11:42         ` Ian Campbell
  0 siblings, 0 replies; 5+ messages in thread
From: Ian Campbell @ 2015-05-22 11:42 UTC (permalink / raw)
  To: Roger Pau Monné; +Cc: xen-devel, ian.jackson

(I thought I'd hit send on this already, sorry if it is a repeat)

On Fri, 2015-05-22 at 10:17 +0100, Ian Campbell wrote:
> On Thu, 2015-05-21 at 18:05 +0100, Ian Campbell wrote:
> > Assuming this flight produces something useful (i.e. a pass) then I'll
> > look into a bisect.
> 
> With this and a couple more adhoc tests I've narrowed it down to
> somewhere between v3.15 and v3.16, which is 13830 commits. That might be
> a few too many for the bisector to cope but I'll see what it says.

With a minor tweak (below) and telling it to consider 14000 rather than
the default of 1000 commits it did seem to produce an answer.

The resulting bisection.png was 12M and opening it oomed my workstation!

bisection.ps was only 2M and opening it produced a frankly hilarious
graph, but I suppose it will eventually produce an answer so I set
something going.

I've spared you the barrage of mails this would normally generate. You
can see the progress in:
        osstest.xs.citrite.net/~osstest/testlogs/results-adhoc/bisect.linux-linus.test-amd64-i386-freebsd10-amd64..html
but I would recommend looking directly at:
        osstest.xs.citrite.net/~osstest/testlogs/results-adhoc/bisect.linux-linus.test-amd64-i386-freebsd10-amd64..ps
Since the html includes the png...

log2(14000) is 17 and a bit, so I guess we might see an answer by
Tuesday (Monday is a holiday in the UK). I'll try and keep and eye on it
over the weekend and if it looks to be going mad I'll stop it.

Ian.

diff --git a/adhoc-revtuple-generator b/adhoc-revtuple-generator
index 2b04c11..1f5b97a 100755
--- a/adhoc-revtuple-generator
+++ b/adhoc-revtuple-generator
@@ -549,7 +549,7 @@ sub main () {
     my @trees_continuous;
     foreach my $tree (@trees) {
         my $gen= tree_get_gen($tree);
-        my $count= 1000;
+        my $count= $num;
         my $found= 0;
         my $top= undef;
         while ($count-- > 0) {

^ permalink raw reply related	[flat|nested] 5+ messages in thread

end of thread, other threads:[~2015-05-22 11:42 UTC | newest]

Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-05-21  2:40 [linux-next test] 56810: regressions - FAIL osstest service user
2015-05-21 13:58 ` Roger Pau Monné
2015-05-21 15:24   ` Ian Campbell
2015-05-21 17:05     ` Ian Campbell
     [not found]       ` <1432286246.10746.152.camel@citrix.com>
2015-05-22 11:42         ` Ian Campbell

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.