* [xen-unstable test] 11807: regressions - FAIL
@ 2012-02-02 7:04 xen.org
2012-02-02 12:34 ` Ian Jackson
0 siblings, 1 reply; 6+ messages in thread
From: xen.org @ 2012-02-02 7:04 UTC (permalink / raw)
To: xen-devel; +Cc: ian.jackson
flight 11807 xen-unstable real [real]
http://www.chiark.greenend.org.uk/~xensrcts/logs/11807/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-i386-xl-credit2 9 guest-start fail REGR. vs. 11643
test-amd64-i386-xl-win7-amd64 7 windows-install fail REGR. vs. 11643
Regressions which are regarded as allowable (not blocking):
test-i386-i386-win 14 guest-start.2 fail like 11643
Tests which did not succeed, but are not blocking:
test-amd64-amd64-xl-pcipt-intel 9 guest-start fail never pass
test-amd64-i386-rhel6hvm-intel 11 leak-check/check fail never pass
test-amd64-i386-rhel6hvm-amd 11 leak-check/check fail never pass
test-amd64-amd64-xl-win7-amd64 13 guest-stop fail never pass
test-amd64-i386-xl-winxpsp3-vcpus1 13 guest-stop fail never pass
test-amd64-i386-win-vcpus1 16 leak-check/check fail never pass
test-amd64-i386-xend-winxpsp3 16 leak-check/check fail never pass
test-amd64-amd64-xl-win 13 guest-stop fail never pass
test-amd64-i386-xl-win-vcpus1 13 guest-stop fail never pass
test-i386-i386-xl-win 13 guest-stop fail never pass
test-amd64-i386-win 16 leak-check/check fail never pass
test-i386-i386-xl-winxpsp3 13 guest-stop fail never pass
test-amd64-amd64-win 16 leak-check/check fail never pass
test-amd64-amd64-xl-winxpsp3 13 guest-stop fail never pass
version targeted for testing:
xen a91aa7a582fb
baseline version:
xen e2722b24dc09
------------------------------------------------------------
People who touched revisions under test:
Adin Scannell <adin@scannell.ca>
Alex Zeffertt <alex.zeffertt@eu.citrix.com>
Andres Lagar-Cavilla <andres@lagarcavilla.org>
Andrew Cooper <andrew.cooper3@citrix.com>
Daniel De Graaf <dgdegra@tycho.nsa.gov>
Dario Faggioli <dario.faggioli@citrix.com>
Diego Ongaro <diego.ongaro@citrix.com>
Dietmar Hahn <dietmar.hahn@ts.fujitsu.com>
Ian Campbell <ian.campbell@citrix.com>
Ian Jackson <ian.jackson@eu.citrix.com>
Jan Beulich <jbeulich@suse.com>
Jim Fehlig <jfehlig@suse.com>
juergen.gross@ts.fujitsu.com
Keir Fraser <keir@xen.org>
Olaf Hering <olaf@aepfle.de>
Paulian Bogdan Marinca <paulian@marinca.net>
Roger Pau Monne <roger.pau@entel.upc.edu>
Stefano Stabellini <stefano.stabellini@eu.citrix.com>
Tim Deegan <tim@xen.org>
Wei Wang <wei.wang2@amd.com>
------------------------------------------------------------
jobs:
build-amd64 pass
build-i386 pass
build-amd64-oldkern pass
build-i386-oldkern pass
build-amd64-pvops pass
build-i386-pvops pass
test-amd64-amd64-xl pass
test-amd64-i386-xl pass
test-i386-i386-xl pass
test-amd64-i386-rhel6hvm-amd fail
test-amd64-amd64-xl-win7-amd64 fail
test-amd64-i386-xl-win7-amd64 fail
test-amd64-i386-xl-credit2 fail
test-amd64-amd64-xl-pcipt-intel fail
test-amd64-i386-rhel6hvm-intel fail
test-amd64-i386-xl-multivcpu pass
test-amd64-amd64-pair pass
test-amd64-i386-pair pass
test-i386-i386-pair pass
test-amd64-amd64-xl-sedf-pin pass
test-amd64-amd64-pv pass
test-amd64-i386-pv pass
test-i386-i386-pv pass
test-amd64-amd64-xl-sedf pass
test-amd64-i386-win-vcpus1 fail
test-amd64-i386-xl-win-vcpus1 fail
test-amd64-i386-xl-winxpsp3-vcpus1 fail
test-amd64-amd64-win fail
test-amd64-i386-win fail
test-i386-i386-win fail
test-amd64-amd64-xl-win fail
test-i386-i386-xl-win fail
test-amd64-i386-xend-winxpsp3 fail
test-amd64-amd64-xl-winxpsp3 fail
test-i386-i386-xl-winxpsp3 fail
------------------------------------------------------------
sg-report-flight on woking.cam.xci-test.com
logs: /home/xc_osstest/logs
images: /home/xc_osstest/images
Logs, config files, etc. are available at
http://www.chiark.greenend.org.uk/~xensrcts/logs
Test harness code can be found at
http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary
Not pushing.
(No revision log; it would be 1232 lines long.)
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [xen-unstable test] 11807: regressions - FAIL
2012-02-02 7:04 [xen-unstable test] 11807: regressions - FAIL xen.org
@ 2012-02-02 12:34 ` Ian Jackson
2012-02-02 15:49 ` Andrew Cooper
0 siblings, 1 reply; 6+ messages in thread
From: Ian Jackson @ 2012-02-02 12:34 UTC (permalink / raw)
To: xen-devel; +Cc: Wei Wang
xen.org writes ("[xen-unstable test] 11807: regressions - FAIL"):
> Tests which did not succeed and are blocking,
> including tests which could not be run:
> test-amd64-i386-xl-credit2 9 guest-start fail REGR. vs. 11643
> test-amd64-i386-xl-win7-amd64 7 windows-install fail REGR. vs. 11643
Both of these seem to be high-probability heisenbugs. In both cases
LThe failure seems to be much more likely (perhaps even restricted to)
on certain hosts, and now that my tester is "sticky" when it sees a
fail these will give us more trouble.
For this one
> test-amd64-i386-xl-win7-amd64 7 windows-install fail REGR. vs. 11643
the failure mode is that Windows sits waiting at a login screen rather
than logging in the user which is supposed to run the test responder
which was installed with the image. Most likely cause is that it has
stopped making progress for some reason. None of the logs seem
interesting.
This one
> test-amd64-i386-xl-credit2 9 guest-start fail REGR. vs. 11643
which occasionally also manifests as various other failures of the
same test run, is this assertion:
Feb 2 02:34:49.293506 (XEN) Assertion 'test_bit(vector, desc->arch.used_vectors)' failed at irq.c:670
which I mentioned yesterday. My bisector had a go at the
guest-saverestore test and produced inconclusive results but looking
at the revision graph output I suspect that something between
24612:54000bca7a6a (probably good) and 24620:926e0820d615 (definitely
bad) may be implicated.
Given that this bug seems to be pretty specific to a particular host,
which happens to be a dual-socket six-core AMD Opteron 2427, I'm
wondering whether 24613:04623ceabb72 "amd iommu: disable iommu
emulation on non-iommu systems" might be relevant.
Suggestions for either bug, and offers to debug these, gratefully
received. Failing that we will probably get lucky and get a push
eventually.
Ian.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [xen-unstable test] 11807: regressions - FAIL
2012-02-02 12:34 ` Ian Jackson
@ 2012-02-02 15:49 ` Andrew Cooper
2012-02-07 18:09 ` Ian Jackson
0 siblings, 1 reply; 6+ messages in thread
From: Andrew Cooper @ 2012-02-02 15:49 UTC (permalink / raw)
To: Ian Jackson; +Cc: Wei Wang, George Dunlap, xen-devel, Keir Fraser, Jan Beulich
[-- Attachment #1: Type: text/plain, Size: 157 bytes --]
This patch ought to help narrow down the problem.
--
Andrew Cooper - Dom0 Kernel Engineer, Citrix XenServer
T: +44 (0)1223 225 900, http://www.citrix.com
[-- Attachment #2: irq-migration-debug.patch --]
[-- Type: text/x-patch, Size: 1449 bytes --]
# HG changeset patch
# Parent e2722b24dc0962de37215320b05d1bb7c4c42864
IRQ: Add extra debugging to help track down why this assertion is failing
Signed-off-by: Andrew Cooper <andrew.cooper3@citrix.com>
diff -r e2722b24dc09 xen/arch/x86/irq.c
--- a/xen/arch/x86/irq.c
+++ b/xen/arch/x86/irq.c
@@ -608,6 +608,8 @@ void move_native_irq(struct irq_desc *de
desc->handler->enable(desc);
}
+static void dump_irqs(unsigned char key);
+
fastcall void smp_irq_move_cleanup_interrupt(struct cpu_user_regs *regs)
{
unsigned vector, me;
@@ -667,7 +669,18 @@ fastcall void smp_irq_move_cleanup_inter
if ( desc->arch.used_vectors )
{
- ASSERT(test_bit(vector, desc->arch.used_vectors));
+ if ( unlikely(!test_bit(vector, desc->arch.used_vectors)) )
+ {
+ bitmap_scnlistprintf(keyhandler_scratch,
+ sizeof(keyhandler_scratch),
+ desc->arch.used_vectors->_bits,
+ NR_VECTORS);
+ printk("*** IRQ BUG found ***\n"
+ "CPU%d -Testing vector %d from bitmap %s\n",
+ me, vector, keyhandler_scratch);
+ dump_irqs('i');
+ BUG();
+ }
clear_bit(vector, desc->arch.used_vectors);
}
}
[-- Attachment #3: Type: text/plain, Size: 138 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xensource.com
http://lists.xensource.com/xen-devel
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [xen-unstable test] 11807: regressions - FAIL
2012-02-07 18:09 ` Ian Jackson
@ 2012-02-07 10:23 ` Keir Fraser
2012-02-07 18:44 ` Ian Jackson
0 siblings, 1 reply; 6+ messages in thread
From: Keir Fraser @ 2012-02-07 10:23 UTC (permalink / raw)
To: Ian Jackson, Andrew Cooper
Cc: Wei Wang, George Dunlap, xen-devel, Jan Beulich
On 07/02/2012 18:09, "Ian Jackson" <Ian.Jackson@eu.citrix.com> wrote:
> Andrew Cooper writes ("Re: [Xen-devel] [xen-unstable test] 11807: regressions
> - FAIL"):
>> This patch ought to help narrow down the problem.
>
> Thanks. Keir, does this look reasonable to you ?
Ah, yes it did. Please apply it.
Acked-by: Keir Fraser <keir@xen.org>
> Thanks,
> Ian.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [xen-unstable test] 11807: regressions - FAIL
2012-02-02 15:49 ` Andrew Cooper
@ 2012-02-07 18:09 ` Ian Jackson
2012-02-07 10:23 ` Keir Fraser
0 siblings, 1 reply; 6+ messages in thread
From: Ian Jackson @ 2012-02-07 18:09 UTC (permalink / raw)
To: Andrew Cooper
Cc: Wei Wang, George Dunlap, xen-devel, Keir Fraser, Jan Beulich
Andrew Cooper writes ("Re: [Xen-devel] [xen-unstable test] 11807: regressions - FAIL"):
> This patch ought to help narrow down the problem.
Thanks. Keir, does this look reasonable to you ?
Thanks,
Ian.
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [xen-unstable test] 11807: regressions - FAIL
2012-02-07 10:23 ` Keir Fraser
@ 2012-02-07 18:44 ` Ian Jackson
0 siblings, 0 replies; 6+ messages in thread
From: Ian Jackson @ 2012-02-07 18:44 UTC (permalink / raw)
To: Keir Fraser
Cc: Wei Wang, Andrew Cooper, xen-devel, George Dunlap, Jan Beulich
Keir Fraser writes ("Re: [Xen-devel] [xen-unstable test] 11807: regressions - FAIL"):
> On 07/02/2012 18:09, "Ian Jackson" <Ian.Jackson@eu.citrix.com> wrote:
> > Thanks. Keir, does this look reasonable to you ?
>
> Ah, yes it did. Please apply it.
>
> Acked-by: Keir Fraser <keir@xen.org>
Thanks, done.
Ian.
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2012-02-07 18:44 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2012-02-02 7:04 [xen-unstable test] 11807: regressions - FAIL xen.org
2012-02-02 12:34 ` Ian Jackson
2012-02-02 15:49 ` Andrew Cooper
2012-02-07 18:09 ` Ian Jackson
2012-02-07 10:23 ` Keir Fraser
2012-02-07 18:44 ` Ian Jackson
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.