* [xen-4.6-testing test] 65327: regressions - FAIL
@ 2015-12-04 5:15 osstest service owner
2015-12-04 10:20 ` Wei Liu
0 siblings, 1 reply; 5+ messages in thread
From: osstest service owner @ 2015-12-04 5:15 UTC (permalink / raw)
To: xen-devel, osstest-admin
flight 65327 xen-4.6-testing real [real]
http://logs.test-lab.xenproject.org/osstest/logs/65327/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 16 guest-localmigrate/x10 fail in 65210 REGR. vs. 63449
Tests which are failing intermittently (not blocking):
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail in 65283 pass in 65210
test-amd64-i386-rumpuserxen-i386 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail in 65299 pass in 65327
test-armhf-armhf-xl-rtds 11 guest-start fail in 65299 pass in 65327
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail pass in 65227
test-armhf-armhf-xl-rtds 15 guest-start.2 fail pass in 65283
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail pass in 65283
test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail pass in 65299
Regressions which are regarded as allowable (not blocking):
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail in 65227 like 63379
test-armhf-armhf-xl-rtds 16 guest-start/debian.repeat fail in 65283 like 63449
Tests which did not succeed, but are not blocking:
test-armhf-armhf-libvirt 14 guest-saverestore fail never pass
test-armhf-armhf-libvirt 12 migrate-support-check fail never pass
test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail never pass
test-armhf-armhf-libvirt-raw 9 debian-di-install fail never pass
test-amd64-amd64-libvirt-vhd 11 migrate-support-check fail never pass
test-amd64-amd64-libvirt-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-xl-rtds 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-rtds 12 migrate-support-check fail never pass
test-amd64-i386-libvirt 12 migrate-support-check fail never pass
test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass
test-armhf-armhf-libvirt-qcow2 9 debian-di-install fail never pass
test-armhf-armhf-xl-vhd 9 debian-di-install fail never pass
test-amd64-amd64-xl-pvh-intel 11 guest-start fail never pass
test-armhf-armhf-xl-multivcpu 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 12 migrate-support-check fail never pass
test-armhf-armhf-libvirt-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-libvirt-xsm 14 guest-saverestore fail never pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-amd64-i386-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-amd64-amd64-libvirt 12 migrate-support-check fail never pass
test-amd64-amd64-qemuu-nested-amd 16 debian-hvm-install/l1/l2 fail never pass
test-armhf-armhf-xl-arndale 12 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-xsm 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail never pass
test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail never pass
test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop fail never pass
test-armhf-armhf-xl-credit2 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-credit2 12 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 12 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 13 saverestore-support-check fail never pass
test-armhf-armhf-xl 12 migrate-support-check fail never pass
test-armhf-armhf-xl 13 saverestore-support-check fail never pass
version targeted for testing:
xen 78833c04250416f1870c458309d3ac0e5cf915fd
baseline version:
xen 40d7a7454835c2f7c639c78f6c09e7b6f0e4a4e2
Last test of basis 63449 2015-11-01 10:09:20 Z 32 days
Failing since 64055 2015-11-10 11:39:11 Z 23 days 22 attempts
Testing same since 64935 2015-11-20 02:51:37 Z 14 days 16 attempts
------------------------------------------------------------
People who touched revisions under test:
Andrew Cooper <andrew.cooper3@citrix.com>
Ian Campbell <ian.campbell@citrix.com>
Ian Jackson <ian.jackson@eu.citrix.com>
Jan Beulich <jbeulich@suse.com>
Kevin Tian <kevin.tian@intel.com>
jobs:
build-amd64-xsm pass
build-armhf-xsm pass
build-i386-xsm pass
build-amd64 pass
build-armhf pass
build-i386 pass
build-amd64-libvirt pass
build-armhf-libvirt pass
build-i386-libvirt pass
build-amd64-prev pass
build-i386-prev pass
build-amd64-pvops pass
build-armhf-pvops pass
build-i386-pvops pass
build-amd64-rumpuserxen pass
build-i386-rumpuserxen pass
test-amd64-amd64-xl pass
test-armhf-armhf-xl pass
test-amd64-i386-xl pass
test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-amd64-libvirt-xsm pass
test-armhf-armhf-libvirt-xsm fail
test-amd64-i386-libvirt-xsm pass
test-amd64-amd64-xl-xsm pass
test-armhf-armhf-xl-xsm pass
test-amd64-i386-xl-xsm pass
test-amd64-amd64-qemuu-nested-amd fail
test-amd64-amd64-xl-pvh-amd fail
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-xl-qemut-debianhvm-amd64 pass
test-amd64-i386-xl-qemut-debianhvm-amd64 pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-freebsd10-amd64 pass
test-amd64-amd64-xl-qemuu-ovmf-amd64 pass
test-amd64-i386-xl-qemuu-ovmf-amd64 pass
test-amd64-amd64-rumpuserxen-amd64 fail
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-i386-xl-qemuu-win7-amd64 fail
test-armhf-armhf-xl-arndale pass
test-amd64-amd64-xl-credit2 pass
test-armhf-armhf-xl-credit2 pass
test-armhf-armhf-xl-cubietruck pass
test-amd64-i386-freebsd10-i386 pass
test-amd64-i386-rumpuserxen-i386 pass
test-amd64-amd64-qemuu-nested-intel pass
test-amd64-amd64-xl-pvh-intel fail
test-amd64-i386-qemut-rhel6hvm-intel pass
test-amd64-i386-qemuu-rhel6hvm-intel pass
test-amd64-amd64-libvirt pass
test-armhf-armhf-libvirt fail
test-amd64-i386-libvirt pass
test-amd64-amd64-migrupgrade pass
test-amd64-i386-migrupgrade pass
test-amd64-amd64-xl-multivcpu pass
test-armhf-armhf-xl-multivcpu pass
test-amd64-amd64-pair pass
test-amd64-i386-pair pass
test-amd64-amd64-libvirt-pair pass
test-amd64-i386-libvirt-pair pass
test-amd64-amd64-amd64-pvgrub pass
test-amd64-amd64-i386-pvgrub pass
test-amd64-amd64-pygrub pass
test-armhf-armhf-libvirt-qcow2 fail
test-amd64-amd64-xl-qcow2 pass
test-armhf-armhf-libvirt-raw fail
test-amd64-i386-xl-raw pass
test-amd64-amd64-xl-rtds pass
test-armhf-armhf-xl-rtds fail
test-amd64-i386-xl-qemut-winxpsp3-vcpus1 pass
test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 pass
test-amd64-amd64-libvirt-vhd pass
test-armhf-armhf-xl-vhd fail
test-amd64-amd64-xl-qemut-winxpsp3 pass
test-amd64-i386-xl-qemut-winxpsp3 pass
test-amd64-amd64-xl-qemuu-winxpsp3 pass
test-amd64-i386-xl-qemuu-winxpsp3 pass
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
Not pushing.
------------------------------------------------------------
commit 78833c04250416f1870c458309d3ac0e5cf915fd
Author: Ian Campbell <ian.campbell@citrix.com>
Date: Thu Sep 10 14:31:34 2015 +0100
Config: Switch to unified qemu trees.
Upstream qemu is now in qemu-xen.git and the trad fork is in
qemu-xen-traditional.git.
QEMU_UPSTREAM_REVISION is currently a tag and
QEMU_TRADITIONAL_REVISION is a specific revision, so no changes are
required to those.
Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
Conflicts:
Config.mk
Signed-off-by: Ian Jackson <ian.jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
commit e3b0c81ba143939282d99d7cdc041f95bae9c917
Author: Jan Beulich <jbeulich@suse.com>
Date: Tue Nov 10 12:16:51 2015 +0100
x86/HVM: always intercept #AC and #DB
Both being benign exceptions, and both being possible to get triggered
by exception delivery, this is required to prevent a guest from locking
up a CPU (resulting from no other VM exits occurring once getting into
such a loop).
The specific scenarios:
1) #AC may be raised during exception delivery if the handler is set to
be a ring-3 one by a 32-bit guest, and the stack is misaligned.
This is CVE-2015-5307 / XSA-156.
Reported-by: Benjamin Serebrin <serebrin@google.com>
2) #DB may be raised during exception delivery when a breakpoint got
placed on a data structure involved in delivering the exception. This
can result in an endless loop when a 64-bit guest uses a non-zero IST
for the vector 1 IDT entry, but even without use of IST the time it
takes until a contributory fault would get raised (results depending
on the handler) may be quite long.
This is CVE-2015-8104 / XSA-156.
Signed-off-by: Jan Beulich <jbeulich@suse.com>
Reviewed-by: Andrew Cooper <andrew.cooper3@citrix.com>
Tested-by: Andrew Cooper <andrew.cooper3@citrix.com>
master commit: bd2239d9fa975a1ee5bcd27c218ae042cd0a57bc
master date: 2015-11-10 12:03:08 +0100
commit a01d1c7ce27c21e31944ae34fd45a4581c202701
Author: Andrew Cooper <andrew.cooper3@citrix.com>
Date: Tue Nov 10 12:16:11 2015 +0100
x86/vmx: improvements to vmentry failure handling
Combine the almost identical vm_launch_fail() and vm_resume_fail() into a
single vmx_vmentry_failure().
Re-save all GPRs so that domain_crash() prints the real register values,
rather than the stack frame of the vmx_vmentry_failure() call.
Signed-off-by: Andrew Cooper <andrew.cooper3@citrix.com>
Acked-by: Kevin Tian <kevin.tian@intel.com>
master commit: bbcf0b218f64b1e3e2b66b0fbb623f51d9014e81
master date: 2015-11-03 18:14:02 +0100
commit 97549e503a2edc8476f9597400159bbe7262fc41
Author: Andrew Cooper <andrew.cooper3@citrix.com>
Date: Tue Nov 10 12:15:29 2015 +0100
x86/PoD: Make p2m_pod_empty_cache() restartable
This avoids a long running operation when destroying a domain with a
large PoD cache.
Signed-off-by: Andrew Cooper <andrew.cooper3@citrix.com>
Reviewed-by: George Dunlap <george.dunlap@citrix.com>
master commit: 59a5061723ba47c0028cf48487e5de551c42a378
master date: 2015-11-02 15:33:38 +0100
(qemu changes not included)
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [xen-4.6-testing test] 65327: regressions - FAIL
2015-12-04 5:15 [xen-4.6-testing test] 65327: regressions - FAIL osstest service owner
@ 2015-12-04 10:20 ` Wei Liu
2015-12-04 11:14 ` Jan Beulich
0 siblings, 1 reply; 5+ messages in thread
From: Wei Liu @ 2015-12-04 10:20 UTC (permalink / raw)
To: osstest service owner; +Cc: Ian Jackson, xen-devel, wei.liu2, Ian Campbell
On Fri, Dec 04, 2015 at 05:15:28AM +0000, osstest service owner wrote:
> flight 65327 xen-4.6-testing real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/65327/
>
> Regressions :-(
>
> Tests which did not succeed and are blocking,
> including tests which could not be run:
> test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 16 guest-localmigrate/x10 fail in 65210 REGR. vs. 63449
This has been blocked on merlot* for quite a while.
And xen-unstable (with the supposedly fixes to mini-os and oxenstored in
place) is not doing any better on merlot*, just that the test cast
itself won't block pushing.
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm/ALL
Looking into this further, OSStest is using cxenstored, which supposedly
doesn't have the bug that stalled the ring.
Maybe this is a host specific bug. Maybe cxenstored also has a latent
bug. I'm not sure. I don't know what to make of this.
Wei.
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [xen-4.6-testing test] 65327: regressions - FAIL
2015-12-04 10:20 ` Wei Liu
@ 2015-12-04 11:14 ` Jan Beulich
2015-12-04 12:14 ` Ian Jackson
0 siblings, 1 reply; 5+ messages in thread
From: Jan Beulich @ 2015-12-04 11:14 UTC (permalink / raw)
To: wei.liu2, osstest service owner; +Cc: xen-devel, Ian Jackson, Ian Campbell
>>> On 04.12.15 at 11:20, <wei.liu2@citrix.com> wrote:
> On Fri, Dec 04, 2015 at 05:15:28AM +0000, osstest service owner wrote:
>> flight 65327 xen-4.6-testing real [real]
>> http://logs.test-lab.xenproject.org/osstest/logs/65327/
>>
>> Regressions :-(
>>
>> Tests which did not succeed and are blocking,
>> including tests which could not be run:
>> test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 16 guest-localmigrate/x10 fail
> in 65210 REGR. vs. 63449
>
> This has been blocked on merlot* for quite a while.
>
> And xen-unstable (with the supposedly fixes to mini-os and oxenstored in
> place) is not doing any better on merlot*, just that the test cast
> itself won't block pushing.
And indeed I had suggested a force push a number of flights ago,
but Ian had hoped it would eventually end up running on another
host, thus allowing a push to happen. I don't know how sticky the
stickiness of failed tests is, but I'm not getting the impression that
such a host change is going to happen reliably within a couple of
days at most.
Jan
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [xen-4.6-testing test] 65327: regressions - FAIL
2015-12-04 11:14 ` Jan Beulich
@ 2015-12-04 12:14 ` Ian Jackson
2015-12-04 12:15 ` [xen-4.6-testing test] 65327: regressions - FAIL [and 1 more messages] Ian Jackson
0 siblings, 1 reply; 5+ messages in thread
From: Ian Jackson @ 2015-12-04 12:14 UTC (permalink / raw)
To: Jan Beulich; +Cc: xen-devel, wei.liu2, osstest service owner
Jan Beulich writes ("Re: [Xen-devel] [xen-4.6-testing test] 65327: regressions - FAIL"):
> And indeed I had suggested a force push a number of flights ago,
> but Ian had hoped it would eventually end up running on another
> host, thus allowing a push to happen.
I'm not sure which Ian this is and I can't find a record in email of
anyone having said that. But, that seems like a rather forlorn hope.
It seems that this is a host-specific failure, which is reliably
reproducible. I did a search in the database[1] to see if this test
ever passed on merlot, and it didn't.
> I don't know how sticky the stickiness of failed tests is, but I'm
> not getting the impression that such a host change is going to
> happen reliably within a couple of days at most.
The system tries to be as sticky as possible to avoid regressions
slipping through.
IMO the right justification for a push is that this test has never
passed on merlot. The push gate only regards it as a regression
because it once happened to run on a different machine for some
reason, which looks like a baseline pass that it thinks ought to be
reproduced.
We can force push this in 4.6 and I will do so (based on 65327) after
sending this mail.
This will recur on other branches occasionally. In general in
situations like this we have four options:
1. Fix the underlying bug
2. Force push each relevant tree each time this comes up
3. Add this particular test to the allowable failures list
4. Arrange to not run this test on merlot*
In this case: fixing the bug seems difficult (thanks to Wei for
investigating). Selecting different hosts would be applicable if we
knew what the problem was (eg BIOS bug, CPU incompatibility, or
whatever), but doesn't seem relevant here. Force pushing affected
trees will get annoying eventually.
I suggest we continue doing force pushes and mark the test as
non-blocking if it gets too annoying.
In the meantime I think we should continue to investigate the bug. I
think it is likely that it is a race which we happen to lose on
merlot*.
Ian.
[1]
select * from steps join flights using (flight) join jobs using (flight,job) where job='test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm' and testid = 'guest-localmigrate/x10' and blessing='real' and (select val from runvars r where r.flight=flights.flight and r.job=jobs.job and name='host') like 'merlot%' order by flight desc;
=> 64 rows, all showing failure, on a variety of branches
select * from steps join flights using (flight) join jobs using (flight,job) where job='test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm' and testid = 'guest-localmigrate/x10' and blessing='real' and (select val from runvars r where r.flight=flights.flight and r.job=jobs.job and name='host') like 'merlot%' and steps.status='pass' order by flight desc;
=> 0 rows
^ permalink raw reply [flat|nested] 5+ messages in thread
* Re: [xen-4.6-testing test] 65327: regressions - FAIL [and 1 more messages]
2015-12-04 12:14 ` Ian Jackson
@ 2015-12-04 12:15 ` Ian Jackson
0 siblings, 0 replies; 5+ messages in thread
From: Ian Jackson @ 2015-12-04 12:15 UTC (permalink / raw)
To: osstest service owner; +Cc: xen-devel, wei.liu2, Jan Beulich
osstest service owner writes ("[xen-4.6-testing test] 65327: regressions - FAIL"):
> Tests which did not succeed and are blocking,
> including tests which could not be run:
> test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 16 guest-localmigrate/x10 fail in 65210 REGR. vs. 63449
>
...
> version targeted for testing:
> xen 78833c04250416f1870c458309d3ac0e5cf915fd
Force pushed as discussed.
Ian.
^ permalink raw reply [flat|nested] 5+ messages in thread
end of thread, other threads:[~2015-12-04 12:15 UTC | newest]
Thread overview: 5+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-12-04 5:15 [xen-4.6-testing test] 65327: regressions - FAIL osstest service owner
2015-12-04 10:20 ` Wei Liu
2015-12-04 11:14 ` Jan Beulich
2015-12-04 12:14 ` Ian Jackson
2015-12-04 12:15 ` [xen-4.6-testing test] 65327: regressions - FAIL [and 1 more messages] Ian Jackson
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.