* [xen-4.12-testing test] 161776: regressions - FAIL
@ 2021-05-06 7:50 osstest service owner
2021-05-06 16:27 ` Ian Jackson
0 siblings, 1 reply; 4+ messages in thread
From: osstest service owner @ 2021-05-06 7:50 UTC (permalink / raw)
To: xen-devel, osstest-admin
flight 161776 xen-4.12-testing real [real]
flight 161806 xen-4.12-testing real-retest [real]
http://logs.test-lab.xenproject.org/osstest/logs/161776/
http://logs.test-lab.xenproject.org/osstest/logs/161806/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-amd64-xl-qcow2 19 guest-localmigrate/x10 fail REGR. vs. 159418
Tests which did not succeed, but are not blocking:
test-amd64-i386-xl-qemuu-win7-amd64 19 guest-stop fail like 159418
test-armhf-armhf-libvirt 16 saverestore-support-check fail like 159418
test-amd64-amd64-qemuu-nested-amd 20 debian-hvm-install/l1/l2 fail like 159418
test-amd64-amd64-xl-qemut-ws16-amd64 19 guest-stop fail like 159418
test-amd64-i386-xl-qemuu-ws16-amd64 19 guest-stop fail like 159418
test-amd64-amd64-xl-qemut-win7-amd64 19 guest-stop fail like 159418
test-amd64-amd64-xl-qemuu-ws16-amd64 19 guest-stop fail like 159418
test-amd64-i386-xl-qemut-win7-amd64 19 guest-stop fail like 159418
test-amd64-amd64-xl-qemuu-win7-amd64 19 guest-stop fail like 159418
test-armhf-armhf-libvirt-raw 15 saverestore-support-check fail like 159418
test-amd64-i386-xl-qemut-ws16-amd64 19 guest-stop fail like 159418
test-amd64-i386-xl-pvshim 14 guest-start fail never pass
test-arm64-arm64-xl-seattle 15 migrate-support-check fail never pass
test-arm64-arm64-xl-seattle 16 saverestore-support-check fail never pass
test-amd64-i386-libvirt 15 migrate-support-check fail never pass
test-amd64-i386-libvirt-xsm 15 migrate-support-check fail never pass
test-amd64-amd64-libvirt 15 migrate-support-check fail never pass
test-amd64-amd64-libvirt-xsm 15 migrate-support-check fail never pass
test-arm64-arm64-xl 15 migrate-support-check fail never pass
test-arm64-arm64-xl 16 saverestore-support-check fail never pass
test-arm64-arm64-xl-xsm 15 migrate-support-check fail never pass
test-arm64-arm64-xl-credit1 15 migrate-support-check fail never pass
test-arm64-arm64-xl-xsm 16 saverestore-support-check fail never pass
test-arm64-arm64-xl-credit1 16 saverestore-support-check fail never pass
test-arm64-arm64-xl-credit2 15 migrate-support-check fail never pass
test-arm64-arm64-xl-credit2 16 saverestore-support-check fail never pass
test-arm64-arm64-xl-thunderx 15 migrate-support-check fail never pass
test-arm64-arm64-xl-thunderx 16 saverestore-support-check fail never pass
test-arm64-arm64-libvirt-xsm 15 migrate-support-check fail never pass
test-arm64-arm64-libvirt-xsm 16 saverestore-support-check fail never pass
test-armhf-armhf-xl-arndale 15 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 16 saverestore-support-check fail never pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 13 migrate-support-check fail never pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 13 migrate-support-check fail never pass
test-amd64-amd64-libvirt-vhd 14 migrate-support-check fail never pass
test-armhf-armhf-xl-multivcpu 15 migrate-support-check fail never pass
test-armhf-armhf-xl-multivcpu 16 saverestore-support-check fail never pass
test-armhf-armhf-xl-credit1 15 migrate-support-check fail never pass
test-armhf-armhf-xl-credit1 16 saverestore-support-check fail never pass
test-armhf-armhf-xl-rtds 15 migrate-support-check fail never pass
test-armhf-armhf-xl-rtds 16 saverestore-support-check fail never pass
test-armhf-armhf-xl-credit2 15 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 16 saverestore-support-check fail never pass
test-armhf-armhf-xl-cubietruck 15 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 16 saverestore-support-check fail never pass
test-armhf-armhf-libvirt 15 migrate-support-check fail never pass
test-armhf-armhf-xl-vhd 14 migrate-support-check fail never pass
test-armhf-armhf-xl-vhd 15 saverestore-support-check fail never pass
test-armhf-armhf-libvirt-raw 14 migrate-support-check fail never pass
test-armhf-armhf-xl 15 migrate-support-check fail never pass
test-armhf-armhf-xl 16 saverestore-support-check fail never pass
version targeted for testing:
xen 5984905b2638df87a0262d1ee91f0a6e14a86df6
baseline version:
xen 4cf5929606adc2fb1ab4e2921c14ba4b8046ecd1
Last test of basis 159418 2021-02-16 15:06:11 Z 78 days
Failing since 160128 2021-03-18 14:36:18 Z 48 days 66 attempts
Testing same since 161776 2021-05-04 19:06:01 Z 1 days 1 attempts
------------------------------------------------------------
People who touched revisions under test:
Andrew Cooper <andrew.cooper3@citrix.com>
Anthony PERARD <anthony.perard@citrix.com>
Christian Lindig <christian.lindig@citrix.com>
Edwin Török <edvin.torok@citrix.com>
George Dunlap <george.dunlap@citrix.com>
Ian Jackson <ian.jackson@eu.citrix.com>
Igor Druzhinin <igor.druzhinin@citrix.com>
Jan Beulich <jbeulich@suse.com>
Julien Grall <jgrall@amazon.com>
Olaf Hering <olaf@aepfle.de>
Stefano Stabellini <sstabellini@kernel.org>
jobs:
build-amd64-xsm pass
build-arm64-xsm pass
build-i386-xsm pass
build-amd64-xtf pass
build-amd64 pass
build-arm64 pass
build-armhf pass
build-i386 pass
build-amd64-libvirt pass
build-arm64-libvirt pass
build-armhf-libvirt pass
build-i386-libvirt pass
build-amd64-prev pass
build-i386-prev pass
build-amd64-pvops pass
build-arm64-pvops pass
build-armhf-pvops pass
build-i386-pvops pass
test-xtf-amd64-amd64-1 pass
test-xtf-amd64-amd64-2 pass
test-xtf-amd64-amd64-3 pass
test-xtf-amd64-amd64-4 pass
test-xtf-amd64-amd64-5 pass
test-amd64-amd64-xl pass
test-arm64-arm64-xl pass
test-armhf-armhf-xl pass
test-amd64-i386-xl pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-debianhvm-i386-xsm pass
test-amd64-i386-xl-qemut-debianhvm-i386-xsm pass
test-amd64-amd64-xl-qemuu-debianhvm-i386-xsm pass
test-amd64-i386-xl-qemuu-debianhvm-i386-xsm pass
test-amd64-amd64-libvirt-xsm pass
test-arm64-arm64-libvirt-xsm pass
test-amd64-i386-libvirt-xsm pass
test-amd64-amd64-xl-xsm pass
test-arm64-arm64-xl-xsm pass
test-amd64-i386-xl-xsm pass
test-amd64-amd64-qemuu-nested-amd fail
test-amd64-amd64-xl-pvhv2-amd pass
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-xl-qemut-debianhvm-amd64 pass
test-amd64-i386-xl-qemut-debianhvm-amd64 pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-freebsd10-amd64 pass
test-amd64-amd64-qemuu-freebsd11-amd64 pass
test-amd64-amd64-qemuu-freebsd12-amd64 pass
test-amd64-amd64-xl-qemuu-ovmf-amd64 pass
test-amd64-i386-xl-qemuu-ovmf-amd64 pass
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-i386-xl-qemuu-win7-amd64 fail
test-amd64-amd64-xl-qemut-ws16-amd64 fail
test-amd64-i386-xl-qemut-ws16-amd64 fail
test-amd64-amd64-xl-qemuu-ws16-amd64 fail
test-amd64-i386-xl-qemuu-ws16-amd64 fail
test-armhf-armhf-xl-arndale pass
test-amd64-amd64-xl-credit1 pass
test-arm64-arm64-xl-credit1 pass
test-armhf-armhf-xl-credit1 pass
test-amd64-amd64-xl-credit2 pass
test-arm64-arm64-xl-credit2 pass
test-armhf-armhf-xl-credit2 pass
test-armhf-armhf-xl-cubietruck pass
test-amd64-amd64-xl-qemuu-dmrestrict-amd64-dmrestrict pass
test-amd64-i386-xl-qemuu-dmrestrict-amd64-dmrestrict pass
test-amd64-i386-freebsd10-i386 pass
test-amd64-amd64-qemuu-nested-intel pass
test-amd64-amd64-xl-pvhv2-intel pass
test-amd64-i386-qemut-rhel6hvm-intel pass
test-amd64-i386-qemuu-rhel6hvm-intel pass
test-amd64-amd64-libvirt pass
test-armhf-armhf-libvirt pass
test-amd64-i386-libvirt pass
test-amd64-amd64-livepatch pass
test-amd64-i386-livepatch pass
test-amd64-amd64-migrupgrade pass
test-amd64-i386-migrupgrade pass
test-amd64-amd64-xl-multivcpu pass
test-armhf-armhf-xl-multivcpu pass
test-amd64-amd64-pair pass
test-amd64-i386-pair pass
test-amd64-amd64-libvirt-pair pass
test-amd64-i386-libvirt-pair pass
test-amd64-amd64-amd64-pvgrub pass
test-amd64-amd64-i386-pvgrub pass
test-amd64-amd64-xl-pvshim pass
test-amd64-i386-xl-pvshim fail
test-amd64-amd64-pygrub pass
test-amd64-amd64-xl-qcow2 fail
test-armhf-armhf-libvirt-raw pass
test-amd64-i386-xl-raw pass
test-amd64-amd64-xl-rtds pass
test-armhf-armhf-xl-rtds pass
test-arm64-arm64-xl-seattle pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64-shadow pass
test-amd64-i386-xl-qemuu-debianhvm-amd64-shadow pass
test-amd64-amd64-xl-shadow pass
test-amd64-i386-xl-shadow pass
test-arm64-arm64-xl-thunderx pass
test-amd64-amd64-libvirt-vhd pass
test-armhf-armhf-xl-vhd pass
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
Not pushing.
(No revision log; it would be 324 lines long.)
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [xen-4.12-testing test] 161776: regressions - FAIL
2021-05-06 7:50 [xen-4.12-testing test] 161776: regressions - FAIL osstest service owner
@ 2021-05-06 16:27 ` Ian Jackson
2021-05-07 8:14 ` Jan Beulich
0 siblings, 1 reply; 4+ messages in thread
From: Ian Jackson @ 2021-05-06 16:27 UTC (permalink / raw)
To: Jan Beulich; +Cc: xen-devel, George Dunlap
osstest service owner writes ("[xen-4.12-testing test] 161776: regressions - FAIL"):
> flight 161776 xen-4.12-testing real [real]
> flight 161806 xen-4.12-testing real-retest [real]
> http://logs.test-lab.xenproject.org/osstest/logs/161776/
> http://logs.test-lab.xenproject.org/osstest/logs/161806/
>
> Regressions :-(
>
> Tests which did not succeed and are blocking,
> including tests which could not be run:
> test-amd64-amd64-xl-qcow2 19 guest-localmigrate/x10 fail REGR. vs. 159418
This has been failing for 48 days.
http://logs.test-lab.xenproject.org/osstest/logs/161776/test-amd64-amd64-xl-qcow2/19.ts-guest-localmigrate.log
shows this:
libxl: error: libxl_dom_suspend.c:377:suspend_common_wait_guest_timeout: Domain
6:guest did not suspend, timed out
as the first thing that goes wrong. This is after the guest has
acknowledged the suspend request.
osstest tried to bisect it but was not able to reproduce the basis
pass. That means either that we got (un)lucky with the basis pass, or
that something not version-controlled by osstest is responsible. In
this case I think the dom0 and domU kernels, as well as the usual
pieces, are all properly version controlled by osstest. The non-Xen
userland tools are not but I doubt they are the cause.
So I think this is not a real regression. In lieu of a fix, I propose
to force push 5984905b2638df87a0262d1ee91f0a6e14a86df6 to stable-4.12.
Ian.
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [xen-4.12-testing test] 161776: regressions - FAIL
2021-05-06 16:27 ` Ian Jackson
@ 2021-05-07 8:14 ` Jan Beulich
2021-05-07 9:51 ` Ian Jackson
0 siblings, 1 reply; 4+ messages in thread
From: Jan Beulich @ 2021-05-07 8:14 UTC (permalink / raw)
To: Ian Jackson; +Cc: xen-devel, George Dunlap
On 06.05.2021 18:27, Ian Jackson wrote:
> osstest service owner writes ("[xen-4.12-testing test] 161776: regressions - FAIL"):
>> flight 161776 xen-4.12-testing real [real]
>> flight 161806 xen-4.12-testing real-retest [real]
>> http://logs.test-lab.xenproject.org/osstest/logs/161776/
>> http://logs.test-lab.xenproject.org/osstest/logs/161806/
>>
>> Regressions :-(
>>
>> Tests which did not succeed and are blocking,
>> including tests which could not be run:
>> test-amd64-amd64-xl-qcow2 19 guest-localmigrate/x10 fail REGR. vs. 159418
>
> This has been failing for 48 days.
>
> http://logs.test-lab.xenproject.org/osstest/logs/161776/test-amd64-amd64-xl-qcow2/19.ts-guest-localmigrate.log
>
> shows this:
>
> libxl: error: libxl_dom_suspend.c:377:suspend_common_wait_guest_timeout: Domain
> 6:guest did not suspend, timed out
>
> as the first thing that goes wrong. This is after the guest has
> acknowledged the suspend request.
>
> osstest tried to bisect it but was not able to reproduce the basis
> pass. That means either that we got (un)lucky with the basis pass, or
> that something not version-controlled by osstest is responsible. In
> this case I think the dom0 and domU kernels, as well as the usual
> pieces, are all properly version controlled by osstest. The non-Xen
> userland tools are not but I doubt they are the cause.
>
> So I think this is not a real regression. In lieu of a fix, I propose
> to force push 5984905b2638df87a0262d1ee91f0a6e14a86df6 to stable-4.12.
I did consider this as an option, but I don't think it's this simple.
Neither 4.11 and older nor 4.13 and newer exhibit such behavior. In
fact in 4.12 we appear to see pushes blocked now because there was a
success of this test once, in flight 159418. So while this may not
be a regression within 4.12 (and hence a force push may still be an
appropriate step), there is something wrong there with 4.12, I would
say. It being out of (general) support may of course mean we want to
leave it at that. Better, for the remaining time the branch is in
security-only maintenance state, would of course be to identify the
(presumably) missing backport ... Of course that's easy to say for
me, because I don't think I would realistically be the one to
undertake such an exercise.
Jan
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: [xen-4.12-testing test] 161776: regressions - FAIL
2021-05-07 8:14 ` Jan Beulich
@ 2021-05-07 9:51 ` Ian Jackson
0 siblings, 0 replies; 4+ messages in thread
From: Ian Jackson @ 2021-05-07 9:51 UTC (permalink / raw)
To: Jan Beulich; +Cc: xen-devel, George Dunlap
Jan Beulich writes ("Re: [xen-4.12-testing test] 161776: regressions - FAIL"):
> I did consider this as an option, but I don't think it's this simple.
> Neither 4.11 and older nor 4.13 and newer exhibit such behavior. In
> fact in 4.12 we appear to see pushes blocked now because there was a
> success of this test once, in flight 159418. So while this may not
> be a regression within 4.12 (and hence a force push may still be an
> appropriate step), there is something wrong there with 4.12, I would
> say. It being out of (general) support may of course mean we want to
> leave it at that. Better, for the remaining time the branch is in
> security-only maintenance state, would of course be to identify the
> (presumably) missing backport ... Of course that's easy to say for
> me, because I don't think I would realistically be the one to
> undertake such an exercise.
Hrm. For now I have force pushed it as I suggested.
Ian.
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2021-05-07 9:52 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-05-06 7:50 [xen-4.12-testing test] 161776: regressions - FAIL osstest service owner
2021-05-06 16:27 ` Ian Jackson
2021-05-07 8:14 ` Jan Beulich
2021-05-07 9:51 ` Ian Jackson
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).