* [linux-4.1 test] 60785: tolerable FAIL - PUSHED
@ 2015-08-21 17:24 osstest service owner
2015-09-03 8:59 ` Analysis: switch osstest default kernel from 3.14 to 4.1 (Was: Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED) Ian Campbell
2015-09-03 9:47 ` [linux-4.1 test] 60785: tolerable FAIL - PUSHED Ian Campbell
0 siblings, 2 replies; 12+ messages in thread
From: osstest service owner @ 2015-08-21 17:24 UTC (permalink / raw)
To: xen-devel, osstest-admin
[-- Warning: decoded text below may be mangled, UTF-8 assumed --]
[-- Attachment #1: Type: text/plain, Size: 24595 bytes --]
flight 60785 linux-4.1 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/60785/
Failures :-/ but no regressions.
Tests which are failing intermittently (not blocking):
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 19 guest-start/debianhvm.repeat fail in 60746 pass in 60785
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 16 guest-start/debianhvm.repeat fail pass in 60746
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail pass in 60746
Regressions which are regarded as allowable (not blocking):
test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail REGR. vs. 60654
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail blocked in 60654
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail in 60746 like 60654
test-amd64-i386-xl-xsm 14 guest-saverestore fail like 60654
test-amd64-i386-xl 14 guest-saverestore fail like 60654
test-amd64-i386-pair 21 guest-migrate/src_host/dst_host fail like 60654
test-armhf-armhf-xl-rtds 11 guest-start fail like 60654
test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail like 60654
test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail like 60654
Tests which did not succeed, but are not blocking:
test-amd64-amd64-xl-pvh-intel 14 guest-saverestore fail never pass
test-amd64-i386-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-xsm 14 guest-saverestore fail never pass
test-armhf-armhf-xl-vhd 9 debian-di-install fail never pass
test-armhf-armhf-libvirt-qcow2 9 debian-di-install fail never pass
test-amd64-i386-libvirt 14 guest-saverestore fail never pass
test-amd64-i386-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-xl-qcow2 9 debian-di-install fail never pass
test-armhf-armhf-xl-raw 9 debian-di-install fail never pass
test-armhf-armhf-libvirt-vhd 9 debian-di-install fail never pass
test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass
test-armhf-armhf-libvirt-raw 9 debian-di-install fail never pass
test-armhf-armhf-libvirt 14 guest-saverestore fail never pass
test-armhf-armhf-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-libvirt-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-libvirt-xsm 14 guest-saverestore fail never pass
test-amd64-amd64-libvirt 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-amd64-amd64-libvirt-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-xl 12 migrate-support-check fail never pass
test-armhf-armhf-xl 13 saverestore-support-check fail never pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-amd64-amd64-libvirt-raw 11 migrate-support-check fail never pass
test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-amd64-i386-libvirt-qcow2 11 migrate-support-check fail never pass
test-amd64-i386-libvirt-raw 11 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-credit2 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-armhf-armhf-xl-multivcpu 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-vhd 11 migrate-support-check fail never pass
test-amd64-i386-libvirt-vhd 11 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 12 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 13 saverestore-support-check fail never pass
test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop fail never pass
test-armhf-armhf-xl-xsm 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-xsm 12 migrate-support-check fail never pass
test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail never pass
test-amd64-amd64-libvirt-qcow2 11 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 12 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 13 saverestore-support-check fail never pass
version targeted for testing:
linux 4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
baseline version:
linux 352cb8677f83a6cf2139151578c8c79785d2d4bf
Last test of basis 60654 2015-08-10 20:42:06 Z 10 days
Testing same since 60746 2015-08-17 05:53:13 Z 4 days 2 attempts
------------------------------------------------------------
People who touched revisions under test:
Adam Williamson <awilliam@redhat.com>
Alan Stern <stern@rowland.harvard.edu>
Alex Deucher <alexander.deucher@amd.com>
Amanieu d'Antras <amanieu@gmail.com>
Anatol Pomozov <anatol.pomozov@gmail.com>
Andrew Morton <akpm@linux-foundation.org>
Andy Lutomirski <luto@kernel.org>
Arkadiusz Miśkiewicz <arekm@maven.pl>
Axel Lin <axel.lin@ingics.com>
Ben Zhang <benzh@chromium.org>
Benjamin Randazzo <benjamin@randazzo.fr>
Bjorn Helgaas <bhelgaas@google.com>
Borislav Petkov <bp@suse.de>
Brian King <brking@linux.vnet.ibm.com>
Brian Norris <computersforpeace@gmail.com>
Chris Wilson <chris@chris-wilson.co.uk>
Christoph Hellwig <hch@lst.de>
Cyrille Pitchen <cyrille.pitchen@atmel.com>
Dan Carpenter <dan.carpenter@oracle.com>
Daniel Mack <zonque@gmail.com>
Daniel Vetter <daniel.vetter@ffwll.ch>
Daniel Vetter <daniel.vetter@intel.com>
David Daney <david.daney@cavium.com>
David S. Miller <davem@davemloft.net>
David Vrabel <david.vrabel@citrix.com>
Davidlohr Bueso <dbueso@suse.de>
Denis Carikli <denis@eukrea.com>
Dirk Behme <dirk.behme@de.bosch.com>
Dmitry Torokhov <dmitry.torokhov@gmail.com>
Doug Ledford <dledford@redhat.com>
Eduardo Valentin <edubezval@gmail.com>
Fang, Yang A <yang.a.fang@intel.com>
Felipe Balbi <balbi@ti.com>
Felix Fietkau <nbd@openwrt.org>
Florian Fainelli <f.fainelli@gmail.com>
Gavin Shan <gwshan@linux.vnet.ibm.com>
Greg Kroah-Hartman <gregkh@linuxfoundation.org>
Guenter Roeck <linux@roeck-us.net>
Hans de Goede <hdegoede@redhat.com>
Herbert Xu <herbert@gondor.apana.org.au>
Hugh Dickins <hughd@google.com>
Hui Wang <hui.wang@canonical.com>
Ilya Dryomov <idryomov@gmail.com>
Ingo Molnar <mingo@kernel.org>
J. Bruce Fields <bfields@redhat.com>
James Bottomley <JBottomley@Odin.com>
James Cowgill <James.Cowgill@imgtec.com>
James Hogan <james.hogan@imgtec.com>
Jan C Peters <jcpeters89@gmail.com>
Jan Kara <jack@suse.com>
Javier Martinez Canillas <javier@osg.samsung.com>
Jeff Layton <jeff.layton@primarydata.com>
Jeff Layton <jlayton@poochiereds.net>
Joe Thornber <ejt@redhat.com>
Johan Hedberg <johan.hedberg@intel.com>
Johan Hovold <johan@kernel.org>
Johannes Oertei <johannes.oertel@uni-due.de>
Joseph Qi <joseph.qi@huawei.com>
Kalle Valo <kvalo@qca.qualcomm.com>
Kinglong Mee <kinglongmee@gmail.com>
Kishon Vijay Abraham I <kishon@ti.com>
Krzysztof Kozlowski <k.kozlowski.k@gmail.com>
Krzysztof Kozlowski <k.kozlowski@samsung.com>
Lars-Peter Clausen <lars@metafoo.de>
Leonidas Da Silva Barbosa <leosilva@linux.vnet.ibm.com>
Leonidas S. Barbosa <leosilva@linux.vnet.ibm.com>
Linus Torvalds <torvalds@linux-foundation.org>
Ludovic Desroches <ludovic.desroches@atmel.com>
Lukasz Majewski <l.majewski@samsung.com>
Malcolm Priestley <tvboxspy@gmail.com>
Marcel Holtmann <marcel@holtmann.org>
Marcus Gelderie <redmnic@gmail.com>
Marek Belisko <marek.belisko@streamunlimited.com>
Marek Marczykowski-Górecki <marmarek@invisiblethingslab.com>
Mark Brown <broonie@kernel.org>
Martin Schwidefsky <schwidefsky@de.ibm.com>
Mathias Nyman <mathias.nyman@linux.intel.com>
Michael Kerrisk <mtk.manpages@gmail.com>
Michael S. Tsirkin <mst@redhat.com>
Michael Turquette <mturquette@baylibre.com>
Michal Hocko <mhocko@suse.cz>
Michal Kazior <michal.kazior@tieto.com>
Mike Snitzer <snitzer@redhat.com>
Murali Karicheri <m-karicheri2@ti.com>
NeilBrown <neilb@suse.com>
NeilBrown <neilb@suse.de>
Nicolas Ferre <nicolas.ferre@atmel.com>
Olof Johansson <olof@lixom.net>
Pali Rohár <pali.rohar@gmail.com>
Paolo Bonzini <pbonzini@redhat.com>
Paul Walmsley <paul@pwsan.com>
Peter Chen <peter.chen@freescale.com>
Pieter Hollants <pieter@hollants.com>
Ralf Baechle <ralf@linux-mips.org>
Reinhard Speyerer <rspmn@arcor.de>
Roger Quadros <rogerq@ti.com>
Santosh Shilimkar <ssantosh@kernel.org>
Scott Wood <scottwood@freescale.com>
Shawn Guo <shawnguo@kernel.org>
Shilpa Sreeramalu <shilpa.sreeramalu@intel.com>
Tadeusz Struk <tadeusz.struk@intel.com>
Takashi Iwai <tiwai@suse.de>
Takashi Sakamoto <o-takashi@sakamocchi.jp>
Tony Lindgren <tony@atomide.com>
Vinod Koul <vinod.koul@intel.com>
Wang Kai <morgan.wang@huawei.com>
Wen Xiong <wenxiong@linux.vnet.ibm.com>
jobs:
build-amd64-xsm pass
build-armhf-xsm pass
build-i386-xsm pass
build-amd64 pass
build-armhf pass
build-i386 pass
build-amd64-libvirt pass
build-armhf-libvirt pass
build-i386-libvirt pass
build-amd64-pvops pass
build-armhf-pvops pass
build-i386-pvops pass
build-amd64-rumpuserxen pass
build-i386-rumpuserxen pass
test-amd64-amd64-xl pass
test-armhf-armhf-xl pass
test-amd64-i386-xl fail
test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm fail
test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-amd64-libvirt-xsm pass
test-armhf-armhf-libvirt-xsm fail
test-amd64-i386-libvirt-xsm fail
test-amd64-amd64-xl-xsm pass
test-armhf-armhf-xl-xsm pass
test-amd64-i386-xl-xsm fail
test-amd64-amd64-xl-pvh-amd fail
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-xl-qemut-debianhvm-amd64 pass
test-amd64-i386-xl-qemut-debianhvm-amd64 pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-freebsd10-amd64 pass
test-amd64-amd64-xl-qemuu-ovmf-amd64 pass
test-amd64-i386-xl-qemuu-ovmf-amd64 pass
test-amd64-amd64-rumpuserxen-amd64 fail
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-i386-xl-qemuu-win7-amd64 fail
test-armhf-armhf-xl-arndale pass
test-amd64-amd64-xl-credit2 pass
test-armhf-armhf-xl-credit2 pass
test-armhf-armhf-xl-cubietruck pass
test-amd64-i386-freebsd10-i386 pass
test-amd64-i386-rumpuserxen-i386 pass
test-amd64-amd64-xl-pvh-intel fail
test-amd64-i386-qemut-rhel6hvm-intel pass
test-amd64-i386-qemuu-rhel6hvm-intel pass
test-amd64-amd64-libvirt pass
test-armhf-armhf-libvirt fail
test-amd64-i386-libvirt fail
test-amd64-amd64-xl-multivcpu pass
test-armhf-armhf-xl-multivcpu pass
test-amd64-amd64-pair pass
test-amd64-i386-pair fail
test-amd64-amd64-libvirt-pair fail
test-amd64-i386-libvirt-pair fail
test-amd64-amd64-amd64-pvgrub pass
test-amd64-amd64-i386-pvgrub pass
test-amd64-amd64-pygrub pass
test-amd64-amd64-libvirt-qcow2 pass
test-armhf-armhf-libvirt-qcow2 fail
test-amd64-i386-libvirt-qcow2 pass
test-amd64-amd64-xl-qcow2 pass
test-armhf-armhf-xl-qcow2 fail
test-amd64-i386-xl-qcow2 pass
test-amd64-amd64-libvirt-raw pass
test-armhf-armhf-libvirt-raw fail
test-amd64-i386-libvirt-raw pass
test-amd64-amd64-xl-raw pass
test-armhf-armhf-xl-raw fail
test-amd64-i386-xl-raw pass
test-amd64-amd64-xl-rtds pass
test-armhf-armhf-xl-rtds fail
test-amd64-i386-xl-qemut-winxpsp3-vcpus1 pass
test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 pass
test-amd64-amd64-libvirt-vhd pass
test-armhf-armhf-libvirt-vhd fail
test-amd64-i386-libvirt-vhd pass
test-amd64-amd64-xl-vhd pass
test-armhf-armhf-xl-vhd fail
test-amd64-i386-xl-vhd pass
test-amd64-amd64-xl-qemut-winxpsp3 pass
test-amd64-i386-xl-qemut-winxpsp3 pass
test-amd64-amd64-xl-qemuu-winxpsp3 pass
test-amd64-i386-xl-qemuu-winxpsp3 pass
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
Pushing revision :
+ branch=linux-4.1
+ revision=4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
+ . cri-lock-repos
++ . cri-common
+++ . cri-getconfig
+++ umask 002
+++ getrepos
++++ getconfig Repos
++++ perl -e '
use Osstest;
readglobalconfig();
print $c{"Repos"} or die $!;
'
+++ local repos=/home/osstest/repos
+++ '[' -z /home/osstest/repos ']'
+++ '[' '!' -d /home/osstest/repos ']'
+++ echo /home/osstest/repos
++ repos=/home/osstest/repos
++ repos_lock=/home/osstest/repos/lock
++ '[' x '!=' x/home/osstest/repos/lock ']'
++ OSSTEST_REPOS_LOCK_LOCKED=/home/osstest/repos/lock
++ exec with-lock-ex -w /home/osstest/repos/lock ./ap-push linux-4.1 4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
+ branch=linux-4.1
+ revision=4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
+ . cri-lock-repos
++ . cri-common
+++ . cri-getconfig
+++ umask 002
+++ getrepos
++++ getconfig Repos
++++ perl -e '
use Osstest;
readglobalconfig();
print $c{"Repos"} or die $!;
'
+++ local repos=/home/osstest/repos
+++ '[' -z /home/osstest/repos ']'
+++ '[' '!' -d /home/osstest/repos ']'
+++ echo /home/osstest/repos
++ repos=/home/osstest/repos
++ repos_lock=/home/osstest/repos/lock
++ '[' x/home/osstest/repos/lock '!=' x/home/osstest/repos/lock ']'
+ . cri-common
++ . cri-getconfig
++ umask 002
+ select_xenbranch
+ case "$branch" in
+ tree=linux
+ xenbranch=xen-unstable
+ '[' xlinux = xlinux ']'
+ linuxbranch=linux-4.1
+ '[' x = x ']'
+ qemuubranch=qemu-upstream-unstable
+ select_prevxenbranch
+ local b
+ local p
++ ./mg-list-all-branches
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.0-testing = xxen-unstable ']'
+ p=xen-4.0-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.1-testing = xxen-unstable ']'
+ p=xen-4.1-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.2-testing = xxen-unstable ']'
+ p=xen-4.2-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.3-testing = xxen-unstable ']'
+ p=xen-4.3-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.4-testing = xxen-unstable ']'
+ p=xen-4.4-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-4.5-testing = xxen-unstable ']'
+ p=xen-4.5-testing
+ for b in '$(./mg-list-all-branches)'
+ case "$b" in
+ '[' xxen-unstable = xxen-unstable ']'
+ break
+ prevxenbranch=xen-4.5-testing
+ : tested/2.6.39.x
+ . ap-common
++ : osstest@xenbits.xen.org
+++ getconfig OsstestUpstream
+++ perl -e '
use Osstest;
readglobalconfig();
print $c{"OsstestUpstream"} or die $!;
'
++ :
++ : git://xenbits.xen.org/xen.git
++ : osstest@xenbits.xen.org:/home/xen/git/xen.git
++ : git://xenbits.xen.org/staging/qemu-xen-unstable.git
++ : git://git.kernel.org
++ : git://git.kernel.org/pub/scm/linux/kernel/git
++ : git
++ : git://xenbits.xen.org/libvirt.git
++ : osstest@xenbits.xen.org:/home/xen/git/libvirt.git
++ : git://xenbits.xen.org/libvirt.git
++ : git://xenbits.xen.org/rumpuser-xen.git
++ : git
++ : git://xenbits.xen.org/rumpuser-xen.git
++ : osstest@xenbits.xen.org:/home/xen/git/rumpuser-xen.git
+++ besteffort_repo https://github.com/rumpkernel/rumpkernel-netbsd-src
+++ local repo=https://github.com/rumpkernel/rumpkernel-netbsd-src
+++ cached_repo https://github.com/rumpkernel/rumpkernel-netbsd-src '[fetch=try]'
+++ local repo=https://github.com/rumpkernel/rumpkernel-netbsd-src
+++ local 'options=[fetch=try]'
++++ getconfig GitCacheProxy
++++ perl -e '
use Osstest;
readglobalconfig();
print $c{"GitCacheProxy"} or die $!;
'
+++ local cache=git://cache:9419/
+++ '[' xgit://cache:9419/ '!=' x ']'
+++ echo 'git://cache:9419/https://github.com/rumpkernel/rumpkernel-netbsd-src%20[fetch=try]'
++ : 'git://cache:9419/https://github.com/rumpkernel/rumpkernel-netbsd-src%20[fetch=try]'
++ : git
++ : git://git.seabios.org/seabios.git
++ : osstest@xenbits.xen.org:/home/xen/git/osstest/seabios.git
++ : git://xenbits.xen.org/osstest/seabios.git
++ : https://github.com/tianocore/edk2.git
++ : osstest@xenbits.xen.org:/home/xen/git/osstest/ovmf.git
++ : git://xenbits.xen.org/osstest/ovmf.git
++ : git://xenbits.xen.org/osstest/linux-firmware.git
++ : osstest@xenbits.xen.org:/home/osstest/ext/linux-firmware.git
++ : git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git
++ : osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
++ : git://xenbits.xen.org/linux-pvops.git
++ : tested/linux-3.14
++ : tested/linux-arm-xen
++ '[' xgit://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git = x ']'
++ '[' xgit://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git = x ']'
++ : git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git
++ : tested/2.6.39.x
++ : daily-cron.linux-4.1
++ : daily-cron.linux-4.1
++ : daily-cron.linux-4.1
++ : daily-cron.linux-4.1
++ : daily-cron.linux-4.1
++ : daily-cron.linux-4.1
++ : http://hg.uk.xensource.com/carbon/trunk/linux-2.6.27
++ : git://xenbits.xen.org/staging/qemu-upstream-unstable.git
++ : daily-cron.linux-4.1
++ : git://git.qemu.org/qemu.git
++ : git://xenbits.xen.org/osstest/qemu.git
++ : osstest@xenbits.xen.org:/home/xen/git/osstest/qemu.git
++ : daily-cron.linux-4.1
+ TREE_LINUX=osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
+ TREE_QEMU_MAINLINE=osstest@xenbits.xen.org:/home/xen/git/osstest/qemu.git
+ TREE_QEMU_UPSTREAM=osstest@xenbits.xen.org:/home/xen/git/qemu-upstream-unstable.git
+ TREE_XEN=osstest@xenbits.xen.org:/home/xen/git/xen.git
+ TREE_LIBVIRT=osstest@xenbits.xen.org:/home/xen/git/libvirt.git
+ TREE_RUMPUSERXEN=osstest@xenbits.xen.org:/home/xen/git/rumpuser-xen.git
+ TREE_SEABIOS=osstest@xenbits.xen.org:/home/xen/git/osstest/seabios.git
+ TREE_OVMF=osstest@xenbits.xen.org:/home/xen/git/osstest/ovmf.git
+ info_linux_tree linux-4.1
+ case $1 in
+ : git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git
+ : linux-4.1.y
+ : linux-4.1.y
+ : git
+ : git
+ : git://xenbits.xen.org/linux-pvops.git
+ : osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
+ : tested/linux-4.1
+ : refs/heads/tested/linux-4.1
+ return 0
+ cd /home/osstest/repos/linux
+ git push osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git 4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc:refs/heads/tested/linux-4.1
To osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
352cb86..4ff62ca 4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc -> tested/linux-4.1
+ exit 0
[-- Attachment #2: Type: text/plain, Size: 126 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 12+ messages in thread
* Analysis: switch osstest default kernel from 3.14 to 4.1 (Was: Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED)
2015-08-21 17:24 [linux-4.1 test] 60785: tolerable FAIL - PUSHED osstest service owner
@ 2015-09-03 8:59 ` Ian Campbell
2015-09-21 12:47 ` Ian Campbell
2015-09-03 9:47 ` [linux-4.1 test] 60785: tolerable FAIL - PUSHED Ian Campbell
1 sibling, 1 reply; 12+ messages in thread
From: Ian Campbell @ 2015-09-03 8:59 UTC (permalink / raw)
To: osstest service owner, xen-devel
[-- Attachment #1: Type: text/plain, Size: 32430 bytes --]
TL;DR: There are issues which need fixing first...
On Fri, 2015-08-21 at 17:24 +0000, osstest service owner wrote:
> flight 60785 linux-4.1 real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/60785/
>
> Failures :-/ but no regressions.
>
> Tests which are failing intermittently (not blocking):
> test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 19 guest-start/debianhvm.repeat fail in 60746 pass in 60785
> test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 16 guest-start/debianhvm.repeat fail pass in 60746
> test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail pass in 60746
I've been considering updating osstest to switch from the current baseline
kernel (the one used for all non linux-* tests) from 3.14 to 4.1.
The last pass on 3.14 was 60666[0] a little while ago on 13/8 (due to a
known issue[1]). As well as this pass of 4.1 today I therefore also
considered 60654[2] on 12/8. Two reports (like this one) are attached
comparing 3.16:60666 against 4.1:60654 and 4.1:60795 respectively.
Both reports have these in common:
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-i386-pair 21 guest-migrate/src_host/dst_host fail REGR. vs. 60666
test-amd64-i386-xl-xsm 14 guest-saverestore fail REGR. vs. 60666
test-amd64-i386-xl 14 guest-saverestore fail REGR. vs. 60666
While the more recent one also adds two more:
Tests which did not succeed and are blocking,
including tests which could not be run:
[...]
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail REGR. vs. 60666
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 16 guest-start/debianhvm.repeat fail REGR. vs. 60666
[...]
The relevant long term histories of each these jobs on the relevant
branches are (also included is the Linus branch for "most recent":
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-pair/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-pair/linux-4.1.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-pair/linux-linus.html
* 4.1 and Linux have been failing since late July, both sticky to
elbling*.
* 3.14 is passing, including a few passes in August on elbling*
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-xl-xsm/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-xl-xsm/linux-4.1.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-xl-xsm/linux-linus.html
* Linus is hard to say, since there are some xen-boot fails in there,
but it has been failing guest-saverestore since late July on
elbling*
* 4.1 failing on italia0 since late July
* 3.14 regularly passing since early June, some recent passes on
elbling* but not attempts on italia0
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-xl/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-xl/linux-4.1.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-xl/linux-linus.html
* Linus is hard to say, since there are some xen-boot fails in there,
but it has been failing guest-saverestore since late July on
italia0*
* 4.1 failing on fiano0 since late July
* 3.14 regularly passing since forever, some recent passes on fiano0
and italia0.
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm/linux-4.1.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm/linux-linus.html
* Linus is hard to say, since there are some xen-boot fails in there,
but it has been failing guest-localmigrate since late July on
merlot1
* 4.1 has been passing until the very last attempt, which touched
merlot1 and failed. I expect this will now be a sticky failure on
merlot1.
* 3.14 regularly failing since late June on merlot0, including on
60666
This looks like a regression between 60666 and 60785 because the former
failed guest-localmigrate.2 while the later failed guest-localmigrate
(which 60666 must have therefore passed).
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm/linux-4.1.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm/linux-linus.html
* Linus looks to mostly pass (a few recent glitches on italia1, but a
pass since).
* 4.1 only has 3 results, 2 passes and the most recent fail on
huxelrebe0
* 3.14 seems to mostly pass.
I think it is pretty clear from the above that we shouldn't be switching to
4.1 just yet.
test-amd64-i386-pair, test-amd64-i386-xl-xsm and test-amd64-i386-xl look
like they ought to be bisectable.
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm looks like the "WTF
is us with merlot*" issue :-(
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm doesn't really have
enough data to go on yet.
For the potentially bisectable ones:
http://logs.test-lab.xenproject.org/osstest/results/bisect/linux-4.1/test-amd64-i386-pair.guest-migrate--src_host--dst_host.html
Seems to have gotten close to blaming something then (from the
timestamps in the apache index) given up towards the end of July.
http://logs.test-lab.xenproject.org/osstest/results/bisect/linux-4.1/test-amd64-i386-xl-xsm.guest-saverestore.html
=> http://lists.xen.org/archives/html/xen-devel/2015-07/msg04798.html
http://logs.test-lab.xenproject.org/osstest/results/bisect/linux-4.1/test-amd64-i386-xl.guest-saverestore.html
=> http://lists.xen.org/archives/html/xen-devel/2015-07/msg05158.html
Both of which are blaming 3a9ace0147d4 "tools/libxc+libxl+xl: Restore v2
streams". That's also within the range of the first incomplete bisect, so I
expect that is the same issue.
Ian.
[0] http://logs.test-lab.xenproject.org/osstest/logs/60666/
http://lists.xen.org/archives/html/xen-devel/2015-09/msg00304.html
[1] http://lists.xen.org/archives/html/xen-devel/2015-09/msg00161.html
[2] http://logs.test-lab.xenproject.org/osstest/logs/60654/
http://lists.xen.org/archives/html/xen-devel/2015-09/msg00303.html
>
> Regressions which are regarded as allowable (not blocking):
> test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail REGR. vs. 60654
> test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail blocked in 60654
> test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail in 60746 like 60654
> test-amd64-i386-xl-xsm 14 guest-saverestore fail like 60654
> test-amd64-i386-xl 14 guest-saverestore fail like 60654
> test-amd64-i386-pair 21 guest-migrate/src_host/dst_host fail like 60654
> test-armhf-armhf-xl-rtds 11 guest-start fail like 60654
> test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail like 60654
> test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail like 60654
>
> Tests which did not succeed, but are not blocking:
> test-amd64-amd64-xl-pvh-intel 14 guest-saverestore fail never pass
> test-amd64-i386-libvirt-xsm 12 migrate-support-check fail never pass
> test-amd64-i386-libvirt-xsm 14 guest-saverestore fail never pass
> test-armhf-armhf-xl-vhd 9 debian-di-install fail never pass
> test-armhf-armhf-libvirt-qcow2 9 debian-di-install fail never pass
> test-amd64-i386-libvirt 14 guest-saverestore fail never pass
> test-amd64-i386-libvirt 12 migrate-support-check fail never pass
> test-armhf-armhf-xl-qcow2 9 debian-di-install fail never pass
> test-armhf-armhf-xl-raw 9 debian-di-install fail never pass
> test-armhf-armhf-libvirt-vhd 9 debian-di-install fail never pass
> test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass
> test-armhf-armhf-libvirt-raw 9 debian-di-install fail never pass
> test-armhf-armhf-libvirt 14 guest-saverestore fail never pass
> test-armhf-armhf-libvirt 12 migrate-support-check fail never pass
> test-armhf-armhf-libvirt-xsm 12 migrate-support-check fail never pass
> test-armhf-armhf-libvirt-xsm 14 guest-saverestore fail never pass
> test-amd64-amd64-libvirt 12 migrate-support-check fail never pass
> test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
> test-amd64-amd64-libvirt-xsm 12 migrate-support-check fail never pass
> test-armhf-armhf-xl 12 migrate-support-check fail never pass
> test-armhf-armhf-xl 13 saverestore-support-check fail never pass
> test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
> test-amd64-amd64-libvirt-raw 11 migrate-support-check fail never pass
> test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
> test-amd64-i386-libvirt-qcow2 11 migrate-support-check fail never pass
> test-amd64-i386-libvirt-raw 11 migrate-support-check fail never pass
> test-armhf-armhf-xl-credit2 13 saverestore-support-check fail never pass
> test-armhf-armhf-xl-credit2 12 migrate-support-check fail never pass
> test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
> test-armhf-armhf-xl-multivcpu 13 saverestore-support-check fail never pass
> test-armhf-armhf-xl-multivcpu 12 migrate-support-check fail never pass
> test-amd64-amd64-libvirt-vhd 11 migrate-support-check fail never pass
> test-amd64-i386-libvirt-vhd 11 migrate-support-check fail never pass
> test-armhf-armhf-xl-cubietruck 12 migrate-support-check fail never pass
> test-armhf-armhf-xl-cubietruck 13 saverestore-support-check fail never pass
> test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop fail never pass
> test-armhf-armhf-xl-xsm 13 saverestore-support-check fail never pass
> test-armhf-armhf-xl-xsm 12 migrate-support-check fail never pass
> test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail never pass
> test-amd64-amd64-libvirt-qcow2 11 migrate-support-check fail never pass
> test-armhf-armhf-xl-arndale 12 migrate-support-check fail never pass
> test-armhf-armhf-xl-arndale 13 saverestore-support-check fail never pass
>
> version targeted for testing:
> linux 4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
> baseline version:
> linux 352cb8677f83a6cf2139151578c8c79785d2d4bf
>
> Last test of basis 60654 2015-08-10 20:42:06 Z 10 days
> Testing same since 60746 2015-08-17 05:53:13 Z 4 days 2 attempts
>
> ------------------------------------------------------------
> People who touched revisions under test:
> Adam Williamson <awilliam@redhat.com>
> Alan Stern <stern@rowland.harvard.edu>
> Alex Deucher <alexander.deucher@amd.com>
> Amanieu d'Antras <amanieu@gmail.com>
> Anatol Pomozov <anatol.pomozov@gmail.com>
> Andrew Morton <akpm@linux-foundation.org>
> Andy Lutomirski <luto@kernel.org>
> Arkadiusz Miśkiewicz <arekm@maven.pl>
> Axel Lin <axel.lin@ingics.com>
> Ben Zhang <benzh@chromium.org>
> Benjamin Randazzo <benjamin@randazzo.fr>
> Bjorn Helgaas <bhelgaas@google.com>
> Borislav Petkov <bp@suse.de>
> Brian King <brking@linux.vnet.ibm.com>
> Brian Norris <computersforpeace@gmail.com>
> Chris Wilson <chris@chris-wilson.co.uk>
> Christoph Hellwig <hch@lst.de>
> Cyrille Pitchen <cyrille.pitchen@atmel.com>
> Dan Carpenter <dan.carpenter@oracle.com>
> Daniel Mack <zonque@gmail.com>
> Daniel Vetter <daniel.vetter@ffwll.ch>
> Daniel Vetter <daniel.vetter@intel.com>
> David Daney <david.daney@cavium.com>
> David S. Miller <davem@davemloft.net>
> David Vrabel <david.vrabel@citrix.com>
> Davidlohr Bueso <dbueso@suse.de>
> Denis Carikli <denis@eukrea.com>
> Dirk Behme <dirk.behme@de.bosch.com>
> Dmitry Torokhov <dmitry.torokhov@gmail.com>
> Doug Ledford <dledford@redhat.com>
> Eduardo Valentin <edubezval@gmail.com>
> Fang, Yang A <yang.a.fang@intel.com>
> Felipe Balbi <balbi@ti.com>
> Felix Fietkau <nbd@openwrt.org>
> Florian Fainelli <f.fainelli@gmail.com>
> Gavin Shan <gwshan@linux.vnet.ibm.com>
> Greg Kroah-Hartman <gregkh@linuxfoundation.org>
> Guenter Roeck <linux@roeck-us.net>
> Hans de Goede <hdegoede@redhat.com>
> Herbert Xu <herbert@gondor.apana.org.au>
> Hugh Dickins <hughd@google.com>
> Hui Wang <hui.wang@canonical.com>
> Ilya Dryomov <idryomov@gmail.com>
> Ingo Molnar <mingo@kernel.org>
> J. Bruce Fields <bfields@redhat.com>
> James Bottomley <JBottomley@Odin.com>
> James Cowgill <James.Cowgill@imgtec.com>
> James Hogan <james.hogan@imgtec.com>
> Jan C Peters <jcpeters89@gmail.com>
> Jan Kara <jack@suse.com>
> Javier Martinez Canillas <javier@osg.samsung.com>
> Jeff Layton <jeff.layton@primarydata.com>
> Jeff Layton <jlayton@poochiereds.net>
> Joe Thornber <ejt@redhat.com>
> Johan Hedberg <johan.hedberg@intel.com>
> Johan Hovold <johan@kernel.org>
> Johannes Oertei <johannes.oertel@uni-due.de>
> Joseph Qi <joseph.qi@huawei.com>
> Kalle Valo <kvalo@qca.qualcomm.com>
> Kinglong Mee <kinglongmee@gmail.com>
> Kishon Vijay Abraham I <kishon@ti.com>
> Krzysztof Kozlowski <k.kozlowski.k@gmail.com>
> Krzysztof Kozlowski <k.kozlowski@samsung.com>
> Lars-Peter Clausen <lars@metafoo.de>
> Leonidas Da Silva Barbosa <leosilva@linux.vnet.ibm.com>
> Leonidas S. Barbosa <leosilva@linux.vnet.ibm.com>
> Linus Torvalds <torvalds@linux-foundation.org>
> Ludovic Desroches <ludovic.desroches@atmel.com>
> Lukasz Majewski <l.majewski@samsung.com>
> Malcolm Priestley <tvboxspy@gmail.com>
> Marcel Holtmann <marcel@holtmann.org>
> Marcus Gelderie <redmnic@gmail.com>
> Marek Belisko <marek.belisko@streamunlimited.com>
> Marek Marczykowski-Górecki <marmarek@invisiblethingslab.com>
> Mark Brown <broonie@kernel.org>
> Martin Schwidefsky <schwidefsky@de.ibm.com>
> Mathias Nyman <mathias.nyman@linux.intel.com>
> Michael Kerrisk <mtk.manpages@gmail.com>
> Michael S. Tsirkin <mst@redhat.com>
> Michael Turquette <mturquette@baylibre.com>
> Michal Hocko <mhocko@suse.cz>
> Michal Kazior <michal.kazior@tieto.com>
> Mike Snitzer <snitzer@redhat.com>
> Murali Karicheri <m-karicheri2@ti.com>
> NeilBrown <neilb@suse.com>
> NeilBrown <neilb@suse.de>
> Nicolas Ferre <nicolas.ferre@atmel.com>
> Olof Johansson <olof@lixom.net>
> Pali Rohár <pali.rohar@gmail.com>
> Paolo Bonzini <pbonzini@redhat.com>
> Paul Walmsley <paul@pwsan.com>
> Peter Chen <peter.chen@freescale.com>
> Pieter Hollants <pieter@hollants.com>
> Ralf Baechle <ralf@linux-mips.org>
> Reinhard Speyerer <rspmn@arcor.de>
> Roger Quadros <rogerq@ti.com>
> Santosh Shilimkar <ssantosh@kernel.org>
> Scott Wood <scottwood@freescale.com>
> Shawn Guo <shawnguo@kernel.org>
> Shilpa Sreeramalu <shilpa.sreeramalu@intel.com>
> Tadeusz Struk <tadeusz.struk@intel.com>
> Takashi Iwai <tiwai@suse.de>
> Takashi Sakamoto <o-takashi@sakamocchi.jp>
> Tony Lindgren <tony@atomide.com>
> Vinod Koul <vinod.koul@intel.com>
> Wang Kai <morgan.wang@huawei.com>
> Wen Xiong <wenxiong@linux.vnet.ibm.com>
>
> jobs:
> build-amd64-xsm pass
> build-armhf-xsm pass
> build-i386-xsm pass
> build-amd64 pass
> build-armhf pass
> build-i386 pass
> build-amd64-libvirt pass
> build-armhf-libvirt pass
> build-i386-libvirt pass
> build-amd64-pvops pass
> build-armhf-pvops pass
> build-i386-pvops pass
> build-amd64-rumpuserxen pass
> build-i386-rumpuserxen pass
> test-amd64-amd64-xl pass
> test-armhf-armhf-xl pass
> test-amd64-i386-xl fail
> test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm pass
> test-amd64-i386-xl-qemut-debianhvm-amd64-xsm pass
> test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
> test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm fail
> test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm pass
> test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm pass
> test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm fail
> test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm fail
> test-amd64-amd64-libvirt-xsm pass
> test-armhf-armhf-libvirt-xsm fail
> test-amd64-i386-libvirt-xsm fail
> test-amd64-amd64-xl-xsm pass
> test-armhf-armhf-xl-xsm pass
> test-amd64-i386-xl-xsm fail
> test-amd64-amd64-xl-pvh-amd fail
> test-amd64-i386-qemut-rhel6hvm-amd pass
> test-amd64-i386-qemuu-rhel6hvm-amd pass
> test-amd64-amd64-xl-qemut-debianhvm-amd64 pass
> test-amd64-i386-xl-qemut-debianhvm-amd64 pass
> test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
> test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
> test-amd64-i386-freebsd10-amd64 pass
> test-amd64-amd64-xl-qemuu-ovmf-amd64 pass
> test-amd64-i386-xl-qemuu-ovmf-amd64 pass
> test-amd64-amd64-rumpuserxen-amd64 fail
> test-amd64-amd64-xl-qemut-win7-amd64 fail
> test-amd64-i386-xl-qemut-win7-amd64 fail
> test-amd64-amd64-xl-qemuu-win7-amd64 fail
> test-amd64-i386-xl-qemuu-win7-amd64 fail
> test-armhf-armhf-xl-arndale pass
> test-amd64-amd64-xl-credit2 pass
> test-armhf-armhf-xl-credit2 pass
> test-armhf-armhf-xl-cubietruck pass
> test-amd64-i386-freebsd10-i386 pass
> test-amd64-i386-rumpuserxen-i386 pass
> test-amd64-amd64-xl-pvh-intel fail
> test-amd64-i386-qemut-rhel6hvm-intel pass
> test-amd64-i386-qemuu-rhel6hvm-intel pass
> test-amd64-amd64-libvirt pass
> test-armhf-armhf-libvirt fail
> test-amd64-i386-libvirt fail
> test-amd64-amd64-xl-multivcpu pass
> test-armhf-armhf-xl-multivcpu pass
> test-amd64-amd64-pair pass
> test-amd64-i386-pair fail
> test-amd64-amd64-libvirt-pair fail
> test-amd64-i386-libvirt-pair fail
> test-amd64-amd64-amd64-pvgrub pass
> test-amd64-amd64-i386-pvgrub pass
> test-amd64-amd64-pygrub pass
> test-amd64-amd64-libvirt-qcow2 pass
> test-armhf-armhf-libvirt-qcow2 fail
> test-amd64-i386-libvirt-qcow2 pass
> test-amd64-amd64-xl-qcow2 pass
> test-armhf-armhf-xl-qcow2 fail
> test-amd64-i386-xl-qcow2 pass
> test-amd64-amd64-libvirt-raw pass
> test-armhf-armhf-libvirt-raw fail
> test-amd64-i386-libvirt-raw pass
> test-amd64-amd64-xl-raw pass
> test-armhf-armhf-xl-raw fail
> test-amd64-i386-xl-raw pass
> test-amd64-amd64-xl-rtds pass
> test-armhf-armhf-xl-rtds fail
> test-amd64-i386-xl-qemut-winxpsp3-vcpus1 pass
> test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 pass
> test-amd64-amd64-libvirt-vhd pass
> test-armhf-armhf-libvirt-vhd fail
> test-amd64-i386-libvirt-vhd pass
> test-amd64-amd64-xl-vhd pass
> test-armhf-armhf-xl-vhd fail
> test-amd64-i386-xl-vhd pass
> test-amd64-amd64-xl-qemut-winxpsp3 pass
> test-amd64-i386-xl-qemut-winxpsp3 pass
> test-amd64-amd64-xl-qemuu-winxpsp3 pass
> test-amd64-i386-xl-qemuu-winxpsp3 pass
>
>
> ------------------------------------------------------------
> sg-report-flight on osstest.test-lab.xenproject.org
> logs: /home/logs/logs
> images: /home/logs/images
>
> Logs, config files, etc. are available at
> http://logs.test-lab.xenproject.org/osstest/logs
>
> Explanation of these reports, and of osstest in general, is at
> http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
> http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
>
> Test harness code can be found at
> http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
>
>
> Pushing revision :
>
> + branch=linux-4.1
> + revision=4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
> + . cri-lock-repos
> ++ . cri-common
> +++ . cri-getconfig
> +++ umask 002
> +++ getrepos
> ++++ getconfig Repos
> ++++ perl -e '
> use Osstest;
> readglobalconfig();
> print $c{"Repos"} or die $!;
> '
> +++ local repos=/home/osstest/repos
> +++ '[' -z /home/osstest/repos ']'
> +++ '[' '!' -d /home/osstest/repos ']'
> +++ echo /home/osstest/repos
> ++ repos=/home/osstest/repos
> ++ repos_lock=/home/osstest/repos/lock
> ++ '[' x '!=' x/home/osstest/repos/lock ']'
> ++ OSSTEST_REPOS_LOCK_LOCKED=/home/osstest/repos/lock
> ++ exec with-lock-ex -w /home/osstest/repos/lock ./ap-push linux-4.1 4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
> + branch=linux-4.1
> + revision=4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc
> + . cri-lock-repos
> ++ . cri-common
> +++ . cri-getconfig
> +++ umask 002
> +++ getrepos
> ++++ getconfig Repos
> ++++ perl -e '
> use Osstest;
> readglobalconfig();
> print $c{"Repos"} or die $!;
> '
> +++ local repos=/home/osstest/repos
> +++ '[' -z /home/osstest/repos ']'
> +++ '[' '!' -d /home/osstest/repos ']'
> +++ echo /home/osstest/repos
> ++ repos=/home/osstest/repos
> ++ repos_lock=/home/osstest/repos/lock
> ++ '[' x/home/osstest/repos/lock '!=' x/home/osstest/repos/lock ']'
> + . cri-common
> ++ . cri-getconfig
> ++ umask 002
> + select_xenbranch
> + case "$branch" in
> + tree=linux
> + xenbranch=xen-unstable
> + '[' xlinux = xlinux ']'
> + linuxbranch=linux-4.1
> + '[' x = x ']'
> + qemuubranch=qemu-upstream-unstable
> + select_prevxenbranch
> + local b
> + local p
> ++ ./mg-list-all-branches
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-4.0-testing = xxen-unstable ']'
> + p=xen-4.0-testing
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-4.1-testing = xxen-unstable ']'
> + p=xen-4.1-testing
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-4.2-testing = xxen-unstable ']'
> + p=xen-4.2-testing
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-4.3-testing = xxen-unstable ']'
> + p=xen-4.3-testing
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-4.4-testing = xxen-unstable ']'
> + p=xen-4.4-testing
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-4.5-testing = xxen-unstable ']'
> + p=xen-4.5-testing
> + for b in '$(./mg-list-all-branches)'
> + case "$b" in
> + '[' xxen-unstable = xxen-unstable ']'
> + break
> + prevxenbranch=xen-4.5-testing
> + : tested/2.6.39.x
> + . ap-common
> ++ : osstest@xenbits.xen.org
> +++ getconfig OsstestUpstream
> +++ perl -e '
> use Osstest;
> readglobalconfig();
> print $c{"OsstestUpstream"} or die $!;
> '
> ++ :
> ++ : git://xenbits.xen.org/xen.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/xen.git
> ++ : git://xenbits.xen.org/staging/qemu-xen-unstable.git
> ++ : git://git.kernel.org
> ++ : git://git.kernel.org/pub/scm/linux/kernel/git
> ++ : git
> ++ : git://xenbits.xen.org/libvirt.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/libvirt.git
> ++ : git://xenbits.xen.org/libvirt.git
> ++ : git://xenbits.xen.org/rumpuser-xen.git
> ++ : git
> ++ : git://xenbits.xen.org/rumpuser-xen.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/rumpuser-xen.git
> +++ besteffort_repo https://github.com/rumpkernel/rumpkernel-netbsd-src
> +++ local repo=https://github.com/rumpkernel/rumpkernel-netbsd-src
> +++ cached_repo https://github.com/rumpkernel/rumpkernel-netbsd-src '[fetch=try]'
> +++ local repo=https://github.com/rumpkernel/rumpkernel-netbsd-src
> +++ local 'options=[fetch=try]'
> ++++ getconfig GitCacheProxy
> ++++ perl -e '
> use Osstest;
> readglobalconfig();
> print $c{"GitCacheProxy"} or die $!;
> '
> +++ local cache=git://cache:9419/
> +++ '[' xgit://cache:9419/ '!=' x ']'
> +++ echo 'git://cache:9419/https://github.com/rumpkernel/rumpkernel-netbsd-src%20[fetch=try]'
> ++ : 'git://cache:9419/https://github.com/rumpkernel/rumpkernel-netbsd-src%20[fetch=try]'
> ++ : git
> ++ : git://git.seabios.org/seabios.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/osstest/seabios.git
> ++ : git://xenbits.xen.org/osstest/seabios.git
> ++ : https://github.com/tianocore/edk2.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/osstest/ovmf.git
> ++ : git://xenbits.xen.org/osstest/ovmf.git
> ++ : git://xenbits.xen.org/osstest/linux-firmware.git
> ++ : osstest@xenbits.xen.org:/home/osstest/ext/linux-firmware.git
> ++ : git://git.kernel.org/pub/scm/linux/kernel/git/firmware/linux-firmware.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
> ++ : git://xenbits.xen.org/linux-pvops.git
> ++ : tested/linux-3.14
> ++ : tested/linux-arm-xen
> ++ '[' xgit://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git = x ']'
> ++ '[' xgit://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git = x ']'
> ++ : git://git.kernel.org/pub/scm/linux/kernel/git/konrad/xen.git
> ++ : tested/2.6.39.x
> ++ : daily-cron.linux-4.1
> ++ : daily-cron.linux-4.1
> ++ : daily-cron.linux-4.1
> ++ : daily-cron.linux-4.1
> ++ : daily-cron.linux-4.1
> ++ : daily-cron.linux-4.1
> ++ : http://hg.uk.xensource.com/carbon/trunk/linux-2.6.27
> ++ : git://xenbits.xen.org/staging/qemu-upstream-unstable.git
> ++ : daily-cron.linux-4.1
> ++ : git://git.qemu.org/qemu.git
> ++ : git://xenbits.xen.org/osstest/qemu.git
> ++ : osstest@xenbits.xen.org:/home/xen/git/osstest/qemu.git
> ++ : daily-cron.linux-4.1
> + TREE_LINUX=osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
> + TREE_QEMU_MAINLINE=osstest@xenbits.xen.org:/home/xen/git/osstest/qemu.git
> + TREE_QEMU_UPSTREAM=osstest@xenbits.xen.org:/home/xen/git/qemu-upstream-unstable.git
> + TREE_XEN=osstest@xenbits.xen.org:/home/xen/git/xen.git
> + TREE_LIBVIRT=osstest@xenbits.xen.org:/home/xen/git/libvirt.git
> + TREE_RUMPUSERXEN=osstest@xenbits.xen.org:/home/xen/git/rumpuser-xen.git
> + TREE_SEABIOS=osstest@xenbits.xen.org:/home/xen/git/osstest/seabios.git
> + TREE_OVMF=osstest@xenbits.xen.org:/home/xen/git/osstest/ovmf.git
> + info_linux_tree linux-4.1
> + case $1 in
> + : git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git
> + : linux-4.1.y
> + : linux-4.1.y
> + : git
> + : git
> + : git://xenbits.xen.org/linux-pvops.git
> + : osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
> + : tested/linux-4.1
> + : refs/heads/tested/linux-4.1
> + return 0
> + cd /home/osstest/repos/linux
> + git push osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git 4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc:refs/heads/tested/linux-4.1
> To osstest@xenbits.xen.org:/home/xen/git/linux-pvops.git
> 352cb86..4ff62ca 4ff62ca06c0c0b084f585f7a2cfcf832b21d94fc -> tested/linux-4.1
> + exit 0
[-- Attachment #2: 3.14:60666-vs-4.1:60654 --]
[-- Type: text/plain, Size: 11531 bytes --]
60654: regressions - FAIL
flight 60654 linux-4.1 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/60654/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-i386-pair 21 guest-migrate/src_host/dst_host fail REGR. vs. 60666
test-amd64-i386-xl-xsm 14 guest-saverestore fail REGR. vs. 60666
test-amd64-i386-xl 14 guest-saverestore fail REGR. vs. 60666
Regressions which are regarded as allowable (not blocking):
test-armhf-armhf-xl-rtds 11 guest-start fail blocked in 60666
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail blocked in 60666
test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail like 60666
test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail like 60666
test-armhf-armhf-libvirt-vhd 6 xen-boot fail like 60666
Tests which did not succeed, but are not blocking:
test-armhf-armhf-xl-raw 9 debian-di-install fail never pass
test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-armhf-armhf-libvirt-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-xl-xsm 13 saverestore-support-check fail never pass
test-amd64-i386-libvirt-qcow2 11 migrate-support-check fail never pass
test-armhf-armhf-libvirt-qcow2 9 debian-di-install fail never pass
test-armhf-armhf-xl-cubietruck 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 13 saverestore-support-check fail never pass
test-amd64-i386-libvirt-raw 11 migrate-support-check fail never pass
test-armhf-armhf-libvirt-raw 9 debian-di-install fail never pass
test-armhf-armhf-libvirt 14 guest-saverestore fail never pass
test-armhf-armhf-xl-cubietruck 13 saverestore-support-check fail never pass
test-amd64-i386-libvirt-vhd 11 migrate-support-check fail never pass
test-amd64-i386-libvirt 14 guest-saverestore fail never pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-armhf-armhf-xl 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-vhd 11 migrate-support-check fail never pass
test-armhf-armhf-xl-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-raw 11 migrate-support-check fail never pass
test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop fail never pass
test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail never pass
test-amd64-i386-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-xl 13 saverestore-support-check fail never pass
test-armhf-armhf-libvirt-xsm 14 guest-saverestore fail never pass
test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass
test-armhf-armhf-xl-multivcpu 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-arndale 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-qcow2 11 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-xsm 14 guest-saverestore fail never pass
test-armhf-armhf-xl-arndale 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-amd64-amd64-xl-pvh-intel 14 guest-saverestore fail never pass
test-armhf-armhf-xl-qcow2 9 debian-di-install fail never pass
test-armhf-armhf-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-xl-vhd 9 debian-di-install fail never pass
baseline version:
flight 60666
jobs:
build-amd64-xsm pass
build-armhf-xsm pass
build-i386-xsm pass
build-amd64 pass
build-armhf pass
build-i386 pass
build-amd64-libvirt pass
build-armhf-libvirt pass
build-i386-libvirt pass
build-amd64-pvops pass
build-armhf-pvops pass
build-i386-pvops pass
build-amd64-rumpuserxen pass
build-i386-rumpuserxen pass
test-amd64-amd64-xl pass
test-armhf-armhf-xl pass
test-amd64-i386-xl fail
test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-amd64-libvirt-xsm pass
test-armhf-armhf-libvirt-xsm fail
test-amd64-i386-libvirt-xsm fail
test-amd64-amd64-xl-xsm pass
test-armhf-armhf-xl-xsm pass
test-amd64-i386-xl-xsm fail
test-amd64-amd64-xl-pvh-amd fail
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-xl-qemut-debianhvm-amd64 pass
test-amd64-i386-xl-qemut-debianhvm-amd64 pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-freebsd10-amd64 pass
test-amd64-amd64-xl-qemuu-ovmf-amd64 pass
test-amd64-i386-xl-qemuu-ovmf-amd64 pass
test-amd64-amd64-rumpuserxen-amd64 pass
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-i386-xl-qemuu-win7-amd64 fail
test-armhf-armhf-xl-arndale pass
test-amd64-amd64-xl-credit2 pass
test-armhf-armhf-xl-credit2 pass
test-armhf-armhf-xl-cubietruck pass
test-amd64-i386-freebsd10-i386 pass
test-amd64-i386-rumpuserxen-i386 pass
test-amd64-amd64-xl-pvh-intel fail
test-amd64-i386-qemut-rhel6hvm-intel pass
test-amd64-i386-qemuu-rhel6hvm-intel pass
test-amd64-amd64-libvirt pass
test-armhf-armhf-libvirt fail
test-amd64-i386-libvirt fail
test-amd64-amd64-xl-multivcpu pass
test-armhf-armhf-xl-multivcpu pass
test-amd64-amd64-pair pass
test-amd64-i386-pair fail
test-amd64-amd64-libvirt-pair fail
test-amd64-i386-libvirt-pair fail
test-amd64-amd64-amd64-pvgrub pass
test-amd64-amd64-i386-pvgrub pass
test-amd64-amd64-pygrub pass
test-amd64-amd64-libvirt-qcow2 pass
test-armhf-armhf-libvirt-qcow2 fail
test-amd64-i386-libvirt-qcow2 pass
test-amd64-amd64-xl-qcow2 pass
test-armhf-armhf-xl-qcow2 fail
test-amd64-i386-xl-qcow2 pass
test-amd64-amd64-libvirt-raw pass
test-armhf-armhf-libvirt-raw fail
test-amd64-i386-libvirt-raw pass
test-amd64-amd64-xl-raw pass
test-armhf-armhf-xl-raw fail
test-amd64-i386-xl-raw pass
test-amd64-amd64-xl-rtds pass
test-armhf-armhf-xl-rtds fail
test-amd64-i386-xl-qemut-winxpsp3-vcpus1 pass
test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 pass
test-amd64-amd64-libvirt-vhd pass
test-armhf-armhf-libvirt-vhd fail
test-amd64-i386-libvirt-vhd pass
test-amd64-amd64-xl-vhd pass
test-armhf-armhf-xl-vhd fail
test-amd64-i386-xl-vhd pass
test-amd64-amd64-xl-qemut-winxpsp3 pass
test-amd64-i386-xl-qemut-winxpsp3 pass
test-amd64-amd64-xl-qemuu-winxpsp3 pass
test-amd64-i386-xl-qemuu-winxpsp3 pass
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
[-- Attachment #3: 3.14:60666-vs-4.1:60785 --]
[-- Type: text/plain, Size: 11836 bytes --]
60785: regressions - FAIL
flight 60785 linux-4.1 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/60785/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-i386-pair 21 guest-migrate/src_host/dst_host fail REGR. vs. 60666
test-amd64-i386-xl-xsm 14 guest-saverestore fail REGR. vs. 60666
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail REGR. vs. 60666
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 16 guest-start/debianhvm.repeat fail REGR. vs. 60666
test-amd64-i386-xl 14 guest-saverestore fail REGR. vs. 60666
Regressions which are regarded as allowable (not blocking):
test-armhf-armhf-xl-rtds 11 guest-start fail blocked in 60666
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail blocked in 60666
test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail like 60666
test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail like 60666
test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail like 60666
Tests which did not succeed, but are not blocking:
test-armhf-armhf-xl-raw 9 debian-di-install fail never pass
test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-armhf-armhf-libvirt-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-xl-xsm 13 saverestore-support-check fail never pass
test-amd64-i386-libvirt-qcow2 11 migrate-support-check fail never pass
test-armhf-armhf-libvirt-qcow2 9 debian-di-install fail never pass
test-armhf-armhf-xl-cubietruck 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 13 saverestore-support-check fail never pass
test-amd64-i386-libvirt-raw 11 migrate-support-check fail never pass
test-armhf-armhf-libvirt-raw 9 debian-di-install fail never pass
test-armhf-armhf-libvirt 14 guest-saverestore fail never pass
test-armhf-armhf-xl-cubietruck 13 saverestore-support-check fail never pass
test-amd64-i386-libvirt-vhd 11 migrate-support-check fail never pass
test-amd64-i386-libvirt 14 guest-saverestore fail never pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-armhf-armhf-xl 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-vhd 11 migrate-support-check fail never pass
test-armhf-armhf-xl-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-raw 11 migrate-support-check fail never pass
test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop fail never pass
test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail never pass
test-amd64-i386-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-xl 13 saverestore-support-check fail never pass
test-armhf-armhf-libvirt-xsm 14 guest-saverestore fail never pass
test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass
test-armhf-armhf-xl-multivcpu 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-arndale 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-qcow2 11 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-xsm 14 guest-saverestore fail never pass
test-armhf-armhf-xl-arndale 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-armhf-armhf-libvirt-vhd 9 debian-di-install fail never pass
test-amd64-amd64-xl-pvh-intel 14 guest-saverestore fail never pass
test-armhf-armhf-xl-qcow2 9 debian-di-install fail never pass
test-armhf-armhf-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-xl-vhd 9 debian-di-install fail never pass
baseline version:
flight 60666
jobs:
build-amd64-xsm pass
build-armhf-xsm pass
build-i386-xsm pass
build-amd64 pass
build-armhf pass
build-i386 pass
build-amd64-libvirt pass
build-armhf-libvirt pass
build-i386-libvirt pass
build-amd64-pvops pass
build-armhf-pvops pass
build-i386-pvops pass
build-amd64-rumpuserxen pass
build-i386-rumpuserxen pass
test-amd64-amd64-xl pass
test-armhf-armhf-xl pass
test-amd64-i386-xl fail
test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm fail
test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-amd64-libvirt-xsm pass
test-armhf-armhf-libvirt-xsm fail
test-amd64-i386-libvirt-xsm fail
test-amd64-amd64-xl-xsm pass
test-armhf-armhf-xl-xsm pass
test-amd64-i386-xl-xsm fail
test-amd64-amd64-xl-pvh-amd fail
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-xl-qemut-debianhvm-amd64 pass
test-amd64-i386-xl-qemut-debianhvm-amd64 pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-freebsd10-amd64 pass
test-amd64-amd64-xl-qemuu-ovmf-amd64 pass
test-amd64-i386-xl-qemuu-ovmf-amd64 pass
test-amd64-amd64-rumpuserxen-amd64 fail
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-i386-xl-qemuu-win7-amd64 fail
test-armhf-armhf-xl-arndale pass
test-amd64-amd64-xl-credit2 pass
test-armhf-armhf-xl-credit2 pass
test-armhf-armhf-xl-cubietruck pass
test-amd64-i386-freebsd10-i386 pass
test-amd64-i386-rumpuserxen-i386 pass
test-amd64-amd64-xl-pvh-intel fail
test-amd64-i386-qemut-rhel6hvm-intel pass
test-amd64-i386-qemuu-rhel6hvm-intel pass
test-amd64-amd64-libvirt pass
test-armhf-armhf-libvirt fail
test-amd64-i386-libvirt fail
test-amd64-amd64-xl-multivcpu pass
test-armhf-armhf-xl-multivcpu pass
test-amd64-amd64-pair pass
test-amd64-i386-pair fail
test-amd64-amd64-libvirt-pair fail
test-amd64-i386-libvirt-pair fail
test-amd64-amd64-amd64-pvgrub pass
test-amd64-amd64-i386-pvgrub pass
test-amd64-amd64-pygrub pass
test-amd64-amd64-libvirt-qcow2 pass
test-armhf-armhf-libvirt-qcow2 fail
test-amd64-i386-libvirt-qcow2 pass
test-amd64-amd64-xl-qcow2 pass
test-armhf-armhf-xl-qcow2 fail
test-amd64-i386-xl-qcow2 pass
test-amd64-amd64-libvirt-raw pass
test-armhf-armhf-libvirt-raw fail
test-amd64-i386-libvirt-raw pass
test-amd64-amd64-xl-raw pass
test-armhf-armhf-xl-raw fail
test-amd64-i386-xl-raw pass
test-amd64-amd64-xl-rtds pass
test-armhf-armhf-xl-rtds fail
test-amd64-i386-xl-qemut-winxpsp3-vcpus1 pass
test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 pass
test-amd64-amd64-libvirt-vhd pass
test-armhf-armhf-libvirt-vhd fail
test-amd64-i386-libvirt-vhd pass
test-amd64-amd64-xl-vhd pass
test-armhf-armhf-xl-vhd fail
test-amd64-i386-xl-vhd pass
test-amd64-amd64-xl-qemut-winxpsp3 pass
test-amd64-i386-xl-qemut-winxpsp3 pass
test-amd64-amd64-xl-qemuu-winxpsp3 pass
test-amd64-i386-xl-qemuu-winxpsp3 pass
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
[-- Attachment #4: Type: text/plain, Size: 126 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED
2015-08-21 17:24 [linux-4.1 test] 60785: tolerable FAIL - PUSHED osstest service owner
2015-09-03 8:59 ` Analysis: switch osstest default kernel from 3.14 to 4.1 (Was: Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED) Ian Campbell
@ 2015-09-03 9:47 ` Ian Campbell
2015-09-03 10:05 ` Jan Beulich
2015-09-03 10:34 ` Ian Jackson
1 sibling, 2 replies; 12+ messages in thread
From: Ian Campbell @ 2015-09-03 9:47 UTC (permalink / raw)
To: osstest service owner, xen-devel, Wei Liu, Andrew Cooper, Ian.Jackson
Cc: Boris Ostrovsky, David Vrabel
On Fri, 2015-08-21 at 17:24 +0000, osstest service owner wrote:
> flight 60785 linux-4.1 real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/60785/
>
> Failures :-/ but no regressions.
>
> Tests which are failing intermittently (not blocking):
> test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 19 guest-start/debianhvm.repeat fail in 60746 pass in 60785
> test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 16 guest-start/debianhvm.repeat fail pass in 60746
> test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail pass in 60746
>
> Regressions which are regarded as allowable (not blocking):
> test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail REGR. vs. 60654
> test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 15 guest-localmigrate.2 fail blocked in 60654
> test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail in 60746 like 60654
> test-amd64-i386-xl-xsm 14 guest-saverestore fail like 60654
> test-amd64-i386-xl 14 guest-saverestore fail like 60654
> test-amd64-i386-pair 21 guest-migrate/src_host/dst_host fail like 60654
As noted in
http://lists.xen.org/archives/html/xen-devel/2015-09/msg00306.html these
three are regressions vs. 3.14 which the bisector has fingered with being
3a9ace0147d4 "tools/libxc+libxl+xl: Restore v2
streams".
linux-linux is also failing in what looks like the same manner.
We perhaps ought to consider whether we think "migration broken with newer
kernels" should be a blocker for 4.6.
The bisector was working on the linux-4.1, so ended up fingering the Xen
change which exposed the bug, since it didn't consider older kernels. I'm
going to see if I can engineer some adhoc runs which will cause the
bisector to instead try and find a commit between 3.18 and 4.1 which was
tickled by the Xen change, since I suspect that will be the actual
underlying buggy thing. If any one has any intuition on where to start
looking that might help speed things along...
Also, the fact these are "fail like NNNN" is a bit odd since the history[0]
shows this used to pass, hence a bad thing got pushed at some point.
59811 and 59837 correctly has them as "fail REGR. vs. 59393",
59909 considered one of the three "fail like 59936-bisect" and the others
as "fail REGR. vs. 59393".
Then 59960 has two as "fail like NNNNNN-bisect" and one as "fail REGR. vs.
59393".
60030 is the "bad" push which uses "fail like NNNNNN-bisect" to justify
ignoring all three.
IIRC there was a bug in the osstest machinery (now fixed by Ian) which lead
to this, but I mention it in case I'm recalling incorrectly.
Ian.
[0] http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64
-i386-pair/linux-4.1.html
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED
2015-09-03 9:47 ` [linux-4.1 test] 60785: tolerable FAIL - PUSHED Ian Campbell
@ 2015-09-03 10:05 ` Jan Beulich
2015-09-03 10:34 ` Ian Jackson
1 sibling, 0 replies; 12+ messages in thread
From: Jan Beulich @ 2015-09-03 10:05 UTC (permalink / raw)
To: Ian Campbell
Cc: Wei Liu, Andrew Cooper, Ian.Jackson, osstest service owner,
David Vrabel, xen-devel, Boris Ostrovsky
>>> On 03.09.15 at 11:47, <ian.campbell@citrix.com> wrote:
> We perhaps ought to consider whether we think "migration broken with newer
> kernels" should be a blocker for 4.6.
I think we should, at least up until we're certain it's in fact a problem
in a Linux commit that simply got exposed by the tools side change.
Jan
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED
2015-09-03 9:47 ` [linux-4.1 test] 60785: tolerable FAIL - PUSHED Ian Campbell
2015-09-03 10:05 ` Jan Beulich
@ 2015-09-03 10:34 ` Ian Jackson
2015-09-03 10:45 ` [OSSTEST PATCH 1/2] cr-daily-branch: Break out blessings_arg variable Ian Jackson
1 sibling, 1 reply; 12+ messages in thread
From: Ian Jackson @ 2015-09-03 10:34 UTC (permalink / raw)
To: Ian Campbell
Cc: xen-devel, Wei Liu, Andrew Cooper, osstest service owner,
David Vrabel, Boris Ostrovsky
Ian Campbell writes ("Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED"):
> 60030 is the "bad" push which uses "fail like NNNNNN-bisect" to justify
> ignoring all three.
For example, you mean the line in 60030's report saying
test-amd64-i386-xl 13 guest-saverestore fail like 60094-bisect
Well, 60094's report is contained within
Date: Tue, 28 Jul 2015 21:44:28 GMT
Subject: "[linux-4.1 bisection] complete test-amd64-i386-xl
and says
test-amd64-i386-xl 13 guest-saverestore fail baseline untested
There was no build job in 60094; for Linux (build-i386-pvops) it used
59826 (ie 5cf9896d) and for Xen (build-i386) 59934 (xen.git#3a9ace01).
> IIRC there was a bug in the osstest machinery (now fixed by Ian) which lead
> to this, but I mention it in case I'm recalling incorrectly.
I think that actually this is another problem: sg-report-flight when
testing X' (with a baseline of X) can justify a failure of T(X',Y,Z)
with a bisection failure of T(X,Y'',Z).
If Y'' breaks T then this makes it look to sg-report-flight like T was
already broken in X.
The simple solution is for sg-report-flight for cr-daily-branch to to
look at bisections.
The more complicated one would be for sg-report-flight to compare
versions of Y when looking for justifications, but I'm not sure this
is desirable because it would reset the justification search each time
any other tree changed.
Ian.
^ permalink raw reply [flat|nested] 12+ messages in thread
* [OSSTEST PATCH 1/2] cr-daily-branch: Break out blessings_arg variable
2015-09-03 10:34 ` Ian Jackson
@ 2015-09-03 10:45 ` Ian Jackson
2015-09-03 10:45 ` [OSSTEST PATCH 2/2] cr-daily-branch: Make sg-report-flight ignore bisections Ian Jackson
2015-09-03 16:41 ` [OSSTEST PATCH 1/2] cr-daily-branch: Break out blessings_arg variable Ian Campbell
0 siblings, 2 replies; 12+ messages in thread
From: Ian Jackson @ 2015-09-03 10:45 UTC (permalink / raw)
To: xen-devel; +Cc: Ian Jackson, Ian Campbell
And rewrap check_tested.
No functional change.
Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
cr-daily-branch | 6 +++---
1 file changed, 3 insertions(+), 3 deletions(-)
diff --git a/cr-daily-branch b/cr-daily-branch
index 7402d3f..e90919d 100755
--- a/cr-daily-branch
+++ b/cr-daily-branch
@@ -75,14 +75,14 @@ case $branch in
treeurl=`./ap-print-url $branch`;;
esac
+blessings_arg=--blessings=${DAILY_BRANCH_TESTED_BLESSING:-$OSSTEST_BLESSING}
+
force_baseline=false
skipidentical=true
wantpush=$OSSTEST_PUSH
check_tested () {
- ./sg-check-tested --debug --branch=$branch \
- --blessings=${DAILY_BRANCH_TESTED_BLESSING:-$OSSTEST_BLESSING} \
- "$@"
+ ./sg-check-tested --debug --branch=$branch $blessings_arg "$@"
}
if [ "x$OLD_REVISION" = x ]; then
--
1.7.10.4
^ permalink raw reply related [flat|nested] 12+ messages in thread
* [OSSTEST PATCH 2/2] cr-daily-branch: Make sg-report-flight ignore bisections
2015-09-03 10:45 ` [OSSTEST PATCH 1/2] cr-daily-branch: Break out blessings_arg variable Ian Jackson
@ 2015-09-03 10:45 ` Ian Jackson
2015-09-03 16:42 ` Ian Campbell
2015-09-03 16:41 ` [OSSTEST PATCH 1/2] cr-daily-branch: Break out blessings_arg variable Ian Campbell
1 sibling, 1 reply; 12+ messages in thread
From: Ian Jackson @ 2015-09-03 10:45 UTC (permalink / raw)
To: xen-devel; +Cc: Ian Jackson, Ian Campbell
sg-report-flight when testing X' (with a baseline of X) can justify a
failure of T(X',Y,Z) with a bisection failure of T(X,Y'',Z).
If Y'' breaks T then this makes it look to sg-report-flight like T was
already broken in X; cr-daily-branch could then push X' even though it
is actually broken.
This happened rarely, because cr-daily-branch's sg-report-flight would
only look at flights on the right branch, so only a bisection of T on
that branch can cause this, but nevertheless this can produce bad
pushes.
So: have cr-daily-branch pass a --blessings option to cr-daily-branch,
so that it only looks at (usually) `real' rather than the default of
`real' and also `real-bisect'.
An alternative, more complicated, approach would be for
sg-report-flight to compare versions of Y, Z, et al, when looking for
justifications, but I'm not sure this is desirable because it would
effectively reset the heisenbug compensator each time any other tree
changed.
Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
cr-daily-branch | 1 +
1 file changed, 1 insertion(+)
diff --git a/cr-daily-branch b/cr-daily-branch
index e90919d..e4c5532 100755
--- a/cr-daily-branch
+++ b/cr-daily-branch
@@ -76,6 +76,7 @@ case $branch in
esac
blessings_arg=--blessings=${DAILY_BRANCH_TESTED_BLESSING:-$OSSTEST_BLESSING}
+sgr_args+=" $blessings_arg"
force_baseline=false
skipidentical=true
--
1.7.10.4
^ permalink raw reply related [flat|nested] 12+ messages in thread
* Re: [OSSTEST PATCH 1/2] cr-daily-branch: Break out blessings_arg variable
2015-09-03 10:45 ` [OSSTEST PATCH 1/2] cr-daily-branch: Break out blessings_arg variable Ian Jackson
2015-09-03 10:45 ` [OSSTEST PATCH 2/2] cr-daily-branch: Make sg-report-flight ignore bisections Ian Jackson
@ 2015-09-03 16:41 ` Ian Campbell
1 sibling, 0 replies; 12+ messages in thread
From: Ian Campbell @ 2015-09-03 16:41 UTC (permalink / raw)
To: Ian Jackson, xen-devel
On Thu, 2015-09-03 at 11:45 +0100, Ian Jackson wrote:
> And rewrap check_tested.
>
> No functional change.
>
> Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
> ---
> cr-daily-branch | 6 +++---
> 1 file changed, 3 insertions(+), 3 deletions(-)
>
> diff --git a/cr-daily-branch b/cr-daily-branch
> index 7402d3f..e90919d 100755
> --- a/cr-daily-branch
> +++ b/cr-daily-branch
> @@ -75,14 +75,14 @@ case $branch in
> treeurl=`./ap-print-url $branch`;;
> esac
>
> +blessings_arg=--blessings=${DAILY_BRANCH_TESTED_BLESSING:
> -$OSSTEST_BLESSING}
> +
> force_baseline=false
> skipidentical=true
> wantpush=$OSSTEST_PUSH
>
> check_tested () {
> - ./sg-check-tested --debug --branch=$branch \
> - --blessings=${DAILY_BRANCH_TESTED_BLESSING:-$OSSTEST_BLESSING}
> \
> - "$@"
> + ./sg-check-tested --debug --branch=$branch $blessings_arg "$@"
> }
>
> if [ "x$OLD_REVISION" = x ]; then
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [OSSTEST PATCH 2/2] cr-daily-branch: Make sg-report-flight ignore bisections
2015-09-03 10:45 ` [OSSTEST PATCH 2/2] cr-daily-branch: Make sg-report-flight ignore bisections Ian Jackson
@ 2015-09-03 16:42 ` Ian Campbell
0 siblings, 0 replies; 12+ messages in thread
From: Ian Campbell @ 2015-09-03 16:42 UTC (permalink / raw)
To: Ian Jackson, xen-devel
On Thu, 2015-09-03 at 11:45 +0100, Ian Jackson wrote:
> sg-report-flight when testing X' (with a baseline of X) can justify a
> failure of T(X',Y,Z) with a bisection failure of T(X,Y'',Z).
>
> If Y'' breaks T then this makes it look to sg-report-flight like T was
> already broken in X; cr-daily-branch could then push X' even though it
> is actually broken.
>
> This happened rarely, because cr-daily-branch's sg-report-flight would
> only look at flights on the right branch, so only a bisection of T on
> that branch can cause this, but nevertheless this can produce bad
> pushes.
>
> So: have cr-daily-branch pass a --blessings option to cr-daily-branch,
> so that it only looks at (usually) `real' rather than the default of
> `real' and also `real-bisect'.
>
> An alternative, more complicated, approach would be for
> sg-report-flight to compare versions of Y, Z, et al, when looking for
> justifications, but I'm not sure this is desirable because it would
> effectively reset the heisenbug compensator each time any other tree
> changed.
>
> Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Acked-by: Ian Campbell <ian.campbell@citrix.com>
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: Analysis: switch osstest default kernel from 3.14 to 4.1 (Was: Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED)
2015-09-03 8:59 ` Analysis: switch osstest default kernel from 3.14 to 4.1 (Was: Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED) Ian Campbell
@ 2015-09-21 12:47 ` Ian Campbell
2015-11-17 14:28 ` Ian Campbell
0 siblings, 1 reply; 12+ messages in thread
From: Ian Campbell @ 2015-09-21 12:47 UTC (permalink / raw)
To: osstest service owner, xen-devel
[-- Attachment #1: Type: text/plain, Size: 3128 bytes --]
TL;DR: There are issues, but IMHO switching can be justified.
On Thu, 2015-09-03 at 09:59 +0100, Ian Campbell wrote:
> TL;DR: There are issues which need fixing first...
>
> On Fri, 2015-08-21 at 17:24 +0000, osstest service owner wrote:
> > flight 60785 linux-4.1 real [real]
> > http://logs.test-lab.xenproject.org/osstest/logs/60785/
> >
> > Failures :-/ but no regressions.
> >
> > Tests which are failing intermittently (not blocking):
> > test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 19 guest
> > -start/debianhvm.repeat fail in 60746 pass in 60785
> > test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 16 guest
> > -start/debianhvm.repeat fail pass in 60746
> > test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest
> > -localmigrate fail pass in 60746
>
> I've been considering updating osstest to switch from the current baseline
> kernel (the one used for all non linux-* tests) from 3.14 to 4.1.
>
> The last pass on 3.14 was 60666[0] a little while ago on 13/8 (due to a
> known issue[1]). As well as this pass of 4.1 today I therefore also
> considered 60654[2] on 12/8. Two reports (like this one) are attached
> comparing 3.16:60666 against 4.1:60654 and 4.1:60795 respectively.
Some time has passed and the issues with migration v2 are now fixed.
The most recent pass of 3.14 is (still, sigh) 60666[0].
The most recent fail was 62085[1] which suffers from the same known issue
WRT gntdev (which breaks qdisk based tests for qcow2 and vhd)
The latest 4.1 pass was 62053[2] from Friday.
Attached are two reports of 4.1:62053 vs 3.14:60666 and 3.14:62085.
The failures are:
vs. 60666 only:
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail REGR. vs. 60666
vs. 60666 and 62085:
test-amd64-amd64-xl-qemuu-ovmf-amd64 19 guest-start/debianhvm.repeat fail REGR. vs. 60666
For the first considering the history:
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm/linux-4.1.html
It seems pretty obvious that this is host specific, and in fact 60666
failed, just as guest-localmigrate.2 not guest-localmigrate like 62053 did.
For the second the history:
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemuu-ovmf-amd64/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-xl-qemuu-ovmf-amd64/linux-4.1.html
Suggests the issue is pretty intermittent. FWIW the push associated with
62085 justified this failure using 61947[3] where it passed with the exact
same kernel version.
So, I think it could be justified to switch our default kernel version to
linux-4.1. Probably after 4.6 is released though.
Ian.
[0] http://lists.xen.org/archives/html/xen-devel/2015-09/msg00304.html
[1] http://lists.xen.org/archives/html/xen-devel/2015-09/msg02441.html
[2] http://lists.xen.org/archives/html/xen-devel/2015-09/msg02364.html
[3] http://lists.xen.org/archives/html/xen-devel/2015-09/msg01921.html
[-- Attachment #2: 3.14:60666-vs-4.1:62053 --]
[-- Type: text/plain, Size: 11320 bytes --]
62053: regressions - FAIL
flight 62053 linux-4.1 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/62053/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail REGR. vs. 60666
test-amd64-amd64-xl-qemuu-ovmf-amd64 19 guest-start/debianhvm.repeat fail REGR. vs. 60666
Regressions which are regarded as allowable (not blocking):
test-armhf-armhf-xl-rtds 11 guest-start fail blocked in 60666
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail blocked in 60666
test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail like 60666
test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail like 60666
Tests which did not succeed, but are not blocking:
test-amd64-amd64-xl-pvh-intel 14 guest-saverestore fail never pass
test-armhf-armhf-xl-qcow2 9 debian-di-install fail never pass
test-armhf-armhf-libvirt-qcow2 9 debian-di-install fail never pass
test-armhf-armhf-xl-vhd 9 debian-di-install fail never pass
test-armhf-armhf-libvirt-vhd 9 debian-di-install fail never pass
test-armhf-armhf-xl-raw 9 debian-di-install fail never pass
test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass
test-armhf-armhf-libvirt-raw 9 debian-di-install fail never pass
test-armhf-armhf-libvirt-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-libvirt-xsm 14 guest-saverestore fail never pass
test-amd64-amd64-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-amd64-amd64-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-libvirt 14 guest-saverestore fail never pass
test-armhf-armhf-libvirt 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-i386-libvirt 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-armhf-armhf-xl-xsm 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 12 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 13 saverestore-support-check fail never pass
test-armhf-armhf-xl 12 migrate-support-check fail never pass
test-armhf-armhf-xl 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-qcow2 11 migrate-support-check fail never pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-amd64-amd64-libvirt-raw 11 migrate-support-check fail never pass
test-amd64-i386-libvirt-vhd 11 migrate-support-check fail never pass
test-amd64-amd64-libvirt-vhd 11 migrate-support-check fail never pass
test-amd64-i386-libvirt-raw 11 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-credit2 12 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 12 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 13 saverestore-support-check fail never pass
test-amd64-i386-libvirt-qcow2 11 migrate-support-check fail never pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop fail never pass
test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail never pass
baseline version:
flight 60666
jobs:
build-amd64-xsm pass
build-armhf-xsm pass
build-i386-xsm pass
build-amd64 pass
build-armhf pass
build-i386 pass
build-amd64-libvirt pass
build-armhf-libvirt pass
build-i386-libvirt pass
build-amd64-pvops pass
build-armhf-pvops pass
build-i386-pvops pass
build-amd64-rumpuserxen pass
build-i386-rumpuserxen pass
test-amd64-amd64-xl pass
test-armhf-armhf-xl pass
test-amd64-i386-xl pass
test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-amd64-libvirt-xsm pass
test-armhf-armhf-libvirt-xsm fail
test-amd64-i386-libvirt-xsm pass
test-amd64-amd64-xl-xsm pass
test-armhf-armhf-xl-xsm pass
test-amd64-i386-xl-xsm pass
test-amd64-amd64-xl-pvh-amd fail
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-xl-qemut-debianhvm-amd64 pass
test-amd64-i386-xl-qemut-debianhvm-amd64 pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-freebsd10-amd64 pass
test-amd64-amd64-xl-qemuu-ovmf-amd64 fail
test-amd64-i386-xl-qemuu-ovmf-amd64 pass
test-amd64-amd64-rumpuserxen-amd64 pass
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-i386-xl-qemuu-win7-amd64 fail
test-armhf-armhf-xl-arndale pass
test-amd64-amd64-xl-credit2 pass
test-armhf-armhf-xl-credit2 pass
test-armhf-armhf-xl-cubietruck pass
test-amd64-i386-freebsd10-i386 pass
test-amd64-i386-rumpuserxen-i386 pass
test-amd64-amd64-xl-pvh-intel fail
test-amd64-i386-qemut-rhel6hvm-intel pass
test-amd64-i386-qemuu-rhel6hvm-intel pass
test-amd64-amd64-libvirt pass
test-armhf-armhf-libvirt fail
test-amd64-i386-libvirt pass
test-amd64-amd64-xl-multivcpu pass
test-armhf-armhf-xl-multivcpu pass
test-amd64-amd64-pair pass
test-amd64-i386-pair pass
test-amd64-amd64-libvirt-pair fail
test-amd64-i386-libvirt-pair fail
test-amd64-amd64-amd64-pvgrub pass
test-amd64-amd64-i386-pvgrub pass
test-amd64-amd64-pygrub pass
test-amd64-amd64-libvirt-qcow2 pass
test-armhf-armhf-libvirt-qcow2 fail
test-amd64-i386-libvirt-qcow2 pass
test-amd64-amd64-xl-qcow2 pass
test-armhf-armhf-xl-qcow2 fail
test-amd64-i386-xl-qcow2 pass
test-amd64-amd64-libvirt-raw pass
test-armhf-armhf-libvirt-raw fail
test-amd64-i386-libvirt-raw pass
test-amd64-amd64-xl-raw pass
test-armhf-armhf-xl-raw fail
test-amd64-i386-xl-raw pass
test-amd64-amd64-xl-rtds pass
test-armhf-armhf-xl-rtds fail
test-amd64-i386-xl-qemut-winxpsp3-vcpus1 pass
test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 pass
test-amd64-amd64-libvirt-vhd pass
test-armhf-armhf-libvirt-vhd fail
test-amd64-i386-libvirt-vhd pass
test-amd64-amd64-xl-vhd pass
test-armhf-armhf-xl-vhd fail
test-amd64-i386-xl-vhd pass
test-amd64-amd64-xl-qemut-winxpsp3 pass
test-amd64-i386-xl-qemut-winxpsp3 pass
test-amd64-amd64-xl-qemuu-winxpsp3 pass
test-amd64-i386-xl-qemuu-winxpsp3 pass
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
[-- Attachment #3: 3.14:62085-vs-4.1:62053 --]
[-- Type: text/plain, Size: 11315 bytes --]
62053: regressions - FAIL
flight 62053 linux-4.1 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/62053/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-amd64-xl-qemuu-ovmf-amd64 19 guest-start/debianhvm.repeat fail REGR. vs. 62085
Regressions which are regarded as allowable (not blocking):
test-armhf-armhf-xl-rtds 11 guest-start fail blocked in 62085
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail blocked in 62085
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 13 guest-localmigrate fail like 62085
test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail like 62085
test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail like 62085
Tests which did not succeed, but are not blocking:
test-amd64-amd64-xl-pvh-intel 14 guest-saverestore fail never pass
test-armhf-armhf-xl-qcow2 9 debian-di-install fail never pass
test-armhf-armhf-libvirt-qcow2 9 debian-di-install fail never pass
test-armhf-armhf-xl-vhd 9 debian-di-install fail never pass
test-armhf-armhf-libvirt-vhd 9 debian-di-install fail never pass
test-armhf-armhf-xl-raw 9 debian-di-install fail never pass
test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass
test-armhf-armhf-libvirt-raw 9 debian-di-install fail never pass
test-armhf-armhf-libvirt-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-libvirt-xsm 14 guest-saverestore fail never pass
test-amd64-amd64-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-amd64-amd64-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-libvirt 14 guest-saverestore fail never pass
test-armhf-armhf-libvirt 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-i386-libvirt 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-pair 21 guest-migrate/src_host/dst_host fail never pass
test-armhf-armhf-xl-xsm 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 12 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 13 saverestore-support-check fail never pass
test-armhf-armhf-xl 12 migrate-support-check fail never pass
test-armhf-armhf-xl 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt-qcow2 11 migrate-support-check fail never pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-amd64-amd64-libvirt-raw 11 migrate-support-check fail never pass
test-amd64-i386-libvirt-vhd 11 migrate-support-check fail never pass
test-amd64-amd64-libvirt-vhd 11 migrate-support-check fail never pass
test-amd64-i386-libvirt-raw 11 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-credit2 12 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 12 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 13 saverestore-support-check fail never pass
test-amd64-i386-libvirt-qcow2 11 migrate-support-check fail never pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop fail never pass
test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail never pass
baseline version:
flight 62085
jobs:
build-amd64-xsm pass
build-armhf-xsm pass
build-i386-xsm pass
build-amd64 pass
build-armhf pass
build-i386 pass
build-amd64-libvirt pass
build-armhf-libvirt pass
build-i386-libvirt pass
build-amd64-pvops pass
build-armhf-pvops pass
build-i386-pvops pass
build-amd64-rumpuserxen pass
build-i386-rumpuserxen pass
test-amd64-amd64-xl pass
test-armhf-armhf-xl pass
test-amd64-i386-xl pass
test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-amd64-libvirt-xsm pass
test-armhf-armhf-libvirt-xsm fail
test-amd64-i386-libvirt-xsm pass
test-amd64-amd64-xl-xsm pass
test-armhf-armhf-xl-xsm pass
test-amd64-i386-xl-xsm pass
test-amd64-amd64-xl-pvh-amd fail
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-xl-qemut-debianhvm-amd64 pass
test-amd64-i386-xl-qemut-debianhvm-amd64 pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-freebsd10-amd64 pass
test-amd64-amd64-xl-qemuu-ovmf-amd64 fail
test-amd64-i386-xl-qemuu-ovmf-amd64 pass
test-amd64-amd64-rumpuserxen-amd64 pass
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-i386-xl-qemuu-win7-amd64 fail
test-armhf-armhf-xl-arndale pass
test-amd64-amd64-xl-credit2 pass
test-armhf-armhf-xl-credit2 pass
test-armhf-armhf-xl-cubietruck pass
test-amd64-i386-freebsd10-i386 pass
test-amd64-i386-rumpuserxen-i386 pass
test-amd64-amd64-xl-pvh-intel fail
test-amd64-i386-qemut-rhel6hvm-intel pass
test-amd64-i386-qemuu-rhel6hvm-intel pass
test-amd64-amd64-libvirt pass
test-armhf-armhf-libvirt fail
test-amd64-i386-libvirt pass
test-amd64-amd64-xl-multivcpu pass
test-armhf-armhf-xl-multivcpu pass
test-amd64-amd64-pair pass
test-amd64-i386-pair pass
test-amd64-amd64-libvirt-pair fail
test-amd64-i386-libvirt-pair fail
test-amd64-amd64-amd64-pvgrub pass
test-amd64-amd64-i386-pvgrub pass
test-amd64-amd64-pygrub pass
test-amd64-amd64-libvirt-qcow2 pass
test-armhf-armhf-libvirt-qcow2 fail
test-amd64-i386-libvirt-qcow2 pass
test-amd64-amd64-xl-qcow2 pass
test-armhf-armhf-xl-qcow2 fail
test-amd64-i386-xl-qcow2 pass
test-amd64-amd64-libvirt-raw pass
test-armhf-armhf-libvirt-raw fail
test-amd64-i386-libvirt-raw pass
test-amd64-amd64-xl-raw pass
test-armhf-armhf-xl-raw fail
test-amd64-i386-xl-raw pass
test-amd64-amd64-xl-rtds pass
test-armhf-armhf-xl-rtds fail
test-amd64-i386-xl-qemut-winxpsp3-vcpus1 pass
test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 pass
test-amd64-amd64-libvirt-vhd pass
test-armhf-armhf-libvirt-vhd fail
test-amd64-i386-libvirt-vhd pass
test-amd64-amd64-xl-vhd pass
test-armhf-armhf-xl-vhd fail
test-amd64-i386-xl-vhd pass
test-amd64-amd64-xl-qemut-winxpsp3 pass
test-amd64-i386-xl-qemut-winxpsp3 pass
test-amd64-amd64-xl-qemuu-winxpsp3 pass
test-amd64-i386-xl-qemuu-winxpsp3 pass
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
[-- Attachment #4: Type: text/plain, Size: 126 bytes --]
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: Analysis: switch osstest default kernel from 3.14 to 4.1 (Was: Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED)
2015-09-21 12:47 ` Ian Campbell
@ 2015-11-17 14:28 ` Ian Campbell
2015-11-17 14:29 ` [PATCH OSSTEST] ap-common: Switch default Linux branch to linux-4.1 Ian Campbell
0 siblings, 1 reply; 12+ messages in thread
From: Ian Campbell @ 2015-11-17 14:28 UTC (permalink / raw)
To: osstest service owner, xen-devel
On Mon, 2015-09-21 at 13:47 +0100, Ian Campbell wrote:
> TL;DR: There are issues, but IMHO switching can be justified.
Since some time has passed here is a fresh comparison of linux-3.14 flight
64435 (latest flight which would have passed except it incorrectly tried to
build an armhf kernel) vs linux-4.1 flight 63996 (latest) pass.
Only regression is "test-amd64-amd64-rumpuserxen-amd64" which fails
occasionally on both kernel versions
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-rumpuserxen-amd64/linux-3.14.html
http://logs.test-lab.xenproject.org/osstest/results/history/test-amd64-amd64-rumpuserxen-amd64/linux-4.1.html
and is down to a long standing heisenbug.
So a push would still be justified IMHO. I've just noticed that I don't
seem to have posted the patch. I'll follow up with it.
Ian.
$ ./sg-report-flight --that-flight=64435 63996
63996: regressions - FAIL
flight 63996 linux-4.1 real [real]
http://osstest.test-lab.xenproject.org/~osstest/pub/logs/63996/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-amd64-rumpuserxen-amd64 15 rumpuserxen-demo-xenstorels/xenstorels.repeat fail REGR. vs. 64435
Regressions which are regarded as allowable (not blocking):
test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail like 64435
test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail like 64435
Tests which did not succeed, but are not blocking:
test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass
test-amd64-amd64-xl-pvh-intel 14 guest-saverestore fail never pass
test-armhf-armhf-xl-vhd 9 debian-di-install fail never pass
test-armhf-armhf-libvirt-qcow2 9 debian-di-install fail never pass
test-armhf-armhf-libvirt-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-libvirt-xsm 14 guest-saverestore fail never pass
test-armhf-armhf-libvirt-raw 9 debian-di-install fail never pass
test-armhf-armhf-libvirt 14 guest-saverestore fail never pass
test-armhf-armhf-libvirt 12 migrate-support-check fail never pass
test-amd64-i386-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 12 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 13 saverestore-support-check fail never pass
test-amd64-amd64-libvirt-xsm 12 migrate-support-check fail never pass
test-amd64-amd64-libvirt 12 migrate-support-check fail never pass
test-armhf-armhf-xl-rtds 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-rtds 12 migrate-support-check fail never pass
test-armhf-armhf-xl-rtds 16 guest-start/debian.repeat fail never pass
test-armhf-armhf-xl 12 migrate-support-check fail never pass
test-armhf-armhf-xl 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 12 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-credit2 12 migrate-support-check fail never pass
test-amd64-i386-libvirt-xsm 12 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 12 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 13 saverestore-support-check fail never pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-amd64-amd64-libvirt-vhd 11 migrate-support-check fail never pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 migrate-support-check fail never pass
test-armhf-armhf-xl-xsm 13 saverestore-support-check fail never pass
test-armhf-armhf-xl-xsm 12 migrate-support-check fail never pass
test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail never pass
test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop fail never pass
baseline version:
flight 64435
jobs:
build-amd64-xsm pass
build-armhf-xsm pass
build-i386-xsm pass
build-amd64 pass
build-armhf pass
build-i386 pass
build-amd64-libvirt pass
build-armhf-libvirt pass
build-i386-libvirt pass
build-amd64-pvops pass
build-armhf-pvops pass
build-i386-pvops pass
build-amd64-rumpuserxen pass
build-i386-rumpuserxen pass
test-amd64-amd64-xl pass
test-armhf-armhf-xl pass
test-amd64-i386-xl pass
test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm pass
test-amd64-amd64-libvirt-xsm pass
test-armhf-armhf-libvirt-xsm fail
test-amd64-i386-libvirt-xsm pass
test-amd64-amd64-xl-xsm pass
test-armhf-armhf-xl-xsm pass
test-amd64-i386-xl-xsm pass
test-amd64-amd64-xl-pvh-amd fail
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-xl-qemut-debianhvm-amd64 pass
test-amd64-i386-xl-qemut-debianhvm-amd64 pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-freebsd10-amd64 pass
test-amd64-amd64-xl-qemuu-ovmf-amd64 pass
test-amd64-i386-xl-qemuu-ovmf-amd64 pass
test-amd64-amd64-rumpuserxen-amd64 fail
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-i386-xl-qemuu-win7-amd64 fail
test-armhf-armhf-xl-arndale pass
test-amd64-amd64-xl-credit2 pass
test-armhf-armhf-xl-credit2 pass
test-armhf-armhf-xl-cubietruck pass
test-amd64-i386-freebsd10-i386 pass
test-amd64-i386-rumpuserxen-i386 pass
test-amd64-amd64-xl-pvh-intel fail
test-amd64-i386-qemut-rhel6hvm-intel pass
test-amd64-i386-qemuu-rhel6hvm-intel pass
test-amd64-amd64-libvirt pass
test-armhf-armhf-libvirt fail
test-amd64-i386-libvirt pass
test-amd64-amd64-xl-multivcpu pass
test-armhf-armhf-xl-multivcpu pass
test-amd64-amd64-pair pass
test-amd64-i386-pair pass
test-amd64-amd64-libvirt-pair pass
test-amd64-i386-libvirt-pair pass
test-amd64-amd64-amd64-pvgrub pass
test-amd64-amd64-i386-pvgrub pass
test-amd64-amd64-pygrub pass
test-armhf-armhf-libvirt-qcow2 fail
test-amd64-amd64-xl-qcow2 pass
test-armhf-armhf-libvirt-raw fail
test-amd64-i386-xl-raw pass
test-amd64-amd64-xl-rtds pass
test-armhf-armhf-xl-rtds fail
test-amd64-i386-xl-qemut-winxpsp3-vcpus1 pass
test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 pass
test-amd64-amd64-libvirt-vhd pass
test-armhf-armhf-xl-vhd fail
test-amd64-amd64-xl-qemut-winxpsp3 pass
test-amd64-i386-xl-qemut-winxpsp3 pass
test-amd64-amd64-xl-qemuu-winxpsp3 pass
test-amd64-i386-xl-qemuu-winxpsp3 pass
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel
^ permalink raw reply [flat|nested] 12+ messages in thread
* [PATCH OSSTEST] ap-common: Switch default Linux branch to linux-4.1.
2015-11-17 14:28 ` Ian Campbell
@ 2015-11-17 14:29 ` Ian Campbell
0 siblings, 0 replies; 12+ messages in thread
From: Ian Campbell @ 2015-11-17 14:29 UTC (permalink / raw)
To: ian.jackson, xen-devel; +Cc: Ian Campbell
Signed-off-by: Ian Campbell <ian.campbell@citrix.com>
---
ap-common | 8 ++++++--
1 file changed, 6 insertions(+), 2 deletions(-)
diff --git a/ap-common b/ap-common
index 19c7580..5e7a791 100644
--- a/ap-common
+++ b/ap-common
@@ -61,8 +61,12 @@
: ${PUSH_TREE_LINUX:=$XENBITS:/home/xen/git/linux-pvops.git}
: ${BASE_TREE_LINUX:=git://xenbits.xen.org/linux-pvops.git}
-: ${BASE_TAG_LINUX:=tested/linux-3.14}
-: ${BASE_TAG_LINUX_ARM:=tested/linux-arm-xen}
+
+# This defines the default Linux kernel to use for all !linux-* tests
+: ${BASE_TAG_LINUX:=tested/linux-4.1}
+# ARM runs can use their own default
+#: ${BASE_TAG_LINUX_ARM:=tested/linux-arm-xen}
+: ${BASE_TAG_LINUX_ARM:=${BASE_TAG_LINUX}}
if [ "x${TREE_LINUX}" = x ]; then
: ${TREE_LINUX:=${BASE_TREE_LINUX}}
--
2.6.1
^ permalink raw reply related [flat|nested] 12+ messages in thread
end of thread, other threads:[~2015-11-17 14:29 UTC | newest]
Thread overview: 12+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2015-08-21 17:24 [linux-4.1 test] 60785: tolerable FAIL - PUSHED osstest service owner
2015-09-03 8:59 ` Analysis: switch osstest default kernel from 3.14 to 4.1 (Was: Re: [linux-4.1 test] 60785: tolerable FAIL - PUSHED) Ian Campbell
2015-09-21 12:47 ` Ian Campbell
2015-11-17 14:28 ` Ian Campbell
2015-11-17 14:29 ` [PATCH OSSTEST] ap-common: Switch default Linux branch to linux-4.1 Ian Campbell
2015-09-03 9:47 ` [linux-4.1 test] 60785: tolerable FAIL - PUSHED Ian Campbell
2015-09-03 10:05 ` Jan Beulich
2015-09-03 10:34 ` Ian Jackson
2015-09-03 10:45 ` [OSSTEST PATCH 1/2] cr-daily-branch: Break out blessings_arg variable Ian Jackson
2015-09-03 10:45 ` [OSSTEST PATCH 2/2] cr-daily-branch: Make sg-report-flight ignore bisections Ian Jackson
2015-09-03 16:42 ` Ian Campbell
2015-09-03 16:41 ` [OSSTEST PATCH 1/2] cr-daily-branch: Break out blessings_arg variable Ian Campbell
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.