* [linux-5.4 test] 174684: regressions - FAIL
@ 2022-11-10 2:48 osstest service owner
2022-11-10 8:18 ` Jan Beulich
0 siblings, 1 reply; 3+ messages in thread
From: osstest service owner @ 2022-11-10 2:48 UTC (permalink / raw)
To: xen-devel
flight 174684 linux-5.4 real [real]
http://logs.test-lab.xenproject.org/osstest/logs/174684/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-armhf-armhf-xl-credit2 18 guest-start/debian.repeat fail REGR. vs. 174540
Tests which are failing intermittently (not blocking):
test-amd64-i386-libvirt-xsm 8 xen-boot fail in 174638 pass in 174684
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 7 xen-install fail in 174638 pass in 174684
test-amd64-i386-pair 11 xen-install/dst_host fail in 174638 pass in 174684
test-armhf-armhf-libvirt-raw 13 guest-start fail in 174638 pass in 174684
test-armhf-armhf-xl-rtds 14 guest-start fail in 174638 pass in 174684
test-armhf-armhf-xl-credit1 19 guest-start.2 fail in 174646 pass in 174638
test-amd64-i386-qemuu-rhel6hvm-amd 12 redhat-install fail in 174646 pass in 174684
test-armhf-armhf-xl-multivcpu 14 guest-start fail in 174646 pass in 174684
test-amd64-amd64-xl-qemuu-debianhvm-i386-xsm 12 debian-hvm-install fail in 174646 pass in 174684
test-armhf-armhf-libvirt-qcow2 13 guest-start fail in 174646 pass in 174684
test-armhf-armhf-xl-rtds 18 guest-start/debian.repeat fail in 174646 pass in 174684
test-armhf-armhf-xl-credit1 18 guest-start/debian.repeat fail in 174672 pass in 174646
test-amd64-i386-qemuu-rhel6hvm-amd 7 xen-install fail in 174672 pass in 174684
test-armhf-armhf-xl-credit2 14 guest-start fail in 174672 pass in 174684
test-armhf-armhf-xl-credit1 14 guest-start fail pass in 174672
test-armhf-armhf-xl-multivcpu 18 guest-start/debian.repeat fail pass in 174672
Tests which did not succeed, but are not blocking:
test-armhf-armhf-xl-credit1 15 migrate-support-check fail in 174672 never pass
test-armhf-armhf-xl-credit1 16 saverestore-support-check fail in 174672 never pass
test-amd64-amd64-xl-qemuu-win7-amd64 19 guest-stop fail like 174540
test-amd64-i386-xl-qemut-win7-amd64 19 guest-stop fail like 174540
test-amd64-i386-xl-qemuu-win7-amd64 19 guest-stop fail like 174540
test-amd64-amd64-xl-qemut-win7-amd64 19 guest-stop fail like 174540
test-amd64-amd64-qemuu-nested-amd 20 debian-hvm-install/l1/l2 fail like 174540
test-amd64-amd64-xl-qemuu-ws16-amd64 19 guest-stop fail like 174540
test-amd64-amd64-xl-qemut-ws16-amd64 19 guest-stop fail like 174540
test-amd64-i386-xl-qemut-ws16-amd64 19 guest-stop fail like 174540
test-armhf-armhf-libvirt 16 saverestore-support-check fail like 174540
test-armhf-armhf-libvirt-raw 15 saverestore-support-check fail like 174540
test-armhf-armhf-libvirt-qcow2 15 saverestore-support-check fail like 174540
test-amd64-i386-xl-qemuu-ws16-amd64 19 guest-stop fail like 174540
test-amd64-i386-xl-pvshim 14 guest-start fail never pass
test-amd64-i386-libvirt-xsm 15 migrate-support-check fail never pass
test-arm64-arm64-xl-seattle 15 migrate-support-check fail never pass
test-arm64-arm64-xl-seattle 16 saverestore-support-check fail never pass
test-amd64-amd64-libvirt 15 migrate-support-check fail never pass
test-amd64-i386-libvirt 15 migrate-support-check fail never pass
test-arm64-arm64-xl 15 migrate-support-check fail never pass
test-arm64-arm64-xl 16 saverestore-support-check fail never pass
test-arm64-arm64-xl-credit2 15 migrate-support-check fail never pass
test-arm64-arm64-libvirt-xsm 15 migrate-support-check fail never pass
test-arm64-arm64-xl-credit2 16 saverestore-support-check fail never pass
test-arm64-arm64-libvirt-xsm 16 saverestore-support-check fail never pass
test-arm64-arm64-xl-xsm 15 migrate-support-check fail never pass
test-arm64-arm64-xl-credit1 15 migrate-support-check fail never pass
test-arm64-arm64-xl-xsm 16 saverestore-support-check fail never pass
test-arm64-arm64-xl-credit1 16 saverestore-support-check fail never pass
test-arm64-arm64-xl-thunderx 15 migrate-support-check fail never pass
test-arm64-arm64-xl-thunderx 16 saverestore-support-check fail never pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 13 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 15 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 16 saverestore-support-check fail never pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 13 migrate-support-check fail never pass
test-amd64-i386-libvirt-raw 14 migrate-support-check fail never pass
test-arm64-arm64-libvirt-raw 14 migrate-support-check fail never pass
test-arm64-arm64-libvirt-raw 15 saverestore-support-check fail never pass
test-arm64-arm64-xl-vhd 14 migrate-support-check fail never pass
test-arm64-arm64-xl-vhd 15 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 15 migrate-support-check fail never pass
test-armhf-armhf-xl-multivcpu 16 saverestore-support-check fail never pass
test-armhf-armhf-xl-cubietruck 15 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 16 saverestore-support-check fail never pass
test-armhf-armhf-xl 15 migrate-support-check fail never pass
test-armhf-armhf-xl 16 saverestore-support-check fail never pass
test-amd64-amd64-libvirt-xsm 15 migrate-support-check fail never pass
test-amd64-amd64-libvirt-vhd 14 migrate-support-check fail never pass
test-armhf-armhf-libvirt 15 migrate-support-check fail never pass
test-armhf-armhf-libvirt-raw 14 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 15 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 16 saverestore-support-check fail never pass
test-armhf-armhf-xl-rtds 15 migrate-support-check fail never pass
test-armhf-armhf-xl-rtds 16 saverestore-support-check fail never pass
test-armhf-armhf-libvirt-qcow2 14 migrate-support-check fail never pass
test-armhf-armhf-xl-vhd 14 migrate-support-check fail never pass
test-armhf-armhf-xl-vhd 15 saverestore-support-check fail never pass
version targeted for testing:
linux a0d9384967214783a92973c920092b7251c03e57
baseline version:
linux b70bfeb98635040588883503d2760e0f46231491
Last test of basis 174540 2022-10-29 12:41:57 Z 11 days
Failing since 174575 2022-11-01 18:42:39 Z 8 days 15 attempts
Testing same since 174608 2022-11-03 19:46:50 Z 6 days 12 attempts
------------------------------------------------------------
People who touched revisions under test:
"Darrick J. Wong" <darrick.wong@oracle.com>
Aaron Conole <aconole@redhat.com>
Abhinav Kumar <quic_abhinavk@quicinc.com>
Adrian Hunter <adrian.hunter@intel.com>
Alexander Aring <aahringo@redhat.com>
Alexander Stein <alexander.stein@ew.tq-group.com>
Andrew Morton <akpm@linux-foundation.org>
Anssi Hannula <anssi.hannula@bitwise.fi>
Arnaldo Carvalho de Melo <acme@redhat.com>
Biju Das <biju.das.jz@bp.renesas.com>
Brian Foster <bfoster@redhat.com>
Chandan Babu R <chandan.babu@oracle.com>
Chen Zhongjin <chenzhongjin@huawei.com>
Chen Zhou <chenzhou10@huawei.com>
Chris Packham <chris.packham@alliedtelesis.co.nz>
Christian A. Ehrhardt <lk@c--e.de>
Darrick J. Wong <darrick.wong@oracle.com>
Darrick J. Wong <djwong@kernel.org>
Dave Chinner <dchinner@redhat.com>
David S. Miller <davem@davemloft.net>
Demi Marie Obenour <demi@invisiblethingslab.com>
Dongliang Mu <dzm91@hust.edu.cn>
Eric Dumazet <edumazet@google.com>
Florian Fainelli <f.fainelli@gmail.com>
Greg Kroah-Hartman <gregkh@linuxfoundation.org>
Guenter Roeck <linux@roeck-us.net>
Gurucharan <gurucharanx.g@intel.com> (A Contingent worker at Intel)
Hannu Hartikainen <hannu@hrtk.in>
Hans Verkuil <hverkuil-cisco@xs4all.nl>
Heiko Carstens <hca@linux.ibm.com>
Helge Deller <deller@gmx.de>
Hyong Youb Kim <hyonkim@cisco.com>
Hyunwoo Kim <imv4bel@gmail.com>
Ilya Maximets <i.maximets@ovn.org>
Jacob Keller <jacob.e.keller@intel.com>
Jakub Kicinski <kuba@kernel.org>
Jan Beulich <jbeulich@suse.com>
Jason A. Donenfeld <Jason@zx2c4.com>
Jeff Vanhoof <jdv1029@gmail.com>
Jens Glathe <jens.glathe@oldschoolsolutions.biz>
Jimmy Assarsson <extja@kvaser.com>
Johan Hovold <johan+linaro@kernel.org>
Jon Hunter <jonathanh@nvidia.com>
Jon Maloy <jmaloy@redhat.com>
Jonathan Cameron <Jonathan.Cameron@huawei.com>
Josh Poimboeuf <jpoimboe@kernel.org>
Juergen Gross <jgross@suse.com>
Justin Chen <justinpopo6@gmail.com>
Konrad Jankowski <konrad0.jankowski@intel.com>
Kuogee Hsieh <quic_khsieh@quicinc.com>
Leon Romanovsky <leonro@nvidia.com>
Linux Kernel Functional Testing <lkft@linaro.org>
Luiz Capitulino <luizcap@amazon.com>
M. Vefa Bicakci <m.v.b@runbox.com>
Marc Kleine-Budde <mkl@pengutronix.de>
Marek Marczykowski-Górecki <marmarek@invisiblethingslab.com>
Mario Limonciello <mario.limonciello@amd.com>
Mateusz Palczewski <mateusz.palczewski@intel.com>
Mathias Nyman <mathias.nyman@linux.intel.com>
Matthew Ma <mahongwei@zeku.com>
Matti Vaittinen <mazziesaccount@gmail.com>
Mauro Carvalho Chehab <mchehab@kernel.org>
Michal Jaron <michalx.jaron@intel.com>
Mike Kravetz <mike.kravetz@oracle.com>
Miquel Raynal <miquel.raynal@bootlin.com>
Nathan Huckleberry <nhuck@google.com>
Neal Cardwell <ncardwell@google.com>
Nicolas Dichtel <nicolas.dichtel@6wind.com>
Oleksij Rempel <o.rempel@pengutronix.de>
Paolo Abeni <pabeni@redhat.com>
Peter Zijlstra <peterz@infradead.org>
Rafael J. Wysocki <rafael.j.wysocki@intel.com>
Raju Rangoju <Raju.Rangoju@amd.com>
Randy Dunlap <rdunlap@infradead.org>
Rik van Riel <riel@surriel.com>
Saeed Mahameed <saeedm@nvidia.com>
Sakari Ailus <sakari.ailus@linux.intel.com>
Sasha Levin <sashal@kernel.org>
Shreeya Patel <shreeya.patel@collabora.com>
Slawomir Laba <slawomirx.laba@intel.com>
Stefan Schmidt <stefan@datenfreihafen.org>
Steven Rostedt (Google) <rostedt@goodmis.org>
Sudeep Holla <sudeep.holla@arm.com>
Sudip Mukherjee <sudip.mukherjee@codethink.co.uk>
Sylwester Dziedziuch <sylwesterx.dziedziuch@intel.com>
Takashi Iwai <tiwai@suse.de>
Tariq Toukan <tariqt@nvidia.com>
Tejun Heo <tj@kernel.org>
Thinh Nguyen <Thinh.Nguyen@synopsys.com>
Tom Lendacky <thomas.lendacky@amd.com>
Tony O'Brien <tony.obrien@alliedtelesis.co.nz>
Ulf Hansson <ulf.hansson@linaro.org>
Vasily Gorbik <gor@linux.ibm.com>
Vineet Gupta <vgupta@kernel.org>
Vladimir Oltean <vladimir.oltean@nxp.com>
Wei Yongjun <weiyongjun1@huawei.com>
Xin Long <lucien.xin@gmail.com>
Yang Yingliang <yangyingliang@huawei.com>
Yongqin Liu <yongqin.liu@linaro.org>
Zhang Changzhong <zhangchangzhong@huawei.com>
Zhengchao Shao <shaozhengchao@huawei.com>
jobs:
build-amd64-xsm pass
build-arm64-xsm pass
build-i386-xsm pass
build-amd64 pass
build-arm64 pass
build-armhf pass
build-i386 pass
build-amd64-libvirt pass
build-arm64-libvirt pass
build-armhf-libvirt pass
build-i386-libvirt pass
build-amd64-pvops pass
build-arm64-pvops pass
build-armhf-pvops pass
build-i386-pvops pass
test-amd64-amd64-xl pass
test-amd64-coresched-amd64-xl pass
test-arm64-arm64-xl pass
test-armhf-armhf-xl pass
test-amd64-i386-xl pass
test-amd64-coresched-i386-xl pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-debianhvm-i386-xsm pass
test-amd64-i386-xl-qemut-debianhvm-i386-xsm pass
test-amd64-amd64-xl-qemuu-debianhvm-i386-xsm pass
test-amd64-i386-xl-qemuu-debianhvm-i386-xsm pass
test-amd64-amd64-libvirt-xsm pass
test-arm64-arm64-libvirt-xsm pass
test-amd64-i386-libvirt-xsm pass
test-amd64-amd64-xl-xsm pass
test-arm64-arm64-xl-xsm pass
test-amd64-i386-xl-xsm pass
test-amd64-amd64-qemuu-nested-amd fail
test-amd64-amd64-xl-pvhv2-amd pass
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-dom0pvh-xl-amd pass
test-amd64-amd64-xl-qemut-debianhvm-amd64 pass
test-amd64-i386-xl-qemut-debianhvm-amd64 pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-freebsd10-amd64 pass
test-amd64-amd64-qemuu-freebsd11-amd64 pass
test-amd64-amd64-qemuu-freebsd12-amd64 pass
test-amd64-amd64-xl-qemuu-ovmf-amd64 pass
test-amd64-i386-xl-qemuu-ovmf-amd64 pass
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-i386-xl-qemuu-win7-amd64 fail
test-amd64-amd64-xl-qemut-ws16-amd64 fail
test-amd64-i386-xl-qemut-ws16-amd64 fail
test-amd64-amd64-xl-qemuu-ws16-amd64 fail
test-amd64-i386-xl-qemuu-ws16-amd64 fail
test-armhf-armhf-xl-arndale pass
test-amd64-amd64-examine-bios pass
test-amd64-i386-examine-bios pass
test-amd64-amd64-xl-credit1 pass
test-arm64-arm64-xl-credit1 pass
test-armhf-armhf-xl-credit1 fail
test-amd64-amd64-xl-credit2 pass
test-arm64-arm64-xl-credit2 pass
test-armhf-armhf-xl-credit2 fail
test-armhf-armhf-xl-cubietruck pass
test-amd64-amd64-xl-qemuu-dmrestrict-amd64-dmrestrict pass
test-amd64-i386-xl-qemuu-dmrestrict-amd64-dmrestrict pass
test-amd64-amd64-examine pass
test-arm64-arm64-examine pass
test-armhf-armhf-examine pass
test-amd64-i386-examine pass
test-amd64-i386-freebsd10-i386 pass
test-amd64-amd64-qemuu-nested-intel pass
test-amd64-amd64-xl-pvhv2-intel pass
test-amd64-i386-qemut-rhel6hvm-intel pass
test-amd64-i386-qemuu-rhel6hvm-intel pass
test-amd64-amd64-dom0pvh-xl-intel pass
test-amd64-amd64-libvirt pass
test-armhf-armhf-libvirt pass
test-amd64-i386-libvirt pass
test-amd64-amd64-xl-multivcpu pass
test-armhf-armhf-xl-multivcpu fail
test-amd64-amd64-pair pass
test-amd64-i386-pair pass
test-amd64-amd64-libvirt-pair pass
test-amd64-i386-libvirt-pair pass
test-amd64-amd64-xl-pvshim pass
test-amd64-i386-xl-pvshim fail
test-amd64-amd64-pygrub pass
test-armhf-armhf-libvirt-qcow2 pass
test-amd64-amd64-xl-qcow2 pass
test-arm64-arm64-libvirt-raw pass
test-armhf-armhf-libvirt-raw pass
test-amd64-i386-libvirt-raw pass
test-amd64-amd64-xl-rtds pass
test-armhf-armhf-xl-rtds pass
test-arm64-arm64-xl-seattle pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64-shadow pass
test-amd64-i386-xl-qemuu-debianhvm-amd64-shadow pass
test-amd64-amd64-xl-shadow pass
test-amd64-i386-xl-shadow pass
test-arm64-arm64-xl-thunderx pass
test-amd64-amd64-examine-uefi pass
test-amd64-i386-examine-uefi pass
test-amd64-amd64-libvirt-vhd pass
test-arm64-arm64-xl-vhd pass
test-armhf-armhf-xl-vhd pass
test-amd64-i386-xl-vhd pass
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
Not pushing.
(No revision log; it would be 2244 lines long.)
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [linux-5.4 test] 174684: regressions - FAIL
2022-11-10 2:48 [linux-5.4 test] 174684: regressions - FAIL osstest service owner
@ 2022-11-10 8:18 ` Jan Beulich
2022-11-10 8:54 ` Bertrand Marquis
0 siblings, 1 reply; 3+ messages in thread
From: Jan Beulich @ 2022-11-10 8:18 UTC (permalink / raw)
To: Julien Grall, Stefano Stabellini, Volodymyr Babchuk, Bertrand Marquis
Cc: osstest service owner, xen-devel
On 10.11.2022 03:48, osstest service owner wrote:
> flight 174684 linux-5.4 real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/174684/
>
> Regressions :-(
>
> Tests which did not succeed and are blocking,
> including tests which could not be run:
> test-armhf-armhf-xl-credit2 18 guest-start/debian.repeat fail REGR. vs. 174540
This now looks to be failing relatively frequently (about every other flight),
and I'd rather suspect it to point at a hypervisor issue than a Linux one.
Looking at the log I found
(XEN) d5v0: vGICD: unhandled word write 0xffffffff to ICACTIVER0
(XEN) arch/arm/traps.c:1985:d5v1 HSR=0x80000006 pc=00000000 gva=0 gpa=0000000000000000
(XEN) arch/arm/traps.c:1985:d5v1 HSR=0x80000006 pc=0x00000c gva=0xc gpa=0x0000000000000c
(XEN) arch/arm/traps.c:1985:d5v1 HSR=0x80000006 pc=0x00000c gva=0xc gpa=0x0000000000000c
with the last two messages then repeated over and over, many dozen times a
second. Which makes me wonder whether that verbosity alone is causing a
problem.
Jan
^ permalink raw reply [flat|nested] 3+ messages in thread
* Re: [linux-5.4 test] 174684: regressions - FAIL
2022-11-10 8:18 ` Jan Beulich
@ 2022-11-10 8:54 ` Bertrand Marquis
0 siblings, 0 replies; 3+ messages in thread
From: Bertrand Marquis @ 2022-11-10 8:54 UTC (permalink / raw)
To: Jan Beulich
Cc: Julien Grall, Stefano Stabellini, Volodymyr Babchuk,
osstest service owner, xen-devel
Hi Jan,
> On 10 Nov 2022, at 08:18, Jan Beulich <jbeulich@suse.com> wrote:
>
> On 10.11.2022 03:48, osstest service owner wrote:
>> flight 174684 linux-5.4 real [real]
>> http://logs.test-lab.xenproject.org/osstest/logs/174684/
>>
>> Regressions :-(
>>
>> Tests which did not succeed and are blocking,
>> including tests which could not be run:
>> test-armhf-armhf-xl-credit2 18 guest-start/debian.repeat fail REGR. vs. 174540
>
> This now looks to be failing relatively frequently (about every other flight),
> and I'd rather suspect it to point at a hypervisor issue than a Linux one.
> Looking at the log I found
>
> (XEN) d5v0: vGICD: unhandled word write 0xffffffff to ICACTIVER0
> (XEN) arch/arm/traps.c:1985:d5v1 HSR=0x80000006 pc=00000000 gva=0 gpa=0000000000000000
> (XEN) arch/arm/traps.c:1985:d5v1 HSR=0x80000006 pc=0x00000c gva=0xc gpa=0x0000000000000c
> (XEN) arch/arm/traps.c:1985:d5v1 HSR=0x80000006 pc=0x00000c gva=0xc gpa=0x0000000000000c
>
> with the last two messages then repeated over and over, many dozen times a
> second. Which makes me wonder whether that verbosity alone is causing a
> problem.
The 2 messages are not necessarily related.
The first one is a warning and the write is ignored, we see that all the time with Xen in Debug mode during linux boot.
The other traps, with PC at 0xc look like there was an exception in Linux but the register pointing to the exception table is at 0 which means the guest did an exception before it initialised the exception table pointer.
When a guest is going to this kind of error it will loop on this:
- exception
- jump to exception table at 0 + offset depending on exception
- trap in xen because 0 is not mapped and push back the exception to guest
- go back to step 1
Now it could be that the first exception we reported back to guest should not have been reported and the guest falls into this loop after.
Our CI was a bit late compared to staging status until today (due to some servers being down).
I will check what is happening on our side with the last status today on arm32.
Cheers
Bertrand
>
> Jan
^ permalink raw reply [flat|nested] 3+ messages in thread
end of thread, other threads:[~2022-11-10 8:54 UTC | newest]
Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-11-10 2:48 [linux-5.4 test] 174684: regressions - FAIL osstest service owner
2022-11-10 8:18 ` Jan Beulich
2022-11-10 8:54 ` Bertrand Marquis
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.