* [xen-unstable test] 122968: regressions - FAIL
@ 2018-05-21 23:59 osstest service owner
2018-05-22 5:20 ` Juergen Gross
0 siblings, 1 reply; 6+ messages in thread
From: osstest service owner @ 2018-05-21 23:59 UTC (permalink / raw)
To: xen-devel, osstest-admin
flight 122968 xen-unstable real [real]
http://logs.test-lab.xenproject.org/osstest/logs/122968/
Regressions :-(
Tests which did not succeed and are blocking,
including tests which could not be run:
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 16 guest-localmigrate/x10 fail REGR. vs. 122804
test-amd64-amd64-xl-qemut-ws16-amd64 13 guest-saverestore fail REGR. vs. 122804
test-armhf-armhf-libvirt 19 leak-check/check fail REGR. vs. 122804
Tests which did not succeed, but are not blocking:
test-amd64-amd64-xl-qemut-win7-amd64 17 guest-stop fail like 122804
test-armhf-armhf-libvirt-xsm 14 saverestore-support-check fail like 122804
test-armhf-armhf-libvirt 14 saverestore-support-check fail like 122804
test-amd64-amd64-xl-qemuu-win7-amd64 17 guest-stop fail like 122804
test-amd64-i386-xl-qemuu-win7-amd64 17 guest-stop fail like 122804
test-amd64-i386-xl-qemut-win7-amd64 17 guest-stop fail like 122804
test-amd64-i386-xl-qemuu-ws16-amd64 17 guest-stop fail like 122804
test-armhf-armhf-libvirt-raw 13 saverestore-support-check fail like 122804
test-amd64-amd64-xl-qemuu-ws16-amd64 17 guest-stop fail like 122804
test-amd64-amd64-xl-pvhv2-intel 12 guest-start fail never pass
test-amd64-amd64-xl-pvhv2-amd 12 guest-start fail never pass
test-amd64-i386-xl-pvshim 12 guest-start fail never pass
test-amd64-i386-libvirt-xsm 13 migrate-support-check fail never pass
test-amd64-i386-libvirt 13 migrate-support-check fail never pass
test-amd64-amd64-libvirt-xsm 13 migrate-support-check fail never pass
test-amd64-amd64-libvirt 13 migrate-support-check fail never pass
test-arm64-arm64-xl-credit2 13 migrate-support-check fail never pass
test-arm64-arm64-xl-credit2 14 saverestore-support-check fail never pass
test-arm64-arm64-xl-xsm 13 migrate-support-check fail never pass
test-arm64-arm64-xl-xsm 14 saverestore-support-check fail never pass
test-arm64-arm64-libvirt-xsm 13 migrate-support-check fail never pass
test-arm64-arm64-libvirt-xsm 14 saverestore-support-check fail never pass
test-arm64-arm64-xl 13 migrate-support-check fail never pass
test-arm64-arm64-xl 14 saverestore-support-check fail never pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 11 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 13 migrate-support-check fail never pass
test-armhf-armhf-xl-credit2 14 saverestore-support-check fail never pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 11 migrate-support-check fail never pass
test-amd64-amd64-qemuu-nested-amd 17 debian-hvm-install/l1/l2 fail never pass
test-amd64-amd64-libvirt-vhd 12 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 13 migrate-support-check fail never pass
test-armhf-armhf-xl-arndale 14 saverestore-support-check fail never pass
test-armhf-armhf-libvirt-xsm 13 migrate-support-check fail never pass
test-armhf-armhf-xl-xsm 13 migrate-support-check fail never pass
test-armhf-armhf-xl-xsm 14 saverestore-support-check fail never pass
test-armhf-armhf-libvirt 13 migrate-support-check fail never pass
test-armhf-armhf-xl 13 migrate-support-check fail never pass
test-armhf-armhf-xl 14 saverestore-support-check fail never pass
test-armhf-armhf-xl-cubietruck 13 migrate-support-check fail never pass
test-armhf-armhf-xl-rtds 13 migrate-support-check fail never pass
test-armhf-armhf-xl-cubietruck 14 saverestore-support-check fail never pass
test-armhf-armhf-xl-rtds 14 saverestore-support-check fail never pass
test-armhf-armhf-xl-multivcpu 13 migrate-support-check fail never pass
test-armhf-armhf-xl-multivcpu 14 saverestore-support-check fail never pass
test-armhf-armhf-libvirt-raw 12 migrate-support-check fail never pass
test-amd64-i386-xl-qemut-ws16-amd64 17 guest-stop fail never pass
test-armhf-armhf-xl-vhd 12 migrate-support-check fail never pass
test-armhf-armhf-xl-vhd 13 saverestore-support-check fail never pass
test-amd64-i386-xl-qemuu-win10-i386 10 windows-install fail never pass
test-amd64-amd64-xl-qemuu-win10-i386 10 windows-install fail never pass
test-amd64-amd64-xl-qemut-win10-i386 10 windows-install fail never pass
test-amd64-i386-xl-qemut-win10-i386 10 windows-install fail never pass
version targeted for testing:
xen e0414f4223bd9b7ce9d07c9f26dd129a79c6d4cc
baseline version:
xen 858dbaaeda33b05c1ac80aea0ba9a03924e09005
Last test of basis 122804 2018-05-14 10:24:54 Z 7 days
Failing since 122892 2018-05-16 23:59:27 Z 4 days 2 attempts
Testing same since 122968 2018-05-19 13:43:03 Z 2 days 1 attempts
------------------------------------------------------------
People who touched revisions under test:
Andrew Cooper <andrew.cooper3@citrix.com>
Anthony PERARD <anthony.perard@citrix.com>
Christian Lindig <christian.lindig@citrix.com>
George Dunlap <george.dunlap@citrix.com>
Ian Jackson <Ian.Jackson@eu.citrix.com>
John Thomson <git@johnthomson.fastmail.com.au>
Konrad Rzeszutek Wilk <konrad.wilk@oracle.com>
Lars Kurth <Lars.kurth@citrix.com>
Olaf Hering <olaf@aepfle.de>
Oleksandr Andrushchenko <oleksandr_andrushchenko@epam.com>
Paul Durrant <paul.durrant@citrix.com>
Roger Pau Monné <roger.pau@citrix.com>
Wei Liu <wei.liu2@citrix.com>
jobs:
build-amd64-xsm pass
build-arm64-xsm pass
build-armhf-xsm pass
build-i386-xsm pass
build-amd64-xtf pass
build-amd64 pass
build-arm64 pass
build-armhf pass
build-i386 pass
build-amd64-libvirt pass
build-arm64-libvirt pass
build-armhf-libvirt pass
build-i386-libvirt pass
build-amd64-prev pass
build-i386-prev pass
build-amd64-pvops pass
build-arm64-pvops pass
build-armhf-pvops pass
build-i386-pvops pass
build-amd64-rumprun pass
build-i386-rumprun pass
test-xtf-amd64-amd64-1 pass
test-xtf-amd64-amd64-2 pass
test-xtf-amd64-amd64-3 pass
test-xtf-amd64-amd64-4 pass
test-xtf-amd64-amd64-5 pass
test-amd64-amd64-xl pass
test-arm64-arm64-xl pass
test-armhf-armhf-xl pass
test-amd64-i386-xl pass
test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemut-debianhvm-amd64-xsm pass
test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm pass
test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm fail
test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm pass
test-amd64-amd64-libvirt-xsm pass
test-arm64-arm64-libvirt-xsm pass
test-armhf-armhf-libvirt-xsm pass
test-amd64-i386-libvirt-xsm pass
test-amd64-amd64-xl-xsm pass
test-arm64-arm64-xl-xsm pass
test-armhf-armhf-xl-xsm pass
test-amd64-i386-xl-xsm pass
test-amd64-amd64-qemuu-nested-amd fail
test-amd64-amd64-xl-pvhv2-amd fail
test-amd64-i386-qemut-rhel6hvm-amd pass
test-amd64-i386-qemuu-rhel6hvm-amd pass
test-amd64-amd64-xl-qemut-debianhvm-amd64 pass
test-amd64-i386-xl-qemut-debianhvm-amd64 pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-xl-qemuu-debianhvm-amd64 pass
test-amd64-i386-freebsd10-amd64 pass
test-amd64-amd64-xl-qemuu-ovmf-amd64 pass
test-amd64-i386-xl-qemuu-ovmf-amd64 pass
test-amd64-amd64-rumprun-amd64 pass
test-amd64-amd64-xl-qemut-win7-amd64 fail
test-amd64-i386-xl-qemut-win7-amd64 fail
test-amd64-amd64-xl-qemuu-win7-amd64 fail
test-amd64-i386-xl-qemuu-win7-amd64 fail
test-amd64-amd64-xl-qemut-ws16-amd64 fail
test-amd64-i386-xl-qemut-ws16-amd64 fail
test-amd64-amd64-xl-qemuu-ws16-amd64 fail
test-amd64-i386-xl-qemuu-ws16-amd64 fail
test-armhf-armhf-xl-arndale pass
test-amd64-amd64-xl-credit2 pass
test-arm64-arm64-xl-credit2 pass
test-armhf-armhf-xl-credit2 pass
test-armhf-armhf-xl-cubietruck pass
test-amd64-amd64-examine pass
test-arm64-arm64-examine pass
test-armhf-armhf-examine pass
test-amd64-i386-examine pass
test-amd64-i386-freebsd10-i386 pass
test-amd64-i386-rumprun-i386 pass
test-amd64-amd64-xl-qemut-win10-i386 fail
test-amd64-i386-xl-qemut-win10-i386 fail
test-amd64-amd64-xl-qemuu-win10-i386 fail
test-amd64-i386-xl-qemuu-win10-i386 fail
test-amd64-amd64-qemuu-nested-intel pass
test-amd64-amd64-xl-pvhv2-intel fail
test-amd64-i386-qemut-rhel6hvm-intel pass
test-amd64-i386-qemuu-rhel6hvm-intel pass
test-amd64-amd64-libvirt pass
test-armhf-armhf-libvirt fail
test-amd64-i386-libvirt pass
test-amd64-amd64-livepatch pass
test-amd64-i386-livepatch pass
test-amd64-amd64-migrupgrade pass
test-amd64-i386-migrupgrade pass
test-amd64-amd64-xl-multivcpu pass
test-armhf-armhf-xl-multivcpu pass
test-amd64-amd64-pair pass
test-amd64-i386-pair pass
test-amd64-amd64-libvirt-pair pass
test-amd64-i386-libvirt-pair pass
test-amd64-amd64-amd64-pvgrub pass
test-amd64-amd64-i386-pvgrub pass
test-amd64-amd64-xl-pvshim pass
test-amd64-i386-xl-pvshim fail
test-amd64-amd64-pygrub pass
test-amd64-amd64-xl-qcow2 pass
test-armhf-armhf-libvirt-raw pass
test-amd64-i386-xl-raw pass
test-amd64-amd64-xl-rtds pass
test-armhf-armhf-xl-rtds pass
test-amd64-amd64-xl-qemuu-debianhvm-amd64-shadow pass
test-amd64-i386-xl-qemuu-debianhvm-amd64-shadow pass
test-amd64-amd64-xl-shadow pass
test-amd64-i386-xl-shadow pass
test-amd64-amd64-libvirt-vhd pass
test-armhf-armhf-xl-vhd pass
------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images
Logs, config files, etc. are available at
http://logs.test-lab.xenproject.org/osstest/logs
Explanation of these reports, and of osstest in general, is at
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master
Test harness code can be found at
http://xenbits.xen.org/gitweb?p=osstest.git;a=summary
Not pushing.
(No revision log; it would be 442 lines long.)
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [xen-unstable test] 122968: regressions - FAIL
2018-05-21 23:59 [xen-unstable test] 122968: regressions - FAIL osstest service owner
@ 2018-05-22 5:20 ` Juergen Gross
2018-05-22 10:28 ` Wei Liu
0 siblings, 1 reply; 6+ messages in thread
From: Juergen Gross @ 2018-05-22 5:20 UTC (permalink / raw)
To: xen-devel
On 22/05/18 01:59, osstest service owner wrote:
> flight 122968 xen-unstable real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/122968/
>
> Regressions :-(
>
> Tests which did not succeed and are blocking,
> including tests which could not be run:
> test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 16 guest-localmigrate/x10 fail REGR. vs. 122804
This seems to be a kernel issue:
[ 349.264490] Freezing user space processes ... (elapsed 0.004 seconds)
done.
[ 349.277385] Freezing remaining freezable tasks ...
[ 369.285006] Freezing of tasks failed after 20.002 seconds (1 tasks
refusing to freeze, wq_busy=0):
[ 369.293150] jbd2/xvda5-8 D 0000000000000000 0 115 2
0x00000000
[ 369.299858] ffff8800001fd590 0000000000000046 0000000000013200
ffff88002ea3ffd8
[ 369.307084] 0000000000013200 ffff8800001fd590 ffff88002f813ab0
ffff88002fbd7140
[ 369.314260] 0000000000000002 ffffffff811df230 ffff88002ea3fc80
ffff880029f64398
[ 369.321462] Call Trace:
[ 369.323726] [<ffffffff811df230>] ? generic_block_bmap+0x50/0x50
[ 369.329144] [<ffffffff815217e9>] ? io_schedule+0x99/0x120
[ 369.334118] [<ffffffff811df23a>] ? sleep_on_buffer+0xa/0x10
[ 369.339259] [<ffffffff81521b6c>] ? __wait_on_bit+0x5c/0x90
[ 369.344304] [<ffffffff811df230>] ? generic_block_bmap+0x50/0x50
[ 369.349782] [<ffffffff81521c17>] ? out_of_line_wait_on_bit+0x77/0x90
[ 369.355718] [<ffffffff810abc90>] ? autoremove_wake_function+0x30/0x30
[ 369.361624] [<ffffffffa01605aa>] ?
jbd2_journal_commit_transaction+0x182a/0x1a30 [jbd2]
[ 369.368948] [<ffffffffa0163e42>] ? kjournald2+0xb2/0x240 [jbd2]
[ 369.374387] [<ffffffff810abc60>] ? prepare_to_wait_event+0xf0/0xf0
[ 369.380082] [<ffffffffa0163d90>] ? commit_timeout+0x10/0x10 [jbd2]
[ 369.385805] [<ffffffff8108b13d>] ? kthread+0xbd/0xe0
[ 369.390470] [<ffffffff8108b080>] ? kthread_create_on_node+0x180/0x180
[ 369.396412] [<ffffffff81524c58>] ? ret_from_fork+0x58/0x90
[ 369.401489] [<ffffffff8108b080>] ? kthread_create_on_node+0x180/0x180
[ 369.407450]
[ 369.408916] Restarting kernel threads ... done.
[ 369.413308] xen:manage: do_suspend: freeze kernel threads failed -16
[ 369.420958] Restarting tasks ... done.
Which kernel version is that?
> test-amd64-amd64-xl-qemut-ws16-amd64 13 guest-saverestore fail REGR. vs. 122804
Can someone from tools side look at this, please?
xc: error: Failed to get types for pfn batch (14 = Bad address):
Internal error
xc: error: Save failed (14 = Bad address): Internal error
> test-armhf-armhf-libvirt 19 leak-check/check fail REGR. vs. 122804
Bad timing/missing whitelist?
2018-05-20 06:25:03 Z LEAKED [process 25641 /bin/sh] process: root
25641 25637 0 06:25 ? 00:00:00 /bin/sh -c test -x
/usr/sbin/anacron || ( cd / && run-parts --report /etc/cron.daily )
2018-05-20 06:25:03 Z LEAKED [process 25644 /bin/sh] process: root
25644 25642 0 06:25 ? 00:00:00 /bin/sh /etc/cron.daily/apt
2018-05-20 06:25:03 Z LEAKED [process 25637 /usr/sbin/CRON] process:
root 25637 1298 0 06:25 ? 00:00:00 /usr/sbin/CRON
2018-05-20 06:25:03 Z LEAKED [process 25663 apt-get] process: root
25663 25644 8 06:25 ? 00:00:00 apt-get check -qq
2018-05-20 06:25:03 Z LEAKED [process 25642 run-parts] process: root
25642 25641 0 06:25 ? 00:00:00 run-parts --report /etc/cron.daily
Juergen
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [xen-unstable test] 122968: regressions - FAIL
2018-05-22 5:20 ` Juergen Gross
@ 2018-05-22 10:28 ` Wei Liu
2018-05-22 12:34 ` Juergen Gross
0 siblings, 1 reply; 6+ messages in thread
From: Wei Liu @ 2018-05-22 10:28 UTC (permalink / raw)
To: Juergen Gross; +Cc: xen-devel, Wei Liu
On Tue, May 22, 2018 at 07:20:32AM +0200, Juergen Gross wrote:
> On 22/05/18 01:59, osstest service owner wrote:
> > flight 122968 xen-unstable real [real]
> > http://logs.test-lab.xenproject.org/osstest/logs/122968/
> >
> > Regressions :-(
> >
> > Tests which did not succeed and are blocking,
> > including tests which could not be run:
> > test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 16 guest-localmigrate/x10 fail REGR. vs. 122804
>
> This seems to be a kernel issue:
>
> [ 349.264490] Freezing user space processes ... (elapsed 0.004 seconds)
> done.
> [ 349.277385] Freezing remaining freezable tasks ...
> [ 369.285006] Freezing of tasks failed after 20.002 seconds (1 tasks
> refusing to freeze, wq_busy=0):
> [ 369.293150] jbd2/xvda5-8 D 0000000000000000 0 115 2
> 0x00000000
> [ 369.299858] ffff8800001fd590 0000000000000046 0000000000013200
> ffff88002ea3ffd8
> [ 369.307084] 0000000000013200 ffff8800001fd590 ffff88002f813ab0
> ffff88002fbd7140
> [ 369.314260] 0000000000000002 ffffffff811df230 ffff88002ea3fc80
> ffff880029f64398
> [ 369.321462] Call Trace:
> [ 369.323726] [<ffffffff811df230>] ? generic_block_bmap+0x50/0x50
> [ 369.329144] [<ffffffff815217e9>] ? io_schedule+0x99/0x120
> [ 369.334118] [<ffffffff811df23a>] ? sleep_on_buffer+0xa/0x10
> [ 369.339259] [<ffffffff81521b6c>] ? __wait_on_bit+0x5c/0x90
> [ 369.344304] [<ffffffff811df230>] ? generic_block_bmap+0x50/0x50
> [ 369.349782] [<ffffffff81521c17>] ? out_of_line_wait_on_bit+0x77/0x90
> [ 369.355718] [<ffffffff810abc90>] ? autoremove_wake_function+0x30/0x30
> [ 369.361624] [<ffffffffa01605aa>] ?
> jbd2_journal_commit_transaction+0x182a/0x1a30 [jbd2]
> [ 369.368948] [<ffffffffa0163e42>] ? kjournald2+0xb2/0x240 [jbd2]
> [ 369.374387] [<ffffffff810abc60>] ? prepare_to_wait_event+0xf0/0xf0
> [ 369.380082] [<ffffffffa0163d90>] ? commit_timeout+0x10/0x10 [jbd2]
> [ 369.385805] [<ffffffff8108b13d>] ? kthread+0xbd/0xe0
> [ 369.390470] [<ffffffff8108b080>] ? kthread_create_on_node+0x180/0x180
> [ 369.396412] [<ffffffff81524c58>] ? ret_from_fork+0x58/0x90
> [ 369.401489] [<ffffffff8108b080>] ? kthread_create_on_node+0x180/0x180
> [ 369.407450]
> [ 369.408916] Restarting kernel threads ... done.
> [ 369.413308] xen:manage: do_suspend: freeze kernel threads failed -16
> [ 369.420958] Restarting tasks ... done.
>
> Which kernel version is that?
Debian Jessie's stock kernel: 3.16.x
>
>
> > test-amd64-amd64-xl-qemut-ws16-amd64 13 guest-saverestore fail REGR. vs. 122804
>
> Can someone from tools side look at this, please?
>
> xc: error: Failed to get types for pfn batch (14 = Bad address):
> Internal error
> xc: error: Save failed (14 = Bad address): Internal error
>
We have a theory: Windows issues reboot in the middle of a migration. Xl
needs more locking.
I wrote a series to start a discussion that but it hasn't got much
attention.
[RFC PATCH 0/4] Per-domain locking in xl
<20170614171921.17475-1-wei.liu2@citrix.com>
> > test-armhf-armhf-libvirt 19 leak-check/check fail REGR. vs. 122804
>
> Bad timing/missing whitelist?
>
> 2018-05-20 06:25:03 Z LEAKED [process 25641 /bin/sh] process: root
> 25641 25637 0 06:25 ? 00:00:00 /bin/sh -c test -x
> /usr/sbin/anacron || ( cd / && run-parts --report /etc/cron.daily )
> 2018-05-20 06:25:03 Z LEAKED [process 25644 /bin/sh] process: root
> 25644 25642 0 06:25 ? 00:00:00 /bin/sh /etc/cron.daily/apt
> 2018-05-20 06:25:03 Z LEAKED [process 25637 /usr/sbin/CRON] process:
> root 25637 1298 0 06:25 ? 00:00:00 /usr/sbin/CRON
> 2018-05-20 06:25:03 Z LEAKED [process 25663 apt-get] process: root
> 25663 25644 8 06:25 ? 00:00:00 apt-get check -qq
> 2018-05-20 06:25:03 Z LEAKED [process 25642 run-parts] process: root
> 25642 25641 0 06:25 ? 00:00:00 run-parts --report /etc/cron.daily
>
Yes this is just unlucky.
>
> Juergen
>
> _______________________________________________
> Xen-devel mailing list
> Xen-devel@lists.xenproject.org
> https://lists.xenproject.org/mailman/listinfo/xen-devel
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [xen-unstable test] 122968: regressions - FAIL
2018-05-22 10:28 ` Wei Liu
@ 2018-05-22 12:34 ` Juergen Gross
2018-05-22 13:28 ` Wei Liu
0 siblings, 1 reply; 6+ messages in thread
From: Juergen Gross @ 2018-05-22 12:34 UTC (permalink / raw)
To: Wei Liu; +Cc: xen-devel
On 22/05/18 12:28, Wei Liu wrote:
> On Tue, May 22, 2018 at 07:20:32AM +0200, Juergen Gross wrote:
>> On 22/05/18 01:59, osstest service owner wrote:
>>> flight 122968 xen-unstable real [real]
>>> http://logs.test-lab.xenproject.org/osstest/logs/122968/
>>>
>>> Regressions :-(
>>>
>>> Tests which did not succeed and are blocking,
>>> including tests which could not be run:
>>> test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 16 guest-localmigrate/x10 fail REGR. vs. 122804
>>
>> This seems to be a kernel issue:
>>
>> [ 349.264490] Freezing user space processes ... (elapsed 0.004 seconds)
>> done.
>> [ 349.277385] Freezing remaining freezable tasks ...
>> [ 369.285006] Freezing of tasks failed after 20.002 seconds (1 tasks
>> refusing to freeze, wq_busy=0):
>> [ 369.293150] jbd2/xvda5-8 D 0000000000000000 0 115 2
>> 0x00000000
>> [ 369.299858] ffff8800001fd590 0000000000000046 0000000000013200
>> ffff88002ea3ffd8
>> [ 369.307084] 0000000000013200 ffff8800001fd590 ffff88002f813ab0
>> ffff88002fbd7140
>> [ 369.314260] 0000000000000002 ffffffff811df230 ffff88002ea3fc80
>> ffff880029f64398
>> [ 369.321462] Call Trace:
>> [ 369.323726] [<ffffffff811df230>] ? generic_block_bmap+0x50/0x50
>> [ 369.329144] [<ffffffff815217e9>] ? io_schedule+0x99/0x120
>> [ 369.334118] [<ffffffff811df23a>] ? sleep_on_buffer+0xa/0x10
>> [ 369.339259] [<ffffffff81521b6c>] ? __wait_on_bit+0x5c/0x90
>> [ 369.344304] [<ffffffff811df230>] ? generic_block_bmap+0x50/0x50
>> [ 369.349782] [<ffffffff81521c17>] ? out_of_line_wait_on_bit+0x77/0x90
>> [ 369.355718] [<ffffffff810abc90>] ? autoremove_wake_function+0x30/0x30
>> [ 369.361624] [<ffffffffa01605aa>] ?
>> jbd2_journal_commit_transaction+0x182a/0x1a30 [jbd2]
>> [ 369.368948] [<ffffffffa0163e42>] ? kjournald2+0xb2/0x240 [jbd2]
>> [ 369.374387] [<ffffffff810abc60>] ? prepare_to_wait_event+0xf0/0xf0
>> [ 369.380082] [<ffffffffa0163d90>] ? commit_timeout+0x10/0x10 [jbd2]
>> [ 369.385805] [<ffffffff8108b13d>] ? kthread+0xbd/0xe0
>> [ 369.390470] [<ffffffff8108b080>] ? kthread_create_on_node+0x180/0x180
>> [ 369.396412] [<ffffffff81524c58>] ? ret_from_fork+0x58/0x90
>> [ 369.401489] [<ffffffff8108b080>] ? kthread_create_on_node+0x180/0x180
>> [ 369.407450]
>> [ 369.408916] Restarting kernel threads ... done.
>> [ 369.413308] xen:manage: do_suspend: freeze kernel threads failed -16
>> [ 369.420958] Restarting tasks ... done.
>>
>> Which kernel version is that?
>
> Debian Jessie's stock kernel: 3.16.x
Hmm, you seem to have hit this problem before:
https://lists.xen.org/archives/html/xen-devel/2017-10/msg02235.html
Back then you blamed the rather new 4.9 kernel...
Juergen
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [xen-unstable test] 122968: regressions - FAIL
2018-05-22 12:34 ` Juergen Gross
@ 2018-05-22 13:28 ` Wei Liu
2018-05-22 13:42 ` Juergen Gross
0 siblings, 1 reply; 6+ messages in thread
From: Wei Liu @ 2018-05-22 13:28 UTC (permalink / raw)
To: Juergen Gross; +Cc: xen-devel, Wei Liu
On Tue, May 22, 2018 at 02:34:37PM +0200, Juergen Gross wrote:
> On 22/05/18 12:28, Wei Liu wrote:
> > On Tue, May 22, 2018 at 07:20:32AM +0200, Juergen Gross wrote:
> >> On 22/05/18 01:59, osstest service owner wrote:
> >>> flight 122968 xen-unstable real [real]
> >>> http://logs.test-lab.xenproject.org/osstest/logs/122968/
> >>>
> >>> Regressions :-(
> >>>
> >>> Tests which did not succeed and are blocking,
> >>> including tests which could not be run:
> >>> test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 16 guest-localmigrate/x10 fail REGR. vs. 122804
> >>
> >> This seems to be a kernel issue:
> >>
> >> [ 349.264490] Freezing user space processes ... (elapsed 0.004 seconds)
> >> done.
> >> [ 349.277385] Freezing remaining freezable tasks ...
> >> [ 369.285006] Freezing of tasks failed after 20.002 seconds (1 tasks
> >> refusing to freeze, wq_busy=0):
> >> [ 369.293150] jbd2/xvda5-8 D 0000000000000000 0 115 2
> >> 0x00000000
> >> [ 369.299858] ffff8800001fd590 0000000000000046 0000000000013200
> >> ffff88002ea3ffd8
> >> [ 369.307084] 0000000000013200 ffff8800001fd590 ffff88002f813ab0
> >> ffff88002fbd7140
> >> [ 369.314260] 0000000000000002 ffffffff811df230 ffff88002ea3fc80
> >> ffff880029f64398
> >> [ 369.321462] Call Trace:
> >> [ 369.323726] [<ffffffff811df230>] ? generic_block_bmap+0x50/0x50
> >> [ 369.329144] [<ffffffff815217e9>] ? io_schedule+0x99/0x120
> >> [ 369.334118] [<ffffffff811df23a>] ? sleep_on_buffer+0xa/0x10
> >> [ 369.339259] [<ffffffff81521b6c>] ? __wait_on_bit+0x5c/0x90
> >> [ 369.344304] [<ffffffff811df230>] ? generic_block_bmap+0x50/0x50
> >> [ 369.349782] [<ffffffff81521c17>] ? out_of_line_wait_on_bit+0x77/0x90
> >> [ 369.355718] [<ffffffff810abc90>] ? autoremove_wake_function+0x30/0x30
> >> [ 369.361624] [<ffffffffa01605aa>] ?
> >> jbd2_journal_commit_transaction+0x182a/0x1a30 [jbd2]
> >> [ 369.368948] [<ffffffffa0163e42>] ? kjournald2+0xb2/0x240 [jbd2]
> >> [ 369.374387] [<ffffffff810abc60>] ? prepare_to_wait_event+0xf0/0xf0
> >> [ 369.380082] [<ffffffffa0163d90>] ? commit_timeout+0x10/0x10 [jbd2]
> >> [ 369.385805] [<ffffffff8108b13d>] ? kthread+0xbd/0xe0
> >> [ 369.390470] [<ffffffff8108b080>] ? kthread_create_on_node+0x180/0x180
> >> [ 369.396412] [<ffffffff81524c58>] ? ret_from_fork+0x58/0x90
> >> [ 369.401489] [<ffffffff8108b080>] ? kthread_create_on_node+0x180/0x180
> >> [ 369.407450]
> >> [ 369.408916] Restarting kernel threads ... done.
> >> [ 369.413308] xen:manage: do_suspend: freeze kernel threads failed -16
> >> [ 369.420958] Restarting tasks ... done.
> >>
> >> Which kernel version is that?
> >
> > Debian Jessie's stock kernel: 3.16.x
>
> Hmm, you seem to have hit this problem before:
>
> https://lists.xen.org/archives/html/xen-devel/2017-10/msg02235.html
>
> Back then you blamed the rather new 4.9 kernel...
>
Yeah, I did see that on 4.9 -- that report was when I used stretch as
guest during my attempt to upgrade osstest to stretch. The production
osstest still uses jessie.
Maybe this is a long standing bug in Linux?
Wei.
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 6+ messages in thread
* Re: [xen-unstable test] 122968: regressions - FAIL
2018-05-22 13:28 ` Wei Liu
@ 2018-05-22 13:42 ` Juergen Gross
0 siblings, 0 replies; 6+ messages in thread
From: Juergen Gross @ 2018-05-22 13:42 UTC (permalink / raw)
To: Wei Liu; +Cc: xen-devel
On 22/05/18 15:28, Wei Liu wrote:
> On Tue, May 22, 2018 at 02:34:37PM +0200, Juergen Gross wrote:
>> On 22/05/18 12:28, Wei Liu wrote:
>>> On Tue, May 22, 2018 at 07:20:32AM +0200, Juergen Gross wrote:
>>>> On 22/05/18 01:59, osstest service owner wrote:
>>>>> flight 122968 xen-unstable real [real]
>>>>> http://logs.test-lab.xenproject.org/osstest/logs/122968/
>>>>>
>>>>> Regressions :-(
>>>>>
>>>>> Tests which did not succeed and are blocking,
>>>>> including tests which could not be run:
>>>>> test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 16 guest-localmigrate/x10 fail REGR. vs. 122804
>>>>
>>>> This seems to be a kernel issue:
>>>>
>>>> [ 349.264490] Freezing user space processes ... (elapsed 0.004 seconds)
>>>> done.
>>>> [ 349.277385] Freezing remaining freezable tasks ...
>>>> [ 369.285006] Freezing of tasks failed after 20.002 seconds (1 tasks
>>>> refusing to freeze, wq_busy=0):
>>>> [ 369.293150] jbd2/xvda5-8 D 0000000000000000 0 115 2
>>>> 0x00000000
>>>> [ 369.299858] ffff8800001fd590 0000000000000046 0000000000013200
>>>> ffff88002ea3ffd8
>>>> [ 369.307084] 0000000000013200 ffff8800001fd590 ffff88002f813ab0
>>>> ffff88002fbd7140
>>>> [ 369.314260] 0000000000000002 ffffffff811df230 ffff88002ea3fc80
>>>> ffff880029f64398
>>>> [ 369.321462] Call Trace:
>>>> [ 369.323726] [<ffffffff811df230>] ? generic_block_bmap+0x50/0x50
>>>> [ 369.329144] [<ffffffff815217e9>] ? io_schedule+0x99/0x120
>>>> [ 369.334118] [<ffffffff811df23a>] ? sleep_on_buffer+0xa/0x10
>>>> [ 369.339259] [<ffffffff81521b6c>] ? __wait_on_bit+0x5c/0x90
>>>> [ 369.344304] [<ffffffff811df230>] ? generic_block_bmap+0x50/0x50
>>>> [ 369.349782] [<ffffffff81521c17>] ? out_of_line_wait_on_bit+0x77/0x90
>>>> [ 369.355718] [<ffffffff810abc90>] ? autoremove_wake_function+0x30/0x30
>>>> [ 369.361624] [<ffffffffa01605aa>] ?
>>>> jbd2_journal_commit_transaction+0x182a/0x1a30 [jbd2]
>>>> [ 369.368948] [<ffffffffa0163e42>] ? kjournald2+0xb2/0x240 [jbd2]
>>>> [ 369.374387] [<ffffffff810abc60>] ? prepare_to_wait_event+0xf0/0xf0
>>>> [ 369.380082] [<ffffffffa0163d90>] ? commit_timeout+0x10/0x10 [jbd2]
>>>> [ 369.385805] [<ffffffff8108b13d>] ? kthread+0xbd/0xe0
>>>> [ 369.390470] [<ffffffff8108b080>] ? kthread_create_on_node+0x180/0x180
>>>> [ 369.396412] [<ffffffff81524c58>] ? ret_from_fork+0x58/0x90
>>>> [ 369.401489] [<ffffffff8108b080>] ? kthread_create_on_node+0x180/0x180
>>>> [ 369.407450]
>>>> [ 369.408916] Restarting kernel threads ... done.
>>>> [ 369.413308] xen:manage: do_suspend: freeze kernel threads failed -16
>>>> [ 369.420958] Restarting tasks ... done.
>>>>
>>>> Which kernel version is that?
>>>
>>> Debian Jessie's stock kernel: 3.16.x
>>
>> Hmm, you seem to have hit this problem before:
>>
>> https://lists.xen.org/archives/html/xen-devel/2017-10/msg02235.html
>>
>> Back then you blamed the rather new 4.9 kernel...
>>
>
> Yeah, I did see that on 4.9 -- that report was when I used stretch as
> guest during my attempt to upgrade osstest to stretch. The production
> osstest still uses jessie.
>
> Maybe this is a long standing bug in Linux?
Or a 4.9 bug which was backported to 3.16 now.
Juergen
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel
^ permalink raw reply [flat|nested] 6+ messages in thread
end of thread, other threads:[~2018-05-22 13:42 UTC | newest]
Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2018-05-21 23:59 [xen-unstable test] 122968: regressions - FAIL osstest service owner
2018-05-22 5:20 ` Juergen Gross
2018-05-22 10:28 ` Wei Liu
2018-05-22 12:34 ` Juergen Gross
2018-05-22 13:28 ` Wei Liu
2018-05-22 13:42 ` Juergen Gross
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.