Xen-Devel Archive on lore.kernel.org
 help / color / Atom feed
* [xen-4.7-testing test] 137065: regressions - FAIL
@ 2019-05-31  1:28 osstest service owner
  2019-05-31  1:28 ` [Xen-devel] " osstest service owner
  2019-05-31 10:55 ` Ian Jackson
  0 siblings, 2 replies; 9+ messages in thread
From: osstest service owner @ 2019-05-31  1:28 UTC (permalink / raw)
  To: xen-devel, osstest-admin

flight 137065 xen-4.7-testing real [real]
http://logs.test-lab.xenproject.org/osstest/logs/137065/

Regressions :-(

Tests which did not succeed and are blocking,
including tests which could not be run:
 build-i386-prev               6 xen-build                fail REGR. vs. 133596
 build-amd64-prev              6 xen-build                fail REGR. vs. 133596
 test-amd64-i386-freebsd10-i386 11 guest-start            fail REGR. vs. 133596
 build-arm64-xsm               6 xen-build                fail REGR. vs. 133596
 test-amd64-i386-freebsd10-amd64 11 guest-start           fail REGR. vs. 133596
 build-arm64                   6 xen-build                fail REGR. vs. 133596
 test-amd64-amd64-xl-qemuu-ovmf-amd64 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-amd64-xl-qemut-debianhvm-amd64 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-xl-qemuu-debianhvm-amd64 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-xl-qemuu-ovmf-amd64 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-amd64-qemuu-nested-intel 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-qemuu-rhel6hvm-intel 10 redhat-install   fail REGR. vs. 133596
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-shadow 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-amd64-qemuu-nested-amd 10 debian-hvm-install  fail REGR. vs. 133596
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-amd64-xl-qemuu-debianhvm-amd64 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-qemuu-rhel6hvm-amd 10 redhat-install     fail REGR. vs. 133596
 test-amd64-i386-xl-qemuu-debianhvm-amd64-shadow 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-qemut-rhel6hvm-amd 10 redhat-install     fail REGR. vs. 133596
 test-amd64-i386-qemut-rhel6hvm-intel 10 redhat-install   fail REGR. vs. 133596
 test-amd64-i386-xl-qemut-debianhvm-amd64 10 debian-hvm-install fail REGR. vs. 133596
 build-armhf                   6 xen-build                fail REGR. vs. 133596
 test-amd64-i386-xl-qemuu-win7-amd64 10 windows-install   fail REGR. vs. 133596
 test-amd64-amd64-xl-qemuu-win7-amd64 10 windows-install  fail REGR. vs. 133596
 test-amd64-i386-xl-qemut-ws16-amd64 10 windows-install   fail REGR. vs. 133596
 test-amd64-amd64-xl-qemut-win7-amd64 10 windows-install  fail REGR. vs. 133596
 test-amd64-amd64-xl-qemut-ws16-amd64 10 windows-install  fail REGR. vs. 133596
 test-amd64-i386-xl-qemuu-ws16-amd64 10 windows-install   fail REGR. vs. 133596
 test-amd64-amd64-xl-qemuu-ws16-amd64 10 windows-install  fail REGR. vs. 133596
 test-amd64-i386-xl-qemut-win7-amd64 10 windows-install   fail REGR. vs. 133596

Tests which did not succeed, but are not blocking:
 test-amd64-i386-migrupgrade   1 build-check(1)               blocked  n/a
 test-arm64-arm64-xl-credit1   1 build-check(1)               blocked  n/a
 test-arm64-arm64-xl-xsm       1 build-check(1)               blocked  n/a
 test-armhf-armhf-libvirt      1 build-check(1)               blocked  n/a
 build-armhf-libvirt           1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-cubietruck  1 build-check(1)               blocked  n/a
 test-arm64-arm64-xl           1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-multivcpu  1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl           1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-arndale   1 build-check(1)               blocked  n/a
 build-arm64-libvirt           1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-rtds      1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-credit1   1 build-check(1)               blocked  n/a
 test-armhf-armhf-libvirt-raw  1 build-check(1)               blocked  n/a
 test-arm64-arm64-xl-credit2   1 build-check(1)               blocked  n/a
 test-arm64-arm64-libvirt-xsm  1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-vhd       1 build-check(1)               blocked  n/a
 test-amd64-amd64-migrupgrade  1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-credit2   1 build-check(1)               blocked  n/a
 test-xtf-amd64-amd64-1      50 xtf/test-hvm64-lbr-tsx-vmentry fail like 133596
 test-xtf-amd64-amd64-3      50 xtf/test-hvm64-lbr-tsx-vmentry fail like 133596
 test-amd64-i386-libvirt-xsm  13 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt     13 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt      13 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-xsm 13 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-vhd 12 migrate-support-check        fail   never pass
 test-amd64-i386-xl-qemut-debianhvm-i386-xsm 10 debian-hvm-install fail never pass
 test-amd64-amd64-xl-qemut-debianhvm-i386-xsm 10 debian-hvm-install fail never pass
 test-amd64-i386-xl-qemuu-debianhvm-i386-xsm 10 debian-hvm-install fail never pass
 test-amd64-amd64-xl-qemuu-debianhvm-i386-xsm 10 debian-hvm-install fail never pass
 test-amd64-amd64-xl-qemut-win10-i386 10 windows-install        fail never pass
 test-amd64-amd64-xl-qemuu-win10-i386 10 windows-install        fail never pass
 test-amd64-i386-xl-qemut-win10-i386 10 windows-install         fail never pass
 test-amd64-i386-xl-qemuu-win10-i386 10 windows-install         fail never pass

version targeted for testing:
 xen                  de86305c7f32b49dfaa5ec6a8716794577c26784
baseline version:
 xen                  88f936d44d2e34ca2d0827cc828ea9d3aeef3fe8

Last test of basis   133596  2019-03-05 15:06:04 Z   86 days
Failing since        135434  2019-04-29 15:36:10 Z   31 days   18 attempts
Testing same since   137065  2019-05-29 12:05:23 Z    1 days    1 attempts

------------------------------------------------------------
People who touched revisions under test:
  Andrew Cooper <andrew.cooper3@citrix.com>
  Christian Lindig <christian.lindig@citrix.com>
  Cédric Bosdonnat <cbosdonnat@suse.com>
  Daniel De Graaf <dgdegra@tycho.nsa.gov>
  Ian Jackson <ian.jackson@eu.citrix.com>
  Jan Beulich <jbeulich@suse.com>
  Juergen Gross <jgross@suse.com>
  Quan Xu <xuquan8@huawei.com>
  Samuel Thibault <samuel.thibault@ens-lyon.org>
  Wei Liu <wei.liu2@citrix.com>

jobs:
 build-amd64-xsm                                              pass    
 build-arm64-xsm                                              fail    
 build-i386-xsm                                               pass    
 build-amd64-xtf                                              pass    
 build-amd64                                                  pass    
 build-arm64                                                  fail    
 build-armhf                                                  fail    
 build-i386                                                   pass    
 build-amd64-libvirt                                          pass    
 build-arm64-libvirt                                          blocked 
 build-armhf-libvirt                                          blocked 
 build-i386-libvirt                                           pass    
 build-amd64-prev                                             fail    
 build-i386-prev                                              fail    
 build-amd64-pvops                                            pass    
 build-arm64-pvops                                            pass    
 build-armhf-pvops                                            pass    
 build-i386-pvops                                             pass    
 test-xtf-amd64-amd64-1                                       pass    
 test-xtf-amd64-amd64-2                                       pass    
 test-xtf-amd64-amd64-3                                       pass    
 test-xtf-amd64-amd64-4                                       pass    
 test-xtf-amd64-amd64-5                                       pass    
 test-amd64-amd64-xl                                          pass    
 test-arm64-arm64-xl                                          blocked 
 test-armhf-armhf-xl                                          blocked 
 test-amd64-i386-xl                                           pass    
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm           fail    
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm            fail    
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm        fail    
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm         fail    
 test-amd64-amd64-xl-qemut-debianhvm-i386-xsm                 fail    
 test-amd64-i386-xl-qemut-debianhvm-i386-xsm                  fail    
 test-amd64-amd64-xl-qemuu-debianhvm-i386-xsm                 fail    
 test-amd64-i386-xl-qemuu-debianhvm-i386-xsm                  fail    
 test-amd64-amd64-libvirt-xsm                                 pass    
 test-arm64-arm64-libvirt-xsm                                 blocked 
 test-amd64-i386-libvirt-xsm                                  pass    
 test-amd64-amd64-xl-xsm                                      pass    
 test-arm64-arm64-xl-xsm                                      blocked 
 test-amd64-i386-xl-xsm                                       pass    
 test-amd64-amd64-qemuu-nested-amd                            fail    
 test-amd64-i386-qemut-rhel6hvm-amd                           fail    
 test-amd64-i386-qemuu-rhel6hvm-amd                           fail    
 test-amd64-amd64-xl-qemut-debianhvm-amd64                    fail    
 test-amd64-i386-xl-qemut-debianhvm-amd64                     fail    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64                    fail    
 test-amd64-i386-xl-qemuu-debianhvm-amd64                     fail    
 test-amd64-i386-freebsd10-amd64                              fail    
 test-amd64-amd64-xl-qemuu-ovmf-amd64                         fail    
 test-amd64-i386-xl-qemuu-ovmf-amd64                          fail    
 test-amd64-amd64-xl-qemut-win7-amd64                         fail    
 test-amd64-i386-xl-qemut-win7-amd64                          fail    
 test-amd64-amd64-xl-qemuu-win7-amd64                         fail    
 test-amd64-i386-xl-qemuu-win7-amd64                          fail    
 test-amd64-amd64-xl-qemut-ws16-amd64                         fail    
 test-amd64-i386-xl-qemut-ws16-amd64                          fail    
 test-amd64-amd64-xl-qemuu-ws16-amd64                         fail    
 test-amd64-i386-xl-qemuu-ws16-amd64                          fail    
 test-armhf-armhf-xl-arndale                                  blocked 
 test-amd64-amd64-xl-credit1                                  pass    
 test-arm64-arm64-xl-credit1                                  blocked 
 test-armhf-armhf-xl-credit1                                  blocked 
 test-amd64-amd64-xl-credit2                                  pass    
 test-arm64-arm64-xl-credit2                                  blocked 
 test-armhf-armhf-xl-credit2                                  blocked 
 test-armhf-armhf-xl-cubietruck                               blocked 
 test-amd64-i386-freebsd10-i386                               fail    
 test-amd64-amd64-xl-qemut-win10-i386                         fail    
 test-amd64-i386-xl-qemut-win10-i386                          fail    
 test-amd64-amd64-xl-qemuu-win10-i386                         fail    
 test-amd64-i386-xl-qemuu-win10-i386                          fail    
 test-amd64-amd64-qemuu-nested-intel                          fail    
 test-amd64-i386-qemut-rhel6hvm-intel                         fail    
 test-amd64-i386-qemuu-rhel6hvm-intel                         fail    
 test-amd64-amd64-libvirt                                     pass    
 test-armhf-armhf-libvirt                                     blocked 
 test-amd64-i386-libvirt                                      pass    
 test-amd64-amd64-migrupgrade                                 blocked 
 test-amd64-i386-migrupgrade                                  blocked 
 test-amd64-amd64-xl-multivcpu                                pass    
 test-armhf-armhf-xl-multivcpu                                blocked 
 test-amd64-amd64-pair                                        pass    
 test-amd64-i386-pair                                         pass    
 test-amd64-amd64-libvirt-pair                                pass    
 test-amd64-i386-libvirt-pair                                 pass    
 test-amd64-amd64-amd64-pvgrub                                pass    
 test-amd64-amd64-i386-pvgrub                                 pass    
 test-amd64-amd64-pygrub                                      pass    
 test-amd64-amd64-xl-qcow2                                    pass    
 test-armhf-armhf-libvirt-raw                                 blocked 
 test-amd64-i386-xl-raw                                       pass    
 test-amd64-amd64-xl-rtds                                     pass    
 test-armhf-armhf-xl-rtds                                     blocked 
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-shadow             fail    
 test-amd64-i386-xl-qemuu-debianhvm-amd64-shadow              fail    
 test-amd64-amd64-xl-shadow                                   pass    
 test-amd64-i386-xl-shadow                                    pass    
 test-amd64-amd64-libvirt-vhd                                 pass    
 test-armhf-armhf-xl-vhd                                      blocked 


------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images

Logs, config files, etc. are available at
    http://logs.test-lab.xenproject.org/osstest/logs

Explanation of these reports, and of osstest in general, is at
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master

Test harness code can be found at
    http://xenbits.xen.org/gitweb?p=osstest.git;a=summary


Not pushing.

(No revision log; it would be 330 lines long.)

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 9+ messages in thread

* [Xen-devel] [xen-4.7-testing test] 137065: regressions - FAIL
  2019-05-31  1:28 [xen-4.7-testing test] 137065: regressions - FAIL osstest service owner
@ 2019-05-31  1:28 ` " osstest service owner
  2019-05-31 10:55 ` Ian Jackson
  1 sibling, 0 replies; 9+ messages in thread
From: osstest service owner @ 2019-05-31  1:28 UTC (permalink / raw)
  To: xen-devel, osstest-admin

flight 137065 xen-4.7-testing real [real]
http://logs.test-lab.xenproject.org/osstest/logs/137065/

Regressions :-(

Tests which did not succeed and are blocking,
including tests which could not be run:
 build-i386-prev               6 xen-build                fail REGR. vs. 133596
 build-amd64-prev              6 xen-build                fail REGR. vs. 133596
 test-amd64-i386-freebsd10-i386 11 guest-start            fail REGR. vs. 133596
 build-arm64-xsm               6 xen-build                fail REGR. vs. 133596
 test-amd64-i386-freebsd10-amd64 11 guest-start           fail REGR. vs. 133596
 build-arm64                   6 xen-build                fail REGR. vs. 133596
 test-amd64-amd64-xl-qemuu-ovmf-amd64 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-amd64-xl-qemut-debianhvm-amd64 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-xl-qemuu-debianhvm-amd64 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-xl-qemuu-ovmf-amd64 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-amd64-qemuu-nested-intel 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-qemuu-rhel6hvm-intel 10 redhat-install   fail REGR. vs. 133596
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-shadow 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-amd64-qemuu-nested-amd 10 debian-hvm-install  fail REGR. vs. 133596
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-amd64-xl-qemuu-debianhvm-amd64 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-qemuu-rhel6hvm-amd 10 redhat-install     fail REGR. vs. 133596
 test-amd64-i386-xl-qemuu-debianhvm-amd64-shadow 10 debian-hvm-install fail REGR. vs. 133596
 test-amd64-i386-qemut-rhel6hvm-amd 10 redhat-install     fail REGR. vs. 133596
 test-amd64-i386-qemut-rhel6hvm-intel 10 redhat-install   fail REGR. vs. 133596
 test-amd64-i386-xl-qemut-debianhvm-amd64 10 debian-hvm-install fail REGR. vs. 133596
 build-armhf                   6 xen-build                fail REGR. vs. 133596
 test-amd64-i386-xl-qemuu-win7-amd64 10 windows-install   fail REGR. vs. 133596
 test-amd64-amd64-xl-qemuu-win7-amd64 10 windows-install  fail REGR. vs. 133596
 test-amd64-i386-xl-qemut-ws16-amd64 10 windows-install   fail REGR. vs. 133596
 test-amd64-amd64-xl-qemut-win7-amd64 10 windows-install  fail REGR. vs. 133596
 test-amd64-amd64-xl-qemut-ws16-amd64 10 windows-install  fail REGR. vs. 133596
 test-amd64-i386-xl-qemuu-ws16-amd64 10 windows-install   fail REGR. vs. 133596
 test-amd64-amd64-xl-qemuu-ws16-amd64 10 windows-install  fail REGR. vs. 133596
 test-amd64-i386-xl-qemut-win7-amd64 10 windows-install   fail REGR. vs. 133596

Tests which did not succeed, but are not blocking:
 test-amd64-i386-migrupgrade   1 build-check(1)               blocked  n/a
 test-arm64-arm64-xl-credit1   1 build-check(1)               blocked  n/a
 test-arm64-arm64-xl-xsm       1 build-check(1)               blocked  n/a
 test-armhf-armhf-libvirt      1 build-check(1)               blocked  n/a
 build-armhf-libvirt           1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-cubietruck  1 build-check(1)               blocked  n/a
 test-arm64-arm64-xl           1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-multivcpu  1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl           1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-arndale   1 build-check(1)               blocked  n/a
 build-arm64-libvirt           1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-rtds      1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-credit1   1 build-check(1)               blocked  n/a
 test-armhf-armhf-libvirt-raw  1 build-check(1)               blocked  n/a
 test-arm64-arm64-xl-credit2   1 build-check(1)               blocked  n/a
 test-arm64-arm64-libvirt-xsm  1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-vhd       1 build-check(1)               blocked  n/a
 test-amd64-amd64-migrupgrade  1 build-check(1)               blocked  n/a
 test-armhf-armhf-xl-credit2   1 build-check(1)               blocked  n/a
 test-xtf-amd64-amd64-1      50 xtf/test-hvm64-lbr-tsx-vmentry fail like 133596
 test-xtf-amd64-amd64-3      50 xtf/test-hvm64-lbr-tsx-vmentry fail like 133596
 test-amd64-i386-libvirt-xsm  13 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt     13 migrate-support-check        fail   never pass
 test-amd64-i386-libvirt      13 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-xsm 13 migrate-support-check        fail   never pass
 test-amd64-amd64-libvirt-vhd 12 migrate-support-check        fail   never pass
 test-amd64-i386-xl-qemut-debianhvm-i386-xsm 10 debian-hvm-install fail never pass
 test-amd64-amd64-xl-qemut-debianhvm-i386-xsm 10 debian-hvm-install fail never pass
 test-amd64-i386-xl-qemuu-debianhvm-i386-xsm 10 debian-hvm-install fail never pass
 test-amd64-amd64-xl-qemuu-debianhvm-i386-xsm 10 debian-hvm-install fail never pass
 test-amd64-amd64-xl-qemut-win10-i386 10 windows-install        fail never pass
 test-amd64-amd64-xl-qemuu-win10-i386 10 windows-install        fail never pass
 test-amd64-i386-xl-qemut-win10-i386 10 windows-install         fail never pass
 test-amd64-i386-xl-qemuu-win10-i386 10 windows-install         fail never pass

version targeted for testing:
 xen                  de86305c7f32b49dfaa5ec6a8716794577c26784
baseline version:
 xen                  88f936d44d2e34ca2d0827cc828ea9d3aeef3fe8

Last test of basis   133596  2019-03-05 15:06:04 Z   86 days
Failing since        135434  2019-04-29 15:36:10 Z   31 days   18 attempts
Testing same since   137065  2019-05-29 12:05:23 Z    1 days    1 attempts

------------------------------------------------------------
People who touched revisions under test:
  Andrew Cooper <andrew.cooper3@citrix.com>
  Christian Lindig <christian.lindig@citrix.com>
  Cédric Bosdonnat <cbosdonnat@suse.com>
  Daniel De Graaf <dgdegra@tycho.nsa.gov>
  Ian Jackson <ian.jackson@eu.citrix.com>
  Jan Beulich <jbeulich@suse.com>
  Juergen Gross <jgross@suse.com>
  Quan Xu <xuquan8@huawei.com>
  Samuel Thibault <samuel.thibault@ens-lyon.org>
  Wei Liu <wei.liu2@citrix.com>

jobs:
 build-amd64-xsm                                              pass    
 build-arm64-xsm                                              fail    
 build-i386-xsm                                               pass    
 build-amd64-xtf                                              pass    
 build-amd64                                                  pass    
 build-arm64                                                  fail    
 build-armhf                                                  fail    
 build-i386                                                   pass    
 build-amd64-libvirt                                          pass    
 build-arm64-libvirt                                          blocked 
 build-armhf-libvirt                                          blocked 
 build-i386-libvirt                                           pass    
 build-amd64-prev                                             fail    
 build-i386-prev                                              fail    
 build-amd64-pvops                                            pass    
 build-arm64-pvops                                            pass    
 build-armhf-pvops                                            pass    
 build-i386-pvops                                             pass    
 test-xtf-amd64-amd64-1                                       pass    
 test-xtf-amd64-amd64-2                                       pass    
 test-xtf-amd64-amd64-3                                       pass    
 test-xtf-amd64-amd64-4                                       pass    
 test-xtf-amd64-amd64-5                                       pass    
 test-amd64-amd64-xl                                          pass    
 test-arm64-arm64-xl                                          blocked 
 test-armhf-armhf-xl                                          blocked 
 test-amd64-i386-xl                                           pass    
 test-amd64-amd64-libvirt-qemuu-debianhvm-amd64-xsm           fail    
 test-amd64-i386-libvirt-qemuu-debianhvm-amd64-xsm            fail    
 test-amd64-amd64-xl-qemut-stubdom-debianhvm-amd64-xsm        fail    
 test-amd64-i386-xl-qemut-stubdom-debianhvm-amd64-xsm         fail    
 test-amd64-amd64-xl-qemut-debianhvm-i386-xsm                 fail    
 test-amd64-i386-xl-qemut-debianhvm-i386-xsm                  fail    
 test-amd64-amd64-xl-qemuu-debianhvm-i386-xsm                 fail    
 test-amd64-i386-xl-qemuu-debianhvm-i386-xsm                  fail    
 test-amd64-amd64-libvirt-xsm                                 pass    
 test-arm64-arm64-libvirt-xsm                                 blocked 
 test-amd64-i386-libvirt-xsm                                  pass    
 test-amd64-amd64-xl-xsm                                      pass    
 test-arm64-arm64-xl-xsm                                      blocked 
 test-amd64-i386-xl-xsm                                       pass    
 test-amd64-amd64-qemuu-nested-amd                            fail    
 test-amd64-i386-qemut-rhel6hvm-amd                           fail    
 test-amd64-i386-qemuu-rhel6hvm-amd                           fail    
 test-amd64-amd64-xl-qemut-debianhvm-amd64                    fail    
 test-amd64-i386-xl-qemut-debianhvm-amd64                     fail    
 test-amd64-amd64-xl-qemuu-debianhvm-amd64                    fail    
 test-amd64-i386-xl-qemuu-debianhvm-amd64                     fail    
 test-amd64-i386-freebsd10-amd64                              fail    
 test-amd64-amd64-xl-qemuu-ovmf-amd64                         fail    
 test-amd64-i386-xl-qemuu-ovmf-amd64                          fail    
 test-amd64-amd64-xl-qemut-win7-amd64                         fail    
 test-amd64-i386-xl-qemut-win7-amd64                          fail    
 test-amd64-amd64-xl-qemuu-win7-amd64                         fail    
 test-amd64-i386-xl-qemuu-win7-amd64                          fail    
 test-amd64-amd64-xl-qemut-ws16-amd64                         fail    
 test-amd64-i386-xl-qemut-ws16-amd64                          fail    
 test-amd64-amd64-xl-qemuu-ws16-amd64                         fail    
 test-amd64-i386-xl-qemuu-ws16-amd64                          fail    
 test-armhf-armhf-xl-arndale                                  blocked 
 test-amd64-amd64-xl-credit1                                  pass    
 test-arm64-arm64-xl-credit1                                  blocked 
 test-armhf-armhf-xl-credit1                                  blocked 
 test-amd64-amd64-xl-credit2                                  pass    
 test-arm64-arm64-xl-credit2                                  blocked 
 test-armhf-armhf-xl-credit2                                  blocked 
 test-armhf-armhf-xl-cubietruck                               blocked 
 test-amd64-i386-freebsd10-i386                               fail    
 test-amd64-amd64-xl-qemut-win10-i386                         fail    
 test-amd64-i386-xl-qemut-win10-i386                          fail    
 test-amd64-amd64-xl-qemuu-win10-i386                         fail    
 test-amd64-i386-xl-qemuu-win10-i386                          fail    
 test-amd64-amd64-qemuu-nested-intel                          fail    
 test-amd64-i386-qemut-rhel6hvm-intel                         fail    
 test-amd64-i386-qemuu-rhel6hvm-intel                         fail    
 test-amd64-amd64-libvirt                                     pass    
 test-armhf-armhf-libvirt                                     blocked 
 test-amd64-i386-libvirt                                      pass    
 test-amd64-amd64-migrupgrade                                 blocked 
 test-amd64-i386-migrupgrade                                  blocked 
 test-amd64-amd64-xl-multivcpu                                pass    
 test-armhf-armhf-xl-multivcpu                                blocked 
 test-amd64-amd64-pair                                        pass    
 test-amd64-i386-pair                                         pass    
 test-amd64-amd64-libvirt-pair                                pass    
 test-amd64-i386-libvirt-pair                                 pass    
 test-amd64-amd64-amd64-pvgrub                                pass    
 test-amd64-amd64-i386-pvgrub                                 pass    
 test-amd64-amd64-pygrub                                      pass    
 test-amd64-amd64-xl-qcow2                                    pass    
 test-armhf-armhf-libvirt-raw                                 blocked 
 test-amd64-i386-xl-raw                                       pass    
 test-amd64-amd64-xl-rtds                                     pass    
 test-armhf-armhf-xl-rtds                                     blocked 
 test-amd64-amd64-xl-qemuu-debianhvm-amd64-shadow             fail    
 test-amd64-i386-xl-qemuu-debianhvm-amd64-shadow              fail    
 test-amd64-amd64-xl-shadow                                   pass    
 test-amd64-i386-xl-shadow                                    pass    
 test-amd64-amd64-libvirt-vhd                                 pass    
 test-armhf-armhf-xl-vhd                                      blocked 


------------------------------------------------------------
sg-report-flight on osstest.test-lab.xenproject.org
logs: /home/logs/logs
images: /home/logs/images

Logs, config files, etc. are available at
    http://logs.test-lab.xenproject.org/osstest/logs

Explanation of these reports, and of osstest in general, is at
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master
    http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master

Test harness code can be found at
    http://xenbits.xen.org/gitweb?p=osstest.git;a=summary


Not pushing.

(No revision log; it would be 330 lines long.)

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: [xen-4.7-testing test] 137065: regressions - FAIL
  2019-05-31  1:28 [xen-4.7-testing test] 137065: regressions - FAIL osstest service owner
  2019-05-31  1:28 ` [Xen-devel] " osstest service owner
@ 2019-05-31 10:55 ` Ian Jackson
  2019-05-31 10:55   ` [Xen-devel] " Ian Jackson
  2019-05-31 11:25   ` Jan Beulich
  1 sibling, 2 replies; 9+ messages in thread
From: Ian Jackson @ 2019-05-31 10:55 UTC (permalink / raw)
  To: xen-devel

osstest service owner writes ("[xen-4.7-testing test] 137065: regressions - FAIL"):
> flight 137065 xen-4.7-testing real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/137065/
> 
> Regressions :-(
> 
> Tests which did not succeed and are blocking,
> including tests which could not be run:
...
>  test-amd64-i386-xl-qemuu-ovmf-amd64 10 debian-hvm-install fail REGR. vs. 133596
>  test-amd64-i386-qemuu-rhel6hvm-intel 10 redhat-install   fail REGR. vs. 133596
>  test-amd64-i386-xl-qemuu-win7-amd64 10 windows-install   fail REGR. vs. 133596

I think something is broken with HVM in Xen 4.7.

I looked at one of these failures (roughly taken at random)
  http://logs.test-lab.xenproject.org/osstest/logs/137065/test-amd64-amd64-xl-qemuu-debianhvm-i386-xsm/info.html
and there are *no* logs from the guest.  The screenshot of the
emulated vga suggests nothing initialised the vga controller either.
There seem to be very few messages in the serial log, too.

Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: [Xen-devel] [xen-4.7-testing test] 137065: regressions - FAIL
  2019-05-31 10:55 ` Ian Jackson
@ 2019-05-31 10:55   ` " Ian Jackson
  2019-05-31 11:25   ` Jan Beulich
  1 sibling, 0 replies; 9+ messages in thread
From: Ian Jackson @ 2019-05-31 10:55 UTC (permalink / raw)
  To: xen-devel

osstest service owner writes ("[xen-4.7-testing test] 137065: regressions - FAIL"):
> flight 137065 xen-4.7-testing real [real]
> http://logs.test-lab.xenproject.org/osstest/logs/137065/
> 
> Regressions :-(
> 
> Tests which did not succeed and are blocking,
> including tests which could not be run:
...
>  test-amd64-i386-xl-qemuu-ovmf-amd64 10 debian-hvm-install fail REGR. vs. 133596
>  test-amd64-i386-qemuu-rhel6hvm-intel 10 redhat-install   fail REGR. vs. 133596
>  test-amd64-i386-xl-qemuu-win7-amd64 10 windows-install   fail REGR. vs. 133596

I think something is broken with HVM in Xen 4.7.

I looked at one of these failures (roughly taken at random)
  http://logs.test-lab.xenproject.org/osstest/logs/137065/test-amd64-amd64-xl-qemuu-debianhvm-i386-xsm/info.html
and there are *no* logs from the guest.  The screenshot of the
emulated vga suggests nothing initialised the vga controller either.
There seem to be very few messages in the serial log, too.

Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: [xen-4.7-testing test] 137065: regressions - FAIL
  2019-05-31 10:55 ` Ian Jackson
  2019-05-31 10:55   ` [Xen-devel] " Ian Jackson
@ 2019-05-31 11:25   ` Jan Beulich
  2019-05-31 11:25     ` [Xen-devel] " Jan Beulich
  2019-06-05 18:02     ` Ian Jackson
  1 sibling, 2 replies; 9+ messages in thread
From: Jan Beulich @ 2019-05-31 11:25 UTC (permalink / raw)
  To: Ian Jackson; +Cc: xen-devel

>>> On 31.05.19 at 12:55, <ian.jackson@citrix.com> wrote:
> osstest service owner writes ("[xen-4.7-testing test] 137065: regressions - 
> FAIL"):
>> flight 137065 xen-4.7-testing real [real]
>> http://logs.test-lab.xenproject.org/osstest/logs/137065/ 
>> 
>> Regressions :-(
>> 
>> Tests which did not succeed and are blocking,
>> including tests which could not be run:
> ...
>>  test-amd64-i386-xl-qemuu-ovmf-amd64 10 debian-hvm-install fail REGR. vs. 133596
>>  test-amd64-i386-qemuu-rhel6hvm-intel 10 redhat-install   fail REGR. vs. 133596
>>  test-amd64-i386-xl-qemuu-win7-amd64 10 windows-install   fail REGR. vs. 133596
> 
> I think something is broken with HVM in Xen 4.7.
> 
> I looked at one of these failures (roughly taken at random)
>   
> http://logs.test-lab.xenproject.org/osstest/logs/137065/test-amd64-amd64-xl-qemuu-debianhvm-i386-xsm/info.html
> and there are *no* logs from the guest.  The screenshot of the
> emulated vga suggests nothing initialised the vga controller either.
> There seem to be very few messages in the serial log, too.

The one you've picked looks to be a "fail never pass" one, so is perhaps
not ideal. I've looked at a couple other ones, and in particular when the
guests are supposedly 64-bit I notice two things
- they look to be busy looping on vCPU 0,
- the VMCS/VMCB dumps suggest they've never left early boot (i.e.
  are still in 32-bit mode with paging still disabled), and may well still
  be sitting inside the boot loader.
I'm not at all certain though if this helps in any way.

Jan



_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: [Xen-devel] [xen-4.7-testing test] 137065: regressions - FAIL
  2019-05-31 11:25   ` Jan Beulich
@ 2019-05-31 11:25     ` " Jan Beulich
  2019-06-05 18:02     ` Ian Jackson
  1 sibling, 0 replies; 9+ messages in thread
From: Jan Beulich @ 2019-05-31 11:25 UTC (permalink / raw)
  To: Ian Jackson; +Cc: xen-devel

>>> On 31.05.19 at 12:55, <ian.jackson@citrix.com> wrote:
> osstest service owner writes ("[xen-4.7-testing test] 137065: regressions - 
> FAIL"):
>> flight 137065 xen-4.7-testing real [real]
>> http://logs.test-lab.xenproject.org/osstest/logs/137065/ 
>> 
>> Regressions :-(
>> 
>> Tests which did not succeed and are blocking,
>> including tests which could not be run:
> ...
>>  test-amd64-i386-xl-qemuu-ovmf-amd64 10 debian-hvm-install fail REGR. vs. 133596
>>  test-amd64-i386-qemuu-rhel6hvm-intel 10 redhat-install   fail REGR. vs. 133596
>>  test-amd64-i386-xl-qemuu-win7-amd64 10 windows-install   fail REGR. vs. 133596
> 
> I think something is broken with HVM in Xen 4.7.
> 
> I looked at one of these failures (roughly taken at random)
>   
> http://logs.test-lab.xenproject.org/osstest/logs/137065/test-amd64-amd64-xl-qemuu-debianhvm-i386-xsm/info.html
> and there are *no* logs from the guest.  The screenshot of the
> emulated vga suggests nothing initialised the vga controller either.
> There seem to be very few messages in the serial log, too.

The one you've picked looks to be a "fail never pass" one, so is perhaps
not ideal. I've looked at a couple other ones, and in particular when the
guests are supposedly 64-bit I notice two things
- they look to be busy looping on vCPU 0,
- the VMCS/VMCB dumps suggest they've never left early boot (i.e.
  are still in 32-bit mode with paging still disabled), and may well still
  be sitting inside the boot loader.
I'm not at all certain though if this helps in any way.

Jan



_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: [Xen-devel] [xen-4.7-testing test] 137065: regressions - FAIL
  2019-05-31 11:25   ` Jan Beulich
  2019-05-31 11:25     ` [Xen-devel] " Jan Beulich
@ 2019-06-05 18:02     ` Ian Jackson
  2019-06-06  7:15       ` Jan Beulich
  1 sibling, 1 reply; 9+ messages in thread
From: Ian Jackson @ 2019-06-05 18:02 UTC (permalink / raw)
  To: Jan Beulich; +Cc: xen-devel

Jan Beulich writes ("Re: [Xen-devel] [xen-4.7-testing test] 137065: regressions - FAIL"):
> The one you've picked looks to be a "fail never pass" one, so is perhaps
> not ideal. I've looked at a couple other ones, and in particular when the
> guests are supposedly 64-bit I notice two things
> - they look to be busy looping on vCPU 0,
> - the VMCS/VMCB dumps suggest they've never left early boot (i.e.
>   are still in 32-bit mode with paging still disabled), and may well still
>   be sitting inside the boot loader.
> I'm not at all certain though if this helps in any way.

I have not yet managed to make much progress with this.  In my most
recent attempt I backported all of the build fixes onto the
last-working Xen revision.

The branch I built and tested was this:
  iwj@osstest.test-lab:xen.git/t.47

And it failed:
  flight 137255 xen-unstable play [play]
  http://logs.test-lab.xenproject.org/osstest/logs/137255/

I think the most likely culprit is the OVMF/seabios changes.

Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: [Xen-devel] [xen-4.7-testing test] 137065: regressions - FAIL
  2019-06-05 18:02     ` Ian Jackson
@ 2019-06-06  7:15       ` Jan Beulich
  2019-06-17  7:04         ` Jan Beulich
  0 siblings, 1 reply; 9+ messages in thread
From: Jan Beulich @ 2019-06-06  7:15 UTC (permalink / raw)
  To: Ian Jackson; +Cc: xen-devel

>>> On 05.06.19 at 20:02, <ian.jackson@citrix.com> wrote:
> Jan Beulich writes ("Re: [Xen-devel] [xen-4.7-testing test] 137065: regressions - 
> FAIL"):
>> The one you've picked looks to be a "fail never pass" one, so is perhaps
>> not ideal. I've looked at a couple other ones, and in particular when the
>> guests are supposedly 64-bit I notice two things
>> - they look to be busy looping on vCPU 0,
>> - the VMCS/VMCB dumps suggest they've never left early boot (i.e.
>>   are still in 32-bit mode with paging still disabled), and may well still
>>   be sitting inside the boot loader.
>> I'm not at all certain though if this helps in any way.
> 
> I have not yet managed to make much progress with this.  In my most
> recent attempt I backported all of the build fixes onto the
> last-working Xen revision.
> 
> The branch I built and tested was this:
>   iwj@osstest.test-lab:xen.git/t.47

I would have wanted to look at what you've pulled in, but I couldn't
figure how to transform this into a url usable from here.

> And it failed:
>   flight 137255 xen-unstable play [play]
>   http://logs.test-lab.xenproject.org/osstest/logs/137255/ 

And it's again is this early boot state, with vCPU 0 spinning on
something. As I'm only now noticing, this

(XEN) RSP = 0x00000000005c2d48 (0x00000000005c2d48)  RIP = 0x00000000001015db (0x00000000001015db)

might actually hint at it being in hvmloader. The guest state dump
would match up with this:

(XEN) RIP:    0018:[<00000000001015e0>]

Both would point into hvmloader()'s memset. In this latter case we
also have the remaining registers, which are interesting:

(XEN) rax: 00000000005c2d50   rbx: 000000000010da9c   rcx: 00000000000002ff
(XEN) rdx: 0000000000000000   rsi: 0000000000000000   rdi: 0000000000000000
(XEN) rbp: 00000000005c2d58   rsp: 00000000005c2d48   r8:  0000000000000000

rax is the address that was just written to (or on the first iteration
is the address about to be written to). It's pretty odd that rax
points exactly between rsp and rbp, i.e. at local variable space of
memset() itself. No caller should ever call the function like this.

Seeing these addresses and seeing

(d1) Testing HVM environment:

as the last line of guest output I wonder whether you need to pull
in 0d6968635c ("hvmloader: avoid tests when they would clobber
used memory"). If nevertheless executing the tests is desired,
e2fc5bb5cb ("hvmloader: dynamically determine scratch memory
range for tests") would also be needed (but then also on 4.8 and
4.9).

Jan



_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 9+ messages in thread

* Re: [Xen-devel] [xen-4.7-testing test] 137065: regressions - FAIL
  2019-06-06  7:15       ` Jan Beulich
@ 2019-06-17  7:04         ` Jan Beulich
  0 siblings, 0 replies; 9+ messages in thread
From: Jan Beulich @ 2019-06-17  7:04 UTC (permalink / raw)
  To: Ian Jackson; +Cc: xen-devel

>>> On 06.06.19 at 09:15,  wrote:
>>>> On 05.06.19 at 20:02, <ian.jackson@citrix.com> wrote:
> > Jan Beulich writes ("Re: [Xen-devel] [xen-4.7-testing test] 137065: regressions 
> - 
> > FAIL"):
> >> The one you've picked looks to be a "fail never pass" one, so is perhaps
> >> not ideal. I've looked at a couple other ones, and in particular when the
> >> guests are supposedly 64-bit I notice two things
> >> - they look to be busy looping on vCPU 0,
> >> - the VMCS/VMCB dumps suggest they've never left early boot (i.e.
> >>   are still in 32-bit mode with paging still disabled), and may well still
> >>   be sitting inside the boot loader.
> >> I'm not at all certain though if this helps in any way.
> > 
> > I have not yet managed to make much progress with this.  In my most
> > recent attempt I backported all of the build fixes onto the
> > last-working Xen revision.
> > 
> > The branch I built and tested was this:
> >   iwj@osstest.test-lab:xen.git/t.47
> 
> I would have wanted to look at what you've pulled in, but I couldn't
> figure how to transform this into a url usable from here.
> 
> > And it failed:
> >   flight 137255 xen-unstable play [play]
> >   http://logs.test-lab.xenproject.org/osstest/logs/137255/ 
> 
> And it's again is this early boot state, with vCPU 0 spinning on
> something. As I'm only now noticing, this
> 
> (XEN) RSP = 0x00000000005c2d48 (0x00000000005c2d48)  RIP = 
> 0x00000000001015db (0x00000000001015db)
> 
> might actually hint at it being in hvmloader. The guest state dump
> would match up with this:
> 
> (XEN) RIP:    0018:[<00000000001015e0>]
> 
> Both would point into hvmloader()'s memset. In this latter case we
> also have the remaining registers, which are interesting:
> 
> (XEN) rax: 00000000005c2d50   rbx: 000000000010da9c   rcx: 00000000000002ff
> (XEN) rdx: 0000000000000000   rsi: 0000000000000000   rdi: 0000000000000000
> (XEN) rbp: 00000000005c2d58   rsp: 00000000005c2d48   r8:  0000000000000000
> 
> rax is the address that was just written to (or on the first iteration
> is the address about to be written to). It's pretty odd that rax
> points exactly between rsp and rbp, i.e. at local variable space of
> memset() itself. No caller should ever call the function like this.
> 
> Seeing these addresses and seeing
> 
> (d1) Testing HVM environment:
> 
> as the last line of guest output I wonder whether you need to pull
> in 0d6968635c ("hvmloader: avoid tests when they would clobber
> used memory"). If nevertheless executing the tests is desired,
> e2fc5bb5cb ("hvmloader: dynamically determine scratch memory
> range for tests") would also be needed (but then also on 4.8 and
> 4.9).

FTR - I've applied the first of these to the 4.7 branch (should have
done so before the weekend, to avoid wasting yet another flight).
If it helps (as I expect), then it may also want go onto the 4.6 one.
Otoh we could as well decide to retire 4.7 (the 3 years from its
initial release expire on Thursday according to my records), at
which point the need to fiddle with the 4.6 branch (for use as
"prev" in 4.7 testing) as well as the need to actually spend testing
resources on it would vanish. But perhaps it's better to have 4.7
get a final "full" push ...

Jan



_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 9+ messages in thread

end of thread, back to index

Thread overview: 9+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-05-31  1:28 [xen-4.7-testing test] 137065: regressions - FAIL osstest service owner
2019-05-31  1:28 ` [Xen-devel] " osstest service owner
2019-05-31 10:55 ` Ian Jackson
2019-05-31 10:55   ` [Xen-devel] " Ian Jackson
2019-05-31 11:25   ` Jan Beulich
2019-05-31 11:25     ` [Xen-devel] " Jan Beulich
2019-06-05 18:02     ` Ian Jackson
2019-06-06  7:15       ` Jan Beulich
2019-06-17  7:04         ` Jan Beulich

Xen-Devel Archive on lore.kernel.org

Archives are clonable:
	git clone --mirror https://lore.kernel.org/xen-devel/0 xen-devel/git/0.git
	git clone --mirror https://lore.kernel.org/xen-devel/1 xen-devel/git/1.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 xen-devel xen-devel/ https://lore.kernel.org/xen-devel \
		xen-devel@lists.xenproject.org xen-devel@archiver.kernel.org
	public-inbox-index xen-devel


Newsgroup available over NNTP:
	nntp://nntp.lore.kernel.org/org.xenproject.lists.xen-devel


AGPL code for this site: git clone https://public-inbox.org/ public-inbox