From mboxrd@z Thu Jan 1 00:00:00 1970 From: Ian Campbell Subject: [PATCH OSSTEST v5 00/24] add distro domU testing flight Date: Wed, 6 May 2015 10:46:45 +0100 Message-ID: <1430905605.2660.187.camel@citrix.com> Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Return-path: List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-devel-bounces@lists.xen.org Errors-To: xen-devel-bounces@lists.xen.org To: Ian Jackson , longtaox.pang@intel.com Cc: xen-devel List-Id: xen-devel@lists.xenproject.org Hi, Since v5 I've run various adhoc tests and fixed a bunch of issues (most noticeably in "Debian: refactor code to add preseed commands to the preseed file" which had broken most debian hvm installs). As last time there are some patches in here which I think will be useful to the Intel folks doing the nested virt testing, specifically the refactoring of how overlays and ssh host keys are done will be useful for installing a guest to be treated as the L1 host. (Note that this has changed a bit, again, since last time) Since Intel are building on some of this with their nested virt patch series I'd like to get the early part of this series in sooner than the rest, I think up to "make-flight: Handle $BUILD_LVEXTEND_MAX in mfi-common:create_build_jobs()" makes sense. I have run an adhoc xen-unstable flight on just those changes and the results are at http://osstest.xs.citrite.net/~osstest/testlogs/logs/37326/ (only visible in Citrix, sorry). The results email is also appended. No regressions AFAICT. (Possibly "Debian: [rR]efactor.*" could go in in isolation, but I didn't test that by itself) This also builds on some changes which are in "[GIT PULL OSSTEST] Merge up changes from Cambridge instance.". Perhaps we should push that as one batch? I can provide a branch if needed. Open questions from last time: When I originally started this work I envisioned a flight running on the main production instance (in Cambridge at the time). Now that we have the new colo I would still consider that the main production instance is the best home, however given the new colo is not yet up to full capacity we could also consider running this flight in Cambridge for the time being. What do you think? Also when running the adhoc tests the sheer number of jobs which are involved (with my hope there will be more in the future as other distros get in on the act) I was considering splitting it into multiple distros-debian-{squeeze,wheezy,jessie,sid,daily} flights. Thoughts? Summary of (A)cks, (M)odified and (N)ew: TestSupport: Add helper to fetch a URL on a host A TestSupport: allow caller of prepareguest_part_xencfg to specify viftype A create_webfile: Support use with guests as well as hosts. M Debian: refactor code to add preseed commands to the preseed file Debian: refactor preseeding of .ssh directories A Debian: Refactor installation of overlays, so it can be used for guests too Debian: add preseed_create_guest helper N ts-debian-hvm-install: Only apply EFI workaround for Wheezy A make-flight: Handle $BUILD_LVEXTEND_MAX in mfi-common:create_build_jobs() <------------ CONSIDER APPLYING TO HERE ------------> M distros: add support for installing Debian PV guests via d-i, flight and jobs distros: support booting Debian PV (d-i installed) guests with pvgrub. distros: Support pvgrub for Wheezy too. distros: support PV guest install from Debian netinst media. Test pygrub and pvgrub on the regular flights distros: add branch infrastructure A distros: Run a flight over the weekend. Debian: Handle lack of bootloader support in d-i on ARM. standalone: propagate result of command from with_logging ts-debian-di-install: Refactor root_disk specification make-flight: refactor PV debian tests M Add testing of non-LVM/phy disk backends. mfi-common: Allow make-*flight to filter the set of build jobs to include make-distros-flight: don't bother building for XSM. distros: email only me on play flights ts-debian-di-install: Use ftp.debian.org directly Ian. "Old" tested version had not actually been tested; therefore in this flight we test it, rather than a new candidate. The baseline, if any, is the most recent actually tested revision. flight 37326 xen-unstable play [play] http://osstest.xs.citrite.net/~osstest/testlogs/logs/37326/ Failures :-/ but no regressions. Tests which did not succeed, but are not blocking: test-amd64-amd64-rumpuserxen-amd64 1 build-check(1) blocked n/a test-amd64-i386-rumpuserxen-i386 1 build-check(1) blocked n/a test-amd64-i386-xl-qemuu-winxpsp3 16 guest-stop fail never pass test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm 9 debian-hvm-install fail never pass test-amd64-amd64-xl-qemuu-win7-amd64 16 guest-stop fail never pass test-armhf-armhf-xl-sedf-pin 12 migrate-support-check fail never pass test-amd64-amd64-xl-winxpsp3 16 guest-stop fail never pass test-amd64-i386-xl-qemut-winxpsp3 16 guest-stop fail never pass test-amd64-i386-xl-winxpsp3 16 guest-stop fail never pass test-amd64-amd64-xl-qemut-win7-amd64 16 guest-stop fail never pass test-amd64-amd64-libvirt 12 migrate-support-check fail never pass test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm 9 debian-hvm-install fail never pass test-armhf-armhf-xl-xsm 6 xen-boot fail never pass test-armhf-armhf-xl 12 migrate-support-check fail never pass test-amd64-i386-xl-qemuu-win7-amd64 16 guest-stop fail never pass test-amd64-amd64-xl-qemuu-winxpsp3 16 guest-stop fail never pass test-amd64-i386-xl-qemut-win7-amd64 16 guest-stop fail never pass test-amd64-i386-libvirt 12 migrate-support-check fail never pass test-amd64-amd64-xl-pvh-amd 11 guest-start fail never pass test-amd64-amd64-xl-pvh-intel 11 guest-start fail never pass test-amd64-amd64-xl-qemut-winxpsp3 16 guest-stop fail never pass test-amd64-i386-libvirt-xsm 11 guest-start fail never pass test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm 9 debian-hvm-install fail never pass test-armhf-armhf-xl-midway 12 migrate-support-check fail never pass test-armhf-armhf-xl-sedf 12 migrate-support-check fail never pass test-amd64-i386-xl-win7-amd64 16 guest-stop fail never pass test-armhf-armhf-xl-credit2 12 migrate-support-check fail never pass test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 16 guest-stop fail never pass test-amd64-i386-xl-winxpsp3-vcpus1 16 guest-stop fail never pass test-amd64-i386-xl-qemut-debianhvm-amd64-xsm 9 debian-hvm-install fail never pass test-amd64-i386-xl-qemut-winxpsp3-vcpus1 16 guest-stop fail never pass test-amd64-amd64-xl-win7-amd64 16 guest-stop fail never pass test-armhf-armhf-xl-multivcpu 12 migrate-support-check fail never pass test-amd64-amd64-libvirt-xsm 11 guest-start fail never pass test-amd64-amd64-xl-xsm 11 guest-start fail never pass test-armhf-armhf-libvirt-xsm 6 xen-boot fail never pass test-amd64-i386-xl-xsm 11 guest-start fail never pass test-armhf-armhf-libvirt 12 migrate-support-check fail never pass version targeted for testing: xen 3a28f760508fb35c430edac17a9efde5aff6d1d5 baseline version: xen 3a28f760508fb35c430edac17a9efde5aff6d1d5 jobs: test-amd64-amd64-xl pass test-armhf-armhf-xl pass test-amd64-i386-xl pass test-amd64-amd64-xl-qemut-debianhvm-amd64-xsm fail test-amd64-i386-xl-qemut-debianhvm-amd64-xsm fail test-amd64-amd64-xl-qemuu-debianhvm-amd64-xsm fail test-amd64-i386-xl-qemuu-debianhvm-amd64-xsm fail test-amd64-amd64-libvirt-xsm fail test-armhf-armhf-libvirt-xsm fail test-amd64-i386-libvirt-xsm fail test-amd64-amd64-xl-xsm fail test-armhf-armhf-xl-xsm fail test-amd64-i386-xl-xsm fail test-amd64-amd64-xl-pvh-amd fail test-amd64-i386-rhel6hvm-amd pass test-amd64-i386-qemut-rhel6hvm-amd pass test-amd64-i386-qemuu-rhel6hvm-amd pass test-amd64-amd64-xl-qemut-debianhvm-amd64 pass test-amd64-i386-xl-qemut-debianhvm-amd64 pass test-amd64-amd64-xl-qemuu-debianhvm-amd64 pass test-amd64-i386-xl-qemuu-debianhvm-amd64 pass test-amd64-i386-freebsd10-amd64 pass test-amd64-amd64-xl-qemuu-ovmf-amd64 pass test-amd64-i386-xl-qemuu-ovmf-amd64 pass test-amd64-amd64-rumpuserxen-amd64 broken test-amd64-amd64-xl-qemut-win7-amd64 fail test-amd64-i386-xl-qemut-win7-amd64 fail test-amd64-amd64-xl-qemuu-win7-amd64 fail test-amd64-i386-xl-qemuu-win7-amd64 fail test-amd64-amd64-xl-win7-amd64 fail test-amd64-i386-xl-win7-amd64 fail test-amd64-amd64-xl-credit2 pass test-armhf-armhf-xl-credit2 pass test-amd64-i386-freebsd10-i386 pass test-amd64-i386-rumpuserxen-i386 broken test-amd64-amd64-xl-pvh-intel fail test-amd64-i386-rhel6hvm-intel pass test-amd64-i386-qemut-rhel6hvm-intel pass test-amd64-i386-qemuu-rhel6hvm-intel pass test-amd64-amd64-libvirt pass test-armhf-armhf-libvirt pass test-amd64-i386-libvirt pass test-armhf-armhf-xl-midway pass test-amd64-amd64-xl-multivcpu pass test-armhf-armhf-xl-multivcpu pass test-amd64-amd64-pair pass test-amd64-i386-pair pass test-amd64-amd64-xl-sedf-pin pass test-armhf-armhf-xl-sedf-pin pass test-amd64-amd64-xl-sedf pass test-armhf-armhf-xl-sedf pass test-amd64-i386-xl-qemut-winxpsp3-vcpus1 fail test-amd64-i386-xl-qemuu-winxpsp3-vcpus1 fail test-amd64-i386-xl-winxpsp3-vcpus1 fail test-amd64-amd64-xl-qemut-winxpsp3 fail test-amd64-i386-xl-qemut-winxpsp3 fail test-amd64-amd64-xl-qemuu-winxpsp3 fail test-amd64-i386-xl-qemuu-winxpsp3 fail test-amd64-amd64-xl-winxpsp3 fail test-amd64-i386-xl-winxpsp3 fail ------------------------------------------------------------ sg-report-flight on osstest.xs.citrite.net logs: /home/xc_osstest/logs images: /home/xc_osstest/images Logs, config files, etc. are available at http://osstest.xs.citrite.net/~osstest/testlogs/logs Test harness code can be found at http://xenbits.xensource.com/gitweb?p=osstest.git;a=summary Published tested tree is already up to date.