All of lore.kernel.org
 help / color / mirror / Atom feed
* [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest
@ 2016-09-06 13:09 Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 01/25] Executive: Previous duration estimator: use overall time, not sum of steps Wei Liu
                   ` (24 more replies)
  0 siblings, 25 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu, andrew.cooper3

Hi all

This patch series integrates XTF into OSSTest. All the prerequisites have been
met, so this is no longer RFC.

Please see (currently Citrix only):

http://osstest.xs.citrite.net/~osstest/testlogs/logs/67651/

I'm going to run the same series a few more times to verify some assumptions.

Wei.

Ian Jackson (12):
  Executive: Previous duration estimator: use overall time, not sum of
    steps
  ts-hosts-allocate-Executive: Replace some odd commas with semicolons
  sg-run-job: Add emacs mode comment
  step status skip: Ignore in cs-bisection-step
  step status skip: Ignore in report_run_getinfo
  step status skip: Implement in sg-report-flight
  ts-hosts-allocate-Executive: pass $plan to hid_find_possibilities
  ts-hosts-allocate-Executive: Support diverse-CLASS hostflag
  DO NOT APPLY make-flight-diverse-test: test case for diverse-CLASS
    hostflag
  Executive: Support substeps
  DO NOT APPLY make-flight-substep-test
  DO NOT APPLY provide ts-substep-test

Wei Liu (13):
  ts-xen-build: always compile in FEP support
  ap-common: add xtf tree
  DO NOT APPLY point xtf to my personal tree
  BuildSupport: move buildcmd_stamped_logged here
  Introduce ts-xtf-build
  sg-run-job: create xtf build recipe
  Introduce ts-xtf-install
  mfi-common: create xtf build job for 4.4 onwards
  Introduce ts-xtf-fep
  Introduce ts-xtf-run
  sg-run-job: test-xtf recipe
  make-flight: create 5 xtf jobs
  Create XTF branch

 Osstest/BuildSupport.pm     |  15 ++++++
 Osstest/Executive.pm        |   3 +-
 Osstest/JobDB/Executive.pm  |  51 +++++++++++++++++++
 Osstest/JobDB/Standalone.pm |  10 ++++
 Osstest/TestSupport.pm      |  11 +++++
 README.planner              |   3 ++
 ap-common                   |   4 ++
 ap-fetch-version            |   4 ++
 ap-print-url                |   3 ++
 ap-push                     |   5 ++
 cr-daily-branch             |   7 +++
 cr-for-branches             |   2 +-
 cri-common                  |   1 +
 cs-bisection-step           |   1 +
 make-flight                 |  40 +++++++++++++++
 make-flight-diverse-test    |  11 +++++
 make-flight-substep-test    |  14 ++++++
 mfi-common                  |  25 ++++++++++
 sg-report-flight            |   6 ++-
 sg-run-job                  |  29 +++++++++++
 tcl/JobDB-Executive.tcl     |  32 ++++++++++++
 tcl/JobDB-Standalone.tcl    |   2 +
 ts-hosts-allocate-Executive |  69 +++++++++++++++++++++++---
 ts-substep-test             |  38 +++++++++++++++
 ts-xen-build                |  27 ++++-------
 ts-xtf-build                |  54 +++++++++++++++++++++
 ts-xtf-fep                  |  41 ++++++++++++++++
 ts-xtf-install              |  37 ++++++++++++++
 ts-xtf-run                  | 116 ++++++++++++++++++++++++++++++++++++++++++++
 29 files changed, 632 insertions(+), 29 deletions(-)
 create mode 100755 make-flight-diverse-test
 create mode 100755 make-flight-substep-test
 create mode 100755 ts-substep-test
 create mode 100755 ts-xtf-build
 create mode 100755 ts-xtf-fep
 create mode 100755 ts-xtf-install
 create mode 100755 ts-xtf-run

-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 01/25] Executive: Previous duration estimator: use overall time, not sum of steps
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 02/25] ts-hosts-allocate-Executive: Replace some odd commas with semicolons Wei Liu
                   ` (23 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: Wei Liu, Ian Jackson

From: Ian Jackson <ian.jackson@eu.citrix.com>

Some jobs runs steps in parallel.  Do not add up all the individual
step durations.  Instead, calculate the duration as the time between
first step start and last step finish.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
Signed-off-by: Wei Liu <wei.liu2@citrix.com>
---
 Osstest/Executive.pm | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/Osstest/Executive.pm b/Osstest/Executive.pm
index 7e31b35..7b40307 100644
--- a/Osstest/Executive.pm
+++ b/Osstest/Executive.pm
@@ -1068,7 +1068,7 @@ END
               FROM steps
              WHERE flight=? AND job=?
         )
-            SELECT sum(finished-started)
+            SELECT max(finished)-min(started)
                 AS duration
               FROM tsteps
              WHERE step != 'ts-hosts-allocate'
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 02/25] ts-hosts-allocate-Executive: Replace some odd commas with semicolons
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 01/25] Executive: Previous duration estimator: use overall time, not sum of steps Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 03/25] sg-run-job: Add emacs mode comment Wei Liu
                   ` (22 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: Wei Liu, Ian Jackson

From: Ian Jackson <ian.jackson@eu.citrix.com>

There does not seem to be any reason for this.  I think it must be a
leftover from a previous use of { A => X, B => Y, ... } syntax.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
CC: Wei Liu <wei.liu2@citrix.com>
---
 ts-hosts-allocate-Executive | 4 ++--
 1 file changed, 2 insertions(+), 2 deletions(-)

diff --git a/ts-hosts-allocate-Executive b/ts-hosts-allocate-Executive
index a8103d1..451c6fc 100755
--- a/ts-hosts-allocate-Executive
+++ b/ts-hosts-allocate-Executive
@@ -709,8 +709,8 @@ sub compute_booking_list () {
 	$book->{Job}= "$flight.$job";
 	$book->{Reso}= "$sel->{restype} $sel->{resname}";
 	$book->{Xinfo}= $hid->{Ident};
-	$book->{Start}= $best->{Start},
-	$book->{End}= $best->{Start} + $best->{Duration},
+	$book->{Start}= $best->{Start};
+	$book->{End}= $best->{Start} + $best->{Duration};
 	push @bookings, $book;
     }
     return { Bookings => \@bookings };
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 03/25] sg-run-job: Add emacs mode comment
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 01/25] Executive: Previous duration estimator: use overall time, not sum of steps Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 02/25] ts-hosts-allocate-Executive: Replace some odd commas with semicolons Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 04/25] step status skip: Ignore in cs-bisection-step Wei Liu
                   ` (21 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: Ian Jackson

From: Ian Jackson <ian.jackson@eu.citrix.com>

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
 sg-run-job | 1 +
 1 file changed, 1 insertion(+)

diff --git a/sg-run-job b/sg-run-job
index 6d455c7..1c154be 100755
--- a/sg-run-job
+++ b/sg-run-job
@@ -1,4 +1,5 @@
 #!/usr/bin/tclsh8.5
+# -*- Tcl -*-
 
 # This is part of "osstest", an automated testing framework for Xen.
 # Copyright (C) 2009-2013 Citrix Inc.
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 04/25] step status skip: Ignore in cs-bisection-step
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (2 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 03/25] sg-run-job: Add emacs mode comment Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 05/25] step status skip: Ignore in report_run_getinfo Wei Liu
                   ` (20 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: Ian Jackson

From: Ian Jackson <ian.jackson@eu.citrix.com>

cs-bisection step wants to completely ignore all skipped steps.  So we
adjust the one query which doesn't already insist on particular status
values, to filter out `skip'.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
 cs-bisection-step | 1 +
 1 file changed, 1 insertion(+)

diff --git a/cs-bisection-step b/cs-bisection-step
index 8d14423..a0595b2 100755
--- a/cs-bisection-step
+++ b/cs-bisection-step
@@ -573,6 +573,7 @@ END
           WHERE flight = ?
             AND job = ?
             AND testid = ?
+            AND status != 'skip'
     ");
 
     my $jobq= db_prepare("
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 05/25] step status skip: Ignore in report_run_getinfo
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (3 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 04/25] step status skip: Ignore in cs-bisection-step Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 06/25] step status skip: Implement in sg-report-flight Wei Liu
                   ` (19 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: Ian Jackson

From: Ian Jackson <ian.jackson@eu.citrix.com>

report_run_getinfo is trying to generate some HTML to describe a job's
(current) status.  It sometimes looks at the steps to find
`interesting' information to report.

Completely ignore steps with status `skip' for this purpose, just like
we ignore ones with status `pass'.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
 Osstest/Executive.pm | 1 +
 1 file changed, 1 insertion(+)

diff --git a/Osstest/Executive.pm b/Osstest/Executive.pm
index 7b40307..69f0319 100644
--- a/Osstest/Executive.pm
+++ b/Osstest/Executive.pm
@@ -312,6 +312,7 @@ sub report_run_getinfo ($) {
 	    SELECT * FROM steps
 	     WHERE flight=? AND job=?
 	       AND status!='pass'
+               AND status!='skip'
 	  ORDER BY stepno
 END
         $failstepq->execute($f->{flight}, $f->{job});
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 06/25] step status skip: Implement in sg-report-flight
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (4 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 05/25] step status skip: Ignore in report_run_getinfo Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 07/25] ts-hosts-allocate-Executive: pass $plan to hid_find_possibilities Wei Liu
                   ` (18 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: Ian Jackson

From: Ian Jackson <ian.jackson@eu.citrix.com>

* When we are doing archaeology, searching for flight(s) which ran a
  particular testid, ignore all flights where the testid was skipped.

* In a flight we are examining for failures we need to justify, do not
  regard `skip' as a failure which requires investigation.  We
  thusg treat `skip' in such a flight very like `pass'.

* Assign a colour (dark grey, almost like the background) and display
  priority (very low) to `skip', so that they turn up nicely in the
  HTML grids.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
---
 sg-report-flight | 6 ++++--
 1 file changed, 4 insertions(+), 2 deletions(-)

diff --git a/sg-report-flight b/sg-report-flight
index ca9ba18..dbb17be 100755
--- a/sg-report-flight
+++ b/sg-report-flight
@@ -162,6 +162,7 @@ sub findaflight ($$$$$) {
 
     my $checkq= db_prepare(<<END);
         SELECT status FROM steps WHERE flight=? AND job=? AND testid=?
+                                   AND status!='skip'
 END
 
     my $thatflight= $specver{that}{flight};
@@ -460,7 +461,7 @@ END
 
             my $fi= { Job => $j, Step => $s };
             
-            if ($s->{status} ne 'pass') {
+            if ($s->{status} ne 'pass' && $s->{status} ne 'skip') {
                 $fi= $storefail->($s);
                 $foundfail= 1;
             }
@@ -1083,7 +1084,8 @@ END
 
 sub html_status2_colour_priority ($) {
     my ($st) = @_;
-    return ($st eq 'pass' ? ('#008800',100) :
+    return ($st eq 'skip' ? ('#555555', 50) :
+            $st eq 'pass' ? ('#008800',100) :
             $st eq 'fail' ? ('#ff8888',200) :
             $st eq 'running' ? ('#666666',250) :
             ('#ffff00',300));
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 07/25] ts-hosts-allocate-Executive: pass $plan to hid_find_possibilities
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (5 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 06/25] step status skip: Implement in sg-report-flight Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 08/25] ts-hosts-allocate-Executive: Support diverse-CLASS hostflag Wei Liu
                   ` (17 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: Wei Liu, Ian Jackson

From: Ian Jackson <ian.jackson@eu.citrix.com>

We are going to want this to implement the new diverse-CLASS hostflag.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
CC: Wei Liu <wei.liu2@citrix.com>
---
 ts-hosts-allocate-Executive | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

diff --git a/ts-hosts-allocate-Executive b/ts-hosts-allocate-Executive
index 451c6fc..6a03d32 100755
--- a/ts-hosts-allocate-Executive
+++ b/ts-hosts-allocate-Executive
@@ -272,8 +272,8 @@ sub compute_hids () {
     }
 }
 
-sub hid_find_possibilities ($) {
-    my ($hid) = @_;
+sub hid_find_possibilities ($$) {
+    my ($hid, $plan) = @_;
 
     delete $hid->{Candidates};
 
@@ -647,7 +647,7 @@ sub attempt_allocation {
 
     foreach my $hid (@hids) {
 	delete $hid->{Allocated};
-	hid_find_possibilities($hid);
+	hid_find_possibilities($hid, $plan);
     }
     optimally_order_hids();
 
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 08/25] ts-hosts-allocate-Executive: Support diverse-CLASS hostflag
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (6 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 07/25] ts-hosts-allocate-Executive: pass $plan to hid_find_possibilities Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 09/25] DO NOT APPLY make-flight-diverse-test: test case for " Wei Liu
                   ` (16 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: Wei Liu, Ian Jackson

From: Ian Jackson <ian.jackson@eu.citrix.com>

Specifically:
 * Parse it out of the hostflags when constructing the hid
 * Look for the `hostalloc-diverse-FLIGHT-CLASS' ClientNote in
   the resource plan, to avoid inappropriately planning to reuse hosts.
 * Look for the `diversehosts_CLASS' runvar in other jobs in this flight,
   to find out who might have allocated with the same CLASS.  (This
   sort of duplicates information in *hostflags and *host, but digging
   the information out of the latter two would be very tiresome.)
 * Check each of the above for each candidate host.
 * Set the ClientNote when we are preparing a booking.
 * Set the runvar when we do the allocation.
 * Document the ClientNote.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
CC: Wei Liu <wei.liu2@citrix.com>
---
 README.planner              |  3 +++
 ts-hosts-allocate-Executive | 59 +++++++++++++++++++++++++++++++++++++++++++--
 2 files changed, 60 insertions(+), 2 deletions(-)

diff --git a/README.planner b/README.planner
index 80c2506..bb18432 100644
--- a/README.planner
+++ b/README.planner
@@ -335,3 +335,6 @@ Note key name (key in ClientNotes):
 	Note value format:
 
 (none yet defined)
+
+hostalloc-diverse-<flight>-<class>
+	{ <hostname> => 'info for debug', ... }
diff --git a/ts-hosts-allocate-Executive b/ts-hosts-allocate-Executive
index 6a03d32..706ab6d 100755
--- a/ts-hosts-allocate-Executive
+++ b/ts-hosts-allocate-Executive
@@ -213,7 +213,7 @@ sub compute_hids () {
     our %equivs;
 
     foreach my $ident (@ARGV) {
-        my $hid= { Conds => { host => [] } };
+        my $hid= { Conds => { host => [] }, Diverse => [] };
         my $override_use;
         if ($ident =~ m/\=/) {
             $hid->{OverrideUse}= $'; #'
@@ -251,6 +251,11 @@ sub compute_hids () {
                 my $equiv= $hid->{Equiv}= $equivs{$formalclass};
                 print DEBUG "HID $ident FLAG $flag EQUIV $equiv->{Wanted}\n";
                 next;
+            } elsif ($flag =~ m/^diverse-/) {
+                my $dclass= $'; #'
+		push @{ $hid->{Diverse} }, $dclass;
+		print DEBUG "HID $ident FLAG $flag DIVERSE $dclass\n";
+                next;
             } elsif ($flag =~ m/^\w+:/) {
 		my (@c) = split /:/, $flag;
 		my $o;
@@ -322,9 +327,40 @@ END
 	     LIMIT 1;
 END
 
+    # we are looking for other jobs where the runvar diversehosts_CLASS
+    # (a space-separated list of hostnames) has been set
+    my $diverseq = $dbh_tests->prepare(<<END);
+            SELECT r.job, r.val
+              FROM runvars r
+             WHERE r.flight = ?
+               AND r.name = ?
+END
+
     my @candidates;
     my $any=0;
 
+    my %diverse_excluded;
+    # $diverse_excluded{CLASS}{HOST} = 1
+    foreach my $dclass (@{ $hid->{Diverse} }) {
+	print DEBUG "HID $hid->{Ident} DIVERSE $dclass:";
+	# look for allocated
+	$diverseq->execute($flight, "diversehosts_$dclass");
+	my ($djob, $dhosts) = $diverseq->fetchrow_array();
+	my $excl = sub {
+	    my ($dh,$why) = @_;
+	    print DEBUG " $dh ($why)";
+	    $diverse_excluded{$dclass}{$dh} = $why;
+	};
+	if (defined $dhosts) {
+	    $excl->($_, "alloc'd job $job") foreach split / /, $dhosts;
+	}
+	# look for booked
+	my $notekey = "hostalloc-diverse-$flight-$dclass";
+	my $booked = $plan->{ClientNotes}{$notekey};
+	$excl->($_, "boooked ".$booked->{$_}) foreach sort keys %$booked;
+	print DEBUG ".\n";
+    }
+
   CANDIDATE:
     while (my $candrow= $findhostsq->fetchrow_hashref()) {
         $candrow->{Warnings}= [ ];
@@ -375,6 +411,13 @@ END
                 "specified host lacks flags @missingflags";
         }
 
+	foreach my $dclass (@{ $hid->{Diverse} }) {
+	    my $excl = $diverse_excluded{$dclass}{ $candrow->{resname} };
+	    next unless defined $excl;
+	    print DEBUG "$dbg excluded by diverse-$dclass ($excl)\n";
+	    next CANDIDATE unless defined $use;
+	}
+
 	foreach my $c (@{ $hid->{Conds}{$candrow->{restype}} }) {
 	    if (!$c->check($candrow->{restype}, $candrow->{resname})) {
 		print DEBUG "$dbg failed $c condition\n";
@@ -629,6 +672,13 @@ sub alloc_hosts () {
         my $use= $r{ $hid->{Ident} };
         next if defined $use;
         store_runvar($hid->{Ident}, $sel->{resname});
+	foreach my $dclass (@{ $hid->{Diverse} }) {
+	    my $drk = "diversehosts_$dclass";
+	    my %dused;
+	    $dused{$_} = 1 foreach split / /, ($r{$drk} // '');
+	    $dused{$sel->{resname}} = 1;
+	    store_runvar($drk, join ' ', sort keys %dused);
+	}
     }
 
     logm("host allocation: all successful and recorded.");
@@ -697,6 +747,7 @@ sub attempt_allocation {
 
 sub compute_booking_list () {
     my @bookings;
+    my %cnotes;
     foreach my $hid (@hids) {
 	my $sel= $hid->{Selected};
 	my $alloc= $hid->{Allocated};
@@ -712,8 +763,12 @@ sub compute_booking_list () {
 	$book->{Start}= $best->{Start};
 	$book->{End}= $best->{Start} + $best->{Duration};
 	push @bookings, $book;
+	foreach my $dclass (@{ $hid->{Diverse} }) {
+	    my $notekey = "hostalloc-diverse-$flight-$dclass";
+	    $cnotes{$notekey}{$sel->{resname}} = "$job $hid->{Ident}";
+	}
     }
-    return { Bookings => \@bookings };
+    return { Bookings => \@bookings, ClientNotes => \%cnotes };
 }
 
 #---------- actually allocate things ----------
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 09/25] DO NOT APPLY make-flight-diverse-test: test case for diverse-CLASS hostflag
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (7 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 08/25] ts-hosts-allocate-Executive: Support diverse-CLASS hostflag Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 10/25] Executive: Support substeps Wei Liu
                   ` (15 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: Wei Liu, Ian Jackson

From: Ian Jackson <ian.jackson@eu.citrix.com>

This generates a flight with two jobs, test-1 and test-2.  They can be
run, and are supposed to allocate different hosts, and will bomb out
after host allocation.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
CC: Wei Liu <wei.liu2@citrix.com>
---
 make-flight-diverse-test | 11 +++++++++++
 1 file changed, 11 insertions(+)
 create mode 100755 make-flight-diverse-test

diff --git a/make-flight-diverse-test b/make-flight-diverse-test
new file mode 100755
index 0000000..dffd23b
--- /dev/null
+++ b/make-flight-diverse-test
@@ -0,0 +1,11 @@
+#!/bin/sh
+set -e
+
+flight=`./cs-flight-create play xen-unstable`
+
+for j in test-1 test-2; do
+    ./cs-job-create $flight $j test-debian \
+        all_hostflags="blessed-adhoc,diverse-d"
+done
+
+echo $flight
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 10/25] Executive: Support substeps
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (8 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 09/25] DO NOT APPLY make-flight-diverse-test: test case for " Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 11/25] DO NOT APPLY make-flight-substep-test Wei Liu
                   ` (14 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: Wei Liu, Ian Jackson

From: Ian Jackson <ian.jackson@eu.citrix.com>

ts-* scripts can now create `substeps'.  For the purposes of
archaeology etc., a substep is just like a step.  But it does
correspond to a single specific ts-* invocation.

Instead, it is started and finished explicitly as required.

The whole job implementation code needs to explicitly assign a unique
stable testid to each substep.

The `script' parameter is stored in the `step' field in the database,
which is used only for reporting.  These do not need to be unique.

All substeps started are should also be finished, by the end of the
job.  If this is not done, the job will be regarded as broken (if it
is not already failed or aborted).  (But a substep might be finished
by a different ts-* script to the one that started it.)

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
CC: Wei Liu <wei.liu2@citrix.com>
---
v2: Permit setting the step status to `skip' too, now that this
    patch is rebased onto the step status skip support.
---
 Osstest/JobDB/Executive.pm  | 51 +++++++++++++++++++++++++++++++++++++++++++++
 Osstest/JobDB/Standalone.pm | 10 +++++++++
 Osstest/TestSupport.pm      | 11 ++++++++++
 sg-run-job                  |  6 ++++++
 tcl/JobDB-Executive.tcl     | 32 ++++++++++++++++++++++++++++
 tcl/JobDB-Standalone.tcl    |  2 ++
 6 files changed, 112 insertions(+)

diff --git a/Osstest/JobDB/Executive.pm b/Osstest/JobDB/Executive.pm
index c21eba7..76f3293 100644
--- a/Osstest/JobDB/Executive.pm
+++ b/Osstest/JobDB/Executive.pm
@@ -163,6 +163,57 @@ END
     logm("starting $flight started=$now") if $count>0;
 }
 
+sub step_start ($$) { #method
+    my ($jd,$testid,$script) = @_;
+    my $snq = $dbh_tests->prepare(<<END);
+        SELECT max(stepno) AS maxstep FROM steps
+            WHERE flight=? AND job=?
+END
+    my $createq = $dbh_tests->prepare(<<END);
+        INSERT INTO steps (flight,job,stepno, step,status, testid,started)
+            VALUES (?,?,?, ?,'running', ?,?)
+END
+    my $stepno;
+    db_retry($flight,[qw(running)], $dbh_tests,[qw(flights)],sub {
+	$snq->execute($flight,$job);
+	($stepno) = $snq->fetchrow_array();
+	$stepno //= 0;
+	$stepno++;
+	$createq->execute($flight,$job,$stepno, $script, $testid,time);
+    });
+    logm("---------- substep $stepno $testid running ----------");
+}
+
+sub step_finish ($$) { #method
+    my ($jd,$testid,$stepstatus) = @_;
+    die "$flight.$job $testid $stepstatus" unless grep { $stepstatus eq $_ }
+	qw(pass fail skip blocked broken);
+    my $checkq = $dbh_tests->prepare(<<END);
+        SELECT stepno, status
+          FROM steps
+         WHERE flight=?
+           AND job=?
+           AND testid=?
+END
+    my $setq = $dbh_tests->prepare(<<END);
+        UPDATE steps
+           SET status=?, finished=?
+         WHERE flight=?
+           AND job=?
+           AND testid=?
+           AND stepno=?
+END
+    my ($stepno,$oldstatus);
+    db_retry($flight,[qw(running)], $dbh_tests,[qw(flights)],sub {
+	$checkq->execute($flight,$job,$testid);
+	($stepno, $oldstatus) = $checkq->fetchrow_array();
+	die "$flight.$job $testid $stepno $oldstatus ?"
+	    unless $oldstatus eq 'running';
+	$setq->execute($stepstatus,time, $flight,$job,$testid, $stepno);
+    });
+    logm("---------- substep $stepno $testid $stepstatus ----------");
+}
+
 sub host_check_allocated ($$) { #method
     my ($jd, $ho) = @_;
 
diff --git a/Osstest/JobDB/Standalone.pm b/Osstest/JobDB/Standalone.pm
index 98d0173..21ea07b 100644
--- a/Osstest/JobDB/Standalone.pm
+++ b/Osstest/JobDB/Standalone.pm
@@ -87,6 +87,16 @@ sub current_flight ($) {
 
 sub job_ensure_started ($) { }
 
+sub step_start ($$) {
+    my ($jd,$testid,$script) = @_;
+    logm("========== $flight.$job step $testid running $script ==========");
+}
+
+sub step_finish ($$) { #method
+    my ($jd,$testid,$stepstatus) = @_;
+    logm("========== $flight.$job step $testid $stepstatus ==========");
+}
+
 sub host_check_allocated ($$) { #method
     my ($jd, $ho) = @_;
 
diff --git a/Osstest/TestSupport.pm b/Osstest/TestSupport.pm
index 7eb7bc4..04b8b3f 100644
--- a/Osstest/TestSupport.pm
+++ b/Osstest/TestSupport.pm
@@ -43,6 +43,7 @@ BEGIN {
                       ts_get_host_guest
 
                       fail broken logm $logm_handle $logm_prefix
+                      substep_start substep_finish
                       get_filecontents
                       report_once
 
@@ -231,6 +232,16 @@ END
                          : "($flight.$job not marked $newst)");
 }
 
+sub substep_start ($$) {
+    my ($testid,$script) = @_;
+    $mjobdb->step_start($testid,$script);
+}
+
+sub substep_finish ($$) {
+    my ($testid,$stepstatus) = @_;
+    $mjobdb->step_finish($testid,$stepstatus);
+}
+
 sub get_filecontents ($;$) {
     my ($path, $ifnoent) = @_;  # $ifnoent=undef => is error
     my $data= get_filecontents_core_quiet($path);
diff --git a/sg-run-job b/sg-run-job
index 1c154be..01c57aa 100755
--- a/sg-run-job
+++ b/sg-run-job
@@ -91,6 +91,12 @@ proc run-job {job} {
 	run-ts  !broken capture-logs      ts-logs-capture + host
     }
 
+    if {$ok} {
+        if {[jobdb::job-check-escaped-steps $flight $job]} {
+            set ok 0
+        }
+    }
+
     if {$truncate} {
        if {$ok} { setstatus truncated                                     }
        set ok 0
diff --git a/tcl/JobDB-Executive.tcl b/tcl/JobDB-Executive.tcl
index 472bab5..6225bd9 100644
--- a/tcl/JobDB-Executive.tcl
+++ b/tcl/JobDB-Executive.tcl
@@ -80,6 +80,38 @@ proc read-runvar {flight job name {val {}}} {
     return $val
 }
 
+proc job-check-escaped-steps {flight job} {
+    global runstepinfo
+    transaction flights {
+	set any 0
+
+	db-execute-array runstepinfo "
+            SELECT stepno, testid
+              FROM steps
+             WHERE flight = [pg_quote $flight]
+               AND job = [pg_quote $job]
+               AND status = 'running'
+        " {
+	    logputs stderr \
+ "$flight.$job step #$runstepinfo(stepno) $runstepinfo(testid) still running!"
+	    set any 1
+	}
+
+	if {$any} {
+	    db-execute "
+                UPDATE jobs
+		   SET status='broken'
+		 WHERE flight = [pg_quote $flight]
+		   AND job = [pg_quote $job]
+		   AND status<>'aborted'
+		   AND status<>'broken'
+		   AND status<>'fail'
+            "
+	}
+    }
+    return $any
+}
+
 proc set-flight {} {
     global flight argv env
 
diff --git a/tcl/JobDB-Standalone.tcl b/tcl/JobDB-Standalone.tcl
index 2d8b319..375e6ba 100644
--- a/tcl/JobDB-Standalone.tcl
+++ b/tcl/JobDB-Standalone.tcl
@@ -57,6 +57,8 @@ proc read-runvar {flight job name {val {}}} {
     return $val
 }
 
+proc job-check-escaped-steps {flight job} { }
+
 proc ensure-db-open {} {
     global c
     if {![catch { osstestdb version }]} { return }
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 11/25] DO NOT APPLY make-flight-substep-test
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (9 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 10/25] Executive: Support substeps Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 12/25] DO NOT APPLY provide ts-substep-test Wei Liu
                   ` (13 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: Wei Liu, Ian Jackson

From: Ian Jackson <ian.jackson@eu.citrix.com>

This is a simple test case for substeps.

Signed-off-by: Ian Jackson <Ian.Jackson@eu.citrix.com>
CC: Wei Liu <wei.liu2@citrix.com>
---
 make-flight-substep-test | 14 ++++++++++++++
 sg-run-job               |  7 +++++++
 2 files changed, 21 insertions(+)
 create mode 100755 make-flight-substep-test

diff --git a/make-flight-substep-test b/make-flight-substep-test
new file mode 100755
index 0000000..44b0451
--- /dev/null
+++ b/make-flight-substep-test
@@ -0,0 +1,14 @@
+#!/bin/sh
+set -e
+
+flight=`./cs-flight-create play xen-unstable`
+
+runvars=bogus=0
+
+for j in test-1 test-2; do
+    ./cs-job-create $flight $j test-substeps \
+	$runvars
+    runvars=bogus=1
+done
+
+echo $flight
diff --git a/sg-run-job b/sg-run-job
index 01c57aa..314019c 100755
--- a/sg-run-job
+++ b/sg-run-job
@@ -459,6 +459,13 @@ proc run-job/test-rumprun {} {
                  ts-guest-destroy-hard            host   $g   +
 }
 
+proc need-hosts/test-substeps {} { }
+proc run-job/test-substeps {} {
+    run-ts . =   ts-substep-test suba:foo 1 subb:wombat suba=pass
+    run-ts . =.2 ts-substep-test subx:foo 1             subx=fail
+    run-ts . =.3 ts-substep-test ,bogus     subb=pass
+}
+
 if {[file exists sg-run-job-adhoc]} {
     source sg-run-job-adhoc
 }
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 12/25] DO NOT APPLY provide ts-substep-test
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (10 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 11/25] DO NOT APPLY make-flight-substep-test Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 13/25] ts-xen-build: always compile in FEP support Wei Liu
                   ` (12 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: Ian Jackson

From: Ian Jackson <ian.jackson@eu.citrix.com>

---
 ts-substep-test | 38 ++++++++++++++++++++++++++++++++++++++
 1 file changed, 38 insertions(+)
 create mode 100755 ts-substep-test

diff --git a/ts-substep-test b/ts-substep-test
new file mode 100755
index 0000000..cea8a6d
--- /dev/null
+++ b/ts-substep-test
@@ -0,0 +1,38 @@
+#!/usr/bin/perl -w
+# This is part of "osstest", an automated testing framework for Xen.
+# Copyright (C) 2016 Citrix Inc.
+# 
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU Affero General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+# 
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU Affero General Public License for more details.
+# 
+# You should have received a copy of the GNU Affero General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+
+use strict qw(vars);
+use DBI;
+use Osstest;
+use Osstest::TestSupport;
+
+tsreadconfig();
+
+foreach my $arg (@ARGV) {
+    if ($arg =~ m/\:/) {
+	substep_start($`, $');
+    } elsif ($arg =~ m/\=/) {
+	substep_finish($`, $');
+    } elsif ($arg =~ m/^\d+$/) {
+	sleep $arg;
+    } elsif ($arg =~ m/^\,/) {
+	print "checking $'\n";
+	exit 0 if $r{$'};
+    } else {
+	die;
+    }
+}
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 13/25] ts-xen-build: always compile in FEP support
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (11 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 12/25] DO NOT APPLY provide ts-substep-test Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 14/25] ap-common: add xtf tree Wei Liu
                   ` (11 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

By default FEP depends on debug flag. When we are near release the debug
flag will be turned off. In order to test a release build, we explicitly
enable FEP in build configuration.

Since we target Xen versions that already have Kconfig support, only a
Kconfig option is created for now.

We can easily add config option for older Xen when necessary.

Note that this only compiles in FEP support. To enable it a user needs
to explicitly specify fep=1 in hypervisor command line.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
---
 ts-xen-build | 7 ++++++-
 1 file changed, 6 insertions(+), 1 deletion(-)

diff --git a/ts-xen-build b/ts-xen-build
index cc171ef..d0b7612 100755
--- a/ts-xen-build
+++ b/ts-xen-build
@@ -97,9 +97,14 @@ END
                (nonempty($earlyprintk) ? <<END : '').
 	echo >>.config CONFIG_EARLY_PRINTK=$earlyprintk
 END
-               ($ho->{Suite} =~ m/squeeze|wheezy/ ? <<END : '') #Debian #693721
+               ($ho->{Suite} =~ m/squeeze|wheezy/ ? <<END : ''). #Debian #693721
 	echo >>.config PYTHON_PREFIX_ARG=
 END
+        <<END
+	if test -f xen/Kconfig; then
+		echo >>xen/.config CONFIG_HVM_FEP=y
+	fi
+END
                );
 }
 
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 14/25] ap-common: add xtf tree
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (12 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 13/25] ts-xen-build: always compile in FEP support Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 15/25] DO NOT APPLY point xtf to my personal tree Wei Liu
                   ` (10 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
---
 ap-common | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/ap-common b/ap-common
index 62d2e4f..6d25025 100644
--- a/ap-common
+++ b/ap-common
@@ -33,6 +33,10 @@
 
 : ${TREEVCS_LINUX:=git}
 
+: ${TREE_XTF:=git://xenbits.xen.org/xtf.git}
+: ${PUSH_TREE_XTF:=$XENBITS:/home/xen/git/osstest/xtf.git}
+: ${BASE_TREE_XTF:=git://xenbits.xen.org/osstest/xtf.git}
+
 : ${TREE_LIBVIRT:=git://libvirt.org/libvirt.git}
 : ${PUSH_TREE_LIBVIRT:=$XENBITS:/home/xen/git/libvirt.git}
 : ${BASE_TREE_LIBVIRT:=git://xenbits.xen.org/libvirt.git}
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 15/25] DO NOT APPLY point xtf to my personal tree
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (13 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 14/25] ap-common: add xtf tree Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 16/25] BuildSupport: move buildcmd_stamped_logged here Wei Liu
                   ` (9 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

The master branch of this tree is xtf.git master + one test case that
always fails.
---
 ap-common | 6 +++---
 1 file changed, 3 insertions(+), 3 deletions(-)

diff --git a/ap-common b/ap-common
index 6d25025..9cdb1c1 100644
--- a/ap-common
+++ b/ap-common
@@ -33,9 +33,9 @@
 
 : ${TREEVCS_LINUX:=git}
 
-: ${TREE_XTF:=git://xenbits.xen.org/xtf.git}
-: ${PUSH_TREE_XTF:=$XENBITS:/home/xen/git/osstest/xtf.git}
-: ${BASE_TREE_XTF:=git://xenbits.xen.org/osstest/xtf.git}
+: ${TREE_XTF:=git://xenbits.xen.org/people/liuw/xtf.git}
+: ${PUSH_TREE_XTF:=/export/home/weil/xtf.git/.git}
+: ${BASE_TREE_XTF:=git://xenbits.xen.org/people/liuw/xtf.git}
 
 : ${TREE_LIBVIRT:=git://libvirt.org/libvirt.git}
 : ${PUSH_TREE_LIBVIRT:=$XENBITS:/home/xen/git/libvirt.git}
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 16/25] BuildSupport: move buildcmd_stamped_logged here
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (14 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 15/25] DO NOT APPLY point xtf to my personal tree Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 17/25] Introduce ts-xtf-build Wei Liu
                   ` (8 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

... so that other build scripts can use it, too.

It now accepts one more parameter called "component" to be useful in
other build scripts.

No functional change.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
---
 Osstest/BuildSupport.pm | 15 +++++++++++++++
 ts-xen-build            | 20 +++-----------------
 2 files changed, 18 insertions(+), 17 deletions(-)

diff --git a/Osstest/BuildSupport.pm b/Osstest/BuildSupport.pm
index d59eace..d005ca9 100644
--- a/Osstest/BuildSupport.pm
+++ b/Osstest/BuildSupport.pm
@@ -36,6 +36,7 @@ BEGIN {
                       $whhost $ho
 
                       builddirsprops
+                      buildcmd_stamped_logged
                       $builddir $makeflags
 
                       prepbuilddirs
@@ -56,6 +57,20 @@ our ($whhost,$ho);
 our ($builddir,$makeflags);
 our ($xendist);
 
+sub buildcmd_stamped_logged ($$$$$$) {
+    my ($timeout, $component, $stampname, $prefix, $cmd, $suffix) = @_;
+    target_cmd_build($ho, $timeout, $builddir, <<END);
+        cd $component
+        $prefix
+        ( $cmd 2>&1 &&             touch ../$stampname-ok-stamp
+        ) |tee ../$stampname-log
+        test -f ../$stampname-ok-stamp
+        $suffix
+        echo ok.
+END
+#/;
+}
+
 sub selectbuildhost {
     # pass \@ARGV
     my ($av) = @_;
diff --git a/ts-xen-build b/ts-xen-build
index d0b7612..07a69ec 100755
--- a/ts-xen-build
+++ b/ts-xen-build
@@ -108,20 +108,6 @@ END
                );
 }
 
-sub buildcmd_stamped_logged ($$$$$) {
-    my ($timeout, $stampname, $prefix, $cmd, $suffix) = @_;
-    target_cmd_build($ho, $timeout, $builddir, <<END);
-        cd xen
-        $prefix
-        ( $cmd 2>&1 &&             touch ../$stampname-ok-stamp
-        ) |tee ../$stampname-log
-        test -f ../$stampname-ok-stamp
-        $suffix
-        echo ok.
-END
-#/;
-}
-
 sub build () {
     my $xend_opt= $r{enable_xend} =~ m/true/ ? "--enable-xend" : "--disable-xend";
     my $ovmf_opt= $r{enable_ovmf} =~ m/true/ ? "--enable-ovmf" : "--disable-ovmf";
@@ -130,7 +116,7 @@ sub build () {
     my $configure_suffix = $r{cmdsuffix_configure} // '';
     my $make_prefix =      $r{cmdprefix_make}      // '';
 
-    buildcmd_stamped_logged(600, 'configure', <<END,<<END,<<END);
+    buildcmd_stamped_logged(600, 'xen', 'configure', <<END,<<END,<<END);
             if test -f configure; then
                 if grep -q -- $xend_opt tools/configure ; then
 		    xend=$xend_opt
@@ -145,13 +131,13 @@ END
 END
 #/;
 
-    buildcmd_stamped_logged(600, 'kconfig', '',<<END,'') if $dokconfig;
+    buildcmd_stamped_logged(600, 'xen', 'kconfig', '',<<END,'') if $dokconfig;
             if test -f xen/Kconfig; then
                 $make_prefix make -C xen olddefconfig
             fi
 END
 
-    buildcmd_stamped_logged(9000, 'build', '',<<END,'');
+    buildcmd_stamped_logged(9000, 'xen', 'build', '',<<END,'');
             $make_prefix make $makeflags @ARGV
 END
 
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 17/25] Introduce ts-xtf-build
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (15 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 16/25] BuildSupport: move buildcmd_stamped_logged here Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 18/25] sg-run-job: create xtf build recipe Wei Liu
                   ` (7 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

Clone, build and package XTF for later use.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
---
 ts-xtf-build | 54 ++++++++++++++++++++++++++++++++++++++++++++++++++++++
 1 file changed, 54 insertions(+)
 create mode 100755 ts-xtf-build

diff --git a/ts-xtf-build b/ts-xtf-build
new file mode 100755
index 0000000..1af1b4e
--- /dev/null
+++ b/ts-xtf-build
@@ -0,0 +1,54 @@
+#!/usr/bin/perl -w
+# This is part of "osstest", an automated testing framework for Xen.
+# Copyright (C) 2016 Citrix Inc.
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU Affero General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU Affero General Public License for more details.
+#
+# You should have received a copy of the GNU Affero General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+
+use strict qw(vars);
+use DBI;
+use Osstest;
+use File::Path;
+use POSIX;
+use Osstest::TestSupport;
+use Osstest::BuildSupport;
+
+tsreadconfig();
+selectbuildhost(\@ARGV);
+# remaining arguments are passed as targets to "make"
+builddirsprops();
+
+sub checkout () {
+    prepbuilddirs();
+
+    build_clone($ho, 'xtf', $builddir, 'xtf');
+}
+
+sub build_and_install () {
+
+    buildcmd_stamped_logged(300, 'xtf', 'build', '', <<END, '');
+        make xtfdir=/home/xtf @ARGV
+END
+
+    buildcmd_stamped_logged(300, 'xtf', 'dist', '', <<END, '');
+        make xtfdir=/home/xtf DESTDIR=$builddir/xtfdist install
+END
+}
+
+sub stash () {
+    built_stash($ho, $builddir, "xtfdist", "xtfdist");
+}
+
+checkout();
+build_and_install();
+stash();
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 18/25] sg-run-job: create xtf build recipe
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (16 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 17/25] Introduce ts-xtf-build Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 19/25] Introduce ts-xtf-install Wei Liu
                   ` (6 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
---
 sg-run-job | 5 +++++
 1 file changed, 5 insertions(+)

diff --git a/sg-run-job b/sg-run-job
index 314019c..95ee89e 100755
--- a/sg-run-job
+++ b/sg-run-job
@@ -476,6 +476,7 @@ proc need-hosts/build {} { return BUILD }
 proc need-hosts/build-kern {} { return BUILD }
 proc need-hosts/build-libvirt {} { return BUILD }
 proc need-hosts/build-rumprun {} { return BUILD }
+proc need-hosts/build-xtf {} { return BUILD }
 
 proc run-job/build {} {
     run-ts . = ts-xen-build
@@ -496,6 +497,10 @@ proc run-job/build-rumprun {} {
         xenstorels ::/usr/local/bin/xenstore-ls
 }
 
+proc run-job/build-xtf {} {
+    run-ts . = ts-xtf-build
+}
+
 proc prepare-build-host {} {
     global jobinfo
     run-ts broken = ts-hosts-allocate + host
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 19/25] Introduce ts-xtf-install
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (17 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 18/25] sg-run-job: create xtf build recipe Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 14:01   ` Ian Jackson
  2016-09-06 13:09 ` [OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards Wei Liu
                   ` (5 subsequent siblings)
  24 siblings, 1 reply; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

Extract XTF to the desired location.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
---
v3: fix typo in commit message
v2: remove reference of runvar xtfdir
---
 ts-xtf-install | 37 +++++++++++++++++++++++++++++++++++++
 1 file changed, 37 insertions(+)
 create mode 100755 ts-xtf-install

diff --git a/ts-xtf-install b/ts-xtf-install
new file mode 100755
index 0000000..040772e
--- /dev/null
+++ b/ts-xtf-install
@@ -0,0 +1,37 @@
+#!/usr/bin/perl -w
+# This is part of "osstest", an automated testing framework for Xen.
+# Copyright (C) 2016 Citrix Inc.
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU Affero General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU Affero General Public License for more details.
+#
+# You should have received a copy of the GNU Affero General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+
+use strict qw(vars);
+use DBI;
+use Osstest;
+use Osstest::TestSupport;
+
+tsreadconfig();
+
+our ($whhost) = @ARGV;
+$whhost ||= 'host';
+
+our $ho= selecthost($whhost);
+
+sub extract () {
+    my %distpath;
+
+    target_extract_jobdistpath($ho, "xtf", "path_xtfdist",
+                               $r{xtfbuildjob}, \%distpath);
+}
+
+extract();
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (18 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 19/25] Introduce ts-xtf-install Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 14:06   ` Ian Jackson
  2016-09-06 13:09 ` [OSSTEST PATCH v3 21/25] Introduce ts-xtf-fep Wei Liu
                   ` (4 subsequent siblings)
  24 siblings, 1 reply; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

Xen 4.4 is the oldest one that we still provide security support at this
point in time.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
---
 mfi-common | 25 +++++++++++++++++++++++++
 1 file changed, 25 insertions(+)

diff --git a/mfi-common b/mfi-common
index 8f27923..0864266 100644
--- a/mfi-common
+++ b/mfi-common
@@ -67,6 +67,17 @@ xenbranch_xsm_variants () {
     esac
 }
 
+xenbranch_wants_xtf_tests () {
+    case "$xenbranch" in
+    xen-3.*-testing) return 1;;
+    xen-4.0-testing) return 1;;
+    xen-4.1-testing) return 1;;
+    xen-4.2-testing) return 1;;
+    xen-4.3-testing) return 1;;
+    *) return 0;;
+    esac
+}
+
 job_create_build () {
   job_create_build_filter_callback "$@" || return 0
 
@@ -265,6 +276,20 @@ create_build_jobs () {
 
     fi
 
+    if xenbranch_wants_xtf_tests; then
+        # Only x86, build once for amd64 and use the same result for
+        # both amd64 and i386
+        if [ x$arch = xamd64 ] ; then
+        job_create_build build-$arch-xtf build-xtf                           \
+                arch=$arch                                                   \
+                $RUNVARS $BUILD_RUNVARS $BUILD_XTF_RUNVARS $arch_runvars     \
+                $hostos_runvars                                              \
+                host_hostflags=$build_hostflags                              \
+                tree_xtf=$TREE_XTF                                           \
+                revision_xtf=$REVISION_XTF
+        fi
+    fi
+
     if branch_wants_rumpkernel_tests; then
 
     case $arch in
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 21/25] Introduce ts-xtf-fep
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (19 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 14:07   ` Ian Jackson
  2016-09-06 13:09 ` [OSSTEST PATCH v3 22/25] Introduce ts-xtf-run Wei Liu
                   ` (3 subsequent siblings)
  24 siblings, 1 reply; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

Test the availability of FEP during runtime.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
---
v3: use logm to log result

v2:
1. use target_cmd_output_root to get output
2. die if the output is not in expected format
3. use fep test result as exit code of the script
4. remove the use of  xtfdir runvar
---
 ts-xtf-fep | 41 +++++++++++++++++++++++++++++++++++++++++
 1 file changed, 41 insertions(+)
 create mode 100755 ts-xtf-fep

diff --git a/ts-xtf-fep b/ts-xtf-fep
new file mode 100755
index 0000000..6f0037a
--- /dev/null
+++ b/ts-xtf-fep
@@ -0,0 +1,41 @@
+#!/usr/bin/perl -w
+# This is part of "osstest", an automated testing framework for Xen.
+# Copyright (C) 2016 Citrix Inc.
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU Affero General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU Affero General Public License for more details.
+#
+# You should have received a copy of the GNU Affero General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+
+use strict qw(vars);
+use Osstest;
+use POSIX;
+use Osstest::TestSupport;
+
+tsreadconfig();
+
+our $ho = selecthost('host');
+
+sub fep_test () {
+    my $output = target_cmd_output_root($ho, <<END);
+        /home/xtf/xtf-runner -m logfile fep 1>&2; echo \$?
+END
+
+    $output =~ m/^(\d+)$/ or die "$output ?";
+
+    return $1;
+}
+
+our $fep_result = fep_test();
+
+logm("HVM FEP test returned $fep_result");
+
+exit $fep_result;
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 22/25] Introduce ts-xtf-run
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (20 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 21/25] Introduce ts-xtf-fep Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 23/25] sg-run-job: test-xtf recipe Wei Liu
                   ` (2 subsequent siblings)
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

This is the main script for running XTF.  It will first perform
selftest, and then run each XTF test case as a substep.

It does the following things:

1. Run self tests for individual environment and record the result.
2. Collect tests according to available environments.
3. Run the collected tests one by one.

The script may exit early if it detects the test host is down or
xtf-runner returns non-recognisable exit code.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
---
 ts-xtf-run | 116 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++++++
 1 file changed, 116 insertions(+)
 create mode 100755 ts-xtf-run

diff --git a/ts-xtf-run b/ts-xtf-run
new file mode 100755
index 0000000..2e69b27
--- /dev/null
+++ b/ts-xtf-run
@@ -0,0 +1,116 @@
+#!/usr/bin/perl -w
+# This is part of "osstest", an automated testing framework for Xen.
+# Copyright (C) 2016 Citrix Inc.
+#
+# This program is free software: you can redistribute it and/or modify
+# it under the terms of the GNU Affero General Public License as published by
+# the Free Software Foundation, either version 3 of the License, or
+# (at your option) any later version.
+#
+# This program is distributed in the hope that it will be useful,
+# but WITHOUT ANY WARRANTY; without even the implied warranty of
+# MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.  See the
+# GNU Affero General Public License for more details.
+#
+# You should have received a copy of the GNU Affero General Public License
+# along with this program.  If not, see <http://www.gnu.org/licenses/>.
+
+use strict qw(vars);
+use Osstest;
+use POSIX;
+use Osstest::TestSupport;
+
+tsreadconfig();
+
+our $ho = selecthost('host');
+
+our $runner = "/home/xtf/xtf-runner";
+our @tests;
+our @all_environments;
+our @environments;
+
+# XTF results and OSStest results mapping
+sub xtf_result_to_osstest_result ($) {
+    my ($xret) = @_;
+
+    return "pass" if $xret == 0; # XTF SUCCESS
+    return "skip" if $xret == 3; # XTF SKIP
+    return "fail" if $xret == 4; # XTF ERROR
+    return "fail" if $xret == 5; # XTF FAILURE
+    die "xtf runner gave unexpected result $xret";
+}
+
+sub get_environments () {
+    my $output = target_cmd_output_root($ho, <<END);
+        $runner --list --environments
+END
+    push @all_environments, split /\n/, $output;
+}
+
+# Call the runner on one test case, generate a substep for it in final test
+# report. Return runner exit code to caller. May exit the script early if
+# things go really bad.
+sub do_one_test ($) {
+    my ($name) = @_;
+    my $tid = "xtf/$name";
+    my $cmd = "xtf-runner $name";
+    my $output;
+    my $ret;
+    my $osstest_result;
+
+    substep_start($tid, $cmd);
+
+    if (!eval {
+            $output = target_cmd_output_root($ho, <<END, 600);
+                $runner -m logfile $name 1>&2; echo \$?
+END
+            $output =~ m/^(\d+)$/ or die "$output ?";
+            $ret = $1;
+
+            target_cmd_output_root($ho, 'echo ok.');
+            $osstest_result = xtf_result_to_osstest_result($ret);
+            1;
+        }) {
+        logm("XTF test threw exception:\n$@");
+        substep_finish($tid, "fail");
+        exit 0;
+    }
+
+    logm("Test $name, XTF returned $ret -> OSSTest $osstest_result");
+    substep_finish($tid, $osstest_result);
+
+    return $ret;
+}
+
+# Run selftest for each environment, record the ones that are
+# functional to get maximum coverage.
+sub do_selftest () {
+    foreach my $e (sort @all_environments) {
+        my $output = target_cmd_output_root($ho, <<END);
+            $runner --list $e selftest
+END
+        my $ret = do_one_test($output);
+        push @environments, $e if $ret == 0;
+    }
+}
+
+sub get_tests_list () {
+    foreach my $e (sort @environments) {
+        my $output = target_cmd_output_root($ho, <<END);
+            $runner --list $e --all --host
+END
+        push @tests, split /\n/, $output;
+    }
+}
+
+sub do_all_tests () {
+    foreach my $t (sort @tests) {
+        do_one_test($t);
+    }
+}
+
+get_environments();
+do_selftest();
+get_tests_list();
+do_all_tests();
+exit 0;
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 23/25] sg-run-job: test-xtf recipe
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (21 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 22/25] Introduce ts-xtf-run Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 24/25] make-flight: create 5 xtf jobs Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 25/25] Create XTF branch Wei Liu
  24 siblings, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

Install XTF, run FEP test and then run all available tests.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
---
 sg-run-job | 10 ++++++++++
 1 file changed, 10 insertions(+)

diff --git a/sg-run-job b/sg-run-job
index 95ee89e..13203ef 100755
--- a/sg-run-job
+++ b/sg-run-job
@@ -411,6 +411,16 @@ proc run-job/test-nested {} {
     run-ts . = ts-guest-stop l1 l2
 }
 
+proc need-hosts/test-xtf {} { return host }
+proc run-job/test-xtf {} {
+    run-ts . = ts-xtf-install
+
+    # Spawn and reap fep test to make it non-fatal
+    reap-ts [spawn-ts . = ts-xtf-fep]
+
+    run-ts . = ts-xtf-run
+}
+
 proc test-guest-migr {g} {
     set to_reap [spawn-ts . = ts-migrate-support-check + host $g 1]
     set can_migrate [reap-ts $to_reap]
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 24/25] make-flight: create 5 xtf jobs
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (22 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 23/25] sg-run-job: test-xtf recipe Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-08 17:01   ` Wei Liu
  2016-09-06 13:09 ` [OSSTEST PATCH v3 25/25] Create XTF branch Wei Liu
  24 siblings, 1 reply; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

Create jobs only for x86 and set host flag diverse-xtf-x86.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>
---
 make-flight | 22 ++++++++++++++++++++++
 1 file changed, 22 insertions(+)

diff --git a/make-flight b/make-flight
index c94dfa4..0aada37 100755
--- a/make-flight
+++ b/make-flight
@@ -422,6 +422,26 @@ do_rtds_tests () {
             $debian_runvars all_hostflags=$most_hostflags
 }
 
+do_xtf_tests () {
+  if ! xenbranch_wants_xtf_tests; then
+      return
+  fi
+
+  # xtf is only meaningful to x86. And amd64 and i386 should be the same,
+  # create only for one subarch is good enough.
+  if [ x$xenarch != xamd64 -o x$dom0arch != xamd64 ]; then
+      return;
+  fi
+
+  for i in `seq 1 5`; do
+      job_create_test test-xtf-$xenarch-$dom0arch-$i                 \
+       test-xtf xl $xenarch $dom0arch                                \
+            xtfbuildjob=build-$xenarch-xtf                           \
+            xen_boot_append='hvm_fep=1'                              \
+            all_hostflags=$most_hostflags,diverse-xtf-x86
+  done
+}
+
 do_multivcpu_tests () {
   if [ $xenarch != $dom0arch ]; then
     return
@@ -705,6 +725,8 @@ test_matrix_do_one () {
 
   do_pygrub_tests
   do_pvgrub_tests
+
+  do_xtf_tests
 }
 
 if [ x$buildflight = x ]; then
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* [OSSTEST PATCH v3 25/25] Create XTF branch
  2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
                   ` (23 preceding siblings ...)
  2016-09-06 13:09 ` [OSSTEST PATCH v3 24/25] make-flight: create 5 xtf jobs Wei Liu
@ 2016-09-06 13:09 ` Wei Liu
  2016-09-06 14:03   ` Ian Jackson
  2016-09-06 19:14   ` Wei Liu
  24 siblings, 2 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 13:09 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

This branch contains Xen and Linux build jobs and all jobs which contain
xtf in their name.

Signed-off-by: Wei Liu <wei.liu2@citrix.com>
---
I'm not sure if everything is ok because I can't test all changes.
---
 ap-fetch-version |  4 ++++
 ap-print-url     |  3 +++
 ap-push          |  5 +++++
 cr-daily-branch  |  7 +++++++
 cr-for-branches  |  2 +-
 cri-common       |  1 +
 make-flight      | 18 ++++++++++++++++++
 7 files changed, 39 insertions(+), 1 deletion(-)

diff --git a/ap-fetch-version b/ap-fetch-version
index 8562159..4a4a892 100755
--- a/ap-fetch-version
+++ b/ap-fetch-version
@@ -98,6 +98,10 @@ seabios)
 	repo_tree_rev_fetch_git seabios \
 		$TREE_SEABIOS_UPSTREAM master $LOCALREV_SEABIOS
 	;;
+xtf)
+	repo_tree_rev_fetch_git xtf \
+		$TREE_XTF_UPSTREAM master $LOCALREV_XTF
+	;;
 ovmf)
 	repo_tree_rev_fetch_git ovmf \
 		$TREE_OVMF_UPSTREAM master $LOCALREV_OVMF
diff --git a/ap-print-url b/ap-print-url
index 8a41e70..38eaf4e 100755
--- a/ap-print-url
+++ b/ap-print-url
@@ -58,6 +58,9 @@ rumprun)
 seabios)
 	echo $TREE_SEABIOS_UPSTREAM
 	;;
+xtf)
+	echo $TREE_XTF_UPSTREAM
+	;;
 ovmf)
 	echo $TREE_OVMF_UPSTREAM
 	;;
diff --git a/ap-push b/ap-push
index 7d3d473..a27ccc2 100755
--- a/ap-push
+++ b/ap-push
@@ -40,6 +40,7 @@ TREE_LIBVIRT=$PUSH_TREE_LIBVIRT
 TREE_RUMPRUN=$PUSH_TREE_RUMPRUN
 TREE_SEABIOS=$PUSH_TREE_SEABIOS
 TREE_OVMF=$PUSH_TREE_OVMF
+TREE_XTF=$PUSH_TREE_XTF
 
 if info_linux_tree "$branch"; then
 	cd $repos/linux
@@ -120,6 +121,10 @@ seabios)
 	cd $repos/seabios
 	git push $TREE_SEABIOS $revision:refs/heads/xen-tested-master
 	;;
+xtf)
+	cd $repos/xtf
+	git push $TREE_XTF $revision:refs/heads/xen-tested-master
+	;;
 ovmf)
 	cd $repos/ovmf
 	git push $TREE_OVMF $revision:refs/heads/xen-tested-master
diff --git a/cr-daily-branch b/cr-daily-branch
index 7d49439..efe7b25 100755
--- a/cr-daily-branch
+++ b/cr-daily-branch
@@ -198,6 +198,9 @@ fi
 if [ "x$REVISION_RUMPRUN" = x ]; then
 	determine_version REVISION_RUMPRUN rumprun RUMPRUN
 	export REVISION_RUMPRUN
+if [ "x$REVISION_XTF" = x ]; then
+	determine_version REVISION_XTF xtf XTF
+	export REVISION_XTF
 fi
 if [ "x$REVISION_LINUXFIRMWARE" = x ]; then
 	determine_version REVISION_LINUXFIRMWARE linuxfirmware LINUXFIRMWARE
@@ -248,6 +251,10 @@ seabios)
 	realtree=seabios
 	NEW_REVISION=$REVISION_SEABIOS
 	;;
+xtf)
+	realtree=xtf
+	NEW_REVISION=$REVISION_XTF
+	;;
 ovmf)
 	realtree=ovmf
 	NEW_REVISION=$REVISION_OVMF
diff --git a/cr-for-branches b/cr-for-branches
index 6a161d4..5e8b1a4 100755
--- a/cr-for-branches
+++ b/cr-for-branches
@@ -31,7 +31,7 @@ scriptoptions="$1"; shift
 LOGFILE=tmp/cr-for-branches.log
 export LOGFILE
 
-: ${BRANCHES:=osstest xen-4.0-testing xen-4.1-testing xen-4.2-testing xen-4.3-testing xen-4.4-testing xen-4.5-testing xen-4.6-testing xen-4.7-testing xen-unstable qemu-mainline qemu-upstream-unstable qemu-upstream-4.2-testing qemu-upstream-4.3-testing qemu-upstream-4.4-testing qemu-upstream-4.5-testing qemu-upstream-4.6-testing qemu-upstream-4.7-testing linux-4.1 linux-3.18 linux-3.16 linux-3.14 linux-3.10 linux-3.4 linux-arm-xen seabios ovmf ${EXTRA_BRANCHES}}
+: ${BRANCHES:=osstest xen-4.0-testing xen-4.1-testing xen-4.2-testing xen-4.3-testing xen-4.4-testing xen-4.5-testing xen-4.6-testing xen-4.7-testing xen-unstable qemu-mainline qemu-upstream-unstable qemu-upstream-4.2-testing qemu-upstream-4.3-testing qemu-upstream-4.4-testing qemu-upstream-4.5-testing qemu-upstream-4.6-testing qemu-upstream-4.7-testing linux-4.1 linux-3.18 linux-3.16 linux-3.14 linux-3.10 linux-3.4 linux-arm-xen seabios ovmf xtf ${EXTRA_BRANCHES}}
 export BRANCHES
 
 fetchwlem=$wlem
diff --git a/cri-common b/cri-common
index 6e555a6..ac360de 100644
--- a/cri-common
+++ b/cri-common
@@ -78,6 +78,7 @@ select_xenbranch () {
 	libvirt)		tree=libvirt;	xenbranch=xen-unstable ;;
 	rumprun)	      tree=rumprun; xenbranch=xen-unstable ;;
 	seabios)		tree=seabios;	xenbranch=xen-unstable ;;
+	xtf)			tree=xtf;	xenbranch=xen-unstable ;;
 	ovmf)			tree=ovmf;	xenbranch=xen-unstable ;;
 	distros-*)		tree=none;	xenbranch=xen-unstable ;;
 	osstest)		tree=osstest;	xenbranch=xen-unstable ;;
diff --git a/make-flight b/make-flight
index 0aada37..bc37ac1 100755
--- a/make-flight
+++ b/make-flight
@@ -75,6 +75,14 @@ job_create_build_filter_callback () {
         *)			return 1 ;;
       esac
     ;;
+    xtf)
+      case "$job" in
+        build-amd64)		;;
+        build-amd64-pvops)	;;
+        build-*-xtf)		;;
+        *)			return 1 ;;
+      esac
+    ;;
   esac
   return 0
 }
@@ -116,6 +124,16 @@ job_create_test_filter_callback () {
           return 1;;
       esac
       ;;
+    xtf)
+      case "$xenarch:$dom0arch" in
+          amd64:amd64) ;;
+          *) return 1;;
+      esac
+      case $job in
+          *-xtf-*) ;;
+          *) return 1;;
+      esac
+      ;;
     seabios)
       case $xenarch in
           amd64|i386) ;;
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 19/25] Introduce ts-xtf-install
  2016-09-06 13:09 ` [OSSTEST PATCH v3 19/25] Introduce ts-xtf-install Wei Liu
@ 2016-09-06 14:01   ` Ian Jackson
  0 siblings, 0 replies; 43+ messages in thread
From: Ian Jackson @ 2016-09-06 14:01 UTC (permalink / raw)
  To: Wei Liu; +Cc: Xen-devel

Wei Liu writes ("[OSSTEST PATCH v3 19/25] Introduce ts-xtf-install"):
> Extract XTF to the desired location.
> 
> Signed-off-by: Wei Liu <wei.liu2@citrix.com>

Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 25/25] Create XTF branch
  2016-09-06 13:09 ` [OSSTEST PATCH v3 25/25] Create XTF branch Wei Liu
@ 2016-09-06 14:03   ` Ian Jackson
  2016-09-06 19:16     ` Wei Liu
  2016-09-06 19:14   ` Wei Liu
  1 sibling, 1 reply; 43+ messages in thread
From: Ian Jackson @ 2016-09-06 14:03 UTC (permalink / raw)
  To: Wei Liu; +Cc: Xen-devel

Wei Liu writes ("[OSSTEST PATCH v3 25/25] Create XTF branch"):
> This branch contains Xen and Linux build jobs and all jobs which contain
> xtf in their name.

This looks plausible but can you please provide the output from
standalone-generate-dump-flight-runvars ?

Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards
  2016-09-06 13:09 ` [OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards Wei Liu
@ 2016-09-06 14:06   ` Ian Jackson
  2016-09-08 17:00     ` Wei Liu
  0 siblings, 1 reply; 43+ messages in thread
From: Ian Jackson @ 2016-09-06 14:06 UTC (permalink / raw)
  To: Wei Liu; +Cc: Xen-devel

Wei Liu writes ("[OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards"):
> Xen 4.4 is the oldest one that we still provide security support at this
> point in time.
> 
> Signed-off-by: Wei Liu <wei.liu2@citrix.com>

This ought to come with a diff, showing the change to the output of
standalone-generate-dump-flight-runvars.  (Consider use of `eatmydata'
and AP_FETCH_MEMO_KEEP=1, as discussed in 74d81dca.)

Thanks,
Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 21/25] Introduce ts-xtf-fep
  2016-09-06 13:09 ` [OSSTEST PATCH v3 21/25] Introduce ts-xtf-fep Wei Liu
@ 2016-09-06 14:07   ` Ian Jackson
  0 siblings, 0 replies; 43+ messages in thread
From: Ian Jackson @ 2016-09-06 14:07 UTC (permalink / raw)
  To: Wei Liu; +Cc: Xen-devel

Wei Liu writes ("[OSSTEST PATCH v3 21/25] Introduce ts-xtf-fep"):
> Test the availability of FEP during runtime.
> 
> Signed-off-by: Wei Liu <wei.liu2@citrix.com>

Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 25/25] Create XTF branch
  2016-09-06 13:09 ` [OSSTEST PATCH v3 25/25] Create XTF branch Wei Liu
  2016-09-06 14:03   ` Ian Jackson
@ 2016-09-06 19:14   ` Wei Liu
  1 sibling, 0 replies; 43+ messages in thread
From: Wei Liu @ 2016-09-06 19:14 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

There is one minor rebase error.

The patch below fixes it.

---8<---
From f950c2a8a23fcfbdce738a6c8af55f9a2941854c Mon Sep 17 00:00:00 2001
From: Wei Liu <wei.liu2@citrix.com>
Date: Tue, 6 Sep 2016 20:13:11 +0100
Subject: [OSSTEST PATCH] fixup! Create XTF branch

---
 cr-daily-branch | 1 +
 1 file changed, 1 insertion(+)

diff --git a/cr-daily-branch b/cr-daily-branch
index efe7b25..158554d 100755
--- a/cr-daily-branch
+++ b/cr-daily-branch
@@ -198,6 +198,7 @@ fi
 if [ "x$REVISION_RUMPRUN" = x ]; then
 	determine_version REVISION_RUMPRUN rumprun RUMPRUN
 	export REVISION_RUMPRUN
+fi
 if [ "x$REVISION_XTF" = x ]; then
 	determine_version REVISION_XTF xtf XTF
 	export REVISION_XTF
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 25/25] Create XTF branch
  2016-09-06 14:03   ` Ian Jackson
@ 2016-09-06 19:16     ` Wei Liu
  2016-09-08 14:47       ` Ian Jackson
  0 siblings, 1 reply; 43+ messages in thread
From: Wei Liu @ 2016-09-06 19:16 UTC (permalink / raw)
  To: Ian Jackson; +Cc: Xen-devel, Wei Liu

On Tue, Sep 06, 2016 at 03:03:50PM +0100, Ian Jackson wrote:
> Wei Liu writes ("[OSSTEST PATCH v3 25/25] Create XTF branch"):
> > This branch contains Xen and Linux build jobs and all jobs which contain
> > xtf in their name.
> 
> This looks plausible but can you please provide the output from
> standalone-generate-dump-flight-runvars ?

Here you go.

--- /proc/self/fd/13	2016-09-06 20:15:36.457007422 +0100
+++ /proc/self/fd/14	2016-09-06 20:15:36.457007422 +0100
@@ -91,6 +91,13 @@
 xen-unstable               build-amd64-xsm                                       tree_qemuu              git://xenbits.xen.org/qemu-xen.git
 xen-unstable               build-amd64-xsm                                       tree_seabios
 xen-unstable               build-amd64-xsm                                       tree_xen                git://xenbits.xen.org/xen.git
+xen-unstable               build-amd64-xtf                                       all_host_di_version     current
+xen-unstable               build-amd64-xtf                                       all_host_suite          wheezy
+xen-unstable               build-amd64-xtf                                       arch                    amd64
+xen-unstable               build-amd64-xtf                                       build_lvextend_max      50
+xen-unstable               build-amd64-xtf                                       host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build
+xen-unstable               build-amd64-xtf                                       revision_xtf            ap-fetch-version-baseline:xtf
+xen-unstable               build-amd64-xtf                                       tree_xtf                git://xenbits.xen.org/people/liuw/xtf.git
 xen-unstable               build-armhf                                           all_host_di_version     current
 xen-unstable               build-armhf                                           all_host_suite          wheezy
 xen-unstable               build-armhf                                           arch                    armhf
@@ -1243,3 +1250,58 @@
 xen-unstable               test-armhf-armhf-xl-xsm                               kernkind                pvops
 xen-unstable               test-armhf-armhf-xl-xsm                               toolstack               xl
 xen-unstable               test-armhf-armhf-xl-xsm                               xenbuildjob             build-armhf-xsm
+xen-unstable               test-xtf-amd64-amd64-1                                all_host_di_version     current
+xen-unstable               test-xtf-amd64-amd64-1                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xen-unstable               test-xtf-amd64-amd64-1                                all_host_suite          wheezy
+xen-unstable               test-xtf-amd64-amd64-1                                arch                    amd64
+xen-unstable               test-xtf-amd64-amd64-1                                buildjob                build-amd64
+xen-unstable               test-xtf-amd64-amd64-1                                kernbuildjob            build-amd64-pvops
+xen-unstable               test-xtf-amd64-amd64-1                                kernkind                pvops
+xen-unstable               test-xtf-amd64-amd64-1                                toolstack               xl
+xen-unstable               test-xtf-amd64-amd64-1                                xen_boot_append         hvm_fep=1
+xen-unstable               test-xtf-amd64-amd64-1                                xenbuildjob             build-amd64
+xen-unstable               test-xtf-amd64-amd64-1                                xtfbuildjob             build-amd64-xtf
+xen-unstable               test-xtf-amd64-amd64-2                                all_host_di_version     current
+xen-unstable               test-xtf-amd64-amd64-2                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xen-unstable               test-xtf-amd64-amd64-2                                all_host_suite          wheezy
+xen-unstable               test-xtf-amd64-amd64-2                                arch                    amd64
+xen-unstable               test-xtf-amd64-amd64-2                                buildjob                build-amd64
+xen-unstable               test-xtf-amd64-amd64-2                                kernbuildjob            build-amd64-pvops
+xen-unstable               test-xtf-amd64-amd64-2                                kernkind                pvops
+xen-unstable               test-xtf-amd64-amd64-2                                toolstack               xl
+xen-unstable               test-xtf-amd64-amd64-2                                xen_boot_append         hvm_fep=1
+xen-unstable               test-xtf-amd64-amd64-2                                xenbuildjob             build-amd64
+xen-unstable               test-xtf-amd64-amd64-2                                xtfbuildjob             build-amd64-xtf
+xen-unstable               test-xtf-amd64-amd64-3                                all_host_di_version     current
+xen-unstable               test-xtf-amd64-amd64-3                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xen-unstable               test-xtf-amd64-amd64-3                                all_host_suite          wheezy
+xen-unstable               test-xtf-amd64-amd64-3                                arch                    amd64
+xen-unstable               test-xtf-amd64-amd64-3                                buildjob                build-amd64
+xen-unstable               test-xtf-amd64-amd64-3                                kernbuildjob            build-amd64-pvops
+xen-unstable               test-xtf-amd64-amd64-3                                kernkind                pvops
+xen-unstable               test-xtf-amd64-amd64-3                                toolstack               xl
+xen-unstable               test-xtf-amd64-amd64-3                                xen_boot_append         hvm_fep=1
+xen-unstable               test-xtf-amd64-amd64-3                                xenbuildjob             build-amd64
+xen-unstable               test-xtf-amd64-amd64-3                                xtfbuildjob             build-amd64-xtf
+xen-unstable               test-xtf-amd64-amd64-4                                all_host_di_version     current
+xen-unstable               test-xtf-amd64-amd64-4                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xen-unstable               test-xtf-amd64-amd64-4                                all_host_suite          wheezy
+xen-unstable               test-xtf-amd64-amd64-4                                arch                    amd64
+xen-unstable               test-xtf-amd64-amd64-4                                buildjob                build-amd64
+xen-unstable               test-xtf-amd64-amd64-4                                kernbuildjob            build-amd64-pvops
+xen-unstable               test-xtf-amd64-amd64-4                                kernkind                pvops
+xen-unstable               test-xtf-amd64-amd64-4                                toolstack               xl
+xen-unstable               test-xtf-amd64-amd64-4                                xen_boot_append         hvm_fep=1
+xen-unstable               test-xtf-amd64-amd64-4                                xenbuildjob             build-amd64
+xen-unstable               test-xtf-amd64-amd64-4                                xtfbuildjob             build-amd64-xtf
+xen-unstable               test-xtf-amd64-amd64-5                                all_host_di_version     current
+xen-unstable               test-xtf-amd64-amd64-5                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xen-unstable               test-xtf-amd64-amd64-5                                all_host_suite          wheezy
+xen-unstable               test-xtf-amd64-amd64-5                                arch                    amd64
+xen-unstable               test-xtf-amd64-amd64-5                                buildjob                build-amd64
+xen-unstable               test-xtf-amd64-amd64-5                                kernbuildjob            build-amd64-pvops
+xen-unstable               test-xtf-amd64-amd64-5                                kernkind                pvops
+xen-unstable               test-xtf-amd64-amd64-5                                toolstack               xl
+xen-unstable               test-xtf-amd64-amd64-5                                xen_boot_append         hvm_fep=1
+xen-unstable               test-xtf-amd64-amd64-5                                xenbuildjob             build-amd64
+xen-unstable               test-xtf-amd64-amd64-5                                xtfbuildjob             build-amd64-xtf

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 25/25] Create XTF branch
  2016-09-06 19:16     ` Wei Liu
@ 2016-09-08 14:47       ` Ian Jackson
  2016-09-08 17:07         ` Wei Liu
  0 siblings, 1 reply; 43+ messages in thread
From: Ian Jackson @ 2016-09-08 14:47 UTC (permalink / raw)
  To: Wei Liu; +Cc: Xen-devel

Wei Liu writes ("Re: [OSSTEST PATCH v3 25/25] Create XTF branch"):
> On Tue, Sep 06, 2016 at 03:03:50PM +0100, Ian Jackson wrote:
> > Wei Liu writes ("[OSSTEST PATCH v3 25/25] Create XTF branch"):
> > > This branch contains Xen and Linux build jobs and all jobs which contain
> > > xtf in their name.
> > 
> > This looks plausible but can you please provide the output from
> > standalone-generate-dump-flight-runvars ?
> 
> Here you go.

Thanks.  It's not entirely clear from your comments above whether this
is a diff for the whole of your series, including 20/25 (add build
jobs), or just for 25/25 (add xtf branch).

The actual diff just shows an additional xtf build job in the
xen-unstable branch, and doesn't mention the new xtf branch even
though you patched cr-for-branches.

All this suggests that you have run
`standalone-generate-dump-flight-runvars xen-unstable' to restrict the
output to that branch only.  I'd like a full diff please.  (At least,
for the series as a whole, but ideally for patch 20 and patch 25
separately.)

Also your commit messages should have a deployment note asking me to

1. Run mg-branch-setup.  You need to specify what value of
   INITIAL-TESTED-VERSION, if any, is appropriate.  If one is
   required, then that means that mg-branch-setup must be run before
   20/25 is pushed, because the change in 20/25 will start to fetch
   the baseline xtf version which is what INITIAL-TESTED-VERSION is.

2. install the new crontab to enable the new branch.

Thanks,
Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards
  2016-09-06 14:06   ` Ian Jackson
@ 2016-09-08 17:00     ` Wei Liu
  2016-09-08 17:41       ` Ian Jackson
  0 siblings, 1 reply; 43+ messages in thread
From: Wei Liu @ 2016-09-08 17:00 UTC (permalink / raw)
  To: Ian Jackson; +Cc: Xen-devel, Wei Liu

On Tue, Sep 06, 2016 at 03:06:02PM +0100, Ian Jackson wrote:
> Wei Liu writes ("[OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards"):
> > Xen 4.4 is the oldest one that we still provide security support at this
> > point in time.
> > 
> > Signed-off-by: Wei Liu <wei.liu2@citrix.com>
> 
> This ought to come with a diff, showing the change to the output of
> standalone-generate-dump-flight-runvars.  (Consider use of `eatmydata'
> and AP_FETCH_MEMO_KEEP=1, as discussed in 74d81dca.)
> 
> Thanks,
> Ian.

The following fixup patch is required to properly filter out unnecessary
branches.

There will be one further fixup patch to another patch to switch to use
branch_wants_xtf_tests. I will post that separately.

From 074237a5b152d7f772b53594732bcc6946dc31ed Mon Sep 17 00:00:00 2001
From: Wei Liu <wei.liu2@citrix.com>
Date: Thu, 8 Sep 2016 17:50:14 +0100
Subject: [OSSTEST PATCH] fixup! mfi-common: create xtf build job for 4.4
 onwards
Cc: ian.jackson@eu.citrix.com

---
 mfi-common | 21 +++++++++++----------
 1 file changed, 11 insertions(+), 10 deletions(-)

diff --git a/mfi-common b/mfi-common
index 0864266..00921c4 100644
--- a/mfi-common
+++ b/mfi-common
@@ -67,15 +67,16 @@ xenbranch_xsm_variants () {
     esac
 }
 
-xenbranch_wants_xtf_tests () {
-    case "$xenbranch" in
-    xen-3.*-testing) return 1;;
-    xen-4.0-testing) return 1;;
-    xen-4.1-testing) return 1;;
-    xen-4.2-testing) return 1;;
-    xen-4.3-testing) return 1;;
-    *) return 0;;
-    esac
+branch_wants_xtf_tests () {
+  case "$branch" in
+    xen-3.*-testing) return 1 ;;
+    xen-4.0-testing) return 1 ;;
+    xen-4.1-testing) return 1 ;;
+    xen-4.2-testing) return 1 ;;
+    xen-4.3-testing) return 1 ;;
+    xen-*) return 0;;
+    *) return 1 ;;
+  esac
 }
 
 job_create_build () {
@@ -276,7 +277,7 @@ create_build_jobs () {
 
     fi
 
-    if xenbranch_wants_xtf_tests; then
+    if branch_wants_xtf_tests; then
         # Only x86, build once for amd64 and use the same result for
         # both amd64 and i386
         if [ x$arch = xamd64 ] ; then
-- 
2.1.4


And now the diff of new stuff in database:


--- /proc/self/fd/11	2016-09-08 17:59:55.664055563 +0100
+++ /proc/self/fd/12	2016-09-08 17:59:55.664055563 +0100
@@ -18554,6 +18554,13 @@
 xen-4.4-testing            build-amd64-xend                          tree_qemu               git://xenbits.xen.org/qemu-xen-traditional.git                         
 xen-4.4-testing            build-amd64-xend                          tree_qemuu              git://xenbits.xen.org/qemu-xen.git                                     
 xen-4.4-testing            build-amd64-xend                          tree_xen                git://xenbits.xen.org/xen.git                                          
+xen-4.4-testing            build-amd64-xtf                           all_host_di_version     current                                                                
+xen-4.4-testing            build-amd64-xtf                           all_host_suite          wheezy                                                                 
+xen-4.4-testing            build-amd64-xtf                           arch                    amd64                                                                  
+xen-4.4-testing            build-amd64-xtf                           build_lvextend_max      50                                                                     
+xen-4.4-testing            build-amd64-xtf                           host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build         
+xen-4.4-testing            build-amd64-xtf                           revision_xtf                                                                                   
+xen-4.4-testing            build-amd64-xtf                           tree_xtf                git://xenbits.xen.org/people/liuw/xtf.git                              
 xen-4.4-testing            build-armhf                               all_host_di_version     current                                                                
 xen-4.4-testing            build-armhf                               all_host_suite          wheezy                                                                 
 xen-4.4-testing            build-armhf                               arch                    armhf                                                                  
@@ -19441,6 +19448,13 @@
 xen-4.5-testing            build-amd64                               tree_qemuu              git://xenbits.xen.org/qemu-xen.git                                     
 xen-4.5-testing            build-amd64                               tree_seabios                                                                                   
 xen-4.5-testing            build-amd64                               tree_xen                git://xenbits.xen.org/xen.git                                          
+xen-4.5-testing            build-amd64-xtf                           all_host_di_version     current                                                                
+xen-4.5-testing            build-amd64-xtf                           all_host_suite          wheezy                                                                 
+xen-4.5-testing            build-amd64-xtf                           arch                    amd64                                                                  
+xen-4.5-testing            build-amd64-xtf                           build_lvextend_max      50                                                                     
+xen-4.5-testing            build-amd64-xtf                           host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build         
+xen-4.5-testing            build-amd64-xtf                           revision_xtf                                                                                   
+xen-4.5-testing            build-amd64-xtf                           tree_xtf                git://xenbits.xen.org/people/liuw/xtf.git                              
 xen-4.5-testing            build-armhf                               all_host_di_version     current                                                                
 xen-4.5-testing            build-armhf                               all_host_suite          wheezy                                                                 
 xen-4.5-testing            build-armhf                               arch                    armhf                                                                  
@@ -20415,6 +20429,13 @@
 xen-4.6-testing            build-amd64-xsm                                       tree_qemuu              git://xenbits.xen.org/qemu-xen.git                                     
 xen-4.6-testing            build-amd64-xsm                                       tree_seabios                                                                                   
 xen-4.6-testing            build-amd64-xsm                                       tree_xen                git://xenbits.xen.org/xen.git                                          
+xen-4.6-testing            build-amd64-xtf                                       all_host_di_version     current                                                                
+xen-4.6-testing            build-amd64-xtf                                       all_host_suite          wheezy                                                                 
+xen-4.6-testing            build-amd64-xtf                                       arch                    amd64                                                                  
+xen-4.6-testing            build-amd64-xtf                                       build_lvextend_max      50                                                                     
+xen-4.6-testing            build-amd64-xtf                                       host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build         
+xen-4.6-testing            build-amd64-xtf                                       revision_xtf                                                                                   
+xen-4.6-testing            build-amd64-xtf                                       tree_xtf                git://xenbits.xen.org/people/liuw/xtf.git                              
 xen-4.6-testing            build-armhf                                           all_host_di_version     current                                                                
 xen-4.6-testing            build-armhf                                           all_host_suite          wheezy                                                                 
 xen-4.6-testing            build-armhf                                           arch                    armhf                                                                  
@@ -21642,6 +21663,13 @@
 xen-4.7-testing            build-amd64-xsm                                       tree_qemuu              git://xenbits.xen.org/qemu-xen.git                                     
 xen-4.7-testing            build-amd64-xsm                                       tree_seabios                                                                                   
 xen-4.7-testing            build-amd64-xsm                                       tree_xen                git://xenbits.xen.org/xen.git                                          
+xen-4.7-testing            build-amd64-xtf                                       all_host_di_version     current                                                                
+xen-4.7-testing            build-amd64-xtf                                       all_host_suite          wheezy                                                                 
+xen-4.7-testing            build-amd64-xtf                                       arch                    amd64                                                                  
+xen-4.7-testing            build-amd64-xtf                                       build_lvextend_max      50                                                                     
+xen-4.7-testing            build-amd64-xtf                                       host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build         
+xen-4.7-testing            build-amd64-xtf                                       revision_xtf                                                                                   
+xen-4.7-testing            build-amd64-xtf                                       tree_xtf                git://xenbits.xen.org/people/liuw/xtf.git                              
 xen-4.7-testing            build-armhf                                           all_host_di_version     current                                                                
 xen-4.7-testing            build-armhf                                           all_host_suite          wheezy                                                                 
 xen-4.7-testing            build-armhf                                           arch                    armhf                                                                  
@@ -22878,6 +22906,13 @@
 xen-unstable               build-amd64-xsm                                       tree_qemuu              git://xenbits.xen.org/qemu-xen.git                                     
 xen-unstable               build-amd64-xsm                                       tree_seabios                                                                                   
 xen-unstable               build-amd64-xsm                                       tree_xen                git://xenbits.xen.org/xen.git                                          
+xen-unstable               build-amd64-xtf                                       all_host_di_version     current                                                                
+xen-unstable               build-amd64-xtf                                       all_host_suite          wheezy                                                                 
+xen-unstable               build-amd64-xtf                                       arch                    amd64                                                                  
+xen-unstable               build-amd64-xtf                                       build_lvextend_max      50                                                                     
+xen-unstable               build-amd64-xtf                                       host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build         
+xen-unstable               build-amd64-xtf                                       revision_xtf                                                                                   
+xen-unstable               build-amd64-xtf                                       tree_xtf                git://xenbits.xen.org/people/liuw/xtf.git                              
 xen-unstable               build-armhf                                           all_host_di_version     current                                                                
 xen-unstable               build-armhf                                           all_host_suite          wheezy                                                                 
 xen-unstable               build-armhf                                           arch                    armhf                                                                  

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 24/25] make-flight: create 5 xtf jobs
  2016-09-06 13:09 ` [OSSTEST PATCH v3 24/25] make-flight: create 5 xtf jobs Wei Liu
@ 2016-09-08 17:01   ` Wei Liu
  2016-09-08 17:41     ` Ian Jackson
  0 siblings, 1 reply; 43+ messages in thread
From: Wei Liu @ 2016-09-08 17:01 UTC (permalink / raw)
  To: Xen-devel; +Cc: ian.jackson, Wei Liu

This is a fixup patch to switch from xenbranch_wants_xtf_tests to
branch_wants_xtf_tests.


From ac5eaf4e4f10fb7da604a8bee41b1af1b27ad96f Mon Sep 17 00:00:00 2001
From: Wei Liu <wei.liu2@citrix.com>
Date: Thu, 8 Sep 2016 17:54:08 +0100
Subject: [OSSTEST PATCH] fixup! make-flight: create 5 xtf jobs
Cc: ian.jackson@eu.citrix.com

---
 make-flight | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/make-flight b/make-flight
index 0aada37..7b166e1 100755
--- a/make-flight
+++ b/make-flight
@@ -423,7 +423,7 @@ do_rtds_tests () {
 }
 
 do_xtf_tests () {
-  if ! xenbranch_wants_xtf_tests; then
+  if ! branch_wants_xtf_tests; then
       return
   fi
 
-- 
2.1.4


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 25/25] Create XTF branch
  2016-09-08 14:47       ` Ian Jackson
@ 2016-09-08 17:07         ` Wei Liu
  2016-09-08 17:45           ` Ian Jackson
  0 siblings, 1 reply; 43+ messages in thread
From: Wei Liu @ 2016-09-08 17:07 UTC (permalink / raw)
  To: Ian Jackson; +Cc: Xen-devel, Wei Liu

On Thu, Sep 08, 2016 at 03:47:38PM +0100, Ian Jackson wrote:
> Wei Liu writes ("Re: [OSSTEST PATCH v3 25/25] Create XTF branch"):
> > On Tue, Sep 06, 2016 at 03:03:50PM +0100, Ian Jackson wrote:
> > > Wei Liu writes ("[OSSTEST PATCH v3 25/25] Create XTF branch"):
> > > > This branch contains Xen and Linux build jobs and all jobs which contain
> > > > xtf in their name.
> > > 
> > > This looks plausible but can you please provide the output from
> > > standalone-generate-dump-flight-runvars ?
> > 
> > Here you go.
> 
> Thanks.  It's not entirely clear from your comments above whether this
> is a diff for the whole of your series, including 20/25 (add build
> jobs), or just for 25/25 (add xtf branch).

There would be one further fixup patch to change branch_wants_xtf_test
to add xtf branch to it.

From 62e90057f8c109d925d9c6be3f2681f40f081c18 Mon Sep 17 00:00:00 2001
From: Wei Liu <wei.liu2@citrix.com>
Date: Thu, 8 Sep 2016 18:06:26 +0100
Subject: [OSSTEST PATCH] fixup! Create XTF branch
Cc: ian.jackson@eu.citrix.com

---
 mfi-common | 1 +
 1 file changed, 1 insertion(+)

diff --git a/mfi-common b/mfi-common
index 00921c4..1c73fee 100644
--- a/mfi-common
+++ b/mfi-common
@@ -75,6 +75,7 @@ branch_wants_xtf_tests () {
     xen-4.2-testing) return 1 ;;
     xen-4.3-testing) return 1 ;;
     xen-*) return 0;;
+    xtf*) return 0;;
     *) return 1 ;;
   esac
 }
-- 
2.1.4



New stuff in DB now:

--- /proc/self/fd/11	2016-09-08 18:05:57.934736388 +0100
+++ /proc/self/fd/12	2016-09-08 18:05:57.938736285 +0100
@@ -18554,6 +18554,13 @@
 xen-4.4-testing            build-amd64-xend                          tree_qemu               git://xenbits.xen.org/qemu-xen-traditional.git                         
 xen-4.4-testing            build-amd64-xend                          tree_qemuu              git://xenbits.xen.org/qemu-xen.git                                     
 xen-4.4-testing            build-amd64-xend                          tree_xen                git://xenbits.xen.org/xen.git                                          
+xen-4.4-testing            build-amd64-xtf                           all_host_di_version     current                                                                
+xen-4.4-testing            build-amd64-xtf                           all_host_suite          wheezy                                                                 
+xen-4.4-testing            build-amd64-xtf                           arch                    amd64                                                                  
+xen-4.4-testing            build-amd64-xtf                           build_lvextend_max      50                                                                     
+xen-4.4-testing            build-amd64-xtf                           host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build         
+xen-4.4-testing            build-amd64-xtf                           revision_xtf            ap-fetch-version-baseline:xtf                                          
+xen-4.4-testing            build-amd64-xtf                           tree_xtf                git://xenbits.xen.org/people/liuw/xtf.git                              
 xen-4.4-testing            build-armhf                               all_host_di_version     current                                                                
 xen-4.4-testing            build-armhf                               all_host_suite          wheezy                                                                 
 xen-4.4-testing            build-armhf                               arch                    armhf                                                                  
@@ -19377,6 +19384,61 @@
 xen-4.4-testing            test-armhf-armhf-xl-vhd                   toolstack               xl                                                                     
 xen-4.4-testing            test-armhf-armhf-xl-vhd                   xenbuildjob             build-armhf                                                            
 xen-4.4-testing            test-armhf-armhf-xl                       xenbuildjob             build-armhf                                                            
+xen-4.4-testing            test-xtf-amd64-amd64-1                    all_host_di_version     current                                                                
+xen-4.4-testing            test-xtf-amd64-amd64-1                    all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.4-testing            test-xtf-amd64-amd64-1                    all_host_suite          wheezy                                                                 
+xen-4.4-testing            test-xtf-amd64-amd64-1                    arch                    amd64                                                                  
+xen-4.4-testing            test-xtf-amd64-amd64-1                    buildjob                build-amd64                                                            
+xen-4.4-testing            test-xtf-amd64-amd64-1                    kernbuildjob            build-amd64-pvops                                                      
+xen-4.4-testing            test-xtf-amd64-amd64-1                    kernkind                pvops                                                                  
+xen-4.4-testing            test-xtf-amd64-amd64-1                    toolstack               xl                                                                     
+xen-4.4-testing            test-xtf-amd64-amd64-1                    xen_boot_append         hvm_fep=1                                                              
+xen-4.4-testing            test-xtf-amd64-amd64-1                    xenbuildjob             build-amd64                                                            
+xen-4.4-testing            test-xtf-amd64-amd64-1                    xtfbuildjob             build-amd64-xtf                                                        
+xen-4.4-testing            test-xtf-amd64-amd64-2                    all_host_di_version     current                                                                
+xen-4.4-testing            test-xtf-amd64-amd64-2                    all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.4-testing            test-xtf-amd64-amd64-2                    all_host_suite          wheezy                                                                 
+xen-4.4-testing            test-xtf-amd64-amd64-2                    arch                    amd64                                                                  
+xen-4.4-testing            test-xtf-amd64-amd64-2                    buildjob                build-amd64                                                            
+xen-4.4-testing            test-xtf-amd64-amd64-2                    kernbuildjob            build-amd64-pvops                                                      
+xen-4.4-testing            test-xtf-amd64-amd64-2                    kernkind                pvops                                                                  
+xen-4.4-testing            test-xtf-amd64-amd64-2                    toolstack               xl                                                                     
+xen-4.4-testing            test-xtf-amd64-amd64-2                    xen_boot_append         hvm_fep=1                                                              
+xen-4.4-testing            test-xtf-amd64-amd64-2                    xenbuildjob             build-amd64                                                            
+xen-4.4-testing            test-xtf-amd64-amd64-2                    xtfbuildjob             build-amd64-xtf                                                        
+xen-4.4-testing            test-xtf-amd64-amd64-3                    all_host_di_version     current                                                                
+xen-4.4-testing            test-xtf-amd64-amd64-3                    all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.4-testing            test-xtf-amd64-amd64-3                    all_host_suite          wheezy                                                                 
+xen-4.4-testing            test-xtf-amd64-amd64-3                    arch                    amd64                                                                  
+xen-4.4-testing            test-xtf-amd64-amd64-3                    buildjob                build-amd64                                                            
+xen-4.4-testing            test-xtf-amd64-amd64-3                    kernbuildjob            build-amd64-pvops                                                      
+xen-4.4-testing            test-xtf-amd64-amd64-3                    kernkind                pvops                                                                  
+xen-4.4-testing            test-xtf-amd64-amd64-3                    toolstack               xl                                                                     
+xen-4.4-testing            test-xtf-amd64-amd64-3                    xen_boot_append         hvm_fep=1                                                              
+xen-4.4-testing            test-xtf-amd64-amd64-3                    xenbuildjob             build-amd64                                                            
+xen-4.4-testing            test-xtf-amd64-amd64-3                    xtfbuildjob             build-amd64-xtf                                                        
+xen-4.4-testing            test-xtf-amd64-amd64-4                    all_host_di_version     current                                                                
+xen-4.4-testing            test-xtf-amd64-amd64-4                    all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.4-testing            test-xtf-amd64-amd64-4                    all_host_suite          wheezy                                                                 
+xen-4.4-testing            test-xtf-amd64-amd64-4                    arch                    amd64                                                                  
+xen-4.4-testing            test-xtf-amd64-amd64-4                    buildjob                build-amd64                                                            
+xen-4.4-testing            test-xtf-amd64-amd64-4                    kernbuildjob            build-amd64-pvops                                                      
+xen-4.4-testing            test-xtf-amd64-amd64-4                    kernkind                pvops                                                                  
+xen-4.4-testing            test-xtf-amd64-amd64-4                    toolstack               xl                                                                     
+xen-4.4-testing            test-xtf-amd64-amd64-4                    xen_boot_append         hvm_fep=1                                                              
+xen-4.4-testing            test-xtf-amd64-amd64-4                    xenbuildjob             build-amd64                                                            
+xen-4.4-testing            test-xtf-amd64-amd64-4                    xtfbuildjob             build-amd64-xtf                                                        
+xen-4.4-testing            test-xtf-amd64-amd64-5                    all_host_di_version     current                                                                
+xen-4.4-testing            test-xtf-amd64-amd64-5                    all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.4-testing            test-xtf-amd64-amd64-5                    all_host_suite          wheezy                                                                 
+xen-4.4-testing            test-xtf-amd64-amd64-5                    arch                    amd64                                                                  
+xen-4.4-testing            test-xtf-amd64-amd64-5                    buildjob                build-amd64                                                            
+xen-4.4-testing            test-xtf-amd64-amd64-5                    kernbuildjob            build-amd64-pvops                                                      
+xen-4.4-testing            test-xtf-amd64-amd64-5                    kernkind                pvops                                                                  
+xen-4.4-testing            test-xtf-amd64-amd64-5                    toolstack               xl                                                                     
+xen-4.4-testing            test-xtf-amd64-amd64-5                    xen_boot_append         hvm_fep=1                                                              
+xen-4.4-testing            test-xtf-amd64-amd64-5                    xenbuildjob             build-amd64                                                            
+xen-4.4-testing            test-xtf-amd64-amd64-5                    xtfbuildjob             build-amd64-xtf                                                        
 xen-4.5-testing            build-amd64                               all_host_di_version     current                                                                
 xen-4.5-testing            build-amd64                               all_host_suite          wheezy                                                                 
 xen-4.5-testing            build-amd64                               arch                    amd64                                                                  
@@ -19441,6 +19503,13 @@
 xen-4.5-testing            build-amd64                               tree_qemuu              git://xenbits.xen.org/qemu-xen.git                                     
 xen-4.5-testing            build-amd64                               tree_seabios                                                                                   
 xen-4.5-testing            build-amd64                               tree_xen                git://xenbits.xen.org/xen.git                                          
+xen-4.5-testing            build-amd64-xtf                           all_host_di_version     current                                                                
+xen-4.5-testing            build-amd64-xtf                           all_host_suite          wheezy                                                                 
+xen-4.5-testing            build-amd64-xtf                           arch                    amd64                                                                  
+xen-4.5-testing            build-amd64-xtf                           build_lvextend_max      50                                                                     
+xen-4.5-testing            build-amd64-xtf                           host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build         
+xen-4.5-testing            build-amd64-xtf                           revision_xtf            ap-fetch-version-baseline:xtf                                          
+xen-4.5-testing            build-amd64-xtf                           tree_xtf                git://xenbits.xen.org/people/liuw/xtf.git                              
 xen-4.5-testing            build-armhf                               all_host_di_version     current                                                                
 xen-4.5-testing            build-armhf                               all_host_suite          wheezy                                                                 
 xen-4.5-testing            build-armhf                               arch                    armhf                                                                  
@@ -20331,6 +20400,61 @@
 xen-4.5-testing            test-armhf-armhf-xl-vhd                   toolstack               xl                                                                     
 xen-4.5-testing            test-armhf-armhf-xl-vhd                   xenbuildjob             build-armhf                                                            
 xen-4.5-testing            test-armhf-armhf-xl                       xenbuildjob             build-armhf                                                            
+xen-4.5-testing            test-xtf-amd64-amd64-1                    all_host_di_version     current                                                                
+xen-4.5-testing            test-xtf-amd64-amd64-1                    all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.5-testing            test-xtf-amd64-amd64-1                    all_host_suite          wheezy                                                                 
+xen-4.5-testing            test-xtf-amd64-amd64-1                    arch                    amd64                                                                  
+xen-4.5-testing            test-xtf-amd64-amd64-1                    buildjob                build-amd64                                                            
+xen-4.5-testing            test-xtf-amd64-amd64-1                    kernbuildjob            build-amd64-pvops                                                      
+xen-4.5-testing            test-xtf-amd64-amd64-1                    kernkind                pvops                                                                  
+xen-4.5-testing            test-xtf-amd64-amd64-1                    toolstack               xl                                                                     
+xen-4.5-testing            test-xtf-amd64-amd64-1                    xen_boot_append         hvm_fep=1                                                              
+xen-4.5-testing            test-xtf-amd64-amd64-1                    xenbuildjob             build-amd64                                                            
+xen-4.5-testing            test-xtf-amd64-amd64-1                    xtfbuildjob             build-amd64-xtf                                                        
+xen-4.5-testing            test-xtf-amd64-amd64-2                    all_host_di_version     current                                                                
+xen-4.5-testing            test-xtf-amd64-amd64-2                    all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.5-testing            test-xtf-amd64-amd64-2                    all_host_suite          wheezy                                                                 
+xen-4.5-testing            test-xtf-amd64-amd64-2                    arch                    amd64                                                                  
+xen-4.5-testing            test-xtf-amd64-amd64-2                    buildjob                build-amd64                                                            
+xen-4.5-testing            test-xtf-amd64-amd64-2                    kernbuildjob            build-amd64-pvops                                                      
+xen-4.5-testing            test-xtf-amd64-amd64-2                    kernkind                pvops                                                                  
+xen-4.5-testing            test-xtf-amd64-amd64-2                    toolstack               xl                                                                     
+xen-4.5-testing            test-xtf-amd64-amd64-2                    xen_boot_append         hvm_fep=1                                                              
+xen-4.5-testing            test-xtf-amd64-amd64-2                    xenbuildjob             build-amd64                                                            
+xen-4.5-testing            test-xtf-amd64-amd64-2                    xtfbuildjob             build-amd64-xtf                                                        
+xen-4.5-testing            test-xtf-amd64-amd64-3                    all_host_di_version     current                                                                
+xen-4.5-testing            test-xtf-amd64-amd64-3                    all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.5-testing            test-xtf-amd64-amd64-3                    all_host_suite          wheezy                                                                 
+xen-4.5-testing            test-xtf-amd64-amd64-3                    arch                    amd64                                                                  
+xen-4.5-testing            test-xtf-amd64-amd64-3                    buildjob                build-amd64                                                            
+xen-4.5-testing            test-xtf-amd64-amd64-3                    kernbuildjob            build-amd64-pvops                                                      
+xen-4.5-testing            test-xtf-amd64-amd64-3                    kernkind                pvops                                                                  
+xen-4.5-testing            test-xtf-amd64-amd64-3                    toolstack               xl                                                                     
+xen-4.5-testing            test-xtf-amd64-amd64-3                    xen_boot_append         hvm_fep=1                                                              
+xen-4.5-testing            test-xtf-amd64-amd64-3                    xenbuildjob             build-amd64                                                            
+xen-4.5-testing            test-xtf-amd64-amd64-3                    xtfbuildjob             build-amd64-xtf                                                        
+xen-4.5-testing            test-xtf-amd64-amd64-4                    all_host_di_version     current                                                                
+xen-4.5-testing            test-xtf-amd64-amd64-4                    all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.5-testing            test-xtf-amd64-amd64-4                    all_host_suite          wheezy                                                                 
+xen-4.5-testing            test-xtf-amd64-amd64-4                    arch                    amd64                                                                  
+xen-4.5-testing            test-xtf-amd64-amd64-4                    buildjob                build-amd64                                                            
+xen-4.5-testing            test-xtf-amd64-amd64-4                    kernbuildjob            build-amd64-pvops                                                      
+xen-4.5-testing            test-xtf-amd64-amd64-4                    kernkind                pvops                                                                  
+xen-4.5-testing            test-xtf-amd64-amd64-4                    toolstack               xl                                                                     
+xen-4.5-testing            test-xtf-amd64-amd64-4                    xen_boot_append         hvm_fep=1                                                              
+xen-4.5-testing            test-xtf-amd64-amd64-4                    xenbuildjob             build-amd64                                                            
+xen-4.5-testing            test-xtf-amd64-amd64-4                    xtfbuildjob             build-amd64-xtf                                                        
+xen-4.5-testing            test-xtf-amd64-amd64-5                    all_host_di_version     current                                                                
+xen-4.5-testing            test-xtf-amd64-amd64-5                    all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.5-testing            test-xtf-amd64-amd64-5                    all_host_suite          wheezy                                                                 
+xen-4.5-testing            test-xtf-amd64-amd64-5                    arch                    amd64                                                                  
+xen-4.5-testing            test-xtf-amd64-amd64-5                    buildjob                build-amd64                                                            
+xen-4.5-testing            test-xtf-amd64-amd64-5                    kernbuildjob            build-amd64-pvops                                                      
+xen-4.5-testing            test-xtf-amd64-amd64-5                    kernkind                pvops                                                                  
+xen-4.5-testing            test-xtf-amd64-amd64-5                    toolstack               xl                                                                     
+xen-4.5-testing            test-xtf-amd64-amd64-5                    xen_boot_append         hvm_fep=1                                                              
+xen-4.5-testing            test-xtf-amd64-amd64-5                    xenbuildjob             build-amd64                                                            
+xen-4.5-testing            test-xtf-amd64-amd64-5                    xtfbuildjob             build-amd64-xtf                                                        
 xen-4.6-testing            build-amd64                                           all_host_di_version     current                                                                
 xen-4.6-testing            build-amd64                                           all_host_suite          wheezy                                                                 
 xen-4.6-testing            build-amd64                                           arch                    amd64                                                                  
@@ -20415,6 +20539,13 @@
 xen-4.6-testing            build-amd64-xsm                                       tree_qemuu              git://xenbits.xen.org/qemu-xen.git                                     
 xen-4.6-testing            build-amd64-xsm                                       tree_seabios                                                                                   
 xen-4.6-testing            build-amd64-xsm                                       tree_xen                git://xenbits.xen.org/xen.git                                          
+xen-4.6-testing            build-amd64-xtf                                       all_host_di_version     current                                                                
+xen-4.6-testing            build-amd64-xtf                                       all_host_suite          wheezy                                                                 
+xen-4.6-testing            build-amd64-xtf                                       arch                    amd64                                                                  
+xen-4.6-testing            build-amd64-xtf                                       build_lvextend_max      50                                                                     
+xen-4.6-testing            build-amd64-xtf                                       host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build         
+xen-4.6-testing            build-amd64-xtf                                       revision_xtf            ap-fetch-version-baseline:xtf                                          
+xen-4.6-testing            build-amd64-xtf                                       tree_xtf                git://xenbits.xen.org/people/liuw/xtf.git                              
 xen-4.6-testing            build-armhf                                           all_host_di_version     current                                                                
 xen-4.6-testing            build-armhf                                           all_host_suite          wheezy                                                                 
 xen-4.6-testing            build-armhf                                           arch                    armhf                                                                  
@@ -21558,6 +21689,61 @@
 xen-4.6-testing            test-armhf-armhf-xl-xsm                               kernkind                pvops                                                                  
 xen-4.6-testing            test-armhf-armhf-xl-xsm                               toolstack               xl                                                                     
 xen-4.6-testing            test-armhf-armhf-xl-xsm                               xenbuildjob             build-armhf-xsm                                                        
+xen-4.6-testing            test-xtf-amd64-amd64-1                                all_host_di_version     current                                                                
+xen-4.6-testing            test-xtf-amd64-amd64-1                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.6-testing            test-xtf-amd64-amd64-1                                all_host_suite          wheezy                                                                 
+xen-4.6-testing            test-xtf-amd64-amd64-1                                arch                    amd64                                                                  
+xen-4.6-testing            test-xtf-amd64-amd64-1                                buildjob                build-amd64                                                            
+xen-4.6-testing            test-xtf-amd64-amd64-1                                kernbuildjob            build-amd64-pvops                                                      
+xen-4.6-testing            test-xtf-amd64-amd64-1                                kernkind                pvops                                                                  
+xen-4.6-testing            test-xtf-amd64-amd64-1                                toolstack               xl                                                                     
+xen-4.6-testing            test-xtf-amd64-amd64-1                                xen_boot_append         hvm_fep=1                                                              
+xen-4.6-testing            test-xtf-amd64-amd64-1                                xenbuildjob             build-amd64                                                            
+xen-4.6-testing            test-xtf-amd64-amd64-1                                xtfbuildjob             build-amd64-xtf                                                        
+xen-4.6-testing            test-xtf-amd64-amd64-2                                all_host_di_version     current                                                                
+xen-4.6-testing            test-xtf-amd64-amd64-2                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.6-testing            test-xtf-amd64-amd64-2                                all_host_suite          wheezy                                                                 
+xen-4.6-testing            test-xtf-amd64-amd64-2                                arch                    amd64                                                                  
+xen-4.6-testing            test-xtf-amd64-amd64-2                                buildjob                build-amd64                                                            
+xen-4.6-testing            test-xtf-amd64-amd64-2                                kernbuildjob            build-amd64-pvops                                                      
+xen-4.6-testing            test-xtf-amd64-amd64-2                                kernkind                pvops                                                                  
+xen-4.6-testing            test-xtf-amd64-amd64-2                                toolstack               xl                                                                     
+xen-4.6-testing            test-xtf-amd64-amd64-2                                xen_boot_append         hvm_fep=1                                                              
+xen-4.6-testing            test-xtf-amd64-amd64-2                                xenbuildjob             build-amd64                                                            
+xen-4.6-testing            test-xtf-amd64-amd64-2                                xtfbuildjob             build-amd64-xtf                                                        
+xen-4.6-testing            test-xtf-amd64-amd64-3                                all_host_di_version     current                                                                
+xen-4.6-testing            test-xtf-amd64-amd64-3                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.6-testing            test-xtf-amd64-amd64-3                                all_host_suite          wheezy                                                                 
+xen-4.6-testing            test-xtf-amd64-amd64-3                                arch                    amd64                                                                  
+xen-4.6-testing            test-xtf-amd64-amd64-3                                buildjob                build-amd64                                                            
+xen-4.6-testing            test-xtf-amd64-amd64-3                                kernbuildjob            build-amd64-pvops                                                      
+xen-4.6-testing            test-xtf-amd64-amd64-3                                kernkind                pvops                                                                  
+xen-4.6-testing            test-xtf-amd64-amd64-3                                toolstack               xl                                                                     
+xen-4.6-testing            test-xtf-amd64-amd64-3                                xen_boot_append         hvm_fep=1                                                              
+xen-4.6-testing            test-xtf-amd64-amd64-3                                xenbuildjob             build-amd64                                                            
+xen-4.6-testing            test-xtf-amd64-amd64-3                                xtfbuildjob             build-amd64-xtf                                                        
+xen-4.6-testing            test-xtf-amd64-amd64-4                                all_host_di_version     current                                                                
+xen-4.6-testing            test-xtf-amd64-amd64-4                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.6-testing            test-xtf-amd64-amd64-4                                all_host_suite          wheezy                                                                 
+xen-4.6-testing            test-xtf-amd64-amd64-4                                arch                    amd64                                                                  
+xen-4.6-testing            test-xtf-amd64-amd64-4                                buildjob                build-amd64                                                            
+xen-4.6-testing            test-xtf-amd64-amd64-4                                kernbuildjob            build-amd64-pvops                                                      
+xen-4.6-testing            test-xtf-amd64-amd64-4                                kernkind                pvops                                                                  
+xen-4.6-testing            test-xtf-amd64-amd64-4                                toolstack               xl                                                                     
+xen-4.6-testing            test-xtf-amd64-amd64-4                                xen_boot_append         hvm_fep=1                                                              
+xen-4.6-testing            test-xtf-amd64-amd64-4                                xenbuildjob             build-amd64                                                            
+xen-4.6-testing            test-xtf-amd64-amd64-4                                xtfbuildjob             build-amd64-xtf                                                        
+xen-4.6-testing            test-xtf-amd64-amd64-5                                all_host_di_version     current                                                                
+xen-4.6-testing            test-xtf-amd64-amd64-5                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.6-testing            test-xtf-amd64-amd64-5                                all_host_suite          wheezy                                                                 
+xen-4.6-testing            test-xtf-amd64-amd64-5                                arch                    amd64                                                                  
+xen-4.6-testing            test-xtf-amd64-amd64-5                                buildjob                build-amd64                                                            
+xen-4.6-testing            test-xtf-amd64-amd64-5                                kernbuildjob            build-amd64-pvops                                                      
+xen-4.6-testing            test-xtf-amd64-amd64-5                                kernkind                pvops                                                                  
+xen-4.6-testing            test-xtf-amd64-amd64-5                                toolstack               xl                                                                     
+xen-4.6-testing            test-xtf-amd64-amd64-5                                xen_boot_append         hvm_fep=1                                                              
+xen-4.6-testing            test-xtf-amd64-amd64-5                                xenbuildjob             build-amd64                                                            
+xen-4.6-testing            test-xtf-amd64-amd64-5                                xtfbuildjob             build-amd64-xtf                                                        
 xen-4.7-testing            build-amd64                                           all_host_di_version     current                                                                
 xen-4.7-testing            build-amd64                                           all_host_suite          wheezy                                                                 
 xen-4.7-testing            build-amd64                                           arch                    amd64                                                                  
@@ -21642,6 +21828,13 @@
 xen-4.7-testing            build-amd64-xsm                                       tree_qemuu              git://xenbits.xen.org/qemu-xen.git                                     
 xen-4.7-testing            build-amd64-xsm                                       tree_seabios                                                                                   
 xen-4.7-testing            build-amd64-xsm                                       tree_xen                git://xenbits.xen.org/xen.git                                          
+xen-4.7-testing            build-amd64-xtf                                       all_host_di_version     current                                                                
+xen-4.7-testing            build-amd64-xtf                                       all_host_suite          wheezy                                                                 
+xen-4.7-testing            build-amd64-xtf                                       arch                    amd64                                                                  
+xen-4.7-testing            build-amd64-xtf                                       build_lvextend_max      50                                                                     
+xen-4.7-testing            build-amd64-xtf                                       host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build         
+xen-4.7-testing            build-amd64-xtf                                       revision_xtf            ap-fetch-version-baseline:xtf                                          
+xen-4.7-testing            build-amd64-xtf                                       tree_xtf                git://xenbits.xen.org/people/liuw/xtf.git                              
 xen-4.7-testing            build-armhf                                           all_host_di_version     current                                                                
 xen-4.7-testing            build-armhf                                           all_host_suite          wheezy                                                                 
 xen-4.7-testing            build-armhf                                           arch                    armhf                                                                  
@@ -22785,6 +22978,61 @@
 xen-4.7-testing            test-armhf-armhf-xl-xsm                               kernkind                pvops                                                                  
 xen-4.7-testing            test-armhf-armhf-xl-xsm                               toolstack               xl                                                                     
 xen-4.7-testing            test-armhf-armhf-xl-xsm                               xenbuildjob             build-armhf-xsm                                                        
+xen-4.7-testing            test-xtf-amd64-amd64-1                                all_host_di_version     current                                                                
+xen-4.7-testing            test-xtf-amd64-amd64-1                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.7-testing            test-xtf-amd64-amd64-1                                all_host_suite          wheezy                                                                 
+xen-4.7-testing            test-xtf-amd64-amd64-1                                arch                    amd64                                                                  
+xen-4.7-testing            test-xtf-amd64-amd64-1                                buildjob                build-amd64                                                            
+xen-4.7-testing            test-xtf-amd64-amd64-1                                kernbuildjob            build-amd64-pvops                                                      
+xen-4.7-testing            test-xtf-amd64-amd64-1                                kernkind                pvops                                                                  
+xen-4.7-testing            test-xtf-amd64-amd64-1                                toolstack               xl                                                                     
+xen-4.7-testing            test-xtf-amd64-amd64-1                                xen_boot_append         hvm_fep=1                                                              
+xen-4.7-testing            test-xtf-amd64-amd64-1                                xenbuildjob             build-amd64                                                            
+xen-4.7-testing            test-xtf-amd64-amd64-1                                xtfbuildjob             build-amd64-xtf                                                        
+xen-4.7-testing            test-xtf-amd64-amd64-2                                all_host_di_version     current                                                                
+xen-4.7-testing            test-xtf-amd64-amd64-2                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.7-testing            test-xtf-amd64-amd64-2                                all_host_suite          wheezy                                                                 
+xen-4.7-testing            test-xtf-amd64-amd64-2                                arch                    amd64                                                                  
+xen-4.7-testing            test-xtf-amd64-amd64-2                                buildjob                build-amd64                                                            
+xen-4.7-testing            test-xtf-amd64-amd64-2                                kernbuildjob            build-amd64-pvops                                                      
+xen-4.7-testing            test-xtf-amd64-amd64-2                                kernkind                pvops                                                                  
+xen-4.7-testing            test-xtf-amd64-amd64-2                                toolstack               xl                                                                     
+xen-4.7-testing            test-xtf-amd64-amd64-2                                xen_boot_append         hvm_fep=1                                                              
+xen-4.7-testing            test-xtf-amd64-amd64-2                                xenbuildjob             build-amd64                                                            
+xen-4.7-testing            test-xtf-amd64-amd64-2                                xtfbuildjob             build-amd64-xtf                                                        
+xen-4.7-testing            test-xtf-amd64-amd64-3                                all_host_di_version     current                                                                
+xen-4.7-testing            test-xtf-amd64-amd64-3                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.7-testing            test-xtf-amd64-amd64-3                                all_host_suite          wheezy                                                                 
+xen-4.7-testing            test-xtf-amd64-amd64-3                                arch                    amd64                                                                  
+xen-4.7-testing            test-xtf-amd64-amd64-3                                buildjob                build-amd64                                                            
+xen-4.7-testing            test-xtf-amd64-amd64-3                                kernbuildjob            build-amd64-pvops                                                      
+xen-4.7-testing            test-xtf-amd64-amd64-3                                kernkind                pvops                                                                  
+xen-4.7-testing            test-xtf-amd64-amd64-3                                toolstack               xl                                                                     
+xen-4.7-testing            test-xtf-amd64-amd64-3                                xen_boot_append         hvm_fep=1                                                              
+xen-4.7-testing            test-xtf-amd64-amd64-3                                xenbuildjob             build-amd64                                                            
+xen-4.7-testing            test-xtf-amd64-amd64-3                                xtfbuildjob             build-amd64-xtf                                                        
+xen-4.7-testing            test-xtf-amd64-amd64-4                                all_host_di_version     current                                                                
+xen-4.7-testing            test-xtf-amd64-amd64-4                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.7-testing            test-xtf-amd64-amd64-4                                all_host_suite          wheezy                                                                 
+xen-4.7-testing            test-xtf-amd64-amd64-4                                arch                    amd64                                                                  
+xen-4.7-testing            test-xtf-amd64-amd64-4                                buildjob                build-amd64                                                            
+xen-4.7-testing            test-xtf-amd64-amd64-4                                kernbuildjob            build-amd64-pvops                                                      
+xen-4.7-testing            test-xtf-amd64-amd64-4                                kernkind                pvops                                                                  
+xen-4.7-testing            test-xtf-amd64-amd64-4                                toolstack               xl                                                                     
+xen-4.7-testing            test-xtf-amd64-amd64-4                                xen_boot_append         hvm_fep=1                                                              
+xen-4.7-testing            test-xtf-amd64-amd64-4                                xenbuildjob             build-amd64                                                            
+xen-4.7-testing            test-xtf-amd64-amd64-4                                xtfbuildjob             build-amd64-xtf                                                        
+xen-4.7-testing            test-xtf-amd64-amd64-5                                all_host_di_version     current                                                                
+xen-4.7-testing            test-xtf-amd64-amd64-5                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-4.7-testing            test-xtf-amd64-amd64-5                                all_host_suite          wheezy                                                                 
+xen-4.7-testing            test-xtf-amd64-amd64-5                                arch                    amd64                                                                  
+xen-4.7-testing            test-xtf-amd64-amd64-5                                buildjob                build-amd64                                                            
+xen-4.7-testing            test-xtf-amd64-amd64-5                                kernbuildjob            build-amd64-pvops                                                      
+xen-4.7-testing            test-xtf-amd64-amd64-5                                kernkind                pvops                                                                  
+xen-4.7-testing            test-xtf-amd64-amd64-5                                toolstack               xl                                                                     
+xen-4.7-testing            test-xtf-amd64-amd64-5                                xen_boot_append         hvm_fep=1                                                              
+xen-4.7-testing            test-xtf-amd64-amd64-5                                xenbuildjob             build-amd64                                                            
+xen-4.7-testing            test-xtf-amd64-amd64-5                                xtfbuildjob             build-amd64-xtf                                                        
 xen-unstable               build-amd64                                           all_host_di_version     current                                                                
 xen-unstable               build-amd64                                           all_host_suite          wheezy                                                                 
 xen-unstable               build-amd64                                           arch                    amd64                                                                  
@@ -22878,6 +23126,13 @@
 xen-unstable               build-amd64-xsm                                       tree_qemuu              git://xenbits.xen.org/qemu-xen.git                                     
 xen-unstable               build-amd64-xsm                                       tree_seabios                                                                                   
 xen-unstable               build-amd64-xsm                                       tree_xen                git://xenbits.xen.org/xen.git                                          
+xen-unstable               build-amd64-xtf                                       all_host_di_version     current                                                                
+xen-unstable               build-amd64-xtf                                       all_host_suite          wheezy                                                                 
+xen-unstable               build-amd64-xtf                                       arch                    amd64                                                                  
+xen-unstable               build-amd64-xtf                                       build_lvextend_max      50                                                                     
+xen-unstable               build-amd64-xtf                                       host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build         
+xen-unstable               build-amd64-xtf                                       revision_xtf            ap-fetch-version-baseline:xtf                                          
+xen-unstable               build-amd64-xtf                                       tree_xtf                git://xenbits.xen.org/people/liuw/xtf.git                              
 xen-unstable               build-armhf                                           all_host_di_version     current                                                                
 xen-unstable               build-armhf                                           all_host_suite          wheezy                                                                 
 xen-unstable               build-armhf                                           arch                    armhf                                                                  
@@ -24168,3 +24423,120 @@
 xen-unstable               test-armhf-armhf-xl-xsm                               kernkind                pvops                                                                  
 xen-unstable               test-armhf-armhf-xl-xsm                               toolstack               xl                                                                     
 xen-unstable               test-armhf-armhf-xl-xsm                               xenbuildjob             build-armhf-xsm                                                        
+xen-unstable               test-xtf-amd64-amd64-1                                all_host_di_version     current                                                                
+xen-unstable               test-xtf-amd64-amd64-1                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-unstable               test-xtf-amd64-amd64-1                                all_host_suite          wheezy                                                                 
+xen-unstable               test-xtf-amd64-amd64-1                                arch                    amd64                                                                  
+xen-unstable               test-xtf-amd64-amd64-1                                buildjob                build-amd64                                                            
+xen-unstable               test-xtf-amd64-amd64-1                                kernbuildjob            build-amd64-pvops                                                      
+xen-unstable               test-xtf-amd64-amd64-1                                kernkind                pvops                                                                  
+xen-unstable               test-xtf-amd64-amd64-1                                toolstack               xl                                                                     
+xen-unstable               test-xtf-amd64-amd64-1                                xen_boot_append         hvm_fep=1                                                              
+xen-unstable               test-xtf-amd64-amd64-1                                xenbuildjob             build-amd64                                                            
+xen-unstable               test-xtf-amd64-amd64-1                                xtfbuildjob             build-amd64-xtf                                                        
+xen-unstable               test-xtf-amd64-amd64-2                                all_host_di_version     current                                                                
+xen-unstable               test-xtf-amd64-amd64-2                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-unstable               test-xtf-amd64-amd64-2                                all_host_suite          wheezy                                                                 
+xen-unstable               test-xtf-amd64-amd64-2                                arch                    amd64                                                                  
+xen-unstable               test-xtf-amd64-amd64-2                                buildjob                build-amd64                                                            
+xen-unstable               test-xtf-amd64-amd64-2                                kernbuildjob            build-amd64-pvops                                                      
+xen-unstable               test-xtf-amd64-amd64-2                                kernkind                pvops                                                                  
+xen-unstable               test-xtf-amd64-amd64-2                                toolstack               xl                                                                     
+xen-unstable               test-xtf-amd64-amd64-2                                xen_boot_append         hvm_fep=1                                                              
+xen-unstable               test-xtf-amd64-amd64-2                                xenbuildjob             build-amd64                                                            
+xen-unstable               test-xtf-amd64-amd64-2                                xtfbuildjob             build-amd64-xtf                                                        
+xen-unstable               test-xtf-amd64-amd64-3                                all_host_di_version     current                                                                
+xen-unstable               test-xtf-amd64-amd64-3                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-unstable               test-xtf-amd64-amd64-3                                all_host_suite          wheezy                                                                 
+xen-unstable               test-xtf-amd64-amd64-3                                arch                    amd64                                                                  
+xen-unstable               test-xtf-amd64-amd64-3                                buildjob                build-amd64                                                            
+xen-unstable               test-xtf-amd64-amd64-3                                kernbuildjob            build-amd64-pvops                                                      
+xen-unstable               test-xtf-amd64-amd64-3                                kernkind                pvops                                                                  
+xen-unstable               test-xtf-amd64-amd64-3                                toolstack               xl                                                                     
+xen-unstable               test-xtf-amd64-amd64-3                                xen_boot_append         hvm_fep=1                                                              
+xen-unstable               test-xtf-amd64-amd64-3                                xenbuildjob             build-amd64                                                            
+xen-unstable               test-xtf-amd64-amd64-3                                xtfbuildjob             build-amd64-xtf                                                        
+xen-unstable               test-xtf-amd64-amd64-4                                all_host_di_version     current                                                                
+xen-unstable               test-xtf-amd64-amd64-4                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-unstable               test-xtf-amd64-amd64-4                                all_host_suite          wheezy                                                                 
+xen-unstable               test-xtf-amd64-amd64-4                                arch                    amd64                                                                  
+xen-unstable               test-xtf-amd64-amd64-4                                buildjob                build-amd64                                                            
+xen-unstable               test-xtf-amd64-amd64-4                                kernbuildjob            build-amd64-pvops                                                      
+xen-unstable               test-xtf-amd64-amd64-4                                kernkind                pvops                                                                  
+xen-unstable               test-xtf-amd64-amd64-4                                toolstack               xl                                                                     
+xen-unstable               test-xtf-amd64-amd64-4                                xen_boot_append         hvm_fep=1                                                              
+xen-unstable               test-xtf-amd64-amd64-4                                xenbuildjob             build-amd64                                                            
+xen-unstable               test-xtf-amd64-amd64-4                                xtfbuildjob             build-amd64-xtf                                                        
+xen-unstable               test-xtf-amd64-amd64-5                                all_host_di_version     current                                                                
+xen-unstable               test-xtf-amd64-amd64-5                                all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86    
+xen-unstable               test-xtf-amd64-amd64-5                                all_host_suite          wheezy                                                                 
+xen-unstable               test-xtf-amd64-amd64-5                                arch                    amd64                                                                  
+xen-unstable               test-xtf-amd64-amd64-5                                buildjob                build-amd64                                                            
+xen-unstable               test-xtf-amd64-amd64-5                                kernbuildjob            build-amd64-pvops                                                      
+xen-unstable               test-xtf-amd64-amd64-5                                kernkind                pvops                                                                  
+xen-unstable               test-xtf-amd64-amd64-5                                toolstack               xl                                                                     
+xen-unstable               test-xtf-amd64-amd64-5                                xen_boot_append         hvm_fep=1                                                              
+xen-unstable               test-xtf-amd64-amd64-5                                xenbuildjob             build-amd64                                                            
+xen-unstable               test-xtf-amd64-amd64-5                                xtfbuildjob             build-amd64-xtf                                                        
+xtf                        build-amd64-xtf        all_host_di_version  current                                                            
+xtf                        build-amd64-xtf        all_host_suite       wheezy                                                             
+xtf                        build-amd64-xtf        arch                 amd64                                                              
+xtf                        build-amd64-xtf        build_lvextend_max   50                                                                 
+xtf                        build-amd64-xtf        host_hostflags       share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build     
+xtf                        build-amd64-xtf        revision_xtf         ap-fetch-version:xtf                                               
+xtf                        build-amd64-xtf        tree_xtf             git://xenbits.xen.org/people/liuw/xtf.git                          
+xtf                        test-xtf-amd64-amd64-1 all_host_di_version  current                                                            
+xtf                        test-xtf-amd64-amd64-1 all_hostflags        arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xtf                        test-xtf-amd64-amd64-1 all_host_suite       wheezy                                                             
+xtf                        test-xtf-amd64-amd64-1 arch                 amd64                                                              
+xtf                        test-xtf-amd64-amd64-1 buildjob             build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-1 kernbuildjob         build-amd64-pvops                                                  
+xtf                        test-xtf-amd64-amd64-1 kernkind             pvops                                                              
+xtf                        test-xtf-amd64-amd64-1 toolstack            xl                                                                 
+xtf                        test-xtf-amd64-amd64-1 xen_boot_append      hvm_fep=1                                                          
+xtf                        test-xtf-amd64-amd64-1 xenbuildjob          build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-1 xtfbuildjob          build-amd64-xtf                                                    
+xtf                        test-xtf-amd64-amd64-2 all_host_di_version  current                                                            
+xtf                        test-xtf-amd64-amd64-2 all_hostflags        arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xtf                        test-xtf-amd64-amd64-2 all_host_suite       wheezy                                                             
+xtf                        test-xtf-amd64-amd64-2 arch                 amd64                                                              
+xtf                        test-xtf-amd64-amd64-2 buildjob             build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-2 kernbuildjob         build-amd64-pvops                                                  
+xtf                        test-xtf-amd64-amd64-2 kernkind             pvops                                                              
+xtf                        test-xtf-amd64-amd64-2 toolstack            xl                                                                 
+xtf                        test-xtf-amd64-amd64-2 xen_boot_append      hvm_fep=1                                                          
+xtf                        test-xtf-amd64-amd64-2 xenbuildjob          build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-2 xtfbuildjob          build-amd64-xtf                                                    
+xtf                        test-xtf-amd64-amd64-3 all_host_di_version  current                                                            
+xtf                        test-xtf-amd64-amd64-3 all_hostflags        arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xtf                        test-xtf-amd64-amd64-3 all_host_suite       wheezy                                                             
+xtf                        test-xtf-amd64-amd64-3 arch                 amd64                                                              
+xtf                        test-xtf-amd64-amd64-3 buildjob             build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-3 kernbuildjob         build-amd64-pvops                                                  
+xtf                        test-xtf-amd64-amd64-3 kernkind             pvops                                                              
+xtf                        test-xtf-amd64-amd64-3 toolstack            xl                                                                 
+xtf                        test-xtf-amd64-amd64-3 xen_boot_append      hvm_fep=1                                                          
+xtf                        test-xtf-amd64-amd64-3 xenbuildjob          build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-3 xtfbuildjob          build-amd64-xtf                                                    
+xtf                        test-xtf-amd64-amd64-4 all_host_di_version  current                                                            
+xtf                        test-xtf-amd64-amd64-4 all_hostflags        arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xtf                        test-xtf-amd64-amd64-4 all_host_suite       wheezy                                                             
+xtf                        test-xtf-amd64-amd64-4 arch                 amd64                                                              
+xtf                        test-xtf-amd64-amd64-4 buildjob             build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-4 kernbuildjob         build-amd64-pvops                                                  
+xtf                        test-xtf-amd64-amd64-4 kernkind             pvops                                                              
+xtf                        test-xtf-amd64-amd64-4 toolstack            xl                                                                 
+xtf                        test-xtf-amd64-amd64-4 xen_boot_append      hvm_fep=1                                                          
+xtf                        test-xtf-amd64-amd64-4 xenbuildjob          build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-4 xtfbuildjob          build-amd64-xtf                                                    
+xtf                        test-xtf-amd64-amd64-5 all_host_di_version  current                                                            
+xtf                        test-xtf-amd64-amd64-5 all_hostflags        arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xtf                        test-xtf-amd64-amd64-5 all_host_suite       wheezy                                                             
+xtf                        test-xtf-amd64-amd64-5 arch                 amd64                                                              
+xtf                        test-xtf-amd64-amd64-5 buildjob             build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-5 kernbuildjob         build-amd64-pvops                                                  
+xtf                        test-xtf-amd64-amd64-5 kernkind             pvops                                                              
+xtf                        test-xtf-amd64-amd64-5 toolstack            xl                                                                 
+xtf                        test-xtf-amd64-amd64-5 xen_boot_append      hvm_fep=1                                                          
+xtf                        test-xtf-amd64-amd64-5 xenbuildjob          build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-5 xtfbuildjob          build-amd64-xtf                                                    

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply related	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards
  2016-09-08 17:00     ` Wei Liu
@ 2016-09-08 17:41       ` Ian Jackson
  2016-09-08 18:11         ` Wei Liu
  0 siblings, 1 reply; 43+ messages in thread
From: Ian Jackson @ 2016-09-08 17:41 UTC (permalink / raw)
  To: Wei Liu; +Cc: Xen-devel

Wei Liu writes ("Re: [OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards"):
> The following fixup patch is required to properly filter out unnecessary
> branches.

Right.

AFAICT the diff you present is of the results of the original v3 20/25
plus your fixup patch ?  If so, it looks good.

> There will be one further fixup patch to another patch to switch to use
> branch_wants_xtf_tests. I will post that separately.

What is the deployment situation ?  See my previous emails about
mg-branch-setup.

Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 24/25] make-flight: create 5 xtf jobs
  2016-09-08 17:01   ` Wei Liu
@ 2016-09-08 17:41     ` Ian Jackson
  0 siblings, 0 replies; 43+ messages in thread
From: Ian Jackson @ 2016-09-08 17:41 UTC (permalink / raw)
  To: Wei Liu; +Cc: Xen-devel

Wei Liu writes ("Re: [OSSTEST PATCH v3 24/25] make-flight: create 5 xtf jobs"):
> This is a fixup patch to switch from xenbranch_wants_xtf_tests to
> branch_wants_xtf_tests.

Right.  Please retain my ack.

Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 25/25] Create XTF branch
  2016-09-08 17:07         ` Wei Liu
@ 2016-09-08 17:45           ` Ian Jackson
  2016-09-08 18:07             ` Wei Liu
  0 siblings, 1 reply; 43+ messages in thread
From: Ian Jackson @ 2016-09-08 17:45 UTC (permalink / raw)
  To: Wei Liu; +Cc: Xen-devel

Wei Liu writes ("Re: [OSSTEST PATCH v3 25/25] Create XTF branch"):
> On Thu, Sep 08, 2016 at 03:47:38PM +0100, Ian Jackson wrote:
> > Thanks.  It's not entirely clear from your comments above whether this
> > is a diff for the whole of your series, including 20/25 (add build
> > jobs), or just for 25/25 (add xtf branch).
> 
> There would be one further fixup patch to change branch_wants_xtf_test
> to add xtf branch to it.

Right, the fixup patch is fine.

The runvars dump shows the following jobs in the xtf branch:

> +xtf                        build-amd64-xtf        [...]
> +xtf                        test-xtf-amd64-amd64-1 [...]
> +xtf                        test-xtf-amd64-amd64-2 [...]
> +xtf                        test-xtf-amd64-amd64-3 [...]
> +xtf                        test-xtf-amd64-amd64-4 [...]
> +xtf                        test-xtf-amd64-amd64-5 [...]

I think it needs a hypervisor and kernel build too!  Here are the
buildjobs it refers to:

> +xtf                        test-xtf-amd64-amd64-5 buildjob             build-amd64                                                        
> +xtf                        test-xtf-amd64-amd64-5 kernbuildjob         build-amd64-pvops                                                  
> +xtf                        test-xtf-amd64-amd64-5 xenbuildjob          build-amd64                                                        
> +xtf                        test-xtf-amd64-amd64-5 xtfbuildjob          build-amd64-xtf                                                    

I'm kind of surprised that the build-amd64-xtf job does not need to
refer to a hypervisor build.  Perhaps XTF has its own copy of the Xen
public headers ?

thanks,
Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 25/25] Create XTF branch
  2016-09-08 17:45           ` Ian Jackson
@ 2016-09-08 18:07             ` Wei Liu
  2016-09-09 10:04               ` Ian Jackson
  0 siblings, 1 reply; 43+ messages in thread
From: Wei Liu @ 2016-09-08 18:07 UTC (permalink / raw)
  To: Ian Jackson; +Cc: Xen-devel, Wei Liu

On Thu, Sep 08, 2016 at 06:45:06PM +0100, Ian Jackson wrote:
> Wei Liu writes ("Re: [OSSTEST PATCH v3 25/25] Create XTF branch"):
> > On Thu, Sep 08, 2016 at 03:47:38PM +0100, Ian Jackson wrote:
> > > Thanks.  It's not entirely clear from your comments above whether this
> > > is a diff for the whole of your series, including 20/25 (add build
> > > jobs), or just for 25/25 (add xtf branch).
> > 
> > There would be one further fixup patch to change branch_wants_xtf_test
> > to add xtf branch to it.
> 
> Right, the fixup patch is fine.
> 
> The runvars dump shows the following jobs in the xtf branch:
> 
> > +xtf                        build-amd64-xtf        [...]
> > +xtf                        test-xtf-amd64-amd64-1 [...]
> > +xtf                        test-xtf-amd64-amd64-2 [...]
> > +xtf                        test-xtf-amd64-amd64-3 [...]
> > +xtf                        test-xtf-amd64-amd64-4 [...]
> > +xtf                        test-xtf-amd64-amd64-5 [...]
> 
> I think it needs a hypervisor and kernel build too!  Here are the

It does have hypervisor and kernel build jobs, but they were somehow
truncated in my mail, sorry.  Here is the complete output for xtf
branch:

--- /proc/self/fd/13	2016-09-08 19:05:52.230115257 +0100
+++ /proc/self/fd/14	2016-09-08 19:05:52.230115257 +0100
+xtf                        build-amd64            all_host_di_version     current                                                            
+xtf                        build-amd64            all_host_suite          wheezy                                                             
+xtf                        build-amd64            arch                    amd64                                                              
+xtf                        build-amd64            build_lvextend_max      50                                                                 
+xtf                        build-amd64            enable_ovmf             true                                                               
+xtf                        build-amd64            enable_xend             false                                                              
+xtf                        build-amd64            enable_xsm              false                                                              
+xtf                        build-amd64            host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build     
+xtf                        build-amd64-pvops      all_host_di_version     current                                                            
+xtf                        build-amd64-pvops      all_host_suite          wheezy                                                             
+xtf                        build-amd64-pvops      arch                    amd64                                                              
+xtf                        build-amd64-pvops      build_lvextend_max      50                                                                 
+xtf                        build-amd64-pvops      host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build     
+xtf                        build-amd64-pvops      kconfighow              xen-enable-xen-config                                              
+xtf                        build-amd64-pvops      revision_linux          ap-fetch-version-baseline:linux                                    
+xtf                        build-amd64-pvops      revision_linuxfirmware  ap-fetch-version-baseline:linuxfirmware                            
+xtf                        build-amd64-pvops      tree_linuxfirmware      git://xenbits.xen.org/osstest/linux-firmware.git                   
+xtf                        build-amd64-pvops      tree_linux              git://xenbits.xen.org/linux-pvops.git                              
+xtf                        build-amd64-pvops      treevcs_linux           git                                                                
+xtf                        build-amd64            revision_minios                                                                            
+xtf                        build-amd64            revision_ovmf                                                                              
+xtf                        build-amd64            revision_qemu                                                                              
+xtf                        build-amd64            revision_qemuu          ap-fetch-version-baseline:qemu-upstream-unstable                   
+xtf                        build-amd64            revision_seabios                                                                           
+xtf                        build-amd64            revision_xen            ap-fetch-version-baseline:xen-unstable                             
+xtf                        build-amd64            tree_minios                                                                                
+xtf                        build-amd64            tree_ovmf                                                                                  
+xtf                        build-amd64            tree_qemu               git://xenbits.xen.org/qemu-xen-traditional.git                     
+xtf                        build-amd64            tree_qemuu              git://xenbits.xen.org/qemu-xen.git                                 
+xtf                        build-amd64            tree_seabios                                                                               
+xtf                        build-amd64            tree_xen                git://xenbits.xen.org/xen.git                                      
+xtf                        build-amd64-xtf        all_host_di_version     current                                                            
+xtf                        build-amd64-xtf        all_host_suite          wheezy                                                             
+xtf                        build-amd64-xtf        arch                    amd64                                                              
+xtf                        build-amd64-xtf        build_lvextend_max      50                                                                 
+xtf                        build-amd64-xtf        host_hostflags          share-build-wheezy-amd64,arch-amd64,suite-wheezy,purpose-build     
+xtf                        build-amd64-xtf        revision_xtf            ap-fetch-version:xtf                                               
+xtf                        build-amd64-xtf        tree_xtf                git://xenbits.xen.org/people/liuw/xtf.git                          
+xtf                        test-xtf-amd64-amd64-1 all_host_di_version     current                                                            
+xtf                        test-xtf-amd64-amd64-1 all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xtf                        test-xtf-amd64-amd64-1 all_host_suite          wheezy                                                             
+xtf                        test-xtf-amd64-amd64-1 arch                    amd64                                                              
+xtf                        test-xtf-amd64-amd64-1 buildjob                build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-1 kernbuildjob            build-amd64-pvops                                                  
+xtf                        test-xtf-amd64-amd64-1 kernkind                pvops                                                              
+xtf                        test-xtf-amd64-amd64-1 toolstack               xl                                                                 
+xtf                        test-xtf-amd64-amd64-1 xen_boot_append         hvm_fep=1                                                          
+xtf                        test-xtf-amd64-amd64-1 xenbuildjob             build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-1 xtfbuildjob             build-amd64-xtf                                                    
+xtf                        test-xtf-amd64-amd64-2 all_host_di_version     current                                                            
+xtf                        test-xtf-amd64-amd64-2 all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xtf                        test-xtf-amd64-amd64-2 all_host_suite          wheezy                                                             
+xtf                        test-xtf-amd64-amd64-2 arch                    amd64                                                              
+xtf                        test-xtf-amd64-amd64-2 buildjob                build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-2 kernbuildjob            build-amd64-pvops                                                  
+xtf                        test-xtf-amd64-amd64-2 kernkind                pvops                                                              
+xtf                        test-xtf-amd64-amd64-2 toolstack               xl                                                                 
+xtf                        test-xtf-amd64-amd64-2 xen_boot_append         hvm_fep=1                                                          
+xtf                        test-xtf-amd64-amd64-2 xenbuildjob             build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-2 xtfbuildjob             build-amd64-xtf                                                    
+xtf                        test-xtf-amd64-amd64-3 all_host_di_version     current                                                            
+xtf                        test-xtf-amd64-amd64-3 all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xtf                        test-xtf-amd64-amd64-3 all_host_suite          wheezy                                                             
+xtf                        test-xtf-amd64-amd64-3 arch                    amd64                                                              
+xtf                        test-xtf-amd64-amd64-3 buildjob                build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-3 kernbuildjob            build-amd64-pvops                                                  
+xtf                        test-xtf-amd64-amd64-3 kernkind                pvops                                                              
+xtf                        test-xtf-amd64-amd64-3 toolstack               xl                                                                 
+xtf                        test-xtf-amd64-amd64-3 xen_boot_append         hvm_fep=1                                                          
+xtf                        test-xtf-amd64-amd64-3 xenbuildjob             build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-3 xtfbuildjob             build-amd64-xtf                                                    
+xtf                        test-xtf-amd64-amd64-4 all_host_di_version     current                                                            
+xtf                        test-xtf-amd64-amd64-4 all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xtf                        test-xtf-amd64-amd64-4 all_host_suite          wheezy                                                             
+xtf                        test-xtf-amd64-amd64-4 arch                    amd64                                                              
+xtf                        test-xtf-amd64-amd64-4 buildjob                build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-4 kernbuildjob            build-amd64-pvops                                                  
+xtf                        test-xtf-amd64-amd64-4 kernkind                pvops                                                              
+xtf                        test-xtf-amd64-amd64-4 toolstack               xl                                                                 
+xtf                        test-xtf-amd64-amd64-4 xen_boot_append         hvm_fep=1                                                          
+xtf                        test-xtf-amd64-amd64-4 xenbuildjob             build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-4 xtfbuildjob             build-amd64-xtf                                                    
+xtf                        test-xtf-amd64-amd64-5 all_host_di_version     current                                                            
+xtf                        test-xtf-amd64-amd64-5 all_hostflags           arch-amd64,arch-xen-amd64,suite-wheezy,purpose-test,diverse-xtf-x86
+xtf                        test-xtf-amd64-amd64-5 all_host_suite          wheezy                                                             
+xtf                        test-xtf-amd64-amd64-5 arch                    amd64                                                              
+xtf                        test-xtf-amd64-amd64-5 buildjob                build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-5 kernbuildjob            build-amd64-pvops                                                  
+xtf                        test-xtf-amd64-amd64-5 kernkind                pvops                                                              
+xtf                        test-xtf-amd64-amd64-5 toolstack               xl                                                                 
+xtf                        test-xtf-amd64-amd64-5 xen_boot_append         hvm_fep=1                                                          
+xtf                        test-xtf-amd64-amd64-5 xenbuildjob             build-amd64                                                        
+xtf                        test-xtf-amd64-amd64-5 xtfbuildjob             build-amd64-xtf                                                    


> buildjobs it refers to:
> 
> > +xtf                        test-xtf-amd64-amd64-5 buildjob             build-amd64                                                        
> > +xtf                        test-xtf-amd64-amd64-5 kernbuildjob         build-amd64-pvops                                                  
> > +xtf                        test-xtf-amd64-amd64-5 xenbuildjob          build-amd64                                                        
> > +xtf                        test-xtf-amd64-amd64-5 xtfbuildjob          build-amd64-xtf                                                    
> 
> I'm kind of surprised that the build-amd64-xtf job does not need to
> refer to a hypervisor build.  Perhaps XTF has its own copy of the Xen
> public headers ?
> 

Yes, it has its own copy of Xen public headers.

Wei.

> thanks,
> Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards
  2016-09-08 17:41       ` Ian Jackson
@ 2016-09-08 18:11         ` Wei Liu
  2016-09-09 10:09           ` Ian Jackson
  0 siblings, 1 reply; 43+ messages in thread
From: Wei Liu @ 2016-09-08 18:11 UTC (permalink / raw)
  To: Ian Jackson; +Cc: Xen-devel, Wei Liu

On Thu, Sep 08, 2016 at 06:41:26PM +0100, Ian Jackson wrote:
> Wei Liu writes ("Re: [OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards"):
> > The following fixup patch is required to properly filter out unnecessary
> > branches.
> 
> Right.
> 
> AFAICT the diff you present is of the results of the original v3 20/25
> plus your fixup patch ?  If so, it looks good.
> 
> > There will be one further fixup patch to another patch to switch to use
> > branch_wants_xtf_tests. I will post that separately.
> 

Yes.

> What is the deployment situation ?  See my previous emails about
> mg-branch-setup.
> 

I'm not sure I know what INITIAL-TESTED-VERSION does. Let's have a
conversation IRL and I will write down something where appropriate.

Wei.

> Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 25/25] Create XTF branch
  2016-09-08 18:07             ` Wei Liu
@ 2016-09-09 10:04               ` Ian Jackson
  0 siblings, 0 replies; 43+ messages in thread
From: Ian Jackson @ 2016-09-09 10:04 UTC (permalink / raw)
  To: Wei Liu; +Cc: Xen-devel

Wei Liu writes ("Re: [OSSTEST PATCH v3 25/25] Create XTF branch"):
> On Thu, Sep 08, 2016 at 06:45:06PM +0100, Ian Jackson wrote:
> > I think it needs a hypervisor and kernel build too!  Here are the
> 
> It does have hypervisor and kernel build jobs, but they were somehow
> truncated in my mail, sorry.  Here is the complete output for xtf
> branch:

Oh!  OK, yes, that looks good.

Acked-by: Ian Jackson <ian.jackson@eu.citrix.com>

Thanks,
Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

* Re: [OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards
  2016-09-08 18:11         ` Wei Liu
@ 2016-09-09 10:09           ` Ian Jackson
  0 siblings, 0 replies; 43+ messages in thread
From: Ian Jackson @ 2016-09-09 10:09 UTC (permalink / raw)
  To: Wei Liu; +Cc: Xen-devel

Wei Liu writes ("Re: [OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards"):
> On Thu, Sep 08, 2016 at 06:41:26PM +0100, Ian Jackson wrote:
> > What is the deployment situation ?  See my previous emails about
> > mg-branch-setup.
> 
> I'm not sure I know what INITIAL-TESTED-VERSION does. Let's have a
> conversation IRL and I will write down something where appropriate.

mg-branch-setup is the tool which sets up an instance of the push gate
machinery.

We are creating a new push gate for xtf.  That is, there will be both
a staging branch and an osstest-tested branch.  If the osstest-tested
branch were to be missing, the push gate runs will bomb out during
flight construction.

So mg-branch-setup helpfully reminds its user (via its usage message)
that something should perhaps be pushed there.  Ie, if one passes it
an INITIAL-TESTED-VERSION, which should usually be a git commit hash,
then that hash is pushed to the osstest-tested branch.

Ian.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
https://lists.xen.org/xen-devel

^ permalink raw reply	[flat|nested] 43+ messages in thread

end of thread, other threads:[~2016-09-09 10:09 UTC | newest]

Thread overview: 43+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2016-09-06 13:09 [OSSTEST PATCH v3 00/25] Integrate XTF into OSSTest Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 01/25] Executive: Previous duration estimator: use overall time, not sum of steps Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 02/25] ts-hosts-allocate-Executive: Replace some odd commas with semicolons Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 03/25] sg-run-job: Add emacs mode comment Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 04/25] step status skip: Ignore in cs-bisection-step Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 05/25] step status skip: Ignore in report_run_getinfo Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 06/25] step status skip: Implement in sg-report-flight Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 07/25] ts-hosts-allocate-Executive: pass $plan to hid_find_possibilities Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 08/25] ts-hosts-allocate-Executive: Support diverse-CLASS hostflag Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 09/25] DO NOT APPLY make-flight-diverse-test: test case for " Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 10/25] Executive: Support substeps Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 11/25] DO NOT APPLY make-flight-substep-test Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 12/25] DO NOT APPLY provide ts-substep-test Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 13/25] ts-xen-build: always compile in FEP support Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 14/25] ap-common: add xtf tree Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 15/25] DO NOT APPLY point xtf to my personal tree Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 16/25] BuildSupport: move buildcmd_stamped_logged here Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 17/25] Introduce ts-xtf-build Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 18/25] sg-run-job: create xtf build recipe Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 19/25] Introduce ts-xtf-install Wei Liu
2016-09-06 14:01   ` Ian Jackson
2016-09-06 13:09 ` [OSSTEST PATCH v3 20/25] mfi-common: create xtf build job for 4.4 onwards Wei Liu
2016-09-06 14:06   ` Ian Jackson
2016-09-08 17:00     ` Wei Liu
2016-09-08 17:41       ` Ian Jackson
2016-09-08 18:11         ` Wei Liu
2016-09-09 10:09           ` Ian Jackson
2016-09-06 13:09 ` [OSSTEST PATCH v3 21/25] Introduce ts-xtf-fep Wei Liu
2016-09-06 14:07   ` Ian Jackson
2016-09-06 13:09 ` [OSSTEST PATCH v3 22/25] Introduce ts-xtf-run Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 23/25] sg-run-job: test-xtf recipe Wei Liu
2016-09-06 13:09 ` [OSSTEST PATCH v3 24/25] make-flight: create 5 xtf jobs Wei Liu
2016-09-08 17:01   ` Wei Liu
2016-09-08 17:41     ` Ian Jackson
2016-09-06 13:09 ` [OSSTEST PATCH v3 25/25] Create XTF branch Wei Liu
2016-09-06 14:03   ` Ian Jackson
2016-09-06 19:16     ` Wei Liu
2016-09-08 14:47       ` Ian Jackson
2016-09-08 17:07         ` Wei Liu
2016-09-08 17:45           ` Ian Jackson
2016-09-08 18:07             ` Wei Liu
2016-09-09 10:04               ` Ian Jackson
2016-09-06 19:14   ` Wei Liu

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.