Re: xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)

From: Andrew Cooper <andrew.cooper3@citrix.com>
To: Ian Jackson <ian.jackson@eu.citrix.com>,
	George Dunlap <dunlapg@umich.edu>
Cc: xen-devel <xen-devel@lists.xenproject.org>,
	Anshul Makkar <anshul.makkar@citrix.com>,
	Wei Liu <wei.liu2@citrix.com>,
	Roger Pau Monne <roger.pau@citrix.com>
Subject: Re: xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)
Date: Tue, 14 Jun 2016 18:27:05 +0100	[thread overview]
Message-ID: <db32a341-48e3-cc03-8c72-35671bf36193@citrix.com> (raw)
In-Reply-To: <22366.48912.679914.484689@mariner.uk.xensource.com>

On 13/06/16 15:11, Ian Jackson wrote:
> George Dunlap writes ("Re: [Xen-devel] xenbits "official" repo for XTF (was Re: [PATCH 0/2] xtf: add launcher (+1 bugfix)"):
>> On Mon, Jun 13, 2016 at 11:10 AM, Andrew Cooper
>>> I am not completely averse to changing it, but I don't see an
>>> alternative which is any better or clearer.
>> Do you have any opinions on "Xen verification framework"?
> The problem IMO is the word "framework" which implies some kind of
> daemonic machinery.

I disagree.  Framework implies building blocks.

I can't see any implication or suggestion of daemonic machinery here.

> The frameworky bit of XTF is quite small; mostly,
> it is a suite of test cases.  "Xen Micro-VM Test Suite" maybe ?

At the moment, the framework is larger than the suite, although I don't
necessarily expect this to remain the case.  Having said that, I would
argue that the "framework" is the more important part; It is the bit
with the complicated logic to build the same code into multiple
different VM types, and APIs to make test reporting easy and consistent.

>
> (I think "verification" is inaccurate because to me it implies formal
> methods, static analysis, or the like.)

I concur.  "verification" is definitely a less accurate description.

>
>> If we weren't going to change it, then you should probably put a note
>> somewhere near the top of the introduction saying something like, "If
>> you're looking for the Xen automated push-gate software, you want
>> osstest[link]", so that people who want osstest but search for "xen
>> test framework" find what they're looking for.
> "CI (continuous integration)" is the keyword that many people will
> have for osstest.
>
> I would suggest
>
>   (This is not the Xen Project's CI / Continuous Integration /
>    automated push gate system.  For that, see
>    <a href="wiki">osstest</a>.)
>
> or something.

I am happy to add text to that effect.

~Andrew

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel