All of lore.kernel.org
 help / color / mirror / Atom feed
* Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-10  1:28 ` Lars Kurth
  0 siblings, 0 replies; 14+ messages in thread
From: Lars Kurth @ 2019-05-10  1:28 UTC (permalink / raw)
  To: xen-devel; +Cc: Juergen Gross, Committers, Ian Jackson

Hi all,

following a discussion with committers about Guest testing in OSSTEST, it surfaced that we have not updated what distros we test in OSSTEST for a very long time. All agreed that we should regularly review what we test against: maybe at the beginning of a release cycle

In any case, currently we test against

x86 HVM guests:
  debian-9.4.0-{i386,amd64}-CD-1.iso
  rhel-server-6.1-i386-dvd.iso
  win10v1703-x86.iso
  win7-x64.iso
  ws16-x64.iso
  FreeBSD-10.1-CUSTOM-{i386,amd64}-20150525.raw.xz
  Debian HVM {i386,amd64} via debian-installer netinst [1]

x86 PV guests:
  Debian PV {i386,amd64} via debian-installer netinst [1]

ARM guests:
  Debian PV via debian-installer netinst [1]

[1] whatever Debian release osstest itself mostly runs

So I am opening the floor to suggestions.

With regards to Windows testing we have some restrictions. We have tried several times to buy additional test licenses, but this never went anywhere (some of the VM licenses are not available for our environment, unless you bulk buy, which is very expensive). The only approach that would allow us to test against different windows versions would be to require everyone who may touch OSSTEST which is not doable.

I can bring this up with the MS open source office, if there are strong feelings about this and try again

Lars

  
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

* [Xen-devel] Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-10  1:28 ` Lars Kurth
  0 siblings, 0 replies; 14+ messages in thread
From: Lars Kurth @ 2019-05-10  1:28 UTC (permalink / raw)
  To: xen-devel; +Cc: Juergen Gross, Committers, Ian Jackson

Hi all,

following a discussion with committers about Guest testing in OSSTEST, it surfaced that we have not updated what distros we test in OSSTEST for a very long time. All agreed that we should regularly review what we test against: maybe at the beginning of a release cycle

In any case, currently we test against

x86 HVM guests:
  debian-9.4.0-{i386,amd64}-CD-1.iso
  rhel-server-6.1-i386-dvd.iso
  win10v1703-x86.iso
  win7-x64.iso
  ws16-x64.iso
  FreeBSD-10.1-CUSTOM-{i386,amd64}-20150525.raw.xz
  Debian HVM {i386,amd64} via debian-installer netinst [1]

x86 PV guests:
  Debian PV {i386,amd64} via debian-installer netinst [1]

ARM guests:
  Debian PV via debian-installer netinst [1]

[1] whatever Debian release osstest itself mostly runs

So I am opening the floor to suggestions.

With regards to Windows testing we have some restrictions. We have tried several times to buy additional test licenses, but this never went anywhere (some of the VM licenses are not available for our environment, unless you bulk buy, which is very expensive). The only approach that would allow us to test against different windows versions would be to require everyone who may touch OSSTEST which is not doable.

I can bring this up with the MS open source office, if there are strong feelings about this and try again

Lars

  
_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-10  1:43   ` Rich Persaud
  0 siblings, 0 replies; 14+ messages in thread
From: Rich Persaud @ 2019-05-10  1:43 UTC (permalink / raw)
  To: Lars Kurth; +Cc: Juergen Gross, xen-devel, Committers, Ian Jackson


[-- Attachment #1.1: Type: text/plain, Size: 1563 bytes --]

> On May 9, 2019, at 21:28, Lars Kurth <lars.kurth.xen@gmail.com> wrote:
> 
> Hi all,
> 
> following a discussion with committers about Guest testing in OSSTEST, it surfaced that we have not updated what distros we test in OSSTEST for a very long time. All agreed that we should regularly review what we test against: maybe at the beginning of a release cycle
> 
> In any case, currently we test against
> 
> x86 HVM guests:
>  debian-9.4.0-{i386,amd64}-CD-1.iso
>  rhel-server-6.1-i386-dvd.iso
>  win10v1703-x86.iso
>  win7-x64.iso
>  ws16-x64.iso
>  FreeBSD-10.1-CUSTOM-{i386,amd64}-20150525.raw.xz
>  Debian HVM {i386,amd64} via debian-installer netinst [1]
> 
> x86 PV guests:
>  Debian PV {i386,amd64} via debian-installer netinst [1]
> 
> ARM guests:
>  Debian PV via debian-installer netinst [1]
> 
> [1] whatever Debian release osstest itself mostly runs
> 
> So I am opening the floor to suggestions.
> 
> With regards to Windows testing we have some restrictions. We have tried several times to buy additional test licenses, but this never went anywhere (some of the VM licenses are not available for our environment, unless you bulk buy, which is very expensive). The only approach that would allow us to test against different windows versions would be to require everyone who may touch OSSTEST which is not doable.

Are the 90-day test/eval versions of Windows incompatible with OSSTEST?

  https://www.microsoft.com/en-us/evalcenter/evaluate-windows-10-enterprise
  https://www.microsoft.com/en-us/evalcenter/

Rich

[-- Attachment #1.2: Type: text/html, Size: 2528 bytes --]

[-- Attachment #2: Type: text/plain, Size: 157 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: [Xen-devel] Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-10  1:43   ` Rich Persaud
  0 siblings, 0 replies; 14+ messages in thread
From: Rich Persaud @ 2019-05-10  1:43 UTC (permalink / raw)
  To: Lars Kurth; +Cc: Juergen Gross, xen-devel, Committers, Ian Jackson


[-- Attachment #1.1: Type: text/plain, Size: 1563 bytes --]

> On May 9, 2019, at 21:28, Lars Kurth <lars.kurth.xen@gmail.com> wrote:
> 
> Hi all,
> 
> following a discussion with committers about Guest testing in OSSTEST, it surfaced that we have not updated what distros we test in OSSTEST for a very long time. All agreed that we should regularly review what we test against: maybe at the beginning of a release cycle
> 
> In any case, currently we test against
> 
> x86 HVM guests:
>  debian-9.4.0-{i386,amd64}-CD-1.iso
>  rhel-server-6.1-i386-dvd.iso
>  win10v1703-x86.iso
>  win7-x64.iso
>  ws16-x64.iso
>  FreeBSD-10.1-CUSTOM-{i386,amd64}-20150525.raw.xz
>  Debian HVM {i386,amd64} via debian-installer netinst [1]
> 
> x86 PV guests:
>  Debian PV {i386,amd64} via debian-installer netinst [1]
> 
> ARM guests:
>  Debian PV via debian-installer netinst [1]
> 
> [1] whatever Debian release osstest itself mostly runs
> 
> So I am opening the floor to suggestions.
> 
> With regards to Windows testing we have some restrictions. We have tried several times to buy additional test licenses, but this never went anywhere (some of the VM licenses are not available for our environment, unless you bulk buy, which is very expensive). The only approach that would allow us to test against different windows versions would be to require everyone who may touch OSSTEST which is not doable.

Are the 90-day test/eval versions of Windows incompatible with OSSTEST?

  https://www.microsoft.com/en-us/evalcenter/evaluate-windows-10-enterprise
  https://www.microsoft.com/en-us/evalcenter/

Rich

[-- Attachment #1.2: Type: text/html, Size: 2528 bytes --]

[-- Attachment #2: Type: text/plain, Size: 157 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-10  7:48   ` Jan Beulich
  0 siblings, 0 replies; 14+ messages in thread
From: Jan Beulich @ 2019-05-10  7:48 UTC (permalink / raw)
  To: Lars Kurth; +Cc: Juergen Gross, xen-devel, Ian Jackson, committers

>>> On 10.05.19 at 03:28, <lars.kurth.xen@gmail.com> wrote:
> Hi all,
> 
> following a discussion with committers about Guest testing in OSSTEST, it 
> surfaced that we have not updated what distros we test in OSSTEST for a very 
> long time. All agreed that we should regularly review what we test against: 
> maybe at the beginning of a release cycle
> 
> In any case, currently we test against
> 
> x86 HVM guests:
>   debian-9.4.0-{i386,amd64}-CD-1.iso
>   rhel-server-6.1-i386-dvd.iso
>   win10v1703-x86.iso
>   win7-x64.iso
>   ws16-x64.iso
>   FreeBSD-10.1-CUSTOM-{i386,amd64}-20150525.raw.xz

Testing fixed snapshots (commonly the original release afaict) instead
of latest updates is pretty meaningless imo. While I would like to
recommend testing all the (active) distros of parties actively involved
in Xen development, I have to admite that I have no idea at all how
this would work for e.g. our SLE versions (such that latest bits would
get tested).

>   Debian HVM {i386,amd64} via debian-installer netinst [1]
> 
> x86 PV guests:
>   Debian PV {i386,amd64} via debian-installer netinst [1]
> 
> ARM guests:
>   Debian PV via debian-installer netinst [1]
> 
> [1] whatever Debian release osstest itself mostly runs
> 
> So I am opening the floor to suggestions.
> 
> With regards to Windows testing we have some restrictions. We have tried 
> several times to buy additional test licenses, but this never went anywhere 
> (some of the VM licenses are not available for our environment, unless you 
> bulk buy, which is very expensive). The only approach that would allow us to 
> test against different windows versions would be to require everyone who may 
> touch OSSTEST which is not doable.
> 
> I can bring this up with the MS open source office, if there are strong 
> feelings about this and try again

If there's at least a (not overly) small chance of succeeding, I think this
may be worth it, unless Rich's suggestion already helps.

Jan



_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: [Xen-devel] Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-10  7:48   ` Jan Beulich
  0 siblings, 0 replies; 14+ messages in thread
From: Jan Beulich @ 2019-05-10  7:48 UTC (permalink / raw)
  To: Lars Kurth; +Cc: Juergen Gross, xen-devel, Ian Jackson, committers

>>> On 10.05.19 at 03:28, <lars.kurth.xen@gmail.com> wrote:
> Hi all,
> 
> following a discussion with committers about Guest testing in OSSTEST, it 
> surfaced that we have not updated what distros we test in OSSTEST for a very 
> long time. All agreed that we should regularly review what we test against: 
> maybe at the beginning of a release cycle
> 
> In any case, currently we test against
> 
> x86 HVM guests:
>   debian-9.4.0-{i386,amd64}-CD-1.iso
>   rhel-server-6.1-i386-dvd.iso
>   win10v1703-x86.iso
>   win7-x64.iso
>   ws16-x64.iso
>   FreeBSD-10.1-CUSTOM-{i386,amd64}-20150525.raw.xz

Testing fixed snapshots (commonly the original release afaict) instead
of latest updates is pretty meaningless imo. While I would like to
recommend testing all the (active) distros of parties actively involved
in Xen development, I have to admite that I have no idea at all how
this would work for e.g. our SLE versions (such that latest bits would
get tested).

>   Debian HVM {i386,amd64} via debian-installer netinst [1]
> 
> x86 PV guests:
>   Debian PV {i386,amd64} via debian-installer netinst [1]
> 
> ARM guests:
>   Debian PV via debian-installer netinst [1]
> 
> [1] whatever Debian release osstest itself mostly runs
> 
> So I am opening the floor to suggestions.
> 
> With regards to Windows testing we have some restrictions. We have tried 
> several times to buy additional test licenses, but this never went anywhere 
> (some of the VM licenses are not available for our environment, unless you 
> bulk buy, which is very expensive). The only approach that would allow us to 
> test against different windows versions would be to require everyone who may 
> touch OSSTEST which is not doable.
> 
> I can bring this up with the MS open source office, if there are strong 
> feelings about this and try again

If there's at least a (not overly) small chance of succeeding, I think this
may be worth it, unless Rich's suggestion already helps.

Jan



_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-10 12:41     ` Lars Kurth
  0 siblings, 0 replies; 14+ messages in thread
From: Lars Kurth @ 2019-05-10 12:41 UTC (permalink / raw)
  To: 'Jan Beulich'
  Cc: Juergen Gross, xen-devel, Paul Durrant, Ian Jackson, Committers


[-- Attachment #1.1: Type: text/plain, Size: 879 bytes --]



> On 10 May 2019, at 01:48, Jan Beulich <JBeulich@suse.com> wrote:
>> 
>> With regards to Windows testing we have some restrictions. We have tried 
>> several times to buy additional test licenses, but this never went anywhere 
>> (some of the VM licenses are not available for our environment, unless you 
>> bulk buy, which is very expensive). The only approach that would allow us to 
>> test against different windows versions would be to require everyone who may 
>> touch OSSTEST which is not doable.
>> 
>> I can bring this up with the MS open source office, if there are strong 
>> feelings about this and try again
> 
> If there's at least a (not overly) small chance of succeeding, I think this
> may be worth it, unless Rich's suggestion already helps.
> 

I will try again. Let's work on the basis that this is possible and see where it goes
Lars

[-- Attachment #1.2: Type: text/html, Size: 3898 bytes --]

[-- Attachment #2: Type: text/plain, Size: 157 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: [Xen-devel] Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-10 12:41     ` Lars Kurth
  0 siblings, 0 replies; 14+ messages in thread
From: Lars Kurth @ 2019-05-10 12:41 UTC (permalink / raw)
  To: 'Jan Beulich'
  Cc: Juergen Gross, xen-devel, Paul Durrant, Ian Jackson, Committers


[-- Attachment #1.1: Type: text/plain, Size: 879 bytes --]



> On 10 May 2019, at 01:48, Jan Beulich <JBeulich@suse.com> wrote:
>> 
>> With regards to Windows testing we have some restrictions. We have tried 
>> several times to buy additional test licenses, but this never went anywhere 
>> (some of the VM licenses are not available for our environment, unless you 
>> bulk buy, which is very expensive). The only approach that would allow us to 
>> test against different windows versions would be to require everyone who may 
>> touch OSSTEST which is not doable.
>> 
>> I can bring this up with the MS open source office, if there are strong 
>> feelings about this and try again
> 
> If there's at least a (not overly) small chance of succeeding, I think this
> may be worth it, unless Rich's suggestion already helps.
> 

I will try again. Let's work on the basis that this is possible and see where it goes
Lars

[-- Attachment #1.2: Type: text/html, Size: 3898 bytes --]

[-- Attachment #2: Type: text/plain, Size: 157 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-24 21:26     ` Lars Kurth
  0 siblings, 0 replies; 14+ messages in thread
From: Lars Kurth @ 2019-05-24 21:26 UTC (permalink / raw)
  To: Rich Persaud; +Cc: Juergen Gross, xen-devel, Committers, Ian Jackson


[-- Attachment #1.1: Type: text/plain, Size: 1120 bytes --]



> On 9 May 2019, at 19:43, Rich Persaud <persaur@gmail.com> wrote:
> 
> On May 9, 2019, at 21:28, Lars Kurth <lars.kurth.xen@gmail.com <mailto:lars.kurth.xen@gmail.com>> wrote:
> 
>> With regards to Windows testing we have some restrictions. We have tried several times to buy additional test licenses, but this never went anywhere (some of the VM licenses are not available for our environment, unless you bulk buy, which is very expensive). The only approach that would allow us to test against different windows versions would be to require everyone who may touch OSSTEST which is not doable.
> 
> Are the 90-day test/eval versions of Windows incompatible with OSSTEST?
> 
>   https://www.microsoft.com/en-us/evalcenter/evaluate-windows-10-enterprise <https://www.microsoft.com/en-us/evalcenter/evaluate-windows-10-enterprise>
>   https://www.microsoft.com/en-us/evalcenter/ <https://www.microsoft.com/en-us/evalcenter/>
> 

Actually, that's a possibility. Our use may not be compatible with the T&D's of the eval license though. It wasn't when we checked last time. But that can be checked.
Lars


[-- Attachment #1.2: Type: text/html, Size: 2167 bytes --]

[-- Attachment #2: Type: text/plain, Size: 157 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: [Xen-devel] Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-24 21:26     ` Lars Kurth
  0 siblings, 0 replies; 14+ messages in thread
From: Lars Kurth @ 2019-05-24 21:26 UTC (permalink / raw)
  To: Rich Persaud; +Cc: Juergen Gross, xen-devel, Committers, Ian Jackson


[-- Attachment #1.1: Type: text/plain, Size: 1120 bytes --]



> On 9 May 2019, at 19:43, Rich Persaud <persaur@gmail.com> wrote:
> 
> On May 9, 2019, at 21:28, Lars Kurth <lars.kurth.xen@gmail.com <mailto:lars.kurth.xen@gmail.com>> wrote:
> 
>> With regards to Windows testing we have some restrictions. We have tried several times to buy additional test licenses, but this never went anywhere (some of the VM licenses are not available for our environment, unless you bulk buy, which is very expensive). The only approach that would allow us to test against different windows versions would be to require everyone who may touch OSSTEST which is not doable.
> 
> Are the 90-day test/eval versions of Windows incompatible with OSSTEST?
> 
>   https://www.microsoft.com/en-us/evalcenter/evaluate-windows-10-enterprise <https://www.microsoft.com/en-us/evalcenter/evaluate-windows-10-enterprise>
>   https://www.microsoft.com/en-us/evalcenter/ <https://www.microsoft.com/en-us/evalcenter/>
> 

Actually, that's a possibility. Our use may not be compatible with the T&D's of the eval license though. It wasn't when we checked last time. But that can be checked.
Lars


[-- Attachment #1.2: Type: text/html, Size: 2167 bytes --]

[-- Attachment #2: Type: text/plain, Size: 157 bytes --]

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-24 21:57   ` Lars Kurth
  0 siblings, 0 replies; 14+ messages in thread
From: Lars Kurth @ 2019-05-24 21:57 UTC (permalink / raw)
  To: xen-devel; +Cc: Juergen Gross, Committers, Ian Jackson

I was hoping we'd get a list of distros + versions together, but have not had any input on specific distros

To make this easier, I created https://cryptpad.fr/pad/#/2/pad/edit/9MppkbU36LDcWT12uC6Xk3SQ/ 
Trying something else, as some people have trouble with google docs

Regards
Lars

> On 9 May 2019, at 19:28, Lars Kurth <lars.kurth.xen@gmail.com> wrote:
> 
> Hi all,
> 
> following a discussion with committers about Guest testing in OSSTEST, it surfaced that we have not updated what distros we test in OSSTEST for a very long time. All agreed that we should regularly review what we test against: maybe at the beginning of a release cycle
> 
> In any case, currently we test against
> 
> x86 HVM guests:
>  debian-9.4.0-{i386,amd64}-CD-1.iso
>  rhel-server-6.1-i386-dvd.iso
>  win10v1703-x86.iso
>  win7-x64.iso
>  ws16-x64.iso
>  FreeBSD-10.1-CUSTOM-{i386,amd64}-20150525.raw.xz
>  Debian HVM {i386,amd64} via debian-installer netinst [1]
> 
> x86 PV guests:
>  Debian PV {i386,amd64} via debian-installer netinst [1]
> 
> ARM guests:
>  Debian PV via debian-installer netinst [1]
> 
> [1] whatever Debian release osstest itself mostly runs
> 
> So I am opening the floor to suggestions.
> 
> With regards to Windows testing we have some restrictions. We have tried several times to buy additional test licenses, but this never went anywhere (some of the VM licenses are not available for our environment, unless you bulk buy, which is very expensive). The only approach that would allow us to test against different windows versions would be to require everyone who may touch OSSTEST which is not doable.
> 
> I can bring this up with the MS open source office, if there are strong feelings about this and try again
> 
> Lars
> 


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: [Xen-devel] Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-24 21:57   ` Lars Kurth
  0 siblings, 0 replies; 14+ messages in thread
From: Lars Kurth @ 2019-05-24 21:57 UTC (permalink / raw)
  To: xen-devel; +Cc: Juergen Gross, Committers, Ian Jackson

I was hoping we'd get a list of distros + versions together, but have not had any input on specific distros

To make this easier, I created https://cryptpad.fr/pad/#/2/pad/edit/9MppkbU36LDcWT12uC6Xk3SQ/ 
Trying something else, as some people have trouble with google docs

Regards
Lars

> On 9 May 2019, at 19:28, Lars Kurth <lars.kurth.xen@gmail.com> wrote:
> 
> Hi all,
> 
> following a discussion with committers about Guest testing in OSSTEST, it surfaced that we have not updated what distros we test in OSSTEST for a very long time. All agreed that we should regularly review what we test against: maybe at the beginning of a release cycle
> 
> In any case, currently we test against
> 
> x86 HVM guests:
>  debian-9.4.0-{i386,amd64}-CD-1.iso
>  rhel-server-6.1-i386-dvd.iso
>  win10v1703-x86.iso
>  win7-x64.iso
>  ws16-x64.iso
>  FreeBSD-10.1-CUSTOM-{i386,amd64}-20150525.raw.xz
>  Debian HVM {i386,amd64} via debian-installer netinst [1]
> 
> x86 PV guests:
>  Debian PV {i386,amd64} via debian-installer netinst [1]
> 
> ARM guests:
>  Debian PV via debian-installer netinst [1]
> 
> [1] whatever Debian release osstest itself mostly runs
> 
> So I am opening the floor to suggestions.
> 
> With regards to Windows testing we have some restrictions. We have tried several times to buy additional test licenses, but this never went anywhere (some of the VM licenses are not available for our environment, unless you bulk buy, which is very expensive). The only approach that would allow us to test against different windows versions would be to require everyone who may touch OSSTEST which is not doable.
> 
> I can bring this up with the MS open source office, if there are strong feelings about this and try again
> 
> Lars
> 


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-27 11:56     ` Roger Pau Monné
  0 siblings, 0 replies; 14+ messages in thread
From: Roger Pau Monné @ 2019-05-27 11:56 UTC (permalink / raw)
  To: Jan Beulich; +Cc: Lars Kurth, Juergen Gross, committers, Ian Jackson, xen-devel

On Fri, May 10, 2019 at 01:48:58AM -0600, Jan Beulich wrote:
> >>> On 10.05.19 at 03:28, <lars.kurth.xen@gmail.com> wrote:
> > Hi all,
> > 
> > following a discussion with committers about Guest testing in OSSTEST, it 
> > surfaced that we have not updated what distros we test in OSSTEST for a very 
> > long time. All agreed that we should regularly review what we test against: 
> > maybe at the beginning of a release cycle
> > 
> > In any case, currently we test against
> > 
> > x86 HVM guests:
> >   debian-9.4.0-{i386,amd64}-CD-1.iso
> >   rhel-server-6.1-i386-dvd.iso
> >   win10v1703-x86.iso
> >   win7-x64.iso
> >   ws16-x64.iso
> >   FreeBSD-10.1-CUSTOM-{i386,amd64}-20150525.raw.xz
> 
> Testing fixed snapshots (commonly the original release afaict) instead
> of latest updates is pretty meaningless imo. While I would like to
> recommend testing all the (active) distros of parties actively involved
> in Xen development, I have to admite that I have no idea at all how
> this would work for e.g. our SLE versions (such that latest bits would
> get tested).

FWIW, this is what osstest does in order to test FreeBSD HEAD. I'm not
sure how much of this would apply to SLE.

There's a dedicated FreeBSD flight, that does the following:

 - Install a bare-metal box using the latest known to work install
   media.
 - Fetch FreeBSD sources and build new install media from scratch.
 - Use the newly built media to install a box from scratch.
 - Build FreeBSD again to make sure the new version is capable of
   building itself at least.
 - Build Xen using the new FreeBSD version.

If all of those steps succeed the new version is anointed, and it will
be used as the install media for new flights.

Note that this is a time consuming process, so making this part of a
regular Xen flight is not feasible, hence the anointment in order to
store the binary installer so other flights can re-use it.

Also note that this process is circular, and needs an initial seed
(binary installer) to be manually anointed for all this to work.

Roger.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: [Xen-devel] Guest Testing in OSSTEST - What distros and versions should we test against
@ 2019-05-27 11:56     ` Roger Pau Monné
  0 siblings, 0 replies; 14+ messages in thread
From: Roger Pau Monné @ 2019-05-27 11:56 UTC (permalink / raw)
  To: Jan Beulich; +Cc: Lars Kurth, Juergen Gross, committers, Ian Jackson, xen-devel

On Fri, May 10, 2019 at 01:48:58AM -0600, Jan Beulich wrote:
> >>> On 10.05.19 at 03:28, <lars.kurth.xen@gmail.com> wrote:
> > Hi all,
> > 
> > following a discussion with committers about Guest testing in OSSTEST, it 
> > surfaced that we have not updated what distros we test in OSSTEST for a very 
> > long time. All agreed that we should regularly review what we test against: 
> > maybe at the beginning of a release cycle
> > 
> > In any case, currently we test against
> > 
> > x86 HVM guests:
> >   debian-9.4.0-{i386,amd64}-CD-1.iso
> >   rhel-server-6.1-i386-dvd.iso
> >   win10v1703-x86.iso
> >   win7-x64.iso
> >   ws16-x64.iso
> >   FreeBSD-10.1-CUSTOM-{i386,amd64}-20150525.raw.xz
> 
> Testing fixed snapshots (commonly the original release afaict) instead
> of latest updates is pretty meaningless imo. While I would like to
> recommend testing all the (active) distros of parties actively involved
> in Xen development, I have to admite that I have no idea at all how
> this would work for e.g. our SLE versions (such that latest bits would
> get tested).

FWIW, this is what osstest does in order to test FreeBSD HEAD. I'm not
sure how much of this would apply to SLE.

There's a dedicated FreeBSD flight, that does the following:

 - Install a bare-metal box using the latest known to work install
   media.
 - Fetch FreeBSD sources and build new install media from scratch.
 - Use the newly built media to install a box from scratch.
 - Build FreeBSD again to make sure the new version is capable of
   building itself at least.
 - Build Xen using the new FreeBSD version.

If all of those steps succeed the new version is anointed, and it will
be used as the install media for new flights.

Note that this is a time consuming process, so making this part of a
regular Xen flight is not feasible, hence the anointment in order to
store the binary installer so other flights can re-use it.

Also note that this process is circular, and needs an initial seed
(binary installer) to be manually anointed for all this to work.

Roger.

_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xenproject.org
https://lists.xenproject.org/mailman/listinfo/xen-devel

^ permalink raw reply	[flat|nested] 14+ messages in thread

end of thread, other threads:[~2019-05-27 11:57 UTC | newest]

Thread overview: 14+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-05-10  1:28 Guest Testing in OSSTEST - What distros and versions should we test against Lars Kurth
2019-05-10  1:28 ` [Xen-devel] " Lars Kurth
2019-05-10  1:43 ` Rich Persaud
2019-05-10  1:43   ` [Xen-devel] " Rich Persaud
2019-05-24 21:26   ` Lars Kurth
2019-05-24 21:26     ` [Xen-devel] " Lars Kurth
2019-05-10  7:48 ` Jan Beulich
2019-05-10  7:48   ` [Xen-devel] " Jan Beulich
2019-05-10 12:41   ` Lars Kurth
2019-05-10 12:41     ` [Xen-devel] " Lars Kurth
2019-05-27 11:56   ` Roger Pau Monné
2019-05-27 11:56     ` [Xen-devel] " Roger Pau Monné
2019-05-24 21:57 ` Lars Kurth
2019-05-24 21:57   ` [Xen-devel] " Lars Kurth

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.