STP for automated GCC testing (was Re: Regression testing of 2.4.x beforerelease?)

From: Bryce Harrington <bryce@osdl.org>
To: Dan Kegel <dank@kegel.com>
Cc: "Timothy D. Witham" <wookie@osdl.org>,
	Luigi Genoni <kernel@Expansa.sns.it>,
	Mike Galbraith <mikeg@wen-online.de>,
	"linux-kernel@vger.kernel.org" <linux-kernel@vger.kernel.org>,
	<stp@osdl.org>
Subject: STP for automated GCC testing  (was Re: Regression testing of 2.4.x beforerelease?)
Date: Tue, 13 Nov 2001 14:00:02 -0800 (PST)	[thread overview]
Message-ID: <Pine.LNX.4.33.0111131343500.28266-100000@osdlab.pdx.osdl.net> (raw)
In-Reply-To: <3BF0A748.A68251C6@kegel.com>

On Mon, 12 Nov 2001, Dan Kegel wrote:
> "Timothy D. Witham" wrote:
> >
> > On Sun, 2001-11-11 at 22:24, Dan Kegel wrote:
> > > At some point it might be nice to also use the STP to help
> > > speed gcc 3 development, too.  (I personally am really
> > > looking forward to the day when I can use the same compiler
> > > for both c++ and kernel.)
> >
> >   Strange, I was just talking to somebody about compiler
> > performance and regression issues and what sort of automation
> > could be done to do that sort of testing.
> >
> >   Since the STP is really a framework and just about any piece
> > of software and testing environment could be worked into it.
> >
> >  So I guess you could have two pieces.  One that just ran a bunch
> > of compile and user level tests and then one that went in and
> > checked out the compiler on a kernel tree and then ran the
> > same performance tests that had been run using the "standard"
> > compiler.
>
> Go/no-go tests, where you make sure a kernel compiled with gcc 3
> actually works, might be appropriate for starters.  I don't know
> if that's been established yet.
>
> >   Are you stepping forward to integrate this into STP? :-)
>
> I wish!  Alas, tendinitis makes hacking hazardous for me for now.
>

Dan, I'd be willing to join in with some of the hacking.  I helped
develop STP so am familiar with how it works and how to apply it to
this.  I've used/compiled/cursed at gcc for years but am not super
familiar with its internals, so would welcome some advice and help
there.

Would anyone else be interested in joining in on doing this?  I think
providing this testing service for gcc would be invaluable for the
community.  Basically we need a couple folks with perl scripting and
html form creation skills.

Anyway, if I get a few positive responses and it's okay by Tim, I'll go
ahead and get a mailing list, etc. set up for everyone interested in
joining in on this.

Bryce