Re: [Ksummit-discuss] [CORE TOPIC] stable workflow

[James Bottomley <James.Bottomley@HansenPartnership.com>]

[duplicate ksummit-discuss@ cc removed]
On Sat, 2016-07-09 at 15:49 +0000, Trond Myklebust wrote:
> > On Jul 9, 2016, at 06:05, James Bottomley <
> > James.Bottomley@HansenPartnership.com> wrote:
> > 
> > On Fri, 2016-07-08 at 17:43 -0700, Dmitry Torokhov wrote:
> > > On Sat, Jul 09, 2016 at 02:37:40AM +0200, Rafael J. Wysocki
> > > wrote:
> > > > I tend to think that all known bugs should be fixed, at least 
> > > > because once they have been fixed, no one needs to remember 
> > > > about them any more. :-)
> > > > 
> > > > Moreover, minor fixes don't really introduce regressions that
> > > > often
> > > 
> > > Famous last words :)
> > 
> > Actually, beyond the humour, the idea that small fixes don't 
> > introduce regressions must be our most annoying anti-pattern.  The 
> > reality is that a lot of so called fixes do introduce bugs.  The 
> > way this happens is that a lot of these "obvious" fixes go through 
> > without any deep review (because they're obvious, right?) and the 
> > bugs noisily turn up slightly later.  The way this works is usually 
> > that some code rearrangement is sold as a "fix" and later turns out 
> > not to be equivalent to the prior code ... sometimes in incredibly 
> > subtle ways. I think we should all be paying much more than lip 
> > service to the old adage "If it ain't broke don't fix it”.
> 
> The main problem with the stable kernel model right now is that we
> have no set of regression tests to apply. Unless someone goes in and
> actually tests each and every stable kernel affected by that “Cc:
> stable” line, then regressions will eventually happen.
> 
> So do we want to have another round of “how do we regression test the
> kernel” talks?

If I look back on our problems, they were all in device drivers, so
generic regression testing wouldn't have picked them up, in fact most
would need specific testing on the actual problem device.  So, I don't
really think testing is the issue, I think it's that we commit way too
many "obvious" patches.  In SCSI we try to gate it by having a
mandatory Reviewed-by: tag before something gets in, but really perhaps
we should insist on Tested-by: as well ... that way there's some
guarantee that the actual device being modified has been tested.

James