From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1752055AbdFZVo0 (ORCPT ); Mon, 26 Jun 2017 17:44:26 -0400 Received: from mx2.suse.de ([195.135.220.15]:43521 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1751381AbdFZVoS (ORCPT ); Mon, 26 Jun 2017 17:44:18 -0400 Date: Mon, 26 Jun 2017 23:44:15 +0200 From: "Luis R. Rodriguez" To: Greg Kroah-Hartman Cc: "Luis R. Rodriguez" , Andy Lutomirski , Kees Cook , Shuah Khan , Sumit Semwal , Brian Norris , Jiri Kosina , LKML , "# 3.4.x" , "open list:KERNEL SELFTEST FRAMEWORK" , Shuah Khan Subject: Re: seccomp ptrace selftest failures with 4.4-stable [Was: Re: LTS testing with latest kselftests - some failures] Message-ID: <20170626214415.GG21846@wotan.suse.de> References: <334e6a92-2d41-c9e1-c807-19e493f1af83@kernel.org> <20170623015251.GA23574@kroah.com> <20170624003407.GZ21846@wotan.suse.de> <20170624044537.GD10973@kroah.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20170624044537.GD10973@kroah.com> User-Agent: Mutt/1.6.0 (2016-04-01) Sender: linux-kernel-owner@vger.kernel.org List-ID: X-Mailing-List: linux-kernel@vger.kernel.org On Sat, Jun 24, 2017 at 06:45:37AM +0200, Greg Kroah-Hartman wrote: > On Sat, Jun 24, 2017 at 02:34:07AM +0200, Luis R. Rodriguez wrote: > > So taking the position that any kselftest script on linux-next or a future > > kernel should never break stable implicate that *any* fix going upstream for > > which there is a respective ksefltest test *must* have a stable upstream fix. > > What, no! If it's a bug, that kselftest points out, great, it's up to > stable or a vendor to backport that fix if they want it. Makes sense! > Again, it's just like any other test suite, look at xfstests, no one > gets mad when it adds new tests that fail on old kernels, due to bugs > there, right? Correct but that means there is an information gap of which test cases fit into this category. An option to run kselftest with the ability to only run tests designed to also include stable would be good, otherwise Sumit Semwal or others would be sending reports or issues for things folks already designed the fix to *not* be a stable candidate. This actually would also prove useful to distributions to ensure to then run kselftest as part of their distribution test suite with all bells and whistles enabled so that they can make a determination of what questionable "fixes" things to fold in somehow. Unless of course we want these discussions to purposely bubble up as an alternative to this kselftest option. It seems rather wasteful though. > > Its not obvious to me that everyone is aware of this. What do we do about > > those cases where we *don't* want a stable fix due to the complexity? > > That's up to the stable maintainers or the vendors that maintain their > own kernel trees. But if the above is already decided having folks send emails about it seems pointless. Luis