From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from smtp1.linuxfoundation.org (smtp1.linux-foundation.org [172.17.192.35]) by mail.linuxfoundation.org (Postfix) with ESMTPS id 06F06B0B for ; Thu, 6 Jul 2017 22:32:53 +0000 (UTC) Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp1.linuxfoundation.org (Postfix) with ESMTPS id 5175E18D for ; Thu, 6 Jul 2017 22:32:52 +0000 (UTC) Date: Thu, 6 Jul 2017 18:32:49 -0400 From: Steven Rostedt To: Shuah Khan Message-ID: <20170706183249.60b2aef9@gandalf.local.home> In-Reply-To: References: <576cea07-770a-4864-c3f5-0832ff211e94@leemhuis.info> <20170703123025.7479702e@gandalf.local.home> <20170705084528.67499f8c@gandalf.local.home> <4080ecc7-1aa8-2940-f230-1b79d656cdb4@redhat.com> <20170705092757.63dc2328@gandalf.local.home> <20170705140607.GA30187@kroah.com> <20170705153259.GA7265@kroah.com> MIME-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Cc: ksummit-discuss@lists.linuxfoundation.org, Carlos O'Donell , Thorsten Leemhuis , linux-api@vger.kernel.org Subject: Re: [Ksummit-discuss] [MAINTAINERS SUMMIT] & [TECH TOPIC] Improve regression tracking List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , On Thu, 6 Jul 2017 16:24:01 -0600 Shuah Khan wrote: > Over the past couple of years, kselftests have seen improvements to run > on ARM in kernel ci rings. TAP13 will definitely make it easier to find > run to run differences. There is the effort to use ksefltests to test > stable releases (4.4 LTS for example), which will help make the tests > fail/skip gracefully when a feature isn't enabled/supported. > > The work so far is two fold: > > - enable them to run in test rings. > - making them easy to use > > As per test development, we are constantly adding tests and I see new tests > getting added for sub-systems that aren't hardware dependent. You will see > lots of activity in mm, timers, seccomp, net, sys-calls to name a few. > > I am going to be looking for TAP13 format compliance for new tests starting > 4.13. > > I am not sure how popular they are among developers and sub-system maintainers > though. Maybe this is one area we can try to improve usage. Maybe this should be included in the MAINTAINERS SUMMIT as well. To consolidate the format of all the kselftests and have something that everyone (or most) developers agree on. -- Steve From mboxrd@z Thu Jan 1 00:00:00 1970 From: Steven Rostedt Subject: Re: [Ksummit-discuss] [MAINTAINERS SUMMIT] & [TECH TOPIC] Improve regression tracking Date: Thu, 6 Jul 2017 18:32:49 -0400 Message-ID: <20170706183249.60b2aef9@gandalf.local.home> References: <576cea07-770a-4864-c3f5-0832ff211e94@leemhuis.info> <20170703123025.7479702e@gandalf.local.home> <20170705084528.67499f8c@gandalf.local.home> <4080ecc7-1aa8-2940-f230-1b79d656cdb4@redhat.com> <20170705092757.63dc2328@gandalf.local.home> <20170705140607.GA30187@kroah.com> <20170705153259.GA7265@kroah.com> Mime-Version: 1.0 Content-Type: text/plain; charset=US-ASCII Content-Transfer-Encoding: 7bit Return-path: In-Reply-To: Sender: linux-api-owner-u79uwXL29TY76Z2rM5mHXA@public.gmane.org To: Shuah Khan Cc: Greg KH , Guenter Roeck , Carlos O'Donell , linux-api-u79uwXL29TY76Z2rM5mHXA@public.gmane.org, Thorsten Leemhuis , ksummit-discuss-cunTk1MwBs98uUxBSJOaYoYkZiVZrdSR2LY78lusg7I@public.gmane.org List-Id: linux-api@vger.kernel.org On Thu, 6 Jul 2017 16:24:01 -0600 Shuah Khan wrote: > Over the past couple of years, kselftests have seen improvements to run > on ARM in kernel ci rings. TAP13 will definitely make it easier to find > run to run differences. There is the effort to use ksefltests to test > stable releases (4.4 LTS for example), which will help make the tests > fail/skip gracefully when a feature isn't enabled/supported. > > The work so far is two fold: > > - enable them to run in test rings. > - making them easy to use > > As per test development, we are constantly adding tests and I see new tests > getting added for sub-systems that aren't hardware dependent. You will see > lots of activity in mm, timers, seccomp, net, sys-calls to name a few. > > I am going to be looking for TAP13 format compliance for new tests starting > 4.13. > > I am not sure how popular they are among developers and sub-system maintainers > though. Maybe this is one area we can try to improve usage. Maybe this should be included in the MAINTAINERS SUMMIT as well. To consolidate the format of all the kselftests and have something that everyone (or most) developers agree on. -- Steve