Re: Linux Testing Microconference at LPC

[Tim Bird <tbird20d@gmail.com>]

I'm in the process now of planning Automated Testing Summit 2019,
which is tentatively planned for Lyon, France on October 31.  This is
the day after Embedded Linux Conference Europe and Open Source Summit
Europe, in Lyon.  I've been working with the
Linux Foundation event staff to set this up.

The focus of that event is test standards, including standards for
test definition, results formats, lab and board management, and APIs
between elements of the Automated Testing and CI stack.

I think that the set of things to discuss is somewhat different
between the Plumbers testing microconference and ATS.  But I hope that
I'm not fragmenting the space too much.

With regards to the Testing microconference at Plumbers, I would like
to do a presentation on the current status of test standards and test
framework interoperability.  We recently had some good meetings
between the LAVA and Fuego people at Linaro Connect
on this topic.

Let me know what you think.
 -- Tim

On Thu, Apr 25, 2019 at 6:37 AM Veronika Kabatova <vkabatov@redhat.com> wrote:
>
>
>
> ----- Original Message -----
> > From: "Dhaval Giani" <dhaval.giani@gmail.com>
> > To: "Sasha Levin" <alexander.levin@microsoft.com>, "shuah" <shuah@kernel.org>, "Kevin Hilman" <khilman@baylibre.com>,
> > "Tim Bird" <tbird20d@gmail.com>, "LKML" <linux-kernel@vger.kernel.org>
> > Cc: "Steven Rostedt" <rostedt@goodmis.org>, "Dan Carpenter" <dan.carpenter@oracle.com>, willy@infradead.org, "gustavo
> > padovan" <gustavo.padovan@collabora.co.uk>, "Dmitry Vyukov" <dvyukov@google.com>, "knut omang"
> > <knut.omang@oracle.com>
> > Sent: Thursday, April 11, 2019 7:37:51 PM
> > Subject: Linux Testing Microconference at LPC
> >
> > Hi Folks,
> >
> > This is a call for participation for the Linux Testing microconference
> > at LPC this year.
> >
> > For those who were at LPC last year, as the closing panel mentioned,
> > testing is probably the next big push needed to improve quality. From
> > getting more selftests in, to regression testing to ensure we don't
> > break realtime as more of PREEMPT_RT comes in, to more stable distros,
> > we need more testing around the kernel.
> >
> > We have talked about different efforts around testing, such as fuzzing
> > (using syzkaller and trinity), automating fuzzing with syzbot, 0day
> > testing, test frameworks such as ktests, smatch to find bugs in the
> > past. We want to push this discussion further this year and are
> > interested in hearing from you what you want to talk about, and where
> > kernel testing needs to go next.
> >
> > Please let us know what topics you believe should be a part of the
> > micro conference this year.
> >
>
> Hi,
>
> as CKI team, we would like to join the Plumbers discussions about CI for
> kernel. We obviously have our own working pipeline but would like to get
> more involved with the other upstream projects working on the same and
> collaborate on common solutions.
>
> I already started some of these discussions on automated-testing mailing
> list and got in contact with Kevin about the possibility of joining forces
> with KernelCI project.
>
> Our team planned to organize a 'hackfest' for upstream CI during the
> conference but I heard that the Automated Testing Summit should likely take
> place during that time too. If that's the case, we should meet up and
> discuss everything there instead of organizing a separate event.
>
>
> Information and links about CKI Project can be be found at [1] in case
> people are curious. Some of the things we'd like to achieve is having a
> single source for all upstream kernel test results where anyone doing the
> testing can publish them and collaborate on solving common problems (like
> interpreting test results, making build times faster, increasing the test
> coverage, detecting regressions etc.)
>
> With one of my colleagues, we will submit a microconference proposal that
> could serve as the starting point for the followup discussions about these
> topics.
>
>
> We would like to get feedback from kernel developers and maintainers about
> their expectations for testing and receiving results, as well as discuss
> the collaboration with other testing/CI projects.
>
>
>
> Veronika Kabatova
> CKI Project
>
>
> [1] https://cki-project.org/
>
>
> > Thanks!
> > Sasha and Dhaval
> >



-- 
 -- Tim Bird
Senior Staff Software Engineer, Sony Corporation
Architecture Group Chair, Core Embedded Linux Project, Linux Foundation