From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-5.8 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,MENTIONS_GIT_HOSTING,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 56F17C10F14 for ; Tue, 8 Oct 2019 13:14:24 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 3122F21920 for ; Tue, 8 Oct 2019 13:14:24 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1730793AbfJHNOX (ORCPT ); Tue, 8 Oct 2019 09:14:23 -0400 Received: from mx2.suse.de ([195.135.220.15]:56304 "EHLO mx1.suse.de" rhost-flags-OK-OK-OK-FAIL) by vger.kernel.org with ESMTP id S1730332AbfJHNOX (ORCPT ); Tue, 8 Oct 2019 09:14:23 -0400 X-Virus-Scanned: by amavisd-new at test-mx.suse.de Received: from relay2.suse.de (unknown [195.135.220.254]) by mx1.suse.de (Postfix) with ESMTP id 5BCE9B28A; Tue, 8 Oct 2019 13:14:21 +0000 (UTC) References: <87zhibwgzm.fsf@rpws.prws.suse.cz> User-agent: mu4e 1.2.0; emacs 26.3 From: Richard Palethorpe To: Dmitry Vyukov Cc: rpalethorpe@suse.de, automated-testing@yoctoproject.org, Shuah Khan , "open list\:KERNEL SELFTEST FRAMEWORK" , kernelci@groups.io, syzkaller Subject: Re: [Automated-testing] syzkaller reproducers Reply-To: rpalethorpe@suse.de In-reply-to: Date: Tue, 08 Oct 2019 15:14:20 +0200 Message-ID: <87y2xvwf9v.fsf@rpws.prws.suse.cz> MIME-Version: 1.0 Content-Type: text/plain Sender: linux-kselftest-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kselftest@vger.kernel.org Hello, Dmitry Vyukov writes: > On Tue, Oct 8, 2019 at 2:37 PM Richard Palethorpe wrote: >> >> Hello, >> >> Dmitry Vyukov writes: >> >> > Hi Shuah, >> > >> > We discussed collecting and uploading all syzkaller reproducers >> > somewhere. You wanted to see how they look. I've uploaded all current >> > reproducers here: >> > https://github.com/dvyukov/syzkaller-repros >> > Minimalistic build/run scripts are included. >> > +some testing mailing lists too as this can be used as a test suite >> > If you have any potential uses for this, you are welcome to use it. >> > But then we probably need to find some more official and shared place >> > for them than my private github. >> > The test programs can also be bulk updated if necessary, because all >> > of this is auto-generated. >> > >> > Thanks >> >> I discussed this a bit with Metan. We think it would be fairly trivial >> to create an LTP wrapper for these. >> >> So we just create an LTP test which forks and execs one of these >> reproducers then checks for kernel taints after the child completes or >> is killed. It can take the reproducer path as an argument and we can >> generate a runtest file with all the reproducers in that we are able to >> compile. >> >> I imagine a lot of these reproducers will not work on older kernels, so >> this would just be a best efforts basis. We would ignore any problems >> during execution unless there is a kernel error. >> >> This should work with existing LTP runners with maybe a minor change or >> two to building and configuration. >> >> I will start experimenting with this and post the results to the LTP >> mailing list. > > > Hi Richard, > > Sounds great! > > Yes, these are totally best effort. May also require some configs, etc. > Also note that each should be run in a clean temp dir and with a > timeout b/c some have an infinite loop. Thanks, fortunately the LTP lib can do that automatically. However the default timeout is 5 minutes, but I guess this should be more like ~3 seconds as in the run script? -- Thank you, Richard.