From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-2.6 required=3.0 tests=DKIMWL_WL_HIGH,DKIM_SIGNED, DKIM_VALID,DKIM_VALID_AU,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS, USER_AGENT_SANE_1 autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id 8050CC4CED1 for ; Fri, 4 Oct 2019 23:16:06 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 53540222CB for ; Fri, 4 Oct 2019 23:16:06 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1570230966; bh=ed2Oj0Rtnhm1rXJkcqfJxOLIvuDPtA/O2HMmNV71h1A=; h=Subject:To:Cc:References:From:Date:In-Reply-To:List-ID:From; b=voSdoMqsLb2CjILZlKXhnzVV1v0WAVwwaOrKfmagjUk/X8Gv3SsBQt3fmMCdz9Cpz R3e6TerhGJKmNiaSRp/mUd7GRWVmvirJ8bgGbyAaxv4v6dVVc8zw2etd/L8eF+Ir3I YBJAGvPq0uo/nJpDS2aBFIPDsrQvZgdGqqZgB7ko= Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1731598AbfJDXQF (ORCPT ); Fri, 4 Oct 2019 19:16:05 -0400 Received: from mail.kernel.org ([198.145.29.99]:58696 "EHLO mail.kernel.org" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1728913AbfJDXQE (ORCPT ); Fri, 4 Oct 2019 19:16:04 -0400 Received: from [192.168.1.112] (c-24-9-64-241.hsd1.co.comcast.net [24.9.64.241]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by mail.kernel.org (Postfix) with ESMTPSA id 07CB7215EA; Fri, 4 Oct 2019 23:16:00 +0000 (UTC) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=kernel.org; s=default; t=1570230963; bh=ed2Oj0Rtnhm1rXJkcqfJxOLIvuDPtA/O2HMmNV71h1A=; h=Subject:To:Cc:References:From:Date:In-Reply-To:From; b=WM0U4KZ8Yc4SM5CiFfv5XPcZ0aRzdXwsYvoXnNevsXnJsPyjQKtdRXjIMQzZ+kVOJ 6YPavRWeR2P5RDQEazsuY+5qqP9SteouIZAzdGwtjgnZiXBW45gWTz4CaJtz77mMLh 9WfdeFi7Wi/iRWJWlEXKUF33HUEeeyYS7Fk3RiSQ= Subject: Re: [PATCH v18 00/19] kunit: introduce KUnit, the Linux kernel unit testing framework To: Brendan Higgins Cc: Linus Torvalds , "Theodore Y. Ts'o" , Frank Rowand , Greg Kroah-Hartman , Josh Poimboeuf , Kees Cook , Kieran Bingham , Luis Chamberlain , Peter Zijlstra , Rob Herring , Stephen Boyd , Masahiro Yamada , devicetree , dri-devel , kunit-dev@googlegroups.com, "open list:DOCUMENTATION" , linux-fsdevel , Linux Kbuild mailing list , Linux Kernel Mailing List , "open list:KERNEL SELFTEST FRAMEWORK" , linux-nvdimm , linux-um@lists.infradead.org, Sasha Levin , "Bird, Timothy" , Amir Goldstein , Dan Carpenter , Daniel Vetter , Jeff Dike , Joel Stanley , Julia Lawall , Kevin Hilman , Knut Omang , Logan Gunthorpe , Michael Ellerman , shuah , Randy Dunlap , Richard Weinberger , David Rientjes , Steven Rostedt , wfg@linux.intel.com References: <20190923090249.127984-1-brendanhiggins@google.com> <20191004213812.GA24644@mit.edu> <56e2e1a7-f8fe-765b-8452-1710b41895bf@kernel.org> <20191004222714.GA107737@google.com> From: shuah Message-ID: Date: Fri, 4 Oct 2019 17:15:59 -0600 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:60.0) Gecko/20100101 Thunderbird/60.8.0 MIME-Version: 1.0 In-Reply-To: Content-Type: text/plain; charset=utf-8; format=flowed Content-Language: en-US Content-Transfer-Encoding: 7bit Sender: linux-kselftest-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kselftest@vger.kernel.org On 10/4/19 5:10 PM, Brendan Higgins wrote: > On Fri, Oct 4, 2019 at 3:47 PM shuah wrote: >> >> On 10/4/19 4:27 PM, Brendan Higgins wrote: >>> On Fri, Oct 04, 2019 at 03:59:10PM -0600, shuah wrote: >>>> On 10/4/19 3:42 PM, Linus Torvalds wrote: >>>>> On Fri, Oct 4, 2019 at 2:39 PM Theodore Y. Ts'o wrote: >>>>>> >>>>>> This question is primarily directed at Shuah and Linus.... >>>>>> >>>>>> What's the current status of the kunit series now that Brendan has >>>>>> moved it out of the top-level kunit directory as Linus has requested? >>>>> >>>> >>>> The move happened smack in the middle of merge window and landed in >>>> linux-next towards the end of the merge window. >>>> >>>>> We seemed to decide to just wait for 5.5, but there is nothing that >>>>> looks to block that. And I encouraged Shuah to find more kunit cases >>>>> for when it _does_ get merged. >>>>> >>>> >>>> Right. I communicated that to Brendan that we could work on adding more >>>> kunit based tests which would help get more mileage on the kunit. >>>> >>>>> So if the kunit branch is stable, and people want to start using it >>>>> for their unit tests, then I think that would be a good idea, and then >>>>> during the 5.5 merge window we'll not just get the infrastructure, >>>>> we'll get a few more users too and not just examples. >>> >>> I was planning on holding off on accepting more tests/changes until >>> KUnit is in torvalds/master. As much as I would like to go around >>> promoting it, I don't really want to promote too much complexity in a >>> non-upstream branch before getting it upstream because I don't want to >>> risk adding something that might cause it to get rejected again. >>> >>> To be clear, I can understand from your perspective why getting more >>> tests/usage before accepting it is a good thing. The more people that >>> play around with it, the more likely that someone will find an issue >>> with it, and more likely that what is accepted into torvalds/master is >>> of high quality. >>> >>> However, if I encourage arbitrary tests/improvements into my KUnit >>> branch, it further diverges away from torvalds/master, and is more >>> likely that there will be a merge conflict or issue that is not related >>> to the core KUnit changes that will cause the whole thing to be >>> rejected again in v5.5. >>> >> >> The idea is that the new development will happen based on kunit in >> linux-kselftest next. It will work just fine. As we accepts patches, >> they will go on top of kunit that is in linux-next now. > > But then wouldn't we want to limit what KUnit changes are going into > linux-kselftest next for v5.5? For example, we probably don't want to > do anymore feature development on it until it is in v5.5, since the > goal is to make it more stable, right? > > I am guessing that it will probably be fine, but it still sounds like > we need to establish some ground rules, and play it *very* safe. > How about we identify a small number tests that can add value and focus on them. I am thinking a number between 2 and 5. This way we get a feel for the API, if it changes for the better great, if it doesn't have to, then you know you already did a great job. Does that sound reasonable to you? thanks, -- Shuah