From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mail-ot1-x341.google.com (mail-ot1-x341.google.com [IPv6:2607:f8b0:4864:20::341]) (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits)) (No client certificate requested) by ml01.01.org (Postfix) with ESMTPS id C852E211E2C1C for ; Mon, 25 Mar 2019 15:04:20 -0700 (PDT) Received: by mail-ot1-x341.google.com with SMTP id s24so100696otk.13 for ; Mon, 25 Mar 2019 15:04:20 -0700 (PDT) MIME-Version: 1.0 References: <20181128193636.254378-1-brendanhiggins@google.com> In-Reply-To: From: Brendan Higgins Date: Mon, 25 Mar 2019 15:04:08 -0700 Message-ID: Subject: Re: [RFC v3 00/19] kunit: introduce KUnit, the Linux kernel unit testing framework List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Errors-To: linux-nvdimm-bounces@lists.01.org Sender: "Linux-nvdimm" To: Frank Rowand Cc: brakmo@fb.com, dri-devel , linux-kselftest@vger.kernel.org, shuah@kernel.org, Rob Herring , linux-nvdimm , Richard Weinberger , Knut Omang , Kieran Bingham , Joel Stanley , Jeff Dike , "Bird," Timothy" , Kees Cook ," linux-um@lists.infradead.org, Steven Rostedt , Julia Lawall , kunit-dev@googlegroups.com, Greg KH , Linux Kernel Mailing List , Luis Chamberlain , Daniel Vetter , Michael Ellerman , Joe Perches , Kevin Hilman List-ID: On Thu, Mar 21, 2019 at 5:28 PM Frank Rowand wrote: > > On 12/5/18 3:10 PM, Brendan Higgins wrote: > > On Tue, Dec 4, 2018 at 5:49 AM Rob Herring wrote: > >> > >> On Tue, Dec 4, 2018 at 5:40 AM Frank Rowand wrote: > >>> > >>> Hi Brendan, Rob, > >>> > >>> Pulling a comment from way back in the v1 patch thread: > >>> > >>> On 10/17/18 3:22 PM, Brendan Higgins wrote: > >>>> On Wed, Oct 17, 2018 at 10:49 AM wrote: > >>> > >>> < snip > > >>> > >>>> The test and the code under test are linked together in the same > >>>> binary and are compiled under Kbuild. Right now I am linking > >>>> everything into a UML kernel, but I would ultimately like to make > >>>> tests compile into completely independent test binaries. So each test > >>>> file would get compiled into its own test binary and would link > >>>> against only the code needed to run the test, but we are a bit of a > >>>> ways off from that. > >>> > >>> I have never used UML, so you should expect naive questions from me, > >>> exhibiting my lack of understanding. > >>> > >>> Does this mean that I have to build a UML architecture kernel to run > >>> the KUnit tests? > >> > >> In this version of the patch series, yes. > >> > >>> *** Rob, if the answer is yes, then it seems like for my workflow, > >>> which is to build for real ARM hardware, my work is doubled (or > >>> worse), because for every patch/commit that I apply, I not only have > >>> to build the ARM kernel and boot on the real hardware to test, I also > >>> have to build the UML kernel and boot in UML. If that is correct > >>> then I see this as a major problem for me. > >> > >> I've already raised this issue elsewhere in the series. Restricting > >> the DT tests to UML is a non-starter. > > > > > I have already stated my position elsewhere on the matter, but in > > summary: Ensuring most tests can run without external dependencies > > (hardware, VM, etc) has a lot of benefits and should be supported in > > nearly all cases, but such tests should also work when compiled to run > > on real hardware/VM; the tooling might not be as good in the latter > > case, but I understand that there are good reasons to support it > > nonetheless. > > And my needs are the exact opposite. My tests must run on real hardware, > in the context of the real operating system subsystems and drivers > potentially causing issues. Right, Rob pointed this out, and I fixed this in v4. To be clear, as of RFC v4 you can run KUnit tests on non-UML architectures, we tested it on x86 and ARM. > > It is useful if the tests can also run without that dependency. This, of course, is still the main intended use case, but there is nothing to stop you from using it on real hardware. _______________________________________________ Linux-nvdimm mailing list Linux-nvdimm@lists.01.org https://lists.01.org/mailman/listinfo/linux-nvdimm