From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-0.8 required=3.0 tests=DKIM_SIGNED,DKIM_VALID, HEADER_FROM_DIFFERENT_DOMAINS,MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id A5C9FC76188 for ; Mon, 22 Jul 2019 04:50:10 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id 7956B21BF2 for ; Mon, 22 Jul 2019 04:50:10 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=nifty.com header.i=@nifty.com header.b="X/RB4iRi" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727913AbfGVEuJ (ORCPT ); Mon, 22 Jul 2019 00:50:09 -0400 Received: from conssluserg-04.nifty.com ([210.131.2.83]:45663 "EHLO conssluserg-04.nifty.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1725766AbfGVEuJ (ORCPT ); Mon, 22 Jul 2019 00:50:09 -0400 Received: from mail-vs1-f48.google.com (mail-vs1-f48.google.com [209.85.217.48]) (authenticated) by conssluserg-04.nifty.com with ESMTP id x6M4nnJ6022698; Mon, 22 Jul 2019 13:49:50 +0900 DKIM-Filter: OpenDKIM Filter v2.10.3 conssluserg-04.nifty.com x6M4nnJ6022698 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=nifty.com; s=dec2015msa; t=1563770990; bh=9RX5JiKfnBiGDConOws41uRVdm8O7qY3Y3y6qfXVKKA=; h=References:In-Reply-To:From:Date:Subject:To:Cc:From; b=X/RB4iRi2ha7tsRUTpCvv3e9ha83yJXFIq5OvTKB1KBxpE2LomrXulUeDGJ3wRyc4 Q1H7L4fz/LMCUIdZIdonTz3JxQBCdbmPAOuQ4kxR6lrWF0qTcykC6HdhGc63pOFEL9 JmryPJzookxatCYYDFvAqnuGEGXB2cKMQgV0//zMaSZbLPR2UYpDASvq399f8yMuTC D2nbmzQDZ863TlVypm/yDboM0jKG8mgd4hPwI6rc6LQMJh0OxfwU0x7CVXNccYFrW1 rT/nnOGVVbzN/xNCdzM6Nlpazu3vV8yAPW2lBjdMmOPwGGh8Dom55Mll0lqoQ8lj4U oBOB+93oQ46aQ== X-Nifty-SrcIP: [209.85.217.48] Received: by mail-vs1-f48.google.com with SMTP id v6so25279347vsq.4; Sun, 21 Jul 2019 21:49:49 -0700 (PDT) X-Gm-Message-State: APjAAAX98vSC1rFL6B7a7AjeBhXUa8MZcu+zOGAb4uha8l8qHKbkvuKa fv6Aou/xXISTE4ONc2A/GkZnqH3G7AObPGbDwHA= X-Google-Smtp-Source: APXvYqyCpxbMn6um9veQlKpgDsTaGkywR8dJ+yp0tC+gN3rXLIXAxN9lQ8f6GjcgoYmU4f/PVo3dRJuMmhVzpkQl4h4= X-Received: by 2002:a67:d46:: with SMTP id 67mr41395812vsn.181.1563770988750; Sun, 21 Jul 2019 21:49:48 -0700 (PDT) MIME-Version: 1.0 References: <20190719100859.11227-1-yamada.masahiro@socionext.com> <20190719124030.GA5858@ravnborg.org> In-Reply-To: <20190719124030.GA5858@ravnborg.org> From: Masahiro Yamada Date: Mon, 22 Jul 2019 13:49:12 +0900 X-Gmail-Original-Message-ID: Message-ID: Subject: Re: [PATCH] kbuild: disable compile-test of kernel headers for now To: Sam Ravnborg Cc: Linux Kbuild mailing list , Arnd Bergmann , Christoph Hellwig , "Darrick J . Wong" , Randy Dunlap , Jani Nikula , Linux Kernel Mailing List Content-Type: text/plain; charset="UTF-8" Sender: linux-kernel-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Hi Sam, On Fri, Jul 19, 2019 at 9:40 PM Sam Ravnborg wrote: > > Hi Masahiro. > > On Fri, Jul 19, 2019 at 07:08:59PM +0900, Masahiro Yamada wrote: > > This compile-test started from the strong belief that (almost) all > > headers should be able to be compiled as a standalone unit, but this > > requirement seems to be just annoying. > > > > I believe compile-test of exported headers is good. On the other hand, > > in-kernel headers are not necessarily supposed to be always compilable. > > Actually, some headers are only included under a certain combination > > of CONFIG options, and that is definitely fine. > > > > This test is still causing false positive errors in randconfig. > > Moreover, newly added headers are compile-tested by default, sometimes > > they catch (not fatal) bugs, but often raise false positive errors to > > end up with making people upset. > > > > The merge window is closing shortly, so there is not much I can do. > > Disable it for now, and take a pause to re-think whether we should > > continue this or change the course. > > The present status is that iomap.h fails - and Arnd promptly > made a fix for it: > https://lore.kernel.org/lkml/20190719113139.4005262-1-arnd@arndb.de/T/#u > > You already fixed another issue. > So the fall-out so far is miniaml and already fixed (pending Arnd's > patch). > > If headers are not self-contained then one needs to include them in a > specific order which can be quite hard to get right. > Especially if the requirements differ across different architectures. > So the whole concept seems sane. > > I have thrown it after may array of cross builds: > => alpha arm arm64 sparc64 i386 x86 powerpc s390 riscv sh > > For each arch I try: > => allmodconfig allyesconfig allnoconfig defconfig > > No errros. > But that obviously only coveres a very minial set of configurations. > Arnd's result from his randconfig are also very promising. > > I advise to keep it enabled and if there is a steady stream of > new errors after -rc1 and -rc2 then to disable the testing. > We will not get the coverage unless this is upstreamed. > And the testing is relevant. > > Sam I am still wondering what to do about this. After some consideration, I thought it would be too annoying to put new headers to the test coverage unconditionally. Kernel code are compiled only under some circumstances. It is not feasible to know correct CONFIG options that headers are compiled with. So, I am thinking of making this testing service on demand. Headers need to be manually added to header-test-y by somebody who is interested in doing so. Divide Makefiles into sub-directory basis as you suggested first. The area of test-coverage is up to each subsystem. If drm people are really passionate about this, they can make effort to make headers self-contained and add everything to include/drm/Kbuild. If nobody is interested, that's it. Probably, many new headers will fall off the coverage, but this is a trade-off to avoiding false-positives. -- Best Regards Masahiro Yamada