From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-3.7 required=3.0 tests=HEADER_FROM_DIFFERENT_DOMAINS, MAILING_LIST_MULTI,SPF_HELO_NONE,SPF_PASS,URIBL_BLOCKED,USER_AGENT_GIT autolearn=no autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id CE861C4360C for ; Thu, 26 Sep 2019 17:52:49 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [209.132.180.67]) by mail.kernel.org (Postfix) with ESMTP id A7F5E222C9 for ; Thu, 26 Sep 2019 17:52:49 +0000 (UTC) Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1727631AbfIZRwt (ORCPT ); Thu, 26 Sep 2019 13:52:49 -0400 Received: from foss.arm.com ([217.140.110.172]:55944 "EHLO foss.arm.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1727502AbfIZRwt (ORCPT ); Thu, 26 Sep 2019 13:52:49 -0400 Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.121.207.14]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id A18FA142F; Thu, 26 Sep 2019 10:52:48 -0700 (PDT) Received: from e120937-lin.cambridge.arm.com (e120937-lin.cambridge.arm.com [10.1.197.50]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id D3D183F67D; Thu, 26 Sep 2019 10:52:47 -0700 (PDT) From: Cristian Marussi To: linux-kselftest@vger.kernel.org, linux-arm-kernel@lists.infradead.org, shuah@kernel.org Cc: dave.martin@arm.com, Tim.Bird@sony.com Subject: [PATCH v2 0/2] Fix KSFT toplevel makefile behaviour Date: Thu, 26 Sep 2019 18:52:17 +0100 Message-Id: <20190926175219.29805-1-cristian.marussi@arm.com> X-Mailer: git-send-email 2.17.1 Sender: linux-kselftest-owner@vger.kernel.org Precedence: bulk List-ID: X-Mailing-List: linux-kselftest@vger.kernel.org Hi so this series carries two small fixes to the toplevel KSelfTest makefile which I found useful especially while attempting to run the suite in automation. [1/2] While it is already possible to specify a limited list of TARGETS to run, it is not instead easily possible to state a list of targets NOT to run (say due to specific instability issues). Moreover providing such a skip list through a stripped down list of TARGETS it is cumbersome and fragile since this poses the risk to stick to an old stale stripped TARGETS list once upstream decides to add more default targets. A new SKIP_TARGETS Makefile variable is provided by this patch to easily specify a skiplist for target subsystems. [2/2] Currently when some target fails to build, KSFT Makefile just carries on building as much subsystems as it can: unfortunately this is not properly reflected also in the generation of the runlist inside run_kselftest.sh. This patch rectifies this behaviour checking for the existence of a target directory in the INSTALL_PATH before adding the related snippet to the run_kselftest.sh script. Thanks Cristian Changelog v1 --> v2 - added Documentation - various typos fixed - added a proper override when filtering-out SKIP_TARGETS from TARGETS to make it work also when TARGETS is provided too from the cmdline Cristian Marussi (2): kselftest: add capability to skip chosen TARGETS kselftest: exclude failed TARGETS from runlist Documentation/dev-tools/kselftest.rst | 11 +++++++++++ tools/testing/selftests/Makefile | 11 +++++++++++ 2 files changed, 22 insertions(+) -- 2.17.1