From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.0 (2014-02-07) on aws-us-west-2-korg-lkml-1.web.codeaurora.org X-Spam-Level: X-Spam-Status: No, score=-20.4 required=3.0 tests=BAYES_00,DKIMWL_WL_MED, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,HEADER_FROM_DIFFERENT_DOMAINS, INCLUDES_PATCH,MAILING_LIST_MULTI,SIGNED_OFF_BY,SPF_HELO_NONE,SPF_PASS, URIBL_BLOCKED,USER_AGENT_GIT,USER_IN_DEF_DKIM_WL autolearn=ham autolearn_force=no version=3.4.0 Received: from mail.kernel.org (mail.kernel.org [198.145.29.99]) by smtp.lore.kernel.org (Postfix) with ESMTP id E9946C388F7 for ; Tue, 10 Nov 2020 07:29:42 +0000 (UTC) Received: from vger.kernel.org (vger.kernel.org [23.128.96.18]) by mail.kernel.org (Postfix) with ESMTP id 80A1420781 for ; Tue, 10 Nov 2020 07:29:42 +0000 (UTC) Authentication-Results: mail.kernel.org; dkim=pass (2048-bit key) header.d=google.com header.i=@google.com header.b="QgFUkXA2" Received: (majordomo@vger.kernel.org) by vger.kernel.org via listexpand id S1729078AbgKJH3l (ORCPT ); Tue, 10 Nov 2020 02:29:41 -0500 Received: from lindbergh.monkeyblade.net ([23.128.96.19]:51806 "EHLO lindbergh.monkeyblade.net" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726690AbgKJH3l (ORCPT ); Tue, 10 Nov 2020 02:29:41 -0500 Received: from mail-yb1-xb49.google.com (mail-yb1-xb49.google.com [IPv6:2607:f8b0:4864:20::b49]) by lindbergh.monkeyblade.net (Postfix) with ESMTPS id E79EAC0613D3 for ; Mon, 9 Nov 2020 23:29:40 -0800 (PST) Received: by mail-yb1-xb49.google.com with SMTP id h6so14097525ybk.4 for ; Mon, 09 Nov 2020 23:29:40 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=google.com; s=20161025; h=sender:date:message-id:mime-version:subject:from:to:cc; bh=RZgsjIDnKB7xNbDoCh6k0wt84803ONPo3Yw+qTs38F8=; b=QgFUkXA2SAS1RT3zLRUZQIxgkv6sINiHkdp0k26B9TEPGFujos3tfIMuq162pDwcHb 25WYHtRA6LVX/3I13vzASjNpOFPYbI/P8NjqJqs1fF/sjHlI0hi7Y0CHLHGQOiuVBHhI 7eBRhQyZJMHUxZO7OP5cTQ82Ls4RWxR43TyD1BiF8ItQNd5skmmnV7As/j/r5OBO4RZv 0tBYbHHHiI3zrd9kycipvmoZff6JqikpfixK7kxkbyoMIVWR6tDqB63EcB8EOJQL3hom dMusd4FjQw3D3BSTA8wMJV4I4FUn17tRgJQn0xD9JfUYSeJUDl+RENDI04VrkyeX0jT3 SJgg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:sender:date:message-id:mime-version:subject:from :to:cc; bh=RZgsjIDnKB7xNbDoCh6k0wt84803ONPo3Yw+qTs38F8=; b=Q1UMK6iIXkjo2I/WGjSboriqLYqyh9iixCn/NW98Va8bDJrhxjbXhJbO9kX2+bP3qN VErV0LyhsPFDo4yuniBxSXkNsjwDIIZbd70//hsY8z4vgxrVocqTLBf7xk5VoFrqq3nW 2M1BYeseQKgQzF8p2JFF//eXiKcpB1uKVPRjJSBtsvoBcPyZoyubEjRlkPZEDohhLj5x 1mYYeZh4jb2Qz8NHZQ6VoIGz9+HanPVtXKWWk4iDFNaUg4vSqo0ILjZCVoIFqpqv5Jh3 3PVSb/adzIHWga22tPc+RjE5UblSo4ocVRyQ3y5uNg3Cl9ASXj1Jpq2trAlnI7djYz+/ E78Q== X-Gm-Message-State: AOAM5300XRDp7O9X3FVln8lI08GHkMyawIHfKrTyZ4QJXn0KoT5OzOka vXh2La2g0xz99oIwuT0K+CxclvYD2/9meg== X-Google-Smtp-Source: ABdhPJxKQOR4nA/qXmKTAe5ixBzOeDD/8asYGVAer2CGp+BDwg1r9TEkwAhaQlwUIGcXoZMDnAjGgDEz2EXEtA== Sender: "davidgow via sendgmr" X-Received: from spirogrip.svl.corp.google.com ([2620:15c:2cb:201:42a8:f0ff:fe4d:3548]) (user=davidgow job=sendgmr) by 2002:a25:42c6:: with SMTP id p189mr11273929yba.255.1604993380137; Mon, 09 Nov 2020 23:29:40 -0800 (PST) Date: Mon, 9 Nov 2020 23:29:36 -0800 Message-Id: <20201110072936.1380718-1-davidgow@google.com> Mime-Version: 1.0 X-Mailer: git-send-email 2.29.2.222.g5d2a92d10f8-goog Subject: [PATCH] kunit: kunit_tool: Correctly parse diagnostic messages From: David Gow To: brendanhiggins@google.com, Shuah Khan , Arpitha Raghunandan <98.arpi@gmail.com>, Marco Elver Cc: KUnit Development , linux-kselftest@vger.kernel.org, Linux Kernel Mailing List , David Gow Content-Type: text/plain; charset="UTF-8" Precedence: bulk List-ID: X-Mailing-List: linux-kernel@vger.kernel.org Currently, kunit_tool expects all diagnostic lines in test results to contain ": " somewhere, as both the subtest header and the crash report do. Fix this to accept any line starting with (minus indent) "# " as being a valid diagnostic line. This matches what the TAP spec[1] and the draft KTAP spec[2] are expecting. [1]: http://testanything.org/tap-specification.html [2]: https://lore.kernel.org/linux-kselftest/CY4PR13MB1175B804E31E502221BC8163FD830@CY4PR13MB1175.namprd13.prod.outlook.com/T/ Signed-off-by: David Gow --- tools/testing/kunit/kunit_parser.py | 7 ++++--- 1 file changed, 4 insertions(+), 3 deletions(-) diff --git a/tools/testing/kunit/kunit_parser.py b/tools/testing/kunit/kunit_parser.py index 84a1af2581f5..dab4cfa05b74 100644 --- a/tools/testing/kunit/kunit_parser.py +++ b/tools/testing/kunit/kunit_parser.py @@ -134,8 +134,8 @@ def parse_ok_not_ok_test_case(lines: List[str], test_case: TestCase) -> bool: else: return False -SUBTEST_DIAGNOSTIC = re.compile(r'^[\s]+# .*?: (.*)$') -DIAGNOSTIC_CRASH_MESSAGE = 'kunit test case crashed!' +SUBTEST_DIAGNOSTIC = re.compile(r'^[\s]+# (.*)$') +DIAGNOSTIC_CRASH_MESSAGE = re.compile(r'^[\s]+# .*?: kunit test case crashed!$') def parse_diagnostic(lines: List[str], test_case: TestCase) -> bool: save_non_diagnositic(lines, test_case) @@ -145,7 +145,8 @@ def parse_diagnostic(lines: List[str], test_case: TestCase) -> bool: match = SUBTEST_DIAGNOSTIC.match(line) if match: test_case.log.append(lines.pop(0)) - if match.group(1) == DIAGNOSTIC_CRASH_MESSAGE: + crash_match = DIAGNOSTIC_CRASH_MESSAGE.match(line) + if crash_match: test_case.status = TestStatus.TEST_CRASHED return True else: -- 2.29.2.222.g5d2a92d10f8-goog