From: "Darrick J. Wong" <djwong@kernel.org>
To: zlang@redhat.com, djwong@kernel.org
Cc: Qu Wenruo <wqu@suse.com>, Leah Rumancik <leah.rumancik@gmail.com>,
linux-xfs@vger.kernel.org, fstests@vger.kernel.org, guan@eryu.me,
leah.rumancik@gmail.com, quwenruo.btrfs@gmx.com, tytso@mit.edu
Subject: [PATCHSET v3 00/15] fstests: improve junit xml reporting
Date: Tue, 14 Mar 2023 17:52:30 -0700 [thread overview]
Message-ID: <167884155064.2482843.4310780034948240980.stgit@magnolia> (raw)
Hi all,
This series improves the fstests reporting code in several ways. First,
change the ./check code to generate the report after every test, so that
a cluster-based fstest scheduler can reschedule tests after a VM crash.
Personally, I was using it to get live status on my tests dashboard.
The bulk of the patches in here improve the junit xml reporting so that
we (a) actually declare which xml schema we're trying to emit and (b)
capture a lot more information about what was being tested.
v2: shorten indenting in the schema file, record .dmesg files as a
separate kernel-log tag, clarify what the timestamp attribute means,
record the test suite start time and report generation time as separate
attributes, make it possible to pass in a list of report variables,
encode cdata correctly
v3: Reviewed-and-tested-by: Leah Rumancik <leah.rumancik@gmail.com>
If you're going to start using this mess, you probably ought to just
pull from my git trees, which are linked below.
This is an extraordinary way to destroy everything. Enjoy!
Comments and questions are, as always, welcome.
--D
fstests git tree:
https://git.kernel.org/cgit/linux/kernel/git/djwong/xfstests-dev.git/log/?h=xunit-reporting-improvements
---
README | 3 +
check | 11 +++
common/ext4 | 5 +
common/report | 130 +++++++++++++++++++++++++-----
common/xfs | 11 +++
doc/xunit.xsd | 246 +++++++++++++++++++++++++++++++++++++++++++++++++++++++++
6 files changed, 386 insertions(+), 20 deletions(-)
create mode 100644 doc/xunit.xsd
next reply other threads:[~2023-03-15 0:52 UTC|newest]
Thread overview: 16+ messages / expand[flat|nested] mbox.gz Atom feed top
2023-03-15 0:52 Darrick J. Wong [this message]
2023-03-15 0:52 ` [PATCH 01/15] check: generate section reports between tests Darrick J. Wong
2023-03-15 0:52 ` [PATCH 02/15] report: derive an xml schema for the xunit report Darrick J. Wong
2023-03-15 0:52 ` [PATCH 03/15] report: capture the time zone in the test report timestamp Darrick J. Wong
2023-03-15 0:52 ` [PATCH 04/15] report: clarify the meaning of the timestamp attribute Darrick J. Wong
2023-03-15 0:52 ` [PATCH 05/15] report: record fstests start and report generation timestamps Darrick J. Wong
2023-03-15 0:53 ` [PATCH 06/15] report: encode cdata sections correctly Darrick J. Wong
2023-03-15 0:53 ` [PATCH 07/15] report: encode the kernel log as a separate xml element Darrick J. Wong
2023-03-15 0:53 ` [PATCH 08/15] report: sort properties by name Darrick J. Wong
2023-03-15 0:53 ` [PATCH 09/15] report: pass property value to _xunit_add_property Darrick J. Wong
2023-03-15 0:53 ` [PATCH 10/15] report: encode xml entities in property values Darrick J. Wong
2023-03-15 0:53 ` [PATCH 11/15] report: collect basic information about a test run Darrick J. Wong
2023-03-15 0:53 ` [PATCH 12/15] report: record optional environment variables Darrick J. Wong
2023-03-15 0:53 ` [PATCH 13/15] report: record xfs-specific information about a test run Darrick J. Wong
2023-03-15 0:53 ` [PATCH 14/15] report: record ext*-specific " Darrick J. Wong
2023-03-15 0:53 ` [PATCH 15/15] report: allow test runners to inject arbitrary values Darrick J. Wong
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=167884155064.2482843.4310780034948240980.stgit@magnolia \
--to=djwong@kernel.org \
--cc=fstests@vger.kernel.org \
--cc=guan@eryu.me \
--cc=leah.rumancik@gmail.com \
--cc=linux-xfs@vger.kernel.org \
--cc=quwenruo.btrfs@gmx.com \
--cc=tytso@mit.edu \
--cc=wqu@suse.com \
--cc=zlang@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.