From: Christian Borntraeger <borntraeger@de.ibm.com>
To: Thomas Huth <thuth@redhat.com>, qemu-devel@nongnu.org
Cc: "Fam Zheng" <fam@euphon.net>, "Kevin Wolf" <kwolf@redhat.com>,
"Ed Maste" <emaste@freebsd.org>,
qemu-block@nongnu.org, "Alex Bennée" <alex.bennee@linaro.org>,
"Max Reitz" <mreitz@redhat.com>,
"Philippe Mathieu-Daudé" <philmd@redhat.com>,
"Li-Wen Hsu" <lwhsu@freebsd.org>
Subject: Re: [Qemu-devel] [PATCH 0/6] tests/qemu-iotests: Run basic iotests during "make check"
Date: Mon, 29 Apr 2019 14:04:15 +0200 [thread overview]
Message-ID: <bde669dd-ba2d-cf93-be65-731d294b8a23@de.ibm.com> (raw)
In-Reply-To: <20190424103747.10173-1-thuth@redhat.com>
On 24.04.19 12:37, Thomas Huth wrote:
> People often forget to run the iotests before submitting patches or
> pull requests - this is likely due to the fact that we do not run the
> tests during our mandatory "make check" tests yet.
> This patch series now introduces a new "ci" iotests group that should
> be safe to run in all CI environments (including FreeBSD and macOS!).
> Thus these iotests can now always be run during "make check" automati-
> cally, too.
Given that the iotests have been broken heavily immediately after the 4.0
release (e.g. by a qemu-io change) consider the series
Acked-by: Christian Borntraeger <borntraeger@de.ibm.com>
>
> Thomas Huth (6):
> tests/qemu-iotests/check: Pick a default machine if necessary
> tests/qemu-iotests/group: Introduce a new "ci" group for CI pipelines
> tests/qemu-iotests: Do not hard-code the path to bash
> cirrus / travis: Add gnu-sed and bash for macOS and FreeBSD
> tests: Run the iotests during "make check" again
> tests/qemu-iotests: Remove the "_supported_os Linux" line from many
> tests
>
> .cirrus.yml | 4 +-
> .travis.yml | 1 +
> tests/Makefile.include | 2 +-
> tests/qemu-iotests-quick.sh | 17 +++-
> tests/qemu-iotests/001 | 1 -
> tests/qemu-iotests/002 | 1 -
> tests/qemu-iotests/003 | 1 -
> tests/qemu-iotests/004 | 1 -
> tests/qemu-iotests/005 | 1 -
> tests/qemu-iotests/007 | 1 -
> tests/qemu-iotests/008 | 1 -
> tests/qemu-iotests/009 | 1 -
> tests/qemu-iotests/010 | 1 -
> tests/qemu-iotests/011 | 1 -
> tests/qemu-iotests/012 | 1 -
> tests/qemu-iotests/013 | 1 -
> tests/qemu-iotests/014 | 1 -
> tests/qemu-iotests/015 | 1 -
> tests/qemu-iotests/017 | 1 -
> tests/qemu-iotests/020 | 1 -
> tests/qemu-iotests/021 | 1 -
> tests/qemu-iotests/022 | 1 -
> tests/qemu-iotests/023 | 1 -
> tests/qemu-iotests/025 | 1 -
> tests/qemu-iotests/026 | 1 -
> tests/qemu-iotests/027 | 1 -
> tests/qemu-iotests/028 | 1 -
> tests/qemu-iotests/029 | 1 -
> tests/qemu-iotests/031 | 1 -
> tests/qemu-iotests/032 | 1 -
> tests/qemu-iotests/033 | 1 -
> tests/qemu-iotests/035 | 1 -
> tests/qemu-iotests/036 | 1 -
> tests/qemu-iotests/037 | 1 -
> tests/qemu-iotests/042 | 1 -
> tests/qemu-iotests/043 | 1 -
> tests/qemu-iotests/046 | 1 -
> tests/qemu-iotests/047 | 1 -
> tests/qemu-iotests/049 | 1 -
> tests/qemu-iotests/050 | 1 -
> tests/qemu-iotests/051 | 1 -
> tests/qemu-iotests/052 | 1 -
> tests/qemu-iotests/053 | 1 -
> tests/qemu-iotests/054 | 1 -
> tests/qemu-iotests/060 | 1 -
> tests/qemu-iotests/061 | 1 -
> tests/qemu-iotests/062 | 1 -
> tests/qemu-iotests/063 | 1 -
> tests/qemu-iotests/066 | 1 -
> tests/qemu-iotests/067 | 1 -
> tests/qemu-iotests/068 | 1 -
> tests/qemu-iotests/069 | 1 -
> tests/qemu-iotests/071 | 1 -
> tests/qemu-iotests/072 | 1 -
> tests/qemu-iotests/073 | 1 -
> tests/qemu-iotests/079 | 1 -
> tests/qemu-iotests/080 | 1 -
> tests/qemu-iotests/082 | 1 -
> tests/qemu-iotests/085 | 1 -
> tests/qemu-iotests/089 | 1 -
> tests/qemu-iotests/090 | 1 -
> tests/qemu-iotests/091 | 1 -
> tests/qemu-iotests/094 | 1 -
> tests/qemu-iotests/095 | 1 -
> tests/qemu-iotests/097 | 1 -
> tests/qemu-iotests/098 | 1 -
> tests/qemu-iotests/102 | 1 -
> tests/qemu-iotests/103 | 1 -
> tests/qemu-iotests/104 | 1 -
> tests/qemu-iotests/105 | 1 -
> tests/qemu-iotests/107 | 1 -
> tests/qemu-iotests/110 | 1 -
> tests/qemu-iotests/111 | 1 -
> tests/qemu-iotests/112 | 1 -
> tests/qemu-iotests/114 | 1 -
> tests/qemu-iotests/115 | 1 -
> tests/qemu-iotests/117 | 1 -
> tests/qemu-iotests/120 | 1 -
> tests/qemu-iotests/121 | 1 -
> tests/qemu-iotests/122 | 1 -
> tests/qemu-iotests/125 | 1 -
> tests/qemu-iotests/126 | 1 -
> tests/qemu-iotests/127 | 1 -
> tests/qemu-iotests/130 | 1 -
> tests/qemu-iotests/133 | 1 -
> tests/qemu-iotests/134 | 1 -
> tests/qemu-iotests/137 | 1 -
> tests/qemu-iotests/138 | 1 -
> tests/qemu-iotests/141 | 1 -
> tests/qemu-iotests/142 | 1 -
> tests/qemu-iotests/143 | 1 -
> tests/qemu-iotests/144 | 1 -
> tests/qemu-iotests/145 | 1 -
> tests/qemu-iotests/153 | 1 -
> tests/qemu-iotests/156 | 1 -
> tests/qemu-iotests/157 | 1 -
> tests/qemu-iotests/158 | 1 -
> tests/qemu-iotests/159 | 1 -
> tests/qemu-iotests/161 | 1 -
> tests/qemu-iotests/162 | 1 -
> tests/qemu-iotests/170 | 1 -
> tests/qemu-iotests/172 | 1 -
> tests/qemu-iotests/173 | 1 -
> tests/qemu-iotests/176 | 1 -
> tests/qemu-iotests/178 | 1 -
> tests/qemu-iotests/181 | 1 -
> tests/qemu-iotests/182 | 1 -
> tests/qemu-iotests/183 | 1 -
> tests/qemu-iotests/185 | 1 -
> tests/qemu-iotests/186 | 1 -
> tests/qemu-iotests/187 | 1 -
> tests/qemu-iotests/189 | 1 -
> tests/qemu-iotests/190 | 1 -
> tests/qemu-iotests/191 | 1 -
> tests/qemu-iotests/192 | 1 -
> tests/qemu-iotests/195 | 1 -
> tests/qemu-iotests/197 | 1 -
> tests/qemu-iotests/198 | 1 -
> tests/qemu-iotests/200 | 1 -
> tests/qemu-iotests/201 | 1 -
> tests/qemu-iotests/214 | 1 -
> tests/qemu-iotests/215 | 1 -
> tests/qemu-iotests/217 | 1 -
> tests/qemu-iotests/220 | 1 -
> tests/qemu-iotests/227 | 1 -
> tests/qemu-iotests/229 | 1 -
> tests/qemu-iotests/231 | 1 -
> tests/qemu-iotests/232 | 1 -
> tests/qemu-iotests/233 | 1 -
> tests/qemu-iotests/239 | 2 +-
> tests/qemu-iotests/240 | 3 +-
> tests/qemu-iotests/241 | 2 +-
> tests/qemu-iotests/243 | 2 +-
> tests/qemu-iotests/244 | 2 +-
> tests/qemu-iotests/247 | 1 -
> tests/qemu-iotests/check | 13 ++-
> tests/qemu-iotests/group | 194 +++++++++++++++++++-----------------
> 137 files changed, 139 insertions(+), 229 deletions(-)
>
WARNING: multiple messages have this Message-ID (diff)
From: Christian Borntraeger <borntraeger@de.ibm.com>
To: Thomas Huth <thuth@redhat.com>, qemu-devel@nongnu.org
Cc: "Fam Zheng" <fam@euphon.net>, "Kevin Wolf" <kwolf@redhat.com>,
"Ed Maste" <emaste@freebsd.org>,
qemu-block@nongnu.org,
"Philippe Mathieu-Daudé" <philmd@redhat.com>,
"Max Reitz" <mreitz@redhat.com>,
"Alex Bennée" <alex.bennee@linaro.org>,
"Li-Wen Hsu" <lwhsu@freebsd.org>
Subject: Re: [Qemu-devel] [PATCH 0/6] tests/qemu-iotests: Run basic iotests during "make check"
Date: Mon, 29 Apr 2019 14:04:15 +0200 [thread overview]
Message-ID: <bde669dd-ba2d-cf93-be65-731d294b8a23@de.ibm.com> (raw)
Message-ID: <20190429120415.QsdaZmTlkk131XQmdHepfKej4tBfrob926pkpI-sBA8@z> (raw)
In-Reply-To: <20190424103747.10173-1-thuth@redhat.com>
On 24.04.19 12:37, Thomas Huth wrote:
> People often forget to run the iotests before submitting patches or
> pull requests - this is likely due to the fact that we do not run the
> tests during our mandatory "make check" tests yet.
> This patch series now introduces a new "ci" iotests group that should
> be safe to run in all CI environments (including FreeBSD and macOS!).
> Thus these iotests can now always be run during "make check" automati-
> cally, too.
Given that the iotests have been broken heavily immediately after the 4.0
release (e.g. by a qemu-io change) consider the series
Acked-by: Christian Borntraeger <borntraeger@de.ibm.com>
>
> Thomas Huth (6):
> tests/qemu-iotests/check: Pick a default machine if necessary
> tests/qemu-iotests/group: Introduce a new "ci" group for CI pipelines
> tests/qemu-iotests: Do not hard-code the path to bash
> cirrus / travis: Add gnu-sed and bash for macOS and FreeBSD
> tests: Run the iotests during "make check" again
> tests/qemu-iotests: Remove the "_supported_os Linux" line from many
> tests
>
> .cirrus.yml | 4 +-
> .travis.yml | 1 +
> tests/Makefile.include | 2 +-
> tests/qemu-iotests-quick.sh | 17 +++-
> tests/qemu-iotests/001 | 1 -
> tests/qemu-iotests/002 | 1 -
> tests/qemu-iotests/003 | 1 -
> tests/qemu-iotests/004 | 1 -
> tests/qemu-iotests/005 | 1 -
> tests/qemu-iotests/007 | 1 -
> tests/qemu-iotests/008 | 1 -
> tests/qemu-iotests/009 | 1 -
> tests/qemu-iotests/010 | 1 -
> tests/qemu-iotests/011 | 1 -
> tests/qemu-iotests/012 | 1 -
> tests/qemu-iotests/013 | 1 -
> tests/qemu-iotests/014 | 1 -
> tests/qemu-iotests/015 | 1 -
> tests/qemu-iotests/017 | 1 -
> tests/qemu-iotests/020 | 1 -
> tests/qemu-iotests/021 | 1 -
> tests/qemu-iotests/022 | 1 -
> tests/qemu-iotests/023 | 1 -
> tests/qemu-iotests/025 | 1 -
> tests/qemu-iotests/026 | 1 -
> tests/qemu-iotests/027 | 1 -
> tests/qemu-iotests/028 | 1 -
> tests/qemu-iotests/029 | 1 -
> tests/qemu-iotests/031 | 1 -
> tests/qemu-iotests/032 | 1 -
> tests/qemu-iotests/033 | 1 -
> tests/qemu-iotests/035 | 1 -
> tests/qemu-iotests/036 | 1 -
> tests/qemu-iotests/037 | 1 -
> tests/qemu-iotests/042 | 1 -
> tests/qemu-iotests/043 | 1 -
> tests/qemu-iotests/046 | 1 -
> tests/qemu-iotests/047 | 1 -
> tests/qemu-iotests/049 | 1 -
> tests/qemu-iotests/050 | 1 -
> tests/qemu-iotests/051 | 1 -
> tests/qemu-iotests/052 | 1 -
> tests/qemu-iotests/053 | 1 -
> tests/qemu-iotests/054 | 1 -
> tests/qemu-iotests/060 | 1 -
> tests/qemu-iotests/061 | 1 -
> tests/qemu-iotests/062 | 1 -
> tests/qemu-iotests/063 | 1 -
> tests/qemu-iotests/066 | 1 -
> tests/qemu-iotests/067 | 1 -
> tests/qemu-iotests/068 | 1 -
> tests/qemu-iotests/069 | 1 -
> tests/qemu-iotests/071 | 1 -
> tests/qemu-iotests/072 | 1 -
> tests/qemu-iotests/073 | 1 -
> tests/qemu-iotests/079 | 1 -
> tests/qemu-iotests/080 | 1 -
> tests/qemu-iotests/082 | 1 -
> tests/qemu-iotests/085 | 1 -
> tests/qemu-iotests/089 | 1 -
> tests/qemu-iotests/090 | 1 -
> tests/qemu-iotests/091 | 1 -
> tests/qemu-iotests/094 | 1 -
> tests/qemu-iotests/095 | 1 -
> tests/qemu-iotests/097 | 1 -
> tests/qemu-iotests/098 | 1 -
> tests/qemu-iotests/102 | 1 -
> tests/qemu-iotests/103 | 1 -
> tests/qemu-iotests/104 | 1 -
> tests/qemu-iotests/105 | 1 -
> tests/qemu-iotests/107 | 1 -
> tests/qemu-iotests/110 | 1 -
> tests/qemu-iotests/111 | 1 -
> tests/qemu-iotests/112 | 1 -
> tests/qemu-iotests/114 | 1 -
> tests/qemu-iotests/115 | 1 -
> tests/qemu-iotests/117 | 1 -
> tests/qemu-iotests/120 | 1 -
> tests/qemu-iotests/121 | 1 -
> tests/qemu-iotests/122 | 1 -
> tests/qemu-iotests/125 | 1 -
> tests/qemu-iotests/126 | 1 -
> tests/qemu-iotests/127 | 1 -
> tests/qemu-iotests/130 | 1 -
> tests/qemu-iotests/133 | 1 -
> tests/qemu-iotests/134 | 1 -
> tests/qemu-iotests/137 | 1 -
> tests/qemu-iotests/138 | 1 -
> tests/qemu-iotests/141 | 1 -
> tests/qemu-iotests/142 | 1 -
> tests/qemu-iotests/143 | 1 -
> tests/qemu-iotests/144 | 1 -
> tests/qemu-iotests/145 | 1 -
> tests/qemu-iotests/153 | 1 -
> tests/qemu-iotests/156 | 1 -
> tests/qemu-iotests/157 | 1 -
> tests/qemu-iotests/158 | 1 -
> tests/qemu-iotests/159 | 1 -
> tests/qemu-iotests/161 | 1 -
> tests/qemu-iotests/162 | 1 -
> tests/qemu-iotests/170 | 1 -
> tests/qemu-iotests/172 | 1 -
> tests/qemu-iotests/173 | 1 -
> tests/qemu-iotests/176 | 1 -
> tests/qemu-iotests/178 | 1 -
> tests/qemu-iotests/181 | 1 -
> tests/qemu-iotests/182 | 1 -
> tests/qemu-iotests/183 | 1 -
> tests/qemu-iotests/185 | 1 -
> tests/qemu-iotests/186 | 1 -
> tests/qemu-iotests/187 | 1 -
> tests/qemu-iotests/189 | 1 -
> tests/qemu-iotests/190 | 1 -
> tests/qemu-iotests/191 | 1 -
> tests/qemu-iotests/192 | 1 -
> tests/qemu-iotests/195 | 1 -
> tests/qemu-iotests/197 | 1 -
> tests/qemu-iotests/198 | 1 -
> tests/qemu-iotests/200 | 1 -
> tests/qemu-iotests/201 | 1 -
> tests/qemu-iotests/214 | 1 -
> tests/qemu-iotests/215 | 1 -
> tests/qemu-iotests/217 | 1 -
> tests/qemu-iotests/220 | 1 -
> tests/qemu-iotests/227 | 1 -
> tests/qemu-iotests/229 | 1 -
> tests/qemu-iotests/231 | 1 -
> tests/qemu-iotests/232 | 1 -
> tests/qemu-iotests/233 | 1 -
> tests/qemu-iotests/239 | 2 +-
> tests/qemu-iotests/240 | 3 +-
> tests/qemu-iotests/241 | 2 +-
> tests/qemu-iotests/243 | 2 +-
> tests/qemu-iotests/244 | 2 +-
> tests/qemu-iotests/247 | 1 -
> tests/qemu-iotests/check | 13 ++-
> tests/qemu-iotests/group | 194 +++++++++++++++++++-----------------
> 137 files changed, 139 insertions(+), 229 deletions(-)
>
next prev parent reply other threads:[~2019-04-29 12:04 UTC|newest]
Thread overview: 72+ messages / expand[flat|nested] mbox.gz Atom feed top
2019-04-24 10:37 [Qemu-devel] [PATCH 0/6] tests/qemu-iotests: Run basic iotests during "make check" Thomas Huth
2019-04-24 10:37 ` Thomas Huth
2019-04-24 10:37 ` [Qemu-devel] [PATCH 1/6] tests/qemu-iotests/check: Pick a default machine if necessary Thomas Huth
2019-04-24 10:37 ` Thomas Huth
2019-04-30 21:31 ` Alex Bennée
2019-04-30 21:31 ` Alex Bennée
2019-04-24 10:37 ` [Qemu-devel] [PATCH 2/6] tests/qemu-iotests/group: Introduce a new "ci" group for CI pipelines Thomas Huth
2019-04-24 10:37 ` Thomas Huth
2019-04-24 11:25 ` Daniel P. Berrangé
2019-04-24 11:25 ` Daniel P. Berrangé
2019-04-24 12:37 ` Thomas Huth
2019-04-24 12:37 ` Thomas Huth
2019-04-24 12:50 ` Daniel P. Berrangé
2019-04-24 12:50 ` Daniel P. Berrangé
2019-04-24 13:01 ` Thomas Huth
2019-04-24 13:01 ` Thomas Huth
2019-04-24 13:12 ` Daniel P. Berrangé
2019-04-24 13:12 ` Daniel P. Berrangé
2019-04-25 7:44 ` Thomas Huth
2019-04-25 7:44 ` Thomas Huth
2019-04-24 10:37 ` [Qemu-devel] [PATCH 3/6] tests/qemu-iotests: Do not hard-code the path to bash Thomas Huth
2019-04-24 10:37 ` Thomas Huth
2019-04-24 14:14 ` Eric Blake
2019-04-24 14:14 ` Eric Blake
2019-04-24 14:42 ` Philippe Mathieu-Daudé
2019-04-24 14:42 ` Philippe Mathieu-Daudé
2019-04-24 15:23 ` Daniel P. Berrangé
2019-04-24 15:23 ` Daniel P. Berrangé
2019-04-25 7:48 ` Thomas Huth
2019-04-25 7:48 ` Thomas Huth
2019-04-30 21:33 ` Alex Bennée
2019-04-30 21:33 ` Alex Bennée
2019-04-24 10:37 ` [Qemu-devel] [PATCH 4/6] cirrus / travis: Add gnu-sed and bash for macOS and FreeBSD Thomas Huth
2019-04-24 10:37 ` Thomas Huth
2019-04-24 21:29 ` Wainer dos Santos Moschetta
2019-04-24 21:29 ` Wainer dos Santos Moschetta
2019-04-25 6:00 ` Thomas Huth
2019-04-25 6:00 ` Thomas Huth
2019-04-26 16:43 ` Laszlo Ersek
2019-04-26 16:43 ` Laszlo Ersek
2019-05-06 10:12 ` [Qemu-devel] Update *BSD images with gnu-sed and bash (was: [PATCH 4/6] cirrus / travis: Add gnu-sed and bash for macOS and FreeBSD) Thomas Huth
2019-05-07 8:32 ` Gerd Hoffmann
2019-05-07 10:13 ` Thomas Huth
2019-05-08 7:06 ` [Qemu-devel] Update *BSD images with gnu-sed and bash Kamil Rytarowski
2019-05-08 8:07 ` Thomas Huth
2019-05-08 19:21 ` Kamil Rytarowski
2019-04-24 10:37 ` [Qemu-devel] [PATCH 5/6] tests: Run the iotests during "make check" again Thomas Huth
2019-04-24 10:37 ` Thomas Huth
2019-04-24 10:48 ` Daniel P. Berrangé
2019-04-24 10:48 ` Daniel P. Berrangé
2019-04-24 10:59 ` Thomas Huth
2019-04-24 10:59 ` Thomas Huth
2019-04-24 12:02 ` Vladimir Sementsov-Ogievskiy
2019-04-24 12:02 ` Vladimir Sementsov-Ogievskiy
2019-04-24 12:13 ` Daniel P. Berrangé
2019-04-24 12:13 ` Daniel P. Berrangé
2019-04-24 12:18 ` Vladimir Sementsov-Ogievskiy
2019-04-24 12:18 ` Vladimir Sementsov-Ogievskiy
2019-04-24 20:42 ` Wainer dos Santos Moschetta
2019-04-24 20:42 ` Wainer dos Santos Moschetta
2019-04-25 5:57 ` Thomas Huth
2019-04-25 5:57 ` Thomas Huth
2019-04-25 10:24 ` Thomas Huth
2019-04-25 10:24 ` Thomas Huth
2019-04-28 2:42 ` Eric Blake
2019-04-28 2:42 ` Eric Blake
2019-04-24 10:37 ` [Qemu-devel] [PATCH 6/6] tests/qemu-iotests: Remove the "_supported_os Linux" line from many tests Thomas Huth
2019-04-24 10:37 ` Thomas Huth
2019-04-27 4:51 ` [Qemu-devel] [PATCH 0/6] tests/qemu-iotests: Run basic iotests during "make check" no-reply
2019-04-27 4:51 ` no-reply
2019-04-29 12:04 ` Christian Borntraeger [this message]
2019-04-29 12:04 ` Christian Borntraeger
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=bde669dd-ba2d-cf93-be65-731d294b8a23@de.ibm.com \
--to=borntraeger@de.ibm.com \
--cc=alex.bennee@linaro.org \
--cc=emaste@freebsd.org \
--cc=fam@euphon.net \
--cc=kwolf@redhat.com \
--cc=lwhsu@freebsd.org \
--cc=mreitz@redhat.com \
--cc=philmd@redhat.com \
--cc=qemu-block@nongnu.org \
--cc=qemu-devel@nongnu.org \
--cc=thuth@redhat.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.