From: Jan Kiszka <jan.kiszka@siemens.com>
To: Richard Weinberger <richard@nod.at>, xenomai@xenomai.org
Subject: Re: [PATCH 3/9] testsuite: Add a simple test driver for alchemytests
Date: Thu, 14 Apr 2022 13:28:42 +0200 [thread overview]
Message-ID: <67b4778f-33b1-9e3c-ed94-b1ddd17c5ab6@siemens.com> (raw)
In-Reply-To: <20220413215819.22954-4-richard@nod.at>
On 13.04.22 23:58, Richard Weinberger via Xenomai wrote:
> In their current shape, every alchemy test has to be a single
> program and does not use the smokey test framework.
>
> alchemytest_driver uses smokey and runs each test as new process.
Maybe rather call this "wrapper" or "loader" - driver reminded my first
of a kernel driver.
Jan
>
> Signed-off-by: Richard Weinberger <richard@nod.at>
> ---
> testsuite/alchemytests/Makefile.am | 11 +++
> testsuite/alchemytests/alchemytest_driver.c | 84 +++++++++++++++++++++
> 2 files changed, 95 insertions(+)
> create mode 100644 testsuite/alchemytests/alchemytest_driver.c
>
> diff --git a/testsuite/alchemytests/Makefile.am b/testsuite/alchemytests/Makefile.am
> index 35df0d49c..9159a0b77 100644
> --- a/testsuite/alchemytests/Makefile.am
> +++ b/testsuite/alchemytests/Makefile.am
> @@ -146,3 +146,14 @@ task10_SOURCES = task-10.c
> task10_CPPFLAGS = $(alchemycppflags)
> task10_LDADD = $(alchemyldadd) -lpthread -lrt -lm
> task10_LDFLAGS = @XENO_AUTOINIT_LDFLAGS@
> +
> +alchemytest_driver_SOURCES = alchemytest_driver.c
> +alchemytest_driver_CPPFLAGS = \
> + $(XENO_USER_CFLAGS) \
> + -I$(top_srcdir)/include
> +alchemytest_driver_LDFLAGS = @XENO_AUTOINIT_LDFLAGS@
> +alchemytest_driver_LDADD = \
> + ../../lib/smokey/libsmokey@CORE@.la \
> + @XENO_CORE_LDADD@ \
> + @XENO_USER_LDADD@ \
> + -lpthread -lrt
> diff --git a/testsuite/alchemytests/alchemytest_driver.c b/testsuite/alchemytests/alchemytest_driver.c
> new file mode 100644
> index 000000000..45323507d
> --- /dev/null
> +++ b/testsuite/alchemytests/alchemytest_driver.c
> @@ -0,0 +1,84 @@
> +#include <error.h>
> +#include <libgen.h>
> +#include <smokey/smokey.h>
> +#include <stdbool.h>
> +#include <stdio.h>
> +#include <stdlib.h>
> +#include <string.h>
> +#include <unistd.h>
> +
> +static char *mydir;
> +
> +#define TEST(name) \
> + smokey_test_plugin(name, SMOKEY_NOARGS, "Run external test"); \
> + static int run_##name(struct smokey_test *t, int argc, char *const argv[]) \
> + { \
> + return __run_extprog(t, argc, argv); \
> + }
> +
> +static int __run_extprog(struct smokey_test *t, int argc, char *const argv[])
> +{
> + int ret;
> + char *tst_path;
> +
> + ret = asprintf(&tst_path, "%s/%s --cpu-affinity=0", mydir, t->name);
> + if (ret == -1)
> + return -ENOMEM;
> +
> + ret = system(tst_path);
> + free(tst_path);
> +
> + return ret;
> +}
> +
> +TEST(alarm1)
> +TEST(buffer1)
> +TEST(event1)
> +TEST(heap1)
> +TEST(heap2)
> +TEST(mq1)
> +TEST(mq2)
> +TEST(mq3)
> +TEST(mutex1)
> +TEST(pipe1)
> +TEST(sem1)
> +TEST(sem2)
> +TEST(task1)
> +TEST(task2)
> +TEST(task3)
> +TEST(task4)
> +TEST(task5)
> +TEST(task6)
> +TEST(task7)
> +TEST(task8)
> +TEST(task9)
> +TEST(task10)
> +
> +int main(int argc, char *const argv[])
> +{
> + struct smokey_test *t;
> + int ret, fails = 0;
> +
> + if (argc > 0)
> + mydir = dirname(argv[0]);
> + else
> + mydir = ".";
> +
> + if (pvlist_empty(&smokey_test_list))
> + return 0;
> +
> + for_each_smokey_test(t) {
> + ret = t->run(t, argc, argv);
> + if (ret) {
> + fails++;
> + if (smokey_keep_going)
> + continue;
> + if (smokey_verbose_mode)
> + error(1, -ret, "test %s failed", t->name);
> + return 1;
> + }
> + smokey_note("%s OK", t->name);
> + }
> +
> + return fails != 0;
> +}
--
Siemens AG, Technology
Competence Center Embedded Linux
next prev parent reply other threads:[~2022-04-14 11:28 UTC|newest]
Thread overview: 112+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-04-13 21:58 [PATCH v2 0/9] Revive alchemy, pSOS and VxWorks tests Richard Weinberger
2022-04-13 21:58 ` [PATCH 1/9] testsuite: Move alchemy tests into testsuite/ Richard Weinberger
2022-04-13 21:58 ` [PATCH 2/9] testsuite: Hook up alchemytests Richard Weinberger
2022-04-13 21:58 ` [PATCH 3/9] testsuite: Add a simple test driver for alchemytests Richard Weinberger
2022-04-14 11:28 ` Jan Kiszka [this message]
2022-04-14 11:42 ` Richard Weinberger
2022-04-13 21:58 ` [PATCH 4/9] Remove old alchemy tests Makefile Richard Weinberger
2022-04-13 21:58 ` [PATCH 5/9] alchemytests: Fix gcc warning in buffer-1 Richard Weinberger
2022-04-13 21:58 ` [PATCH 6/9] alchemytests: Fix gcc warning in task-9 Richard Weinberger
2022-04-13 21:58 ` [PATCH 7/9] testsuite: Move pSOS tests into testsuite/ Richard Weinberger
2022-04-13 21:58 ` [PATCH 8/9] testsuite: Add a simple test driver for psostests Richard Weinberger
2022-04-13 21:58 ` [PATCH 9/9] testsuite: Integrate vwworks tests into testsuite/ Richard Weinberger
2022-04-14 11:18 ` [PATCH v2 0/9] Revive alchemy, pSOS and VxWorks tests Jan Kiszka
2022-04-14 11:29 ` Richard Weinberger
2022-04-14 12:58 ` Richard Weinberger
2022-04-14 14:15 ` Bezdeka, Florian
2022-04-14 14:19 ` Richard Weinberger
2022-04-14 15:13 ` Richard Weinberger
2022-04-14 15:34 ` Jan Kiszka
2022-04-14 15:41 ` Richard Weinberger
2022-04-14 15:43 ` Jan Kiszka
2023-04-06 10:33 ` [PATCH v3 0/11] " Aaron Marcher
2023-04-06 10:33 ` [PATCH 01/11] testsuite: Move alchemy tests into testsuite/ Aaron Marcher
2023-04-06 10:33 ` [PATCH 02/11] testsuite: Hook up alchemytests Aaron Marcher
2023-04-06 10:33 ` [PATCH 03/11] testsuite: Add a simple test driver for alchemytests Aaron Marcher
2023-04-06 10:33 ` [PATCH 04/11] Remove old alchemy tests Makefile Aaron Marcher
2023-04-06 10:33 ` [PATCH 05/11] alchemytests: Fix gcc warning in buffer-1 Aaron Marcher
2023-04-06 10:33 ` [PATCH 06/11] alchemytests: Fix gcc warning in task-9 Aaron Marcher
2023-04-06 10:33 ` [PATCH 07/11] testsuite: Move pSOS tests into testsuite/ Aaron Marcher
2023-04-06 10:33 ` [PATCH 08/11] testsuite: Add a simple test driver for psostests Aaron Marcher
2023-04-06 10:33 ` [PATCH 09/11] testsuite: Integrate vwworks tests into testsuite/ Aaron Marcher
2023-04-06 10:33 ` [PATCH 10/11] alchemytests: check pipe-1 asprintf ret value Aaron Marcher
2023-04-06 10:33 ` [PATCH 11/11] vxworkstests: fix Makefile.am reference Aaron Marcher
2023-04-16 7:33 ` Jan Kiszka
2023-04-16 7:32 ` [PATCH v3 0/11] Revive alchemy, pSOS and VxWorks tests Jan Kiszka
2023-04-16 7:41 ` Jan Kiszka
2023-04-16 9:03 ` Richard Weinberger
2023-05-17 7:30 ` Aaron Marcher
2023-05-17 9:35 ` Jan Kiszka
2023-05-20 14:57 ` Florian Bezdeka
2023-07-20 14:51 ` [PATCH v4 00/10] " Aaron Marcher
2023-07-20 14:51 ` [PATCH 01/10] testsuite: Fully integrate alchemytests into smokey Aaron Marcher
2023-07-20 16:50 ` Jan Kiszka
2023-07-20 14:51 ` [PATCH 02/10] testsuite: Fully integrate psostests " Aaron Marcher
2023-07-20 14:51 ` [PATCH 03/10] testsuite: Fully integrate vwworkstests " Aaron Marcher
2023-07-20 14:51 ` [PATCH 04/10] testsuite: Remove old alchemytests Makefile Aaron Marcher
2023-07-20 14:51 ` [PATCH 05/10] alchemytests: Fix gcc warning in buffer-1 Aaron Marcher
2023-07-20 14:51 ` [PATCH 06/10] alchemytests: Fix gcc warning in task-9 Aaron Marcher
2023-07-20 14:51 ` [PATCH 07/10] alchemytests: Check pipe-1 asprintf ret value Aaron Marcher
2023-07-20 14:51 ` [PATCH 08/10] alchemytests: Fix task-2 Aaron Marcher
2023-07-20 14:51 ` [PATCH 09/10] alchemytests: Fix task-5 logic Aaron Marcher
2023-07-20 14:51 ` [PATCH 10/10] testsuite: disable broken tests Aaron Marcher
2023-07-20 14:54 ` [PATCH v4 00/10] Revive alchemy, pSOS and VxWorks tests Jan Kiszka
2023-07-20 15:01 ` Aaron Marcher
2023-07-24 13:52 ` [PATCH v5 " Aaron Marcher
2023-07-24 13:52 ` [PATCH 01/10] testsuite: Fully integrate alchemytests into smokey Aaron Marcher
2023-08-10 7:07 ` Florian Bezdeka
2023-08-11 17:32 ` Jan Kiszka
2023-08-16 12:43 ` Aaron Marcher
2023-09-14 7:41 ` Jan Kiszka
2023-09-20 13:52 ` [PATCH 0/5] Improvements for smokey skintests Aaron Marcher
2023-09-20 13:52 ` [PATCH 1/5] lib: Add smokey_run_extprog as helper for testsuite Aaron Marcher
2023-09-22 15:49 ` Jan Kiszka
2023-09-22 21:03 ` Richard Weinberger
2023-09-25 13:03 ` [PATCH] lib: Drop cpu-affinity=0 from skin-tests helper Aaron Marcher
2023-09-25 15:04 ` Philippe Gerum
2023-09-25 15:12 ` [PATCH 0/1 V2] " Aaron Marcher
2023-09-25 15:12 ` [PATCH 1/1] " Aaron Marcher
2023-09-25 15:42 ` Jan Kiszka
2023-09-28 17:04 ` Jan Kiszka
2023-09-28 17:30 ` Jan Kiszka
2023-09-29 12:12 ` Aaron Marcher
2023-09-29 12:34 ` Jan Kiszka
2023-09-20 13:52 ` [PATCH 2/5] testsuite: Merge alchemytests in single smokey case Aaron Marcher
2023-09-20 13:52 ` [PATCH 3/5] testsuite: Merge psostests in a " Aaron Marcher
2023-09-20 13:52 ` [PATCH 4/5] testsuite: Merge vxworkstests " Aaron Marcher
2023-09-20 13:52 ` [PATCH 5/5] testsuite: Drop skin test "drivers" Aaron Marcher
2023-09-22 15:52 ` [PATCH 0/5] Improvements for smokey skintests Jan Kiszka
2023-09-20 14:00 ` [PATCH 01/10] testsuite: Fully integrate alchemytests into smokey Aaron Marcher
2023-08-16 12:41 ` Aaron Marcher
2023-08-16 14:19 ` Jan Kiszka
2023-07-24 13:52 ` [PATCH 02/10] testsuite: Fully integrate psostests " Aaron Marcher
2023-07-24 13:52 ` [PATCH 03/10] testsuite: Fully integrate vwworkstests " Aaron Marcher
2023-07-24 13:52 ` [PATCH 04/10] testsuite: Remove old alchemytests Makefile Aaron Marcher
2023-07-24 13:52 ` [PATCH 05/10] alchemytests: Fix gcc warning in buffer-1 Aaron Marcher
2023-07-24 13:52 ` [PATCH 06/10] alchemytests: Fix gcc warning in task-9 Aaron Marcher
2023-07-24 13:52 ` [PATCH 07/10] alchemytests: Check pipe-1 asprintf ret value Aaron Marcher
2023-07-24 13:52 ` [PATCH 08/10] alchemytests: Fix task-2 Aaron Marcher
2023-07-24 14:39 ` Richard Weinberger
2023-07-25 8:29 ` [PATCH v6 00/10] Revive alchemy, pSOS and VxWorks tests Aaron Marcher
2023-07-25 8:29 ` [PATCH 01/10] testsuite: Fully integrate alchemytests into smokey Aaron Marcher
2023-08-09 7:28 ` Jan Kiszka
2023-08-09 11:32 ` [PATCH v7 " Jan Kiszka
2023-07-25 8:29 ` [PATCH 02/10] testsuite: Fully integrate psostests " Aaron Marcher
2023-08-09 11:32 ` [PATCH v7 " Jan Kiszka
2023-07-25 8:29 ` [PATCH 03/10] testsuite: Fully integrate vwworkstests " Aaron Marcher
2023-08-09 11:32 ` [PATCH v7 " Jan Kiszka
2023-08-09 15:02 ` Jan Kiszka
2023-07-25 8:29 ` [PATCH 04/10] testsuite: Remove old alchemytests Makefile Aaron Marcher
2023-07-25 8:29 ` [PATCH 05/10] alchemytests: Fix gcc warning in buffer-1 Aaron Marcher
2023-07-25 8:29 ` [PATCH 06/10] alchemytests: Fix gcc warning in task-9 Aaron Marcher
2023-07-25 8:29 ` [PATCH 07/10] alchemytests: Check pipe-1 asprintf ret value Aaron Marcher
2023-07-25 8:29 ` [PATCH 08/10] alchemytests: Fix task-2 Aaron Marcher
2023-07-25 8:29 ` [PATCH 09/10] alchemytests: Fix task-5 logic Aaron Marcher
2023-07-25 8:29 ` [PATCH 10/10] testsuite: disable broken tests Aaron Marcher
2023-08-03 15:35 ` [PATCH v6 00/10] Revive alchemy, pSOS and VxWorks tests Florian Bezdeka
2023-08-09 7:36 ` Jan Kiszka
2023-08-09 11:33 ` Jan Kiszka
2023-08-16 12:37 ` Aaron Marcher
2023-08-09 11:32 ` [PATCH v7 11/10] testsuite/smokey: Hook up new tests Jan Kiszka
2023-07-24 13:52 ` [PATCH 09/10] alchemytests: Fix task-5 logic Aaron Marcher
2023-07-24 13:52 ` [PATCH 10/10] testsuite: disable broken tests Aaron Marcher
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=67b4778f-33b1-9e3c-ed94-b1ddd17c5ab6@siemens.com \
--to=jan.kiszka@siemens.com \
--cc=richard@nod.at \
--cc=xenomai@xenomai.org \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).