* [LTP] [PATCH v2 1/2] Add Coccinelle helper scripts for reference @ 2021-06-07 14:14 Richard Palethorpe 2021-06-07 14:14 ` [LTP] [PATCH v2 2/2] API: Remove TEST macro usage from library Richard Palethorpe 2021-06-09 8:48 ` [LTP] [PATCH v2 1/2] Add Coccinelle helper scripts for reference Petr Vorel 0 siblings, 2 replies; 4+ messages in thread From: Richard Palethorpe @ 2021-06-07 14:14 UTC (permalink / raw) To: ltp Check-in a couple of scripts used for removing the TEST macro from the library. Also a shell script to show how to run them. These are only intended to help someone develop their own refactoring scripts. Not for running automatically. Signed-off-by: Richard Palethorpe <rpalethorpe@suse.com> --- V2: * Simplify the Cocci scripts * Simplify the patchset and combine it with the separate CGroups patch * Testing & sign-off Feel free to drop the Coccinelle scripts. However I do think they should be included for people's information. I simplified them to remove the Python code and make them easier to understand. .../coccinelle/libltp-test-macro-vars.cocci | 19 ++++ scripts/coccinelle/libltp-test-macro.cocci | 104 ++++++++++++++++++ scripts/coccinelle/run-spatch.sh | 39 +++++++ 3 files changed, 162 insertions(+) create mode 100644 scripts/coccinelle/libltp-test-macro-vars.cocci create mode 100644 scripts/coccinelle/libltp-test-macro.cocci create mode 100755 scripts/coccinelle/run-spatch.sh diff --git a/scripts/coccinelle/libltp-test-macro-vars.cocci b/scripts/coccinelle/libltp-test-macro-vars.cocci new file mode 100644 index 000000000..c12bf3891 --- /dev/null +++ b/scripts/coccinelle/libltp-test-macro-vars.cocci @@ -0,0 +1,19 @@ +// SPDX-License-Identifier: GPL-2.0-or-later +// Copyright (c) 2021 SUSE LLC <rpalethorpe@suse.com> + +// The TEST macro should not be used in the library because it sets +// TST_RET and TST_ERR which are global variables. The test author +// only expects these to be changed if *they* call TEST directly. + +// Find all positions where TEST's variables are used +@ find_use exists @ +identifier tst_var =~ "TST_(ERR|RET)"; +position p; +expression E; +@@ + +( +* tst_var@p +| +* TTERRNO@p | E +) diff --git a/scripts/coccinelle/libltp-test-macro.cocci b/scripts/coccinelle/libltp-test-macro.cocci new file mode 100644 index 000000000..8855aaeb7 --- /dev/null +++ b/scripts/coccinelle/libltp-test-macro.cocci @@ -0,0 +1,104 @@ +// SPDX-License-Identifier: GPL-2.0-or-later +// Copyright (c) 2021 SUSE LLC <rpalethorpe@suse.com> + +// The TEST macro should not be used in the library because it sets +// TST_RET and TST_ERR which are global variables. The test author +// only expects these to be changed if *they* call TEST directly. + +// Set with -D fix +virtual fix + +// Find all positions where TEST is _used_. +@ find_use exists @ +position p; +@@ + +* TEST@p(...); + +// Below are rules which will create a patch to replace TEST usage +// It assumes we can use the ret var without conflicts + +// Fix all references to the variables TEST modifies when they occur in a +// function where TEST was used. +@ depends on fix && find_use @ +@@ + +( +- TST_RET ++ ret +| +- TST_ERR ++ errno +| +- TTERRNO ++ TERRNO +) + +// Replace TEST in all functions where it occurs only at the start. It +// is slightly complicated by adding a newline if a statement appears +// on the line after TEST(). It is not clear to me what the rules are +// for matching whitespace as it has no semantic meaning, but this +// appears to work. +@ depends on fix @ +identifier fn; +expression tested_expr; +statement st; +@@ + + fn (...) + { +- TEST(tested_expr); ++ const long ret = tested_expr; +( ++ + st +| + +) + ... when != TEST(...) + } + +// Replace TEST in all functions where it occurs at the start +// Functions where it *only* occurs at the start were handled above +@ depends on fix @ +identifier fn; +expression tested_expr; +statement st; +@@ + + fn (...) + { +- TEST(tested_expr); ++ long ret = tested_expr; +( ++ + st +| + +) + ... + } + +// Add ret var at the start of a function where TEST occurs and there +// is not already a ret declaration +@ depends on fix exists @ +identifier fn; +@@ + + fn (...) + { ++ long ret; + ... when != long ret; + + TEST(...) + ... + } + +// Replace any remaining occurances of TEST +@ depends on fix @ +expression tested_expr; +@@ + +- TEST(tested_expr); ++ ret = tested_expr; + diff --git a/scripts/coccinelle/run-spatch.sh b/scripts/coccinelle/run-spatch.sh new file mode 100755 index 000000000..7bb781bc1 --- /dev/null +++ b/scripts/coccinelle/run-spatch.sh @@ -0,0 +1,39 @@ +#!/bin/sh -eu +# SPDX-License-Identifier: GPL-2.0-or-later +# Copyright (c) 2021 SUSE LLC <rpalethorpe@suse.com> + +# Helper for running spatch Coccinelle scripts on the LTP source tree + +if [[ ! -d lib || ! -d scripts/coccinelle ]]; then + echo "$0: Can't find lib or scripts directories. Run me from top src dir" + exit 1 +fi + +# Run a script on the lib dir +libltp_spatch_report() { + spatch --dir lib \ + --ignore lib/parse_opts.c \ + --ignore lib/newlib_tests \ + --ignore lib/tests \ + --use-gitgrep \ + -D report \ + --include-headers \ + $* +} + +libltp_spatch_fix() { + spatch --dir lib \ + --ignore lib/parse_opts.c \ + --ignore lib/newlib_tests \ + --ignore lib/tests \ + --use-gitgrep \ + --in-place \ + -D fix \ + --include-headers \ + $* +} + +echo You should uncomment one of the scripts below! +#libltp_spatch_report --sp-file scripts/coccinelle/libltp-test-macro.cocci +#libltp_spatch_report --sp-file scripts/coccinelle/libltp-test-macro-vars.cocci \ +# --ignore lib/tst_test.c -- 2.31.1 ^ permalink raw reply related [flat|nested] 4+ messages in thread
* [LTP] [PATCH v2 2/2] API: Remove TEST macro usage from library 2021-06-07 14:14 [LTP] [PATCH v2 1/2] Add Coccinelle helper scripts for reference Richard Palethorpe @ 2021-06-07 14:14 ` Richard Palethorpe 2021-06-09 8:48 ` [LTP] [PATCH v2 1/2] Add Coccinelle helper scripts for reference Petr Vorel 1 sibling, 0 replies; 4+ messages in thread From: Richard Palethorpe @ 2021-06-07 14:14 UTC (permalink / raw) To: ltp The test author is guaranteed that the LTP library will not change the TST_RET and TST_ERR global variables. That way the test author can use the TEST macro then call other library functions before using TST_RET, TST_ERR or TTERRNO. Signed-off-by: Richard Palethorpe <rpalethorpe@suse.com> --- lib/tst_af_alg.c | 46 ++++++++++++++++++++---------------- lib/tst_cgroup.c | 13 +++++----- lib/tst_crypto.c | 20 +++++++++------- lib/tst_netdevice.c | 10 ++++---- lib/tst_rtnetlink.c | 4 ++-- lib/tst_supported_fs_types.c | 10 ++++---- 6 files changed, 57 insertions(+), 46 deletions(-) diff --git a/lib/tst_af_alg.c b/lib/tst_af_alg.c index d3895a83d..05caa6301 100644 --- a/lib/tst_af_alg.c +++ b/lib/tst_af_alg.c @@ -13,25 +13,28 @@ int tst_alg_create(void) { - TEST(socket(AF_ALG, SOCK_SEQPACKET, 0)); - if (TST_RET >= 0) - return TST_RET; - if (TST_ERR == EAFNOSUPPORT) + const long ret = socket(AF_ALG, SOCK_SEQPACKET, 0); + + if (ret >= 0) + return ret; + if (errno == EAFNOSUPPORT) tst_brk(TCONF, "kernel doesn't support AF_ALG"); - tst_brk(TBROK | TTERRNO, "unexpected error creating AF_ALG socket"); + tst_brk(TBROK | TERRNO, "unexpected error creating AF_ALG socket"); return -1; } void tst_alg_bind_addr(int algfd, const struct sockaddr_alg *addr) { - TEST(bind(algfd, (const struct sockaddr *)addr, sizeof(*addr))); - if (TST_RET == 0) + const long ret = bind(algfd, (const struct sockaddr *)addr, + sizeof(*addr)); + + if (ret == 0) return; - if (TST_ERR == ENOENT) { + if (errno == ENOENT) { tst_brk(TCONF, "kernel doesn't support %s algorithm '%s'", addr->salg_type, addr->salg_name); } - tst_brk(TBROK | TTERRNO, + tst_brk(TBROK | TERRNO, "unexpected error binding AF_ALG socket to %s algorithm '%s'", addr->salg_type, addr->salg_name); } @@ -63,6 +66,7 @@ void tst_alg_bind(int algfd, const char *algtype, const char *algname) bool tst_have_alg(const char *algtype, const char *algname) { + long ret; int algfd; struct sockaddr_alg addr; bool have_alg = true; @@ -71,10 +75,10 @@ bool tst_have_alg(const char *algtype, const char *algname) init_sockaddr_alg(&addr, algtype, algname); - TEST(bind(algfd, (const struct sockaddr *)&addr, sizeof(addr))); - if (TST_RET != 0) { - if (TST_ERR != ENOENT) { - tst_brk(TBROK | TTERRNO, + ret = bind(algfd, (const struct sockaddr *)&addr, sizeof(addr)); + if (ret != 0) { + if (errno != ENOENT) { + tst_brk(TBROK | TERRNO, "unexpected error binding AF_ALG socket to %s algorithm '%s'", algtype, algname); } @@ -96,6 +100,7 @@ void tst_require_alg(const char *algtype, const char *algname) void tst_alg_setkey(int algfd, const uint8_t *key, unsigned int keylen) { + long ret; uint8_t *keybuf = NULL; unsigned int i; @@ -106,9 +111,9 @@ void tst_alg_setkey(int algfd, const uint8_t *key, unsigned int keylen) keybuf[i] = rand(); key = keybuf; } - TEST(setsockopt(algfd, SOL_ALG, ALG_SET_KEY, key, keylen)); - if (TST_RET != 0) { - tst_brk(TBROK | TTERRNO, + ret = setsockopt(algfd, SOL_ALG, ALG_SET_KEY, key, keylen); + if (ret != 0) { + tst_brk(TBROK | TERRNO, "unexpected error setting key (len=%u)", keylen); } free(keybuf); @@ -116,12 +121,13 @@ void tst_alg_setkey(int algfd, const uint8_t *key, unsigned int keylen) int tst_alg_accept(int algfd) { - TEST(accept(algfd, NULL, NULL)); - if (TST_RET < 0) { - tst_brk(TBROK | TTERRNO, + const long ret = accept(algfd, NULL, NULL); + + if (ret < 0) { + tst_brk(TBROK | TERRNO, "unexpected error accept()ing AF_ALG request socket"); } - return TST_RET; + return ret; } int tst_alg_setup(const char *algtype, const char *algname, diff --git a/lib/tst_cgroup.c b/lib/tst_cgroup.c index 1e036d3c3..666260647 100644 --- a/lib/tst_cgroup.c +++ b/lib/tst_cgroup.c @@ -1043,6 +1043,7 @@ ssize_t safe_cgroup_read(const char *const file, const int lineno, const char *alias; size_t prev_len = 0; char prev_buf[BUFSIZ]; + ssize_t read_ret = 0; for_each_dir(cg, cfile->ctrl_indx, dir) { if (!(alias = cgroup_file_alias(cfile, *dir))) @@ -1051,9 +1052,9 @@ ssize_t safe_cgroup_read(const char *const file, const int lineno, if (prev_len) memcpy(prev_buf, out, prev_len); - TEST(safe_file_readat(file, lineno, - (*dir)->dir_fd, alias, out, len)); - if (TST_RET < 0) + read_ret = safe_file_readat(file, lineno, + (*dir)->dir_fd, alias, out, len); + if (read_ret < 0) continue; if (prev_len && memcmp(out, prev_buf, prev_len)) { @@ -1063,12 +1064,12 @@ ssize_t safe_cgroup_read(const char *const file, const int lineno, break; } - prev_len = MIN(sizeof(prev_buf), (size_t)TST_RET); + prev_len = MIN(sizeof(prev_buf), (size_t)read_ret); } - out[MAX(TST_RET, 0)] = '\0'; + out[MAX(read_ret, 0)] = '\0'; - return TST_RET; + return read_ret; } void safe_cgroup_printf(const char *const file, const int lineno, diff --git a/lib/tst_crypto.c b/lib/tst_crypto.c index 685e0871e..c01632c2a 100644 --- a/lib/tst_crypto.c +++ b/lib/tst_crypto.c @@ -14,16 +14,17 @@ void tst_crypto_open(struct tst_crypto_session *ses) { - TEST(socket(AF_NETLINK, SOCK_DGRAM, NETLINK_CRYPTO)); - if (TST_RET < 0 && TST_ERR == EPROTONOSUPPORT) - tst_brk(TCONF | TTERRNO, "NETLINK_CRYPTO is probably disabled"); + const long ret = socket(AF_NETLINK, SOCK_DGRAM, NETLINK_CRYPTO); - if (TST_RET < 0) { - tst_brk(TBROK | TTERRNO, + if (ret < 0 && errno == EPROTONOSUPPORT) + tst_brk(TCONF | TERRNO, "NETLINK_CRYPTO is probably disabled"); + + if (ret < 0) { + tst_brk(TBROK | TERRNO, "socket(AF_NETLINK, SOCK_DGRAM, NETLINK_CRYPTO)"); } - ses->fd = TST_RET; + ses->fd = ret; ses->seq_num = 0; } @@ -83,6 +84,7 @@ int tst_crypto_add_alg(struct tst_crypto_session *ses, int tst_crypto_del_alg(struct tst_crypto_session *ses, const struct crypto_user_alg *alg) { + long ret; unsigned int i = 0; struct nlmsghdr nh = { .nlmsg_len = sizeof(struct nlmsghdr) + sizeof(*alg), @@ -96,8 +98,8 @@ int tst_crypto_del_alg(struct tst_crypto_session *ses, SAFE_NETLINK_SEND(ses->fd, &nh, alg); - TEST(tst_crypto_recv_ack(ses)); - if (TST_RET != -EBUSY || i >= ses->retries) + ret = tst_crypto_recv_ack(ses); + if (ret != -EBUSY || i >= ses->retries) break; if (usleep(1) && errno != EINTR) @@ -106,5 +108,5 @@ int tst_crypto_del_alg(struct tst_crypto_session *ses, ++i; } - return TST_RET; + return ret; } diff --git a/lib/tst_netdevice.c b/lib/tst_netdevice.c index d098173d5..cc2766be8 100644 --- a/lib/tst_netdevice.c +++ b/lib/tst_netdevice.c @@ -149,7 +149,7 @@ int tst_create_veth_pair(const char *file, const int lineno, tst_rtnl_destroy_context(file, lineno, ctx); if (!ret) { - tst_brk_(file, lineno, TBROK | TTERRNO, + tst_brk_(file, lineno, TBROK | TERRNO, "Failed to create veth interfaces %s+%s", ifname1, ifname2); } @@ -183,7 +183,7 @@ int tst_remove_netdev(const char *file, const int lineno, const char *ifname) tst_rtnl_destroy_context(file, lineno, ctx); if (!ret) { - tst_brk_(file, lineno, TBROK | TTERRNO, + tst_brk_(file, lineno, TBROK | TERRNO, "Failed to remove netdevice %s", ifname); } @@ -232,7 +232,7 @@ static int modify_address(const char *file, const int lineno, tst_rtnl_destroy_context(file, lineno, ctx); if (!ret) { - tst_brk_(file, lineno, TBROK | TTERRNO, + tst_brk_(file, lineno, TBROK | TERRNO, "Failed to modify %s network address", ifname); } @@ -301,7 +301,7 @@ static int change_ns(const char *file, const int lineno, const char *ifname, tst_rtnl_destroy_context(file, lineno, ctx); if (!ret) { - tst_brk_(file, lineno, TBROK | TTERRNO, + tst_brk_(file, lineno, TBROK | TERRNO, "Failed to move %s to another namespace", ifname); } @@ -392,7 +392,7 @@ static int modify_route(const char *file, const int lineno, unsigned int action, tst_rtnl_destroy_context(file, lineno, ctx); if (!ret) { - tst_brk_(file, lineno, TBROK | TTERRNO, + tst_brk_(file, lineno, TBROK | TERRNO, "Failed to modify network route"); } diff --git a/lib/tst_rtnetlink.c b/lib/tst_rtnetlink.c index 1ecda3a9f..d93f7e18d 100644 --- a/lib/tst_rtnetlink.c +++ b/lib/tst_rtnetlink.c @@ -380,7 +380,7 @@ int tst_rtnl_check_acks(const char *file, const int lineno, } if (res->err->error) { - TST_ERR = -res->err->error; + errno = -res->err->error; return 0; } } @@ -394,7 +394,7 @@ int tst_rtnl_send_validate(const char *file, const int lineno, struct tst_rtnl_message *response; int ret; - TST_ERR = 0; + errno = 0; if (tst_rtnl_send(file, lineno, ctx) <= 0) return 0; diff --git a/lib/tst_supported_fs_types.c b/lib/tst_supported_fs_types.c index 592a526ae..d0f745490 100644 --- a/lib/tst_supported_fs_types.c +++ b/lib/tst_supported_fs_types.c @@ -167,14 +167,16 @@ const char **tst_get_supported_fs_types(const char *const *skiplist) int tst_check_quota_support(const char *device, int format, char *quotafile) { - TEST(quotactl(QCMD(Q_QUOTAON, USRQUOTA), device, format, quotafile)); + const long ret = quotactl(QCMD(Q_QUOTAON, USRQUOTA), device, format, + quotafile); /* Not supported */ - if (TST_RET == -1 && TST_ERR == ESRCH) + + if (ret == -1 && errno == ESRCH) return 0; /* Broken */ - if (TST_RET) + if (ret) return -1; quotactl(QCMD(Q_QUOTAOFF, USRQUOTA), device, 0, 0); @@ -192,5 +194,5 @@ void tst_require_quota_support_(const char *file, const int lineno, } if (status < 0) - tst_brk_(file, lineno, TBROK|TTERRNO, "FS quotas are broken"); + tst_brk_(file, lineno, TBROK|TERRNO, "FS quotas are broken"); } -- 2.31.1 ^ permalink raw reply related [flat|nested] 4+ messages in thread
* [LTP] [PATCH v2 1/2] Add Coccinelle helper scripts for reference 2021-06-07 14:14 [LTP] [PATCH v2 1/2] Add Coccinelle helper scripts for reference Richard Palethorpe 2021-06-07 14:14 ` [LTP] [PATCH v2 2/2] API: Remove TEST macro usage from library Richard Palethorpe @ 2021-06-09 8:48 ` Petr Vorel 2021-06-09 10:28 ` Richard Palethorpe 1 sibling, 1 reply; 4+ messages in thread From: Petr Vorel @ 2021-06-09 8:48 UTC (permalink / raw) To: ltp Hi Richie, > Check-in a couple of scripts used for removing the TEST macro from the > library. Also a shell script to show how to run them. These are only > intended to help someone develop their own refactoring scripts. Not > for running automatically. Nice, LGTM, with two notes bellow. > +++ b/scripts/coccinelle/run-spatch.sh > @@ -0,0 +1,39 @@ > +#!/bin/sh -eu > +# SPDX-License-Identifier: GPL-2.0-or-later > +# Copyright (c) 2021 SUSE LLC <rpalethorpe@suse.com> > + > +# Helper for running spatch Coccinelle scripts on the LTP source tree > + > +if [[ ! -d lib || ! -d scripts/coccinelle ]]; then [[ ... ]] is bashism. It should be if [ ! -d lib ] || [ ! -d scripts/coccinelle ]; then or > + echo "$0: Can't find lib or scripts directories. Run me from top src dir" > + exit 1 > +fi > + > +# Run a script on the lib dir > +libltp_spatch_report() { > + spatch --dir lib \ > + --ignore lib/parse_opts.c \ > + --ignore lib/newlib_tests \ > + --ignore lib/tests \ > + --use-gitgrep \ > + -D report \ > + --include-headers \ > + $* > +} > + > +libltp_spatch_fix() { > + spatch --dir lib \ > + --ignore lib/parse_opts.c \ > + --ignore lib/newlib_tests \ > + --ignore lib/tests \ > + --use-gitgrep \ > + --in-place \ > + -D fix \ > + --include-headers \ > + $* > +} > + > +echo You should uncomment one of the scripts below! > +#libltp_spatch_report --sp-file scripts/coccinelle/libltp-test-macro.cocci > +#libltp_spatch_report --sp-file scripts/coccinelle/libltp-test-macro-vars.cocci \ > +# --ignore lib/tst_test.c Maybe have getopts to specify what needs to be running would prevent a need to modify versioned file. Kind regards, Petr ^ permalink raw reply [flat|nested] 4+ messages in thread
* [LTP] [PATCH v2 1/2] Add Coccinelle helper scripts for reference 2021-06-09 8:48 ` [LTP] [PATCH v2 1/2] Add Coccinelle helper scripts for reference Petr Vorel @ 2021-06-09 10:28 ` Richard Palethorpe 0 siblings, 0 replies; 4+ messages in thread From: Richard Palethorpe @ 2021-06-09 10:28 UTC (permalink / raw) To: ltp Petr Vorel <pvorel@suse.cz> writes: > Hi Richie, > >> Check-in a couple of scripts used for removing the TEST macro from the >> library. Also a shell script to show how to run them. These are only >> intended to help someone develop their own refactoring scripts. Not >> for running automatically. > Nice, LGTM, with two notes bellow. > >> +++ b/scripts/coccinelle/run-spatch.sh >> @@ -0,0 +1,39 @@ >> +#!/bin/sh -eu >> +# SPDX-License-Identifier: GPL-2.0-or-later >> +# Copyright (c) 2021 SUSE LLC <rpalethorpe@suse.com> >> + >> +# Helper for running spatch Coccinelle scripts on the LTP source tree >> + >> +if [[ ! -d lib || ! -d scripts/coccinelle ]]; then > [[ ... ]] is bashism. It should be > if [ ! -d lib ] || [ ! -d scripts/coccinelle ]; then +1 > > or > >> + echo "$0: Can't find lib or scripts directories. Run me from top src dir" >> + exit 1 >> +fi >> + >> +# Run a script on the lib dir >> +libltp_spatch_report() { >> + spatch --dir lib \ >> + --ignore lib/parse_opts.c \ >> + --ignore lib/newlib_tests \ >> + --ignore lib/tests \ >> + --use-gitgrep \ >> + -D report \ >> + --include-headers \ >> + $* >> +} >> + >> +libltp_spatch_fix() { >> + spatch --dir lib \ >> + --ignore lib/parse_opts.c \ >> + --ignore lib/newlib_tests \ >> + --ignore lib/tests \ >> + --use-gitgrep \ >> + --in-place \ >> + -D fix \ >> + --include-headers \ >> + $* >> +} >> + >> +echo You should uncomment one of the scripts below! >> +#libltp_spatch_report --sp-file scripts/coccinelle/libltp-test-macro.cocci >> +#libltp_spatch_report --sp-file scripts/coccinelle/libltp-test-macro-vars.cocci \ >> +# --ignore lib/tst_test.c > Maybe have getopts to specify what needs to be running would prevent a need to > modify versioned file. +1 > > Kind regards, > Petr -- Thank you, Richard. ^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2021-06-09 10:28 UTC | newest] Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed) -- links below jump to the message on this page -- 2021-06-07 14:14 [LTP] [PATCH v2 1/2] Add Coccinelle helper scripts for reference Richard Palethorpe 2021-06-07 14:14 ` [LTP] [PATCH v2 2/2] API: Remove TEST macro usage from library Richard Palethorpe 2021-06-09 8:48 ` [LTP] [PATCH v2 1/2] Add Coccinelle helper scripts for reference Petr Vorel 2021-06-09 10:28 ` Richard Palethorpe
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.