From: "Ævar Arnfjörð Bjarmason" <avarab@gmail.com>
To: git@vger.kernel.org
Cc: "Junio C Hamano" <gitster@pobox.com>,
"Anthony Sottile" <asottile@umich.edu>,
"Emily Shaffer" <emilyshaffer@google.com>,
"Phillip Wood" <phillip.wood123@gmail.com>,
"Johannes Schindelin" <Johannes.Schindelin@gmx.de>,
"Ævar Arnfjörð Bjarmason" <avarab@gmail.com>
Subject: [PATCH v4 0/2] hook API: connect hooks to the TTY again, fixes a v2.36.0 regression
Date: Tue, 31 May 2022 19:32:57 +0200 [thread overview]
Message-ID: <cover-v4-0.2-00000000000-20220531T173005Z-avarab@gmail.com> (raw)
In-Reply-To: <cover-v3-0.2-00000000000-20220527T090618Z-avarab@gmail.com>
A re-roll of [1] fixing issues pointed out by Junio in the last re-roll:
* A minor whitespace parameter fix.
* Clear up confusion about GIT_CP_WAIT_CLEANUP, and remove the
duplicate "mark ungroup children as GIT_CP_WAIT_CLEANUP" code.
* Droped a conditional strbuf_write() on an always-empty string under
"ungroup".
* Correct "err" parameter name to "out" in the new API docs.
* Replace assert() with BUG().
* Address other minor issues noted by Junio.
Ævar Arnfjörð Bjarmason (2):
run-command: add an "ungroup" option to run_process_parallel()
hook API: fix v2.36.0 regression: hooks should be connected to a TTY
hook.c | 1 +
run-command.c | 83 +++++++++++++++++++++++++++++--------
run-command.h | 30 ++++++++++----
t/helper/test-run-command.c | 19 +++++++--
t/t0061-run-command.sh | 35 ++++++++++++++++
t/t1800-hook.sh | 37 +++++++++++++++++
6 files changed, 177 insertions(+), 28 deletions(-)
Range-diff against v3:
1: aabd99de680 ! 1: f1170b02553 run-command: add an "ungroup" option to run_process_parallel()
@@ Commit message
Signed-off-by: Ævar Arnfjörð Bjarmason <avarab@gmail.com>
## run-command.c ##
-@@ run-command.c: int pipe_command(struct child_process *cmd,
- enum child_state {
- GIT_CP_FREE,
- GIT_CP_WORKING,
-- GIT_CP_WAIT_CLEANUP,
-+ GIT_CP_WAIT_CLEANUP, /* only for !ungroup */
+@@ run-command.c: enum child_state {
+ GIT_CP_WAIT_CLEANUP,
};
+int run_processes_parallel_ungroup;
@@ run-command.c: static void pp_init(struct parallel_processes *pp,
start_failure_fn start_failure,
task_finished_fn task_finished,
- void *data)
-+ void *data, const int ungroup)
++ void *data, const int ungroup)
{
int i;
@@ run-command.c: static void pp_init(struct parallel_processes *pp,
pp->pfd[i].events = POLLIN | POLLHUP;
pp->pfd[i].fd = -1;
}
-@@ run-command.c: static void pp_cleanup(struct parallel_processes *pp)
- * When get_next_task added messages to the buffer in its last
- * iteration, the buffered output is non empty.
- */
-- strbuf_write(&pp->buffered_output, stderr);
-+ if (!pp->ungroup)
-+ strbuf_write(&pp->buffered_output, stderr);
- strbuf_release(&pp->buffered_output);
-
- sigchain_pop_common();
@@ run-command.c: static void pp_cleanup(struct parallel_processes *pp)
*/
static int pp_start_one(struct parallel_processes *pp)
@@ run-command.c: static int pp_start_one(struct parallel_processes *pp)
return 0;
}
-+static void pp_mark_working_for_cleanup(struct parallel_processes *pp)
++static void pp_mark_ungrouped_for_cleanup(struct parallel_processes *pp)
+{
+ int i;
+
++ if (!pp->ungroup)
++ BUG("only reachable if 'ungrouped'");
++
+ for (i = 0; i < pp->max_processes; i++)
-+ if (pp->children[i].state == GIT_CP_WORKING)
-+ pp->children[i].state = GIT_CP_WAIT_CLEANUP;
++ pp->children[i].state = GIT_CP_WAIT_CLEANUP;
+}
+
static void pp_buffer_stderr(struct parallel_processes *pp, int output_timeout)
{
int i;
-+ assert(!pp->ungroup);
++ if (pp->ungroup)
++ BUG("unreachable with 'ungrouped'");
+
while ((i = poll(pp->pfd, pp->max_processes, output_timeout)) < 0) {
if (errno == EINTR)
@@ run-command.c: static void pp_buffer_stderr(struct parallel_processes *pp, int o
{
int i = pp->output_owner;
+
-+ assert(!pp->ungroup);
++ if (pp->ungroup)
++ BUG("unreachable with 'ungrouped'");
+
if (pp->children[i].state == GIT_CP_WORKING &&
pp->children[i].err.len) {
@@ run-command.c: static void pp_output(struct parallel_processes *pp)
int i, code;
int n = pp->max_processes;
int result = 0;
-
-+ if (ungroup)
-+ for (i = 0; i < pp->max_processes; i++)
-+ pp->children[i].state = GIT_CP_WAIT_CLEANUP;
-+
- while (pp->nr_processes > 0) {
- for (i = 0; i < pp->max_processes; i++)
- if (pp->children[i].state == GIT_CP_WAIT_CLEANUP)
@@ run-command.c: static int pp_collect_finished(struct parallel_processes *pp)
code = finish_command(&pp->children[i].process);
@@ run-command.c: int run_processes_parallel(int n,
- pp_buffer_stderr(&pp, output_timeout);
- pp_output(&pp);
+ if (ungroup) {
-+ pp_mark_working_for_cleanup(&pp);
++ pp_mark_ungrouped_for_cleanup(&pp);
+ } else {
+ pp_buffer_stderr(&pp, output_timeout);
+ pp_output(&pp);
@@ run-command.h: void check_pipe(int err);
* pp_cb is the callback cookie as passed to run_processes_parallel.
* You can store a child process specific callback cookie in pp_task_cb.
*
-+ * The "struct strbuf *err" parameter is either a pointer to a string
-+ * to write errors to, or NULL if the "ungroup" option was
-+ * provided. See run_processes_parallel() below.
++ * See run_processes_parallel() below for a discussion of the "struct
++ * strbuf *out" parameter.
+ *
* Even after returning 0 to indicate that there are no more processes,
* this function will be called again until there are no more running
@@ run-command.h: typedef int (*get_next_task_fn)(struct child_process *cp,
- * You must not write to stdout or stderr in this function. Add your
- * message to the strbuf out instead, which will be printed without
- * messing up the output of the other parallel processes.
-+ * The "struct strbuf *err" parameter is either a pointer to a string
-+ * to write errors to, or NULL if the "ungroup" option was
-+ * provided. See run_processes_parallel() below.
++ * See run_processes_parallel() below for a discussion of the "struct
++ * strbuf *out" parameter.
*
* pp_cb is the callback cookie as passed into run_processes_parallel,
* pp_task_cb is the callback cookie as passed into get_next_task_fn.
@@ run-command.h: typedef int (*start_failure_fn)(struct strbuf *out,
- * You must not write to stdout or stderr in this function. Add your
- * message to the strbuf out instead, which will be printed without
- * messing up the output of the other parallel processes.
-+ * The "struct strbuf *err" parameter is either a pointer to a string
-+ * to write errors to, or NULL if the "ungroup" option was
-+ * provided. See run_processes_parallel() below.
++ * See run_processes_parallel() below for a discussion of the "struct
++ * strbuf *out" parameter.
*
* pp_cb is the callback cookie as passed into run_processes_parallel,
* pp_task_cb is the callback cookie as passed into get_next_task_fn.
@@ run-command.h: typedef int (*task_finished_fn)(int result,
* The children started via this function run in parallel. Their output
* (both stdout and stderr) is routed to stderr in a manner that output
- * from different tasks does not interleave.
-+ * from different tasks does not interleave (but see "ungroup" above).
++ * from different tasks does not interleave (but see "ungroup" below).
*
* start_failure_fn and task_finished_fn can be NULL to omit any
* special handling.
+ *
-+ * If the "ungroup" option isn't specified the callbacks will get a
-+ * pointer to a "struct strbuf *out", and must not write to stdout or
++ * If the "ungroup" option isn't specified, the API will set the
++ * "stdout_to_stderr" parameter in "struct child_process" and provide
++ * the callbacks with a "struct strbuf *out" parameter to write output
++ * to. In this case the callbacks must not write to stdout or
+ * stderr as such output will mess up the output of the other parallel
+ * processes. If "ungroup" option is specified callbacks will get a
+ * NULL "struct strbuf *out" parameter, and are responsible for
2: ec27e3906e1 = 2: 8ab09f28729 hook API: fix v2.36.0 regression: hooks should be connected to a TTY
--
2.36.1.1103.g036c05811b0
next prev parent reply other threads:[~2022-05-31 17:35 UTC|newest]
Thread overview: 85+ messages / expand[flat|nested] mbox.gz Atom feed top
2022-04-19 18:59 git 2.36.0 regression: pre-commit hooks no longer have stdout/stderr as tty Anthony Sottile
2022-04-19 23:37 ` Emily Shaffer
2022-04-19 23:52 ` Anthony Sottile
2022-04-20 9:00 ` Phillip Wood
2022-04-20 12:25 ` Ævar Arnfjörð Bjarmason
2022-04-20 16:22 ` Emily Shaffer
2022-04-20 16:42 ` Junio C Hamano
2022-04-20 17:09 ` Emily Shaffer
2022-04-20 17:25 ` Junio C Hamano
2022-04-20 17:41 ` Emily Shaffer
2022-04-21 12:03 ` Ævar Arnfjörð Bjarmason
2022-04-21 17:24 ` Junio C Hamano
2022-04-21 18:40 ` Junio C Hamano
2022-04-20 4:23 ` Junio C Hamano
2022-04-21 12:25 ` [PATCH 0/6] hook API: connect hooks to the TTY again, fixes a v2.36.0 regression Ævar Arnfjörð Bjarmason
2022-04-21 12:25 ` [PATCH 1/6] run-command API: replace run_processes_parallel_tr2() with opts struct Ævar Arnfjörð Bjarmason
2022-04-23 4:24 ` Junio C Hamano
2022-04-28 23:16 ` Emily Shaffer
2022-04-29 16:44 ` Junio C Hamano
2022-04-21 12:25 ` [PATCH 2/6] run-command tests: test stdout of run_command_parallel() Ævar Arnfjörð Bjarmason
2022-04-23 4:24 ` Junio C Hamano
2022-04-21 12:25 ` [PATCH 3/6] run-command: add an "ungroup" option to run_process_parallel() Ævar Arnfjörð Bjarmason
2022-04-23 3:54 ` Junio C Hamano
2022-04-28 23:26 ` Emily Shaffer
2022-04-21 12:25 ` [PATCH 4/6] hook tests: fix redirection logic error in 96e7225b310 Ævar Arnfjörð Bjarmason
2022-04-23 3:54 ` Junio C Hamano
2022-04-21 12:25 ` [PATCH 5/6] hook API: don't redundantly re-set "no_stdin" and "stdout_to_stderr" Ævar Arnfjörð Bjarmason
2022-04-29 22:54 ` Junio C Hamano
2022-04-21 12:25 ` [PATCH 6/6] hook API: fix v2.36.0 regression: hooks should be connected to a TTY Ævar Arnfjörð Bjarmason
2022-04-28 23:31 ` Emily Shaffer
2022-04-29 23:09 ` Junio C Hamano
2022-04-21 17:35 ` [PATCH 0/6] hook API: connect hooks to the TTY again, fixes a v2.36.0 regression Junio C Hamano
2022-04-21 18:50 ` Ævar Arnfjörð Bjarmason
2022-05-18 20:05 ` [PATCH v2 0/8] " Ævar Arnfjörð Bjarmason
2022-05-18 20:05 ` [PATCH v2 1/8] run-command tests: change if/if/... to if/else if/else Ævar Arnfjörð Bjarmason
2022-05-18 20:05 ` [PATCH v2 2/8] run-command API: use "opts" struct for run_processes_parallel{,_tr2}() Ævar Arnfjörð Bjarmason
2022-05-18 21:45 ` Junio C Hamano
2022-05-25 13:18 ` Emily Shaffer
2022-05-18 20:05 ` [PATCH v2 3/8] run-command tests: test stdout of run_command_parallel() Ævar Arnfjörð Bjarmason
2022-05-18 20:05 ` [PATCH v2 4/8] run-command.c: add an initializer for "struct parallel_processes" Ævar Arnfjörð Bjarmason
2022-05-18 20:05 ` [PATCH v2 5/8] run-command: add an "ungroup" option to run_process_parallel() Ævar Arnfjörð Bjarmason
2022-05-18 21:51 ` Junio C Hamano
2022-05-26 17:18 ` Emily Shaffer
2022-05-27 16:08 ` Junio C Hamano
2022-05-18 20:05 ` [PATCH v2 6/8] hook tests: fix redirection logic error in 96e7225b310 Ævar Arnfjörð Bjarmason
2022-05-18 20:05 ` [PATCH v2 7/8] hook API: don't redundantly re-set "no_stdin" and "stdout_to_stderr" Ævar Arnfjörð Bjarmason
2022-05-18 20:05 ` [PATCH v2 8/8] hook API: fix v2.36.0 regression: hooks should be connected to a TTY Ævar Arnfjörð Bjarmason
2022-05-18 21:53 ` Junio C Hamano
2022-05-26 17:23 ` Emily Shaffer
2022-05-26 18:23 ` Ævar Arnfjörð Bjarmason
2022-05-26 18:54 ` Emily Shaffer
2022-05-25 11:30 ` [PATCH v2 0/8] hook API: connect hooks to the TTY again, fixes a v2.36.0 regression Johannes Schindelin
2022-05-25 13:00 ` Ævar Arnfjörð Bjarmason
2022-05-25 16:57 ` Junio C Hamano
2022-05-26 1:10 ` Junio C Hamano
2022-05-26 10:16 ` Ævar Arnfjörð Bjarmason
2022-05-26 16:36 ` Junio C Hamano
2022-05-26 19:13 ` Ævar Arnfjörð Bjarmason
2022-05-26 19:56 ` Junio C Hamano
2022-05-27 9:14 ` [PATCH v3 0/2] " Ævar Arnfjörð Bjarmason
2022-05-27 9:14 ` [PATCH v3 1/2] run-command: add an "ungroup" option to run_process_parallel() Ævar Arnfjörð Bjarmason
2022-05-27 16:58 ` Junio C Hamano
2022-05-27 9:14 ` [PATCH v3 2/2] hook API: fix v2.36.0 regression: hooks should be connected to a TTY Ævar Arnfjörð Bjarmason
2022-05-27 17:17 ` [PATCH v3 0/2] hook API: connect hooks to the TTY again, fixes a v2.36.0 regression Junio C Hamano
2022-05-31 17:32 ` Ævar Arnfjörð Bjarmason [this message]
2022-05-31 17:32 ` [PATCH v4 1/2] run-command: add an "ungroup" option to run_process_parallel() Ævar Arnfjörð Bjarmason
2022-06-01 16:49 ` Johannes Schindelin
2022-06-01 17:09 ` Junio C Hamano
2022-05-31 17:32 ` [PATCH v4 2/2] hook API: fix v2.36.0 regression: hooks should be connected to a TTY Ævar Arnfjörð Bjarmason
2022-06-01 16:50 ` Johannes Schindelin
2022-06-01 16:53 ` [PATCH v4 0/2] hook API: connect hooks to the TTY again, fixes a v2.36.0 regression Johannes Schindelin
2022-06-02 14:07 ` [PATCH v5 " Ævar Arnfjörð Bjarmason
2022-06-02 14:07 ` [PATCH v5 1/2] run-command: add an "ungroup" option to run_process_parallel() Ævar Arnfjörð Bjarmason
2022-06-02 14:07 ` [PATCH v5 2/2] hook API: fix v2.36.0 regression: hooks should be connected to a TTY Ævar Arnfjörð Bjarmason
2022-06-02 20:05 ` [PATCH v5 0/2] hook API: connect hooks to the TTY again, fixes a v2.36.0 regression Junio C Hamano
2022-06-03 8:51 ` Phillip Wood
2022-06-03 9:20 ` Ævar Arnfjörð Bjarmason
2022-06-03 13:21 ` Phillip Wood
2022-06-07 8:49 ` Ævar Arnfjörð Bjarmason
2022-06-07 8:48 ` [PATCH v6 " Ævar Arnfjörð Bjarmason
2022-06-07 8:48 ` [PATCH v6 1/2] run-command: add an "ungroup" option to run_process_parallel() Ævar Arnfjörð Bjarmason
2022-06-17 0:07 ` Emily Shaffer
2022-06-07 8:48 ` [PATCH v6 2/2] hook API: fix v2.36.0 regression: hooks should be connected to a TTY Ævar Arnfjörð Bjarmason
2022-06-07 17:08 ` Junio C Hamano
2022-06-07 17:02 ` [PATCH v6 0/2] hook API: connect hooks to the TTY again, fixes a v2.36.0 regression Junio C Hamano
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=cover-v4-0.2-00000000000-20220531T173005Z-avarab@gmail.com \
--to=avarab@gmail.com \
--cc=Johannes.Schindelin@gmx.de \
--cc=asottile@umich.edu \
--cc=emilyshaffer@google.com \
--cc=git@vger.kernel.org \
--cc=gitster@pobox.com \
--cc=phillip.wood123@gmail.com \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).