git.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Jeff King <peff@peff.net>
To: "René Scharfe" <l.s.r@web.de>
Cc: Junio C Hamano <gitster@pobox.com>,
	git@vger.kernel.org,
	Johannes Schindelin <Johannes.Schindelin@gmx.de>
Subject: Re: [PATCH v2] pipe_command(): mark stdin descriptor as non-blocking
Date: Fri, 5 Aug 2022 11:36:58 -0400	[thread overview]
Message-ID: <Yu05GjncDaGRTgce@coredump.intra.peff.net> (raw)
In-Reply-To: <41477326-5493-4d3c-246d-8a28969fa73e@web.de>

On Wed, Aug 03, 2022 at 11:56:13PM +0200, René Scharfe wrote:

> Without that line the added test hangs for me on the Git for Windows
> SDK on Windows 11.

Hmph. Interesting that it passes in CI, but not on your local setup.
I wonder why pipes would behave differently. Or perhaps there is even
some configuration different that means we are still running the perl
add--interactive there, though I kind of doubt it (and couldn't find
anything pointing there).

Still, if it fails in at least one spot, it's something we need to deal
with. On the plus side, once we figure out how to fix it, the
hand-grenade of "enable_nonblock() does nothing on Windows" will not be
present anymore. ;)

> With the patch below it fails and reports basically nothing:
> [...]
>    not ok 57 - handle very large filtered diff
>    #
>    #               git reset --hard &&
>    #               # The specific number here is not important, but it must
>    #               # be large enough that the output of "git diff --color"
>    #               # fills up the pipe buffer. 10,000 results in ~200k of
>    #               # colored output.
>    #               test_seq 10000 >test &&
>    #               test_config interactive.diffFilter cat &&
>    #               printf y >y &&
>    #               force_color git add -p >output 2>&1 <y &&
>    #               git diff-files --exit-code -- test
>    #
>    1..57
> 
> The file "output" contains "error: failed to run 'cat'".  This is
> add-patch.c::parse_diff() reporting that pipe_command() failed.  So
> that's not it, yet.  (I don't actually know what I'm doing here.)

That implies that your call to enable_nonblock() succeeded, or
pipe_command() itself would have complained, too. Maybe instrument
it like this:

diff --git a/run-command.c b/run-command.c
index 8ea609d4ae..27e79c928a 100644
--- a/run-command.c
+++ b/run-command.c
@@ -1473,11 +1473,17 @@ int pipe_command(struct child_process *cmd,
 	}
 
 	if (pump_io(io, nr) < 0) {
+		error_errno("pumping io failed");
 		finish_command(cmd); /* throw away exit code */
 		return -1;
 	}
 
-	return finish_command(cmd);
+	{
+		int ret = finish_command(cmd);
+		if (ret)
+			error("child returned failure %d", ret);
+		return ret;
+	}
 }
 
 enum child_state {

Normally we stay pretty quiet there and let the caller report any
problems, but it lacks enough context to make a more specific error
report.

>  int enable_nonblock(int fd)
>  {
> +	DWORD mode;
> +	HANDLE handle = winansi_get_osfhandle(fd);
> +	if (!handle)
> +		return -1;
> +	if (!GetNamedPipeHandleState(handle, &mode, NULL, NULL, NULL, NULL, 0))
> +		return -1;
> +	if (mode & PIPE_NOWAIT)
> +		return 0;
> +	mode |= PIPE_NOWAIT;
> +	if (!SetNamedPipeHandleState(handle, &mode, NULL, NULL))
> +		return -1;
>  	return 0;
>  }

This looks plausibly correct to me. ;) We might want to change the name
of the compat layer to enable_pipe_nonblock(), since one assumes from
the function names this only works for pipes.

Thanks for poking at this.

-Peff

  reply	other threads:[~2022-08-05 15:37 UTC|newest]

Thread overview: 44+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2022-08-02  4:13 [RFC/PATCH] pipe_command(): mark stdin descriptor as non-blocking Jeff King
2022-08-02 15:04 ` Junio C Hamano
2022-08-02 15:39 ` Jeff King
2022-08-02 16:16   ` Junio C Hamano
2022-08-03  3:53     ` [PATCH v2] " Jeff King
2022-08-03 16:45       ` René Scharfe
2022-08-03 17:20         ` Jeff King
2022-08-03 21:56           ` René Scharfe
2022-08-05 15:36             ` Jeff King [this message]
2022-08-05 21:13               ` René Scharfe
2022-08-07 10:15                 ` René Scharfe
2022-08-07 17:41                   ` Jeff King
2022-08-10  5:39                     ` René Scharfe
2022-08-10 19:53                       ` Jeff King
2022-08-10 22:35                         ` René Scharfe
2022-08-11  8:52                           ` Jeff King
2022-08-10  5:39                     ` [PATCH] mingw: handle writes to non-blocking pipe René Scharfe
2022-08-10  9:07                       ` Johannes Schindelin
2022-08-10 20:02                       ` Jeff King
2022-08-10 22:34                         ` René Scharfe
2022-08-11  8:47                           ` Jeff King
2022-08-11 17:35                             ` René Scharfe
2022-08-11 18:20                               ` Jeff King
2022-08-14 15:37                                 ` René Scharfe
2022-08-17  5:39                                   ` Jeff King
2022-08-17  6:04                                     ` [PATCH v2 0/6] fix pipe_command() deadlock Jeff King
2022-08-17  6:04                                       ` [PATCH v2 1/6] compat: add function to enable nonblocking pipes Jeff King
2022-08-17 20:23                                         ` Junio C Hamano
2022-08-18  5:41                                           ` Jeff King
2022-08-17  6:05                                       ` [PATCH v2 2/6] nonblock: support Windows Jeff King
2022-08-17  6:06                                       ` [PATCH v2 3/6] git-compat-util: make MAX_IO_SIZE define globally available Jeff King
2022-08-17  6:08                                       ` [PATCH v2 4/6] pipe_command(): avoid xwrite() for writing to pipe Jeff King
2022-08-17  6:09                                       ` [PATCH v2 5/6] pipe_command(): handle ENOSPC when writing to a pipe Jeff King
2022-08-17 18:57                                         ` Junio C Hamano
2022-08-18  5:38                                           ` Jeff King
2022-08-17  6:10                                       ` [PATCH v2 6/6] pipe_command(): mark stdin descriptor as non-blocking Jeff King
2022-08-17  6:20                                       ` [PATCH v2 0/6] fix pipe_command() deadlock Jeff King
2022-08-19 21:19                                       ` René Scharfe
2022-08-20  7:04                                         ` Jeff King
2022-08-07 10:14               ` [PATCH v2] pipe_command(): mark stdin descriptor as non-blocking René Scharfe
2022-08-08 12:55                 ` Johannes Schindelin
2022-08-08 12:59       ` Johannes Schindelin
2022-08-09 13:04         ` Jeff King
2022-08-09 22:10           ` Johannes Schindelin

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=Yu05GjncDaGRTgce@coredump.intra.peff.net \
    --to=peff@peff.net \
    --cc=Johannes.Schindelin@gmx.de \
    --cc=git@vger.kernel.org \
    --cc=gitster@pobox.com \
    --cc=l.s.r@web.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).