All of lore.kernel.org
 help / color / mirror / Atom feed
From: "Paul Barker" <pbarker@konsulko.com>
To: Richard Purdie <richard.purdie@linuxfoundation.org>
Cc: bitbake-devel@lists.openembedded.org,
	Joshua Watt <JPEWhacker@gmail.com>,
	 swat <swat@lists.yoctoproject.org>
Subject: Re: [PATCH 0/4] Re-implement prserv on top of asyncrpc
Date: Mon, 31 May 2021 15:45:49 +0100	[thread overview]
Message-ID: <CAM9ZRVuYgsQXPSYRR8ZJYQJsPKGpQGU8P2O_VMcFK6q=rdt8NA@mail.gmail.com> (raw)
In-Reply-To: <b258e09be64468dcdf685cb9f7f26a011cb7f2af.camel@linuxfoundation.org>

On Mon, 31 May 2021 at 12:25, Richard Purdie
<richard.purdie@linuxfoundation.org> wrote:
>
> Hi Paul,
>
> On Fri, 2021-05-28 at 09:42 +0100, Paul Barker wrote:
> > These changes replace the old XML-based RPC system in prserv with the
> > new asyncrpc implementation originally used by hashserv. A couple of
> > improvments are required in asyncrpc to support this.
> >
> > I finally stumbled across the issue which led to the hanging builds
> > seen on the autobuilder when testing the initial RFC series.
> > It was a fairly dumb mistake on my behalf and I'm not sure how it
> > didn't trigger in my initial testing! The
> > `PRServerClient.handle_export()` function was missing a call to
> > `self.write_message()` so the client just ended up stuck waiting for a
> > response that was never to come. This issue is fixed here.
> >
> > I've ran these changes through both `bitbake-selftest` and
> > `oe-selftest -a` and all looks good on my end. A couple of failures
> > were seen in oe-selftest but these are related to my host system
> > configuration (socat not installed, firewall blocking ports, etc) so
> > I'm fairly confident they aren't caused by this patch series.
>
> Thanks for these. Unfortunately I think there is still a gremlin somewhere
> as this was included in an autobuilder test build that is showing as this:
>
> https://autobuilder.yoctoproject.org/typhoon/#/builders/83/builds/2203
>
> i.e. all four selftests have not finished and I'd have expected them to
> by now.

(╯°□°)╯︵ ┻━┻

>
> I'm trying not to work today so I haven't debugged them or confirmed where
> they are hanging but it seems likely related.

If you're planning to take the day off don't worry about investigating
these. I'll take a look at the patches again on Wednesday. I think the
best approach may be to add some timeouts and maybe more error
handling to the asyncrpc code I extracted from hashserv - if we can
turn these hangs into a proper error then we can reduce the amount of
autobuilder time they take to test and hopefully we'll get a better
insight into what is actually going wrong. My guess is that there's
something in the autobuilder config or just the level of load on the
machines which is aggravating this as the tests finish successfully on
my build machine (with a few expected test failures as noted
previously).

Thanks,

-- 
Paul Barker
Konsulko Group

      reply	other threads:[~2021-05-31 14:46 UTC|newest]

Thread overview: 9+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2021-05-28  8:42 [PATCH 0/4] Re-implement prserv on top of asyncrpc Paul Barker
2021-05-28  8:42 ` [PATCH 1/4] asyncrpc: Add ping method Paul Barker
2021-05-28  8:42 ` [PATCH 2/4] asyncrpc: Avoid duplicate sockets in TCP server Paul Barker
2021-06-02 14:38   ` Joshua Watt
2021-06-07 13:51     ` Paul Barker
2021-05-28  8:42 ` [PATCH 3/4] asyncrpc: Reduce verbosity Paul Barker
2021-05-28  8:42 ` [PATCH 4/4] prserv: Replace XML RPC with modern asyncrpc implementation Paul Barker
2021-05-31 11:25 ` [PATCH 0/4] Re-implement prserv on top of asyncrpc Richard Purdie
2021-05-31 14:45   ` Paul Barker [this message]

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to='CAM9ZRVuYgsQXPSYRR8ZJYQJsPKGpQGU8P2O_VMcFK6q=rdt8NA@mail.gmail.com' \
    --to=pbarker@konsulko.com \
    --cc=JPEWhacker@gmail.com \
    --cc=bitbake-devel@lists.openembedded.org \
    --cc=richard.purdie@linuxfoundation.org \
    --cc=swat@lists.yoctoproject.org \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body.
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.