linux-rt-users.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
From: Sebastian Andrzej Siewior <bigeasy@linutronix.de>
To: Davidlohr Bueso <dave@stgolabs.net>
Cc: linux-rt-users@vger.kernel.org, tglx@linutronix.de
Subject: Re: rcu stalls with pi_stress in latest rt
Date: Mon, 4 Nov 2019 16:29:31 +0100	[thread overview]
Message-ID: <20191104152931.dzdhn3wwilohlttc@linutronix.de> (raw)
In-Reply-To: <20191028182258.76o6qnbgmzm525ff@linux-p48b>

On 2019-10-28 11:22:58 [-0700], Davidlohr Bueso wrote:
> Hi,
Hi,

> I've been running into rcu self-stalls as soon as I start running
> the pi_stress program on a v5.2.21-rt13 kernel - I've seen it on
> older rt 5.2 versions as well so it's not specific to 954ad80c23e
> (futex: Make the futex_hash_bucket spinlock_t again and bring back
> its old state), for example.
> 
> No other workload is running on the machine. The workload does not
> crash, but incurs in very long response times.
> 
> I'm attaching two different splats I'm seeing for the futex wait
> and wake paths. Does this ring any bells?

On 8-CPU system here I have:
|Starting PI Stress Test
|Number of thread groups: 7
|Duration of test run: infinite
|Number of inversions per group: unlimited
|     Admin thread SCHED_FIFO priority 4
|7 groups of 3 threads will be created
|      High thread SCHED_FIFO priority 3
|       Med thread SCHED_FIFO priority 2
|       Low thread SCHED_FIFO priority 1
|Current Inversions: 199678139

without any RCU-stalls. The system is slow but then the test kind of
asked for it… I see *only* the workqueue stalls which is hardly any news
since the system is busy on almost every CPU with RT tasks and the
workqueue is not of RT prio so, yes.
That means you might not have RCU-boost enabled.

CPU0 goes sometimes idle and hardly has any RT-task. CPU1-7 almost never
see idle and are busy scheduling/running RT-tasks.

> Thanks,
> Davidlohr

Sebastian

  reply	other threads:[~2019-11-04 15:29 UTC|newest]

Thread overview: 3+ messages / expand[flat|nested]  mbox.gz  Atom feed  top
2019-10-28 18:22 rcu stalls with pi_stress in latest rt Davidlohr Bueso
2019-11-04 15:29 ` Sebastian Andrzej Siewior [this message]
2019-11-07 18:53   ` Davidlohr Bueso

Reply instructions:

You may reply publicly to this message via plain-text email
using any one of the following methods:

* Save the following mbox file, import it into your mail client,
  and reply-to-all from there: mbox

  Avoid top-posting and favor interleaved quoting:
  https://en.wikipedia.org/wiki/Posting_style#Interleaved_style

* Reply using the --to, --cc, and --in-reply-to
  switches of git-send-email(1):

  git send-email \
    --in-reply-to=20191104152931.dzdhn3wwilohlttc@linutronix.de \
    --to=bigeasy@linutronix.de \
    --cc=dave@stgolabs.net \
    --cc=linux-rt-users@vger.kernel.org \
    --cc=tglx@linutronix.de \
    /path/to/YOUR_REPLY

  https://kernel.org/pub/software/scm/git/docs/git-send-email.html

* If your mail client supports setting the In-Reply-To header
  via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line before the message body. 
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).