linux-kernel.vger.kernel.org archive mirror
 help / color / mirror / Atom feed
* [BUG] kernel freeze, rcu_sched self-detected stall on CPU
@ 2016-12-17 22:25 Johanna Abrahamsson
  2016-12-18 16:32 ` Davidlohr Bueso
  0 siblings, 1 reply; 3+ messages in thread
From: Johanna Abrahamsson @ 2016-12-17 22:25 UTC (permalink / raw)
  To: Andrew Morton, Davidlohr Bueso; +Cc: linux-kernel

A bug has been introduced in ipc/sem.c by a patch '[PATCH -next 2/2] ipc/sem: avoid idr tree lookup for interrupted semop' (https://marc.info/?l=linux-kernel&m=147870885903619, commit 370b262c896e5565b271a3ea3abee4d0914ba443).
The bug results in a kernel freeze and several "INFO: rcu_sched self-detected stall on CPU". The system becomes unresponsible and has to be rebooted to work again as far as I can tell.
My repro case is, hilariously enough, packaging the linux kernel for debian with `make -j8 deb-pkg`. I'm sure a smaller repro case could be constructed, but so far I've had 100% reproducibility from this one. The freeze always occurs at the Makefiles.headerinst part of packaging, after the kernel is built.
The bug is present in next-20161124 and linux-next versions going forward from that and has now been merged to linus/master. However, in linus/master it doesn't trigger a bug. This seems to indicate that it only triggers a bug in combination with a commit that is present in next-20161216 but not present in linus/master.
I've confirmed that doing `git revert 370b262c896e5565b271a3ea3abee4d0914ba443` on next-20161216 fixes the bug.

In all repro cases I've tested on virtual machines with multiple cpu cores running under either Xen or Virtualbox.

I will try to investigate this further but as I have limited knowledge of RCU and how the kernel works with semaphores don't expect any miracles :)

Best Regards,
Johanna Abrahamsson

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: [BUG] kernel freeze, rcu_sched self-detected stall on CPU
  2016-12-17 22:25 [BUG] kernel freeze, rcu_sched self-detected stall on CPU Johanna Abrahamsson
@ 2016-12-18 16:32 ` Davidlohr Bueso
  2016-12-19  9:06   ` Johanna Abrahamsson
  0 siblings, 1 reply; 3+ messages in thread
From: Davidlohr Bueso @ 2016-12-18 16:32 UTC (permalink / raw)
  To: Johanna Abrahamsson; +Cc: Andrew Morton, linux-kernel

On Sat, 17 Dec 2016, Johanna Abrahamsson wrote:

>I will try to investigate this further but as I have limited knowledge of RCU and how the kernel works with semaphores don't expect any miracles :)

Please see if this helps: https://lkml.org/lkml/2016/12/18/79

Thanks,
Davidlohr

^ permalink raw reply	[flat|nested] 3+ messages in thread

* Re: [BUG] kernel freeze, rcu_sched self-detected stall on CPU
  2016-12-18 16:32 ` Davidlohr Bueso
@ 2016-12-19  9:06   ` Johanna Abrahamsson
  0 siblings, 0 replies; 3+ messages in thread
From: Johanna Abrahamsson @ 2016-12-19  9:06 UTC (permalink / raw)
  To: Davidlohr Bueso; +Cc: Andrew Morton, linux-kernel

On Sun, Dec 18, 2016 at 08:32:23AM -0800, Davidlohr Bueso wrote:
> Please see if this helps: https://lkml.org/lkml/2016/12/18/79

That does help, thank you! I would never have fixed this myself in reasonable time :)


Best Regards,
Johanna Abrahamsson

^ permalink raw reply	[flat|nested] 3+ messages in thread

end of thread, other threads:[~2016-12-19  9:06 UTC | newest]

Thread overview: 3+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2016-12-17 22:25 [BUG] kernel freeze, rcu_sched self-detected stall on CPU Johanna Abrahamsson
2016-12-18 16:32 ` Davidlohr Bueso
2016-12-19  9:06   ` Johanna Abrahamsson

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).