[Bug 195755] rcu_sched detected stalls on CPUs/tasks: (detected by 0, t=6302 jiffies, g=11405, c=11404, q=1880), ppc64, G5

linuxppc-dev.lists.ozlabs.org archive mirror
 help / color / mirror / Atom feed

* [Bug 195755] rcu_sched detected stalls on CPUs/tasks: (detected by 0, t=6302 jiffies, g=11405, c=11404, q=1880), ppc64, G5
       [not found] <bug-195755-206035@https.bugzilla.kernel.org/>
@ 2019-09-23  0:07 ` bugzilla-daemon
  2019-09-30  9:35 ` bugzilla-daemon
                   ` (4 subsequent siblings)
  5 siblings, 0 replies; 6+ messages in thread
From: bugzilla-daemon @ 2019-09-23  0:07 UTC (permalink / raw)
  To: linuxppc-dev

https://bugzilla.kernel.org/show_bug.cgi?id=195755

Erhard F. (erhard_f@mailbox.org) changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|NEEDINFO                    |CLOSED
         Resolution|---                         |OBSOLETE

--- Comment #26 from Erhard F. (erhard_f@mailbox.org) ---
Have not seen this again on the G5 7,2 since kernel 5.2.x, nor 5.3.x.

Will close the bug for now and hopefully it does not return. ;)

-- 
You are receiving this mail because:
You are watching the assignee of the bug.

^ permalink raw reply	[flat|nested] 6+ messages in thread

* [Bug 195755] rcu_sched detected stalls on CPUs/tasks: (detected by 0, t=6302 jiffies, g=11405, c=11404, q=1880), ppc64, G5
       [not found] <bug-195755-206035@https.bugzilla.kernel.org/>
  2019-09-23  0:07 ` [Bug 195755] rcu_sched detected stalls on CPUs/tasks: (detected by 0, t=6302 jiffies, g=11405, c=11404, q=1880), ppc64, G5 bugzilla-daemon
@ 2019-09-30  9:35 ` bugzilla-daemon
  2019-09-30 10:50 ` bugzilla-daemon
                   ` (3 subsequent siblings)
  5 siblings, 0 replies; 6+ messages in thread
From: bugzilla-daemon @ 2019-09-30  9:35 UTC (permalink / raw)
  To: linuxppc-dev

https://bugzilla.kernel.org/show_bug.cgi?id=195755

Martin Zaharinov (micron10@gmail.com) changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |micron10@gmail.com

--- Comment #27 from Martin Zaharinov (micron10@gmail.com) ---
I see this bug is back in kernel 5.3.x 

Sep 28 15:40:01  [  611.520537][    C0] rcu: INFO: rcu_sched self-detected
stall on CPU
Sep 28 15:40:01  [  611.520992][    C0] rcu:    0-...!: (5998 ticks this GP)
idle=ace/1/0x4000000000000004 softirq=46973/46973 fqs=73
Sep 28 15:40:01  [  611.521721][    C0]         (t=6000 jiffies g=83505 q=2615)
Sep 28 15:40:01  [  611.522076][    C0] rcu: rcu_sched kthread starved for 5853
jiffies! g83505 f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=1
Sep 28 15:40:01  [  611.522858][    C0] rcu: RCU grace-period kthread stack
dump:
Sep 28 15:40:01  [  611.523269][    C0] rcu_sched       I    0    10      2
0x80004000
Sep 28 15:40:01  [  611.523710][    C0] Call Trace:
Sep 28 15:40:01  [  611.523938][    C0]  ? __schedule+0x1db/0x5d0
Sep 28 15:40:01  [  611.524251][    C0]  schedule+0x34/0xa0
Sep 28 15:40:01  [  611.524525][    C0]  schedule_timeout+0x1f7/0x3e0
Sep 28 15:40:01  [  611.524861][    C0]  ? collect_expired_timers+0x270/0x270
Sep 28 15:40:01  [  611.525248][    C0]  rcu_gp_kthread+0x49f/0xea0
Sep 28 15:40:01  [  611.525572][    C0]  kthread+0x11a/0x150
Sep 28 15:40:01  [  611.525851][    C0]  ? rcu_report_qs_rnp+0x160/0x160
Sep 28 15:40:01  [  611.534554][    C0]  ? kthread_park+0x70/0x70
Sep 28 15:40:01  [  611.543250][    C0]  ret_from_fork+0x1f/0x30
Sep 28 15:40:01  [  611.551953][    C0] NMI backtrace for cpu 0
Sep 28 15:40:01  [  611.560402][    C0] CPU: 0 PID: 10870 Comm: ifmgr Tainted:
G           O      5.3.1 #1
Sep 28 15:40:01  [  611.576928][    C0] Hardware name: HP ProLiant ML110 G7,
BIOS J01 08/10/2012
Sep 28 15:40:01  [  611.585641][    C0] Call Trace:
Sep 28 15:40:01  [  611.594279][    C0]  <IRQ>
Sep 28 15:40:01  [  611.602783][    C0]  dump_stack+0x47/0x5a
Sep 28 15:40:01  [  611.611375][    C0]  nmi_cpu_backtrace.cold+0x14/0x53
Sep 28 15:40:01  [  611.620076][    C0]  ? lapic_can_unplug_cpu.cold+0x37/0x37
Sep 28 15:40:01  [  611.628588][    C0] 
nmi_trigger_cpumask_backtrace+0xef/0xf1
Sep 28 15:40:01  [  611.637040][    C0]  rcu_dump_cpu_stacks+0x8d/0xbb
Sep 28 15:40:01  [  611.645425][    C0]  rcu_sched_clock_irq.cold+0x1b1/0x3a6
Sep 28 15:40:01  [  611.653707][    C0]  update_process_times+0x5b/0x90
Sep 28 15:40:01  [  611.661857][    C0]  tick_sched_timer+0x65/0x100
Sep 28 15:40:01  [  611.669733][    C0]  ? get_cpu_iowait_time_us+0x100/0x100
Sep 28 15:40:01  [  611.677571][    C0]  __hrtimer_run_queues+0x105/0x1b0
Sep 28 15:40:01  [  611.685267][    C0]  hrtimer_interrupt+0x10b/0x3d0
Sep 28 15:40:01  [  611.692709][    C0]  smp_apic_timer_interrupt+0x50/0x80
Sep 28 15:40:01  [  611.700044][    C0]  apic_timer_interrupt+0xf/0x20
Sep 28 15:40:01  [  611.707293][    C0] RIP:
0010:native_queued_spin_lock_slowpath+0x63/0x1d0
Sep 28 15:40:01  [  611.714847][    C0] Code: ba 2f 08 0f 92 c0 0f b6 c0 c1 e0
08 89 c2 8b 07 30 e4 09 d0 a9 00 01 ff ff 75 1c 85 c0 74 0f 8b 07 84 c0 74 09
0f ae e8 8b 07 <84> c0 75 f7 b8 01 00 00 00 66 89 07 c3 f6 c4 01 75 04 c6 47 01
00
Sep 28 15:40:01  [  611.738876][    C0] RSP: 0000:ffffc90000003ad8 EFLAGS:
00000202 ORIG_RAX: ffffffffffffff13
Sep 28 15:40:01  [  611.755477][    C0] RAX: 0000000000080101 RBX:
0000000000000000 RCX: 0000000000000000
Sep 28 15:40:01  [  611.772993][    C0] RDX: 0000000000000000 RSI:
0000000000000000 RDI: ffff8882dcf72080
Sep 28 15:40:01  [  611.791481][    C0] RBP: ffff8882c7527800 R08:
ffff8882c7765890 R09: 0000000000000000
Sep 28 15:40:01  [  611.810932][    C0] R10: 0000000000000000 R11:
ffffffff817b5d30 R12: ffff8882db3a7000
Sep 28 15:40:01  [  611.830825][    C0] R13: ffff8882dcf72000 R14:
ffff8882dcf71800 R15: ffff8882db3a7000
Sep 28 15:40:01  [  611.851397][    C0]  ? apic_timer_interrupt+0xa/0x20
Sep 28 15:40:01  [  611.862019][    C0]  ? ip_fragment.constprop.0+0x80/0x80
Sep 28 15:40:01  [  611.872654][    C0]  _raw_spin_lock+0x15/0x20
Sep 28 15:40:01  [  611.883227][    C0]  __imq_nf_queue+0x3a5/0x6d0 [imq]
Sep 28 15:40:01  [  611.893786][    C0]  imq_nf_queue+0x326/0x423 [imq]
Sep 28 15:40:01  [  611.904278][    C0]  nf_queue+0x1b8/0x320
Sep 28 15:40:01  [  611.914713][    C0]  nf_hook_slow+0x82/0xe0
Sep 28 15:40:01  [  611.925061][    C0]  ip_output+0xb3/0x280
Sep 28 15:40:01  [  611.935355][    C0]  ? ip_fragment.constprop.0+0x80/0x80
Sep 28 15:40:01  [  611.945745][    C0]  ip_push_pending_frames+0x52/0x80
Sep 28 15:40:01  [  611.956106][    C0]  __icmp_send+0x4ac/0x5a0
Sep 28 15:40:01  [  611.966513][    C0]  ? nf_xfrm_me_harder+0xf4/0x110
[nf_nat]
Sep 28 15:40:02  [  611.976960][    C0]  ? ip_fragment.constprop.0+0x6d/0x80
Sep 28 15:40:02  [  611.987406][    C0]  ip_fragment.constprop.0+0x6d/0x80
Sep 28 15:40:02  [  611.997743][    C0]  nf_reinject+0x15d/0x18f
Sep 28 15:40:02  [  612.007855][    C0]  imq_dev_xmit+0x70/0xb0 [imq]
Sep 28 15:40:02  [  612.017725][    C0]  dev_hard_start_xmit+0x96/0x130
Sep 28 15:40:02  [  612.027513][    C0]  __qdisc_run+0x1bf/0x2d0
Sep 28 15:40:02  [  612.037043][    C0]  net_tx_action+0xd3/0x150
Sep 28 15:40:02  [  612.046310][    C0]  __do_softirq+0xc8/0x206
Sep 28 15:40:02  [  612.055317][    C0]  irq_exit+0xa7/0xf0
Sep 28 15:40:02  [  612.064020][    C0]  smp_apic_timer_interrupt+0x55/0x80
Sep 28 15:40:02  [  612.072615][    C0]  apic_timer_interrupt+0xf/0x20
Sep 28 15:40:02  [  612.080970][    C0]  </IRQ>
Sep 28 15:40:02  [  612.088957][    C0] RIP: 0033:0x55e6e4
Sep 28 15:40:02  [  612.096796][    C0] Code: 48 01 d0 48 89 c2 4c 01 c0 4c 0f
be 47 fb 48 c1 e2 05 48 01 c2 48 89 d0 48 c1 e0 05 4c 01 c2 4c 0f be 47 fc 48
01 d0 48 89 c2 <48> c1 e2 05 4c 01 c0 48 01 d0 48 0f be 57 fd 49 89 c0 49 c1 e0
05
Sep 28 15:40:02  [  612.120192][    C0] RSP: 002b:00007ffc8f1f1fd8 EFLAGS:
00000287 ORIG_RAX: ffffffffffffff13
Sep 28 15:40:02  [  612.135465][    C0] RAX: a888682638287cbb RBX:
00000000000002d0 RCX: 00007fb6b4431f88
Sep 28 15:40:02  [  612.151470][    C0] RDX: a888682638287cbb RSI:
000000000000001a RDI: 00007fb6b4431f80
Sep 28 15:40:02  [  612.168344][    C0] RBP: 0000000000001680 R08:
000000000000004c R09: 000000000000001a
Sep 28 15:40:02  [  612.186162][    C0] R10: 00007fb6b8541948 R11:
00007fb6b8a930a0 R12: 0000000000000090
Sep 28 15:40:02  [  612.205010][    C0] R13: 00007fb6b442daa0 R14:
00007fb6b41044d0 R15: 0000000001619440

-- 
You are receiving this mail because:
You are watching the assignee of the bug.

^ permalink raw reply	[flat|nested] 6+ messages in thread

* [Bug 195755] rcu_sched detected stalls on CPUs/tasks: (detected by 0, t=6302 jiffies, g=11405, c=11404, q=1880), ppc64, G5
       [not found] <bug-195755-206035@https.bugzilla.kernel.org/>
  2019-09-23  0:07 ` [Bug 195755] rcu_sched detected stalls on CPUs/tasks: (detected by 0, t=6302 jiffies, g=11405, c=11404, q=1880), ppc64, G5 bugzilla-daemon
  2019-09-30  9:35 ` bugzilla-daemon
@ 2019-09-30 10:50 ` bugzilla-daemon
  2020-09-24  7:41 ` bugzilla-daemon
                   ` (2 subsequent siblings)
  5 siblings, 0 replies; 6+ messages in thread
From: bugzilla-daemon @ 2019-09-30 10:50 UTC (permalink / raw)
  To: linuxppc-dev

https://bugzilla.kernel.org/show_bug.cgi?id=195755

Erhard F. (erhard_f@mailbox.org) changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
             Status|CLOSED                      |REOPENED
         Resolution|OBSOLETE                    |---

--- Comment #28 from Erhard F. (erhard_f@mailbox.org) ---
Mkay... seems I was only lucky with my top-notch G5 hardware not having seen
this bug for quite some time.

Re-opening 'cause this is already the 2nd report this bug (still) affects other
hardware.

-- 
You are receiving this mail because:
You are watching the assignee of the bug.

^ permalink raw reply	[flat|nested] 6+ messages in thread

* [Bug 195755] rcu_sched detected stalls on CPUs/tasks: (detected by 0, t=6302 jiffies, g=11405, c=11404, q=1880), ppc64, G5
       [not found] <bug-195755-206035@https.bugzilla.kernel.org/>
                   ` (2 preceding siblings ...)
  2019-09-30 10:50 ` bugzilla-daemon
@ 2020-09-24  7:41 ` bugzilla-daemon
  2020-10-15 18:31 ` bugzilla-daemon
  2021-06-27 17:45 ` bugzilla-daemon
  5 siblings, 0 replies; 6+ messages in thread
From: bugzilla-daemon @ 2020-09-24  7:41 UTC (permalink / raw)
  To: linuxppc-dev

https://bugzilla.kernel.org/show_bug.cgi?id=195755

Nigel Reed (nigel@nigelreed.net) changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |nigel@nigelreed.net

--- Comment #29 from Nigel Reed (nigel@nigelreed.net) ---
I know this is old but I have been having some issues for a while, I was
finally able to get something useful:

[165716.089703] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[165716.095949] rcu:    1-...!: (0 ticks this GP) idle=354/0/0x0
softirq=2154363/2154363 fqs=0
[165716.104512] rcu:    3-...!: (0 ticks this GP) idle=29c/0/0x0
softirq=883832/883832 fqs=0
[165716.112873] rcu:    4-...!: (8 GPs behind) idle=ad8/0/0x0
softirq=2165586/2165586 fqs=0
[165716.121179] rcu:    9-...!: (9 GPs behind) idle=acc/0/0x0
softirq=1340600/1340600 fqs=0
[165716.129467] rcu:    11-...!: (2 GPs behind) idle=a18/0/0x0
softirq=4538536/4538537 fqs=0
[165716.137828] rcu:    12-...!: (0 ticks this GP) idle=870/0/0x0
softirq=2158040/2158040 fqs=0
[165775.697763] rcu: rcu_sched kthread starved for 29898 jiffies! g36134941
f0x0 RCU_GP_WAIT_FQS(5) ->state=0x402 ->cpu=3
[165775.709013] rcu: RCU grace-period kthread stack dump:
[165837.494623] watchdog: BUG: soft lockup - CPU#6 stuck for 23s!
[(resolved):52315]
[165865.494840] watchdog: BUG: soft lockup - CPU#6 stuck for 23s!
[(resolved):52315]

This happened just after freshclam ran but I don't know if it's related.

This is with a Ryzen 7 1800X CPU.
5.4.0-48-generic #52-Ubuntu

I thought I had sysrq configured but it seems not so I can't really provide any
more information, other than this is driving me crazy.

-- 
You are receiving this mail because:
You are watching the assignee of the bug.

^ permalink raw reply	[flat|nested] 6+ messages in thread

* [Bug 195755] rcu_sched detected stalls on CPUs/tasks: (detected by 0, t=6302 jiffies, g=11405, c=11404, q=1880), ppc64, G5
       [not found] <bug-195755-206035@https.bugzilla.kernel.org/>
                   ` (3 preceding siblings ...)
  2020-09-24  7:41 ` bugzilla-daemon
@ 2020-10-15 18:31 ` bugzilla-daemon
  2021-06-27 17:45 ` bugzilla-daemon
  5 siblings, 0 replies; 6+ messages in thread
From: bugzilla-daemon @ 2020-10-15 18:31 UTC (permalink / raw)
  To: linuxppc-dev

https://bugzilla.kernel.org/show_bug.cgi?id=195755

Marco Descher (marco@descher.at) changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |marco@descher.at

--- Comment #30 from Marco Descher (marco@descher.at) ---
I experienced this problem today, a freeze on an 

processor       : 3
vendor_id       : AuthenticAMD
cpu family      : 22
model           : 48
model name      : AMD GX-412TC SOC

on Debian 10  4.19.0-11-amd64 #1 SMP Debian 4.19.146-1 (2020-09-17) x86_64
GNU/Linux

with more and more sysrq messages coming up resulting in the following syslog
entry

Oct 15 11:43:45 gate kernel: [1545118.045973] rcu: INFO: rcu_sched detected
stalls on CPUs/tasks:

leading to the system becoming unreachable. Only after a reboot this works
again.

-- 
You are receiving this mail because:
You are watching the assignee of the bug.

^ permalink raw reply	[flat|nested] 6+ messages in thread

* [Bug 195755] rcu_sched detected stalls on CPUs/tasks: (detected by 0, t=6302 jiffies, g=11405, c=11404, q=1880), ppc64, G5
       [not found] <bug-195755-206035@https.bugzilla.kernel.org/>
                   ` (4 preceding siblings ...)
  2020-10-15 18:31 ` bugzilla-daemon
@ 2021-06-27 17:45 ` bugzilla-daemon
  5 siblings, 0 replies; 6+ messages in thread
From: bugzilla-daemon @ 2021-06-27 17:45 UTC (permalink / raw)
  To: linuxppc-dev

https://bugzilla.kernel.org/show_bug.cgi?id=195755

rudi@heitbaum.com changed:

           What    |Removed                     |Added
----------------------------------------------------------------------------
                 CC|                            |rudi@heitbaum.com

--- Comment #31 from rudi@heitbaum.com ---
Same error on RK3399pro (Radxa N10) with kernel 5.13.0-rc7

[13081.586168] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13081.586749] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=2081 
[13081.587613]  (detected by 1, t=6302 jiffies, g=1226929, q=7859)
[13081.588159] Task dump for CPU 5:
[13081.588462] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13081.589388] Call trace:
[13081.589619]  __switch_to+0xdc/0x130
[13081.589967]  0xffff800016db3bc8
[13144.605054] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13144.605636] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=8283 
[13144.606501]  (detected by 1, t=25207 jiffies, g=1226929, q=8960)
[13144.607055] Task dump for CPU 5:
[13144.607358] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13144.608283] Call trace:
[13144.608513]  __switch_to+0xdc/0x130
[13144.608862]  0xffff800016db3bc8
[13207.623887] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13207.624453] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=14520 
[13207.625307]  (detected by 1, t=44112 jiffies, g=1226929, q=9270)
[13207.625851] Task dump for CPU 5:
[13207.626146] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13207.627052] Call trace:
[13207.627278]  __switch_to+0xdc/0x130
[13207.627614]  0xffff800016db3bc8
[13270.642861] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13270.643441] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=20751 
[13270.644314]  (detected by 1, t=63017 jiffies, g=1226929, q=9388)
[13270.644867] Task dump for CPU 5:
[13270.645170] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13270.646095] Call trace:
[13270.646326]  __switch_to+0xdc/0x130
[13270.646673]  0xffff800016db3bc8
[13333.661672] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13333.662238] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=26980 
[13333.663092]  (detected by 1, t=81922 jiffies, g=1226929, q=9585)
[13333.663636] Task dump for CPU 5:
[13333.663931] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13333.664838] Call trace:
[13333.665063]  __switch_to+0xdc/0x130
[13333.665399]  0xffff800016db3bc8
[13396.680495] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13396.681062] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=33213 
[13396.681917]  (detected by 1, t=100827 jiffies, g=1226929, q=9817)
[13396.682469] Task dump for CPU 5:
[13396.682765] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13396.683671] Call trace:
[13396.683896]  __switch_to+0xdc/0x130
[13396.684233]  0xffff800016db3bc8
[13459.699554] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13459.700120] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=39406 
[13459.700974]  (detected by 1, t=119732 jiffies, g=1226929, q=10436)
[13459.701533] Task dump for CPU 5:
[13459.701829] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13459.702735] Call trace:
[13459.702961]  __switch_to+0xdc/0x130
[13459.703297]  0xffff800016db3bc8
[13522.718478] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13522.719049] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=45667 
[13522.719902]  (detected by 1, t=138637 jiffies, g=1226929, q=10742)
[13522.720460] Task dump for CPU 5:
[13522.720755] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13522.721662] Call trace:
[13522.721888]  __switch_to+0xdc/0x130
[13522.722224]  0xffff800016db3bc8
[13585.737386] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13585.737953] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=51904 
[13585.738807]  (detected by 1, t=157542 jiffies, g=1226929, q=10947)
[13585.739365] Task dump for CPU 5:
[13585.739661] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13585.740567] Call trace:
[13585.740793]  __switch_to+0xdc/0x130
[13585.741129]  0xffff800016db3bc8
[13648.756295] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13648.756862] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=58090 
[13648.757715]  (detected by 1, t=176447 jiffies, g=1226929, q=12205)
[13648.758274] Task dump for CPU 5:
[13648.758570] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13648.759476] Call trace:
[13648.759701]  __switch_to+0xdc/0x130
[13648.760036]  0xffff800016db3bc8
[13711.775146] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13711.775715] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=64362 
[13711.776569]  (detected by 1, t=195352 jiffies, g=1226929, q=12462)
[13711.777127] Task dump for CPU 5:
[13711.777423] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13711.778329] Call trace:
[13711.778555]  __switch_to+0xdc/0x130
[13711.778892]  0xffff800016db3bc8
[13774.793985] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13774.794553] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=70639 
[13774.795408]  (detected by 1, t=214257 jiffies, g=1226929, q=12569)
[13774.795967] Task dump for CPU 5:
[13774.796262] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13774.797168] Call trace:
[13774.797394]  __switch_to+0xdc/0x130
[13774.797730]  0xffff800016db3bc8
[13837.813008] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13837.813575] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=76909 
[13837.814429]  (detected by 1, t=233162 jiffies, g=1226929, q=12746)
[13837.814986] Task dump for CPU 5:
[13837.815281] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13837.816188] Call trace:
[13837.816414]  __switch_to+0xdc/0x130
[13837.816750]  0xffff800016db3bc8
[13900.831934] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13900.832514] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=83140 
[13900.833387]  (detected by 1, t=252067 jiffies, g=1226929, q=12831)
[13900.833957] Task dump for CPU 5:
[13900.834260] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13900.835184] Call trace:
[13900.835416]  __switch_to+0xdc/0x130
[13900.835763]  0xffff800016db3bc8
[13963.850798] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[13963.851365] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=89428 
[13963.852219]  (detected by 1, t=270972 jiffies, g=1226929, q=12997)
[13963.852777] Task dump for CPU 5:
[13963.853072] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[13963.853978] Call trace:
[13963.854204]  __switch_to+0xdc/0x130
[13963.854539]  0xffff800016db3bc8
[14026.869692] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14026.870256] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=95711 
[14026.871109]  (detected by 1, t=289877 jiffies, g=1226929, q=13189)
[14026.871669] Task dump for CPU 5:
[14026.871964] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14026.872870] Call trace:
[14026.873096]  __switch_to+0xdc/0x130
[14026.873432]  0xffff800016db3bc8
[14089.888567] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14089.889132] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=101977 
[14089.889994]  (detected by 1, t=308782 jiffies, g=1226929, q=13301)
[14089.890552] Task dump for CPU 5:
[14089.890847] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14089.891753] Call trace:
[14089.891977]  __switch_to+0xdc/0x130
[14089.892312]  0xffff800016db3bc8
[14152.907476] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14152.908040] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=108248 
[14152.908901]  (detected by 1, t=327687 jiffies, g=1226929, q=13583)
[14152.909459] Task dump for CPU 5:
[14152.909755] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14152.910661] Call trace:
[14152.910885]  __switch_to+0xdc/0x130
[14152.911221]  0xffff800016db3bc8
[14215.926397] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14215.926980] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=114520 
[14215.927859]  (detected by 1, t=346592 jiffies, g=1226929, q=14824)
[14215.928430] Task dump for CPU 5:
[14215.928732] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14215.929657] Call trace:
[14215.929888]  __switch_to+0xdc/0x130
[14215.930235]  0xffff800016db3bc8
[14278.945254] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14278.945819] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=120755 
[14278.946681]  (detected by 1, t=365497 jiffies, g=1226929, q=14953)
[14278.947240] Task dump for CPU 5:
[14278.947534] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14278.948441] Call trace:
[14278.948665]  __switch_to+0xdc/0x130
[14278.949001]  0xffff800016db3bc8
[14341.964082] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14341.964650] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=127008 
[14341.965512]  (detected by 1, t=384402 jiffies, g=1226929, q=15207)
[14341.966069] Task dump for CPU 5:
[14341.966365] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14341.967271] Call trace:
[14341.967497]  __switch_to+0xdc/0x130
[14341.967832]  0xffff800016db3bc8
[14404.982988] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14404.983555] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=133228 
[14404.984415]  (detected by 1, t=403307 jiffies, g=1226929, q=15393)
[14404.984974] Task dump for CPU 5:
[14404.985270] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14404.986176] Call trace:
[14404.986402]  __switch_to+0xdc/0x130
[14404.986738]  0xffff800016db3bc8
[14468.001845] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14468.002412] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=139490 
[14468.003274]  (detected by 1, t=422212 jiffies, g=1226929, q=15648)
[14468.003833] Task dump for CPU 5:
[14468.004128] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14468.005035] Call trace:
[14468.005260]  __switch_to+0xdc/0x130
[14468.005594]  0xffff800016db3bc8
[14531.020589] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14531.021155] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=145729 
[14531.022018]  (detected by 1, t=441117 jiffies, g=1226929, q=15794)
[14531.022577] Task dump for CPU 5:
[14531.022873] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14531.023779] Call trace:
[14531.024005]  __switch_to+0xdc/0x130
[14531.024341]  0xffff800016db3bc8
[14594.039456] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14594.040025] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=151980 
[14594.040886]  (detected by 1, t=460022 jiffies, g=1226929, q=15878)
[14594.041446] Task dump for CPU 5:
[14594.041741] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14594.042647] Call trace:
[14594.042872]  __switch_to+0xdc/0x130
[14594.043207]  0xffff800016db3bc8
[14657.058389] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14657.058959] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=158250 
[14657.059822]  (detected by 1, t=478927 jiffies, g=1226929, q=16066)
[14657.060381] Task dump for CPU 5:
[14657.060676] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14657.061583] Call trace:
[14657.061807]  __switch_to+0xdc/0x130
[14657.062141]  0xffff800016db3bc8
[14720.077324] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14720.077890] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=164517 
[14720.078752]  (detected by 1, t=497832 jiffies, g=1226929, q=16282)
[14720.079312] Task dump for CPU 5:
[14720.079607] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14720.080513] Call trace:
[14720.080739]  __switch_to+0xdc/0x130
[14720.081075]  0xffff800016db3bc8
[14783.096138] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14783.096707] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=170813 
[14783.097569]  (detected by 1, t=516737 jiffies, g=1226929, q=16500)
[14783.098129] Task dump for CPU 5:
[14783.098425] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14783.099331] Call trace:
[14783.099557]  __switch_to+0xdc/0x130
[14783.099892]  0xffff800016db3bc8
[14846.115081] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14846.115662] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=177083 
[14846.116542]  (detected by 1, t=535642 jiffies, g=1226929, q=17790)
[14846.117111] Task dump for CPU 5:
[14846.117414] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14846.118339] Call trace:
[14846.118572]  __switch_to+0xdc/0x130
[14846.118919]  0xffff800016db3bc8
[14909.133891] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14909.134461] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=183326 
[14909.135323]  (detected by 1, t=554547 jiffies, g=1226929, q=17940)
[14909.135882] Task dump for CPU 5:
[14909.136177] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14909.137084] Call trace:
[14909.137309]  __switch_to+0xdc/0x130
[14909.137644]  0xffff800016db3bc8
[14972.152771] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[14972.153341] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=189592 
[14972.154203]  (detected by 1, t=573452 jiffies, g=1226929, q=18093)
[14972.154763] Task dump for CPU 5:
[14972.155058] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[14972.155964] Call trace:
[14972.156190]  __switch_to+0xdc/0x130
[14972.156525]  0xffff800016db3bc8
[15035.171590] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15035.172159] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=195867 
[15035.173022]  (detected by 1, t=592357 jiffies, g=1226929, q=18270)
[15035.173583] Task dump for CPU 5:
[15035.173878] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15035.174785] Call trace:
[15035.175012]  __switch_to+0xdc/0x130
[15035.175347]  0xffff800016db3bc8
[15098.190534] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15098.191104] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=202159 
[15098.191966]  (detected by 1, t=611262 jiffies, g=1226929, q=18399)
[15098.192524] Task dump for CPU 5:
[15098.192819] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15098.193726] Call trace:
[15098.193952]  __switch_to+0xdc/0x130
[15098.194288]  0xffff800016db3bc8
[15161.209414] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15161.209983] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=208429 
[15161.210846]  (detected by 1, t=630167 jiffies, g=1226929, q=18573)
[15161.211404] Task dump for CPU 5:
[15161.211699] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15161.212606] Call trace:
[15161.212832]  __switch_to+0xdc/0x130
[15161.213168]  0xffff800016db3bc8
[15224.228338] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15224.228905] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=214694 
[15224.229767]  (detected by 1, t=649072 jiffies, g=1226929, q=18750)
[15224.230326] Task dump for CPU 5:
[15224.230622] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15224.231527] Call trace:
[15224.231753]  __switch_to+0xdc/0x130
[15224.232088]  0xffff800016db3bc8
[15287.247240] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15287.247805] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=220945 
[15287.248668]  (detected by 1, t=667977 jiffies, g=1226929, q=18876)
[15287.249226] Task dump for CPU 5:
[15287.249521] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15287.250427] Call trace:
[15287.250652]  __switch_to+0xdc/0x130
[15287.250987]  0xffff800016db3bc8
[15350.266060] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15350.266628] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=227219 
[15350.267491]  (detected by 1, t=686882 jiffies, g=1226929, q=19238)
[15350.268050] Task dump for CPU 5:
[15350.268345] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15350.269252] Call trace:
[15350.269477]  __switch_to+0xdc/0x130
[15350.269812]  0xffff800016db3bc8
[15413.284937] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15413.285504] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=233484 
[15413.286368]  (detected by 1, t=705787 jiffies, g=1226929, q=20770)
[15413.286926] Task dump for CPU 5:
[15413.287221] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15413.288128] Call trace:
[15413.288353]  __switch_to+0xdc/0x130
[15413.288689]  0xffff800016db3bc8
[15476.304113] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15476.304693] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=239734 
[15476.305571]  (detected by 1, t=724692 jiffies, g=1226929, q=21025)
[15476.306141] Task dump for CPU 5:
[15476.306444] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15476.307370] Call trace:
[15476.307601]  __switch_to+0xdc/0x130
[15476.307949]  0xffff800016db3bc8
[15539.322826] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15539.323390] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=245985 
[15539.324252]  (detected by 1, t=743597 jiffies, g=1226929, q=21217)
[15539.324812] Task dump for CPU 5:
[15539.325108] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15539.326014] Call trace:
[15539.326240]  __switch_to+0xdc/0x130
[15539.326578]  0xffff800016db3bc8
[15602.341877] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15602.342442] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=252236 
[15602.343304]  (detected by 1, t=762502 jiffies, g=1226929, q=21374)
[15602.343864] Task dump for CPU 5:
[15602.344159] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15602.345065] Call trace:
[15602.345290]  __switch_to+0xdc/0x130
[15602.345625]  0xffff800016db3bc8
[15665.360673] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15665.361243] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=258527 
[15665.362106]  (detected by 3, t=781407 jiffies, g=1226929, q=21533)
[15665.362666] Task dump for CPU 5:
[15665.362961] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15665.363867] Call trace:
[15665.364093]  __switch_to+0xdc/0x130
[15665.364430]  0xffff800016db3bc8
[15728.379714] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15728.380280] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=264799 
[15728.381141]  (detected by 1, t=800312 jiffies, g=1226929, q=21623)
[15728.381699] Task dump for CPU 5:
[15728.381995] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15728.382901] Call trace:
[15728.383127]  __switch_to+0xdc/0x130
[15728.383462]  0xffff800016db3bc8
[15791.398498] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15791.399064] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=271031 
[15791.399927]  (detected by 1, t=819217 jiffies, g=1226929, q=21803)
[15791.400486] Task dump for CPU 5:
[15791.400781] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15791.401687] Call trace:
[15791.401911]  __switch_to+0xdc/0x130
[15791.402247]  0xffff800016db3bc8
[15854.417401] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15854.417968] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=277248 
[15854.418832]  (detected by 2, t=838122 jiffies, g=1226929, q=21993)
[15854.419391] Task dump for CPU 5:
[15854.419686] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15854.420593] Call trace:
[15854.420817]  __switch_to+0xdc/0x130
[15854.421153]  0xffff800016db3bc8
[15917.436445] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15917.437012] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=283509 
[15917.437874]  (detected by 1, t=857027 jiffies, g=1226929, q=22214)
[15917.438434] Task dump for CPU 5:
[15917.438729] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15917.439634] Call trace:
[15917.439859]  __switch_to+0xdc/0x130
[15917.440195]  0xffff800016db3bc8
[15980.455269] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[15980.455839] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=289795 
[15980.456702]  (detected by 1, t=875932 jiffies, g=1226929, q=22336)
[15980.457260] Task dump for CPU 5:
[15980.457555] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[15980.458462] Call trace:
[15980.458688]  __switch_to+0xdc/0x130
[15980.459024]  0xffff800016db3bc8
[16043.474210] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[16043.474775] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=296074 
[16043.475637]  (detected by 1, t=894837 jiffies, g=1226929, q=23604)
[16043.476197] Task dump for CPU 5:
[16043.476492] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[16043.477398] Call trace:
[16043.477623]  __switch_to+0xdc/0x130
[16043.477959]  0xffff800016db3bc8
[16106.493004] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[16106.493574] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=302355 
[16106.494439]  (detected by 1, t=913742 jiffies, g=1226929, q=23693)
[16106.494998] Task dump for CPU 5:
[16106.495293] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[16106.496200] Call trace:
[16106.496426]  __switch_to+0xdc/0x130
[16106.496763]  0xffff800016db3bc8
[16169.511966] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[16169.512534] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=308617 
[16169.513398]  (detected by 1, t=932647 jiffies, g=1226929, q=23881)
[16169.513958] Task dump for CPU 5:
[16169.514253] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[16169.515160] Call trace:
[16169.515386]  __switch_to+0xdc/0x130
[16169.515720]  0xffff800016db3bc8
[16232.530953] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[16232.531530] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=314840 
[16232.532412]  (detected by 1, t=951552 jiffies, g=1226929, q=24168)
[16232.532981] Task dump for CPU 5:
[16232.533284] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[16232.534208] Call trace:
[16232.534439]  __switch_to+0xdc/0x130
[16232.534786]  0xffff800016db3bc8
[16295.549694] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[16295.550260] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=321100 
[16295.551122]  (detected by 1, t=970457 jiffies, g=1226929, q=24344)
[16295.551682] Task dump for CPU 5:
[16295.551977] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[16295.552883] Call trace:
[16295.553109]  __switch_to+0xdc/0x130
[16295.553444]  0xffff800016db3bc8
[16358.568692] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[16358.569257] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=327311 
[16358.570119]  (detected by 1, t=989362 jiffies, g=1226929, q=24453)
[16358.570677] Task dump for CPU 5:
[16358.570973] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[16358.571878] Call trace:
[16358.572103]  __switch_to+0xdc/0x130
[16358.572438]  0xffff800016db3bc8
[16421.587636] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[16421.588203] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=333593 
[16421.589064]  (detected by 1, t=1008267 jiffies, g=1226929, q=24583)
[16421.589631] Task dump for CPU 5:
[16421.589926] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[16421.590832] Call trace:
[16421.591058]  __switch_to+0xdc/0x130
[16421.591393]  0xffff800016db3bc8
[16484.606656] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[16484.607238] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=339823 
[16484.608120]  (detected by 1, t=1027172 jiffies, g=1226929, q=24800)
[16484.608697] Task dump for CPU 5:
[16484.609001] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[16484.609926] Call trace:
[16484.610156]  __switch_to+0xdc/0x130
[16484.610503]  0xffff800016db3bc8
[16547.625618] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[16547.626182] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=346004 
[16547.627043]  (detected by 1, t=1046077 jiffies, g=1226929, q=24992)
[16547.627609] Task dump for CPU 5:
[16547.627905] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[16547.628811] Call trace:
[16547.629035]  __switch_to+0xdc/0x130
[16547.629371]  0xffff800016db3bc8
[16610.644564] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[16610.645128] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=352273 
[16610.645990]  (detected by 1, t=1064982 jiffies, g=1226929, q=26024)
[16610.646556] Task dump for CPU 5:
[16610.646851] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[16610.647758] Call trace:
[16610.647982]  __switch_to+0xdc/0x130
[16610.648318]  0xffff800016db3bc8
[16673.663533] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[16673.664098] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=358540 
[16673.664960]  (detected by 1, t=1083887 jiffies, g=1226929, q=27452)
[16673.665526] Task dump for CPU 5:
[16673.665822] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842539 flags:0x00000002[16673.666728] Call trace:
[16673.666954]  __switch_to+0xdc/0x130
[16673.667289]  0xffff800016db3bc8
[16736.682410] rcu: INFO: rcu_sched detected stalls on CPUs/tasks:
[16736.682978] rcu: 5-...0: (1 GPs behind) idle=aaa/1/0x4000000000000000
softirq=981287/981290 fqs=364780 
[16736.683840]  (detected by 1, t=1102792 jiffies, g=1226929, q=28629)
[16736.684407] Task dump for CPU 5:
[16736.684702] task:pkgjson         state:R  running task     stack:    0
pid:845641 ppid:842408 flags:0x00000003[16736.685608] Call trace:
[16736.685834]  __switch_to+0xdc/0x130
[16736.686169]  0xffff800016db3bc8

-- 
You may reply to this email to add a comment.

You are receiving this mail because:
You are watching the assignee of the bug.

^ permalink raw reply	[flat|nested] 6+ messages in thread

end of thread, other threads:[~2021-06-27 17:46 UTC | newest]

Thread overview: 6+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
     [not found] <bug-195755-206035@https.bugzilla.kernel.org/>
2019-09-23  0:07 ` [Bug 195755] rcu_sched detected stalls on CPUs/tasks: (detected by 0, t=6302 jiffies, g=11405, c=11404, q=1880), ppc64, G5 bugzilla-daemon
2019-09-30  9:35 ` bugzilla-daemon
2019-09-30 10:50 ` bugzilla-daemon
2020-09-24  7:41 ` bugzilla-daemon
2020-10-15 18:31 ` bugzilla-daemon
2021-06-27 17:45 ` bugzilla-daemon

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).