* Re: [Bug 204165] New: 100% CPU usage in compact_zone_order
[not found] <bug-204165-27@https.bugzilla.kernel.org/>
@ 2019-07-15 21:25 ` Andrew Morton
2019-07-15 23:28 ` howaboutsynergy
2019-07-16 1:08 ` howaboutsynergy
0 siblings, 2 replies; 12+ messages in thread
From: Andrew Morton @ 2019-07-15 21:25 UTC (permalink / raw)
To: howaboutsynergy; +Cc: bugzilla-daemon, linux-mm, Mel Gorman
(switched to email. Please respond via emailed reply-to-all, not via the
bugzilla web interface).
On Sat, 13 Jul 2019 19:20:21 +0000 bugzilla-daemon@bugzilla.kernel.org wrote:
> https://bugzilla.kernel.org/show_bug.cgi?id=204165
>
> Bug ID: 204165
> Summary: 100% CPU usage in compact_zone_order
Looks like we have a lockup in compact_zone()
> Product: Memory Management
> Version: 2.5
> Kernel Version: 5.2.0-g0ecfebd2b524
> Hardware: x86-64
> OS: Linux
> Tree: Mainline
> Status: NEW
> Severity: normal
> Priority: P1
> Component: Page Allocator
> Assignee: akpm@linux-foundation.org
> Reporter: howaboutsynergy@pm.me
> Regression: No
I assume this should be "yes". Did previous kernels exhibit this
behavior or is it new in 5.2?
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [Bug 204165] New: 100% CPU usage in compact_zone_order
2019-07-15 21:25 ` [Bug 204165] New: 100% CPU usage in compact_zone_order Andrew Morton
@ 2019-07-15 23:28 ` howaboutsynergy
2019-07-16 1:52 ` howaboutsynergy
2019-07-16 1:08 ` howaboutsynergy
1 sibling, 1 reply; 12+ messages in thread
From: howaboutsynergy @ 2019-07-15 23:28 UTC (permalink / raw)
To: Andrew Morton; +Cc: bugzilla-daemon, linux-mm, Mel Gorman
[-- Attachment #1.1: Type: text/plain, Size: 2342 bytes --]
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Monday, July 15, 2019 11:25 PM, Andrew Morton <akpm@linux-foundation.org> wrote:
> (switched to email. Please respond via emailed reply-to-all, not via the
> bugzilla web interface).
Roger that.
>
> On Sat, 13 Jul 2019 19:20:21 +0000 bugzilla-daemon@bugzilla.kernel.org wrote:
>
> > https://bugzilla.kernel.org/show_bug.cgi?id=204165
> >
> > Bug ID: 204165
> > Summary: 100% CPU usage in compact_zone_order
> >
>
> Looks like we have a lockup in compact_zone()
>
> > Product: Memory Management
> > Version: 2.5
> > Kernel Version: 5.2.0-g0ecfebd2b524
> > Hardware: x86-64
> > OS: Linux
> > Tree: Mainline
> > Status: NEW
> > Severity: normal
> > Priority: P1
> > Component: Page Allocator
> > Assignee: akpm@linux-foundation.org
> > Reporter: howaboutsynergy@pm.me
> > Regression: No
> >
>
> I assume this should be "yes". Did previous kernels exhibit this
> behavior or is it new in 5.2?
Regression: yes?
I'm not sure...
tl;dr: seen with kernel linux-stable 5.1.8.r0.g937cc0cc22a2-1
And really not sure if I've seen it before.
long read:
At least one previous kernel did because I've seen this before in https://bugzilla.kernel.org/show_bug.cgi?id=203833#c1 where I thought it was due to 'teo' governor but it wasn't (I'm using 'menu' gov. now)
I didn't mention kernel version there, but according to irc logs where I seek'd help at the time, the date was June 10th 2019 3am, checking which kernel I was running at the time (thanks to my q1q repo. git logs) it was 5.1.8 (stable)kernel to which I updated on Sun Jun 9 10:50:09 2019 +0200 and have not changed until Tue Jun 11 05:16:59 2019 +0200
local/linux-stable 5.1.8.r0.g937cc0cc22a2-1 (builtbydaddy)
Side note:
I've encountered something similar here https://github.com/constantoverride/qubes-linux-kernel/issues/2
where kworker would randomly start using 100% CPU and couldn't be killed. The kernel there was 4.18.7, the VM had very little RAM in Qubes there. Since it's probably a different bug due to that stacktrace being so different/unrelated, please ignore.
[-- Attachment #1.2: publickey - howaboutsynergy@protonmail.com - 0x947B9B34.asc --]
[-- Type: application/pgp-keys, Size: 3227 bytes --]
[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 855 bytes --]
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [Bug 204165] New: 100% CPU usage in compact_zone_order
2019-07-15 21:25 ` [Bug 204165] New: 100% CPU usage in compact_zone_order Andrew Morton
2019-07-15 23:28 ` howaboutsynergy
@ 2019-07-16 1:08 ` howaboutsynergy
1 sibling, 0 replies; 12+ messages in thread
From: howaboutsynergy @ 2019-07-16 1:08 UTC (permalink / raw)
To: Andrew Morton; +Cc: bugzilla-daemon, linux-mm, Mel Gorman
[-- Attachment #1.1: Type: text/plain, Size: 1786 bytes --]
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Monday, July 15, 2019 11:25 PM, Andrew Morton <akpm@linux-foundation.org> wrote:
> (switched to email. Please respond via emailed reply-to-all, not via the
> bugzilla web interface).
>
> On Sat, 13 Jul 2019 19:20:21 +0000 bugzilla-daemon@bugzilla.kernel.org wrote:
>
> > https://bugzilla.kernel.org/show_bug.cgi?id=204165
> >
> > Bug ID: 204165
> > Summary: 100% CPU usage in compact_zone_order
> >
>
> Looks like we have a lockup in compact_zone()
>
> > Product: Memory Management
> > Version: 2.5
> > Kernel Version: 5.2.0-g0ecfebd2b524
> > Hardware: x86-64
> > OS: Linux
> > Tree: Mainline
> > Status: NEW
> > Severity: normal
> > Priority: P1
> > Component: Page Allocator
> > Assignee: akpm@linux-foundation.org
> > Reporter: howaboutsynergy@pm.me
> > Regression: No
> >
>
> I assume this should be "yes". Did previous kernels exhibit this
> behavior or is it new in 5.2?
Is the reason that you switched to email somehow related to bugzilla not even posting this very reply of yours(seen above) that you sent via email even though you included bugzilla in the CC ?! I noticed that only mine got posted and mine was after yours in the emails. Yet there's no trace of yours when looking at the issue through the bugzilla interface.
Your (emailed)comment should be right after this https://bugzilla.kernel.org/show_bug.cgi?id=204165#c11
but it's not.
Anyway, I'm ready to test stuff, please let me know how I can help.
Meanwhile I'll try to find a better way to replicate the issue.
[-- Attachment #1.2: publickey - howaboutsynergy@protonmail.com - 0x947B9B34.asc --]
[-- Type: application/pgp-keys, Size: 3227 bytes --]
[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 855 bytes --]
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [Bug 204165] New: 100% CPU usage in compact_zone_order
2019-07-15 23:28 ` howaboutsynergy
@ 2019-07-16 1:52 ` howaboutsynergy
2019-07-16 3:25 ` howaboutsynergy
0 siblings, 1 reply; 12+ messages in thread
From: howaboutsynergy @ 2019-07-16 1:52 UTC (permalink / raw)
To: Andrew Morton; +Cc: bugzilla-daemon, linux-mm, Mel Gorman
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Tuesday, July 16, 2019 1:28 AM, <howaboutsynergy@protonmail.com> wrote:
> ‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
> On Monday, July 15, 2019 11:25 PM, Andrew Morton akpm@linux-foundation.org wrote:
>
> > (switched to email. Please respond via emailed reply-to-all, not via the
> > bugzilla web interface).
>
> Roger that.
>
> > On Sat, 13 Jul 2019 19:20:21 +0000 bugzilla-daemon@bugzilla.kernel.org wrote:
> >
> > > https://bugzilla.kernel.org/show_bug.cgi?id=204165
> > >
> > > Bug ID: 204165
> > > Summary: 100% CPU usage in compact_zone_order
> > >
> >
> > Looks like we have a lockup in compact_zone()
> >
> > > Product: Memory Management
> > > Version: 2.5
> > > Kernel Version: 5.2.0-g0ecfebd2b524
> > > Hardware: x86-64
> > > OS: Linux
> > > Tree: Mainline
> > > Status: NEW
> > > Severity: normal
> > > Priority: P1
> > > Component: Page Allocator
> > > Assignee: akpm@linux-foundation.org
> > > Reporter: howaboutsynergy@pm.me
> > > Regression: No
> > >
> >
> > I assume this should be "yes". Did previous kernels exhibit this
> > behavior or is it new in 5.2?
>
> Regression: yes?
> I'm not sure...
> tl;dr: seen with kernel linux-stable 5.1.8.r0.g937cc0cc22a2-1
> And really not sure if I've seen it before.
>
> long read:
> At least one previous kernel did because I've seen this before in https://bugzilla.kernel.org/show_bug.cgi?id=203833#c1 where I thought it was due to 'teo' governor but it wasn't (I'm using 'menu' gov. now)
>
> I didn't mention kernel version there, but according to irc logs where I seek'd help at the time, the date was June 10th 2019 3am, checking which kernel I was running at the time (thanks to my q1q repo. git logs) it was 5.1.8 (stable)kernel to which I updated on Sun Jun 9 10:50:09 2019 +0200 and have not changed until Tue Jun 11 05:16:59 2019 +0200
> local/linux-stable 5.1.8.r0.g937cc0cc22a2-1 (builtbydaddy)
>
> Side note:
> I've encountered something similar here https://github.com/constantoverride/qubes-linux-kernel/issues/2
> where kworker would randomly start using 100% CPU and couldn't be killed. The kernel there was 4.18.7, the VM had very little RAM in Qubes there. Since it's probably a different bug due to that stacktrace being so different/unrelated, please ignore.
Well after a maybe 50+ tries, got it triggered on kernel 5.2.1-g527a3db363a3
```
$ time stress -m 220 --vm-bytes 10000000000 --timeout 10
stress: info: [19317] dispatching hogs: 0 cpu, 0 io, 220 vm, 0 hdd
stress: FAIL: [19317] (415) <-- worker 19536 got signal 9
stress: WARN: [19317] (417) now reaping child worker processes
stress: FAIL: [19317] (415) <-- worker 19530 got signal 9
stress: WARN: [19317] (417) now reaping child worker processes
```
MiB Mem : 31745.3 total, 28945.2 free, 2055.4 used, 744.7 buff/cache
MiB Swap: 65536.0 total, 63410.3 free, 2125.7 used. 28774.5 avail Mem
PID %CPU COMMAND PR NI VIRT RES S USER
19335 100.0 stress 20 0 9769416 12 R user
19376 100.0 stress 20 0 9769416 0 R user
19418 100.0 stress 20 0 9769416 12 R user
19490 100.0 stress 20 0 9769416 8 R user
21020 100.0 dmesg 20 0 6112 2636 R user
```
[ 1572.246553] sysrq: Show backtrace of all active CPUs
[ 1572.246563] NMI backtrace for cpu 8
[ 1572.246572] CPU: 8 PID: 0 Comm: swapper/8 Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
[ 1572.246579] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
[ 1572.246582] Call Trace:
[ 1572.246589] <IRQ>
[ 1572.246603] dump_stack+0x46/0x60
[ 1572.246615] nmi_cpu_backtrace.cold+0x14/0x53
[ 1572.246623] ? lapic_can_unplug_cpu.cold+0x42/0x42
[ 1572.246634] nmi_trigger_cpumask_backtrace+0x8e/0x90
[ 1572.246641] __handle_sysrq.cold+0x48/0x102
[ 1572.246650] sysrq_filter+0x2ea/0x3b0
[ 1572.246658] input_to_handler+0x4d/0xf0
[ 1572.246668] input_pass_values.part.0+0x109/0x130
[ 1572.246675] input_handle_event+0x171/0x5a0
[ 1572.246684] input_event+0x4d/0x70
[ 1572.246694] hidinput_report_event+0x2e/0x40
[ 1572.246703] hid_report_raw_event+0x260/0x430
[ 1572.246710] hid_input_report+0xfb/0x150
[ 1572.246721] hid_irq_in+0x168/0x190
[ 1572.246730] __usb_hcd_giveback_urb+0x77/0xe0
[ 1572.246754] xhci_giveback_urb_in_irq.isra.0+0x62/0x90 [xhci_hcd]
[ 1572.246777] xhci_td_cleanup+0xf7/0x140 [xhci_hcd]
[ 1572.246799] xhci_irq+0x7e8/0x1be0 [xhci_hcd]
[ 1572.246811] __handle_irq_event_percpu+0x2f/0xc0
[ 1572.246820] handle_irq_event_percpu+0x2c/0x80
[ 1572.246827] handle_irq_event+0x23/0x43
[ 1572.246838] handle_edge_irq+0x78/0x190
[ 1572.246846] handle_irq+0x17/0x20
[ 1572.246857] do_IRQ+0x3e/0xd0
[ 1572.246865] common_interrupt+0xf/0xf
[ 1572.246872] </IRQ>
[ 1572.246880] RIP: 0010:cpuidle_enter_state+0x11f/0x2a0
[ 1572.246890] Code: e8 d6 1c a1 ff 49 89 c6 31 ff e8 fc 2c a1 ff 45 84 ff 74 12 9c 58 f6 c4 02 0f 85 65 01 00 00 31 ff e8 d5 18 a6 ff fb 45 85 ed <0f> 88 c0 00 00 00 49 63 f5 48 8d 04 76 48 c1 e0 05 8b 7c 03 4c 4c
[ 1572.246895] RSP: 0018:ffffbd38c3217e80 EFLAGS: 00000206 ORIG_RAX: ffffffffffffffde
[ 1572.246904] RAX: ffff9699ada5cb00 RBX: ffffffff93062340 RCX: 000000000000001f
[ 1572.246909] RDX: 0000000000000000 RSI: 0000000022a1cd05 RDI: 0000000000000000
[ 1572.246916] RBP: 0000016e1126287d R08: 0000016e11320f1b R09: 000000007fffffff
[ 1572.246921] R10: ffff9699ada5bc44 R11: ffff9699ada5bc24 R12: ffff9699ada65b00
[ 1572.246925] R13: 0000000000000006 R14: 0000016e11320f1b R15: 0000000000000000
[ 1572.246936] cpuidle_enter+0x24/0x40
[ 1572.246945] do_idle+0x1c1/0x230
[ 1572.246955] cpu_startup_entry+0x14/0x20
[ 1572.246963] start_secondary+0x168/0x1b0
[ 1572.246972] secondary_startup_64+0xa4/0xb0
[ 1572.246981] Sending NMI from CPU 8 to CPUs 0-7,9-11:
[ 1572.247108] NMI backtrace for cpu 0
[ 1572.247110] CPU: 0 PID: 19376 Comm: stress Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
[ 1572.247111] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
[ 1572.247112] RIP: 0010:compact_zone+0x3cf/0xa70
[ 1572.247115] Code: 7f 70 02 74 07 83 ce 04 89 74 24 50 45 0f b6 6f 74 48 8b 55 60 45 84 ed 0f 85 5d 02 00 00 48 39 d0 0f 84 3d 02 00 00 48 89 c7 <48> 81 e7 00 fe ff ff a9 ff 01 00 00 0f 84 28 02 00 00 49 89 c4 48
[ 1572.247116] RSP: 0018:ffffbd38cfca7a18 EFLAGS: 00000202
[ 1572.247118] RAX: 000000000022c720 RBX: 000000000022ca00 RCX: 0000000000001163
[ 1572.247119] RDX: 0000000000100000 RSI: 000000000000000c RDI: 000000000022c720
[ 1572.247122] RBP: ffff9699cdfded00 R08: 0000000000000001 R09: ffff9699ad65d550
[ 1572.247123] R10: 0000000000000001 R11: ffff9699ad65cb80 R12: 0000000000000009
[ 1572.247124] R13: 0000000000000000 R14: 000000000022c720 R15: ffffbd38cfca7ad0
[ 1572.247125] FS: 0000710f1082f740(0000) GS:ffff9699ad600000(0000) knlGS:0000000000000000
[ 1572.247126] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1572.247127] CR2: 000056d077f9cea8 CR3: 000000027ed88005 CR4: 00000000003606f0
[ 1572.247128] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1572.247129] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1572.247130] Call Trace:
[ 1572.247130] compact_zone_order+0xde/0x120
[ 1572.247131] try_to_compact_pages+0x187/0x240
[ 1572.247132] __alloc_pages_direct_compact+0x87/0x170
[ 1572.247133] __alloc_pages_slowpath+0x454/0xc20
[ 1572.247134] ? release_pages+0x348/0x3b0
[ 1572.247134] __alloc_pages_nodemask+0x268/0x2b0
[ 1572.247137] do_huge_pmd_anonymous_page+0x131/0x5c0
[ 1572.247138] __handle_mm_fault+0xc0c/0x1310
[ 1572.247139] handle_mm_fault+0xa9/0x1d0
[ 1572.247139] __do_page_fault+0x237/0x480
[ 1572.247140] do_page_fault+0x1d/0x67
[ 1572.247141] ? page_fault+0x8/0x30
[ 1572.247142] page_fault+0x1e/0x30
[ 1572.247143] RIP: 0033:0x5f7c81c80c10
[ 1572.247145] Code: c0 0f 84 53 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f fa 00 00 00 31 c0 4d 85 ff 7e 10 0f 1f 40 00 <c6> 04 03 5a 4c 01 f0 49 39 c7 7f f4 4d 85 e4 0f 84 f4 01 00 00 7e
[ 1572.247145] RSP: 002b:00007ffdb884d190 EFLAGS: 00010206
[ 1572.247147] RAX: 0000000016e90000 RBX: 0000710cbc770010 RCX: 0000710f109543db
[ 1572.247148] RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000710cbc770000
[ 1572.247149] RBP: 00005f7c81c81a54 R08: 0000710cbc770010 R09: 0000000000000000
[ 1572.247152] R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
[ 1572.247153] R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
[ 1572.247212] NMI backtrace for cpu 1
[ 1572.247214] CPU: 1 PID: 19335 Comm: stress Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
[ 1572.247216] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
[ 1572.247217] RIP: 0010:isolate_migratepages_block+0x267/0xa50
[ 1572.247219] Code: 00 00 00 c4 e2 f9 f7 c6 48 8d 5c 03 ff 45 84 ed 0f 85 17 ff ff ff 48 ff c3 48 39 5c 24 08 0f 87 46 ff ff ff 4d 89 d7 4d 89 e6 <48> 89 d8 0f b6 54 24 77 48 3b 5c 24 08 0f 87 25 02 00 00 84 d2 0f
[ 1572.247220] RSP: 0018:ffffbd38cfb5f958 EFLAGS: 00000202
[ 1572.247223] RAX: 0000000000000001 RBX: 000000000018c060 RCX: ffffbd38cfb5fb49
[ 1572.247224] RDX: 0000000000000004 RSI: 0000000000000000 RDI: ffff9699cdfffb00
[ 1572.247225] RBP: ffff9699cdfde000 R08: 0000000000000001 R09: ffff9699ad6dd550
[ 1572.247226] R10: 0000000000000000 R11: ffff969946236600 R12: ffffbd38cfb5fad0
[ 1572.247230] R13: 0000000000000000 R14: ffffbd38cfb5fad0 R15: 0000000000000000
[ 1572.247232] FS: 0000710f1082f740(0000) GS:ffff9699ad680000(0000) knlGS:0000000000000000
[ 1572.247233] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1572.247234] CR2: 00007f6eb6d40faa CR3: 000000080b004002 CR4: 00000000003606e0
[ 1572.247235] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1572.247237] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1572.247237] Call Trace:
[ 1572.247238] compact_zone+0x577/0xa70
[ 1572.247239] compact_zone_order+0xde/0x120
[ 1572.247241] try_to_compact_pages+0x187/0x240
[ 1572.247242] __alloc_pages_direct_compact+0x87/0x170
[ 1572.247248] __alloc_pages_slowpath+0x454/0xc20
[ 1572.247259] ? release_pages+0x348/0x3b0
[ 1572.247265] ? __pagevec_lru_add_fn+0x189/0x2a0
[ 1572.247266] __alloc_pages_nodemask+0x268/0x2b0
[ 1572.247267] do_huge_pmd_anonymous_page+0x131/0x5c0
[ 1572.247268] __handle_mm_fault+0xc0c/0x1310
[ 1572.247269] handle_mm_fault+0xa9/0x1d0
[ 1572.247270] __do_page_fault+0x237/0x480
[ 1572.247272] do_page_fault+0x1d/0x67
[ 1572.247273] ? page_fault+0x8/0x30
[ 1572.247275] page_fault+0x1e/0x30
[ 1572.247276] RIP: 0033:0x5f7c81c80c10
[ 1572.247280] Code: c0 0f 84 53 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f fa 00 00 00 31 c0 4d 85 ff 7e 10 0f 1f 40 00 <c6> 04 03 5a 4c 01 f0 49 39 c7 7f f4 4d 85 e4 0f 84 f4 01 00 00 7e
[ 1572.247281] RSP: 002b:00007ffdb884d190 EFLAGS: 00010206
[ 1572.247287] RAX: 0000000015c90000 RBX: 0000710cbc770010 RCX: 0000710f109543db
[ 1572.247289] RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000710cbc770000
[ 1572.247290] RBP: 00005f7c81c81a54 R08: 0000710cbc770010 R09: 0000000000000000
[ 1572.247292] R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
[ 1572.247293] R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
[ 1572.247321] NMI backtrace for cpu 2
[ 1572.247328] CPU: 2 PID: 19490 Comm: stress Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
[ 1572.247331] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
[ 1572.247335] RIP: 0010:isolate_migratepages_block+0x1c/0xa50
[ 1572.247339] Code: 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 41 57 41 56 41 55 41 54 55 53 48 81 ec 88 00 00 00 49 89 fe 48 89 f3 48 89 54 24 08 <89> 4c 24 3c 65 48 8b 04 25 28 00 00 00 48 89 84 24 80 00 00 00 31
[ 1572.247346] RSP: 0018:ffffbd3929043958 EFLAGS: 00000292
[ 1572.247358] RAX: 0000000000000000 RBX: 000000000062b760 RCX: 000000000000000c
[ 1572.247361] RDX: 000000000062b800 RSI: 000000000062b760 RDI: ffffbd3929043ad0
[ 1572.247364] RBP: ffffbd3929043ad0 R08: 0000000000000001 R09: ffff9699ad75d550
[ 1572.247368] R10: 0000000000000001 R11: ffff9699ad75cb80 R12: 000000000062b800
[ 1572.247371] R13: ffff9699cdfded00 R14: ffffbd3929043ad0 R15: ffffbd3929043ad0
[ 1572.247377] FS: 0000710f1082f740(0000) GS:ffff9699ad700000(0000) knlGS:0000000000000000
[ 1572.247380] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1572.247390] CR2: 000077de6c7b3ec4 CR3: 000000080bde2005 CR4: 00000000003606e0
[ 1572.247393] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1572.247397] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1572.247402] Call Trace:
[ 1572.247409] compact_zone+0x577/0xa70
[ 1572.247415] compact_zone_order+0xde/0x120
[ 1572.247418] try_to_compact_pages+0x187/0x240
[ 1572.247423] __alloc_pages_direct_compact+0x87/0x170
[ 1572.247426] __alloc_pages_slowpath+0x454/0xc20
[ 1572.247432] ? release_pages+0x348/0x3b0
[ 1572.247439] ? __pagevec_lru_add_fn+0x189/0x2a0
[ 1572.247442] __alloc_pages_nodemask+0x268/0x2b0
[ 1572.247448] do_huge_pmd_anonymous_page+0x131/0x5c0
[ 1572.247450] __handle_mm_fault+0xc0c/0x1310
[ 1572.247455] handle_mm_fault+0xa9/0x1d0
[ 1572.247460] __do_page_fault+0x237/0x480
[ 1572.247464] do_page_fault+0x1d/0x67
[ 1572.247468] ? page_fault+0x8/0x30
[ 1572.247473] page_fault+0x1e/0x30
[ 1572.247476] RIP: 0033:0x5f7c81c80c10
[ 1572.247482] Code: c0 0f 84 53 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f fa 00 00 00 31 c0 4d 85 ff 7e 10 0f 1f 40 00 <c6> 04 03 5a 4c 01 f0 49 39 c7 7f f4 4d 85 e4 0f 84 f4 01 00 00 7e
[ 1572.247488] RSP: 002b:00007ffdb884d190 EFLAGS: 00010206
[ 1572.247494] RAX: 0000000019c90000 RBX: 0000710cbc770010 RCX: 0000710f109543db
[ 1572.247500] RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000710cbc770000
[ 1572.247504] RBP: 00005f7c81c81a54 R08: 0000710cbc770010 R09: 0000000000000000
[ 1572.247507] R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
[ 1572.247511] R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
[ 1572.247516] NMI backtrace for cpu 5
[ 1572.247520] CPU: 5 PID: 1273 Comm: dmesg Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
[ 1572.247525] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
[ 1572.247530] RIP: 0033:0x7de7c0c81388
[ 1572.247534] Code: 85 e4 fa ff ff 00 00 00 00 c7 85 e0 fa ff ff 00 00 00 00 e9 38 f4 ff ff 66 2e 0f 1f 84 00 00 00 00 00 48 83 bd e8 fa ff ff 00 <0f> 84 5c 0c 00 00 0f b6 85 dc fa ff ff 83 e0 01 83 bd f0 fa ff ff
[ 1572.247537] RSP: 002b:00007ffeedcb2aa0 EFLAGS: 00000206
[ 1572.247546] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000004
[ 1572.247551] RDX: 0000000000000000 RSI: 00007de7c0dc95c0 RDI: 0000000000000000
[ 1572.247557] RBP: 00007ffeedcb3010 R08: 00007ffeedcb2fd4 R09: 0000000000000001
[ 1572.247560] R10: 0000560441280093 R11: 00007ffeedcb2fd4 R12: 00007ffeedcb3030
[ 1572.247563] R13: 000056044128008f R14: 00007ffeedcb31b0 R15: 0000000000000064
[ 1572.247568] FS: 00007de7c0c01740 GS: 0000000000000000
[ 1572.247575] NMI backtrace for cpu 4
[ 1572.247580] CPU: 4 PID: 1245 Comm: dmesg Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
[ 1572.247584] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
[ 1572.247587] RIP: 0010:_raw_spin_lock+0xb/0x20
[ 1572.247690] Code: 81 05 6d b7 81 6d 00 02 00 00 31 c0 ba ff 00 00 00 f0 0f b1 17 75 01 c3 e9 92 14 8f ff 66 90 31 c0 ba 01 00 00 00 f0 0f b1 17 <75> 01 c3 89 c6 e9 1b 04 8f ff 66 66 2e 0f 1f 84 00 00 00 00 00 65
[ 1572.247801] RSP: 0018:ffffbd38c546bcb8 EFLAGS: 00000097
[ 1572.247812] RAX: 0000000000000001 RBX: ffff96994b4e5ac0 RCX: 000000000000000a
[ 1572.247815] RDX: 0000000000000001 RSI: ffff9699ad800000 RDI: ffff9699adb5cb00
[ 1572.247818] RBP: ffff9699adb5cb00 R08: 000000000000000a R09: ffffbd38c546bd90
[ 1572.247821] R10: 0000000000000000 R11: 0000000000000004 R12: 0000000000000001
[ 1572.247827] R13: 0000000000000046 R14: ffff96994b4e6204 R15: 000000000005cb00
[ 1572.247830] FS: 000077a36f17e740(0000) GS:ffff9699ad800000(0000) knlGS:0000000000000000
[ 1572.247833] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1572.247837] CR2: 000072d7ae4d9578 CR3: 00000007ca59c006 CR4: 00000000003606e0
[ 1572.247840] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1572.247847] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1572.247850] Call Trace:
[ 1572.247853] try_to_wake_up+0x18d/0x500
[ 1572.247855] autoremove_wake_function+0xc/0x50
[ 1572.247858] __wake_up_common+0x7a/0x190
[ 1572.247861] __wake_up_common_lock+0x79/0xc0
[ 1572.247864] pipe_write+0x1e3/0x410
[ 1572.247869] new_sync_write+0x116/0x1b0
[ 1572.247875] vfs_write+0xb1/0x190
[ 1572.247878] ksys_write+0x5d/0xe0
[ 1572.247881] do_syscall_64+0x50/0x170
[ 1572.247884] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 1572.247886] RIP: 0033:0x77a36f2984ba
[ 1572.247894] Code: 48 c7 c0 ff ff ff ff eb bc 0f 1f 80 00 00 00 00 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 18 b8 01 00 00 00 c5 fc 77 0f 05 <48> 3d 00 f0 ff ff 77 56 c3 0f 1f 44 00 00 55 48 89 e5 48 83 ec 20
[ 1572.247897] RSP: 002b:00007fffd15cf728 EFLAGS: 00000246 ORIG_RAX: 0000000000000001
[ 1572.247903] RAX: ffffffffffffffda RBX: 0000000000000029 RCX: 000077a36f2984ba
[ 1572.247906] RDX: 0000000000000029 RSI: 00006261bcaad3c0 RDI: 0000000000000001
[ 1572.247909] RBP: 00007fffd15cf750 R08: 000000000000000a R09: 0000000000000000
[ 1572.247912] R10: 00007fffd15cf77c R11: 0000000000000246 R12: 0000000000000029
[ 1572.247918] R13: 00006261bcaad3c0 R14: 000077a36f36d500 R15: 000077a36f36e300
[ 1572.247922] NMI backtrace for cpu 3
[ 1572.247926] CPU: 3 PID: 19418 Comm: stress Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
[ 1572.247929] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
[ 1572.247932] RIP: 0010:isolate_migratepages_block+0xad/0xa50
[ 1572.247938] Code: 89 ef e8 06 91 ff ff 49 89 c7 be 01 00 00 00 48 89 ef e8 f6 90 ff ff 49 89 c5 be 08 00 00 00 48 89 ef e8 e6 90 ff ff 49 89 c4 <be> 07 00 00 00 48 89 ef e8 d6 90 ff ff 49 01 c4 4c 03 3c 24 4d 01
[ 1572.247944] RSP: 0018:ffffbd38cfdf7958 EFLAGS: 00000246
[ 1572.247952] RAX: 0000000000000000 RBX: 00000000006f1ba0 RCX: 000000000000000c
[ 1572.247955] RDX: 0000000000000000 RSI: 0000000000000008 RDI: ffff9699cdfde000
[ 1572.247958] RBP: ffff9699cdfde000 R08: 0000000000000001 R09: ffff9699ad7dd550
[ 1572.247964] R10: 0000000000000001 R11: ffff9699ad7dcb80 R12: 0000000000000000
[ 1572.247969] R13: 00000000000012b2 R14: ffffbd38cfdf7ad0 R15: 00000000000018a8
[ 1572.247972] FS: 0000710f1082f740(0000) GS:ffff9699ad780000(0000) knlGS:0000000000000000
[ 1572.247974] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1572.247977] CR2: 000072d7ae4d9578 CR3: 00000007c59c4001 CR4: 00000000003606e0
[ 1572.247980] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1572.247983] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1572.247987] Call Trace:
[ 1572.247990] compact_zone+0x577/0xa70
[ 1572.247992] compact_zone_order+0xde/0x120
[ 1572.247995] try_to_compact_pages+0x187/0x240
[ 1572.248000] __alloc_pages_direct_compact+0x87/0x170
[ 1572.248004] __alloc_pages_slowpath+0x454/0xc20
[ 1572.248007] __alloc_pages_nodemask+0x268/0x2b0
[ 1572.248010] do_huge_pmd_anonymous_page+0x131/0x5c0
[ 1572.248013] ? mem_cgroup_throttle_swaprate+0x20/0x113
[ 1572.248018] __handle_mm_fault+0xc0c/0x1310
[ 1572.248023] handle_mm_fault+0xa9/0x1d0
[ 1572.248026] __do_page_fault+0x237/0x480
[ 1572.248030] do_page_fault+0x1d/0x67
[ 1572.248035] ? page_fault+0x8/0x30
[ 1572.248039] page_fault+0x1e/0x30
[ 1572.248042] RIP: 0033:0x5f7c81c80c10
[ 1572.248046] Code: c0 0f 84 53 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f fa 00 00 00 31 c0 4d 85 ff 7e 10 0f 1f 40 00 <c6> 04 03 5a 4c 01 f0 49 39 c7 7f f4 4d 85 e4 0f 84 f4 01 00 00 7e
[ 1572.248050] RSP: 002b:00007ffdb884d190 EFLAGS: 00010206
[ 1572.248058] RAX: 0000000026a90000 RBX: 0000710cbc770010 RCX: 0000710f109543db
[ 1572.248060] RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000710cbc770000
[ 1572.248065] RBP: 00005f7c81c81a54 R08: 0000710cbc770010 R09: 0000000000000000
[ 1572.248070] R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
[ 1572.248073] R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
[ 1572.248078] NMI backtrace for cpu 6
[ 1572.248082] CPU: 6 PID: 1258 Comm: dmesg Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
[ 1572.248087] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
[ 1572.248092] RIP: 0033:0x7cfec2fbca97
[ 1572.248097] Code: 00 00 00 83 e1 1f 48 83 e7 e0 c5 7e 6f 07 c4 c1 7d 74 c8 c4 c1 35 74 d0 c5 ed eb c9 c5 fd d7 c1 d3 f8 85 c0 74 1d f3 0f bc c0 <48> 01 c8 31 d2 48 8d 04 07 40 3a 30 48 0f 45 c2 c5 f8 77 c3 0f 1f
[ 1572.248102] RSP: 002b:00007fffc45dab98 EFLAGS: 00000202
[ 1572.248110] RAX: 0000000000000001 RBX: 0000582b21b12475 RCX: 000000000000001a
[ 1572.248113] RDX: 0000000000000000 RSI: 000000000000005f RDI: 0000582b21b0e7e0
[ 1572.248118] RBP: 0000582b21b0e7fa R08: 000000000000000a R09: 0000000000000000
[ 1572.248123] R10: 00007fffc45da9ac R11: 0000000000000246 R12: 0000582b21b12459
[ 1572.248126] R13: 0000582b21b0d377 R14: 0000582b21b12440 R15: 0000582b21b12456
[ 1572.248131] FS: 00007cfec2e27740 GS: 0000000000000000
[ 1572.248134] NMI backtrace for cpu 7
[ 1572.248137] CPU: 7 PID: 1249 Comm: dmesg Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
[ 1572.248143] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
[ 1572.248145] RIP: 0010:number+0x234/0x360
[ 1572.248149] Code: c6 00 20 48 ff c0 4c 39 c0 75 f0 48 8b 44 24 30 65 48 33 04 25 28 00 00 00 0f 85 31 01 00 00 4c 89 c0 48 83 c4 38 5b 5d 41 5c <41> 5d 41 5e 41 5f c3 83 e5 ef 44 88 7c 24 16 e9 2e fe ff ff 48 f7
[ 1572.248152] RSP: 0018:ffffbd38c541bd40 EFLAGS: 00000086
[ 1572.248163] RAX: ffff96994b6f0059 RBX: ffffbd38c541bdb8 RCX: 00000000fffffffb
[ 1572.248168] RDX: ffffbd38c541bd07 RSI: 0000000000000034 RDI: ffff969a4b6f0056
[ 1572.248170] RBP: ffff96994b6f2058 R08: ffff96994b6f0059 R09: 0000000000000000
[ 1572.248172] R10: 0000000000000004 R11: ffff96994b6f0059 R12: ffffffff92e33a07
[ 1572.248179] R13: 0000000000000000 R14: 0000000000ffff0a R15: 0000000000000000
[ 1572.248183] FS: 00007ef911609740(0000) GS:ffff9699ad980000(0000) knlGS:0000000000000000
[ 1572.248186] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1572.248188] CR2: 00007d5d665cfae0 CR3: 00000007cb6ec002 CR4: 00000000003606e0
[ 1572.248192] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1572.248199] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1572.248201] Call Trace:
[ 1572.248203] vsnprintf+0x3e1/0x5b0
[ 1572.248207] scnprintf+0x4d/0x90
[ 1572.248212] msg_print_ext_header.constprop.0+0x7f/0xa0
[ 1572.248217] ? _cond_resched+0x10/0x20
[ 1572.248219] ? mutex_lock_interruptible+0x9/0x30
[ 1572.248225] devkmsg_read+0x17f/0x270
[ 1572.248227] vfs_read+0x98/0x150
[ 1572.248232] ksys_read+0x5d/0xe0
[ 1572.248234] do_syscall_64+0x50/0x170
[ 1572.248241] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 1572.248245] RIP: 0033:0x7ef911723415
[ 1572.248251] Code: fe ff ff 55 48 89 e5 48 8d 3d 4f bf 0a 00 e8 22 25 02 00 66 90 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 c5 fc 77 0f 05 <48> 3d 00 f0 ff ff 77 53 c3 66 90 55 48 89 e5 48 83 ec 20 48 89 55
[ 1572.248255] RSP: 002b:00007ffcf81cb498 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
[ 1572.248262] RAX: ffffffffffffffda RBX: 00005571c56a2440 RCX: 00007ef911723415
[ 1572.248267] RDX: 0000000000001fff RSI: 00005571c56a2440 RDI: 0000000000000003
[ 1572.248271] RBP: 00005571c569e7fa R08: 000000000000000a R09: 0000000000000000
[ 1572.248273] R10: 00007ffcf81cb2cc R11: 0000000000000246 R12: 000000000000001c
[ 1572.248278] R13: 00005571c569d377 R14: 00005571c56a2440 R15: 00005571c56a2456
[ 1572.248285] NMI backtrace for cpu 9
[ 1572.248288] CPU: 9 PID: 400 Comm: systemd-journal Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
[ 1572.248292] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
[ 1572.248300] RIP: 0010:queued_spin_lock_slowpath+0x17b/0x1d0
[ 1572.248307] Code: e5 83 e0 03 48 c1 e0 04 48 05 c0 d7 05 00 c1 ee 12 ff ce 48 63 f6 48 03 04 f5 a0 15 ed 92 48 89 10 8b 42 08 85 c0 75 09 f3 90 <8b> 42 08 85 c0 74 f7 48 8b 02 48 85 c0 74 8c 48 89 c6 0f 0d 08 eb
[ 1572.248310] RSP: 0018:ffffbd38c34cbd50 EFLAGS: 00000046
[ 1572.248322] RAX: 0000000000000000 RBX: ffff9699a86f4370 RCX: 0000000000280000
[ 1572.248325] RDX: ffff9699adadd7c0 RSI: 0000000000000005 RDI: ffffffff935a02ac
[ 1572.248333] RBP: ffffbd38c34cbda8 R08: 0000000000000009 R09: 0000000000000000
[ 1572.248336] R10: 0000000000000000 R11: 0000000000000000 R12: ffff9699a4980000
[ 1572.248342] R13: 00007ffddcf63680 R14: ffffbd38c34cbe00 R15: ffff9699a86f4318
[ 1572.248346] FS: 00007c88db99c840(0000) GS:ffff9699ada80000(0000) knlGS:0000000000000000
[ 1572.248351] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1572.248359] CR2: 00007c88cf9be3c0 CR3: 00000008286d4001 CR4: 00000000003606e0
[ 1572.248364] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1572.248369] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1572.248375] Call Trace:
[ 1572.248382] devkmsg_poll+0x3c/0x80
[ 1572.248388] ep_item_poll.isra.0+0x3a/0xb0
[ 1572.248391] ep_send_events_proc+0xec/0x230
[ 1572.248394] ? ep_read_events_proc+0xe0/0xe0
[ 1572.248403] ep_scan_ready_list.constprop.0+0x9b/0x1f0
[ 1572.248408] ep_poll+0x87/0x450
[ 1572.248412] do_epoll_wait+0xab/0xd0
[ 1572.248419] __x64_sys_epoll_wait+0x15/0x20
[ 1572.248424] do_syscall_64+0x50/0x170
[ 1572.248428] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 1572.248435] RIP: 0033:0x7c88dd1b20b5
[ 1572.248439] Code: 89 55 f8 48 89 75 f0 89 7d fc e8 e6 18 f7 ff 41 89 c0 44 8b 55 ec 8b 55 f8 48 8b 75 f0 8b 7d fc b8 e8 00 00 00 c5 fc 77 0f 05 <48> 3d 00 f0 ff ff 77 25 89 45 fc 44 89 c7 e8 18 19 f7 ff 8b 45 fc
[ 1572.248444] RSP: 002b:00007ffddcf63650 EFLAGS: 00000293 ORIG_RAX: 00000000000000e8
[ 1572.248458] RAX: ffffffffffffffda RBX: 00006265e2ccc3d0 RCX: 00007c88dd1b20b5
[ 1572.248461] RDX: 0000000000000020 RSI: 00007ffddcf63680 RDI: 0000000000000007
[ 1572.248465] RBP: 00007ffddcf63670 R08: 0000000000000000 R09: 0000000000000020
[ 1572.248471] R10: 00000000dd84bf82 R11: 0000000000000293 R12: 00007ffddcf63680
[ 1572.248478] R13: 000007494e8c1088 R14: 0000000000000000 R15: 0000000000000001
[ 1572.248486] NMI backtrace for cpu 11
[ 1572.248490] CPU: 11 PID: 20040 Comm: dmesg Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
[ 1572.248493] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
[ 1572.248502] RIP: 0033:0x7717bcea7cbb
[ 1572.248509] Code: 48 83 ec 18 49 89 f5 4c 0f af ea 4d 85 ed 0f 84 f0 00 00 00 49 89 ff 49 89 f6 49 89 d4 48 89 cb 8b 11 81 e2 00 80 00 00 75 44 <64> 48 8b 04 25 10 00 00 00 48 89 45 c8 48 8b b9 88 00 00 00 48 39
[ 1572.248518] RSP: 002b:00007fff79d5f6a0 EFLAGS: 00000246
[ 1572.248531] RAX: 0000000000000001 RBX: 00007717bd00b500 RCX: 00007717bd00b500
[ 1572.248534] RDX: 0000000000000000 RSI: 0000000000000001 RDI: 000062592cea0487
[ 1572.248538] RBP: 00007fff79d5f6e0 R08: 000062592cea0488 R09: 0000000000000000
[ 1572.248544] R10: 00007fff79d5f71c R11: 000062592cea0487 R12: 0000000000000001
[ 1572.248552] R13: 0000000000000001 R14: 0000000000000001 R15: 000062592cea0487
[ 1572.248557] FS: 00007717bce1c740 GS: 0000000000000000
[ 1572.248563] NMI backtrace for cpu 10
[ 1572.248567] CPU: 10 PID: 1260 Comm: grep Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
[ 1572.248570] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
[ 1572.248577] RIP: 0010:ZSTD_decompressSequences+0x6be/0xb80
[ 1572.248586] Code: 8b 39 48 89 7c 24 68 84 c0 74 13 f3 0f bd c0 8d 48 e9 89 ce 49 83 fc ea 0f 86 2c fb ff ff 49 c7 c5 f2 ff ff ff e9 21 fa ff ff <89> d0 44 8b 34 85 00 f0 c7 92 44 8b 54 24 70 c4 e2 a9 f7 44 24 68
[ 1572.248589] RSP: 0018:ffffbd38c5a37838 EFLAGS: 00000202
[ 1572.248599] RAX: 0000000000000008 RBX: 0000000000000000 RCX: ffffbd38c6022048
[ 1572.248606] RDX: 0000000000000008 RSI: ffffbd38c6022d30 RDI: ffffbd38c60228a4
[ 1572.248611] RBP: 0000000000000000 R08: 0000000000000099 R09: 0000000000000001
[ 1572.248617] R10: 0000000000000007 R11: 0000000000000006 R12: 0000000000000001
[ 1572.248622] R13: 0000000000000006 R14: fffffffffffffffe R15: ffff969928146263
[ 1572.248628] FS: 000077c96a004740(0000) GS:ffff9699adb00000(0000) knlGS:0000000000000000
[ 1572.248635] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1572.248642] CR2: 00005a61235ce000 CR3: 00000007cba90004 CR4: 00000000003606e0
[ 1572.248648] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1572.248659] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1572.248666] Call Trace:
[ 1572.248672] ZSTD_decompressMultiFrame+0x329/0x370
[ 1572.248677] ZSTD_decompressDCtx+0xc/0x10
[ 1572.248680] zstd_decompress+0x1f/0x40
[ 1572.248685] zcomp_decompress+0x2e/0x50
[ 1572.248690] zram_bvec_rw.isra.0+0x5e2/0x6a0
[ 1572.248699] zram_rw_page+0x7f/0xe0
[ 1572.248705] bdev_read_page+0x6e/0xa0
[ 1572.248710] swap_readpage+0xaf/0x1f0
[ 1572.248713] do_swap_page+0x72e/0x7e0
[ 1572.248718] __handle_mm_fault+0xa77/0x1310
[ 1572.248722] handle_mm_fault+0xa9/0x1d0
[ 1572.248725] __do_page_fault+0x237/0x480
[ 1572.248734] do_page_fault+0x1d/0x67
[ 1572.248741] ? reweight_entity+0x15a/0x1a0
[ 1572.248744] page_fault+0x1e/0x30
[ 1572.248749] RIP: 0010:copy_user_generic_unrolled+0x89/0xc0
[ 1572.248758] Code: 38 4c 89 47 20 4c 89 4f 28 4c 89 57 30 4c 89 5f 38 48 8d 76 40 48 8d 7f 40 ff c9 75 b6 89 d1 83 e2 07 c1 e9 03 74 12 4c 8b 06 <4c> 89 07 48 8d 76 08 48 8d 7f 08 ff c9 75 ee 21 d2 74 10 89 d1 8a
[ 1572.248766] RSP: 0018:ffffbd38c5a37d90 EFLAGS: 00050203
[ 1572.248780] RAX: 0000000000000016 RBX: ffff96972af7c000 RCX: 0000000000000001
[ 1572.248783] RDX: 0000000000000006 RSI: ffff96972af7c008 RDI: 00005a61235cdffe
[ 1572.248789] RBP: 0000000000000016 R08: 363478302b6b6361 R09: 0000000000000000
[ 1572.248794] R10: 0000000000000003 R11: ffff9699a2261e00 R12: 0000000000000016
[ 1572.248800] R13: ffffbd38c5a37e50 R14: 0000000000000000 R15: 0000000000000000
[ 1572.248803] copyout+0x28/0x30
[ 1572.248806] copy_page_to_iter+0xbc/0x2f0
[ 1572.248809] pipe_read+0xad/0x2c0
[ 1572.248814] new_sync_read+0x10f/0x1a0
[ 1572.248821] vfs_read+0x98/0x150
[ 1572.248826] ksys_read+0x5d/0xe0
[ 1572.248832] do_syscall_64+0x50/0x170
[ 1572.248837] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 1572.248840] RIP: 0033:0x77c96a140415
[ 1572.248849] Code: fe ff ff 55 48 89 e5 48 8d 3d 4f bf 0a 00 e8 22 25 02 00 66 90 f3 0f 1e fa 64 8b 04 25 18 00 00 00 85 c0 75 10 c5 fc 77 0f 05 <48> 3d 00 f0 ff ff 77 53 c3 66 90 55 48 89 e5 48 83 ec 20 48 89 55
[ 1572.248855] RSP: 002b:00007fff87565c78 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
[ 1572.248869] RAX: ffffffffffffffda RBX: 000000000000e000 RCX: 000077c96a140415
[ 1572.248877] RDX: 000000000000e000 RSI: 00005a61235cdff6 RDI: 0000000000000000
[ 1572.248886] RBP: 000000000000e000 R08: 0000000000000000 R09: 0000000000019008
[ 1572.248890] R10: 00005a61235b85a0 R11: 0000000000000246 R12: 00005a61235cdff6
[ 1572.248893] R13: 0000000000000000 R14: 00005a61235c3100 R15: 0000000000000000
```
Ignore the dmesg process, I've had two programs that keep querrying it and I've put process to 800Mhz max, to avoid high power usage during this.
the swap is in zram
/etc/fstab shows:
/dev/zram0 none swap defaults,discard 0 0
$ zramctl
NAME ALGORITHM DISKSIZE DATA COMPR TOTAL STREAMS MOUNTPOINT
/dev/zram2 zstd 64G 4.7M 136.3K 248K 12 /var/tmp
/dev/zram1 zstd 64G 320.3M 84.1M 88M 12 /tmp
/dev/zram0 zstd 64G 1.6G 75.6M 230.6M 12 [SWAP]
I can't find a reliable way to reproduce it, it seems to happen sort of random...
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [Bug 204165] New: 100% CPU usage in compact_zone_order
2019-07-16 1:52 ` howaboutsynergy
@ 2019-07-16 3:25 ` howaboutsynergy
2019-07-16 3:57 ` howaboutsynergy
0 siblings, 1 reply; 12+ messages in thread
From: howaboutsynergy @ 2019-07-16 3:25 UTC (permalink / raw)
To: Andrew Morton; +Cc: bugzilla-daemon, linux-mm, Mel Gorman
I got more info/better stacktrace(seen at the end):
[ 4793.539013] sysrq: Show backtrace of all active CPUs
[ 4793.539019] NMI backtrace for cpu 8
[ 4793.539026] CPU: 8 PID: 21120 Comm: stress Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
[ 4793.539029] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
[ 4793.539032] Call Trace:
[ 4793.539036] <IRQ>
[ 4793.539047] dump_stack+0x46/0x60
[ 4793.539054] nmi_cpu_backtrace.cold+0x14/0x53
[ 4793.539061] ? lapic_can_unplug_cpu.cold+0x42/0x42
[ 4793.539067] nmi_trigger_cpumask_backtrace+0x8e/0x90
[ 4793.539073] __handle_sysrq.cold+0x48/0x102
[ 4793.539078] sysrq_filter+0x2ea/0x3b0
[ 4793.539084] input_to_handler+0x4d/0xf0
[ 4793.539090] input_pass_values.part.0+0x109/0x130
[ 4793.539096] input_handle_event+0x171/0x5a0
[ 4793.539101] input_event+0x4d/0x70
[ 4793.539107] hidinput_report_event+0x2e/0x40
[ 4793.539112] hid_report_raw_event+0x260/0x430
[ 4793.539118] hid_input_report+0xfb/0x150
[ 4793.539124] hid_irq_in+0x168/0x190
[ 4793.539131] __usb_hcd_giveback_urb+0x77/0xe0
[ 4793.539148] xhci_giveback_urb_in_irq.isra.0+0x62/0x90 [xhci_hcd]
[ 4793.539163] xhci_td_cleanup+0xf7/0x140 [xhci_hcd]
[ 4793.539177] xhci_irq+0x7e8/0x1be0 [xhci_hcd]
[ 4793.539185] __handle_irq_event_percpu+0x2f/0xc0
[ 4793.539191] handle_irq_event_percpu+0x2c/0x80
[ 4793.539196] handle_irq_event+0x23/0x43
[ 4793.539202] handle_edge_irq+0x78/0x190
[ 4793.539208] handle_irq+0x17/0x20
[ 4793.539215] do_IRQ+0x3e/0xd0
[ 4793.539221] common_interrupt+0xf/0xf
[ 4793.539225] </IRQ>
[ 4793.539231] RIP: 0010:isolate_migratepages_block+0x1d3/0xa50
[ 4793.539237] Code: df 77 27 45 84 ed 74 22 4d 85 d2 0f 85 a7 00 00 00 41 8b 44 24 60 be 01 00 00 00 c4 e2 f9 f7 c6 4c 8d 3c 18 48 f7 d8 49 21 c7 <f6> c3 1f 0f 84 ec 00 00 00 48 ff 44 24 10 48 8b 05 68 b3 d1 00 48
[ 4793.539240] RSP: 0018:ffff9cb9a9f57958 EFLAGS: 00000206 ORIG_RAX: ffffffffffffffde
[ 4793.539246] RAX: ffff9cb9a9f57b49 RBX: 00000000004b4b00 RCX: 000000000000000c
[ 4793.539249] RDX: 00000000004b4c00 RSI: 0000000000000007 RDI: 0000000000000000
[ 4793.539252] RBP: ffff8fd8cdfde000 R08: ffff8fd8cdfd9960 R09: ffff8fd8ada5d550
[ 4793.539254] R10: 0000000000000000 R11: ffff8fd8ada5cb80 R12: ffff9cb9a9f57ad0
[ 4793.539257] R13: 0000000000000001 R14: ffff9cb9a9f57ad0 R15: 00000000004b4c00
[ 4793.539264] ? isolate_migratepages_block+0xd5/0xa50
[ 4793.539269] compact_zone+0x577/0xa70
[ 4793.539275] compact_zone_order+0xde/0x120
[ 4793.539280] try_to_compact_pages+0x187/0x240
[ 4793.539286] __alloc_pages_direct_compact+0x87/0x170
[ 4793.539291] __alloc_pages_slowpath+0x20e/0xc20
[ 4793.539297] ? release_pages+0x348/0x3b0
[ 4793.539303] ? __pagevec_lru_add_fn+0x189/0x2a0
[ 4793.539307] __alloc_pages_nodemask+0x268/0x2b0
[ 4793.539314] do_huge_pmd_anonymous_page+0x131/0x5c0
[ 4793.539321] __handle_mm_fault+0xc0c/0x1310
[ 4793.539327] handle_mm_fault+0xa9/0x1d0
[ 4793.539333] __do_page_fault+0x237/0x480
[ 4793.539339] do_page_fault+0x1d/0x67
[ 4793.539345] ? page_fault+0x8/0x30
[ 4793.539350] page_fault+0x1e/0x30
[ 4793.539355] RIP: 0033:0x5879fc8c4c10
[ 4793.539360] Code: c0 0f 84 53 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f fa 00 00 00 31 c0 4d 85 ff 7e 10 0f 1f 40 00 <c6> 04 03 5a 4c 01 f0 49 39 c7 7f f4 4d 85 e4 0f 84 f4 01 00 00 7e
[ 4793.539363] RSP: 002b:00007ffd393aa0d0 EFLAGS: 00010206
[ 4793.539367] RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
[ 4793.539370] RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
[ 4793.539373] RBP: 00005879fc8c5a54 R08: 0000714104876010 R09: 0000000000000000
[ 4793.539376] R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
[ 4793.539379] R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
[ 4793.539385] Sending NMI from CPU 8 to CPUs 0-7,9-11:
[ 4793.539450] NMI backtrace for cpu 0 skipped: idling at intel_idle+0x7d/0x120
[ 4793.539541] NMI backtrace for cpu 1 skipped: idling at intel_idle+0x7d/0x120
[ 4793.539606] NMI backtrace for cpu 2 skipped: idling at intel_idle+0x7d/0x120
[ 4793.539815] NMI backtrace for cpu 3
crash> task 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 4 COMMAND: "stress"
struct task_struct {
thread_info = {
flags = 2147500036,
status = 0
},
state = 0,
stack = 0xffff9cb9a9f54000,
usage = {
refs = {
counter = 2
}
},
flags = 20990016,
ptrace = 0,
wake_entry = {
next = 0x0
},
on_cpu = 1,
cpu = 4,
wakee_flips = 0,
wakee_flip_decay_ts = 4299663580,
last_wakee = 0xffff8fd8a9e01e40,
recent_used_cpu = 4,
wake_cpu = 4,
on_rq = 1,
prio = 120,
static_prio = 120,
normal_prio = 120,
rt_priority = 0,
sched_class = 0xffffffff98c0f700,
se = {
load = {
weight = 1048576,
inv_weight = 4194304
},
runnable_weight = 1048576,
run_node = {
__rb_parent_color = 1,
rb_right = 0x0,
rb_left = 0x0
},
group_node = {
next = 0xffff8fd8ad85d550,
prev = 0xffff8fd8ad85d550
},
on_rq = 1,
exec_start = 4987351794570,
sum_exec_runtime = 275188015038,
vruntime = 268378190293,
prev_sum_exec_runtime = 275071762024,
nr_migrations = 75,
statistics = {
wait_start = 0,
wait_max = 0,
wait_count = 0,
wait_sum = 0,
iowait_count = 0,
iowait_sum = 0,
sleep_start = 0,
sleep_max = 0,
sum_sleep_runtime = 0,
block_start = 0,
block_max = 0,
exec_max = 0,
slice_max = 0,
nr_migrations_cold = 0,
nr_failed_migrations_affine = 0,
nr_failed_migrations_running = 0,
nr_failed_migrations_hot = 0,
nr_forced_migrations = 0,
nr_wakeups = 0,
nr_wakeups_sync = 0,
nr_wakeups_migrate = 0,
nr_wakeups_local = 0,
nr_wakeups_remote = 0,
nr_wakeups_affine = 0,
nr_wakeups_affine_attempts = 0,
nr_wakeups_passive = 0,
nr_wakeups_idle = 0
},
depth = 1,
parent = 0xffff8fd38de23000,
cfs_rq = 0xffff8fd38de20e00,
my_q = 0x0,
avg = {
last_update_time = 4987351793664,
load_sum = 47037,
runnable_load_sum = 47037,
util_sum = 48192640,
period_contrib = 320,
load_avg = 1023,
runnable_load_avg = 1023,
util_avg = 1024,
util_est = {
enqueued = 100,
ewma = 75
}
}
},
rt = {
run_list = {
next = 0xffff8fd7f10ddd00,
prev = 0xffff8fd7f10ddd00
},
timeout = 0,
watchdog_stamp = 0,
time_slice = 100,
on_rq = 0,
on_list = 0,
back = 0x0
},
sched_task_group = 0xffff8fd8a69f7480,
dl = {
rb_node = {
__rb_parent_color = 18446620756357799224,
rb_right = 0x0,
rb_left = 0x0
},
dl_runtime = 0,
dl_deadline = 0,
dl_period = 0,
dl_bw = 0,
dl_density = 0,
runtime = 0,
deadline = 0,
flags = 0,
dl_throttled = 0,
dl_boosted = 0,
dl_yielded = 0,
dl_non_contending = 0,
dl_overrun = 0,
dl_timer = {
node = {
node = {
__rb_parent_color = 18446620756357799312,
rb_right = 0x0,
rb_left = 0x0
},
expires = 0
},
_softexpires = 0,
function = 0xffffffff980dac70,
base = 0xffff8fd8ad958b00,
state = 0 '\000',
is_rel = 0 '\000',
is_soft = 0 '\000'
},
inactive_timer = {
node = {
node = {
__rb_parent_color = 18446620756357799376,
rb_right = 0x0,
rb_left = 0x0
},
expires = 0
},
_softexpires = 0,
function = 0xffffffff980d8ca0,
base = 0xffff8fd8ad958b00,
state = 0 '\000',
is_rel = 0 '\000',
is_soft = 0 '\000'
}
},
policy = 0,
nr_cpus_allowed = 12,
cpus_allowed = {
bits = {4095}
},
sched_info = {
pcount = 927,
run_delay = 10768613805,
last_arrival = 4997587172423,
last_queued = 0
},
tasks = {
next = 0xffff8fd7ef4e8380,
prev = 0xffff8fd80b12a1c0
},
pushable_tasks = {
prio = 140,
prio_list = {
next = 0xffff8fd7f10dde58,
prev = 0xffff8fd7f10dde58
},
node_list = {
next = 0xffff8fd7f10dde68,
prev = 0xffff8fd7f10dde68
}
},
pushable_dl_tasks = {
__rb_parent_color = 18446620756357799544,
rb_right = 0x0,
rb_left = 0x0
},
mm = 0xffff8fd84a0c0000,
active_mm = 0xffff8fd84a0c0000,
vmacache = {
seqnum = 0,
vmas = {0xffff8fd8064dcd80, 0xffff8fd188b0ce40, 0xffff8fd73833ed80, 0x0}
},
rss_stat = {
events = 59,
count = {0, 54, 0, 0}
},
exit_state = 0,
exit_code = 0,
exit_signal = 17,
pdeath_signal = 0,
jobctl = 0,
personality = 0,
sched_reset_on_fork = 0,
sched_contributes_to_load = 1,
sched_migrated = 0,
sched_remote_wakeup = 0,
sched_psi_wake_requeue = 0,
in_execve = 0,
in_iowait = 0,
restore_sigmask = 0,
in_user_fault = 1,
no_cgroup_migration = 0,
frozen = 0,
use_memdelay = 0,
atomic_flags = 0,
restart_block = {
fn = 0xffffffff980a97b0,
{
futex = {
uaddr = 0x791b80,
val = 0,
flags = 0,
bitset = 30,
time = 685393978,
uaddr2 = 0x0
},
nanosleep = {
clockid = 7936896,
type = TT_NONE,
{
rmtp = 0x0,
compat_rmtp = 0x0
},
expires = 30
},
poll = {
ufds = 0x791b80,
nfds = 0,
has_timeout = 0,
tv_sec = 30,
tv_nsec = 685393978
}
}
},
pid = 21120,
tgid = 21120,
stack_canary = 2699928380174480896,
real_parent = 0xffff8fd80b129e40,
parent = 0xffff8fd80b129e40,
children = {
next = 0xffff8fd7f10ddf60,
prev = 0xffff8fd7f10ddf60
},
sibling = {
next = 0xffff8fd7ef4e84b0,
prev = 0xffff8fd80b12a2e0
},
group_leader = 0xffff8fd7f10ddac0,
ptraced = {
next = 0xffff8fd7f10ddf88,
prev = 0xffff8fd7f10ddf88
},
ptrace_entry = {
next = 0xffff8fd7f10ddf98,
prev = 0xffff8fd7f10ddf98
},
thread_pid = 0xffff8fd8a5c6e000,
pid_links = {{
next = 0x0,
pprev = 0xffff8fd8a5c6e008
}, {
next = 0x0,
pprev = 0xffff8fd8a5c6e010
}, {
next = 0xffff8fd80b12a350,
pprev = 0xffff8fd7ef4e8510
}, {
next = 0xffff8fd80b12a360,
pprev = 0xffff8fd7ef4e8520
}},
thread_group = {
next = 0xffff8fd7f10ddff0,
prev = 0xffff8fd7f10ddff0
},
thread_node = {
next = 0xffff8fd18547bfd0,
prev = 0xffff8fd18547bfd0
},
vfork_done = 0x0,
set_child_tid = 0x714358935a10,
clear_child_tid = 0x714358935a10,
utime = 2991526,
stime = 275229123556,
gtime = 0,
prev_cputime = {
utime = 0,
stime = 0,
lock = {
raw_lock = {
{
val = {
counter = 0
},
{
locked = 0 '\000',
pending = 0 '\000'
},
{
locked_pending = 0,
tail = 0
}
}
}
}
},
vtime = {
seqcount = {
sequence = 0
},
starttime = 0,
state = VTIME_INACTIVE,
utime = 0,
stime = 0,
gtime = 0
},
tick_dep_mask = {
counter = 0
},
nvcsw = 64,
nivcsw = 862,
start_time = 4707054953905,
real_start_time = 4707054953927,
min_flt = 16888,
maj_flt = 0,
cputime_expires = {
utime = 0,
stime = 0,
sum_exec_runtime = 0
},
cpu_timers = {{
next = 0xffff8fd7f10de0d8,
prev = 0xffff8fd7f10de0d8
}, {
next = 0xffff8fd7f10de0e8,
prev = 0xffff8fd7f10de0e8
}, {
next = 0xffff8fd7f10de0f8,
prev = 0xffff8fd7f10de0f8
}},
ptracer_cred = 0x0,
real_cred = 0xffff8fd188b0cd80,
cred = 0xffff8fd188b0cd80,
comm = "stress\000ce4-term",
nameidata = 0x0,
sysvsem = {
undo_list = 0x0
},
sysvshm = {
shm_clist = {
next = 0xffff8fd7f10de140,
prev = 0xffff8fd7f10de140
}
},
last_switch_count = 0,
last_switch_time = 0,
fs = 0xffff8fd84b0e8f40,
files = 0xffff8fd2944fd600,
nsproxy = 0xffffffff990349a0,
signal = 0xffff8fd18547bfc0,
sighand = 0xffff8fd3c8277380,
blocked = {
sig = {0}
},
real_blocked = {
sig = {0}
},
saved_sigmask = {
sig = {512}
},
pending = {
list = {
next = 0xffff8fd7f10de1a0,
prev = 0xffff8fd7f10de1a0
},
signal = {
sig = {256}
}
},
sas_ss_sp = 0,
sas_ss_size = 0,
sas_ss_flags = 2,
task_works = 0x0,
audit_context = 0x0,
loginuid = {
val = 1000
},
sessionid = 1,
seccomp = {
mode = 0,
filter = 0x0
},
parent_exec_id = 15,
self_exec_id = 15,
alloc_lock = {
{
rlock = {
raw_lock = {
{
val = {
counter = 0
},
{
locked = 0 '\000',
pending = 0 '\000'
},
{
locked_pending = 0,
tail = 0
}
}
}
}
}
},
pi_lock = {
raw_lock = {
{
val = {
counter = 0
},
{
locked = 0 '\000',
pending = 0 '\000'
},
{
locked_pending = 0,
tail = 0
}
}
}
},
wake_q = {
next = 0x0
},
pi_waiters = {
rb_root = {
rb_node = 0x0
},
rb_leftmost = 0x0
},
pi_top_task = 0x0,
pi_blocked_on = 0x0,
journal_info = 0x0,
bio_list = 0x0,
plug = 0x0,
reclaim_state = 0x0,
backing_dev_info = 0x0,
io_context = 0xffff8fd84b2ce888,
capture_control = 0xffff9cb9a9f57ac0,
ptrace_message = 0,
last_siginfo = 0x0,
ioac = {
rchar = 0,
wchar = 0,
syscr = 0,
syscw = 0,
read_bytes = 0,
write_bytes = 0,
cancelled_write_bytes = 0
},
psi_flags = 6,
acct_rss_mem1 = 3212941986541,
acct_vm_mem1 = 656456860857633,
acct_timexpd = 275231119481,
mems_allowed = {
bits = {1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0}
},
mems_allowed_seq = {
sequence = 0
},
cpuset_mem_spread_rotor = -1,
cpuset_slab_spread_rotor = -1,
cgroups = 0xffff8fd8a4d01800,
cg_list = {
next = 0xffff8fd7ef4e88a8,
prev = 0xffff8fd80b12a6e8
},
robust_list = 0x0,
compat_robust_list = 0x0,
pi_state_list = {
next = 0xffff8fd7f10de388,
prev = 0xffff8fd7f10de388
},
pi_state_cache = 0x0,
perf_event_ctxp = {0x0, 0x0},
perf_event_mutex = {
owner = {
counter = 0
},
wait_lock = {
{
rlock = {
raw_lock = {
{
val = {
counter = 0
},
{
locked = 0 '\000',
pending = 0 '\000'
},
{
locked_pending = 0,
tail = 0
}
}
}
}
}
},
osq = {
tail = {
counter = 0
}
},
wait_list = {
next = 0xffff8fd7f10de3c0,
prev = 0xffff8fd7f10de3c0
}
},
perf_event_list = {
next = 0xffff8fd7f10de3d0,
prev = 0xffff8fd7f10de3d0
},
mempolicy = 0x0,
il_prev = 0,
pref_node_fork = 0,
numa_scan_seq = 0,
numa_scan_period = 1000,
numa_scan_period_max = 0,
numa_preferred_nid = -1,
numa_migrate_retry = 0,
node_stamp = 0,
last_task_numa_placement = 0,
last_sum_exec_runtime = 0,
numa_work = {
next = 0xffff8fd7f10de420,
func = 0x0
},
numa_group = 0x0,
numa_faults = 0x0,
total_numa_faults = 0,
numa_faults_locality = {0, 0, 0},
numa_pages_migrated = 0,
rseq = 0x0,
rseq_sig = 0,
rseq_event_mask = 5,
tlb_ubc = {
arch = {
cpumask = {
bits = {0}
}
},
flush_required = false,
writable = false
},
rcu = {
next = 0x0,
func = 0x0
},
splice_pipe = 0x0,
task_frag = {
page = 0x0,
offset = 0,
size = 0
},
delays = 0xffff8fd8a638d3c0,
nr_dirtied = 0,
nr_dirtied_pause = 32,
dirty_paused_when = 0,
latency_record_count = 0,
latency_record = {{
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}, {
backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
count = 0,
time = 0,
max = 0
}},
timer_slack_ns = 50000,
default_timer_slack_ns = 50000,
memcg_in_oom = 0x0,
memcg_oom_gfp_mask = 0,
memcg_oom_order = 0,
memcg_nr_pages_over_high = 0,
active_memcg = 0x0,
throttle_queue = 0x0,
pagefault_disabled = 0,
oom_reaper_list = 0x0,
stack_vm_area = 0xffff8fd3895a9fc0,
stack_refcount = {
refs = {
counter = 1
}
},
security = 0x0,
thread = {
tls_array = {{
limit0 = 0,
base0 = 0,
base1 = 0,
type = 0,
s = 0,
dpl = 0,
p = 0,
limit1 = 0,
avl = 0,
l = 0,
d = 0,
g = 0,
base2 = 0
}, {
limit0 = 0,
base0 = 0,
base1 = 0,
type = 0,
s = 0,
dpl = 0,
p = 0,
limit1 = 0,
avl = 0,
l = 0,
d = 0,
g = 0,
base2 = 0
}, {
limit0 = 0,
base0 = 0,
base1 = 0,
type = 0,
s = 0,
dpl = 0,
p = 0,
limit1 = 0,
avl = 0,
l = 0,
d = 0,
g = 0,
base2 = 0
}},
sp = 18446634919967160496,
es = 0,
ds = 0,
fsindex = 0,
gsindex = 0,
fsbase = 124534062798656,
gsbase = 0,
ptrace_bps = {0x0, 0x0, 0x0, 0x0},
debugreg6 = 0,
ptrace_dr7 = 0,
cr2 = 0,
trap_nr = 0,
error_code = 0,
io_bitmap_ptr = 0x0,
iopl = 0,
io_bitmap_max = 0,
addr_limit = {
seg = 140737488351232
},
sig_on_uaccess_err = 0,
uaccess_err = 0,
fpu = {
last_cpu = 9,
avx512_timestamp = 0,
state = {
fsave = {
cwd = 0,
swd = 0,
twd = 0,
fip = 0,
fcs = 0,
foo = 0,
fos = 0,
st_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
status = 0
},
fxsave = {
cwd = 0,
swd = 0,
twd = 0,
fop = 0,
{
{
rip = 0,
rdp = 0
},
{
fip = 0,
fcs = 0,
foo = 0,
fos = 0
}
},
mxcsr = 0,
mxcsr_mask = 0,
st_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
xmm_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
padding = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
{
padding1 = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
sw_reserved = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0}
}
},
soft = {
cwd = 0,
swd = 0,
twd = 0,
fip = 0,
fcs = 0,
foo = 0,
fos = 0,
st_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
ftop = 0 '\000',
changed = 0 '\000',
lookahead = 0 '\000',
no_update = 0 '\000',
rm = 0 '\000',
alimit = 0 '\000',
info = 0x0,
entry_eip = 0
},
xsave = {
i387 = {
cwd = 0,
swd = 0,
twd = 0,
fop = 0,
{
{
rip = 0,
rdp = 0
},
{
fip = 0,
fcs = 0,
foo = 0,
fos = 0
}
},
mxcsr = 0,
mxcsr_mask = 0,
st_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
xmm_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
padding = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
{
padding1 = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
sw_reserved = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0}
}
},
header = {
xfeatures = 0,
xcomp_bv = 9223372036854775839,
reserved = {0, 0, 0, 0, 0, 0}
},
extended_state_area = 0xffff8fd7f10df780 ""
},
__padding = "\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000"...
}
}
}
}
struct thread_info {
flags = 2147500036,
status = 0
}
crash>
crash> bt -l 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
(active)
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b35c6
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash>
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57918] compact_unlock_should_abort at ffffffff981b27f8
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] node_page_state at ffffffff981ac66d
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] node_page_state at ffffffff981ac660
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] node_page_state at ffffffff981ac675
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b350b
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3539
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b34e4
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b373f
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b34e4
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] node_page_state at ffffffff981ac662
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4b2e
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] node_page_state at ffffffff981ac662
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b350b
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b35a0
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4b2e
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3552
[ffff9cb9a9f57948] _cond_resched at ffffffff987f5f30
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b35a5
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3572
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] node_page_state at ffffffff981ac662
[ffff9cb9a9f57948] _cond_resched at ffffffff987f5f30
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b35a5
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] _cond_resched at ffffffff987f5f2b
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b35ec
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3591
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3546
[ffff9cb9a9f57948] _cond_resched at ffffffff987f5f30
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b35a5
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] node_page_state at ffffffff981ac675
[ffff9cb9a9f57948] _cond_resched at ffffffff987f5f30
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b35a5
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] node_page_state at ffffffff981ac675
[ffff9cb9a9f57948] _cond_resched at ffffffff987f5f30
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b35a5
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] node_page_state at ffffffff981ac660
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b35a0
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] compact_unlock_should_abort at ffffffff981b27f0
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b34f9
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3546
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3798
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57918] compact_unlock_should_abort at ffffffff981b2822
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57918] compact_unlock_should_abort at ffffffff981b27f8
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] compact_unlock_should_abort at ffffffff981b27f0
[ffff9cb9a9f57930] apic_timer_interrupt at ffffffff9880146a
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f579b8] isolate_migratepages_block at ffffffff981b378e
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b373f
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57918] compact_unlock_should_abort at ffffffff981b27f8
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b350b
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash>
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3798
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -t 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
START: __schedule at ffffffff987f5a0c
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3539
[ffff9cb9a9f57930] apic_timer_interrupt at ffffffff9880146a
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash>
crash> bt -T 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
[ffff9cb9a9f57160] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57180] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57200] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f572f8] wake_all_kswapds at ffffffff981d5e5f
[ffff9cb9a9f57338] __alloc_pages_slowpath at ffffffff981d9955
[ffff9cb9a9f57368] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57378] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57408] FSE_buildCTable_wksp at ffffffff98485f5a
[ffff9cb9a9f57410] reschedule_interrupt at ffffffff9880152a
[ffff9cb9a9f57478] ZSTD_compressSequences_internal at ffffffff9849ecbb
[ffff9cb9a9f57548] ZSTD_compressBlock_internal at ffffffff9849f4dd
[ffff9cb9a9f57570] ZSTD_compressContinue_internal at ffffffff9849f709
[ffff9cb9a9f575d8] ZSTD_compressEnd at ffffffff9849f9ae
[ffff9cb9a9f57620] zs_malloc at ffffffff98217ad3
[ffff9cb9a9f57648] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f57668] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f576b8] update_load_avg at ffffffff980cda5b
[ffff9cb9a9f576c0] account_entity_enqueue at ffffffff980cc13f
[ffff9cb9a9f576f8] enqueue_entity at ffffffff980cea64
[ffff9cb9a9f57700] record_times at ffffffff980e8140
[ffff9cb9a9f57750] check_preempt_wakeup at ffffffff980cd422
[ffff9cb9a9f57798] check_preempt_curr at ffffffff980c2ce0
[ffff9cb9a9f577a8] ttwu_do_wakeup at ffffffff980c2d02
[ffff9cb9a9f577c0] __free_one_page at ffffffff981d66a4
[ffff9cb9a9f577c8] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f57808] __update_load_avg_cfs_rq at ffffffff980e085f
[ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
[ffff9cb9a9f57858] update_load_avg at ffffffff980cd6a6
[ffff9cb9a9f57890] apic_timer_interrupt at ffffffff9880146a
[ffff9cb9a9f578a0] apic_timer_interrupt at ffffffff9880146a
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3572
[ffff9cb9a9f57948] _cond_resched at ffffffff987f5f30
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -T 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
[ffff9cb9a9f57160] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57180] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57200] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f572f8] wake_all_kswapds at ffffffff981d5e5f
[ffff9cb9a9f57338] __alloc_pages_slowpath at ffffffff981d9955
[ffff9cb9a9f57368] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57378] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57408] FSE_buildCTable_wksp at ffffffff98485f5a
[ffff9cb9a9f57410] reschedule_interrupt at ffffffff9880152a
[ffff9cb9a9f57478] ZSTD_compressSequences_internal at ffffffff9849ecbb
[ffff9cb9a9f57548] ZSTD_compressBlock_internal at ffffffff9849f4dd
[ffff9cb9a9f57570] ZSTD_compressContinue_internal at ffffffff9849f709
[ffff9cb9a9f575d8] ZSTD_compressEnd at ffffffff9849f9ae
[ffff9cb9a9f57620] zs_malloc at ffffffff98217ad3
[ffff9cb9a9f57648] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f57668] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f576b8] update_load_avg at ffffffff980cda5b
[ffff9cb9a9f576c0] account_entity_enqueue at ffffffff980cc13f
[ffff9cb9a9f576f8] enqueue_entity at ffffffff980cea64
[ffff9cb9a9f57700] record_times at ffffffff980e8140
[ffff9cb9a9f57750] check_preempt_wakeup at ffffffff980cd422
[ffff9cb9a9f57798] check_preempt_curr at ffffffff980c2ce0
[ffff9cb9a9f577a8] ttwu_do_wakeup at ffffffff980c2d02
[ffff9cb9a9f577c0] __free_one_page at ffffffff981d66a4
[ffff9cb9a9f577c8] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f57808] __update_load_avg_cfs_rq at ffffffff980e085f
[ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
[ffff9cb9a9f57858] update_load_avg at ffffffff980cd6a6
[ffff9cb9a9f57890] apic_timer_interrupt at ffffffff9880146a
[ffff9cb9a9f578a0] apic_timer_interrupt at ffffffff9880146a
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b350b
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash>
crash> bt -T 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
[ffff9cb9a9f57160] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57180] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57200] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f572f8] wake_all_kswapds at ffffffff981d5e5f
[ffff9cb9a9f57338] __alloc_pages_slowpath at ffffffff981d9955
[ffff9cb9a9f57368] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57378] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57408] FSE_buildCTable_wksp at ffffffff98485f5a
[ffff9cb9a9f57410] reschedule_interrupt at ffffffff9880152a
[ffff9cb9a9f57478] ZSTD_compressSequences_internal at ffffffff9849ecbb
[ffff9cb9a9f57548] ZSTD_compressBlock_internal at ffffffff9849f4dd
[ffff9cb9a9f57570] ZSTD_compressContinue_internal at ffffffff9849f709
[ffff9cb9a9f575d8] ZSTD_compressEnd at ffffffff9849f9ae
[ffff9cb9a9f57620] zs_malloc at ffffffff98217ad3
[ffff9cb9a9f57648] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f57668] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f576b8] update_load_avg at ffffffff980cda5b
[ffff9cb9a9f576c0] account_entity_enqueue at ffffffff980cc13f
[ffff9cb9a9f576f8] enqueue_entity at ffffffff980cea64
[ffff9cb9a9f57700] record_times at ffffffff980e8140
[ffff9cb9a9f57750] check_preempt_wakeup at ffffffff980cd422
[ffff9cb9a9f57798] check_preempt_curr at ffffffff980c2ce0
[ffff9cb9a9f577a8] ttwu_do_wakeup at ffffffff980c2d02
[ffff9cb9a9f577c0] __free_one_page at ffffffff981d66a4
[ffff9cb9a9f577c8] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f57808] __update_load_avg_cfs_rq at ffffffff980e085f
[ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
[ffff9cb9a9f57858] update_load_avg at ffffffff980cd6a6
[ffff9cb9a9f57890] apic_timer_interrupt at ffffffff9880146a
[ffff9cb9a9f57918] rcu_all_qs at ffffffff980ff319
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -T 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
[ffff9cb9a9f57160] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57180] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57200] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f572f8] wake_all_kswapds at ffffffff981d5e5f
[ffff9cb9a9f57338] __alloc_pages_slowpath at ffffffff981d9955
[ffff9cb9a9f57368] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57378] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57408] FSE_buildCTable_wksp at ffffffff98485f5a
[ffff9cb9a9f57410] reschedule_interrupt at ffffffff9880152a
[ffff9cb9a9f57478] ZSTD_compressSequences_internal at ffffffff9849ecbb
[ffff9cb9a9f57548] ZSTD_compressBlock_internal at ffffffff9849f4dd
[ffff9cb9a9f57570] ZSTD_compressContinue_internal at ffffffff9849f709
[ffff9cb9a9f575d8] ZSTD_compressEnd at ffffffff9849f9ae
[ffff9cb9a9f57620] zs_malloc at ffffffff98217ad3
[ffff9cb9a9f57648] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f57668] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f576b8] update_load_avg at ffffffff980cda5b
[ffff9cb9a9f576c0] account_entity_enqueue at ffffffff980cc13f
[ffff9cb9a9f576f8] enqueue_entity at ffffffff980cea64
[ffff9cb9a9f57700] record_times at ffffffff980e8140
[ffff9cb9a9f57750] check_preempt_wakeup at ffffffff980cd422
[ffff9cb9a9f57798] check_preempt_curr at ffffffff980c2ce0
[ffff9cb9a9f577a8] ttwu_do_wakeup at ffffffff980c2d02
[ffff9cb9a9f577c0] __free_one_page at ffffffff981d66a4
[ffff9cb9a9f577c8] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f57808] __update_load_avg_cfs_rq at ffffffff980e085f
[ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
[ffff9cb9a9f57858] update_load_avg at ffffffff980cd6a6
[ffff9cb9a9f57890] apic_timer_interrupt at ffffffff9880146a
[ffff9cb9a9f578a0] apic_timer_interrupt at ffffffff9880146a
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3582
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash>
$ colordiff -up /tmp/{a,b}
--- /tmp/a 2019-07-16 05:09:24.145246010 +0200
+++ /tmp/b 2019-07-16 05:09:27.399245979 +0200
@@ -29,7 +29,8 @@ PID: 21120 TASK: ffff8fd7f10ddac0 CPU:
[ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
[ffff9cb9a9f57858] update_load_avg at ffffffff980cd6a6
[ffff9cb9a9f57890] apic_timer_interrupt at ffffffff9880146a
- [ffff9cb9a9f57918] rcu_all_qs at ffffffff980ff319
+ [ffff9cb9a9f578a0] apic_timer_interrupt at ffffffff9880146a
+ [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3582
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
@@ -53,4 +54,4 @@ PID: 21120 TASK: ffff8fd7f10ddac0 CPU:
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
-
+crash>
crash> bt -T 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 0 COMMAND: "stress"
[ffff9cb9a9f57160] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57180] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57200] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f572f8] wake_all_kswapds at ffffffff981d5e5f
[ffff9cb9a9f57338] __alloc_pages_slowpath at ffffffff981d9955
[ffff9cb9a9f57368] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57378] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57408] FSE_buildCTable_wksp at ffffffff98485f5a
[ffff9cb9a9f57410] reschedule_interrupt at ffffffff9880152a
[ffff9cb9a9f57478] ZSTD_compressSequences_internal at ffffffff9849ecbb
[ffff9cb9a9f57548] ZSTD_compressBlock_internal at ffffffff9849f4dd
[ffff9cb9a9f57570] ZSTD_compressContinue_internal at ffffffff9849f709
[ffff9cb9a9f575d8] ZSTD_compressEnd at ffffffff9849f9ae
[ffff9cb9a9f57620] zs_malloc at ffffffff98217ad3
[ffff9cb9a9f57648] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f57668] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f576b8] update_load_avg at ffffffff980cda5b
[ffff9cb9a9f576c0] account_entity_enqueue at ffffffff980cc13f
[ffff9cb9a9f576f8] enqueue_entity at ffffffff980cea64
[ffff9cb9a9f57700] record_times at ffffffff980e8140
[ffff9cb9a9f57750] check_preempt_wakeup at ffffffff980cd422
[ffff9cb9a9f57798] check_preempt_curr at ffffffff980c2ce0
[ffff9cb9a9f577a8] ttwu_do_wakeup at ffffffff980c2d02
[ffff9cb9a9f577c8] try_to_wake_up at ffffffff980c3a06
[ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
[ffff9cb9a9f57850] set_next_entity at ffffffff980cdc29
[ffff9cb9a9f57870] pick_next_task_fair at ffffffff980d4a50
[ffff9cb9a9f578a0] apic_timer_interrupt at ffffffff9880146a
[ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3bc0
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -T 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 0 COMMAND: "stress"
[ffff9cb9a9f57160] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57180] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57200] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f572f8] wake_all_kswapds at ffffffff981d5e5f
[ffff9cb9a9f57338] __alloc_pages_slowpath at ffffffff981d9955
[ffff9cb9a9f57368] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57378] get_page_from_freelist at ffffffff981d9078
[ffff9cb9a9f57408] FSE_buildCTable_wksp at ffffffff98485f5a
[ffff9cb9a9f57410] reschedule_interrupt at ffffffff9880152a
[ffff9cb9a9f57478] ZSTD_compressSequences_internal at ffffffff9849ecbb
[ffff9cb9a9f57548] ZSTD_compressBlock_internal at ffffffff9849f4dd
[ffff9cb9a9f57570] ZSTD_compressContinue_internal at ffffffff9849f709
[ffff9cb9a9f575d8] ZSTD_compressEnd at ffffffff9849f9ae
[ffff9cb9a9f57620] zs_malloc at ffffffff98217ad3
[ffff9cb9a9f57648] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f57668] __update_load_avg_se at ffffffff980e05d0
[ffff9cb9a9f576b8] update_load_avg at ffffffff980cda5b
[ffff9cb9a9f576c0] account_entity_enqueue at ffffffff980cc13f
[ffff9cb9a9f576f8] enqueue_entity at ffffffff980cea64
[ffff9cb9a9f57700] record_times at ffffffff980e8140
[ffff9cb9a9f57750] check_preempt_wakeup at ffffffff980cd422
[ffff9cb9a9f57798] check_preempt_curr at ffffffff980c2ce0
[ffff9cb9a9f577a8] ttwu_do_wakeup at ffffffff980c2d02
[ffff9cb9a9f577c8] try_to_wake_up at ffffffff980c3a06
[ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
[ffff9cb9a9f57850] set_next_entity at ffffffff980cdc29
[ffff9cb9a9f57870] pick_next_task_fair at ffffffff980d4a50
[ffff9cb9a9f57890] apic_timer_interrupt at ffffffff9880146a
[ffff9cb9a9f578a0] apic_timer_interrupt at ffffffff9880146a
[ffff9cb9a9f57928] node_page_state at ffffffff981ac66d
[ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash>
Ok, I don't know why but I can't start any more terminals and exiting chromium also made starter terminal unusable. Some kind of lockup/wait is at hand!
here's last of `strace bash -l`:
clone(child_stack=NULL, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7733e277fa10) = 22571
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
rt_sigaction(SIGCHLD, {sa_handler=0x623cac34987a, sa_mask=[], sa_flags=SA_RESTORER|SA_RESTART, sa_restorer=0x7733e27c8910}, {sa_handler=0x623cac34987a, sa_mask=[], sa_flags=SA_RESTORER|SA_RESTART, sa_restorer=0x7733e27c8910}, 8) = 0
close(4) = 0
read(3, "\33[4m", 512) = 4
read(3, "", 512) = 0
--- SIGCHLD {si_signo=SIGCHLD, si_code=CLD_EXITED, si_pid=22571, si_uid=1000, si_status=0, si_utime=0, si_stime=0} ---
wait4(-1, [{WIFEXITED(s) && WEXITSTATUS(s) == 0}], WNOHANG, NULL) = 22571
wait4(-1, 0x7ffc85dc1b50, WNOHANG, NULL) = -1 ECHILD (No child processes)
rt_sigreturn({mask=[]}) = 0
close(3) = 0
rt_sigprocmask(SIG_BLOCK, [CHLD], [], 8) = 0
rt_sigaction(SIGINT, {sa_handler=0x623cac347485, sa_mask=[], sa_flags=SA_RESTORER, sa_restorer=0x7733e27c8910}, {sa_handler=0x623cac36e877, sa_mask=[], sa_flags=SA_RESTORER, sa_restorer=0x7733e27c8910}, 8) = 0
rt_sigaction(SIGINT, {sa_handler=0x623cac36e877, sa_mask=[], sa_flags=SA_RESTORER, sa_restorer=0x7733e27c8910}, {sa_handler=0x623cac347485, sa_mask=[], sa_flags=SA_RESTORER, sa_restorer=0x7733e27c8910}, 8) = 0
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
rt_sigprocmask(SIG_BLOCK, [CHLD], [], 8) = 0
pipe([3, 4]) = 0
rt_sigprocmask(SIG_BLOCK, [INT CHLD], [CHLD], 8) = 0
rt_sigprocmask(SIG_BLOCK, [CHLD], [INT CHLD], 8) = 0
rt_sigprocmask(SIG_SETMASK, [INT CHLD], NULL, 8) = 0
clone(child_stack=NULL, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7733e277fa10) = 22572
rt_sigprocmask(SIG_SETMASK, [CHLD], NULL, 8) = 0
close(4) = 0
close(4) = -1 EBADF (Bad file descriptor)
rt_sigprocmask(SIG_BLOCK, [INT CHLD], [CHLD], 8) = 0
clone(child_stack=NULL, flags=CLONE_CHILD_CLEARTID|CLONE_CHILD_SETTID|SIGCHLD, child_tidptr=0x7733e277fa10) = 22573
rt_sigprocmask(SIG_SETMASK, [CHLD], NULL, 8) = 0
close(3) = 0
rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD], 8) = 0
rt_sigprocmask(SIG_SETMASK, [CHLD], NULL, 8) = 0
rt_sigprocmask(SIG_BLOCK, [CHLD], [CHLD], 8) = 0
rt_sigaction(SIGINT, {sa_handler=0x623cac347485, sa_mask=[], sa_flags=SA_RESTORER, sa_restorer=0x7733e27c8910}, {sa_handler=0x623cac36e877, sa_mask=[], sa_flags=SA_RESTORER, sa_restorer=0x7733e27c8910}, 8) = 0
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1, 0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGWINCH {si_signo=SIGWINCH, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = 61
wait4(-1,
^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, [{WIFSIGNALED(s) && WTERMSIG(s) == SIGINT}], 0, NULL) = 22573
wait4(-1,
^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1, ^C0x7ffc85dc2690, 0, NULL) = ? ERESTARTSYS (To be restarted if SA_RESTART is set)
--- SIGINT {si_signo=SIGINT, si_code=SI_KERNEL} ---
rt_sigreturn({mask=[CHLD]}) = -1 EINTR (Interrupted system call)
wait4(-1,
crash> bt -f 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 4 COMMAND: "stress"
(active)
crash> bt -F 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 4 COMMAND: "stress"
(active)
crash> bt -FF 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 4 COMMAND: "stress"
(active)
crash> bt -v 21120
No stack overflows detected
crash> bt -Tsx 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 4 COMMAND: "stress"
[ffff9cb9a9f57160] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f57180] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f57200] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f572f8] wake_all_kswapds+0x4f at ffffffff981d5e5f
[ffff9cb9a9f57338] __alloc_pages_slowpath+0x175 at ffffffff981d9955
[ffff9cb9a9f57368] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f57378] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f57408] FSE_buildCTable_wksp+0xba at ffffffff98485f5a
[ffff9cb9a9f57410] reschedule_interrupt+0xa at ffffffff9880152a
[ffff9cb9a9f57478] ZSTD_compressSequences_internal+0x8db at ffffffff9849ecbb
[ffff9cb9a9f57548] ZSTD_compressBlock_internal+0xad at ffffffff9849f4dd
[ffff9cb9a9f57570] ZSTD_compressContinue_internal+0x1c9 at ffffffff9849f709
[ffff9cb9a9f575d8] ZSTD_compressEnd+0x1e at ffffffff9849f9ae
[ffff9cb9a9f57620] zs_malloc+0x1e3 at ffffffff98217ad3
[ffff9cb9a9f57648] __update_load_avg_se+0x200 at ffffffff980e05d0
[ffff9cb9a9f57668] __update_load_avg_se+0x200 at ffffffff980e05d0
[ffff9cb9a9f576b8] update_load_avg+0x42b at ffffffff980cda5b
[ffff9cb9a9f576c0] account_entity_enqueue+0xbf at ffffffff980cc13f
[ffff9cb9a9f576f8] enqueue_entity+0xe4 at ffffffff980cea64
[ffff9cb9a9f57700] record_times+0x10 at ffffffff980e8140
[ffff9cb9a9f57750] check_preempt_wakeup+0x182 at ffffffff980cd422
[ffff9cb9a9f57798] check_preempt_curr+0x70 at ffffffff980c2ce0
[ffff9cb9a9f577a8] ttwu_do_wakeup+0x12 at ffffffff980c2d02
[ffff9cb9a9f577c8] __update_load_avg_se+0x200 at ffffffff980e05d0
[ffff9cb9a9f57810] update_load_avg+0x76 at ffffffff980cd6a6
[ffff9cb9a9f57850] set_next_entity+0x89 at ffffffff980cdc29
[ffff9cb9a9f57858] update_load_avg+0x76 at ffffffff980cd6a6
[ffff9cb9a9f57890] apic_timer_interrupt+0xa at ffffffff9880146a
[ffff9cb9a9f578a0] apic_timer_interrupt+0xa at ffffffff9880146a
[ffff9cb9a9f57928] node_page_state+0x15 at ffffffff981ac675
[ffff9cb9a9f57948] _cond_resched+0x10 at ffffffff987f5f30
[ffff9cb9a9f57950] isolate_migratepages_block+0xd5 at ffffffff981b35a5
[ffff9cb9a9f57a10] compact_zone+0x577 at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order+0xde at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages+0x187 at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact+0x87 at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath+0x20e at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages+0x348 at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn+0x189 at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask+0x268 at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page+0x131 at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault+0xc0c at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault+0xa9 at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault+0x237 at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault+0x1d at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault+0x8 at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault+0x1e at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -Tsx 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 4 COMMAND: "stress"
[ffff9cb9a9f57160] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f57180] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f57200] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f572f8] wake_all_kswapds+0x4f at ffffffff981d5e5f
[ffff9cb9a9f57338] __alloc_pages_slowpath+0x175 at ffffffff981d9955
[ffff9cb9a9f57368] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f57378] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f57408] FSE_buildCTable_wksp+0xba at ffffffff98485f5a
[ffff9cb9a9f57410] reschedule_interrupt+0xa at ffffffff9880152a
[ffff9cb9a9f57478] ZSTD_compressSequences_internal+0x8db at ffffffff9849ecbb
[ffff9cb9a9f57548] ZSTD_compressBlock_internal+0xad at ffffffff9849f4dd
[ffff9cb9a9f57570] ZSTD_compressContinue_internal+0x1c9 at ffffffff9849f709
[ffff9cb9a9f575d8] ZSTD_compressEnd+0x1e at ffffffff9849f9ae
[ffff9cb9a9f57620] zs_malloc+0x1e3 at ffffffff98217ad3
[ffff9cb9a9f57648] __update_load_avg_se+0x200 at ffffffff980e05d0
[ffff9cb9a9f57668] __update_load_avg_se+0x200 at ffffffff980e05d0
[ffff9cb9a9f576b8] update_load_avg+0x42b at ffffffff980cda5b
[ffff9cb9a9f576c0] account_entity_enqueue+0xbf at ffffffff980cc13f
[ffff9cb9a9f576f8] enqueue_entity+0xe4 at ffffffff980cea64
[ffff9cb9a9f57700] record_times+0x10 at ffffffff980e8140
[ffff9cb9a9f57750] check_preempt_wakeup+0x182 at ffffffff980cd422
[ffff9cb9a9f57798] check_preempt_curr+0x70 at ffffffff980c2ce0
[ffff9cb9a9f577a8] ttwu_do_wakeup+0x12 at ffffffff980c2d02
[ffff9cb9a9f577c8] __update_load_avg_se+0x200 at ffffffff980e05d0
[ffff9cb9a9f57810] update_load_avg+0x76 at ffffffff980cd6a6
[ffff9cb9a9f57850] set_next_entity+0x89 at ffffffff980cdc29
[ffff9cb9a9f57870] pick_next_task_fair+0x590 at ffffffff980d4a50
[ffff9cb9a9f57890] apic_timer_interrupt+0xa at ffffffff9880146a
[ffff9cb9a9f578a0] apic_timer_interrupt+0xa at ffffffff9880146a
[ffff9cb9a9f57928] isolate_migratepages_block+0x2a7 at ffffffff981b3777
[ffff9cb9a9f57950] isolate_migratepages_block+0x2ed at ffffffff981b37bd
[ffff9cb9a9f57a10] compact_zone+0x577 at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order+0xde at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages+0x187 at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact+0x87 at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath+0x20e at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages+0x348 at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn+0x189 at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask+0x268 at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page+0x131 at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault+0xc0c at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault+0xa9 at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault+0x237 at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault+0x1d at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault+0x8 at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault+0x1e at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -Tsx 21120
PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 4 COMMAND: "stress"
[ffff9cb9a9f57160] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f57180] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f57200] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f572f8] wake_all_kswapds+0x4f at ffffffff981d5e5f
[ffff9cb9a9f57338] __alloc_pages_slowpath+0x175 at ffffffff981d9955
[ffff9cb9a9f57368] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f57378] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb9a9f57408] FSE_buildCTable_wksp+0xba at ffffffff98485f5a
[ffff9cb9a9f57410] reschedule_interrupt+0xa at ffffffff9880152a
[ffff9cb9a9f57478] ZSTD_compressSequences_internal+0x8db at ffffffff9849ecbb
[ffff9cb9a9f57548] ZSTD_compressBlock_internal+0xad at ffffffff9849f4dd
[ffff9cb9a9f57570] ZSTD_compressContinue_internal+0x1c9 at ffffffff9849f709
[ffff9cb9a9f575d8] ZSTD_compressEnd+0x1e at ffffffff9849f9ae
[ffff9cb9a9f57620] zs_malloc+0x1e3 at ffffffff98217ad3
[ffff9cb9a9f57648] __update_load_avg_se+0x200 at ffffffff980e05d0
[ffff9cb9a9f57668] __update_load_avg_se+0x200 at ffffffff980e05d0
[ffff9cb9a9f576b8] update_load_avg+0x42b at ffffffff980cda5b
[ffff9cb9a9f576c0] account_entity_enqueue+0xbf at ffffffff980cc13f
[ffff9cb9a9f576f8] enqueue_entity+0xe4 at ffffffff980cea64
[ffff9cb9a9f57700] record_times+0x10 at ffffffff980e8140
[ffff9cb9a9f57750] check_preempt_wakeup+0x182 at ffffffff980cd422
[ffff9cb9a9f57798] check_preempt_curr+0x70 at ffffffff980c2ce0
[ffff9cb9a9f577a8] ttwu_do_wakeup+0x12 at ffffffff980c2d02
[ffff9cb9a9f577c8] __update_load_avg_se+0x200 at ffffffff980e05d0
[ffff9cb9a9f57810] update_load_avg+0x76 at ffffffff980cd6a6
[ffff9cb9a9f57850] set_next_entity+0x89 at ffffffff980cdc29
[ffff9cb9a9f57870] pick_next_task_fair+0x590 at ffffffff980d4a50
[ffff9cb9a9f57890] apic_timer_interrupt+0xa at ffffffff9880146a
[ffff9cb9a9f578a0] apic_timer_interrupt+0xa at ffffffff9880146a
[ffff9cb9a9f57928] isolate_migratepages_block+0xd5 at ffffffff981b35a5
[ffff9cb9a9f57930] apic_timer_interrupt+0xa at ffffffff9880146a
[ffff9cb9a9f57950] isolate_migratepages_block+0x2ed at ffffffff981b37bd
[ffff9cb9a9f579b8] isolate_migratepages_block+0x9 at ffffffff981b34d9
[ffff9cb9a9f57a10] compact_zone+0x577 at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order+0xde at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages+0x187 at ffffffff981b5a17
[ffff9cb9a9f57bd8] __alloc_pages_direct_compact+0x87 at ffffffff981d95a7
[ffff9cb9a9f57c30] __alloc_pages_slowpath+0x20e at ffffffff981d99ee
[ffff9cb9a9f57cd0] release_pages+0x348 at ffffffff9819aa08
[ffff9cb9a9f57d00] __pagevec_lru_add_fn+0x189 at ffffffff9819ada9
[ffff9cb9a9f57d40] __alloc_pages_nodemask+0x268 at ffffffff981da668
[ffff9cb9a9f57da0] do_huge_pmd_anonymous_page+0x131 at ffffffff98202c01
[ffff9cb9a9f57df0] __handle_mm_fault+0xc0c at ffffffff981bfa4c
[ffff9cb9a9f57ea0] handle_mm_fault+0xa9 at ffffffff981c01f9
[ffff9cb9a9f57ec8] __do_page_fault+0x237 at ffffffff9803d5c7
[ffff9cb9a9f57f28] do_page_fault+0x1d at ffffffff9803d85d
[ffff9cb9a9f57f48] page_fault+0x8 at ffffffff98800de8
[ffff9cb9a9f57f50] page_fault+0x1e at ffffffff98800dfe
RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash>
diff of the above two:
$ colordiff -up /tmp/{c,d}
--- /tmp/c 2019-07-16 05:20:20.959239746 +0200
+++ /tmp/d 2019-07-16 05:20:29.450239665 +0200
@@ -29,8 +29,10 @@ PID: 21120 TASK: ffff8fd7f10ddac0 CPU:
[ffff9cb9a9f57870] pick_next_task_fair+0x590 at ffffffff980d4a50
[ffff9cb9a9f57890] apic_timer_interrupt+0xa at ffffffff9880146a
[ffff9cb9a9f578a0] apic_timer_interrupt+0xa at ffffffff9880146a
- [ffff9cb9a9f57928] isolate_migratepages_block+0x2a7 at ffffffff981b3777
+ [ffff9cb9a9f57928] isolate_migratepages_block+0xd5 at ffffffff981b35a5
+ [ffff9cb9a9f57930] apic_timer_interrupt+0xa at ffffffff9880146a
[ffff9cb9a9f57950] isolate_migratepages_block+0x2ed at ffffffff981b37bd
+ [ffff9cb9a9f579b8] isolate_migratepages_block+0x9 at ffffffff981b34d9
[ffff9cb9a9f57a10] compact_zone+0x577 at ffffffff981b4c07
[ffff9cb9a9f57ab8] compact_zone_order+0xde at ffffffff981b51de
[ffff9cb9a9f57b78] try_to_compact_pages+0x187 at ffffffff981b5a17
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [Bug 204165] New: 100% CPU usage in compact_zone_order
2019-07-16 3:25 ` howaboutsynergy
@ 2019-07-16 3:57 ` howaboutsynergy
2019-07-16 7:11 ` Mel Gorman
2019-07-16 10:03 ` Mel Gorman
0 siblings, 2 replies; 12+ messages in thread
From: howaboutsynergy @ 2019-07-16 3:57 UTC (permalink / raw)
To: Andrew Morton; +Cc: bugzilla-daemon, linux-mm, Mel Gorman
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Tuesday, July 16, 2019 5:25 AM, <howaboutsynergy@protonmail.com> wrote:
> I got more info/better stacktrace(seen at the end):
>
> [ 4793.539013] sysrq: Show backtrace of all active CPUs
> [ 4793.539019] NMI backtrace for cpu 8
> [ 4793.539026] CPU: 8 PID: 21120 Comm: stress Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #68
> [ 4793.539029] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 1002 07/02/2018
> [ 4793.539032] Call Trace:
> [ 4793.539036] <IRQ>
> [ 4793.539047] dump_stack+0x46/0x60
> [ 4793.539054] nmi_cpu_backtrace.cold+0x14/0x53
> [ 4793.539061] ? lapic_can_unplug_cpu.cold+0x42/0x42
> [ 4793.539067] nmi_trigger_cpumask_backtrace+0x8e/0x90
> [ 4793.539073] __handle_sysrq.cold+0x48/0x102
> [ 4793.539078] sysrq_filter+0x2ea/0x3b0
> [ 4793.539084] input_to_handler+0x4d/0xf0
> [ 4793.539090] input_pass_values.part.0+0x109/0x130
> [ 4793.539096] input_handle_event+0x171/0x5a0
> [ 4793.539101] input_event+0x4d/0x70
> [ 4793.539107] hidinput_report_event+0x2e/0x40
> [ 4793.539112] hid_report_raw_event+0x260/0x430
> [ 4793.539118] hid_input_report+0xfb/0x150
> [ 4793.539124] hid_irq_in+0x168/0x190
> [ 4793.539131] __usb_hcd_giveback_urb+0x77/0xe0
> [ 4793.539148] xhci_giveback_urb_in_irq.isra.0+0x62/0x90 [xhci_hcd]
> [ 4793.539163] xhci_td_cleanup+0xf7/0x140 [xhci_hcd]
> [ 4793.539177] xhci_irq+0x7e8/0x1be0 [xhci_hcd]
> [ 4793.539185] __handle_irq_event_percpu+0x2f/0xc0
> [ 4793.539191] handle_irq_event_percpu+0x2c/0x80
> [ 4793.539196] handle_irq_event+0x23/0x43
> [ 4793.539202] handle_edge_irq+0x78/0x190
> [ 4793.539208] handle_irq+0x17/0x20
> [ 4793.539215] do_IRQ+0x3e/0xd0
> [ 4793.539221] common_interrupt+0xf/0xf
> [ 4793.539225] </IRQ>
> [ 4793.539231] RIP: 0010:isolate_migratepages_block+0x1d3/0xa50
> [ 4793.539237] Code: df 77 27 45 84 ed 74 22 4d 85 d2 0f 85 a7 00 00 00 41 8b 44 24 60 be 01 00 00 00 c4 e2 f9 f7 c6 4c 8d 3c 18 48 f7 d8 49 21 c7 <f6> c3 1f 0f 84 ec 00 00 00 48 ff 44 24 10 48 8b 05 68 b3 d1 00 48
> [ 4793.539240] RSP: 0018:ffff9cb9a9f57958 EFLAGS: 00000206 ORIG_RAX: ffffffffffffffde
> [ 4793.539246] RAX: ffff9cb9a9f57b49 RBX: 00000000004b4b00 RCX: 000000000000000c
> [ 4793.539249] RDX: 00000000004b4c00 RSI: 0000000000000007 RDI: 0000000000000000
> [ 4793.539252] RBP: ffff8fd8cdfde000 R08: ffff8fd8cdfd9960 R09: ffff8fd8ada5d550
> [ 4793.539254] R10: 0000000000000000 R11: ffff8fd8ada5cb80 R12: ffff9cb9a9f57ad0
> [ 4793.539257] R13: 0000000000000001 R14: ffff9cb9a9f57ad0 R15: 00000000004b4c00
> [ 4793.539264] ? isolate_migratepages_block+0xd5/0xa50
> [ 4793.539269] compact_zone+0x577/0xa70
> [ 4793.539275] compact_zone_order+0xde/0x120
> [ 4793.539280] try_to_compact_pages+0x187/0x240
> [ 4793.539286] __alloc_pages_direct_compact+0x87/0x170
> [ 4793.539291] __alloc_pages_slowpath+0x20e/0xc20
> [ 4793.539297] ? release_pages+0x348/0x3b0
> [ 4793.539303] ? __pagevec_lru_add_fn+0x189/0x2a0
> [ 4793.539307] __alloc_pages_nodemask+0x268/0x2b0
> [ 4793.539314] do_huge_pmd_anonymous_page+0x131/0x5c0
> [ 4793.539321] __handle_mm_fault+0xc0c/0x1310
> [ 4793.539327] handle_mm_fault+0xa9/0x1d0
> [ 4793.539333] __do_page_fault+0x237/0x480
> [ 4793.539339] do_page_fault+0x1d/0x67
> [ 4793.539345] ? page_fault+0x8/0x30
> [ 4793.539350] page_fault+0x1e/0x30
> [ 4793.539355] RIP: 0033:0x5879fc8c4c10
> [ 4793.539360] Code: c0 0f 84 53 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f fa 00 00 00 31 c0 4d 85 ff 7e 10 0f 1f 40 00 <c6> 04 03 5a 4c 01 f0 49 39 c7 7f f4 4d 85 e4 0f 84 f4 01 00 00 7e
> [ 4793.539363] RSP: 002b:00007ffd393aa0d0 EFLAGS: 00010206
> [ 4793.539367] RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> [ 4793.539370] RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> [ 4793.539373] RBP: 00005879fc8c5a54 R08: 0000714104876010 R09: 0000000000000000
> [ 4793.539376] R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> [ 4793.539379] R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> [ 4793.539385] Sending NMI from CPU 8 to CPUs 0-7,9-11:
> [ 4793.539450] NMI backtrace for cpu 0 skipped: idling at intel_idle+0x7d/0x120
> [ 4793.539541] NMI backtrace for cpu 1 skipped: idling at intel_idle+0x7d/0x120
> [ 4793.539606] NMI backtrace for cpu 2 skipped: idling at intel_idle+0x7d/0x120
> [ 4793.539815] NMI backtrace for cpu 3
>
> crash> task 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 4 COMMAND: "stress"
> struct task_struct {
> thread_info = {
> flags = 2147500036,
> status = 0
> },
> state = 0,
> stack = 0xffff9cb9a9f54000,
> usage = {
> refs = {
> counter = 2
> }
> },
> flags = 20990016,
> ptrace = 0,
> wake_entry = {
> next = 0x0
> },
> on_cpu = 1,
> cpu = 4,
> wakee_flips = 0,
> wakee_flip_decay_ts = 4299663580,
> last_wakee = 0xffff8fd8a9e01e40,
> recent_used_cpu = 4,
> wake_cpu = 4,
> on_rq = 1,
> prio = 120,
> static_prio = 120,
> normal_prio = 120,
> rt_priority = 0,
> sched_class = 0xffffffff98c0f700,
> se = {
> load = {
> weight = 1048576,
> inv_weight = 4194304
> },
> runnable_weight = 1048576,
> run_node = {
> __rb_parent_color = 1,
> rb_right = 0x0,
> rb_left = 0x0
> },
> group_node = {
> next = 0xffff8fd8ad85d550,
> prev = 0xffff8fd8ad85d550
> },
> on_rq = 1,
> exec_start = 4987351794570,
> sum_exec_runtime = 275188015038,
> vruntime = 268378190293,
> prev_sum_exec_runtime = 275071762024,
> nr_migrations = 75,
> statistics = {
> wait_start = 0,
> wait_max = 0,
> wait_count = 0,
> wait_sum = 0,
> iowait_count = 0,
> iowait_sum = 0,
> sleep_start = 0,
> sleep_max = 0,
> sum_sleep_runtime = 0,
> block_start = 0,
> block_max = 0,
> exec_max = 0,
> slice_max = 0,
> nr_migrations_cold = 0,
> nr_failed_migrations_affine = 0,
> nr_failed_migrations_running = 0,
> nr_failed_migrations_hot = 0,
> nr_forced_migrations = 0,
> nr_wakeups = 0,
> nr_wakeups_sync = 0,
> nr_wakeups_migrate = 0,
> nr_wakeups_local = 0,
> nr_wakeups_remote = 0,
> nr_wakeups_affine = 0,
> nr_wakeups_affine_attempts = 0,
> nr_wakeups_passive = 0,
> nr_wakeups_idle = 0
> },
> depth = 1,
> parent = 0xffff8fd38de23000,
> cfs_rq = 0xffff8fd38de20e00,
> my_q = 0x0,
> avg = {
> last_update_time = 4987351793664,
> load_sum = 47037,
> runnable_load_sum = 47037,
> util_sum = 48192640,
> period_contrib = 320,
> load_avg = 1023,
> runnable_load_avg = 1023,
> util_avg = 1024,
> util_est = {
> enqueued = 100,
> ewma = 75
> }
> }
> },
> rt = {
> run_list = {
> next = 0xffff8fd7f10ddd00,
> prev = 0xffff8fd7f10ddd00
> },
> timeout = 0,
> watchdog_stamp = 0,
> time_slice = 100,
> on_rq = 0,
> on_list = 0,
> back = 0x0
> },
> sched_task_group = 0xffff8fd8a69f7480,
> dl = {
> rb_node = {
> __rb_parent_color = 18446620756357799224,
> rb_right = 0x0,
> rb_left = 0x0
> },
> dl_runtime = 0,
> dl_deadline = 0,
> dl_period = 0,
> dl_bw = 0,
> dl_density = 0,
> runtime = 0,
> deadline = 0,
> flags = 0,
> dl_throttled = 0,
> dl_boosted = 0,
> dl_yielded = 0,
> dl_non_contending = 0,
> dl_overrun = 0,
> dl_timer = {
> node = {
> node = {
> __rb_parent_color = 18446620756357799312,
> rb_right = 0x0,
> rb_left = 0x0
> },
> expires = 0
> },
> _softexpires = 0,
> function = 0xffffffff980dac70,
> base = 0xffff8fd8ad958b00,
> state = 0 '\000',
> is_rel = 0 '\000',
> is_soft = 0 '\000'
> },
> inactive_timer = {
> node = {
> node = {
> __rb_parent_color = 18446620756357799376,
> rb_right = 0x0,
> rb_left = 0x0
> },
> expires = 0
> },
> _softexpires = 0,
> function = 0xffffffff980d8ca0,
> base = 0xffff8fd8ad958b00,
> state = 0 '\000',
> is_rel = 0 '\000',
> is_soft = 0 '\000'
> }
> },
> policy = 0,
> nr_cpus_allowed = 12,
> cpus_allowed = {
> bits = {4095}
> },
> sched_info = {
> pcount = 927,
> run_delay = 10768613805,
> last_arrival = 4997587172423,
> last_queued = 0
> },
> tasks = {
> next = 0xffff8fd7ef4e8380,
> prev = 0xffff8fd80b12a1c0
> },
> pushable_tasks = {
> prio = 140,
> prio_list = {
> next = 0xffff8fd7f10dde58,
> prev = 0xffff8fd7f10dde58
> },
> node_list = {
> next = 0xffff8fd7f10dde68,
> prev = 0xffff8fd7f10dde68
> }
> },
> pushable_dl_tasks = {
> __rb_parent_color = 18446620756357799544,
> rb_right = 0x0,
> rb_left = 0x0
> },
> mm = 0xffff8fd84a0c0000,
> active_mm = 0xffff8fd84a0c0000,
> vmacache = {
> seqnum = 0,
> vmas = {0xffff8fd8064dcd80, 0xffff8fd188b0ce40, 0xffff8fd73833ed80, 0x0}
> },
> rss_stat = {
> events = 59,
> count = {0, 54, 0, 0}
> },
> exit_state = 0,
> exit_code = 0,
> exit_signal = 17,
> pdeath_signal = 0,
> jobctl = 0,
> personality = 0,
> sched_reset_on_fork = 0,
> sched_contributes_to_load = 1,
> sched_migrated = 0,
> sched_remote_wakeup = 0,
> sched_psi_wake_requeue = 0,
> in_execve = 0,
> in_iowait = 0,
> restore_sigmask = 0,
> in_user_fault = 1,
> no_cgroup_migration = 0,
> frozen = 0,
> use_memdelay = 0,
> atomic_flags = 0,
> restart_block = {
> fn = 0xffffffff980a97b0,
> {
> futex = {
> uaddr = 0x791b80,
> val = 0,
> flags = 0,
> bitset = 30,
> time = 685393978,
> uaddr2 = 0x0
> },
> nanosleep = {
> clockid = 7936896,
> type = TT_NONE,
> {
> rmtp = 0x0,
> compat_rmtp = 0x0
> },
> expires = 30
> },
> poll = {
> ufds = 0x791b80,
> nfds = 0,
> has_timeout = 0,
> tv_sec = 30,
> tv_nsec = 685393978
> }
> }
> },
> pid = 21120,
> tgid = 21120,
> stack_canary = 2699928380174480896,
> real_parent = 0xffff8fd80b129e40,
> parent = 0xffff8fd80b129e40,
> children = {
> next = 0xffff8fd7f10ddf60,
> prev = 0xffff8fd7f10ddf60
> },
> sibling = {
> next = 0xffff8fd7ef4e84b0,
> prev = 0xffff8fd80b12a2e0
> },
> group_leader = 0xffff8fd7f10ddac0,
> ptraced = {
> next = 0xffff8fd7f10ddf88,
> prev = 0xffff8fd7f10ddf88
> },
> ptrace_entry = {
> next = 0xffff8fd7f10ddf98,
> prev = 0xffff8fd7f10ddf98
> },
> thread_pid = 0xffff8fd8a5c6e000,
> pid_links = {{
> next = 0x0,
> pprev = 0xffff8fd8a5c6e008
> }, {
> next = 0x0,
> pprev = 0xffff8fd8a5c6e010
> }, {
> next = 0xffff8fd80b12a350,
> pprev = 0xffff8fd7ef4e8510
> }, {
> next = 0xffff8fd80b12a360,
> pprev = 0xffff8fd7ef4e8520
> }},
> thread_group = {
> next = 0xffff8fd7f10ddff0,
> prev = 0xffff8fd7f10ddff0
> },
> thread_node = {
> next = 0xffff8fd18547bfd0,
> prev = 0xffff8fd18547bfd0
> },
> vfork_done = 0x0,
> set_child_tid = 0x714358935a10,
> clear_child_tid = 0x714358935a10,
> utime = 2991526,
> stime = 275229123556,
> gtime = 0,
> prev_cputime = {
> utime = 0,
> stime = 0,
> lock = {
> raw_lock = {
> {
> val = {
> counter = 0
> },
> {
> locked = 0 '\000',
> pending = 0 '\000'
> },
> {
> locked_pending = 0,
> tail = 0
> }
> }
> }
> }
> },
> vtime = {
> seqcount = {
> sequence = 0
> },
> starttime = 0,
> state = VTIME_INACTIVE,
> utime = 0,
> stime = 0,
> gtime = 0
> },
> tick_dep_mask = {
> counter = 0
> },
> nvcsw = 64,
> nivcsw = 862,
> start_time = 4707054953905,
> real_start_time = 4707054953927,
> min_flt = 16888,
> maj_flt = 0,
> cputime_expires = {
> utime = 0,
> stime = 0,
> sum_exec_runtime = 0
> },
> cpu_timers = {{
> next = 0xffff8fd7f10de0d8,
> prev = 0xffff8fd7f10de0d8
> }, {
> next = 0xffff8fd7f10de0e8,
> prev = 0xffff8fd7f10de0e8
> }, {
> next = 0xffff8fd7f10de0f8,
> prev = 0xffff8fd7f10de0f8
> }},
> ptracer_cred = 0x0,
> real_cred = 0xffff8fd188b0cd80,
> cred = 0xffff8fd188b0cd80,
> comm = "stress\000ce4-term",
> nameidata = 0x0,
> sysvsem = {
> undo_list = 0x0
> },
> sysvshm = {
> shm_clist = {
> next = 0xffff8fd7f10de140,
> prev = 0xffff8fd7f10de140
> }
> },
> last_switch_count = 0,
> last_switch_time = 0,
> fs = 0xffff8fd84b0e8f40,
> files = 0xffff8fd2944fd600,
> nsproxy = 0xffffffff990349a0,
> signal = 0xffff8fd18547bfc0,
> sighand = 0xffff8fd3c8277380,
> blocked = {
> sig = {0}
> },
> real_blocked = {
> sig = {0}
> },
> saved_sigmask = {
> sig = {512}
> },
> pending = {
> list = {
> next = 0xffff8fd7f10de1a0,
> prev = 0xffff8fd7f10de1a0
> },
> signal = {
> sig = {256}
> }
> },
> sas_ss_sp = 0,
> sas_ss_size = 0,
> sas_ss_flags = 2,
> task_works = 0x0,
> audit_context = 0x0,
> loginuid = {
> val = 1000
> },
> sessionid = 1,
> seccomp = {
> mode = 0,
> filter = 0x0
> },
> parent_exec_id = 15,
> self_exec_id = 15,
> alloc_lock = {
> {
> rlock = {
> raw_lock = {
> {
> val = {
> counter = 0
> },
> {
> locked = 0 '\000',
> pending = 0 '\000'
> },
> {
> locked_pending = 0,
> tail = 0
> }
> }
> }
> }
> }
> },
> pi_lock = {
> raw_lock = {
> {
> val = {
> counter = 0
> },
> {
> locked = 0 '\000',
> pending = 0 '\000'
> },
> {
> locked_pending = 0,
> tail = 0
> }
> }
> }
> },
> wake_q = {
> next = 0x0
> },
> pi_waiters = {
> rb_root = {
> rb_node = 0x0
> },
> rb_leftmost = 0x0
> },
> pi_top_task = 0x0,
> pi_blocked_on = 0x0,
> journal_info = 0x0,
> bio_list = 0x0,
> plug = 0x0,
> reclaim_state = 0x0,
> backing_dev_info = 0x0,
> io_context = 0xffff8fd84b2ce888,
> capture_control = 0xffff9cb9a9f57ac0,
> ptrace_message = 0,
> last_siginfo = 0x0,
> ioac = {
> rchar = 0,
> wchar = 0,
> syscr = 0,
> syscw = 0,
> read_bytes = 0,
> write_bytes = 0,
> cancelled_write_bytes = 0
> },
> psi_flags = 6,
> acct_rss_mem1 = 3212941986541,
> acct_vm_mem1 = 656456860857633,
> acct_timexpd = 275231119481,
> mems_allowed = {
> bits = {1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0}
> },
> mems_allowed_seq = {
> sequence = 0
> },
> cpuset_mem_spread_rotor = -1,
> cpuset_slab_spread_rotor = -1,
> cgroups = 0xffff8fd8a4d01800,
> cg_list = {
> next = 0xffff8fd7ef4e88a8,
> prev = 0xffff8fd80b12a6e8
> },
> robust_list = 0x0,
> compat_robust_list = 0x0,
> pi_state_list = {
> next = 0xffff8fd7f10de388,
> prev = 0xffff8fd7f10de388
> },
> pi_state_cache = 0x0,
> perf_event_ctxp = {0x0, 0x0},
> perf_event_mutex = {
> owner = {
> counter = 0
> },
> wait_lock = {
> {
> rlock = {
> raw_lock = {
> {
> val = {
> counter = 0
> },
> {
> locked = 0 '\000',
> pending = 0 '\000'
> },
> {
> locked_pending = 0,
> tail = 0
> }
> }
> }
> }
> }
> },
> osq = {
> tail = {
> counter = 0
> }
> },
> wait_list = {
> next = 0xffff8fd7f10de3c0,
> prev = 0xffff8fd7f10de3c0
> }
> },
> perf_event_list = {
> next = 0xffff8fd7f10de3d0,
> prev = 0xffff8fd7f10de3d0
> },
> mempolicy = 0x0,
> il_prev = 0,
> pref_node_fork = 0,
> numa_scan_seq = 0,
> numa_scan_period = 1000,
> numa_scan_period_max = 0,
> numa_preferred_nid = -1,
> numa_migrate_retry = 0,
> node_stamp = 0,
> last_task_numa_placement = 0,
> last_sum_exec_runtime = 0,
> numa_work = {
> next = 0xffff8fd7f10de420,
> func = 0x0
> },
> numa_group = 0x0,
> numa_faults = 0x0,
> total_numa_faults = 0,
> numa_faults_locality = {0, 0, 0},
> numa_pages_migrated = 0,
> rseq = 0x0,
> rseq_sig = 0,
> rseq_event_mask = 5,
> tlb_ubc = {
> arch = {
> cpumask = {
> bits = {0}
> }
> },
> flush_required = false,
> writable = false
> },
> rcu = {
> next = 0x0,
> func = 0x0
> },
> splice_pipe = 0x0,
> task_frag = {
> page = 0x0,
> offset = 0,
> size = 0
> },
> delays = 0xffff8fd8a638d3c0,
> nr_dirtied = 0,
> nr_dirtied_pause = 32,
> dirty_paused_when = 0,
> latency_record_count = 0,
> latency_record = {{
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }, {
> backtrace = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> count = 0,
> time = 0,
> max = 0
> }},
> timer_slack_ns = 50000,
> default_timer_slack_ns = 50000,
> memcg_in_oom = 0x0,
> memcg_oom_gfp_mask = 0,
> memcg_oom_order = 0,
> memcg_nr_pages_over_high = 0,
> active_memcg = 0x0,
> throttle_queue = 0x0,
> pagefault_disabled = 0,
> oom_reaper_list = 0x0,
> stack_vm_area = 0xffff8fd3895a9fc0,
> stack_refcount = {
> refs = {
> counter = 1
> }
> },
> security = 0x0,
> thread = {
> tls_array = {{
> limit0 = 0,
> base0 = 0,
> base1 = 0,
> type = 0,
> s = 0,
> dpl = 0,
> p = 0,
> limit1 = 0,
> avl = 0,
> l = 0,
> d = 0,
> g = 0,
> base2 = 0
> }, {
> limit0 = 0,
> base0 = 0,
> base1 = 0,
> type = 0,
> s = 0,
> dpl = 0,
> p = 0,
> limit1 = 0,
> avl = 0,
> l = 0,
> d = 0,
> g = 0,
> base2 = 0
> }, {
> limit0 = 0,
> base0 = 0,
> base1 = 0,
> type = 0,
> s = 0,
> dpl = 0,
> p = 0,
> limit1 = 0,
> avl = 0,
> l = 0,
> d = 0,
> g = 0,
> base2 = 0
> }},
> sp = 18446634919967160496,
> es = 0,
> ds = 0,
> fsindex = 0,
> gsindex = 0,
> fsbase = 124534062798656,
> gsbase = 0,
> ptrace_bps = {0x0, 0x0, 0x0, 0x0},
> debugreg6 = 0,
> ptrace_dr7 = 0,
> cr2 = 0,
> trap_nr = 0,
> error_code = 0,
> io_bitmap_ptr = 0x0,
> iopl = 0,
> io_bitmap_max = 0,
> addr_limit = {
> seg = 140737488351232
> },
> sig_on_uaccess_err = 0,
> uaccess_err = 0,
> fpu = {
> last_cpu = 9,
> avx512_timestamp = 0,
> state = {
> fsave = {
> cwd = 0,
> swd = 0,
> twd = 0,
> fip = 0,
> fcs = 0,
> foo = 0,
> fos = 0,
> st_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> status = 0
> },
> fxsave = {
> cwd = 0,
> swd = 0,
> twd = 0,
> fop = 0,
> {
> {
> rip = 0,
> rdp = 0
> },
> {
> fip = 0,
> fcs = 0,
> foo = 0,
> fos = 0
> }
> },
> mxcsr = 0,
> mxcsr_mask = 0,
> st_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> xmm_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> padding = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> {
> padding1 = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> sw_reserved = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0}
> }
> },
> soft = {
> cwd = 0,
> swd = 0,
> twd = 0,
> fip = 0,
> fcs = 0,
> foo = 0,
> fos = 0,
> st_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> ftop = 0 '\000',
> changed = 0 '\000',
> lookahead = 0 '\000',
> no_update = 0 '\000',
> rm = 0 '\000',
> alimit = 0 '\000',
> info = 0x0,
> entry_eip = 0
> },
> xsave = {
> i387 = {
> cwd = 0,
> swd = 0,
> twd = 0,
> fop = 0,
> {
> {
> rip = 0,
> rdp = 0
> },
> {
> fip = 0,
> fcs = 0,
> foo = 0,
> fos = 0
> }
> },
> mxcsr = 0,
> mxcsr_mask = 0,
> st_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> xmm_space = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> padding = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> {
> padding1 = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0},
> sw_reserved = {0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0}
> }
> },
> header = {
> xfeatures = 0,
> xcomp_bv = 9223372036854775839,
> reserved = {0, 0, 0, 0, 0, 0}
> },
> extended_state_area = 0xffff8fd7f10df780 ""
> },
> __padding = "\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000\000"...
> }
> }
> }
> }
>
> struct thread_info {
> flags = 2147500036,
> status = 0
> }
>
> crash>
>
> crash> bt -l 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> (active)
>
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b35c6
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash>
>
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57918] compact_unlock_should_abort at ffffffff981b27f8
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] node_page_state at ffffffff981ac66d
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] node_page_state at ffffffff981ac660
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] node_page_state at ffffffff981ac675
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b350b
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3539
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b34e4
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b373f
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b34e4
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] node_page_state at ffffffff981ac662
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4b2e
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] node_page_state at ffffffff981ac662
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b350b
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b35a0
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4b2e
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3552
> [ffff9cb9a9f57948] _cond_resched at ffffffff987f5f30
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b35a5
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3572
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] node_page_state at ffffffff981ac662
> [ffff9cb9a9f57948] _cond_resched at ffffffff987f5f30
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b35a5
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] _cond_resched at ffffffff987f5f2b
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b35ec
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3591
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3546
> [ffff9cb9a9f57948] _cond_resched at ffffffff987f5f30
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b35a5
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] node_page_state at ffffffff981ac675
> [ffff9cb9a9f57948] _cond_resched at ffffffff987f5f30
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b35a5
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] node_page_state at ffffffff981ac675
> [ffff9cb9a9f57948] _cond_resched at ffffffff987f5f30
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b35a5
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] node_page_state at ffffffff981ac660
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b35a0
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] compact_unlock_should_abort at ffffffff981b27f0
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b34f9
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3546
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3798
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57918] compact_unlock_should_abort at ffffffff981b2822
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57918] compact_unlock_should_abort at ffffffff981b27f8
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4b69
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] compact_unlock_should_abort at ffffffff981b27f0
> [ffff9cb9a9f57930] apic_timer_interrupt at ffffffff9880146a
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f579b8] isolate_migratepages_block at ffffffff981b378e
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b373f
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57918] compact_unlock_should_abort at ffffffff981b27f8
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b350b
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash>
>
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3798
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -t 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> START: __schedule at ffffffff987f5a0c
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3539
> [ffff9cb9a9f57930] apic_timer_interrupt at ffffffff9880146a
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash>
>
> crash> bt -T 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> [ffff9cb9a9f57160] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57180] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57200] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f572f8] wake_all_kswapds at ffffffff981d5e5f
> [ffff9cb9a9f57338] __alloc_pages_slowpath at ffffffff981d9955
> [ffff9cb9a9f57368] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57378] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57408] FSE_buildCTable_wksp at ffffffff98485f5a
> [ffff9cb9a9f57410] reschedule_interrupt at ffffffff9880152a
> [ffff9cb9a9f57478] ZSTD_compressSequences_internal at ffffffff9849ecbb
> [ffff9cb9a9f57548] ZSTD_compressBlock_internal at ffffffff9849f4dd
> [ffff9cb9a9f57570] ZSTD_compressContinue_internal at ffffffff9849f709
> [ffff9cb9a9f575d8] ZSTD_compressEnd at ffffffff9849f9ae
> [ffff9cb9a9f57620] zs_malloc at ffffffff98217ad3
> [ffff9cb9a9f57648] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f57668] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f576b8] update_load_avg at ffffffff980cda5b
> [ffff9cb9a9f576c0] account_entity_enqueue at ffffffff980cc13f
> [ffff9cb9a9f576f8] enqueue_entity at ffffffff980cea64
> [ffff9cb9a9f57700] record_times at ffffffff980e8140
> [ffff9cb9a9f57750] check_preempt_wakeup at ffffffff980cd422
> [ffff9cb9a9f57798] check_preempt_curr at ffffffff980c2ce0
> [ffff9cb9a9f577a8] ttwu_do_wakeup at ffffffff980c2d02
> [ffff9cb9a9f577c0] __free_one_page at ffffffff981d66a4
> [ffff9cb9a9f577c8] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f57808] __update_load_avg_cfs_rq at ffffffff980e085f
> [ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
> [ffff9cb9a9f57858] update_load_avg at ffffffff980cd6a6
> [ffff9cb9a9f57890] apic_timer_interrupt at ffffffff9880146a
> [ffff9cb9a9f578a0] apic_timer_interrupt at ffffffff9880146a
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3572
> [ffff9cb9a9f57948] _cond_resched at ffffffff987f5f30
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -T 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> [ffff9cb9a9f57160] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57180] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57200] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f572f8] wake_all_kswapds at ffffffff981d5e5f
> [ffff9cb9a9f57338] __alloc_pages_slowpath at ffffffff981d9955
> [ffff9cb9a9f57368] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57378] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57408] FSE_buildCTable_wksp at ffffffff98485f5a
> [ffff9cb9a9f57410] reschedule_interrupt at ffffffff9880152a
> [ffff9cb9a9f57478] ZSTD_compressSequences_internal at ffffffff9849ecbb
> [ffff9cb9a9f57548] ZSTD_compressBlock_internal at ffffffff9849f4dd
> [ffff9cb9a9f57570] ZSTD_compressContinue_internal at ffffffff9849f709
> [ffff9cb9a9f575d8] ZSTD_compressEnd at ffffffff9849f9ae
> [ffff9cb9a9f57620] zs_malloc at ffffffff98217ad3
> [ffff9cb9a9f57648] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f57668] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f576b8] update_load_avg at ffffffff980cda5b
> [ffff9cb9a9f576c0] account_entity_enqueue at ffffffff980cc13f
> [ffff9cb9a9f576f8] enqueue_entity at ffffffff980cea64
> [ffff9cb9a9f57700] record_times at ffffffff980e8140
> [ffff9cb9a9f57750] check_preempt_wakeup at ffffffff980cd422
> [ffff9cb9a9f57798] check_preempt_curr at ffffffff980c2ce0
> [ffff9cb9a9f577a8] ttwu_do_wakeup at ffffffff980c2d02
> [ffff9cb9a9f577c0] __free_one_page at ffffffff981d66a4
> [ffff9cb9a9f577c8] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f57808] __update_load_avg_cfs_rq at ffffffff980e085f
> [ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
> [ffff9cb9a9f57858] update_load_avg at ffffffff980cd6a6
> [ffff9cb9a9f57890] apic_timer_interrupt at ffffffff9880146a
> [ffff9cb9a9f578a0] apic_timer_interrupt at ffffffff9880146a
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b350b
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash>
>
> crash> bt -T 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> [ffff9cb9a9f57160] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57180] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57200] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f572f8] wake_all_kswapds at ffffffff981d5e5f
> [ffff9cb9a9f57338] __alloc_pages_slowpath at ffffffff981d9955
> [ffff9cb9a9f57368] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57378] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57408] FSE_buildCTable_wksp at ffffffff98485f5a
> [ffff9cb9a9f57410] reschedule_interrupt at ffffffff9880152a
> [ffff9cb9a9f57478] ZSTD_compressSequences_internal at ffffffff9849ecbb
> [ffff9cb9a9f57548] ZSTD_compressBlock_internal at ffffffff9849f4dd
> [ffff9cb9a9f57570] ZSTD_compressContinue_internal at ffffffff9849f709
> [ffff9cb9a9f575d8] ZSTD_compressEnd at ffffffff9849f9ae
> [ffff9cb9a9f57620] zs_malloc at ffffffff98217ad3
> [ffff9cb9a9f57648] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f57668] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f576b8] update_load_avg at ffffffff980cda5b
> [ffff9cb9a9f576c0] account_entity_enqueue at ffffffff980cc13f
> [ffff9cb9a9f576f8] enqueue_entity at ffffffff980cea64
> [ffff9cb9a9f57700] record_times at ffffffff980e8140
> [ffff9cb9a9f57750] check_preempt_wakeup at ffffffff980cd422
> [ffff9cb9a9f57798] check_preempt_curr at ffffffff980c2ce0
> [ffff9cb9a9f577a8] ttwu_do_wakeup at ffffffff980c2d02
> [ffff9cb9a9f577c0] __free_one_page at ffffffff981d66a4
> [ffff9cb9a9f577c8] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f57808] __update_load_avg_cfs_rq at ffffffff980e085f
> [ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
> [ffff9cb9a9f57858] update_load_avg at ffffffff980cd6a6
> [ffff9cb9a9f57890] apic_timer_interrupt at ffffffff9880146a
> [ffff9cb9a9f57918] rcu_all_qs at ffffffff980ff319
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -T 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> [ffff9cb9a9f57160] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57180] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57200] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f572f8] wake_all_kswapds at ffffffff981d5e5f
> [ffff9cb9a9f57338] __alloc_pages_slowpath at ffffffff981d9955
> [ffff9cb9a9f57368] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57378] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57408] FSE_buildCTable_wksp at ffffffff98485f5a
> [ffff9cb9a9f57410] reschedule_interrupt at ffffffff9880152a
> [ffff9cb9a9f57478] ZSTD_compressSequences_internal at ffffffff9849ecbb
> [ffff9cb9a9f57548] ZSTD_compressBlock_internal at ffffffff9849f4dd
> [ffff9cb9a9f57570] ZSTD_compressContinue_internal at ffffffff9849f709
> [ffff9cb9a9f575d8] ZSTD_compressEnd at ffffffff9849f9ae
> [ffff9cb9a9f57620] zs_malloc at ffffffff98217ad3
> [ffff9cb9a9f57648] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f57668] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f576b8] update_load_avg at ffffffff980cda5b
> [ffff9cb9a9f576c0] account_entity_enqueue at ffffffff980cc13f
> [ffff9cb9a9f576f8] enqueue_entity at ffffffff980cea64
> [ffff9cb9a9f57700] record_times at ffffffff980e8140
> [ffff9cb9a9f57750] check_preempt_wakeup at ffffffff980cd422
> [ffff9cb9a9f57798] check_preempt_curr at ffffffff980c2ce0
> [ffff9cb9a9f577a8] ttwu_do_wakeup at ffffffff980c2d02
> [ffff9cb9a9f577c0] __free_one_page at ffffffff981d66a4
> [ffff9cb9a9f577c8] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f57808] __update_load_avg_cfs_rq at ffffffff980e085f
> [ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
> [ffff9cb9a9f57858] update_load_avg at ffffffff980cd6a6
> [ffff9cb9a9f57890] apic_timer_interrupt at ffffffff9880146a
> [ffff9cb9a9f578a0] apic_timer_interrupt at ffffffff9880146a
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3582
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash>
>
> $ colordiff -up /tmp/{a,b}
> --- /tmp/a 2019-07-16 05:09:24.145246010 +0200
> +++ /tmp/b 2019-07-16 05:09:27.399245979 +0200
> @@ -29,7 +29,8 @@ PID: 21120 TASK: ffff8fd7f10ddac0 CPU:
> [ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
> [ffff9cb9a9f57858] update_load_avg at ffffffff980cd6a6
> [ffff9cb9a9f57890] apic_timer_interrupt at ffffffff9880146a
>
> - [ffff9cb9a9f57918] rcu_all_qs at ffffffff980ff319
>
> - [ffff9cb9a9f578a0] apic_timer_interrupt at ffffffff9880146a
> - [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3582
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> @@ -53,4 +54,4 @@ PID: 21120 TASK: ffff8fd7f10ddac0 CPU:
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
>
>
> -
>
> +crash>
>
> crash> bt -T 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 0 COMMAND: "stress"
> [ffff9cb9a9f57160] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57180] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57200] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f572f8] wake_all_kswapds at ffffffff981d5e5f
> [ffff9cb9a9f57338] __alloc_pages_slowpath at ffffffff981d9955
> [ffff9cb9a9f57368] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57378] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57408] FSE_buildCTable_wksp at ffffffff98485f5a
> [ffff9cb9a9f57410] reschedule_interrupt at ffffffff9880152a
> [ffff9cb9a9f57478] ZSTD_compressSequences_internal at ffffffff9849ecbb
> [ffff9cb9a9f57548] ZSTD_compressBlock_internal at ffffffff9849f4dd
> [ffff9cb9a9f57570] ZSTD_compressContinue_internal at ffffffff9849f709
> [ffff9cb9a9f575d8] ZSTD_compressEnd at ffffffff9849f9ae
> [ffff9cb9a9f57620] zs_malloc at ffffffff98217ad3
> [ffff9cb9a9f57648] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f57668] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f576b8] update_load_avg at ffffffff980cda5b
> [ffff9cb9a9f576c0] account_entity_enqueue at ffffffff980cc13f
> [ffff9cb9a9f576f8] enqueue_entity at ffffffff980cea64
> [ffff9cb9a9f57700] record_times at ffffffff980e8140
> [ffff9cb9a9f57750] check_preempt_wakeup at ffffffff980cd422
> [ffff9cb9a9f57798] check_preempt_curr at ffffffff980c2ce0
> [ffff9cb9a9f577a8] ttwu_do_wakeup at ffffffff980c2d02
> [ffff9cb9a9f577c8] try_to_wake_up at ffffffff980c3a06
> [ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
> [ffff9cb9a9f57850] set_next_entity at ffffffff980cdc29
> [ffff9cb9a9f57870] pick_next_task_fair at ffffffff980d4a50
> [ffff9cb9a9f578a0] apic_timer_interrupt at ffffffff9880146a
> [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b3bc0
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash> bt -T 21120
> PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 0 COMMAND: "stress"
> [ffff9cb9a9f57160] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57180] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57200] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f572f8] wake_all_kswapds at ffffffff981d5e5f
> [ffff9cb9a9f57338] __alloc_pages_slowpath at ffffffff981d9955
> [ffff9cb9a9f57368] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57378] get_page_from_freelist at ffffffff981d9078
> [ffff9cb9a9f57408] FSE_buildCTable_wksp at ffffffff98485f5a
> [ffff9cb9a9f57410] reschedule_interrupt at ffffffff9880152a
> [ffff9cb9a9f57478] ZSTD_compressSequences_internal at ffffffff9849ecbb
> [ffff9cb9a9f57548] ZSTD_compressBlock_internal at ffffffff9849f4dd
> [ffff9cb9a9f57570] ZSTD_compressContinue_internal at ffffffff9849f709
> [ffff9cb9a9f575d8] ZSTD_compressEnd at ffffffff9849f9ae
> [ffff9cb9a9f57620] zs_malloc at ffffffff98217ad3
> [ffff9cb9a9f57648] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f57668] __update_load_avg_se at ffffffff980e05d0
> [ffff9cb9a9f576b8] update_load_avg at ffffffff980cda5b
> [ffff9cb9a9f576c0] account_entity_enqueue at ffffffff980cc13f
> [ffff9cb9a9f576f8] enqueue_entity at ffffffff980cea64
> [ffff9cb9a9f57700] record_times at ffffffff980e8140
> [ffff9cb9a9f57750] check_preempt_wakeup at ffffffff980cd422
> [ffff9cb9a9f57798] check_preempt_curr at ffffffff980c2ce0
> [ffff9cb9a9f577a8] ttwu_do_wakeup at ffffffff980c2d02
> [ffff9cb9a9f577c8] try_to_wake_up at ffffffff980c3a06
> [ffff9cb9a9f57810] update_load_avg at ffffffff980cd6a6
> [ffff9cb9a9f57850] set_next_entity at ffffffff980cdc29
> [ffff9cb9a9f57870] pick_next_task_fair at ffffffff980d4a50
> [ffff9cb9a9f57890] apic_timer_interrupt at ffffffff9880146a
> [ffff9cb9a9f578a0] apic_timer_interrupt at ffffffff9880146a
> [ffff9cb9a9f57928] node_page_state at ffffffff981ac66d
> [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> crash>
>
> Ok, I don't know why but I can't start any more terminals and exiting chromium also made starter terminal unusable. Some kind of lockup/wait is at hand!
Ok I actually ran sysrq+w and this time it showed me what got stuck and i got their (better)stacktraces via `crash` program:
all info here: https://gist.github.com/howaboutsynergy/629578627783223eb9e7878733968507
but here's a sample:
[ 7664.139179] ps D 0 25471 25445 0x00000004
[ 7664.139183] Call Trace:
[ 7664.139191] ? __schedule+0x2cc/0x590
[ 7664.139196] schedule+0x2e/0x90
[ 7664.139201] rwsem_down_read_failed+0x11e/0x1c0
[ 7664.139209] __access_remote_vm+0x52/0x200
[ 7664.139216] proc_pid_cmdline_read+0x19f/0x390
[ 7664.139224] vfs_read+0x98/0x150
[ 7664.139230] ksys_read+0x5d/0xe0
[ 7664.139235] do_syscall_64+0x50/0x170
[ 7664.139241] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 7664.139244] RIP: 0033:0x71f9f42c0415
[ 7664.139250] Code: Bad RIP value.
[ 7664.139253] RSP: 002b:00007ffee096b4c8 EFLAGS: 00000246 ORIG_RAX: 0000000000000000
[ 7664.139256] RAX: ffffffffffffffda RBX: 000071f9f3a37010 RCX: 000071f9f42c0415
[ 7664.139259] RDX: 0000000000020000 RSI: 000071f9f3a37010 RDI: 0000000000000006
[ 7664.139262] RBP: 0000000000020000 R08: 00000000ffffffff R09: 0000000000000013
[ 7664.139264] R10: 0000000000000000 R11: 0000000000000246 R12: 000071f9f3a37010
[ 7664.139267] R13: 0000000000000000 R14: 0000000000000006 R15: 0000000000000000
crash> bt -Tsx 25471
PID: 25471 TASK: ffff8fd695d25ac0 CPU: 0 COMMAND: "ps"
[ffff9cb94cdeb968] prep_new_page+0x65 at ffffffff981d56b5
[ffff9cb94cdeb978] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb94cdeb9b0] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb94cdeb9d8] xas_load+0x5 at ffffffff987ee805
[ffff9cb94cdebb08] page_counter_try_charge+0x18 at ffffffff9820aaa8
[ffff9cb94cdebb10] __memcg_kmem_charge_memcg+0x76 at ffffffff98211926
[ffff9cb94cdebb18] __mod_lruvec_state+0x3a at ffffffff9820edca
[ffff9cb94cdebc08] update_load_avg+0x76 at ffffffff980cd6a6
[ffff9cb94cdebc48] pick_next_task_fair+0x365 at ffffffff980d4825
[ffff9cb94cdebc78] put_prev_entity+0x19 at ffffffff980ce889
[ffff9cb94cdebcb8] __schedule+0x2cc at ffffffff987f5a0c
[ffff9cb94cdebd10] schedule+0x2e at ffffffff987f5cfe
[ffff9cb94cdebd28] rwsem_down_read_failed+0x11e at ffffffff987f896e
[ffff9cb94cdebdb0] __access_remote_vm+0x52 at ffffffff981c2182
[ffff9cb94cdebe30] proc_pid_cmdline_read+0x19f at ffffffff9829b76f
[ffff9cb94cdebec0] vfs_read+0x98 at ffffffff9821fe88
[ffff9cb94cdebef8] ksys_read+0x5d at ffffffff982201ad
[ffff9cb94cdebf38] do_syscall_64+0x50 at ffffffff98001830
[ffff9cb94cdebf50] entry_SYSCALL_64_after_hwframe+0x44 at ffffffff9880007c
RIP: 000071f9f42c0415 RSP: 00007ffee096b4c8 RFLAGS: 00000246
RAX: ffffffffffffffda RBX: 000071f9f3a37010 RCX: 000071f9f42c0415
RDX: 0000000000020000 RSI: 000071f9f3a37010 RDI: 0000000000000006
RBP: 0000000000020000 R8: 00000000ffffffff R9: 0000000000000013
R10: 0000000000000000 R11: 0000000000000246 R12: 000071f9f3a37010
R13: 0000000000000000 R14: 0000000000000006 R15: 0000000000000000
ORIG_RAX: 0000000000000000 CS: 0033 SS: 002b
crash> bt -Tsx 25445
PID: 25445 TASK: ffff8fd37cfe5ac0 CPU: 11 COMMAND: "bash"
[ffff9cb94cd738e8] prep_new_page+0x65 at ffffffff981d56b5
[ffff9cb94cd738f8] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb94cd73968] prep_new_page+0x65 at ffffffff981d56b5
[ffff9cb94cd73978] get_page_from_freelist+0xe88 at ffffffff981d9078
[ffff9cb94cd73988] update_group_capacity+0x20 at ffffffff980d2530
[ffff9cb94cd739b8] cpumask_next_and+0x18 at ffffffff987df928
[ffff9cb94cd739c0] update_sd_lb_stats+0x159 at ffffffff980d2839
[ffff9cb94cd73aa0] find_busiest_group+0x4f at ffffffff980d2e9f
[ffff9cb94cd73b10] __inode_wait_for_writeback+0x79 at ffffffff9824b499
[ffff9cb94cd73b30] fsnotify_grab_connector+0x45 at ffffffff98264d45
[ffff9cb94cd73b48] fsnotify_destroy_marks+0x1d at ffffffff9826582d
[ffff9cb94cd73b80] __inode_wait_for_writeback+0x79 at ffffffff9824b499
[ffff9cb94cd73ba0] fsnotify_grab_connector+0x45 at ffffffff98264d45
[ffff9cb94cd73bb8] fsnotify_destroy_marks+0x1d at ffffffff9826582d
[ffff9cb94cd73c78] update_load_avg+0x76 at ffffffff980cd6a6
[ffff9cb94cd73cb8] pick_next_task_fair+0x365 at ffffffff980d4825
[ffff9cb94cd73ce8] put_prev_entity+0x19 at ffffffff980ce889
[ffff9cb94cd73d28] __schedule+0x2cc at ffffffff987f5a0c
[ffff9cb94cd73d38] wait_consider_task+0x88b at ffffffff9809d4db
[ffff9cb94cd73d80] schedule+0x2e at ffffffff987f5cfe
[ffff9cb94cd73d98] do_wait+0x1b4 at ffffffff9809d6e4
[ffff9cb94cd73de8] kernel_wait4+0xa1 at ffffffff9809e9d1
[ffff9cb94cd73e28] child_wait_callback at ffffffff9809c730
[ffff9cb94cd73e78] __do_sys_wait4+0x85 at ffffffff9809eaf5
[ffff9cb94cd73ea0] handle_mm_fault+0xa9 at ffffffff981c01f9
[ffff9cb94cd73ec8] __do_page_fault+0x255 at ffffffff9803d5e5
[ffff9cb94cd73f38] do_syscall_64+0x50 at ffffffff98001830
[ffff9cb94cd73f50] entry_SYSCALL_64_after_hwframe+0x44 at ffffffff9880007c
RIP: 000071c78c3487bd RSP: 00007ffe9e1d0168 RFLAGS: 00000246
RAX: ffffffffffffffda RBX: 00005a4399257420 RCX: 000071c78c3487bd
RDX: 0000000000000000 RSI: 00007ffe9e1d0180 RDI: 00000000ffffffff
RBP: 00007ffe9e1d01b0 R8: 00007ffe9e1d0110 R9: 0000000000000000
R10: 0000000000000000 R11: 0000000000000246 R12: 0000000000000000
R13: 00007ffe9e1d1a00 R14: 0000000000000000 R15: 0000000000000000
ORIG_RAX: 000000000000003d CS: 0033 SS: 002b
crash>
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [Bug 204165] New: 100% CPU usage in compact_zone_order
2019-07-16 3:57 ` howaboutsynergy
@ 2019-07-16 7:11 ` Mel Gorman
2019-07-16 19:15 ` howaboutsynergy
2019-07-16 10:03 ` Mel Gorman
1 sibling, 1 reply; 12+ messages in thread
From: Mel Gorman @ 2019-07-16 7:11 UTC (permalink / raw)
To: howaboutsynergy; +Cc: Andrew Morton, bugzilla-daemon, linux-mm
On Tue, Jul 16, 2019 at 03:57:30AM +0000, howaboutsynergy@protonmail.com wrote:
> > PID: 21120 TASK: ffff8fd7f10ddac0 CPU: 9 COMMAND: "stress"
> > START: __schedule at ffffffff987f5a0c
> > [ffff9cb9a9f57928] isolate_migratepages_block at ffffffff981b35c6
> > [ffff9cb9a9f57950] isolate_migratepages_block at ffffffff981b37bd
> > [ffff9cb9a9f57a10] compact_zone at ffffffff981b4c07
> > [ffff9cb9a9f57ab8] compact_zone_order at ffffffff981b51de
> > [ffff9cb9a9f57b78] try_to_compact_pages at ffffffff981b5a17
> > [ffff9cb9a9f57bd8] __alloc_pages_direct_compact at ffffffff981d95a7
> > [ffff9cb9a9f57c30] __alloc_pages_slowpath at ffffffff981d99ee
> > [ffff9cb9a9f57cd0] release_pages at ffffffff9819aa08
> > [ffff9cb9a9f57d00] __pagevec_lru_add_fn at ffffffff9819ada9
> > [ffff9cb9a9f57d40] __alloc_pages_nodemask at ffffffff981da668
> > [ffff9cb9a9f57da0] do_huge_pmd_anonymous_page at ffffffff98202c01
> > [ffff9cb9a9f57df0] __handle_mm_fault at ffffffff981bfa4c
> > [ffff9cb9a9f57ea0] handle_mm_fault at ffffffff981c01f9
> > [ffff9cb9a9f57ec8] __do_page_fault at ffffffff9803d5c7
> > [ffff9cb9a9f57f28] do_page_fault at ffffffff9803d85d
> > [ffff9cb9a9f57f48] page_fault at ffffffff98800de8
> > [ffff9cb9a9f57f50] page_fault at ffffffff98800dfe
> > RIP: 00005879fc8c4c10 RSP: 00007ffd393aa0d0 RFLAGS: 00010206
> > RAX: 0000000010b8a000 RBX: 0000714104876010 RCX: 0000714358a5a3db
> > RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 0000714104876000
> > RBP: 00005879fc8c5a54 R8: 0000714104876010 R9: 0000000000000000
> > R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
> > R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
> > ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
> > crash>
High CPU usage in this path is not something I've observed recently.
When it happens and CPU usage is high, can you run the following commands
please?
trace-cmd record -e compaction:* sleep 10
trace-cmd report > trace.log
and send me the resulting trace.log please?
--
Mel Gorman
SUSE Labs
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [Bug 204165] New: 100% CPU usage in compact_zone_order
2019-07-16 3:57 ` howaboutsynergy
2019-07-16 7:11 ` Mel Gorman
@ 2019-07-16 10:03 ` Mel Gorman
1 sibling, 0 replies; 12+ messages in thread
From: Mel Gorman @ 2019-07-16 10:03 UTC (permalink / raw)
To: howaboutsynergy; +Cc: Andrew Morton, bugzilla-daemon, linux-mm
I tried reproducing this but after 300 attempts with various parameters
and adding other workloads in the background, I was unable to reproduce
the problem.
--
Mel Gorman
SUSE Labs
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [Bug 204165] New: 100% CPU usage in compact_zone_order
2019-07-16 7:11 ` Mel Gorman
@ 2019-07-16 19:15 ` howaboutsynergy
2019-07-17 17:53 ` Mel Gorman
0 siblings, 1 reply; 12+ messages in thread
From: howaboutsynergy @ 2019-07-16 19:15 UTC (permalink / raw)
To: Mel Gorman; +Cc: Andrew Morton, bugzilla-daemon, linux-mm
[-- Attachment #1.1: Type: text/plain, Size: 23574 bytes --]
On Tuesday, July 16, 2019 12:03 PM, Mel Gorman <mgorman@techsingularity.net> wrote:
> I tried reproducing this but after 300 attempts with various parameters
> and adding other workloads in the background, I was unable to reproduce
> the problem.
>
The third time I ran this command `$ time stress -m 220 --vm-bytes 10000000000 --timeout 10`, got 10+ hung:
PID %CPU COMMAND PR NI VIRT RES S USER
3785 94.5 stress 20 0 9769416 4 R user
3777 87.3 stress 20 0 9769416 4 R user
3923 85.5 stress 20 0 9769416 4 R user
3937 85.5 stress 20 0 9769416 4 R user
3943 81.8 stress 20 0 9769416 4 R user
3885 80.0 stress 20 0 9769416 4 R user
3970 80.0 stress 20 0 9769416 4 R user
3902 76.4 stress 20 0 9769416 4 R user
3954 72.7 stress 20 0 9769416 4 R user
3868 70.9 stress 20 0 9769416 4 R user
3893 69.1 stress 20 0 9769416 4 R user
3786 65.5 stress 20 0 9769416 4 R user
3783 60.0 stress 20 0 9769416 4 R user
3848 58.2 stress 20 0 9769416 4 R user
3863 58.2 stress 20 0 9769416 4 R user
looked like this:
```
TERM='xterm-256color'
53.48 573.49
-----------
user@i87k 2019/07/16 20:36:47 -bash5.0.7 t:5 j:0 d:3 pp:1140 p:1623 ut53
!41866 1 0 5.2.1-g527a3db363a3 #71 SMP Tue Jul 16 19:41:12 CEST 2019
/home/user
$ time stress -m 220 --vm-bytes 10000000000 --timeout 10
stress: info: [1744] dispatching hogs: 0 cpu, 0 io, 220 vm, 0 hdd
stress: info: [1744] successful run completed in 19s
real 0m19.036s
user 0m0.794s
sys 2m59.583s
-----------
user@i87k 2019/07/16 20:37:12 -bash5.0.7 t:5 j:0 d:3 pp:1140 p:1623 ut79
!41867 2 0 5.2.1-g527a3db363a3 #71 SMP Tue Jul 16 19:41:12 CEST 2019
/home/user
$ time stress -m 220 --vm-bytes 10000000000 --timeout 10
stress: info: [3520] dispatching hogs: 0 cpu, 0 io, 220 vm, 0 hdd
stress: info: [3520] successful run completed in 18s
real 0m18.657s
user 0m0.901s
sys 2m59.700s
-----------
user@i87k 2019/07/16 20:42:28 -bash5.0.7 t:5 j:0 d:3 pp:1140 p:1623 ut394
!41868 3 0 5.2.1-g527a3db363a3 #71 SMP Tue Jul 16 19:41:12 CEST 2019
/home/user
$ time stress -m 220 --vm-bytes 10000000000 --timeout 10
stress: info: [3771] dispatching hogs: 0 cpu, 0 io, 220 vm, 0 hdd
```
(sure I waited a few minutes until I ran the 3rd one, I don't remember what trivial things I've been doing during the time - like making sure I got the right trace command(s))
I'm pretty sure you need swap in (ext4)zram for this to trigger (faster?), judging by the fuller stacktrace that I showed in prev. email(s) gotten via 'crash'-s `bt -Tsx pidhere`
On Tuesday, July 16, 2019 9:11 AM, Mel Gorman <mgorman@techsingularity.net> wrote:
> High CPU usage in this path is not something I've observed recently.
> When it happens and CPU usage is high, can you run the following commands
> please?
>
> trace-cmd record -e compaction:* sleep 10
> trace-cmd report > trace.log
>
> and send me the resulting trace.log please?
Ok, getting trace.log as requested:
```
$ sudo trace-cmd record -e compaction:* sleep 10
[sudo] password for user:
CPU 0: 12430 events lost
CPU 1: 83959 events lost
CPU 4: 13447 events lost
CPU 6: 2825 events lost
CPU 8: 791 events lost
CPU 11: 8475 events lost
CPU0 data recorded at offset=0x5bc000
114487296 bytes in size
CPU1 data recorded at offset=0x72eb000
106885120 bytes in size
CPU2 data recorded at offset=0xd8da000
125046784 bytes in size
CPU3 data recorded at offset=0x1501b000
111022080 bytes in size
CPU4 data recorded at offset=0x1b9fc000
120532992 bytes in size
CPU5 data recorded at offset=0x22cef000
115990528 bytes in size
CPU6 data recorded at offset=0x29b8d000
116109312 bytes in size
CPU7 data recorded at offset=0x30a48000
73822208 bytes in size
CPU8 data recorded at offset=0x350af000
98643968 bytes in size
CPU9 data recorded at offset=0x3aec2000
96514048 bytes in size
CPU10 data recorded at offset=0x40acd000
113967104 bytes in size
CPU11 data recorded at offset=0x4777d000
127184896 bytes in size
trace.dat is 1.3G
-rw-r--r-- 1 root root 1326219264 16.07.2019 20:45 trace.dat
$ LD_PRELOAD=/usr/lib/trace-cmd/python/ctracecmd.so trace-cmd report > trace.log
trace-cmd: symbol lookup error: /usr/lib/trace-cmd/python/ctracecmd.so: undefined symbol: PyExc_SystemError
$ trace-cmd report > trace.log
could not load plugin '/usr/lib/trace-cmd/plugins/plugin_python.so'
/usr/lib/trace-cmd/plugins/plugin_python.so: undefined symbol: PyString_FromString
I guess we could ignore that?
trace.log is like 4.3G
-rw-r--r-- 1 user user 4370520245 16.07.2019 20:50 trace.log
On Tuesday, July 16, 2019 12:03 PM, Mel Gorman <mgorman@techsingularity.net> wrote:
> I tried reproducing this but after 300 attempts with various parameters
> and adding other workloads in the background, I was unable to reproduce
> the problem.
>
As a reminder, here's how sysrq+l stacktraces look like (for two of the stress pids):
```
[ 1294.913508] NMI backtrace for cpu 5
[ 1294.913517] CPU: 5 PID: 3848 Comm: stress Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #71
[ 1294.913522] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 2201 05/27/2019
[ 1294.913526] RIP: 0010:ftrace_likely_update+0x1a/0x200
[ 1294.913533] Code: 0b eb bb 66 66 2e 0f 1f 84 00 00 00 00 00 66 90 41 57 41 56 41 55 41 54 55 53 48 83 ec 20 48 89 fb 41 89 d4 9c 41 5f 0f 01 ca <85> c9 0f 84 8b 00 00 00 48 ff 47 28 8b 15 34 72 47 01 85 d2 75 16
[ 1294.913537] RSP: 0000:ffffa3cd4c7ef848 EFLAGS: 00000286
[ 1294.913552] RAX: 0000000000000000 RBX: ffffffff97546180 RCX: 0000000000000000
[ 1294.913557] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffff97546180
[ 1294.913562] RBP: 000000000017cc6f R08: 0000000000000000 R09: 0000000000000000
[ 1294.913567] R10: 0000000000000001 R11: 0000000000000004 R12: 0000000000000000
[ 1294.913571] R13: ffff93560dfdc000 R14: 000000000012f44c R15: 0000000000000286
[ 1294.913577] FS: 000072d6afdff740(0000) GS:ffff9355ed880000(0000) knlGS:0000000000000000
[ 1294.913582] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1294.913590] CR2: 000070fbe8abdc88 CR3: 0000000827a46004 CR4: 00000000003606e0
[ 1294.913595] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1294.913600] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1294.913605] Call Trace:
[ 1294.913609] _cond_resched+0x2d/0x50
[ 1294.913613] isolate_migratepages_block+0xf8/0xe40
[ 1294.913618] compact_zone+0x4f9/0xe10
[ 1294.913626] compact_zone_order+0xe3/0x120
[ 1294.913630] try_to_compact_pages+0xde/0x3b0
[ 1294.913635] __alloc_pages_direct_compact+0x8c/0x170
[ 1294.913639] __alloc_pages_slowpath+0x65c/0x1290
[ 1294.913644] __alloc_pages_nodemask+0x4cf/0x530
[ 1294.913648] do_huge_pmd_anonymous_page+0x17c/0x780
[ 1294.913653] __handle_mm_fault+0xeee/0x17d0
[ 1294.913661] handle_mm_fault+0x17b/0x330
[ 1294.913666] __do_page_fault+0x34e/0x800
[ 1294.913671] do_page_fault+0x57/0x1f9
[ 1294.913675] ? page_fault+0x8/0x30
[ 1294.913680] page_fault+0x1e/0x30
[ 1294.913684] RIP: 0033:0x5a46e611ac10
[ 1294.913690] Code: c0 0f 84 53 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f fa 00 00 00 31 c0 4d 85 ff 7e 10 0f 1f 40 00 <c6> 04 03 5a 4c 01 f0 49 39 c7 7f f4 4d 85 e4 0f 84 f4 01 00 00 7e
[ 1294.913695] RSP: 002b:00007fffa51f0f60 EFLAGS: 00010206
[ 1294.913705] RAX: 00000000098c0000 RBX: 000072d45bd40010 RCX: 000072d6aff243db
[ 1294.913710] RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 000072d45bd40000
[ 1294.913715] RBP: 00005a46e611ba54 R08: 000072d45bd40010 R09: 0000000000000000
[ 1294.913720] R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
[ 1294.913724] R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
[ 1294.913730] NMI backtrace for cpu 11
[ 1294.913739] CPU: 11 PID: 3902 Comm: stress Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #71
[ 1294.913744] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 2201 05/27/2019
[ 1294.913748] RIP: 0010:isolate_migratepages_block+0x97b/0xe40
[ 1294.913754] Code: c6 43 79 01 4c 8b 74 24 08 4d 39 fe b9 00 00 00 00 ba 00 00 00 00 40 0f 92 c6 40 0f b6 f6 48 c7 c7 90 ac 56 97 e8 05 fe f5 ff <4d> 39 fe 0f 82 7a f9 ff ff 4c 39 7c 24 08 0f 84 6f f9 ff ff 0f 1f
[ 1294.913758] RSP: 0000:ffffa3cd4c99f8b0 EFLAGS: 00000286
[ 1294.913768] RAX: 0000000000000000 RBX: ffffa3cd4c99fa50 RCX: 0000000000000000
[ 1294.913777] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffffff9756ac90
[ 1294.913781] RBP: 0000000000000001 R08: 0000000000000000 R09: 0000000000000000
[ 1294.913786] R10: 0000000000000001 R11: 0000000000000004 R12: 0000000000000000
[ 1294.913790] R13: 0000000000000000 R14: 000000000070ee00 R15: 000000000070ece0
[ 1294.913795] FS: 000072d6afdff740(0000) GS:ffff9355edb80000(0000) knlGS:0000000000000000
[ 1294.913799] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 1294.913804] CR2: 00007d99c6200000 CR3: 00000007ecb1a003 CR4: 00000000003606e0
[ 1294.913813] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 1294.913817] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[ 1294.913822] Call Trace:
[ 1294.913826] compact_zone+0x4f9/0xe10
[ 1294.913830] compact_zone_order+0xe3/0x120
[ 1294.913835] try_to_compact_pages+0xde/0x3b0
[ 1294.913839] __alloc_pages_direct_compact+0x8c/0x170
[ 1294.913848] __alloc_pages_slowpath+0x65c/0x1290
[ 1294.913852] __alloc_pages_nodemask+0x4cf/0x530
[ 1294.913856] do_huge_pmd_anonymous_page+0x17c/0x780
[ 1294.913861] __handle_mm_fault+0xeee/0x17d0
[ 1294.913865] handle_mm_fault+0x17b/0x330
[ 1294.913869] __do_page_fault+0x34e/0x800
[ 1294.913874] do_page_fault+0x57/0x1f9
[ 1294.913882] ? page_fault+0x8/0x30
[ 1294.913886] page_fault+0x1e/0x30
[ 1294.913891] RIP: 0033:0x5a46e611ac10
[ 1294.913896] Code: c0 0f 84 53 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f fa 00 00 00 31 c0 4d 85 ff 7e 10 0f 1f 40 00 <c6> 04 03 5a 4c 01 f0 49 39 c7 7f f4 4d 85 e4 0f 84 f4 01 00 00 7e
[ 1294.913901] RSP: 002b:00007fffa51f0f60 EFLAGS: 00010206
[ 1294.913907] RAX: 000000000d0c0000 RBX: 000072d45bd40010 RCX: 000072d6aff243db
[ 1294.913916] RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 000072d45bd40000
[ 1294.913921] RBP: 00005a46e611ba54 R08: 000072d45bd40010 R09: 0000000000000000
[ 1294.913925] R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
[ 1294.913929] R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
```
and here's how they look via crash:
```
$ sudo crash "/usr/lib/modules/$(uname -r)/build/vmlinux"
[sudo] password for user:
crash 7.2.6
Copyright (C) 2002-2019 Red Hat, Inc.
Copyright (C) 2004, 2005, 2006, 2010 IBM Corporation
Copyright (C) 1999-2006 Hewlett-Packard Co
Copyright (C) 2005, 2006, 2011, 2012 Fujitsu Limited
Copyright (C) 2006, 2007 VA Linux Systems Japan K.K.
Copyright (C) 2005, 2011 NEC Corporation
Copyright (C) 1999, 2002, 2007 Silicon Graphics, Inc.
Copyright (C) 1999, 2000, 2001, 2002 Mission Critical Linux, Inc.
This program is free software, covered by the GNU General Public License,
and you are welcome to change it and/or distribute copies of it under
certain conditions. Enter "help copying" to see the conditions.
This program has absolutely no warranty. Enter "help warranty" for details.
GNU gdb (GDB) 7.6
Copyright (C) 2013 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-unknown-linux-gnu"...
WARNING: kernel relocated [336MB]: patching 121800 gdb minimal_symbol values
KERNEL: /usr/lib/modules/5.2.1-g527a3db363a3/build/vmlinux
DUMPFILE: /proc/kcore
CPUS: 12
DATE: Tue Jul 16 20:59:48 2019
UPTIME: 00:23:54
LOAD AVERAGE: 26.83, 21.74, 16.35
TASKS: 508
NODENAME: i87k
RELEASE: 5.2.1-g527a3db363a3
VERSION: #71 SMP Tue Jul 16 19:41:12 CEST 2019
MACHINE: x86_64 (3700 Mhz)
MEMORY: 31.9 GB
PID: 6417
COMMAND: "crash"
TASK: ffff934f9c9a8000 [THREAD_INFO: ffff934f9c9a8000]
CPU: 2
STATE: TASK_RUNNING (ACTIVE)
crash> bt -Tsx 3848
PID: 3848 TASK: ffff934f83373d80 CPU: 5 COMMAND: "stress"
[ffffa3cd4c7eefb8] get_page_from_freelist+0xaa9 at ffffffff96291799
[ffffa3cd4c7ef0e8] get_page_from_freelist+0xaa9 at ffffffff96291799
[ffffa3cd4c7ef108] __alloc_pages_slowpath+0x216 at ffffffff96292cb6
[ffffa3cd4c7ef130] get_page_from_freelist+0xb76 at ffffffff96291866
[ffffa3cd4c7ef178] get_page_from_freelist+0xaa9 at ffffffff96291799
[ffffa3cd4c7ef1a0] trace_hardirqs_on_caller+0x32 at ffffffff961bc4b2
[ffffa3cd4c7ef2e0] ZSTD_compressSequences_internal+0x8db at ffffffff9660a27b
[ffffa3cd4c7ef388] ZSTD_compressSequences_internal+0x8db at ffffffff9660a27b
[ffffa3cd4c7ef4b0] get_zspage_mapping+0x40 at ffffffff962e2220
[ffffa3cd4c7ef538] decay_load+0x6a at ffffffff96111d1a
[ffffa3cd4c7ef5a0] __list_add_valid+0x90 at ffffffff965e3ff0
[ffffa3cd4c7ef650] check_preempt_wakeup+0x267 at ffffffff960f7097
[ffffa3cd4c7ef6b8] decay_load+0x6a at ffffffff96111d1a
[ffffa3cd4c7ef700] trace_hardirqs_on_thunk+0x1a at ffffffff96001b02
[ffffa3cd4c7ef738] update_load_avg+0xca at ffffffff960f73aa
[ffffa3cd4c7ef740] update_load_avg+0xca at ffffffff960f73aa
[ffffa3cd4c7ef7a0] finish_task_switch+0xc9 at ffffffff960e6879
[ffffa3cd4c7ef7e8] finish_task_switch+0x17f at ffffffff960e692f
[ffffa3cd4c7ef820] __schedule+0x552 at ffffffff969f4752
[ffffa3cd4c7ef8a8] isolate_migratepages_block+0x97b at ffffffff9626165b
[ffffa3cd4c7ef918] isolate_migratepages_block+0xf at ffffffff96260cef
[ffffa3cd4c7ef978] compact_zone+0x4f9 at ffffffff96263eb9
[ffffa3cd4c7efa38] compact_zone_order+0xe3 at ffffffff962648b3
[ffffa3cd4c7efaf0] try_to_compact_pages+0xde at ffffffff9626523e
[ffffa3cd4c7efb60] __alloc_pages_direct_compact+0x8c at ffffffff9629285c
[ffffa3cd4c7efbb8] __alloc_pages_slowpath+0x65c at ffffffff962930fc
[ffffa3cd4c7efce8] __alloc_pages_nodemask+0x4cf at ffffffff962941ff
[ffffa3cd4c7efd60] do_huge_pmd_anonymous_page+0x17c at ffffffff962c6fcc
[ffffa3cd4c7efdb0] __handle_mm_fault+0xeee at ffffffff96272c3e
[ffffa3cd4c7efe78] handle_mm_fault+0x17b at ffffffff9627369b
[ffffa3cd4c7efeb0] __do_page_fault+0x34e at ffffffff9604f8ee
[ffffa3cd4c7eff20] do_page_fault+0x57 at ffffffff9604fe27
[ffffa3cd4c7eff38] page_fault+0x8 at ffffffff96a00e78
[ffffa3cd4c7eff50] page_fault+0x1e at ffffffff96a00e8e
RIP: 00005a46e611ac10 RSP: 00007fffa51f0f60 RFLAGS: 00010206
RAX: 00000000098c0000 RBX: 000072d45bd40010 RCX: 000072d6aff243db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 000072d45bd40000
RBP: 00005a46e611ba54 R8: 000072d45bd40010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -l 3848
PID: 3848 TASK: ffff934f83373d80 CPU: 11 COMMAND: "stress"
#0 [ffffa3cd4c7ef7f0] __schedule at ffffffff969f471a
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/kernel/sched/core.c: 2818
#1 [ffffa3cd4c7ef830] trace_hardirqs_on_thunk at ffffffff96001b02
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/arch/x86/entry/thunk_64.S: 42
#2 [ffffa3cd4c7ef8a8] isolate_migratepages_block at ffffffff9626165b
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/mm/compaction.c: 1039
#3 [ffffa3cd4c7ef978] compact_zone at ffffffff96263eb9
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/mm/compaction.c: 1817
#4 [ffffa3cd4c7efa38] compact_zone_order at ffffffff962648b3
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/mm/compaction.c: 2313
#5 [ffffa3cd4c7efaf0] try_to_compact_pages at ffffffff9626523e
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/mm/compaction.c: 2362
#6 [ffffa3cd4c7efb60] __alloc_pages_direct_compact at ffffffff9629285c
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/mm/page_alloc.c: 3831
#7 [ffffa3cd4c7efbb8] __alloc_pages_slowpath at ffffffff962930fc
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/mm/page_alloc.c: 4470
#8 [ffffa3cd4c7efce8] __alloc_pages_nodemask at ffffffff962941ff
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/mm/page_alloc.c: 4678
#9 [ffffa3cd4c7efd60] do_huge_pmd_anonymous_page at ffffffff962c6fcc
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/./include/linux/topology.h: 73
#10 [ffffa3cd4c7efdb0] __handle_mm_fault at ffffffff96272c3e
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/mm/memory.c: 3788
#11 [ffffa3cd4c7efe78] handle_mm_fault at ffffffff9627369b
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/mm/memory.c: 4058
#12 [ffffa3cd4c7efeb0] __do_page_fault at ffffffff9604f8ee
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/arch/x86/mm/fault.c: 1457
#13 [ffffa3cd4c7eff20] do_page_fault at ffffffff9604fe27
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/./arch/x86/include/asm/jump_label.h: 23
#14 [ffffa3cd4c7eff50] page_fault at ffffffff96a00e8e
/home/user/build/1packages/4used/kernel/linux-stable/makepkg_pacman/linux-stable/src/linux-stable/arch/x86/entry/entry_64.S: 1156
RIP: 00005a46e611ac10 RSP: 00007fffa51f0f60 RFLAGS: 00010206
RAX: 00000000098c0000 RBX: 000072d45bd40010 RCX: 000072d6aff243db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 000072d45bd40000
RBP: 00005a46e611ba54 R8: 000072d45bd40010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -Tsx 3902
PID: 3902 TASK: ffff934f5264bd80 CPU: 1 COMMAND: "stress"
[ffffa3cd4c99efb8] get_page_from_freelist+0xaa9 at ffffffff96291799
[ffffa3cd4c99f108] __alloc_pages_slowpath+0x216 at ffffffff96292cb6
[ffffa3cd4c99f130] get_page_from_freelist+0xb76 at ffffffff96291866
[ffffa3cd4c99f178] get_page_from_freelist+0xaa9 at ffffffff96291799
[ffffa3cd4c99f2e0] ZSTD_compressSequences_internal+0x8db at ffffffff9660a27b
[ffffa3cd4c99f480] test_clear_page_writeback+0x12a at ffffffff9623ad8a
[ffffa3cd4c99f4a8] trace_hardirqs_on+0x2c at ffffffff961bc30c
[ffffa3cd4c99f4c8] test_clear_page_writeback+0x18c at ffffffff9623adec
[ffffa3cd4c99f538] decay_load+0x6a at ffffffff96111d1a
[ffffa3cd4c99f5a0] __list_add_valid+0x90 at ffffffff965e3ff0
[ffffa3cd4c99f650] check_preempt_wakeup+0x267 at ffffffff960f7097
[ffffa3cd4c99f6b8] decay_load+0x6a at ffffffff96111d1a
[ffffa3cd4c99f6e0] __accumulate_pelt_segments+0x29 at ffffffff96111d89
[ffffa3cd4c99f700] __update_load_avg_se+0x1cb at ffffffff961120ab
[ffffa3cd4c99f738] update_load_avg+0xca at ffffffff960f73aa
[ffffa3cd4c99f740] update_load_avg+0xca at ffffffff960f73aa
[ffffa3cd4c99f7e0] switch_mm_irqs_off+0x270 at ffffffff96057920
[ffffa3cd4c99f820] __schedule+0x51a at ffffffff969f471a
[ffffa3cd4c99f880] preempt_schedule_common+0x15 at ffffffff969f4ed5
[ffffa3cd4c99f898] _cond_resched+0x3f at ffffffff969f4f3f
[ffffa3cd4c99f8a8] isolate_migratepages_block+0xf8 at ffffffff96260dd8
[ffffa3cd4c99f978] compact_zone+0x4f9 at ffffffff96263eb9
[ffffa3cd4c99fa38] compact_zone_order+0xe3 at ffffffff962648b3
[ffffa3cd4c99faf0] try_to_compact_pages+0xde at ffffffff9626523e
[ffffa3cd4c99fb60] __alloc_pages_direct_compact+0x8c at ffffffff9629285c
[ffffa3cd4c99fbb8] __alloc_pages_slowpath+0x65c at ffffffff962930fc
[ffffa3cd4c99fce8] __alloc_pages_nodemask+0x4cf at ffffffff962941ff
[ffffa3cd4c99fd60] do_huge_pmd_anonymous_page+0x17c at ffffffff962c6fcc
[ffffa3cd4c99fdb0] __handle_mm_fault+0xeee at ffffffff96272c3e
[ffffa3cd4c99fe78] handle_mm_fault+0x17b at ffffffff9627369b
[ffffa3cd4c99feb0] __do_page_fault+0x34e at ffffffff9604f8ee
[ffffa3cd4c99ff20] do_page_fault+0x57 at ffffffff9604fe27
[ffffa3cd4c99ff38] page_fault+0x8 at ffffffff96a00e78
[ffffa3cd4c99ff50] page_fault+0x1e at ffffffff96a00e8e
RIP: 00005a46e611ac10 RSP: 00007fffa51f0f60 RFLAGS: 00010206
RAX: 000000000d0c0000 RBX: 000072d45bd40010 RCX: 000072d6aff243db
RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 000072d45bd40000
RBP: 00005a46e611ba54 R8: 000072d45bd40010 R9: 0000000000000000
R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
ORIG_RAX: ffffffffffffffff CS: 0033 SS: 002b
crash> bt -l 3902
PID: 3902 TASK: ffff934f5264bd80 CPU: 9 COMMAND: "stress"
(active)
crash>
```
As can be seen, it's doing stuff with(in) zstd, maybe that's why swap in zstd is needed to reproduce this (more easily? or at all?)
trace.log is still being compressed(via xz) but those running 'stress' processes using 100% cpu are only making this slower :)
I'll send it when it's ready?
[-- Attachment #1.2: publickey - howaboutsynergy@protonmail.com - 0x947B9B34.asc --]
[-- Type: application/pgp-keys, Size: 3227 bytes --]
[-- Attachment #2: OpenPGP digital signature --]
[-- Type: application/pgp-signature, Size: 855 bytes --]
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [Bug 204165] New: 100% CPU usage in compact_zone_order
2019-07-16 19:15 ` howaboutsynergy
@ 2019-07-17 17:53 ` Mel Gorman
2019-07-17 22:00 ` howaboutsynergy
0 siblings, 1 reply; 12+ messages in thread
From: Mel Gorman @ 2019-07-17 17:53 UTC (permalink / raw)
To: howaboutsynergy; +Cc: Andrew Morton, bugzilla-daemon, linux-mm
On Tue, Jul 16, 2019 at 07:15:08PM +0000, howaboutsynergy@protonmail.com wrote:
> On Tuesday, July 16, 2019 12:03 PM, Mel Gorman <mgorman@techsingularity.net> wrote:
> > I tried reproducing this but after 300 attempts with various parameters
> > and adding other workloads in the background, I was unable to reproduce
> > the problem.
> >
>
>
> The third time I ran this command `$ time stress -m 220 --vm-bytes 10000000000 --timeout 10`, got 10+ hung:
>
> PID %CPU COMMAND PR NI VIRT RES S USER
> 3785 94.5 stress 20 0 9769416 4 R user
> 3777 87.3 stress 20 0 9769416 4 R user
> 3923 85.5 stress 20 0 9769416 4 R user
> 3937 85.5 stress 20 0 9769416 4 R user
> 3943 81.8 stress 20 0 9769416 4 R user
> 3885 80.0 stress 20 0 9769416 4 R user
> 3970 80.0 stress 20 0 9769416 4 R user
>
> <SNIP>
>
> trace.dat is 1.3G
> -rw-r--r-- 1 root root 1326219264 16.07.2019 20:45 trace.dat
>
Ok, great. From the trace, it was obvious that the scanner is making no
progress. I don't think zswap is involved as such but it *may* be making
it easier to trigger due to altering timing. At least, I see no reason
why zswap would materially affect the termination conditions.
From the path and your trace, I think what *might* be happening is that
a fatal signal is pending which does not advance the scanner or look like
a proper abort. I think it ends up looping in compaction instead of dying
without either aborting or progressing the scanner. It might explain why
stress-ng is hitting is as it is probably sending fatal signals on timeout
(I didn't check the source).
Can you try this (compile tested only) patch please? Note that the stress
test might still take time to exit normally if it's stuck in a swap
storm of some sort but I'm hoping the 100% compaction CPU usage goes away
at least.
diff --git a/mm/compaction.c b/mm/compaction.c
index 9e1b9acb116b..952dc2fb24e5 100644
--- a/mm/compaction.c
+++ b/mm/compaction.c
@@ -842,13 +842,15 @@ isolate_migratepages_block(struct compact_control *cc, unsigned long low_pfn,
/*
* Periodically drop the lock (if held) regardless of its
- * contention, to give chance to IRQs. Abort async compaction
- * if contended.
+ * contention, to give chance to IRQs. Abort completely if
+ * a fatal signal is pending.
*/
if (!(low_pfn % SWAP_CLUSTER_MAX)
&& compact_unlock_should_abort(&pgdat->lru_lock,
- flags, &locked, cc))
- break;
+ flags, &locked, cc)) {
+ low_pfn = 0;
+ goto fatal_pending;
+ }
if (!pfn_valid_within(low_pfn))
goto isolate_fail;
@@ -1060,6 +1062,7 @@ isolate_migratepages_block(struct compact_control *cc, unsigned long low_pfn,
trace_mm_compaction_isolate_migratepages(start_pfn, low_pfn,
nr_scanned, nr_isolated);
+fatal_pending:
cc->total_migrate_scanned += nr_scanned;
if (nr_isolated)
count_compact_events(COMPACTISOLATED, nr_isolated);
--
Mel Gorman
SUSE Labs
^ permalink raw reply related [flat|nested] 12+ messages in thread
* Re: [Bug 204165] New: 100% CPU usage in compact_zone_order
2019-07-17 17:53 ` Mel Gorman
@ 2019-07-17 22:00 ` howaboutsynergy
2019-07-18 8:37 ` Mel Gorman
0 siblings, 1 reply; 12+ messages in thread
From: howaboutsynergy @ 2019-07-17 22:00 UTC (permalink / raw)
To: Mel Gorman; +Cc: Andrew Morton, bugzilla-daemon, linux-mm
tl;dr: patch seems to work, thank you very much!
‐‐‐‐‐‐‐ Original Message ‐‐‐‐‐‐‐
On Wednesday, July 17, 2019 7:53 PM, Mel Gorman <mgorman@techsingularity.net> wrote:
> Ok, great. From the trace, it was obvious that the scanner is making no
> progress. I don't think zswap is involved as such but it may be making
> it easier to trigger due to altering timing. At least, I see no reason
> why zswap would materially affect the termination conditions.
I don't know if it matters in this context, but I've been using the term `zswap`(somewhere else I think) to (wrongly)refer to swap in zram (and even sometimes called it ext4(in this bug report too) without realizing at the time that ext4 is only for /tmp and /var/tmp instead! they are ext4 in zram) but in fact this isn't zswap that I have been using (even though I have CONFIG_ZSWAP=y in .config) but it's just CONFIG_ZRAM=y with CONFIG_SWAP=y (and probably a bunch of others being needed too).
>
> From the path and your trace, I think what might be happening is that
> a fatal signal is pending which does not advance the scanner or look like
> a proper abort. I think it ends up looping in compaction instead of dying
> without either aborting or progressing the scanner. It might explain why
> stress-ng is hitting is as it is probably sending fatal signals on timeout
> (I didn't check the source).
Ah I didn't know there are multiple `stress` versions, here's what I used:
/usr/bin/stress is owned by stress 1.0.4-5
$ pacman -Qs stress
local/stress 1.0.4-5
A tool that stress tests your system (CPU, memory, I/O, disks)
$ pacman -Qi stress
Name : stress
Version : 1.0.4-5
Description : A tool that stress tests your system (CPU, memory, I/O, disks)
Architecture : x86_64
URL : http://people.seas.harvard.edu/~apw/stress/
Licenses : GPL
Groups : None
Provides : None
Depends On : None
Optional Deps : None
Required By : None
Optional For : None
Conflicts With : None
Replaces : None
Installed Size : 25.00 KiB
Packager : Florian Pritz <bluewind@xinu.at>
Build Date : Thu 31 May 2018 01:46:16 PM CEST
Install Date : Mon 10 Jun 2019 02:44:14 AM CEST
Install Reason : Explicitly installed
Install Script : No
Validated By : Signature
Note: not:
$ yaourt -Ss stress-ng
aur/stress-ng 0.09.59-1 (11) (0.10)
stress-ng will stress test a computer system in various selectable ways
(it probably doesn't matter anyway :) as I didn't look at the source either)
>
> Can you try this (compile tested only) patch please? Note that the stress
> test might still take time to exit normally if it's stuck in a swap
> storm of some sort but I'm hoping the 100% compaction CPU usage goes away
> at least.
>
> diff --git a/mm/compaction.c b/mm/compaction.c
> index 9e1b9acb116b..952dc2fb24e5 100644
> --- a/mm/compaction.c
> +++ b/mm/compaction.c
> @@ -842,13 +842,15 @@ isolate_migratepages_block(struct compact_control cc, unsigned long low_pfn,
> /* Periodically drop the lock (if held) regardless of its
>
> - * contention, to give chance to IRQs. Abort async compaction
>
>
> - * if contended.
>
>
>
> - * contention, to give chance to IRQs. Abort completely if
>
>
> - * a fatal signal is pending.
> */
> if (!(low_pfn % SWAP_CLUSTER_MAX)
> && compact_unlock_should_abort(&pgdat->lru_lock,
>
>
>
> - flags, &locked, cc))
>
>
> - break;
>
>
>
> - flags, &locked, cc)) {
>
>
> - low_pfn = 0;
>
>
> - goto fatal_pending;
>
>
> - }
>
>
>
> if (!pfn_valid_within(low_pfn))
> goto isolate_fail;
> @@ -1060,6 +1062,7 @@ isolate_migratepages_block(struct compact_control *cc, unsigned long low_pfn,
> trace_mm_compaction_isolate_migratepages(start_pfn, low_pfn,
> nr_scanned, nr_isolated);
>
> +fatal_pending:
> cc->total_migrate_scanned += nr_scanned;
>
> if (nr_isolated)
> count_compact_events(COMPACTISOLATED, nr_isolated);
>
>
> --
>
> Mel Gorman
> SUSE Labs
Now the "problem" is I can't tell if it would get stuck :D but it usually ends in no more than 17 sec:
$ time stress -m 220 --vm-bytes 10000000000 --timeout 10
stress: info: [7981] dispatching hogs: 0 cpu, 0 io, 220 vm, 0 hdd
stress: FAIL: [7981] (415) <-- worker 8202 got signal 9
stress: WARN: [7981] (417) now reaping child worker processes
stress: FAIL: [7981] (415) <-- worker 8199 got signal 9
stress: WARN: [7981] (417) now reaping child worker processes
stress: FAIL: [7981] (451) failed run completed in 18s
real 0m17.397s
user 0m1.069s
sys 2m42.774s
sometimes it's 14,15 or 16, but usually it's between 17 and 18(exclusive) seconds.
Interestingly sometimes (rarely) it succeeds:
$ time stress -m 220 --vm-bytes 10000000000 --timeout 10
stress: info: [12629] dispatching hogs: 0 cpu, 0 io, 220 vm, 0 hdd
stress: info: [12629] successful run completed in 15s
real 0m14.571s
user 0m1.122s
sys 2m18.623s
But it succeedes 100% of the time if I limit CPU max to 800Mhz (lowest):
$ time stress -m 220 --vm-bytes 10000000000 --timeout 10
stress: info: [8434] dispatching hogs: 0 cpu, 0 io, 220 vm, 0 hdd
stress: info: [8434] successful run completed in 23s
real 0m22.639s
user 0m1.653s
sys 3m18.693s
sometimes it's in 7 sec less that the usual 22sec:
$ time stress -m 220 --vm-bytes 10000000000 --timeout 10
stress: info: [8689] dispatching hogs: 0 cpu, 0 io, 220 vm, 0 hdd
stress: info: [8689] successful run completed in 15s
real 0m15.585s
user 0m1.576s
sys 2m26.495s
(probably irrelevant)Sometimes Xorg says it can't allocate any more memory but stacktrace looks like it's inside some zram i915 kernel stuff:
[ 1416.842931] [drm] Atomic update on pipe (A) took 188 us, max time under evasion is 100 us
[ 1425.416979] Xorg: page allocation failure: order:0, mode:0x400d0(__GFP_IO|__GFP_FS|__GFP_COMP|__GFP_RECLAIMABLE), nodemask=(null),cpuset=/,mems_allowed=0
[ 1425.416984] CPU: 1 PID: 1024 Comm: Xorg Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #74
[ 1425.416985] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 2201 05/27/2019
[ 1425.416986] Call Trace:
[ 1425.416991] dump_stack+0x46/0x60
[ 1425.416993] warn_alloc.cold+0x7b/0xfb
[ 1425.416996] __alloc_pages_slowpath+0xbe2/0xc20
[ 1425.416997] __alloc_pages_nodemask+0x268/0x2b0
[ 1425.416999] new_slab+0x3ff/0x610
[ 1425.417001] ? xas_alloc+0x9c/0xc0
[ 1425.417002] ___slab_alloc+0x33b/0x540
[ 1425.417003] ? xas_nomem+0x49/0x70
[ 1425.417005] ? xas_alloc+0x9c/0xc0
[ 1425.417006] ? xas_nomem+0x49/0x70
[ 1425.417007] __slab_alloc+0x9/0x10
[ 1425.417008] kmem_cache_alloc+0x118/0x150
[ 1425.417010] xas_nomem+0x49/0x70
[ 1425.417011] add_to_swap_cache+0x25c/0x310
[ 1425.417013] __read_swap_cache_async+0xef/0x1e0
[ 1425.417014] swap_cluster_readahead+0x1ac/0x2a0
[ 1425.417015] shmem_swapin+0x55/0xa0
[ 1425.417018] ? call_function_single_interrupt+0xa/0x20
[ 1425.417019] ? xas_init_marks+0x19/0x40
[ 1425.417020] ? xas_store+0x3e4/0x640
[ 1425.417022] shmem_swapin_page+0x418/0x590
[ 1425.417023] ? xas_load+0x5/0x70
[ 1425.417025] ? find_get_entry+0x55/0x120
[ 1425.417026] shmem_getpage_gfp.isra.0+0x37f/0x820
[ 1425.417028] shmem_read_mapping_page_gfp+0x3b/0x70
[ 1425.417051] i915_gem_object_get_pages_gtt+0x1f9/0x550 [i915]
[ 1425.417070] ? gen8_ppgtt_alloc_4lvl+0x5a/0x150 [i915]
[ 1425.417086] __i915_gem_object_get_pages+0x4e/0x60 [i915]
[ 1425.417104] __i915_vma_do_pin+0x4bf/0x540 [i915]
[ 1425.417120] eb_lookup_vmas+0x68b/0xb90 [i915]
[ 1425.417136] ? i915_gem_do_execbuffer+0x351/0x1040 [i915]
[ 1425.417152] ? i915_gem_execbuffer2_ioctl+0x1b7/0x380 [i915]
[ 1425.417154] ? krealloc+0x21/0xa0
[ 1425.417169] i915_gem_do_execbuffer+0x502/0x1040 [i915]
[ 1425.417172] ? ZSTD_decompressMultiFrame+0x329/0x370
[ 1425.417174] ? ZSTD_decompressDCtx+0xc/0x10
[ 1425.417175] ? ktime_get_with_offset+0x5c/0x130
[ 1425.417177] ? zram_bvec_rw.isra.0+0x154/0x6a0
[ 1425.417179] ? _cond_resched+0x10/0x20
[ 1425.417194] i915_gem_execbuffer2_ioctl+0x1b7/0x380 [i915]
[ 1425.417196] ? zram_rw_page+0xba/0xe0
[ 1425.417211] ? i915_gem_execbuffer_ioctl+0x2a0/0x2a0 [i915]
[ 1425.417220] drm_ioctl_kernel+0xa5/0xf0 [drm]
[ 1425.417228] drm_ioctl+0x201/0x380 [drm]
[ 1425.417243] ? i915_gem_execbuffer_ioctl+0x2a0/0x2a0 [i915]
[ 1425.417245] do_vfs_ioctl+0x3f4/0x660
[ 1425.417246] ? handle_mm_fault+0xa9/0x1d0
[ 1425.417248] ksys_ioctl+0x59/0x90
[ 1425.417249] __x64_sys_ioctl+0x11/0x20
[ 1425.417251] do_syscall_64+0x50/0x170
[ 1425.417253] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 1425.417255] RIP: 0033:0x78521f1b1c2b
[ 1425.417256] Code: 0f 1e fa 48 8b 05 65 d2 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 0f 1f 44 00 00 f3 0f 1e fa b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 35 d2 0c 00 f7 d8 64 89 01 48
[ 1425.417258] RSP: 002b:00007ffcf8fd0d08 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 1425.417259] RAX: ffffffffffffffda RBX: 000000000000000a RCX: 000078521f1b1c2b
[ 1425.417260] RDX: 00007ffcf8fd0d40 RSI: 0000000040406469 RDI: 000000000000000a
[ 1425.417261] RBP: 00005a6a541acad0 R08: 0000000000000000 R09: 00007852196c2a60
[ 1425.417262] R10: 0000785213f3e000 R11: 0000000000000246 R12: 0000000000002000
[ 1425.417263] R13: 000078521af98000 R14: 00007ffcf8fd0d40 R15: 00007ffcf8fd0d40
[ 1425.417264] Mem-Info:
[ 1425.417267] active_anon:6998108 inactive_anon:442511 isolated_anon:9465
active_file:2251 inactive_file:2329 isolated_file:259
unevictable:16735 dirty:20 writeback:0 unstable:0
slab_reclaimable:28873 slab_unreclaimable:37272
mapped:3501 shmem:39527 pagetables:32186 bounce:0
free:87238 free_pcp:2904 free_cma:0
[ 1425.417269] Node 0 active_anon:27992432kB inactive_anon:1770044kB active_file:9004kB inactive_file:9316kB unevictable:66940kB isolated(anon):37860kB isolated(file):1036kB mapped:14004kB dirty:80kB writeback:0kB shmem:158108kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 22118400kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
[ 1425.417271] Node 0 DMA free:15892kB min:100kB low:124kB high:148kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15892kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[ 1425.417273] lowmem_reserve[]: 0 2346 31714 31714
[ 1425.417275] Node 0 DMA32 free:132920kB min:15608kB low:19508kB high:23408kB active_anon:2259000kB inactive_anon:1412kB active_file:0kB inactive_file:0kB unevictable:1296kB writepending:0kB present:2744176kB managed:2416496kB mlocked:0kB kernel_stack:16kB pagetables:3420kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
[ 1425.417277] lowmem_reserve[]: 0 0 29368 29368
[ 1425.417279] Node 0 Normal free:200140kB min:198384kB low:246956kB high:295528kB active_anon:25733140kB inactive_anon:1769340kB active_file:10288kB inactive_file:10456kB unevictable:65560kB writepending:80kB present:30654464kB managed:30077908kB mlocked:32kB kernel_stack:9408kB pagetables:125324kB bounce:0kB free_pcp:11740kB local_pcp:1420kB free_cma:0kB
[ 1425.417281] lowmem_reserve[]: 0 0 0 0
[ 1425.417282] Node 0 DMA: 1*4kB (U) 0*8kB 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15892kB
[ 1425.417287] Node 0 DMA32: 248*4kB (UME) 256*8kB (UME) 172*16kB (UME) 138*32kB (UME) 87*64kB (UME) 68*128kB (UME) 38*256kB (UE) 22*512kB (UME) 11*1024kB (E) 0*2048kB 19*4096kB (M) = 134560kB
[ 1425.417292] Node 0 Normal: 17*4kB (UM) 20*8kB (UM) 16*16kB (UM) 1721*32kB (UM) 733*64kB (UME) 140*128kB (UM) 1*256kB (E) 1*512kB (M) 2*1024kB (ME) 37*2048kB (M) 0*4096kB = 198980kB
[ 1425.417297] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[ 1425.417298] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[ 1425.417299] 50365 total pagecache pages
[ 1425.417306] 6377 pages in swap cache
[ 1425.417307] Swap cache stats: add 728656996, delete 728204250, find 6351630/8862186
[ 1425.417308] Free swap = 35959128kB
[ 1425.417308] Total swap = 67108860kB
[ 1425.417309] 8353655 pages RAM
[ 1425.417310] 0 pages HighMem/MovableOnly
[ 1425.417310] 226081 pages reserved
[ 1425.417311] 0 pages cma reserved
[ 1425.417312] SLUB: Unable to allocate memory on node -1, gfp=0xc0(__GFP_IO|__GFP_FS)
[ 1425.417313] cache: radix_tree_node, object size: 576, buffer size: 584, default order: 2, min order: 0
[ 1425.417314] node 0: slabs: 5357, objs: 149702, free: 0
[ 1426.236297] Xorg: page allocation failure: order:0, mode:0x400d0(__GFP_IO|__GFP_FS|__GFP_COMP|__GFP_RECLAIMABLE), nodemask=(null),cpuset=/,mems_allowed=0
[ 1426.236306] CPU: 9 PID: 1024 Comm: Xorg Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #74
[ 1426.236307] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 2201 05/27/2019
[ 1426.236308] Call Trace:
[ 1426.236318] dump_stack+0x46/0x60
[ 1426.236322] warn_alloc.cold+0x7b/0xfb
[ 1426.236326] __alloc_pages_slowpath+0xbe2/0xc20
[ 1426.236328] __alloc_pages_nodemask+0x268/0x2b0
[ 1426.236331] new_slab+0x3ff/0x610
[ 1426.236335] ? xas_alloc+0x9c/0xc0
[ 1426.236337] ___slab_alloc+0x33b/0x540
[ 1426.236339] ? xas_nomem+0x49/0x70
[ 1426.236340] ? xas_alloc+0x9c/0xc0
[ 1426.236341] ? xas_nomem+0x49/0x70
[ 1426.236342] __slab_alloc+0x9/0x10
[ 1426.236343] kmem_cache_alloc+0x118/0x150
[ 1426.236345] xas_nomem+0x49/0x70
[ 1426.236347] add_to_swap_cache+0x25c/0x310
[ 1426.236349] __read_swap_cache_async+0xef/0x1e0
[ 1426.236351] read_swap_cache_async+0x24/0x60
[ 1426.236352] swap_cluster_readahead+0x237/0x2a0
[ 1426.236354] ? get_page_from_freelist+0xe88/0x1330
[ 1426.236356] ? ktime_get+0x49/0x110
[ 1426.236358] shmem_swapin+0x55/0xa0
[ 1426.236361] shmem_swapin_page+0x418/0x590
[ 1426.236362] ? xas_load+0x5/0x70
[ 1426.236366] ? find_get_entry+0x55/0x120
[ 1426.236367] shmem_getpage_gfp.isra.0+0x37f/0x820
[ 1426.236368] shmem_read_mapping_page_gfp+0x3b/0x70
[ 1426.236438] i915_gem_object_get_pages_gtt+0x1f9/0x550 [i915]
[ 1426.236445] ? set_next_entity+0x89/0x150
[ 1426.236447] ? pick_next_task_fair+0x590/0x760
[ 1426.236482] __i915_gem_object_get_pages+0x4e/0x60 [i915]
[ 1426.236501] __i915_vma_do_pin+0x4bf/0x540 [i915]
[ 1426.236518] eb_lookup_vmas+0x68b/0xb90 [i915]
[ 1426.236534] i915_gem_do_execbuffer+0x502/0x1040 [i915]
[ 1426.236537] ? xas_init_marks+0x19/0x40
[ 1426.236538] ? xas_store+0x3e4/0x640
[ 1426.236540] ? __delete_from_swap_cache+0x15a/0x190
[ 1426.236541] ? _swap_info_get+0xa/0x30
[ 1426.236543] ? free_swap_slot+0x43/0xc0
[ 1426.236544] ? __swap_entry_free.constprop.0+0x92/0xa0
[ 1426.236545] ? shmem_swapin_page+0x4fe/0x590
[ 1426.236547] ? xas_load+0x5/0x70
[ 1426.236549] ? find_get_entry+0x55/0x120
[ 1426.236550] ? _cond_resched+0x10/0x20
[ 1426.236566] i915_gem_execbuffer2_ioctl+0x1b7/0x380 [i915]
[ 1426.236577] ? __mod_lruvec_state+0x3a/0xe0
[ 1426.236593] ? i915_gem_execbuffer_ioctl+0x2a0/0x2a0 [i915]
[ 1426.236618] drm_ioctl_kernel+0xa5/0xf0 [drm]
[ 1426.236627] drm_ioctl+0x201/0x380 [drm]
[ 1426.236645] ? i915_gem_execbuffer_ioctl+0x2a0/0x2a0 [i915]
[ 1426.236649] ? __set_current_blocked+0x38/0x50
[ 1426.236650] ? signal_setup_done+0x8b/0xa0
[ 1426.236654] do_vfs_ioctl+0x3f4/0x660
[ 1426.236656] ? recalc_sigpending+0xe/0x40
[ 1426.236659] ? _copy_from_user+0x37/0x60
[ 1426.236661] ksys_ioctl+0x59/0x90
[ 1426.236662] __x64_sys_ioctl+0x11/0x20
[ 1426.236664] do_syscall_64+0x50/0x170
[ 1426.236669] entry_SYSCALL_64_after_hwframe+0x44/0xa9
[ 1426.236671] RIP: 0033:0x78521f1b1c2b
[ 1426.236673] Code: 0f 1e fa 48 8b 05 65 d2 0c 00 64 c7 00 26 00 00 00 48 c7 c0 ff ff ff ff c3 66 0f 1f 44 00 00 f3 0f 1e fa b8 10 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 35 d2 0c 00 f7 d8 64 89 01 48
[ 1426.236674] RSP: 002b:00007ffcf8fcee18 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[ 1426.236676] RAX: ffffffffffffffda RBX: 000078521dd60d40 RCX: 000078521f1b1c2b
[ 1426.236677] RDX: 00007ffcf8fcee80 RSI: 0000000040406469 RDI: 000000000000000a
[ 1426.236677] RBP: 00007ffcf8fcee80 R08: 0000000000000000 R09: 00007852196c3d60
[ 1426.236678] R10: 00007852184ea000 R11: 0000000000000246 R12: 0000000040406469
[ 1426.236679] R13: 000000000000000a R14: 00007ffcf8fcee80 R15: 00007ffcf8fcee80
[ 1426.236682] SLUB: Unable to allocate memory on node -1, gfp=0xc0(__GFP_IO|__GFP_FS)
[ 1426.236683] cache: radix_tree_node, object size: 576, buffer size: 584, default order: 2, min order: 0
[ 1426.236684] node 0: slabs: 1195, objs: 33082, free: 0
[ 1466.913788] stress invoked oom-killer: gfp_mask=0x100dca(GFP_HIGHUSER_MOVABLE|__GFP_ZERO), order=0, oom_score_adj=0
[ 1466.913792] CPU: 3 PID: 15698 Comm: stress Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #74
[ 1466.913793] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 2201 05/27/2019
[ 1466.913794] Call Trace:
[ 1466.913798] dump_stack+0x46/0x60
[ 1466.913800] dump_header+0x4f/0x2fd
[ 1466.913801] ? oom_unkillable_task+0x95/0xc0
[ 1466.913802] ? find_lock_task_mm+0x2e/0x70
[ 1466.913803] oom_kill_process.cold+0xb/0x10
[ 1466.913805] out_of_memory+0x1bc/0x460
[ 1466.913806] __alloc_pages_slowpath+0xb19/0xc20
[ 1466.913808] __alloc_pages_nodemask+0x268/0x2b0
[ 1466.913810] alloc_pages_vma+0x74/0x1c0
[ 1466.913812] __handle_mm_fault+0xe1f/0x1310
[ 1466.913814] handle_mm_fault+0xa9/0x1d0
[ 1466.913816] __do_page_fault+0x237/0x480
[ 1466.913817] do_page_fault+0x1d/0x67
[ 1466.913819] ? page_fault+0x8/0x30
[ 1466.913821] page_fault+0x1e/0x30
[ 1466.913822] RIP: 0033:0x56f413018c10
[ 1466.913824] Code: c0 0f 84 53 02 00 00 8b 54 24 0c 31 c0 85 d2 0f 94 c0 89 04 24 41 83 fd 02 0f 8f fa 00 00 00 31 c0 4d 85 ff 7e 10 0f 1f 40 00 <c6> 04 03 5a 4c 01 f0 49 39 c7 7f f4 4d 85 e4 0f 84 f4 01 00 00 7e
[ 1466.913825] RSP: 002b:00007ffd17a85910 EFLAGS: 00010206
[ 1466.913827] RAX: 00000000187e3000 RBX: 00007a864406e010 RCX: 00007a88982523db
[ 1466.913827] RDX: 0000000000000000 RSI: 00000002540bf000 RDI: 00007a864406e000
[ 1466.913828] RBP: 000056f413019a54 R08: 00007a864406e010 R09: 0000000000000000
[ 1466.913829] R10: 0000000000000022 R11: 00000002540be400 R12: ffffffffffffffff
[ 1466.913830] R13: 0000000000000002 R14: 0000000000001000 R15: 00000002540be400
[ 1466.913831] Mem-Info:
[ 1466.913834] active_anon:6889086 inactive_anon:437196 isolated_anon:44189
active_file:210 inactive_file:248 isolated_file:32
unevictable:16068 dirty:0 writeback:0 unstable:0
slab_reclaimable:10669 slab_unreclaimable:55287
mapped:492 shmem:16679 pagetables:49030 bounce:0
free:85711 free_pcp:1702 free_cma:0
[ 1466.913837] Node 0 active_anon:27556344kB inactive_anon:1748784kB active_file:840kB inactive_file:992kB unevictable:64272kB isolated(anon):176756kB isolated(file):128kB mapped:1968kB dirty:0kB writeback:0kB shmem:66716kB shmem_thp: 0kB shmem_pmdmapped: 0kB anon_thp: 18806784kB writeback_tmp:0kB unstable:0kB all_unreclaimable? no
[ 1466.913838] Node 0 DMA free:15892kB min:100kB low:124kB high:148kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB writepending:0kB present:15980kB managed:15892kB mlocked:0kB kernel_stack:0kB pagetables:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
[ 1466.913841] lowmem_reserve[]: 0 2346 31714 31714
[ 1466.913842] Node 0 DMA32 free:133064kB min:15608kB low:19508kB high:23408kB active_anon:2246984kB inactive_anon:516kB active_file:32kB inactive_file:20kB unevictable:56kB writepending:0kB present:2744176kB managed:2416496kB mlocked:0kB kernel_stack:16kB pagetables:6120kB bounce:0kB free_pcp:4kB local_pcp:0kB free_cma:0kB
[ 1466.913845] lowmem_reserve[]: 0 0 29368 29368
[ 1466.913847] Node 0 Normal free:193888kB min:194288kB low:242860kB high:291432kB active_anon:25307420kB inactive_anon:1748072kB active_file:2148kB inactive_file:2432kB unevictable:62728kB writepending:0kB present:30654464kB managed:30077908kB mlocked:32kB kernel_stack:9392kB pagetables:190000kB bounce:0kB free_pcp:6804kB local_pcp:344kB free_cma:0kB
[ 1466.913849] lowmem_reserve[]: 0 0 0 0
[ 1466.913851] Node 0 DMA: 1*4kB (U) 0*8kB 1*16kB (U) 0*32kB 2*64kB (U) 1*128kB (U) 1*256kB (U) 0*512kB 1*1024kB (U) 1*2048kB (M) 3*4096kB (M) = 15892kB
[ 1466.913856] Node 0 DMA32: 117*4kB (UME) 133*8kB (UME) 95*16kB (UME) 98*32kB (UME) 127*64kB (UME) 80*128kB (UME) 40*256kB (UME) 27*512kB (UME) 18*1024kB (ME) 2*2048kB (ME) 15*4096kB (ME) = 132588kB
[ 1466.913861] Node 0 Normal: 482*4kB (UME) 478*8kB (UME) 648*16kB (ME) 849*32kB (E) 661*64kB (UME) 345*128kB (UE) 132*256kB (UE) 49*512kB (UME) 4*1024kB (ME) 0*2048kB 0*4096kB = 192728kB
[ 1466.913867] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=1048576kB
[ 1466.913868] Node 0 hugepages_total=0 hugepages_free=0 hugepages_surp=0 hugepages_size=2048kB
[ 1466.913869] 64205 total pagecache pages
[ 1466.913875] 47161 pages in swap cache
[ 1466.913876] Swap cache stats: add 776634640, delete 776102875, find 6734206/9399597
[ 1466.913877] Free swap = 0kB
[ 1466.913877] Total swap = 67108860kB
[ 1466.913878] 8353655 pages RAM
[ 1466.913879] 0 pages HighMem/MovableOnly
[ 1466.913879] 226081 pages reserved
[ 1466.913880] 0 pages cma reserved
[ 1466.913880] Tasks state (memory values in pages):
[ 1466.913881] [ pid ] uid tgid total_vm rss pgtables_bytes swapents oom_score_adj name
[ 1466.913888] [ 399] 0 399 21409 0 212992 330 0 systemd-journal
[ 1466.913889] [ 413] 0 413 9265 0 94208 420 -1000 systemd-udevd
[ 1466.913891] [ 604] 81 604 2773 0 65536 225 -900 dbus-daemon
[ 1466.913893] [ 609] 0 609 649 0 45056 45 0 gpm
[ 1466.913894] [ 610] 0 610 6600 0 90112 269 0 systemd-logind
[ 1466.913896] [ 695] 0 695 11319 0 131072 157 0 login
[ 1466.913898] [ 799] 1000 799 7472 1 102400 377 0 systemd
[ 1466.913899] [ 800] 1000 800 16164 131 159744 463 0 (sd-pam)
[ 1466.913900] [ 812] 1000 812 3407 1 69632 1626 0 bash
[ 1466.913902] [ 1001] 1000 1001 1895 1 57344 143 0 startx
[ 1466.913903] [ 1023] 1000 1023 1006 0 49152 51 0 xinit
[ 1466.913905] [ 1024] 1000 1024 179163 512 634880 3292 0 Xorg
[ 1466.913906] [ 1033] 1000 1033 92987 0 217088 1934 0 xfce4-session
[ 1466.913908] [ 1037] 1000 1037 2758 0 61440 241 0 dbus-daemon
[ 1466.913909] [ 1040] 1000 1040 76635 1 98304 232 0 at-spi-bus-laun
[ 1466.913911] [ 1044] 1000 1044 57827 0 81920 290 0 xfconfd
[ 1466.913912] [ 1051] 1000 1051 2716 1 65536 165 0 dbus-daemon
[ 1466.913914] [ 1054] 1000 1054 40960 1 81920 256 0 at-spi2-registr
[ 1466.913915] [ 1057] 102 1057 483104 0 233472 1331 0 polkitd
[ 1466.913916] [ 1075] 1000 1075 1498 0 49152 120 0 ssh-agent
[ 1466.913918] [ 1080] 1000 1080 39233 18 69632 57 0 gpg-agent
[ 1466.913919] [ 1082] 1000 1082 90685 109 274432 4696 0 xfwm4
[ 1466.913921] [ 1088] 1000 1088 58565 1 176128 1375 0 xfsettingsd
[ 1466.913922] [ 1089] 1000 1089 69802 0 184320 1784 0 xfce4-panel
[ 1466.913924] [ 1092] 0 1092 65176 0 126976 419 0 upowerd
[ 1466.913925] [ 1097] 1000 1097 87154 0 184320 1268 0 Thunar
[ 1466.913926] [ 1118] 1000 1118 78926 0 258048 10182 0 xfdesktop
[ 1466.913928] [ 1123] 1000 1123 69044 0 167936 1478 0 panel-16-whiske
[ 1466.913929] [ 1126] 1000 1126 60071 0 196608 1436 0 panel-22-screen
[ 1466.913931] [ 1127] 1000 1127 49794 0 163840 1227 0 panel-12-system
[ 1466.913932] [ 1128] 1000 1128 49428 0 159744 1239 0 panel-24-cpugra
[ 1466.913933] [ 1129] 1000 1129 50483 0 167936 1603 0 panel-20-cpufre
[ 1466.913935] [ 1130] 1000 1130 49795 0 155648 1230 0 panel-13-netloa
[ 1466.913936] [ 1131] 1000 1131 49794 0 159744 1267 0 panel-10-diskpe
[ 1466.913938] [ 1132] 1000 1132 49795 0 163840 1225 0 panel-4-diskper
[ 1466.913939] [ 1133] 1000 1133 49928 0 159744 1242 0 panel-8-xfce4-s
[ 1466.913940] [ 1134] 1000 1134 59673 0 192512 1491 0 panel-3-power-m
[ 1466.913942] [ 1137] 1000 1137 49443 0 159744 1225 0 panel-6-systray
[ 1466.913943] [ 1140] 1000 1140 59653 0 192512 1497 0 panel-11-notifi
[ 1466.913944] [ 1141] 1000 1141 58452 4 176128 695 0 panel-17-xfce4-
[ 1466.913946] [ 1142] 1000 1142 49851 0 159744 1243 0 panel-2-actions
[ 1466.913947] [ 1145] 1000 1145 48311 160 143360 350 0 panel-25-xfce4-
[ 1466.913949] [ 1174] 1000 1174 95427 0 212992 2255 0 xfce4-terminal
[ 1466.913950] [ 1176] 1000 1176 116553 0 258048 4697 0 xfce4-terminal
[ 1466.913951] [ 1189] 1000 1189 48086 0 139264 467 0 polkit-gnome-au
[ 1466.913953] [ 1197] 1000 1197 50286 0 159744 1402 0 xfce4-power-man
[ 1466.913954] [ 1200] 1000 1200 42772 1 114688 874 0 pulseaudio
[ 1466.913956] [ 1206] 1000 1206 67174 0 155648 541 0 xfce4-notifyd
[ 1466.913957] [ 1216] 1000 1216 1895 1 53248 121 0 showdns
[ 1466.913958] [ 1223] 1000 1223 1862 0 57344 107 0 logw
[ 1466.913960] [ 1224] 1000 1224 1895 0 53248 124 0 showdns
[ 1466.913961] [ 1225] 1000 1225 1895 1 53248 121 0 showdns_success
[ 1466.913963] [ 1226] 1000 1226 1895 1 57344 120 0 showdns_fails
[ 1466.913964] [ 1227] 1000 1227 1862 1 53248 120 0 showdns_from_fi
[ 1466.913965] [ 1228] 1000 1228 1862 1 57344 120 0 showdns_from_ch
[ 1466.913967] [ 1231] 1000 1231 1528 0 53248 82 0 dmesg
[ 1466.913968] [ 1254] 1000 1254 1528 0 53248 77 0 dmesg
[ 1466.913970] [ 1255] 1000 1255 1862 0 53248 108 0 stripcolors
[ 1466.913971] [ 1256] 1000 1256 1625 0 53248 121 0 grep
[ 1466.913972] [ 1257] 1000 1257 2479 1 53248 78 0 sed
[ 1466.913974] [ 1260] 1000 1260 1528 0 53248 74 0 dmesg
[ 1466.913975] [ 1261] 1000 1261 1862 0 57344 107 0 stripcolors
[ 1466.913977] [ 1262] 1000 1262 1528 0 53248 87 0 dmesg
[ 1466.913978] [ 1263] 1000 1263 1625 0 53248 119 0 grep
[ 1466.913979] [ 1264] 1000 1264 1862 0 53248 108 0 stripcolors
[ 1466.913981] [ 1265] 1000 1265 1635 0 53248 108 0 grep
[ 1466.913982] [ 1266] 1000 1266 1624 0 53248 169 0 grep
[ 1466.913984] [ 1267] 1000 1267 2545 0 61440 213 0 sed
[ 1466.913985] [ 1268] 1000 1268 1623 0 53248 103 0 grep
[ 1466.913986] [ 1269] 1000 1269 1528 0 53248 93 0 dmesg
[ 1466.913988] [ 1270] 1000 1270 1862 0 49152 106 0 stripcolors
[ 1466.913989] [ 1271] 1000 1271 1627 0 53248 143 0 grep
[ 1466.913991] [ 1272] 1000 1272 2512 0 61440 154 0 sed
[ 1466.913992] [ 1273] 1000 1273 2479 0 57344 101 0 sed
[ 1466.913993] [ 1274] 1000 1274 2479 0 61440 94 0 sed
[ 1466.913995] [ 1275] 1000 1275 2479 0 57344 82 0 sed
[ 1466.913996] [ 1276] 1000 1276 2479 0 57344 114 0 sed
[ 1466.913998] [ 1325] 133 1325 38725 0 73728 106 0 rtkit-daemon
[ 1466.913999] [ 1336] 1000 1336 2649 0 69632 99 0 dbus-daemon
[ 1466.914000] [ 1364] 1000 1364 61444 0 106496 288 0 gsettings-helpe
[ 1466.914002] [ 1369] 1000 1369 57721 0 81920 137 0 xfconfd
[ 1466.914003] [ 1765] 1000 1765 39295 0 69632 188 0 dconf-service
[ 1466.914005] [ 3405] 1000 3405 3410 1 69632 1632 0 bash
[ 1466.914007] [ 3472] 1000 3472 3487 0 61440 277 0 top
[ 1466.914008] [ 3824] 1000 3824 3411 1 69632 1656 0 bash
[ 1466.914010] [ 5947] 1000 5947 3410 1 73728 1633 0 bash
[ 1466.914012] [ 11271] 1000 11271 3410 1 73728 1669 0 bash
[ 1466.914014] [ 11355] 1000 11355 1862 1 53248 113 0 v
[ 1466.914015] [ 11363] 1000 11363 16261 0 167936 1709 0 vim
[ 1466.914017] [ 14553] 1000 14553 3501 1 73728 1714 0 bash
[ 1466.914019] [ 14624] 1000 14624 1646 131 65536 82 0 watch
[ 1466.914020] [ 15658] 1000 15658 947 1 49152 26 0 stress
[ 1466.914022] [ 15659] 1000 15659 2442354 35472 733184 49380 0 stress
[ 1466.914023] [ 15660] 1000 15660 2442354 17461 712704 64448 0 stress
[ 1466.914025] [ 15661] 1000 15661 2442354 31447 1048576 92880 0 stress
[ 1466.914026] [ 15662] 1000 15662 2442354 24856 692224 54878 0 stress
[ 1466.914027] [ 15663] 1000 15663 2442354 78517 1007616 40479 0 stress
[ 1466.914029] [ 15664] 1000 15664 2442354 28535 946176 82962 0 stress
[ 1466.914030] [ 15665] 1000 15665 2442354 763 458752 49668 0 stress
[ 1466.914032] [ 15666] 1000 15666 2442354 33217 905216 73150 0 stress
[ 1466.914033] [ 15667] 1000 15667 2442354 27000 1216512 118297 0 stress
[ 1466.914034] [ 15668] 1000 15668 2442354 30129 868352 71648 0 stress
[ 1466.914036] [ 15669] 1000 15669 2442354 58911 1298432 96600 0 stress
[ 1466.914037] [ 15670] 1000 15670 2442354 34067 1028096 87659 0 stress
[ 1466.914038] [ 15671] 1000 15671 2442354 37665 1290240 116863 0 stress
[ 1466.914040] [ 15672] 1000 15672 2442354 27605 1064960 98712 0 stress
[ 1466.914041] [ 15673] 1000 15673 2442354 72245 1294336 82778 0 stress
[ 1466.914042] [ 15674] 1000 15674 2442354 32309 1101824 98646 0 stress
[ 1466.914044] [ 15675] 1000 15675 2442354 16205 659456 59473 0 stress
[ 1466.914045] [ 15676] 1000 15676 2442354 75163 1179648 65513 0 stress
[ 1466.914047] [ 15677] 1000 15677 2442354 1 577536 65327 0 stress
[ 1466.914048] [ 15678] 1000 15678 2442354 87 643072 73506 0 stress
[ 1466.914050] [ 15679] 1000 15679 2442354 21381 598016 46576 0 stress
[ 1466.914051] [ 15680] 1000 15680 2442354 27317 925696 81287 0 stress
[ 1466.914052] [ 15681] 1000 15681 2442354 53527 1007616 65673 0 stress
[ 1466.914054] [ 15682] 1000 15682 2442354 33620 790528 58401 0 stress
[ 1466.914055] [ 15683] 1000 15683 2442354 22478 688128 56765 0 stress
[ 1466.914056] [ 15684] 1000 15684 2442354 45031 774144 44974 0 stress
[ 1466.914058] [ 15685] 1000 15685 2442354 167 466944 51456 0 stress
[ 1466.914059] [ 15686] 1000 15686 2442354 30506 684032 48204 0 stress
[ 1466.914060] [ 15687] 1000 15687 2442354 76 360448 38174 0 stress
[ 1466.914062] [ 15688] 1000 15688 2442354 27924 716800 54795 0 stress
[ 1466.914063] [ 15689] 1000 15689 2442354 24105 823296 72068 0 stress
[ 1466.914064] [ 15690] 1000 15690 2442354 13187 651264 60993 0 stress
[ 1466.914066] [ 15691] 1000 15691 2442354 20202 675840 57520 0 stress
[ 1466.914067] [ 15692] 1000 15692 2442354 37068 1036288 85690 0 stress
[ 1466.914069] [ 15693] 1000 15693 2442354 34960 753664 52047 0 stress
[ 1466.914070] [ 15694] 1000 15694 2442354 33364 1003520 85280 0 stress
[ 1466.914071] [ 15695] 1000 15695 2442354 37500 1122304 95993 0 stress
[ 1466.914073] [ 15696] 1000 15696 2442354 40010 774144 49648 0 stress
[ 1466.914074] [ 15697] 1000 15697 2442354 25200 733184 59669 0 stress
[ 1466.914075] [ 15698] 1000 15698 2442354 33928 860160 66367 0 stress
[ 1466.914077] [ 15699] 1000 15699 2442354 28883 696320 51372 0 stress
[ 1466.914078] [ 15700] 1000 15700 2442354 63688 1032192 58535 0 stress
[ 1466.914079] [ 15701] 1000 15701 2442354 206 462848 50676 0 stress
[ 1466.914081] [ 15702] 1000 15702 2442354 37586 978944 78007 0 stress
[ 1466.914082] [ 15703] 1000 15703 2442354 57038 950272 54697 0 stress
[ 1466.914083] [ 15704] 1000 15704 2442354 23691 688128 55570 0 stress
[ 1466.914085] [ 15705] 1000 15705 2442354 24519 704512 56769 0 stress
[ 1466.914086] [ 15706] 1000 15706 2442354 41070 831488 56065 0 stress
[ 1466.914087] [ 15707] 1000 15707 2442354 16687 950272 95308 0 stress
[ 1466.914089] [ 15708] 1000 15708 2442354 72969 1179648 67689 0 stress
[ 1466.914090] [ 15709] 1000 15709 2442354 46107 962560 67440 0 stress
[ 1466.914091] [ 15710] 1000 15710 2442354 30480 733184 54368 0 stress
[ 1466.914093] [ 15711] 1000 15711 2442354 28799 757760 58943 0 stress
[ 1466.914094] [ 15712] 1000 15712 2442354 24325 806912 69759 0 stress
[ 1466.914095] [ 15713] 1000 15713 2442354 17610 737280 67758 0 stress
[ 1466.914097] [ 15714] 1000 15714 2442354 26403 917504 81508 0 stress
[ 1466.914098] [ 15715] 1000 15715 2442354 1099 577536 64016 0 stress
[ 1466.914099] [ 15716] 1000 15716 2442354 36219 880640 67074 0 stress
[ 1466.914101] [ 15717] 1000 15717 2442354 47198 1003520 71486 0 stress
[ 1466.914102] [ 15718] 1000 15718 2442354 22209 798720 70805 0 stress
[ 1466.914103] [ 15719] 1000 15719 2442354 36188 729088 48179 0 stress
[ 1466.914105] [ 15720] 1000 15720 2442354 48222 1081344 80144 0 stress
[ 1466.914106] [ 15721] 1000 15721 2442354 114843 1372160 49891 0 stress
[ 1466.914108] [ 15722] 1000 15722 2442354 162 557056 62352 0 stress
[ 1466.914109] [ 15723] 1000 15723 2442354 34078 843776 64635 0 stress
[ 1466.914110] [ 15724] 1000 15724 2442354 1 516096 57478 0 stress
[ 1466.914112] [ 15725] 1000 15725 2442354 33713 684032 45031 0 stress
[ 1466.914113] [ 15726] 1000 15726 2442354 70880 1007616 48303 0 stress
[ 1466.914114] [ 15727] 1000 15727 2442354 33070 794624 59294 0 stress
[ 1466.914116] [ 15728] 1000 15728 2442354 49921 884736 53910 0 stress
[ 1466.914117] [ 15729] 1000 15729 2442354 37100 786432 54438 0 stress
[ 1466.914118] [ 15730] 1000 15730 2442354 772 745472 85673 0 stress
[ 1466.914120] [ 15731] 1000 15731 2442354 20798 647168 53336 0 stress
[ 1466.914121] [ 15732] 1000 15732 2442354 66860 1286144 87132 0 stress
[ 1466.914122] [ 15733] 1000 15733 2442354 58022 1003520 60648 0 stress
[ 1466.914124] [ 15734] 1000 15734 2442354 40229 794624 52337 0 stress
[ 1466.914125] [ 15735] 1000 15735 2442354 52416 831488 44743 0 stress
[ 1466.914127] [ 15736] 1000 15736 2442354 22784 1220608 123039 0 stress
[ 1466.914128] [ 15737] 1000 15737 2442354 47752 1228800 99082 0 stress
[ 1466.914130] [ 15738] 1000 15738 2442354 5388 598016 62219 0 stress
[ 1466.914131] [ 15739] 1000 15739 2442354 42512 991232 74612 0 stress
[ 1466.914132] [ 15740] 1000 15740 2442354 30409 843776 68268 0 stress
[ 1466.914134] [ 15741] 1000 15741 2442354 61 385024 41076 0 stress
[ 1466.914135] [ 15742] 1000 15742 2442354 22049 688128 57225 0 stress
[ 1466.914136] [ 15743] 1000 15743 2442354 11593 1163264 127053 0 stress
[ 1466.914138] [ 15744] 1000 15744 2442354 12709 700416 68066 0 stress
[ 1466.914139] [ 15745] 1000 15745 2442354 58506 966656 55522 0 stress
[ 1466.914140] [ 15746] 1000 15746 2442354 37704 978944 77912 0 stress
[ 1466.914142] [ 15747] 1000 15747 2442354 557 430080 46244 0 stress
[ 1466.914143] [ 15748] 1000 15748 2442354 47961 929792 61466 0 stress
[ 1466.914144] [ 15749] 1000 15749 2442354 35600 880640 67733 0 stress
[ 1466.914146] [ 15750] 1000 15750 2442354 36018 897024 69355 0 stress
[ 1466.914147] [ 15751] 1000 15751 2442354 397 552960 61659 0 stress
[ 1466.914149] [ 15752] 1000 15752 2442354 9336 745472 77088 0 stress
[ 1466.914150] [ 15753] 1000 15753 2442354 57814 1249280 91607 0 stress
[ 1466.914151] [ 15754] 1000 15754 2442354 46202 1044480 77582 0 stress
[ 1466.914153] [ 15755] 1000 15755 2442354 63801 1069056 63083 0 stress
[ 1466.914154] [ 15756] 1000 15756 2442354 21609 765952 67300 0 stress
[ 1466.914155] [ 15757] 1000 15757 2442354 59274 892928 45599 0 stress
[ 1466.914157] [ 15758] 1000 15758 2442354 1 479232 52862 0 stress
[ 1466.914158] [ 15759] 1000 15759 2442354 76444 1163264 62175 0 stress
[ 1466.914160] [ 15760] 1000 15760 2442354 31653 933888 78283 0 stress
[ 1466.914161] [ 15761] 1000 15761 2442354 30021 790528 62026 0 stress
[ 1466.914163] [ 15762] 1000 15762 2442354 45007 901120 60875 0 stress
[ 1466.914164] [ 15763] 1000 15763 2442354 21275 659456 54316 0 stress
[ 1466.914165] [ 15764] 1000 15764 2442354 29773 778240 60715 0 stress
[ 1466.914167] [ 15765] 1000 15765 2442354 34685 815104 60423 0 stress
[ 1466.914168] [ 15766] 1000 15766 2442354 19320 741376 66595 0 stress
[ 1466.914169] [ 15767] 1000 15767 2442354 26619 630784 45137 0 stress
[ 1466.914171] [ 15768] 1000 15768 2442354 65238 1044480 58545 0 stress
[ 1466.914172] [ 15769] 1000 15769 2442354 34694 851968 65018 0 stress
[ 1466.914174] [ 15770] 1000 15770 2442354 7212 589824 59319 0 stress
[ 1466.914175] [ 15771] 1000 15771 2442354 35594 729088 48796 0 stress
[ 1466.914177] [ 15772] 1000 15772 2442354 17326 811008 77258 0 stress
[ 1466.914178] [ 15773] 1000 15773 2442354 32841 1118208 100160 0 stress
[ 1466.914180] [ 15774] 1000 15774 2442354 202 847872 98614 0 stress
[ 1466.914181] [ 15775] 1000 15775 2442354 31 651264 74185 0 stress
[ 1466.914182] [ 15776] 1000 15776 2442354 44425 1032192 77815 0 stress
[ 1466.914184] [ 15777] 1000 15777 2442354 23280 675840 54459 0 stress
[ 1466.914185] [ 15778] 1000 15778 2442354 20222 839680 77633 0 stress
[ 1466.914187] [ 15779] 1000 15779 2442354 34766 1187840 106667 0 stress
[ 1466.914188] [ 15780] 1000 15780 2442354 18561 540672 42251 0 stress
[ 1466.914189] [ 15781] 1000 15781 2442354 157 360448 37959 0 stress
[ 1466.914191] [ 15782] 1000 15782 2442354 31124 733184 53724 0 stress
[ 1466.914209] [ 15783] 1000 15783 2442354 25112 638976 48009 0 stress
[ 1466.914210] [ 15784] 1000 15784 2442354 9932 495616 45085 0 stress
[ 1466.914212] [ 15785] 1000 15785 2442354 33793 724992 50071 0 stress
[ 1466.914213] [ 15786] 1000 15786 2442354 20149 860160 80493 0 stress
[ 1466.914214] [ 15787] 1000 15787 2442354 49386 1040384 73876 0 stress
[ 1466.914216] [ 15788] 1000 15788 2442354 26792 794624 65738 0 stress
[ 1466.914217] [ 15789] 1000 15789 2442354 463 647168 73278 0 stress
[ 1466.914219] [ 15790] 1000 15790 2442354 27350 651264 47280 0 stress
[ 1466.914220] [ 15791] 1000 15791 2442354 27893 974848 87221 0 stress
[ 1466.914221] [ 15792] 1000 15792 2442354 51549 917504 56361 0 stress
[ 1466.914223] [ 15793] 1000 15793 2442354 31852 860160 68872 0 stress
[ 1466.914224] [ 15794] 1000 15794 2442354 28996 827392 67626 0 stress
[ 1466.914226] [ 15795] 1000 15795 2442354 49525 806912 44556 0 stress
[ 1466.914227] [ 15796] 1000 15796 2442354 59806 819200 35827 0 stress
[ 1466.914228] [ 15797] 1000 15797 2442354 42778 966656 71305 0 stress
[ 1466.914230] [ 15798] 1000 15798 2442354 29384 745472 57056 0 stress
[ 1466.914231] [ 15799] 1000 15799 2442354 29609 655360 45554 0 stress
[ 1466.914232] [ 15800] 1000 15800 2442354 19677 602112 48838 0 stress
[ 1466.914234] [ 15801] 1000 15801 2442354 91631 1261568 59202 0 stress
[ 1466.914235] [ 15802] 1000 15802 2442354 37784 708608 44013 0 stress
[ 1466.914236] [ 15803] 1000 15803 2442354 38862 843776 59834 0 stress
[ 1466.914238] [ 15804] 1000 15804 2442354 53364 1110016 78641 0 stress
[ 1466.914239] [ 15805] 1000 15805 2442354 93 380928 40778 0 stress
[ 1466.914241] [ 15806] 1000 15806 2442354 38511 1003520 80159 0 stress
[ 1466.914242] [ 15807] 1000 15807 2442354 73352 1150976 63780 0 stress
[ 1466.914243] [ 15808] 1000 15808 2442354 41336 745472 45096 0 stress
[ 1466.914245] [ 15809] 1000 15809 2442354 22708 831488 74460 0 stress
[ 1466.914246] [ 15810] 1000 15810 2442354 30775 716800 52072 0 stress
[ 1466.914247] [ 15811] 1000 15811 2442354 28548 1024000 92686 0 stress
[ 1466.914249] [ 15812] 1000 15812 2442354 45063 1224704 101243 0 stress
[ 1466.914250] [ 15813] 1000 15813 2442354 41298 786432 50210 0 stress
[ 1466.914252] [ 15814] 1000 15814 2442354 16514 557056 45980 0 stress
[ 1466.914253] [ 15815] 1000 15815 2442354 38228 950272 73777 0 stress
[ 1466.914255] [ 15816] 1000 15816 2442354 3546 1073152 123763 0 stress
[ 1466.914256] [ 15817] 1000 15817 2442354 228 774144 89437 0 stress
[ 1466.914258] [ 15818] 1000 15818 2442354 147848 2117632 109587 0 stress
[ 1466.914259] [ 15819] 1000 15819 2442354 30535 1105920 100966 0 stress
[ 1466.914260] [ 15820] 1000 15820 2442354 35952 1097728 94515 0 stress
[ 1466.914262] [ 15821] 1000 15821 2442354 1 716800 82464 0 stress
[ 1466.914263] [ 15822] 1000 15822 2442354 24288 1056768 101008 0 stress
[ 1466.914265] [ 15823] 1000 15823 2442354 82 753664 87027 0 stress
[ 1466.914266] [ 15824] 1000 15824 2442354 46572 1122304 86919 0 stress
[ 1466.914268] [ 15825] 1000 15825 2442354 27250 1073152 100103 0 stress
[ 1466.914269] [ 15826] 1000 15826 2442354 16521 851968 83211 0 stress
[ 1466.914270] [ 15827] 1000 15827 2442354 65108 1241088 83270 0 stress
[ 1466.914272] [ 15828] 1000 15828 2442354 42946 995328 74688 0 stress
[ 1466.914273] [ 15829] 1000 15829 2442354 29091 1073152 97972 0 stress
[ 1466.914275] [ 15830] 1000 15830 2442354 43149 1134592 91934 0 stress
[ 1466.914276] [ 15831] 1000 15831 2442354 20040 962560 93516 0 stress
[ 1466.914277] [ 15832] 1000 15832 2442354 39625 1032192 82643 0 stress
[ 1466.914279] [ 15833] 1000 15833 2442354 28676 802816 64882 0 stress
[ 1466.914280] [ 15834] 1000 15834 2442354 32089 1122304 101453 0 stress
[ 1466.914281] [ 15835] 1000 15835 2442354 53649 1032192 68572 0 stress
[ 1466.914283] [ 15836] 1000 15836 2442354 176 585728 66213 0 stress
[ 1466.914284] [ 15837] 1000 15837 2442354 16 487424 53694 0 stress
[ 1466.914286] [ 15838] 1000 15838 2442354 34092 753664 53328 0 stress
[ 1466.914287] [ 15839] 1000 15839 2442354 24923 733184 59956 0 stress
[ 1466.914288] [ 15840] 1000 15840 2442354 75766 1343488 85385 0 stress
[ 1466.914290] [ 15841] 1000 15841 2442354 24663 819200 70933 0 stress
[ 1466.914291] [ 15842] 1000 15842 2442354 53107 966656 60930 0 stress
[ 1466.914292] [ 15843] 1000 15843 2442354 38419 925696 70548 0 stress
[ 1466.914294] [ 15844] 1000 15844 2442354 34410 823296 61763 0 stress
[ 1466.914295] [ 15845] 1000 15845 2442354 18088 724992 65749 0 stress
[ 1466.914297] [ 15846] 1000 15846 2442354 48202 1228800 98646 0 stress
[ 1466.914298] [ 15847] 1000 15847 2442354 82782 1212416 61974 0 stress
[ 1466.914299] [ 15848] 1000 15848 2442354 19695 872448 82357 0 stress
[ 1466.914301] [ 15849] 1000 15849 2442354 34530 860160 66229 0 stress
[ 1466.914302] [ 15850] 1000 15850 2442354 40215 819200 55441 0 stress
[ 1466.914303] [ 15851] 1000 15851 2442354 33624 716800 49227 0 stress
[ 1466.914305] [ 15852] 1000 15852 2442354 55436 995328 62192 0 stress
[ 1466.914306] [ 15853] 1000 15853 2442354 21205 929792 88066 0 stress
[ 1466.914308] [ 15854] 1000 15854 2442354 52815 1171456 86823 0 stress
[ 1466.914309] [ 15855] 1000 15855 2442354 16708 667648 59546 0 stress
[ 1466.914310] [ 15856] 1000 15856 2442354 33506 925696 75409 0 stress
[ 1466.914312] [ 15857] 1000 15857 2442354 4436 417792 41037 0 stress
[ 1466.914313] [ 15858] 1000 15858 2442354 41905 839680 56283 0 stress
[ 1466.914314] [ 15859] 1000 15859 2442354 16448 802816 77136 0 stress
[ 1466.914316] [ 15860] 1000 15860 2442354 48905 950272 63128 0 stress
[ 1466.914317] [ 15861] 1000 15861 2442354 14641 704512 66276 0 stress
[ 1466.914319] [ 15862] 1000 15862 2442354 244 638976 72828 0 stress
[ 1466.914320] [ 15863] 1000 15863 2442354 37726 978944 77901 0 stress
[ 1466.914321] [ 15864] 1000 15864 2442354 69044 1224704 77302 0 stress
[ 1466.914323] [ 15865] 1000 15865 2442354 50818 892928 54057 0 stress
[ 1466.914324] [ 15866] 1000 15866 2442354 149 815104 94511 0 stress
[ 1466.914326] [ 15867] 1000 15867 2442354 21797 753664 65579 0 stress
[ 1466.914327] [ 15868] 1000 15868 2442354 86029 3780608 379238 0 stress
[ 1466.914329] [ 15869] 1000 15869 2442354 35631 1433600 136771 0 stress
[ 1466.914330] [ 15870] 1000 15870 2442354 73646 1695744 131540 0 stress
[ 1466.914332] [ 15871] 1000 15871 2442354 70948 1466368 105576 0 stress
[ 1466.914333] [ 15872] 1000 15872 2442354 627 2543616 309624 0 stress
[ 1466.914335] [ 15873] 1000 15873 2442354 592 802816 93005 0 stress
[ 1466.914336] [ 15874] 1000 15874 2442354 50241 3207168 343395 0 stress
[ 1466.914337] [ 15875] 1000 15875 2442354 33324 1392640 133978 0 stress
[ 1466.914339] [ 15876] 1000 15876 2442354 75920 1761280 137479 0 stress
[ 1466.914340] [ 15877] 1000 15877 2442354 36961 3280896 365416 0 stress
[ 1466.914341] [ 15878] 1000 15878 2442354 33187 1441792 140260 0 stress
[ 1466.914342] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/user.slice/user-1000.slice/session-1.scope,task=stress,pid=15868,uid=1000
[ 1466.914349] Out of memory: Killed process 15868 (stress) total-vm:9769416kB, anon-rss:344112kB, file-rss:4kB, shmem-rss:0kB
[ 1467.129760] oom_reaper: reaped process 15868 (stress), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
I got one at 19.2sec
$ time stress -m 220 --vm-bytes 10000000000 --timeout 10
stress: info: [21374] dispatching hogs: 0 cpu, 0 io, 220 vm, 0 hdd
stress: FAIL: [21374] (415) <-- worker 21585 got signal 9
stress: WARN: [21374] (417) now reaping child worker processes
stress: FAIL: [21374] (451) failed run completed in 19s
real 0m19.223s
user 0m1.077s
sys 2m53.496s
I did 45 tries without tracers.
Recompiled kernel just like the last time(when I was able to trigger it on the third try) aka with tracers:
I did 15 tries and they were all successfull(at full CPU speed) with durations between 17-22 sec.
I guess all that tracing code in kernel introduced some minor lag which is enough for this to never trigger OOM-killer, just like when I limit cpu max to 800Mhz.
I even tried running two in parallel, no OOM-killer.
Or this:
$ time stress -m 220 --vm-bytes 10000000000 --timeout 30
stress: info: [12381] dispatching hogs: 0 cpu, 0 io, 220 vm, 0 hdd
stress: info: [12381] successful run completed in 56s
real 0m55.957s
user 0m1.908s
sys 9m20.969s
Longer timeout I could see 65000MiB of swap were used at some point! (in 'top')
still nothing triggered OOM-killer :D
ok, a timeout of 60 did it(triggered OOM):
$ time stress -m 220 --vm-bytes 10000000000 --timeout 60
stress: info: [13225] dispatching hogs: 0 cpu, 0 io, 220 vm, 0 hdd
stress: FAIL: [13225] (415) <-- worker 13445 got signal 9
stress: WARN: [13225] (417) now reaping child worker processes
stress: FAIL: [13225] (451) failed run completed in 59s
real 0m58.812s
user 0m2.312s
sys 9m53.327s
But anyway, since last time I was able to trigger it with the normal(timeout 10) command on the third try, I've decided to keep trying that:
after 170 more tries via `$ while true; do time stress -m 220 --vm-bytes 10000000000 --timeout 10; done`
I saw no hangs or any runs taking more time than the usual 16-26 sec.
So the patch must be working as intended. Thanks very much. Let me know if you want me to do anything else.
Cheers!
^ permalink raw reply [flat|nested] 12+ messages in thread
* Re: [Bug 204165] New: 100% CPU usage in compact_zone_order
2019-07-17 22:00 ` howaboutsynergy
@ 2019-07-18 8:37 ` Mel Gorman
0 siblings, 0 replies; 12+ messages in thread
From: Mel Gorman @ 2019-07-18 8:37 UTC (permalink / raw)
To: howaboutsynergy; +Cc: Andrew Morton, bugzilla-daemon, linux-mm
On Wed, Jul 17, 2019 at 10:00:18PM +0000, howaboutsynergy@protonmail.com wrote:
> tl;dr: patch seems to work, thank you very much!
>
\o/
> ????????????????????? Original Message ?????????????????????
> On Wednesday, July 17, 2019 7:53 PM, Mel Gorman <mgorman@techsingularity.net> wrote:
>
> > Ok, great. From the trace, it was obvious that the scanner is making no
> > progress. I don't think zswap is involved as such but it may be making
> > it easier to trigger due to altering timing. At least, I see no reason
> > why zswap would materially affect the termination conditions.
>
> I don't know if it matters in this context, but I've been using the term
> `zswap`(somewhere else I think) to (wrongly)refer to swap in zram (and
> even sometimes called it ext4(in this bug report too) without realizing
> at the time that ext4 is only for /tmp and /var/tmp instead! they are
> ext4 in zram) but in fact this isn't zswap that I have been using (even
> though I have CONFIG_ZSWAP=y in .config) but it's just CONFIG_ZRAM=y with
> CONFIG_SWAP=y (and probably a bunch of others being needed too).
For other bugs, it would matter a lot. In this specific case, all that
was altered was the timing. With enough effort I was able to reproduce
the problem reliably within 30 minutes. With the patch, it ran without
hitting the problem for hours. I had tracing patches applied to log when
the specific problem occurred.
Without the patch, when the problem occurred, it hit 197009 times in a tight
loop driving up CPU usage. With the patch, the same condition was hit 4
times and in each case the task exited immediately as expected so I
think we're good.
> > a proper abort. I think it ends up looping in compaction instead of dying
> > without either aborting or progressing the scanner. It might explain why
> > stress-ng is hitting is as it is probably sending fatal signals on timeout
> > (I didn't check the source).
> Ah I didn't know there are multiple `stress` versions, here's what I used:
>
> /usr/bin/stress is owned by stress 1.0.4-5
>
Fortunately, they were all equivalent. The key was getting a task to
receive a fatal signal while compacting and while scanning a PFN that
was not aligned to SWAP_CLUSTER_MAX. Tricky to hit but fortunately your
test case was exactly what we needed.
> > <SNIP>
>
> Now the "problem" is I can't tell if it would get stuck :D but it usually ends in no more than 17 sec:
> $ time stress -m 220 --vm-bytes 10000000000 --timeout 10
> stress: info: [7981] dispatching hogs: 0 cpu, 0 io, 220 vm, 0 hdd
> stress: FAIL: [7981] (415) <-- worker 8202 got signal 9
> stress: WARN: [7981] (417) now reaping child worker processes
> stress: FAIL: [7981] (415) <-- worker 8199 got signal 9
> stress: WARN: [7981] (417) now reaping child worker processes
> stress: FAIL: [7981] (451) failed run completed in 18s
>
That's fine. Fortunately my own debug tracing added based on your trace
gives me enough confidence.
> <SNIP>
>
> (probably irrelevant)Sometimes Xorg says it can't allocate any more memory but stacktrace looks like it's inside some zram i915 kernel stuff:
>
> [ 1416.842931] [drm] Atomic update on pipe (A) took 188 us, max time under evasion is 100 us
> [ 1425.416979] Xorg: page allocation failure: order:0, mode:0x400d0(__GFP_IO|__GFP_FS|__GFP_COMP|__GFP_RECLAIMABLE), nodemask=(null),cpuset=/,mems_allowed=0
> [ 1425.416984] CPU: 1 PID: 1024 Comm: Xorg Kdump: loaded Tainted: G U 5.2.1-g527a3db363a3 #74
> [ 1425.416985] Hardware name: System manufacturer System Product Name/PRIME Z370-A, BIOS 2201 05/27/2019
> [ 1425.416986] Call Trace:
So this looks like the system is still under a lot of stress trying to
swap. It's unfortunate but unrelated and relatively benign given the
level of stress the system is under.
> <SNIP>
>
> But anyway, since last time I was able to trigger it with the normal(timeout 10) command on the third try, I've decided to keep trying that:
> after 170 more tries via `$ while true; do time stress -m 220 --vm-bytes 10000000000 --timeout 10; done`
> I saw no hangs or any runs taking more time than the usual 16-26 sec.
> So the patch must be working as intended. Thanks very much. Let me know if you want me to do anything else.
>
Perfect. Thanks a million for your patience, testing and tracing (the
tracing pinpointed exactly where I needed to look -- of 3 potential
candidates, only one really made sense). I'll put a proper changelog on
this and send it out where it should get picked up for 5.3 and -stable.
--
Mel Gorman
SUSE Labs
^ permalink raw reply [flat|nested] 12+ messages in thread
end of thread, other threads:[~2019-07-18 8:37 UTC | newest]
Thread overview: 12+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
[not found] <bug-204165-27@https.bugzilla.kernel.org/>
2019-07-15 21:25 ` [Bug 204165] New: 100% CPU usage in compact_zone_order Andrew Morton
2019-07-15 23:28 ` howaboutsynergy
2019-07-16 1:52 ` howaboutsynergy
2019-07-16 3:25 ` howaboutsynergy
2019-07-16 3:57 ` howaboutsynergy
2019-07-16 7:11 ` Mel Gorman
2019-07-16 19:15 ` howaboutsynergy
2019-07-17 17:53 ` Mel Gorman
2019-07-17 22:00 ` howaboutsynergy
2019-07-18 8:37 ` Mel Gorman
2019-07-16 10:03 ` Mel Gorman
2019-07-16 1:08 ` howaboutsynergy
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.