* [RFC] Arm64 boot fail with numa enable in BIOS
@ 2016-09-19 13:05 Yisheng Xie
2016-09-19 14:07 ` Mark Rutland
2016-09-20 2:01 ` Ming Lei
0 siblings, 2 replies; 10+ messages in thread
From: Yisheng Xie @ 2016-09-19 13:05 UTC (permalink / raw)
To: linux-kernel, linux-mm; +Cc: Hanjun Guo, Xishi Qiu
[-- Attachment #1: Type: text/plain, Size: 10330 bytes --]
hi all,
When I enable NUMA in BIOS for arm64, it failed to boot on v4.8-rc4-162-g071e31e.
For the crash log, it seems caused by error number of cpumask.
Any ideas about it?
Thanks.
The related config and detail dmesg can be seen in the attachment.
--- crash messages ---
[ 1.279155] ------------[ cut here ]------------
[ 1.537146] WARNING: CPU: 16 PID: 103 at ./include/linux/cpumask.h:121 try_to_wake_up+0x298/0x300
[ 1.546112] Modules linked in:
[ 1.549190]
[ 1.550687] CPU: 16 PID: 103 Comm: cpuhp/16 Tainted: G W 4.8.0-rc4-00163-g803ea3a #21
[ 1.559741] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
[ 1.565896] task: ffff8013e9678000 task.stack: ffff8013e9674000
[ 1.571874] PC is at try_to_wake_up+0x298/0x300
[ 1.576446] LR is at try_to_wake_up+0x278/0x300
[ 1.581019] pc : [<ffff0000080df66c>] lr : [<ffff0000080df64c>] pstate: 200000c5
[ 1.588490] sp : ffff8013e9677b90
[ 1.591832] x29: ffff8013e9677b90 x28: ffff8413eb81a4b0
[ 1.597196] x27: 000000000000008c x26: ffff000008d6e840
[ 1.602561] x25: 0000000000000004 x24: ffff8013e96e82e0
[ 1.607925] x23: 0000000000000040 x22: 00000000000000c0
[ 1.613289] x21: ffff8013e96e868c x20: 0000000000000000
[ 1.618653] x19: ffff8013e96e8000 x18: 0000000000000000
[ 1.624018] x17: 0000000000000000 x16: 0000000003010066
[ 1.629381] x15: ffff000008ca8000 x14: 0000000000000003
[ 1.634745] x13: 0000000000000026 x12: 0000000000000009
[ 1.640109] x11: 0000000000000009 x10: 0000000000000000
[ 1.645472] x9 : 0000000000000000 x8 : 0000000000000014
[ 1.650837] x7 : ffff8013e9452e00 x6 : 0000000000000000
[ 1.656200] x5 : ffffffffffffffff x4 : 0000000000000000
[ 1.661565] x3 : 0000000000000000 x2 : 0000000000000040
[ 1.666929] x1 : 0000000000000001 x0 : ffff000008d63df9
[ 1.672293]
[ 1.673788] ---[ end trace b58e70f3295a8cd8 ]---
[ 1.678448] Call trace:
[ 1.680911] Exception stack(0xffff8013e96779c0 to 0xffff8013e9677af0)
[ 1.687417] 79c0: ffff8013e96e8000 0001000000000000 ffff8013e9677b90 ffff0000080df66c
[ 1.695329] 79e0: 0000000000000000 ffff00000808e1f4 0000000000000000 ffff8013e9d30c80
[ 1.703242] 7a00: ffff8013e9677a20 ffff00000882b6f4 ffff8013e9677a60 ffff0000080dd384
[ 1.711153] 7a20: 0000000000000000 ffff8013e9677b00 ffff000008cbaa00 ffff000008d6e000
[ 1.719065] 7a40: 0000000000000000 00000000ffffffff 0000000000000001 0000000000000080
[ 1.726977] 7a60: ffff000008d63df9 0000000000000001 0000000000000040 0000000000000000
[ 1.734889] 7a80: 0000000000000000 ffffffffffffffff 0000000000000000 ffff8013e9452e00
[ 1.742801] 7aa0: 0000000000000014 0000000000000000 0000000000000000 0000000000000009
[ 1.750713] 7ac0: 0000000000000009 0000000000000026 0000000000000003 ffff000008ca8000
[ 1.758624] 7ae0: 0000000003010066 0000000000000000
[ 1.763548] [<ffff0000080df66c>] try_to_wake_up+0x298/0x300
[ 1.769175] [<ffff0000080df6e8>] wake_up_process+0x14/0x1c
[ 1.774716] [<ffff0000080d027c>] create_worker+0x108/0x194
[ 1.780255] [<ffff0000080d2cf4>] alloc_unbound_pwq+0x1e4/0x398
[ 1.786146] [<ffff0000080d2f84>] wq_update_unbound_numa+0xdc/0x190
[ 1.792389] [<ffff0000080d4094>] workqueue_online_cpu+0x254/0x2a8
[ 1.798545] [<ffff0000080bb8a4>] cpuhp_up_callbacks+0x54/0x100
[ 1.804436] [<ffff0000080bbb40>] cpuhp_thread_fun+0x12c/0x13c
[ 1.810240] [<ffff0000080daf00>] smpboot_thread_fn+0x1a8/0x1cc
[ 1.816130] [<ffff0000080d7844>] kthread+0xd4/0xe8
[ 1.820967] [<ffff000008082e90>] ret_from_fork+0x10/0x40
[ 1.826334] Unable to handle kernel paging request at virtual address fffe841404c71524
[ 1.834333] pgd = ffff000008dae000
[ 1.837762] [fffe841404c71524] *pgd=00000413fbfee003, *pud=0000000000000000
[ 1.844797] Internal error: Oops: 96000004 [#1] SMP
[ 1.849720] Modules linked in:
[ 1.852799] CPU: 16 PID: 103 Comm: cpuhp/16 Tainted: G W 4.8.0-rc4-00163-g803ea3a #21
[ 1.861853] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
[ 1.868007] task: ffff8013e9678000 task.stack: ffff8013e9674000
[ 1.873985] PC is at try_to_wake_up+0x148/0x300
[ 1.878557] LR is at try_to_wake_up+0x11c/0x300
[ 1.883129] pc : [<ffff0000080df51c>] lr : [<ffff0000080df4f0>] pstate: 600000c5
[ 1.890602] sp : ffff8013e9677b90
[ 1.893943] x29: ffff8013e9677b90 x28: ffff8413eb81a4b0
[ 1.899307] x27: 000000000000008c x26: ffff000008d6e840
[ 1.904670] x25: ffff000008ca5f10 x24: ffff000008c77600
[ 1.910033] x23: 0000000000000040 x22: 00000000000000c0
[ 1.915398] x21: ffff8013e96e868c x20: 0000000000000004
[ 1.920761] x19: ffff8013e96e8000 x18: 0000000000000000
[ 1.926125] x17: 0000000000000000 x16: 0000000003010066
[ 1.931489] x15: ffff000008ca8000 x14: 0000000000000003
[ 1.936853] x13: 0000000000000026 x12: 0000000000000009
[ 1.942217] x11: 0000000000000009 x10: 0000000000000000
[ 1.947581] x9 : 0000000000000000 x8 : 0000000000000014
[ 1.952945] x7 : ffff8013e9452e00 x6 : 0000000000000000
[ 1.958309] x5 : ffff8413eb6ca700 x4 : 0000000000000000
[ 1.963674] x3 : 00008413e2ba3000 x2 : 0000000000000010
[ 1.969037] x1 : ffff8413fbfffa80 x0 : ffff000008c71aa4
[ 1.974401]
[ 1.975897] Process cpuhp/16 (pid: 103, stack limit = 0xffff8013e9674020)
[ 1.982754] Stack: (0xffff8013e9677b90 to 0xffff8013e9678000)
[ 1.988556] 7b80: ffff8013e9677bf0 ffff0000080df6e8
[ 1.996468] 7ba0: ffff8013e96e0000 ffff8013e96d0000 0000000000000000 ffff8013e9677c40
[ 2.004381] 7bc0: ffff8013e96d0318 ffff8013e96d0000 0000000000000004 ffff0000080d0254
[ 2.012293] 7be0: ffff8013e9677c00 ffff0000080d0274 ffff8013e9677c00 ffff0000080d027c
[ 2.020204] 7c00: ffff8013e9677c50 ffff0000080d2cf4 ffff000008d6e000 ffff8013e9cdf100
[ 2.028116] 7c20: 0000000000000021 ffff8413e98b9000 0000000000000000 ffff0000080d2ce8
[ 2.036028] 7c40: ff00303a39323175 ffff0000080d2e3c ffff8013e9677ca0 ffff0000080d2f84
[ 2.043940] 7c60: ffff8413e98b9000 0000000000000001 ffff8013e9cdf100 ffff8013e9da4000
[ 2.051852] 7c80: ffff8013e9677d6c ffff000008d6eaa8 0000000000000000 ffff000008d63dc9
[ 2.059764] 7ca0: ffff8013e9677ce0 ffff0000080d4094 ffff8413e98b9000 ffff000008cb9978
[ 2.067675] 7cc0: 0000000000000010 ffff000008d6e840 ffff8013e9677d6c ffff0000080d3ec0
[ 2.075587] 7ce0: ffff8013e9677d70 ffff0000080bb8a4 ffff8413eb814a08 ffff000008cb5688
[ 2.083499] 7d00: 0000000000000010 0000000000000045 0000000000000000 0000000000000079
[ 2.091411] 7d20: 0000000000000001 0000000000000000 0000000000000000 0000000000000000
[ 2.099323] 7d40: ffff8413eb814a08 01ff000008cb5688 0000000000000000 0000000000010000
[ 2.107234] 7d60: 0000000000000000 0000008100000079 ffff8013e9677db0 ffff0000080bbb40
[ 2.115147] 7d80: ffff8413eb814a08 0000000000000010 0000000000000001 ffff000008cb6ef8
[ 2.123058] 7da0: 0000000000000001 0000000000000002 ffff8013e9677dd0 ffff0000080daf00
[ 2.130970] 7dc0: ffff8013e9674000 ffff8013e9450000 ffff8013e9677e20 ffff0000080d7844
[ 2.138883] 7de0: ffff8013e9450080 ffff000008d6eb20 ffff000008a8dba0 ffff8013e9450000
[ 2.146795] 7e00: ffff0000080dad58 0000000000000000 0000000000000000 ffff8013e9450000
[ 2.154706] 7e20: 0000000000000000 ffff000008082e90 ffff0000080d7770 ffff8013e9450080
[ 2.162618] 7e40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.170530] 7e60: ffff8013e9677ea0 0000000000000001 ffff000000000010 ffff8013e9450000
[ 2.178442] 7e80: 0000000000000000 0000000000030003 ffff8013e9677e90 ffff8013e9677e90
[ 2.186354] 7ea0: 0000000000000000 ffff000000000000 ffff8013e9677eb0 ffff8013e9677eb0
[ 2.194265] 7ec0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.202177] 7ee0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.210089] 7f00: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.218001] 7f20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.225913] 7f40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.233824] 7f60: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.241736] 7f80: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.249648] 7fa0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.257560] 7fc0: 0000000000000000 0000000000000005 0000000000000000 0000000000000000
[ 2.265472] 7fe0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.273383] Call trace:
[ 2.275846] Exception stack(0xffff8013e96779c0 to 0xffff8013e9677af0)
[ 2.282352] 79c0: ffff8013e96e8000 0001000000000000 ffff8013e9677b90 ffff0000080df51c
[ 2.290264] 79e0: 0000000000000000 ffff00000808e1f4 0000000000000000 ffff8013e9d30c80
[ 2.298177] 7a00: ffff8013e9677a20 ffff00000882b6f4 ffff8013e9677a60 ffff0000080dd384
[ 2.306089] 7a20: 0000000000000000 ffff8013e9677b00 ffff000008cbaa00 ffff000008d6e000
[ 2.314001] 7a40: 0000000000000000 00000000ffffffff 0000000000000001 0000000000000080
[ 2.321912] 7a60: ffff000008c71aa4 ffff8413fbfffa80 0000000000000010 00008413e2ba3000
[ 2.329824] 7a80: 0000000000000000 ffff8413eb6ca700 0000000000000000 ffff8013e9452e00
[ 2.337736] 7aa0: 0000000000000014 0000000000000000 0000000000000000 0000000000000009
[ 2.345648] 7ac0: 0000000000000009 0000000000000026 0000000000000003 ffff000008ca8000
[ 2.353559] 7ae0: 0000000003010066 0000000000000000
[ 2.358483] [<ffff0000080df51c>] try_to_wake_up+0x148/0x300
[ 2.364110] [<ffff0000080df6e8>] wake_up_process+0x14/0x1c
[ 2.369649] [<ffff0000080d027c>] create_worker+0x108/0x194
[ 2.375189] [<ffff0000080d2cf4>] alloc_unbound_pwq+0x1e4/0x398
[ 2.381080] [<ffff0000080d2f84>] wq_update_unbound_numa+0xdc/0x190
[ 2.387322] [<ffff0000080d4094>] workqueue_online_cpu+0x254/0x2a8
[ 2.393477] [<ffff0000080bb8a4>] cpuhp_up_callbacks+0x54/0x100
[ 2.399368] [<ffff0000080bbb40>] cpuhp_thread_fun+0x12c/0x13c
[ 2.405171] [<ffff0000080daf00>] smpboot_thread_fn+0x1a8/0x1cc
[ 2.411061] [<ffff0000080d7844>] kthread+0xd4/0xe8
[ 2.415897] [<ffff000008082e90>] ret_from_fork+0x10/0x40
[ 2.421261] Code: f877db21 90005cd8 f8627b23 91180318 (b8616802)
[ 2.427426] ---[ end trace b58e70f3295a8cd9 ]---
[-- Attachment #2: config.tar.bz2 --]
[-- Type: application/x-bzip, Size: 26585 bytes --]
[-- Attachment #3: dmesg.txt --]
[-- Type: text/plain, Size: 39930 bytes --]
Loading driver at 0x000306BF000 EntryPoint=0x000311F35A0
Loading driver at 0x000306BF000 EntryPoint=0x000311F35A0
EFI stub: Booting Linux Kernel...
SmiGraphicsOutputQueryMode +
SmiGraphicsOutputQueryMode -
EFI stub: Using DTB from configuration table
EFI stub: Exiting boot services and installing virtual address map...
SAS ExitBootServicesEvent
GMAC ExitBootServicesEvent
GMAC ExitBootServicesEvent
GMAC ExitBootServicesEvent
GMAC ExitBootServicesEvent
OHCI ExitBootServicesEvent
GetVariable Status : Not Found.
[ 0.000000] Booting Linux on physical CPU 0x10000
[ 0.000000] Linux version 4.8.0-rc4-00163-g803ea3a (xys@linux-ibm) (gcc version 4.9.3 20150113 (prerelease) (Linaro GCC 4.9-2015.01-3) ) #21 SMP Mon Sep 19 20:21:45 CST 2016
[ 0.000000] Boot CPU: AArch64 Processor [410fd082]
[ 0.000000] earlycon: pl11 at MMIO32 0x00000000602b0000 (options '')
[ 0.000000] bootconsole [pl11] enabled
[ 0.000000] efi: Getting EFI parameters from FDT:
[ 0.000000] efi: EFI v2.60 by EDK II
[ 0.000000] efi: SMBIOS=0x3edb0000 SMBIOS 3.0=0x39860000 ACPI=0x39930000 ACPI 2.0=0x39930014 MEMATTR=0x3d06c018
[ 0.000000] cma: Reserved 16 MiB at 0x000000003dc00000
[ 0.000000] ACPI: Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 0x0000000039930014 000024 (v02 HISI )
[ 0.000000] ACPI: XSDT 0x00000000399200E8 00005C (v01 HISI HIP07 00000000 01000013)
[ 0.000000] ACPI: FACP 0x0000000039800000 00010C (v05 HISI HIP07 00000000 INTL 20151124)
[ 0.000000] ACPI: DSDT 0x00000000397C0000 003996 (v01 HISI HIP07 00000000 INTL 20151124)
[ 0.000000] ACPI: MCFG 0x0000000039840000 0000AC (v01 HISI HIP07 00000000 INTL 20151124)
[ 0.000000] ACPI: SLIT 0x0000000039830000 00003C (v01 HISI HIP07 00000000 INTL 20151124)
[ 0.000000] ACPI: SRAT 0x0000000039820000 000550 (v03 HISI HIP07 00000000 INTL 20151124)
[ 0.000000] ACPI: GTDT 0x00000000397F0000 000060 (v02 HISI HIP07 00000000 INTL 20151124)
[ 0.000000] ACPI: APIC 0x00000000397E0000 0013E4 (v01 HISI HIP07 00000000 INTL 20151124)
[ 0.000000] ACPI: IORT 0x00000000397D0000 000414 (v00 HISI HIP07 00000000 INTL 20151124)
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10000 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10001 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10002 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10003 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10100 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10101 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10102 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10103 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10200 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10201 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10202 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10203 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10300 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10301 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10302 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 0 -> MPIDR 0x10303 -> Node 0
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30000 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30001 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30002 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30003 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30100 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30101 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30102 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30103 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30200 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30201 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30202 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30203 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30300 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30301 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30302 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 1 -> MPIDR 0x30303 -> Node 1
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50000 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50001 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50002 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50003 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50100 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50101 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50102 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50103 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50200 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50201 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50202 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50203 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50300 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50301 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50302 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 2 -> MPIDR 0x50303 -> Node 2
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70000 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70001 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70002 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70003 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70100 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70101 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70102 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70103 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70200 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70201 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70202 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70203 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70300 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70301 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70302 -> Node 3
[ 0.000000] ACPI: NUMA: SRAT: PXM 3 -> MPIDR 0x70303 -> Node 3
[ 0.000000] NUMA: Adding memblock [0x0 - 0x3fffffff] on node 1
[ 0.000000] ACPI: SRAT: Node 1 PXM 1 [mem 0x00000000-0x3fffffff]
[ 0.000000] NUMA: Adding memblock [0x1000000000 - 0x13ffffffff] on node 1
[ 0.000000] ACPI: SRAT: Node 1 PXM 1 [mem 0x1000000000-0x13ffffffff]
[ 0.000000] NUMA: Adding memblock [0x40000000000 - 0x4003fffffff] on node 3
[ 0.000000] ACPI: SRAT: Node 3 PXM 3 [mem 0x40000000000-0x4003fffffff]
[ 0.000000] NUMA: Adding memblock [0x41000000000 - 0x413ffffffff] on node 3
[ 0.000000] ACPI: SRAT: Node 3 PXM 3 [mem 0x41000000000-0x413ffffffff]
[ 0.000000] NUMA: Initmem setup node 0 [mem 0x00000000-0xffffffffffffffff]
[ 0.000000] NUMA: NODE_DATA [mem 0x413fbfeb500-0x413fbfecfff]
[ 0.000000] NUMA: NODE_DATA(0) on node 3
[ 0.000000] NUMA: Initmem setup node 1 [mem 0x00000000-0x13fbffffff]
[ 0.000000] NUMA: NODE_DATA [mem 0x13fbffe500-0x13fbffffff]
[ 0.000000] NUMA: Initmem setup node 2 [mem 0x00000000-0xffffffffffffffff]
[ 0.000000] NUMA: NODE_DATA [mem 0x413fbfe9a00-0x413fbfeb4ff]
[ 0.000000] NUMA: NODE_DATA(2) on node 3
[ 0.000000] NUMA: Initmem setup node 3 [mem 0x41000000000-0x413fbffffff]
[ 0.000000] NUMA: NODE_DATA [mem 0x413fbfe7f00-0x413fbfe99ff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000000000-0x00000000ffffffff]
[ 0.000000] Normal [mem 0x0000000100000000-0x00000413fbffffff]
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 1: [mem 0x0000000000000000-0x0000000000024fff]
[ 0.000000] node 1: [mem 0x0000000000026000-0x00000000313effff]
[ 0.000000] node 1: [mem 0x00000000313f0000-0x000000003145ffff]
[ 0.000000] node 1: [mem 0x0000000031460000-0x000000003156ffff]
[ 0.000000] node 1: [mem 0x0000000031570000-0x000000003157ffff]
[ 0.000000] node 1: [mem 0x0000000031580000-0x000000003970ffff]
[ 0.000000] node 1: [mem 0x0000000039710000-0x0000000039dbffff]
[ 0.000000] node 1: [mem 0x0000000039dc0000-0x000000003edaffff]
[ 0.000000] node 1: [mem 0x000000003edb0000-0x000000003eddffff]
[ 0.000000] node 1: [mem 0x000000003ede0000-0x000000003fbfffff]
[ 0.000000] node 1: [mem 0x0000001040000000-0x00000013fbffffff]
[ 0.000000] node 3: [mem 0x0000041000000000-0x00000413fbffffff]
[ 0.000000] Could not find start_pfn for node 0
[ 0.000000] Initmem setup node 0 [mem 0x0000000000000000-0x0000000000000000]
[ 0.000000] Initmem setup node 1 [mem 0x0000000000000000-0x00000013fbffffff]
[ 0.000000] Could not find start_pfn for node 2
[ 0.000000] Initmem setup node 2 [mem 0x0000000000000000-0x0000000000000000]
[ 0.000000] Initmem setup node 3 [mem 0x0000041000000000-0x00000413fbffffff]
[ 0.000000] psci: probing for conduit method from ACPI.
NOTICE: [psci_smc_handler]:[347L] PSCI_VERSION CALL
NOTICE: [psci_version]:[99L] PSCI_MAJOR_VER: 10000: PSCI_MINOR_VER: 0
0808>734
[ 0.000000] psci: PSCIv1.0 detected in firmware.
[ 0.000000] psci: Using standard PSCI v0.2 function IDs
0808>734
[ 0.000000] psci: MIGRATE_INFO_TYPE not supported.
0808>734
0808>734
[ 0.000000] percpu: Embedded 21 pages/cpu @ffff8413eb6c0000 s47104 r8192 d30720 u86016
[ 0.000000] Detected PIPT I-cache on CPU0
[ 0.000000] Built 4 zonelists in Node order, mobility grouping on. Total pages: 8224271
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: earlycon=pl011,mmio32,0x602b0000 console=ttyAMA0,115200 acpi=force initrd=filesystem_d03.cpio.gz pcie_aspm=off
[ 0.000000] PCIe ASPM is disabled
[ 0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[ 0.000000] log_buf_len total cpu_extra contributions: 258048 bytes
[ 0.000000] log_buf_len min size: 16384 bytes
[ 0.000000] log_buf_len: 524288 bytes
[ 0.000000] early log buf free: 5308(32%)
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] software IO TLB [mem 0x35710000-0x39710000] (64MB) mapped at [ffff800035710000-ffff80003970ffff]
[ 0.000000] Memory: 32756896K/33419260K available (7932K kernel code, 791K rwdata, 3464K rodata, 960K init, 276K bss, 645980K reserved, 16384K cma-reserved)
[ 0.000000] Virtual kernel memory layout:
[ 0.000000] modules : 0xffff000000000000 - 0xffff000008000000 ( 128 MB)
[ 0.000000] vmalloc : 0xffff000008000000 - 0xffff7dffbfff0000 (129022 GB)
[ 0.000000] .text : 0xffff000008080000 - 0xffff000008840000 ( 7936 KB)
[ 0.000000] .rodata : 0xffff000008840000 - 0xffff000008bb0000 ( 3520 KB)
[ 0.000000] .init : 0xffff000008bb0000 - 0xffff000008ca0000 ( 960 KB)
[ 0.000000] .data : 0xffff000008ca0000 - 0xffff000008d65c00 ( 791 KB)
[ 0.000000] .bss : 0xffff000008d65c00 - 0xffff000008daac38 ( 277 KB)
[ 0.000000] fixed : 0xffff7dfffe7fd000 - 0xffff7dfffec00000 ( 4108 KB)
[ 0.000000] PCI I/O : 0xffff7dfffee00000 - 0xffff7dffffe00000 ( 16 MB)
[ 0.000000] vmemmap : 0xffff7e0000000000 - 0xffff800000000000 ( 2048 GB maximum)
[ 0.000000] 0xffff7e0000000000 - 0xffff7e104ff00000 ( 66815 MB actual)
[ 0.000000] memory : 0xffff800000000000 - 0xffff8413fc000000 (4276160 MB)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=64, Nodes=4
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] Build-time adjustment of leaf fanout to 64.
[ 0.000000] NR_IRQS:64 nr_irqs:64 0
[ 0.000000] GICv3: GIC: Using split EOI/Deactivate mode
[ 0.000000] GICv3: CPU0: found redistributor 10000 region 0:0x000000004d100000
[ 0.000000] arm_arch_timer: Architected cp15 timer(s) running at 50.00MHz (phys).
[ 0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff max_cycles: 0xb8812736b, max_idle_ns: 440795202655 ns
[ 0.000001] sched_clock: 56 bits at 50MHz, resolution 20ns, wraps every 4398046511100ns
[ 0.008194] Console: colour dummy device 80x25
[ 0.012720] Calibrating delay loop (skipped), value calculated using timer frequency.. 100.00 BogoMIPS (lpj=200000)
[ 0.023273] pid_max: default: 65536 minimum: 512
[ 0.027949] ACPI: Core revision 20160422
[ 0.033026] ACPI: 1 ACPI AML tables successfully acquired and loaded
[ 0.039448]
[ 0.040998] Security Framework initialized
[ 0.049141] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[ 0.068198] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[ 0.080449] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.087457] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes)
[ 0.095597] ASID allocator initialised with 65536 entries
[ 0.101561] Remapping and enabling EFI services.
[ 0.106267] EFI remap 0x00000000313f0000 => 0000000020000000
[ 0.112167] EFI remap 0x0000000031570000 => 0000000020070000
[ 0.118080] EFI remap 0x0000000039710000 => 0000000020080000
[ 0.123992] EFI remap 0x0000000039760000 => 00000000200d0000
[ 0.129893] EFI remap 0x00000000397b0000 => 0000000020120000
[ 0.135814] EFI remap 0x0000000039850000 => 0000000020130000
[ 0.141727] EFI remap 0x00000000398d0000 => 00000000201b0000
[ 0.147642] EFI remap 0x0000000039940000 => 0000000020200000
[ 0.153555] EFI remap 0x0000000039990000 => 0000000020250000
[ 0.159470] EFI remap 0x00000000399e0000 => 00000000202a0000
[ 0.165384] EFI remap 0x0000000039a30000 => 00000000202f0000
[ 0.171298] EFI remap 0x0000000039a80000 => 0000000020340000
[ 0.177212] EFI remap 0x0000000039ad0000 => 0000000020390000
[ 0.183130] EFI remap 0x0000000039b20000 => 00000000203e0000
[ 0.189041] EFI remap 0x0000000039b70000 => 0000000020430000
[ 0.194960] EFI remap 0x0000000039bc0000 => 0000000020480000
[ 0.200873] EFI remap 0x0000000039c30000 => 00000000204f0000
[ 0.206785] EFI remap 0x0000000039c80000 => 0000000020540000
[ 0.212698] EFI remap 0x0000000039cd0000 => 0000000020590000
[ 0.218615] EFI remap 0x0000000039d20000 => 00000000205e0000
[ 0.224527] EFI remap 0x0000000039d70000 => 0000000020630000
[ 0.230433] EFI remap 0x000000003edb0000 => 0000000020680000
[ 0.236330] EFI remap 0x00000000a4000000 => 0000000020800000
[ 0.242234] EFI remap 0x00000000a6000000 => 0000000021800000
[ 0.248134] EFI remap 0x00000000d00e0000 => 0000000021810000
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10001 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0x10000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0x10000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5e880
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc7f190
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
[ 0.297337] Detected PIPT I-cache on CPU1
[ 0.297347] GICv3: CPU1: found redistributor 10001 region 1:0x000000004d140000
[ 0.297356] CPU1: Booted secondary processor [410fd082]
[ 0.297375] ------------[ cut here ]------------
[ 0.320390] WARNING: CPU: 1 PID: 0 at ./include/linux/cpumask.h:121 gic_raise_softirq+0x128/0x17c
[ 0.329356] Modules linked in:
[ 0.332434]
[ 0.333932] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.8.0-rc4-00163-g803ea3a #21
[ 0.341581] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
[ 0.347735] task: ffff8013e9dd0000 task.stack: ffff8013e9dcc000
[ 0.353714] PC is at gic_raise_softirq+0x128/0x17c
[ 0.358550] LR is at gic_raise_softirq+0xa0/0x17c
[ 0.363298] pc : [<ffff00000838c124>] lr : [<ffff00000838c09c>] pstate: 200001c5
[ 0.370770] sp : ffff8013e9dcfde0
[ 0.374112] x29: ffff8013e9dcfde0 x28: 0000000000000000
[ 0.379476] x27: 000000000083207c x26: ffff000008ca5d70
[ 0.384841] x25: 0000000100000001 x24: ffff000008d63ff3
[ 0.390205] x23: 0000000000000000 x22: ffff000008cb0000
[ 0.395569] x21: ffff00000884edb0 x20: 0000000000000001
[ 0.400933] x19: 0000000100000000 x18: 0000000000000000
[ 0.406298] x17: 0000000000000000 x16: 0000000003010066
[ 0.411661] x15: ffff000008ca8000 x14: 0000000000000013
[ 0.417025] x13: 0000000000000000 x12: 0000000000000013
[ 0.422389] x11: 0000000000000013 x10: 0000000002e92aa7
[ 0.427754] x9 : 0000000000000000 x8 : ffff8413eb6ca668
[ 0.433118] x7 : ffff8413eb6ca690 x6 : 0000000000000000
[ 0.438482] x5 : fffffffffffffffe x4 : 0000000000000000
[ 0.443845] x3 : 0000000000000040 x2 : 0000000000000041
[ 0.449209] x1 : 0000000000000000 x0 : 0000000000000001
[ 0.454573]
[ 0.456069] ---[ end trace b58e70f3295a8cd7 ]---
[ 0.460730] Call trace:
[ 0.463193] Exception stack(0xffff8013e9dcfc10 to 0xffff8013e9dcfd40)
[ 0.469699] fc00: 0000000100000000 0001000000000000
[ 0.477611] fc20: ffff8013e9dcfde0 ffff00000838c124 ffff000008d72228 ffff8013e9dcff70
[ 0.485524] fc40: ffff000008d72608 ffff000008ab02a4 0000000000000000 0000000000000000
[ 0.493436] fc60: 0000000000000000 3464313430303030 0000000000000000 0000000000000000
[ 0.501348] fc80: ffff8013e9dcfc90 ffff00000836e678 ffff8013e9dcfca0 ffff00000836e910
[ 0.509259] fca0: ffff8013e9dcfd30 ffff00000836ec10 0000000000000001 0000000000000000
[ 0.517171] fcc0: 0000000000000041 0000000000000040 0000000000000000 fffffffffffffffe
[ 0.525083] fce0: 0000000000000000 ffff8413eb6ca690 ffff8413eb6ca668 0000000000000000
[ 0.532995] fd00: 0000000002e92aa7 0000000000000013 0000000000000013 0000000000000000
[ 0.540907] fd20: 0000000000000013 ffff000008ca8000 0000000003010066 0000000000000000
[ 0.548819] [<ffff00000838c124>] gic_raise_softirq+0x128/0x17c
[ 0.554713] [<ffff00000808e1f4>] smp_send_reschedule+0x34/0x3c
[ 0.560605] [<ffff0000080ddf18>] resched_curr+0x40/0x5c
[ 0.565881] [<ffff0000080de650>] check_preempt_curr+0x58/0xa0
[ 0.571685] [<ffff0000080de6b0>] ttwu_do_wakeup+0x18/0x80
[ 0.577136] [<ffff0000080de790>] ttwu_do_activate+0x78/0x88
[ 0.582763] [<ffff0000080df5cc>] try_to_wake_up+0x1f8/0x300
[ 0.588390] [<ffff0000080df79c>] default_wake_function+0x10/0x18
[ 0.594458] [<ffff0000080f3210>] __wake_up_common+0x5c/0x9c
[ 0.600085] [<ffff0000080f3264>] __wake_up_locked+0x14/0x1c
[ 0.605712] [<ffff0000080f3e10>] complete+0x40/0x5c
[ 0.610635] [<ffff00000808dba8>] secondary_start_kernel+0x148/0x1a8
[ 0.616965] [<00000000000831a8>] 0x831a8
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10002 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0x10000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0x10000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5e900
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc7f3a0
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10003 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0x10000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0x10000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5e980
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc7f5b0
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10100 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0x10000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0x30000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5ea00
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc7f7c0
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10101 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0x30000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0x30000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5ea80
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc7f9d0
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10102 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0x30000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0x30000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5eb00
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc7fbe0
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10103 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0x30000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0x30000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5eb80
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc7fdf0
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10200 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0x30000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0x70000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5ec00
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc80000
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10201 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0x70000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0x70000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5ec80
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc80210
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10202 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0x70000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0x70000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5ed00
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc80420
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10203 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0x70000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0x70000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5ed80
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc80630
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10300 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0x70000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0xf0000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5ee00
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc80840
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10301 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0xf0000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0xf0000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5ee80
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc80a50
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10302 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0xf0000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0xf0000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5ef00
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc80c60
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x10303 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0xf0000
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0xf0000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5ef80
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc80e70
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
NOTICE: [psci_smc_handler]:[408L] PSCI_CPU_ON_AARCH64 CALL
NOTICE: [psci_smc_handler]:[409L] x1=0x30000 x2=0x83190 x3=0x0
NOTICE: [scpi_set_css_power_state]:[120L] domain_cluster=0x0
\rNOTICE: [scpi_set_css_power_state]:[143L] domain_cluster=0x10000
0808>734
NOTICE: [psci_afflvl_power_on_finish]:[504L]
NOTICE: [cm_prepare_el3_exit]:[262L] read_tpidr_el3 = 3fc5f800
NOTICE: [cm_prepare_el3_exit]:[319L] ctx add = 3fc83180
NOTICE: [psci_afflvl_power_on_finish]:[562L]
00083190
[ 0.663306] Detected PIPT I-cache on CPU2
[ 0.663312] GICv3: CPU2: found redistributor 10002 region 2:0x000000004d180000
[ 0.663318] CPU2: Booted secondary processor [410fd082]
[ 0.707314] Detected PIPT I-cache on CPU3
[ 0.707319] GICv3: CPU3: found redistributor 10003 region 3:0x000000004d1c0000
[ 0.707325] CPU3: Booted secondary processor [410fd082]
[ 0.751324] Detected PIPT I-cache on CPU4
[ 0.751333] GICv3: CPU4: found redistributor 10100 region 4:0x000000004d200000
[ 0.751343] CPU4: Booted secondary processor [410fd082]
[ 0.795329] Detected PIPT I-cache on CPU5
[ 0.795335] GICv3: CPU5: found redistributor 10101 region 5:0x000000004d240000
[ 0.795341] CPU5: Booted secondary processor [410fd082]
[ 0.839337] Detected PIPT I-cache on CPU6
[ 0.839343] GICv3: CPU6: found redistributor 10102 region 6:0x000000004d280000
[ 0.839349] CPU6: Booted secondary processor [410fd082]
[ 0.883344] Detected PIPT I-cache on CPU7
[ 0.883350] GICv3: CPU7: found redistributor 10103 region 7:0x000000004d2c0000
[ 0.883356] CPU7: Booted secondary processor [410fd082]
[ 0.927353] Detected PIPT I-cache on CPU8
[ 0.927363] GICv3: CPU8: found redistributor 10200 region 8:0x000000004d300000
[ 0.927372] CPU8: Booted secondary processor [410fd082]
[ 0.971360] Detected PIPT I-cache on CPU9
[ 0.971366] GICv3: CPU9: found redistributor 10201 region 9:0x000000004d340000
[ 0.971372] CPU9: Booted secondary processor [410fd082]
[ 1.015367] Detected PIPT I-cache on CPU10
[ 1.015374] GICv3: CPU10: found redistributor 10202 region 10:0x000000004d380000
[ 1.015380] CPU10: Booted secondary processor [410fd082]
[ 1.059375] Detected PIPT I-cache on CPU11
[ 1.059381] GICv3: CPU11: found redistributor 10203 region 11:0x000000004d3c0000
[ 1.059387] CPU11: Booted secondary processor [410fd082]
[ 1.103384] Detected PIPT I-cache on CPU12
[ 1.103394] GICv3: CPU12: found redistributor 10300 region 12:0x000000004d400000
[ 1.103403] CPU12: Booted secondary processor [410fd082]
[ 1.147390] Detected PIPT I-cache on CPU13
[ 1.147397] GICv3: CPU13: found redistributor 10301 region 13:0x000000004d440000
[ 1.147404] CPU13: Booted secondary processor [410fd082]
[ 1.191398] Detected PIPT I-cache on CPU14
[ 1.191405] GICv3: CPU14: found redistributor 10302 region 14:0x000000004d480000
[ 1.191411] CPU14: Booted secondary processor [410fd082]
[ 1.235406] Detected PIPT I-cache on CPU15
[ 1.235413] GICv3: CPU15: found redistributor 10303 region 15:0x000000004d4c0000
[ 1.235419] CPU15: Booted secondary processor [410fd082]
[ 1.279065] Detected PIPT I-cache on CPU16
[ 1.279075] GICv3: CPU16: found redistributor 30000 region 16:0x000000006d100000
[ 1.279082] CPU16: Booted secondary processor [410fd082]
[ 1.279155] ------------[ cut here ]------------
[ 1.537146] WARNING: CPU: 16 PID: 103 at ./include/linux/cpumask.h:121 try_to_wake_up+0x298/0x300
[ 1.546112] Modules linked in:
[ 1.549190]
[ 1.550687] CPU: 16 PID: 103 Comm: cpuhp/16 Tainted: G W 4.8.0-rc4-00163-g803ea3a #21
[ 1.559741] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
[ 1.565896] task: ffff8013e9678000 task.stack: ffff8013e9674000
[ 1.571874] PC is at try_to_wake_up+0x298/0x300
[ 1.576446] LR is at try_to_wake_up+0x278/0x300
[ 1.581019] pc : [<ffff0000080df66c>] lr : [<ffff0000080df64c>] pstate: 200000c5
[ 1.588490] sp : ffff8013e9677b90
[ 1.591832] x29: ffff8013e9677b90 x28: ffff8413eb81a4b0
[ 1.597196] x27: 000000000000008c x26: ffff000008d6e840
[ 1.602561] x25: 0000000000000004 x24: ffff8013e96e82e0
[ 1.607925] x23: 0000000000000040 x22: 00000000000000c0
[ 1.613289] x21: ffff8013e96e868c x20: 0000000000000000
[ 1.618653] x19: ffff8013e96e8000 x18: 0000000000000000
[ 1.624018] x17: 0000000000000000 x16: 0000000003010066
[ 1.629381] x15: ffff000008ca8000 x14: 0000000000000003
[ 1.634745] x13: 0000000000000026 x12: 0000000000000009
[ 1.640109] x11: 0000000000000009 x10: 0000000000000000
[ 1.645472] x9 : 0000000000000000 x8 : 0000000000000014
[ 1.650837] x7 : ffff8013e9452e00 x6 : 0000000000000000
[ 1.656200] x5 : ffffffffffffffff x4 : 0000000000000000
[ 1.661565] x3 : 0000000000000000 x2 : 0000000000000040
[ 1.666929] x1 : 0000000000000001 x0 : ffff000008d63df9
[ 1.672293]
[ 1.673788] ---[ end trace b58e70f3295a8cd8 ]---
[ 1.678448] Call trace:
[ 1.680911] Exception stack(0xffff8013e96779c0 to 0xffff8013e9677af0)
[ 1.687417] 79c0: ffff8013e96e8000 0001000000000000 ffff8013e9677b90 ffff0000080df66c
[ 1.695329] 79e0: 0000000000000000 ffff00000808e1f4 0000000000000000 ffff8013e9d30c80
[ 1.703242] 7a00: ffff8013e9677a20 ffff00000882b6f4 ffff8013e9677a60 ffff0000080dd384
[ 1.711153] 7a20: 0000000000000000 ffff8013e9677b00 ffff000008cbaa00 ffff000008d6e000
[ 1.719065] 7a40: 0000000000000000 00000000ffffffff 0000000000000001 0000000000000080
[ 1.726977] 7a60: ffff000008d63df9 0000000000000001 0000000000000040 0000000000000000
[ 1.734889] 7a80: 0000000000000000 ffffffffffffffff 0000000000000000 ffff8013e9452e00
[ 1.742801] 7aa0: 0000000000000014 0000000000000000 0000000000000000 0000000000000009
[ 1.750713] 7ac0: 0000000000000009 0000000000000026 0000000000000003 ffff000008ca8000
[ 1.758624] 7ae0: 0000000003010066 0000000000000000
[ 1.763548] [<ffff0000080df66c>] try_to_wake_up+0x298/0x300
[ 1.769175] [<ffff0000080df6e8>] wake_up_process+0x14/0x1c
[ 1.774716] [<ffff0000080d027c>] create_worker+0x108/0x194
[ 1.780255] [<ffff0000080d2cf4>] alloc_unbound_pwq+0x1e4/0x398
[ 1.786146] [<ffff0000080d2f84>] wq_update_unbound_numa+0xdc/0x190
[ 1.792389] [<ffff0000080d4094>] workqueue_online_cpu+0x254/0x2a8
[ 1.798545] [<ffff0000080bb8a4>] cpuhp_up_callbacks+0x54/0x100
[ 1.804436] [<ffff0000080bbb40>] cpuhp_thread_fun+0x12c/0x13c
[ 1.810240] [<ffff0000080daf00>] smpboot_thread_fn+0x1a8/0x1cc
[ 1.816130] [<ffff0000080d7844>] kthread+0xd4/0xe8
[ 1.820967] [<ffff000008082e90>] ret_from_fork+0x10/0x40
[ 1.826334] Unable to handle kernel paging request at virtual address fffe841404c71524
[ 1.834333] pgd = ffff000008dae000
[ 1.837762] [fffe841404c71524] *pgd=00000413fbfee003, *pud=0000000000000000
[ 1.844797] Internal error: Oops: 96000004 [#1] SMP
[ 1.849720] Modules linked in:
[ 1.852799] CPU: 16 PID: 103 Comm: cpuhp/16 Tainted: G W 4.8.0-rc4-00163-g803ea3a #21
[ 1.861853] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
[ 1.868007] task: ffff8013e9678000 task.stack: ffff8013e9674000
[ 1.873985] PC is at try_to_wake_up+0x148/0x300
[ 1.878557] LR is at try_to_wake_up+0x11c/0x300
[ 1.883129] pc : [<ffff0000080df51c>] lr : [<ffff0000080df4f0>] pstate: 600000c5
[ 1.890602] sp : ffff8013e9677b90
[ 1.893943] x29: ffff8013e9677b90 x28: ffff8413eb81a4b0
[ 1.899307] x27: 000000000000008c x26: ffff000008d6e840
[ 1.904670] x25: ffff000008ca5f10 x24: ffff000008c77600
[ 1.910033] x23: 0000000000000040 x22: 00000000000000c0
[ 1.915398] x21: ffff8013e96e868c x20: 0000000000000004
[ 1.920761] x19: ffff8013e96e8000 x18: 0000000000000000
[ 1.926125] x17: 0000000000000000 x16: 0000000003010066
[ 1.931489] x15: ffff000008ca8000 x14: 0000000000000003
[ 1.936853] x13: 0000000000000026 x12: 0000000000000009
[ 1.942217] x11: 0000000000000009 x10: 0000000000000000
[ 1.947581] x9 : 0000000000000000 x8 : 0000000000000014
[ 1.952945] x7 : ffff8013e9452e00 x6 : 0000000000000000
[ 1.958309] x5 : ffff8413eb6ca700 x4 : 0000000000000000
[ 1.963674] x3 : 00008413e2ba3000 x2 : 0000000000000010
[ 1.969037] x1 : ffff8413fbfffa80 x0 : ffff000008c71aa4
[ 1.974401]
[ 1.975897] Process cpuhp/16 (pid: 103, stack limit = 0xffff8013e9674020)
[ 1.982754] Stack: (0xffff8013e9677b90 to 0xffff8013e9678000)
[ 1.988556] 7b80: ffff8013e9677bf0 ffff0000080df6e8
[ 1.996468] 7ba0: ffff8013e96e0000 ffff8013e96d0000 0000000000000000 ffff8013e9677c40
[ 2.004381] 7bc0: ffff8013e96d0318 ffff8013e96d0000 0000000000000004 ffff0000080d0254
[ 2.012293] 7be0: ffff8013e9677c00 ffff0000080d0274 ffff8013e9677c00 ffff0000080d027c
[ 2.020204] 7c00: ffff8013e9677c50 ffff0000080d2cf4 ffff000008d6e000 ffff8013e9cdf100
[ 2.028116] 7c20: 0000000000000021 ffff8413e98b9000 0000000000000000 ffff0000080d2ce8
[ 2.036028] 7c40: ff00303a39323175 ffff0000080d2e3c ffff8013e9677ca0 ffff0000080d2f84
[ 2.043940] 7c60: ffff8413e98b9000 0000000000000001 ffff8013e9cdf100 ffff8013e9da4000
[ 2.051852] 7c80: ffff8013e9677d6c ffff000008d6eaa8 0000000000000000 ffff000008d63dc9
[ 2.059764] 7ca0: ffff8013e9677ce0 ffff0000080d4094 ffff8413e98b9000 ffff000008cb9978
[ 2.067675] 7cc0: 0000000000000010 ffff000008d6e840 ffff8013e9677d6c ffff0000080d3ec0
[ 2.075587] 7ce0: ffff8013e9677d70 ffff0000080bb8a4 ffff8413eb814a08 ffff000008cb5688
[ 2.083499] 7d00: 0000000000000010 0000000000000045 0000000000000000 0000000000000079
[ 2.091411] 7d20: 0000000000000001 0000000000000000 0000000000000000 0000000000000000
[ 2.099323] 7d40: ffff8413eb814a08 01ff000008cb5688 0000000000000000 0000000000010000
[ 2.107234] 7d60: 0000000000000000 0000008100000079 ffff8013e9677db0 ffff0000080bbb40
[ 2.115147] 7d80: ffff8413eb814a08 0000000000000010 0000000000000001 ffff000008cb6ef8
[ 2.123058] 7da0: 0000000000000001 0000000000000002 ffff8013e9677dd0 ffff0000080daf00
[ 2.130970] 7dc0: ffff8013e9674000 ffff8013e9450000 ffff8013e9677e20 ffff0000080d7844
[ 2.138883] 7de0: ffff8013e9450080 ffff000008d6eb20 ffff000008a8dba0 ffff8013e9450000
[ 2.146795] 7e00: ffff0000080dad58 0000000000000000 0000000000000000 ffff8013e9450000
[ 2.154706] 7e20: 0000000000000000 ffff000008082e90 ffff0000080d7770 ffff8013e9450080
[ 2.162618] 7e40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.170530] 7e60: ffff8013e9677ea0 0000000000000001 ffff000000000010 ffff8013e9450000
[ 2.178442] 7e80: 0000000000000000 0000000000030003 ffff8013e9677e90 ffff8013e9677e90
[ 2.186354] 7ea0: 0000000000000000 ffff000000000000 ffff8013e9677eb0 ffff8013e9677eb0
[ 2.194265] 7ec0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.202177] 7ee0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.210089] 7f00: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.218001] 7f20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.225913] 7f40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.233824] 7f60: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.241736] 7f80: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.249648] 7fa0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.257560] 7fc0: 0000000000000000 0000000000000005 0000000000000000 0000000000000000
[ 2.265472] 7fe0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 2.273383] Call trace:
[ 2.275846] Exception stack(0xffff8013e96779c0 to 0xffff8013e9677af0)
[ 2.282352] 79c0: ffff8013e96e8000 0001000000000000 ffff8013e9677b90 ffff0000080df51c
[ 2.290264] 79e0: 0000000000000000 ffff00000808e1f4 0000000000000000 ffff8013e9d30c80
[ 2.298177] 7a00: ffff8013e9677a20 ffff00000882b6f4 ffff8013e9677a60 ffff0000080dd384
[ 2.306089] 7a20: 0000000000000000 ffff8013e9677b00 ffff000008cbaa00 ffff000008d6e000
[ 2.314001] 7a40: 0000000000000000 00000000ffffffff 0000000000000001 0000000000000080
[ 2.321912] 7a60: ffff000008c71aa4 ffff8413fbfffa80 0000000000000010 00008413e2ba3000
[ 2.329824] 7a80: 0000000000000000 ffff8413eb6ca700 0000000000000000 ffff8013e9452e00
[ 2.337736] 7aa0: 0000000000000014 0000000000000000 0000000000000000 0000000000000009
[ 2.345648] 7ac0: 0000000000000009 0000000000000026 0000000000000003 ffff000008ca8000
[ 2.353559] 7ae0: 0000000003010066 0000000000000000
[ 2.358483] [<ffff0000080df51c>] try_to_wake_up+0x148/0x300
[ 2.364110] [<ffff0000080df6e8>] wake_up_process+0x14/0x1c
[ 2.369649] [<ffff0000080d027c>] create_worker+0x108/0x194
[ 2.375189] [<ffff0000080d2cf4>] alloc_unbound_pwq+0x1e4/0x398
[ 2.381080] [<ffff0000080d2f84>] wq_update_unbound_numa+0xdc/0x190
[ 2.387322] [<ffff0000080d4094>] workqueue_online_cpu+0x254/0x2a8
[ 2.393477] [<ffff0000080bb8a4>] cpuhp_up_callbacks+0x54/0x100
[ 2.399368] [<ffff0000080bbb40>] cpuhp_thread_fun+0x12c/0x13c
[ 2.405171] [<ffff0000080daf00>] smpboot_thread_fn+0x1a8/0x1cc
[ 2.411061] [<ffff0000080d7844>] kthread+0xd4/0xe8
[ 2.415897] [<ffff000008082e90>] ret_from_fork+0x10/0x40
[ 2.421261] Code: f877db21 90005cd8 f8627b23 91180318 (b8616802)
[ 2.427426] ---[ end trace b58e70f3295a8cd9 ]---
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC] Arm64 boot fail with numa enable in BIOS
2016-09-19 13:05 [RFC] Arm64 boot fail with numa enable in BIOS Yisheng Xie
@ 2016-09-19 14:07 ` Mark Rutland
2016-09-19 14:45 ` Will Deacon
` (3 more replies)
2016-09-20 2:01 ` Ming Lei
1 sibling, 4 replies; 10+ messages in thread
From: Mark Rutland @ 2016-09-19 14:07 UTC (permalink / raw)
To: Yisheng Xie
Cc: linux-kernel, linux-mm, Hanjun Guo, Xishi Qiu, linux-arm-kernel,
will.deacon, catalin.marinas
[adding LAKML, arm64 maintainers]
On Mon, Sep 19, 2016 at 09:05:26PM +0800, Yisheng Xie wrote:
> hi all,
Hi,
In future, please make sure to Cc LAKML along with relevant parties when
sending arm64 patches/queries.
For everyone newly Cc'd, the original message (with attachments) can be
found at:
http://lkml.kernel.org/r/7618d76d-bfa8-d8aa-59aa-06f9d90c1a98@huawei.com
> When I enable NUMA in BIOS for arm64, it failed to boot on v4.8-rc4-162-g071e31e.
That commit ID doesn't seem to be in mainline (I can't find it in my
local tree). Which tree are you using? Do you have local patches
applied?
I take it that by "enable NUMA in BIOS", you mean exposing SRAT to the
OS?
> For the crash log, it seems caused by error number of cpumask.
> Any ideas about it?
Much earlier in your log, there was a (non-fatal) warning, as below. Do
you see this without NUMA/SRAT enabled in your FW? I don't see how the
SRAT should affect the secondaries we try to bring online.
Given your MPIDRs have Aff2 bits set, I wonder if we've conflated a
logical ID with a physical ID somewhere, and it just so happens that the
NUMA code is more likely to poke something based on that.
Can you modify the warning in cpumask.h to dump the bad CPU number? That
would make it fairly clear if that's the case.
Thanks,
Mark.
> [ 0.297337] Detected PIPT I-cache on CPU1
> [ 0.297347] GICv3: CPU1: found redistributor 10001 region 1:0x000000004d140000
> [ 0.297356] CPU1: Booted secondary processor [410fd082]
> [ 0.297375] ------------[ cut here ]------------
> [ 0.320390] WARNING: CPU: 1 PID: 0 at ./include/linux/cpumask.h:121 gic_raise_softirq+0x128/0x17c
> [ 0.329356] Modules linked in:
> [ 0.332434]
> [ 0.333932] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.8.0-rc4-00163-g803ea3a #21
> [ 0.341581] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
> [ 0.347735] task: ffff8013e9dd0000 task.stack: ffff8013e9dcc000
> [ 0.353714] PC is at gic_raise_softirq+0x128/0x17c
> [ 0.358550] LR is at gic_raise_softirq+0xa0/0x17c
> [ 0.363298] pc : [<ffff00000838c124>] lr : [<ffff00000838c09c>] pstate: 200001c5
> [ 0.370770] sp : ffff8013e9dcfde0
> [ 0.374112] x29: ffff8013e9dcfde0 x28: 0000000000000000
> [ 0.379476] x27: 000000000083207c x26: ffff000008ca5d70
> [ 0.384841] x25: 0000000100000001 x24: ffff000008d63ff3
> [ 0.390205] x23: 0000000000000000 x22: ffff000008cb0000
> [ 0.395569] x21: ffff00000884edb0 x20: 0000000000000001
> [ 0.400933] x19: 0000000100000000 x18: 0000000000000000
> [ 0.406298] x17: 0000000000000000 x16: 0000000003010066
> [ 0.411661] x15: ffff000008ca8000 x14: 0000000000000013
> [ 0.417025] x13: 0000000000000000 x12: 0000000000000013
> [ 0.422389] x11: 0000000000000013 x10: 0000000002e92aa7
> [ 0.427754] x9 : 0000000000000000 x8 : ffff8413eb6ca668
> [ 0.433118] x7 : ffff8413eb6ca690 x6 : 0000000000000000
> [ 0.438482] x5 : fffffffffffffffe x4 : 0000000000000000
> [ 0.443845] x3 : 0000000000000040 x2 : 0000000000000041
> [ 0.449209] x1 : 0000000000000000 x0 : 0000000000000001
> [ 0.454573]
> [ 0.456069] ---[ end trace b58e70f3295a8cd7 ]---
> [ 0.460730] Call trace:
> [ 0.463193] Exception stack(0xffff8013e9dcfc10 to 0xffff8013e9dcfd40)
> [ 0.469699] fc00: 0000000100000000 0001000000000000
> [ 0.477611] fc20: ffff8013e9dcfde0 ffff00000838c124 ffff000008d72228 ffff8013e9dcff70
> [ 0.485524] fc40: ffff000008d72608 ffff000008ab02a4 0000000000000000 0000000000000000
> [ 0.493436] fc60: 0000000000000000 3464313430303030 0000000000000000 0000000000000000
> [ 0.501348] fc80: ffff8013e9dcfc90 ffff00000836e678 ffff8013e9dcfca0 ffff00000836e910
> [ 0.509259] fca0: ffff8013e9dcfd30 ffff00000836ec10 0000000000000001 0000000000000000
> [ 0.517171] fcc0: 0000000000000041 0000000000000040 0000000000000000 fffffffffffffffe
> [ 0.525083] fce0: 0000000000000000 ffff8413eb6ca690 ffff8413eb6ca668 0000000000000000
> [ 0.532995] fd00: 0000000002e92aa7 0000000000000013 0000000000000013 0000000000000000
> [ 0.540907] fd20: 0000000000000013 ffff000008ca8000 0000000003010066 0000000000000000
> [ 0.548819] [<ffff00000838c124>] gic_raise_softirq+0x128/0x17c
> [ 0.554713] [<ffff00000808e1f4>] smp_send_reschedule+0x34/0x3c
> [ 0.560605] [<ffff0000080ddf18>] resched_curr+0x40/0x5c
> [ 0.565881] [<ffff0000080de650>] check_preempt_curr+0x58/0xa0
> [ 0.571685] [<ffff0000080de6b0>] ttwu_do_wakeup+0x18/0x80
> [ 0.577136] [<ffff0000080de790>] ttwu_do_activate+0x78/0x88
> [ 0.582763] [<ffff0000080df5cc>] try_to_wake_up+0x1f8/0x300
> [ 0.588390] [<ffff0000080df79c>] default_wake_function+0x10/0x18
> [ 0.594458] [<ffff0000080f3210>] __wake_up_common+0x5c/0x9c
> [ 0.600085] [<ffff0000080f3264>] __wake_up_locked+0x14/0x1c
> [ 0.605712] [<ffff0000080f3e10>] complete+0x40/0x5c
> [ 0.610635] [<ffff00000808dba8>] secondary_start_kernel+0x148/0x1a8
> [ 0.616965] [<00000000000831a8>] 0x831a8
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC] Arm64 boot fail with numa enable in BIOS
2016-09-19 14:07 ` Mark Rutland
@ 2016-09-19 14:45 ` Will Deacon
2016-09-20 1:19 ` Leizhen (ThunderTown)
2016-09-19 17:41 ` James Morse
` (2 subsequent siblings)
3 siblings, 1 reply; 10+ messages in thread
From: Will Deacon @ 2016-09-19 14:45 UTC (permalink / raw)
To: Mark Rutland
Cc: Yisheng Xie, linux-kernel, linux-mm, Hanjun Guo, Xishi Qiu,
linux-arm-kernel, catalin.marinas, thunder.leizhen
On Mon, Sep 19, 2016 at 03:07:19PM +0100, Mark Rutland wrote:
> [adding LAKML, arm64 maintainers]
I've also looped in Euler ThunderTown, since (a) he's at Huawei and is
assumedly testing this stuff and (b) he has a fairly big NUMA patch
series doing the rounds (some of which I've queued).
> On Mon, Sep 19, 2016 at 09:05:26PM +0800, Yisheng Xie wrote:
> In future, please make sure to Cc LAKML along with relevant parties when
> sending arm64 patches/queries.
>
> For everyone newly Cc'd, the original message (with attachments) can be
> found at:
>
> http://lkml.kernel.org/r/7618d76d-bfa8-d8aa-59aa-06f9d90c1a98@huawei.com
>
> > When I enable NUMA in BIOS for arm64, it failed to boot on v4.8-rc4-162-g071e31e.
>
> That commit ID doesn't seem to be in mainline (I can't find it in my
> local tree). Which tree are you using? Do you have local patches
> applied?
That commit is in mainline:
http://git.kernel.org/linus/071e31e
It would be nice to know if the problem also exists on the arm64
for-next/core branch.
Will
> I take it that by "enable NUMA in BIOS", you mean exposing SRAT to the
> OS?
>
> > For the crash log, it seems caused by error number of cpumask.
> > Any ideas about it?
>
> Much earlier in your log, there was a (non-fatal) warning, as below. Do
> you see this without NUMA/SRAT enabled in your FW? I don't see how the
> SRAT should affect the secondaries we try to bring online.
>
> Given your MPIDRs have Aff2 bits set, I wonder if we've conflated a
> logical ID with a physical ID somewhere, and it just so happens that the
> NUMA code is more likely to poke something based on that.
>
> Can you modify the warning in cpumask.h to dump the bad CPU number? That
> would make it fairly clear if that's the case.
>
> Thanks,
> Mark.
>
> > [ 0.297337] Detected PIPT I-cache on CPU1
> > [ 0.297347] GICv3: CPU1: found redistributor 10001 region 1:0x000000004d140000
> > [ 0.297356] CPU1: Booted secondary processor [410fd082]
> > [ 0.297375] ------------[ cut here ]------------
> > [ 0.320390] WARNING: CPU: 1 PID: 0 at ./include/linux/cpumask.h:121 gic_raise_softirq+0x128/0x17c
> > [ 0.329356] Modules linked in:
> > [ 0.332434]
> > [ 0.333932] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.8.0-rc4-00163-g803ea3a #21
> > [ 0.341581] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
> > [ 0.347735] task: ffff8013e9dd0000 task.stack: ffff8013e9dcc000
> > [ 0.353714] PC is at gic_raise_softirq+0x128/0x17c
> > [ 0.358550] LR is at gic_raise_softirq+0xa0/0x17c
> > [ 0.363298] pc : [<ffff00000838c124>] lr : [<ffff00000838c09c>] pstate: 200001c5
> > [ 0.370770] sp : ffff8013e9dcfde0
> > [ 0.374112] x29: ffff8013e9dcfde0 x28: 0000000000000000
> > [ 0.379476] x27: 000000000083207c x26: ffff000008ca5d70
> > [ 0.384841] x25: 0000000100000001 x24: ffff000008d63ff3
> > [ 0.390205] x23: 0000000000000000 x22: ffff000008cb0000
> > [ 0.395569] x21: ffff00000884edb0 x20: 0000000000000001
> > [ 0.400933] x19: 0000000100000000 x18: 0000000000000000
> > [ 0.406298] x17: 0000000000000000 x16: 0000000003010066
> > [ 0.411661] x15: ffff000008ca8000 x14: 0000000000000013
> > [ 0.417025] x13: 0000000000000000 x12: 0000000000000013
> > [ 0.422389] x11: 0000000000000013 x10: 0000000002e92aa7
> > [ 0.427754] x9 : 0000000000000000 x8 : ffff8413eb6ca668
> > [ 0.433118] x7 : ffff8413eb6ca690 x6 : 0000000000000000
> > [ 0.438482] x5 : fffffffffffffffe x4 : 0000000000000000
> > [ 0.443845] x3 : 0000000000000040 x2 : 0000000000000041
> > [ 0.449209] x1 : 0000000000000000 x0 : 0000000000000001
> > [ 0.454573]
> > [ 0.456069] ---[ end trace b58e70f3295a8cd7 ]---
> > [ 0.460730] Call trace:
> > [ 0.463193] Exception stack(0xffff8013e9dcfc10 to 0xffff8013e9dcfd40)
> > [ 0.469699] fc00: 0000000100000000 0001000000000000
> > [ 0.477611] fc20: ffff8013e9dcfde0 ffff00000838c124 ffff000008d72228 ffff8013e9dcff70
> > [ 0.485524] fc40: ffff000008d72608 ffff000008ab02a4 0000000000000000 0000000000000000
> > [ 0.493436] fc60: 0000000000000000 3464313430303030 0000000000000000 0000000000000000
> > [ 0.501348] fc80: ffff8013e9dcfc90 ffff00000836e678 ffff8013e9dcfca0 ffff00000836e910
> > [ 0.509259] fca0: ffff8013e9dcfd30 ffff00000836ec10 0000000000000001 0000000000000000
> > [ 0.517171] fcc0: 0000000000000041 0000000000000040 0000000000000000 fffffffffffffffe
> > [ 0.525083] fce0: 0000000000000000 ffff8413eb6ca690 ffff8413eb6ca668 0000000000000000
> > [ 0.532995] fd00: 0000000002e92aa7 0000000000000013 0000000000000013 0000000000000000
> > [ 0.540907] fd20: 0000000000000013 ffff000008ca8000 0000000003010066 0000000000000000
> > [ 0.548819] [<ffff00000838c124>] gic_raise_softirq+0x128/0x17c
> > [ 0.554713] [<ffff00000808e1f4>] smp_send_reschedule+0x34/0x3c
> > [ 0.560605] [<ffff0000080ddf18>] resched_curr+0x40/0x5c
> > [ 0.565881] [<ffff0000080de650>] check_preempt_curr+0x58/0xa0
> > [ 0.571685] [<ffff0000080de6b0>] ttwu_do_wakeup+0x18/0x80
> > [ 0.577136] [<ffff0000080de790>] ttwu_do_activate+0x78/0x88
> > [ 0.582763] [<ffff0000080df5cc>] try_to_wake_up+0x1f8/0x300
> > [ 0.588390] [<ffff0000080df79c>] default_wake_function+0x10/0x18
> > [ 0.594458] [<ffff0000080f3210>] __wake_up_common+0x5c/0x9c
> > [ 0.600085] [<ffff0000080f3264>] __wake_up_locked+0x14/0x1c
> > [ 0.605712] [<ffff0000080f3e10>] complete+0x40/0x5c
> > [ 0.610635] [<ffff00000808dba8>] secondary_start_kernel+0x148/0x1a8
> > [ 0.616965] [<00000000000831a8>] 0x831a8
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC] Arm64 boot fail with numa enable in BIOS
2016-09-19 14:07 ` Mark Rutland
2016-09-19 14:45 ` Will Deacon
@ 2016-09-19 17:41 ` James Morse
2016-09-20 2:51 ` Hanjun Guo
2016-09-20 3:29 ` Yisheng Xie
3 siblings, 0 replies; 10+ messages in thread
From: James Morse @ 2016-09-19 17:41 UTC (permalink / raw)
To: Mark Rutland, Yisheng Xie
Cc: linux-kernel, linux-mm, Hanjun Guo, Xishi Qiu, linux-arm-kernel,
will.deacon, catalin.marinas
On 19/09/16 15:07, Mark Rutland wrote:
> On Mon, Sep 19, 2016 at 09:05:26PM +0800, Yisheng Xie wrote:
>> For the crash log, it seems caused by error number of cpumask.
>> Any ideas about it?
> Much earlier in your log, there was a (non-fatal) warning, as below. Do
> you see this without NUMA/SRAT enabled in your FW?
>> [ 0.297337] Detected PIPT I-cache on CPU1
>> [ 0.297347] GICv3: CPU1: found redistributor 10001 region 1:0x000000004d140000
>> [ 0.297356] CPU1: Booted secondary processor [410fd082]
>> [ 0.297375] ------------[ cut here ]------------
>> [ 0.320390] WARNING: CPU: 1 PID: 0 at ./include/linux/cpumask.h:121 gic_raise_softirq+0x128/0x17c
>> [ 0.329356] Modules linked in:
>> [ 0.332434]
>> [ 0.333932] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.8.0-rc4-00163-g803ea3a #21
>> [ 0.341581] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
>> [ 0.347735] task: ffff8013e9dd0000 task.stack: ffff8013e9dcc000
>> [ 0.353714] PC is at gic_raise_softirq+0x128/0x17c
>> [ 0.358550] LR is at gic_raise_softirq+0xa0/0x17c
I've seen this first trace when built with DEBUG_PER_CPU_MAPS. My version of
this trace[0] was just noise due to gic_compute_target_list() and
gic_raise_softirq() sharing an iterator.
This patch silenced it for me:
https://lkml.org/lkml/2016/9/19/623
Yours may be a different problem with the same symptom.
Thanks,
James
[0] gicv3 trace when built with DEBUG_PER_CPU_MAPS
[ 3.077738] GICv3: CPU1: found redistributor 1 region 0:0x000000002f120000
[ 3.077943] CPU1: Booted secondary processor [410fd0f0]
[ 3.078542] ------------[ cut here ]------------
[ 3.078746] WARNING: CPU: 1 PID: 0 at ../include/linux/cpumask.h:121
gic_raise_softirq+0x12c/0x170
[ 3.078812] Modules linked in:
[ 3.078869]
[ 3.078930] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.8.0-rc5+ #5188
[ 3.078994] Hardware name: Foundation-v8A (DT)
[ 3.079059] task: ffff80087a1a0080 task.stack: ffff80087a19c000
[ 3.079145] PC is at gic_raise_softirq+0x12c/0x170
[ 3.079226] LR is at gic_raise_softirq+0xa4/0x170
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC] Arm64 boot fail with numa enable in BIOS
2016-09-19 14:45 ` Will Deacon
@ 2016-09-20 1:19 ` Leizhen (ThunderTown)
0 siblings, 0 replies; 10+ messages in thread
From: Leizhen (ThunderTown) @ 2016-09-20 1:19 UTC (permalink / raw)
To: Will Deacon, Mark Rutland
Cc: Yisheng Xie, linux-kernel, linux-mm, Hanjun Guo, Xishi Qiu,
linux-arm-kernel, catalin.marinas
On 2016/9/19 22:45, Will Deacon wrote:
> On Mon, Sep 19, 2016 at 03:07:19PM +0100, Mark Rutland wrote:
>> [adding LAKML, arm64 maintainers]
>
> I've also looped in Euler ThunderTown, since (a) he's at Huawei and is
> assumedly testing this stuff and (b) he has a fairly big NUMA patch
> series doing the rounds (some of which I've queued).
In my patch series, only one is used to resolve crashed problem, but it's related to device-tree.
>
>> On Mon, Sep 19, 2016 at 09:05:26PM +0800, Yisheng Xie wrote:
>> In future, please make sure to Cc LAKML along with relevant parties when
>> sending arm64 patches/queries.
>>
>> For everyone newly Cc'd, the original message (with attachments) can be
>> found at:
>>
>> http://lkml.kernel.org/r/7618d76d-bfa8-d8aa-59aa-06f9d90c1a98@huawei.com
>>
>>> When I enable NUMA in BIOS for arm64, it failed to boot on v4.8-rc4-162-g071e31e.
>>
>> That commit ID doesn't seem to be in mainline (I can't find it in my
>> local tree). Which tree are you using? Do you have local patches
>> applied?
>
> That commit is in mainline:
>
> http://git.kernel.org/linus/071e31e
>
> It would be nice to know if the problem also exists on the arm64
> for-next/core branch.
>
> Will
>
>
>> I take it that by "enable NUMA in BIOS", you mean exposing SRAT to the
>> OS?
>>
>>> For the crash log, it seems caused by error number of cpumask.
>>> Any ideas about it?
>>
>> Much earlier in your log, there was a (non-fatal) warning, as below. Do
>> you see this without NUMA/SRAT enabled in your FW? I don't see how the
>> SRAT should affect the secondaries we try to bring online.
>>
>> Given your MPIDRs have Aff2 bits set, I wonder if we've conflated a
>> logical ID with a physical ID somewhere, and it just so happens that the
>> NUMA code is more likely to poke something based on that.
>>
>> Can you modify the warning in cpumask.h to dump the bad CPU number? That
>> would make it fairly clear if that's the case.
>>
>> Thanks,
>> Mark.
>>
>>> [ 0.297337] Detected PIPT I-cache on CPU1
>>> [ 0.297347] GICv3: CPU1: found redistributor 10001 region 1:0x000000004d140000
>>> [ 0.297356] CPU1: Booted secondary processor [410fd082]
>>> [ 0.297375] ------------[ cut here ]------------
>>> [ 0.320390] WARNING: CPU: 1 PID: 0 at ./include/linux/cpumask.h:121 gic_raise_softirq+0x128/0x17c
>>> [ 0.329356] Modules linked in:
>>> [ 0.332434]
>>> [ 0.333932] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.8.0-rc4-00163-g803ea3a #21
>>> [ 0.341581] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
>>> [ 0.347735] task: ffff8013e9dd0000 task.stack: ffff8013e9dcc000
>>> [ 0.353714] PC is at gic_raise_softirq+0x128/0x17c
>>> [ 0.358550] LR is at gic_raise_softirq+0xa0/0x17c
>>> [ 0.363298] pc : [<ffff00000838c124>] lr : [<ffff00000838c09c>] pstate: 200001c5
>>> [ 0.370770] sp : ffff8013e9dcfde0
>>> [ 0.374112] x29: ffff8013e9dcfde0 x28: 0000000000000000
>>> [ 0.379476] x27: 000000000083207c x26: ffff000008ca5d70
>>> [ 0.384841] x25: 0000000100000001 x24: ffff000008d63ff3
>>> [ 0.390205] x23: 0000000000000000 x22: ffff000008cb0000
>>> [ 0.395569] x21: ffff00000884edb0 x20: 0000000000000001
>>> [ 0.400933] x19: 0000000100000000 x18: 0000000000000000
>>> [ 0.406298] x17: 0000000000000000 x16: 0000000003010066
>>> [ 0.411661] x15: ffff000008ca8000 x14: 0000000000000013
>>> [ 0.417025] x13: 0000000000000000 x12: 0000000000000013
>>> [ 0.422389] x11: 0000000000000013 x10: 0000000002e92aa7
>>> [ 0.427754] x9 : 0000000000000000 x8 : ffff8413eb6ca668
>>> [ 0.433118] x7 : ffff8413eb6ca690 x6 : 0000000000000000
>>> [ 0.438482] x5 : fffffffffffffffe x4 : 0000000000000000
>>> [ 0.443845] x3 : 0000000000000040 x2 : 0000000000000041
>>> [ 0.449209] x1 : 0000000000000000 x0 : 0000000000000001
>>> [ 0.454573]
>>> [ 0.456069] ---[ end trace b58e70f3295a8cd7 ]---
>>> [ 0.460730] Call trace:
>>> [ 0.463193] Exception stack(0xffff8013e9dcfc10 to 0xffff8013e9dcfd40)
>>> [ 0.469699] fc00: 0000000100000000 0001000000000000
>>> [ 0.477611] fc20: ffff8013e9dcfde0 ffff00000838c124 ffff000008d72228 ffff8013e9dcff70
>>> [ 0.485524] fc40: ffff000008d72608 ffff000008ab02a4 0000000000000000 0000000000000000
>>> [ 0.493436] fc60: 0000000000000000 3464313430303030 0000000000000000 0000000000000000
>>> [ 0.501348] fc80: ffff8013e9dcfc90 ffff00000836e678 ffff8013e9dcfca0 ffff00000836e910
>>> [ 0.509259] fca0: ffff8013e9dcfd30 ffff00000836ec10 0000000000000001 0000000000000000
>>> [ 0.517171] fcc0: 0000000000000041 0000000000000040 0000000000000000 fffffffffffffffe
>>> [ 0.525083] fce0: 0000000000000000 ffff8413eb6ca690 ffff8413eb6ca668 0000000000000000
>>> [ 0.532995] fd00: 0000000002e92aa7 0000000000000013 0000000000000013 0000000000000000
>>> [ 0.540907] fd20: 0000000000000013 ffff000008ca8000 0000000003010066 0000000000000000
>>> [ 0.548819] [<ffff00000838c124>] gic_raise_softirq+0x128/0x17c
>>> [ 0.554713] [<ffff00000808e1f4>] smp_send_reschedule+0x34/0x3c
>>> [ 0.560605] [<ffff0000080ddf18>] resched_curr+0x40/0x5c
>>> [ 0.565881] [<ffff0000080de650>] check_preempt_curr+0x58/0xa0
>>> [ 0.571685] [<ffff0000080de6b0>] ttwu_do_wakeup+0x18/0x80
>>> [ 0.577136] [<ffff0000080de790>] ttwu_do_activate+0x78/0x88
>>> [ 0.582763] [<ffff0000080df5cc>] try_to_wake_up+0x1f8/0x300
>>> [ 0.588390] [<ffff0000080df79c>] default_wake_function+0x10/0x18
>>> [ 0.594458] [<ffff0000080f3210>] __wake_up_common+0x5c/0x9c
>>> [ 0.600085] [<ffff0000080f3264>] __wake_up_locked+0x14/0x1c
>>> [ 0.605712] [<ffff0000080f3e10>] complete+0x40/0x5c
>>> [ 0.610635] [<ffff00000808dba8>] secondary_start_kernel+0x148/0x1a8
>>> [ 0.616965] [<00000000000831a8>] 0x831a8
>>
>
> .
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC] Arm64 boot fail with numa enable in BIOS
2016-09-19 13:05 [RFC] Arm64 boot fail with numa enable in BIOS Yisheng Xie
2016-09-19 14:07 ` Mark Rutland
@ 2016-09-20 2:01 ` Ming Lei
2016-09-20 4:05 ` Yisheng Xie
1 sibling, 1 reply; 10+ messages in thread
From: Ming Lei @ 2016-09-20 2:01 UTC (permalink / raw)
To: Yisheng Xie; +Cc: Linux Kernel Mailing List, linux-mm, Hanjun Guo, Xishi Qiu
On Mon, Sep 19, 2016 at 9:05 PM, Yisheng Xie <xieyisheng1@huawei.com> wrote:
> hi all,
> When I enable NUMA in BIOS for arm64, it failed to boot on v4.8-rc4-162-g071e31e.
> For the crash log, it seems caused by error number of cpumask.
> Any ideas about it?
When I played v4.7 on ARM64 with NUMA, I saw the same issue[1] too,
but it can be avoided by reverting e9d867a(sched: Allow per-cpu kernel
threads to run on online && !active).
But with v4.8-rc6, looks the issue can't be observed any more, so I guess
it has been fixed with some recent patch.
[1] https://lkml.org/lkml/2016/8/8/74
Thanks,
>
> Thanks.
>
> The related config and detail dmesg can be seen in the attachment.
>
> --- crash messages ---
> [ 1.279155] ------------[ cut here ]------------
> [ 1.537146] WARNING: CPU: 16 PID: 103 at ./include/linux/cpumask.h:121 try_to_wake_up+0x298/0x300
> [ 1.546112] Modules linked in:
> [ 1.549190]
> [ 1.550687] CPU: 16 PID: 103 Comm: cpuhp/16 Tainted: G W 4.8.0-rc4-00163-g803ea3a #21
> [ 1.559741] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
> [ 1.565896] task: ffff8013e9678000 task.stack: ffff8013e9674000
> [ 1.571874] PC is at try_to_wake_up+0x298/0x300
> [ 1.576446] LR is at try_to_wake_up+0x278/0x300
> [ 1.581019] pc : [<ffff0000080df66c>] lr : [<ffff0000080df64c>] pstate: 200000c5
> [ 1.588490] sp : ffff8013e9677b90
> [ 1.591832] x29: ffff8013e9677b90 x28: ffff8413eb81a4b0
> [ 1.597196] x27: 000000000000008c x26: ffff000008d6e840
> [ 1.602561] x25: 0000000000000004 x24: ffff8013e96e82e0
> [ 1.607925] x23: 0000000000000040 x22: 00000000000000c0
> [ 1.613289] x21: ffff8013e96e868c x20: 0000000000000000
> [ 1.618653] x19: ffff8013e96e8000 x18: 0000000000000000
> [ 1.624018] x17: 0000000000000000 x16: 0000000003010066
> [ 1.629381] x15: ffff000008ca8000 x14: 0000000000000003
> [ 1.634745] x13: 0000000000000026 x12: 0000000000000009
> [ 1.640109] x11: 0000000000000009 x10: 0000000000000000
> [ 1.645472] x9 : 0000000000000000 x8 : 0000000000000014
> [ 1.650837] x7 : ffff8013e9452e00 x6 : 0000000000000000
> [ 1.656200] x5 : ffffffffffffffff x4 : 0000000000000000
> [ 1.661565] x3 : 0000000000000000 x2 : 0000000000000040
> [ 1.666929] x1 : 0000000000000001 x0 : ffff000008d63df9
> [ 1.672293]
> [ 1.673788] ---[ end trace b58e70f3295a8cd8 ]---
> [ 1.678448] Call trace:
> [ 1.680911] Exception stack(0xffff8013e96779c0 to 0xffff8013e9677af0)
> [ 1.687417] 79c0: ffff8013e96e8000 0001000000000000 ffff8013e9677b90 ffff0000080df66c
> [ 1.695329] 79e0: 0000000000000000 ffff00000808e1f4 0000000000000000 ffff8013e9d30c80
> [ 1.703242] 7a00: ffff8013e9677a20 ffff00000882b6f4 ffff8013e9677a60 ffff0000080dd384
> [ 1.711153] 7a20: 0000000000000000 ffff8013e9677b00 ffff000008cbaa00 ffff000008d6e000
> [ 1.719065] 7a40: 0000000000000000 00000000ffffffff 0000000000000001 0000000000000080
> [ 1.726977] 7a60: ffff000008d63df9 0000000000000001 0000000000000040 0000000000000000
> [ 1.734889] 7a80: 0000000000000000 ffffffffffffffff 0000000000000000 ffff8013e9452e00
> [ 1.742801] 7aa0: 0000000000000014 0000000000000000 0000000000000000 0000000000000009
> [ 1.750713] 7ac0: 0000000000000009 0000000000000026 0000000000000003 ffff000008ca8000
> [ 1.758624] 7ae0: 0000000003010066 0000000000000000
> [ 1.763548] [<ffff0000080df66c>] try_to_wake_up+0x298/0x300
> [ 1.769175] [<ffff0000080df6e8>] wake_up_process+0x14/0x1c
> [ 1.774716] [<ffff0000080d027c>] create_worker+0x108/0x194
> [ 1.780255] [<ffff0000080d2cf4>] alloc_unbound_pwq+0x1e4/0x398
> [ 1.786146] [<ffff0000080d2f84>] wq_update_unbound_numa+0xdc/0x190
> [ 1.792389] [<ffff0000080d4094>] workqueue_online_cpu+0x254/0x2a8
> [ 1.798545] [<ffff0000080bb8a4>] cpuhp_up_callbacks+0x54/0x100
> [ 1.804436] [<ffff0000080bbb40>] cpuhp_thread_fun+0x12c/0x13c
> [ 1.810240] [<ffff0000080daf00>] smpboot_thread_fn+0x1a8/0x1cc
> [ 1.816130] [<ffff0000080d7844>] kthread+0xd4/0xe8
> [ 1.820967] [<ffff000008082e90>] ret_from_fork+0x10/0x40
> [ 1.826334] Unable to handle kernel paging request at virtual address fffe841404c71524
> [ 1.834333] pgd = ffff000008dae000
> [ 1.837762] [fffe841404c71524] *pgd=00000413fbfee003, *pud=0000000000000000
> [ 1.844797] Internal error: Oops: 96000004 [#1] SMP
> [ 1.849720] Modules linked in:
> [ 1.852799] CPU: 16 PID: 103 Comm: cpuhp/16 Tainted: G W 4.8.0-rc4-00163-g803ea3a #21
> [ 1.861853] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
> [ 1.868007] task: ffff8013e9678000 task.stack: ffff8013e9674000
> [ 1.873985] PC is at try_to_wake_up+0x148/0x300
> [ 1.878557] LR is at try_to_wake_up+0x11c/0x300
> [ 1.883129] pc : [<ffff0000080df51c>] lr : [<ffff0000080df4f0>] pstate: 600000c5
> [ 1.890602] sp : ffff8013e9677b90
> [ 1.893943] x29: ffff8013e9677b90 x28: ffff8413eb81a4b0
> [ 1.899307] x27: 000000000000008c x26: ffff000008d6e840
> [ 1.904670] x25: ffff000008ca5f10 x24: ffff000008c77600
> [ 1.910033] x23: 0000000000000040 x22: 00000000000000c0
> [ 1.915398] x21: ffff8013e96e868c x20: 0000000000000004
> [ 1.920761] x19: ffff8013e96e8000 x18: 0000000000000000
> [ 1.926125] x17: 0000000000000000 x16: 0000000003010066
> [ 1.931489] x15: ffff000008ca8000 x14: 0000000000000003
> [ 1.936853] x13: 0000000000000026 x12: 0000000000000009
> [ 1.942217] x11: 0000000000000009 x10: 0000000000000000
> [ 1.947581] x9 : 0000000000000000 x8 : 0000000000000014
> [ 1.952945] x7 : ffff8013e9452e00 x6 : 0000000000000000
> [ 1.958309] x5 : ffff8413eb6ca700 x4 : 0000000000000000
> [ 1.963674] x3 : 00008413e2ba3000 x2 : 0000000000000010
> [ 1.969037] x1 : ffff8413fbfffa80 x0 : ffff000008c71aa4
> [ 1.974401]
> [ 1.975897] Process cpuhp/16 (pid: 103, stack limit = 0xffff8013e9674020)
> [ 1.982754] Stack: (0xffff8013e9677b90 to 0xffff8013e9678000)
> [ 1.988556] 7b80: ffff8013e9677bf0 ffff0000080df6e8
> [ 1.996468] 7ba0: ffff8013e96e0000 ffff8013e96d0000 0000000000000000 ffff8013e9677c40
> [ 2.004381] 7bc0: ffff8013e96d0318 ffff8013e96d0000 0000000000000004 ffff0000080d0254
> [ 2.012293] 7be0: ffff8013e9677c00 ffff0000080d0274 ffff8013e9677c00 ffff0000080d027c
> [ 2.020204] 7c00: ffff8013e9677c50 ffff0000080d2cf4 ffff000008d6e000 ffff8013e9cdf100
> [ 2.028116] 7c20: 0000000000000021 ffff8413e98b9000 0000000000000000 ffff0000080d2ce8
> [ 2.036028] 7c40: ff00303a39323175 ffff0000080d2e3c ffff8013e9677ca0 ffff0000080d2f84
> [ 2.043940] 7c60: ffff8413e98b9000 0000000000000001 ffff8013e9cdf100 ffff8013e9da4000
> [ 2.051852] 7c80: ffff8013e9677d6c ffff000008d6eaa8 0000000000000000 ffff000008d63dc9
> [ 2.059764] 7ca0: ffff8013e9677ce0 ffff0000080d4094 ffff8413e98b9000 ffff000008cb9978
> [ 2.067675] 7cc0: 0000000000000010 ffff000008d6e840 ffff8013e9677d6c ffff0000080d3ec0
> [ 2.075587] 7ce0: ffff8013e9677d70 ffff0000080bb8a4 ffff8413eb814a08 ffff000008cb5688
> [ 2.083499] 7d00: 0000000000000010 0000000000000045 0000000000000000 0000000000000079
> [ 2.091411] 7d20: 0000000000000001 0000000000000000 0000000000000000 0000000000000000
> [ 2.099323] 7d40: ffff8413eb814a08 01ff000008cb5688 0000000000000000 0000000000010000
> [ 2.107234] 7d60: 0000000000000000 0000008100000079 ffff8013e9677db0 ffff0000080bbb40
> [ 2.115147] 7d80: ffff8413eb814a08 0000000000000010 0000000000000001 ffff000008cb6ef8
> [ 2.123058] 7da0: 0000000000000001 0000000000000002 ffff8013e9677dd0 ffff0000080daf00
> [ 2.130970] 7dc0: ffff8013e9674000 ffff8013e9450000 ffff8013e9677e20 ffff0000080d7844
> [ 2.138883] 7de0: ffff8013e9450080 ffff000008d6eb20 ffff000008a8dba0 ffff8013e9450000
> [ 2.146795] 7e00: ffff0000080dad58 0000000000000000 0000000000000000 ffff8013e9450000
> [ 2.154706] 7e20: 0000000000000000 ffff000008082e90 ffff0000080d7770 ffff8013e9450080
> [ 2.162618] 7e40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> [ 2.170530] 7e60: ffff8013e9677ea0 0000000000000001 ffff000000000010 ffff8013e9450000
> [ 2.178442] 7e80: 0000000000000000 0000000000030003 ffff8013e9677e90 ffff8013e9677e90
> [ 2.186354] 7ea0: 0000000000000000 ffff000000000000 ffff8013e9677eb0 ffff8013e9677eb0
> [ 2.194265] 7ec0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> [ 2.202177] 7ee0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> [ 2.210089] 7f00: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> [ 2.218001] 7f20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> [ 2.225913] 7f40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> [ 2.233824] 7f60: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> [ 2.241736] 7f80: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> [ 2.249648] 7fa0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> [ 2.257560] 7fc0: 0000000000000000 0000000000000005 0000000000000000 0000000000000000
> [ 2.265472] 7fe0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
> [ 2.273383] Call trace:
> [ 2.275846] Exception stack(0xffff8013e96779c0 to 0xffff8013e9677af0)
> [ 2.282352] 79c0: ffff8013e96e8000 0001000000000000 ffff8013e9677b90 ffff0000080df51c
> [ 2.290264] 79e0: 0000000000000000 ffff00000808e1f4 0000000000000000 ffff8013e9d30c80
> [ 2.298177] 7a00: ffff8013e9677a20 ffff00000882b6f4 ffff8013e9677a60 ffff0000080dd384
> [ 2.306089] 7a20: 0000000000000000 ffff8013e9677b00 ffff000008cbaa00 ffff000008d6e000
> [ 2.314001] 7a40: 0000000000000000 00000000ffffffff 0000000000000001 0000000000000080
> [ 2.321912] 7a60: ffff000008c71aa4 ffff8413fbfffa80 0000000000000010 00008413e2ba3000
> [ 2.329824] 7a80: 0000000000000000 ffff8413eb6ca700 0000000000000000 ffff8013e9452e00
> [ 2.337736] 7aa0: 0000000000000014 0000000000000000 0000000000000000 0000000000000009
> [ 2.345648] 7ac0: 0000000000000009 0000000000000026 0000000000000003 ffff000008ca8000
> [ 2.353559] 7ae0: 0000000003010066 0000000000000000
> [ 2.358483] [<ffff0000080df51c>] try_to_wake_up+0x148/0x300
> [ 2.364110] [<ffff0000080df6e8>] wake_up_process+0x14/0x1c
> [ 2.369649] [<ffff0000080d027c>] create_worker+0x108/0x194
> [ 2.375189] [<ffff0000080d2cf4>] alloc_unbound_pwq+0x1e4/0x398
> [ 2.381080] [<ffff0000080d2f84>] wq_update_unbound_numa+0xdc/0x190
> [ 2.387322] [<ffff0000080d4094>] workqueue_online_cpu+0x254/0x2a8
> [ 2.393477] [<ffff0000080bb8a4>] cpuhp_up_callbacks+0x54/0x100
> [ 2.399368] [<ffff0000080bbb40>] cpuhp_thread_fun+0x12c/0x13c
> [ 2.405171] [<ffff0000080daf00>] smpboot_thread_fn+0x1a8/0x1cc
> [ 2.411061] [<ffff0000080d7844>] kthread+0xd4/0xe8
> [ 2.415897] [<ffff000008082e90>] ret_from_fork+0x10/0x40
> [ 2.421261] Code: f877db21 90005cd8 f8627b23 91180318 (b8616802)
> [ 2.427426] ---[ end trace b58e70f3295a8cd9 ]---
--
Ming Lei
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC] Arm64 boot fail with numa enable in BIOS
2016-09-19 14:07 ` Mark Rutland
2016-09-19 14:45 ` Will Deacon
2016-09-19 17:41 ` James Morse
@ 2016-09-20 2:51 ` Hanjun Guo
2016-09-20 3:29 ` Yisheng Xie
3 siblings, 0 replies; 10+ messages in thread
From: Hanjun Guo @ 2016-09-20 2:51 UTC (permalink / raw)
To: Mark Rutland, Yisheng Xie
Cc: linux-kernel, linux-mm, Xishi Qiu, linux-arm-kernel, will.deacon,
catalin.marinas
On 2016/9/19 22:07, Mark Rutland wrote:
> [adding LAKML, arm64 maintainers]
>
> On Mon, Sep 19, 2016 at 09:05:26PM +0800, Yisheng Xie wrote:
>> hi all,
> Hi,
>
> In future, please make sure to Cc LAKML along with relevant parties when
> sending arm64 patches/queries.
>
> For everyone newly Cc'd, the original message (with attachments) can be
> found at:
>
> http://lkml.kernel.org/r/7618d76d-bfa8-d8aa-59aa-06f9d90c1a98@huawei.com
>
>> When I enable NUMA in BIOS for arm64, it failed to boot on v4.8-rc4-162-g071e31e.
> That commit ID doesn't seem to be in mainline (I can't find it in my
> local tree). Which tree are you using? Do you have local patches
> applied?
Yes, we have GICv3 ITS and mbigen patches on top which trying to enable PCI msi
and native SAS on the board.
>
> I take it that by "enable NUMA in BIOS", you mean exposing SRAT to the
> OS?
Yes, SRAT and SLIT.
>
>> For the crash log, it seems caused by error number of cpumask.
>> Any ideas about it?
> Much earlier in your log, there was a (non-fatal) warning, as below. Do
> you see this without NUMA/SRAT enabled in your FW?
Works ok without NUMA/SRAT enabled, we will check the SRAT table.
> I don't see how the
>
> SRAT should affect the secondaries we try to bring online.
Yes, CPU masks and secondaries boot up is related MADT not SRAT.
Thanks
Hanjun
>
> Given your MPIDRs have Aff2 bits set, I wonder if we've conflated a
> logical ID with a physical ID somewhere, and it just so happens that the
> NUMA code is more likely to poke something based on that.
>
> Can you modify the warning in cpumask.h to dump the bad CPU number? That
> would make it fairly clear if that's the case.
>
> Thanks,
> Mark.
>
>> [ 0.297337] Detected PIPT I-cache on CPU1
>> [ 0.297347] GICv3: CPU1: found redistributor 10001 region 1:0x000000004d140000
>> [ 0.297356] CPU1: Booted secondary processor [410fd082]
>> [ 0.297375] ------------[ cut here ]------------
>> [ 0.320390] WARNING: CPU: 1 PID: 0 at ./include/linux/cpumask.h:121 gic_raise_softirq+0x128/0x17c
>> [ 0.329356] Modules linked in:
>> [ 0.332434]
>> [ 0.333932] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.8.0-rc4-00163-g803ea3a #21
>> [ 0.341581] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
>> [ 0.347735] task: ffff8013e9dd0000 task.stack: ffff8013e9dcc000
>> [ 0.353714] PC is at gic_raise_softirq+0x128/0x17c
>> [ 0.358550] LR is at gic_raise_softirq+0xa0/0x17c
>> [ 0.363298] pc : [<ffff00000838c124>] lr : [<ffff00000838c09c>] pstate: 200001c5
>> [ 0.370770] sp : ffff8013e9dcfde0
>> [ 0.374112] x29: ffff8013e9dcfde0 x28: 0000000000000000
>> [ 0.379476] x27: 000000000083207c x26: ffff000008ca5d70
>> [ 0.384841] x25: 0000000100000001 x24: ffff000008d63ff3
>> [ 0.390205] x23: 0000000000000000 x22: ffff000008cb0000
>> [ 0.395569] x21: ffff00000884edb0 x20: 0000000000000001
>> [ 0.400933] x19: 0000000100000000 x18: 0000000000000000
>> [ 0.406298] x17: 0000000000000000 x16: 0000000003010066
>> [ 0.411661] x15: ffff000008ca8000 x14: 0000000000000013
>> [ 0.417025] x13: 0000000000000000 x12: 0000000000000013
>> [ 0.422389] x11: 0000000000000013 x10: 0000000002e92aa7
>> [ 0.427754] x9 : 0000000000000000 x8 : ffff8413eb6ca668
>> [ 0.433118] x7 : ffff8413eb6ca690 x6 : 0000000000000000
>> [ 0.438482] x5 : fffffffffffffffe x4 : 0000000000000000
>> [ 0.443845] x3 : 0000000000000040 x2 : 0000000000000041
>> [ 0.449209] x1 : 0000000000000000 x0 : 0000000000000001
>> [ 0.454573]
>> [ 0.456069] ---[ end trace b58e70f3295a8cd7 ]---
>> [ 0.460730] Call trace:
>> [ 0.463193] Exception stack(0xffff8013e9dcfc10 to 0xffff8013e9dcfd40)
>> [ 0.469699] fc00: 0000000100000000 0001000000000000
>> [ 0.477611] fc20: ffff8013e9dcfde0 ffff00000838c124 ffff000008d72228 ffff8013e9dcff70
>> [ 0.485524] fc40: ffff000008d72608 ffff000008ab02a4 0000000000000000 0000000000000000
>> [ 0.493436] fc60: 0000000000000000 3464313430303030 0000000000000000 0000000000000000
>> [ 0.501348] fc80: ffff8013e9dcfc90 ffff00000836e678 ffff8013e9dcfca0 ffff00000836e910
>> [ 0.509259] fca0: ffff8013e9dcfd30 ffff00000836ec10 0000000000000001 0000000000000000
>> [ 0.517171] fcc0: 0000000000000041 0000000000000040 0000000000000000 fffffffffffffffe
>> [ 0.525083] fce0: 0000000000000000 ffff8413eb6ca690 ffff8413eb6ca668 0000000000000000
>> [ 0.532995] fd00: 0000000002e92aa7 0000000000000013 0000000000000013 0000000000000000
>> [ 0.540907] fd20: 0000000000000013 ffff000008ca8000 0000000003010066 0000000000000000
>> [ 0.548819] [<ffff00000838c124>] gic_raise_softirq+0x128/0x17c
>> [ 0.554713] [<ffff00000808e1f4>] smp_send_reschedule+0x34/0x3c
>> [ 0.560605] [<ffff0000080ddf18>] resched_curr+0x40/0x5c
>> [ 0.565881] [<ffff0000080de650>] check_preempt_curr+0x58/0xa0
>> [ 0.571685] [<ffff0000080de6b0>] ttwu_do_wakeup+0x18/0x80
>> [ 0.577136] [<ffff0000080de790>] ttwu_do_activate+0x78/0x88
>> [ 0.582763] [<ffff0000080df5cc>] try_to_wake_up+0x1f8/0x300
>> [ 0.588390] [<ffff0000080df79c>] default_wake_function+0x10/0x18
>> [ 0.594458] [<ffff0000080f3210>] __wake_up_common+0x5c/0x9c
>> [ 0.600085] [<ffff0000080f3264>] __wake_up_locked+0x14/0x1c
>> [ 0.605712] [<ffff0000080f3e10>] complete+0x40/0x5c
>> [ 0.610635] [<ffff00000808dba8>] secondary_start_kernel+0x148/0x1a8
>> [ 0.616965] [<00000000000831a8>] 0x831a8
> .
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC] Arm64 boot fail with numa enable in BIOS
2016-09-19 14:07 ` Mark Rutland
` (2 preceding siblings ...)
2016-09-20 2:51 ` Hanjun Guo
@ 2016-09-20 3:29 ` Yisheng Xie
2016-09-20 8:33 ` Will Deacon
3 siblings, 1 reply; 10+ messages in thread
From: Yisheng Xie @ 2016-09-20 3:29 UTC (permalink / raw)
To: Mark Rutland
Cc: linux-kernel, linux-mm, Hanjun Guo, Xishi Qiu, linux-arm-kernel,
will.deacon, catalin.marinas
On 2016/9/19 22:07, Mark Rutland wrote:
> [adding LAKML, arm64 maintainers]
>
> On Mon, Sep 19, 2016 at 09:05:26PM +0800, Yisheng Xie wrote:
>> hi all,
>
> Can you modify the warning in cpumask.h to dump the bad CPU number? That
> would make it fairly clear if that's the case.
>
hi Mark,
I dump the bad CPU number, it is 64,
And the cpumask get from task is 00000000,00000000.
[ 3.873044] select_task_rq: allowed 0, allow_cpumask 00000000,00000000
[ 3.879727] cpumask_check: cpu 64, nr_cpumask_bits:64, nr_cpu_ids= 64
[ 3.895989] ------------[ cut here ]------------
[ 3.900652] WARNING: CPU: 16 PID: 103 at ./include/linux/cpumask.h:122 try_to_wake_up+0x410/0x4ac
Thanks.
Yisheng Xie
> Thanks,
> Mark.
>
>> [ 0.297337] Detected PIPT I-cache on CPU1
>> [ 0.297347] GICv3: CPU1: found redistributor 10001 region 1:0x000000004d140000
>> [ 0.297356] CPU1: Booted secondary processor [410fd082]
>> [ 0.297375] ------------[ cut here ]------------
>> [ 0.320390] WARNING: CPU: 1 PID: 0 at ./include/linux/cpumask.h:121 gic_raise_softirq+0x128/0x17c
>> [ 0.329356] Modules linked in:
>> [ 0.332434]
>> [ 0.333932] CPU: 1 PID: 0 Comm: swapper/1 Not tainted 4.8.0-rc4-00163-g803ea3a #21
>> [ 0.341581] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
>> [ 0.347735] task: ffff8013e9dd0000 task.stack: ffff8013e9dcc000
>> [ 0.353714] PC is at gic_raise_softirq+0x128/0x17c
>> [ 0.358550] LR is at gic_raise_softirq+0xa0/0x17c
>> [ 0.363298] pc : [<ffff00000838c124>] lr : [<ffff00000838c09c>] pstate: 200001c5
>> [ 0.370770] sp : ffff8013e9dcfde0
>> [ 0.374112] x29: ffff8013e9dcfde0 x28: 0000000000000000
>> [ 0.379476] x27: 000000000083207c x26: ffff000008ca5d70
>> [ 0.384841] x25: 0000000100000001 x24: ffff000008d63ff3
>> [ 0.390205] x23: 0000000000000000 x22: ffff000008cb0000
>> [ 0.395569] x21: ffff00000884edb0 x20: 0000000000000001
>> [ 0.400933] x19: 0000000100000000 x18: 0000000000000000
>> [ 0.406298] x17: 0000000000000000 x16: 0000000003010066
>> [ 0.411661] x15: ffff000008ca8000 x14: 0000000000000013
>> [ 0.417025] x13: 0000000000000000 x12: 0000000000000013
>> [ 0.422389] x11: 0000000000000013 x10: 0000000002e92aa7
>> [ 0.427754] x9 : 0000000000000000 x8 : ffff8413eb6ca668
>> [ 0.433118] x7 : ffff8413eb6ca690 x6 : 0000000000000000
>> [ 0.438482] x5 : fffffffffffffffe x4 : 0000000000000000
>> [ 0.443845] x3 : 0000000000000040 x2 : 0000000000000041
>> [ 0.449209] x1 : 0000000000000000 x0 : 0000000000000001
>> [ 0.454573]
>> [ 0.456069] ---[ end trace b58e70f3295a8cd7 ]---
>> [ 0.460730] Call trace:
>> [ 0.463193] Exception stack(0xffff8013e9dcfc10 to 0xffff8013e9dcfd40)
>> [ 0.469699] fc00: 0000000100000000 0001000000000000
>> [ 0.477611] fc20: ffff8013e9dcfde0 ffff00000838c124 ffff000008d72228 ffff8013e9dcff70
>> [ 0.485524] fc40: ffff000008d72608 ffff000008ab02a4 0000000000000000 0000000000000000
>> [ 0.493436] fc60: 0000000000000000 3464313430303030 0000000000000000 0000000000000000
>> [ 0.501348] fc80: ffff8013e9dcfc90 ffff00000836e678 ffff8013e9dcfca0 ffff00000836e910
>> [ 0.509259] fca0: ffff8013e9dcfd30 ffff00000836ec10 0000000000000001 0000000000000000
>> [ 0.517171] fcc0: 0000000000000041 0000000000000040 0000000000000000 fffffffffffffffe
>> [ 0.525083] fce0: 0000000000000000 ffff8413eb6ca690 ffff8413eb6ca668 0000000000000000
>> [ 0.532995] fd00: 0000000002e92aa7 0000000000000013 0000000000000013 0000000000000000
>> [ 0.540907] fd20: 0000000000000013 ffff000008ca8000 0000000003010066 0000000000000000
>> [ 0.548819] [<ffff00000838c124>] gic_raise_softirq+0x128/0x17c
>> [ 0.554713] [<ffff00000808e1f4>] smp_send_reschedule+0x34/0x3c
>> [ 0.560605] [<ffff0000080ddf18>] resched_curr+0x40/0x5c
>> [ 0.565881] [<ffff0000080de650>] check_preempt_curr+0x58/0xa0
>> [ 0.571685] [<ffff0000080de6b0>] ttwu_do_wakeup+0x18/0x80
>> [ 0.577136] [<ffff0000080de790>] ttwu_do_activate+0x78/0x88
>> [ 0.582763] [<ffff0000080df5cc>] try_to_wake_up+0x1f8/0x300
>> [ 0.588390] [<ffff0000080df79c>] default_wake_function+0x10/0x18
>> [ 0.594458] [<ffff0000080f3210>] __wake_up_common+0x5c/0x9c
>> [ 0.600085] [<ffff0000080f3264>] __wake_up_locked+0x14/0x1c
>> [ 0.605712] [<ffff0000080f3e10>] complete+0x40/0x5c
>> [ 0.610635] [<ffff00000808dba8>] secondary_start_kernel+0x148/0x1a8
>> [ 0.616965] [<00000000000831a8>] 0x831a8
>
> .
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC] Arm64 boot fail with numa enable in BIOS
2016-09-20 2:01 ` Ming Lei
@ 2016-09-20 4:05 ` Yisheng Xie
0 siblings, 0 replies; 10+ messages in thread
From: Yisheng Xie @ 2016-09-20 4:05 UTC (permalink / raw)
To: Ming Lei; +Cc: Linux Kernel Mailing List, linux-mm, Hanjun Guo, Xishi Qiu
On 2016/9/20 10:01, Ming Lei wrote:
> On Mon, Sep 19, 2016 at 9:05 PM, Yisheng Xie <xieyisheng1@huawei.com> wrote:
>> hi all,
>> When I enable NUMA in BIOS for arm64, it failed to boot on v4.8-rc4-162-g071e31e.
>> For the crash log, it seems caused by error number of cpumask.
>> Any ideas about it?
>
> When I played v4.7 on ARM64 with NUMA, I saw the same issue[1] too,
> but it can be avoided by reverting e9d867a(sched: Allow per-cpu kernel
> threads to run on online && !active).
>
> But with v4.8-rc6, looks the issue can't be observed any more, so I guess
> it has been fixed with some recent patch.
>
>
> [1] https://lkml.org/lkml/2016/8/8/74
>
> Thanks,
>
Hi Ming,
Thanks for this info.
Do you use the same config as me? I have tried on 4.8.0-rc6-00331-gb01cf67
also have the same problem.
Thanks
Yisheng Xie
>>
>> Thanks.
>>
>> The related config and detail dmesg can be seen in the attachment.
>>
>> --- crash messages ---
>> [ 1.279155] ------------[ cut here ]------------
>> [ 1.537146] WARNING: CPU: 16 PID: 103 at ./include/linux/cpumask.h:121 try_to_wake_up+0x298/0x300
>> [ 1.546112] Modules linked in:
>> [ 1.549190]
>> [ 1.550687] CPU: 16 PID: 103 Comm: cpuhp/16 Tainted: G W 4.8.0-rc4-00163-g803ea3a #21
>> [ 1.559741] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
>> [ 1.565896] task: ffff8013e9678000 task.stack: ffff8013e9674000
>> [ 1.571874] PC is at try_to_wake_up+0x298/0x300
>> [ 1.576446] LR is at try_to_wake_up+0x278/0x300
>> [ 1.581019] pc : [<ffff0000080df66c>] lr : [<ffff0000080df64c>] pstate: 200000c5
>> [ 1.588490] sp : ffff8013e9677b90
>> [ 1.591832] x29: ffff8013e9677b90 x28: ffff8413eb81a4b0
>> [ 1.597196] x27: 000000000000008c x26: ffff000008d6e840
>> [ 1.602561] x25: 0000000000000004 x24: ffff8013e96e82e0
>> [ 1.607925] x23: 0000000000000040 x22: 00000000000000c0
>> [ 1.613289] x21: ffff8013e96e868c x20: 0000000000000000
>> [ 1.618653] x19: ffff8013e96e8000 x18: 0000000000000000
>> [ 1.624018] x17: 0000000000000000 x16: 0000000003010066
>> [ 1.629381] x15: ffff000008ca8000 x14: 0000000000000003
>> [ 1.634745] x13: 0000000000000026 x12: 0000000000000009
>> [ 1.640109] x11: 0000000000000009 x10: 0000000000000000
>> [ 1.645472] x9 : 0000000000000000 x8 : 0000000000000014
>> [ 1.650837] x7 : ffff8013e9452e00 x6 : 0000000000000000
>> [ 1.656200] x5 : ffffffffffffffff x4 : 0000000000000000
>> [ 1.661565] x3 : 0000000000000000 x2 : 0000000000000040
>> [ 1.666929] x1 : 0000000000000001 x0 : ffff000008d63df9
>> [ 1.672293]
>> [ 1.673788] ---[ end trace b58e70f3295a8cd8 ]---
>> [ 1.678448] Call trace:
>> [ 1.680911] Exception stack(0xffff8013e96779c0 to 0xffff8013e9677af0)
>> [ 1.687417] 79c0: ffff8013e96e8000 0001000000000000 ffff8013e9677b90 ffff0000080df66c
>> [ 1.695329] 79e0: 0000000000000000 ffff00000808e1f4 0000000000000000 ffff8013e9d30c80
>> [ 1.703242] 7a00: ffff8013e9677a20 ffff00000882b6f4 ffff8013e9677a60 ffff0000080dd384
>> [ 1.711153] 7a20: 0000000000000000 ffff8013e9677b00 ffff000008cbaa00 ffff000008d6e000
>> [ 1.719065] 7a40: 0000000000000000 00000000ffffffff 0000000000000001 0000000000000080
>> [ 1.726977] 7a60: ffff000008d63df9 0000000000000001 0000000000000040 0000000000000000
>> [ 1.734889] 7a80: 0000000000000000 ffffffffffffffff 0000000000000000 ffff8013e9452e00
>> [ 1.742801] 7aa0: 0000000000000014 0000000000000000 0000000000000000 0000000000000009
>> [ 1.750713] 7ac0: 0000000000000009 0000000000000026 0000000000000003 ffff000008ca8000
>> [ 1.758624] 7ae0: 0000000003010066 0000000000000000
>> [ 1.763548] [<ffff0000080df66c>] try_to_wake_up+0x298/0x300
>> [ 1.769175] [<ffff0000080df6e8>] wake_up_process+0x14/0x1c
>> [ 1.774716] [<ffff0000080d027c>] create_worker+0x108/0x194
>> [ 1.780255] [<ffff0000080d2cf4>] alloc_unbound_pwq+0x1e4/0x398
>> [ 1.786146] [<ffff0000080d2f84>] wq_update_unbound_numa+0xdc/0x190
>> [ 1.792389] [<ffff0000080d4094>] workqueue_online_cpu+0x254/0x2a8
>> [ 1.798545] [<ffff0000080bb8a4>] cpuhp_up_callbacks+0x54/0x100
>> [ 1.804436] [<ffff0000080bbb40>] cpuhp_thread_fun+0x12c/0x13c
>> [ 1.810240] [<ffff0000080daf00>] smpboot_thread_fn+0x1a8/0x1cc
>> [ 1.816130] [<ffff0000080d7844>] kthread+0xd4/0xe8
>> [ 1.820967] [<ffff000008082e90>] ret_from_fork+0x10/0x40
>> [ 1.826334] Unable to handle kernel paging request at virtual address fffe841404c71524
>> [ 1.834333] pgd = ffff000008dae000
>> [ 1.837762] [fffe841404c71524] *pgd=00000413fbfee003, *pud=0000000000000000
>> [ 1.844797] Internal error: Oops: 96000004 [#1] SMP
>> [ 1.849720] Modules linked in:
>> [ 1.852799] CPU: 16 PID: 103 Comm: cpuhp/16 Tainted: G W 4.8.0-rc4-00163-g803ea3a #21
>> [ 1.861853] Hardware name: Hisilicon Hi1616 Evaluation Board (DT)
>> [ 1.868007] task: ffff8013e9678000 task.stack: ffff8013e9674000
>> [ 1.873985] PC is at try_to_wake_up+0x148/0x300
>> [ 1.878557] LR is at try_to_wake_up+0x11c/0x300
>> [ 1.883129] pc : [<ffff0000080df51c>] lr : [<ffff0000080df4f0>] pstate: 600000c5
>> [ 1.890602] sp : ffff8013e9677b90
>> [ 1.893943] x29: ffff8013e9677b90 x28: ffff8413eb81a4b0
>> [ 1.899307] x27: 000000000000008c x26: ffff000008d6e840
>> [ 1.904670] x25: ffff000008ca5f10 x24: ffff000008c77600
>> [ 1.910033] x23: 0000000000000040 x22: 00000000000000c0
>> [ 1.915398] x21: ffff8013e96e868c x20: 0000000000000004
>> [ 1.920761] x19: ffff8013e96e8000 x18: 0000000000000000
>> [ 1.926125] x17: 0000000000000000 x16: 0000000003010066
>> [ 1.931489] x15: ffff000008ca8000 x14: 0000000000000003
>> [ 1.936853] x13: 0000000000000026 x12: 0000000000000009
>> [ 1.942217] x11: 0000000000000009 x10: 0000000000000000
>> [ 1.947581] x9 : 0000000000000000 x8 : 0000000000000014
>> [ 1.952945] x7 : ffff8013e9452e00 x6 : 0000000000000000
>> [ 1.958309] x5 : ffff8413eb6ca700 x4 : 0000000000000000
>> [ 1.963674] x3 : 00008413e2ba3000 x2 : 0000000000000010
>> [ 1.969037] x1 : ffff8413fbfffa80 x0 : ffff000008c71aa4
>> [ 1.974401]
>> [ 1.975897] Process cpuhp/16 (pid: 103, stack limit = 0xffff8013e9674020)
>> [ 1.982754] Stack: (0xffff8013e9677b90 to 0xffff8013e9678000)
>> [ 1.988556] 7b80: ffff8013e9677bf0 ffff0000080df6e8
>> [ 1.996468] 7ba0: ffff8013e96e0000 ffff8013e96d0000 0000000000000000 ffff8013e9677c40
>> [ 2.004381] 7bc0: ffff8013e96d0318 ffff8013e96d0000 0000000000000004 ffff0000080d0254
>> [ 2.012293] 7be0: ffff8013e9677c00 ffff0000080d0274 ffff8013e9677c00 ffff0000080d027c
>> [ 2.020204] 7c00: ffff8013e9677c50 ffff0000080d2cf4 ffff000008d6e000 ffff8013e9cdf100
>> [ 2.028116] 7c20: 0000000000000021 ffff8413e98b9000 0000000000000000 ffff0000080d2ce8
>> [ 2.036028] 7c40: ff00303a39323175 ffff0000080d2e3c ffff8013e9677ca0 ffff0000080d2f84
>> [ 2.043940] 7c60: ffff8413e98b9000 0000000000000001 ffff8013e9cdf100 ffff8013e9da4000
>> [ 2.051852] 7c80: ffff8013e9677d6c ffff000008d6eaa8 0000000000000000 ffff000008d63dc9
>> [ 2.059764] 7ca0: ffff8013e9677ce0 ffff0000080d4094 ffff8413e98b9000 ffff000008cb9978
>> [ 2.067675] 7cc0: 0000000000000010 ffff000008d6e840 ffff8013e9677d6c ffff0000080d3ec0
>> [ 2.075587] 7ce0: ffff8013e9677d70 ffff0000080bb8a4 ffff8413eb814a08 ffff000008cb5688
>> [ 2.083499] 7d00: 0000000000000010 0000000000000045 0000000000000000 0000000000000079
>> [ 2.091411] 7d20: 0000000000000001 0000000000000000 0000000000000000 0000000000000000
>> [ 2.099323] 7d40: ffff8413eb814a08 01ff000008cb5688 0000000000000000 0000000000010000
>> [ 2.107234] 7d60: 0000000000000000 0000008100000079 ffff8013e9677db0 ffff0000080bbb40
>> [ 2.115147] 7d80: ffff8413eb814a08 0000000000000010 0000000000000001 ffff000008cb6ef8
>> [ 2.123058] 7da0: 0000000000000001 0000000000000002 ffff8013e9677dd0 ffff0000080daf00
>> [ 2.130970] 7dc0: ffff8013e9674000 ffff8013e9450000 ffff8013e9677e20 ffff0000080d7844
>> [ 2.138883] 7de0: ffff8013e9450080 ffff000008d6eb20 ffff000008a8dba0 ffff8013e9450000
>> [ 2.146795] 7e00: ffff0000080dad58 0000000000000000 0000000000000000 ffff8013e9450000
>> [ 2.154706] 7e20: 0000000000000000 ffff000008082e90 ffff0000080d7770 ffff8013e9450080
>> [ 2.162618] 7e40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>> [ 2.170530] 7e60: ffff8013e9677ea0 0000000000000001 ffff000000000010 ffff8013e9450000
>> [ 2.178442] 7e80: 0000000000000000 0000000000030003 ffff8013e9677e90 ffff8013e9677e90
>> [ 2.186354] 7ea0: 0000000000000000 ffff000000000000 ffff8013e9677eb0 ffff8013e9677eb0
>> [ 2.194265] 7ec0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>> [ 2.202177] 7ee0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>> [ 2.210089] 7f00: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>> [ 2.218001] 7f20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>> [ 2.225913] 7f40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>> [ 2.233824] 7f60: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>> [ 2.241736] 7f80: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>> [ 2.249648] 7fa0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>> [ 2.257560] 7fc0: 0000000000000000 0000000000000005 0000000000000000 0000000000000000
>> [ 2.265472] 7fe0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
>> [ 2.273383] Call trace:
>> [ 2.275846] Exception stack(0xffff8013e96779c0 to 0xffff8013e9677af0)
>> [ 2.282352] 79c0: ffff8013e96e8000 0001000000000000 ffff8013e9677b90 ffff0000080df51c
>> [ 2.290264] 79e0: 0000000000000000 ffff00000808e1f4 0000000000000000 ffff8013e9d30c80
>> [ 2.298177] 7a00: ffff8013e9677a20 ffff00000882b6f4 ffff8013e9677a60 ffff0000080dd384
>> [ 2.306089] 7a20: 0000000000000000 ffff8013e9677b00 ffff000008cbaa00 ffff000008d6e000
>> [ 2.314001] 7a40: 0000000000000000 00000000ffffffff 0000000000000001 0000000000000080
>> [ 2.321912] 7a60: ffff000008c71aa4 ffff8413fbfffa80 0000000000000010 00008413e2ba3000
>> [ 2.329824] 7a80: 0000000000000000 ffff8413eb6ca700 0000000000000000 ffff8013e9452e00
>> [ 2.337736] 7aa0: 0000000000000014 0000000000000000 0000000000000000 0000000000000009
>> [ 2.345648] 7ac0: 0000000000000009 0000000000000026 0000000000000003 ffff000008ca8000
>> [ 2.353559] 7ae0: 0000000003010066 0000000000000000
>> [ 2.358483] [<ffff0000080df51c>] try_to_wake_up+0x148/0x300
>> [ 2.364110] [<ffff0000080df6e8>] wake_up_process+0x14/0x1c
>> [ 2.369649] [<ffff0000080d027c>] create_worker+0x108/0x194
>> [ 2.375189] [<ffff0000080d2cf4>] alloc_unbound_pwq+0x1e4/0x398
>> [ 2.381080] [<ffff0000080d2f84>] wq_update_unbound_numa+0xdc/0x190
>> [ 2.387322] [<ffff0000080d4094>] workqueue_online_cpu+0x254/0x2a8
>> [ 2.393477] [<ffff0000080bb8a4>] cpuhp_up_callbacks+0x54/0x100
>> [ 2.399368] [<ffff0000080bbb40>] cpuhp_thread_fun+0x12c/0x13c
>> [ 2.405171] [<ffff0000080daf00>] smpboot_thread_fn+0x1a8/0x1cc
>> [ 2.411061] [<ffff0000080d7844>] kthread+0xd4/0xe8
>> [ 2.415897] [<ffff000008082e90>] ret_from_fork+0x10/0x40
>> [ 2.421261] Code: f877db21 90005cd8 f8627b23 91180318 (b8616802)
>> [ 2.427426] ---[ end trace b58e70f3295a8cd9 ]---
>
>
>
^ permalink raw reply [flat|nested] 10+ messages in thread
* Re: [RFC] Arm64 boot fail with numa enable in BIOS
2016-09-20 3:29 ` Yisheng Xie
@ 2016-09-20 8:33 ` Will Deacon
0 siblings, 0 replies; 10+ messages in thread
From: Will Deacon @ 2016-09-20 8:33 UTC (permalink / raw)
To: Yisheng Xie
Cc: Mark Rutland, linux-kernel, linux-mm, Hanjun Guo, Xishi Qiu,
linux-arm-kernel, catalin.marinas
Hi Yisheng,
On Tue, Sep 20, 2016 at 11:29:24AM +0800, Yisheng Xie wrote:
> On 2016/9/19 22:07, Mark Rutland wrote:
> > On Mon, Sep 19, 2016 at 09:05:26PM +0800, Yisheng Xie wrote:
> > Can you modify the warning in cpumask.h to dump the bad CPU number? That
> > would make it fairly clear if that's the case.
> >
> hi Mark,
> I dump the bad CPU number, it is 64,
> And the cpumask get from task is 00000000,00000000.
>
> [ 3.873044] select_task_rq: allowed 0, allow_cpumask 00000000,00000000
> [ 3.879727] cpumask_check: cpu 64, nr_cpumask_bits:64, nr_cpu_ids= 64
> [ 3.895989] ------------[ cut here ]------------
> [ 3.900652] WARNING: CPU: 16 PID: 103 at ./include/linux/cpumask.h:122 try_to_wake_up+0x410/0x4ac
Can you look at this patch from David, please:
http://lists.infradead.org/pipermail/linux-arm-kernel/2016-September/458110.html
and offer a Tested-by if it fixes your problem?
Thanks,
Will
^ permalink raw reply [flat|nested] 10+ messages in thread
end of thread, other threads:[~2016-09-20 8:33 UTC | newest]
Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2016-09-19 13:05 [RFC] Arm64 boot fail with numa enable in BIOS Yisheng Xie
2016-09-19 14:07 ` Mark Rutland
2016-09-19 14:45 ` Will Deacon
2016-09-20 1:19 ` Leizhen (ThunderTown)
2016-09-19 17:41 ` James Morse
2016-09-20 2:51 ` Hanjun Guo
2016-09-20 3:29 ` Yisheng Xie
2016-09-20 8:33 ` Will Deacon
2016-09-20 2:01 ` Ming Lei
2016-09-20 4:05 ` Yisheng Xie
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).