some kernel exceptions

some kernel exceptions

[Yxian.Yao]

[-- Attachment #1.1: Type: text/plain, Size: 3649 bytes --]



Hi，


Install the debian11.0 operating system on the machine.，the system can start normally.
But the system is abnormal after using this kernel,linux-5.4.133-ipipe-6-xenomai-3.1.1-20221216 (linux-5.4.133, ipipe-core-5.4.133-x86-6.patch, xenomai 3.1.1), 
See the attachment for output information during kernel startup, and the kernel outputs some exception messages, as follows.

Please give me some hints!

Thanks a lot.


[    2.425873] ------------[ cut here ]------------
[    2.430270] kernel BUG at arch/x86/kernel/apic/apic.c:1659!
[    2.435593] invalid opcode: 0000 [#1] PREEMPT SMP NOPTI
[    2.440574] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.4.133-ipipe-6-xenomai-3.1.1-20221216 #1
[    2.448851] Hardware name: HP HP Z8 Fury G5 Workstation/88C1, BIOS U61 Ver. 79.01.87 09/22/2022
[    2.457129] I-pipe domain: Linux
[    2.460211] RIP: 0010:setup_local_APIC+0x2df/0x310
[    2.464775] Code: 00 0b 05 b8 66 5b 01 0f 85 f7 fe ff ff 85 d2 7f 3f 48 8b 05 43 36 e4 00 be 00 07 01 00 bf 50 03 00 00 ff 50 10 e9 f6 fe ff ff <0f> 0b 48 8b 4c 24 40 65 48 2b 0c 25 28 00 00 00 75 0a be 00 04 00
[    2.482628] RSP: 0000:ffffffff82003ea0 EFLAGS: 00010246
[    2.487606] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff889fffe00000
[    2.494401] RDX: 0000000000000000 RSI: 00000000fffffeff RDI: 0000000000000020
[    2.501196] RBP: ffffffff8253d2e0 R08: 0000000000000001 R09: ffffffff820dbc20
[    2.507989] R10: 0000000000000008 R11: 0000000000000000 R12: 00000000000000d0
[    2.514786] R13: 0000000000000000 R14: 000000005565f000 R15: 000000005b0ca000
[    2.521582] FS:  0000000000000000(0000) GS:ffff889fffe00000(0000) knlGS:0000000000000000
[    2.529285] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    2.534759] CR2: ffff88a07ffff000 CR3: 000000000400a001 CR4: 00000000000606b0
[    2.541553] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[    2.548348] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
[    2.555141] Call Trace:
[    2.557479]  ? __ipipe_do_IRQ+0x87/0xb0
[    2.561137]  ? __ipipe_do_sync_stage+0x12a/0x160
[    2.565537]  apic_intr_mode_init+0xb7/0xda
[    2.569441]  x86_late_time_init+0x12/0x17
[    2.573262]  start_kernel+0x42e/0x4e7
[    2.576757]  secondary_startup_64+0xa4/0xb0
[    2.580744] Modules linked in:
[    2.583659] ---[ end trace bd3da5ac6eb39a7b ]---
[    2.588058] RIP: 0010:setup_local_APIC+0x2df/0x310
[    2.592622] Code: 00 0b 05 b8 66 5b 01 0f 85 f7 fe ff ff 85 d2 7f 3f 48 8b 05 43 36 e4 00 be 00 07 01 00 bf 50 03 00 00 ff 50 10 e9 f6 fe ff ff <0f> 0b 48 8b 4c 24 40 65 48 2b 0c 25 28 00 00 00 75 0a be 00 04 00
[    2.610482] RSP: 0000:ffffffff82003ea0 EFLAGS: 00010246
[    2.615460] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff889fffe00000
[    2.622252] RDX: 0000000000000000 RSI: 00000000fffffeff RDI: 0000000000000020
[    2.629048] RBP: ffffffff8253d2e0 R08: 0000000000000001 R09: ffffffff820dbc20
[    2.635841] R10: 0000000000000008 R11: 0000000000000000 R12: 00000000000000d0
[    2.642637] R13: 0000000000000000 R14: 000000005565f000 R15: 000000005b0ca000
[    2.649430] FS:  0000000000000000(0000) GS:ffff889fffe00000(0000) knlGS:0000000000000000
[    2.657135] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    2.662608] CR2: ffff88a07ffff000 CR3: 000000000400a001 CR4: 00000000000606b0
[    2.669403] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[    2.676198] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
[    2.682993] Kernel panic - not syncing: Attempted to kill the idle task!
[    2.689396] Rebooting in 1 seconds..
[    3.648759] ACPI MEMORY or I/O RESET_REG.

[-- Attachment #1.2: Type: text/html, Size: 6085 bytes --]

[-- Attachment #2: debian11_invalid opcode.txt --]
[-- Type: text/plain, Size: 31997 bytes --]

PROGRESS CODE: V01020004 I0
PROGRESS CODE: V01021000 I0
PROGRESS CODE: V01020003 I0
PROGRESS CODE: V01020001 I0
PROGRESS CODE: V01020006 I0
PROGRESS CODE: V02010000 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010000 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010000 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010000 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010000 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010000 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010000 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010000 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010000 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010000 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010000 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02010004 I0
PROGRESS CODE: V02020000 I0
PROGRESS CODE: VF0F03000 I0
PROGRESS CODE: VF0F04000 I0
PROGRESS CODE: VF0F03000 I0
PROGRESS CODE: VF0F04000 I0
PROGRESS CODE: VF0F08517 I0
PROGRESS CODE: VF0F08607 I0
PROGRESS CODE: VF0F09607 I0
PROGRESS CODE: VF0F08504 I0
PROGRESS CODE: VF0F09504 I0
PROGRESS CODE: VF0F08604 I0
PROGRESS CODE: VF0F09604 I0
PROGRESS CODE: VF0F08509 I0
PROGRESS CODE: VF0F09509 I0
PROGRESS CODE: VF0F070B4 I0
PROGRESS CODE: VF0F070B9 I0
PROGRESS CODE: V03008000 I0
PROGRESS CODE: V03001002 I0
PROGRESS CODE: V03051001 I0
PROGRESS CODE: V03058000 I0
PROGRESS CODE: V03058001 I0
PROGRESS CODE: VF0F08513 I0
PROGRESS CODE: VF0F09513 I0
PROGRESS CODE: V03101019 I0
[    0.000000] Linux version 5.4.133-ipipe-6-xenomai-3.1.1-20221216 (root@debian) (gcc version 10.2.1 20210110 (Debian 10.2.1-6)) #1 SMP PREEMPT Fri Dec 16 09:48:06 EST 2022
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.4.133-ipipe-6-xenomai-3.1.1-20221216 root=UUID=67ce258c-ca4b-4f9e-ae59-36d2212d366d ro xenomai.supported_cpus=0xf idle=halt nosmap nmi_watchdog=panic console=ttyS0,115200n8 panic=1
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x020: 'AVX-512 opmask'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x040: 'AVX-512 Hi256'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x080: 'AVX-512 ZMM_Hi256'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x200: 'Protection Keys User registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: xstate_offset[5]:  832, xstate_sizes[5]:   64
[    0.000000] x86/fpu: xstate_offset[6]:  896, xstate_sizes[6]:  512
[    0.000000] x86/fpu: xstate_offset[7]: 1408, xstate_sizes[7]: 1024
[    0.000000] x86/fpu: xstate_offset[9]: 2432, xstate_sizes[9]:    8
[    0.000000] x86/fpu: Enabled xstate features 0x2e7, context size is 2440 bytes, using 'compacted' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009efff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009f000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000069768fff] usable
[    0.000000] BIOS-e820: [mem 0x0000000069769000-0x0000000069868fff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000069869000-0x00000000699dffff] type 20
[    0.000000] BIOS-e820: [mem 0x00000000699e0000-0x000000006c352fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000006c353000-0x000000006f62cfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000006f62d000-0x000000006f7fefff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000006f7ff000-0x000000006f7fffff] usable
[    0.000000] BIOS-e820: [mem 0x000000006f800000-0x000000008fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fe010000-0x00000000fe010fff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000207fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] efi: EFI v2.70 by HP
[    0.000000] efi:  ACPI=0x6f7fe000  ACPI 2.0=0x6f7fe014  SMBIOS=0x697d3000  SMBIOS 3.0=0x697d1000  TPMFinalLog=0x6f5a9000  ESRT=0x697bc218  MEMATTR=0x62a4e018 
[    0.000000] SMBIOS 3.2.0 present.
[    0.000000] DMI: HP HP Z8 Fury G5 Workstation/88C1, BIOS U61 Ver. 79.01.87 09/22/2022
[    0.000000] tsc: Detected 2500.000 MHz processor
[    0.000034] last_pfn = 0x2080000 max_arch_pfn = 0x400000000
[    0.000451] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.001181] last_pfn = 0x6f800 max_arch_pfn = 0x400000000
[    0.007736] esrt: Reserving ESRT space from 0x00000000697bc218 to 0x00000000697bc250.
[    0.007796] check: Scanning 1 areas for low memory corruption
[    0.007813] Using GB pages for direct mapping
[    0.007969] Secure boot could not be determined
[    0.007970] RAMDISK: [mem 0x35399000-0x369c3fff]
[    0.007972] ACPI: Early table checksum verification disabled
[    0.007974] ACPI: RSDP 0x000000006F7FE014 000024 (v02 HPQOEM)
[    0.007977] ACPI: XSDT 0x000000006F769188 000154 (v01 HPQOEM SLIC-WKS 00000000 INTL 01000013)
[    0.007982] ACPI: FACP 0x000000006F7EE000 000114 (v06 HPQOEM SLIC-WKS 00000000 HP   00000001)
[    0.007985] ACPI: DSDT 0x000000006F76D000 07AD68 (v02 HPQOEM 88C1     00000003 INTL 20091013)
[    0.007988] ACPI: FACS 0x000000006F57F000 000040
[    0.007990] ACPI: SSDT 0x000000006F7FC000 00013E (v02 HP     ShmTable 00000001 INTL 20200717)
[    0.007993] ACPI: SSDT 0x000000006F7F9000 0029AE (v01 HPQOEM Plat_Wmi 00000001 INTL 20200717)
[    0.007995] ACPI: SSDT 0x000000006F7F8000 0006FE (v02 INTEL  RAS_ACPI 00000001 INTL 20200717)
[    0.007997] ACPI: OEMJ 0x000000006F7F7000 00003D (v01 HPQOEM 88C1     00000002 INTL 01000013)
[    0.008000] ACPI: SSDT 0x000000006F7F6000 00076E (v02 INTEL  ADDRXLAT 00000001 INTL 20200717)
[    0.008002] ACPI: SSDT 0x000000006F7F5000 0004AC (v02 Intel  UcsiAcpi 00001000 INTL 20200717)
[    0.008004] ACPI: OEML 0x000000006F7F4000 000028 (v03 HPQOEM 88C1     00000002 INTL 01000013)
[    0.008006] ACPI: SSDT 0x000000006F7F3000 00061F (v02 HPQOEM Tpm2Tabl 00001000 INTL 20200717)
[    0.008009] ACPI: TPM2 0x000000006F7F2000 00004C (v04 HPQOEM 88C1     00000002 INTL 01000013)
[    0.008011] ACPI: BERT 0x000000006F7F1000 000030 (v01 HPQOEM 88C1     00000001 INTL 00000001)
[    0.008013] ACPI: ERST 0x000000006F7F0000 000230 (v01 HPQOEM 88C1     00000001 INTL 00000001)
[    0.008015] ACPI: BDAT 0x000000006F7EF000 000030 (v01 HPQOEM 88C1     00000000 HP   00000001)
[    0.008017] ACPI: MSDM 0x000000006F7ED000 000055 (v03 HPQOEM SLIC-WKS 00000000 HP   00000001)
[    0.008019] ACPI: WSMT 0x000000006F7EC000 000028 (v01 HPQOEM 88C1     00000001 HP   00000001)
[    0.008022] ACPI: HPET 0x000000006F7EB000 000038 (v01 HPQOEM 88C1     00000001 HP   00000001)
[    0.008024] ACPI: MCFG 0x000000006F7EA000 00003C (v01 HPQOEM 88C1     00000001 HP   00000001)
[    0.008026] ACPI: MSCT 0x000000006F7E9000 00004E (v01 HPQOEM 88C1     00000001 HP   00000001)
[    0.008028] ACPI: WDDT 0x000000006F7E8000 000040 (v01 HPQOEM 88C1     00000000 HP   00000001)
[    0.008030] ACPI: APIC 0x000000006F76C000 00035E (v04 HPQOEM 88C1     00000000 INTL 20091013)
[    0.008032] ACPI: SRAT 0x000000006F76A000 001E30 (v03 HPQOEM 88C1     00000002 INTL 01000013)
[    0.008035] ACPI: SLIT 0x000000006F7FD000 00002D (v01 HPQOEM 88C1     00000002 INTL 01000013)
[    0.008037] ACPI: HMAT 0x000000006F768000 0000F8 (v02 HPQOEM 88C1     00000002 INTL 01000013)
[    0.008039] ACPI: OEM4 0x000000006F706000 061ED1 (v02 INTEL  CPU  CST 00003000 INTL 20200717)
[    0.008041] ACPI: OEM1 0x000000006F6C1000 044379 (v02 INTEL  CPU EIST 00003000 INTL 20200717)
[    0.008043] ACPI: OEM2 0x000000006F6AF000 011831 (v02 INTEL  CPU  HWP 00003000 INTL 20200717)
[    0.008046] ACPI: SSDT 0x000000006F694000 01A65E (v02 HPQOEM SSDT  PM 00004000 INTL 20200717)
[    0.008048] ACPI: SSDT 0x000000006F692000 001523 (v02 HPQOEM 88C1     00000000 INTL 20091013)
[    0.008050] ACPI: DBG2 0x000000006F691000 00005C (v00 HPQOEM 88C1     00000002 INTL 01000013)
[    0.008052] ACPI: HEST 0x000000006F690000 00013C (v01 HPQOEM 88C1     00000001 INTL 00000001)
[    0.008054] ACPI: DMAR 0x000000006F68F000 000358 (v01 HPQOEM 88C1     00000001 HP   00000001)
[    0.008057] ACPI: FPDT 0x000000006F68E000 000044 (v01 HPQOEM 88C1     00000002 INTL 01000013)
[    0.008059] ACPI: SSDT 0x000000006F68D000 000024 (v01 HP     HPSANIMD 00001000 INTL 20200717)
[    0.008061] ACPI: SSDT 0x000000006F68C000 000075 (v02 HP     HPCAHWID 00001000 INTL 20200717)
[    0.008063] ACPI: SSDT 0x000000006F68B000 00004B (v01 HP     CAPAHWID 00001000 INTL 20200717)
[    0.008066] ACPI: UEFI 0x000000006CD7E000 00005C (v01 INTEL  RstSataV 00000000      00000000)
[    0.008068] ACPI: BGRT 0x000000006F689000 000038 (v01 HPQOEM 88C1     00000002 INTL 01000013)
[    0.008070] ACPI: ASF! 0x000000006F68A000 000074 (v32 HPQOEM 88C1     00000002 INTL 01000013)
[    0.008072] ACPI: Reserving FACP table memory at [mem 0x6f7ee000-0x6f7ee113]
[    0.008074] ACPI: Reserving DSDT table memory at [mem 0x6f76d000-0x6f7e7d67]
[    0.008075] ACPI: Reserving FACS table memory at [mem 0x6f57f000-0x6f57f03f]
[    0.008076] ACPI: Reserving SSDT table memory at [mem 0x6f7fc000-0x6f7fc13d]
[    0.008077] ACPI: Reserving SSDT table memory at [mem 0x6f7f9000-0x6f7fb9ad]
[    0.008078] ACPI: Reserving SSDT table memory at [mem 0x6f7f8000-0x6f7f86fd]
[    0.008079] ACPI: Reserving OEMJ table memory at [mem 0x6f7f7000-0x6f7f703c]
[    0.008080] ACPI: Reserving SSDT table memory at [mem 0x6f7f6000-0x6f7f676d]
[    0.008081] ACPI: Reserving SSDT table memory at [mem 0x6f7f5000-0x6f7f54ab]
[    0.008082] ACPI: Reserving OEML table memory at [mem 0x6f7f4000-0x6f7f4027]
[    0.008083] ACPI: Reserving SSDT table memory at [mem 0x6f7f3000-0x6f7f361e]
[    0.008084] ACPI: Reserving TPM2 table memory at [mem 0x6f7f2000-0x6f7f204b]
[    0.008085] ACPI: Reserving BERT table memory at [mem 0x6f7f1000-0x6f7f102f]
[    0.008086] ACPI: Reserving ERST table memory at [mem 0x6f7f0000-0x6f7f022f]
[    0.008087] ACPI: Reserving BDAT table memory at [mem 0x6f7ef000-0x6f7ef02f]
[    0.008088] ACPI: Reserving MSDM table memory at [mem 0x6f7ed000-0x6f7ed054]
[    0.008089] ACPI: Reserving WSMT table memory at [mem 0x6f7ec000-0x6f7ec027]
[    0.008091] ACPI: Reserving HPET table memory at [mem 0x6f7eb000-0x6f7eb037]
[    0.008092] ACPI: Reserving MCFG table memory at [mem 0x6f7ea000-0x6f7ea03b]
[    0.008093] ACPI: Reserving MSCT table memory at [mem 0x6f7e9000-0x6f7e904d]
[    0.008094] ACPI: Reserving WDDT table memory at [mem 0x6f7e8000-0x6f7e803f]
[    0.008095] ACPI: Reserving APIC table memory at [mem 0x6f76c000-0x6f76c35d]
[    0.008096] ACPI: Reserving SRAT table memory at [mem 0x6f76a000-0x6f76be2f]
[    0.008097] ACPI: Reserving SLIT table memory at [mem 0x6f7fd000-0x6f7fd02c]
[    0.008098] ACPI: Reserving HMAT table memory at [mem 0x6f768000-0x6f7680f7]
[    0.008099] ACPI: Reserving OEM4 table memory at [mem 0x6f706000-0x6f767ed0]
[    0.008100] ACPI: Reserving OEM1 table memory at [mem 0x6f6c1000-0x6f705378]
[    0.008101] ACPI: Reserving OEM2 table memory at [mem 0x6f6af000-0x6f6c0830]
[    0.008102] ACPI: Reserving SSDT table memory at [mem 0x6f694000-0x6f6ae65d]
[    0.008103] ACPI: Reserving SSDT table memory at [mem 0x6f692000-0x6f693522]
[    0.008104] ACPI: Reserving DBG2 table memory at [mem 0x6f691000-0x6f69105b]
[    0.008105] ACPI: Reserving HEST table memory at [mem 0x6f690000-0x6f69013b]
[    0.008107] ACPI: Reserving DMAR table memory at [mem 0x6f68f000-0x6f68f357]
[    0.008108] ACPI: Reserving FPDT table memory at [mem 0x6f68e000-0x6f68e043]
[    0.008109] ACPI: Reserving SSDT table memory at [mem 0x6f68d000-0x6f68d023]
[    0.008110] ACPI: Reserving SSDT table memory at [mem 0x6f68c000-0x6f68c074]
[    0.008111] ACPI: Reserving SSDT table memory at [mem 0x6f68b000-0x6f68b04a]
[    0.008112] ACPI: Reserving UEFI table memory at [mem 0x6cd7e000-0x6cd7e05b]
[    0.008113] ACPI: Reserving BGRT table memory at [mem 0x6f689000-0x6f689037]
[    0.008114] ACPI: Reserving ASF! table memory at [mem 0x6f68a000-0x6f68a073]
[    0.008144] SRAT: PXM 0 -> APIC 0x0000 -> Node 0
[    0.008146] SRAT: PXM 0 -> APIC 0x0001 -> Node 0
[    0.008146] SRAT: PXM 0 -> APIC 0x0002 -> Node 0
[    0.008147] SRAT: PXM 0 -> APIC 0x0003 -> Node 0
[    0.008148] SRAT: PXM 0 -> APIC 0x0004 -> Node 0
[    0.008149] SRAT: PXM 0 -> APIC 0x0005 -> Node 0
[    0.008150] SRAT: PXM 0 -> APIC 0x0006 -> Node 0
[    0.008151] SRAT: PXM 0 -> APIC 0x0007 -> Node 0
[    0.008152] SRAT: PXM 0 -> APIC 0x0008 -> Node 0
[    0.008153] SRAT: PXM 0 -> APIC 0x0009 -> Node 0
[    0.008153] SRAT: PXM 0 -> APIC 0x000a -> Node 0
[    0.008154] SRAT: PXM 0 -> APIC 0x000b -> Node 0
[    0.008155] SRAT: PXM 0 -> APIC 0x000c -> Node 0
[    0.008156] SRAT: PXM 0 -> APIC 0x000d -> Node 0
[    0.008157] SRAT: PXM 0 -> APIC 0x000e -> Node 0
[    0.008158] SRAT: PXM 0 -> APIC 0x000f -> Node 0
[    0.008159] SRAT: PXM 0 -> APIC 0x0010 -> Node 0
[    0.008160] SRAT: PXM 0 -> APIC 0x0011 -> Node 0
[    0.008160] SRAT: PXM 0 -> APIC 0x0012 -> Node 0
[    0.008161] SRAT: PXM 0 -> APIC 0x0013 -> Node 0
[    0.008162] SRAT: PXM 0 -> APIC 0x0014 -> Node 0
[    0.008163] SRAT: PXM 0 -> APIC 0x0015 -> Node 0
[    0.008164] SRAT: PXM 0 -> APIC 0x0016 -> Node 0
[    0.008165] SRAT: PXM 0 -> APIC 0x0017 -> Node 0
[    0.008166] SRAT: PXM 0 -> APIC 0x0018 -> Node 0
[    0.008166] SRAT: PXM 0 -> APIC 0x0019 -> Node 0
[    0.008167] SRAT: PXM 0 -> APIC 0x001a -> Node 0
[    0.008168] SRAT: PXM 0 -> APIC 0x001b -> Node 0
[    0.008169] SRAT: PXM 0 -> APIC 0x001c -> Node 0
[    0.008170] SRAT: PXM 0 -> APIC 0x001d -> Node 0
[    0.008171] SRAT: PXM 0 -> APIC 0x001e -> Node 0
[    0.008172] SRAT: PXM 0 -> APIC 0x001f -> Node 0
[    0.008172] SRAT: PXM 0 -> APIC 0x0020 -> Node 0
[    0.008173] SRAT: PXM 0 -> APIC 0x0021 -> Node 0
[    0.008174] SRAT: PXM 0 -> APIC 0x0022 -> Node 0
[    0.008175] SRAT: PXM 0 -> APIC 0x0023 -> Node 0
[    0.008176] SRAT: PXM 0 -> APIC 0x0024 -> Node 0
[    0.008177] SRAT: PXM 0 -> APIC 0x0025 -> Node 0
[    0.008178] SRAT: PXM 0 -> APIC 0x0026 -> Node 0
[    0.008178] SRAT: PXM 0 -> APIC 0x0027 -> Node 0
[    0.008179] SRAT: PXM 0 -> APIC 0x0028 -> Node 0
[    0.008180] SRAT: PXM 0 -> APIC 0x0029 -> Node 0
[    0.008181] SRAT: PXM 0 -> APIC 0x002a -> Node 0
[    0.008182] SRAT: PXM 0 -> APIC 0x002b -> Node 0
[    0.008183] SRAT: PXM 0 -> APIC 0x002c -> Node 0
[    0.008184] SRAT: PXM 0 -> APIC 0x002d -> Node 0
[    0.008184] SRAT: PXM 0 -> APIC 0x002e -> Node 0
[    0.008185] SRAT: PXM 0 -> APIC 0x002f -> Node 0
[    0.008189] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[    0.008191] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x207fffffff]
[    0.008196] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x207fffffff] -> [mem 0x00000000-0x207fffffff]
[    0.008200] NODE_DATA(0) allocated [mem 0x207fff9000-0x207fffcfff]
[    0.008271] Zone ranges:
[    0.008272]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.008274]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.008275]   Normal   [mem 0x0000000100000000-0x000000207fffffff]
[    0.008276] Movable zone start for each node
[    0.008277] Early memory node ranges
[    0.008278]   node   0: [mem 0x0000000000001000-0x000000000009efff]
[    0.008280]   node   0: [mem 0x0000000000100000-0x0000000069768fff]
[    0.008281]   node   0: [mem 0x000000006f7ff000-0x000000006f7fffff]
[    0.008282]   node   0: [mem 0x0000000100000000-0x000000207fffffff]
[    0.008429] Zeroed struct page in unavailable ranges: 26872 pages
[    0.008430] Initmem setup node 0 [mem 0x0000000000001000-0x000000207fffffff]
[    0.214728] ACPI: PM-Timer IO Port: 0x508
[    0.214733] ACPI: x2apic entry ignored
[    0.214734] ACPI: x2apic entry ignored
[    0.214734] ACPI: x2apic entry ignored
[    0.214735] ACPI: x2apic entry ignored
[    0.214736] ACPI: x2apic entry ignored
[    0.214737] ACPI: x2apic entry ignored
[    0.214737] ACPI: x2apic entry ignored
[    0.214738] ACPI: x2apic entry ignored
[    0.214739] ACPI: x2apic entry ignored
[    0.214739] ACPI: x2apic entry ignored
[    0.214740] ACPI: x2apic entry ignored
[    0.214741] ACPI: x2apic entry ignored
[    0.214742] ACPI: x2apic entry ignored
[    0.214742] ACPI: x2apic entry ignored
[    0.214743] ACPI: x2apic entry ignored
[    0.214744] ACPI: x2apic entry ignored
[    0.214745] ACPI: x2apic entry ignored
[    0.214745] ACPI: x2apic entry ignored
[    0.214746] ACPI: x2apic entry ignored
[    0.214747] ACPI: x2apic entry ignored
[    0.214748] ACPI: x2apic entry ignored
[    0.214748] ACPI: x2apic entry ignored
[    0.214749] ACPI: x2apic entry ignored
[    0.214750] ACPI: x2apic entry ignored
[    0.214751] ACPI: x2apic entry ignored
[    0.214751] ACPI: x2apic entry ignored
[    0.214752] ACPI: x2apic entry ignored
[    0.214753] ACPI: x2apic entry ignored
[    0.214753] ACPI: x2apic entry ignored
[    0.214754] ACPI: x2apic entry ignored
[    0.214755] ACPI: x2apic entry ignored
[    0.214756] ACPI: x2apic entry ignored
[    0.214756] ACPI: x2apic entry ignored
[    0.214757] ACPI: x2apic entry ignored
[    0.214758] ACPI: x2apic entry ignored
[    0.214759] ACPI: x2apic entry ignored
[    0.214759] ACPI: x2apic entry ignored
[    0.214760] ACPI: x2apic entry ignored
[    0.214761] ACPI: x2apic entry ignored
[    0.214762] ACPI: x2apic entry ignored
[    0.214762] ACPI: x2apic entry ignored
[    0.214763] ACPI: x2apic entry ignored
[    0.214764] ACPI: x2apic entry ignored
[    0.214765] ACPI: x2apic entry ignored
[    0.214765] ACPI: x2apic entry ignored
[    0.214766] ACPI: x2apic entry ignored
[    0.214767] ACPI: x2apic entry ignored
[    0.214767] ACPI: x2apic entry ignored
[    0.214770] ACPI: X2APIC_NMI (uid[0xffffffff] high edge lint[0x1])
[    0.214771] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.214809] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[    0.214811] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.214813] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.214817] Using ACPI (MADT) for SMP configuration information
[    0.214818] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.214821] TSC deadline timer available
[    0.214840] smpboot: Boot CPU (id 255) not listed by BIOS
[    0.214842] smpboot: Allowing 1 CPUs, 0 hotplug CPUs
[    0.214853] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.214855] PM: Registered nosave memory: [mem 0x0009f000-0x000fffff]
[    0.214856] PM: Registered nosave memory: [mem 0x69769000-0x69868fff]
[    0.214857] PM: Registered nosave memory: [mem 0x69869000-0x699dffff]
[    0.214858] PM: Registered nosave memory: [mem 0x699e0000-0x6c352fff]
[    0.214859] PM: Registered nosave memory: [mem 0x6c353000-0x6f62cfff]
[    0.214860] PM: Registered nosave memory: [mem 0x6f62d000-0x6f7fefff]
[    0.214861] PM: Registered nosave memory: [mem 0x6f800000-0x8fffffff]
[    0.214862] PM: Registered nosave memory: [mem 0x90000000-0xfe00ffff]
[    0.214863] PM: Registered nosave memory: [mem 0xfe010000-0xfe010fff]
[    0.214864] PM: Registered nosave memory: [mem 0xfe011000-0xffffffff]
[    0.214866] [mem 0x90000000-0xfe00ffff] available for PCI devices
[    0.214882] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.284534] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:1 nr_node_ids:1
[    0.284746] percpu: Embedded 187 pages/cpu s728728 r8192 d29032 u2097152
[    0.284765] Built 1 zonelists, mobility grouping on.  Total pages: 32939149
[    0.284767] Policy zone: Normal
[    0.284768] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.4.133-ipipe-6-xenomai-3.1.1-20221216 root=UUID=67ce258c-ca4b-4f9e-ae59-36d2212d366d ro xenomai.supported_cpus=0xf idle=halt nosmap nmi_watchdog=panic console=ttyS0,115200n8 panic=1
[    0.289671] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes, linear)
[    0.292107] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes, linear)
[    0.292272] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.506580] Memory: 131287560K/133848096K available (10244K kernel code, 901K rwdata, 2920K rodata, 1984K init, 8336K bss, 2560536K reserved, 0K cma-reserved)
[    0.506591] random: get_random_u32 called from cache_grow_begin+0x26d/0x7f0 with crng_init=0
[    0.506698] rcu: Preemptible hierarchical RCU implementation.
[    0.506699] rcu:     RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=1.
[    0.506701]  Tasks RCU enabled.
[    0.506702] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.506703] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=1
[    0.506836] NR_IRQS: 33024, nr_irqs: 256, preallocated irqs: 16
[    0.508146] Interrupt pipeline (release #6)
[    0.508270] Console: colour dummy device 80x25
[    2.141068] printk: console [ttyS0] enabled
[    2.145066] ACPI: Core revision 20190816
[    2.149592] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 79635855245 ns
[    2.158270] APIC: Switch to symmetric I/O mode setup
[    2.163011] DMAR: Host address width 52
[    2.166665] DMAR: DRHD base: 0x0000009cbfc000 flags: 0x0
[    2.171729] DMAR: dmar0: reg_base_addr 9cbfc000 ver 6:0 cap 19ed008c40780c66 ecap 3ef9e86f050df
[    2.180002] DMAR: DRHD base: 0x000000a7ffc000 flags: 0x0
[    2.185066] DMAR: dmar1: reg_base_addr a7ffc000 ver 6:0 cap 19ed008c40780c66 ecap 3ef9e86f050df
[    2.193345] DMAR: DRHD base: 0x000000b33fc000 flags: 0x0
[    2.198408] DMAR: dmar2: reg_base_addr b33fc000 ver 6:0 cap 19ed008c40780c66 ecap 3ef9e86f050df
[    2.206687] DMAR: DRHD base: 0x000000bbffc000 flags: 0x0
[    2.211752] DMAR: dmar3: reg_base_addr bbffc000 ver 6:0 cap 19ed008c40780c66 ecap 3ef9e86f050df
[    2.220030] DMAR: DRHD base: 0x000000c4bfc000 flags: 0x0
[    2.225093] DMAR: dmar4: reg_base_addr c4bfc000 ver 6:0 cap 19ed008c40780c66 ecap 3ef9e86f050df
[    2.233374] DMAR: DRHD base: 0x000000cd7fc000 flags: 0x0
[    2.238436] DMAR: dmar5: reg_base_addr cd7fc000 ver 6:0 cap 19ed008c40780c66 ecap 3ef9e86f050df
[    2.246715] DMAR: DRHD base: 0x000000dd7fc000 flags: 0x0
[    2.251777] DMAR: dmar6: reg_base_addr dd7fc000 ver 6:0 cap 19ed008c40780c66 ecap 3ef9e86f050df
[    2.260054] DMAR: DRHD base: 0x000000ddffc000 flags: 0x0
[    2.265115] DMAR: dmar7: reg_base_addr ddffc000 ver 6:0 cap 19ed008c40780c66 ecap 3ef9ea6f050df
[    2.273395] DMAR: DRHD base: 0x000000de7fc000 flags: 0x0
[    2.278457] DMAR: dmar8: reg_base_addr de7fc000 ver 6:0 cap 19ed008c40780c66 ecap 3ef9ea6f050df
[    2.286734] DMAR: DRHD base: 0x000000deffc000 flags: 0x0
[    2.291796] DMAR: dmar9: reg_base_addr deffc000 ver 6:0 cap 19ed008c40780c66 ecap 3ef9ea6f050df
[    2.300073] DMAR: DRHD base: 0x000000df7fc000 flags: 0x0
[    2.305135] DMAR: dmar10: reg_base_addr df7fc000 ver 6:0 cap 19ed008c40780c66 ecap 3ef9ea6f050df
[    2.313495] DMAR: DRHD base: 0x00000092ffc000 flags: 0x1
[    2.318560] DMAR: dmar11: reg_base_addr 92ffc000 ver 6:0 cap 19ed008c40780c66 ecap 3ef9e86f050df
[    2.326918] DMAR: RMRR base: 0x0000006a258000 end: 0x0000006a25afff
[    2.332886] DMAR: ATSR flags: 0x0
[    2.336046] DMAR: RHSA base: 0x00000092ffc000 proximity domain: 0x0
[    2.342013] DMAR: RHSA base: 0x0000009cbfc000 proximity domain: 0x0
[    2.347984] DMAR: RHSA base: 0x000000a7ffc000 proximity domain: 0x0
[    2.353951] DMAR: RHSA base: 0x000000b33fc000 proximity domain: 0x0
[    2.359920] DMAR: RHSA base: 0x000000bbffc000 proximity domain: 0x0
[    2.365888] DMAR: RHSA base: 0x000000c4bfc000 proximity domain: 0x0
[    2.371859] DMAR: RHSA base: 0x000000cd7fc000 proximity domain: 0x0
[    2.377826] DMAR: RHSA base: 0x000000dd7fc000 proximity domain: 0x0
[    2.383796] DMAR: RHSA base: 0x000000ddffc000 proximity domain: 0x0
[    2.389765] DMAR: RHSA base: 0x000000de7fc000 proximity domain: 0x0
[    2.395731] DMAR: RHSA base: 0x000000deffc000 proximity domain: 0x0
[    2.401701] DMAR: RHSA base: 0x000000df7fc000 proximity domain: 0x0
[    2.407670] DMAR-IR: IOAPIC id 8 under DRHD base  0x92ffc000 IOMMU 11
[    2.413803] DMAR-IR: HPET id 0 under DRHD base 0x92ffc000
[    2.420755] DMAR-IR: Enabled IRQ remapping in xapic mode
[    2.425873] ------------[ cut here ]------------
[    2.430270] kernel BUG at arch/x86/kernel/apic/apic.c:1659!
[    2.435593] invalid opcode: 0000 [#1] PREEMPT SMP NOPTI
[    2.440574] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.4.133-ipipe-6-xenomai-3.1.1-20221216 #1
[    2.448851] Hardware name: HP HP Z8 Fury G5 Workstation/88C1, BIOS U61 Ver. 79.01.87 09/22/2022
[    2.457129] I-pipe domain: Linux
[    2.460211] RIP: 0010:setup_local_APIC+0x2df/0x310
[    2.464775] Code: 00 0b 05 b8 66 5b 01 0f 85 f7 fe ff ff 85 d2 7f 3f 48 8b 05 43 36 e4 00 be 00 07 01 00 bf 50 03 00 00 ff 50 10 e9 f6 fe ff ff <0f> 0b 48 8b 4c 24 40 65 48 2b 0c 25 28 00 00 00 75 0a be 00 04 00
[    2.482628] RSP: 0000:ffffffff82003ea0 EFLAGS: 00010246
[    2.487606] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff889fffe00000
[    2.494401] RDX: 0000000000000000 RSI: 00000000fffffeff RDI: 0000000000000020
[    2.501196] RBP: ffffffff8253d2e0 R08: 0000000000000001 R09: ffffffff820dbc20
[    2.507989] R10: 0000000000000008 R11: 0000000000000000 R12: 00000000000000d0
[    2.514786] R13: 0000000000000000 R14: 000000005565f000 R15: 000000005b0ca000
[    2.521582] FS:  0000000000000000(0000) GS:ffff889fffe00000(0000) knlGS:0000000000000000
[    2.529285] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    2.534759] CR2: ffff88a07ffff000 CR3: 000000000400a001 CR4: 00000000000606b0
[    2.541553] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[    2.548348] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
[    2.555141] Call Trace:
[    2.557479]  ? __ipipe_do_IRQ+0x87/0xb0
[    2.561137]  ? __ipipe_do_sync_stage+0x12a/0x160
[    2.565537]  apic_intr_mode_init+0xb7/0xda
[    2.569441]  x86_late_time_init+0x12/0x17
[    2.573262]  start_kernel+0x42e/0x4e7
[    2.576757]  secondary_startup_64+0xa4/0xb0
[    2.580744] Modules linked in:
[    2.583659] ---[ end trace bd3da5ac6eb39a7b ]---
[    2.588058] RIP: 0010:setup_local_APIC+0x2df/0x310
[    2.592622] Code: 00 0b 05 b8 66 5b 01 0f 85 f7 fe ff ff 85 d2 7f 3f 48 8b 05 43 36 e4 00 be 00 07 01 00 bf 50 03 00 00 ff 50 10 e9 f6 fe ff ff <0f> 0b 48 8b 4c 24 40 65 48 2b 0c 25 28 00 00 00 75 0a be 00 04 00
[    2.610482] RSP: 0000:ffffffff82003ea0 EFLAGS: 00010246
[    2.615460] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff889fffe00000
[    2.622252] RDX: 0000000000000000 RSI: 00000000fffffeff RDI: 0000000000000020
[    2.629048] RBP: ffffffff8253d2e0 R08: 0000000000000001 R09: ffffffff820dbc20
[    2.635841] R10: 0000000000000008 R11: 0000000000000000 R12: 00000000000000d0
[    2.642637] R13: 0000000000000000 R14: 000000005565f000 R15: 000000005b0ca000
[    2.649430] FS:  0000000000000000(0000) GS:ffff889fffe00000(0000) knlGS:0000000000000000
[    2.657135] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    2.662608] CR2: ffff88a07ffff000 CR3: 000000000400a001 CR4: 00000000000606b0
[    2.669403] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[    2.676198] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
[    2.682993] Kernel panic - not syncing: Attempted to kill the idle task!
[    2.689396] Rebooting in 1 seconds..
[    3.648759] ACPI MEMORY or I/O RESET_REG.

Re: some kernel exceptions

[Florian Bezdeka]

Hi,

On Mon, 2022-12-26 at 15:37 +0800, Yxian.Yao wrote:
> 
> Hi，
> 
> Install the debian11.0 operating system on the machine.，the system
> can start normally.
> But the system is abnormal after using this kernel,linux-5.4.133-
> ipipe-6-xenomai-3.1.1-20221216 (linux-5.4.133, ipipe-core-5.4.133-
> x86-6.patch, xenomai 3.1.1), 
> See the attachment for output information during kernel startup, and
> the kernel outputs some exception messages, as follows.

Linux is failing while trying to initialize the IRQ controler (APIC) of
your application processors (APs) (= non boot CPUs). There seems to be
a mismatch regarding LAPIC IDs.

Such IDs are normally extracted from the APIC ACPI table. Something
seems to go wrong there (taken from your attachment):

[    0.214734] ACPI: x2apic entry ignored

There are a lot of such lines. This makes me wonder if your ACPI tables
are set up properly (which might be a BIOS/Firmware issue). That's
nothing Xenomai/ipipe specific. Does a standard Linux 5.4 boot on that
machine?

[    0.214840] smpboot: Boot CPU (id 255) not listed by BIOS

That points into the same direction. Your boot CPU has a APIC ID of
255, I would expect 0.

[    0.284534] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:1 nr_node_ids:1

nr_cpu_ids: 1 is strage. According to the line below we are on a NUMA
system (with one node) and I would expect a higher number of CPUs on
that system. So something is hiding your cores. (At least there is no
maxcpus=1 on your kernel cmdline).

NUMA configuration:
[    0.008196] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x207fffffff] -> [mem 0x00000000-0x207fffffff]

Hope that helps,
Florian

> 
> Please give me some hints!
> 
> Thanks a lot.
> 
> [    2.425873] ------------[ cut here ]------------
> [    2.430270] kernel BUG at arch/x86/kernel/apic/apic.c:1659!
> [    2.435593] invalid opcode: 0000 [#1] PREEMPT SMP NOPTI
> [    2.440574] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.4.133-ipipe-6-xenomai-3.1.1-20221216 #1
> [    2.448851] Hardware name: HP HP Z8 Fury G5 Workstation/88C1, BIOS U61 Ver. 79.01.87 09/22/2022
> [    2.457129] I-pipe domain: Linux
> [    2.460211] RIP: 0010:setup_local_APIC+0x2df/0x310
> [    2.464775] Code: 00 0b 05 b8 66 5b 01 0f 85 f7 fe ff ff 85 d2 7f 3f 48 8b 05 43 36 e4 00 be 00 07 01 00 bf 50 03 00 00 ff 50 10 e9 f6 fe ff ff <0f> 0b 48 8b 4c 24 40 65 48 2b 0c 25 28 00 00 00 75 0a be 00 04 00
> [    2.482628] RSP: 0000:ffffffff82003ea0 EFLAGS: 00010246
> [    2.487606] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff889fffe00000
> [    2.494401] RDX: 0000000000000000 RSI: 00000000fffffeff RDI: 0000000000000020
> [    2.501196] RBP: ffffffff8253d2e0 R08: 0000000000000001 R09: ffffffff820dbc20
> [    2.507989] R10: 0000000000000008 R11: 0000000000000000 R12: 00000000000000d0
> [    2.514786] R13: 0000000000000000 R14: 000000005565f000 R15: 000000005b0ca000
> [    2.521582] FS:  0000000000000000(0000) GS:ffff889fffe00000(0000) knlGS:0000000000000000
> [    2.529285] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [    2.534759] CR2: ffff88a07ffff000 CR3: 000000000400a001 CR4: 00000000000606b0
> [    2.541553] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [    2.548348] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
> [    2.555141] Call Trace:
> [    2.557479]  ? __ipipe_do_IRQ+0x87/0xb0
> [    2.561137]  ? __ipipe_do_sync_stage+0x12a/0x160
> [    2.565537]  apic_intr_mode_init+0xb7/0xda
> [    2.569441]  x86_late_time_init+0x12/0x17
> [    2.573262]  start_kernel+0x42e/0x4e7
> [    2.576757]  secondary_startup_64+0xa4/0xb0
> [    2.580744] Modules linked in:
> [    2.583659] ---[ end trace bd3da5ac6eb39a7b ]---
> [    2.588058] RIP: 0010:setup_local_APIC+0x2df/0x310
> [    2.592622] Code: 00 0b 05 b8 66 5b 01 0f 85 f7 fe ff ff 85 d2 7f 3f 48 8b 05 43 36 e4 00 be 00 07 01 00 bf 50 03 00 00 ff 50 10 e9 f6 fe ff ff <0f> 0b 48 8b 4c 24 40 65 48 2b 0c 25 28 00 00 00 75 0a be 00 04 00
> [    2.610482] RSP: 0000:ffffffff82003ea0 EFLAGS: 00010246
> [    2.615460] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff889fffe00000
> [    2.622252] RDX: 0000000000000000 RSI: 00000000fffffeff RDI: 0000000000000020
> [    2.629048] RBP: ffffffff8253d2e0 R08: 0000000000000001 R09: ffffffff820dbc20
> [    2.635841] R10: 0000000000000008 R11: 0000000000000000 R12: 00000000000000d0
> [    2.642637] R13: 0000000000000000 R14: 000000005565f000 R15: 000000005b0ca000
> [    2.649430] FS:  0000000000000000(0000) GS:ffff889fffe00000(0000) knlGS:0000000000000000
> [    2.657135] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [    2.662608] CR2: ffff88a07ffff000 CR3: 000000000400a001 CR4: 00000000000606b0
> [    2.669403] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [    2.676198] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
> [    2.682993] Kernel panic - not syncing: Attempted to kill the idle task!
> [    2.689396] Rebooting in 1 seconds..
> [    3.648759] ACPI MEMORY or I/O RESET_REG.

Re: some kernel exceptions

[Bezdeka, Florian]

On Tue, 2022-12-27 at 10:36 +0100, Florian Bezdeka wrote:
> Hi,
> 
> On Mon, 2022-12-26 at 15:37 +0800, Yxian.Yao wrote:
> > 
> > Hi，
> > 
> > Install the debian11.0 operating system on the machine.，the system
> > can start normally.
> > But the system is abnormal after using this kernel,linux-5.4.133-
> > ipipe-6-xenomai-3.1.1-20221216 (linux-5.4.133, ipipe-core-5.4.133-
> > x86-6.patch, xenomai 3.1.1), 
> > See the attachment for output information during kernel startup, and
> > the kernel outputs some exception messages, as follows.
> 
> Linux is failing while trying to initialize the IRQ controler (APIC) of
> your application processors (APs) (= non boot CPUs). There seems to be
> a mismatch regarding LAPIC IDs.
> 
> Such IDs are normally extracted from the APIC ACPI table. Something
> seems to go wrong there (taken from your attachment):
> 
> [    0.214734] ACPI: x2apic entry ignored

CONFIG_X86_X2APIC is enabled in your kernel configuration?

> 
> There are a lot of such lines. This makes me wonder if your ACPI tables
> are set up properly (which might be a BIOS/Firmware issue). That's
> nothing Xenomai/ipipe specific. Does a standard Linux 5.4 boot on that
> machine?
> 
> [    0.214840] smpboot: Boot CPU (id 255) not listed by BIOS
> 
> That points into the same direction. Your boot CPU has a APIC ID of
> 255, I would expect 0.
> 
> [    0.284534] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:1 nr_node_ids:1
> 
> nr_cpu_ids: 1 is strage. According to the line below we are on a NUMA
> system (with one node) and I would expect a higher number of CPUs on
> that system. So something is hiding your cores. (At least there is no
> maxcpus=1 on your kernel cmdline).
> 
> NUMA configuration:
> [    0.008196] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x207fffffff] -> [mem 0x00000000-0x207fffffff]
> 
> Hope that helps,
> Florian
> 
> > 
> > Please give me some hints!
> > 
> > Thanks a lot.
> > 
> > [    2.425873] ------------[ cut here ]------------
> > [    2.430270] kernel BUG at arch/x86/kernel/apic/apic.c:1659!
> > [    2.435593] invalid opcode: 0000 [#1] PREEMPT SMP NOPTI
> > [    2.440574] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.4.133-ipipe-6-xenomai-3.1.1-20221216 #1
> > [    2.448851] Hardware name: HP HP Z8 Fury G5 Workstation/88C1, BIOS U61 Ver. 79.01.87 09/22/2022
> > [    2.457129] I-pipe domain: Linux
> > [    2.460211] RIP: 0010:setup_local_APIC+0x2df/0x310
> > [    2.464775] Code: 00 0b 05 b8 66 5b 01 0f 85 f7 fe ff ff 85 d2 7f 3f 48 8b 05 43 36 e4 00 be 00 07 01 00 bf 50 03 00 00 ff 50 10 e9 f6 fe ff ff <0f> 0b 48 8b 4c 24 40 65 48 2b 0c 25 28 00 00 00 75 0a be 00 04 00
> > [    2.482628] RSP: 0000:ffffffff82003ea0 EFLAGS: 00010246
> > [    2.487606] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff889fffe00000
> > [    2.494401] RDX: 0000000000000000 RSI: 00000000fffffeff RDI: 0000000000000020
> > [    2.501196] RBP: ffffffff8253d2e0 R08: 0000000000000001 R09: ffffffff820dbc20
> > [    2.507989] R10: 0000000000000008 R11: 0000000000000000 R12: 00000000000000d0
> > [    2.514786] R13: 0000000000000000 R14: 000000005565f000 R15: 000000005b0ca000
> > [    2.521582] FS:  0000000000000000(0000) GS:ffff889fffe00000(0000) knlGS:0000000000000000
> > [    2.529285] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > [    2.534759] CR2: ffff88a07ffff000 CR3: 000000000400a001 CR4: 00000000000606b0
> > [    2.541553] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> > [    2.548348] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
> > [    2.555141] Call Trace:
> > [    2.557479]  ? __ipipe_do_IRQ+0x87/0xb0
> > [    2.561137]  ? __ipipe_do_sync_stage+0x12a/0x160
> > [    2.565537]  apic_intr_mode_init+0xb7/0xda
> > [    2.569441]  x86_late_time_init+0x12/0x17
> > [    2.573262]  start_kernel+0x42e/0x4e7
> > [    2.576757]  secondary_startup_64+0xa4/0xb0
> > [    2.580744] Modules linked in:
> > [    2.583659] ---[ end trace bd3da5ac6eb39a7b ]---
> > [    2.588058] RIP: 0010:setup_local_APIC+0x2df/0x310
> > [    2.592622] Code: 00 0b 05 b8 66 5b 01 0f 85 f7 fe ff ff 85 d2 7f 3f 48 8b 05 43 36 e4 00 be 00 07 01 00 bf 50 03 00 00 ff 50 10 e9 f6 fe ff ff <0f> 0b 48 8b 4c 24 40 65 48 2b 0c 25 28 00 00 00 75 0a be 00 04 00
> > [    2.610482] RSP: 0000:ffffffff82003ea0 EFLAGS: 00010246
> > [    2.615460] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff889fffe00000
> > [    2.622252] RDX: 0000000000000000 RSI: 00000000fffffeff RDI: 0000000000000020
> > [    2.629048] RBP: ffffffff8253d2e0 R08: 0000000000000001 R09: ffffffff820dbc20
> > [    2.635841] R10: 0000000000000008 R11: 0000000000000000 R12: 00000000000000d0
> > [    2.642637] R13: 0000000000000000 R14: 000000005565f000 R15: 000000005b0ca000
> > [    2.649430] FS:  0000000000000000(0000) GS:ffff889fffe00000(0000) knlGS:0000000000000000
> > [    2.657135] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> > [    2.662608] CR2: ffff88a07ffff000 CR3: 000000000400a001 CR4: 00000000000606b0
> > [    2.669403] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> > [    2.676198] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
> > [    2.682993] Kernel panic - not syncing: Attempted to kill the idle task!
> > [    2.689396] Rebooting in 1 seconds..
> > [    3.648759] ACPI MEMORY or I/O RESET_REG.
> 

Re: some kernel exceptions

[Bezdeka, Florian]

[RESEND: Seems my original mail did not make it to the list]

Hi,

On Mon, 2022-12-26 at 15:37 +0800, Yxian.Yao wrote:
> 
> Hi，
> 
> Install the debian11.0 operating system on the machine.，the system
> can start normally.
> But the system is abnormal after using this kernel,linux-5.4.133-
> ipipe-6-xenomai-3.1.1-20221216 (linux-5.4.133, ipipe-core-5.4.133-
> x86-6.patch, xenomai 3.1.1), 
> See the attachment for output information during kernel startup, and
> the kernel outputs some exception messages, as follows.

Linux is failing while trying to initialize the IRQ controler (APIC) of
your application processors (APs) (= non boot CPUs). There seems to be
a mismatch regarding LAPIC IDs.

Such IDs are normally extracted from the APIC ACPI table. Something
seems to go wrong there (taken from your attachment):

[    0.214734] ACPI: x2apic entry ignored

There are a lot of such lines. This makes me wonder if your ACPI tables
are set up properly (which might be a BIOS/Firmware issue). That's
nothing Xenomai/ipipe specific. Does a standard Linux 5.4 boot on that
machine?

[    0.214840] smpboot: Boot CPU (id 255) not listed by BIOS

That points into the same direction. Your boot CPU has a APIC ID of
255, I would expect 0.

[    0.284534] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:1 nr_node_ids:1

nr_cpu_ids: 1 is strage. According to the line below we are on a NUMA
system (with one node) and I would expect a higher number of CPUs on
that system. So something is hiding your cores. (At least there is no
maxcpus=1 on your kernel cmdline).

NUMA configuration:
[    0.008196] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x207fffffff] -> [mem 0x00000000-0x207fffffff]

Hope that helps,
Florian

> 
> Please give me some hints!
> 
> Thanks a lot.
> 
> [    2.425873] ------------[ cut here ]------------
> [    2.430270] kernel BUG at arch/x86/kernel/apic/apic.c:1659!
> [    2.435593] invalid opcode: 0000 [#1] PREEMPT SMP NOPTI
> [    2.440574] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 5.4.133-ipipe-6-xenomai-3.1.1-20221216 #1
> [    2.448851] Hardware name: HP HP Z8 Fury G5 Workstation/88C1, BIOS U61 Ver. 79.01.87 09/22/2022
> [    2.457129] I-pipe domain: Linux
> [    2.460211] RIP: 0010:setup_local_APIC+0x2df/0x310
> [    2.464775] Code: 00 0b 05 b8 66 5b 01 0f 85 f7 fe ff ff 85 d2 7f 3f 48 8b 05 43 36 e4 00 be 00 07 01 00 bf 50 03 00 00 ff 50 10 e9 f6 fe ff ff <0f> 0b 48 8b 4c 24 40 65 48 2b 0c 25 28 00 00 00 75 0a be 00 04 00
> [    2.482628] RSP: 0000:ffffffff82003ea0 EFLAGS: 00010246
> [    2.487606] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff889fffe00000
> [    2.494401] RDX: 0000000000000000 RSI: 00000000fffffeff RDI: 0000000000000020
> [    2.501196] RBP: ffffffff8253d2e0 R08: 0000000000000001 R09: ffffffff820dbc20
> [    2.507989] R10: 0000000000000008 R11: 0000000000000000 R12: 00000000000000d0
> [    2.514786] R13: 0000000000000000 R14: 000000005565f000 R15: 000000005b0ca000
> [    2.521582] FS:  0000000000000000(0000) GS:ffff889fffe00000(0000) knlGS:0000000000000000
> [    2.529285] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [    2.534759] CR2: ffff88a07ffff000 CR3: 000000000400a001 CR4: 00000000000606b0
> [    2.541553] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [    2.548348] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
> [    2.555141] Call Trace:
> [    2.557479]  ? __ipipe_do_IRQ+0x87/0xb0
> [    2.561137]  ? __ipipe_do_sync_stage+0x12a/0x160
> [    2.565537]  apic_intr_mode_init+0xb7/0xda
> [    2.569441]  x86_late_time_init+0x12/0x17
> [    2.573262]  start_kernel+0x42e/0x4e7
> [    2.576757]  secondary_startup_64+0xa4/0xb0
> [    2.580744] Modules linked in:
> [    2.583659] ---[ end trace bd3da5ac6eb39a7b ]---
> [    2.588058] RIP: 0010:setup_local_APIC+0x2df/0x310
> [    2.592622] Code: 00 0b 05 b8 66 5b 01 0f 85 f7 fe ff ff 85 d2 7f 3f 48 8b 05 43 36 e4 00 be 00 07 01 00 bf 50 03 00 00 ff 50 10 e9 f6 fe ff ff <0f> 0b 48 8b 4c 24 40 65 48 2b 0c 25 28 00 00 00 75 0a be 00 04 00
> [    2.610482] RSP: 0000:ffffffff82003ea0 EFLAGS: 00010246
> [    2.615460] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffff889fffe00000
> [    2.622252] RDX: 0000000000000000 RSI: 00000000fffffeff RDI: 0000000000000020
> [    2.629048] RBP: ffffffff8253d2e0 R08: 0000000000000001 R09: ffffffff820dbc20
> [    2.635841] R10: 0000000000000008 R11: 0000000000000000 R12: 00000000000000d0
> [    2.642637] R13: 0000000000000000 R14: 000000005565f000 R15: 000000005b0ca000
> [    2.649430] FS:  0000000000000000(0000) GS:ffff889fffe00000(0000) knlGS:0000000000000000
> [    2.657135] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [    2.662608] CR2: ffff88a07ffff000 CR3: 000000000400a001 CR4: 00000000000606b0
> [    2.669403] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [    2.676198] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
> [    2.682993] Kernel panic - not syncing: Attempted to kill the idle task!
> [    2.689396] Rebooting in 1 seconds..
> [    3.648759] ACPI MEMORY or I/O RESET_REG.

Re: Re: some kernel exceptions

[Florian Bezdeka]

On Wed, 2022-12-28 at 13:34 +0800, Yxian Yao wrote:
> 
> Hi Florian,
> > > 
> > > [    0.214734] ACPI: x2apic entry ignored
> > 
> > CONFIG_X86_X2APIC is enabled in your kernel configuration?
> Yes, it's OK now after CONFIG_X86_X2APIC is enabled.

Great. Thanks for reporting back.

This means that at least HP stopped testing their firmware without
x2apic support in the OS. There should be "fallbacks" available on the
platform but for some reason Linux never reaches the point where it
would/could enable them.

Maybe recent Linux versions handle that case better but the firmware
still has to provide correct values in the hardware description (ACPI
tables on x86).

> 
> Thanks.
> 

Re:Re: some kernel exceptions

[Yxian Yao]

Hi Florian,

>> 
>> [    0.214734] ACPI: x2apic entry ignored
>
>CONFIG_X86_X2APIC is enabled in your kernel configuration?

Yes, it's OK now after CONFIG_X86_X2APIC is enabled.


Thanks.

Re: some kernel exceptions

[Jan Kiszka]

On 10.10.22 17:30, Yxian.Yao wrote:
> 
> Hi Jan,
> 
>> The warnings start with perf, but I might have been too quick to shoot
>> at it. The real issue is definitely the page fault. You don't have a
>> stack backtrace for the first one?
> 
> No, these are the last messages that the kernel outputs. 
> The second exception is the same as the first one？
> The logs are printed with "BUG: unable to handle kernel painting request at 00000000000a22e8"
> 

The issue is that you generally cannot trust succeeding BUG messages
after the first one. They may point into the wrong direction, not to the
root cause.

> 
>> Also note that your kernel is not just old /wrt to its base version
>> (4.19), it's also not using the latest I-pipe patch for that
>> (ipipe-core-4.19.252-cip78-x86-23).
> 
> What is the difference between cip and no cip on ipipe core?
> 

At some point, we moved from 4.19-LTS to 4.19-CIP as baseline for the
I-pipe patches as the latter kernel will live longer (10 instead of 6
years). No further development was done on the 4.19-LTS branch you are
sitting on, which is also missing some bug fixes to I-pipe since then.

> 
>> The key switches are warned about. But that does not exclude that some
>> sleeping bug is only surfaced by turning on or off some feature that
>> others usually do not touch.
> 
> 
> How to further determine what caused it?

Hard to say yet. Please re-try with the latest 4.19-ipipe release if
possible and also check if something changes positively when you use the
config from xenomai-images.

Jan

-- 
Siemens AG, Technology
Competence Center Embedded Linux

Re: some kernel exceptions

[Jan Kiszka]

On 10.10.22 16:37, Yxian.Yao wrote:
> 
> 
> Hi Jan,
>> At 2022-10-10 22:13:51, "Jan Kiszka" <jan.kiszka@siemens.com> wrote:
>>
>> No, I meant of you are calling "perf" in order to profile some
>> applications. The pure activation of the related kernel features is not
>> considered problematic, but some "perf" feature are if actively used.
> 
> My application software does not use perf. 
> I update the dual kernel after installing Debian 10.3, 
> install the xenomai cobalt library, and then run my application software. 
> How can I determine whether other applications in the system use perf?

Applications usually do not call those services directly - like you
don't start the debugger from a normal application.

> Are these kernel exceptions related to perf?
> 

The warnings start with perf, but I might have been too quick to shoot
at it. The real issue is definitely the page fault. You don't have a
stack backtrace for the first one?

Also note that your kernel is not just old /wrt to its base version
(4.19), it's also not using the latest I-pipe patch for that
(ipipe-core-4.19.252-cip78-x86-23).

> 
>> If you do not need those features, you may also try disabling them, if
>> that changes the picture. Also compare your config in this regard to the
>> config we test in xenomai-images (just a reference, not as the only
>> possibly valid config, by far).
> 
> Where can I get the xenomai-images and the config?

https://source.denx.de/Xenomai/xenomai-images/-/blob/master/recipes-kernel/linux/files/amd64_defconfig

> In addition, the kernel has a lot of configuration items. 
> How can I determine which ones should be turned on and off?
> Is there a detailed instruction manual?
> 

The key switches are warned about. But that does not exclude that some
sleeping bug is only surfaced by turning on or off some feature that
others usually do not touch.

Jan

-- 
Siemens AG, Technology
Competence Center Embedded Linux

Re: some kernel exceptions

[Jan Kiszka]

On 10.10.22 16:09, Yxian.Yao wrote:
> 
> Hi Jan,
> 
> 
> This is the only kernel version. Besides, these problems are hard to reproduce.
> Whether some configurations related to perf are enabled in the kernel？

No, I meant of you are calling "perf" in order to profile some
applications. The pure activation of the related kernel features is not
considered problematic, but some "perf" feature are if actively used.

> The following are the configuration items for perf:
> 
> 
> CONFIG_CGROUP_PERF=y
> CONFIG_CC_OPTIMIZE_FOR_PERFORMANCE=y
> CONFIG_HAVE_PERF_EVENTS=y
> # Kernel Performance Events And Counters
> CONFIG_PERF_EVENTS=y
> # CONFIG_DEBUG_PERF_USE_VMALLOC is not set
> # Performance monitoring
> CONFIG_PERF_EVENTS_INTEL_UNCORE=m
> CONFIG_PERF_EVENTS_INTEL_RAPL=m
> CONFIG_PERF_EVENTS_INTEL_CSTATE=m
> # CONFIG_PERF_EVENTS_AMD_POWER is not set
> # CONFIG_PCIEASPM_PERFORMANCE is not set
> CONFIG_HAVE_PERF_EVENTS_NMI=y
> CONFIG_HAVE_HARDLOCKUP_DETECTOR_PERF=y
> CONFIG_HAVE_PERF_REGS=y
> CONFIG_HAVE_PERF_USER_STACK_DUMP=y
> CONFIG_CLS_U32_PERF=y
> # CONFIG_DEVFREQ_GOV_PERFORMANCE is not set
> # Performance monitor support
> CONFIG_HARDLOCKUP_DETECTOR_PERF=y
> # CONFIG_RCU_PERF_TEST is not set

If you do not need those features, you may also try disabling them, if
that changes the picture. Also compare your config in this regard to the
config we test in xenomai-images (just a reference, not as the only
possibly valid config, by far).

Jan

-- 
Siemens AG, Technology
Competence Center Embedded Linux

Re: some kernel exceptions

[Jan Kiszka]

On 10.10.22 15:31, Yxian.Yao wrote:
> 
> 
> During the recent testing on the linux-4.19.89-ipipe-9-xenomai-3.1 (linux-4.19.89, ipipe-core-4.19.89-x86-9.patch, xenomai 3.1), 
> the kernel outputs some exception messages, as follows.
> Please give me some hints!

Are you using the perf tool here?

Also, can you check if the issue persists with a recent dovetail kernel
(5.15 or 5.10)? Or are you locked into these versions technically?

Jan

> 
> Thanks a lot.
> 
> 
> [ 5228.358085] perf: interrupt took too long (2504 > 2500), lowering kernel.perf_event_max_sample_rate to 79750
> [13323.899759] perf: interrupt took too long (3137 > 3130), lowering kernel.perf_event_max_sample_rate to 63750
> [62540.659725] hrtimer: interrupt took 12379 ns
> [63405.661958] perf: interrupt took too long (3927 > 3921), lowering kernel.perf_event_max_sample_rate to 50750
> [131204.150039] perf: interrupt took too long (5012 > 4908), lowering kernel.perf_event_max_sample_rate to 39750
> [166021.881707] BUG: unable to handle kernel paging request at 00000000000a22e8
> [166021.889579] PGD 0 P4D 0 
> [166021.892503] Oops: 0000 [#1] PREEMPT SMP PTI
> [166021.897268] CPU: 2 PID: 1604 Comm: RunCommandActor Kdump: loaded Tainted: P           O      4.19.89-ipipe-9-xenomai-3.1-20201027 #1
> [166021.910661] Hardware name: Intel Corporation S2600CWR/S2600CWR, BIOS SE5C610.86B.01.01.0022.C2.062820171903 06/28/2017
> [166021.922696] I-pipe domain: Linux
> [166021.926394] RIP: a2260:0xffff88866761c560
> [166021.930965] Code: 00 00 00 00 00 00 00 00 00 00 c0 8f 6a 67 86 88 ff ff 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <01> 00 00 00 00 00 00 00 01 01 00 00 00 00 00 00 02 00 00 00 00 00
> [166021.952016] RSP: 81037f07:00000000000a2260 EFLAGS: ffff88866761c560 ORIG_RAX: ffffffff8111953e
> [166021.961726] RAX: 00000000000a2260 RBX: 0000000000000002 RCX: ffffffff828021c0
> [166021.969786] RDX: ffff88866761c560 RSI: 0000000000000000 RDI: 0000000000000000
> [166021.977847] RBP: ffff8886676a4540 R08: 000000000005f3e0 R09: ffffffff811838cb
> [166021.985909] R10: ffffffff8117cddc R11: 0000000000000002 R12: ffff8886676a5d08
> [166021.993969] R13: ffffe8f9ff8077d8 R14: ffff8886676a4540 R15: ffffffff811838cb
> [166022.002030] FS:  00007f73c6ffd700(0000) GS:ffff888667600000(0000) knlGS:0000000000000000
> [166022.011157] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [166022.017666] CR2: 00000000000a22e8 CR3: 0000000c29cf8004 CR4: 00000000001606e0
> [166022.025720] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [166022.033781] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
> [166022.041843] Call Trace:
> [166022.044667] Modules linked in: fuse mod_samo(PO) mod_drxu(PO) mod_stcu(PO) arc4 ecb md4 sha512_ssse3 sha512_generic cmac nls_utf8 cifs ccm dns_resolver fscache intel_rapl sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd cryptd joydev glue_helper intel_cstate mgag200 ttm drm_kms_helper drm fb_sys_fops iTCO_wdt iTCO_vendor_support lpc_ich intel_uncore syscopyarea evdev ipmi_si ipmi_devintf mfd_core mei_me sysfillrect i2c_i801 ipmi_msghandler mxm_wmi intel_rapl_perf snd_pcsp snd_pcm snd_timer snd soundcore sysimgblt ioatdma mei acpi_power_meter wmi button ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto dm_mod i40evf atlantic i40e ixgb e1000e e1000 e100 mii vmw_pvscsi vmxnet3 sg sd_mod
> [166022.124033]  hid_generic usbhid hid ahci libahci xhci_pci ehci_pci libata xhci_hcd ehci_hcd crc32c_intel igb ixgbe i2c_algo_bit usbcore scsi_mod mdio dca
> 
> [166022.139480] CR2: 00000000000a22e8
> 
> 
> 
> 
> [184723.509341] BUG: unable to handle kernel paging request at 00000000000a22e8
> [184723.516418] BUG: unable to handle kernel paging request at 0000000000048044
> [184723.523453] PGD 0 P4D 0 
> [184723.526072] Oops: 0010 [#1] PREEMPT SMP PTI
> [184723.530336] CPU: 2 PID: 4763 Comm: RunCommandActor Kdump: loaded Tainted: P           O      4.19.89-ipipe-9-xenomai-3.1-20201027 #1
> [184723.542312] Hardware name: Supermicro Kontron C612XS1/Kontron C612XS1, BIOS 2.0a.V2 07/04/2021
> [184723.550996] I-pipe domain: Linux
> [184723.554308] RIP: 0010:0x48044
> [184723.557360] Code: Bad RIP value.
> [184723.560669] RSP: 0018:ffff88885fa03ed0 EFLAGS: 00051046
> [184723.565972] RAX: ffff88885fa5f3e0 RBX: ffffffffa07ed4a8 RCX: ffff88885f8a4540
> [184723.573184] RDX: 0000000000000000 RSI: ffffffff81e0f0a7 RDI: 000000000000000b
> [184723.580394] RBP: 0000000000000000 R08: 0000000000000002 R09: 0000000000000a7e
> [184723.587604] R10: 000000000000000f R11: ffffffff825b1eee R12: dead000000000200
> [184723.594815] R13: dead000000000100 R14: ffffffffa07ed480 R15: ffffc90003b5fa40
> [184723.602028] FS:  00007f4ad57fa700(0000) GS:ffff88885fa00000(0000) knlGS:0000000000000000
> [184723.610190] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [184723.616014] CR2: 000000000004801a CR3: 0000000813a66001 CR4: 00000000001606e0
> [184723.623225] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [184723.630435] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
> [184723.637645] Call Trace:
> [184723.640178]  <IRQ>
> [184723.642277]  ? xnthread_switch_fpu+0x21/0x30
> [184723.646636]  ? ___xnsched_run.part.68+0x1fb/0x460
> [184723.651426]  ? xnintr_core_clock_handler+0x20d/0x310
> [184723.656471]  ? ___xnsched_run.part.68+0x120/0x460
> [184723.661257]  ? __ipipe_dispatch_irq+0x120/0x1b0
> [184723.665876]  ? __ipipe_handle_irq+0x67/0x1e0
> [184723.670226]  ? common_interrupt+0xf/0x2c
> [184723.674229]  </IRQ>
> [184723.676412] WARNING: stack recursion on stack type 2
> [184723.676413] Modules linked in: mod_daconrt(PO) mod_daco(PO) mod_pgcu(PO) mod_tsmu(PO) mod_scc(PO) fuse arc4 ecb md4 sha512_ssse3 sha512_generic cmac nls_utf8 cifs ccm dns_resolver fscache intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd cryptd glue_helper intel_cstate intel_uncore intel_rapl_perf snd_hda_codec_realtek snd_hda_codec_generic iTCO_wdt iTCO_vendor_support joydev snd_hda_intel ast evdev snd_hda_codec ttm snd_pcsp drm_kms_helper i2c_i801 snd_hda_core drm snd_hwdep fb_sys_fops syscopyarea sysfillrect snd_pcm sysimgblt snd_timer snd lpc_ich soundcore mfd_core wmi ipmi_si ipmi_devintf ipmi_msghandler button ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto dm_mod
> [184723.752393]  hid_generic usbhid hid i40evf atlantic ixgbe mdio ixgb e1000e e1000 e100 mii vmw_pvscsi vmxnet3 sg sd_mod ahci xhci_pci libahci ehci_pci libata igb ehci_hcd i2c_algo_bit xhci_hcd scsi_mod dca crc32c_intel usbcore i40e [last unloaded: mod_scc]
> [184723.775041] CR2: 0000000000048044

-- 
Siemens AG, Technology
Competence Center Embedded Linux

some kernel exceptions

[Yxian.Yao]

During the recent testing on the linux-4.19.89-ipipe-9-xenomai-3.1 (linux-4.19.89, ipipe-core-4.19.89-x86-9.patch, xenomai 3.1), 
the kernel outputs some exception messages, as follows.
Please give me some hints!

Thanks a lot.


[ 5228.358085] perf: interrupt took too long (2504 > 2500), lowering kernel.perf_event_max_sample_rate to 79750
[13323.899759] perf: interrupt took too long (3137 > 3130), lowering kernel.perf_event_max_sample_rate to 63750
[62540.659725] hrtimer: interrupt took 12379 ns
[63405.661958] perf: interrupt took too long (3927 > 3921), lowering kernel.perf_event_max_sample_rate to 50750
[131204.150039] perf: interrupt took too long (5012 > 4908), lowering kernel.perf_event_max_sample_rate to 39750
[166021.881707] BUG: unable to handle kernel paging request at 00000000000a22e8
[166021.889579] PGD 0 P4D 0 
[166021.892503] Oops: 0000 [#1] PREEMPT SMP PTI
[166021.897268] CPU: 2 PID: 1604 Comm: RunCommandActor Kdump: loaded Tainted: P           O      4.19.89-ipipe-9-xenomai-3.1-20201027 #1
[166021.910661] Hardware name: Intel Corporation S2600CWR/S2600CWR, BIOS SE5C610.86B.01.01.0022.C2.062820171903 06/28/2017
[166021.922696] I-pipe domain: Linux
[166021.926394] RIP: a2260:0xffff88866761c560
[166021.930965] Code: 00 00 00 00 00 00 00 00 00 00 c0 8f 6a 67 86 88 ff ff 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 <01> 00 00 00 00 00 00 00 01 01 00 00 00 00 00 00 02 00 00 00 00 00
[166021.952016] RSP: 81037f07:00000000000a2260 EFLAGS: ffff88866761c560 ORIG_RAX: ffffffff8111953e
[166021.961726] RAX: 00000000000a2260 RBX: 0000000000000002 RCX: ffffffff828021c0
[166021.969786] RDX: ffff88866761c560 RSI: 0000000000000000 RDI: 0000000000000000
[166021.977847] RBP: ffff8886676a4540 R08: 000000000005f3e0 R09: ffffffff811838cb
[166021.985909] R10: ffffffff8117cddc R11: 0000000000000002 R12: ffff8886676a5d08
[166021.993969] R13: ffffe8f9ff8077d8 R14: ffff8886676a4540 R15: ffffffff811838cb
[166022.002030] FS:  00007f73c6ffd700(0000) GS:ffff888667600000(0000) knlGS:0000000000000000
[166022.011157] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[166022.017666] CR2: 00000000000a22e8 CR3: 0000000c29cf8004 CR4: 00000000001606e0
[166022.025720] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[166022.033781] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[166022.041843] Call Trace:
[166022.044667] Modules linked in: fuse mod_samo(PO) mod_drxu(PO) mod_stcu(PO) arc4 ecb md4 sha512_ssse3 sha512_generic cmac nls_utf8 cifs ccm dns_resolver fscache intel_rapl sb_edac x86_pkg_temp_thermal intel_powerclamp coretemp kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd cryptd joydev glue_helper intel_cstate mgag200 ttm drm_kms_helper drm fb_sys_fops iTCO_wdt iTCO_vendor_support lpc_ich intel_uncore syscopyarea evdev ipmi_si ipmi_devintf mfd_core mei_me sysfillrect i2c_i801 ipmi_msghandler mxm_wmi intel_rapl_perf snd_pcsp snd_pcm snd_timer snd soundcore sysimgblt ioatdma mei acpi_power_meter wmi button ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto dm_mod i40evf atlantic i40e ixgb e1000e e1000 e100 mii vmw_pvscsi vmxnet3 sg sd_mod
[166022.124033]  hid_generic usbhid hid ahci libahci xhci_pci ehci_pci libata xhci_hcd ehci_hcd crc32c_intel igb ixgbe i2c_algo_bit usbcore scsi_mod mdio dca

[166022.139480] CR2: 00000000000a22e8




[184723.509341] BUG: unable to handle kernel paging request at 00000000000a22e8
[184723.516418] BUG: unable to handle kernel paging request at 0000000000048044
[184723.523453] PGD 0 P4D 0 
[184723.526072] Oops: 0010 [#1] PREEMPT SMP PTI
[184723.530336] CPU: 2 PID: 4763 Comm: RunCommandActor Kdump: loaded Tainted: P           O      4.19.89-ipipe-9-xenomai-3.1-20201027 #1
[184723.542312] Hardware name: Supermicro Kontron C612XS1/Kontron C612XS1, BIOS 2.0a.V2 07/04/2021
[184723.550996] I-pipe domain: Linux
[184723.554308] RIP: 0010:0x48044
[184723.557360] Code: Bad RIP value.
[184723.560669] RSP: 0018:ffff88885fa03ed0 EFLAGS: 00051046
[184723.565972] RAX: ffff88885fa5f3e0 RBX: ffffffffa07ed4a8 RCX: ffff88885f8a4540
[184723.573184] RDX: 0000000000000000 RSI: ffffffff81e0f0a7 RDI: 000000000000000b
[184723.580394] RBP: 0000000000000000 R08: 0000000000000002 R09: 0000000000000a7e
[184723.587604] R10: 000000000000000f R11: ffffffff825b1eee R12: dead000000000200
[184723.594815] R13: dead000000000100 R14: ffffffffa07ed480 R15: ffffc90003b5fa40
[184723.602028] FS:  00007f4ad57fa700(0000) GS:ffff88885fa00000(0000) knlGS:0000000000000000
[184723.610190] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[184723.616014] CR2: 000000000004801a CR3: 0000000813a66001 CR4: 00000000001606e0
[184723.623225] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[184723.630435] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[184723.637645] Call Trace:
[184723.640178]  <IRQ>
[184723.642277]  ? xnthread_switch_fpu+0x21/0x30
[184723.646636]  ? ___xnsched_run.part.68+0x1fb/0x460
[184723.651426]  ? xnintr_core_clock_handler+0x20d/0x310
[184723.656471]  ? ___xnsched_run.part.68+0x120/0x460
[184723.661257]  ? __ipipe_dispatch_irq+0x120/0x1b0
[184723.665876]  ? __ipipe_handle_irq+0x67/0x1e0
[184723.670226]  ? common_interrupt+0xf/0x2c
[184723.674229]  </IRQ>
[184723.676412] WARNING: stack recursion on stack type 2
[184723.676413] Modules linked in: mod_daconrt(PO) mod_daco(PO) mod_pgcu(PO) mod_tsmu(PO) mod_scc(PO) fuse arc4 ecb md4 sha512_ssse3 sha512_generic cmac nls_utf8 cifs ccm dns_resolver fscache intel_rapl x86_pkg_temp_thermal intel_powerclamp coretemp kvm_intel kvm irqbypass crct10dif_pclmul crc32_pclmul ghash_clmulni_intel pcbc aesni_intel aes_x86_64 crypto_simd cryptd glue_helper intel_cstate intel_uncore intel_rapl_perf snd_hda_codec_realtek snd_hda_codec_generic iTCO_wdt iTCO_vendor_support joydev snd_hda_intel ast evdev snd_hda_codec ttm snd_pcsp drm_kms_helper i2c_i801 snd_hda_core drm snd_hwdep fb_sys_fops syscopyarea sysfillrect snd_pcm sysimgblt snd_timer snd lpc_ich soundcore mfd_core wmi ipmi_si ipmi_devintf ipmi_msghandler button ip_tables x_tables autofs4 ext4 crc16 mbcache jbd2 fscrypto dm_mod
[184723.752393]  hid_generic usbhid hid i40evf atlantic ixgbe mdio ixgb e1000e e1000 e100 mii vmw_pvscsi vmxnet3 sg sd_mod ahci xhci_pci libahci ehci_pci libata igb ehci_hcd i2c_algo_bit xhci_hcd scsi_mod dca crc32c_intel usbcore i40e [last unloaded: mod_scc]
[184723.775041] CR2: 0000000000048044