* Bug report: the extended PCI config space is missed with 6.2-rc2
@ 2023-01-04 14:39 Liang, Kan
2023-01-04 14:50 ` Bjorn Helgaas
` (2 more replies)
0 siblings, 3 replies; 37+ messages in thread
From: Liang, Kan @ 2023-01-04 14:39 UTC (permalink / raw)
To: bhelgaas
Cc: hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, david.e.box,
yunying.sun, Kan Liang
Hi Bjorn,
Happy new year!
We found some PCI issues with the latest 6.2-rc2.
- Using the lspci -xxxx, the extended PCI config space of all PCI
devices are missed with the latest 6.2-rc2. The system we used had 932
PCI devices, at least 800 which have extended space as seen when booted
into a 5.15 kernel. But none of them appeared in 6.2-rc2.
- The drivers which rely on the information in the extended PCI config
space don't work anymore. We have confirmed that the perf uncore driver
(uncore performance monitoring) and Intel VSEC driver (telemetry) don't
work in 6.2-rc2. There could be more drivers which are impacted.
After a bisect, we found the regression is caused by the below commit
07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map").
After reverting the commit, the issues are gone.
Could you please take a look at the issues?
Thanks,
Kan
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-04 14:39 Bug report: the extended PCI config space is missed with 6.2-rc2 Liang, Kan
@ 2023-01-04 14:50 ` Bjorn Helgaas
2023-01-04 15:45 ` Bjorn Helgaas
2023-01-05 22:32 ` Bjorn Helgaas
2023-01-06 9:44 ` Linux kernel regression tracking (#adding)
2 siblings, 1 reply; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-04 14:50 UTC (permalink / raw)
To: Liang, Kan
Cc: bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, david.e.box,
yunying.sun
On Wed, Jan 04, 2023 at 09:39:56AM -0500, Liang, Kan wrote:
> Hi Bjorn,
>
> Happy new year!
>
> We found some PCI issues with the latest 6.2-rc2.
>
> - Using the lspci -xxxx, the extended PCI config space of all PCI
> devices are missed with the latest 6.2-rc2. The system we used had 932
> PCI devices, at least 800 which have extended space as seen when booted
> into a 5.15 kernel. But none of them appeared in 6.2-rc2.
> - The drivers which rely on the information in the extended PCI config
> space don't work anymore. We have confirmed that the perf uncore driver
> (uncore performance monitoring) and Intel VSEC driver (telemetry) don't
> work in 6.2-rc2. There could be more drivers which are impacted.
>
> After a bisect, we found the regression is caused by the below commit
> 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map").
> After reverting the commit, the issues are gone.
>
> Could you please take a look at the issues?
Certainly. Can you capture the complete dmesg log, please?
Bjorn
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-04 14:50 ` Bjorn Helgaas
@ 2023-01-04 15:45 ` Bjorn Helgaas
2023-01-05 17:42 ` Tony Luck
0 siblings, 1 reply; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-04 15:45 UTC (permalink / raw)
To: Liang, Kan
Cc: bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, david.e.box,
yunying.sun
On Wed, Jan 04, 2023 at 08:50:32AM -0600, Bjorn Helgaas wrote:
> On Wed, Jan 04, 2023 at 09:39:56AM -0500, Liang, Kan wrote:
> > Hi Bjorn,
> >
> > Happy new year!
> >
> > We found some PCI issues with the latest 6.2-rc2.
> >
> > - Using the lspci -xxxx, the extended PCI config space of all PCI
> > devices are missed with the latest 6.2-rc2. The system we used had 932
> > PCI devices, at least 800 which have extended space as seen when booted
> > into a 5.15 kernel. But none of them appeared in 6.2-rc2.
> > - The drivers which rely on the information in the extended PCI config
> > space don't work anymore. We have confirmed that the perf uncore driver
> > (uncore performance monitoring) and Intel VSEC driver (telemetry) don't
> > work in 6.2-rc2. There could be more drivers which are impacted.
> >
> > After a bisect, we found the regression is caused by the below commit
> > 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map").
> > After reverting the commit, the issues are gone.
> >
> > Could you please take a look at the issues?
>
> Certainly. Can you capture the complete dmesg log, please?
Thanks! Comparing v5.19 and v6.2-rc2, I see these:
--- v5.19
+++ v6.2-rc2
+efi: Remove mem458: MMIO range=[0x80000000-0x8fffffff] (256MB) from e820 map
+e820: remove [mem 0x80000000-0x8fffffff] reserved
-PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
+PCI: not using MMCONFIG
+PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
+[Firmware Info]: PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] not reserved in ACPI motherboard resources
+PCI: not using MMCONFIG
system 00:01: [mem 0xff000000-0xffffffff] has been reserved
system 00:02: [mem 0xfd000000-0xfd69ffff] could not be reserved
system 00:02: [mem 0xfd6c0000-0xfd6cffff] has been reserved
system 00:02: [mem 0xfd6f0000-0xfdffffff] has been reserved
system 00:02: [mem 0xfe000000-0xfe01ffff] could not be reserved
system 00:02: [mem 0xfe200000-0xfe7fffff] has been reserved
system 00:02: [mem 0xff000000-0xffffffff] has been reserved
I think this is a firmware defect. MCFG says the ECAM space is at
[mem 0x80000000-0x8fffffff]. Per the PCI Firmware Spec, r3.3, Note 2
of Table 4-2, this space should be reserved by a motherboard resource,
i.e., a PNP0C02 device (which would appear as "system 00:01" or
similar above) with _CRS that includes [mem 0x80000000-0x8fffffff].
This firmware supplies an EfiMemoryMappedIO region
[0x80000000-0x8fffffff] for the ECAM space (this could be confirmed by
adding "efi=debug"), and the bootloader or EFI stub converted that to
an E820 entry that Linux consumes.
On v5.19, Linux treated that EfiMemoryMappedIO region as a reservation
of the ECAM space, but starting with v6.2-rc1, Linux removes
EfiMemoryMappedIO regions from E820.
My understanding is that EfiMemoryMappedIO tells the OS to map the
area for use by runtime services, but is not intended to prevent the
OS from using the area. Some platforms use EfiMemoryMappedIO for PCI
host bridge apertures, and of course the OS needs to use those.
If your firmware folks disagree and think Linux should be able to
figure this out differently, I would love to have a conversation about
how to do this.
Bjorn
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-04 15:45 ` Bjorn Helgaas
@ 2023-01-05 17:42 ` Tony Luck
2023-01-05 17:51 ` Bjorn Helgaas
0 siblings, 1 reply; 37+ messages in thread
From: Tony Luck @ 2023-01-05 17:42 UTC (permalink / raw)
To: Bjorn Helgaas
Cc: Liang, Kan, bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, david.e.box,
yunying.sun
On Wed, Jan 04, 2023 at 09:45:11AM -0600, Bjorn Helgaas wrote:
> My understanding is that EfiMemoryMappedIO tells the OS to map the
> area for use by runtime services, but is not intended to prevent the
> OS from using the area. Some platforms use EfiMemoryMappedIO for PCI
> host bridge apertures, and of course the OS needs to use those.
>
> If your firmware folks disagree and think Linux should be able to
> figure this out differently, I would love to have a conversation about
> how to do this.
It seems that 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map")
is also the cause of breakage for drivers/edac/sb_edac.c. It is broken
in v6.2-rc2 and reverting this commit makes it work again.
This ancient driver probably plays fast and loose with how it ought to
access extended PCIe config space ... but it needs to do this to read various
memory controller configuration registers to do address translation from
a system physical address to a DIMM address.
-Tony
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 17:42 ` Tony Luck
@ 2023-01-05 17:51 ` Bjorn Helgaas
2023-01-05 18:04 ` Luck, Tony
0 siblings, 1 reply; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-05 17:51 UTC (permalink / raw)
To: Tony Luck
Cc: Liang, Kan, bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, david.e.box,
yunying.sun
On Thu, Jan 05, 2023 at 09:42:10AM -0800, Tony Luck wrote:
> On Wed, Jan 04, 2023 at 09:45:11AM -0600, Bjorn Helgaas wrote:
> > My understanding is that EfiMemoryMappedIO tells the OS to map the
> > area for use by runtime services, but is not intended to prevent the
> > OS from using the area. Some platforms use EfiMemoryMappedIO for PCI
> > host bridge apertures, and of course the OS needs to use those.
> >
> > If your firmware folks disagree and think Linux should be able to
> > figure this out differently, I would love to have a conversation about
> > how to do this.
>
> It seems that 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map")
> is also the cause of breakage for drivers/edac/sb_edac.c. It is broken
> in v6.2-rc2 and reverting this commit makes it work again.
>
> This ancient driver probably plays fast and loose with how it ought to
> access extended PCIe config space ... but it needs to do this to read various
> memory controller configuration registers to do address translation from
> a system physical address to a DIMM address.
Hi Tony, can you share a dmesg log? Does it look like the same thing
Kan reported, where the ECAM space is reported only via an
EfiMemoryMappedIO region and is not otherwise reserved by firmware?
Bjorn
^ permalink raw reply [flat|nested] 37+ messages in thread
* RE: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 17:51 ` Bjorn Helgaas
@ 2023-01-05 18:04 ` Luck, Tony
2023-01-05 18:29 ` Bjorn Helgaas
0 siblings, 1 reply; 37+ messages in thread
From: Luck, Tony @ 2023-01-05 18:04 UTC (permalink / raw)
To: Bjorn Helgaas
Cc: Liang, Kan, bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, Box, David E, Sun,
Yunying
[-- Attachment #1: Type: text/plain, Size: 389 bytes --]
> Hi Tony, can you share a dmesg log? Does it look like the same thing
> Kan reported, where the ECAM space is reported only via an
> EfiMemoryMappedIO region and is not otherwise reserved by firmware?
Bjorn,
Attached are serial logs. "broken" is the one from v6.2-rc2, "revert" is the
one with your commit reverted.
I don't see the string "ECAM" in either of them.
-Tony
[-- Attachment #2: broken --]
[-- Type: application/octet-stream, Size: 123552 bytes --]
[ 0.000000] microcode: microcode updated early to revision 0xb00003e, date = 2021-02-06
[ 0.000000] Linux version 6.2.0-rc2+ (aegl@brk-bdx-01.sc.intel.com) (gcc (GCC) 11.2.1 20210728 (Red Hat 11.2.1-1), GNU ld version 2.35.2-5.fc34) #128 SMP PREEMPT_DYNAMIC Thu Jan 5 08:32:48 PST 2023
[ 0.000000] Command line: BOOT_IMAGE=(hd1,gpt2)/vmlinuz-6.2.0-rc2+ root=UUID=c1fd9bc7-73bf-4cc4-b72b-a369bdec1a5e ro rootflags=subvol=root console=tty1 console=ttyS0,115200 intel_iommu=on,sm_on
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[ 0.000000] signal: max sigframe size: 1776
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008dfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000008e000-0x000000000008ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000090000-0x000000000009ffff] usable
[ 0.000000] BIOS-e820: [mem 0x00000000000a0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005c687fff] usable
[ 0.000000] BIOS-e820: [mem 0x000000005c688000-0x000000005db85fff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000005db86000-0x000000005fd97fff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x000000005fd98000-0x000000005ff20fff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x000000005ff21000-0x000000007bafffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007bb00000-0x000000008fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000807fffffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] extended physical RAM map:
[ 0.000000] reserve setup_data: [mem 0x0000000000000000-0x000000000008dfff] usable
[ 0.000000] reserve setup_data: [mem 0x000000000008e000-0x000000000008ffff] reserved
[ 0.000000] reserve setup_data: [mem 0x0000000000090000-0x000000000009ffff] usable
[ 0.000000] reserve setup_data: [mem 0x00000000000a0000-0x00000000000fffff] reserved
[ 0.000000] reserve setup_data: [mem 0x0000000000100000-0x000000005af75017] usable
[ 0.000000] reserve setup_data: [mem 0x000000005af75018-0x000000005af7d057] usable
[ 0.000000] reserve setup_data: [mem 0x000000005af7d058-0x000000005af7e017] usable
[ 0.000000] reserve setup_data: [mem 0x000000005af7e018-0x000000005afa2e57] usable
[ 0.000000] reserve setup_data: [mem 0x000000005afa2e58-0x000000005afa3017] usable
[ 0.000000] reserve setup_data: [mem 0x000000005afa3018-0x000000005afc7e57] usable
[ 0.000000] reserve setup_data: [mem 0x000000005afc7e58-0x000000005afc8017] usable
[ 0.000000] reserve setup_data: [mem 0x000000005afc8018-0x000000005b00f457] usable
[ 0.000000] reserve setup_data: [mem 0x000000005b00f458-0x000000005c687fff] usable
[ 0.000000] reserve setup_data: [mem 0x000000005c688000-0x000000005db85fff] reserved
[ 0.000000] reserve setup_data: [mem 0x000000005db86000-0x000000005fd97fff] ACPI NVS
[ 0.000000] reserve setup_data: [mem 0x000000005fd98000-0x000000005ff20fff] ACPI data
[ 0.000000] reserve setup_data: [mem 0x000000005ff21000-0x000000007bafffff] usable
[ 0.000000] reserve setup_data: [mem 0x000000007bb00000-0x000000008fffffff] reserved
[ 0.000000] reserve setup_data: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[ 0.000000] reserve setup_data: [mem 0x0000000100000000-0x000000807fffffff] usable
[ 0.000000] efi: EFI v2.40 by EDK II BIOS ID:BRBDXSD1.86B.0338.V01.1603162127
[ 0.000000] efi: ACPI=0x5ff20000 ACPI 2.0=0x5ff20014 SMBIOS=0x5ca84000 MOKvar=0x7a88a000 RNG=0x5fde1f98
[ 0.000000] random: crng init done
[ 0.000000] efi: Remove mem48: MMIO range=[0x80000000-0x8fffffff] (256MB) from e820 map
[ 0.000000] efi: Not removing mem49: MMIO range=[0xfed1c000-0xfed1ffff] (16KB) from e820 map
[ 0.000000] SMBIOS 3.0 present.
[ 0.000000] DMI: Intel Corporation BRICKLAND/BRICKLAND, BIOS BRBDXSD1.86B.0338.V01.1603162127 03/16/2016
[ 0.000000] tsc: Fast TSC calibration using PIT
[ 0.000000] tsc: Detected 2194.483 MHz processor
[ 0.000427] last_pfn = 0x8080000 max_arch_pfn = 0x400000000
[ 0.000434] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
[ 0.001082] last_pfn = 0x7bb00 max_arch_pfn = 0x400000000
[ 0.016881] Using GB pages for direct mapping
[ 0.017403] Secure boot disabled
[ 0.017404] RAMDISK: [mem 0x2ca14000-0x2e85afff]
[ 0.017410] ACPI: Early table checksum verification disabled
[ 0.017414] ACPI: RSDP 0x000000005FF20014 000024 (v02 INTEL )
[ 0.017419] ACPI: XSDT 0x000000005FDE4188 0000E4 (v01 INTEL TIANO 00000000 01000013)
[ 0.017426] ACPI: FACP 0x000000005FF1B000 0000F4 (v04 INTEL TIANO 00000000 MSFT 01000013)
[ 0.017433] ACPI: DSDT 0x000000005FEE6000 028260 (v02 INTEL TIANO 00000003 MSFT 01000013)
[ 0.017437] ACPI: FACS 0x000000005E4C6000 000040
[ 0.017441] ACPI: TCPA 0x000000005FF1E000 000064 (v02 INTEL EDK2 00000002 01000013)
[ 0.017445] ACPI: SSDT 0x000000005FF1D000 0003A2 (v02 INTEL TcgTable 00001000 INTL 20130328)
[ 0.017449] ACPI: BDAT 0x000000005FF1C000 000030 (v01 INTEL TIANO 00000000 MSFT 01000013)
[ 0.017453] ACPI: HPET 0x000000005FF1A000 000038 (v01 INTEL TIANO 00000001 MSFT 01000013)
[ 0.017457] ACPI: APIC 0x000000005FF19000 000AFC (v03 INTEL TIANO 00000000 MSFT 01000013)
[ 0.017461] ACPI: MCFG 0x000000005FF18000 00003C (v01 INTEL TIANO 00000001 MSFT 01000013)
[ 0.017465] ACPI: MSCT 0x000000005FF17000 0000E8 (v01 INTEL TIANO 00000001 MSFT 01000013)
[ 0.017469] ACPI: PCCT 0x000000005FF16000 0000AC (v01 INTEL TIANO 00000002 MSFT 01000013)
[ 0.017473] ACPI: PMCT 0x000000005FF15000 000060 (v01 INTEL TIANO 00000000 MSFT 01000013)
[ 0.017477] ACPI: RASF 0x000000005FF14000 000030 (v01 INTEL TIANO 00000001 MSFT 01000013)
[ 0.017480] ACPI: SLIT 0x000000005FF13000 00006C (v01 INTEL TIANO 00000001 MSFT 01000013)
[ 0.017484] ACPI: SRAT 0x000000005FF11000 001130 (v03 INTEL TIANO 00000001 MSFT 01000013)
[ 0.017488] ACPI: SVOS 0x000000005FF10000 000032 (v01 INTEL TIANO 00000000 MSFT 01000013)
[ 0.017491] ACPI: WDDT 0x000000005FF0F000 000040 (v01 INTEL TIANO 00000000 MSFT 01000013)
[ 0.017495] ACPI: SSDT 0x000000005FDEC000 0F9430 (v02 INTEL SSDT PM 00004000 INTL 20130328)
[ 0.017499] ACPI: SSDT 0x000000005FDE9000 00246F (v02 INTEL SpsNm 00000002 INTL 20130328)
[ 0.017503] ACPI: SSDT 0x000000005FDE8000 000040 (v02 INTEL SpsNvs 00000002 INTL 20130328)
[ 0.017507] ACPI: PRAD 0x000000005FDE7000 000125 (v02 INTEL SpsPrAgg 00000002 INTL 20130328)
[ 0.017511] ACPI: SPCR 0x000000005FDE6000 000050 (v01 00000000 00000000)
[ 0.017515] ACPI: HEST 0x000000005FDE5000 0000A8 (v01 INTEL 00000001 INTL 00000001)
[ 0.017519] ACPI: BERT 0x000000005FF1F000 000030 (v01 INTEL 00000001 INTL 00000001)
[ 0.017523] ACPI: ERST 0x000000005FDE3000 000230 (v01 INTEL 00000001 INTL 00000001)
[ 0.017527] ACPI: EINJ 0x000000005FDE2000 000150 (v01 INTEL 00000001 INTL 00000001)
[ 0.017530] ACPI: Reserving FACP table memory at [mem 0x5ff1b000-0x5ff1b0f3]
[ 0.017532] ACPI: Reserving DSDT table memory at [mem 0x5fee6000-0x5ff0e25f]
[ 0.017533] ACPI: Reserving FACS table memory at [mem 0x5e4c6000-0x5e4c603f]
[ 0.017534] ACPI: Reserving TCPA table memory at [mem 0x5ff1e000-0x5ff1e063]
[ 0.017535] ACPI: Reserving SSDT table memory at [mem 0x5ff1d000-0x5ff1d3a1]
[ 0.017537] ACPI: Reserving BDAT table memory at [mem 0x5ff1c000-0x5ff1c02f]
[ 0.017538] ACPI: Reserving HPET table memory at [mem 0x5ff1a000-0x5ff1a037]
[ 0.017539] ACPI: Reserving APIC table memory at [mem 0x5ff19000-0x5ff19afb]
[ 0.017540] ACPI: Reserving MCFG table memory at [mem 0x5ff18000-0x5ff1803b]
[ 0.017541] ACPI: Reserving MSCT table memory at [mem 0x5ff17000-0x5ff170e7]
[ 0.017543] ACPI: Reserving PCCT table memory at [mem 0x5ff16000-0x5ff160ab]
[ 0.017544] ACPI: Reserving PMCT table memory at [mem 0x5ff15000-0x5ff1505f]
[ 0.017545] ACPI: Reserving RASF table memory at [mem 0x5ff14000-0x5ff1402f]
[ 0.017546] ACPI: Reserving SLIT table memory at [mem 0x5ff13000-0x5ff1306b]
[ 0.017547] ACPI: Reserving SRAT table memory at [mem 0x5ff11000-0x5ff1212f]
[ 0.017548] ACPI: Reserving SVOS table memory at [mem 0x5ff10000-0x5ff10031]
[ 0.017550] ACPI: Reserving WDDT table memory at [mem 0x5ff0f000-0x5ff0f03f]
[ 0.017551] ACPI: Reserving SSDT table memory at [mem 0x5fdec000-0x5fee542f]
[ 0.017552] ACPI: Reserving SSDT table memory at [mem 0x5fde9000-0x5fdeb46e]
[ 0.017553] ACPI: Reserving SSDT table memory at [mem 0x5fde8000-0x5fde803f]
[ 0.017554] ACPI: Reserving PRAD table memory at [mem 0x5fde7000-0x5fde7124]
[ 0.017555] ACPI: Reserving SPCR table memory at [mem 0x5fde6000-0x5fde604f]
[ 0.017557] ACPI: Reserving HEST table memory at [mem 0x5fde5000-0x5fde50a7]
[ 0.017558] ACPI: Reserving BERT table memory at [mem 0x5ff1f000-0x5ff1f02f]
[ 0.017559] ACPI: Reserving ERST table memory at [mem 0x5fde3000-0x5fde322f]
[ 0.017560] ACPI: Reserving EINJ table memory at [mem 0x5fde2000-0x5fde214f]
[ 0.017605] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[ 0.017607] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[ 0.017608] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[ 0.017609] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[ 0.017610] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[ 0.017611] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[ 0.017612] SRAT: PXM 0 -> APIC 0x10 -> Node 0
[ 0.017613] SRAT: PXM 0 -> APIC 0x12 -> Node 0
[ 0.017614] SRAT: PXM 0 -> APIC 0x14 -> Node 0
[ 0.017615] SRAT: PXM 0 -> APIC 0x16 -> Node 0
[ 0.017616] SRAT: PXM 0 -> APIC 0x18 -> Node 0
[ 0.017617] SRAT: PXM 0 -> APIC 0x1a -> Node 0
[ 0.017617] SRAT: PXM 0 -> APIC 0x20 -> Node 0
[ 0.017619] SRAT: PXM 0 -> APIC 0x22 -> Node 0
[ 0.017619] SRAT: PXM 0 -> APIC 0x24 -> Node 0
[ 0.017620] SRAT: PXM 0 -> APIC 0x26 -> Node 0
[ 0.017622] SRAT: PXM 0 -> APIC 0x28 -> Node 0
[ 0.017623] SRAT: PXM 0 -> APIC 0x2a -> Node 0
[ 0.017624] SRAT: PXM 0 -> APIC 0x30 -> Node 0
[ 0.017625] SRAT: PXM 0 -> APIC 0x32 -> Node 0
[ 0.017625] SRAT: PXM 0 -> APIC 0x34 -> Node 0
[ 0.017627] SRAT: PXM 0 -> APIC 0x36 -> Node 0
[ 0.017628] SRAT: PXM 0 -> APIC 0x38 -> Node 0
[ 0.017628] SRAT: PXM 0 -> APIC 0x3a -> Node 0
[ 0.017629] SRAT: PXM 1 -> APIC 0x40 -> Node 1
[ 0.017630] SRAT: PXM 1 -> APIC 0x42 -> Node 1
[ 0.017631] SRAT: PXM 1 -> APIC 0x44 -> Node 1
[ 0.017632] SRAT: PXM 1 -> APIC 0x46 -> Node 1
[ 0.017633] SRAT: PXM 1 -> APIC 0x48 -> Node 1
[ 0.017634] SRAT: PXM 1 -> APIC 0x4a -> Node 1
[ 0.017635] SRAT: PXM 1 -> APIC 0x50 -> Node 1
[ 0.017636] SRAT: PXM 1 -> APIC 0x52 -> Node 1
[ 0.017637] SRAT: PXM 1 -> APIC 0x54 -> Node 1
[ 0.017638] SRAT: PXM 1 -> APIC 0x56 -> Node 1
[ 0.017639] SRAT: PXM 1 -> APIC 0x58 -> Node 1
[ 0.017640] SRAT: PXM 1 -> APIC 0x5a -> Node 1
[ 0.017641] SRAT: PXM 1 -> APIC 0x60 -> Node 1
[ 0.017642] SRAT: PXM 1 -> APIC 0x62 -> Node 1
[ 0.017643] SRAT: PXM 1 -> APIC 0x64 -> Node 1
[ 0.017644] SRAT: PXM 1 -> APIC 0x66 -> Node 1
[ 0.017645] SRAT: PXM 1 -> APIC 0x68 -> Node 1
[ 0.017646] SRAT: PXM 1 -> APIC 0x6a -> Node 1
[ 0.017647] SRAT: PXM 1 -> APIC 0x70 -> Node 1
[ 0.017648] SRAT: PXM 1 -> APIC 0x72 -> Node 1
[ 0.017649] SRAT: PXM 1 -> APIC 0x74 -> Node 1
[ 0.017650] SRAT: PXM 1 -> APIC 0x76 -> Node 1
[ 0.017651] SRAT: PXM 1 -> APIC 0x78 -> Node 1
[ 0.017652] SRAT: PXM 1 -> APIC 0x7a -> Node 1
[ 0.017653] SRAT: PXM 2 -> APIC 0x80 -> Node 2
[ 0.017654] SRAT: PXM 2 -> APIC 0x82 -> Node 2
[ 0.017655] SRAT: PXM 2 -> APIC 0x84 -> Node 2
[ 0.017656] SRAT: PXM 2 -> APIC 0x86 -> Node 2
[ 0.017656] SRAT: PXM 2 -> APIC 0x88 -> Node 2
[ 0.017657] SRAT: PXM 2 -> APIC 0x8a -> Node 2
[ 0.017658] SRAT: PXM 2 -> APIC 0x90 -> Node 2
[ 0.017659] SRAT: PXM 2 -> APIC 0x92 -> Node 2
[ 0.017660] SRAT: PXM 2 -> APIC 0x94 -> Node 2
[ 0.017661] SRAT: PXM 2 -> APIC 0x96 -> Node 2
[ 0.017662] SRAT: PXM 2 -> APIC 0x98 -> Node 2
[ 0.017663] SRAT: PXM 2 -> APIC 0x9a -> Node 2
[ 0.017664] SRAT: PXM 2 -> APIC 0xa0 -> Node 2
[ 0.017666] SRAT: PXM 2 -> APIC 0xa2 -> Node 2
[ 0.017667] SRAT: PXM 2 -> APIC 0xa4 -> Node 2
[ 0.017668] SRAT: PXM 2 -> APIC 0xa6 -> Node 2
[ 0.017669] SRAT: PXM 2 -> APIC 0xa8 -> Node 2
[ 0.017670] SRAT: PXM 2 -> APIC 0xaa -> Node 2
[ 0.017671] SRAT: PXM 2 -> APIC 0xb0 -> Node 2
[ 0.017672] SRAT: PXM 2 -> APIC 0xb2 -> Node 2
[ 0.017673] SRAT: PXM 2 -> APIC 0xb4 -> Node 2
[ 0.017673] SRAT: PXM 2 -> APIC 0xb6 -> Node 2
[ 0.017674] SRAT: PXM 2 -> APIC 0xb8 -> Node 2
[ 0.017675] SRAT: PXM 2 -> APIC 0xba -> Node 2
[ 0.017676] SRAT: PXM 3 -> APIC 0xc0 -> Node 3
[ 0.017677] SRAT: PXM 3 -> APIC 0xc2 -> Node 3
[ 0.017678] SRAT: PXM 3 -> APIC 0xc4 -> Node 3
[ 0.017679] SRAT: PXM 3 -> APIC 0xc6 -> Node 3
[ 0.017680] SRAT: PXM 3 -> APIC 0xc8 -> Node 3
[ 0.017681] SRAT: PXM 3 -> APIC 0xca -> Node 3
[ 0.017682] SRAT: PXM 3 -> APIC 0xd0 -> Node 3
[ 0.017682] SRAT: PXM 3 -> APIC 0xd2 -> Node 3
[ 0.017683] SRAT: PXM 3 -> APIC 0xd4 -> Node 3
[ 0.017684] SRAT: PXM 3 -> APIC 0xd6 -> Node 3
[ 0.017685] SRAT: PXM 3 -> APIC 0xd8 -> Node 3
[ 0.017686] SRAT: PXM 3 -> APIC 0xda -> Node 3
[ 0.017687] SRAT: PXM 3 -> APIC 0xe0 -> Node 3
[ 0.017688] SRAT: PXM 3 -> APIC 0xe2 -> Node 3
[ 0.017689] SRAT: PXM 3 -> APIC 0xe4 -> Node 3
[ 0.017689] SRAT: PXM 3 -> APIC 0xe6 -> Node 3
[ 0.017690] SRAT: PXM 3 -> APIC 0xe8 -> Node 3
[ 0.017691] SRAT: PXM 3 -> APIC 0xea -> Node 3
[ 0.017692] SRAT: PXM 3 -> APIC 0xf0 -> Node 3
[ 0.017693] SRAT: PXM 3 -> APIC 0xf2 -> Node 3
[ 0.017694] SRAT: PXM 3 -> APIC 0xf4 -> Node 3
[ 0.017695] SRAT: PXM 3 -> APIC 0xf6 -> Node 3
[ 0.017696] SRAT: PXM 3 -> APIC 0xf8 -> Node 3
[ 0.017697] SRAT: PXM 3 -> APIC 0xfa -> Node 3
[ 0.017697] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[ 0.017698] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[ 0.017699] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[ 0.017700] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[ 0.017701] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[ 0.017702] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[ 0.017703] SRAT: PXM 0 -> APIC 0x11 -> Node 0
[ 0.017704] SRAT: PXM 0 -> APIC 0x13 -> Node 0
[ 0.017704] SRAT: PXM 0 -> APIC 0x15 -> Node 0
[ 0.017705] SRAT: PXM 0 -> APIC 0x17 -> Node 0
[ 0.017706] SRAT: PXM 0 -> APIC 0x19 -> Node 0
[ 0.017707] SRAT: PXM 0 -> APIC 0x1b -> Node 0
[ 0.017708] SRAT: PXM 0 -> APIC 0x21 -> Node 0
[ 0.017709] SRAT: PXM 0 -> APIC 0x23 -> Node 0
[ 0.017710] SRAT: PXM 0 -> APIC 0x25 -> Node 0
[ 0.017711] SRAT: PXM 0 -> APIC 0x27 -> Node 0
[ 0.017712] SRAT: PXM 0 -> APIC 0x29 -> Node 0
[ 0.017713] SRAT: PXM 0 -> APIC 0x2b -> Node 0
[ 0.017714] SRAT: PXM 0 -> APIC 0x31 -> Node 0
[ 0.017716] SRAT: PXM 0 -> APIC 0x33 -> Node 0
[ 0.017716] SRAT: PXM 0 -> APIC 0x35 -> Node 0
[ 0.017717] SRAT: PXM 0 -> APIC 0x37 -> Node 0
[ 0.017718] SRAT: PXM 0 -> APIC 0x39 -> Node 0
[ 0.017719] SRAT: PXM 0 -> APIC 0x3b -> Node 0
[ 0.017720] SRAT: PXM 1 -> APIC 0x41 -> Node 1
[ 0.017721] SRAT: PXM 1 -> APIC 0x43 -> Node 1
[ 0.017722] SRAT: PXM 1 -> APIC 0x45 -> Node 1
[ 0.017723] SRAT: PXM 1 -> APIC 0x47 -> Node 1
[ 0.017724] SRAT: PXM 1 -> APIC 0x49 -> Node 1
[ 0.017724] SRAT: PXM 1 -> APIC 0x4b -> Node 1
[ 0.017725] SRAT: PXM 1 -> APIC 0x51 -> Node 1
[ 0.017726] SRAT: PXM 1 -> APIC 0x53 -> Node 1
[ 0.017727] SRAT: PXM 1 -> APIC 0x55 -> Node 1
[ 0.017728] SRAT: PXM 1 -> APIC 0x57 -> Node 1
[ 0.017729] SRAT: PXM 1 -> APIC 0x59 -> Node 1
[ 0.017730] SRAT: PXM 1 -> APIC 0x5b -> Node 1
[ 0.017731] SRAT: PXM 1 -> APIC 0x61 -> Node 1
[ 0.017732] SRAT: PXM 1 -> APIC 0x63 -> Node 1
[ 0.017733] SRAT: PXM 1 -> APIC 0x65 -> Node 1
[ 0.017733] SRAT: PXM 1 -> APIC 0x67 -> Node 1
[ 0.017734] SRAT: PXM 1 -> APIC 0x69 -> Node 1
[ 0.017735] SRAT: PXM 1 -> APIC 0x6b -> Node 1
[ 0.017736] SRAT: PXM 1 -> APIC 0x71 -> Node 1
[ 0.017737] SRAT: PXM 1 -> APIC 0x73 -> Node 1
[ 0.017738] SRAT: PXM 1 -> APIC 0x75 -> Node 1
[ 0.017739] SRAT: PXM 1 -> APIC 0x77 -> Node 1
[ 0.017740] SRAT: PXM 1 -> APIC 0x79 -> Node 1
[ 0.017741] SRAT: PXM 1 -> APIC 0x7b -> Node 1
[ 0.017742] SRAT: PXM 2 -> APIC 0x81 -> Node 2
[ 0.017743] SRAT: PXM 2 -> APIC 0x83 -> Node 2
[ 0.017744] SRAT: PXM 2 -> APIC 0x85 -> Node 2
[ 0.017745] SRAT: PXM 2 -> APIC 0x87 -> Node 2
[ 0.017746] SRAT: PXM 2 -> APIC 0x89 -> Node 2
[ 0.017747] SRAT: PXM 2 -> APIC 0x8b -> Node 2
[ 0.017748] SRAT: PXM 2 -> APIC 0x91 -> Node 2
[ 0.017748] SRAT: PXM 2 -> APIC 0x93 -> Node 2
[ 0.017749] SRAT: PXM 2 -> APIC 0x95 -> Node 2
[ 0.017750] SRAT: PXM 2 -> APIC 0x97 -> Node 2
[ 0.017751] SRAT: PXM 2 -> APIC 0x99 -> Node 2
[ 0.017752] SRAT: PXM 2 -> APIC 0x9b -> Node 2
[ 0.017753] SRAT: PXM 2 -> APIC 0xa1 -> Node 2
[ 0.017754] SRAT: PXM 2 -> APIC 0xa3 -> Node 2
[ 0.017755] SRAT: PXM 2 -> APIC 0xa5 -> Node 2
[ 0.017756] SRAT: PXM 2 -> APIC 0xa7 -> Node 2
[ 0.017758] SRAT: PXM 2 -> APIC 0xa9 -> Node 2
[ 0.017759] SRAT: PXM 2 -> APIC 0xab -> Node 2
[ 0.017759] SRAT: PXM 2 -> APIC 0xb1 -> Node 2
[ 0.017760] SRAT: PXM 2 -> APIC 0xb3 -> Node 2
[ 0.017761] SRAT: PXM 2 -> APIC 0xb5 -> Node 2
[ 0.017762] SRAT: PXM 2 -> APIC 0xb7 -> Node 2
[ 0.017763] SRAT: PXM 2 -> APIC 0xb9 -> Node 2
[ 0.017764] SRAT: PXM 2 -> APIC 0xbb -> Node 2
[ 0.017765] SRAT: PXM 3 -> APIC 0xc1 -> Node 3
[ 0.017766] SRAT: PXM 3 -> APIC 0xc3 -> Node 3
[ 0.017766] SRAT: PXM 3 -> APIC 0xc5 -> Node 3
[ 0.017767] SRAT: PXM 3 -> APIC 0xc7 -> Node 3
[ 0.017768] SRAT: PXM 3 -> APIC 0xc9 -> Node 3
[ 0.017769] SRAT: PXM 3 -> APIC 0xcb -> Node 3
[ 0.017770] SRAT: PXM 3 -> APIC 0xd1 -> Node 3
[ 0.017771] SRAT: PXM 3 -> APIC 0xd3 -> Node 3
[ 0.017772] SRAT: PXM 3 -> APIC 0xd5 -> Node 3
[ 0.017773] SRAT: PXM 3 -> APIC 0xd7 -> Node 3
[ 0.017773] SRAT: PXM 3 -> APIC 0xd9 -> Node 3
[ 0.017774] SRAT: PXM 3 -> APIC 0xdb -> Node 3
[ 0.017775] SRAT: PXM 3 -> APIC 0xe1 -> Node 3
[ 0.017776] SRAT: PXM 3 -> APIC 0xe3 -> Node 3
[ 0.017777] SRAT: PXM 3 -> APIC 0xe5 -> Node 3
[ 0.017778] SRAT: PXM 3 -> APIC 0xe7 -> Node 3
[ 0.017779] SRAT: PXM 3 -> APIC 0xe9 -> Node 3
[ 0.017780] SRAT: PXM 3 -> APIC 0xeb -> Node 3
[ 0.017781] SRAT: PXM 3 -> APIC 0xf1 -> Node 3
[ 0.017781] SRAT: PXM 3 -> APIC 0xf3 -> Node 3
[ 0.017782] SRAT: PXM 3 -> APIC 0xf5 -> Node 3
[ 0.017783] SRAT: PXM 3 -> APIC 0xf7 -> Node 3
[ 0.017784] SRAT: PXM 3 -> APIC 0xf9 -> Node 3
[ 0.017785] SRAT: PXM 3 -> APIC 0xfb -> Node 3
[ 0.017789] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[ 0.017791] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x207fffffff]
[ 0.017793] ACPI: SRAT: Node 1 PXM 1 [mem 0x2080000000-0x407fffffff]
[ 0.017794] ACPI: SRAT: Node 2 PXM 2 [mem 0x4080000000-0x607fffffff]
[ 0.017796] ACPI: SRAT: Node 3 PXM 3 [mem 0x6080000000-0x807fffffff]
[ 0.017809] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x207fffffff] -> [mem 0x00000000-0x207fffffff]
[ 0.017824] NODE_DATA(0) allocated [mem 0x207ffd5000-0x207fffffff]
[ 0.017858] NODE_DATA(1) allocated [mem 0x407ffd5000-0x407fffffff]
[ 0.017932] NODE_DATA(2) allocated [mem 0x607ffd5000-0x607fffffff]
[ 0.018008] NODE_DATA(3) allocated [mem 0x807ffd4000-0x807fffefff]
[ 2.346034] Zone ranges:
[ 2.346037] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 2.346041] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]
[ 2.346043] Normal [mem 0x0000000100000000-0x000000807fffffff]
[ 2.346045] Device empty
[ 2.346046] Movable zone start for each node
[ 2.346050] Early memory node ranges
[ 2.346051] node 0: [mem 0x0000000000001000-0x000000000008dfff]
[ 2.346053] node 0: [mem 0x0000000000090000-0x000000000009ffff]
[ 2.346054] node 0: [mem 0x0000000000100000-0x000000005c687fff]
[ 2.346056] node 0: [mem 0x000000005ff21000-0x000000007bafffff]
[ 2.346057] node 0: [mem 0x0000000100000000-0x000000207fffffff]
[ 2.346075] node 1: [mem 0x0000002080000000-0x000000407fffffff]
[ 2.346100] node 2: [mem 0x0000004080000000-0x000000607fffffff]
[ 2.346121] node 3: [mem 0x0000006080000000-0x000000807fffffff]
[ 2.346140] Initmem setup node 0 [mem 0x0000000000001000-0x000000207fffffff]
[ 2.346150] Initmem setup node 1 [mem 0x0000002080000000-0x000000407fffffff]
[ 2.346157] Initmem setup node 2 [mem 0x0000004080000000-0x000000607fffffff]
[ 2.346162] Initmem setup node 3 [mem 0x0000006080000000-0x000000807fffffff]
[ 2.346168] On node 0, zone DMA: 1 pages in unavailable ranges
[ 2.346170] On node 0, zone DMA: 2 pages in unavailable ranges
[ 2.346210] On node 0, zone DMA: 96 pages in unavailable ranges
[ 2.351481] On node 0, zone DMA32: 14489 pages in unavailable ranges
[ 2.698032] On node 0, zone Normal: 17664 pages in unavailable ranges
[ 4.086505] ACPI: PM-Timer IO Port: 0x408
[ 4.086552] ACPI: LAPIC_NMI (acpi_id[0x00] high level lint[0x1])
[ 4.086554] ACPI: LAPIC_NMI (acpi_id[0x01] high level lint[0x1])
[ 4.086556] ACPI: LAPIC_NMI (acpi_id[0x02] high level lint[0x1])
[ 4.086557] ACPI: LAPIC_NMI (acpi_id[0x03] high level lint[0x1])
[ 4.086558] ACPI: LAPIC_NMI (acpi_id[0x04] high level lint[0x1])
[ 4.086559] ACPI: LAPIC_NMI (acpi_id[0x05] high level lint[0x1])
[ 4.086560] ACPI: LAPIC_NMI (acpi_id[0x06] high level lint[0x1])
[ 4.086561] ACPI: LAPIC_NMI (acpi_id[0x07] high level lint[0x1])
[ 4.086562] ACPI: LAPIC_NMI (acpi_id[0x08] high level lint[0x1])
[ 4.086564] ACPI: LAPIC_NMI (acpi_id[0x09] high level lint[0x1])
[ 4.086565] ACPI: LAPIC_NMI (acpi_id[0x0a] high level lint[0x1])
[ 4.086566] ACPI: LAPIC_NMI (acpi_id[0x0b] high level lint[0x1])
[ 4.086567] ACPI: LAPIC_NMI (acpi_id[0x0c] high level lint[0x1])
[ 4.086568] ACPI: LAPIC_NMI (acpi_id[0x0d] high level lint[0x1])
[ 4.086569] ACPI: LAPIC_NMI (acpi_id[0x0e] high level lint[0x1])
[ 4.086570] ACPI: LAPIC_NMI (acpi_id[0x0f] high level lint[0x1])
[ 4.086570] ACPI: LAPIC_NMI (acpi_id[0x10] high level lint[0x1])
[ 4.086572] ACPI: LAPIC_NMI (acpi_id[0x11] high level lint[0x1])
[ 4.086573] ACPI: LAPIC_NMI (acpi_id[0x12] high level lint[0x1])
[ 4.086574] ACPI: LAPIC_NMI (acpi_id[0x13] high level lint[0x1])
[ 4.086575] ACPI: LAPIC_NMI (acpi_id[0x14] high level lint[0x1])
[ 4.086576] ACPI: LAPIC_NMI (acpi_id[0x15] high level lint[0x1])
[ 4.086577] ACPI: LAPIC_NMI (acpi_id[0x16] high level lint[0x1])
[ 4.086578] ACPI: LAPIC_NMI (acpi_id[0x17] high level lint[0x1])
[ 4.086579] ACPI: LAPIC_NMI (acpi_id[0x18] high level lint[0x1])
[ 4.086580] ACPI: LAPIC_NMI (acpi_id[0x19] high level lint[0x1])
[ 4.086581] ACPI: LAPIC_NMI (acpi_id[0x1a] high level lint[0x1])
[ 4.086582] ACPI: LAPIC_NMI (acpi_id[0x1b] high level lint[0x1])
[ 4.086583] ACPI: LAPIC_NMI (acpi_id[0x1c] high level lint[0x1])
[ 4.086584] ACPI: LAPIC_NMI (acpi_id[0x1d] high level lint[0x1])
[ 4.086585] ACPI: LAPIC_NMI (acpi_id[0x1e] high level lint[0x1])
[ 4.086586] ACPI: LAPIC_NMI (acpi_id[0x1f] high level lint[0x1])
[ 4.086587] ACPI: LAPIC_NMI (acpi_id[0x20] high level lint[0x1])
[ 4.086588] ACPI: LAPIC_NMI (acpi_id[0x21] high level lint[0x1])
[ 4.086589] ACPI: LAPIC_NMI (acpi_id[0x22] high level lint[0x1])
[ 4.086590] ACPI: LAPIC_NMI (acpi_id[0x23] high level lint[0x1])
[ 4.086591] ACPI: LAPIC_NMI (acpi_id[0x24] high level lint[0x1])
[ 4.086592] ACPI: LAPIC_NMI (acpi_id[0x25] high level lint[0x1])
[ 4.086593] ACPI: LAPIC_NMI (acpi_id[0x26] high level lint[0x1])
[ 4.086594] ACPI: LAPIC_NMI (acpi_id[0x27] high level lint[0x1])
[ 4.086595] ACPI: LAPIC_NMI (acpi_id[0x28] high level lint[0x1])
[ 4.086596] ACPI: LAPIC_NMI (acpi_id[0x29] high level lint[0x1])
[ 4.086597] ACPI: LAPIC_NMI (acpi_id[0x2a] high level lint[0x1])
[ 4.086598] ACPI: LAPIC_NMI (acpi_id[0x2b] high level lint[0x1])
[ 4.086599] ACPI: LAPIC_NMI (acpi_id[0x2c] high level lint[0x1])
[ 4.086600] ACPI: LAPIC_NMI (acpi_id[0x2d] high level lint[0x1])
[ 4.086601] ACPI: LAPIC_NMI (acpi_id[0x2e] high level lint[0x1])
[ 4.086602] ACPI: LAPIC_NMI (acpi_id[0x2f] high level lint[0x1])
[ 4.086603] ACPI: LAPIC_NMI (acpi_id[0x30] high level lint[0x1])
[ 4.086604] ACPI: LAPIC_NMI (acpi_id[0x31] high level lint[0x1])
[ 4.086605] ACPI: LAPIC_NMI (acpi_id[0x32] high level lint[0x1])
[ 4.086606] ACPI: LAPIC_NMI (acpi_id[0x33] high level lint[0x1])
[ 4.086607] ACPI: LAPIC_NMI (acpi_id[0x34] high level lint[0x1])
[ 4.086608] ACPI: LAPIC_NMI (acpi_id[0x35] high level lint[0x1])
[ 4.086609] ACPI: LAPIC_NMI (acpi_id[0x36] high level lint[0x1])
[ 4.086610] ACPI: LAPIC_NMI (acpi_id[0x37] high level lint[0x1])
[ 4.086611] ACPI: LAPIC_NMI (acpi_id[0x38] high level lint[0x1])
[ 4.086612] ACPI: LAPIC_NMI (acpi_id[0x39] high level lint[0x1])
[ 4.086613] ACPI: LAPIC_NMI (acpi_id[0x3a] high level lint[0x1])
[ 4.086614] ACPI: LAPIC_NMI (acpi_id[0x3b] high level lint[0x1])
[ 4.086615] ACPI: LAPIC_NMI (acpi_id[0x3c] high level lint[0x1])
[ 4.086616] ACPI: LAPIC_NMI (acpi_id[0x3d] high level lint[0x1])
[ 4.086617] ACPI: LAPIC_NMI (acpi_id[0x3e] high level lint[0x1])
[ 4.086618] ACPI: LAPIC_NMI (acpi_id[0x3f] high level lint[0x1])
[ 4.086619] ACPI: LAPIC_NMI (acpi_id[0x40] high level lint[0x1])
[ 4.086620] ACPI: LAPIC_NMI (acpi_id[0x41] high level lint[0x1])
[ 4.086621] ACPI: LAPIC_NMI (acpi_id[0x42] high level lint[0x1])
[ 4.086622] ACPI: LAPIC_NMI (acpi_id[0x43] high level lint[0x1])
[ 4.086623] ACPI: LAPIC_NMI (acpi_id[0x44] high level lint[0x1])
[ 4.086624] ACPI: LAPIC_NMI (acpi_id[0x45] high level lint[0x1])
[ 4.086625] ACPI: LAPIC_NMI (acpi_id[0x46] high level lint[0x1])
[ 4.086626] ACPI: LAPIC_NMI (acpi_id[0x47] high level lint[0x1])
[ 4.086627] ACPI: LAPIC_NMI (acpi_id[0x48] high level lint[0x1])
[ 4.086628] ACPI: LAPIC_NMI (acpi_id[0x49] high level lint[0x1])
[ 4.086629] ACPI: LAPIC_NMI (acpi_id[0x4a] high level lint[0x1])
[ 4.086630] ACPI: LAPIC_NMI (acpi_id[0x4b] high level lint[0x1])
[ 4.086631] ACPI: LAPIC_NMI (acpi_id[0x4c] high level lint[0x1])
[ 4.086632] ACPI: LAPIC_NMI (acpi_id[0x4d] high level lint[0x1])
[ 4.086633] ACPI: LAPIC_NMI (acpi_id[0x4e] high level lint[0x1])
[ 4.086634] ACPI: LAPIC_NMI (acpi_id[0x4f] high level lint[0x1])
[ 4.086635] ACPI: LAPIC_NMI (acpi_id[0x50] high level lint[0x1])
[ 4.086636] ACPI: LAPIC_NMI (acpi_id[0x51] high level lint[0x1])
[ 4.086637] ACPI: LAPIC_NMI (acpi_id[0x52] high level lint[0x1])
[ 4.086638] ACPI: LAPIC_NMI (acpi_id[0x53] high level lint[0x1])
[ 4.086639] ACPI: LAPIC_NMI (acpi_id[0x54] high level lint[0x1])
[ 4.086640] ACPI: LAPIC_NMI (acpi_id[0x55] high level lint[0x1])
[ 4.086641] ACPI: LAPIC_NMI (acpi_id[0x56] high level lint[0x1])
[ 4.086642] ACPI: LAPIC_NMI (acpi_id[0x57] high level lint[0x1])
[ 4.086643] ACPI: LAPIC_NMI (acpi_id[0x58] high level lint[0x1])
[ 4.086643] ACPI: LAPIC_NMI (acpi_id[0x59] high level lint[0x1])
[ 4.086644] ACPI: LAPIC_NMI (acpi_id[0x5a] high level lint[0x1])
[ 4.086645] ACPI: LAPIC_NMI (acpi_id[0x5b] high level lint[0x1])
[ 4.086646] ACPI: LAPIC_NMI (acpi_id[0x5c] high level lint[0x1])
[ 4.086647] ACPI: LAPIC_NMI (acpi_id[0x5d] high level lint[0x1])
[ 4.086648] ACPI: LAPIC_NMI (acpi_id[0x5e] high level lint[0x1])
[ 4.086649] ACPI: LAPIC_NMI (acpi_id[0x5f] high level lint[0x1])
[ 4.086650] ACPI: LAPIC_NMI (acpi_id[0x60] high level lint[0x1])
[ 4.086651] ACPI: LAPIC_NMI (acpi_id[0x61] high level lint[0x1])
[ 4.086652] ACPI: LAPIC_NMI (acpi_id[0x62] high level lint[0x1])
[ 4.086653] ACPI: LAPIC_NMI (acpi_id[0x63] high level lint[0x1])
[ 4.086654] ACPI: LAPIC_NMI (acpi_id[0x64] high level lint[0x1])
[ 4.086655] ACPI: LAPIC_NMI (acpi_id[0x65] high level lint[0x1])
[ 4.086656] ACPI: LAPIC_NMI (acpi_id[0x66] high level lint[0x1])
[ 4.086657] ACPI: LAPIC_NMI (acpi_id[0x67] high level lint[0x1])
[ 4.086658] ACPI: LAPIC_NMI (acpi_id[0x68] high level lint[0x1])
[ 4.086658] ACPI: LAPIC_NMI (acpi_id[0x69] high level lint[0x1])
[ 4.086659] ACPI: LAPIC_NMI (acpi_id[0x6a] high level lint[0x1])
[ 4.086660] ACPI: LAPIC_NMI (acpi_id[0x6b] high level lint[0x1])
[ 4.086661] ACPI: LAPIC_NMI (acpi_id[0x6c] high level lint[0x1])
[ 4.086662] ACPI: LAPIC_NMI (acpi_id[0x6d] high level lint[0x1])
[ 4.086663] ACPI: LAPIC_NMI (acpi_id[0x6e] high level lint[0x1])
[ 4.086665] ACPI: LAPIC_NMI (acpi_id[0x6f] high level lint[0x1])
[ 4.086666] ACPI: LAPIC_NMI (acpi_id[0x70] high level lint[0x1])
[ 4.086667] ACPI: LAPIC_NMI (acpi_id[0x71] high level lint[0x1])
[ 4.086668] ACPI: LAPIC_NMI (acpi_id[0x72] high level lint[0x1])
[ 4.086669] ACPI: LAPIC_NMI (acpi_id[0x73] high level lint[0x1])
[ 4.086671] ACPI: LAPIC_NMI (acpi_id[0x74] high level lint[0x1])
[ 4.086672] ACPI: LAPIC_NMI (acpi_id[0x75] high level lint[0x1])
[ 4.086673] ACPI: LAPIC_NMI (acpi_id[0x76] high level lint[0x1])
[ 4.086674] ACPI: LAPIC_NMI (acpi_id[0x77] high level lint[0x1])
[ 4.086675] ACPI: LAPIC_NMI (acpi_id[0x78] high level lint[0x1])
[ 4.086676] ACPI: LAPIC_NMI (acpi_id[0x79] high level lint[0x1])
[ 4.086677] ACPI: LAPIC_NMI (acpi_id[0x7a] high level lint[0x1])
[ 4.086678] ACPI: LAPIC_NMI (acpi_id[0x7b] high level lint[0x1])
[ 4.086679] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 4.086680] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 4.086681] ACPI: LAPIC_NMI (acpi_id[0x7d] high level lint[0x1])
[ 4.086682] ACPI: LAPIC_NMI (acpi_id[0x7e] high level lint[0x1])
[ 4.086683] ACPI: LAPIC_NMI (acpi_id[0x7f] high level lint[0x1])
[ 4.086684] ACPI: LAPIC_NMI (acpi_id[0x80] high level lint[0x1])
[ 4.086685] ACPI: LAPIC_NMI (acpi_id[0x81] high level lint[0x1])
[ 4.086685] ACPI: LAPIC_NMI (acpi_id[0x82] high level lint[0x1])
[ 4.086686] ACPI: LAPIC_NMI (acpi_id[0x83] high level lint[0x1])
[ 4.086687] ACPI: LAPIC_NMI (acpi_id[0x84] high level lint[0x1])
[ 4.086688] ACPI: LAPIC_NMI (acpi_id[0x85] high level lint[0x1])
[ 4.086689] ACPI: LAPIC_NMI (acpi_id[0x86] high level lint[0x1])
[ 4.086690] ACPI: LAPIC_NMI (acpi_id[0x87] high level lint[0x1])
[ 4.086691] ACPI: LAPIC_NMI (acpi_id[0x88] high level lint[0x1])
[ 4.086692] ACPI: LAPIC_NMI (acpi_id[0x89] high level lint[0x1])
[ 4.086693] ACPI: LAPIC_NMI (acpi_id[0x8a] high level lint[0x1])
[ 4.086694] ACPI: LAPIC_NMI (acpi_id[0x8b] high level lint[0x1])
[ 4.086695] ACPI: LAPIC_NMI (acpi_id[0x8c] high level lint[0x1])
[ 4.086696] ACPI: LAPIC_NMI (acpi_id[0x8d] high level lint[0x1])
[ 4.086697] ACPI: LAPIC_NMI (acpi_id[0x8f] high level lint[0x1])
[ 4.086698] ACPI: LAPIC_NMI (acpi_id[0x90] high level lint[0x1])
[ 4.086699] ACPI: LAPIC_NMI (acpi_id[0x91] high level lint[0x1])
[ 4.086700] ACPI: LAPIC_NMI (acpi_id[0x92] high level lint[0x1])
[ 4.086700] ACPI: LAPIC_NMI (acpi_id[0x93] high level lint[0x1])
[ 4.086701] ACPI: LAPIC_NMI (acpi_id[0x94] high level lint[0x1])
[ 4.086702] ACPI: LAPIC_NMI (acpi_id[0x95] high level lint[0x1])
[ 4.086703] ACPI: LAPIC_NMI (acpi_id[0x96] high level lint[0x1])
[ 4.086704] ACPI: LAPIC_NMI (acpi_id[0x97] high level lint[0x1])
[ 4.086705] ACPI: LAPIC_NMI (acpi_id[0x98] high level lint[0x1])
[ 4.086706] ACPI: LAPIC_NMI (acpi_id[0x99] high level lint[0x1])
[ 4.086707] ACPI: LAPIC_NMI (acpi_id[0x9a] high level lint[0x1])
[ 4.086708] ACPI: LAPIC_NMI (acpi_id[0x9b] high level lint[0x1])
[ 4.086709] ACPI: LAPIC_NMI (acpi_id[0x9c] high level lint[0x1])
[ 4.086710] ACPI: LAPIC_NMI (acpi_id[0x9d] high level lint[0x1])
[ 4.086711] ACPI: LAPIC_NMI (acpi_id[0x9e] high level lint[0x1])
[ 4.086712] ACPI: LAPIC_NMI (acpi_id[0x9f] high level lint[0x1])
[ 4.086713] ACPI: LAPIC_NMI (acpi_id[0xa0] high level lint[0x1])
[ 4.086714] ACPI: LAPIC_NMI (acpi_id[0xa1] high level lint[0x1])
[ 4.086715] ACPI: LAPIC_NMI (acpi_id[0xa2] high level lint[0x1])
[ 4.086717] ACPI: LAPIC_NMI (acpi_id[0xa3] high level lint[0x1])
[ 4.086718] ACPI: LAPIC_NMI (acpi_id[0xa4] high level lint[0x1])
[ 4.086719] ACPI: LAPIC_NMI (acpi_id[0xa5] high level lint[0x1])
[ 4.086720] ACPI: LAPIC_NMI (acpi_id[0xa6] high level lint[0x1])
[ 4.086721] ACPI: LAPIC_NMI (acpi_id[0xa7] high level lint[0x1])
[ 4.086722] ACPI: LAPIC_NMI (acpi_id[0xa8] high level lint[0x1])
[ 4.086723] ACPI: LAPIC_NMI (acpi_id[0xa9] high level lint[0x1])
[ 4.086724] ACPI: LAPIC_NMI (acpi_id[0xaa] high level lint[0x1])
[ 4.086724] ACPI: LAPIC_NMI (acpi_id[0xab] high level lint[0x1])
[ 4.086726] ACPI: LAPIC_NMI (acpi_id[0xac] high level lint[0x1])
[ 4.086727] ACPI: LAPIC_NMI (acpi_id[0xad] high level lint[0x1])
[ 4.086728] ACPI: LAPIC_NMI (acpi_id[0xae] high level lint[0x1])
[ 4.086729] ACPI: LAPIC_NMI (acpi_id[0xaf] high level lint[0x1])
[ 4.086730] ACPI: LAPIC_NMI (acpi_id[0xb0] high level lint[0x1])
[ 4.086731] ACPI: LAPIC_NMI (acpi_id[0xb1] high level lint[0x1])
[ 4.086732] ACPI: LAPIC_NMI (acpi_id[0xb2] high level lint[0x1])
[ 4.086733] ACPI: LAPIC_NMI (acpi_id[0xb3] high level lint[0x1])
[ 4.086734] ACPI: LAPIC_NMI (acpi_id[0xb4] high level lint[0x1])
[ 4.086735] ACPI: LAPIC_NMI (acpi_id[0xb5] high level lint[0x1])
[ 4.086736] ACPI: LAPIC_NMI (acpi_id[0xb6] high level lint[0x1])
[ 4.086737] ACPI: LAPIC_NMI (acpi_id[0xb7] high level lint[0x1])
[ 4.086738] ACPI: LAPIC_NMI (acpi_id[0xb8] high level lint[0x1])
[ 4.086739] ACPI: LAPIC_NMI (acpi_id[0xb9] high level lint[0x1])
[ 4.086740] ACPI: LAPIC_NMI (acpi_id[0xba] high level lint[0x1])
[ 4.086741] ACPI: LAPIC_NMI (acpi_id[0xbb] high level lint[0x1])
[ 4.086742] ACPI: LAPIC_NMI (acpi_id[0xbc] high level lint[0x1])
[ 4.086743] ACPI: LAPIC_NMI (acpi_id[0xbd] high level lint[0x1])
[ 4.086744] ACPI: LAPIC_NMI (acpi_id[0xbe] high level lint[0x1])
[ 4.086745] ACPI: LAPIC_NMI (acpi_id[0xbf] high level lint[0x1])
[ 4.086756] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[ 4.086761] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47
[ 4.086766] IOAPIC[2]: apic_id 10, version 32, address 0xfec40000, GSI 48-71
[ 4.086771] IOAPIC[3]: apic_id 11, version 32, address 0xfec80000, GSI 72-95
[ 4.086776] IOAPIC[4]: apic_id 12, version 32, address 0xfecc0000, GSI 96-119
[ 4.086780] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 4.086782] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 4.086791] ACPI: Using ACPI (MADT) for SMP configuration information
[ 4.086793] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[ 4.086798] ACPI: SPCR: SPCR table version 1
[ 4.086800] ACPI: SPCR: console: uart,io,0x3f8,115200
[ 4.086802] TSC deadline timer available
[ 4.086804] smpboot: Allowing 192 CPUs, 0 hotplug CPUs
[ 4.086834] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 4.086837] PM: hibernation: Registered nosave memory: [mem 0x0008e000-0x0008ffff]
[ 4.086839] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[ 4.086842] PM: hibernation: Registered nosave memory: [mem 0x5af75000-0x5af75fff]
[ 4.086844] PM: hibernation: Registered nosave memory: [mem 0x5af7d000-0x5af7dfff]
[ 4.086845] PM: hibernation: Registered nosave memory: [mem 0x5af7e000-0x5af7efff]
[ 4.086847] PM: hibernation: Registered nosave memory: [mem 0x5afa2000-0x5afa2fff]
[ 4.086848] PM: hibernation: Registered nosave memory: [mem 0x5afa3000-0x5afa3fff]
[ 4.086850] PM: hibernation: Registered nosave memory: [mem 0x5afc7000-0x5afc7fff]
[ 4.086851] PM: hibernation: Registered nosave memory: [mem 0x5afc8000-0x5afc8fff]
[ 4.086854] PM: hibernation: Registered nosave memory: [mem 0x5b00f000-0x5b00ffff]
[ 4.086856] PM: hibernation: Registered nosave memory: [mem 0x5c688000-0x5db85fff]
[ 4.086857] PM: hibernation: Registered nosave memory: [mem 0x5db86000-0x5fd97fff]
[ 4.086858] PM: hibernation: Registered nosave memory: [mem 0x5fd98000-0x5ff20fff]
[ 4.086861] PM: hibernation: Registered nosave memory: [mem 0x7a88a000-0x7a88afff]
[ 4.086863] PM: hibernation: Registered nosave memory: [mem 0x7bb00000-0x7fffffff]
[ 4.086864] PM: hibernation: Registered nosave memory: [mem 0x80000000-0xfed1bfff]
[ 4.086866] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[ 4.086866] PM: hibernation: Registered nosave memory: [mem 0xfed20000-0xffffffff]
[ 4.086869] [mem 0x80000000-0xfed1bfff] available for PCI devices
[ 4.086872] Booting paravirtualized kernel on bare hardware
[ 4.086875] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[ 4.094501] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:192 nr_cpu_ids:192 nr_node_ids:4
[ 4.115172] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144
[ 4.115422] Fallback order for Node 0: 0 1 2 3
[ 4.115428] Fallback order for Node 1: 1 2 3 0
[ 4.115433] Fallback order for Node 2: 2 3 0 1
[ 4.115437] Fallback order for Node 3: 3 0 1 2
[ 4.115456] Built 4 zonelists, mobility grouping on. Total pages: 132088407
[ 4.115458] Policy zone: Normal
[ 4.115460] Kernel command line: BOOT_IMAGE=(hd1,gpt2)/vmlinuz-6.2.0-rc2+ root=UUID=c1fd9bc7-73bf-4cc4-b72b-a369bdec1a5e ro rootflags=subvol=root console=tty1 console=ttyS0,115200 intel_iommu=on,sm_on
[ 4.115567] DMAR: IOMMU enabled
[ 4.115569] DMAR: Enable scalable mode if hardware supports
[ 4.115573] Unknown kernel command line parameters "BOOT_IMAGE=(hd1,gpt2)/vmlinuz-6.2.0-rc2+", will be passed to user space.
[ 4.115584] printk: log_buf_len individual max cpu contribution: 4096 bytes
[ 4.115585] printk: log_buf_len total cpu_extra contributions: 782336 bytes
[ 4.115586] printk: log_buf_len min size: 262144 bytes
[ 4.117963] printk: log_buf_len: 1048576 bytes
[ 4.117964] printk: early log buf free: 223560(85%)
[ 4.123838] mem auto-init: stack:off, heap alloc:off, heap free:off
[ 4.123844] software IO TLB: area num 256.
[ 6.289468] Memory: 527824592K/536741904K available (18432K kernel code, 3115K rwdata, 7072K rodata, 4056K init, 5748K bss, 8917052K reserved, 0K cma-reserved)
[ 6.291250] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=192, Nodes=4
[ 6.291348] Kernel/User page tables isolation: enabled
[ 6.291660] ftrace: allocating 49654 entries in 194 pages
[ 6.303256] ftrace: allocated 194 pages with 3 groups
[ 6.304934] Dynamic Preempt: voluntary
[ 6.305994] rcu: Preemptible hierarchical RCU implementation.
[ 6.305995] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=192.
[ 6.305998] Trampoline variant of Tasks RCU enabled.
[ 6.305999] Rude variant of Tasks RCU enabled.
[ 6.306000] Tracing variant of Tasks RCU enabled.
[ 6.306002] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.
[ 6.306003] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=192
[ 6.312853] NR_IRQS: 524544, nr_irqs: 3592, preallocated irqs: 16
[ 6.313358] rcu: srcu_init: Setting srcu_struct sizes to big.
[ 6.314186] Console: colour dummy device 80x25
[ 6.314189] printk: console [tty1] enabled
[ 6.315270] printk: console [ttyS0] enabled
[ 10.251763] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[ 10.264294] ACPI: Core revision 20221020
[ 10.269842] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[ 10.280055] APIC: Switch to symmetric I/O mode setup
[ 10.285790] x2apic: IRQ remapping doesn't support X2APIC mode
[ 10.292341] Switched APIC routing to physical flat.
[ 10.298670] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 10.310094] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x1fa1d748248, max_idle_ns: 440795282666 ns
[ 10.321853] Calibrating delay loop (skipped), value calculated using timer frequency.. 4388.96 BogoMIPS (lpj=2194483)
[ 10.322855] pid_max: default: 196608 minimum: 1536
[ 10.338163] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf,landlock
[ 10.339853] Yama: becoming mindful.
[ 10.340880] SELinux: Initializing.
[ 10.342942] LSM support for eBPF active
[ 10.343854] landlock: Up and running.
[ 10.384399] Dentry cache hash table entries: 16777216 (order: 15, 134217728 bytes, vmalloc hugepage)
[ 10.405183] Inode-cache hash table entries: 8388608 (order: 14, 67108864 bytes, vmalloc hugepage)
[ 10.406603] Mount-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[ 10.408252] Mountpoint-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[ 10.410978] x86/cpu: VMX (outside TXT) disabled by BIOS
[ 10.411860] CPU0: Thermal monitoring enabled (TM1)
[ 10.412940] process: using mwait in idle threads
[ 10.413858] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8
[ 10.414852] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4
[ 10.415860] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[ 10.416856] Spectre V2 : Mitigation: Retpolines
[ 10.417852] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[ 10.418853] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT
[ 10.419853] Spectre V2 : Enabling Restricted Speculation for firmware calls
[ 10.420857] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[ 10.421853] Spectre V2 : User space: Mitigation: STIBP via prctl
[ 10.422853] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl
[ 10.423862] MDS: Mitigation: Clear CPU buffers
[ 10.424853] TAA: Mitigation: Clear CPU buffers
[ 10.425854] MMIO Stale Data: Mitigation: Clear CPU buffers
[ 10.447591] Freeing SMP alternatives memory: 44K
[ 10.449247] smpboot: CPU0: Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz (family: 0x6, model: 0x4f, stepping: 0x1)
[ 10.450351] cblist_init_generic: Setting adjustable number of callback queues.
[ 10.450853] cblist_init_generic: Setting shift to 8 and lim to 1.
[ 10.451958] cblist_init_generic: Setting shift to 8 and lim to 1.
[ 10.452916] cblist_init_generic: Setting shift to 8 and lim to 1.
[ 10.453878] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver.
[ 10.454858] ... version: 3
[ 10.455852] ... bit width: 48
[ 10.456852] ... generic registers: 4
[ 10.457854] ... value mask: 0000ffffffffffff
[ 10.458852] ... max period: 00007fffffffffff
[ 10.459852] ... fixed-purpose events: 3
[ 10.460852] ... event mask: 000000070000000f
[ 10.462156] Estimated ratio of average max frequency by base frequency (times 1024): 1442
[ 10.462891] rcu: Hierarchical SRCU implementation.
[ 10.463856] rcu: Max phase no-delay instances is 400.
[ 10.489986] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[ 10.494873] smp: Bringing up secondary CPUs ...
[ 10.496082] x86: Booting SMP configuration:
[ 10.496856] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20 #21 #22 #23
[ 10.740864] .... node #1, CPUs: #24
[ 4.000425] smpboot: CPU 24 Converting physical 0 to logical die 1
[ 10.824156] #25 #26 #27 #28 #29 #30 #31 #32 #33 #34 #35 #36 #37 #38 #39 #40 #41 #42 #43 #44 #45 #46 #47
[ 11.073855] .... node #2, CPUs: #48
[ 4.000425] smpboot: CPU 48 Converting physical 0 to logical die 2
[ 11.158136] #49 #50 #51 #52 #53 #54 #55 #56 #57 #58 #59 #60 #61 #62 #63 #64 #65 #66 #67 #68 #69 #70 #71
[ 11.408855] .... node #3, CPUs: #72
[ 4.000425] smpboot: CPU 72 Converting physical 0 to logical die 3
[ 11.493125] #73 #74 #75 #76 #77 #78 #79 #80 #81 #82 #83 #84 #85 #86 #87 #88 #89 #90 #91 #92 #93 #94 #95
[ 11.743857] .... node #0, CPUs: #96
[ 11.745349] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details.
[ 11.746856] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details.
[ 11.747857] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details.
[ 11.749142] #97 #98 #99 #100 #101 #102 #103 #104 #105 #106 #107 #108 #109 #110 #111 #112 #113 #114 #115 #116 #117 #118 #119
[ 11.843864] .... node #1, CPUs: #120 #121 #122 #123 #124 #125 #126 #127 #128 #129 #130 #131 #132 #133 #134 #135 #136 #137 #138 #139 #140 #141 #142 #143
[ 11.947855] .... node #2, CPUs: #144 #145 #146 #147 #148 #149 #150 #151 #152 #153 #154 #155 #156 #157 #158 #159 #160 #161 #162 #163 #164 #165 #166 #167
[ 12.052855] .... node #3, CPUs: #168 #169 #170 #171 #172 #173 #174 #175 #176 #177 #178 #179 #180 #181 #182 #183 #184 #185 #186 #187 #188 #189 #190 #191
[ 12.158952] smp: Brought up 4 nodes, 192 CPUs
[ 12.160853] smpboot: Max logical packages: 4
[ 12.161866] smpboot: Total of 192 processors activated (843818.11 BogoMIPS)
[ 12.210852] devtmpfs: initialized
[ 12.211951] x86/mm: Memory block size: 2048MB
[ 12.217543] ACPI: PM: Registering ACPI NVS region [mem 0x5db86000-0x5fd97fff] (35725312 bytes)
[ 12.219474] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[ 12.219980] futex hash table entries: 65536 (order: 10, 4194304 bytes, vmalloc)
[ 12.222640] pinctrl core: initialized pinctrl subsystem
[ 12.223090] PM: RTC time: 16:43:26, date: 2023-01-05
[ 12.228113] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[ 12.229063] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations
[ 12.229870] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[ 12.230869] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[ 12.231900] audit: initializing netlink subsys (disabled)
[ 12.232897] audit: type=2000 audit(1672937000.920:1): state=initialized audit_enabled=0 res=1
[ 12.233544] thermal_sys: Registered thermal governor 'fair_share'
[ 12.233856] thermal_sys: Registered thermal governor 'bang_bang'
[ 12.234853] thermal_sys: Registered thermal governor 'step_wise'
[ 12.235852] thermal_sys: Registered thermal governor 'user_space'
[ 12.236918] cpuidle: using governor menu
[ 12.248056] Detected 2 PCC Subspaces
[ 12.251859] Registering PCC driver as Mailbox controller
[ 12.260135] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[ 12.267867] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 12.276586] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[ 12.286863] PCI: not using MMCONFIG
[ 12.290859] PCI: Using configuration type 1 for base access
[ 12.318062] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[ 12.329023] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
[ 12.336858] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page
[ 12.343856] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[ 12.351856] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page
[ 12.360197] cryptd: max_cpu_qlen set to 1000
[ 12.365984] raid6: skipped pq benchmark and selected avx2x4
[ 12.371859] raid6: using avx2x2 recovery algorithm
[ 12.378200] fbcon: Taking over console
[ 12.382216] ACPI: Added _OSI(Module Device)
[ 12.386856] ACPI: Added _OSI(Processor Device)
[ 12.391855] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 12.396858] ACPI: Added _OSI(Processor Aggregator Device)
[ 12.682527] ACPI: 5 ACPI AML tables successfully acquired and loaded
[ 12.729965] ACPI: Dynamic OEM Table Load:
[ 12.741960] ACPI BIOS Error (bug): AE_AML_BUFFER_LIMIT, Field [CPB3] at bit offset/length 64/32 exceeds size of target Buffer (64 bits) (20221020/dsopcode-198)
[ 12.757864] ACPI Error: Aborting method \_SB._OSC due to previous error (AE_AML_BUFFER_LIMIT) (20221020/psparse-529)
[ 12.855740] ACPI: Interpreter enabled
[ 12.859883] ACPI: PM: (supports S0 S4 S5)
[ 12.864855] ACPI: Using IOAPIC for interrupt routing
[ 12.869889] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[ 12.889522] [Firmware Info]: PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] not reserved in ACPI motherboard resources
[ 12.901859] PCI: not using MMCONFIG
[ 12.905940] HEST: Table parsing has been initialized.
[ 12.911754] GHES: APEI firmware first mode is enabled by WHEA _OSC.
[ 12.918867] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 12.929861] PCI: Using E820 reservations for host bridge windows
[ 12.938689] ACPI: Enabled 6 GPEs in block 00 to 3F
[ 13.354431] ACPI: PCI Root Bridge [UNC3] (domain 0000 [bus ff])
[ 13.360867] acpi PNP0A03:00: _OSC: OS supports [ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 13.369858] acpi PNP0A03:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI]
[ 13.380875] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ 13.392913] PCI host bridge to bus 0000:ff
[ 13.397856] pci_bus 0000:ff: Unknown NUMA node; performance will be reduced
[ 13.404856] pci_bus 0000:ff: root bus resource [bus ff]
[ 13.410880] pci 0000:ff:08.0: [8086:6f80] type 00 class 0x088000
[ 13.417984] pci 0000:ff:08.2: [8086:6f32] type 00 class 0x110100
[ 13.424955] pci 0000:ff:09.0: [8086:6f90] type 00 class 0x088000
[ 13.431963] pci 0000:ff:09.2: [8086:6f33] type 00 class 0x110100
[ 13.437958] pci 0000:ff:0a.0: [8086:6f40] type 00 class 0x088000
[ 13.444963] pci 0000:ff:0a.2: [8086:6f3a] type 00 class 0x110100
[ 13.451968] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000
[ 13.458971] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100
[ 13.465963] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100
[ 13.471994] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000
[ 13.478978] pci 0000:ff:0b.4: [8086:6f41] type 00 class 0x088000
[ 13.485948] pci 0000:ff:0b.5: [8086:6f3e] type 00 class 0x110100
[ 13.492969] pci 0000:ff:0b.6: [8086:6f3f] type 00 class 0x110100
[ 13.499947] pci 0000:ff:0b.7: [8086:6f7e] type 00 class 0x088000
[ 13.506962] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000
[ 13.512941] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000
[ 13.519965] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000
[ 13.526945] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000
[ 13.533966] pci 0000:ff:0c.4: [8086:6fe4] type 00 class 0x088000
[ 13.540967] pci 0000:ff:0c.5: [8086:6fe5] type 00 class 0x088000
[ 13.546964] pci 0000:ff:0c.6: [8086:6fe6] type 00 class 0x088000
[ 13.553948] pci 0000:ff:0c.7: [8086:6fe7] type 00 class 0x088000
[ 13.560969] pci 0000:ff:0d.0: [8086:6fe8] type 00 class 0x088000
[ 13.567948] pci 0000:ff:0d.1: [8086:6fe9] type 00 class 0x088000
[ 13.574960] pci 0000:ff:0d.2: [8086:6fea] type 00 class 0x088000
[ 13.580943] pci 0000:ff:0d.3: [8086:6feb] type 00 class 0x088000
[ 13.587963] pci 0000:ff:0d.4: [8086:6fec] type 00 class 0x088000
[ 13.594946] pci 0000:ff:0d.5: [8086:6fed] type 00 class 0x088000
[ 13.601961] pci 0000:ff:0d.6: [8086:6fee] type 00 class 0x088000
[ 13.608958] pci 0000:ff:0d.7: [8086:6fef] type 00 class 0x088000
[ 13.615861] pci 0000:ff:0e.0: [8086:6ff0] type 00 class 0x088000
[ 13.621980] pci 0000:ff:0e.1: [8086:6ff1] type 00 class 0x088000
[ 13.628953] pci 0000:ff:0e.2: [8086:6ff2] type 00 class 0xffffff
[ 13.635957] pci 0000:ff:0e.3: [8086:6ff3] type 00 class 0xffffff
[ 13.642942] pci 0000:ff:0e.4: [8086:6ff4] type 00 class 0xffffff
[ 13.648961] pci 0000:ff:0e.5: [8086:6ff5] type 00 class 0xffffff
[ 13.655945] pci 0000:ff:0e.6: [8086:6ff6] type 00 class 0xffffff
[ 13.662959] pci 0000:ff:0e.7: [8086:6ff7] type 00 class 0xffffff
[ 13.669948] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000
[ 13.676964] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000
[ 13.683995] pci 0000:ff:0f.2: [8086:6ffa] type 00 class 0x088000
[ 13.689973] pci 0000:ff:0f.3: [8086:6ffb] type 00 class 0x088000
[ 13.696947] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000
[ 13.703956] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000
[ 13.710941] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000
[ 13.717968] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000
[ 13.723935] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100
[ 13.730953] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000
[ 13.737969] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000
[ 13.744957] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000
[ 13.751925] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100
[ 13.757962] pci 0000:ff:12.4: [8086:6f60] type 00 class 0x088000
[ 13.764922] pci 0000:ff:12.5: [8086:6f38] type 00 class 0x110100
[ 13.771973] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000
[ 13.778971] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000
[ 13.785958] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000
[ 13.791987] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000
[ 13.798969] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000
[ 13.805986] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000
[ 13.812966] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000
[ 13.819966] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000
[ 13.826950] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000
[ 13.832962] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000
[ 13.839978] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000
[ 13.846994] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000
[ 13.853960] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000
[ 13.860967] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000
[ 13.866969] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000
[ 13.873959] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000
[ 13.880969] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000
[ 13.887972] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000
[ 13.894989] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000
[ 13.901901] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000
[ 13.908003] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000
[ 13.914969] pci 0000:ff:16.1: [8086:6f79] type 00 class 0x088000
[ 13.921994] pci 0000:ff:16.2: [8086:6f6a] type 00 class 0x088000
[ 13.928985] pci 0000:ff:16.3: [8086:6f6b] type 00 class 0x088000
[ 13.935980] pci 0000:ff:16.4: [8086:6f6c] type 00 class 0x088000
[ 13.941990] pci 0000:ff:16.5: [8086:6f6d] type 00 class 0x088000
[ 13.949024] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000
[ 13.955990] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000
[ 13.962958] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000
[ 13.969998] pci 0000:ff:17.1: [8086:6fd1] type 00 class 0x088000
[ 13.976972] pci 0000:ff:17.2: [8086:6fd2] type 00 class 0x088000
[ 13.983994] pci 0000:ff:17.3: [8086:6fd3] type 00 class 0x088000
[ 13.989984] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000
[ 13.996954] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000
[ 14.003972] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000
[ 14.010954] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000
[ 14.017969] pci 0000:ff:18.0: [8086:6fd4] type 00 class 0x088000
[ 14.024992] pci 0000:ff:18.1: [8086:6fd5] type 00 class 0x088000
[ 14.030969] pci 0000:ff:18.2: [8086:6fd6] type 00 class 0x088000
[ 14.037994] pci 0000:ff:18.3: [8086:6fd7] type 00 class 0x088000
[ 14.044999] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000
[ 14.051977] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000
[ 14.058973] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000
[ 14.065054] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000
[ 14.071945] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000
[ 14.078969] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000
[ 14.085974] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000
[ 14.093228] ACPI: PCI Root Bridge [UNC2] (domain 0000 [bus bf])
[ 14.099861] acpi PNP0A03:01: _OSC: OS supports [ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 14.108858] acpi PNP0A03:01: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI]
[ 14.119875] acpi PNP0A03:01: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ 14.131934] PCI host bridge to bus 0000:bf
[ 14.136856] pci_bus 0000:bf: Unknown NUMA node; performance will be reduced
[ 14.143856] pci_bus 0000:bf: root bus resource [bus bf]
[ 14.149909] pci 0000:bf:08.0: [8086:6f80] type 00 class 0x088000
[ 14.156962] pci 0000:bf:08.2: [8086:6f32] type 00 class 0x110100
[ 14.163972] pci 0000:bf:09.0: [8086:6f90] type 00 class 0x088000
[ 14.170946] pci 0000:bf:09.2: [8086:6f33] type 00 class 0x110100
[ 14.176962] pci 0000:bf:0a.0: [8086:6f40] type 00 class 0x088000
[ 14.183970] pci 0000:bf:0a.2: [8086:6f3a] type 00 class 0x110100
[ 14.190994] pci 0000:bf:0b.0: [8086:6f81] type 00 class 0x088000
[ 14.197976] pci 0000:bf:0b.1: [8086:6f36] type 00 class 0x110100
[ 14.204948] pci 0000:bf:0b.2: [8086:6f37] type 00 class 0x110100
[ 14.211968] pci 0000:bf:0b.3: [8086:6f76] type 00 class 0x088000
[ 14.217949] pci 0000:bf:0b.4: [8086:6f41] type 00 class 0x088000
[ 14.224960] pci 0000:bf:0b.5: [8086:6f3e] type 00 class 0x110100
[ 14.231943] pci 0000:bf:0b.6: [8086:6f3f] type 00 class 0x110100
[ 14.238962] pci 0000:bf:0b.7: [8086:6f7e] type 00 class 0x088000
[ 14.244946] pci 0000:bf:0c.0: [8086:6fe0] type 00 class 0x088000
[ 14.251966] pci 0000:bf:0c.1: [8086:6fe1] type 00 class 0x088000
[ 14.258982] pci 0000:bf:0c.2: [8086:6fe2] type 00 class 0x088000
[ 14.265966] pci 0000:bf:0c.3: [8086:6fe3] type 00 class 0x088000
[ 14.272948] pci 0000:bf:0c.4: [8086:6fe4] type 00 class 0x088000
[ 14.279968] pci 0000:bf:0c.5: [8086:6fe5] type 00 class 0x088000
[ 14.285945] pci 0000:bf:0c.6: [8086:6fe6] type 00 class 0x088000
[ 14.292960] pci 0000:bf:0c.7: [8086:6fe7] type 00 class 0x088000
[ 14.299943] pci 0000:bf:0d.0: [8086:6fe8] type 00 class 0x088000
[ 14.306927] pci 0000:bf:0d.1: [8086:6fe9] type 00 class 0x088000
[ 14.313952] pci 0000:bf:0d.2: [8086:6fea] type 00 class 0x088000
[ 14.319961] pci 0000:bf:0d.3: [8086:6feb] type 00 class 0x088000
[ 14.326942] pci 0000:bf:0d.4: [8086:6fec] type 00 class 0x088000
[ 14.333962] pci 0000:bf:0d.5: [8086:6fed] type 00 class 0x088000
[ 14.340954] pci 0000:bf:0d.6: [8086:6fee] type 00 class 0x088000
[ 14.347950] pci 0000:bf:0d.7: [8086:6fef] type 00 class 0x088000
[ 14.353956] pci 0000:bf:0e.0: [8086:6ff0] type 00 class 0x088000
[ 14.360945] pci 0000:bf:0e.1: [8086:6ff1] type 00 class 0x088000
[ 14.367966] pci 0000:bf:0e.2: [8086:6ff2] type 00 class 0xffffff
[ 14.374947] pci 0000:bf:0e.3: [8086:6ff3] type 00 class 0xffffff
[ 14.381947] pci 0000:bf:0e.4: [8086:6ff4] type 00 class 0xffffff
[ 14.387959] pci 0000:bf:0e.5: [8086:6ff5] type 00 class 0xffffff
[ 14.394944] pci 0000:bf:0e.6: [8086:6ff6] type 00 class 0xffffff
[ 14.401970] pci 0000:bf:0e.7: [8086:6ff7] type 00 class 0xffffff
[ 14.408950] pci 0000:bf:0f.0: [8086:6ff8] type 00 class 0x088000
[ 14.414958] pci 0000:bf:0f.1: [8086:6ff9] type 00 class 0x088000
[ 14.421962] pci 0000:bf:0f.2: [8086:6ffa] type 00 class 0x088000
[ 14.428995] pci 0000:bf:0f.3: [8086:6ffb] type 00 class 0x088000
[ 14.435982] pci 0000:bf:0f.4: [8086:6ffc] type 00 class 0x088000
[ 14.442955] pci 0000:bf:0f.5: [8086:6ffd] type 00 class 0x088000
[ 14.449972] pci 0000:bf:0f.6: [8086:6ffe] type 00 class 0x088000
[ 14.455951] pci 0000:bf:10.0: [8086:6f1d] type 00 class 0x088000
[ 14.462962] pci 0000:bf:10.1: [8086:6f34] type 00 class 0x110100
[ 14.469950] pci 0000:bf:10.5: [8086:6f1e] type 00 class 0x088000
[ 14.476967] pci 0000:bf:10.7: [8086:6f1f] type 00 class 0x088000
[ 14.483950] pci 0000:bf:12.0: [8086:6fa0] type 00 class 0x088000
[ 14.489944] pci 0000:bf:12.1: [8086:6f30] type 00 class 0x110100
[ 14.496966] pci 0000:bf:12.4: [8086:6f60] type 00 class 0x088000
[ 14.503995] pci 0000:bf:12.5: [8086:6f38] type 00 class 0x110100
[ 14.510982] pci 0000:bf:13.0: [8086:6fa8] type 00 class 0x088000
[ 14.517974] pci 0000:bf:13.1: [8086:6f71] type 00 class 0x088000
[ 14.523980] pci 0000:bf:13.2: [8086:6faa] type 00 class 0x088000
[ 14.530964] pci 0000:bf:13.3: [8086:6fab] type 00 class 0x088000
[ 14.537984] pci 0000:bf:13.4: [8086:6fac] type 00 class 0x088000
[ 14.544982] pci 0000:bf:13.5: [8086:6fad] type 00 class 0x088000
[ 14.551953] pci 0000:bf:13.6: [8086:6fae] type 00 class 0x088000
[ 14.558955] pci 0000:bf:13.7: [8086:6faf] type 00 class 0x088000
[ 14.564960] pci 0000:bf:14.0: [8086:6fb0] type 00 class 0x088000
[ 14.571966] pci 0000:bf:14.1: [8086:6fb1] type 00 class 0x088000
[ 14.578984] pci 0000:bf:14.2: [8086:6fb2] type 00 class 0x088000
[ 14.585977] pci 0000:bf:14.3: [8086:6fb3] type 00 class 0x088000
[ 14.592971] pci 0000:bf:14.4: [8086:6fbc] type 00 class 0x088000
[ 14.599963] pci 0000:bf:14.5: [8086:6fbd] type 00 class 0x088000
[ 14.605949] pci 0000:bf:14.6: [8086:6fbe] type 00 class 0x088000
[ 14.612969] pci 0000:bf:14.7: [8086:6fbf] type 00 class 0x088000
[ 14.619948] pci 0000:bf:15.0: [8086:6fb4] type 00 class 0x088000
[ 14.626993] pci 0000:bf:15.1: [8086:6fb5] type 00 class 0x088000
[ 14.633964] pci 0000:bf:15.2: [8086:6fb6] type 00 class 0x088000
[ 14.639984] pci 0000:bf:15.3: [8086:6fb7] type 00 class 0x088000
[ 14.646978] pci 0000:bf:16.0: [8086:6f68] type 00 class 0x088000
[ 14.653983] pci 0000:bf:16.1: [8086:6f79] type 00 class 0x088000
[ 14.660987] pci 0000:bf:16.2: [8086:6f6a] type 00 class 0x088000
[ 14.667941] pci 0000:bf:16.3: [8086:6f6b] type 00 class 0x088000
[ 14.674986] pci 0000:bf:16.4: [8086:6f6c] type 00 class 0x088000
[ 14.680986] pci 0000:bf:16.5: [8086:6f6d] type 00 class 0x088000
[ 14.687971] pci 0000:bf:16.6: [8086:6f6e] type 00 class 0x088000
[ 14.694967] pci 0000:bf:16.7: [8086:6f6f] type 00 class 0x088000
[ 14.701950] pci 0000:bf:17.0: [8086:6fd0] type 00 class 0x088000
[ 14.708981] pci 0000:bf:17.1: [8086:6fd1] type 00 class 0x088000
[ 14.714967] pci 0000:bf:17.2: [8086:6fd2] type 00 class 0x088000
[ 14.721992] pci 0000:bf:17.3: [8086:6fd3] type 00 class 0x088000
[ 14.728983] pci 0000:bf:17.4: [8086:6fb8] type 00 class 0x088000
[ 14.735938] pci 0000:bf:17.5: [8086:6fb9] type 00 class 0x088000
[ 14.742964] pci 0000:bf:17.6: [8086:6fba] type 00 class 0x088000
[ 14.749949] pci 0000:bf:17.7: [8086:6fbb] type 00 class 0x088000
[ 14.755968] pci 0000:bf:18.0: [8086:6fd4] type 00 class 0x088000
[ 14.762993] pci 0000:bf:18.1: [8086:6fd5] type 00 class 0x088000
[ 14.769988] pci 0000:bf:18.2: [8086:6fd6] type 00 class 0x088000
[ 14.776983] pci 0000:bf:18.3: [8086:6fd7] type 00 class 0x088000
[ 14.784004] pci 0000:bf:1e.0: [8086:6f98] type 00 class 0x088000
[ 14.789969] pci 0000:bf:1e.1: [8086:6f99] type 00 class 0x088000
[ 14.796951] pci 0000:bf:1e.2: [8086:6f9a] type 00 class 0x088000
[ 14.803973] pci 0000:bf:1e.3: [8086:6fc0] type 00 class 0x088000
[ 14.810931] pci 0000:bf:1e.4: [8086:6f9c] type 00 class 0x088000
[ 14.817978] pci 0000:bf:1f.0: [8086:6f88] type 00 class 0x088000
[ 14.823953] pci 0000:bf:1f.2: [8086:6f8a] type 00 class 0x088000
[ 14.831229] ACPI: PCI Root Bridge [UNC1] (domain 0000 [bus 7f])
[ 14.837861] acpi PNP0A03:02: _OSC: OS supports [ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 14.846861] acpi PNP0A03:02: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI]
[ 14.857947] acpi PNP0A03:02: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ 14.870979] PCI host bridge to bus 0000:7f
[ 14.874856] pci_bus 0000:7f: Unknown NUMA node; performance will be reduced
[ 14.882858] pci_bus 0000:7f: root bus resource [bus 7f]
[ 14.888873] pci 0000:7f:08.0: [8086:6f80] type 00 class 0x088000
[ 14.895966] pci 0000:7f:08.2: [8086:6f32] type 00 class 0x110100
[ 14.901978] pci 0000:7f:09.0: [8086:6f90] type 00 class 0x088000
[ 14.908968] pci 0000:7f:09.2: [8086:6f33] type 00 class 0x110100
[ 14.915955] pci 0000:7f:0a.0: [8086:6f40] type 00 class 0x088000
[ 14.922969] pci 0000:7f:0a.2: [8086:6f3a] type 00 class 0x110100
[ 14.930004] pci 0000:7f:0b.0: [8086:6f81] type 00 class 0x088000
[ 14.935973] pci 0000:7f:0b.1: [8086:6f36] type 00 class 0x110100
[ 14.942948] pci 0000:7f:0b.2: [8086:6f37] type 00 class 0x110100
[ 14.949967] pci 0000:7f:0b.3: [8086:6f76] type 00 class 0x088000
[ 14.956948] pci 0000:7f:0b.4: [8086:6f41] type 00 class 0x088000
[ 14.963968] pci 0000:7f:0b.5: [8086:6f3e] type 00 class 0x110100
[ 14.970946] pci 0000:7f:0b.6: [8086:6f3f] type 00 class 0x110100
[ 14.976961] pci 0000:7f:0b.7: [8086:6f7e] type 00 class 0x088000
[ 14.983948] pci 0000:7f:0c.0: [8086:6fe0] type 00 class 0x088000
[ 14.990966] pci 0000:7f:0c.1: [8086:6fe1] type 00 class 0x088000
[ 14.997966] pci 0000:7f:0c.2: [8086:6fe2] type 00 class 0x088000
[ 15.005005] pci 0000:7f:0c.3: [8086:6fe3] type 00 class 0x088000
[ 15.010986] pci 0000:7f:0c.4: [8086:6fe4] type 00 class 0x088000
[ 15.017952] pci 0000:7f:0c.5: [8086:6fe5] type 00 class 0x088000
[ 15.024978] pci 0000:7f:0c.6: [8086:6fe6] type 00 class 0x088000
[ 15.031947] pci 0000:7f:0c.7: [8086:6fe7] type 00 class 0x088000
[ 15.038965] pci 0000:7f:0d.0: [8086:6fe8] type 00 class 0x088000
[ 15.044947] pci 0000:7f:0d.1: [8086:6fe9] type 00 class 0x088000
[ 15.051963] pci 0000:7f:0d.2: [8086:6fea] type 00 class 0x088000
[ 15.058948] pci 0000:7f:0d.3: [8086:6feb] type 00 class 0x088000
[ 15.065963] pci 0000:7f:0d.4: [8086:6fec] type 00 class 0x088000
[ 15.072964] pci 0000:7f:0d.5: [8086:6fed] type 00 class 0x088000
[ 15.079005] pci 0000:7f:0d.6: [8086:6fee] type 00 class 0x088000
[ 15.085979] pci 0000:7f:0d.7: [8086:6fef] type 00 class 0x088000
[ 15.092987] pci 0000:7f:0e.0: [8086:6ff0] type 00 class 0x088000
[ 15.099973] pci 0000:7f:0e.1: [8086:6ff1] type 00 class 0x088000
[ 15.106948] pci 0000:7f:0e.2: [8086:6ff2] type 00 class 0xffffff
[ 15.113964] pci 0000:7f:0e.3: [8086:6ff3] type 00 class 0xffffff
[ 15.119948] pci 0000:7f:0e.4: [8086:6ff4] type 00 class 0xffffff
[ 15.126966] pci 0000:7f:0e.5: [8086:6ff5] type 00 class 0xffffff
[ 15.133951] pci 0000:7f:0e.6: [8086:6ff6] type 00 class 0xffffff
[ 15.140965] pci 0000:7f:0e.7: [8086:6ff7] type 00 class 0xffffff
[ 15.147966] pci 0000:7f:0f.0: [8086:6ff8] type 00 class 0x088000
[ 15.153952] pci 0000:7f:0f.1: [8086:6ff9] type 00 class 0x088000
[ 15.160961] pci 0000:7f:0f.2: [8086:6ffa] type 00 class 0x088000
[ 15.167948] pci 0000:7f:0f.3: [8086:6ffb] type 00 class 0x088000
[ 15.174964] pci 0000:7f:0f.4: [8086:6ffc] type 00 class 0x088000
[ 15.181953] pci 0000:7f:0f.5: [8086:6ffd] type 00 class 0x088000
[ 15.187932] pci 0000:7f:0f.6: [8086:6ffe] type 00 class 0x088000
[ 15.194974] pci 0000:7f:10.0: [8086:6f1d] type 00 class 0x088000
[ 15.201950] pci 0000:7f:10.1: [8086:6f34] type 00 class 0x110100
[ 15.208969] pci 0000:7f:10.5: [8086:6f1e] type 00 class 0x088000
[ 15.215946] pci 0000:7f:10.7: [8086:6f1f] type 00 class 0x088000
[ 15.221977] pci 0000:7f:12.0: [8086:6fa0] type 00 class 0x088000
[ 15.229009] pci 0000:7f:12.1: [8086:6f30] type 00 class 0x110100
[ 15.235995] pci 0000:7f:12.4: [8086:6f60] type 00 class 0x088000
[ 15.242932] pci 0000:7f:12.5: [8086:6f38] type 00 class 0x110100
[ 15.249979] pci 0000:7f:13.0: [8086:6fa8] type 00 class 0x088000
[ 15.256976] pci 0000:7f:13.1: [8086:6f71] type 00 class 0x088000
[ 15.262989] pci 0000:7f:13.2: [8086:6faa] type 00 class 0x088000
[ 15.269986] pci 0000:7f:13.3: [8086:6fab] type 00 class 0x088000
[ 15.276972] pci 0000:7f:13.4: [8086:6fac] type 00 class 0x088000
[ 15.283990] pci 0000:7f:13.5: [8086:6fad] type 00 class 0x088000
[ 15.290971] pci 0000:7f:13.6: [8086:6fae] type 00 class 0x088000
[ 15.297006] pci 0000:7f:13.7: [8086:6faf] type 00 class 0x088000
[ 15.303987] pci 0000:7f:14.0: [8086:6fb0] type 00 class 0x088000
[ 15.310975] pci 0000:7f:14.1: [8086:6fb1] type 00 class 0x088000
[ 15.317993] pci 0000:7f:14.2: [8086:6fb2] type 00 class 0x088000
[ 15.324967] pci 0000:7f:14.3: [8086:6fb3] type 00 class 0x088000
[ 15.331991] pci 0000:7f:14.4: [8086:6fbc] type 00 class 0x088000
[ 15.338002] pci 0000:7f:14.5: [8086:6fbd] type 00 class 0x088000
[ 15.344987] pci 0000:7f:14.6: [8086:6fbe] type 00 class 0x088000
[ 15.351959] pci 0000:7f:14.7: [8086:6fbf] type 00 class 0x088000
[ 15.358977] pci 0000:7f:15.0: [8086:6fb4] type 00 class 0x088000
[ 15.365976] pci 0000:7f:15.1: [8086:6fb5] type 00 class 0x088000
[ 15.372991] pci 0000:7f:15.2: [8086:6fb6] type 00 class 0x088000
[ 15.378985] pci 0000:7f:15.3: [8086:6fb7] type 00 class 0x088000
[ 15.385985] pci 0000:7f:16.0: [8086:6f68] type 00 class 0x088000
[ 15.392993] pci 0000:7f:16.1: [8086:6f79] type 00 class 0x088000
[ 15.399977] pci 0000:7f:16.2: [8086:6f6a] type 00 class 0x088000
[ 15.407024] pci 0000:7f:16.3: [8086:6f6b] type 00 class 0x088000
[ 15.414000] pci 0000:7f:16.4: [8086:6f6c] type 00 class 0x088000
[ 15.419971] pci 0000:7f:16.5: [8086:6f6d] type 00 class 0x088000
[ 15.426992] pci 0000:7f:16.6: [8086:6f6e] type 00 class 0x088000
[ 15.433953] pci 0000:7f:16.7: [8086:6f6f] type 00 class 0x088000
[ 15.440978] pci 0000:7f:17.0: [8086:6fd0] type 00 class 0x088000
[ 15.447995] pci 0000:7f:17.1: [8086:6fd1] type 00 class 0x088000
[ 15.454909] pci 0000:7f:17.2: [8086:6fd2] type 00 class 0x088000
[ 15.461001] pci 0000:7f:17.3: [8086:6fd3] type 00 class 0x088000
[ 15.467982] pci 0000:7f:17.4: [8086:6fb8] type 00 class 0x088000
[ 15.474956] pci 0000:7f:17.5: [8086:6fb9] type 00 class 0x088000
[ 15.481965] pci 0000:7f:17.6: [8086:6fba] type 00 class 0x088000
[ 15.488948] pci 0000:7f:17.7: [8086:6fbb] type 00 class 0x088000
[ 15.494965] pci 0000:7f:18.0: [8086:6fd4] type 00 class 0x088000
[ 15.501966] pci 0000:7f:18.1: [8086:6fd5] type 00 class 0x088000
[ 15.508987] pci 0000:7f:18.2: [8086:6fd6] type 00 class 0x088000
[ 15.515983] pci 0000:7f:18.3: [8086:6fd7] type 00 class 0x088000
[ 15.522978] pci 0000:7f:1e.0: [8086:6f98] type 00 class 0x088000
[ 15.529969] pci 0000:7f:1e.1: [8086:6f99] type 00 class 0x088000
[ 15.535950] pci 0000:7f:1e.2: [8086:6f9a] type 00 class 0x088000
[ 15.542963] pci 0000:7f:1e.3: [8086:6fc0] type 00 class 0x088000
[ 15.549928] pci 0000:7f:1e.4: [8086:6f9c] type 00 class 0x088000
[ 15.556977] pci 0000:7f:1f.0: [8086:6f88] type 00 class 0x088000
[ 15.563927] pci 0000:7f:1f.2: [8086:6f8a] type 00 class 0x088000
[ 15.570239] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus 3f])
[ 15.576862] acpi PNP0A03:03: _OSC: OS supports [ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 15.585858] acpi PNP0A03:03: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI]
[ 15.596876] acpi PNP0A03:03: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ 15.609932] PCI host bridge to bus 0000:3f
[ 15.613856] pci_bus 0000:3f: Unknown NUMA node; performance will be reduced
[ 15.621856] pci_bus 0000:3f: root bus resource [bus 3f]
[ 15.627875] pci 0000:3f:08.0: [8086:6f80] type 00 class 0x088000
[ 15.635008] pci 0000:3f:08.2: [8086:6f32] type 00 class 0x110100
[ 15.641991] pci 0000:3f:09.0: [8086:6f90] type 00 class 0x088000
[ 15.647954] pci 0000:3f:09.2: [8086:6f33] type 00 class 0x110100
[ 15.654970] pci 0000:3f:0a.0: [8086:6f40] type 00 class 0x088000
[ 15.661953] pci 0000:3f:0a.2: [8086:6f3a] type 00 class 0x110100
[ 15.668964] pci 0000:3f:0b.0: [8086:6f81] type 00 class 0x088000
[ 15.675940] pci 0000:3f:0b.1: [8086:6f36] type 00 class 0x110100
[ 15.681962] pci 0000:3f:0b.2: [8086:6f37] type 00 class 0x110100
[ 15.688949] pci 0000:3f:0b.3: [8086:6f76] type 00 class 0x088000
[ 15.695950] pci 0000:3f:0b.4: [8086:6f41] type 00 class 0x088000
[ 15.702993] pci 0000:3f:0b.5: [8086:6f3e] type 00 class 0x110100
[ 15.709968] pci 0000:3f:0b.6: [8086:6f3f] type 00 class 0x110100
[ 15.715945] pci 0000:3f:0b.7: [8086:6f7e] type 00 class 0x088000
[ 15.722961] pci 0000:3f:0c.0: [8086:6fe0] type 00 class 0x088000
[ 15.729946] pci 0000:3f:0c.1: [8086:6fe1] type 00 class 0x088000
[ 15.736961] pci 0000:3f:0c.2: [8086:6fe2] type 00 class 0x088000
[ 15.743960] pci 0000:3f:0c.3: [8086:6fe3] type 00 class 0x088000
[ 15.749953] pci 0000:3f:0c.4: [8086:6fe4] type 00 class 0x088000
[ 15.756962] pci 0000:3f:0c.5: [8086:6fe5] type 00 class 0x088000
[ 15.763949] pci 0000:3f:0c.6: [8086:6fe6] type 00 class 0x088000
[ 15.770961] pci 0000:3f:0c.7: [8086:6fe7] type 00 class 0x088000
[ 15.777993] pci 0000:3f:0d.0: [8086:6fe8] type 00 class 0x088000
[ 15.783981] pci 0000:3f:0d.1: [8086:6fe9] type 00 class 0x088000
[ 15.790952] pci 0000:3f:0d.2: [8086:6fea] type 00 class 0x088000
[ 15.797966] pci 0000:3f:0d.3: [8086:6feb] type 00 class 0x088000
[ 15.804949] pci 0000:3f:0d.4: [8086:6fec] type 00 class 0x088000
[ 15.811963] pci 0000:3f:0d.5: [8086:6fed] type 00 class 0x088000
[ 15.817945] pci 0000:3f:0d.6: [8086:6fee] type 00 class 0x088000
[ 15.824962] pci 0000:3f:0d.7: [8086:6fef] type 00 class 0x088000
[ 15.831948] pci 0000:3f:0e.0: [8086:6ff0] type 00 class 0x088000
[ 15.838965] pci 0000:3f:0e.1: [8086:6ff1] type 00 class 0x088000
[ 15.845985] pci 0000:3f:0e.2: [8086:6ff2] type 00 class 0xffffff
[ 15.851970] pci 0000:3f:0e.3: [8086:6ff3] type 00 class 0xffffff
[ 15.858947] pci 0000:3f:0e.4: [8086:6ff4] type 00 class 0xffffff
[ 15.865965] pci 0000:3f:0e.5: [8086:6ff5] type 00 class 0xffffff
[ 15.872943] pci 0000:3f:0e.6: [8086:6ff6] type 00 class 0xffffff
[ 15.879966] pci 0000:3f:0e.7: [8086:6ff7] type 00 class 0xffffff
[ 15.885949] pci 0000:3f:0f.0: [8086:6ff8] type 00 class 0x088000
[ 15.892961] pci 0000:3f:0f.1: [8086:6ff9] type 00 class 0x088000
[ 15.899944] pci 0000:3f:0f.2: [8086:6ffa] type 00 class 0x088000
[ 15.906958] pci 0000:3f:0f.3: [8086:6ffb] type 00 class 0x088000
[ 15.913964] pci 0000:3f:0f.4: [8086:6ffc] type 00 class 0x088000
[ 15.919949] pci 0000:3f:0f.5: [8086:6ffd] type 00 class 0x088000
[ 15.926949] pci 0000:3f:0f.6: [8086:6ffe] type 00 class 0x088000
[ 15.933974] pci 0000:3f:10.0: [8086:6f1d] type 00 class 0x088000
[ 15.940950] pci 0000:3f:10.1: [8086:6f34] type 00 class 0x110100
[ 15.947982] pci 0000:3f:10.5: [8086:6f1e] type 00 class 0x088000
[ 15.953949] pci 0000:3f:10.7: [8086:6f1f] type 00 class 0x088000
[ 15.960975] pci 0000:3f:12.0: [8086:6fa0] type 00 class 0x088000
[ 15.968019] pci 0000:3f:12.1: [8086:6f30] type 00 class 0x110100
[ 15.975000] pci 0000:3f:12.4: [8086:6f60] type 00 class 0x088000
[ 15.981937] pci 0000:3f:12.5: [8086:6f38] type 00 class 0x110100
[ 15.987983] pci 0000:3f:13.0: [8086:6fa8] type 00 class 0x088000
[ 15.994975] pci 0000:3f:13.1: [8086:6f71] type 00 class 0x088000
[ 16.001994] pci 0000:3f:13.2: [8086:6faa] type 00 class 0x088000
[ 16.008988] pci 0000:3f:13.3: [8086:6fab] type 00 class 0x088000
[ 16.015979] pci 0000:3f:13.4: [8086:6fac] type 00 class 0x088000
[ 16.022995] pci 0000:3f:13.5: [8086:6fad] type 00 class 0x088000
[ 16.028972] pci 0000:3f:13.6: [8086:6fae] type 00 class 0x088000
[ 16.036009] pci 0000:3f:13.7: [8086:6faf] type 00 class 0x088000
[ 16.043003] pci 0000:3f:14.0: [8086:6fb0] type 00 class 0x088000
[ 16.049974] pci 0000:3f:14.1: [8086:6fb1] type 00 class 0x088000
[ 16.057004] pci 0000:3f:14.2: [8086:6fb2] type 00 class 0x088000
[ 16.063968] pci 0000:3f:14.3: [8086:6fb3] type 00 class 0x088000
[ 16.069992] pci 0000:3f:14.4: [8086:6fbc] type 00 class 0x088000
[ 16.076974] pci 0000:3f:14.5: [8086:6fbd] type 00 class 0x088000
[ 16.083955] pci 0000:3f:14.6: [8086:6fbe] type 00 class 0x088000
[ 16.090975] pci 0000:3f:14.7: [8086:6fbf] type 00 class 0x088000
[ 16.097956] pci 0000:3f:15.0: [8086:6fb4] type 00 class 0x088000
[ 16.104998] pci 0000:3f:15.1: [8086:6fb5] type 00 class 0x088000
[ 16.110971] pci 0000:3f:15.2: [8086:6fb6] type 00 class 0x088000
[ 16.117967] pci 0000:3f:15.3: [8086:6fb7] type 00 class 0x088000
[ 16.125016] pci 0000:3f:16.0: [8086:6f68] type 00 class 0x088000
[ 16.131973] pci 0000:3f:16.1: [8086:6f79] type 00 class 0x088000
[ 16.138986] pci 0000:3f:16.2: [8086:6f6a] type 00 class 0x088000
[ 16.144969] pci 0000:3f:16.3: [8086:6f6b] type 00 class 0x088000
[ 16.151991] pci 0000:3f:16.4: [8086:6f6c] type 00 class 0x088000
[ 16.158997] pci 0000:3f:16.5: [8086:6f6d] type 00 class 0x088000
[ 16.165942] pci 0000:3f:16.6: [8086:6f6e] type 00 class 0x088000
[ 16.172976] pci 0000:3f:16.7: [8086:6f6f] type 00 class 0x088000
[ 16.179970] pci 0000:3f:17.0: [8086:6fd0] type 00 class 0x088000
[ 16.185979] pci 0000:3f:17.1: [8086:6fd1] type 00 class 0x088000
[ 16.192986] pci 0000:3f:17.2: [8086:6fd2] type 00 class 0x088000
[ 16.199972] pci 0000:3f:17.3: [8086:6fd3] type 00 class 0x088000
[ 16.206988] pci 0000:3f:17.4: [8086:6fb8] type 00 class 0x088000
[ 16.213953] pci 0000:3f:17.5: [8086:6fb9] type 00 class 0x088000
[ 16.220973] pci 0000:3f:17.6: [8086:6fba] type 00 class 0x088000
[ 16.226965] pci 0000:3f:17.7: [8086:6fbb] type 00 class 0x088000
[ 16.233957] pci 0000:3f:18.0: [8086:6fd4] type 00 class 0x088000
[ 16.240951] pci 0000:3f:18.1: [8086:6fd5] type 00 class 0x088000
[ 16.247998] pci 0000:3f:18.2: [8086:6fd6] type 00 class 0x088000
[ 16.254969] pci 0000:3f:18.3: [8086:6fd7] type 00 class 0x088000
[ 16.261026] pci 0000:3f:1e.0: [8086:6f98] type 00 class 0x088000
[ 16.267966] pci 0000:3f:1e.1: [8086:6f99] type 00 class 0x088000
[ 16.274959] pci 0000:3f:1e.2: [8086:6f9a] type 00 class 0x088000
[ 16.281976] pci 0000:3f:1e.3: [8086:6fc0] type 00 class 0x088000
[ 16.288929] pci 0000:3f:1e.4: [8086:6f9c] type 00 class 0x088000
[ 16.294978] pci 0000:3f:1f.0: [8086:6f88] type 00 class 0x088000
[ 16.302019] pci 0000:3f:1f.2: [8086:6f8a] type 00 class 0x088000
[ 16.569824] ACPI: PCI Root Bridge [IIO0] (domain 0000 [bus 00-3e])
[ 16.576866] acpi PNP0A08:00: _OSC: OS supports [ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 16.585858] acpi PNP0A08:00: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI]
[ 16.596976] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[ 16.605875] acpi PNP0A08:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ 16.620531] PCI host bridge to bus 0000:00
[ 16.624857] pci_bus 0000:00: Unknown NUMA node; performance will be reduced
[ 16.632888] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 16.639860] pci_bus 0000:00: root bus resource [io 0x1000-0x3fff window]
[ 16.647856] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 16.655856] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000cbfff window]
[ 16.664859] pci_bus 0000:00: root bus resource [mem 0x90000000-0xabffbfff window]
[ 16.672856] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x381fffffffff window]
[ 16.681860] pci_bus 0000:00: root bus resource [bus 00-3e]
[ 16.687969] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000
[ 16.695127] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400
[ 16.701890] pci 0000:00:02.0: enabling Extended Tags
[ 16.706897] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[ 16.714090] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400
[ 16.720892] pci 0000:00:03.0: enabling Extended Tags
[ 16.726899] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[ 16.734072] pci 0000:00:03.2: [8086:6f0a] type 01 class 0x060400
[ 16.740933] pci 0000:00:03.2: PME# supported from D0 D3hot D3cold
[ 16.747091] pci 0000:00:03.3: [8086:6f0b] type 01 class 0x060400
[ 16.753900] pci 0000:00:03.3: PME# supported from D0 D3hot D3cold
[ 16.761148] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000
[ 16.767869] pci 0000:00:04.0: reg 0x10: [mem 0x381ffff1c000-0x381ffff1ffff 64bit]
[ 16.777079] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000
[ 16.783870] pci 0000:00:04.1: reg 0x10: [mem 0x381ffff18000-0x381ffff1bfff 64bit]
[ 16.792068] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000
[ 16.798871] pci 0000:00:04.2: reg 0x10: [mem 0x381ffff14000-0x381ffff17fff 64bit]
[ 16.807066] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000
[ 16.813870] pci 0000:00:04.3: reg 0x10: [mem 0x381ffff10000-0x381ffff13fff 64bit]
[ 16.822069] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000
[ 16.828869] pci 0000:00:04.4: reg 0x10: [mem 0x381ffff0c000-0x381ffff0ffff 64bit]
[ 16.837986] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000
[ 16.844869] pci 0000:00:04.5: reg 0x10: [mem 0x381ffff08000-0x381ffff0bfff 64bit]
[ 16.853070] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000
[ 16.859868] pci 0000:00:04.6: reg 0x10: [mem 0x381ffff04000-0x381ffff07fff 64bit]
[ 16.868047] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000
[ 16.874868] pci 0000:00:04.7: reg 0x10: [mem 0x381ffff00000-0x381ffff03fff 64bit]
[ 16.884062] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000
[ 16.890071] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000
[ 16.897057] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000
[ 16.904005] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020
[ 16.910866] pci 0000:00:05.4: reg 0x10: [mem 0x92406000-0x92406fff]
[ 16.918022] pci 0000:00:11.0: [8086:1d3e] type 01 class 0x060400
[ 16.924986] pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
[ 16.932056] pci 0000:00:16.0: [8086:1d3a] type 00 class 0x078000
[ 16.938886] pci 0000:00:16.0: reg 0x10: [mem 0x92405000-0x9240500f 64bit]
[ 16.945925] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[ 16.952951] pci 0000:00:16.1: [8086:1d3b] type 00 class 0x078000
[ 16.959876] pci 0000:00:16.1: reg 0x10: [mem 0x92404000-0x9240400f 64bit]
[ 16.967928] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
[ 16.975051] pci 0000:00:1a.0: [8086:1d2d] type 00 class 0x0c0320
[ 16.981879] pci 0000:00:1a.0: reg 0x10: [mem 0x92402000-0x924023ff]
[ 16.988966] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[ 16.995038] pci 0000:00:1c.0: [8086:1d10] type 01 class 0x060400
[ 17.002010] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[ 17.009108] pci 0000:00:1c.7: [8086:1d1e] type 01 class 0x060400
[ 17.015970] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
[ 17.023068] pci 0000:00:1d.0: [8086:1d26] type 00 class 0x0c0320
[ 17.029875] pci 0000:00:1d.0: reg 0x10: [mem 0x92401000-0x924013ff]
[ 17.036964] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[ 17.044037] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
[ 17.051103] pci 0000:00:1f.0: [8086:1d41] type 00 class 0x060100
[ 17.058190] pci 0000:00:1f.2: [8086:1d02] type 00 class 0x010601
[ 17.064874] pci 0000:00:1f.2: reg 0x10: [io 0x2058-0x205f]
[ 17.070863] pci 0000:00:1f.2: reg 0x14: [io 0x207c-0x207f]
[ 17.076863] pci 0000:00:1f.2: reg 0x18: [io 0x2050-0x2057]
[ 17.083863] pci 0000:00:1f.2: reg 0x1c: [io 0x2078-0x207b]
[ 17.089863] pci 0000:00:1f.2: reg 0x20: [io 0x2020-0x203f]
[ 17.095864] pci 0000:00:1f.2: reg 0x24: [mem 0x92400000-0x924007ff]
[ 17.102913] pci 0000:00:1f.2: PME# supported from D3hot
[ 17.109088] pci 0000:00:1f.3: [8086:1d22] type 00 class 0x0c0500
[ 17.115875] pci 0000:00:1f.3: reg 0x10: [mem 0x381ffff20000-0x381ffff200ff 64bit]
[ 17.123877] pci 0000:00:1f.3: reg 0x20: [io 0x2000-0x201f]
[ 17.130442] acpiphp: Slot [8] registered
[ 17.134919] pci 0000:01:00.0: [1000:0087] type 00 class 0x010700
[ 17.141868] pci 0000:01:00.0: reg 0x10: [io 0x1000-0x10ff]
[ 17.147865] pci 0000:01:00.0: reg 0x14: [mem 0x92340000-0x9234ffff 64bit]
[ 17.155865] pci 0000:01:00.0: reg 0x1c: [mem 0x92300000-0x9233ffff 64bit]
[ 17.163868] pci 0000:01:00.0: reg 0x30: [mem 0xfff00000-0xffffffff pref]
[ 17.170915] pci 0000:01:00.0: supports D1 D2
[ 17.176021] pci 0000:00:02.0: PCI bridge to [bus 01]
[ 17.181858] pci 0000:00:02.0: bridge window [io 0x1000-0x1fff]
[ 17.187857] pci 0000:00:02.0: bridge window [mem 0x92300000-0x923fffff]
[ 17.196175] acpiphp: Slot [2] registered
[ 17.200936] pci 0000:00:03.0: PCI bridge to [bus 02]
[ 17.206267] acpiphp: Slot [1] registered
[ 17.210940] pci 0000:03:00.0: [8086:1528] type 00 class 0x020000
[ 17.217880] pci 0000:03:00.0: reg 0x10: [mem 0x91c00000-0x91dfffff 64bit pref]
[ 17.225883] pci 0000:03:00.0: reg 0x20: [mem 0x91e04000-0x91e07fff 64bit pref]
[ 17.233871] pci 0000:03:00.0: reg 0x30: [mem 0xfff80000-0xffffffff pref]
[ 17.240933] pci 0000:03:00.0: PME# supported from D0 D3hot
[ 17.247882] pci 0000:03:00.0: 16.000 Gb/s available PCIe bandwidth, limited by 5.0 GT/s PCIe x4 link at 0000:00:03.2 (capable of 32.000 Gb/s with 5.0 GT/s PCIe x8 link)
[ 17.264057] pci 0000:03:00.1: [8086:1528] type 00 class 0x020000
[ 17.270879] pci 0000:03:00.1: reg 0x10: [mem 0x91a00000-0x91bfffff 64bit pref]
[ 17.278883] pci 0000:03:00.1: reg 0x20: [mem 0x91e00000-0x91e03fff 64bit pref]
[ 17.286869] pci 0000:03:00.1: reg 0x30: [mem 0xfff80000-0xffffffff pref]
[ 17.294922] pci 0000:03:00.1: PME# supported from D0 D3hot
[ 17.301060] pci 0000:00:03.2: PCI bridge to [bus 03-04]
[ 17.306859] pci 0000:00:03.2: bridge window [mem 0x91f00000-0x922fffff]
[ 17.314859] pci 0000:00:03.2: bridge window [mem 0x91a00000-0x91efffff 64bit pref]
[ 17.323192] acpiphp: Slot [0] registered
[ 17.327902] pci 0000:00:03.3: PCI bridge to [bus 05]
[ 17.333956] pci 0000:00:11.0: PCI bridge to [bus 06]
[ 17.338975] pci 0000:00:1c.0: PCI bridge to [bus 07]
[ 17.344956] pci 0000:08:00.0: [102b:0522] type 00 class 0x030000
[ 17.351889] pci 0000:08:00.0: reg 0x10: [mem 0x90000000-0x90ffffff pref]
[ 17.358880] pci 0000:08:00.0: reg 0x14: [mem 0x91800000-0x91803fff]
[ 17.365874] pci 0000:08:00.0: reg 0x18: [mem 0x91000000-0x917fffff]
[ 17.372935] pci 0000:08:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 17.380884] pci 0000:08:00.0: BAR 0: assigned to efifb
[ 17.387088] pci 0000:00:1c.7: PCI bridge to [bus 08]
[ 17.391861] pci 0000:00:1c.7: bridge window [mem 0x91000000-0x918fffff]
[ 17.399865] pci 0000:00:1c.7: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 17.408890] pci_bus 0000:09: extended config space not accessible
[ 17.414956] pci 0000:00:1e.0: PCI bridge to [bus 09] (subtractive decode)
[ 17.422895] pci 0000:00:1e.0: bridge window [io 0x0000-0x0cf7 window] (subtractive decode)
[ 17.432859] pci 0000:00:1e.0: bridge window [io 0x1000-0x3fff window] (subtractive decode)
[ 17.441859] pci 0000:00:1e.0: bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[ 17.451857] pci 0000:00:1e.0: bridge window [mem 0x000c4000-0x000cbfff window] (subtractive decode)
[ 17.462857] pci 0000:00:1e.0: bridge window [mem 0x90000000-0xabffbfff window] (subtractive decode)
[ 17.472856] pci 0000:00:1e.0: bridge window [mem 0x380000000000-0x381fffffffff window] (subtractive decode)
[ 17.484909] ACPI: PCI: Interrupt link LNKA configured for IRQ 0
[ 17.490859] ACPI: PCI: Interrupt link LNKA disabled
[ 17.496943] ACPI: PCI: Interrupt link LNKB configured for IRQ 0
[ 17.503856] ACPI: PCI: Interrupt link LNKB disabled
[ 17.508954] ACPI: PCI: Interrupt link LNKC configured for IRQ 0
[ 17.515858] ACPI: PCI: Interrupt link LNKC disabled
[ 17.520939] ACPI: PCI: Interrupt link LNKD configured for IRQ 0
[ 17.527855] ACPI: PCI: Interrupt link LNKD disabled
[ 17.532975] ACPI: PCI: Interrupt link LNKE configured for IRQ 0
[ 17.539859] ACPI: PCI: Interrupt link LNKE disabled
[ 17.544939] ACPI: PCI: Interrupt link LNKF configured for IRQ 0
[ 17.551858] ACPI: PCI: Interrupt link LNKF disabled
[ 17.557938] ACPI: PCI: Interrupt link LNKG configured for IRQ 0
[ 17.563855] ACPI: PCI: Interrupt link LNKG disabled
[ 17.569939] ACPI: PCI: Interrupt link LNKH configured for IRQ 0
[ 17.575855] ACPI: PCI: Interrupt link LNKH disabled
[ 17.582518] ACPI: PCI Root Bridge [IIO1] (domain 0000 [bus 40-7e])
[ 17.588865] acpi PNP0A08:01: _OSC: OS supports [ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 17.597861] acpi PNP0A08:01: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI]
[ 17.609009] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[ 17.617901] acpi PNP0A08:01: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ 17.631588] PCI host bridge to bus 0000:40
[ 17.635857] pci_bus 0000:40: root bus resource [io 0x4000-0x7fff window]
[ 17.643869] pci_bus 0000:40: root bus resource [mem 0xac000000-0xc7ffbfff window]
[ 17.651856] pci_bus 0000:40: root bus resource [mem 0x382000000000-0x383fffffffff window]
[ 17.660858] pci_bus 0000:40: root bus resource [bus 40-7e]
[ 17.666896] pci 0000:40:02.0: [8086:6f04] type 01 class 0x060400
[ 17.673930] pci 0000:40:02.0: PME# supported from D0 D3hot D3cold
[ 17.681073] pci 0000:40:02.2: [8086:6f06] type 01 class 0x060400
[ 17.687933] pci 0000:40:02.2: PME# supported from D0 D3hot D3cold
[ 17.695052] pci 0000:40:03.0: [8086:6f08] type 01 class 0x060400
[ 17.701889] pci 0000:40:03.0: enabling Extended Tags
[ 17.706896] pci 0000:40:03.0: PME# supported from D0 D3hot D3cold
[ 17.714065] pci 0000:40:04.0: [8086:6f20] type 00 class 0x088000
[ 17.720869] pci 0000:40:04.0: reg 0x10: [mem 0x383ffff1c000-0x383ffff1ffff 64bit]
[ 17.729032] pci 0000:40:04.1: [8086:6f21] type 00 class 0x088000
[ 17.735873] pci 0000:40:04.1: reg 0x10: [mem 0x383ffff18000-0x383ffff1bfff 64bit]
[ 17.744069] pci 0000:40:04.2: [8086:6f22] type 00 class 0x088000
[ 17.750868] pci 0000:40:04.2: reg 0x10: [mem 0x383ffff14000-0x383ffff17fff 64bit]
[ 17.760059] pci 0000:40:04.3: [8086:6f23] type 00 class 0x088000
[ 17.766868] pci 0000:40:04.3: reg 0x10: [mem 0x383ffff10000-0x383ffff13fff 64bit]
[ 17.775068] pci 0000:40:04.4: [8086:6f24] type 00 class 0x088000
[ 17.781868] pci 0000:40:04.4: reg 0x10: [mem 0x383ffff0c000-0x383ffff0ffff 64bit]
[ 17.790060] pci 0000:40:04.5: [8086:6f25] type 00 class 0x088000
[ 17.796868] pci 0000:40:04.5: reg 0x10: [mem 0x383ffff08000-0x383ffff0bfff 64bit]
[ 17.806042] pci 0000:40:04.6: [8086:6f26] type 00 class 0x088000
[ 17.811871] pci 0000:40:04.6: reg 0x10: [mem 0x383ffff04000-0x383ffff07fff 64bit]
[ 17.821040] pci 0000:40:04.7: [8086:6f27] type 00 class 0x088000
[ 17.827868] pci 0000:40:04.7: reg 0x10: [mem 0x383ffff00000-0x383ffff03fff 64bit]
[ 17.836064] pci 0000:40:05.0: [8086:6f28] type 00 class 0x088000
[ 17.843053] pci 0000:40:05.1: [8086:6f29] type 00 class 0x088000
[ 17.850065] pci 0000:40:05.2: [8086:6f2a] type 00 class 0x088000
[ 17.857007] pci 0000:40:05.4: [8086:6f2c] type 00 class 0x080020
[ 17.863866] pci 0000:40:05.4: reg 0x10: [mem 0xac000000-0xac000fff]
[ 17.872171] acpiphp: Slot [5] registered
[ 17.875894] pci 0000:40:02.0: PCI bridge to [bus 41]
[ 17.882159] acpiphp: Slot [7] registered
[ 17.886892] pci 0000:40:02.2: PCI bridge to [bus 42]
[ 17.892159] acpiphp: Slot [6] registered
[ 17.896918] pci 0000:40:03.0: PCI bridge to [bus 43]
[ 17.902378] ACPI: PCI Root Bridge [IIO2] (domain 0000 [bus 80-be])
[ 17.909864] acpi PNP0A08:02: _OSC: OS supports [ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 17.918858] acpi PNP0A08:02: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI]
[ 17.929993] acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration
[ 17.939053] acpi PNP0A08:02: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ 17.951620] PCI host bridge to bus 0000:80
[ 17.956860] pci_bus 0000:80: root bus resource [io 0x8000-0xbfff window]
[ 17.963856] pci_bus 0000:80: root bus resource [mem 0xc8000000-0xe3ffbfff window]
[ 17.972856] pci_bus 0000:80: root bus resource [mem 0x384000000000-0x385fffffffff window]
[ 17.981860] pci_bus 0000:80: root bus resource [bus 80-be]
[ 17.987896] pci 0000:80:02.0: [8086:6f04] type 01 class 0x060400
[ 17.994941] pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
[ 18.002208] pci 0000:80:02.2: [8086:6f06] type 01 class 0x060400
[ 18.008934] pci 0000:80:02.2: PME# supported from D0 D3hot D3cold
[ 18.016095] pci 0000:80:03.0: [8086:6f08] type 01 class 0x060400
[ 18.021889] pci 0000:80:03.0: enabling Extended Tags
[ 18.027914] pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
[ 18.035087] pci 0000:80:04.0: [8086:6f20] type 00 class 0x088000
[ 18.041869] pci 0000:80:04.0: reg 0x10: [mem 0x385ffff1c000-0x385ffff1ffff 64bit]
[ 18.050061] pci 0000:80:04.1: [8086:6f21] type 00 class 0x088000
[ 18.056868] pci 0000:80:04.1: reg 0x10: [mem 0x385ffff18000-0x385ffff1bfff 64bit]
[ 18.065077] pci 0000:80:04.2: [8086:6f22] type 00 class 0x088000
[ 18.071868] pci 0000:80:04.2: reg 0x10: [mem 0x385ffff14000-0x385ffff17fff 64bit]
[ 18.081051] pci 0000:80:04.3: [8086:6f23] type 00 class 0x088000
[ 18.087868] pci 0000:80:04.3: reg 0x10: [mem 0x385ffff10000-0x385ffff13fff 64bit]
[ 18.096055] pci 0000:80:04.4: [8086:6f24] type 00 class 0x088000
[ 18.102871] pci 0000:80:04.4: reg 0x10: [mem 0x385ffff0c000-0x385ffff0ffff 64bit]
[ 18.111033] pci 0000:80:04.5: [8086:6f25] type 00 class 0x088000
[ 18.117873] pci 0000:80:04.5: reg 0x10: [mem 0x385ffff08000-0x385ffff0bfff 64bit]
[ 18.126060] pci 0000:80:04.6: [8086:6f26] type 00 class 0x088000
[ 18.132870] pci 0000:80:04.6: reg 0x10: [mem 0x385ffff04000-0x385ffff07fff 64bit]
[ 18.142053] pci 0000:80:04.7: [8086:6f27] type 00 class 0x088000
[ 18.148868] pci 0000:80:04.7: reg 0x10: [mem 0x385ffff00000-0x385ffff03fff 64bit]
[ 18.157059] pci 0000:80:05.0: [8086:6f28] type 00 class 0x088000
[ 18.164046] pci 0000:80:05.1: [8086:6f29] type 00 class 0x088000
[ 18.171046] pci 0000:80:05.2: [8086:6f2a] type 00 class 0x088000
[ 18.178015] pci 0000:80:05.4: [8086:6f2c] type 00 class 0x080020
[ 18.184866] pci 0000:80:05.4: reg 0x10: [mem 0xc8000000-0xc8000fff]
[ 18.193121] acpiphp: Slot [4] registered
[ 18.196911] pci 0000:80:02.0: PCI bridge to [bus 81]
[ 18.203229] acpiphp: Slot [3] registered
[ 18.207892] pci 0000:80:02.2: PCI bridge to [bus 82]
[ 18.213176] acpiphp: Slot [9] registered
[ 18.217891] pci 0000:80:03.0: PCI bridge to [bus 83]
[ 18.223346] ACPI: PCI Root Bridge [IIO3] (domain 0000 [bus c0-fe])
[ 18.230865] acpi PNP0A08:03: _OSC: OS supports [ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 18.239858] acpi PNP0A08:03: _OSC: not requesting OS control; OS requires [ExtendedConfig ASPM ClockPM MSI]
[ 18.251000] acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration
[ 18.259896] acpi PNP0A08:03: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ 18.272454] PCI host bridge to bus 0000:c0
[ 18.277862] pci_bus 0000:c0: root bus resource [io 0xc000-0xffff window]
[ 18.284856] pci_bus 0000:c0: root bus resource [mem 0xe4000000-0xfbffbfff window]
[ 18.293856] pci_bus 0000:c0: root bus resource [mem 0x386000000000-0x387fffffffff window]
[ 18.302859] pci_bus 0000:c0: root bus resource [bus c0-fe]
[ 18.308889] pci 0000:c0:02.0: [8086:6f04] type 01 class 0x060400
[ 18.315928] pci 0000:c0:02.0: PME# supported from D0 D3hot D3cold
[ 18.322073] pci 0000:c0:02.2: [8086:6f06] type 01 class 0x060400
[ 18.328924] pci 0000:c0:02.2: PME# supported from D0 D3hot D3cold
[ 18.336063] pci 0000:c0:03.0: [8086:6f08] type 01 class 0x060400
[ 18.342887] pci 0000:c0:03.0: enabling Extended Tags
[ 18.348915] pci 0000:c0:03.0: PME# supported from D0 D3hot D3cold
[ 18.356149] pci 0000:c0:04.0: [8086:6f20] type 00 class 0x088000
[ 18.362869] pci 0000:c0:04.0: reg 0x10: [mem 0x387ffff1c000-0x387ffff1ffff 64bit]
[ 18.371066] pci 0000:c0:04.1: [8086:6f21] type 00 class 0x088000
[ 18.377873] pci 0000:c0:04.1: reg 0x10: [mem 0x387ffff18000-0x387ffff1bfff 64bit]
[ 18.386062] pci 0000:c0:04.2: [8086:6f22] type 00 class 0x088000
[ 18.392868] pci 0000:c0:04.2: reg 0x10: [mem 0x387ffff14000-0x387ffff17fff 64bit]
[ 18.401048] pci 0000:c0:04.3: [8086:6f23] type 00 class 0x088000
[ 18.407872] pci 0000:c0:04.3: reg 0x10: [mem 0x387ffff10000-0x387ffff13fff 64bit]
[ 18.417058] pci 0000:c0:04.4: [8086:6f24] type 00 class 0x088000
[ 18.423867] pci 0000:c0:04.4: reg 0x10: [mem 0x387ffff0c000-0x387ffff0ffff 64bit]
[ 18.432054] pci 0000:c0:04.5: [8086:6f25] type 00 class 0x088000
[ 18.438867] pci 0000:c0:04.5: reg 0x10: [mem 0x387ffff08000-0x387ffff0bfff 64bit]
[ 18.447046] pci 0000:c0:04.6: [8086:6f26] type 00 class 0x088000
[ 18.453867] pci 0000:c0:04.6: reg 0x10: [mem 0x387ffff04000-0x387ffff07fff 64bit]
[ 18.462047] pci 0000:c0:04.7: [8086:6f27] type 00 class 0x088000
[ 18.468870] pci 0000:c0:04.7: reg 0x10: [mem 0x387ffff00000-0x387ffff03fff 64bit]
[ 18.478037] pci 0000:c0:05.0: [8086:6f28] type 00 class 0x088000
[ 18.485065] pci 0000:c0:05.1: [8086:6f29] type 00 class 0x088000
[ 18.491044] pci 0000:c0:05.2: [8086:6f2a] type 00 class 0x088000
[ 18.497988] pci 0000:c0:05.4: [8086:6f2c] type 00 class 0x080020
[ 18.504865] pci 0000:c0:05.4: reg 0x10: [mem 0xe4000000-0xe4000fff]
[ 18.513959] acpiphp: Slot [12] registered
[ 18.517898] pci 0000:c0:02.0: PCI bridge to [bus c1]
[ 18.524186] acpiphp: Slot [10] registered
[ 18.527892] pci 0000:c0:02.2: PCI bridge to [bus c2]
[ 18.534151] acpiphp: Slot [11] registered
[ 18.538891] pci 0000:c0:03.0: PCI bridge to [bus c3]
[ 18.545891] iommu: Default domain type: Translated
[ 18.550861] iommu: DMA domain TLB invalidation policy: lazy mode
[ 18.558508] SCSI subsystem initialized
[ 18.562996] ACPI: bus type USB registered
[ 18.567881] usbcore: registered new interface driver usbfs
[ 18.573870] usbcore: registered new interface driver hub
[ 18.580023] usbcore: registered new device driver usb
[ 18.586017] pps_core: LinuxPPS API ver. 1 registered
[ 18.590858] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 18.600863] PTP clock support registered
[ 18.606247] EDAC MC: Ver: 3.0.0
[ 18.610926] Registered efivars operations
[ 18.616864] NetLabel: Initializing
[ 18.620857] NetLabel: domain hash size = 128
[ 18.625858] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 18.631894] NetLabel: unlabeled traffic allowed by default
[ 18.637863] PCI: Using ACPI for IRQ routing
[ 18.643993] pci 0000:08:00.0: vgaarb: setting as boot VGA device
[ 18.648853] pci 0000:08:00.0: vgaarb: bridge control possible
[ 18.654854] pci 0000:08:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[ 18.666869] vgaarb: loaded
[ 18.670019] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[ 18.676861] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[ 18.686333] clocksource: Switched to clocksource tsc-early
[ 18.693121] VFS: Disk quotas dquot_6.6.0
[ 18.697730] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 18.705774] pnp: PnP ACPI init
[ 18.712111] system 00:01: [io 0x0500-0x053f] has been reserved
[ 18.718736] system 00:01: [io 0x0400-0x047f] has been reserved
[ 18.725353] system 00:01: [io 0x0540-0x057f] has been reserved
[ 18.731971] system 00:01: [io 0x0600-0x061f] has been reserved
[ 18.738595] system 00:01: [io 0x0ca0-0x0ca5] could not be reserved
[ 18.745607] system 00:01: [io 0x0880-0x0883] has been reserved
[ 18.752227] system 00:01: [io 0x0800-0x081f] has been reserved
[ 18.758849] system 00:01: [mem 0xfed1c000-0xfed3ffff] could not be reserved
[ 18.766646] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved
[ 18.774040] system 00:01: [mem 0xff000000-0xffffffff] has been reserved
[ 18.781440] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved
[ 18.788841] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved
[ 18.796240] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved
[ 18.803638] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved
[ 18.812485] pnp: PnP ACPI: found 5 devices
[ 18.825567] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 18.835935] NET: Registered PF_INET protocol family
[ 18.842998] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[ 18.857637] tcp_listen_portaddr_hash hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc)
[ 18.867996] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, vmalloc)
[ 18.877069] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc)
[ 18.887907] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[ 18.897315] TCP: Hash tables configured (established 524288 bind 65536)
[ 18.906975] MPTCP token hash table entries: 65536 (order: 8, 1572864 bytes, vmalloc)
[ 18.916280] UDP hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[ 18.924941] UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[ 18.935004] NET: Registered PF_UNIX/PF_LOCAL protocol family
[ 18.941355] NET: Registered PF_XDP protocol family
[ 18.946841] pci 0000:01:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window
[ 18.957937] pci 0000:03:00.0: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window
[ 18.969025] pci 0000:03:00.1: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window
[ 18.980115] pci 0000:08:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 18.991502] pci 0000:01:00.0: BAR 6: no space for [mem size 0x00100000 pref]
[ 18.999399] pci 0000:01:00.0: BAR 6: failed to assign [mem size 0x00100000 pref]
[ 19.007668] pci 0000:00:02.0: PCI bridge to [bus 01]
[ 19.013217] pci 0000:00:02.0: bridge window [io 0x1000-0x1fff]
[ 19.020031] pci 0000:00:02.0: bridge window [mem 0x92300000-0x923fffff]
[ 19.027633] pci 0000:00:03.0: PCI bridge to [bus 02]
[ 19.033183] pci 0000:03:00.0: BAR 6: assigned [mem 0x91f00000-0x91f7ffff pref]
[ 19.041256] pci 0000:03:00.1: BAR 6: assigned [mem 0x91f80000-0x91ffffff pref]
[ 19.049330] pci 0000:00:03.2: PCI bridge to [bus 03-04]
[ 19.055175] pci 0000:00:03.2: bridge window [mem 0x91f00000-0x922fffff]
[ 19.062768] pci 0000:00:03.2: bridge window [mem 0x91a00000-0x91efffff 64bit pref]
[ 19.071427] pci 0000:00:03.3: PCI bridge to [bus 05]
[ 19.076986] pci 0000:00:11.0: PCI bridge to [bus 06]
[ 19.082555] pci 0000:00:1c.0: PCI bridge to [bus 07]
[ 19.088119] pci 0000:08:00.0: BAR 6: assigned [mem 0x91810000-0x9181ffff pref]
[ 19.096192] pci 0000:00:1c.7: PCI bridge to [bus 08]
[ 19.101744] pci 0000:00:1c.7: bridge window [mem 0x91000000-0x918fffff]
[ 19.109333] pci 0000:00:1c.7: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 19.118000] pci 0000:00:1e.0: PCI bridge to [bus 09]
[ 19.123563] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
[ 19.130469] pci_bus 0000:00: resource 5 [io 0x1000-0x3fff window]
[ 19.137371] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[ 19.145054] pci_bus 0000:00: resource 7 [mem 0x000c4000-0x000cbfff window]
[ 19.152736] pci_bus 0000:00: resource 8 [mem 0x90000000-0xabffbfff window]
[ 19.160422] pci_bus 0000:00: resource 9 [mem 0x380000000000-0x381fffffffff window]
[ 19.168884] pci_bus 0000:01: resource 0 [io 0x1000-0x1fff]
[ 19.175108] pci_bus 0000:01: resource 1 [mem 0x92300000-0x923fffff]
[ 19.182117] pci_bus 0000:03: resource 1 [mem 0x91f00000-0x922fffff]
[ 19.189124] pci_bus 0000:03: resource 2 [mem 0x91a00000-0x91efffff 64bit pref]
[ 19.197200] pci_bus 0000:08: resource 1 [mem 0x91000000-0x918fffff]
[ 19.204196] pci_bus 0000:08: resource 2 [mem 0x90000000-0x90ffffff 64bit pref]
[ 19.212273] pci_bus 0000:09: resource 4 [io 0x0000-0x0cf7 window]
[ 19.219181] pci_bus 0000:09: resource 5 [io 0x1000-0x3fff window]
[ 19.226094] pci_bus 0000:09: resource 6 [mem 0x000a0000-0x000bffff window]
[ 19.233779] pci_bus 0000:09: resource 7 [mem 0x000c4000-0x000cbfff window]
[ 19.241465] pci_bus 0000:09: resource 8 [mem 0x90000000-0xabffbfff window]
[ 19.249159] pci_bus 0000:09: resource 9 [mem 0x380000000000-0x381fffffffff window]
[ 19.257892] pci 0000:40:02.0: bridge window [io 0x1000-0x0fff] to [bus 41] add_size 1000
[ 19.267036] pci 0000:40:02.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 41] add_size 200000 add_align 100000
[ 19.279863] pci 0000:40:02.0: bridge window [mem 0x00100000-0x000fffff] to [bus 41] add_size 200000 add_align 100000
[ 19.291623] pci 0000:40:02.2: bridge window [io 0x1000-0x0fff] to [bus 42] add_size 1000
[ 19.300768] pci 0000:40:02.2: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 42] add_size 200000 add_align 100000
[ 19.313597] pci 0000:40:02.2: bridge window [mem 0x00100000-0x000fffff] to [bus 42] add_size 200000 add_align 100000
[ 19.325380] pci 0000:40:02.0: BAR 14: assigned [mem 0xac100000-0xac2fffff]
[ 19.333068] pci 0000:40:02.0: BAR 15: assigned [mem 0x382000000000-0x3820001fffff 64bit pref]
[ 19.342598] pci 0000:40:02.2: BAR 14: assigned [mem 0xac300000-0xac4fffff]
[ 19.350284] pci 0000:40:02.2: BAR 15: assigned [mem 0x382000200000-0x3820003fffff 64bit pref]
[ 19.359818] pci 0000:40:02.0: BAR 13: assigned [io 0x4000-0x4fff]
[ 19.366731] pci 0000:40:02.2: BAR 13: assigned [io 0x5000-0x5fff]
[ 19.373643] pci 0000:40:02.0: PCI bridge to [bus 41]
[ 19.379196] pci 0000:40:02.0: bridge window [io 0x4000-0x4fff]
[ 19.386010] pci 0000:40:02.0: bridge window [mem 0xac100000-0xac2fffff]
[ 19.393604] pci 0000:40:02.0: bridge window [mem 0x382000000000-0x3820001fffff 64bit pref]
[ 19.403041] pci 0000:40:02.2: PCI bridge to [bus 42]
[ 19.408594] pci 0000:40:02.2: bridge window [io 0x5000-0x5fff]
[ 19.415406] pci 0000:40:02.2: bridge window [mem 0xac300000-0xac4fffff]
[ 19.422996] pci 0000:40:02.2: bridge window [mem 0x382000200000-0x3820003fffff 64bit pref]
[ 19.432432] pci 0000:40:03.0: PCI bridge to [bus 43]
[ 19.437994] pci_bus 0000:40: resource 4 [io 0x4000-0x7fff window]
[ 19.444901] pci_bus 0000:40: resource 5 [mem 0xac000000-0xc7ffbfff window]
[ 19.452584] pci_bus 0000:40: resource 6 [mem 0x382000000000-0x383fffffffff window]
[ 19.461047] pci_bus 0000:41: resource 0 [io 0x4000-0x4fff]
[ 19.467274] pci_bus 0000:41: resource 1 [mem 0xac100000-0xac2fffff]
[ 19.474284] pci_bus 0000:41: resource 2 [mem 0x382000000000-0x3820001fffff 64bit pref]
[ 19.483136] pci_bus 0000:42: resource 0 [io 0x5000-0x5fff]
[ 19.489367] pci_bus 0000:42: resource 1 [mem 0xac300000-0xac4fffff]
[ 19.496374] pci_bus 0000:42: resource 2 [mem 0x382000200000-0x3820003fffff 64bit pref]
[ 19.505306] ACPI: \_SB_.IIO1.AID1: IOxAPIC at (null), GSI 48
[ 19.511791] pci 0000:80:02.0: PCI bridge to [bus 81]
[ 19.517351] pci 0000:80:02.2: PCI bridge to [bus 82]
[ 19.522907] pci 0000:80:03.0: PCI bridge to [bus 83]
[ 19.528470] pci_bus 0000:80: resource 4 [io 0x8000-0xbfff window]
[ 19.535377] pci_bus 0000:80: resource 5 [mem 0xc8000000-0xe3ffbfff window]
[ 19.543061] pci_bus 0000:80: resource 6 [mem 0x384000000000-0x385fffffffff window]
[ 19.551614] ACPI: \_SB_.IIO2.AID2: IOxAPIC at (null), GSI 72
[ 19.558091] pci 0000:c0:02.0: bridge window [io 0x1000-0x0fff] to [bus c1] add_size 1000
[ 19.567233] pci 0000:c0:02.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus c1] add_size 200000 add_align 100000
[ 19.580064] pci 0000:c0:02.0: bridge window [mem 0x00100000-0x000fffff] to [bus c1] add_size 200000 add_align 100000
[ 19.591819] pci 0000:c0:02.2: bridge window [io 0x1000-0x0fff] to [bus c2] add_size 1000
[ 19.600956] pci 0000:c0:02.2: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus c2] add_size 200000 add_align 100000
[ 19.613784] pci 0000:c0:02.2: bridge window [mem 0x00100000-0x000fffff] to [bus c2] add_size 200000 add_align 100000
[ 19.625559] pci 0000:c0:02.0: BAR 14: assigned [mem 0xe4100000-0xe42fffff]
[ 19.633234] pci 0000:c0:02.0: BAR 15: assigned [mem 0x386000000000-0x3860001fffff 64bit pref]
[ 19.642761] pci 0000:c0:02.2: BAR 14: assigned [mem 0xe4300000-0xe44fffff]
[ 19.650446] pci 0000:c0:02.2: BAR 15: assigned [mem 0x386000200000-0x3860003fffff 64bit pref]
[ 19.659979] pci 0000:c0:02.0: BAR 13: assigned [io 0xc000-0xcfff]
[ 19.666887] pci 0000:c0:02.2: BAR 13: assigned [io 0xd000-0xdfff]
[ 19.673797] pci 0000:c0:02.0: PCI bridge to [bus c1]
[ 19.679352] pci 0000:c0:02.0: bridge window [io 0xc000-0xcfff]
[ 19.686167] pci 0000:c0:02.0: bridge window [mem 0xe4100000-0xe42fffff]
[ 19.693761] pci 0000:c0:02.0: bridge window [mem 0x386000000000-0x3860001fffff 64bit pref]
[ 19.703197] pci 0000:c0:02.2: PCI bridge to [bus c2]
[ 19.708749] pci 0000:c0:02.2: bridge window [io 0xd000-0xdfff]
[ 19.715568] pci 0000:c0:02.2: bridge window [mem 0xe4300000-0xe44fffff]
[ 19.723160] pci 0000:c0:02.2: bridge window [mem 0x386000200000-0x3860003fffff 64bit pref]
[ 19.732595] pci 0000:c0:03.0: PCI bridge to [bus c3]
[ 19.738155] pci_bus 0000:c0: resource 4 [io 0xc000-0xffff window]
[ 19.745063] pci_bus 0000:c0: resource 5 [mem 0xe4000000-0xfbffbfff window]
[ 19.752747] pci_bus 0000:c0: resource 6 [mem 0x386000000000-0x387fffffffff window]
[ 19.761207] pci_bus 0000:c1: resource 0 [io 0xc000-0xcfff]
[ 19.767436] pci_bus 0000:c1: resource 1 [mem 0xe4100000-0xe42fffff]
[ 19.774441] pci_bus 0000:c1: resource 2 [mem 0x386000000000-0x3860001fffff 64bit pref]
[ 19.783293] pci_bus 0000:c2: resource 0 [io 0xd000-0xdfff]
[ 19.789523] pci_bus 0000:c2: resource 1 [mem 0xe4300000-0xe44fffff]
[ 19.796529] pci_bus 0000:c2: resource 2 [mem 0x386000200000-0x3860003fffff 64bit pref]
[ 19.805433] ACPI: \_SB_.IIO3.AID3: IOxAPIC at (null), GSI 96
[ 19.813129] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28]
[ 19.821703] pci 0000:40:05.0: disabled boot interrupts on device [8086:6f28]
[ 19.829650] pci 0000:80:05.0: disabled boot interrupts on device [8086:6f28]
[ 19.837577] pci 0000:c0:05.0: disabled boot interrupts on device [8086:6f28]
[ 19.845472] PCI: CLS 32 bytes, default 64
[ 19.849959] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 19.850024] Trying to unpack rootfs image as initramfs...
[ 19.857144] software IO TLB: mapped [mem 0x0000000075b89000-0x0000000079b89000] (64MB)
[ 19.909988] Initialise system trusted keyrings
[ 19.915006] Key type blacklist registered
[ 19.919704] workingset: timestamp_bits=36 max_order=27 bucket_order=0
[ 19.926971] zbud: loaded
[ 19.932828] integrity: Platform Keyring initialized
[ 19.961518] NET: Registered PF_ALG protocol family
[ 19.966897] xor: automatically using best checksumming function avx
[ 19.974771] Key type asymmetric registered
[ 19.979354] Asymmetric key parser 'x509' registered
[ 20.884911] Freeing initrd memory: 31004K
[ 20.899469] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[ 20.903873] tsc: Refined TSC clocksource calibration: 2194.711 MHz
[ 20.908026] io scheduler mq-deadline registered
[ 20.914763] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1fa2ae85276, max_idle_ns: 440795242984 ns
[ 20.919706] io scheduler kyber registered
[ 20.935505] clocksource: Switched to clocksource tsc
[ 20.935625] io scheduler bfq registered
[ 20.951346] atomic64_test: passed for x86-64 platform with CX8 and with SSE
[ 20.965801] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 20.973579] ACPI: \_SB_.SCK0.CP00: Found 2 idle states
[ 21.001835] input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input0
[ 21.011439] ACPI: button: Sleep Button [SLPB]
[ 21.016394] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1
[ 21.024726] ACPI: button: Power Button [PWRF]
[ 21.074639] ERST: Error Record Serialization Table (ERST) support is initialized.
[ 21.083013] pstore: Registered erst as persistent store backend
[ 21.090338] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 21.097574] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 21.107077] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[ 21.120755] Non-volatile memory driver v1.3
[ 21.125493] Linux agpgart interface v0.103
[ 21.138951] tpm_tis 00:04: 1.2 TPM (device-id 0x0, rev-id 78)
[ 21.157972] tpm tpm0: [Hardware Error]: Adjusting reported durations.
[ 21.183691] tpm tpm0: TPM is disabled/deactivated (0x6)
[ 21.189555] tpm tpm0: tpm_read_log_acpi: TCPA log area empty
[ 21.251799] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x10 impl SATA mode
[ 21.260962] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst
[ 21.271216] scsi host0: ahci
[ 21.275148] scsi host1: ahci
[ 21.278773] scsi host2: ahci
[ 21.282455] scsi host3: ahci
[ 21.286110] scsi host4: ahci
[ 21.289782] scsi host5: ahci
[ 21.293153] ata1: DUMMY
[ 21.295891] ata2: DUMMY
[ 21.298630] ata3: DUMMY
[ 21.301364] ata4: DUMMY
[ 21.304100] ata5: SATA max UDMA/133 abar m2048@0x92400000 port 0x92400300 irq 41
[ 21.312371] ata6: DUMMY
[ 21.317776] ehci-pci 0000:00:1a.0: EHCI Host Controller
[ 21.317786] usbcore: registered new interface driver usbserial_generic
[ 21.323744] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[ 21.331011] usbserial: USB Serial support registered for generic
[ 21.339229] ehci-pci 0000:00:1a.0: debug port 2
[ 21.345983] i8042: PNP: No PS/2 controller found.
[ 21.354937] ehci-pci 0000:00:1a.0: irq 16, io mem 0x92402000
[ 21.356327] mousedev: PS/2 mouse device common for all mice
[ 21.369256] rtc_cmos 00:00: RTC can wake from S4
[ 21.369911] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[ 21.375024] rtc_cmos 00:00: registered as rtc0
[ 21.381052] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.02
[ 21.385983] rtc_cmos 00:00: setting system clock to 2023-01-05T16:43:35 UTC (1672937015)
[ 21.395045] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 21.395051] usb usb1: Product: EHCI Host Controller
[ 21.404155] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram
[ 21.412158] usb usb1: Manufacturer: Linux 6.2.0-rc2+ ehci_hcd
[ 21.431533] usb usb1: SerialNumber: 0000:00:1a.0
[ 21.437082] hub 1-0:1.0: USB hub found
[ 21.441367] hub 1-0:1.0: 2 ports detected
[ 21.446375] ehci-pci 0000:00:1d.0: EHCI Host Controller
[ 21.451181] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ 21.452348] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[ 21.465922] device-mapper: uevent: version 1.0.3
[ 21.474091] ehci-pci 0000:00:1d.0: debug port 2
[ 21.479549] device-mapper: ioctl: 4.47.0-ioctl (2022-07-28) initialised: dm-devel@redhat.com
[ 21.488241] ehci-pci 0000:00:1d.0: irq 23, io mem 0x92401000
[ 21.494277] intel_pstate: Intel P-state driver initializing
[ 21.506898] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[ 21.513467] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.02
[ 21.522719] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 21.530789] usb usb2: Product: EHCI Host Controller
[ 21.536239] usb usb2: Manufacturer: Linux 6.2.0-rc2+ ehci_hcd
[ 21.542665] usb usb2: SerialNumber: 0000:00:1d.0
[ 21.548134] hub 2-0:1.0: USB hub found
[ 21.552369] hub 2-0:1.0: 2 ports detected
[ 21.606651] efifb: probing for efifb
[ 21.610683] efifb: No BGRT, not showing boot graphics
[ 21.616328] efifb: framebuffer at 0x90000000, using 5120k, total 5120k
[ 21.622100] ata5: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[ 21.623623] efifb: mode is 1280x1024x32, linelength=5120, pages=1
[ 21.623630] efifb: scrolling: redraw
[ 21.632369] ata5.00: ATAPI: TEAC DV-W28S-W, 1.0A, max UDMA/100
[ 21.637336] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[ 21.654519] Console: switching to colour frame buffer device 160x64
[ 21.659332] ata5.00: configured for UDMA/100
[ 21.674171] scsi 4:0:0:0: CD-ROM TEAC DV-W28S-W 1.0A PQ: 0 ANSI: 5
[ 21.682885] usb 1-1: new high-speed USB device number 2 using ehci-pci
[ 21.719418] fb0: EFI VGA frame buffer device
[ 21.724381] hid: raw HID events driver (C) Jiri Kosina
[ 21.730358] usbcore: registered new interface driver usbhid
[ 21.736802] usbhid: USB HID core driver
[ 21.741881] drop_monitor: Initializing network drop monitor service
[ 21.744930] sr 4:0:0:0: [sr0] scsi3-mmc drive: 24x/24x writer dvd-ram cd/rw xa/form2 cdda tray
[ 21.749433] Initializing XFRM netlink socket
[ 21.758511] cdrom: Uniform CD-ROM driver Revision: 3.20
[ 21.763777] NET: Registered PF_INET6 protocol family
[ 21.786867] Segment Routing with IPv6
[ 21.791090] RPL Segment Routing with IPv6
[ 21.795744] In-situ OAM (IOAM) with IPv6
[ 21.795910] usb 2-1: new high-speed USB device number 2 using ehci-pci
[ 21.800203] mip6: Mobile IPv6
[ 21.811273] NET: Registered PF_PACKET protocol family
[ 21.815209] usb 1-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[ 21.826574] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 21.835156] hub 1-1:1.0: USB hub found
[ 21.839620] hub 1-1:1.0: 6 ports detected
[ 21.844456] sr 4:0:0:0: Attached scsi generic sg0 type 5
[ 21.868016] microcode: Microcode Update Driver: v2.2.
[ 21.879194] resctrl: L3 allocation detected
[ 21.889893] resctrl: L3 monitoring detected
[ 21.894742] IPI shorthand broadcast: enabled
[ 21.899699] AVX2 version of gcm_enc/dec engaged.
[ 21.905567] AES CTR mode by8 optimization enabled
[ 21.914038] sched_clock: Marking stable (17914427775, 3999425911)->(22837931810, -924078124)
[ 21.936337] usb 2-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[ 21.941299] registered taskstats version 1
[ 21.945483] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 21.959144] hub 2-1:1.0: USB hub found
[ 21.963622] hub 2-1:1.0: 8 ports detected
[ 21.966687] Loading compiled-in X.509 certificates
[ 21.988139] Loaded X.509 cert 'Build time autogenerated kernel key: d9ee3e5f7dde388b58bc603daf51328079932e36'
[ 22.006619] zswap: loaded using pool lzo/zbud
[ 22.018610] page_owner is disabled
[ 22.035857] Key type .fscrypt registered
[ 22.052864] Key type fscrypt-provisioning registered
[ 22.072533] Btrfs loaded, crc32c=crc32c-generic, zoned=yes, fsverity=yes
[ 22.093276] pstore: Using crash dump compression: deflate
[ 22.117735] Key type encrypted registered
[ 22.137535] Loading compiled-in module X.509 certificates
[ 22.156779] Loaded X.509 cert 'Build time autogenerated kernel key: d9ee3e5f7dde388b58bc603daf51328079932e36'
[ 22.180623] ima: Allocated hash algorithm: sha256
[ 22.202813] ima: Error Communicating to TPM chip
[ 22.224789] ima: Error Communicating to TPM chip
[ 22.242921] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
[ 22.246365] ima: Error Communicating to TPM chip
[ 22.284687] ima: Error Communicating to TPM chip
[ 22.306352] ima: Error Communicating to TPM chip
[ 22.327954] ima: Error Communicating to TPM chip
[ 22.349382] ima: Error Communicating to TPM chip
[ 22.352963] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10, bcdDevice= 1.00
[ 22.358733] ima: Error Communicating to TPM chip
[ 22.363880] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 22.378981] ima: No architecture policies found
[ 22.389241] usb 2-1.4: Product: Virtual Keyboard and Mouse
[ 22.394330] evm: Initialising EVM extended attributes:
[ 22.400427] usb 2-1.4: Manufacturer: American Megatrends Inc.
[ 22.406160] evm: security.selinux
[ 22.406164] evm: security.SMACK64 (disabled)
[ 22.412582] usb 2-1.4: SerialNumber: serial
[ 22.416281] evm: security.SMACK64EXEC (disabled)
[ 22.422913] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/0003:046B:FF10.0001/input/input2
[ 22.425718] evm: security.SMACK64TRANSMUTE (disabled)
[ 22.431130] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
[ 22.447280] evm: security.SMACK64MMAP (disabled)
[ 22.454229] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/0003:046B:FF10.0002/input/input3
[ 22.469613] evm: security.apparmor (disabled)
[ 22.469615] evm: security.ima
[ 22.469618] evm: security.capability
[ 22.469620] evm: HMAC attrs: 0x1
[ 22.663218] alg: No test for 842 (842-scomp)
[ 22.667110] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
[ 22.671924] alg: No test for 842 (842-generic)
[ 22.983231] PM: Magic number: 7:724:741
[ 23.002043] pci 0000:ff:0d.3: hash matches
[ 23.020645] acpi LNXCPU:3d: hash matches
[ 23.038948] workqueue writeback: hash matches
[ 23.069836] RAS: Correctable Errors collector initialized.
[ 23.093156] Freeing unused decrypted memory: 2036K
[ 23.114283] Freeing unused kernel image (initmem) memory: 4056K
[ 23.135156] Write protecting the kernel read-only data: 26624k
[ 23.156636] Freeing unused kernel image (rodata/data gap) memory: 1120K
[ 23.252219] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 23.273677] rodata_test: all tests were successful
[ 23.293137] x86/mm: Checking user space page tables
[ 23.380424] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 23.401584] Run /init as init process
[-- Attachment #3: revert --]
[-- Type: application/octet-stream, Size: 125746 bytes --]
[ 0.000000] microcode: microcode updated early to revision 0xb00003e, date = 2021-02-06
[ 0.000000] Linux version 6.2.0-rc2+ (aegl@brk-bdx-01.sc.intel.com) (gcc (GCC) 11.2.1 20210728 (Red Hat 11.2.1-1), GNU ld version 2.35.2-5.fc34) #129 SMP PREEMPT_DYNAMIC Thu Jan 5 09:20:40 PST 2023
[ 0.000000] Command line: BOOT_IMAGE=(hd1,gpt2)/vmlinuz-6.2.0-rc2+ root=UUID=c1fd9bc7-73bf-4cc4-b72b-a369bdec1a5e ro rootflags=subvol=root console=tty1 console=ttyS0,115200 intel_iommu=on,sm_on
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[ 0.000000] signal: max sigframe size: 1776
[ 0.000000] BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008dfff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000008e000-0x000000000008ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000090000-0x000000000009ffff] usable
[ 0.000000] BIOS-e820: [mem 0x00000000000a0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000005c687fff] usable
[ 0.000000] BIOS-e820: [mem 0x000000005c688000-0x000000005db85fff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000005db86000-0x000000005fd97fff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x000000005fd98000-0x000000005ff20fff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x000000005ff21000-0x000000007bafffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007bb00000-0x000000008fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000807fffffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] extended physical RAM map:
[ 0.000000] reserve setup_data: [mem 0x0000000000000000-0x000000000008dfff] usable
[ 0.000000] reserve setup_data: [mem 0x000000000008e000-0x000000000008ffff] reserved
[ 0.000000] reserve setup_data: [mem 0x0000000000090000-0x000000000009ffff] usable
[ 0.000000] reserve setup_data: [mem 0x00000000000a0000-0x00000000000fffff] reserved
[ 0.000000] reserve setup_data: [mem 0x0000000000100000-0x000000005af75017] usable
[ 0.000000] reserve setup_data: [mem 0x000000005af75018-0x000000005af7d057] usable
[ 0.000000] reserve setup_data: [mem 0x000000005af7d058-0x000000005af7e017] usable
[ 0.000000] reserve setup_data: [mem 0x000000005af7e018-0x000000005afa2e57] usable
[ 0.000000] reserve setup_data: [mem 0x000000005afa2e58-0x000000005afa3017] usable
[ 0.000000] reserve setup_data: [mem 0x000000005afa3018-0x000000005afc7e57] usable
[ 0.000000] reserve setup_data: [mem 0x000000005afc7e58-0x000000005afc8017] usable
[ 0.000000] reserve setup_data: [mem 0x000000005afc8018-0x000000005b00f457] usable
[ 0.000000] reserve setup_data: [mem 0x000000005b00f458-0x000000005c687fff] usable
[ 0.000000] reserve setup_data: [mem 0x000000005c688000-0x000000005db85fff] reserved
[ 0.000000] reserve setup_data: [mem 0x000000005db86000-0x000000005fd97fff] ACPI NVS
[ 0.000000] reserve setup_data: [mem 0x000000005fd98000-0x000000005ff20fff] ACPI data
[ 0.000000] reserve setup_data: [mem 0x000000005ff21000-0x000000007bafffff] usable
[ 0.000000] reserve setup_data: [mem 0x000000007bb00000-0x000000008fffffff] reserved
[ 0.000000] reserve setup_data: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[ 0.000000] reserve setup_data: [mem 0x0000000100000000-0x000000807fffffff] usable
[ 0.000000] efi: EFI v2.40 by EDK II BIOS ID:BRBDXSD1.86B.0338.V01.1603162127
[ 0.000000] efi: ACPI=0x5ff20000 ACPI 2.0=0x5ff20014 SMBIOS=0x5ca84000 MOKvar=0x7a88a000 RNG=0x5fde1f98
[ 0.000000] random: crng init done
[ 0.000000] SMBIOS 3.0 present.
[ 0.000000] DMI: Intel Corporation BRICKLAND/BRICKLAND, BIOS BRBDXSD1.86B.0338.V01.1603162127 03/16/2016
[ 0.000000] tsc: Fast TSC calibration using PIT
[ 0.000000] tsc: Detected 2194.543 MHz processor
[ 0.000416] last_pfn = 0x8080000 max_arch_pfn = 0x400000000
[ 0.000424] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT
[ 0.001277] last_pfn = 0x7bb00 max_arch_pfn = 0x400000000
[ 0.017059] Using GB pages for direct mapping
[ 0.017443] Secure boot disabled
[ 0.017444] RAMDISK: [mem 0x2ca14000-0x2e85afff]
[ 0.017452] ACPI: Early table checksum verification disabled
[ 0.017458] ACPI: RSDP 0x000000005FF20014 000024 (v02 INTEL )
[ 0.017463] ACPI: XSDT 0x000000005FDE4188 0000E4 (v01 INTEL TIANO 00000000 01000013)
[ 0.017471] ACPI: FACP 0x000000005FF1B000 0000F4 (v04 INTEL TIANO 00000000 MSFT 01000013)
[ 0.017478] ACPI: DSDT 0x000000005FEE6000 028260 (v02 INTEL TIANO 00000003 MSFT 01000013)
[ 0.017482] ACPI: FACS 0x000000005E4C6000 000040
[ 0.017486] ACPI: TCPA 0x000000005FF1E000 000064 (v02 INTEL EDK2 00000002 01000013)
[ 0.017490] ACPI: SSDT 0x000000005FF1D000 0003A2 (v02 INTEL TcgTable 00001000 INTL 20130328)
[ 0.017494] ACPI: BDAT 0x000000005FF1C000 000030 (v01 INTEL TIANO 00000000 MSFT 01000013)
[ 0.017497] ACPI: HPET 0x000000005FF1A000 000038 (v01 INTEL TIANO 00000001 MSFT 01000013)
[ 0.017501] ACPI: APIC 0x000000005FF19000 000AFC (v03 INTEL TIANO 00000000 MSFT 01000013)
[ 0.017505] ACPI: MCFG 0x000000005FF18000 00003C (v01 INTEL TIANO 00000001 MSFT 01000013)
[ 0.017508] ACPI: MSCT 0x000000005FF17000 0000E8 (v01 INTEL TIANO 00000001 MSFT 01000013)
[ 0.017512] ACPI: PCCT 0x000000005FF16000 0000AC (v01 INTEL TIANO 00000002 MSFT 01000013)
[ 0.017516] ACPI: PMCT 0x000000005FF15000 000060 (v01 INTEL TIANO 00000000 MSFT 01000013)
[ 0.017520] ACPI: RASF 0x000000005FF14000 000030 (v01 INTEL TIANO 00000001 MSFT 01000013)
[ 0.017524] ACPI: SLIT 0x000000005FF13000 00006C (v01 INTEL TIANO 00000001 MSFT 01000013)
[ 0.017528] ACPI: SRAT 0x000000005FF11000 001130 (v03 INTEL TIANO 00000001 MSFT 01000013)
[ 0.017531] ACPI: SVOS 0x000000005FF10000 000032 (v01 INTEL TIANO 00000000 MSFT 01000013)
[ 0.017535] ACPI: WDDT 0x000000005FF0F000 000040 (v01 INTEL TIANO 00000000 MSFT 01000013)
[ 0.017539] ACPI: SSDT 0x000000005FDEC000 0F9430 (v02 INTEL SSDT PM 00004000 INTL 20130328)
[ 0.017543] ACPI: SSDT 0x000000005FDE9000 00246F (v02 INTEL SpsNm 00000002 INTL 20130328)
[ 0.017547] ACPI: SSDT 0x000000005FDE8000 000040 (v02 INTEL SpsNvs 00000002 INTL 20130328)
[ 0.017550] ACPI: PRAD 0x000000005FDE7000 000125 (v02 INTEL SpsPrAgg 00000002 INTL 20130328)
[ 0.017554] ACPI: SPCR 0x000000005FDE6000 000050 (v01 00000000 00000000)
[ 0.017558] ACPI: HEST 0x000000005FDE5000 0000A8 (v01 INTEL 00000001 INTL 00000001)
[ 0.017562] ACPI: BERT 0x000000005FF1F000 000030 (v01 INTEL 00000001 INTL 00000001)
[ 0.017566] ACPI: ERST 0x000000005FDE3000 000230 (v01 INTEL 00000001 INTL 00000001)
[ 0.017570] ACPI: EINJ 0x000000005FDE2000 000150 (v01 INTEL 00000001 INTL 00000001)
[ 0.017573] ACPI: Reserving FACP table memory at [mem 0x5ff1b000-0x5ff1b0f3]
[ 0.017575] ACPI: Reserving DSDT table memory at [mem 0x5fee6000-0x5ff0e25f]
[ 0.017577] ACPI: Reserving FACS table memory at [mem 0x5e4c6000-0x5e4c603f]
[ 0.017578] ACPI: Reserving TCPA table memory at [mem 0x5ff1e000-0x5ff1e063]
[ 0.017579] ACPI: Reserving SSDT table memory at [mem 0x5ff1d000-0x5ff1d3a1]
[ 0.017581] ACPI: Reserving BDAT table memory at [mem 0x5ff1c000-0x5ff1c02f]
[ 0.017582] ACPI: Reserving HPET table memory at [mem 0x5ff1a000-0x5ff1a037]
[ 0.017583] ACPI: Reserving APIC table memory at [mem 0x5ff19000-0x5ff19afb]
[ 0.017584] ACPI: Reserving MCFG table memory at [mem 0x5ff18000-0x5ff1803b]
[ 0.017586] ACPI: Reserving MSCT table memory at [mem 0x5ff17000-0x5ff170e7]
[ 0.017587] ACPI: Reserving PCCT table memory at [mem 0x5ff16000-0x5ff160ab]
[ 0.017588] ACPI: Reserving PMCT table memory at [mem 0x5ff15000-0x5ff1505f]
[ 0.017590] ACPI: Reserving RASF table memory at [mem 0x5ff14000-0x5ff1402f]
[ 0.017591] ACPI: Reserving SLIT table memory at [mem 0x5ff13000-0x5ff1306b]
[ 0.017592] ACPI: Reserving SRAT table memory at [mem 0x5ff11000-0x5ff1212f]
[ 0.017594] ACPI: Reserving SVOS table memory at [mem 0x5ff10000-0x5ff10031]
[ 0.017595] ACPI: Reserving WDDT table memory at [mem 0x5ff0f000-0x5ff0f03f]
[ 0.017596] ACPI: Reserving SSDT table memory at [mem 0x5fdec000-0x5fee542f]
[ 0.017597] ACPI: Reserving SSDT table memory at [mem 0x5fde9000-0x5fdeb46e]
[ 0.017598] ACPI: Reserving SSDT table memory at [mem 0x5fde8000-0x5fde803f]
[ 0.017599] ACPI: Reserving PRAD table memory at [mem 0x5fde7000-0x5fde7124]
[ 0.017600] ACPI: Reserving SPCR table memory at [mem 0x5fde6000-0x5fde604f]
[ 0.017602] ACPI: Reserving HEST table memory at [mem 0x5fde5000-0x5fde50a7]
[ 0.017603] ACPI: Reserving BERT table memory at [mem 0x5ff1f000-0x5ff1f02f]
[ 0.017604] ACPI: Reserving ERST table memory at [mem 0x5fde3000-0x5fde322f]
[ 0.017605] ACPI: Reserving EINJ table memory at [mem 0x5fde2000-0x5fde214f]
[ 0.017672] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[ 0.017674] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[ 0.017675] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[ 0.017676] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[ 0.017677] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[ 0.017679] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[ 0.017680] SRAT: PXM 0 -> APIC 0x10 -> Node 0
[ 0.017681] SRAT: PXM 0 -> APIC 0x12 -> Node 0
[ 0.017682] SRAT: PXM 0 -> APIC 0x14 -> Node 0
[ 0.017683] SRAT: PXM 0 -> APIC 0x16 -> Node 0
[ 0.017684] SRAT: PXM 0 -> APIC 0x18 -> Node 0
[ 0.017686] SRAT: PXM 0 -> APIC 0x1a -> Node 0
[ 0.017687] SRAT: PXM 0 -> APIC 0x20 -> Node 0
[ 0.017688] SRAT: PXM 0 -> APIC 0x22 -> Node 0
[ 0.017689] SRAT: PXM 0 -> APIC 0x24 -> Node 0
[ 0.017690] SRAT: PXM 0 -> APIC 0x26 -> Node 0
[ 0.017692] SRAT: PXM 0 -> APIC 0x28 -> Node 0
[ 0.017693] SRAT: PXM 0 -> APIC 0x2a -> Node 0
[ 0.017694] SRAT: PXM 0 -> APIC 0x30 -> Node 0
[ 0.017696] SRAT: PXM 0 -> APIC 0x32 -> Node 0
[ 0.017697] SRAT: PXM 0 -> APIC 0x34 -> Node 0
[ 0.017699] SRAT: PXM 0 -> APIC 0x36 -> Node 0
[ 0.017700] SRAT: PXM 0 -> APIC 0x38 -> Node 0
[ 0.017701] SRAT: PXM 0 -> APIC 0x3a -> Node 0
[ 0.017703] SRAT: PXM 1 -> APIC 0x40 -> Node 1
[ 0.017704] SRAT: PXM 1 -> APIC 0x42 -> Node 1
[ 0.017705] SRAT: PXM 1 -> APIC 0x44 -> Node 1
[ 0.017706] SRAT: PXM 1 -> APIC 0x46 -> Node 1
[ 0.017707] SRAT: PXM 1 -> APIC 0x48 -> Node 1
[ 0.017709] SRAT: PXM 1 -> APIC 0x4a -> Node 1
[ 0.017710] SRAT: PXM 1 -> APIC 0x50 -> Node 1
[ 0.017711] SRAT: PXM 1 -> APIC 0x52 -> Node 1
[ 0.017712] SRAT: PXM 1 -> APIC 0x54 -> Node 1
[ 0.017713] SRAT: PXM 1 -> APIC 0x56 -> Node 1
[ 0.017715] SRAT: PXM 1 -> APIC 0x58 -> Node 1
[ 0.017716] SRAT: PXM 1 -> APIC 0x5a -> Node 1
[ 0.017717] SRAT: PXM 1 -> APIC 0x60 -> Node 1
[ 0.017719] SRAT: PXM 1 -> APIC 0x62 -> Node 1
[ 0.017720] SRAT: PXM 1 -> APIC 0x64 -> Node 1
[ 0.017721] SRAT: PXM 1 -> APIC 0x66 -> Node 1
[ 0.017723] SRAT: PXM 1 -> APIC 0x68 -> Node 1
[ 0.017724] SRAT: PXM 1 -> APIC 0x6a -> Node 1
[ 0.017725] SRAT: PXM 1 -> APIC 0x70 -> Node 1
[ 0.017726] SRAT: PXM 1 -> APIC 0x72 -> Node 1
[ 0.017727] SRAT: PXM 1 -> APIC 0x74 -> Node 1
[ 0.017728] SRAT: PXM 1 -> APIC 0x76 -> Node 1
[ 0.017729] SRAT: PXM 1 -> APIC 0x78 -> Node 1
[ 0.017731] SRAT: PXM 1 -> APIC 0x7a -> Node 1
[ 0.017732] SRAT: PXM 2 -> APIC 0x80 -> Node 2
[ 0.017733] SRAT: PXM 2 -> APIC 0x82 -> Node 2
[ 0.017734] SRAT: PXM 2 -> APIC 0x84 -> Node 2
[ 0.017735] SRAT: PXM 2 -> APIC 0x86 -> Node 2
[ 0.017736] SRAT: PXM 2 -> APIC 0x88 -> Node 2
[ 0.017737] SRAT: PXM 2 -> APIC 0x8a -> Node 2
[ 0.017738] SRAT: PXM 2 -> APIC 0x90 -> Node 2
[ 0.017740] SRAT: PXM 2 -> APIC 0x92 -> Node 2
[ 0.017741] SRAT: PXM 2 -> APIC 0x94 -> Node 2
[ 0.017742] SRAT: PXM 2 -> APIC 0x96 -> Node 2
[ 0.017743] SRAT: PXM 2 -> APIC 0x98 -> Node 2
[ 0.017744] SRAT: PXM 2 -> APIC 0x9a -> Node 2
[ 0.017746] SRAT: PXM 2 -> APIC 0xa0 -> Node 2
[ 0.017747] SRAT: PXM 2 -> APIC 0xa2 -> Node 2
[ 0.017748] SRAT: PXM 2 -> APIC 0xa4 -> Node 2
[ 0.017750] SRAT: PXM 2 -> APIC 0xa6 -> Node 2
[ 0.017751] SRAT: PXM 2 -> APIC 0xa8 -> Node 2
[ 0.017752] SRAT: PXM 2 -> APIC 0xaa -> Node 2
[ 0.017754] SRAT: PXM 2 -> APIC 0xb0 -> Node 2
[ 0.017755] SRAT: PXM 2 -> APIC 0xb2 -> Node 2
[ 0.017757] SRAT: PXM 2 -> APIC 0xb4 -> Node 2
[ 0.017758] SRAT: PXM 2 -> APIC 0xb6 -> Node 2
[ 0.017759] SRAT: PXM 2 -> APIC 0xb8 -> Node 2
[ 0.017761] SRAT: PXM 2 -> APIC 0xba -> Node 2
[ 0.017762] SRAT: PXM 3 -> APIC 0xc0 -> Node 3
[ 0.017763] SRAT: PXM 3 -> APIC 0xc2 -> Node 3
[ 0.017764] SRAT: PXM 3 -> APIC 0xc4 -> Node 3
[ 0.017765] SRAT: PXM 3 -> APIC 0xc6 -> Node 3
[ 0.017766] SRAT: PXM 3 -> APIC 0xc8 -> Node 3
[ 0.017767] SRAT: PXM 3 -> APIC 0xca -> Node 3
[ 0.017768] SRAT: PXM 3 -> APIC 0xd0 -> Node 3
[ 0.017769] SRAT: PXM 3 -> APIC 0xd2 -> Node 3
[ 0.017770] SRAT: PXM 3 -> APIC 0xd4 -> Node 3
[ 0.017771] SRAT: PXM 3 -> APIC 0xd6 -> Node 3
[ 0.017772] SRAT: PXM 3 -> APIC 0xd8 -> Node 3
[ 0.017774] SRAT: PXM 3 -> APIC 0xda -> Node 3
[ 0.017775] SRAT: PXM 3 -> APIC 0xe0 -> Node 3
[ 0.017776] SRAT: PXM 3 -> APIC 0xe2 -> Node 3
[ 0.017777] SRAT: PXM 3 -> APIC 0xe4 -> Node 3
[ 0.017778] SRAT: PXM 3 -> APIC 0xe6 -> Node 3
[ 0.017779] SRAT: PXM 3 -> APIC 0xe8 -> Node 3
[ 0.017780] SRAT: PXM 3 -> APIC 0xea -> Node 3
[ 0.017781] SRAT: PXM 3 -> APIC 0xf0 -> Node 3
[ 0.017782] SRAT: PXM 3 -> APIC 0xf2 -> Node 3
[ 0.017783] SRAT: PXM 3 -> APIC 0xf4 -> Node 3
[ 0.017784] SRAT: PXM 3 -> APIC 0xf6 -> Node 3
[ 0.017786] SRAT: PXM 3 -> APIC 0xf8 -> Node 3
[ 0.017787] SRAT: PXM 3 -> APIC 0xfa -> Node 3
[ 0.017788] SRAT: PXM 0 -> APIC 0x01 -> Node 0
[ 0.017789] SRAT: PXM 0 -> APIC 0x03 -> Node 0
[ 0.017790] SRAT: PXM 0 -> APIC 0x05 -> Node 0
[ 0.017791] SRAT: PXM 0 -> APIC 0x07 -> Node 0
[ 0.017792] SRAT: PXM 0 -> APIC 0x09 -> Node 0
[ 0.017793] SRAT: PXM 0 -> APIC 0x0b -> Node 0
[ 0.017794] SRAT: PXM 0 -> APIC 0x11 -> Node 0
[ 0.017795] SRAT: PXM 0 -> APIC 0x13 -> Node 0
[ 0.017797] SRAT: PXM 0 -> APIC 0x15 -> Node 0
[ 0.017798] SRAT: PXM 0 -> APIC 0x17 -> Node 0
[ 0.017799] SRAT: PXM 0 -> APIC 0x19 -> Node 0
[ 0.017800] SRAT: PXM 0 -> APIC 0x1b -> Node 0
[ 0.017801] SRAT: PXM 0 -> APIC 0x21 -> Node 0
[ 0.017802] SRAT: PXM 0 -> APIC 0x23 -> Node 0
[ 0.017803] SRAT: PXM 0 -> APIC 0x25 -> Node 0
[ 0.017805] SRAT: PXM 0 -> APIC 0x27 -> Node 0
[ 0.017806] SRAT: PXM 0 -> APIC 0x29 -> Node 0
[ 0.017807] SRAT: PXM 0 -> APIC 0x2b -> Node 0
[ 0.017808] SRAT: PXM 0 -> APIC 0x31 -> Node 0
[ 0.017810] SRAT: PXM 0 -> APIC 0x33 -> Node 0
[ 0.017811] SRAT: PXM 0 -> APIC 0x35 -> Node 0
[ 0.017812] SRAT: PXM 0 -> APIC 0x37 -> Node 0
[ 0.017813] SRAT: PXM 0 -> APIC 0x39 -> Node 0
[ 0.017814] SRAT: PXM 0 -> APIC 0x3b -> Node 0
[ 0.017816] SRAT: PXM 1 -> APIC 0x41 -> Node 1
[ 0.017817] SRAT: PXM 1 -> APIC 0x43 -> Node 1
[ 0.017818] SRAT: PXM 1 -> APIC 0x45 -> Node 1
[ 0.017819] SRAT: PXM 1 -> APIC 0x47 -> Node 1
[ 0.017820] SRAT: PXM 1 -> APIC 0x49 -> Node 1
[ 0.017821] SRAT: PXM 1 -> APIC 0x4b -> Node 1
[ 0.017822] SRAT: PXM 1 -> APIC 0x51 -> Node 1
[ 0.017823] SRAT: PXM 1 -> APIC 0x53 -> Node 1
[ 0.017824] SRAT: PXM 1 -> APIC 0x55 -> Node 1
[ 0.017825] SRAT: PXM 1 -> APIC 0x57 -> Node 1
[ 0.017826] SRAT: PXM 1 -> APIC 0x59 -> Node 1
[ 0.017827] SRAT: PXM 1 -> APIC 0x5b -> Node 1
[ 0.017828] SRAT: PXM 1 -> APIC 0x61 -> Node 1
[ 0.017830] SRAT: PXM 1 -> APIC 0x63 -> Node 1
[ 0.017831] SRAT: PXM 1 -> APIC 0x65 -> Node 1
[ 0.017832] SRAT: PXM 1 -> APIC 0x67 -> Node 1
[ 0.017833] SRAT: PXM 1 -> APIC 0x69 -> Node 1
[ 0.017834] SRAT: PXM 1 -> APIC 0x6b -> Node 1
[ 0.017835] SRAT: PXM 1 -> APIC 0x71 -> Node 1
[ 0.017836] SRAT: PXM 1 -> APIC 0x73 -> Node 1
[ 0.017838] SRAT: PXM 1 -> APIC 0x75 -> Node 1
[ 0.017839] SRAT: PXM 1 -> APIC 0x77 -> Node 1
[ 0.017840] SRAT: PXM 1 -> APIC 0x79 -> Node 1
[ 0.017841] SRAT: PXM 1 -> APIC 0x7b -> Node 1
[ 0.017842] SRAT: PXM 2 -> APIC 0x81 -> Node 2
[ 0.017843] SRAT: PXM 2 -> APIC 0x83 -> Node 2
[ 0.017845] SRAT: PXM 2 -> APIC 0x85 -> Node 2
[ 0.017846] SRAT: PXM 2 -> APIC 0x87 -> Node 2
[ 0.017847] SRAT: PXM 2 -> APIC 0x89 -> Node 2
[ 0.017848] SRAT: PXM 2 -> APIC 0x8b -> Node 2
[ 0.017849] SRAT: PXM 2 -> APIC 0x91 -> Node 2
[ 0.017851] SRAT: PXM 2 -> APIC 0x93 -> Node 2
[ 0.017852] SRAT: PXM 2 -> APIC 0x95 -> Node 2
[ 0.017853] SRAT: PXM 2 -> APIC 0x97 -> Node 2
[ 0.017854] SRAT: PXM 2 -> APIC 0x99 -> Node 2
[ 0.017855] SRAT: PXM 2 -> APIC 0x9b -> Node 2
[ 0.017856] SRAT: PXM 2 -> APIC 0xa1 -> Node 2
[ 0.017858] SRAT: PXM 2 -> APIC 0xa3 -> Node 2
[ 0.017859] SRAT: PXM 2 -> APIC 0xa5 -> Node 2
[ 0.017860] SRAT: PXM 2 -> APIC 0xa7 -> Node 2
[ 0.017862] SRAT: PXM 2 -> APIC 0xa9 -> Node 2
[ 0.017863] SRAT: PXM 2 -> APIC 0xab -> Node 2
[ 0.017864] SRAT: PXM 2 -> APIC 0xb1 -> Node 2
[ 0.017865] SRAT: PXM 2 -> APIC 0xb3 -> Node 2
[ 0.017867] SRAT: PXM 2 -> APIC 0xb5 -> Node 2
[ 0.017868] SRAT: PXM 2 -> APIC 0xb7 -> Node 2
[ 0.017869] SRAT: PXM 2 -> APIC 0xb9 -> Node 2
[ 0.017870] SRAT: PXM 2 -> APIC 0xbb -> Node 2
[ 0.017871] SRAT: PXM 3 -> APIC 0xc1 -> Node 3
[ 0.017872] SRAT: PXM 3 -> APIC 0xc3 -> Node 3
[ 0.017873] SRAT: PXM 3 -> APIC 0xc5 -> Node 3
[ 0.017874] SRAT: PXM 3 -> APIC 0xc7 -> Node 3
[ 0.017875] SRAT: PXM 3 -> APIC 0xc9 -> Node 3
[ 0.017876] SRAT: PXM 3 -> APIC 0xcb -> Node 3
[ 0.017877] SRAT: PXM 3 -> APIC 0xd1 -> Node 3
[ 0.017878] SRAT: PXM 3 -> APIC 0xd3 -> Node 3
[ 0.017879] SRAT: PXM 3 -> APIC 0xd5 -> Node 3
[ 0.017880] SRAT: PXM 3 -> APIC 0xd7 -> Node 3
[ 0.017882] SRAT: PXM 3 -> APIC 0xd9 -> Node 3
[ 0.017883] SRAT: PXM 3 -> APIC 0xdb -> Node 3
[ 0.017884] SRAT: PXM 3 -> APIC 0xe1 -> Node 3
[ 0.017885] SRAT: PXM 3 -> APIC 0xe3 -> Node 3
[ 0.017886] SRAT: PXM 3 -> APIC 0xe5 -> Node 3
[ 0.017887] SRAT: PXM 3 -> APIC 0xe7 -> Node 3
[ 0.017888] SRAT: PXM 3 -> APIC 0xe9 -> Node 3
[ 0.017889] SRAT: PXM 3 -> APIC 0xeb -> Node 3
[ 0.017890] SRAT: PXM 3 -> APIC 0xf1 -> Node 3
[ 0.017891] SRAT: PXM 3 -> APIC 0xf3 -> Node 3
[ 0.017892] SRAT: PXM 3 -> APIC 0xf5 -> Node 3
[ 0.017893] SRAT: PXM 3 -> APIC 0xf7 -> Node 3
[ 0.017894] SRAT: PXM 3 -> APIC 0xf9 -> Node 3
[ 0.017895] SRAT: PXM 3 -> APIC 0xfb -> Node 3
[ 0.017900] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[ 0.017902] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x207fffffff]
[ 0.017904] ACPI: SRAT: Node 1 PXM 1 [mem 0x2080000000-0x407fffffff]
[ 0.017906] ACPI: SRAT: Node 2 PXM 2 [mem 0x4080000000-0x607fffffff]
[ 0.017907] ACPI: SRAT: Node 3 PXM 3 [mem 0x6080000000-0x807fffffff]
[ 0.017919] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x207fffffff] -> [mem 0x00000000-0x207fffffff]
[ 0.017935] NODE_DATA(0) allocated [mem 0x207ffd5000-0x207fffffff]
[ 0.017969] NODE_DATA(1) allocated [mem 0x407ffd5000-0x407fffffff]
[ 0.018045] NODE_DATA(2) allocated [mem 0x607ffd5000-0x607fffffff]
[ 0.018122] NODE_DATA(3) allocated [mem 0x807ffd4000-0x807fffefff]
[ 2.344716] Zone ranges:
[ 2.344721] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 2.344726] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]
[ 2.344728] Normal [mem 0x0000000100000000-0x000000807fffffff]
[ 2.344730] Device empty
[ 2.344731] Movable zone start for each node
[ 2.344735] Early memory node ranges
[ 2.344736] node 0: [mem 0x0000000000001000-0x000000000008dfff]
[ 2.344738] node 0: [mem 0x0000000000090000-0x000000000009ffff]
[ 2.344739] node 0: [mem 0x0000000000100000-0x000000005c687fff]
[ 2.344741] node 0: [mem 0x000000005ff21000-0x000000007bafffff]
[ 2.344742] node 0: [mem 0x0000000100000000-0x000000207fffffff]
[ 2.344760] node 1: [mem 0x0000002080000000-0x000000407fffffff]
[ 2.344787] node 2: [mem 0x0000004080000000-0x000000607fffffff]
[ 2.344808] node 3: [mem 0x0000006080000000-0x000000807fffffff]
[ 2.344828] Initmem setup node 0 [mem 0x0000000000001000-0x000000207fffffff]
[ 2.344837] Initmem setup node 1 [mem 0x0000002080000000-0x000000407fffffff]
[ 2.344844] Initmem setup node 2 [mem 0x0000004080000000-0x000000607fffffff]
[ 2.344848] Initmem setup node 3 [mem 0x0000006080000000-0x000000807fffffff]
[ 2.344855] On node 0, zone DMA: 1 pages in unavailable ranges
[ 2.344857] On node 0, zone DMA: 2 pages in unavailable ranges
[ 2.344897] On node 0, zone DMA: 96 pages in unavailable ranges
[ 2.350169] On node 0, zone DMA32: 14489 pages in unavailable ranges
[ 2.697203] On node 0, zone Normal: 17664 pages in unavailable ranges
[ 4.084354] ACPI: PM-Timer IO Port: 0x408
[ 4.084409] ACPI: LAPIC_NMI (acpi_id[0x00] high level lint[0x1])
[ 4.084412] ACPI: LAPIC_NMI (acpi_id[0x01] high level lint[0x1])
[ 4.084414] ACPI: LAPIC_NMI (acpi_id[0x02] high level lint[0x1])
[ 4.084415] ACPI: LAPIC_NMI (acpi_id[0x03] high level lint[0x1])
[ 4.084417] ACPI: LAPIC_NMI (acpi_id[0x04] high level lint[0x1])
[ 4.084418] ACPI: LAPIC_NMI (acpi_id[0x05] high level lint[0x1])
[ 4.084419] ACPI: LAPIC_NMI (acpi_id[0x06] high level lint[0x1])
[ 4.084420] ACPI: LAPIC_NMI (acpi_id[0x07] high level lint[0x1])
[ 4.084422] ACPI: LAPIC_NMI (acpi_id[0x08] high level lint[0x1])
[ 4.084423] ACPI: LAPIC_NMI (acpi_id[0x09] high level lint[0x1])
[ 4.084424] ACPI: LAPIC_NMI (acpi_id[0x0a] high level lint[0x1])
[ 4.084425] ACPI: LAPIC_NMI (acpi_id[0x0b] high level lint[0x1])
[ 4.084426] ACPI: LAPIC_NMI (acpi_id[0x0c] high level lint[0x1])
[ 4.084427] ACPI: LAPIC_NMI (acpi_id[0x0d] high level lint[0x1])
[ 4.084428] ACPI: LAPIC_NMI (acpi_id[0x0e] high level lint[0x1])
[ 4.084429] ACPI: LAPIC_NMI (acpi_id[0x0f] high level lint[0x1])
[ 4.084430] ACPI: LAPIC_NMI (acpi_id[0x10] high level lint[0x1])
[ 4.084431] ACPI: LAPIC_NMI (acpi_id[0x11] high level lint[0x1])
[ 4.084432] ACPI: LAPIC_NMI (acpi_id[0x12] high level lint[0x1])
[ 4.084433] ACPI: LAPIC_NMI (acpi_id[0x13] high level lint[0x1])
[ 4.084434] ACPI: LAPIC_NMI (acpi_id[0x14] high level lint[0x1])
[ 4.084435] ACPI: LAPIC_NMI (acpi_id[0x15] high level lint[0x1])
[ 4.084436] ACPI: LAPIC_NMI (acpi_id[0x16] high level lint[0x1])
[ 4.084438] ACPI: LAPIC_NMI (acpi_id[0x17] high level lint[0x1])
[ 4.084439] ACPI: LAPIC_NMI (acpi_id[0x18] high level lint[0x1])
[ 4.084440] ACPI: LAPIC_NMI (acpi_id[0x19] high level lint[0x1])
[ 4.084441] ACPI: LAPIC_NMI (acpi_id[0x1a] high level lint[0x1])
[ 4.084442] ACPI: LAPIC_NMI (acpi_id[0x1b] high level lint[0x1])
[ 4.084444] ACPI: LAPIC_NMI (acpi_id[0x1c] high level lint[0x1])
[ 4.084445] ACPI: LAPIC_NMI (acpi_id[0x1d] high level lint[0x1])
[ 4.084446] ACPI: LAPIC_NMI (acpi_id[0x1e] high level lint[0x1])
[ 4.084447] ACPI: LAPIC_NMI (acpi_id[0x1f] high level lint[0x1])
[ 4.084448] ACPI: LAPIC_NMI (acpi_id[0x20] high level lint[0x1])
[ 4.084448] ACPI: LAPIC_NMI (acpi_id[0x21] high level lint[0x1])
[ 4.084449] ACPI: LAPIC_NMI (acpi_id[0x22] high level lint[0x1])
[ 4.084450] ACPI: LAPIC_NMI (acpi_id[0x23] high level lint[0x1])
[ 4.084451] ACPI: LAPIC_NMI (acpi_id[0x24] high level lint[0x1])
[ 4.084452] ACPI: LAPIC_NMI (acpi_id[0x25] high level lint[0x1])
[ 4.084453] ACPI: LAPIC_NMI (acpi_id[0x26] high level lint[0x1])
[ 4.084454] ACPI: LAPIC_NMI (acpi_id[0x27] high level lint[0x1])
[ 4.084455] ACPI: LAPIC_NMI (acpi_id[0x28] high level lint[0x1])
[ 4.084456] ACPI: LAPIC_NMI (acpi_id[0x29] high level lint[0x1])
[ 4.084457] ACPI: LAPIC_NMI (acpi_id[0x2a] high level lint[0x1])
[ 4.084458] ACPI: LAPIC_NMI (acpi_id[0x2b] high level lint[0x1])
[ 4.084459] ACPI: LAPIC_NMI (acpi_id[0x2c] high level lint[0x1])
[ 4.084460] ACPI: LAPIC_NMI (acpi_id[0x2d] high level lint[0x1])
[ 4.084461] ACPI: LAPIC_NMI (acpi_id[0x2e] high level lint[0x1])
[ 4.084462] ACPI: LAPIC_NMI (acpi_id[0x2f] high level lint[0x1])
[ 4.084463] ACPI: LAPIC_NMI (acpi_id[0x30] high level lint[0x1])
[ 4.084464] ACPI: LAPIC_NMI (acpi_id[0x31] high level lint[0x1])
[ 4.084465] ACPI: LAPIC_NMI (acpi_id[0x32] high level lint[0x1])
[ 4.084466] ACPI: LAPIC_NMI (acpi_id[0x33] high level lint[0x1])
[ 4.084467] ACPI: LAPIC_NMI (acpi_id[0x34] high level lint[0x1])
[ 4.084468] ACPI: LAPIC_NMI (acpi_id[0x35] high level lint[0x1])
[ 4.084469] ACPI: LAPIC_NMI (acpi_id[0x36] high level lint[0x1])
[ 4.084470] ACPI: LAPIC_NMI (acpi_id[0x37] high level lint[0x1])
[ 4.084471] ACPI: LAPIC_NMI (acpi_id[0x38] high level lint[0x1])
[ 4.084472] ACPI: LAPIC_NMI (acpi_id[0x39] high level lint[0x1])
[ 4.084473] ACPI: LAPIC_NMI (acpi_id[0x3a] high level lint[0x1])
[ 4.084475] ACPI: LAPIC_NMI (acpi_id[0x3b] high level lint[0x1])
[ 4.084476] ACPI: LAPIC_NMI (acpi_id[0x3c] high level lint[0x1])
[ 4.084477] ACPI: LAPIC_NMI (acpi_id[0x3d] high level lint[0x1])
[ 4.084478] ACPI: LAPIC_NMI (acpi_id[0x3e] high level lint[0x1])
[ 4.084478] ACPI: LAPIC_NMI (acpi_id[0x3f] high level lint[0x1])
[ 4.084479] ACPI: LAPIC_NMI (acpi_id[0x40] high level lint[0x1])
[ 4.084480] ACPI: LAPIC_NMI (acpi_id[0x41] high level lint[0x1])
[ 4.084481] ACPI: LAPIC_NMI (acpi_id[0x42] high level lint[0x1])
[ 4.084482] ACPI: LAPIC_NMI (acpi_id[0x43] high level lint[0x1])
[ 4.084484] ACPI: LAPIC_NMI (acpi_id[0x44] high level lint[0x1])
[ 4.084485] ACPI: LAPIC_NMI (acpi_id[0x45] high level lint[0x1])
[ 4.084486] ACPI: LAPIC_NMI (acpi_id[0x46] high level lint[0x1])
[ 4.084487] ACPI: LAPIC_NMI (acpi_id[0x47] high level lint[0x1])
[ 4.084488] ACPI: LAPIC_NMI (acpi_id[0x48] high level lint[0x1])
[ 4.084489] ACPI: LAPIC_NMI (acpi_id[0x49] high level lint[0x1])
[ 4.084490] ACPI: LAPIC_NMI (acpi_id[0x4a] high level lint[0x1])
[ 4.084492] ACPI: LAPIC_NMI (acpi_id[0x4b] high level lint[0x1])
[ 4.084493] ACPI: LAPIC_NMI (acpi_id[0x4c] high level lint[0x1])
[ 4.084494] ACPI: LAPIC_NMI (acpi_id[0x4d] high level lint[0x1])
[ 4.084494] ACPI: LAPIC_NMI (acpi_id[0x4e] high level lint[0x1])
[ 4.084495] ACPI: LAPIC_NMI (acpi_id[0x4f] high level lint[0x1])
[ 4.084496] ACPI: LAPIC_NMI (acpi_id[0x50] high level lint[0x1])
[ 4.084497] ACPI: LAPIC_NMI (acpi_id[0x51] high level lint[0x1])
[ 4.084498] ACPI: LAPIC_NMI (acpi_id[0x52] high level lint[0x1])
[ 4.084499] ACPI: LAPIC_NMI (acpi_id[0x53] high level lint[0x1])
[ 4.084500] ACPI: LAPIC_NMI (acpi_id[0x54] high level lint[0x1])
[ 4.084501] ACPI: LAPIC_NMI (acpi_id[0x55] high level lint[0x1])
[ 4.084502] ACPI: LAPIC_NMI (acpi_id[0x56] high level lint[0x1])
[ 4.084503] ACPI: LAPIC_NMI (acpi_id[0x57] high level lint[0x1])
[ 4.084504] ACPI: LAPIC_NMI (acpi_id[0x58] high level lint[0x1])
[ 4.084505] ACPI: LAPIC_NMI (acpi_id[0x59] high level lint[0x1])
[ 4.084506] ACPI: LAPIC_NMI (acpi_id[0x5a] high level lint[0x1])
[ 4.084507] ACPI: LAPIC_NMI (acpi_id[0x5b] high level lint[0x1])
[ 4.084508] ACPI: LAPIC_NMI (acpi_id[0x5c] high level lint[0x1])
[ 4.084509] ACPI: LAPIC_NMI (acpi_id[0x5d] high level lint[0x1])
[ 4.084510] ACPI: LAPIC_NMI (acpi_id[0x5e] high level lint[0x1])
[ 4.084510] ACPI: LAPIC_NMI (acpi_id[0x5f] high level lint[0x1])
[ 4.084511] ACPI: LAPIC_NMI (acpi_id[0x60] high level lint[0x1])
[ 4.084512] ACPI: LAPIC_NMI (acpi_id[0x61] high level lint[0x1])
[ 4.084513] ACPI: LAPIC_NMI (acpi_id[0x62] high level lint[0x1])
[ 4.084514] ACPI: LAPIC_NMI (acpi_id[0x63] high level lint[0x1])
[ 4.084515] ACPI: LAPIC_NMI (acpi_id[0x64] high level lint[0x1])
[ 4.084516] ACPI: LAPIC_NMI (acpi_id[0x65] high level lint[0x1])
[ 4.084517] ACPI: LAPIC_NMI (acpi_id[0x66] high level lint[0x1])
[ 4.084518] ACPI: LAPIC_NMI (acpi_id[0x67] high level lint[0x1])
[ 4.084519] ACPI: LAPIC_NMI (acpi_id[0x68] high level lint[0x1])
[ 4.084520] ACPI: LAPIC_NMI (acpi_id[0x69] high level lint[0x1])
[ 4.084521] ACPI: LAPIC_NMI (acpi_id[0x6a] high level lint[0x1])
[ 4.084522] ACPI: LAPIC_NMI (acpi_id[0x6b] high level lint[0x1])
[ 4.084523] ACPI: LAPIC_NMI (acpi_id[0x6c] high level lint[0x1])
[ 4.084524] ACPI: LAPIC_NMI (acpi_id[0x6d] high level lint[0x1])
[ 4.084525] ACPI: LAPIC_NMI (acpi_id[0x6e] high level lint[0x1])
[ 4.084526] ACPI: LAPIC_NMI (acpi_id[0x6f] high level lint[0x1])
[ 4.084526] ACPI: LAPIC_NMI (acpi_id[0x70] high level lint[0x1])
[ 4.084528] ACPI: LAPIC_NMI (acpi_id[0x71] high level lint[0x1])
[ 4.084529] ACPI: LAPIC_NMI (acpi_id[0x72] high level lint[0x1])
[ 4.084530] ACPI: LAPIC_NMI (acpi_id[0x73] high level lint[0x1])
[ 4.084531] ACPI: LAPIC_NMI (acpi_id[0x74] high level lint[0x1])
[ 4.084533] ACPI: LAPIC_NMI (acpi_id[0x75] high level lint[0x1])
[ 4.084534] ACPI: LAPIC_NMI (acpi_id[0x76] high level lint[0x1])
[ 4.084535] ACPI: LAPIC_NMI (acpi_id[0x77] high level lint[0x1])
[ 4.084537] ACPI: LAPIC_NMI (acpi_id[0x78] high level lint[0x1])
[ 4.084538] ACPI: LAPIC_NMI (acpi_id[0x79] high level lint[0x1])
[ 4.084539] ACPI: LAPIC_NMI (acpi_id[0x7a] high level lint[0x1])
[ 4.084540] ACPI: LAPIC_NMI (acpi_id[0x7b] high level lint[0x1])
[ 4.084541] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 4.084542] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 4.084543] ACPI: LAPIC_NMI (acpi_id[0x7d] high level lint[0x1])
[ 4.084544] ACPI: LAPIC_NMI (acpi_id[0x7e] high level lint[0x1])
[ 4.084545] ACPI: LAPIC_NMI (acpi_id[0x7f] high level lint[0x1])
[ 4.084546] ACPI: LAPIC_NMI (acpi_id[0x80] high level lint[0x1])
[ 4.084547] ACPI: LAPIC_NMI (acpi_id[0x81] high level lint[0x1])
[ 4.084548] ACPI: LAPIC_NMI (acpi_id[0x82] high level lint[0x1])
[ 4.084549] ACPI: LAPIC_NMI (acpi_id[0x83] high level lint[0x1])
[ 4.084550] ACPI: LAPIC_NMI (acpi_id[0x84] high level lint[0x1])
[ 4.084551] ACPI: LAPIC_NMI (acpi_id[0x85] high level lint[0x1])
[ 4.084552] ACPI: LAPIC_NMI (acpi_id[0x86] high level lint[0x1])
[ 4.084553] ACPI: LAPIC_NMI (acpi_id[0x87] high level lint[0x1])
[ 4.084554] ACPI: LAPIC_NMI (acpi_id[0x88] high level lint[0x1])
[ 4.084555] ACPI: LAPIC_NMI (acpi_id[0x89] high level lint[0x1])
[ 4.084555] ACPI: LAPIC_NMI (acpi_id[0x8a] high level lint[0x1])
[ 4.084556] ACPI: LAPIC_NMI (acpi_id[0x8b] high level lint[0x1])
[ 4.084557] ACPI: LAPIC_NMI (acpi_id[0x8c] high level lint[0x1])
[ 4.084558] ACPI: LAPIC_NMI (acpi_id[0x8d] high level lint[0x1])
[ 4.084559] ACPI: LAPIC_NMI (acpi_id[0x8f] high level lint[0x1])
[ 4.084560] ACPI: LAPIC_NMI (acpi_id[0x90] high level lint[0x1])
[ 4.084561] ACPI: LAPIC_NMI (acpi_id[0x91] high level lint[0x1])
[ 4.084562] ACPI: LAPIC_NMI (acpi_id[0x92] high level lint[0x1])
[ 4.084563] ACPI: LAPIC_NMI (acpi_id[0x93] high level lint[0x1])
[ 4.084564] ACPI: LAPIC_NMI (acpi_id[0x94] high level lint[0x1])
[ 4.084565] ACPI: LAPIC_NMI (acpi_id[0x95] high level lint[0x1])
[ 4.084566] ACPI: LAPIC_NMI (acpi_id[0x96] high level lint[0x1])
[ 4.084567] ACPI: LAPIC_NMI (acpi_id[0x97] high level lint[0x1])
[ 4.084568] ACPI: LAPIC_NMI (acpi_id[0x98] high level lint[0x1])
[ 4.084569] ACPI: LAPIC_NMI (acpi_id[0x99] high level lint[0x1])
[ 4.084570] ACPI: LAPIC_NMI (acpi_id[0x9a] high level lint[0x1])
[ 4.084570] ACPI: LAPIC_NMI (acpi_id[0x9b] high level lint[0x1])
[ 4.084571] ACPI: LAPIC_NMI (acpi_id[0x9c] high level lint[0x1])
[ 4.084572] ACPI: LAPIC_NMI (acpi_id[0x9d] high level lint[0x1])
[ 4.084573] ACPI: LAPIC_NMI (acpi_id[0x9e] high level lint[0x1])
[ 4.084574] ACPI: LAPIC_NMI (acpi_id[0x9f] high level lint[0x1])
[ 4.084576] ACPI: LAPIC_NMI (acpi_id[0xa0] high level lint[0x1])
[ 4.084577] ACPI: LAPIC_NMI (acpi_id[0xa1] high level lint[0x1])
[ 4.084578] ACPI: LAPIC_NMI (acpi_id[0xa2] high level lint[0x1])
[ 4.084579] ACPI: LAPIC_NMI (acpi_id[0xa3] high level lint[0x1])
[ 4.084580] ACPI: LAPIC_NMI (acpi_id[0xa4] high level lint[0x1])
[ 4.084581] ACPI: LAPIC_NMI (acpi_id[0xa5] high level lint[0x1])
[ 4.084582] ACPI: LAPIC_NMI (acpi_id[0xa6] high level lint[0x1])
[ 4.084584] ACPI: LAPIC_NMI (acpi_id[0xa7] high level lint[0x1])
[ 4.084585] ACPI: LAPIC_NMI (acpi_id[0xa8] high level lint[0x1])
[ 4.084586] ACPI: LAPIC_NMI (acpi_id[0xa9] high level lint[0x1])
[ 4.084587] ACPI: LAPIC_NMI (acpi_id[0xaa] high level lint[0x1])
[ 4.084588] ACPI: LAPIC_NMI (acpi_id[0xab] high level lint[0x1])
[ 4.084589] ACPI: LAPIC_NMI (acpi_id[0xac] high level lint[0x1])
[ 4.084589] ACPI: LAPIC_NMI (acpi_id[0xad] high level lint[0x1])
[ 4.084590] ACPI: LAPIC_NMI (acpi_id[0xae] high level lint[0x1])
[ 4.084592] ACPI: LAPIC_NMI (acpi_id[0xaf] high level lint[0x1])
[ 4.084592] ACPI: LAPIC_NMI (acpi_id[0xb0] high level lint[0x1])
[ 4.084594] ACPI: LAPIC_NMI (acpi_id[0xb1] high level lint[0x1])
[ 4.084595] ACPI: LAPIC_NMI (acpi_id[0xb2] high level lint[0x1])
[ 4.084596] ACPI: LAPIC_NMI (acpi_id[0xb3] high level lint[0x1])
[ 4.084597] ACPI: LAPIC_NMI (acpi_id[0xb4] high level lint[0x1])
[ 4.084598] ACPI: LAPIC_NMI (acpi_id[0xb5] high level lint[0x1])
[ 4.084599] ACPI: LAPIC_NMI (acpi_id[0xb6] high level lint[0x1])
[ 4.084600] ACPI: LAPIC_NMI (acpi_id[0xb7] high level lint[0x1])
[ 4.084601] ACPI: LAPIC_NMI (acpi_id[0xb8] high level lint[0x1])
[ 4.084603] ACPI: LAPIC_NMI (acpi_id[0xb9] high level lint[0x1])
[ 4.084604] ACPI: LAPIC_NMI (acpi_id[0xba] high level lint[0x1])
[ 4.084605] ACPI: LAPIC_NMI (acpi_id[0xbb] high level lint[0x1])
[ 4.084606] ACPI: LAPIC_NMI (acpi_id[0xbc] high level lint[0x1])
[ 4.084607] ACPI: LAPIC_NMI (acpi_id[0xbd] high level lint[0x1])
[ 4.084608] ACPI: LAPIC_NMI (acpi_id[0xbe] high level lint[0x1])
[ 4.084609] ACPI: LAPIC_NMI (acpi_id[0xbf] high level lint[0x1])
[ 4.084621] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[ 4.084627] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47
[ 4.084632] IOAPIC[2]: apic_id 10, version 32, address 0xfec40000, GSI 48-71
[ 4.084637] IOAPIC[3]: apic_id 11, version 32, address 0xfec80000, GSI 72-95
[ 4.084642] IOAPIC[4]: apic_id 12, version 32, address 0xfecc0000, GSI 96-119
[ 4.084646] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 4.084649] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 4.084658] ACPI: Using ACPI (MADT) for SMP configuration information
[ 4.084660] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[ 4.084666] ACPI: SPCR: SPCR table version 1
[ 4.084668] ACPI: SPCR: console: uart,io,0x3f8,115200
[ 4.084671] TSC deadline timer available
[ 4.084673] smpboot: Allowing 192 CPUs, 0 hotplug CPUs
[ 4.084705] PM: hibernation: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 4.084708] PM: hibernation: Registered nosave memory: [mem 0x0008e000-0x0008ffff]
[ 4.084710] PM: hibernation: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[ 4.084713] PM: hibernation: Registered nosave memory: [mem 0x5af75000-0x5af75fff]
[ 4.084715] PM: hibernation: Registered nosave memory: [mem 0x5af7d000-0x5af7dfff]
[ 4.084717] PM: hibernation: Registered nosave memory: [mem 0x5af7e000-0x5af7efff]
[ 4.084719] PM: hibernation: Registered nosave memory: [mem 0x5afa2000-0x5afa2fff]
[ 4.084720] PM: hibernation: Registered nosave memory: [mem 0x5afa3000-0x5afa3fff]
[ 4.084723] PM: hibernation: Registered nosave memory: [mem 0x5afc7000-0x5afc7fff]
[ 4.084724] PM: hibernation: Registered nosave memory: [mem 0x5afc8000-0x5afc8fff]
[ 4.084726] PM: hibernation: Registered nosave memory: [mem 0x5b00f000-0x5b00ffff]
[ 4.084729] PM: hibernation: Registered nosave memory: [mem 0x5c688000-0x5db85fff]
[ 4.084730] PM: hibernation: Registered nosave memory: [mem 0x5db86000-0x5fd97fff]
[ 4.084731] PM: hibernation: Registered nosave memory: [mem 0x5fd98000-0x5ff20fff]
[ 4.084734] PM: hibernation: Registered nosave memory: [mem 0x7a88a000-0x7a88afff]
[ 4.084736] PM: hibernation: Registered nosave memory: [mem 0x7bb00000-0x8fffffff]
[ 4.084737] PM: hibernation: Registered nosave memory: [mem 0x90000000-0xfed1bfff]
[ 4.084738] PM: hibernation: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[ 4.084739] PM: hibernation: Registered nosave memory: [mem 0xfed20000-0xffffffff]
[ 4.084743] [mem 0x90000000-0xfed1bfff] available for PCI devices
[ 4.084745] Booting paravirtualized kernel on bare hardware
[ 4.084749] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[ 4.092657] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:192 nr_cpu_ids:192 nr_node_ids:4
[ 4.113362] percpu: Embedded 61 pages/cpu s212992 r8192 d28672 u262144
[ 4.113618] Fallback order for Node 0: 0 1 2 3
[ 4.113624] Fallback order for Node 1: 1 2 3 0
[ 4.113629] Fallback order for Node 2: 2 3 0 1
[ 4.113633] Fallback order for Node 3: 3 0 1 2
[ 4.113653] Built 4 zonelists, mobility grouping on. Total pages: 132088407
[ 4.113655] Policy zone: Normal
[ 4.113657] Kernel command line: BOOT_IMAGE=(hd1,gpt2)/vmlinuz-6.2.0-rc2+ root=UUID=c1fd9bc7-73bf-4cc4-b72b-a369bdec1a5e ro rootflags=subvol=root console=tty1 console=ttyS0,115200 intel_iommu=on,sm_on
[ 4.113782] DMAR: IOMMU enabled
[ 4.113784] DMAR: Enable scalable mode if hardware supports
[ 4.113789] Unknown kernel command line parameters "BOOT_IMAGE=(hd1,gpt2)/vmlinuz-6.2.0-rc2+", will be passed to user space.
[ 4.113801] printk: log_buf_len individual max cpu contribution: 4096 bytes
[ 4.113802] printk: log_buf_len total cpu_extra contributions: 782336 bytes
[ 4.113803] printk: log_buf_len min size: 262144 bytes
[ 4.116194] printk: log_buf_len: 1048576 bytes
[ 4.116196] printk: early log buf free: 223800(85%)
[ 4.122093] mem auto-init: stack:off, heap alloc:off, heap free:off
[ 4.122101] software IO TLB: area num 256.
[ 6.289788] Memory: 527824584K/536741904K available (18432K kernel code, 3115K rwdata, 7072K rodata, 4056K init, 5748K bss, 8917060K reserved, 0K cma-reserved)
[ 6.291581] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=192, Nodes=4
[ 6.291689] Kernel/User page tables isolation: enabled
[ 6.292009] ftrace: allocating 49654 entries in 194 pages
[ 6.306476] ftrace: allocated 194 pages with 3 groups
[ 6.308337] Dynamic Preempt: voluntary
[ 6.309418] rcu: Preemptible hierarchical RCU implementation.
[ 6.309420] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=192.
[ 6.309422] Trampoline variant of Tasks RCU enabled.
[ 6.309423] Rude variant of Tasks RCU enabled.
[ 6.309423] Tracing variant of Tasks RCU enabled.
[ 6.309424] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies.
[ 6.309426] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=192
[ 6.316533] NR_IRQS: 524544, nr_irqs: 3592, preallocated irqs: 16
[ 6.317050] rcu: srcu_init: Setting srcu_struct sizes to big.
[ 6.317892] Console: colour dummy device 80x25
[ 6.317896] printk: console [tty1] enabled
[ 6.318978] printk: console [ttyS0] enabled
[ 10.236981] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[ 10.249514] ACPI: Core revision 20221020
[ 10.255064] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[ 10.265279] APIC: Switch to symmetric I/O mode setup
[ 10.271025] x2apic: IRQ remapping doesn't support X2APIC mode
[ 10.277578] Switched APIC routing to physical flat.
[ 10.283914] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 10.295321] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x1fa20ff52ca, max_idle_ns: 440795283836 ns
[ 10.307082] Calibrating delay loop (skipped), value calculated using timer frequency.. 4389.08 BogoMIPS (lpj=2194543)
[ 10.308084] pid_max: default: 196608 minimum: 1536
[ 10.323404] LSM: initializing lsm=lockdown,capability,yama,integrity,selinux,bpf,landlock
[ 10.324153] Yama: becoming mindful.
[ 10.325107] SELinux: Initializing.
[ 10.326371] LSM support for eBPF active
[ 10.327082] landlock: Up and running.
[ 10.367533] Dentry cache hash table entries: 16777216 (order: 15, 134217728 bytes, vmalloc hugepage)
[ 10.388348] Inode-cache hash table entries: 8388608 (order: 14, 67108864 bytes, vmalloc hugepage)
[ 10.389840] Mount-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[ 10.391430] Mountpoint-cache hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[ 10.394222] x86/cpu: VMX (outside TXT) disabled by BIOS
[ 10.395089] CPU0: Thermal monitoring enabled (TM1)
[ 10.396175] process: using mwait in idle threads
[ 10.397084] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8
[ 10.398080] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4
[ 10.399092] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization
[ 10.400084] Spectre V2 : Mitigation: Retpolines
[ 10.401080] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[ 10.402081] Spectre V2 : Spectre v2 / SpectreRSB : Filling RSB on VMEXIT
[ 10.403080] Spectre V2 : Enabling Restricted Speculation for firmware calls
[ 10.404083] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[ 10.405082] Spectre V2 : User space: Mitigation: STIBP via prctl
[ 10.406081] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl
[ 10.407093] MDS: Mitigation: Clear CPU buffers
[ 10.408081] TAA: Mitigation: Clear CPU buffers
[ 10.409081] MMIO Stale Data: Mitigation: Clear CPU buffers
[ 10.435297] Freeing SMP alternatives memory: 44K
[ 10.437494] smpboot: CPU0: Intel(R) Xeon(R) CPU E7-8890 v4 @ 2.20GHz (family: 0x6, model: 0x4f, stepping: 0x1)
[ 10.438586] cblist_init_generic: Setting adjustable number of callback queues.
[ 10.439080] cblist_init_generic: Setting shift to 8 and lim to 1.
[ 10.440189] cblist_init_generic: Setting shift to 8 and lim to 1.
[ 10.441149] cblist_init_generic: Setting shift to 8 and lim to 1.
[ 10.442105] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver.
[ 10.443086] ... version: 3
[ 10.444080] ... bit width: 48
[ 10.445080] ... generic registers: 4
[ 10.446080] ... value mask: 0000ffffffffffff
[ 10.447080] ... max period: 00007fffffffffff
[ 10.448080] ... fixed-purpose events: 3
[ 10.449081] ... event mask: 000000070000000f
[ 10.450409] Estimated ratio of average max frequency by base frequency (times 1024): 1442
[ 10.451121] rcu: Hierarchical SRCU implementation.
[ 10.452083] rcu: Max phase no-delay instances is 400.
[ 10.476524] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[ 10.481746] smp: Bringing up secondary CPUs ...
[ 10.482317] x86: Booting SMP configuration:
[ 10.483085] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20 #21 #22 #23
[ 10.729091] .... node #1, CPUs: #24
[ 3.981960] smpboot: CPU 24 Converting physical 0 to logical die 1
[ 10.813388] #25 #26 #27 #28 #29 #30 #31 #32 #33 #34 #35 #36 #37 #38 #39 #40 #41 #42 #43 #44 #45 #46 #47
[ 11.062085] .... node #2, CPUs: #48
[ 3.981960] smpboot: CPU 48 Converting physical 0 to logical die 2
[ 11.145362] #49 #50 #51 #52 #53 #54 #55 #56 #57 #58 #59 #60 #61 #62 #63 #64 #65 #66 #67 #68 #69 #70 #71
[ 11.396083] .... node #3, CPUs: #72
[ 3.981960] smpboot: CPU 72 Converting physical 0 to logical die 3
[ 11.480399] #73 #74 #75 #76 #77 #78 #79 #80 #81 #82 #83 #84 #85 #86 #87 #88 #89 #90 #91 #92 #93 #94 #95
[ 11.731087] .... node #0, CPUs: #96
[ 11.732604] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details.
[ 11.734083] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details.
[ 11.735089] MMIO Stale Data CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/processor_mmio_stale_data.html for more details.
[ 11.736402] #97 #98 #99 #100 #101 #102 #103 #104 #105 #106 #107 #108 #109 #110 #111 #112 #113 #114 #115 #116 #117 #118 #119
[ 11.833092] .... node #1, CPUs: #120 #121 #122 #123 #124 #125 #126 #127 #128 #129 #130 #131 #132 #133 #134 #135 #136 #137 #138 #139 #140 #141 #142 #143
[ 11.937086] .... node #2, CPUs: #144 #145 #146 #147 #148 #149 #150 #151 #152 #153 #154 #155 #156 #157 #158 #159 #160 #161 #162 #163 #164 #165 #166 #167
[ 12.043084] .... node #3, CPUs: #168 #169 #170 #171 #172 #173 #174 #175 #176 #177 #178 #179 #180 #181 #182 #183 #184 #185 #186 #187 #188 #189 #190 #191
[ 12.149098] smp: Brought up 4 nodes, 192 CPUs
[ 12.151083] smpboot: Max logical packages: 4
[ 12.152094] smpboot: Total of 192 processors activated (846208.70 BogoMIPS)
[ 12.201276] devtmpfs: initialized
[ 12.202198] x86/mm: Memory block size: 2048MB
[ 12.207620] ACPI: PM: Registering ACPI NVS region [mem 0x5db86000-0x5fd97fff] (35725312 bytes)
[ 12.209707] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[ 12.210201] futex hash table entries: 65536 (order: 10, 4194304 bytes, vmalloc)
[ 12.212882] pinctrl core: initialized pinctrl subsystem
[ 12.213339] PM: RTC time: 17:31:55, date: 2023-01-05
[ 12.218400] NET: Registered PF_NETLINK/PF_ROUTE protocol family
[ 12.219309] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations
[ 12.220100] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations
[ 12.221095] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations
[ 12.222124] audit: initializing netlink subsys (disabled)
[ 12.223124] audit: type=2000 audit(1672939910.925:1): state=initialized audit_enabled=0 res=1
[ 12.223789] thermal_sys: Registered thermal governor 'fair_share'
[ 12.224084] thermal_sys: Registered thermal governor 'bang_bang'
[ 12.225080] thermal_sys: Registered thermal governor 'step_wise'
[ 12.226080] thermal_sys: Registered thermal governor 'user_space'
[ 12.227147] cpuidle: using governor menu
[ 12.238270] Detected 2 PCC Subspaces
[ 12.242087] Registering PCC driver as Mailbox controller
[ 12.250366] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[ 12.258101] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 12.265834] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[ 12.277093] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[ 12.284139] PCI: Using configuration type 1 for base access
[ 12.312286] kprobes: kprobe jump-optimization is enabled. All kprobes are optimized if possible.
[ 12.322307] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages
[ 12.330086] HugeTLB: 16380 KiB vmemmap can be freed for a 1.00 GiB page
[ 12.337083] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages
[ 12.345083] HugeTLB: 28 KiB vmemmap can be freed for a 2.00 MiB page
[ 12.354154] cryptd: max_cpu_qlen set to 1000
[ 12.360116] raid6: skipped pq benchmark and selected avx2x4
[ 12.366088] raid6: using avx2x2 recovery algorithm
[ 12.371432] fbcon: Taking over console
[ 12.376440] ACPI: Added _OSI(Module Device)
[ 12.381084] ACPI: Added _OSI(Processor Device)
[ 12.386083] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 12.391087] ACPI: Added _OSI(Processor Aggregator Device)
[ 12.679220] ACPI: 5 ACPI AML tables successfully acquired and loaded
[ 12.726063] ACPI: Dynamic OEM Table Load:
[ 12.738181] ACPI BIOS Error (bug): AE_AML_BUFFER_LIMIT, Field [CPB3] at bit offset/length 64/32 exceeds size of target Buffer (64 bits) (20221020/dsopcode-198)
[ 12.754093] ACPI Error: Aborting method \_SB._OSC due to previous error (AE_AML_BUFFER_LIMIT) (20221020/psparse-529)
[ 12.852409] ACPI: Interpreter enabled
[ 12.856114] ACPI: PM: (supports S0 S4 S5)
[ 12.861083] ACPI: Using IOAPIC for interrupt routing
[ 12.866182] HEST: Table parsing has been initialized.
[ 12.872977] GHES: APEI firmware first mode is enabled by WHEA _OSC.
[ 12.879098] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 12.890088] PCI: Using E820 reservations for host bridge windows
[ 12.898925] ACPI: Enabled 6 GPEs in block 00 to 3F
[ 13.313356] ACPI: PCI Root Bridge [UNC3] (domain 0000 [bus ff])
[ 13.319092] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 13.330162] PCI host bridge to bus 0000:ff
[ 13.334084] pci_bus 0000:ff: Unknown NUMA node; performance will be reduced
[ 13.342090] pci_bus 0000:ff: root bus resource [bus ff]
[ 13.348117] pci 0000:ff:08.0: [8086:6f80] type 00 class 0x088000
[ 13.355234] pci 0000:ff:08.2: [8086:6f32] type 00 class 0x110100
[ 13.362179] pci 0000:ff:09.0: [8086:6f90] type 00 class 0x088000
[ 13.368192] pci 0000:ff:09.2: [8086:6f33] type 00 class 0x110100
[ 13.375196] pci 0000:ff:0a.0: [8086:6f40] type 00 class 0x088000
[ 13.382183] pci 0000:ff:0a.2: [8086:6f3a] type 00 class 0x110100
[ 13.389195] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000
[ 13.395172] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100
[ 13.402180] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100
[ 13.409173] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000
[ 13.416189] pci 0000:ff:0b.4: [8086:6f41] type 00 class 0x088000
[ 13.423169] pci 0000:ff:0b.5: [8086:6f3e] type 00 class 0x110100
[ 13.429186] pci 0000:ff:0b.6: [8086:6f3f] type 00 class 0x110100
[ 13.436197] pci 0000:ff:0b.7: [8086:6f7e] type 00 class 0x088000
[ 13.443175] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000
[ 13.450175] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000
[ 13.456175] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000
[ 13.463190] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000
[ 13.470191] pci 0000:ff:0c.4: [8086:6fe4] type 00 class 0x088000
[ 13.477193] pci 0000:ff:0c.5: [8086:6fe5] type 00 class 0x088000
[ 13.484178] pci 0000:ff:0c.6: [8086:6fe6] type 00 class 0x088000
[ 13.490178] pci 0000:ff:0c.7: [8086:6fe7] type 00 class 0x088000
[ 13.497178] pci 0000:ff:0d.0: [8086:6fe8] type 00 class 0x088000
[ 13.504188] pci 0000:ff:0d.1: [8086:6fe9] type 00 class 0x088000
[ 13.511168] pci 0000:ff:0d.2: [8086:6fea] type 00 class 0x088000
[ 13.517191] pci 0000:ff:0d.3: [8086:6feb] type 00 class 0x088000
[ 13.524181] pci 0000:ff:0d.4: [8086:6fec] type 00 class 0x088000
[ 13.531176] pci 0000:ff:0d.5: [8086:6fed] type 00 class 0x088000
[ 13.538191] pci 0000:ff:0d.6: [8086:6fee] type 00 class 0x088000
[ 13.544175] pci 0000:ff:0d.7: [8086:6fef] type 00 class 0x088000
[ 13.551190] pci 0000:ff:0e.0: [8086:6ff0] type 00 class 0x088000
[ 13.558175] pci 0000:ff:0e.1: [8086:6ff1] type 00 class 0x088000
[ 13.565193] pci 0000:ff:0e.2: [8086:6ff2] type 00 class 0xffffff
[ 13.572176] pci 0000:ff:0e.3: [8086:6ff3] type 00 class 0xffffff
[ 13.578198] pci 0000:ff:0e.4: [8086:6ff4] type 00 class 0xffffff
[ 13.585179] pci 0000:ff:0e.5: [8086:6ff5] type 00 class 0xffffff
[ 13.592187] pci 0000:ff:0e.6: [8086:6ff6] type 00 class 0xffffff
[ 13.599175] pci 0000:ff:0e.7: [8086:6ff7] type 00 class 0xffffff
[ 13.605202] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000
[ 13.612158] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000
[ 13.619192] pci 0000:ff:0f.2: [8086:6ffa] type 00 class 0x088000
[ 13.626182] pci 0000:ff:0f.3: [8086:6ffb] type 00 class 0x088000
[ 13.633188] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000
[ 13.639170] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000
[ 13.646196] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000
[ 13.653160] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000
[ 13.660190] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100
[ 13.666180] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000
[ 13.673191] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000
[ 13.680176] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000
[ 13.687176] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100
[ 13.694176] pci 0000:ff:12.4: [8086:6f60] type 00 class 0x088000
[ 13.700155] pci 0000:ff:12.5: [8086:6f38] type 00 class 0x110100
[ 13.707209] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000
[ 13.714262] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000
[ 13.721223] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000
[ 13.728205] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000
[ 13.734196] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000
[ 13.741206] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000
[ 13.748219] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000
[ 13.755176] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000
[ 13.761197] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000
[ 13.768224] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000
[ 13.775155] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000
[ 13.782222] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000
[ 13.789208] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000
[ 13.795197] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000
[ 13.802194] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000
[ 13.809198] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000
[ 13.816153] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000
[ 13.823227] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000
[ 13.830200] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000
[ 13.836223] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000
[ 13.843217] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000
[ 13.850278] pci 0000:ff:16.1: [8086:6f79] type 00 class 0x088000
[ 13.857202] pci 0000:ff:16.2: [8086:6f6a] type 00 class 0x088000
[ 13.864207] pci 0000:ff:16.3: [8086:6f6b] type 00 class 0x088000
[ 13.871216] pci 0000:ff:16.4: [8086:6f6c] type 00 class 0x088000
[ 13.877204] pci 0000:ff:16.5: [8086:6f6d] type 00 class 0x088000
[ 13.884220] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000
[ 13.891198] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000
[ 13.898295] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000
[ 13.905304] pci 0000:ff:17.1: [8086:6fd1] type 00 class 0x088000
[ 13.912213] pci 0000:ff:17.2: [8086:6fd2] type 00 class 0x088000
[ 13.918232] pci 0000:ff:17.3: [8086:6fd3] type 00 class 0x088000
[ 13.925202] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000
[ 13.932202] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000
[ 13.939207] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000
[ 13.946177] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000
[ 13.952208] pci 0000:ff:18.0: [8086:6fd4] type 00 class 0x088000
[ 13.959212] pci 0000:ff:18.1: [8086:6fd5] type 00 class 0x088000
[ 13.966238] pci 0000:ff:18.2: [8086:6fd6] type 00 class 0x088000
[ 13.973239] pci 0000:ff:18.3: [8086:6fd7] type 00 class 0x088000
[ 13.980247] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000
[ 13.987197] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000
[ 13.994173] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000
[ 14.000316] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000
[ 14.007167] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000
[ 14.014185] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000
[ 14.021201] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000
[ 14.028526] ACPI: PCI Root Bridge [UNC2] (domain 0000 [bus bf])
[ 14.035094] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 14.045183] PCI host bridge to bus 0000:bf
[ 14.050083] pci_bus 0000:bf: Unknown NUMA node; performance will be reduced
[ 14.058088] pci_bus 0000:bf: root bus resource [bus bf]
[ 14.063100] pci 0000:bf:08.0: [8086:6f80] type 00 class 0x088000
[ 14.070202] pci 0000:bf:08.2: [8086:6f32] type 00 class 0x110100
[ 14.077201] pci 0000:bf:09.0: [8086:6f90] type 00 class 0x088000
[ 14.084163] pci 0000:bf:09.2: [8086:6f33] type 00 class 0x110100
[ 14.091200] pci 0000:bf:0a.0: [8086:6f40] type 00 class 0x088000
[ 14.097174] pci 0000:bf:0a.2: [8086:6f3a] type 00 class 0x110100
[ 14.104199] pci 0000:bf:0b.0: [8086:6f81] type 00 class 0x088000
[ 14.111169] pci 0000:bf:0b.1: [8086:6f36] type 00 class 0x110100
[ 14.118193] pci 0000:bf:0b.2: [8086:6f37] type 00 class 0x110100
[ 14.125167] pci 0000:bf:0b.3: [8086:6f76] type 00 class 0x088000
[ 14.131236] pci 0000:bf:0b.4: [8086:6f41] type 00 class 0x088000
[ 14.138214] pci 0000:bf:0b.5: [8086:6f3e] type 00 class 0x110100
[ 14.145174] pci 0000:bf:0b.6: [8086:6f3f] type 00 class 0x110100
[ 14.152191] pci 0000:bf:0b.7: [8086:6f7e] type 00 class 0x088000
[ 14.159171] pci 0000:bf:0c.0: [8086:6fe0] type 00 class 0x088000
[ 14.165201] pci 0000:bf:0c.1: [8086:6fe1] type 00 class 0x088000
[ 14.172170] pci 0000:bf:0c.2: [8086:6fe2] type 00 class 0x088000
[ 14.179196] pci 0000:bf:0c.3: [8086:6fe3] type 00 class 0x088000
[ 14.186179] pci 0000:bf:0c.4: [8086:6fe4] type 00 class 0x088000
[ 14.193196] pci 0000:bf:0c.5: [8086:6fe5] type 00 class 0x088000
[ 14.199230] pci 0000:bf:0c.6: [8086:6fe6] type 00 class 0x088000
[ 14.206207] pci 0000:bf:0c.7: [8086:6fe7] type 00 class 0x088000
[ 14.213173] pci 0000:bf:0d.0: [8086:6fe8] type 00 class 0x088000
[ 14.220190] pci 0000:bf:0d.1: [8086:6fe9] type 00 class 0x088000
[ 14.227174] pci 0000:bf:0d.2: [8086:6fea] type 00 class 0x088000
[ 14.234195] pci 0000:bf:0d.3: [8086:6feb] type 00 class 0x088000
[ 14.240173] pci 0000:bf:0d.4: [8086:6fec] type 00 class 0x088000
[ 14.247189] pci 0000:bf:0d.5: [8086:6fed] type 00 class 0x088000
[ 14.254182] pci 0000:bf:0d.6: [8086:6fee] type 00 class 0x088000
[ 14.261192] pci 0000:bf:0d.7: [8086:6fef] type 00 class 0x088000
[ 14.268175] pci 0000:bf:0e.0: [8086:6ff0] type 00 class 0x088000
[ 14.274178] pci 0000:bf:0e.1: [8086:6ff1] type 00 class 0x088000
[ 14.281194] pci 0000:bf:0e.2: [8086:6ff2] type 00 class 0xffffff
[ 14.288173] pci 0000:bf:0e.3: [8086:6ff3] type 00 class 0xffffff
[ 14.295197] pci 0000:bf:0e.4: [8086:6ff4] type 00 class 0xffffff
[ 14.301180] pci 0000:bf:0e.5: [8086:6ff5] type 00 class 0xffffff
[ 14.308202] pci 0000:bf:0e.6: [8086:6ff6] type 00 class 0xffffff
[ 14.315177] pci 0000:bf:0e.7: [8086:6ff7] type 00 class 0xffffff
[ 14.322178] pci 0000:bf:0f.0: [8086:6ff8] type 00 class 0x088000
[ 14.329193] pci 0000:bf:0f.1: [8086:6ff9] type 00 class 0x088000
[ 14.336187] pci 0000:bf:0f.2: [8086:6ffa] type 00 class 0x088000
[ 14.342193] pci 0000:bf:0f.3: [8086:6ffb] type 00 class 0x088000
[ 14.349183] pci 0000:bf:0f.4: [8086:6ffc] type 00 class 0x088000
[ 14.356159] pci 0000:bf:0f.5: [8086:6ffd] type 00 class 0x088000
[ 14.363198] pci 0000:bf:0f.6: [8086:6ffe] type 00 class 0x088000
[ 14.370176] pci 0000:bf:10.0: [8086:6f1d] type 00 class 0x088000
[ 14.376198] pci 0000:bf:10.1: [8086:6f34] type 00 class 0x110100
[ 14.383199] pci 0000:bf:10.5: [8086:6f1e] type 00 class 0x088000
[ 14.390184] pci 0000:bf:10.7: [8086:6f1f] type 00 class 0x088000
[ 14.397186] pci 0000:bf:12.0: [8086:6fa0] type 00 class 0x088000
[ 14.404155] pci 0000:bf:12.1: [8086:6f30] type 00 class 0x110100
[ 14.410204] pci 0000:bf:12.4: [8086:6f60] type 00 class 0x088000
[ 14.417157] pci 0000:bf:12.5: [8086:6f38] type 00 class 0x110100
[ 14.424211] pci 0000:bf:13.0: [8086:6fa8] type 00 class 0x088000
[ 14.431289] pci 0000:bf:13.1: [8086:6f71] type 00 class 0x088000
[ 14.438195] pci 0000:bf:13.2: [8086:6faa] type 00 class 0x088000
[ 14.444219] pci 0000:bf:13.3: [8086:6fab] type 00 class 0x088000
[ 14.451234] pci 0000:bf:13.4: [8086:6fac] type 00 class 0x088000
[ 14.458229] pci 0000:bf:13.5: [8086:6fad] type 00 class 0x088000
[ 14.465207] pci 0000:bf:13.6: [8086:6fae] type 00 class 0x088000
[ 14.472209] pci 0000:bf:13.7: [8086:6faf] type 00 class 0x088000
[ 14.479162] pci 0000:bf:14.0: [8086:6fb0] type 00 class 0x088000
[ 14.485242] pci 0000:bf:14.1: [8086:6fb1] type 00 class 0x088000
[ 14.492213] pci 0000:bf:14.2: [8086:6fb2] type 00 class 0x088000
[ 14.499232] pci 0000:bf:14.3: [8086:6fb3] type 00 class 0x088000
[ 14.506232] pci 0000:bf:14.4: [8086:6fbc] type 00 class 0x088000
[ 14.513190] pci 0000:bf:14.5: [8086:6fbd] type 00 class 0x088000
[ 14.519211] pci 0000:bf:14.6: [8086:6fbe] type 00 class 0x088000
[ 14.526165] pci 0000:bf:14.7: [8086:6fbf] type 00 class 0x088000
[ 14.533217] pci 0000:bf:15.0: [8086:6fb4] type 00 class 0x088000
[ 14.540218] pci 0000:bf:15.1: [8086:6fb5] type 00 class 0x088000
[ 14.547245] pci 0000:bf:15.2: [8086:6fb6] type 00 class 0x088000
[ 14.554233] pci 0000:bf:15.3: [8086:6fb7] type 00 class 0x088000
[ 14.560234] pci 0000:bf:16.0: [8086:6f68] type 00 class 0x088000
[ 14.567338] pci 0000:bf:16.1: [8086:6f79] type 00 class 0x088000
[ 14.574259] pci 0000:bf:16.2: [8086:6f6a] type 00 class 0x088000
[ 14.581223] pci 0000:bf:16.3: [8086:6f6b] type 00 class 0x088000
[ 14.588251] pci 0000:bf:16.4: [8086:6f6c] type 00 class 0x088000
[ 14.595245] pci 0000:bf:16.5: [8086:6f6d] type 00 class 0x088000
[ 14.602219] pci 0000:bf:16.6: [8086:6f6e] type 00 class 0x088000
[ 14.608215] pci 0000:bf:16.7: [8086:6f6f] type 00 class 0x088000
[ 14.615193] pci 0000:bf:17.0: [8086:6fd0] type 00 class 0x088000
[ 14.622302] pci 0000:bf:17.1: [8086:6fd1] type 00 class 0x088000
[ 14.629236] pci 0000:bf:17.2: [8086:6fd2] type 00 class 0x088000
[ 14.636269] pci 0000:bf:17.3: [8086:6fd3] type 00 class 0x088000
[ 14.643251] pci 0000:bf:17.4: [8086:6fb8] type 00 class 0x088000
[ 14.650190] pci 0000:bf:17.5: [8086:6fb9] type 00 class 0x088000
[ 14.656218] pci 0000:bf:17.6: [8086:6fba] type 00 class 0x088000
[ 14.663186] pci 0000:bf:17.7: [8086:6fbb] type 00 class 0x088000
[ 14.670221] pci 0000:bf:18.0: [8086:6fd4] type 00 class 0x088000
[ 14.677280] pci 0000:bf:18.1: [8086:6fd5] type 00 class 0x088000
[ 14.684290] pci 0000:bf:18.2: [8086:6fd6] type 00 class 0x088000
[ 14.691225] pci 0000:bf:18.3: [8086:6fd7] type 00 class 0x088000
[ 14.697297] pci 0000:bf:1e.0: [8086:6f98] type 00 class 0x088000
[ 14.704186] pci 0000:bf:1e.1: [8086:6f99] type 00 class 0x088000
[ 14.711218] pci 0000:bf:1e.2: [8086:6f9a] type 00 class 0x088000
[ 14.718209] pci 0000:bf:1e.3: [8086:6fc0] type 00 class 0x088000
[ 14.725160] pci 0000:bf:1e.4: [8086:6f9c] type 00 class 0x088000
[ 14.732237] pci 0000:bf:1f.0: [8086:6f88] type 00 class 0x088000
[ 14.738195] pci 0000:bf:1f.2: [8086:6f8a] type 00 class 0x088000
[ 14.745645] ACPI: PCI Root Bridge [UNC1] (domain 0000 [bus 7f])
[ 14.752133] acpi PNP0A03:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 14.763303] PCI host bridge to bus 0000:7f
[ 14.768085] pci_bus 0000:7f: Unknown NUMA node; performance will be reduced
[ 14.775086] pci_bus 0000:7f: root bus resource [bus 7f]
[ 14.781102] pci 0000:7f:08.0: [8086:6f80] type 00 class 0x088000
[ 14.788198] pci 0000:7f:08.2: [8086:6f32] type 00 class 0x110100
[ 14.795223] pci 0000:7f:09.0: [8086:6f90] type 00 class 0x088000
[ 14.801167] pci 0000:7f:09.2: [8086:6f33] type 00 class 0x110100
[ 14.808261] pci 0000:7f:0a.0: [8086:6f40] type 00 class 0x088000
[ 14.815233] pci 0000:7f:0a.2: [8086:6f3a] type 00 class 0x110100
[ 14.822189] pci 0000:7f:0b.0: [8086:6f81] type 00 class 0x088000
[ 14.829214] pci 0000:7f:0b.1: [8086:6f36] type 00 class 0x110100
[ 14.836179] pci 0000:7f:0b.2: [8086:6f37] type 00 class 0x110100
[ 14.842207] pci 0000:7f:0b.3: [8086:6f76] type 00 class 0x088000
[ 14.849180] pci 0000:7f:0b.4: [8086:6f41] type 00 class 0x088000
[ 14.856208] pci 0000:7f:0b.5: [8086:6f3e] type 00 class 0x110100
[ 14.863206] pci 0000:7f:0b.6: [8086:6f3f] type 00 class 0x110100
[ 14.870241] pci 0000:7f:0b.7: [8086:6f7e] type 00 class 0x088000
[ 14.876215] pci 0000:7f:0c.0: [8086:6fe0] type 00 class 0x088000
[ 14.883185] pci 0000:7f:0c.1: [8086:6fe1] type 00 class 0x088000
[ 14.890213] pci 0000:7f:0c.2: [8086:6fe2] type 00 class 0x088000
[ 14.897182] pci 0000:7f:0c.3: [8086:6fe3] type 00 class 0x088000
[ 14.904205] pci 0000:7f:0c.4: [8086:6fe4] type 00 class 0x088000
[ 14.910180] pci 0000:7f:0c.5: [8086:6fe5] type 00 class 0x088000
[ 14.917207] pci 0000:7f:0c.6: [8086:6fe6] type 00 class 0x088000
[ 14.924182] pci 0000:7f:0c.7: [8086:6fe7] type 00 class 0x088000
[ 14.931225] pci 0000:7f:0d.0: [8086:6fe8] type 00 class 0x088000
[ 14.938216] pci 0000:7f:0d.1: [8086:6fe9] type 00 class 0x088000
[ 14.945168] pci 0000:7f:0d.2: [8086:6fea] type 00 class 0x088000
[ 14.951210] pci 0000:7f:0d.3: [8086:6feb] type 00 class 0x088000
[ 14.958182] pci 0000:7f:0d.4: [8086:6fec] type 00 class 0x088000
[ 14.965213] pci 0000:7f:0d.5: [8086:6fed] type 00 class 0x088000
[ 14.972182] pci 0000:7f:0d.6: [8086:6fee] type 00 class 0x088000
[ 14.978219] pci 0000:7f:0d.7: [8086:6fef] type 00 class 0x088000
[ 14.985185] pci 0000:7f:0e.0: [8086:6ff0] type 00 class 0x088000
[ 14.992209] pci 0000:7f:0e.1: [8086:6ff1] type 00 class 0x088000
[ 14.999269] pci 0000:7f:0e.2: [8086:6ff2] type 00 class 0xffffff
[ 15.006234] pci 0000:7f:0e.3: [8086:6ff3] type 00 class 0xffffff
[ 15.013192] pci 0000:7f:0e.4: [8086:6ff4] type 00 class 0xffffff
[ 15.019220] pci 0000:7f:0e.5: [8086:6ff5] type 00 class 0xffffff
[ 15.026184] pci 0000:7f:0e.6: [8086:6ff6] type 00 class 0xffffff
[ 15.033218] pci 0000:7f:0e.7: [8086:6ff7] type 00 class 0xffffff
[ 15.040189] pci 0000:7f:0f.0: [8086:6ff8] type 00 class 0x088000
[ 15.047202] pci 0000:7f:0f.1: [8086:6ff9] type 00 class 0x088000
[ 15.053190] pci 0000:7f:0f.2: [8086:6ffa] type 00 class 0x088000
[ 15.060212] pci 0000:7f:0f.3: [8086:6ffb] type 00 class 0x088000
[ 15.067224] pci 0000:7f:0f.4: [8086:6ffc] type 00 class 0x088000
[ 15.074264] pci 0000:7f:0f.5: [8086:6ffd] type 00 class 0x088000
[ 15.081208] pci 0000:7f:0f.6: [8086:6ffe] type 00 class 0x088000
[ 15.088187] pci 0000:7f:10.0: [8086:6f1d] type 00 class 0x088000
[ 15.094217] pci 0000:7f:10.1: [8086:6f34] type 00 class 0x110100
[ 15.101193] pci 0000:7f:10.5: [8086:6f1e] type 00 class 0x088000
[ 15.108206] pci 0000:7f:10.7: [8086:6f1f] type 00 class 0x088000
[ 15.115184] pci 0000:7f:12.0: [8086:6fa0] type 00 class 0x088000
[ 15.121188] pci 0000:7f:12.1: [8086:6f30] type 00 class 0x110100
[ 15.128188] pci 0000:7f:12.4: [8086:6f60] type 00 class 0x088000
[ 15.135316] pci 0000:7f:12.5: [8086:6f38] type 00 class 0x110100
[ 15.142268] pci 0000:7f:13.0: [8086:6fa8] type 00 class 0x088000
[ 15.149281] pci 0000:7f:13.1: [8086:6f71] type 00 class 0x088000
[ 15.156263] pci 0000:7f:13.2: [8086:6faa] type 00 class 0x088000
[ 15.163226] pci 0000:7f:13.3: [8086:6fab] type 00 class 0x088000
[ 15.169258] pci 0000:7f:13.4: [8086:6fac] type 00 class 0x088000
[ 15.176245] pci 0000:7f:13.5: [8086:6fad] type 00 class 0x088000
[ 15.183217] pci 0000:7f:13.6: [8086:6fae] type 00 class 0x088000
[ 15.190225] pci 0000:7f:13.7: [8086:6faf] type 00 class 0x088000
[ 15.197203] pci 0000:7f:14.0: [8086:6fb0] type 00 class 0x088000
[ 15.204314] pci 0000:7f:14.1: [8086:6fb1] type 00 class 0x088000
[ 15.211264] pci 0000:7f:14.2: [8086:6fb2] type 00 class 0x088000
[ 15.217220] pci 0000:7f:14.3: [8086:6fb3] type 00 class 0x088000
[ 15.224236] pci 0000:7f:14.4: [8086:6fbc] type 00 class 0x088000
[ 15.231184] pci 0000:7f:14.5: [8086:6fbd] type 00 class 0x088000
[ 15.238220] pci 0000:7f:14.6: [8086:6fbe] type 00 class 0x088000
[ 15.245212] pci 0000:7f:14.7: [8086:6fbf] type 00 class 0x088000
[ 15.252224] pci 0000:7f:15.0: [8086:6fb4] type 00 class 0x088000
[ 15.258236] pci 0000:7f:15.1: [8086:6fb5] type 00 class 0x088000
[ 15.265254] pci 0000:7f:15.2: [8086:6fb6] type 00 class 0x088000
[ 15.272218] pci 0000:7f:15.3: [8086:6fb7] type 00 class 0x088000
[ 15.279257] pci 0000:7f:16.0: [8086:6f68] type 00 class 0x088000
[ 15.286306] pci 0000:7f:16.1: [8086:6f79] type 00 class 0x088000
[ 15.293229] pci 0000:7f:16.2: [8086:6f6a] type 00 class 0x088000
[ 15.299254] pci 0000:7f:16.3: [8086:6f6b] type 00 class 0x088000
[ 15.306219] pci 0000:7f:16.4: [8086:6f6c] type 00 class 0x088000
[ 15.313249] pci 0000:7f:16.5: [8086:6f6d] type 00 class 0x088000
[ 15.320223] pci 0000:7f:16.6: [8086:6f6e] type 00 class 0x088000
[ 15.327232] pci 0000:7f:16.7: [8086:6f6f] type 00 class 0x088000
[ 15.334197] pci 0000:7f:17.0: [8086:6fd0] type 00 class 0x088000
[ 15.340303] pci 0000:7f:17.1: [8086:6fd1] type 00 class 0x088000
[ 15.347219] pci 0000:7f:17.2: [8086:6fd2] type 00 class 0x088000
[ 15.354263] pci 0000:7f:17.3: [8086:6fd3] type 00 class 0x088000
[ 15.361241] pci 0000:7f:17.4: [8086:6fb8] type 00 class 0x088000
[ 15.368198] pci 0000:7f:17.5: [8086:6fb9] type 00 class 0x088000
[ 15.375212] pci 0000:7f:17.6: [8086:6fba] type 00 class 0x088000
[ 15.382191] pci 0000:7f:17.7: [8086:6fbb] type 00 class 0x088000
[ 15.388166] pci 0000:7f:18.0: [8086:6fd4] type 00 class 0x088000
[ 15.395266] pci 0000:7f:18.1: [8086:6fd5] type 00 class 0x088000
[ 15.402255] pci 0000:7f:18.2: [8086:6fd6] type 00 class 0x088000
[ 15.409223] pci 0000:7f:18.3: [8086:6fd7] type 00 class 0x088000
[ 15.416292] pci 0000:7f:1e.0: [8086:6f98] type 00 class 0x088000
[ 15.423185] pci 0000:7f:1e.1: [8086:6f99] type 00 class 0x088000
[ 15.429226] pci 0000:7f:1e.2: [8086:6f9a] type 00 class 0x088000
[ 15.436216] pci 0000:7f:1e.3: [8086:6fc0] type 00 class 0x088000
[ 15.443162] pci 0000:7f:1e.4: [8086:6f9c] type 00 class 0x088000
[ 15.450227] pci 0000:7f:1f.0: [8086:6f88] type 00 class 0x088000
[ 15.457195] pci 0000:7f:1f.2: [8086:6f8a] type 00 class 0x088000
[ 15.464396] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus 3f])
[ 15.471096] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 15.481194] PCI host bridge to bus 0000:3f
[ 15.486084] pci_bus 0000:3f: Unknown NUMA node; performance will be reduced
[ 15.493084] pci_bus 0000:3f: root bus resource [bus 3f]
[ 15.499105] pci 0000:3f:08.0: [8086:6f80] type 00 class 0x088000
[ 15.506157] pci 0000:3f:08.2: [8086:6f32] type 00 class 0x110100
[ 15.513223] pci 0000:3f:09.0: [8086:6f90] type 00 class 0x088000
[ 15.520192] pci 0000:3f:09.2: [8086:6f33] type 00 class 0x110100
[ 15.526213] pci 0000:3f:0a.0: [8086:6f40] type 00 class 0x088000
[ 15.533188] pci 0000:3f:0a.2: [8086:6f3a] type 00 class 0x110100
[ 15.540215] pci 0000:3f:0b.0: [8086:6f81] type 00 class 0x088000
[ 15.547185] pci 0000:3f:0b.1: [8086:6f36] type 00 class 0x110100
[ 15.554215] pci 0000:3f:0b.2: [8086:6f37] type 00 class 0x110100
[ 15.560192] pci 0000:3f:0b.3: [8086:6f76] type 00 class 0x088000
[ 15.567208] pci 0000:3f:0b.4: [8086:6f41] type 00 class 0x088000
[ 15.574208] pci 0000:3f:0b.5: [8086:6f3e] type 00 class 0x110100
[ 15.581200] pci 0000:3f:0b.6: [8086:6f3f] type 00 class 0x110100
[ 15.588222] pci 0000:3f:0b.7: [8086:6f7e] type 00 class 0x088000
[ 15.595191] pci 0000:3f:0c.0: [8086:6fe0] type 00 class 0x088000
[ 15.601203] pci 0000:3f:0c.1: [8086:6fe1] type 00 class 0x088000
[ 15.608179] pci 0000:3f:0c.2: [8086:6fe2] type 00 class 0x088000
[ 15.615204] pci 0000:3f:0c.3: [8086:6fe3] type 00 class 0x088000
[ 15.622151] pci 0000:3f:0c.4: [8086:6fe4] type 00 class 0x088000
[ 15.628187] pci 0000:3f:0c.5: [8086:6fe5] type 00 class 0x088000
[ 15.635210] pci 0000:3f:0c.6: [8086:6fe6] type 00 class 0x088000
[ 15.642181] pci 0000:3f:0c.7: [8086:6fe7] type 00 class 0x088000
[ 15.649209] pci 0000:3f:0d.0: [8086:6fe8] type 00 class 0x088000
[ 15.656178] pci 0000:3f:0d.1: [8086:6fe9] type 00 class 0x088000
[ 15.662205] pci 0000:3f:0d.2: [8086:6fea] type 00 class 0x088000
[ 15.669178] pci 0000:3f:0d.3: [8086:6feb] type 00 class 0x088000
[ 15.676210] pci 0000:3f:0d.4: [8086:6fec] type 00 class 0x088000
[ 15.683202] pci 0000:3f:0d.5: [8086:6fed] type 00 class 0x088000
[ 15.690187] pci 0000:3f:0d.6: [8086:6fee] type 00 class 0x088000
[ 15.696194] pci 0000:3f:0d.7: [8086:6fef] type 00 class 0x088000
[ 15.703190] pci 0000:3f:0e.0: [8086:6ff0] type 00 class 0x088000
[ 15.710207] pci 0000:3f:0e.1: [8086:6ff1] type 00 class 0x088000
[ 15.717187] pci 0000:3f:0e.2: [8086:6ff2] type 00 class 0xffffff
[ 15.723213] pci 0000:3f:0e.3: [8086:6ff3] type 00 class 0xffffff
[ 15.730186] pci 0000:3f:0e.4: [8086:6ff4] type 00 class 0xffffff
[ 15.737209] pci 0000:3f:0e.5: [8086:6ff5] type 00 class 0xffffff
[ 15.744263] pci 0000:3f:0e.6: [8086:6ff6] type 00 class 0xffffff
[ 15.751237] pci 0000:3f:0e.7: [8086:6ff7] type 00 class 0xffffff
[ 15.758196] pci 0000:3f:0f.0: [8086:6ff8] type 00 class 0x088000
[ 15.764216] pci 0000:3f:0f.1: [8086:6ff9] type 00 class 0x088000
[ 15.771189] pci 0000:3f:0f.2: [8086:6ffa] type 00 class 0x088000
[ 15.778214] pci 0000:3f:0f.3: [8086:6ffb] type 00 class 0x088000
[ 15.785182] pci 0000:3f:0f.4: [8086:6ffc] type 00 class 0x088000
[ 15.792217] pci 0000:3f:0f.5: [8086:6ffd] type 00 class 0x088000
[ 15.798191] pci 0000:3f:0f.6: [8086:6ffe] type 00 class 0x088000
[ 15.805217] pci 0000:3f:10.0: [8086:6f1d] type 00 class 0x088000
[ 15.812208] pci 0000:3f:10.1: [8086:6f34] type 00 class 0x110100
[ 15.819195] pci 0000:3f:10.5: [8086:6f1e] type 00 class 0x088000
[ 15.826222] pci 0000:3f:10.7: [8086:6f1f] type 00 class 0x088000
[ 15.832188] pci 0000:3f:12.0: [8086:6fa0] type 00 class 0x088000
[ 15.839200] pci 0000:3f:12.1: [8086:6f30] type 00 class 0x110100
[ 15.846200] pci 0000:3f:12.4: [8086:6f60] type 00 class 0x088000
[ 15.853191] pci 0000:3f:12.5: [8086:6f38] type 00 class 0x110100
[ 15.860200] pci 0000:3f:13.0: [8086:6fa8] type 00 class 0x088000
[ 15.866275] pci 0000:3f:13.1: [8086:6f71] type 00 class 0x088000
[ 15.873252] pci 0000:3f:13.2: [8086:6faa] type 00 class 0x088000
[ 15.880224] pci 0000:3f:13.3: [8086:6fab] type 00 class 0x088000
[ 15.887248] pci 0000:3f:13.4: [8086:6fac] type 00 class 0x088000
[ 15.894243] pci 0000:3f:13.5: [8086:6fad] type 00 class 0x088000
[ 15.901252] pci 0000:3f:13.6: [8086:6fae] type 00 class 0x088000
[ 15.908192] pci 0000:3f:13.7: [8086:6faf] type 00 class 0x088000
[ 15.914222] pci 0000:3f:14.0: [8086:6fb0] type 00 class 0x088000
[ 15.921223] pci 0000:3f:14.1: [8086:6fb1] type 00 class 0x088000
[ 15.928250] pci 0000:3f:14.2: [8086:6fb2] type 00 class 0x088000
[ 15.935241] pci 0000:3f:14.3: [8086:6fb3] type 00 class 0x088000
[ 15.942218] pci 0000:3f:14.4: [8086:6fbc] type 00 class 0x088000
[ 15.949201] pci 0000:3f:14.5: [8086:6fbd] type 00 class 0x088000
[ 15.955192] pci 0000:3f:14.6: [8086:6fbe] type 00 class 0x088000
[ 15.962217] pci 0000:3f:14.7: [8086:6fbf] type 00 class 0x088000
[ 15.969189] pci 0000:3f:15.0: [8086:6fb4] type 00 class 0x088000
[ 15.976244] pci 0000:3f:15.1: [8086:6fb5] type 00 class 0x088000
[ 15.983246] pci 0000:3f:15.2: [8086:6fb6] type 00 class 0x088000
[ 15.989214] pci 0000:3f:15.3: [8086:6fb7] type 00 class 0x088000
[ 15.996255] pci 0000:3f:16.0: [8086:6f68] type 00 class 0x088000
[ 16.003264] pci 0000:3f:16.1: [8086:6f79] type 00 class 0x088000
[ 16.010246] pci 0000:3f:16.2: [8086:6f6a] type 00 class 0x088000
[ 16.017193] pci 0000:3f:16.3: [8086:6f6b] type 00 class 0x088000
[ 16.024251] pci 0000:3f:16.4: [8086:6f6c] type 00 class 0x088000
[ 16.031265] pci 0000:3f:16.5: [8086:6f6d] type 00 class 0x088000
[ 16.037231] pci 0000:3f:16.6: [8086:6f6e] type 00 class 0x088000
[ 16.044215] pci 0000:3f:16.7: [8086:6f6f] type 00 class 0x088000
[ 16.051199] pci 0000:3f:17.0: [8086:6fd0] type 00 class 0x088000
[ 16.058309] pci 0000:3f:17.1: [8086:6fd1] type 00 class 0x088000
[ 16.065221] pci 0000:3f:17.2: [8086:6fd2] type 00 class 0x088000
[ 16.072245] pci 0000:3f:17.3: [8086:6fd3] type 00 class 0x088000
[ 16.078235] pci 0000:3f:17.4: [8086:6fb8] type 00 class 0x088000
[ 16.085188] pci 0000:3f:17.5: [8086:6fb9] type 00 class 0x088000
[ 16.092198] pci 0000:3f:17.6: [8086:6fba] type 00 class 0x088000
[ 16.099195] pci 0000:3f:17.7: [8086:6fbb] type 00 class 0x088000
[ 16.106213] pci 0000:3f:18.0: [8086:6fd4] type 00 class 0x088000
[ 16.113224] pci 0000:3f:18.1: [8086:6fd5] type 00 class 0x088000
[ 16.119241] pci 0000:3f:18.2: [8086:6fd6] type 00 class 0x088000
[ 16.126243] pci 0000:3f:18.3: [8086:6fd7] type 00 class 0x088000
[ 16.133268] pci 0000:3f:1e.0: [8086:6f98] type 00 class 0x088000
[ 16.140207] pci 0000:3f:1e.1: [8086:6f99] type 00 class 0x088000
[ 16.147198] pci 0000:3f:1e.2: [8086:6f9a] type 00 class 0x088000
[ 16.154191] pci 0000:3f:1e.3: [8086:6fc0] type 00 class 0x088000
[ 16.160184] pci 0000:3f:1e.4: [8086:6f9c] type 00 class 0x088000
[ 16.167203] pci 0000:3f:1f.0: [8086:6f88] type 00 class 0x088000
[ 16.174215] pci 0000:3f:1f.2: [8086:6f8a] type 00 class 0x088000
[ 16.446150] ACPI: PCI Root Bridge [IIO0] (domain 0000 [bus 00-3e])
[ 16.452094] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 16.466813] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug LTR DPC]
[ 16.476448] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[ 16.485090] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[ 16.495783] PCI host bridge to bus 0000:00
[ 16.501091] pci_bus 0000:00: Unknown NUMA node; performance will be reduced
[ 16.508120] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 16.516087] pci_bus 0000:00: root bus resource [io 0x1000-0x3fff window]
[ 16.524083] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 16.532084] pci_bus 0000:00: root bus resource [mem 0x000c4000-0x000cbfff window]
[ 16.540089] pci_bus 0000:00: root bus resource [mem 0x90000000-0xabffbfff window]
[ 16.549084] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x381fffffffff window]
[ 16.558086] pci_bus 0000:00: root bus resource [bus 00-3e]
[ 16.564174] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000
[ 16.571422] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400
[ 16.578121] pci 0000:00:02.0: enabling Extended Tags
[ 16.583148] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[ 16.590428] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400
[ 16.597124] pci 0000:00:03.0: enabling Extended Tags
[ 16.603149] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[ 16.609373] pci 0000:00:03.2: [8086:6f0a] type 01 class 0x060400
[ 16.616184] pci 0000:00:03.2: PME# supported from D0 D3hot D3cold
[ 16.623397] pci 0000:00:03.3: [8086:6f0b] type 01 class 0x060400
[ 16.630132] pci 0000:00:03.3: PME# supported from D0 D3hot D3cold
[ 16.637470] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000
[ 16.644099] pci 0000:00:04.0: reg 0x10: [mem 0x381ffff1c000-0x381ffff1ffff 64bit]
[ 16.653325] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000
[ 16.660098] pci 0000:00:04.1: reg 0x10: [mem 0x381ffff18000-0x381ffff1bfff 64bit]
[ 16.668321] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000
[ 16.675097] pci 0000:00:04.2: reg 0x10: [mem 0x381ffff14000-0x381ffff17fff 64bit]
[ 16.683324] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000
[ 16.690097] pci 0000:00:04.3: reg 0x10: [mem 0x381ffff10000-0x381ffff13fff 64bit]
[ 16.698317] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000
[ 16.705098] pci 0000:00:04.4: reg 0x10: [mem 0x381ffff0c000-0x381ffff0ffff 64bit]
[ 16.714299] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000
[ 16.721101] pci 0000:00:04.5: reg 0x10: [mem 0x381ffff08000-0x381ffff0bfff 64bit]
[ 16.729323] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000
[ 16.736097] pci 0000:00:04.6: reg 0x10: [mem 0x381ffff04000-0x381ffff07fff 64bit]
[ 16.744317] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000
[ 16.751097] pci 0000:00:04.7: reg 0x10: [mem 0x381ffff00000-0x381ffff03fff 64bit]
[ 16.759316] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000
[ 16.766289] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000
[ 16.773334] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000
[ 16.780265] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020
[ 16.787095] pci 0000:00:05.4: reg 0x10: [mem 0x92406000-0x92406fff]
[ 16.794296] pci 0000:00:11.0: [8086:1d3e] type 01 class 0x060400
[ 16.801233] pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
[ 16.808377] pci 0000:00:16.0: [8086:1d3a] type 00 class 0x078000
[ 16.815113] pci 0000:00:16.0: reg 0x10: [mem 0x92405000-0x9240500f 64bit]
[ 16.822172] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[ 16.829273] pci 0000:00:16.1: [8086:1d3b] type 00 class 0x078000
[ 16.836104] pci 0000:00:16.1: reg 0x10: [mem 0x92404000-0x9240400f 64bit]
[ 16.844161] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
[ 16.851344] pci 0000:00:1a.0: [8086:1d2d] type 00 class 0x0c0320
[ 16.857109] pci 0000:00:1a.0: reg 0x10: [mem 0x92402000-0x924023ff]
[ 16.864203] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[ 16.871288] pci 0000:00:1c.0: [8086:1d10] type 01 class 0x060400
[ 16.878244] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[ 16.885374] pci 0000:00:1c.7: [8086:1d1e] type 01 class 0x060400
[ 16.892208] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
[ 16.899318] pci 0000:00:1d.0: [8086:1d26] type 00 class 0x0c0320
[ 16.906103] pci 0000:00:1d.0: reg 0x10: [mem 0x92401000-0x924013ff]
[ 16.913200] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[ 16.920319] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
[ 16.927351] pci 0000:00:1f.0: [8086:1d41] type 00 class 0x060100
[ 16.934475] pci 0000:00:1f.2: [8086:1d02] type 00 class 0x010601
[ 16.941100] pci 0000:00:1f.2: reg 0x10: [io 0x2058-0x205f]
[ 16.947091] pci 0000:00:1f.2: reg 0x14: [io 0x207c-0x207f]
[ 16.953094] pci 0000:00:1f.2: reg 0x18: [io 0x2050-0x2057]
[ 16.959094] pci 0000:00:1f.2: reg 0x1c: [io 0x2078-0x207b]
[ 16.966092] pci 0000:00:1f.2: reg 0x20: [io 0x2020-0x203f]
[ 16.972091] pci 0000:00:1f.2: reg 0x24: [mem 0x92400000-0x924007ff]
[ 16.979168] pci 0000:00:1f.2: PME# supported from D3hot
[ 16.985411] pci 0000:00:1f.3: [8086:1d22] type 00 class 0x0c0500
[ 16.992105] pci 0000:00:1f.3: reg 0x10: [mem 0x381ffff20000-0x381ffff200ff 64bit]
[ 17.000103] pci 0000:00:1f.3: reg 0x20: [io 0x2000-0x201f]
[ 17.006669] acpiphp: Slot [8] registered
[ 17.011150] pci 0000:01:00.0: [1000:0087] type 00 class 0x010700
[ 17.018096] pci 0000:01:00.0: reg 0x10: [io 0x1000-0x10ff]
[ 17.024093] pci 0000:01:00.0: reg 0x14: [mem 0x92340000-0x9234ffff 64bit]
[ 17.032093] pci 0000:01:00.0: reg 0x1c: [mem 0x92300000-0x9233ffff 64bit]
[ 17.039096] pci 0000:01:00.0: reg 0x30: [mem 0xfff00000-0xffffffff pref]
[ 17.047162] pci 0000:01:00.0: supports D1 D2
[ 17.052397] pci 0000:00:02.0: PCI bridge to [bus 01]
[ 17.058092] pci 0000:00:02.0: bridge window [io 0x1000-0x1fff]
[ 17.064085] pci 0000:00:02.0: bridge window [mem 0x92300000-0x923fffff]
[ 17.072475] acpiphp: Slot [2] registered
[ 17.077132] pci 0000:00:03.0: PCI bridge to [bus 02]
[ 17.082366] acpiphp: Slot [1] registered
[ 17.087186] pci 0000:03:00.0: [8086:1528] type 00 class 0x020000
[ 17.094110] pci 0000:03:00.0: reg 0x10: [mem 0x91c00000-0x91dfffff 64bit pref]
[ 17.102111] pci 0000:03:00.0: reg 0x20: [mem 0x91e04000-0x91e07fff 64bit pref]
[ 17.110097] pci 0000:03:00.0: reg 0x30: [mem 0xfff80000-0xffffffff pref]
[ 17.117204] pci 0000:03:00.0: PME# supported from D0 D3hot
[ 17.124124] pci 0000:03:00.0: reg 0x184: [mem 0x92100000-0x92103fff 64bit]
[ 17.131084] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x92100000-0x921fffff 64bit] (contains BAR0 for 64 VFs)
[ 17.142102] pci 0000:03:00.0: reg 0x190: [mem 0x92200000-0x92203fff 64bit]
[ 17.150083] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x92200000-0x922fffff 64bit] (contains BAR3 for 64 VFs)
[ 17.161284] pci 0000:03:00.0: 16.000 Gb/s available PCIe bandwidth, limited by 5.0 GT/s PCIe x4 link at 0000:00:03.2 (capable of 32.000 Gb/s with 5.0 GT/s PCIe x8 link)
[ 17.178421] pci 0000:03:00.1: [8086:1528] type 00 class 0x020000
[ 17.185110] pci 0000:03:00.1: reg 0x10: [mem 0x91a00000-0x91bfffff 64bit pref]
[ 17.193112] pci 0000:03:00.1: reg 0x20: [mem 0x91e00000-0x91e03fff 64bit pref]
[ 17.201097] pci 0000:03:00.1: reg 0x30: [mem 0xfff80000-0xffffffff pref]
[ 17.208261] pci 0000:03:00.1: PME# supported from D0 D3hot
[ 17.215117] pci 0000:03:00.1: reg 0x184: [mem 0x91f00000-0x91f03fff 64bit]
[ 17.222083] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x91f00000-0x91ffffff 64bit] (contains BAR0 for 64 VFs)
[ 17.233101] pci 0000:03:00.1: reg 0x190: [mem 0x92000000-0x92003fff 64bit]
[ 17.241087] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x92000000-0x920fffff 64bit] (contains BAR3 for 64 VFs)
[ 17.252578] pci 0000:00:03.2: PCI bridge to [bus 03-04]
[ 17.258088] pci 0000:00:03.2: bridge window [mem 0x91f00000-0x922fffff]
[ 17.266086] pci 0000:00:03.2: bridge window [mem 0x91a00000-0x91efffff 64bit pref]
[ 17.274432] acpiphp: Slot [0] registered
[ 17.279134] pci 0000:00:03.3: PCI bridge to [bus 05]
[ 17.285193] pci 0000:00:11.0: PCI bridge to [bus 06]
[ 17.290190] pci 0000:00:1c.0: PCI bridge to [bus 07]
[ 17.296191] pci 0000:08:00.0: [102b:0522] type 00 class 0x030000
[ 17.303118] pci 0000:08:00.0: reg 0x10: [mem 0x90000000-0x90ffffff pref]
[ 17.310101] pci 0000:08:00.0: reg 0x14: [mem 0x91800000-0x91803fff]
[ 17.317104] pci 0000:08:00.0: reg 0x18: [mem 0x91000000-0x917fffff]
[ 17.324154] pci 0000:08:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 17.332106] pci 0000:08:00.0: BAR 0: assigned to efifb
[ 17.338363] pci 0000:00:1c.7: PCI bridge to [bus 08]
[ 17.343090] pci 0000:00:1c.7: bridge window [mem 0x91000000-0x918fffff]
[ 17.351089] pci 0000:00:1c.7: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 17.360119] pci_bus 0000:09: extended config space not accessible
[ 17.366166] pci 0000:00:1e.0: PCI bridge to [bus 09] (subtractive decode)
[ 17.374118] pci 0000:00:1e.0: bridge window [io 0x0000-0x0cf7 window] (subtractive decode)
[ 17.383084] pci 0000:00:1e.0: bridge window [io 0x1000-0x3fff window] (subtractive decode)
[ 17.393084] pci 0000:00:1e.0: bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[ 17.403088] pci 0000:00:1e.0: bridge window [mem 0x000c4000-0x000cbfff window] (subtractive decode)
[ 17.413090] pci 0000:00:1e.0: bridge window [mem 0x90000000-0xabffbfff window] (subtractive decode)
[ 17.424087] pci 0000:00:1e.0: bridge window [mem 0x380000000000-0x381fffffffff window] (subtractive decode)
[ 17.435768] ACPI: PCI: Interrupt link LNKA configured for IRQ 0
[ 17.442086] ACPI: PCI: Interrupt link LNKA disabled
[ 17.447173] ACPI: PCI: Interrupt link LNKB configured for IRQ 0
[ 17.454083] ACPI: PCI: Interrupt link LNKB disabled
[ 17.460304] ACPI: PCI: Interrupt link LNKC configured for IRQ 0
[ 17.466092] ACPI: PCI: Interrupt link LNKC disabled
[ 17.472167] ACPI: PCI: Interrupt link LNKD configured for IRQ 0
[ 17.478083] ACPI: PCI: Interrupt link LNKD disabled
[ 17.484167] ACPI: PCI: Interrupt link LNKE configured for IRQ 0
[ 17.491083] ACPI: PCI: Interrupt link LNKE disabled
[ 17.496160] ACPI: PCI: Interrupt link LNKF configured for IRQ 0
[ 17.503083] ACPI: PCI: Interrupt link LNKF disabled
[ 17.508158] ACPI: PCI: Interrupt link LNKG configured for IRQ 0
[ 17.515083] ACPI: PCI: Interrupt link LNKG disabled
[ 17.520159] ACPI: PCI: Interrupt link LNKH configured for IRQ 0
[ 17.527086] ACPI: PCI: Interrupt link LNKH disabled
[ 17.532849] ACPI: PCI Root Bridge [IIO1] (domain 0000 [bus 40-7e])
[ 17.540095] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 17.550823] acpi PNP0A08:01: _OSC: platform does not support [SHPCHotplug LTR DPC]
[ 17.561431] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[ 17.570088] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[ 17.579840] PCI host bridge to bus 0000:40
[ 17.584089] pci_bus 0000:40: root bus resource [io 0x4000-0x7fff window]
[ 17.592084] pci_bus 0000:40: root bus resource [mem 0xac000000-0xc7ffbfff window]
[ 17.600091] pci_bus 0000:40: root bus resource [mem 0x382000000000-0x383fffffffff window]
[ 17.609088] pci_bus 0000:40: root bus resource [bus 40-7e]
[ 17.615135] pci 0000:40:02.0: [8086:6f04] type 01 class 0x060400
[ 17.622181] pci 0000:40:02.0: PME# supported from D0 D3hot D3cold
[ 17.629365] pci 0000:40:02.2: [8086:6f06] type 01 class 0x060400
[ 17.636183] pci 0000:40:02.2: PME# supported from D0 D3hot D3cold
[ 17.643363] pci 0000:40:03.0: [8086:6f08] type 01 class 0x060400
[ 17.650122] pci 0000:40:03.0: enabling Extended Tags
[ 17.655146] pci 0000:40:03.0: PME# supported from D0 D3hot D3cold
[ 17.662366] pci 0000:40:04.0: [8086:6f20] type 00 class 0x088000
[ 17.669097] pci 0000:40:04.0: reg 0x10: [mem 0x383ffff1c000-0x383ffff1ffff 64bit]
[ 17.677316] pci 0000:40:04.1: [8086:6f21] type 00 class 0x088000
[ 17.684097] pci 0000:40:04.1: reg 0x10: [mem 0x383ffff18000-0x383ffff1bfff 64bit]
[ 17.693337] pci 0000:40:04.2: [8086:6f22] type 00 class 0x088000
[ 17.700096] pci 0000:40:04.2: reg 0x10: [mem 0x383ffff14000-0x383ffff17fff 64bit]
[ 17.708307] pci 0000:40:04.3: [8086:6f23] type 00 class 0x088000
[ 17.715097] pci 0000:40:04.3: reg 0x10: [mem 0x383ffff10000-0x383ffff13fff 64bit]
[ 17.723230] pci 0000:40:04.4: [8086:6f24] type 00 class 0x088000
[ 17.730097] pci 0000:40:04.4: reg 0x10: [mem 0x383ffff0c000-0x383ffff0ffff 64bit]
[ 17.738305] pci 0000:40:04.5: [8086:6f25] type 00 class 0x088000
[ 17.745096] pci 0000:40:04.5: reg 0x10: [mem 0x383ffff08000-0x383ffff0bfff 64bit]
[ 17.754304] pci 0000:40:04.6: [8086:6f26] type 00 class 0x088000
[ 17.761096] pci 0000:40:04.6: reg 0x10: [mem 0x383ffff04000-0x383ffff07fff 64bit]
[ 17.769299] pci 0000:40:04.7: [8086:6f27] type 00 class 0x088000
[ 17.776096] pci 0000:40:04.7: reg 0x10: [mem 0x383ffff00000-0x383ffff03fff 64bit]
[ 17.784301] pci 0000:40:05.0: [8086:6f28] type 00 class 0x088000
[ 17.791316] pci 0000:40:05.1: [8086:6f29] type 00 class 0x088000
[ 17.798307] pci 0000:40:05.2: [8086:6f2a] type 00 class 0x088000
[ 17.805251] pci 0000:40:05.4: [8086:6f2c] type 00 class 0x080020
[ 17.812093] pci 0000:40:05.4: reg 0x10: [mem 0xac000000-0xac000fff]
[ 17.819449] pci 0000:40:02.0: PCI bridge to [bus 41]
[ 17.825382] pci 0000:40:02.2: PCI bridge to [bus 42]
[ 17.831387] acpiphp: Slot [6] registered
[ 17.835123] pci 0000:40:03.0: PCI bridge to [bus 43]
[ 17.841597] ACPI: PCI Root Bridge [IIO2] (domain 0000 [bus 80-be])
[ 17.848091] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 17.859796] acpi PNP0A08:02: _OSC: platform does not support [SHPCHotplug LTR DPC]
[ 17.869726] acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[ 17.878091] acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration
[ 17.887880] PCI host bridge to bus 0000:80
[ 17.893086] pci_bus 0000:80: root bus resource [io 0x8000-0xbfff window]
[ 17.900083] pci_bus 0000:80: root bus resource [mem 0xc8000000-0xe3ffbfff window]
[ 17.909084] pci_bus 0000:80: root bus resource [mem 0x384000000000-0x385fffffffff window]
[ 17.918085] pci_bus 0000:80: root bus resource [bus 80-be]
[ 17.924129] pci 0000:80:02.0: [8086:6f04] type 01 class 0x060400
[ 17.930189] pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
[ 17.937413] pci 0000:80:02.2: [8086:6f06] type 01 class 0x060400
[ 17.944188] pci 0000:80:02.2: PME# supported from D0 D3hot D3cold
[ 17.951412] pci 0000:80:03.0: [8086:6f08] type 01 class 0x060400
[ 17.958121] pci 0000:80:03.0: enabling Extended Tags
[ 17.964148] pci 0000:80:03.0: PME# supported from D0 D3hot D3cold
[ 17.971396] pci 0000:80:04.0: [8086:6f20] type 00 class 0x088000
[ 17.978098] pci 0000:80:04.0: reg 0x10: [mem 0x385ffff1c000-0x385ffff1ffff 64bit]
[ 17.986327] pci 0000:80:04.1: [8086:6f21] type 00 class 0x088000
[ 17.993097] pci 0000:80:04.1: reg 0x10: [mem 0x385ffff18000-0x385ffff1bfff 64bit]
[ 18.001294] pci 0000:80:04.2: [8086:6f22] type 00 class 0x088000
[ 18.008098] pci 0000:80:04.2: reg 0x10: [mem 0x385ffff14000-0x385ffff17fff 64bit]
[ 18.017303] pci 0000:80:04.3: [8086:6f23] type 00 class 0x088000
[ 18.024101] pci 0000:80:04.3: reg 0x10: [mem 0x385ffff10000-0x385ffff13fff 64bit]
[ 18.032332] pci 0000:80:04.4: [8086:6f24] type 00 class 0x088000
[ 18.039097] pci 0000:80:04.4: reg 0x10: [mem 0x385ffff0c000-0x385ffff0ffff 64bit]
[ 18.047314] pci 0000:80:04.5: [8086:6f25] type 00 class 0x088000
[ 18.054100] pci 0000:80:04.5: reg 0x10: [mem 0x385ffff08000-0x385ffff0bfff 64bit]
[ 18.063318] pci 0000:80:04.6: [8086:6f26] type 00 class 0x088000
[ 18.069104] pci 0000:80:04.6: reg 0x10: [mem 0x385ffff04000-0x385ffff07fff 64bit]
[ 18.078347] pci 0000:80:04.7: [8086:6f27] type 00 class 0x088000
[ 18.085097] pci 0000:80:04.7: reg 0x10: [mem 0x385ffff00000-0x385ffff03fff 64bit]
[ 18.093321] pci 0000:80:05.0: [8086:6f28] type 00 class 0x088000
[ 18.100293] pci 0000:80:05.1: [8086:6f29] type 00 class 0x088000
[ 18.107337] pci 0000:80:05.2: [8086:6f2a] type 00 class 0x088000
[ 18.114275] pci 0000:80:05.4: [8086:6f2c] type 00 class 0x080020
[ 18.121095] pci 0000:80:05.4: reg 0x10: [mem 0xc8000000-0xc8000fff]
[ 18.128632] acpiphp: Slot [4] registered
[ 18.133136] pci 0000:80:02.0: PCI bridge to [bus 81]
[ 18.138389] acpiphp: Slot [3] registered
[ 18.143124] pci 0000:80:02.2: PCI bridge to [bus 82]
[ 18.148419] acpiphp: Slot [9] registered
[ 18.153121] pci 0000:80:03.0: PCI bridge to [bus 83]
[ 18.159610] ACPI: PCI Root Bridge [IIO3] (domain 0000 [bus c0-fe])
[ 18.166096] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3]
[ 18.177820] acpi PNP0A08:03: _OSC: platform does not support [SHPCHotplug LTR DPC]
[ 18.187433] acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[ 18.196086] acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration
[ 18.205843] PCI host bridge to bus 0000:c0
[ 18.210086] pci_bus 0000:c0: root bus resource [io 0xc000-0xffff window]
[ 18.218087] pci_bus 0000:c0: root bus resource [mem 0xe4000000-0xfbffbfff window]
[ 18.226094] pci_bus 0000:c0: root bus resource [mem 0x386000000000-0x387fffffffff window]
[ 18.235090] pci_bus 0000:c0: root bus resource [bus c0-fe]
[ 18.242131] pci 0000:c0:02.0: [8086:6f04] type 01 class 0x060400
[ 18.248187] pci 0000:c0:02.0: PME# supported from D0 D3hot D3cold
[ 18.255370] pci 0000:c0:02.2: [8086:6f06] type 01 class 0x060400
[ 18.262190] pci 0000:c0:02.2: PME# supported from D0 D3hot D3cold
[ 18.269385] pci 0000:c0:03.0: [8086:6f08] type 01 class 0x060400
[ 18.276119] pci 0000:c0:03.0: enabling Extended Tags
[ 18.282143] pci 0000:c0:03.0: PME# supported from D0 D3hot D3cold
[ 18.288403] pci 0000:c0:04.0: [8086:6f20] type 00 class 0x088000
[ 18.295099] pci 0000:c0:04.0: reg 0x10: [mem 0x387ffff1c000-0x387ffff1ffff 64bit]
[ 18.304336] pci 0000:c0:04.1: [8086:6f21] type 00 class 0x088000
[ 18.311099] pci 0000:c0:04.1: reg 0x10: [mem 0x387ffff18000-0x387ffff1bfff 64bit]
[ 18.319312] pci 0000:c0:04.2: [8086:6f22] type 00 class 0x088000
[ 18.326099] pci 0000:c0:04.2: reg 0x10: [mem 0x387ffff14000-0x387ffff17fff 64bit]
[ 18.334338] pci 0000:c0:04.3: [8086:6f23] type 00 class 0x088000
[ 18.341097] pci 0000:c0:04.3: reg 0x10: [mem 0x387ffff10000-0x387ffff13fff 64bit]
[ 18.350326] pci 0000:c0:04.4: [8086:6f24] type 00 class 0x088000
[ 18.357097] pci 0000:c0:04.4: reg 0x10: [mem 0x387ffff0c000-0x387ffff0ffff 64bit]
[ 18.365357] pci 0000:c0:04.5: [8086:6f25] type 00 class 0x088000
[ 18.372104] pci 0000:c0:04.5: reg 0x10: [mem 0x387ffff08000-0x387ffff0bfff 64bit]
[ 18.380339] pci 0000:c0:04.6: [8086:6f26] type 00 class 0x088000
[ 18.387098] pci 0000:c0:04.6: reg 0x10: [mem 0x387ffff04000-0x387ffff07fff 64bit]
[ 18.396327] pci 0000:c0:04.7: [8086:6f27] type 00 class 0x088000
[ 18.402097] pci 0000:c0:04.7: reg 0x10: [mem 0x387ffff00000-0x387ffff03fff 64bit]
[ 18.411316] pci 0000:c0:05.0: [8086:6f28] type 00 class 0x088000
[ 18.418320] pci 0000:c0:05.1: [8086:6f29] type 00 class 0x088000
[ 18.425341] pci 0000:c0:05.2: [8086:6f2a] type 00 class 0x088000
[ 18.432264] pci 0000:c0:05.4: [8086:6f2c] type 00 class 0x080020
[ 18.438095] pci 0000:c0:05.4: reg 0x10: [mem 0xe4000000-0xe4000fff]
[ 18.446245] pci 0000:c0:02.0: PCI bridge to [bus c1]
[ 18.452400] pci 0000:c0:02.2: PCI bridge to [bus c2]
[ 18.458369] acpiphp: Slot [11] registered
[ 18.462129] pci 0000:c0:03.0: PCI bridge to [bus c3]
[ 18.469645] iommu: Default domain type: Translated
[ 18.475088] iommu: DMA domain TLB invalidation policy: lazy mode
[ 18.482883] SCSI subsystem initialized
[ 18.487277] ACPI: bus type USB registered
[ 18.491112] usbcore: registered new interface driver usbfs
[ 18.498099] usbcore: registered new interface driver hub
[ 18.503282] usbcore: registered new device driver usb
[ 18.509197] pps_core: LinuxPPS API ver. 1 registered
[ 18.515083] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 18.525150] PTP clock support registered
[ 18.530530] EDAC MC: Ver: 3.0.0
[ 18.535207] Registered efivars operations
[ 18.541099] NetLabel: Initializing
[ 18.545089] NetLabel: domain hash size = 128
[ 18.550082] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 18.556132] NetLabel: unlabeled traffic allowed by default
[ 18.562092] PCI: Using ACPI for IRQ routing
[ 18.574237] pci 0000:08:00.0: vgaarb: setting as boot VGA device
[ 18.575077] pci 0000:08:00.0: vgaarb: bridge control possible
[ 18.586131] pci 0000:08:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
[ 18.596102] vgaarb: loaded
[ 18.599279] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[ 18.607086] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[ 18.616313] clocksource: Switched to clocksource tsc-early
[ 18.623512] VFS: Disk quotas dquot_6.6.0
[ 18.628143] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 18.636204] pnp: PnP ACPI init
[ 18.642040] system 00:01: [io 0x0500-0x053f] has been reserved
[ 18.648671] system 00:01: [io 0x0400-0x047f] has been reserved
[ 18.655290] system 00:01: [io 0x0540-0x057f] has been reserved
[ 18.661896] system 00:01: [io 0x0600-0x061f] has been reserved
[ 18.668512] system 00:01: [io 0x0ca0-0x0ca5] could not be reserved
[ 18.675522] system 00:01: [io 0x0880-0x0883] has been reserved
[ 18.682142] system 00:01: [io 0x0800-0x081f] has been reserved
[ 18.688762] system 00:01: [mem 0xfed1c000-0xfed3ffff] could not be reserved
[ 18.696548] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved
[ 18.703943] system 00:01: [mem 0xff000000-0xffffffff] has been reserved
[ 18.711342] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved
[ 18.718738] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved
[ 18.726133] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved
[ 18.733531] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved
[ 18.742283] pnp: PnP ACPI: found 5 devices
[ 18.755409] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 18.765854] NET: Registered PF_INET protocol family
[ 18.773020] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc)
[ 18.787626] tcp_listen_portaddr_hash hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc)
[ 18.797932] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, vmalloc)
[ 18.806929] TCP established hash table entries: 524288 (order: 10, 4194304 bytes, vmalloc)
[ 18.817626] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[ 18.826722] TCP: Hash tables configured (established 524288 bind 65536)
[ 18.836221] MPTCP token hash table entries: 65536 (order: 8, 1572864 bytes, vmalloc)
[ 18.845289] UDP hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[ 18.853841] UDP-Lite hash table entries: 65536 (order: 9, 2097152 bytes, vmalloc)
[ 18.863638] NET: Registered PF_UNIX/PF_LOCAL protocol family
[ 18.869999] NET: Registered PF_XDP protocol family
[ 18.875502] pci 0000:01:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window
[ 18.886591] pci 0000:03:00.0: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window
[ 18.897669] pci 0000:03:00.1: can't claim BAR 6 [mem 0xfff80000-0xffffffff pref]: no compatible bridge window
[ 18.908753] pci 0000:08:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 18.920115] pci 0000:01:00.0: BAR 6: no space for [mem size 0x00100000 pref]
[ 18.927987] pci 0000:01:00.0: BAR 6: failed to assign [mem size 0x00100000 pref]
[ 18.936253] pci 0000:00:02.0: PCI bridge to [bus 01]
[ 18.941791] pci 0000:00:02.0: bridge window [io 0x1000-0x1fff]
[ 18.948602] pci 0000:00:02.0: bridge window [mem 0x92300000-0x923fffff]
[ 18.956194] pci 0000:00:03.0: PCI bridge to [bus 02]
[ 18.961747] pci 0000:03:00.0: BAR 6: assigned [mem 0x91e80000-0x91efffff pref]
[ 18.969816] pci 0000:03:00.1: BAR 6: no space for [mem size 0x00080000 pref]
[ 18.977693] pci 0000:03:00.1: BAR 6: failed to assign [mem size 0x00080000 pref]
[ 18.985962] pci 0000:00:03.2: PCI bridge to [bus 03-04]
[ 18.991799] pci 0000:00:03.2: bridge window [mem 0x91f00000-0x922fffff]
[ 18.999383] pci 0000:00:03.2: bridge window [mem 0x91a00000-0x91efffff 64bit pref]
[ 19.008039] pci 0000:00:03.3: PCI bridge to [bus 05]
[ 19.013593] pci 0000:00:11.0: PCI bridge to [bus 06]
[ 19.019153] pci 0000:00:1c.0: PCI bridge to [bus 07]
[ 19.024705] pci 0000:08:00.0: BAR 6: assigned [mem 0x91810000-0x9181ffff pref]
[ 19.032773] pci 0000:00:1c.7: PCI bridge to [bus 08]
[ 19.038322] pci 0000:00:1c.7: bridge window [mem 0x91000000-0x918fffff]
[ 19.045906] pci 0000:00:1c.7: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 19.054562] pci 0000:00:1e.0: PCI bridge to [bus 09]
[ 19.060122] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
[ 19.067036] pci_bus 0000:00: resource 5 [io 0x1000-0x3fff window]
[ 19.073941] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[ 19.081623] pci_bus 0000:00: resource 7 [mem 0x000c4000-0x000cbfff window]
[ 19.089306] pci_bus 0000:00: resource 8 [mem 0x90000000-0xabffbfff window]
[ 19.096986] pci_bus 0000:00: resource 9 [mem 0x380000000000-0x381fffffffff window]
[ 19.105448] pci_bus 0000:01: resource 0 [io 0x1000-0x1fff]
[ 19.111681] pci_bus 0000:01: resource 1 [mem 0x92300000-0x923fffff]
[ 19.118688] pci_bus 0000:03: resource 1 [mem 0x91f00000-0x922fffff]
[ 19.125691] pci_bus 0000:03: resource 2 [mem 0x91a00000-0x91efffff 64bit pref]
[ 19.133765] pci_bus 0000:08: resource 1 [mem 0x91000000-0x918fffff]
[ 19.140767] pci_bus 0000:08: resource 2 [mem 0x90000000-0x90ffffff 64bit pref]
[ 19.148846] pci_bus 0000:09: resource 4 [io 0x0000-0x0cf7 window]
[ 19.155751] pci_bus 0000:09: resource 5 [io 0x1000-0x3fff window]
[ 19.162663] pci_bus 0000:09: resource 6 [mem 0x000a0000-0x000bffff window]
[ 19.170350] pci_bus 0000:09: resource 7 [mem 0x000c4000-0x000cbfff window]
[ 19.178036] pci_bus 0000:09: resource 8 [mem 0x90000000-0xabffbfff window]
[ 19.185727] pci_bus 0000:09: resource 9 [mem 0x380000000000-0x381fffffffff window]
[ 19.194437] pci 0000:40:02.0: bridge window [io 0x1000-0x0fff] to [bus 41] add_size 1000
[ 19.203623] pci 0000:40:02.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 41] add_size 200000 add_align 100000
[ 19.216450] pci 0000:40:02.0: bridge window [mem 0x00100000-0x000fffff] to [bus 41] add_size 200000 add_align 100000
[ 19.228209] pci 0000:40:02.2: bridge window [io 0x1000-0x0fff] to [bus 42] add_size 1000
[ 19.237351] pci 0000:40:02.2: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 42] add_size 200000 add_align 100000
[ 19.250178] pci 0000:40:02.2: bridge window [mem 0x00100000-0x000fffff] to [bus 42] add_size 200000 add_align 100000
[ 19.261960] pci 0000:40:02.0: BAR 14: assigned [mem 0xac100000-0xac2fffff]
[ 19.269648] pci 0000:40:02.0: BAR 15: assigned [mem 0x382000000000-0x3820001fffff 64bit pref]
[ 19.279175] pci 0000:40:02.2: BAR 14: assigned [mem 0xac300000-0xac4fffff]
[ 19.286861] pci 0000:40:02.2: BAR 15: assigned [mem 0x382000200000-0x3820003fffff 64bit pref]
[ 19.296387] pci 0000:40:02.0: BAR 13: assigned [io 0x4000-0x4fff]
[ 19.303298] pci 0000:40:02.2: BAR 13: assigned [io 0x5000-0x5fff]
[ 19.310209] pci 0000:40:02.0: PCI bridge to [bus 41]
[ 19.315758] pci 0000:40:02.0: bridge window [io 0x4000-0x4fff]
[ 19.322569] pci 0000:40:02.0: bridge window [mem 0xac100000-0xac2fffff]
[ 19.330160] pci 0000:40:02.0: bridge window [mem 0x382000000000-0x3820001fffff 64bit pref]
[ 19.339592] pci 0000:40:02.2: PCI bridge to [bus 42]
[ 19.345145] pci 0000:40:02.2: bridge window [io 0x5000-0x5fff]
[ 19.351960] pci 0000:40:02.2: bridge window [mem 0xac300000-0xac4fffff]
[ 19.359547] pci 0000:40:02.2: bridge window [mem 0x382000200000-0x3820003fffff 64bit pref]
[ 19.368976] pci 0000:40:03.0: PCI bridge to [bus 43]
[ 19.374539] pci_bus 0000:40: resource 4 [io 0x4000-0x7fff window]
[ 19.381459] pci_bus 0000:40: resource 5 [mem 0xac000000-0xc7ffbfff window]
[ 19.389148] pci_bus 0000:40: resource 6 [mem 0x382000000000-0x383fffffffff window]
[ 19.397612] pci_bus 0000:41: resource 0 [io 0x4000-0x4fff]
[ 19.403842] pci_bus 0000:41: resource 1 [mem 0xac100000-0xac2fffff]
[ 19.410834] pci_bus 0000:41: resource 2 [mem 0x382000000000-0x3820001fffff 64bit pref]
[ 19.419682] pci_bus 0000:42: resource 0 [io 0x5000-0x5fff]
[ 19.425910] pci_bus 0000:42: resource 1 [mem 0xac300000-0xac4fffff]
[ 19.432920] pci_bus 0000:42: resource 2 [mem 0x382000200000-0x3820003fffff 64bit pref]
[ 19.441977] ACPI: \_SB_.IIO1.AID1: IOxAPIC at (null), GSI 48
[ 19.448481] pci 0000:80:02.0: PCI bridge to [bus 81]
[ 19.454043] pci 0000:80:02.2: PCI bridge to [bus 82]
[ 19.459599] pci 0000:80:03.0: PCI bridge to [bus 83]
[ 19.465160] pci_bus 0000:80: resource 4 [io 0x8000-0xbfff window]
[ 19.472070] pci_bus 0000:80: resource 5 [mem 0xc8000000-0xe3ffbfff window]
[ 19.479755] pci_bus 0000:80: resource 6 [mem 0x384000000000-0x385fffffffff window]
[ 19.488247] ACPI: \_SB_.IIO2.AID2: IOxAPIC at (null), GSI 72
[ 19.494710] pci 0000:c0:02.0: bridge window [io 0x1000-0x0fff] to [bus c1] add_size 1000
[ 19.503852] pci 0000:c0:02.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus c1] add_size 200000 add_align 100000
[ 19.516680] pci 0000:c0:02.0: bridge window [mem 0x00100000-0x000fffff] to [bus c1] add_size 200000 add_align 100000
[ 19.528442] pci 0000:c0:02.2: bridge window [io 0x1000-0x0fff] to [bus c2] add_size 1000
[ 19.537582] pci 0000:c0:02.2: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus c2] add_size 200000 add_align 100000
[ 19.550406] pci 0000:c0:02.2: bridge window [mem 0x00100000-0x000fffff] to [bus c2] add_size 200000 add_align 100000
[ 19.562177] pci 0000:c0:02.0: BAR 14: assigned [mem 0xe4100000-0xe42fffff]
[ 19.569865] pci 0000:c0:02.0: BAR 15: assigned [mem 0x386000000000-0x3860001fffff 64bit pref]
[ 19.579397] pci 0000:c0:02.2: BAR 14: assigned [mem 0xe4300000-0xe44fffff]
[ 19.587081] pci 0000:c0:02.2: BAR 15: assigned [mem 0x386000200000-0x3860003fffff 64bit pref]
[ 19.596611] pci 0000:c0:02.0: BAR 13: assigned [io 0xc000-0xcfff]
[ 19.603519] pci 0000:c0:02.2: BAR 13: assigned [io 0xd000-0xdfff]
[ 19.610427] pci 0000:c0:02.0: PCI bridge to [bus c1]
[ 19.615976] pci 0000:c0:02.0: bridge window [io 0xc000-0xcfff]
[ 19.622790] pci 0000:c0:02.0: bridge window [mem 0xe4100000-0xe42fffff]
[ 19.630378] pci 0000:c0:02.0: bridge window [mem 0x386000000000-0x3860001fffff 64bit pref]
[ 19.639815] pci 0000:c0:02.2: PCI bridge to [bus c2]
[ 19.645368] pci 0000:c0:02.2: bridge window [io 0xd000-0xdfff]
[ 19.652180] pci 0000:c0:02.2: bridge window [mem 0xe4300000-0xe44fffff]
[ 19.659767] pci 0000:c0:02.2: bridge window [mem 0x386000200000-0x3860003fffff 64bit pref]
[ 19.669194] pci 0000:c0:03.0: PCI bridge to [bus c3]
[ 19.674756] pci_bus 0000:c0: resource 4 [io 0xc000-0xffff window]
[ 19.681664] pci_bus 0000:c0: resource 5 [mem 0xe4000000-0xfbffbfff window]
[ 19.689348] pci_bus 0000:c0: resource 6 [mem 0x386000000000-0x387fffffffff window]
[ 19.697808] pci_bus 0000:c1: resource 0 [io 0xc000-0xcfff]
[ 19.704036] pci_bus 0000:c1: resource 1 [mem 0xe4100000-0xe42fffff]
[ 19.711041] pci_bus 0000:c1: resource 2 [mem 0x386000000000-0x3860001fffff 64bit pref]
[ 19.719889] pci_bus 0000:c2: resource 0 [io 0xd000-0xdfff]
[ 19.726117] pci_bus 0000:c2: resource 1 [mem 0xe4300000-0xe44fffff]
[ 19.733120] pci_bus 0000:c2: resource 2 [mem 0x386000200000-0x3860003fffff 64bit pref]
[ 19.742004] ACPI: \_SB_.IIO3.AID3: IOxAPIC at (null), GSI 96
[ 19.749648] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28]
[ 19.758316] pci 0000:40:05.0: disabled boot interrupts on device [8086:6f28]
[ 19.766251] pci 0000:80:05.0: disabled boot interrupts on device [8086:6f28]
[ 19.774186] pci 0000:c0:05.0: disabled boot interrupts on device [8086:6f28]
[ 19.782087] PCI: CLS 32 bytes, default 64
[ 19.786589] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 19.786656] Trying to unpack rootfs image as initramfs...
[ 19.793783] software IO TLB: mapped [mem 0x0000000075b89000-0x0000000079b89000] (64MB)
[ 19.847598] Initialise system trusted keyrings
[ 19.852612] Key type blacklist registered
[ 19.857344] workingset: timestamp_bits=36 max_order=27 bucket_order=0
[ 19.864587] zbud: loaded
[ 19.870510] integrity: Platform Keyring initialized
[ 19.898856] NET: Registered PF_ALG protocol family
[ 19.904218] xor: automatically using best checksumming function avx
[ 19.912096] Key type asymmetric registered
[ 19.916673] Asymmetric key parser 'x509' registered
[ 20.757480] Freeing initrd memory: 31004K
[ 20.771771] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 245)
[ 20.780305] io scheduler mq-deadline registered
[ 20.785370] io scheduler kyber registered
[ 20.789991] io scheduler bfq registered
[ 20.800383] atomic64_test: passed for x86-64 platform with CX8 and with SSE
[ 20.809424] pcieport 0000:00:02.0: PME: Signaling with IRQ 25
[ 20.815991] pcieport 0000:00:02.0: AER: enabled with IRQ 25
[ 20.822595] pcieport 0000:00:03.0: PME: Signaling with IRQ 26
[ 20.825107] tsc: Refined TSC clocksource calibration: 2194.711 MHz
[ 20.829162] pcieport 0000:00:03.0: AER: enabled with IRQ 26
[ 20.836048] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1fa2ae85276, max_idle_ns: 440795242984 ns
[ 20.842510] pcieport 0000:00:03.2: PME: Signaling with IRQ 27
[ 20.859899] clocksource: Switched to clocksource tsc
[ 20.860037] pcieport 0000:00:03.2: AER: enabled with IRQ 27
[ 20.871939] pcieport 0000:00:03.3: PME: Signaling with IRQ 28
[ 20.878454] pcieport 0000:00:03.3: AER: enabled with IRQ 28
[ 20.885006] pcieport 0000:00:11.0: PME: Signaling with IRQ 29
[ 20.891564] pcieport 0000:00:11.0: AER: enabled with IRQ 29
[ 20.898071] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30
[ 20.904738] pcieport 0000:00:1c.7: PME: Signaling with IRQ 31
[ 20.911651] pcieport 0000:40:02.0: PME: Signaling with IRQ 33
[ 20.918268] pcieport 0000:40:02.0: AER: enabled with IRQ 33
[ 20.924558] pcieport 0000:40:02.0: pciehp: Slot #5 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise- Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[ 20.942527] pcieport 0000:40:02.2: PME: Signaling with IRQ 34
[ 20.949095] pcieport 0000:40:02.2: AER: enabled with IRQ 34
[ 20.955371] pcieport 0000:40:02.2: pciehp: Slot #7 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise- Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[ 20.973320] pcieport 0000:40:03.0: PME: Signaling with IRQ 35
[ 20.979866] pcieport 0000:40:03.0: AER: enabled with IRQ 35
[ 20.986693] pcieport 0000:80:02.0: PME: Signaling with IRQ 37
[ 20.993324] pcieport 0000:80:02.0: AER: enabled with IRQ 37
[ 20.999909] pcieport 0000:80:02.2: PME: Signaling with IRQ 38
[ 21.006467] pcieport 0000:80:02.2: AER: enabled with IRQ 38
[ 21.013017] pcieport 0000:80:03.0: PME: Signaling with IRQ 39
[ 21.019595] pcieport 0000:80:03.0: AER: enabled with IRQ 39
[ 21.026379] pcieport 0000:c0:02.0: PME: Signaling with IRQ 41
[ 21.032989] pcieport 0000:c0:02.0: AER: enabled with IRQ 41
[ 21.039275] pcieport 0000:c0:02.0: pciehp: Slot #12 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise- Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[ 21.057362] pcieport 0000:c0:02.2: PME: Signaling with IRQ 42
[ 21.063949] pcieport 0000:c0:02.2: AER: enabled with IRQ 42
[ 21.070226] pcieport 0000:c0:02.2: pciehp: Slot #10 AttnBtn+ PwrCtrl+ MRL- AttnInd+ PwrInd+ HotPlug+ Surprise- Interlock- NoCompl- IbPresDis- LLActRep+ (with Cmd Compl erratum)
[ 21.088292] pcieport 0000:c0:03.0: PME: Signaling with IRQ 43
[ 21.094873] pcieport 0000:c0:03.0: AER: enabled with IRQ 43
[ 21.102634] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 21.110613] ACPI: \_SB_.SCK0.CP00: Found 2 idle states
[ 21.142822] input: Sleep Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0E:00/input/input0
[ 21.152401] ACPI: button: Sleep Button [SLPB]
[ 21.157373] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1
[ 21.165723] ACPI: button: Power Button [PWRF]
[ 21.217481] ERST: Error Record Serialization Table (ERST) support is initialized.
[ 21.225862] pstore: Registered erst as persistent store backend
[ 21.233366] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 21.240600] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 21.250111] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[ 21.264416] Non-volatile memory driver v1.3
[ 21.269125] Linux agpgart interface v0.103
[ 21.282628] tpm_tis 00:04: 1.2 TPM (device-id 0x0, rev-id 78)
[ 21.301209] tpm tpm0: [Hardware Error]: Adjusting reported durations.
[ 21.326993] tpm tpm0: TPM is disabled/deactivated (0x6)
[ 21.332864] tpm tpm0: tpm_read_log_acpi: TCPA log area empty
[ 21.395953] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x10 impl SATA mode
[ 21.405117] ahci 0000:00:1f.2: flags: 64bit ncq sntf pm led clo pio slum part ems apst
[ 21.415473] scsi host0: ahci
[ 21.419413] scsi host1: ahci
[ 21.423210] scsi host2: ahci
[ 21.426978] scsi host3: ahci
[ 21.430712] scsi host4: ahci
[ 21.434430] scsi host5: ahci
[ 21.437848] ata1: DUMMY
[ 21.440592] ata2: DUMMY
[ 21.443335] ata3: DUMMY
[ 21.446073] ata4: DUMMY
[ 21.448814] ata5: SATA max UDMA/133 abar m2048@0x92400000 port 0x92400300 irq 44
[ 21.457085] ata6: DUMMY
[ 21.462487] usbcore: registered new interface driver usbserial_generic
[ 21.463062] ehci-pci 0000:00:1a.0: EHCI Host Controller
[ 21.469799] usbserial: USB Serial support registered for generic
[ 21.475837] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[ 21.482452] i8042: PNP: No PS/2 controller found.
[ 21.490644] ehci-pci 0000:00:1a.0: debug port 2
[ 21.496053] mousedev: PS/2 mouse device common for all mice
[ 21.504925] ehci-pci 0000:00:1a.0: irq 16, io mem 0x92402000
[ 21.507678] rtc_cmos 00:00: RTC can wake from S4
[ 21.519271] rtc_cmos 00:00: registered as rtc0
[ 21.520154] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[ 21.524379] rtc_cmos 00:00: setting system clock to 2023-01-05T17:32:05 UTC (1672939925)
[ 21.530799] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.02
[ 21.539787] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram
[ 21.548941] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 21.564527] usb usb1: Product: EHCI Host Controller
[ 21.569988] usb usb1: Manufacturer: Linux 6.2.0-rc2+ ehci_hcd
[ 21.576417] usb usb1: SerialNumber: 0000:00:1a.0
[ 21.581917] hub 1-0:1.0: USB hub found
[ 21.586202] hub 1-0:1.0: 2 ports detected
[ 21.591394] ehci-pci 0000:00:1d.0: EHCI Host Controller
[ 21.594274] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.
[ 21.597371] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[ 21.611032] device-mapper: uevent: version 1.0.3
[ 21.619134] ehci-pci 0000:00:1d.0: debug port 2
[ 21.624714] device-mapper: ioctl: 4.47.0-ioctl (2022-07-28) initialised: dm-devel@redhat.com
[ 21.633321] ehci-pci 0000:00:1d.0: irq 23, io mem 0x92401000
[ 21.639261] intel_pstate: Intel P-state driver initializing
[ 21.651156] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[ 21.657880] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 6.02
[ 21.667146] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 21.675234] usb usb2: Product: EHCI Host Controller
[ 21.680696] usb usb2: Manufacturer: Linux 6.2.0-rc2+ ehci_hcd
[ 21.687127] usb usb2: SerialNumber: 0000:00:1d.0
[ 21.692676] hub 2-0:1.0: USB hub found
[ 21.696922] hub 2-0:1.0: 2 ports detected
[ 21.767371] ata5: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[ 21.776141] ata5.00: ATAPI: TEAC DV-W28S-W, 1.0A, max UDMA/100
[ 21.785039] ata5.00: configured for UDMA/100
[ 21.791265] scsi 4:0:0:0: CD-ROM TEAC DV-W28S-W 1.0A PQ: 0 ANSI: 5
[ 21.792708] efifb: probing for efifb
[ 21.804365] efifb: No BGRT, not showing boot graphics
[ 21.810005] efifb: framebuffer at 0x90000000, using 5120k, total 5120k
[ 21.817305] efifb: mode is 1280x1024x32, linelength=5120, pages=1
[ 21.824104] efifb: scrolling: redraw
[ 21.827166] usb 1-1: new high-speed USB device number 2 using ehci-pci
[ 21.828100] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[ 21.841781] Console: switching to colour frame buffer device 160x64
[ 21.885720] fb0: EFI VGA frame buffer device
[ 21.890752] hid: raw HID events driver (C) Jiri Kosina
[ 21.896818] usbcore: registered new interface driver usbhid
[ 21.903262] usbhid: USB HID core driver
[ 21.908553] drop_monitor: Initializing network drop monitor service
[ 21.911229] sr 4:0:0:0: [sr0] scsi3-mmc drive: 24x/24x writer dvd-ram cd/rw xa/form2 cdda tray
[ 21.915782] Initializing XFRM netlink socket
[ 21.925189] cdrom: Uniform CD-ROM driver Revision: 3.20
[ 21.930319] NET: Registered PF_INET6 protocol family
[ 21.939148] usb 2-1: new high-speed USB device number 2 using ehci-pci
[ 21.951802] Segment Routing with IPv6
[ 21.956057] RPL Segment Routing with IPv6
[ 21.960704] In-situ OAM (IOAM) with IPv6
[ 21.965305] mip6: Mobile IPv6
[ 21.968742] NET: Registered PF_PACKET protocol family
[ 21.973603] usb 1-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[ 21.984070] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 21.992782] hub 1-1:1.0: USB hub found
[ 21.997187] hub 1-1:1.0: 6 ports detected
[ 22.001996] sr 4:0:0:0: Attached scsi generic sg0 type 5
[ 22.022590] microcode: Microcode Update Driver: v2.2.
[ 22.033837] resctrl: L3 allocation detected
[ 22.044547] resctrl: L3 monitoring detected
[ 22.049405] IPI shorthand broadcast: enabled
[ 22.054368] AVX2 version of gcm_enc/dec engaged.
[ 22.060251] AES CTR mode by8 optimization enabled
[ 22.068616] sched_clock: Marking stable (18087120049, 3980960178)->(23010029414, -941949187)
[ 22.079434] usb 2-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[ 22.088931] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 22.094888] registered taskstats version 1
[ 22.097271] hub 2-1:1.0: USB hub found
[ 22.106475] hub 2-1:1.0: 8 ports detected
[ 22.118538] Loading compiled-in X.509 certificates
[ 22.139187] Loaded X.509 cert 'Build time autogenerated kernel key: d9ee3e5f7dde388b58bc603daf51328079932e36'
[ 22.157832] zswap: loaded using pool lzo/zbud
[ 22.169117] page_owner is disabled
[ 22.174005] Key type .fscrypt registered
[ 22.178543] Key type fscrypt-provisioning registered
[ 22.185959] Btrfs loaded, crc32c=crc32c-generic, zoned=yes, fsverity=yes
[ 22.206290] pstore: Using crash dump compression: deflate
[ 22.230099] Key type encrypted registered
[ 22.249366] Loading compiled-in module X.509 certificates
[ 22.268267] Loaded X.509 cert 'Build time autogenerated kernel key: d9ee3e5f7dde388b58bc603daf51328079932e36'
[ 22.291683] ima: Allocated hash algorithm: sha256
[ 22.313176] ima: Error Communicating to TPM chip
[ 22.334542] ima: Error Communicating to TPM chip
[ 22.355844] ima: Error Communicating to TPM chip
[ 22.377167] ima: Error Communicating to TPM chip
[ 22.385150] usb 2-1.4: new full-speed USB device number 3 using ehci-pci
[ 22.398210] ima: Error Communicating to TPM chip
[ 22.434681] ima: Error Communicating to TPM chip
[ 22.455707] ima: Error Communicating to TPM chip
[ 22.476573] ima: Error Communicating to TPM chip
[ 22.501057] usb 2-1.4: New USB device found, idVendor=046b, idProduct=ff10, bcdDevice= 1.00
[ 22.502254] ima: No architecture policies found
[ 22.510402] usb 2-1.4: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 22.515516] evm: Initialising EVM extended attributes:
[ 22.523621] usb 2-1.4: Product: Virtual Keyboard and Mouse
[ 22.529358] evm: security.selinux
[ 22.535485] usb 2-1.4: Manufacturer: American Megatrends Inc.
[ 22.539191] evm: security.SMACK64 (disabled)
[ 22.545612] usb 2-1.4: SerialNumber: serial
[ 22.550380] evm: security.SMACK64EXEC (disabled)
[ 22.550382] evm: security.SMACK64TRANSMUTE (disabled)
[ 22.550384] evm: security.SMACK64MMAP (disabled)
[ 22.550384] evm: security.apparmor (disabled)
[ 22.550385] evm: security.ima
[ 22.550386] evm: security.capability
[ 22.550387] evm: HMAC attrs: 0x1
[ 22.557044] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.0/0003:046B:FF10.0001/input/input2
[ 22.611269] alg: No test for 842 (842-scomp)
[ 22.614670] hid-generic 0003:046B:FF10.0001: input,hidraw0: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input0
[ 22.618639] alg: No test for 842 (842-generic)
[ 22.623261] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:1d.0/usb2/2-1/2-1.4/2-1.4:1.1/0003:046B:FF10.0002/input/input3
[ 22.765411] PM: Magic number: 7:624:541
[ 22.775939] hid-generic 0003:046B:FF10.0002: input,hidraw1: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1.4/input1
[ 22.780288] usbhid 2-1.4:1.0: hash matches
[ 23.018492] RAS: Correctable Errors collector initialized.
[ 23.041122] Freeing unused decrypted memory: 2036K
[ 23.062613] Freeing unused kernel image (initmem) memory: 4056K
[ 23.082993] Write protecting the kernel read-only data: 26624k
[ 23.104156] Freeing unused kernel image (rodata/data gap) memory: 1120K
[ 23.201250] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 23.222282] rodata_test: all tests were successful
[ 23.241536] x86/mm: Checking user space page tables
[ 23.316347] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 23.337398] Run /init as init process
[ 23.515681] systemd[1]: systemd v248.7-1.fc34 running in system mode. (+PAM +AUDIT +SELINUX -APPARMOR +IMA +SMACK +SECCOMP +GCRYPT +GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 -IDN +IPTC +KMOD +LIBCRYPTSETUP +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +XKBCOMMON +UTMP +SYSVINIT default-hierarchy=unified)
[ 23.593682] systemd[1]: Detected architecture x86-64.
[ 23.614268] systemd[1]: Running in initial RAM disk.
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 18:04 ` Luck, Tony
@ 2023-01-05 18:29 ` Bjorn Helgaas
2023-01-05 19:23 ` Liang, Kan
2023-01-05 19:44 ` Dan Williams
0 siblings, 2 replies; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-05 18:29 UTC (permalink / raw)
To: Luck, Tony
Cc: Liang, Kan, bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, Box, David E, Sun,
Yunying
On Thu, Jan 05, 2023 at 06:04:52PM +0000, Luck, Tony wrote:
> > Hi Tony, can you share a dmesg log? Does it look like the same thing
> > Kan reported, where the ECAM space is reported only via an
> > EfiMemoryMappedIO region and is not otherwise reserved by firmware?
>
> Attached are serial logs. "broken" is the one from v6.2-rc2, "revert" is the
> one with your commit reverted.
>
> I don't see the string "ECAM" in either of them.
Yeah, "ECAM" is what the PCIe spec calls it, but Linux logging uses
"MMCONFIG". Probably should change that.
Anyway, your dmesg log shows the same problem:
DMI: Intel Corporation BRICKLAND/BRICKLAND, BIOS BRBDXSD1.86B.0338.V01.1603162127 03/16/2016
efi: Remove mem48: MMIO range=[0x80000000-0x8fffffff] (256MB) from e820 map
PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[Firmware Info]: PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] not reserved in ACPI motherboard resources
PCI: not using MMCONFIG
acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge
Apparently the only mention of [mem 0x80000000-0x8fffffff] in the
firmware/kernel interface is as an EfiMemoryMappedIO region.
I think this is a firmware bug, but obviously we're going to have to
figure out a way around it.
Bjorn
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 18:29 ` Bjorn Helgaas
@ 2023-01-05 19:23 ` Liang, Kan
2023-01-05 19:44 ` Bjorn Helgaas
2023-01-05 19:44 ` Dan Williams
1 sibling, 1 reply; 37+ messages in thread
From: Liang, Kan @ 2023-01-05 19:23 UTC (permalink / raw)
To: Bjorn Helgaas, Luck, Tony
Cc: bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, Box, David E, Sun,
Yunying
On 2023-01-05 1:29 p.m., Bjorn Helgaas wrote:
> On Thu, Jan 05, 2023 at 06:04:52PM +0000, Luck, Tony wrote:
>>> Hi Tony, can you share a dmesg log? Does it look like the same thing
>>> Kan reported, where the ECAM space is reported only via an
>>> EfiMemoryMappedIO region and is not otherwise reserved by firmware?
>>
>> Attached are serial logs. "broken" is the one from v6.2-rc2, "revert" is the
>> one with your commit reverted.
>>
>> I don't see the string "ECAM" in either of them.
>
> Yeah, "ECAM" is what the PCIe spec calls it, but Linux logging uses
> "MMCONFIG". Probably should change that.
>
> Anyway, your dmesg log shows the same problem:
>
> DMI: Intel Corporation BRICKLAND/BRICKLAND, BIOS BRBDXSD1.86B.0338.V01.1603162127 03/16/2016
> efi: Remove mem48: MMIO range=[0x80000000-0x8fffffff] (256MB) from e820 map
> PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
> [Firmware Info]: PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] not reserved in ACPI motherboard resources
> PCI: not using MMCONFIG
> acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge
>
> Apparently the only mention of [mem 0x80000000-0x8fffffff] in the
> firmware/kernel interface is as an EfiMemoryMappedIO region.
>
> I think this is a firmware bug, but obviously we're going to have to
> figure out a way around it.
>
I just want to share that I did more tests on an Ice Lake server (a
different generation from my original report and Tony's machine).
The same problem can be found as well.
[ 0.000000] DMI: Intel Corporation M50CYP2SB2U/M50CYP2SB2U, BIOS
SE5C6200.86B.4018.D65.2010201151 10/20/2020
[ 0.000000] efi: Remove mem375: MMIO range=[0x80000000-0x8fffffff]
(256MB) from e820 map
[ 0.000000] e820: remove [mem 0x80000000-0x8fffffff] reserved
[ 1.528341] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
0x80000000-0x8fffffff] (base 0x80000000)
[ 1.566605] [Firmware Info]: PCI: MMCONFIG at [mem
0x80000000-0x8fffffff] not reserved in ACPI motherboard resources
[ 1.566611] PCI: not using MMCONFIG
This firmware implementation should exist on the existing platforms for
a long time.
Thanks,
Kan
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 18:29 ` Bjorn Helgaas
2023-01-05 19:23 ` Liang, Kan
@ 2023-01-05 19:44 ` Dan Williams
2023-01-05 19:58 ` Luck, Tony
2023-01-05 20:23 ` Bjorn Helgaas
1 sibling, 2 replies; 37+ messages in thread
From: Dan Williams @ 2023-01-05 19:44 UTC (permalink / raw)
To: Bjorn Helgaas, Luck, Tony
Cc: Liang, Kan, bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, Box, David E, Sun,
Yunying
Bjorn Helgaas wrote:
> On Thu, Jan 05, 2023 at 06:04:52PM +0000, Luck, Tony wrote:
> > > Hi Tony, can you share a dmesg log? Does it look like the same thing
> > > Kan reported, where the ECAM space is reported only via an
> > > EfiMemoryMappedIO region and is not otherwise reserved by firmware?
> >
> > Attached are serial logs. "broken" is the one from v6.2-rc2, "revert" is the
> > one with your commit reverted.
> >
> > I don't see the string "ECAM" in either of them.
>
> Yeah, "ECAM" is what the PCIe spec calls it, but Linux logging uses
> "MMCONFIG". Probably should change that.
>
> Anyway, your dmesg log shows the same problem:
>
> DMI: Intel Corporation BRICKLAND/BRICKLAND, BIOS BRBDXSD1.86B.0338.V01.1603162127 03/16/2016
> efi: Remove mem48: MMIO range=[0x80000000-0x8fffffff] (256MB) from e820 map
> PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
> [Firmware Info]: PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] not reserved in ACPI motherboard resources
> PCI: not using MMCONFIG
> acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge
>
> Apparently the only mention of [mem 0x80000000-0x8fffffff] in the
> firmware/kernel interface is as an EfiMemoryMappedIO region.
>
> I think this is a firmware bug, but obviously we're going to have to
> figure out a way around it.
Definitely an ambiguity / conflict, but not sure it is a bug when you
look at from the perspective of how would an EFI runtime service use
ECAM/MMCONFIG space?
Would it be enough to add this clarification in "EFI 2.9 Table 7-6
Memory Type Usage after ExitBootServices()"?
s/This memory is not used by the OS./This memory is not used by the OS,
unless ACPI declares it for another puporse./
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 19:23 ` Liang, Kan
@ 2023-01-05 19:44 ` Bjorn Helgaas
0 siblings, 0 replies; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-05 19:44 UTC (permalink / raw)
To: Liang, Kan
Cc: Luck, Tony, bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, Box, David E, Sun,
Yunying
On Thu, Jan 05, 2023 at 02:23:45PM -0500, Liang, Kan wrote:
> On 2023-01-05 1:29 p.m., Bjorn Helgaas wrote:
> > On Thu, Jan 05, 2023 at 06:04:52PM +0000, Luck, Tony wrote:
> >>> Hi Tony, can you share a dmesg log? Does it look like the same thing
> >>> Kan reported, where the ECAM space is reported only via an
> >>> EfiMemoryMappedIO region and is not otherwise reserved by firmware?
> >>
> >> Attached are serial logs. "broken" is the one from v6.2-rc2, "revert" is the
> >> one with your commit reverted.
> >>
> >> I don't see the string "ECAM" in either of them.
> >
> > Yeah, "ECAM" is what the PCIe spec calls it, but Linux logging uses
> > "MMCONFIG". Probably should change that.
> >
> > Anyway, your dmesg log shows the same problem:
> >
> > DMI: Intel Corporation BRICKLAND/BRICKLAND, BIOS BRBDXSD1.86B.0338.V01.1603162127 03/16/2016
> > efi: Remove mem48: MMIO range=[0x80000000-0x8fffffff] (256MB) from e820 map
> > PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
> > [Firmware Info]: PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] not reserved in ACPI motherboard resources
> > PCI: not using MMCONFIG
> > acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge
> >
> > Apparently the only mention of [mem 0x80000000-0x8fffffff] in the
> > firmware/kernel interface is as an EfiMemoryMappedIO region.
> >
> > I think this is a firmware bug, but obviously we're going to have to
> > figure out a way around it.
>
> I just want to share that I did more tests on an Ice Lake server (a
> different generation from my original report and Tony's machine).
>
> The same problem can be found as well.
>
> [ 0.000000] DMI: Intel Corporation M50CYP2SB2U/M50CYP2SB2U, BIOS
> SE5C6200.86B.4018.D65.2010201151 10/20/2020
> [ 0.000000] efi: Remove mem375: MMIO range=[0x80000000-0x8fffffff]
> (256MB) from e820 map
> [ 0.000000] e820: remove [mem 0x80000000-0x8fffffff] reserved
>
> [ 1.528341] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem
> 0x80000000-0x8fffffff] (base 0x80000000)
> [ 1.566605] [Firmware Info]: PCI: MMCONFIG at [mem
> 0x80000000-0x8fffffff] not reserved in ACPI motherboard resources
> [ 1.566611] PCI: not using MMCONFIG
>
> This firmware implementation should exist on the existing platforms for
> a long time.
Yes. Frustrating, but I think we have no choice but to make Linux
work with the firmware as it is, whether it is buggy or not. From
your first report, I hoped it was isolated to unreleased firmware that
had a chance of being fixed, but obviously that's not the case.
Bjorn
^ permalink raw reply [flat|nested] 37+ messages in thread
* RE: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 19:44 ` Dan Williams
@ 2023-01-05 19:58 ` Luck, Tony
2023-01-05 20:37 ` Bjorn Helgaas
2023-01-05 20:23 ` Bjorn Helgaas
1 sibling, 1 reply; 37+ messages in thread
From: Luck, Tony @ 2023-01-05 19:58 UTC (permalink / raw)
To: Williams, Dan J, Bjorn Helgaas
Cc: Liang, Kan, bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, Box, David E, Sun,
Yunying
> Definitely an ambiguity / conflict, but not sure it is a bug when you
> look at from the perspective of how would an EFI runtime service use
> ECAM/MMCONFIG space?
>
> Would it be enough to add this clarification in "EFI 2.9 Table 7-6
> Memory Type Usage after ExitBootServices()"?
>
> s/This memory is not used by the OS./This memory is not used by the OS,
> unless ACPI declares it for another purpose./
In the case of the EDAC driver there isn't any ACPI declaration. It just does
pci_get_device() to find the devices it needs to use with a lookup based on
vendor-id and device-id.
and then uses pci_read_config_dword() to read various offsets from config
space, some of which are in PCIe extended config space.
-Tony
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 19:44 ` Dan Williams
2023-01-05 19:58 ` Luck, Tony
@ 2023-01-05 20:23 ` Bjorn Helgaas
2023-01-05 21:20 ` Dan Williams
1 sibling, 1 reply; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-05 20:23 UTC (permalink / raw)
To: Dan Williams
Cc: Luck, Tony, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying
On Thu, Jan 05, 2023 at 11:44:28AM -0800, Dan Williams wrote:
> Bjorn Helgaas wrote:
> > Apparently the only mention of [mem 0x80000000-0x8fffffff] in the
> > firmware/kernel interface is as an EfiMemoryMappedIO region.
> >
> > I think this is a firmware bug, but obviously we're going to have to
> > figure out a way around it.
>
> Definitely an ambiguity / conflict, but not sure it is a bug when you
> look at from the perspective of how would an EFI runtime service use
> ECAM/MMCONFIG space?
I think it's perfectly fine for firmware to advertise ECAM space as an
EfiMemoryMappedIO region via EFI GetMemoryMap() because it certainly
makes sense that EFI runtime services would use config space.
My understanding is that the OS should learn about device address
space via ACPI _CRS, not GetMemoryMap(). The MCFG spec (PCI Firmware
Spec, r3.3, sec 4.1.2) requires ECAM space to be reserved via a
PNP0C02 motherboard device _CRS.
So what I think *is* a bug is that this firmware doesn't report the
ECAM space via PNP0C02 _CRS.
If somebody thinks the lack of this reservation is not a bug, I would
love to hear ideas about how Linux *should* be handling this. There
are many variations on how firmware does things like this, and it's
been a nightmare trying to figure out something that works with all of
them.
> Would it be enough to add this clarification in "EFI 2.9 Table 7-6
> Memory Type Usage after ExitBootServices()"?
>
> s/This memory is not used by the OS./This memory is not used by the OS,
> unless ACPI declares it for another purpose./
I guess the idea is that MCFG is a form of "ACPI declaring it"? I
don't have an explicit citation for it, but I infer at [1] that ACPI
static tables are second-class citizens and not intended as a way of
reserving address space because that would lead to problems booting
old OSes on firmware that provides new tables unknown to the OS.
Bjorn
[1] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/Documentation/PCI/acpi-info.rst?id=v6.1#n32
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 19:58 ` Luck, Tony
@ 2023-01-05 20:37 ` Bjorn Helgaas
2023-01-05 21:49 ` Luck, Tony
0 siblings, 1 reply; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-05 20:37 UTC (permalink / raw)
To: Luck, Tony
Cc: Williams, Dan J, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying
On Thu, Jan 05, 2023 at 07:58:47PM +0000, Luck, Tony wrote:
> > Definitely an ambiguity / conflict, but not sure it is a bug when you
> > look at from the perspective of how would an EFI runtime service use
> > ECAM/MMCONFIG space?
> >
> > Would it be enough to add this clarification in "EFI 2.9 Table 7-6
> > Memory Type Usage after ExitBootServices()"?
> >
> > s/This memory is not used by the OS./This memory is not used by the OS,
> > unless ACPI declares it for another purpose./
>
> In the case of the EDAC driver there isn't any ACPI declaration. It just does
> pci_get_device() to find the devices it needs to use with a lookup based on
> vendor-id and device-id.
The EDAC driver wouldn't have any ACPI stuff in it; it's just that
Linux is looking for ACPI info about the ECAM area.
I think the problem here is that the ECAM/MMCONFIG code checks to make
sure the ECAM space is reserved somewhere. If it doesn't find a
reservation either in E820 [1] or by PNP0C01/PNP0C02 _CRS methods [2],
it decides it's not safe to use ECAM, which means we may only have the
old accessors that can only reach 256 bytes of config space.
Bjorn
[1] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/arch/x86/pci/mmconfig-shared.c?id=v6.1#n447
[2] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/arch/x86/pci/mmconfig-shared.c?id=v6.1#n428
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 20:23 ` Bjorn Helgaas
@ 2023-01-05 21:20 ` Dan Williams
2023-01-05 21:35 ` Bjorn Helgaas
0 siblings, 1 reply; 37+ messages in thread
From: Dan Williams @ 2023-01-05 21:20 UTC (permalink / raw)
To: Bjorn Helgaas, Dan Williams
Cc: Luck, Tony, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying
Bjorn Helgaas wrote:
> On Thu, Jan 05, 2023 at 11:44:28AM -0800, Dan Williams wrote:
> > Bjorn Helgaas wrote:
>
> > > Apparently the only mention of [mem 0x80000000-0x8fffffff] in the
> > > firmware/kernel interface is as an EfiMemoryMappedIO region.
> > >
> > > I think this is a firmware bug, but obviously we're going to have to
> > > figure out a way around it.
> >
> > Definitely an ambiguity / conflict, but not sure it is a bug when you
> > look at from the perspective of how would an EFI runtime service use
> > ECAM/MMCONFIG space?
>
> I think it's perfectly fine for firmware to advertise ECAM space as an
> EfiMemoryMappedIO region via EFI GetMemoryMap() because it certainly
> makes sense that EFI runtime services would use config space.
>
> My understanding is that the OS should learn about device address
> space via ACPI _CRS, not GetMemoryMap(). The MCFG spec (PCI Firmware
> Spec, r3.3, sec 4.1.2) requires ECAM space to be reserved via a
> PNP0C02 motherboard device _CRS.
>
> So what I think *is* a bug is that this firmware doesn't report the
> ECAM space via PNP0C02 _CRS.
>
> If somebody thinks the lack of this reservation is not a bug, I would
> love to hear ideas about how Linux *should* be handling this. There
> are many variations on how firmware does things like this, and it's
> been a nightmare trying to figure out something that works with all of
> them.
I am trying to get a statement from a BIOS person, but in the meantime I
am confused by this lead in sentence of Note 2 in "PCI Firmware Spec
v3.2 Table 4-2: MCFG Table to Support Enhanced Configuration Space
Access":
If the operating system does not natively comprehend reserving the MMCFG
region, the MMCFG region must be reserved by firmware. The address range
reported in the MCFG table or by _CBA method (see Section 4.1.3) must be
reserved by declaring a motherboard resource...
Which seems to say it is ok for the OS to treat MMCFG space as reserved
by default. It certainly fails the Robustness Principle for the BIOS to
*assume* that the OS can natively comprehend that reservation, but it
seems Linux is in its rights to make that assumption.
>
> > Would it be enough to add this clarification in "EFI 2.9 Table 7-6
> > Memory Type Usage after ExitBootServices()"?
> >
> > s/This memory is not used by the OS./This memory is not used by the OS,
> > unless ACPI declares it for another purpose./
>
> I guess the idea is that MCFG is a form of "ACPI declaring it"? I
> don't have an explicit citation for it, but I infer at [1] that ACPI
> static tables are second-class citizens and not intended as a way of
> reserving address space because that would lead to problems booting
> old OSes on firmware that provides new tables unknown to the OS.
Ah, true, certainly for new stuff, but what about MCFG specifically?
What harm is there an assuming that MMCONFIG intersecting with
EfiMemoryMappedIO shall be treated as reserved for MMCONFIG usage.
>
> Bjorn
>
> [1] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/Documentation/PCI/acpi-info.rst?id=v6.1#n32
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 21:20 ` Dan Williams
@ 2023-01-05 21:35 ` Bjorn Helgaas
2023-01-05 21:43 ` Dan Williams
0 siblings, 1 reply; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-05 21:35 UTC (permalink / raw)
To: Dan Williams
Cc: Luck, Tony, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying
On Thu, Jan 05, 2023 at 01:20:36PM -0800, Dan Williams wrote:
> Bjorn Helgaas wrote:
> > On Thu, Jan 05, 2023 at 11:44:28AM -0800, Dan Williams wrote:
> > > Bjorn Helgaas wrote:
> >
> > > > Apparently the only mention of [mem 0x80000000-0x8fffffff] in the
> > > > firmware/kernel interface is as an EfiMemoryMappedIO region.
> > > >
> > > > I think this is a firmware bug, but obviously we're going to have to
> > > > figure out a way around it.
> > >
> > > Definitely an ambiguity / conflict, but not sure it is a bug when you
> > > look at from the perspective of how would an EFI runtime service use
> > > ECAM/MMCONFIG space?
> >
> > I think it's perfectly fine for firmware to advertise ECAM space as an
> > EfiMemoryMappedIO region via EFI GetMemoryMap() because it certainly
> > makes sense that EFI runtime services would use config space.
> >
> > My understanding is that the OS should learn about device address
> > space via ACPI _CRS, not GetMemoryMap(). The MCFG spec (PCI Firmware
> > Spec, r3.3, sec 4.1.2) requires ECAM space to be reserved via a
> > PNP0C02 motherboard device _CRS.
> >
> > So what I think *is* a bug is that this firmware doesn't report the
> > ECAM space via PNP0C02 _CRS.
> >
> > If somebody thinks the lack of this reservation is not a bug, I would
> > love to hear ideas about how Linux *should* be handling this. There
> > are many variations on how firmware does things like this, and it's
> > been a nightmare trying to figure out something that works with all of
> > them.
>
> I am trying to get a statement from a BIOS person, but in the meantime I
> am confused by this lead in sentence of Note 2 in "PCI Firmware Spec
> v3.2 Table 4-2: MCFG Table to Support Enhanced Configuration Space
> Access":
>
> If the operating system does not natively comprehend reserving the MMCFG
> region, the MMCFG region must be reserved by firmware. The address range
> reported in the MCFG table or by _CBA method (see Section 4.1.3) must be
> reserved by declaring a motherboard resource...
>
> Which seems to say it is ok for the OS to treat MMCFG space as reserved
> by default. It certainly fails the Robustness Principle for the BIOS to
> *assume* that the OS can natively comprehend that reservation, but it
> seems Linux is in its rights to make that assumption.
I read "OS natively comprehends MMCFG space" as meaning "the OS has
device-specific knowledge of the PCI host bridge and the associated
MMCFG space." But in that case, the OS wouldn't need MCFG at all, so
maybe I'm not reading it right.
There must have been some reason for that sentence, e.g., some system
that didn't or couldn't report MMCFG via PNP0C02 _CBA, but it sure
makes a mess of what could have been a simple "range must be reserved"
statement.
> > > Would it be enough to add this clarification in "EFI 2.9 Table 7-6
> > > Memory Type Usage after ExitBootServices()"?
> > >
> > > s/This memory is not used by the OS./This memory is not used by the OS,
> > > unless ACPI declares it for another purpose./
> >
> > I guess the idea is that MCFG is a form of "ACPI declaring it"? I
> > don't have an explicit citation for it, but I infer at [1] that ACPI
> > static tables are second-class citizens and not intended as a way of
> > reserving address space because that would lead to problems booting
> > old OSes on firmware that provides new tables unknown to the OS.
>
> Ah, true, certainly for new stuff, but what about MCFG specifically?
> What harm is there an assuming that MMCONFIG intersecting with
> EfiMemoryMappedIO shall be treated as reserved for MMCONFIG usage.
Probably none, and I think that's what we'll have to do. Ugh.
Another random special-case rule.
> > [1] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/Documentation/PCI/acpi-info.rst?id=v6.1#n32
>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 21:35 ` Bjorn Helgaas
@ 2023-01-05 21:43 ` Dan Williams
2023-01-05 21:48 ` Bjorn Helgaas
0 siblings, 1 reply; 37+ messages in thread
From: Dan Williams @ 2023-01-05 21:43 UTC (permalink / raw)
To: Bjorn Helgaas, Dan Williams
Cc: Luck, Tony, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying
Bjorn Helgaas wrote:
> On Thu, Jan 05, 2023 at 01:20:36PM -0800, Dan Williams wrote:
> > Bjorn Helgaas wrote:
> > > On Thu, Jan 05, 2023 at 11:44:28AM -0800, Dan Williams wrote:
> > > > Bjorn Helgaas wrote:
> > >
> > > > > Apparently the only mention of [mem 0x80000000-0x8fffffff] in the
> > > > > firmware/kernel interface is as an EfiMemoryMappedIO region.
> > > > >
> > > > > I think this is a firmware bug, but obviously we're going to have to
> > > > > figure out a way around it.
> > > >
> > > > Definitely an ambiguity / conflict, but not sure it is a bug when you
> > > > look at from the perspective of how would an EFI runtime service use
> > > > ECAM/MMCONFIG space?
> > >
> > > I think it's perfectly fine for firmware to advertise ECAM space as an
> > > EfiMemoryMappedIO region via EFI GetMemoryMap() because it certainly
> > > makes sense that EFI runtime services would use config space.
> > >
> > > My understanding is that the OS should learn about device address
> > > space via ACPI _CRS, not GetMemoryMap(). The MCFG spec (PCI Firmware
> > > Spec, r3.3, sec 4.1.2) requires ECAM space to be reserved via a
> > > PNP0C02 motherboard device _CRS.
> > >
> > > So what I think *is* a bug is that this firmware doesn't report the
> > > ECAM space via PNP0C02 _CRS.
> > >
> > > If somebody thinks the lack of this reservation is not a bug, I would
> > > love to hear ideas about how Linux *should* be handling this. There
> > > are many variations on how firmware does things like this, and it's
> > > been a nightmare trying to figure out something that works with all of
> > > them.
> >
> > I am trying to get a statement from a BIOS person, but in the meantime I
> > am confused by this lead in sentence of Note 2 in "PCI Firmware Spec
> > v3.2 Table 4-2: MCFG Table to Support Enhanced Configuration Space
> > Access":
> >
> > If the operating system does not natively comprehend reserving the MMCFG
> > region, the MMCFG region must be reserved by firmware. The address range
> > reported in the MCFG table or by _CBA method (see Section 4.1.3) must be
> > reserved by declaring a motherboard resource...
> >
> > Which seems to say it is ok for the OS to treat MMCFG space as reserved
> > by default. It certainly fails the Robustness Principle for the BIOS to
> > *assume* that the OS can natively comprehend that reservation, but it
> > seems Linux is in its rights to make that assumption.
>
> I read "OS natively comprehends MMCFG space" as meaning "the OS has
> device-specific knowledge of the PCI host bridge and the associated
> MMCFG space." But in that case, the OS wouldn't need MCFG at all, so
> maybe I'm not reading it right.
>
> There must have been some reason for that sentence, e.g., some system
> that didn't or couldn't report MMCFG via PNP0C02 _CBA, but it sure
> makes a mess of what could have been a simple "range must be reserved"
> statement.
>
> > > > Would it be enough to add this clarification in "EFI 2.9 Table 7-6
> > > > Memory Type Usage after ExitBootServices()"?
> > > >
> > > > s/This memory is not used by the OS./This memory is not used by the OS,
> > > > unless ACPI declares it for another purpose./
> > >
> > > I guess the idea is that MCFG is a form of "ACPI declaring it"? I
> > > don't have an explicit citation for it, but I infer at [1] that ACPI
> > > static tables are second-class citizens and not intended as a way of
> > > reserving address space because that would lead to problems booting
> > > old OSes on firmware that provides new tables unknown to the OS.
> >
> > Ah, true, certainly for new stuff, but what about MCFG specifically?
> > What harm is there an assuming that MMCONFIG intersecting with
> > EfiMemoryMappedIO shall be treated as reserved for MMCONFIG usage.
>
> Probably none, and I think that's what we'll have to do. Ugh.
> Another random special-case rule.
>
> > > [1] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/Documentation/PCI/acpi-info.rst?id=v6.1#n32
I am still holding out that a BIOS developer can either say "whoops,
populating MMCONFIG in _CRS was overlooked", or point out "if you take
the derivative of the PCI spec, multiply it be the inverse of the EFI
spec and then take the cross-product with the ACPI spec then the memory
type comes out as implicitly reserved".
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 21:43 ` Dan Williams
@ 2023-01-05 21:48 ` Bjorn Helgaas
0 siblings, 0 replies; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-05 21:48 UTC (permalink / raw)
To: Dan Williams
Cc: Luck, Tony, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying
On Thu, Jan 05, 2023 at 01:43:20PM -0800, Dan Williams wrote:
> Bjorn Helgaas wrote:
> > On Thu, Jan 05, 2023 at 01:20:36PM -0800, Dan Williams wrote:
> > > Bjorn Helgaas wrote:
> > > > On Thu, Jan 05, 2023 at 11:44:28AM -0800, Dan Williams wrote:
> > > > > Would it be enough to add this clarification in "EFI 2.9 Table 7-6
> > > > > Memory Type Usage after ExitBootServices()"?
> > > > >
> > > > > s/This memory is not used by the OS./This memory is not used by the OS,
> > > > > unless ACPI declares it for another purpose./
> > > >
> > > > I guess the idea is that MCFG is a form of "ACPI declaring it"? I
> > > > don't have an explicit citation for it, but I infer at [1] that ACPI
> > > > static tables are second-class citizens and not intended as a way of
> > > > reserving address space because that would lead to problems booting
> > > > old OSes on firmware that provides new tables unknown to the OS.
> > >
> > > Ah, true, certainly for new stuff, but what about MCFG specifically?
> > > What harm is there an assuming that MMCONFIG intersecting with
> > > EfiMemoryMappedIO shall be treated as reserved for MMCONFIG usage.
> >
> > Probably none, and I think that's what we'll have to do. Ugh.
> > Another random special-case rule.
> >
> > > > [1] https://git.kernel.org/pub/scm/linux/kernel/git/torvalds/linux.git/tree/Documentation/PCI/acpi-info.rst?id=v6.1#n32
>
> I am still holding out that a BIOS developer can either say "whoops,
> populating MMCONFIG in _CRS was overlooked", or point out "if you take
> the derivative of the PCI spec, multiply it be the inverse of the EFI
> spec and then take the cross-product with the ACPI spec then the memory
> type comes out as implicitly reserved".
Hahaha :) Yep, but even if they change it, apparently there are lots
of machines in the field that won't get updated, so we're stuck
working around it.
Or, I guess the best-case scenario would be that it's not actually a
firmware bug, and there's some clean fix we can make to Linux. But
I'm not holding my breath.
^ permalink raw reply [flat|nested] 37+ messages in thread
* RE: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 20:37 ` Bjorn Helgaas
@ 2023-01-05 21:49 ` Luck, Tony
2023-01-05 22:20 ` Bjorn Helgaas
0 siblings, 1 reply; 37+ messages in thread
From: Luck, Tony @ 2023-01-05 21:49 UTC (permalink / raw)
To: Bjorn Helgaas
Cc: Williams, Dan J, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying
> The EDAC driver wouldn't have any ACPI stuff in it; it's just that
> Linux is looking for ACPI info about the ECAM area.
Is there some way for a driver to know that pci_read_config_dword()
is going to fail for offsets in extended PCIe config space?
-Tony
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 21:49 ` Luck, Tony
@ 2023-01-05 22:20 ` Bjorn Helgaas
0 siblings, 0 replies; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-05 22:20 UTC (permalink / raw)
To: Luck, Tony
Cc: Williams, Dan J, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying
On Thu, Jan 05, 2023 at 09:49:44PM +0000, Luck, Tony wrote:
> > The EDAC driver wouldn't have any ACPI stuff in it; it's just that
> > Linux is looking for ACPI info about the ECAM area.
>
> Is there some way for a driver to know that pci_read_config_dword()
> is going to fail for offsets in extended PCIe config space?
There's no nice way to know ahead of time. "raw_pci_ext_ops ==
&pci_mmcfg" means it should work. It looks like pci_direct_conf1 and
pci_mmcfg_numachip would also work, but it's all pretty ugly.
You could check the result for PCI_POSSIBLE_ERROR(), since reads
should return ~0 (PCI_ERROR_RESPONSE) if they fail either because we
can't access extended config space or because there was some PCI
error.
Bjorn
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-04 14:39 Bug report: the extended PCI config space is missed with 6.2-rc2 Liang, Kan
2023-01-04 14:50 ` Bjorn Helgaas
@ 2023-01-05 22:32 ` Bjorn Helgaas
2023-01-05 23:38 ` Dan Williams
` (3 more replies)
2023-01-06 9:44 ` Linux kernel regression tracking (#adding)
2 siblings, 4 replies; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-05 22:32 UTC (permalink / raw)
To: Liang, Kan
Cc: bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, david.e.box,
yunying.sun, Tony Luck, Dan Williams
[+cc Tony, Dan]
On Wed, Jan 04, 2023 at 09:39:56AM -0500, Liang, Kan wrote:
> Hi Bjorn,
>
> Happy new year!
>
> We found some PCI issues with the latest 6.2-rc2.
>
> - Using the lspci -xxxx, the extended PCI config space of all PCI
> devices are missed with the latest 6.2-rc2. The system we used had 932
> PCI devices, at least 800 which have extended space as seen when booted
> into a 5.15 kernel. But none of them appeared in 6.2-rc2.
> - The drivers which rely on the information in the extended PCI config
> space don't work anymore. We have confirmed that the perf uncore driver
> (uncore performance monitoring) and Intel VSEC driver (telemetry) don't
> work in 6.2-rc2. There could be more drivers which are impacted.
>
> After a bisect, we found the regression is caused by the below commit
> 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map").
> After reverting the commit, the issues are gone.
Can you try this patch (based on v6.2-rc1):
commit 89a0067217b0 ("x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space")
parent 1b929c02afd3
Author: Bjorn Helgaas <bhelgaas@google.com>
Date: Thu Jan 5 16:02:58 2023 -0600
x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space
Normally we reject ECAM space unless it is reported as reserved in the E820
table or via a PNP0C02 _CRS method (PCI Firmware, r3.3, sec 4.1.2). This
means extended config space (offsets 0x100-0xfff) may not be accessible.
Some firmware doesn't report ECAM space via PNP0C02 _CRS methods, but does
mention it as an EfiMemoryMappedIO region via EFI GetMemoryMap(), which is
normally converted to an E820 entry by a bootloader or EFI stub.
07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map"), removes
E820 entries that correspond to EfiMemoryMappedIO regions because some
other firmware uses EfiMemoryMappedIO for PCI host bridge windows, and the
E820 entries prevent Linux from allocating BAR space for hot-added devices.
Allow use of ECAM for extended config space when the region is covered by
an EfiMemoryMappedIO region, even if it's not included in E820 or PNP0C02
_CRS.
Fixes: 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map")
Link: https://lore.kernel.org/r/ac2693d8-8ba3-72e0-5b66-b3ae008d539d@linux.intel.com
diff --git a/arch/x86/pci/mmconfig-shared.c b/arch/x86/pci/mmconfig-shared.c
index 758cbfe55daa..4adc587a4c94 100644
--- a/arch/x86/pci/mmconfig-shared.c
+++ b/arch/x86/pci/mmconfig-shared.c
@@ -12,6 +12,7 @@
*/
#include <linux/acpi.h>
+#include <linux/efi.h>
#include <linux/pci.h>
#include <linux/init.h>
#include <linux/bitmap.h>
@@ -442,6 +443,25 @@ static bool is_acpi_reserved(u64 start, u64 end, enum e820_type not_used)
return mcfg_res.flags;
}
+static bool is_efi_reserved(u64 start, u64 end, enum e820_type not_used)
+{
+ efi_memory_desc_t *md;
+ u64 size, mmio_start, mmio_end;
+
+ for_each_efi_memory_desc(md) {
+ if (md->type == EFI_MEMORY_MAPPED_IO) {
+ size = md->num_pages << EFI_PAGE_SHIFT;
+ mmio_start = md->phys_addr;
+ mmio_end = mmio_start + size - 1;
+
+ if (mmio_start <= start && end <= mmio_end)
+ return true;
+ }
+ }
+
+ return false;
+}
+
typedef bool (*check_reserved_t)(u64 start, u64 end, enum e820_type type);
static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
@@ -452,7 +472,7 @@ static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
u64 size = resource_size(&cfg->res);
u64 old_size = size;
int num_buses;
- char *method = with_e820 ? "E820" : "ACPI motherboard resources";
+ char *method = with_e820 ? "E820" : "ACPI motherboard resources or EFI";
while (!is_reserved(addr, addr + size, E820_TYPE_RESERVED)) {
size >>= 1;
@@ -502,15 +522,17 @@ pci_mmcfg_check_reserved(struct device *dev, struct pci_mmcfg_region *cfg, int e
if (!early && !acpi_disabled) {
if (is_mmconf_reserved(is_acpi_reserved, cfg, dev, 0))
return true;
+ if (is_mmconf_reserved(is_efi_reserved, cfg, dev, 0))
+ return true;
if (dev)
dev_info(dev, FW_INFO
- "MMCONFIG at %pR not reserved in "
+ "MMCONFIG at %pR not reserved in EFI "
"ACPI motherboard resources\n",
&cfg->res);
else
pr_info(FW_INFO PREFIX
- "MMCONFIG at %pR not reserved in "
+ "MMCONFIG at %pR not reserved in EFI or "
"ACPI motherboard resources\n",
&cfg->res);
}
^ permalink raw reply related [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 22:32 ` Bjorn Helgaas
@ 2023-01-05 23:38 ` Dan Williams
2023-01-06 0:22 ` Luck, Tony
2023-01-06 0:32 ` Bjorn Helgaas
2023-01-06 0:50 ` Liang, Kan
` (2 subsequent siblings)
3 siblings, 2 replies; 37+ messages in thread
From: Dan Williams @ 2023-01-05 23:38 UTC (permalink / raw)
To: Bjorn Helgaas, Liang, Kan
Cc: bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, david.e.box,
yunying.sun, Tony Luck, Dan Williams, dave.jiang
Bjorn Helgaas wrote:
> [+cc Tony, Dan]
>
> On Wed, Jan 04, 2023 at 09:39:56AM -0500, Liang, Kan wrote:
> > Hi Bjorn,
> >
> > Happy new year!
> >
> > We found some PCI issues with the latest 6.2-rc2.
> >
> > - Using the lspci -xxxx, the extended PCI config space of all PCI
> > devices are missed with the latest 6.2-rc2. The system we used had 932
> > PCI devices, at least 800 which have extended space as seen when booted
> > into a 5.15 kernel. But none of them appeared in 6.2-rc2.
> > - The drivers which rely on the information in the extended PCI config
> > space don't work anymore. We have confirmed that the perf uncore driver
> > (uncore performance monitoring) and Intel VSEC driver (telemetry) don't
> > work in 6.2-rc2. There could be more drivers which are impacted.
> >
> > After a bisect, we found the regression is caused by the below commit
> > 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map").
> > After reverting the commit, the issues are gone.
>
> Can you try this patch (based on v6.2-rc1):
Looks good to me, one question below, but either way:
Reviewed-by: Dan Williams <dan.j.williams@intel.com>
...and Dave, who reported that CXL enumeration was busted in -rc2, says
this patch fixes that. So you can also add:
Tested-by: Dave Jiang <dave.jiang@intel.com>
>
>
> commit 89a0067217b0 ("x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space")
> parent 1b929c02afd3
> Author: Bjorn Helgaas <bhelgaas@google.com>
> Date: Thu Jan 5 16:02:58 2023 -0600
>
> x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space
>
> Normally we reject ECAM space unless it is reported as reserved in the E820
> table or via a PNP0C02 _CRS method (PCI Firmware, r3.3, sec 4.1.2). This
> means extended config space (offsets 0x100-0xfff) may not be accessible.
>
> Some firmware doesn't report ECAM space via PNP0C02 _CRS methods, but does
> mention it as an EfiMemoryMappedIO region via EFI GetMemoryMap(), which is
> normally converted to an E820 entry by a bootloader or EFI stub.
>
> 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map"), removes
> E820 entries that correspond to EfiMemoryMappedIO regions because some
> other firmware uses EfiMemoryMappedIO for PCI host bridge windows, and the
> E820 entries prevent Linux from allocating BAR space for hot-added devices.
>
> Allow use of ECAM for extended config space when the region is covered by
> an EfiMemoryMappedIO region, even if it's not included in E820 or PNP0C02
> _CRS.
>
> Fixes: 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map")
> Link: https://lore.kernel.org/r/ac2693d8-8ba3-72e0-5b66-b3ae008d539d@linux.intel.com
>
> diff --git a/arch/x86/pci/mmconfig-shared.c b/arch/x86/pci/mmconfig-shared.c
> index 758cbfe55daa..4adc587a4c94 100644
> --- a/arch/x86/pci/mmconfig-shared.c
> +++ b/arch/x86/pci/mmconfig-shared.c
> @@ -12,6 +12,7 @@
> */
>
> #include <linux/acpi.h>
> +#include <linux/efi.h>
> #include <linux/pci.h>
> #include <linux/init.h>
> #include <linux/bitmap.h>
> @@ -442,6 +443,25 @@ static bool is_acpi_reserved(u64 start, u64 end, enum e820_type not_used)
> return mcfg_res.flags;
> }
>
> +static bool is_efi_reserved(u64 start, u64 end, enum e820_type not_used)
> +{
> + efi_memory_desc_t *md;
> + u64 size, mmio_start, mmio_end;
> +
> + for_each_efi_memory_desc(md) {
> + if (md->type == EFI_MEMORY_MAPPED_IO) {
Should this also consider EFI_RESERVED_TYPE? Not that any known BIOS
needs that accommodation. This is more a question than a suggestion.
^ permalink raw reply [flat|nested] 37+ messages in thread
* RE: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 23:38 ` Dan Williams
@ 2023-01-06 0:22 ` Luck, Tony
2023-01-06 0:47 ` Bjorn Helgaas
2023-01-06 0:32 ` Bjorn Helgaas
1 sibling, 1 reply; 37+ messages in thread
From: Luck, Tony @ 2023-01-06 0:22 UTC (permalink / raw)
To: Williams, Dan J, Bjorn Helgaas, Liang, Kan
Cc: bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, Box, David E, Sun,
Yunying, Jiang, Dave
> ...and Dave, who reported that CXL enumeration was busted in -rc2, says
> this patch fixes that. So you can also add:
>
> Tested-by: Dave Jiang <dave.jiang@intel.com>
Also seems good for my Broadwell/EDAC system.
Boot messages mentioning MMCONFIG are:
$ dmesg | grep MMCONFIG
[ 12.280360] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[ 12.291606] PCI: not using MMCONFIG
[ 12.873676] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[ 12.893266] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in ACPI motherboard resources or EFI
[ 12.903601] PCI: MMCONFIG for 0000 [bus00-7f] at [mem 0x80000000-0x87ffffff] (base 0x80000000) (size reduced!)
[ 13.385616] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ 14.115617] acpi PNP0A03:01: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ 17.969639] acpi PNP0A08:02: fail to add MMCONFIG information, can't access extended configuration space under this bridge
[ 18.298640] acpi PNP0A08:03: fail to add MMCONFIG information, can't access extended configuration space under this bridge
The EDAC driver works with this patch applied.
Tested-by: Tony Luck <tony.luck@intel.com>
-Tony
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 23:38 ` Dan Williams
2023-01-06 0:22 ` Luck, Tony
@ 2023-01-06 0:32 ` Bjorn Helgaas
1 sibling, 0 replies; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-06 0:32 UTC (permalink / raw)
To: Dan Williams
Cc: Liang, Kan, bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, david.e.box,
yunying.sun, Tony Luck, dave.jiang
On Thu, Jan 05, 2023 at 03:38:40PM -0800, Dan Williams wrote:
> Bjorn Helgaas wrote:
> > On Wed, Jan 04, 2023 at 09:39:56AM -0500, Liang, Kan wrote:
> > > Hi Bjorn,
> > >
> > > Happy new year!
> > >
> > > We found some PCI issues with the latest 6.2-rc2.
> > >
> > > - Using the lspci -xxxx, the extended PCI config space of all PCI
> > > devices are missed with the latest 6.2-rc2. The system we used had 932
> > > PCI devices, at least 800 which have extended space as seen when booted
> > > into a 5.15 kernel. But none of them appeared in 6.2-rc2.
> > > - The drivers which rely on the information in the extended PCI config
> > > space don't work anymore. We have confirmed that the perf uncore driver
> > > (uncore performance monitoring) and Intel VSEC driver (telemetry) don't
> > > work in 6.2-rc2. There could be more drivers which are impacted.
> > >
> > > After a bisect, we found the regression is caused by the below commit
> > > 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map").
> > > After reverting the commit, the issues are gone.
> >
> > Can you try this patch (based on v6.2-rc1):
>
> Looks good to me, one question below, but either way:
>
> Reviewed-by: Dan Williams <dan.j.williams@intel.com>
>
> ...and Dave, who reported that CXL enumeration was busted in -rc2, says
> this patch fixes that. So you can also add:
>
> Tested-by: Dave Jiang <dave.jiang@intel.com>
Thanks for all this!
> > +static bool is_efi_reserved(u64 start, u64 end, enum e820_type not_used)
> > +{
> > + efi_memory_desc_t *md;
> > + u64 size, mmio_start, mmio_end;
> > +
> > + for_each_efi_memory_desc(md) {
> > + if (md->type == EFI_MEMORY_MAPPED_IO) {
>
> Should this also consider EFI_RESERVED_TYPE? Not that any known BIOS
> needs that accommodation. This is more a question than a suggestion.
I don't think GetMemoryMap() is intended as a way to tell the OS about
device memory. The OS needs to know what address space goes with what
device and what kind of device it is. The ACPI namespace supplies all
that kind of information, so it doesn't make sense to me that we'd get
some from ACPI and some from EFI.
Also, the EFI spec says EfiReservedMemoryType is "Not usable." But if
ECAM space were described that way, obviously the OS *does* need to
use it, so it doesn't really seem to fit.
I do think the EFI spec is pretty poorly worded. EfiMemoryMappedIO is
"not used by the OS" -- misleading, since the OS *has* to use ECAM and
host bridge apertures. And "all system memory-mapped IO information
should come from ACPI tables" -- well, the EfiMemoryMappedIO region is
itself certainly some kind of information about memory-mapped IO
space! I think it should really refer to the ACPI *namespace*
specifically, not just tables that might include MCFG, etc. IMHO the
static tables like MCFG are basically just a crutch for use before we
know how to parse the namespace.
Anyway, I am inclined to do nothing with EFI_RESERVED_TYPE unless we
come across a system that needs it.
Bjorn
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-06 0:22 ` Luck, Tony
@ 2023-01-06 0:47 ` Bjorn Helgaas
2023-01-06 17:33 ` Bjorn Helgaas
0 siblings, 1 reply; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-06 0:47 UTC (permalink / raw)
To: Luck, Tony
Cc: Williams, Dan J, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying, Jiang, Dave
On Fri, Jan 06, 2023 at 12:22:09AM +0000, Luck, Tony wrote:
> > ...and Dave, who reported that CXL enumeration was busted in -rc2, says
> > this patch fixes that. So you can also add:
> >
> > Tested-by: Dave Jiang <dave.jiang@intel.com>
>
> Also seems good for my Broadwell/EDAC system.
>
> Boot messages mentioning MMCONFIG are:
>
> $ dmesg | grep MMCONFIG
> PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
> PCI: not using MMCONFIG
> PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
> PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in ACPI motherboard resources or EFI
This part looks ok.
> PCI: MMCONFIG for 0000 [bus00-7f] at [mem 0x80000000-0x87ffffff] (base 0x80000000) (size reduced!)
> acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge
> acpi PNP0A03:01: fail to add MMCONFIG information, can't access extended configuration space under this bridge
> acpi PNP0A08:02: fail to add MMCONFIG information, can't access extended configuration space under this bridge
> acpi PNP0A08:03: fail to add MMCONFIG information, can't access extended configuration space under this bridge
But the rest of this still looks like a regression. From your
previous dmesg log:
PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
PNP0A03:00: host bridge to domain 0000 [bus ff]
PNP0A03:01: host bridge to domain 0000 [bus bf]
PNP0A03:02: host bridge to domain 0000 [bus 7f]
PNP0A03:03: host bridge to domain 0000 [bus 3f]
PNP0A08:00: host bridge to domain 0000 [bus 00-3e]
PNP0A08:01: host bridge to domain 0000 [bus 40-7e]
PNP0A08:02: host bridge to domain 0000 [bus 80-be]
PNP0A08:03: host bridge to domain 0000 [bus c0-fe]
That MMCONFIG space should cover all those buses, but something is
going wrong.
I'll look at this more tomorrow.
Bjorn
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 22:32 ` Bjorn Helgaas
2023-01-05 23:38 ` Dan Williams
@ 2023-01-06 0:50 ` Liang, Kan
2023-01-09 12:27 ` Giovanni Cabiddu
2023-01-10 6:03 ` Sun, Yunying
3 siblings, 0 replies; 37+ messages in thread
From: Liang, Kan @ 2023-01-06 0:50 UTC (permalink / raw)
To: Bjorn Helgaas
Cc: bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, david.e.box,
yunying.sun, Tony Luck, Dan Williams
On 2023-01-05 5:32 p.m., Bjorn Helgaas wrote:
> [+cc Tony, Dan]
>
> On Wed, Jan 04, 2023 at 09:39:56AM -0500, Liang, Kan wrote:
>> Hi Bjorn,
>>
>> Happy new year!
>>
>> We found some PCI issues with the latest 6.2-rc2.
>>
>> - Using the lspci -xxxx, the extended PCI config space of all PCI
>> devices are missed with the latest 6.2-rc2. The system we used had 932
>> PCI devices, at least 800 which have extended space as seen when booted
>> into a 5.15 kernel. But none of them appeared in 6.2-rc2.
>> - The drivers which rely on the information in the extended PCI config
>> space don't work anymore. We have confirmed that the perf uncore driver
>> (uncore performance monitoring) and Intel VSEC driver (telemetry) don't
>> work in 6.2-rc2. There could be more drivers which are impacted.
>>
>> After a bisect, we found the regression is caused by the below commit
>> 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map").
>> After reverting the commit, the issues are gone.
>
> Can you try this patch (based on v6.2-rc1):
>
> > commit 89a0067217b0 ("x86/pci: Treat EfiMemoryMappedIO as reservation
of ECAM space")
> parent 1b929c02afd3
> Author: Bjorn Helgaas <bhelgaas@google.com>
> Date: Thu Jan 5 16:02:58 2023 -0600
>
> x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space
>
> Normally we reject ECAM space unless it is reported as reserved in the E820
> table or via a PNP0C02 _CRS method (PCI Firmware, r3.3, sec 4.1.2). This
> means extended config space (offsets 0x100-0xfff) may not be accessible.
>
> Some firmware doesn't report ECAM space via PNP0C02 _CRS methods, but does
> mention it as an EfiMemoryMappedIO region via EFI GetMemoryMap(), which is
> normally converted to an E820 entry by a bootloader or EFI stub.
>
> 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map"), removes
> E820 entries that correspond to EfiMemoryMappedIO regions because some
> other firmware uses EfiMemoryMappedIO for PCI host bridge windows, and the
> E820 entries prevent Linux from allocating BAR space for hot-added devices.
>
> Allow use of ECAM for extended config space when the region is covered by
> an EfiMemoryMappedIO region, even if it's not included in E820 or PNP0C02
> _CRS.
>
> Fixes: 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map")
> Link: https://lore.kernel.org/r/ac2693d8-8ba3-72e0-5b66-b3ae008d539d@linux.intel.com
>
The patch fixes the issue I reported.
Tested-by: Kan Liang <kan.liang@linux.intel.com>
Thanks,
Kan
> diff --git a/arch/x86/pci/mmconfig-shared.c b/arch/x86/pci/mmconfig-shared.c
> index 758cbfe55daa..4adc587a4c94 100644
> --- a/arch/x86/pci/mmconfig-shared.c
> +++ b/arch/x86/pci/mmconfig-shared.c
> @@ -12,6 +12,7 @@
> */
>
> #include <linux/acpi.h>
> +#include <linux/efi.h>
> #include <linux/pci.h>
> #include <linux/init.h>
> #include <linux/bitmap.h>
> @@ -442,6 +443,25 @@ static bool is_acpi_reserved(u64 start, u64 end, enum e820_type not_used)
> return mcfg_res.flags;
> }
>
> +static bool is_efi_reserved(u64 start, u64 end, enum e820_type not_used)
> +{
> + efi_memory_desc_t *md;
> + u64 size, mmio_start, mmio_end;
> +
> + for_each_efi_memory_desc(md) {
> + if (md->type == EFI_MEMORY_MAPPED_IO) {
> + size = md->num_pages << EFI_PAGE_SHIFT;
> + mmio_start = md->phys_addr;
> + mmio_end = mmio_start + size - 1;
> +
> + if (mmio_start <= start && end <= mmio_end)
> + return true;
> + }
> + }
> +
> + return false;
> +}
> +
> typedef bool (*check_reserved_t)(u64 start, u64 end, enum e820_type type);
>
> static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
> @@ -452,7 +472,7 @@ static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
> u64 size = resource_size(&cfg->res);
> u64 old_size = size;
> int num_buses;
> - char *method = with_e820 ? "E820" : "ACPI motherboard resources";
> + char *method = with_e820 ? "E820" : "ACPI motherboard resources or EFI";
>
> while (!is_reserved(addr, addr + size, E820_TYPE_RESERVED)) {
> size >>= 1;
> @@ -502,15 +522,17 @@ pci_mmcfg_check_reserved(struct device *dev, struct pci_mmcfg_region *cfg, int e
> if (!early && !acpi_disabled) {
> if (is_mmconf_reserved(is_acpi_reserved, cfg, dev, 0))
> return true;
> + if (is_mmconf_reserved(is_efi_reserved, cfg, dev, 0))
> + return true;
>
> if (dev)
> dev_info(dev, FW_INFO
> - "MMCONFIG at %pR not reserved in "
> + "MMCONFIG at %pR not reserved in EFI "
> "ACPI motherboard resources\n",
> &cfg->res);
> else
> pr_info(FW_INFO PREFIX
> - "MMCONFIG at %pR not reserved in "
> + "MMCONFIG at %pR not reserved in EFI or "
> "ACPI motherboard resources\n",
> &cfg->res);
> }
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-04 14:39 Bug report: the extended PCI config space is missed with 6.2-rc2 Liang, Kan
2023-01-04 14:50 ` Bjorn Helgaas
2023-01-05 22:32 ` Bjorn Helgaas
@ 2023-01-06 9:44 ` Linux kernel regression tracking (#adding)
2 siblings, 0 replies; 37+ messages in thread
From: Linux kernel regression tracking (#adding) @ 2023-01-06 9:44 UTC (permalink / raw)
To: Liang, Kan, bhelgaas
Cc: hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, david.e.box,
yunying.sun, regressions
[TLDR: I'm adding this report to the list of tracked Linux kernel
regressions; all text you find below is based on a few templates
paragraphs you might have encountered already already in similar form.
See link in footer if these mails annoy you.]
On 04.01.23 15:39, Liang, Kan wrote:
> Hi Bjorn,
>
> Happy new year!
>
> We found some PCI issues with the latest 6.2-rc2.
>
> - Using the lspci -xxxx, the extended PCI config space of all PCI
> devices are missed with the latest 6.2-rc2. The system we used had 932
> PCI devices, at least 800 which have extended space as seen when booted
> into a 5.15 kernel. But none of them appeared in 6.2-rc2.
> - The drivers which rely on the information in the extended PCI config
> space don't work anymore. We have confirmed that the perf uncore driver
> (uncore performance monitoring) and Intel VSEC driver (telemetry) don't
> work in 6.2-rc2. There could be more drivers which are impacted.
>
> After a bisect, we found the regression is caused by the below commit
> 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map").
> After reverting the commit, the issues are gone.
>
> Could you please take a look at the issues?
Thanks for the report. To be sure the issue doesn't fall through the
cracks unnoticed, I'm adding it to regzbot, the Linux kernel regression
tracking bot:
#regzbot ^introduced 07eab0901ede
#regzbot title x86/pci: extended PCI config space is missed
#regzbot ignore-activity
This isn't a regression? This issue or a fix for it are already
discussed somewhere else? It was fixed already? You want to clarify when
the regression started to happen? Or point out I got the title or
something else totally wrong? Then just reply and tell me -- ideally
while also telling regzbot about it, as explained by the page listed in
the footer of this mail.
Reminder for developers: When fixing the issue, add 'Link:' tags
pointing to the report (see page linked in footer for details).
Ciao, Thorsten (wearing his 'the Linux kernel's regression tracker' hat)
--
Everything you wanna know about Linux kernel regression tracking:
https://linux-regtracking.leemhuis.info/about/#tldr
That page also explains what to do if mails like this annoy you.
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-06 0:47 ` Bjorn Helgaas
@ 2023-01-06 17:33 ` Bjorn Helgaas
2023-01-06 18:03 ` Luck, Tony
0 siblings, 1 reply; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-06 17:33 UTC (permalink / raw)
To: Luck, Tony
Cc: Williams, Dan J, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying, Jiang, Dave
On Thu, Jan 05, 2023 at 06:47:44PM -0600, Bjorn Helgaas wrote:
> On Fri, Jan 06, 2023 at 12:22:09AM +0000, Luck, Tony wrote:
> > > ...and Dave, who reported that CXL enumeration was busted in -rc2, says
> > > this patch fixes that. So you can also add:
> > >
> > > Tested-by: Dave Jiang <dave.jiang@intel.com>
> >
> > Also seems good for my Broadwell/EDAC system.
> >
> > Boot messages mentioning MMCONFIG are:
> >
> > $ dmesg | grep MMCONFIG
> > PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
> > PCI: not using MMCONFIG
> > PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
> > PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in ACPI motherboard resources or EFI
>
> This part looks ok.
>
> > PCI: MMCONFIG for 0000 [bus00-7f] at [mem 0x80000000-0x87ffffff] (base 0x80000000) (size reduced!)
> > acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended configuration space under this bridge
> > acpi PNP0A03:01: fail to add MMCONFIG information, can't access extended configuration space under this bridge
> > acpi PNP0A08:02: fail to add MMCONFIG information, can't access extended configuration space under this bridge
> > acpi PNP0A08:03: fail to add MMCONFIG information, can't access extended configuration space under this bridge
>
> But the rest of this still looks like a regression. From your
> previous dmesg log:
>
> PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
> PNP0A03:00: host bridge to domain 0000 [bus ff]
> PNP0A03:01: host bridge to domain 0000 [bus bf]
> PNP0A03:02: host bridge to domain 0000 [bus 7f]
> PNP0A03:03: host bridge to domain 0000 [bus 3f]
> PNP0A08:00: host bridge to domain 0000 [bus 00-3e]
> PNP0A08:01: host bridge to domain 0000 [bus 40-7e]
> PNP0A08:02: host bridge to domain 0000 [bus 80-be]
> PNP0A08:03: host bridge to domain 0000 [bus c0-fe]
>
> That MMCONFIG space should cover all those buses, but something is
> going wrong.
Tony, would you mind collecting a dmesg log with "efi=debug"? I want
to see the EFI_MEMORY_MAPPED_IO size and what we remove from E820.
Bjorn
^ permalink raw reply [flat|nested] 37+ messages in thread
* RE: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-06 17:33 ` Bjorn Helgaas
@ 2023-01-06 18:03 ` Luck, Tony
2023-01-06 20:52 ` Bjorn Helgaas
0 siblings, 1 reply; 37+ messages in thread
From: Luck, Tony @ 2023-01-06 18:03 UTC (permalink / raw)
To: Bjorn Helgaas
Cc: Williams, Dan J, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying, Jiang, Dave
[-- Attachment #1: Type: text/plain, Size: 292 bytes --]
> Tony, would you mind collecting a dmesg log with "efi=debug"? I want
> to see the EFI_MEMORY_MAPPED_IO size and what we remove from E820.
Bjorn,
Booted the 6.2-rc1 kernel with the patch that you provided yesterday with efi=debug option.
Compressed dmesg file attached.
-Tony
[-- Attachment #2: dmesg.gz --]
[-- Type: application/x-gzip, Size: 36749 bytes --]
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-06 18:03 ` Luck, Tony
@ 2023-01-06 20:52 ` Bjorn Helgaas
2023-01-06 21:37 ` Luck, Tony
0 siblings, 1 reply; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-06 20:52 UTC (permalink / raw)
To: Luck, Tony
Cc: Williams, Dan J, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying, Jiang, Dave
On Fri, Jan 06, 2023 at 06:03:13PM +0000, Luck, Tony wrote:
> > Tony, would you mind collecting a dmesg log with "efi=debug"? I want
> > to see the EFI_MEMORY_MAPPED_IO size and what we remove from E820.
>
> Bjorn,
>
> Booted the 6.2-rc1 kernel with the patch that you provided yesterday with efi=debug option.
>
> Compressed dmesg file attached.
Thanks, Tony! Something is wrong with the EFI MMIO removal
(obviously), but I don't see what it is. Could you try the patch
below (replacement for previous one, with more debug)?
commit ce347c04cc2f ("x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space")
parent 1b929c02afd3
Author: Bjorn Helgaas <bhelgaas@google.com>
Date: Thu Jan 5 16:02:58 2023 -0600
x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space
Normally we reject ECAM space unless it is reported as reserved in the E820
table or via a PNP0C02 _CRS method (PCI Firmware, r3.3, sec 4.1.2). This
means extended config space (offsets 0x100-0xfff) may not be accessible.
Some firmware doesn't report ECAM space via PNP0C02 _CRS methods, but does
mention it as an EfiMemoryMappedIO region via EFI GetMemoryMap(), which is
normally converted to an E820 entry by a bootloader or EFI stub.
07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map"), removes
E820 entries that correspond to EfiMemoryMappedIO regions because some
other firmware uses EfiMemoryMappedIO for PCI host bridge windows, and the
E820 entries prevent Linux from allocating BAR space for hot-added devices.
Allow use of ECAM for extended config space when the region is covered by
an EfiMemoryMappedIO region, even if it's not included in E820 or PNP0C02
_CRS.
Fixes: 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map")
Link: https://lore.kernel.org/r/ac2693d8-8ba3-72e0-5b66-b3ae008d539d@linux.intel.com
diff --git a/arch/x86/pci/mmconfig-shared.c b/arch/x86/pci/mmconfig-shared.c
index 758cbfe55daa..07308f403649 100644
--- a/arch/x86/pci/mmconfig-shared.c
+++ b/arch/x86/pci/mmconfig-shared.c
@@ -12,6 +12,7 @@
*/
#include <linux/acpi.h>
+#include <linux/efi.h>
#include <linux/pci.h>
#include <linux/init.h>
#include <linux/bitmap.h>
@@ -442,6 +443,33 @@ static bool is_acpi_reserved(u64 start, u64 end, enum e820_type not_used)
return mcfg_res.flags;
}
+static bool is_efi_mmio(u64 start, u64 end, enum e820_type not_used)
+{
+ efi_memory_desc_t *md;
+ u64 size, mmio_start, mmio_end;
+
+ pr_info("is_efi_mmio %#lx-%#lx\n",
+ (unsigned long) start, (unsigned long) end);
+ for_each_efi_memory_desc(md) {
+ if (md->type == EFI_MEMORY_MAPPED_IO) {
+ size = md->num_pages << EFI_PAGE_SHIFT;
+ mmio_start = md->phys_addr;
+ mmio_end = mmio_start + size - 1;
+
+ pr_info(" efi_mmio %#lx-%#lx\n",
+ (unsigned long) mmio_start,
+ (unsigned long) mmio_end);
+ if (mmio_start <= start && end <= mmio_end) {
+ pr_info("is_efi_mmio true\n");
+ return true;
+ }
+ }
+ }
+
+ pr_info("is_efi_mmio false\n");
+ return false;
+}
+
typedef bool (*check_reserved_t)(u64 start, u64 end, enum e820_type type);
static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
@@ -452,23 +480,24 @@ static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
u64 size = resource_size(&cfg->res);
u64 old_size = size;
int num_buses;
- char *method = with_e820 ? "E820" : "ACPI motherboard resources";
+ char *method = with_e820 ? "E820" : "ACPI motherboard resources or EFI";
+ pr_info("is_mmconf_reserved %ps [bus %02x-%02x] %pR\n",
+ is_reserved, cfg->start_bus, cfg->end_bus, &cfg->res);
while (!is_reserved(addr, addr + size, E820_TYPE_RESERVED)) {
+ pr_info(" %#lx-%#lx (size %#lx) not reserved\n",
+ (unsigned long) addr, (unsigned long) (addr + size - 1),
+ (unsigned long) size);
size >>= 1;
+ pr_info(" size reduced to %#lx\n", (unsigned long) size);
if (size < (16UL<<20))
break;
}
- if (size < (16UL<<20) && size != old_size)
+ if (size < (16UL<<20) && size != old_size) {
+ pr_info("is_mmconf_reserved %ps false\n", is_reserved);
return false;
-
- if (dev)
- dev_info(dev, "MMCONFIG at %pR reserved in %s\n",
- &cfg->res, method);
- else
- pr_info(PREFIX "MMCONFIG at %pR reserved in %s\n",
- &cfg->res, method);
+ }
if (old_size != size) {
/* update end_bus */
@@ -487,30 +516,42 @@ static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
&cfg->res, (unsigned long) cfg->address);
else
pr_info(PREFIX
- "MMCONFIG for %04x [bus%02x-%02x] "
+ "MMCONFIG for %04x [bus %02x-%02x] "
"at %pR (base %#lx) (size reduced!)\n",
cfg->segment, cfg->start_bus, cfg->end_bus,
&cfg->res, (unsigned long) cfg->address);
}
+ if (dev)
+ dev_info(dev, "MMCONFIG at %pR reserved in %s\n",
+ &cfg->res, method);
+ else
+ pr_info(PREFIX "MMCONFIG at %pR reserved in %s\n",
+ &cfg->res, method);
+
return true;
}
static bool __ref
pci_mmcfg_check_reserved(struct device *dev, struct pci_mmcfg_region *cfg, int early)
{
+ pr_info("pci_mmcfg_check_reserved([bus %02x-%02x] %pR, %s)\n",
+ cfg->start_bus, cfg->end_bus, &cfg->res,
+ early ? "early" : "late");
if (!early && !acpi_disabled) {
if (is_mmconf_reserved(is_acpi_reserved, cfg, dev, 0))
return true;
+ if (is_mmconf_reserved(is_efi_mmio, cfg, dev, 0))
+ return true;
if (dev)
dev_info(dev, FW_INFO
- "MMCONFIG at %pR not reserved in "
+ "MMCONFIG at %pR not reserved in EFI or "
"ACPI motherboard resources\n",
&cfg->res);
else
pr_info(FW_INFO PREFIX
- "MMCONFIG at %pR not reserved in "
+ "MMCONFIG at %pR not reserved in EFI or "
"ACPI motherboard resources\n",
&cfg->res);
}
@@ -536,6 +577,7 @@ static void __init pci_mmcfg_reject_broken(int early)
{
struct pci_mmcfg_region *cfg;
+ pr_info("pci_mmcfg_reject_broken(%s)\n", early ? "early" : "late");
list_for_each_entry(cfg, &pci_mmcfg_list, list) {
if (pci_mmcfg_check_reserved(NULL, cfg, early) == 0) {
pr_info(PREFIX "not using MMCONFIG\n");
@@ -570,6 +612,7 @@ static int __init pci_parse_mcfg(struct acpi_table_header *header)
unsigned long i;
int entries;
+ pr_info("pci_parse_mcfg\n");
if (!header)
return -EINVAL;
@@ -661,6 +704,7 @@ static int __initdata known_bridge;
void __init pci_mmcfg_early_init(void)
{
+ pr_info("pci_mmcfg_early_init\n");
if (pci_probe & PCI_PROBE_MMCONF) {
if (pci_mmcfg_check_hostbridge())
known_bridge = 1;
@@ -674,6 +718,7 @@ void __init pci_mmcfg_early_init(void)
void __init pci_mmcfg_late_init(void)
{
+ pr_info("pci_mmcfg_late_init\n");
/* MMCONFIG disabled */
if ((pci_probe & PCI_PROBE_MMCONF) == 0)
return;
@@ -725,6 +770,8 @@ int pci_mmconfig_insert(struct device *dev, u16 seg, u8 start, u8 end,
struct resource *tmp = NULL;
struct pci_mmcfg_region *cfg;
+ dev_info(dev, "pci_mmconfig_insert %02x-%02x addr %#lx\n",
+ start, end, (unsigned long)addr);
if (!(pci_probe & PCI_PROBE_MMCONF) || pci_mmcfg_arch_init_failed)
return -ENODEV;
@@ -788,6 +835,7 @@ int pci_mmconfig_insert(struct device *dev, u16 seg, u8 start, u8 end,
mutex_unlock(&pci_mmcfg_lock);
+ dev_info(dev, "pci_mmconfig_insert returns %d\n", rc);
return rc;
}
^ permalink raw reply related [flat|nested] 37+ messages in thread
* RE: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-06 20:52 ` Bjorn Helgaas
@ 2023-01-06 21:37 ` Luck, Tony
2023-01-06 22:04 ` Bjorn Helgaas
0 siblings, 1 reply; 37+ messages in thread
From: Luck, Tony @ 2023-01-06 21:37 UTC (permalink / raw)
To: Bjorn Helgaas
Cc: Williams, Dan J, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying, Jiang, Dave
[-- Attachment #1: Type: text/plain, Size: 290 bytes --]
> Thanks, Tony! Something is wrong with the EFI MMIO removal
> (obviously), but I don't see what it is. Could you try the patch
> below (replacement for previous one, with more debug)?
Swapped out old patch for this new one. Booted with efi-debug
New dmesg attached.
-Tony
[-- Attachment #2: dmesg.gz --]
[-- Type: application/x-gzip, Size: 37436 bytes --]
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-06 21:37 ` Luck, Tony
@ 2023-01-06 22:04 ` Bjorn Helgaas
2023-01-06 22:30 ` Luck, Tony
` (2 more replies)
0 siblings, 3 replies; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-06 22:04 UTC (permalink / raw)
To: Luck, Tony
Cc: Williams, Dan J, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying, Jiang, Dave
On Fri, Jan 06, 2023 at 09:37:06PM +0000, Luck, Tony wrote:
> > Thanks, Tony! Something is wrong with the EFI MMIO removal
> > (obviously), but I don't see what it is. Could you try the patch
> > below (replacement for previous one, with more debug)?
>
> Swapped out old patch for this new one. Booted with efi-debug
>
> New dmesg attached.
Thanks! Ah, off-by-one error because e820__mapped_all() expects
"[start, end)" which means is_acpi_reserved() and is_efi_mmio() must
use the same, and I was thinking "[start, end]" like a struct
resource.
The below should work better.
commit 696ac9286d3d ("x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space")
parent 1b929c02afd3
Author: Bjorn Helgaas <bhelgaas@google.com>
Date: Thu Jan 5 16:02:58 2023 -0600
x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space
Normally we reject ECAM space unless it is reported as reserved in the E820
table or via a PNP0C02 _CRS method (PCI Firmware, r3.3, sec 4.1.2). This
means extended config space (offsets 0x100-0xfff) may not be accessible.
Some firmware doesn't report ECAM space via PNP0C02 _CRS methods, but does
mention it as an EfiMemoryMappedIO region via EFI GetMemoryMap(), which is
normally converted to an E820 entry by a bootloader or EFI stub.
07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map"), removes
E820 entries that correspond to EfiMemoryMappedIO regions because some
other firmware uses EfiMemoryMappedIO for PCI host bridge windows, and the
E820 entries prevent Linux from allocating BAR space for hot-added devices.
Allow use of ECAM for extended config space when the region is covered by
an EfiMemoryMappedIO region, even if it's not included in E820 or PNP0C02
_CRS.
Fixes: 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map")
Link: https://lore.kernel.org/r/ac2693d8-8ba3-72e0-5b66-b3ae008d539d@linux.intel.com
diff --git a/arch/x86/pci/mmconfig-shared.c b/arch/x86/pci/mmconfig-shared.c
index 758cbfe55daa..5c6cadd60fef 100644
--- a/arch/x86/pci/mmconfig-shared.c
+++ b/arch/x86/pci/mmconfig-shared.c
@@ -12,6 +12,7 @@
*/
#include <linux/acpi.h>
+#include <linux/efi.h>
#include <linux/pci.h>
#include <linux/init.h>
#include <linux/bitmap.h>
@@ -442,6 +443,34 @@ static bool is_acpi_reserved(u64 start, u64 end, enum e820_type not_used)
return mcfg_res.flags;
}
+static bool is_efi_mmio(u64 start, u64 end, enum e820_type not_used)
+{
+ efi_memory_desc_t *md;
+ u64 size, mmio_start, mmio_end;
+
+ end--; /* caller supplies start, end = start + size */
+ pr_info("is_efi_mmio %#lx-%#lx\n",
+ (unsigned long) start, (unsigned long) end);
+ for_each_efi_memory_desc(md) {
+ if (md->type == EFI_MEMORY_MAPPED_IO) {
+ size = md->num_pages << EFI_PAGE_SHIFT;
+ mmio_start = md->phys_addr;
+ mmio_end = mmio_start + size - 1;
+
+ pr_info(" efi_mmio %#lx-%#lx\n",
+ (unsigned long) mmio_start,
+ (unsigned long) mmio_end);
+ if (mmio_start <= start && end <= mmio_end) {
+ pr_info("is_efi_mmio true\n");
+ return true;
+ }
+ }
+ }
+
+ pr_info("is_efi_mmio false\n");
+ return false;
+}
+
typedef bool (*check_reserved_t)(u64 start, u64 end, enum e820_type type);
static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
@@ -452,23 +481,24 @@ static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
u64 size = resource_size(&cfg->res);
u64 old_size = size;
int num_buses;
- char *method = with_e820 ? "E820" : "ACPI motherboard resources";
+ char *method = with_e820 ? "E820" : "ACPI motherboard resources or EFI";
+ pr_info("is_mmconf_reserved %ps [bus %02x-%02x] %pR\n",
+ is_reserved, cfg->start_bus, cfg->end_bus, &cfg->res);
while (!is_reserved(addr, addr + size, E820_TYPE_RESERVED)) {
+ pr_info(" %#lx-%#lx (size %#lx) not reserved\n",
+ (unsigned long) addr, (unsigned long) (addr + size - 1),
+ (unsigned long) size);
size >>= 1;
+ pr_info(" size reduced to %#lx\n", (unsigned long) size);
if (size < (16UL<<20))
break;
}
- if (size < (16UL<<20) && size != old_size)
+ if (size < (16UL<<20) && size != old_size) {
+ pr_info("is_mmconf_reserved %ps false\n", is_reserved);
return false;
-
- if (dev)
- dev_info(dev, "MMCONFIG at %pR reserved in %s\n",
- &cfg->res, method);
- else
- pr_info(PREFIX "MMCONFIG at %pR reserved in %s\n",
- &cfg->res, method);
+ }
if (old_size != size) {
/* update end_bus */
@@ -487,30 +517,42 @@ static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
&cfg->res, (unsigned long) cfg->address);
else
pr_info(PREFIX
- "MMCONFIG for %04x [bus%02x-%02x] "
+ "MMCONFIG for %04x [bus %02x-%02x] "
"at %pR (base %#lx) (size reduced!)\n",
cfg->segment, cfg->start_bus, cfg->end_bus,
&cfg->res, (unsigned long) cfg->address);
}
+ if (dev)
+ dev_info(dev, "MMCONFIG at %pR reserved in %s\n",
+ &cfg->res, method);
+ else
+ pr_info(PREFIX "MMCONFIG at %pR reserved in %s\n",
+ &cfg->res, method);
+
return true;
}
static bool __ref
pci_mmcfg_check_reserved(struct device *dev, struct pci_mmcfg_region *cfg, int early)
{
+ pr_info("pci_mmcfg_check_reserved([bus %02x-%02x] %pR, %s)\n",
+ cfg->start_bus, cfg->end_bus, &cfg->res,
+ early ? "early" : "late");
if (!early && !acpi_disabled) {
if (is_mmconf_reserved(is_acpi_reserved, cfg, dev, 0))
return true;
+ if (is_mmconf_reserved(is_efi_mmio, cfg, dev, 0))
+ return true;
if (dev)
dev_info(dev, FW_INFO
- "MMCONFIG at %pR not reserved in "
+ "MMCONFIG at %pR not reserved in EFI or "
"ACPI motherboard resources\n",
&cfg->res);
else
pr_info(FW_INFO PREFIX
- "MMCONFIG at %pR not reserved in "
+ "MMCONFIG at %pR not reserved in EFI or "
"ACPI motherboard resources\n",
&cfg->res);
}
@@ -536,6 +578,7 @@ static void __init pci_mmcfg_reject_broken(int early)
{
struct pci_mmcfg_region *cfg;
+ pr_info("pci_mmcfg_reject_broken(%s)\n", early ? "early" : "late");
list_for_each_entry(cfg, &pci_mmcfg_list, list) {
if (pci_mmcfg_check_reserved(NULL, cfg, early) == 0) {
pr_info(PREFIX "not using MMCONFIG\n");
@@ -570,6 +613,7 @@ static int __init pci_parse_mcfg(struct acpi_table_header *header)
unsigned long i;
int entries;
+ pr_info("pci_parse_mcfg\n");
if (!header)
return -EINVAL;
@@ -661,6 +705,7 @@ static int __initdata known_bridge;
void __init pci_mmcfg_early_init(void)
{
+ pr_info("pci_mmcfg_early_init\n");
if (pci_probe & PCI_PROBE_MMCONF) {
if (pci_mmcfg_check_hostbridge())
known_bridge = 1;
@@ -674,6 +719,7 @@ void __init pci_mmcfg_early_init(void)
void __init pci_mmcfg_late_init(void)
{
+ pr_info("pci_mmcfg_late_init\n");
/* MMCONFIG disabled */
if ((pci_probe & PCI_PROBE_MMCONF) == 0)
return;
@@ -725,6 +771,8 @@ int pci_mmconfig_insert(struct device *dev, u16 seg, u8 start, u8 end,
struct resource *tmp = NULL;
struct pci_mmcfg_region *cfg;
+ dev_info(dev, "pci_mmconfig_insert %02x-%02x addr %#lx\n",
+ start, end, (unsigned long)addr);
if (!(pci_probe & PCI_PROBE_MMCONF) || pci_mmcfg_arch_init_failed)
return -ENODEV;
@@ -788,6 +836,7 @@ int pci_mmconfig_insert(struct device *dev, u16 seg, u8 start, u8 end,
mutex_unlock(&pci_mmcfg_lock);
+ dev_info(dev, "pci_mmconfig_insert returns %d\n", rc);
return rc;
}
^ permalink raw reply related [flat|nested] 37+ messages in thread
* RE: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-06 22:04 ` Bjorn Helgaas
@ 2023-01-06 22:30 ` Luck, Tony
2023-01-10 5:43 ` Sun, Yunying
2023-01-10 18:12 ` Rafael J. Wysocki
2 siblings, 0 replies; 37+ messages in thread
From: Luck, Tony @ 2023-01-06 22:30 UTC (permalink / raw)
To: Bjorn Helgaas
Cc: Williams, Dan J, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying, Jiang, Dave
[-- Attachment #1: Type: text/plain, Size: 760 bytes --]
> Thanks! Ah, off-by-one error because e820__mapped_all() expects
> "[start, end)" which means is_acpi_reserved() and is_efi_mmio() must
> use the same, and I was thinking "[start, end]" like a struct
> resource.
>
> The below should work better.
Applied in place of earlier patch.
The basic MMCONFIG messages look better:
$ dmesg | grep MMCONFIG
[ 12.985055] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[ 13.078050] PCI: not using MMCONFIG
[ 13.666053] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[ 13.795049] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in ACPI motherboard resources or EFI
Full dmesg attached.
-Tony
[-- Attachment #2: dmesg.gz --]
[-- Type: application/x-gzip, Size: 36852 bytes --]
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 22:32 ` Bjorn Helgaas
2023-01-05 23:38 ` Dan Williams
2023-01-06 0:50 ` Liang, Kan
@ 2023-01-09 12:27 ` Giovanni Cabiddu
2023-01-10 6:03 ` Sun, Yunying
3 siblings, 0 replies; 37+ messages in thread
From: Giovanni Cabiddu @ 2023-01-09 12:27 UTC (permalink / raw)
To: Bjorn Helgaas
Cc: Liang, Kan, bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, david.e.box,
yunying.sun, Tony Luck, Dan Williams, Herbert Xu, linux-crypto
[+cc Herbert, linux-crypto ML as it affects QAT]
On Thu, Jan 05, 2023 at 04:32:57PM -0600, Bjorn Helgaas wrote:
> [+cc Tony, Dan]
>
> On Wed, Jan 04, 2023 at 09:39:56AM -0500, Liang, Kan wrote:
> > Hi Bjorn,
> >
> > Happy new year!
> >
> > We found some PCI issues with the latest 6.2-rc2.
> >
> > - Using the lspci -xxxx, the extended PCI config space of all PCI
> > devices are missed with the latest 6.2-rc2. The system we used had 932
> > PCI devices, at least 800 which have extended space as seen when booted
> > into a 5.15 kernel. But none of them appeared in 6.2-rc2.
> > - The drivers which rely on the information in the extended PCI config
> > space don't work anymore. We have confirmed that the perf uncore driver
> > (uncore performance monitoring) and Intel VSEC driver (telemetry) don't
> > work in 6.2-rc2. There could be more drivers which are impacted.
> >
> > After a bisect, we found the regression is caused by the below commit
> > 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map").
> > After reverting the commit, the issues are gone.
This patch also affects all the QAT drivers, and causes them to fail
during the probe when they look at data from the extended PCI config
space.
Herbert, FYI, this patch is in your cryptodev-2.6 tree.
I tried the patch below and it seems to resolve the problem on my
system (S2600WFQ with Skylake).
> Can you try this patch (based on v6.2-rc1):
>
>
> commit 89a0067217b0 ("x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space")
> parent 1b929c02afd3
> Author: Bjorn Helgaas <bhelgaas@google.com>
> Date: Thu Jan 5 16:02:58 2023 -0600
>
> x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space
>
> Normally we reject ECAM space unless it is reported as reserved in the E820
> table or via a PNP0C02 _CRS method (PCI Firmware, r3.3, sec 4.1.2). This
> means extended config space (offsets 0x100-0xfff) may not be accessible.
>
> Some firmware doesn't report ECAM space via PNP0C02 _CRS methods, but does
> mention it as an EfiMemoryMappedIO region via EFI GetMemoryMap(), which is
> normally converted to an E820 entry by a bootloader or EFI stub.
>
> 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map"), removes
> E820 entries that correspond to EfiMemoryMappedIO regions because some
> other firmware uses EfiMemoryMappedIO for PCI host bridge windows, and the
> E820 entries prevent Linux from allocating BAR space for hot-added devices.
>
> Allow use of ECAM for extended config space when the region is covered by
> an EfiMemoryMappedIO region, even if it's not included in E820 or PNP0C02
> _CRS.
>
> Fixes: 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map")
> Link: https://lore.kernel.org/r/ac2693d8-8ba3-72e0-5b66-b3ae008d539d@linux.intel.com
>
> diff --git a/arch/x86/pci/mmconfig-shared.c b/arch/x86/pci/mmconfig-shared.c
> index 758cbfe55daa..4adc587a4c94 100644
> --- a/arch/x86/pci/mmconfig-shared.c
> +++ b/arch/x86/pci/mmconfig-shared.c
> @@ -12,6 +12,7 @@
> */
>
> #include <linux/acpi.h>
> +#include <linux/efi.h>
> #include <linux/pci.h>
> #include <linux/init.h>
> #include <linux/bitmap.h>
> @@ -442,6 +443,25 @@ static bool is_acpi_reserved(u64 start, u64 end, enum e820_type not_used)
> return mcfg_res.flags;
> }
>
> +static bool is_efi_reserved(u64 start, u64 end, enum e820_type not_used)
> +{
> + efi_memory_desc_t *md;
> + u64 size, mmio_start, mmio_end;
> +
> + for_each_efi_memory_desc(md) {
> + if (md->type == EFI_MEMORY_MAPPED_IO) {
> + size = md->num_pages << EFI_PAGE_SHIFT;
> + mmio_start = md->phys_addr;
> + mmio_end = mmio_start + size - 1;
> +
> + if (mmio_start <= start && end <= mmio_end)
> + return true;
> + }
> + }
> +
> + return false;
> +}
> +
> typedef bool (*check_reserved_t)(u64 start, u64 end, enum e820_type type);
>
> static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
> @@ -452,7 +472,7 @@ static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
> u64 size = resource_size(&cfg->res);
> u64 old_size = size;
> int num_buses;
> - char *method = with_e820 ? "E820" : "ACPI motherboard resources";
> + char *method = with_e820 ? "E820" : "ACPI motherboard resources or EFI";
>
> while (!is_reserved(addr, addr + size, E820_TYPE_RESERVED)) {
> size >>= 1;
> @@ -502,15 +522,17 @@ pci_mmcfg_check_reserved(struct device *dev, struct pci_mmcfg_region *cfg, int e
> if (!early && !acpi_disabled) {
> if (is_mmconf_reserved(is_acpi_reserved, cfg, dev, 0))
> return true;
> + if (is_mmconf_reserved(is_efi_reserved, cfg, dev, 0))
> + return true;
>
> if (dev)
> dev_info(dev, FW_INFO
> - "MMCONFIG at %pR not reserved in "
> + "MMCONFIG at %pR not reserved in EFI "
> "ACPI motherboard resources\n",
> &cfg->res);
> else
> pr_info(FW_INFO PREFIX
> - "MMCONFIG at %pR not reserved in "
> + "MMCONFIG at %pR not reserved in EFI or "
> "ACPI motherboard resources\n",
> &cfg->res);
> }
Tested-by: Giovanni Cabiddu <giovanni.cabiddu@intel.com>
Regards,
--
Giovanni
^ permalink raw reply [flat|nested] 37+ messages in thread
* RE: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-06 22:04 ` Bjorn Helgaas
2023-01-06 22:30 ` Luck, Tony
@ 2023-01-10 5:43 ` Sun, Yunying
2023-01-10 18:12 ` Rafael J. Wysocki
2 siblings, 0 replies; 37+ messages in thread
From: Sun, Yunying @ 2023-01-10 5:43 UTC (permalink / raw)
To: Bjorn Helgaas, Luck, Tony, Liang, Kan
Cc: Williams, Dan J, bhelgaas, hdegoede, kernelorg, kjhambrick,
2lprbe78, nicholas.johnson-opensource, benoitg, mika.westerberg,
wse, mumblingdrunkard, linux-pci, linux-kernel, Box, David E,
Jiang, Dave
Verified this updated patch on SPR DNP and SPR MCC, it fixes the perf uncore driver not working issue.
Tested-by: Yunying Sun <yunying.sun@intel.com>
-Yunying
-----Original Message-----
From: Bjorn Helgaas <helgaas@kernel.org>
Sent: Saturday, 7 January, 2023 06:05
To: Luck, Tony <tony.luck@intel.com>
Cc: Williams, Dan J <dan.j.williams@intel.com>; Liang, Kan <kan.liang@linux.intel.com>; bhelgaas@google.com; hdegoede@redhat.com; kernelorg@undead.fr; kjhambrick@gmail.com; 2lprbe78@duck.com; nicholas.johnson-opensource@outlook.com.au; benoitg@coeus.ca; mika.westerberg@linux.intel.com; wse@tuxedocomputers.com; mumblingdrunkard@protonmail.com; linux-pci@vger.kernel.org; linux-kernel@vger.kernel.org; Box, David E <david.e.box@intel.com>; Sun, Yunying <yunying.sun@intel.com>; Jiang, Dave <dave.jiang@intel.com>
Subject: Re: Bug report: the extended PCI config space is missed with 6.2-rc2
On Fri, Jan 06, 2023 at 09:37:06PM +0000, Luck, Tony wrote:
> > Thanks, Tony! Something is wrong with the EFI MMIO removal
> > (obviously), but I don't see what it is. Could you try the patch
> > below (replacement for previous one, with more debug)?
>
> Swapped out old patch for this new one. Booted with efi-debug
>
> New dmesg attached.
Thanks! Ah, off-by-one error because e820__mapped_all() expects "[start, end)" which means is_acpi_reserved() and is_efi_mmio() must use the same, and I was thinking "[start, end]" like a struct resource.
The below should work better.
commit 696ac9286d3d ("x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space") parent 1b929c02afd3
Author: Bjorn Helgaas <bhelgaas@google.com>
Date: Thu Jan 5 16:02:58 2023 -0600
x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space
Normally we reject ECAM space unless it is reported as reserved in the E820
table or via a PNP0C02 _CRS method (PCI Firmware, r3.3, sec 4.1.2). This
means extended config space (offsets 0x100-0xfff) may not be accessible.
Some firmware doesn't report ECAM space via PNP0C02 _CRS methods, but does
mention it as an EfiMemoryMappedIO region via EFI GetMemoryMap(), which is
normally converted to an E820 entry by a bootloader or EFI stub.
07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map"), removes
E820 entries that correspond to EfiMemoryMappedIO regions because some
other firmware uses EfiMemoryMappedIO for PCI host bridge windows, and the
E820 entries prevent Linux from allocating BAR space for hot-added devices.
Allow use of ECAM for extended config space when the region is covered by
an EfiMemoryMappedIO region, even if it's not included in E820 or PNP0C02
_CRS.
Fixes: 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map")
Link: https://lore.kernel.org/r/ac2693d8-8ba3-72e0-5b66-b3ae008d539d@linux.intel.com
diff --git a/arch/x86/pci/mmconfig-shared.c b/arch/x86/pci/mmconfig-shared.c index 758cbfe55daa..5c6cadd60fef 100644
--- a/arch/x86/pci/mmconfig-shared.c
+++ b/arch/x86/pci/mmconfig-shared.c
@@ -12,6 +12,7 @@
*/
#include <linux/acpi.h>
+#include <linux/efi.h>
#include <linux/pci.h>
#include <linux/init.h>
#include <linux/bitmap.h>
@@ -442,6 +443,34 @@ static bool is_acpi_reserved(u64 start, u64 end, enum e820_type not_used)
return mcfg_res.flags;
}
+static bool is_efi_mmio(u64 start, u64 end, enum e820_type not_used) {
+ efi_memory_desc_t *md;
+ u64 size, mmio_start, mmio_end;
+
+ end--; /* caller supplies start, end = start + size */
+ pr_info("is_efi_mmio %#lx-%#lx\n",
+ (unsigned long) start, (unsigned long) end);
+ for_each_efi_memory_desc(md) {
+ if (md->type == EFI_MEMORY_MAPPED_IO) {
+ size = md->num_pages << EFI_PAGE_SHIFT;
+ mmio_start = md->phys_addr;
+ mmio_end = mmio_start + size - 1;
+
+ pr_info(" efi_mmio %#lx-%#lx\n",
+ (unsigned long) mmio_start,
+ (unsigned long) mmio_end);
+ if (mmio_start <= start && end <= mmio_end) {
+ pr_info("is_efi_mmio true\n");
+ return true;
+ }
+ }
+ }
+
+ pr_info("is_efi_mmio false\n");
+ return false;
+}
+
typedef bool (*check_reserved_t)(u64 start, u64 end, enum e820_type type);
static bool __ref is_mmconf_reserved(check_reserved_t is_reserved, @@ -452,23 +481,24 @@ static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
u64 size = resource_size(&cfg->res);
u64 old_size = size;
int num_buses;
- char *method = with_e820 ? "E820" : "ACPI motherboard resources";
+ char *method = with_e820 ? "E820" : "ACPI motherboard resources or
+EFI";
+ pr_info("is_mmconf_reserved %ps [bus %02x-%02x] %pR\n",
+ is_reserved, cfg->start_bus, cfg->end_bus, &cfg->res);
while (!is_reserved(addr, addr + size, E820_TYPE_RESERVED)) {
+ pr_info(" %#lx-%#lx (size %#lx) not reserved\n",
+ (unsigned long) addr, (unsigned long) (addr + size - 1),
+ (unsigned long) size);
size >>= 1;
+ pr_info(" size reduced to %#lx\n", (unsigned long) size);
if (size < (16UL<<20))
break;
}
- if (size < (16UL<<20) && size != old_size)
+ if (size < (16UL<<20) && size != old_size) {
+ pr_info("is_mmconf_reserved %ps false\n", is_reserved);
return false;
-
- if (dev)
- dev_info(dev, "MMCONFIG at %pR reserved in %s\n",
- &cfg->res, method);
- else
- pr_info(PREFIX "MMCONFIG at %pR reserved in %s\n",
- &cfg->res, method);
+ }
if (old_size != size) {
/* update end_bus */
@@ -487,30 +517,42 @@ static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
&cfg->res, (unsigned long) cfg->address);
else
pr_info(PREFIX
- "MMCONFIG for %04x [bus%02x-%02x] "
+ "MMCONFIG for %04x [bus %02x-%02x] "
"at %pR (base %#lx) (size reduced!)\n",
cfg->segment, cfg->start_bus, cfg->end_bus,
&cfg->res, (unsigned long) cfg->address);
}
+ if (dev)
+ dev_info(dev, "MMCONFIG at %pR reserved in %s\n",
+ &cfg->res, method);
+ else
+ pr_info(PREFIX "MMCONFIG at %pR reserved in %s\n",
+ &cfg->res, method);
+
return true;
}
static bool __ref
pci_mmcfg_check_reserved(struct device *dev, struct pci_mmcfg_region *cfg, int early) {
+ pr_info("pci_mmcfg_check_reserved([bus %02x-%02x] %pR, %s)\n",
+ cfg->start_bus, cfg->end_bus, &cfg->res,
+ early ? "early" : "late");
if (!early && !acpi_disabled) {
if (is_mmconf_reserved(is_acpi_reserved, cfg, dev, 0))
return true;
+ if (is_mmconf_reserved(is_efi_mmio, cfg, dev, 0))
+ return true;
if (dev)
dev_info(dev, FW_INFO
- "MMCONFIG at %pR not reserved in "
+ "MMCONFIG at %pR not reserved in EFI or "
"ACPI motherboard resources\n",
&cfg->res);
else
pr_info(FW_INFO PREFIX
- "MMCONFIG at %pR not reserved in "
+ "MMCONFIG at %pR not reserved in EFI or "
"ACPI motherboard resources\n",
&cfg->res);
}
@@ -536,6 +578,7 @@ static void __init pci_mmcfg_reject_broken(int early) {
struct pci_mmcfg_region *cfg;
+ pr_info("pci_mmcfg_reject_broken(%s)\n", early ? "early" : "late");
list_for_each_entry(cfg, &pci_mmcfg_list, list) {
if (pci_mmcfg_check_reserved(NULL, cfg, early) == 0) {
pr_info(PREFIX "not using MMCONFIG\n"); @@ -570,6 +613,7 @@ static int __init pci_parse_mcfg(struct acpi_table_header *header)
unsigned long i;
int entries;
+ pr_info("pci_parse_mcfg\n");
if (!header)
return -EINVAL;
@@ -661,6 +705,7 @@ static int __initdata known_bridge;
void __init pci_mmcfg_early_init(void)
{
+ pr_info("pci_mmcfg_early_init\n");
if (pci_probe & PCI_PROBE_MMCONF) {
if (pci_mmcfg_check_hostbridge())
known_bridge = 1;
@@ -674,6 +719,7 @@ void __init pci_mmcfg_early_init(void)
void __init pci_mmcfg_late_init(void)
{
+ pr_info("pci_mmcfg_late_init\n");
/* MMCONFIG disabled */
if ((pci_probe & PCI_PROBE_MMCONF) == 0)
return;
@@ -725,6 +771,8 @@ int pci_mmconfig_insert(struct device *dev, u16 seg, u8 start, u8 end,
struct resource *tmp = NULL;
struct pci_mmcfg_region *cfg;
+ dev_info(dev, "pci_mmconfig_insert %02x-%02x addr %#lx\n",
+ start, end, (unsigned long)addr);
if (!(pci_probe & PCI_PROBE_MMCONF) || pci_mmcfg_arch_init_failed)
return -ENODEV;
@@ -788,6 +836,7 @@ int pci_mmconfig_insert(struct device *dev, u16 seg, u8 start, u8 end,
mutex_unlock(&pci_mmcfg_lock);
+ dev_info(dev, "pci_mmconfig_insert returns %d\n", rc);
return rc;
}
^ permalink raw reply [flat|nested] 37+ messages in thread
* RE: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-05 22:32 ` Bjorn Helgaas
` (2 preceding siblings ...)
2023-01-09 12:27 ` Giovanni Cabiddu
@ 2023-01-10 6:03 ` Sun, Yunying
3 siblings, 0 replies; 37+ messages in thread
From: Sun, Yunying @ 2023-01-10 6:03 UTC (permalink / raw)
To: Bjorn Helgaas, Liang, Kan
Cc: bhelgaas, hdegoede, kernelorg, kjhambrick, 2lprbe78,
nicholas.johnson-opensource, benoitg, mika.westerberg, wse,
mumblingdrunkard, linux-pci, linux-kernel, Box, David E, Luck,
Tony, Williams, Dan J
[-- Attachment #1: Type: text/plain, Size: 5468 bytes --]
Hi Bjorn,
I tested this first version patch too. It fixes the uncore driver issue on SPR DNP, but does not work on SPR MCC.
Compressed dmesg files attached.
-Yunying
-----Original Message-----
From: Bjorn Helgaas <helgaas@kernel.org>
Sent: Friday, 6 January, 2023 06:33
To: Liang, Kan <kan.liang@linux.intel.com>
Cc: bhelgaas@google.com; hdegoede@redhat.com; kernelorg@undead.fr; kjhambrick@gmail.com; 2lprbe78@duck.com; nicholas.johnson-opensource@outlook.com.au; benoitg@coeus.ca; mika.westerberg@linux.intel.com; wse@tuxedocomputers.com; mumblingdrunkard@protonmail.com; linux-pci@vger.kernel.org; linux-kernel@vger.kernel.org; Box, David E <david.e.box@intel.com>; Sun, Yunying <yunying.sun@intel.com>; Luck, Tony <tony.luck@intel.com>; Williams, Dan J <dan.j.williams@intel.com>
Subject: Re: Bug report: the extended PCI config space is missed with 6.2-rc2
[+cc Tony, Dan]
On Wed, Jan 04, 2023 at 09:39:56AM -0500, Liang, Kan wrote:
> Hi Bjorn,
>
> Happy new year!
>
> We found some PCI issues with the latest 6.2-rc2.
>
> - Using the lspci -xxxx, the extended PCI config space of all PCI
> devices are missed with the latest 6.2-rc2. The system we used had 932
> PCI devices, at least 800 which have extended space as seen when
> booted into a 5.15 kernel. But none of them appeared in 6.2-rc2.
> - The drivers which rely on the information in the extended PCI config
> space don't work anymore. We have confirmed that the perf uncore
> driver (uncore performance monitoring) and Intel VSEC driver
> (telemetry) don't work in 6.2-rc2. There could be more drivers which are impacted.
>
> After a bisect, we found the regression is caused by the below commit
> 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map").
> After reverting the commit, the issues are gone.
Can you try this patch (based on v6.2-rc1):
commit 89a0067217b0 ("x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space") parent 1b929c02afd3
Author: Bjorn Helgaas <bhelgaas@google.com>
Date: Thu Jan 5 16:02:58 2023 -0600
x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space
Normally we reject ECAM space unless it is reported as reserved in the E820
table or via a PNP0C02 _CRS method (PCI Firmware, r3.3, sec 4.1.2). This
means extended config space (offsets 0x100-0xfff) may not be accessible.
Some firmware doesn't report ECAM space via PNP0C02 _CRS methods, but does
mention it as an EfiMemoryMappedIO region via EFI GetMemoryMap(), which is
normally converted to an E820 entry by a bootloader or EFI stub.
07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map"), removes
E820 entries that correspond to EfiMemoryMappedIO regions because some
other firmware uses EfiMemoryMappedIO for PCI host bridge windows, and the
E820 entries prevent Linux from allocating BAR space for hot-added devices.
Allow use of ECAM for extended config space when the region is covered by
an EfiMemoryMappedIO region, even if it's not included in E820 or PNP0C02
_CRS.
Fixes: 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map")
Link: https://lore.kernel.org/r/ac2693d8-8ba3-72e0-5b66-b3ae008d539d@linux.intel.com
diff --git a/arch/x86/pci/mmconfig-shared.c b/arch/x86/pci/mmconfig-shared.c index 758cbfe55daa..4adc587a4c94 100644
--- a/arch/x86/pci/mmconfig-shared.c
+++ b/arch/x86/pci/mmconfig-shared.c
@@ -12,6 +12,7 @@
*/
#include <linux/acpi.h>
+#include <linux/efi.h>
#include <linux/pci.h>
#include <linux/init.h>
#include <linux/bitmap.h>
@@ -442,6 +443,25 @@ static bool is_acpi_reserved(u64 start, u64 end, enum e820_type not_used)
return mcfg_res.flags;
}
+static bool is_efi_reserved(u64 start, u64 end, enum e820_type
+not_used) {
+ efi_memory_desc_t *md;
+ u64 size, mmio_start, mmio_end;
+
+ for_each_efi_memory_desc(md) {
+ if (md->type == EFI_MEMORY_MAPPED_IO) {
+ size = md->num_pages << EFI_PAGE_SHIFT;
+ mmio_start = md->phys_addr;
+ mmio_end = mmio_start + size - 1;
+
+ if (mmio_start <= start && end <= mmio_end)
+ return true;
+ }
+ }
+
+ return false;
+}
+
typedef bool (*check_reserved_t)(u64 start, u64 end, enum e820_type type);
static bool __ref is_mmconf_reserved(check_reserved_t is_reserved, @@ -452,7 +472,7 @@ static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
u64 size = resource_size(&cfg->res);
u64 old_size = size;
int num_buses;
- char *method = with_e820 ? "E820" : "ACPI motherboard resources";
+ char *method = with_e820 ? "E820" : "ACPI motherboard resources or
+EFI";
while (!is_reserved(addr, addr + size, E820_TYPE_RESERVED)) {
size >>= 1;
@@ -502,15 +522,17 @@ pci_mmcfg_check_reserved(struct device *dev, struct pci_mmcfg_region *cfg, int e
if (!early && !acpi_disabled) {
if (is_mmconf_reserved(is_acpi_reserved, cfg, dev, 0))
return true;
+ if (is_mmconf_reserved(is_efi_reserved, cfg, dev, 0))
+ return true;
if (dev)
dev_info(dev, FW_INFO
- "MMCONFIG at %pR not reserved in "
+ "MMCONFIG at %pR not reserved in EFI "
"ACPI motherboard resources\n",
&cfg->res);
else
pr_info(FW_INFO PREFIX
- "MMCONFIG at %pR not reserved in "
+ "MMCONFIG at %pR not reserved in EFI or "
"ACPI motherboard resources\n",
&cfg->res);
}
[-- Attachment #2: dmesg-sprdnp.log.gz --]
[-- Type: application/x-gzip, Size: 100705 bytes --]
[-- Attachment #3: dmesg-sprmcc.log.gz --]
[-- Type: application/x-gzip, Size: 23799 bytes --]
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-06 22:04 ` Bjorn Helgaas
2023-01-06 22:30 ` Luck, Tony
2023-01-10 5:43 ` Sun, Yunying
@ 2023-01-10 18:12 ` Rafael J. Wysocki
2023-01-10 19:06 ` Bjorn Helgaas
2 siblings, 1 reply; 37+ messages in thread
From: Rafael J. Wysocki @ 2023-01-10 18:12 UTC (permalink / raw)
To: Luck, Tony, Bjorn Helgaas
Cc: Williams, Dan J, Liang, Kan, bhelgaas, hdegoede, kernelorg,
kjhambrick, 2lprbe78, nicholas.johnson-opensource, benoitg,
mika.westerberg, wse, mumblingdrunkard, linux-pci, linux-kernel,
Box, David E, Sun, Yunying, Jiang, Dave
On Friday, January 6, 2023 11:04:49 PM CET Bjorn Helgaas wrote:
> On Fri, Jan 06, 2023 at 09:37:06PM +0000, Luck, Tony wrote:
> > > Thanks, Tony! Something is wrong with the EFI MMIO removal
> > > (obviously), but I don't see what it is. Could you try the patch
> > > below (replacement for previous one, with more debug)?
> >
> > Swapped out old patch for this new one. Booted with efi-debug
> >
> > New dmesg attached.
>
> Thanks! Ah, off-by-one error because e820__mapped_all() expects
> "[start, end)" which means is_acpi_reserved() and is_efi_mmio() must
> use the same, and I was thinking "[start, end]" like a struct
> resource.
>
> The below should work better.
>
> commit 696ac9286d3d ("x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space")
> parent 1b929c02afd3
> Author: Bjorn Helgaas <bhelgaas@google.com>
> Date: Thu Jan 5 16:02:58 2023 -0600
>
> x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space
>
> Normally we reject ECAM space unless it is reported as reserved in the E820
> table or via a PNP0C02 _CRS method (PCI Firmware, r3.3, sec 4.1.2). This
> means extended config space (offsets 0x100-0xfff) may not be accessible.
>
> Some firmware doesn't report ECAM space via PNP0C02 _CRS methods, but does
> mention it as an EfiMemoryMappedIO region via EFI GetMemoryMap(), which is
> normally converted to an E820 entry by a bootloader or EFI stub.
>
> 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map"), removes
> E820 entries that correspond to EfiMemoryMappedIO regions because some
> other firmware uses EfiMemoryMappedIO for PCI host bridge windows, and the
> E820 entries prevent Linux from allocating BAR space for hot-added devices.
>
> Allow use of ECAM for extended config space when the region is covered by
> an EfiMemoryMappedIO region, even if it's not included in E820 or PNP0C02
> _CRS.
>
> Fixes: 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map")
> Link: https://lore.kernel.org/r/ac2693d8-8ba3-72e0-5b66-b3ae008d539d@linux.intel.com
This prints quite a few debug-level messages to dmesg. I guess you'll post an
update with fewer of them?
In any case, please feel free to add
Acked-by: Rafael J. Wysocki <rafael@kernel.org>
to it.
>
> diff --git a/arch/x86/pci/mmconfig-shared.c b/arch/x86/pci/mmconfig-shared.c
> index 758cbfe55daa..5c6cadd60fef 100644
> --- a/arch/x86/pci/mmconfig-shared.c
> +++ b/arch/x86/pci/mmconfig-shared.c
> @@ -12,6 +12,7 @@
> */
>
> #include <linux/acpi.h>
> +#include <linux/efi.h>
> #include <linux/pci.h>
> #include <linux/init.h>
> #include <linux/bitmap.h>
> @@ -442,6 +443,34 @@ static bool is_acpi_reserved(u64 start, u64 end, enum e820_type not_used)
> return mcfg_res.flags;
> }
>
> +static bool is_efi_mmio(u64 start, u64 end, enum e820_type not_used)
> +{
> + efi_memory_desc_t *md;
> + u64 size, mmio_start, mmio_end;
> +
> + end--; /* caller supplies start, end = start + size */
> + pr_info("is_efi_mmio %#lx-%#lx\n",
> + (unsigned long) start, (unsigned long) end);
> + for_each_efi_memory_desc(md) {
> + if (md->type == EFI_MEMORY_MAPPED_IO) {
> + size = md->num_pages << EFI_PAGE_SHIFT;
> + mmio_start = md->phys_addr;
> + mmio_end = mmio_start + size - 1;
> +
> + pr_info(" efi_mmio %#lx-%#lx\n",
> + (unsigned long) mmio_start,
> + (unsigned long) mmio_end);
> + if (mmio_start <= start && end <= mmio_end) {
> + pr_info("is_efi_mmio true\n");
> + return true;
> + }
> + }
> + }
> +
> + pr_info("is_efi_mmio false\n");
> + return false;
> +}
> +
> typedef bool (*check_reserved_t)(u64 start, u64 end, enum e820_type type);
>
> static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
> @@ -452,23 +481,24 @@ static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
> u64 size = resource_size(&cfg->res);
> u64 old_size = size;
> int num_buses;
> - char *method = with_e820 ? "E820" : "ACPI motherboard resources";
> + char *method = with_e820 ? "E820" : "ACPI motherboard resources or EFI";
>
> + pr_info("is_mmconf_reserved %ps [bus %02x-%02x] %pR\n",
> + is_reserved, cfg->start_bus, cfg->end_bus, &cfg->res);
> while (!is_reserved(addr, addr + size, E820_TYPE_RESERVED)) {
> + pr_info(" %#lx-%#lx (size %#lx) not reserved\n",
> + (unsigned long) addr, (unsigned long) (addr + size - 1),
> + (unsigned long) size);
> size >>= 1;
> + pr_info(" size reduced to %#lx\n", (unsigned long) size);
> if (size < (16UL<<20))
> break;
> }
>
> - if (size < (16UL<<20) && size != old_size)
> + if (size < (16UL<<20) && size != old_size) {
> + pr_info("is_mmconf_reserved %ps false\n", is_reserved);
> return false;
> -
> - if (dev)
> - dev_info(dev, "MMCONFIG at %pR reserved in %s\n",
> - &cfg->res, method);
> - else
> - pr_info(PREFIX "MMCONFIG at %pR reserved in %s\n",
> - &cfg->res, method);
> + }
>
> if (old_size != size) {
> /* update end_bus */
> @@ -487,30 +517,42 @@ static bool __ref is_mmconf_reserved(check_reserved_t is_reserved,
> &cfg->res, (unsigned long) cfg->address);
> else
> pr_info(PREFIX
> - "MMCONFIG for %04x [bus%02x-%02x] "
> + "MMCONFIG for %04x [bus %02x-%02x] "
> "at %pR (base %#lx) (size reduced!)\n",
> cfg->segment, cfg->start_bus, cfg->end_bus,
> &cfg->res, (unsigned long) cfg->address);
> }
>
> + if (dev)
> + dev_info(dev, "MMCONFIG at %pR reserved in %s\n",
> + &cfg->res, method);
> + else
> + pr_info(PREFIX "MMCONFIG at %pR reserved in %s\n",
> + &cfg->res, method);
> +
> return true;
> }
>
> static bool __ref
> pci_mmcfg_check_reserved(struct device *dev, struct pci_mmcfg_region *cfg, int early)
> {
> + pr_info("pci_mmcfg_check_reserved([bus %02x-%02x] %pR, %s)\n",
> + cfg->start_bus, cfg->end_bus, &cfg->res,
> + early ? "early" : "late");
> if (!early && !acpi_disabled) {
> if (is_mmconf_reserved(is_acpi_reserved, cfg, dev, 0))
> return true;
> + if (is_mmconf_reserved(is_efi_mmio, cfg, dev, 0))
> + return true;
>
> if (dev)
> dev_info(dev, FW_INFO
> - "MMCONFIG at %pR not reserved in "
> + "MMCONFIG at %pR not reserved in EFI or "
> "ACPI motherboard resources\n",
> &cfg->res);
> else
> pr_info(FW_INFO PREFIX
> - "MMCONFIG at %pR not reserved in "
> + "MMCONFIG at %pR not reserved in EFI or "
> "ACPI motherboard resources\n",
> &cfg->res);
> }
> @@ -536,6 +578,7 @@ static void __init pci_mmcfg_reject_broken(int early)
> {
> struct pci_mmcfg_region *cfg;
>
> + pr_info("pci_mmcfg_reject_broken(%s)\n", early ? "early" : "late");
> list_for_each_entry(cfg, &pci_mmcfg_list, list) {
> if (pci_mmcfg_check_reserved(NULL, cfg, early) == 0) {
> pr_info(PREFIX "not using MMCONFIG\n");
> @@ -570,6 +613,7 @@ static int __init pci_parse_mcfg(struct acpi_table_header *header)
> unsigned long i;
> int entries;
>
> + pr_info("pci_parse_mcfg\n");
> if (!header)
> return -EINVAL;
>
> @@ -661,6 +705,7 @@ static int __initdata known_bridge;
>
> void __init pci_mmcfg_early_init(void)
> {
> + pr_info("pci_mmcfg_early_init\n");
> if (pci_probe & PCI_PROBE_MMCONF) {
> if (pci_mmcfg_check_hostbridge())
> known_bridge = 1;
> @@ -674,6 +719,7 @@ void __init pci_mmcfg_early_init(void)
>
> void __init pci_mmcfg_late_init(void)
> {
> + pr_info("pci_mmcfg_late_init\n");
> /* MMCONFIG disabled */
> if ((pci_probe & PCI_PROBE_MMCONF) == 0)
> return;
> @@ -725,6 +771,8 @@ int pci_mmconfig_insert(struct device *dev, u16 seg, u8 start, u8 end,
> struct resource *tmp = NULL;
> struct pci_mmcfg_region *cfg;
>
> + dev_info(dev, "pci_mmconfig_insert %02x-%02x addr %#lx\n",
> + start, end, (unsigned long)addr);
> if (!(pci_probe & PCI_PROBE_MMCONF) || pci_mmcfg_arch_init_failed)
> return -ENODEV;
>
> @@ -788,6 +836,7 @@ int pci_mmconfig_insert(struct device *dev, u16 seg, u8 start, u8 end,
>
> mutex_unlock(&pci_mmcfg_lock);
>
> + dev_info(dev, "pci_mmconfig_insert returns %d\n", rc);
> return rc;
> }
>
>
^ permalink raw reply [flat|nested] 37+ messages in thread
* Re: Bug report: the extended PCI config space is missed with 6.2-rc2
2023-01-10 18:12 ` Rafael J. Wysocki
@ 2023-01-10 19:06 ` Bjorn Helgaas
0 siblings, 0 replies; 37+ messages in thread
From: Bjorn Helgaas @ 2023-01-10 19:06 UTC (permalink / raw)
To: Rafael J. Wysocki
Cc: Luck, Tony, Williams, Dan J, Liang, Kan, bhelgaas, hdegoede,
kernelorg, kjhambrick, 2lprbe78, nicholas.johnson-opensource,
benoitg, mika.westerberg, wse, mumblingdrunkard, linux-pci,
linux-kernel, Box, David E, Sun, Yunying, Jiang, Dave
On Tue, Jan 10, 2023 at 07:12:42PM +0100, Rafael J. Wysocki wrote:
> On Friday, January 6, 2023 11:04:49 PM CET Bjorn Helgaas wrote:
> ...
> > The below should work better.
> >
> > commit 696ac9286d3d ("x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space")
> > parent 1b929c02afd3
> > Author: Bjorn Helgaas <bhelgaas@google.com>
> > Date: Thu Jan 5 16:02:58 2023 -0600
> >
> > x86/pci: Treat EfiMemoryMappedIO as reservation of ECAM space
> >
> > Normally we reject ECAM space unless it is reported as reserved in the E820
> > table or via a PNP0C02 _CRS method (PCI Firmware, r3.3, sec 4.1.2). This
> > means extended config space (offsets 0x100-0xfff) may not be accessible.
> >
> > Some firmware doesn't report ECAM space via PNP0C02 _CRS methods, but does
> > mention it as an EfiMemoryMappedIO region via EFI GetMemoryMap(), which is
> > normally converted to an E820 entry by a bootloader or EFI stub.
> >
> > 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map"), removes
> > E820 entries that correspond to EfiMemoryMappedIO regions because some
> > other firmware uses EfiMemoryMappedIO for PCI host bridge windows, and the
> > E820 entries prevent Linux from allocating BAR space for hot-added devices.
> >
> > Allow use of ECAM for extended config space when the region is covered by
> > an EfiMemoryMappedIO region, even if it's not included in E820 or PNP0C02
> > _CRS.
> >
> > Fixes: 07eab0901ede ("efi/x86: Remove EfiMemoryMappedIO from E820 map")
> > Link: https://lore.kernel.org/r/ac2693d8-8ba3-72e0-5b66-b3ae008d539d@linux.intel.com
>
> This prints quite a few debug-level messages to dmesg. I guess you'll post an
> update with fewer of them?
Right, this was a debugging patch.
> In any case, please feel free to add
>
> Acked-by: Rafael J. Wysocki <rafael@kernel.org>
Thanks!
^ permalink raw reply [flat|nested] 37+ messages in thread
end of thread, other threads:[~2023-01-10 19:09 UTC | newest]
Thread overview: 37+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2023-01-04 14:39 Bug report: the extended PCI config space is missed with 6.2-rc2 Liang, Kan
2023-01-04 14:50 ` Bjorn Helgaas
2023-01-04 15:45 ` Bjorn Helgaas
2023-01-05 17:42 ` Tony Luck
2023-01-05 17:51 ` Bjorn Helgaas
2023-01-05 18:04 ` Luck, Tony
2023-01-05 18:29 ` Bjorn Helgaas
2023-01-05 19:23 ` Liang, Kan
2023-01-05 19:44 ` Bjorn Helgaas
2023-01-05 19:44 ` Dan Williams
2023-01-05 19:58 ` Luck, Tony
2023-01-05 20:37 ` Bjorn Helgaas
2023-01-05 21:49 ` Luck, Tony
2023-01-05 22:20 ` Bjorn Helgaas
2023-01-05 20:23 ` Bjorn Helgaas
2023-01-05 21:20 ` Dan Williams
2023-01-05 21:35 ` Bjorn Helgaas
2023-01-05 21:43 ` Dan Williams
2023-01-05 21:48 ` Bjorn Helgaas
2023-01-05 22:32 ` Bjorn Helgaas
2023-01-05 23:38 ` Dan Williams
2023-01-06 0:22 ` Luck, Tony
2023-01-06 0:47 ` Bjorn Helgaas
2023-01-06 17:33 ` Bjorn Helgaas
2023-01-06 18:03 ` Luck, Tony
2023-01-06 20:52 ` Bjorn Helgaas
2023-01-06 21:37 ` Luck, Tony
2023-01-06 22:04 ` Bjorn Helgaas
2023-01-06 22:30 ` Luck, Tony
2023-01-10 5:43 ` Sun, Yunying
2023-01-10 18:12 ` Rafael J. Wysocki
2023-01-10 19:06 ` Bjorn Helgaas
2023-01-06 0:32 ` Bjorn Helgaas
2023-01-06 0:50 ` Liang, Kan
2023-01-09 12:27 ` Giovanni Cabiddu
2023-01-10 6:03 ` Sun, Yunying
2023-01-06 9:44 ` Linux kernel regression tracking (#adding)
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).