All of lore.kernel.org
 help / color / mirror / Atom feed
* failure to setup devdax over fake nvdimm
@ 2019-03-15 22:31 Brice Goglin
  2019-03-15 23:12 ` Dan Williams
  0 siblings, 1 reply; 10+ messages in thread
From: Brice Goglin @ 2019-03-15 22:31 UTC (permalink / raw)
  To: Dan Williams; +Cc: linux-nvdimm

Hello Dan,

On a machine emulating nvdimms over DDR using the memmap kernel parameter,
I can't enable devdax anymore with ndctl, when using your libnvdimm-pending
branch (1ffc664f9b8ca7346f2af0fb4f62b923193bf65c):

# ndctl create-namespace -f -e namespace1.0 -t pmem -m devdax
libndctl: ndctl_dax_enable: dax1.0: failed to enable
  Error: namespace1.0: failed to enable
failed to reconfigure namespace: No such device or address

In the previous version of your libnvdimm-pending branch that I used before
(8d4a7e3da68e88a6efd3acb5cc971d0c2ca219a4 from January 8th) this ndctl line
worked fine right after boot.

The difference between strace ndctl doesn't show anything obvious.
* /sys/devices/platform/e820_pmem/ndbus0/region1/namespace1.0/holder_class contains nothing instead of "dax"
* /sys/devices/platform/e820_pmem/ndbus0/region1/dax_seed contains dax1.0 instead of dax1.1

Any idea where to look?

Thanks
Brice


_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: failure to setup devdax over fake nvdimm
  2019-03-15 22:31 failure to setup devdax over fake nvdimm Brice Goglin
@ 2019-03-15 23:12 ` Dan Williams
  2019-03-15 23:42   ` Brice Goglin
  0 siblings, 1 reply; 10+ messages in thread
From: Dan Williams @ 2019-03-15 23:12 UTC (permalink / raw)
  To: Brice Goglin; +Cc: linux-nvdimm

On Fri, Mar 15, 2019 at 3:31 PM Brice Goglin <Brice.Goglin@inria.fr> wrote:
>
> Hello Dan,
>
> On a machine emulating nvdimms over DDR using the memmap kernel parameter,
> I can't enable devdax anymore with ndctl, when using your libnvdimm-pending
> branch (1ffc664f9b8ca7346f2af0fb4f62b923193bf65c):
>
> # ndctl create-namespace -f -e namespace1.0 -t pmem -m devdax
> libndctl: ndctl_dax_enable: dax1.0: failed to enable
>   Error: namespace1.0: failed to enable
> failed to reconfigure namespace: No such device or address
>
> In the previous version of your libnvdimm-pending branch that I used before
> (8d4a7e3da68e88a6efd3acb5cc971d0c2ca219a4 from January 8th) this ndctl line
> worked fine right after boot.
>
> The difference between strace ndctl doesn't show anything obvious.
> * /sys/devices/platform/e820_pmem/ndbus0/region1/namespace1.0/holder_class contains nothing instead of "dax"
> * /sys/devices/platform/e820_pmem/ndbus0/region1/dax_seed contains dax1.0 instead of dax1.1
>
> Any idea where to look?

If my libnvdimm-pending branch worked it is likely due to the
alignment padding fixes I had pending there. Can you post the dmesg
from this failure?

The alignment padding fixes are being abandoned in favor of just
teaching the core-mm to not require section (128MB) alignment, but
until then you need to make sure your persistent memory is 128MB
aligned.
_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: failure to setup devdax over fake nvdimm
  2019-03-15 23:12 ` Dan Williams
@ 2019-03-15 23:42   ` Brice Goglin
  2019-03-16  1:19     ` Dan Williams
  0 siblings, 1 reply; 10+ messages in thread
From: Brice Goglin @ 2019-03-15 23:42 UTC (permalink / raw)
  To: Dan Williams; +Cc: linux-nvdimm


Le 16/03/2019 à 00:12, Dan Williams a écrit :
> On Fri, Mar 15, 2019 at 3:31 PM Brice Goglin <Brice.Goglin@inria.fr> wrote:
>> Hello Dan,
>>
>> On a machine emulating nvdimms over DDR using the memmap kernel parameter,
>> I can't enable devdax anymore with ndctl, when using your libnvdimm-pending
>> branch (1ffc664f9b8ca7346f2af0fb4f62b923193bf65c):
>>
>> # ndctl create-namespace -f -e namespace1.0 -t pmem -m devdax
>> libndctl: ndctl_dax_enable: dax1.0: failed to enable
>>   Error: namespace1.0: failed to enable
>> failed to reconfigure namespace: No such device or address
>>
>> In the previous version of your libnvdimm-pending branch that I used before
>> (8d4a7e3da68e88a6efd3acb5cc971d0c2ca219a4 from January 8th) this ndctl line
>> worked fine right after boot.
>>
>> The difference between strace ndctl doesn't show anything obvious.
>> * /sys/devices/platform/e820_pmem/ndbus0/region1/namespace1.0/holder_class contains nothing instead of "dax"
>> * /sys/devices/platform/e820_pmem/ndbus0/region1/dax_seed contains dax1.0 instead of dax1.1
>>
>> Any idea where to look?
> If my libnvdimm-pending branch worked it is likely due to the
> alignment padding fixes I had pending there. Can you post the dmesg
> from this failure?
>
> The alignment padding fixes are being abandoned in favor of just
> teaching the core-mm to not require section (128MB) alignment, but
> until then you need to make sure your persistent memory is 128MB
> aligned.

I am passing memmap=24G!7G memmap=24G!39G to the kernel command-line.
It looks properly aligned.

dmesg is below. Nothing appears when ndctl fails.

Brice


[    0.000000] Linux version 5.0.0-rc6+ (bgoglin@averell1) (gcc version 8.2.0 (Debian 8.2.0-14)) #6 SMP Fri Mar 15 19:35:25 CET 2019
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.0.0-rc6+ root=UUID=f37dbe66-2ff2-4d99-bc44-1c6e36c2e0e2 ro console=tty0 console=ttyS1,115200n8 memmap=24G!7G memmap=24G!39G cgroup_no_v1=all
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000009b2dffff] usable
[    0.000000] BIOS-e820: [mem 0x000000009b2e0000-0x000000009d31bfff] reserved
[    0.000000] BIOS-e820: [mem 0x000000009d31c000-0x000000009d35afff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000009d35b000-0x000000009fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fe000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000105fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] user-defined physical RAM map:
[    0.000000] user: [mem 0x0000000000000000-0x000000000009dfff] usable
[    0.000000] user: [mem 0x0000000000100000-0x000000009b2dffff] usable
[    0.000000] user: [mem 0x000000009b2e0000-0x000000009d31bfff] reserved
[    0.000000] user: [mem 0x000000009d31c000-0x000000009d35afff] ACPI data
[    0.000000] user: [mem 0x000000009d35b000-0x000000009fffffff] reserved
[    0.000000] user: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] user: [mem 0x00000000fe000000-0x00000000ffffffff] reserved
[    0.000000] user: [mem 0x0000000100000000-0x00000001bfffffff] usable
[    0.000000] user: [mem 0x00000001c0000000-0x00000007bfffffff] persistent (type 12)
[    0.000000] user: [mem 0x00000007c0000000-0x00000009bfffffff] usable
[    0.000000] user: [mem 0x00000009c0000000-0x0000000fbfffffff] persistent (type 12)
[    0.000000] user: [mem 0x0000000fc0000000-0x000000105fffffff] usable
[    0.000000] SMBIOS 2.7 present.
[    0.000000] DMI: Dell Inc. PowerEdge R720/046V88, BIOS 1.2.6 05/10/2012
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 1999.786 MHz processor
[    0.002335] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.002337] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.002342] last_pfn = 0x1060000 max_arch_pfn = 0x400000000
[    0.002346] MTRR default type: uncachable
[    0.002347] MTRR fixed ranges enabled:
[    0.002348]   00000-9FFFF write-back
[    0.002349]   A0000-BFFFF uncachable
[    0.002349]   C0000-C7FFF write-protect
[    0.002350]   C8000-D3FFF write-back
[    0.002351]   D4000-EBFFF uncachable
[    0.002352]   EC000-FFFFF write-protect
[    0.002352] MTRR variable ranges enabled:
[    0.002354]   0 base 000000000000 mask 3FFF80000000 write-back
[    0.002355]   1 base 000080000000 mask 3FFFE0000000 write-back
[    0.002356]   2 base 000100000000 mask 3FFF00000000 write-back
[    0.002357]   3 base 000200000000 mask 3FFE00000000 write-back
[    0.002357]   4 base 000400000000 mask 3FFC00000000 write-back
[    0.002358]   5 base 000800000000 mask 3FF800000000 write-back
[    0.002359]   6 base 001000000000 mask 3FFFC0000000 write-back
[    0.002360]   7 base 001040000000 mask 3FFFE0000000 write-back
[    0.002361]   8 disabled
[    0.002361]   9 disabled
[    0.006692] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.007246] e820: update [mem 0xa0000000-0xffffffff] usable ==> reserved
[    0.007253] last_pfn = 0x9b2e0 max_arch_pfn = 0x400000000
[    0.018207] found SMP MP-table at [mem 0x000fe710-0x000fe71f] mapped at [(____ptrval____)]
[    0.028976] Base memory trampoline at [(____ptrval____)] 98000 size 24576
[    0.028981] Using GB pages for direct mapping
[    0.028984] BRK [0x871601000, 0x871601fff] PGTABLE
[    0.028987] BRK [0x871602000, 0x871602fff] PGTABLE
[    0.028988] BRK [0x871603000, 0x871603fff] PGTABLE
[    0.029009] BRK [0x871604000, 0x871604fff] PGTABLE
[    0.029012] BRK [0x871605000, 0x871605fff] PGTABLE
[    0.029087] BRK [0x871606000, 0x871606fff] PGTABLE
[    0.029113] BRK [0x871607000, 0x871607fff] PGTABLE
[    0.029165] RAMDISK: [mem 0x32bbf000-0x355d6fff]
[    0.029171] ACPI: Early table checksum verification disabled
[    0.031927] ACPI: RSDP 0x00000000000F1090 000024 (v02 DELL  )
[    0.031931] ACPI: XSDT 0x00000000000F1194 00009C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031938] ACPI: FACP 0x000000009D34115C 0000F4 (v03 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031944] ACPI: DSDT 0x000000009D31C000 00723C (v01 DELL   PE_SC3   00000001 INTL 20110211)
[    0.031947] ACPI: FACS 0x000000009D343000 000040
[    0.031950] ACPI: FACS 0x000000009D343000 000040
[    0.031952] ACPI: APIC 0x000000009D340478 00016A (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031956] ACPI: SPCR 0x000000009D3405E4 000050 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031959] ACPI: HPET 0x000000009D340638 000038 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031962] ACPI: DMAR 0x000000009D340674 000198 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031965] ACPI: MCFG 0x000000009D340990 00003C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031968] ACPI: WD__ 0x000000009D3409D0 000134 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031971] ACPI: SLIC 0x000000009D340B08 000024 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031974] ACPI: ERST 0x000000009D3233FC 000270 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031978] ACPI: HEST 0x000000009D32366C 00059C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031981] ACPI: BERT 0x000000009D32323C 000030 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031984] ACPI: EINJ 0x000000009D32326C 000190 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031987] ACPI: TCPA 0x000000009D3410F4 000064 (v02 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031990] ACPI: SRAT 0x000000009D340D30 0003C0 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.031993] ACPI: SSDT 0x000000009D344000 008054 (v01 INTEL  PPM RCM  80000001 INTL 20061109)
[    0.032003] ACPI: Local APIC address 0xfee00000
[    0.032030] SRAT: PXM 1 -> APIC 0x00 -> Node 0
[    0.032031] SRAT: PXM 2 -> APIC 0x20 -> Node 1
[    0.032032] SRAT: PXM 1 -> APIC 0x02 -> Node 0
[    0.032033] SRAT: PXM 2 -> APIC 0x22 -> Node 1
[    0.032034] SRAT: PXM 1 -> APIC 0x04 -> Node 0
[    0.032035] SRAT: PXM 2 -> APIC 0x24 -> Node 1
[    0.032036] SRAT: PXM 1 -> APIC 0x06 -> Node 0
[    0.032037] SRAT: PXM 2 -> APIC 0x26 -> Node 1
[    0.032038] SRAT: PXM 1 -> APIC 0x08 -> Node 0
[    0.032038] SRAT: PXM 2 -> APIC 0x28 -> Node 1
[    0.032039] SRAT: PXM 1 -> APIC 0x0a -> Node 0
[    0.032040] SRAT: PXM 2 -> APIC 0x2a -> Node 1
[    0.032041] SRAT: PXM 1 -> APIC 0x0c -> Node 0
[    0.032042] SRAT: PXM 2 -> APIC 0x2c -> Node 1
[    0.032043] SRAT: PXM 1 -> APIC 0x0e -> Node 0
[    0.032043] SRAT: PXM 2 -> APIC 0x2e -> Node 1
[    0.032044] SRAT: PXM 1 -> APIC 0x01 -> Node 0
[    0.032045] SRAT: PXM 2 -> APIC 0x21 -> Node 1
[    0.032046] SRAT: PXM 1 -> APIC 0x03 -> Node 0
[    0.032047] SRAT: PXM 2 -> APIC 0x23 -> Node 1
[    0.032048] SRAT: PXM 1 -> APIC 0x05 -> Node 0
[    0.032048] SRAT: PXM 2 -> APIC 0x25 -> Node 1
[    0.032049] SRAT: PXM 1 -> APIC 0x07 -> Node 0
[    0.032050] SRAT: PXM 2 -> APIC 0x27 -> Node 1
[    0.032051] SRAT: PXM 1 -> APIC 0x09 -> Node 0
[    0.032052] SRAT: PXM 2 -> APIC 0x29 -> Node 1
[    0.032053] SRAT: PXM 1 -> APIC 0x0b -> Node 0
[    0.032054] SRAT: PXM 2 -> APIC 0x2b -> Node 1
[    0.032054] SRAT: PXM 1 -> APIC 0x0d -> Node 0
[    0.032055] SRAT: PXM 2 -> APIC 0x2d -> Node 1
[    0.032056] SRAT: PXM 1 -> APIC 0x0f -> Node 0
[    0.032057] SRAT: PXM 2 -> APIC 0x2f -> Node 1
[    0.032061] ACPI: SRAT: Node 0 PXM 1 [mem 0x00000000-0x85fffffff]
[    0.032062] ACPI: SRAT: Node 1 PXM 2 [mem 0x860000000-0x105fffffff]
[    0.032069] NODE_DATA(0) allocated [mem 0x85fffb000-0x85fffffff]
[    0.032074] NODE_DATA(1) allocated [mem 0x105fffb000-0x105fffffff]
[    0.032128] Zone ranges:
[    0.032129]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.032131]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.032132]   Normal   [mem 0x0000000100000000-0x000000105fffffff]
[    0.032134]   Device   empty
[    0.032135] Movable zone start for each node
[    0.032136] Early memory node ranges
[    0.032137]   node   0: [mem 0x0000000000001000-0x000000000009dfff]
[    0.032138]   node   0: [mem 0x0000000000100000-0x000000009b2dffff]
[    0.032139]   node   0: [mem 0x0000000100000000-0x00000001bfffffff]
[    0.032140]   node   0: [mem 0x00000007c0000000-0x000000085fffffff]
[    0.032141]   node   1: [mem 0x0000000860000000-0x00000009bfffffff]
[    0.032142]   node   1: [mem 0x0000000fc0000000-0x000000105fffffff]
[    0.032683] Zeroed struct page in unavailable ranges: 19843 pages
[    0.032684] Initmem setup node 0 [mem 0x0000000000001000-0x000000085fffffff]
[    0.032687] On node 0 totalpages: 2077309
[    0.032688]   DMA zone: 64 pages used for memmap
[    0.032688]   DMA zone: 21 pages reserved
[    0.032689]   DMA zone: 3997 pages, LIFO batch:0
[    0.032838]   DMA32 zone: 9868 pages used for memmap
[    0.032839]   DMA32 zone: 631520 pages, LIFO batch:63
[    0.053892]   Normal zone: 22528 pages used for memmap
[    0.053895]   Normal zone: 1441792 pages, LIFO batch:63
[    0.120352] Initmem setup node 1 [mem 0x0000000860000000-0x000000105fffffff]
[    0.120357] On node 1 totalpages: 2097152
[    0.120358]   Normal zone: 32768 pages used for memmap
[    0.120359]   Normal zone: 2097152 pages, LIFO batch:63
[    0.208158] ACPI: PM-Timer IO Port: 0x808
[    0.208163] ACPI: Local APIC address 0xfee00000
[    0.208176] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.208188] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.208193] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 32-55
[    0.208197] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 64-87
[    0.208200] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.208203] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.208204] ACPI: IRQ0 used by override.
[    0.208205] ACPI: IRQ9 used by override.
[    0.208207] Using ACPI (MADT) for SMP configuration information
[    0.208209] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.208215] ACPI: SPCR: SPCR table version 1
[    0.208217] ACPI: SPCR: console: uart,io,0x2f8,115200
[    0.208221] smpboot: Allowing 32 CPUs, 0 hotplug CPUs
[    0.208238] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.208240] PM: Registered nosave memory: [mem 0x0009e000-0x000fffff]
[    0.208241] PM: Registered nosave memory: [mem 0x9b2e0000-0x9d31bfff]
[    0.208242] PM: Registered nosave memory: [mem 0x9d31c000-0x9d35afff]
[    0.208243] PM: Registered nosave memory: [mem 0x9d35b000-0x9fffffff]
[    0.208244] PM: Registered nosave memory: [mem 0xa0000000-0xdfffffff]
[    0.208245] PM: Registered nosave memory: [mem 0xe0000000-0xefffffff]
[    0.208246] PM: Registered nosave memory: [mem 0xf0000000-0xfdffffff]
[    0.208247] PM: Registered nosave memory: [mem 0xfe000000-0xffffffff]
[    0.208249] PM: Registered nosave memory: [mem 0x1c0000000-0x7bfffffff]
[    0.208250] PM: Registered nosave memory: [mem 0x9c0000000-0xfbfffffff]
[    0.208253] [mem 0xa0000000-0xdfffffff] available for PCI devices
[    0.208254] Booting paravirtualized kernel on bare hardware
[    0.208259] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.322424] random: get_random_bytes called from start_kernel+0x93/0x4a9 with crng_init=0
[    0.322434] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:32 nr_node_ids:2
[    0.323972] percpu: Embedded 44 pages/cpu @(____ptrval____) s142168 r8192 d29864 u262144
[    0.323981] pcpu-alloc: s142168 r8192 d29864 u262144 alloc=1*2097152
[    0.323982] pcpu-alloc: [0] 00 02 04 06 08 10 12 14 [0] 16 18 20 22 24 26 28 30 
[    0.323986] pcpu-alloc: [1] 01 03 05 07 09 11 13 15 [1] 17 19 21 23 25 27 29 31 
[    0.324016] Built 2 zonelists, mobility grouping on.  Total pages: 4109212
[    0.324017] Policy zone: Normal
[    0.324019] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.0.0-rc6+ root=UUID=f37dbe66-2ff2-4d99-bc44-1c6e36c2e0e2 ro console=tty0 console=ttyS1,115200n8 memmap=24G!7G memmap=24G!39G cgroup_no_v1=all
[    0.324113] printk: log_buf_len individual max cpu contribution: 4096 bytes
[    0.324114] printk: log_buf_len total cpu_extra contributions: 126976 bytes
[    0.324115] printk: log_buf_len min size: 131072 bytes
[    0.324177] printk: log_buf_len: 262144 bytes
[    0.324178] printk: early log buf free: 117656(89%)
[    0.334343] Calgary: detecting Calgary via BIOS EBDA area
[    0.334346] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.381611] Memory: 16295836K/16697844K available (10243K kernel code, 1191K rwdata, 3228K rodata, 1572K init, 2380K bss, 402008K reserved, 0K cma-reserved)
[    0.381913] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=32, Nodes=2
[    0.381924] Kernel/User page tables isolation: enabled
[    0.381952] ftrace: allocating 31607 entries in 124 pages
[    0.395320] rcu: Hierarchical RCU implementation.
[    0.395322] rcu: 	RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=32.
[    0.395324] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.395325] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=32
[    0.398904] NR_IRQS: 33024, nr_irqs: 1768, preallocated irqs: 16
[    0.407374] Console: colour VGA+ 80x25
[    0.425524] printk: console [tty0] enabled
[    1.565597] printk: console [ttyS1] enabled
[    1.570409] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    1.583093] ACPI: Core revision 20181213
[    1.587814] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[    1.598152] hpet clockevent registered
[    1.598156] APIC: Switch to symmetric I/O mode setup
[    1.603815] DMAR: Host address width 46
[    1.608204] DMAR: DRHD base: 0x000000be200000 flags: 0x0
[    1.614251] DMAR: dmar0: reg_base_addr be200000 ver 1:0 cap d2078c106f0462 ecap f020fe
[    1.623228] DMAR: DRHD base: 0x000000dd900000 flags: 0x1
[    1.629272] DMAR: dmar1: reg_base_addr dd900000 ver 1:0 cap d2078c106f0462 ecap f020fe
[    1.638251] DMAR: RMRR base: 0x0000009f458000 end: 0x0000009f46ffff
[    1.645360] DMAR: RMRR base: 0x0000009f450000 end: 0x0000009f450fff
[    1.652469] DMAR: RMRR base: 0x0000009f452000 end: 0x0000009f452fff
[    1.659578] DMAR: ATSR flags: 0x0
[    1.663386] DMAR-IR: IOAPIC id 2 under DRHD base  0xbe200000 IOMMU 0
[    1.670593] DMAR-IR: IOAPIC id 0 under DRHD base  0xdd900000 IOMMU 1
[    1.677799] DMAR-IR: IOAPIC id 1 under DRHD base  0xdd900000 IOMMU 1
[    1.685006] DMAR-IR: HPET id 0 under DRHD base 0xdd900000
[    1.691135] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit.
[    1.691136] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting.
[    1.708292] DMAR-IR: Enabled IRQ remapping in xapic mode
[    1.714318] x2apic: IRQ remapping doesn't support X2APIC mode
[    1.720840] Switched APIC routing to physical flat.
[    1.727004] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    1.750175] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x39a6c876ec9, max_idle_ns: 881590757399 ns
[    1.762074] Calibrating delay loop (skipped), value calculated using timer frequency.. 3999.57 BogoMIPS (lpj=7999144)
[    1.766065] pid_max: default: 32768 minimum: 301
[    1.770122] LSM: Security Framework initializing
[    1.774065] Yama: becoming mindful.
[    1.778099] AppArmor: AppArmor initialized
[    1.787927] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    1.791427] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[    1.794132] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes)
[    1.798110] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes)
[    1.802315] Disabling cpuset control group subsystem in v1 mounts
[    1.806070] Disabling cpu control group subsystem in v1 mounts
[    1.810066] Disabling cpuacct control group subsystem in v1 mounts
[    1.814067] Disabling io control group subsystem in v1 mounts
[    1.818087] Disabling memory control group subsystem in v1 mounts
[    1.822067] Disabling devices control group subsystem in v1 mounts
[    1.826065] Disabling freezer control group subsystem in v1 mounts
[    1.830065] Disabling net_cls control group subsystem in v1 mounts
[    1.834066] Disabling perf_event control group subsystem in v1 mounts
[    1.838065] Disabling net_prio control group subsystem in v1 mounts
[    1.842065] Disabling pids control group subsystem in v1 mounts
[    1.846115] mce: CPU supports 20 MCE banks
[    1.850084] mce: CPU0: Thermal monitoring enabled (TM1)
[    1.854094] process: using mwait in idle threads
[    1.858067] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[    1.862064] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0
[    1.866066] Spectre V2 : Mitigation: Full generic retpoline
[    1.870064] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    1.874065] Speculative Store Bypass: Vulnerable
[    1.878243] Freeing SMP alternatives memory: 28K
[    1.884800] TSC deadline timer enabled
[    1.884806] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz (family: 0x6, model: 0x2d, stepping: 0x7)
[    1.886228] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    1.890069] core: PEBS disabled due to CPU errata, please upgrade microcode
[    1.894072] ... version:                3
[    1.898064] ... bit width:              48
[    1.902064] ... generic registers:      4
[    1.906064] ... value mask:             0000ffffffffffff
[    1.910064] ... max period:             00007fffffffffff
[    1.914064] ... fixed-purpose events:   3
[    1.918064] ... event mask:             000000070000000f
[    1.922119] rcu: Hierarchical SRCU implementation.
[    1.928584] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[    1.930508] smp: Bringing up secondary CPUs ...
[    1.934194] x86: Booting SMP configuration:
[    1.938067] .... node  #1, CPUs:        #1
[    2.026067] .... node  #0, CPUs:    #2
[    2.034067] .... node  #1, CPUs:    #3
[    2.038067] .... node  #0, CPUs:    #4
[    2.042067] .... node  #1, CPUs:    #5
[    2.046066] .... node  #0, CPUs:    #6
[    2.050069] .... node  #1, CPUs:    #7
[    2.054067] .... node  #0, CPUs:    #8
[    2.058068] .... node  #1, CPUs:    #9
[    2.062066] .... node  #0, CPUs:   #10
[    2.066068] .... node  #1, CPUs:   #11
[    2.070067] .... node  #0, CPUs:   #12
[    2.074068] .... node  #1, CPUs:   #13
[    2.078066] .... node  #0, CPUs:   #14
[    2.082068] .... node  #1, CPUs:   #15
[    2.086067] .... node  #0, CPUs:   #16
[    2.090069] .... node  #1, CPUs:   #17
[    2.094066] .... node  #0, CPUs:   #18
[    2.098068] .... node  #1, CPUs:   #19
[    2.102067] .... node  #0, CPUs:   #20
[    2.106068] .... node  #1, CPUs:   #21
[    2.110066] .... node  #0, CPUs:   #22
[    2.114068] .... node  #1, CPUs:   #23
[    2.118067] .... node  #0, CPUs:   #24
[    2.122068] .... node  #1, CPUs:   #25
[    2.126066] .... node  #0, CPUs:   #26
[    2.130068] .... node  #1, CPUs:   #27
[    2.134067] .... node  #0, CPUs:   #28
[    2.138068] .... node  #1, CPUs:   #29
[    2.142065] .... node  #0, CPUs:   #30
[    2.146068] .... node  #1, CPUs:   #31
[    2.148831] smp: Brought up 2 nodes, 32 CPUs
[    2.154066] smpboot: Max logical packages: 2
[    2.158066] smpboot: Total of 32 processors activated (128005.43 BogoMIPS)
[    2.168053] devtmpfs: initialized
[    2.170158] x86/mm: Memory block size: 512MB
[    2.174581] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    2.186101] futex hash table entries: 8192 (order: 7, 524288 bytes)
[    2.194324] pinctrl core: initialized pinctrl subsystem
[    2.198335] NET: Registered protocol family 16
[    2.206175] audit: initializing netlink subsys (disabled)
[    2.210085] audit: type=2000 audit(1552687858.544:1): state=initialized audit_enabled=0 res=1
[    2.222068] cpuidle: using governor ladder
[    2.226086] cpuidle: using governor menu
[    2.230128] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    2.238066] ACPI: bus type PCI registered
[    2.242066] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    2.250182] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000)
[    2.262068] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved in E820
[    2.270084] PCI: Using configuration type 1 for base access
[    2.274080] PCI: Dell System detected, enabling pci=bfsort.
[    2.282096] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    2.291753] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    2.298067] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    2.306259] ACPI: Added _OSI(Module Device)
[    2.314066] ACPI: Added _OSI(Processor Device)
[    2.318065] ACPI: Added _OSI(3.0 _SCP Extensions)
[    2.322065] ACPI: Added _OSI(Processor Aggregator Device)
[    2.330065] ACPI: Added _OSI(Linux-Dell-Video)
[    2.334065] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    2.338065] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    2.348963] ACPI: 2 ACPI AML tables successfully acquired and loaded
[    2.354624] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    2.365795] ACPI: Interpreter enabled
[    2.370079] ACPI: (supports S0 S4 S5)
[    2.374065] ACPI: Using IOAPIC for interrupt routing
[    2.382193] HEST: Table parsing has been initialized.
[    2.386067] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    2.398234] ACPI: Enabled 4 GPEs in block 00 to 3F
[    2.410832] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3d])
[    2.418073] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.426153] acpi PNP0A08:00: PCIe AER handled by firmware
[    2.434233] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    2.446066] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.454673] PCI host bridge to bus 0000:00
[    2.458068] pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
[    2.466066] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
[    2.474066] pci_bus 0000:00: root bus resource [io  0x03b0-0x03df window]
[    2.482066] pci_bus 0000:00: root bus resource [io  0x0d00-0x1fff window]
[    2.490066] pci_bus 0000:00: root bus resource [io  0x8000-0x9fff window]
[    2.498066] pci_bus 0000:00: root bus resource [io  0xa000-0xbfff window]
[    2.506066] pci_bus 0000:00: root bus resource [io  0xc000-0xdfff window]
[    2.514066] pci_bus 0000:00: root bus resource [io  0xe000-0xffff window]
[    2.522066] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.530066] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xdfffffff window]
[    2.538066] pci_bus 0000:00: root bus resource [mem 0xfed40000-0xfed44fff window]
[    2.546068] pci_bus 0000:00: root bus resource [bus 00-3d]
[    2.554078] pci 0000:00:00.0: [8086:3c00] type 00 class 0x060000
[    2.554162] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    2.554245] pci 0000:00:01.0: [8086:3c02] type 01 class 0x060400
[    2.554329] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    2.554438] pci 0000:00:01.1: [8086:3c03] type 01 class 0x060400
[    2.554520] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
[    2.554612] pci 0000:00:02.0: [8086:3c04] type 01 class 0x060400
[    2.554695] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[    2.554813] pci 0000:00:02.2: [8086:3c06] type 01 class 0x060400
[    2.554895] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[    2.554980] pci 0000:00:03.0: [8086:3c08] type 01 class 0x060400
[    2.555020] pci 0000:00:03.0: enabling Extended Tags
[    2.562113] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    2.562234] pci 0000:00:04.0: [8086:3c20] type 00 class 0x088000
[    2.562253] pci 0000:00:04.0: reg 0x10: [mem 0xdd8dc000-0xdd8dffff 64bit]
[    2.562379] pci 0000:00:04.1: [8086:3c21] type 00 class 0x088000
[    2.562397] pci 0000:00:04.1: reg 0x10: [mem 0xdd8e0000-0xdd8e3fff 64bit]
[    2.562520] pci 0000:00:04.2: [8086:3c22] type 00 class 0x088000
[    2.562538] pci 0000:00:04.2: reg 0x10: [mem 0xdd8e4000-0xdd8e7fff 64bit]
[    2.562661] pci 0000:00:04.3: [8086:3c23] type 00 class 0x088000
[    2.562679] pci 0000:00:04.3: reg 0x10: [mem 0xdd8e8000-0xdd8ebfff 64bit]
[    2.562799] pci 0000:00:04.4: [8086:3c24] type 00 class 0x088000
[    2.562817] pci 0000:00:04.4: reg 0x10: [mem 0xdd8ec000-0xdd8effff 64bit]
[    2.562937] pci 0000:00:04.5: [8086:3c25] type 00 class 0x088000
[    2.562955] pci 0000:00:04.5: reg 0x10: [mem 0xdd8f0000-0xdd8f3fff 64bit]
[    2.563077] pci 0000:00:04.6: [8086:3c26] type 00 class 0x088000
[    2.563095] pci 0000:00:04.6: reg 0x10: [mem 0xdd8f4000-0xdd8f7fff 64bit]
[    2.563219] pci 0000:00:04.7: [8086:3c27] type 00 class 0x088000
[    2.563237] pci 0000:00:04.7: reg 0x10: [mem 0xdd8f8000-0xdd8fbfff 64bit]
[    2.563357] pci 0000:00:05.0: [8086:3c28] type 00 class 0x088000
[    2.563480] pci 0000:00:05.2: [8086:3c2a] type 00 class 0x088000
[    2.563605] pci 0000:00:11.0: [8086:1d3e] type 01 class 0x060400
[    2.563704] pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
[    2.563789] pci 0000:00:16.0: [8086:1d3a] type 00 class 0x078000
[    2.563809] pci 0000:00:16.0: reg 0x10: [mem 0xdd8fc000-0xdd8fc00f 64bit]
[    2.563871] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[    2.563935] pci 0000:00:16.1: [8086:1d3b] type 00 class 0x078000
[    2.563955] pci 0000:00:16.1: reg 0x10: [mem 0xdd8fd000-0xdd8fd00f 64bit]
[    2.564017] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
[    2.564093] pci 0000:00:1a.0: [8086:1d2d] type 00 class 0x0c0320
[    2.564115] pci 0000:00:1a.0: reg 0x10: [mem 0xdd8fe000-0xdd8fe3ff]
[    2.564197] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[    2.564265] pci 0000:00:1c.0: [8086:1d10] type 01 class 0x060400
[    2.564347] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    2.564451] pci 0000:00:1c.7: [8086:1d1e] type 01 class 0x060400
[    2.564534] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
[    2.564615] pci 0000:00:1d.0: [8086:1d26] type 00 class 0x0c0320
[    2.564637] pci 0000:00:1d.0: reg 0x10: [mem 0xdd8ff000-0xdd8ff3ff]
[    2.564720] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[    2.564787] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
[    2.564889] pci 0000:00:1f.0: [8086:1d41] type 00 class 0x060100
[    2.565136] pci 0000:02:00.0: [14e4:165f] type 00 class 0x020000
[    2.565158] pci 0000:02:00.0: reg 0x10: [mem 0xd10a0000-0xd10affff 64bit pref]
[    2.565169] pci 0000:02:00.0: reg 0x18: [mem 0xd10b0000-0xd10bffff 64bit pref]
[    2.565181] pci 0000:02:00.0: reg 0x20: [mem 0xd10c0000-0xd10cffff 64bit pref]
[    2.565188] pci 0000:02:00.0: reg 0x30: [mem 0xda000000-0xda03ffff pref]
[    2.565249] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[    2.565277] pci 0000:02:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5 GT/s x1 link at 0000:00:01.0 (capable of 8.000 Gb/s with 5 GT/s x2 link)
[    2.578151] pci 0000:02:00.1: [14e4:165f] type 00 class 0x020000
[    2.578174] pci 0000:02:00.1: reg 0x10: [mem 0xd10d0000-0xd10dffff 64bit pref]
[    2.578185] pci 0000:02:00.1: reg 0x18: [mem 0xd10e0000-0xd10effff 64bit pref]
[    2.578196] pci 0000:02:00.1: reg 0x20: [mem 0xd10f0000-0xd10fffff 64bit pref]
[    2.578204] pci 0000:02:00.1: reg 0x30: [mem 0xda000000-0xda03ffff pref]
[    2.578264] pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
[    2.578381] pci 0000:00:01.0: PCI bridge to [bus 02]
[    2.586070] pci 0000:00:01.0:   bridge window [mem 0xda000000-0xda7fffff]
[    2.586075] pci 0000:00:01.0:   bridge window [mem 0xd1000000-0xd10fffff 64bit pref]
[    2.586139] pci 0000:01:00.0: [14e4:165f] type 00 class 0x020000
[    2.586162] pci 0000:01:00.0: reg 0x10: [mem 0xd11a0000-0xd11affff 64bit pref]
[    2.586173] pci 0000:01:00.0: reg 0x18: [mem 0xd11b0000-0xd11bffff 64bit pref]
[    2.586184] pci 0000:01:00.0: reg 0x20: [mem 0xd11c0000-0xd11cffff 64bit pref]
[    2.586192] pci 0000:01:00.0: reg 0x30: [mem 0xda800000-0xda83ffff pref]
[    2.586253] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    2.586280] pci 0000:01:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5 GT/s x1 link at 0000:00:01.1 (capable of 8.000 Gb/s with 5 GT/s x2 link)
[    2.602142] pci 0000:01:00.1: [14e4:165f] type 00 class 0x020000
[    2.602165] pci 0000:01:00.1: reg 0x10: [mem 0xd11d0000-0xd11dffff 64bit pref]
[    2.602176] pci 0000:01:00.1: reg 0x18: [mem 0xd11e0000-0xd11effff 64bit pref]
[    2.602187] pci 0000:01:00.1: reg 0x20: [mem 0xd11f0000-0xd11fffff 64bit pref]
[    2.602195] pci 0000:01:00.1: reg 0x30: [mem 0xda800000-0xda83ffff pref]
[    2.602256] pci 0000:01:00.1: PME# supported from D0 D3hot D3cold
[    2.602371] pci 0000:00:01.1: PCI bridge to [bus 01]
[    2.606070] pci 0000:00:01.1:   bridge window [mem 0xda800000-0xdaffffff]
[    2.606074] pci 0000:00:01.1:   bridge window [mem 0xd1100000-0xd11fffff 64bit pref]
[    2.606117] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.614114] pci 0000:03:00.0: [1000:0073] type 00 class 0x010400
[    2.614126] pci 0000:03:00.0: reg 0x10: [io  0xfc00-0xfcff]
[    2.614134] pci 0000:03:00.0: reg 0x14: [mem 0xdbffc000-0xdbffffff 64bit]
[    2.614143] pci 0000:03:00.0: reg 0x1c: [mem 0xdbf80000-0xdbfbffff 64bit]
[    2.614152] pci 0000:03:00.0: reg 0x30: [mem 0xdb000000-0xdb01ffff pref]
[    2.614158] pci 0000:03:00.0: enabling Extended Tags
[    2.618098] pci 0000:03:00.0: supports D1 D2
[    2.618151] pci 0000:00:02.2: PCI bridge to [bus 03]
[    2.622068] pci 0000:00:02.2:   bridge window [io  0xf000-0xffff]
[    2.622071] pci 0000:00:02.2:   bridge window [mem 0xdb000000-0xdbffffff]
[    2.622119] pci 0000:05:00.0: [10de:1094] type 00 class 0x030200
[    2.622134] pci 0000:05:00.0: reg 0x10: [mem 0xd8000000-0xd8ffffff]
[    2.622143] pci 0000:05:00.0: reg 0x14: [mem 0xc0000000-0xc7ffffff 64bit pref]
[    2.622152] pci 0000:05:00.0: reg 0x1c: [mem 0xce000000-0xcfffffff 64bit pref]
[    2.622159] pci 0000:05:00.0: reg 0x24: [io  0xec80-0xecff]
[    2.622165] pci 0000:05:00.0: reg 0x30: [mem 0xd9800000-0xd987ffff pref]
[    2.622171] pci 0000:05:00.0: enabling Extended Tags
[    2.630172] pci 0000:00:03.0: PCI bridge to [bus 05]
[    2.634068] pci 0000:00:03.0:   bridge window [io  0xe000-0xefff]
[    2.634071] pci 0000:00:03.0:   bridge window [mem 0xd8000000-0xd9ffffff]
[    2.634075] pci 0000:00:03.0:   bridge window [mem 0xc0000000-0xcfffffff 64bit pref]
[    2.634120] pci 0000:00:11.0: PCI bridge to [bus 06]
[    2.642118] pci 0000:00:1c.0: PCI bridge to [bus 07]
[    2.646421] pci 0000:08:00.0: [1912:0013] type 01 class 0x060400
[    2.648976] pci 0000:08:00.0: PME# supported from D0 D3hot D3cold
[    2.649990] pci 0000:00:1c.7: PCI bridge to [bus 08-0c]
[    2.658071] pci 0000:00:1c.7:   bridge window [mem 0xdc000000-0xdd7fffff]
[    2.658076] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    2.659148] pci 0000:09:00.0: [1912:0013] type 01 class 0x060400
[    2.662100] pci 0000:09:00.0: PME# supported from D0 D3hot D3cold
[    2.663177] pci 0000:09:01.0: [1912:0013] type 01 class 0x060400
[    2.666283] pci 0000:09:01.0: PME# supported from D0 D3hot D3cold
[    2.668669] pci 0000:08:00.0: PCI bridge to [bus 09-0c]
[    2.674249] pci 0000:08:00.0:   bridge window [mem 0xdc000000-0xdd7fffff]
[    2.674374] pci 0000:08:00.0:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    2.675485] pci 0000:0a:00.0: [1912:0012] type 01 class 0x060400
[    2.679325] pci 0000:09:00.0: PCI bridge to [bus 0a-0b]
[    2.686280] pci 0000:09:00.0:   bridge window [mem 0xdc000000-0xdcffffff]
[    2.686424] pci 0000:09:00.0:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    2.687345] pci_bus 0000:0b: extended config space not accessible
[    2.694296] pci 0000:0b:00.0: [102b:0534] type 00 class 0x030000
[    2.694780] pci 0000:0b:00.0: reg 0x10: [mem 0xd0000000-0xd0ffffff pref]
[    2.695041] pci 0000:0b:00.0: reg 0x14: [mem 0xdcffc000-0xdcffffff]
[    2.695301] pci 0000:0b:00.0: reg 0x18: [mem 0xdc000000-0xdc7fffff]
[    2.699445] pci 0000:0a:00.0: PCI bridge to [bus 0b]
[    2.702280] pci 0000:0a:00.0:   bridge window [mem 0xdc000000-0xdcffffff]
[    2.702425] pci 0000:0a:00.0:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    2.703558] pci 0000:09:01.0: PCI bridge to [bus 0c]
[    2.710279] pci 0000:09:01.0:   bridge window [mem 0xdd700000-0xdd7fffff]
[    2.711408] pci_bus 0000:0d: extended config space not accessible
[    2.718119] pci 0000:00:1e.0: PCI bridge to [bus 0d] (subtractive decode)
[    2.726073] pci 0000:00:1e.0:   bridge window [io  0x0000-0x03af window] (subtractive decode)
[    2.726075] pci 0000:00:1e.0:   bridge window [io  0x03e0-0x0cf7 window] (subtractive decode)
[    2.726076] pci 0000:00:1e.0:   bridge window [io  0x03b0-0x03df window] (subtractive decode)
[    2.726078] pci 0000:00:1e.0:   bridge window [io  0x0d00-0x1fff window] (subtractive decode)
[    2.726080] pci 0000:00:1e.0:   bridge window [io  0x8000-0x9fff window] (subtractive decode)
[    2.726081] pci 0000:00:1e.0:   bridge window [io  0xa000-0xbfff window] (subtractive decode)
[    2.726082] pci 0000:00:1e.0:   bridge window [io  0xc000-0xdfff window] (subtractive decode)
[    2.726084] pci 0000:00:1e.0:   bridge window [io  0xe000-0xffff window] (subtractive decode)
[    2.726085] pci 0000:00:1e.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    2.726087] pci 0000:00:1e.0:   bridge window [mem 0xc0000000-0xdfffffff window] (subtractive decode)
[    2.726088] pci 0000:00:1e.0:   bridge window [mem 0xfed40000-0xfed44fff window] (subtractive decode)
[    2.726140] pci_bus 0000:00: on NUMA node 0
[    2.727237] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 40-7e])
[    2.734069] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.746152] acpi PNP0A08:01: PCIe AER handled by firmware
[    2.750232] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    2.762066] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.770635] PCI host bridge to bus 0000:40
[    2.774068] pci_bus 0000:40: root bus resource [io  0x2000-0x3fff window]
[    2.782066] pci_bus 0000:40: root bus resource [io  0x4000-0x5fff window]
[    2.790066] pci_bus 0000:40: root bus resource [io  0x6000-0x7fff window]
[    2.798066] pci_bus 0000:40: root bus resource [mem 0xa8000000-0xbfffffff window]
[    2.806067] pci_bus 0000:40: root bus resource [bus 40-7e]
[    2.814078] pci 0000:40:01.0: [8086:3c02] type 01 class 0x060400
[    2.814171] pci 0000:40:01.0: PME# supported from D0 D3hot D3cold
[    2.814296] pci 0000:40:02.0: [8086:3c04] type 01 class 0x060400
[    2.814386] pci 0000:40:02.0: PME# supported from D0 D3hot D3cold
[    2.814499] pci 0000:40:03.0: [8086:3c08] type 01 class 0x060400
[    2.814542] pci 0000:40:03.0: enabling Extended Tags
[    2.818116] pci 0000:40:03.0: PME# supported from D0 D3hot D3cold
[    2.818231] pci 0000:40:03.2: [8086:3c0a] type 01 class 0x060400
[    2.818320] pci 0000:40:03.2: PME# supported from D0 D3hot D3cold
[    2.818429] pci 0000:40:04.0: [8086:3c20] type 00 class 0x088000
[    2.818449] pci 0000:40:04.0: reg 0x10: [mem 0xbe1e0000-0xbe1e3fff 64bit]
[    2.818571] pci 0000:40:04.1: [8086:3c21] type 00 class 0x088000
[    2.818591] pci 0000:40:04.1: reg 0x10: [mem 0xbe1e4000-0xbe1e7fff 64bit]
[    2.818710] pci 0000:40:04.2: [8086:3c22] type 00 class 0x088000
[    2.818729] pci 0000:40:04.2: reg 0x10: [mem 0xbe1e8000-0xbe1ebfff 64bit]
[    2.818846] pci 0000:40:04.3: [8086:3c23] type 00 class 0x088000
[    2.818865] pci 0000:40:04.3: reg 0x10: [mem 0xbe1ec000-0xbe1effff 64bit]
[    2.818987] pci 0000:40:04.4: [8086:3c24] type 00 class 0x088000
[    2.819006] pci 0000:40:04.4: reg 0x10: [mem 0xbe1f0000-0xbe1f3fff 64bit]
[    2.819130] pci 0000:40:04.5: [8086:3c25] type 00 class 0x088000
[    2.819149] pci 0000:40:04.5: reg 0x10: [mem 0xbe1f4000-0xbe1f7fff 64bit]
[    2.819268] pci 0000:40:04.6: [8086:3c26] type 00 class 0x088000
[    2.819288] pci 0000:40:04.6: reg 0x10: [mem 0xbe1f8000-0xbe1fbfff 64bit]
[    2.819409] pci 0000:40:04.7: [8086:3c27] type 00 class 0x088000
[    2.819428] pci 0000:40:04.7: reg 0x10: [mem 0xbe1fc000-0xbe1fffff 64bit]
[    2.819544] pci 0000:40:05.0: [8086:3c28] type 00 class 0x088000
[    2.819658] pci 0000:40:05.2: [8086:3c2a] type 00 class 0x088000
[    2.819980] pci 0000:41:00.0: [15b3:1003] type 00 class 0x028000
[    2.820338] pci 0000:41:00.0: reg 0x10: [mem 0xbe000000-0xbe0fffff 64bit]
[    2.820514] pci 0000:41:00.0: reg 0x18: [mem 0xb8000000-0xb87fffff 64bit pref]
[    2.822063] pci 0000:40:01.0: PCI bridge to [bus 41]
[    2.830069] pci 0000:40:01.0:   bridge window [mem 0xbe000000-0xbe0fffff]
[    2.830074] pci 0000:40:01.0:   bridge window [mem 0xb8000000-0xb87fffff 64bit pref]
[    2.830123] pci 0000:42:00.0: [10de:1094] type 00 class 0x030200
[    2.830139] pci 0000:42:00.0: reg 0x10: [mem 0xbc000000-0xbcffffff]
[    2.830149] pci 0000:42:00.0: reg 0x14: [mem 0xa8000000-0xafffffff 64bit pref]
[    2.830158] pci 0000:42:00.0: reg 0x1c: [mem 0xb6000000-0xb7ffffff 64bit pref]
[    2.830165] pci 0000:42:00.0: reg 0x24: [io  0x7c80-0x7cff]
[    2.830172] pci 0000:42:00.0: reg 0x30: [mem 0xbd800000-0xbd87ffff pref]
[    2.830178] pci 0000:42:00.0: enabling Extended Tags
[    2.834174] pci 0000:40:02.0: PCI bridge to [bus 42]
[    2.842068] pci 0000:40:02.0:   bridge window [io  0x7000-0x7fff]
[    2.842071] pci 0000:40:02.0:   bridge window [mem 0xbc000000-0xbdffffff]
[    2.842076] pci 0000:40:02.0:   bridge window [mem 0xa8000000-0xb7ffffff 64bit pref]
[    2.842115] pci 0000:40:03.0: PCI bridge to [bus 43]
[    2.846111] pci 0000:40:03.2: PCI bridge to [bus 44]
[    2.850099] pci_bus 0000:40: on NUMA node 1
[    2.850170] ACPI: PCI Root Bridge [P0B1] (domain 0000 [bus 3f])
[    2.858068] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.866152] acpi PNP0A08:02: PCIe AER handled by firmware
[    2.874232] acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    2.886066] acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.894132] PCI host bridge to bus 0000:3f
[    2.898067] pci_bus 0000:3f: root bus resource [bus 3f]
[    2.906074] pci 0000:3f:08.0: [8086:3c80] type 00 class 0x088000
[    2.906138] pci 0000:3f:09.0: [8086:3c90] type 00 class 0x088000
[    2.906196] pci 0000:3f:0a.0: [8086:3cc0] type 00 class 0x088000
[    2.906250] pci 0000:3f:0a.1: [8086:3cc1] type 00 class 0x088000
[    2.906300] pci 0000:3f:0a.2: [8086:3cc2] type 00 class 0x088000
[    2.906350] pci 0000:3f:0a.3: [8086:3cd0] type 00 class 0x088000
[    2.906401] pci 0000:3f:0b.0: [8086:3ce0] type 00 class 0x088000
[    2.906450] pci 0000:3f:0b.3: [8086:3ce3] type 00 class 0x088000
[    2.906506] pci 0000:3f:0c.0: [8086:3ce8] type 00 class 0x088000
[    2.906554] pci 0000:3f:0c.1: [8086:3ce8] type 00 class 0x088000
[    2.906603] pci 0000:3f:0c.2: [8086:3ce8] type 00 class 0x088000
[    2.906653] pci 0000:3f:0c.3: [8086:3ce8] type 00 class 0x088000
[    2.906702] pci 0000:3f:0c.6: [8086:3cf4] type 00 class 0x088000
[    2.906752] pci 0000:3f:0c.7: [8086:3cf6] type 00 class 0x088000
[    2.906800] pci 0000:3f:0d.0: [8086:3ce8] type 00 class 0x088000
[    2.906849] pci 0000:3f:0d.1: [8086:3ce8] type 00 class 0x088000
[    2.906898] pci 0000:3f:0d.2: [8086:3ce8] type 00 class 0x088000
[    2.906946] pci 0000:3f:0d.3: [8086:3ce8] type 00 class 0x088000
[    2.906997] pci 0000:3f:0d.6: [8086:3cf5] type 00 class 0x088000
[    2.907048] pci 0000:3f:0e.0: [8086:3ca0] type 00 class 0x088000
[    2.907099] pci 0000:3f:0e.1: [8086:3c46] type 00 class 0x110100
[    2.907157] pci 0000:3f:0f.0: [8086:3ca8] type 00 class 0x088000
[    2.907225] pci 0000:3f:0f.1: [8086:3c71] type 00 class 0x088000
[    2.907290] pci 0000:3f:0f.2: [8086:3caa] type 00 class 0x088000
[    2.907359] pci 0000:3f:0f.3: [8086:3cab] type 00 class 0x088000
[    2.907426] pci 0000:3f:0f.4: [8086:3cac] type 00 class 0x088000
[    2.907492] pci 0000:3f:0f.5: [8086:3cad] type 00 class 0x088000
[    2.907557] pci 0000:3f:0f.6: [8086:3cae] type 00 class 0x088000
[    2.907612] pci 0000:3f:10.0: [8086:3cb0] type 00 class 0x088000
[    2.907682] pci 0000:3f:10.1: [8086:3cb1] type 00 class 0x088000
[    2.907747] pci 0000:3f:10.2: [8086:3cb2] type 00 class 0x088000
[    2.907814] pci 0000:3f:10.3: [8086:3cb3] type 00 class 0x088000
[    2.907881] pci 0000:3f:10.4: [8086:3cb4] type 00 class 0x088000
[    2.907947] pci 0000:3f:10.5: [8086:3cb5] type 00 class 0x088000
[    2.908016] pci 0000:3f:10.6: [8086:3cb6] type 00 class 0x088000
[    2.908084] pci 0000:3f:10.7: [8086:3cb7] type 00 class 0x088000
[    2.908148] pci 0000:3f:11.0: [8086:3cb8] type 00 class 0x088000
[    2.908206] pci 0000:3f:13.0: [8086:3ce4] type 00 class 0x088000
[    2.908255] pci 0000:3f:13.1: [8086:3c43] type 00 class 0x110100
[    2.908307] pci 0000:3f:13.4: [8086:3ce6] type 00 class 0x110100
[    2.908356] pci 0000:3f:13.5: [8086:3c44] type 00 class 0x110100
[    2.908405] pci 0000:3f:13.6: [8086:3c45] type 00 class 0x088000
[    2.908460] pci_bus 0000:3f: on NUMA node 0
[    2.908518] ACPI: PCI Root Bridge [P1B1] (domain 0000 [bus 7f])
[    2.914069] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.922152] acpi PNP0A08:03: PCIe AER handled by firmware
[    2.930232] acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    2.938067] acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.950110] PCI host bridge to bus 0000:7f
[    2.954067] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.958074] pci 0000:7f:08.0: [8086:3c80] type 00 class 0x088000
[    2.958140] pci 0000:7f:09.0: [8086:3c90] type 00 class 0x088000
[    2.958198] pci 0000:7f:0a.0: [8086:3cc0] type 00 class 0x088000
[    2.958247] pci 0000:7f:0a.1: [8086:3cc1] type 00 class 0x088000
[    2.958297] pci 0000:7f:0a.2: [8086:3cc2] type 00 class 0x088000
[    2.958346] pci 0000:7f:0a.3: [8086:3cd0] type 00 class 0x088000
[    2.958399] pci 0000:7f:0b.0: [8086:3ce0] type 00 class 0x088000
[    2.958448] pci 0000:7f:0b.3: [8086:3ce3] type 00 class 0x088000
[    2.958496] pci 0000:7f:0c.0: [8086:3ce8] type 00 class 0x088000
[    2.958545] pci 0000:7f:0c.1: [8086:3ce8] type 00 class 0x088000
[    2.958594] pci 0000:7f:0c.2: [8086:3ce8] type 00 class 0x088000
[    2.958644] pci 0000:7f:0c.3: [8086:3ce8] type 00 class 0x088000
[    2.958692] pci 0000:7f:0c.6: [8086:3cf4] type 00 class 0x088000
[    2.958740] pci 0000:7f:0c.7: [8086:3cf6] type 00 class 0x088000
[    2.958788] pci 0000:7f:0d.0: [8086:3ce8] type 00 class 0x088000
[    2.958838] pci 0000:7f:0d.1: [8086:3ce8] type 00 class 0x088000
[    2.958888] pci 0000:7f:0d.2: [8086:3ce8] type 00 class 0x088000
[    2.958937] pci 0000:7f:0d.3: [8086:3ce8] type 00 class 0x088000
[    2.958985] pci 0000:7f:0d.6: [8086:3cf5] type 00 class 0x088000
[    2.959037] pci 0000:7f:0e.0: [8086:3ca0] type 00 class 0x088000
[    2.959090] pci 0000:7f:0e.1: [8086:3c46] type 00 class 0x110100
[    2.959154] pci 0000:7f:0f.0: [8086:3ca8] type 00 class 0x088000
[    2.959222] pci 0000:7f:0f.1: [8086:3c71] type 00 class 0x088000
[    2.959288] pci 0000:7f:0f.2: [8086:3caa] type 00 class 0x088000
[    2.959356] pci 0000:7f:0f.3: [8086:3cab] type 00 class 0x088000
[    2.959423] pci 0000:7f:0f.4: [8086:3cac] type 00 class 0x088000
[    2.959488] pci 0000:7f:0f.5: [8086:3cad] type 00 class 0x088000
[    2.959555] pci 0000:7f:0f.6: [8086:3cae] type 00 class 0x088000
[    2.959609] pci 0000:7f:10.0: [8086:3cb0] type 00 class 0x088000
[    2.959676] pci 0000:7f:10.1: [8086:3cb1] type 00 class 0x088000
[    2.959742] pci 0000:7f:10.2: [8086:3cb2] type 00 class 0x088000
[    2.959810] pci 0000:7f:10.3: [8086:3cb3] type 00 class 0x088000
[    2.959876] pci 0000:7f:10.4: [8086:3cb4] type 00 class 0x088000
[    2.959945] pci 0000:7f:10.5: [8086:3cb5] type 00 class 0x088000
[    2.960017] pci 0000:7f:10.6: [8086:3cb6] type 00 class 0x088000
[    2.960083] pci 0000:7f:10.7: [8086:3cb7] type 00 class 0x088000
[    2.960148] pci 0000:7f:11.0: [8086:3cb8] type 00 class 0x088000
[    2.960208] pci 0000:7f:13.0: [8086:3ce4] type 00 class 0x088000
[    2.960256] pci 0000:7f:13.1: [8086:3c43] type 00 class 0x110100
[    2.960310] pci 0000:7f:13.4: [8086:3ce6] type 00 class 0x110100
[    2.960359] pci 0000:7f:13.5: [8086:3c44] type 00 class 0x110100
[    2.960409] pci 0000:7f:13.6: [8086:3c45] type 00 class 0x088000
[    2.960468] pci_bus 0000:7f: on NUMA node 1
[    2.960565] ACPI: PCI Interrupt Link [LK00] (IRQs 3 4 5 6 7 11 14 *15)
[    2.970127] ACPI: PCI Interrupt Link [LK01] (IRQs 3 4 5 6 7 11 *14 15)
[    2.978123] ACPI: PCI Interrupt Link [LK02] (IRQs 3 4 5 6 7 11 *14 15)
[    2.986122] ACPI: PCI Interrupt Link [LK03] (IRQs 3 4 5 6 7 *11 14 15)
[    2.990122] ACPI: PCI Interrupt Link [LK04] (IRQs 3 4 *5 6 7 11 14 15)
[    2.998121] ACPI: PCI Interrupt Link [LK05] (IRQs 3 4 5 6 7 11 *14 15)
[    3.006122] ACPI: PCI Interrupt Link [LK06] (IRQs 3 4 5 *6 7 11 14 15)
[    3.014121] ACPI: PCI Interrupt Link [LK07] (IRQs 3 4 5 6 7 11 *14 15)
[    3.022217] pci 0000:0b:00.0: vgaarb: setting as boot VGA device
[    3.026063] pci 0000:0b:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    3.038083] pci 0000:0b:00.0: vgaarb: bridge control possible
[    3.046065] vgaarb: loaded
[    3.049291] pps_core: LinuxPPS API ver. 1 registered
[    3.054065] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    3.062067] PTP clock support registered
[    3.070083] EDAC MC: Ver: 3.0.0
[    3.074403] PCI: Using ACPI for IRQ routing
[    3.083323] PCI: pci_cache_line_size set to 64 bytes
[    3.083875] e820: reserve RAM buffer [mem 0x0009e000-0x0009ffff]
[    3.083876] e820: reserve RAM buffer [mem 0x9b2e0000-0x9bffffff]
[    3.084165] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    3.090067] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    3.102065] clocksource: Switched to clocksource tsc-early
[    3.119290] VFS: Disk quotas dquot_6.6.0
[    3.123808] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    3.131734] AppArmor: AppArmor Filesystem Enabled
[    3.137107] pnp: PnP ACPI init
[    3.140821] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
[    3.140854] pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active)
[    3.141035] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active)
[    3.141207] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[    3.141565] system 00:04: [io  0x0800-0x087f] has been reserved
[    3.148280] system 00:04: [io  0x0880-0x08ff] has been reserved
[    3.154999] system 00:04: [io  0x0900-0x091f] has been reserved
[    3.161718] system 00:04: [io  0x0920-0x0923] has been reserved
[    3.168436] system 00:04: [io  0x0924] has been reserved
[    3.174474] system 00:04: [io  0x0370-0x0377] has been reserved
[    3.181228] system 00:04: [io  0x0ca0-0x0ca7] has been reserved
[    3.187946] system 00:04: [io  0x0ca9-0x0cab] has been reserved
[    3.194666] system 00:04: [io  0x0cad-0x0caf] has been reserved
[    3.201384] system 00:04: [io  0x0cb0-0x0cbf] has been reserved
[    3.208105] system 00:04: Plug and Play ACPI device, IDs PNP0c01 (active)
[    3.208197] system 00:05: [io  0x0ca8] has been reserved
[    3.214239] system 00:05: [io  0x0cac] has been reserved
[    3.220280] system 00:05: Plug and Play ACPI device, IDs IPI0001 PNP0c01 (active)
[    3.220685] system 00:06: [mem 0xe0000000-0xe3efffff] has been reserved
[    3.228189] system 00:06: Plug and Play ACPI device, IDs PNP0c02 (active)
[    3.228386] system 00:07: [mem 0xe4000000-0xe7ffffff] has been reserved
[    3.235888] system 00:07: Plug and Play ACPI device, IDs PNP0c02 (active)
[    3.235995] system 00:08: [mem 0xe3f00000-0xe3ffffff] has been reserved
[    3.243497] system 00:08: Plug and Play ACPI device, IDs PNP0c02 (active)
[    3.243610] system 00:09: [mem 0xdd900000-0xdd901fff] could not be reserved
[    3.251499] system 00:09: Plug and Play ACPI device, IDs PNP0c02 (active)
[    3.251630] system 00:0a: [mem 0xbe200000-0xbe201fff] could not be reserved
[    3.259520] system 00:0a: Plug and Play ACPI device, IDs PNP0c02 (active)
[    3.259661] pnp: PnP ACPI: found 11 devices
[    3.270460] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    3.280506] pci 0000:02:00.1: can't claim BAR 6 [mem 0xda000000-0xda03ffff pref]: address conflict with 0000:02:00.0 [mem 0xda000000-0xda03ffff pref]
[    3.295596] pci 0000:01:00.1: can't claim BAR 6 [mem 0xda800000-0xda83ffff pref]: address conflict with 0000:01:00.0 [mem 0xda800000-0xda83ffff pref]
[    3.311688] pci 0000:02:00.1: BAR 6: assigned [mem 0xda040000-0xda07ffff pref]
[    3.319886] pci 0000:00:01.0: PCI bridge to [bus 02]
[    3.325539] pci 0000:00:01.0:   bridge window [mem 0xda000000-0xda7fffff]
[    3.333230] pci 0000:00:01.0:   bridge window [mem 0xd1000000-0xd10fffff 64bit pref]
[    3.342013] pci 0000:01:00.1: BAR 6: assigned [mem 0xda840000-0xda87ffff pref]
[    3.350210] pci 0000:00:01.1: PCI bridge to [bus 01]
[    3.355862] pci 0000:00:01.1:   bridge window [mem 0xda800000-0xdaffffff]
[    3.363553] pci 0000:00:01.1:   bridge window [mem 0xd1100000-0xd11fffff 64bit pref]
[    3.372336] pci 0000:00:02.0: PCI bridge to [bus 04]
[    3.377992] pci 0000:00:02.2: PCI bridge to [bus 03]
[    3.383633] pci 0000:00:02.2:   bridge window [io  0xf000-0xffff]
[    3.390546] pci 0000:00:02.2:   bridge window [mem 0xdb000000-0xdbffffff]
[    3.398239] pci 0000:00:03.0: PCI bridge to [bus 05]
[    3.403888] pci 0000:00:03.0:   bridge window [io  0xe000-0xefff]
[    3.410801] pci 0000:00:03.0:   bridge window [mem 0xd8000000-0xd9ffffff]
[    3.418492] pci 0000:00:03.0:   bridge window [mem 0xc0000000-0xcfffffff 64bit pref]
[    3.427274] pci 0000:00:11.0: PCI bridge to [bus 06]
[    3.432933] pci 0000:00:1c.0: PCI bridge to [bus 07]
[    3.438591] pci 0000:0a:00.0: PCI bridge to [bus 0b]
[    3.444379] pci 0000:0a:00.0:   bridge window [mem 0xdc000000-0xdcffffff]
[    3.452160] pci 0000:0a:00.0:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.461128] pci 0000:09:00.0: PCI bridge to [bus 0a-0b]
[    3.467210] pci 0000:09:00.0:   bridge window [mem 0xdc000000-0xdcffffff]
[    3.474987] pci 0000:09:00.0:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.483955] pci 0000:09:01.0: PCI bridge to [bus 0c]
[    3.489742] pci 0000:09:01.0:   bridge window [mem 0xdd700000-0xdd7fffff]
[    3.497774] pci 0000:08:00.0: PCI bridge to [bus 09-0c]
[    3.503839] pci 0000:08:00.0:   bridge window [mem 0xdc000000-0xdd7fffff]
[    3.511606] pci 0000:08:00.0:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.520619] pci 0000:00:1c.7: PCI bridge to [bus 08-0c]
[    3.526560] pci 0000:00:1c.7:   bridge window [mem 0xdc000000-0xdd7fffff]
[    3.534251] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.543034] pci 0000:00:1e.0: PCI bridge to [bus 0d]
[    3.548691] pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    3.548693] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    3.548694] pci_bus 0000:00: resource 6 [io  0x03b0-0x03df window]
[    3.548695] pci_bus 0000:00: resource 7 [io  0x0d00-0x1fff window]
[    3.548697] pci_bus 0000:00: resource 8 [io  0x8000-0x9fff window]
[    3.548698] pci_bus 0000:00: resource 9 [io  0xa000-0xbfff window]
[    3.548700] pci_bus 0000:00: resource 10 [io  0xc000-0xdfff window]
[    3.548701] pci_bus 0000:00: resource 11 [io  0xe000-0xffff window]
[    3.548703] pci_bus 0000:00: resource 12 [mem 0x000a0000-0x000bffff window]
[    3.548704] pci_bus 0000:00: resource 13 [mem 0xc0000000-0xdfffffff window]
[    3.548706] pci_bus 0000:00: resource 14 [mem 0xfed40000-0xfed44fff window]
[    3.548707] pci_bus 0000:02: resource 1 [mem 0xda000000-0xda7fffff]
[    3.548709] pci_bus 0000:02: resource 2 [mem 0xd1000000-0xd10fffff 64bit pref]
[    3.548710] pci_bus 0000:01: resource 1 [mem 0xda800000-0xdaffffff]
[    3.548712] pci_bus 0000:01: resource 2 [mem 0xd1100000-0xd11fffff 64bit pref]
[    3.548713] pci_bus 0000:03: resource 0 [io  0xf000-0xffff]
[    3.548714] pci_bus 0000:03: resource 1 [mem 0xdb000000-0xdbffffff]
[    3.548716] pci_bus 0000:05: resource 0 [io  0xe000-0xefff]
[    3.548717] pci_bus 0000:05: resource 1 [mem 0xd8000000-0xd9ffffff]
[    3.548719] pci_bus 0000:05: resource 2 [mem 0xc0000000-0xcfffffff 64bit pref]
[    3.548720] pci_bus 0000:08: resource 1 [mem 0xdc000000-0xdd7fffff]
[    3.548722] pci_bus 0000:08: resource 2 [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.548723] pci_bus 0000:09: resource 1 [mem 0xdc000000-0xdd7fffff]
[    3.548725] pci_bus 0000:09: resource 2 [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.548726] pci_bus 0000:0a: resource 1 [mem 0xdc000000-0xdcffffff]
[    3.548728] pci_bus 0000:0a: resource 2 [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.548729] pci_bus 0000:0b: resource 1 [mem 0xdc000000-0xdcffffff]
[    3.548731] pci_bus 0000:0b: resource 2 [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.548732] pci_bus 0000:0c: resource 1 [mem 0xdd700000-0xdd7fffff]
[    3.548734] pci_bus 0000:0d: resource 4 [io  0x0000-0x03af window]
[    3.548735] pci_bus 0000:0d: resource 5 [io  0x03e0-0x0cf7 window]
[    3.548736] pci_bus 0000:0d: resource 6 [io  0x03b0-0x03df window]
[    3.548738] pci_bus 0000:0d: resource 7 [io  0x0d00-0x1fff window]
[    3.548739] pci_bus 0000:0d: resource 8 [io  0x8000-0x9fff window]
[    3.548741] pci_bus 0000:0d: resource 9 [io  0xa000-0xbfff window]
[    3.548742] pci_bus 0000:0d: resource 10 [io  0xc000-0xdfff window]
[    3.548743] pci_bus 0000:0d: resource 11 [io  0xe000-0xffff window]
[    3.548745] pci_bus 0000:0d: resource 12 [mem 0x000a0000-0x000bffff window]
[    3.548746] pci_bus 0000:0d: resource 13 [mem 0xc0000000-0xdfffffff window]
[    3.548748] pci_bus 0000:0d: resource 14 [mem 0xfed40000-0xfed44fff window]
[    3.548794] pci 0000:40:01.0: PCI bridge to [bus 41]
[    3.554446] pci 0000:40:01.0:   bridge window [mem 0xbe000000-0xbe0fffff]
[    3.562137] pci 0000:40:01.0:   bridge window [mem 0xb8000000-0xb87fffff 64bit pref]
[    3.570919] pci 0000:40:02.0: PCI bridge to [bus 42]
[    3.576568] pci 0000:40:02.0:   bridge window [io  0x7000-0x7fff]
[    3.583485] pci 0000:40:02.0:   bridge window [mem 0xbc000000-0xbdffffff]
[    3.591176] pci 0000:40:02.0:   bridge window [mem 0xa8000000-0xb7ffffff 64bit pref]
[    3.599958] pci 0000:40:03.0: PCI bridge to [bus 43]
[    3.605614] pci 0000:40:03.2: PCI bridge to [bus 44]
[    3.611263] pci_bus 0000:40: resource 4 [io  0x2000-0x3fff window]
[    3.611264] pci_bus 0000:40: resource 5 [io  0x4000-0x5fff window]
[    3.611266] pci_bus 0000:40: resource 6 [io  0x6000-0x7fff window]
[    3.611267] pci_bus 0000:40: resource 7 [mem 0xa8000000-0xbfffffff window]
[    3.611269] pci_bus 0000:41: resource 1 [mem 0xbe000000-0xbe0fffff]
[    3.611270] pci_bus 0000:41: resource 2 [mem 0xb8000000-0xb87fffff 64bit pref]
[    3.611272] pci_bus 0000:42: resource 0 [io  0x7000-0x7fff]
[    3.611273] pci_bus 0000:42: resource 1 [mem 0xbc000000-0xbdffffff]
[    3.611275] pci_bus 0000:42: resource 2 [mem 0xa8000000-0xb7ffffff 64bit pref]
[    3.611344] NET: Registered protocol family 2
[    3.616503] tcp_listen_portaddr_hash hash table entries: 8192 (order: 5, 131072 bytes)
[    3.625541] TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
[    3.634158] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.641881] TCP: Hash tables configured (established 131072 bind 65536)
[    3.649466] UDP hash table entries: 8192 (order: 6, 262144 bytes)
[    3.656431] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes)
[    3.665963] NET: Registered protocol family 1
[    3.690246] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x6a7 took 18809 usecs
[    3.698980] pci 0000:03:00.0: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[    3.710875] pci 0000:03:00.0: quirk_blacklist_vpd+0x0/0x30 took 11613 usecs
[    3.719120] pci 0000:0b:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    3.728786] PCI: CLS 64 bytes, default 64
[    3.728833] Unpacking initramfs...
[    4.478489] Freeing initrd memory: 43104K
[    4.502085] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    4.509390] software IO TLB: mapped [mem 0x972e0000-0x9b2e0000] (64MB)
[    4.517126] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    4.526102] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    4.532624] RAPL PMU: hw unit of domain package 2^-16 Joules
[    4.539048] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    4.548313] Initialise system trusted keyrings
[    4.553455] workingset: timestamp_bits=40 max_order=22 bucket_order=0
[    4.562250] zbud: loaded
[    4.565402] fuse init (API version 7.28)
[    4.959794] Key type asymmetric registered
[    4.964480] Asymmetric key parser 'x509' registered
[    4.970054] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    4.978526] io scheduler mq-deadline registered
[    4.983692] io scheduler kyber registered
[    4.989100] pcieport 0000:00:01.0: Signaling PME with IRQ 25
[    4.995863] pcieport 0000:00:01.1: Signaling PME with IRQ 26
[    5.002611] pcieport 0000:00:02.0: Signaling PME with IRQ 27
[    5.009353] pcieport 0000:00:02.2: Signaling PME with IRQ 28
[    5.016097] pcieport 0000:00:03.0: Signaling PME with IRQ 29
[    5.022805] pcieport 0000:00:11.0: Signaling PME with IRQ 30
[    5.029357] pcieport 0000:00:1c.0: Signaling PME with IRQ 31
[    5.036061] pcieport 0000:00:1c.7: Signaling PME with IRQ 32
[    5.046421] pcieport 0000:40:01.0: Signaling PME with IRQ 34
[    5.053124] pcieport 0000:40:02.0: Signaling PME with IRQ 35
[    5.059812] pcieport 0000:40:03.0: Signaling PME with IRQ 36
[    5.066493] pcieport 0000:40:03.2: Signaling PME with IRQ 37
[    5.073213] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    5.080825] intel_idle: MWAIT substates: 0x21120
[    5.080826] intel_idle: v0.4.1 model 0x2D
[    5.082666] intel_idle: lapic_timer_reliable_states 0xffffffff
[    5.083782] ERST: Error Record Serialization Table (ERST) support is initialized.
[    5.092275] pstore: Registered erst as persistent store backend
[    5.099175] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    5.107687] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    5.135233] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    5.164068] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    5.172963] Linux agpgart interface v0.103
[    5.177841] AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel <jroedel@suse.de>
[    5.185431] AMD-Vi: AMD IOMMUv2 functionality not available on this system
[    5.197873] i8042: PNP: No PS/2 controller found.
[    5.203409] mousedev: PS/2 mouse device common for all mice
[    5.209769] rtc_cmos 00:01: RTC can wake from S4
[    5.215281] rtc_cmos 00:01: registered as rtc0
[    5.220376] rtc_cmos 00:01: alarms up to one day, y3k, 242 bytes nvram, hpet irqs
[    5.228874] intel_pstate: Intel P-state driver initializing
[    5.238167] ledtrig-cpu: registered to indicate activity on CPUs
[    5.246298] NET: Registered protocol family 10
[    5.251778] Segment Routing with IPv6
[    5.255988] mip6: Mobile IPv6
[    5.259401] NET: Registered protocol family 17
[    5.264468] mpls_gso: MPLS GSO support
[    5.274018] microcode: sig=0x206d7, pf=0x1, revision=0x70b
[    5.281313] microcode: Microcode Update Driver: v2.2.
[    5.281330] sched_clock: Marking stable (4014340252, 1266959968)->(5577394745, -296094525)
[    5.297770] registered taskstats version 1
[    5.302457] Loading compiled-in X.509 certificates
[    5.307956] zswap: loaded using pool lzo/zbud
[    5.313964] pstore: Using crash dump compression: deflate
[    5.320113] AppArmor: AppArmor sha1 policy hashing enabled
[    5.328010] rtc_cmos 00:01: setting system clock to 2019-03-15T22:11:04 UTC (1552687864)
[    5.338661] Freeing unused kernel image memory: 1572K
[    5.358119] Write protecting the kernel read-only data: 16384k
[    5.366079] Freeing unused kernel image memory: 2016K
[    5.372456] Freeing unused kernel image memory: 868K
[    5.385942] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    5.393242] x86/mm: Checking user space page tables
[    5.406316] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    5.413616] Run /init as init process
[    5.522585] tg3.c:v3.137 (May 11, 2014)
[    5.527812] SCSI subsystem initialized
[    5.527879] ACPI: bus type USB registered
[    5.536737] usbcore: registered new interface driver usbfs
[    5.542994] usbcore: registered new interface driver hub
[    5.549237] usbcore: registered new device driver usb
[    5.549860] tg3 0000:01:00.0 eth0: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d4:ae:52:98:c4:38
[    5.566079] tsc: Refined TSC clocksource calibration: 2000.001 MHz
[    5.566894] tg3 0000:01:00.0 eth0: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    5.573929] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1cd42f1dc63, max_idle_ns: 440795248933 ns
[    5.585009] tg3 0000:01:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    5.605190] tg3 0000:01:00.0 eth0: dma_rwctrl[00000001] dma_mask[64-bit]
[    5.612845] clocksource: Switched to clocksource tsc
[    5.619396] mlx4_core: Mellanox ConnectX core driver v4.0-0
[    5.625770] mlx4_core: Initializing 0000:41:00.0
[    5.632282] megasas: 07.707.50.00-rc1
[    5.632305] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    5.636826] megaraid_sas 0000:03:00.0: FW now in Ready state
[    5.650337] megaraid_sas 0000:03:00.0: 63 bit DMA mask and 32 bit consistent mask
[    5.659473] megaraid_sas 0000:03:00.0: firmware supports msix	: (0)
[    5.666581] megaraid_sas 0000:03:00.0: current msix/online cpus	: (1/32)
[    5.674179] megaraid_sas 0000:03:00.0: RDPQ mode	: (disabled)
[    5.681057] ehci-pci: EHCI PCI platform driver
[    5.683433] tg3 0000:01:00.1 eth1: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d4:ae:52:98:c4:39
[    5.698048] tg3 0000:01:00.1 eth1: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    5.709160] tg3 0000:01:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    5.718035] tg3 0000:01:00.1 eth1: dma_rwctrl[00000001] dma_mask[64-bit]
[    5.725928] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    5.731874] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    5.740274] ehci-pci 0000:00:1a.0: debug port 2
[    5.749334] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[    5.749350] ehci-pci 0000:00:1a.0: irq 23, io mem 0xdd8fe000
[    5.755781] megaraid_sas 0000:03:00.0: controller type	: iMR(0MB)
[    5.762693] megaraid_sas 0000:03:00.0: Online Controller Reset(OCR)	: Enabled
[    5.770770] megaraid_sas 0000:03:00.0: Secure JBOD support	: No
[    5.777486] megaraid_sas 0000:03:00.0: NVMe passthru support	: No
[    5.784399] megaraid_sas 0000:03:00.0: FW provided TM TaskAbort/Reset timeout	: 0 secs/0 secs
[    5.794064] megaraid_sas 0000:03:00.0: megasas_init_mfi: fw_support_ieee=67108864
[    5.802556] megaraid_sas 0000:03:00.0: INIT adapter done
[    5.808593] megaraid_sas 0000:03:00.0: Jbod map is not supported megasas_setup_jbod_map 5267
[    5.818151] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    5.824710] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.00
[    5.834073] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.842268] usb usb1: Product: EHCI Host Controller
[    5.847820] usb usb1: Manufacturer: Linux 5.0.0-rc6+ ehci_hcd
[    5.854341] usb usb1: SerialNumber: 0000:00:1a.0
[    5.860140] hub 1-0:1.0: USB hub found
[    5.864433] hub 1-0:1.0: 2 ports detected
[    5.869401] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    5.875588] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    5.884085] ehci-pci 0000:00:1d.0: debug port 2
[    5.889354] megaraid_sas 0000:03:00.0: pci id		: (0x1000)/(0x0073)/(0x1028)/(0x1f51)
[    5.898133] megaraid_sas 0000:03:00.0: unevenspan support	: no
[    5.904752] megaraid_sas 0000:03:00.0: firmware crash dump	: no
[    5.911468] megaraid_sas 0000:03:00.0: jbod sync map		: no
[    5.917700] scsi host0: Avago SAS based MegaRAID driver
[    5.927643] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[    5.927759] ehci-pci 0000:00:1d.0: irq 22, io mem 0xdd8ff000
[    5.950071] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    5.956643] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.00
[    5.966012] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.967640] scsi 0:2:0:0: Direct-Access     DELL     PERC H310        2.12 PQ: 0 ANSI: 5
[    5.974211] usb usb2: Product: EHCI Host Controller
[    5.988931] usb usb2: Manufacturer: Linux 5.0.0-rc6+ ehci_hcd
[    5.995458] usb usb2: SerialNumber: 0000:00:1d.0
[    6.001262] hub 2-0:1.0: USB hub found
[    6.005671] hub 2-0:1.0: 2 ports detected
[    6.011003] tg3 0000:02:00.0 eth2: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d4:ae:52:98:c4:3a
[    6.022897] tg3 0000:02:00.0 eth2: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    6.034011] tg3 0000:02:00.0 eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    6.042970] tg3 0000:02:00.0 eth2: dma_rwctrl[00000001] dma_mask[64-bit]
[    6.051406] sd 0:2:0:0: [sda] 487325696 512-byte logical blocks: (250 GB/232 GiB)
[    6.060429] sd 0:2:0:0: [sda] Write Protect is off
[    6.065933] sd 0:2:0:0: [sda] Mode Sense: 1f 00 10 08
[    6.066169] sd 0:2:0:0: [sda] Write cache: disabled, read cache: disabled, supports DPO and FUA
[    6.079072] tg3 0000:02:00.1 eth3: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d4:ae:52:98:c4:3b
[    6.090966] tg3 0000:02:00.1 eth3: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    6.102090] tg3 0000:02:00.1 eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    6.104526]  sda: sda1 sda2 sda3 < sda5 sda6 sda7 >
[    6.110969] tg3 0000:02:00.1 eth3: dma_rwctrl[00000001] dma_mask[64-bit]
[    6.117915] sd 0:2:0:0: [sda] Attached SCSI disk
[    6.250103] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    6.337414] random: fast init done
[    6.354110] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    6.410532] usb 1-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[    6.419821] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    6.428553] hub 1-1:1.0: USB hub found
[    6.433024] hub 1-1:1.0: 6 ports detected
[    6.518727] usb 2-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[    6.528019] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    6.536540] hub 2-1:1.0: USB hub found
[    6.541023] hub 2-1:1.0: 8 ports detected
[    6.730098] usb 1-1.6: new high-speed USB device number 3 using ehci-pci
[    6.847875] usb 1-1.6: New USB device found, idVendor=0624, idProduct=0248, bcdDevice= 0.00
[    6.857357] usb 1-1.6: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    6.865651] usb 1-1.6: Product: Gadget USB HUB
[    6.870716] usb 1-1.6: Manufacturer: no manufacturer
[    6.876363] usb 1-1.6: SerialNumber: 0123456789
[    6.881988] hub 1-1.6:1.0: USB hub found
[    6.886649] hub 1-1.6:1.0: 6 ports detected
[    7.194104] usb 1-1.6.1: new high-speed USB device number 4 using ehci-pci
[    7.319866] usb 1-1.6.1: New USB device found, idVendor=0624, idProduct=0249, bcdDevice= 0.00
[    7.329546] usb 1-1.6.1: New USB device strings: Mfr=4, Product=5, SerialNumber=6
[    7.338035] usb 1-1.6.1: Product: Keyboard/Mouse Function
[    7.344168] usb 1-1.6.1: Manufacturer: Avocent
[    7.349233] usb 1-1.6.1: SerialNumber: 20110426
[    7.363412] hidraw: raw HID events driver (C) Jiri Kosina
[    7.373059] usbcore: registered new interface driver usbhid
[    7.379394] usbhid: USB HID core driver
[    7.386317] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.0/0003:0624:0249.0001/input/input0
[    7.442677] mlx4_core 0000:41:00.0: Old device ETS support detected
[    7.449788] mlx4_core 0000:41:00.0: Consider upgrading device FW.
[    7.458364] hid-generic 0003:0624:0249.0001: input,hidraw0: USB HID v1.00 Keyboard [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input0
[    7.473620] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.1/0003:0624:0249.0002/input/input1
[    7.489266] hid-generic 0003:0624:0249.0002: input,hidraw1: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input1
[    7.504156] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.2/0003:0624:0249.0003/input/input2
[    7.519796] hid-generic 0003:0624:0249.0003: input,hidraw2: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input2
[    8.137987] mlx4_core 0000:41:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[    8.291080] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.0-0
[    8.302128] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[    8.333652] PM: Image not found (code -22)
[    8.450260] EXT4-fs (sda5): mounted filesystem with ordered data mode. Opts: (null)
[    9.802782] ERST: NVRAM ERST Log Address Range not implemented yet.
[    9.857971] systemd[1]: systemd 239 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 +IDN -PCRE2 default-hierarchy=hybrid)
[    9.903886] systemd[1]: Detected architecture x86-64.
[    9.958498] systemd[1]: Set hostname to <averell1>.
[   12.188094] random: systemd: uninitialized urandom read (16 bytes read)
[   12.195692] systemd[1]: Listening on udev Control Socket.
[   12.218150] random: systemd: uninitialized urandom read (16 bytes read)
[   12.225793] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.
[   12.254167] random: systemd: uninitialized urandom read (16 bytes read)
[   12.261857] systemd[1]: Listening on Syslog Socket.
[   12.282272] systemd[1]: Listening on udev Kernel Socket.
[   12.302695] systemd[1]: Created slice system-getty.slice.
[   12.322383] systemd[1]: Created slice system-postfix.slice.
[   12.342406] systemd[1]: Listening on Journal Audit Socket.
[   12.597428] EXT4-fs (sda5): re-mounted. Opts: errors=remount-ro
[   12.751798] RPC: Registered named UNIX socket transport module.
[   12.758523] RPC: Registered udp transport module.
[   12.758524] RPC: Registered tcp transport module.
[   12.758524] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   12.855669] loop: module loaded
[   13.156930] systemd-journald[480]: Received request to flush runtime journal from PID 1
[   13.762534] iTCO_vendor_support: vendor-support=0
[   13.769888] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3
[   13.778334] ACPI: Power Button [PWRF]
[   13.782845] input: PC Speaker as /devices/platform/pcspkr/input/input4
[   13.810518] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.3)
[   13.882659] IPMI message handler: version 39.2
[   13.940425] ipmi device interface
[   13.944773] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   13.951155] iTCO_wdt: Found a Patsburg TCO device (Version=2, TCOBASE=0x0860)
[   13.959359] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
[   13.966271] dca service started, version 1.12.1
[   13.972939] sd 0:2:0:0: Attached scsi generic sg0 type 0
[   13.973078] ACPI Error: No handler for Region [SYSI] ((____ptrval____)) [IPMI] (20181213/evregion-132)
[   13.989513] ACPI Error: Region IPMI (ID=7) has no handler (20181213/exfldio-265)
[   13.997917] ACPI Error: Method parse/execution failed \_SB.PMI0._GHL, AE_NOT_EXIST (20181213/psparse-531)
[   14.008755] ACPI Error: Method parse/execution failed \_SB.PMI0._PMC, AE_NOT_EXIST (20181213/psparse-531)
[   14.019588] ACPI Error: AE_NOT_EXIST, Evaluating _PMC (20181213/power_meter-756)
[   14.219839] ipmi_si: IPMI System Interface driver
[   14.225246] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS
[   14.232463] ipmi_platform: ipmi_si: SMBIOS: io 0xca8 regsize 1 spacing 4 irq 10
[   14.240788] ipmi_si: Adding SMBIOS-specified kcs state machine
[   14.247561] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca8, slave address 0x20, irq 10
[   14.296558] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   14.424962] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   14.454563] cryptd: max_cpu_qlen set to 1000
[   14.497098] [TTM] Zone  kernel: Available graphics memory: 8171712 kiB
[   14.504506] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[   14.511907] [TTM] Initializing pool allocator
[   14.511924] [TTM] Initializing DMA pool allocator
[   14.522776] nd_pmem namespace0.0: unable to guarantee persistence of writes
[   14.545209] fbcon: mgadrmfb (fb0) is primary device
[   14.597763] AVX version of gcm_enc/dec engaged.
[   14.597764] AES CTR mode by8 optimization enabled
[   14.640937] Console: switching to colour frame buffer device 128x48
[   14.670097] ipmi_si dmi-ipmi-si.0: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed.
[   14.670299] mgag200 0000:0b:00.0: fb0: mgadrmfb frame buffer device
[   14.720346] namespace0.0 initialised, 6291456 pages in 132ms
[   14.727120] pmem0: detected capacity change from 0 to 25769803776
[   14.734165] nd_pmem namespace1.0: unable to guarantee persistence of writes
[   14.742163] ipmi_si dmi-ipmi-si.0: Using irq 10
[   14.746131] [drm] Initialized mgag200 1.0.0 20110418 for 0000:0b:00.0 on minor 0
[   14.758412] ipmi_si dmi-ipmi-si.0: IPMI message handler: Found new BMC (man_id: 0x0002a2, prod_id: 0x0100, dev_id: 0x20)
[   14.769494] ipmi_si dmi-ipmi-si.0: IPMI kcs interface initialized
[   14.920049] namespace1.0 initialised, 6291456 pages in 132ms
[   14.920521] pmem1: detected capacity change from 0 to 25769803776
[   15.435228] Adding 15624188k swap on /dev/sda6.  Priority:-2 extents:1 across:15624188k FS
[   15.792400] intel_rapl: Found RAPL domain package
[   15.797682] intel_rapl: Found RAPL domain core
[   15.802665] intel_rapl: Found RAPL domain dram
[   15.807773] intel_rapl: Found RAPL domain package
[   15.813056] intel_rapl: Found RAPL domain core
[   15.818039] intel_rapl: Found RAPL domain dram
[   15.892958] EXT4-fs (sda7): mounted filesystem with ordered data mode. Opts: (null)
[   19.979138] tg3 0000:01:00.0 eth0: Link is up at 1000 Mbps, full duplex
[   19.987389] tg3 0000:01:00.0 eth0: Flow control is off for TX and off for RX
[   19.996000] tg3 0000:01:00.0 eth0: EEE is disabled
[   20.002200] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   29.438090] random: crng init done
[   29.441911] random: 7 urandom warning(s) missed due to ratelimiting
[   33.368518] FS-Cache: Loaded
[   33.592696] FS-Cache: Netfs 'nfs' registered for caching

_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: failure to setup devdax over fake nvdimm
  2019-03-15 23:42   ` Brice Goglin
@ 2019-03-16  1:19     ` Dan Williams
  2019-03-16  7:50       ` Brice Goglin
  0 siblings, 1 reply; 10+ messages in thread
From: Dan Williams @ 2019-03-16  1:19 UTC (permalink / raw)
  To: Brice Goglin; +Cc: linux-nvdimm

On Fri, Mar 15, 2019 at 4:42 PM Brice Goglin <Brice.Goglin@inria.fr> wrote:
>
>
> Le 16/03/2019 à 00:12, Dan Williams a écrit :
> > On Fri, Mar 15, 2019 at 3:31 PM Brice Goglin <Brice.Goglin@inria.fr> wrote:
> >> Hello Dan,
> >>
> >> On a machine emulating nvdimms over DDR using the memmap kernel parameter,
> >> I can't enable devdax anymore with ndctl, when using your libnvdimm-pending
> >> branch (1ffc664f9b8ca7346f2af0fb4f62b923193bf65c):
> >>
> >> # ndctl create-namespace -f -e namespace1.0 -t pmem -m devdax
> >> libndctl: ndctl_dax_enable: dax1.0: failed to enable
> >>   Error: namespace1.0: failed to enable
> >> failed to reconfigure namespace: No such device or address
> >>
> >> In the previous version of your libnvdimm-pending branch that I used before
> >> (8d4a7e3da68e88a6efd3acb5cc971d0c2ca219a4 from January 8th) this ndctl line
> >> worked fine right after boot.
> >>
> >> The difference between strace ndctl doesn't show anything obvious.
> >> * /sys/devices/platform/e820_pmem/ndbus0/region1/namespace1.0/holder_class contains nothing instead of "dax"
> >> * /sys/devices/platform/e820_pmem/ndbus0/region1/dax_seed contains dax1.0 instead of dax1.1
> >>
> >> Any idea where to look?
> > If my libnvdimm-pending branch worked it is likely due to the
> > alignment padding fixes I had pending there. Can you post the dmesg
> > from this failure?
> >
> > The alignment padding fixes are being abandoned in favor of just
> > teaching the core-mm to not require section (128MB) alignment, but
> > until then you need to make sure your persistent memory is 128MB
> > aligned.
>
> I am passing memmap=24G!7G memmap=24G!39G to the kernel command-line.
> It looks properly aligned.
>
> dmesg is below. Nothing appears when ndctl fails.

Hmm, ok. Can you boot with libnvdimm.dyndbg and see if it squawks
about the problem? If this is 1ffc664f9b8c then you need to have the
dax_pmem_compat driver or the dax_pmem driver to attach, and this also
won't work if you've hotplugged it with the kmem driver.
_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: failure to setup devdax over fake nvdimm
  2019-03-16  1:19     ` Dan Williams
@ 2019-03-16  7:50       ` Brice Goglin
  2019-03-16 16:16         ` Dan Williams
  0 siblings, 1 reply; 10+ messages in thread
From: Brice Goglin @ 2019-03-16  7:50 UTC (permalink / raw)
  To: Dan Williams; +Cc: linux-nvdimm

Le 16/03/2019 à 02:19, Dan Williams a écrit :

>
> Hmm, ok. Can you boot with libnvdimm.dyndbg and see if it squawks
> about the problem? If this is 1ffc664f9b8c then you need to have the
> dax_pmem_compat driver or the dax_pmem driver to attach, and this also
> won't work if you've hotplugged it with the kmem driver.


Things work when dax_pmem_compat is loaded.

[   93.387078] nd_bus ndbus0: START: dax_pmem_compat.probe(dax0.0)
[   93.387082] nd_bus ndbus0: END: dax_pmem_compat.probe(dax0.0) = -19
[   93.387101] nd_bus ndbus0: START: dax_pmem_compat.probe(dax1.0)
[   93.387103] nd_bus ndbus0: END: dax_pmem_compat.probe(dax1.0) = -19
[   96.741806] nd_bus ndbus0: nd_pmem.remove(namespace1.0) = 0
[   96.940567] nd namespace1.0: fail (-6)
[   96.941343] nd namespace1.0: fail (-6)
[   96.941488] nd dax1.0: result: 0 wrote: 1cdae3a1-5ede-45d6-a3fc-31bb5c4c891a
[   96.941583] nd dax1.0: result: 0 wrote: pmem
[   96.941650] nd dax1.0: result: 0 wrote: 2097152

[   96.941745] nd dax1.0: result: 13 wrote: namespace1.0
[   96.942445] nd_bus ndbus0: START: dax_pmem_compat.probe(dax1.0)
[   97.087764] dax1.0 initialised, 6192640 pages in 124ms
[   97.093554] nd_bus ndbus0: END: dax_pmem_compat.probe(dax1.0) = 0
[   97.093673] nd_bus ndbus0: START: dax_pmem_compat.probe(dax1.1)
[   97.093677] nd_bus ndbus0: END: dax_pmem_compat.probe(dax1.1) = -19


When only dax_pmem is loaded (compat is blacklisted), it fails with:

[   36.141032] nd_bus ndbus0: nd_pmem.remove(namespace1.0) = 0
[   36.343444] nd namespace1.0: fail (-6)
[   36.344268] nd namespace1.0: fail (-6)
[   36.344440] nd dax1.0: result: 0 wrote: bf1ed9eb-5fc1-4637-85e5-c67a59c7c59d
[   36.344528] nd dax1.0: result: 0 wrote: pmem
[   36.344595] nd dax1.0: result: 0 wrote: 2097152

[   36.344704] nd dax1.0: result: 13 wrote: namespace1.0
[   36.345802] nd dax1.0: result: 2 wrote: 

Boot dmesg below (before running ndctl).

Brice


[    0.000000] Linux version 5.0.0-rc6+ (bgoglin@averell1) (gcc version 8.2.0 (Debian 8.2.0-14)) #6 SMP Fri Mar 15 19:35:25 CET 2019
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.0.0-rc6+ root=UUID=f37dbe66-2ff2-4d99-bc44-1c6e36c2e0e2 ro console=tty0 console=ttyS1,115200n8 memmap=24G!7G memmap=24G!39G cgroup_no_v1=all libnvdimm.dyndbg
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009dfff] usable
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000009b2dffff] usable
[    0.000000] BIOS-e820: [mem 0x000000009b2e0000-0x000000009d31bfff] reserved
[    0.000000] BIOS-e820: [mem 0x000000009d31c000-0x000000009d35afff] ACPI data
[    0.000000] BIOS-e820: [mem 0x000000009d35b000-0x000000009fffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fe000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000105fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] user-defined physical RAM map:
[    0.000000] user: [mem 0x0000000000000000-0x000000000009dfff] usable
[    0.000000] user: [mem 0x0000000000100000-0x000000009b2dffff] usable
[    0.000000] user: [mem 0x000000009b2e0000-0x000000009d31bfff] reserved
[    0.000000] user: [mem 0x000000009d31c000-0x000000009d35afff] ACPI data
[    0.000000] user: [mem 0x000000009d35b000-0x000000009fffffff] reserved
[    0.000000] user: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] user: [mem 0x00000000fe000000-0x00000000ffffffff] reserved
[    0.000000] user: [mem 0x0000000100000000-0x00000001bfffffff] usable
[    0.000000] user: [mem 0x00000001c0000000-0x00000007bfffffff] persistent (type 12)
[    0.000000] user: [mem 0x00000007c0000000-0x00000009bfffffff] usable
[    0.000000] user: [mem 0x00000009c0000000-0x0000000fbfffffff] persistent (type 12)
[    0.000000] user: [mem 0x0000000fc0000000-0x000000105fffffff] usable
[    0.000000] SMBIOS 2.7 present.
[    0.000000] DMI: Dell Inc. PowerEdge R720/046V88, BIOS 1.2.6 05/10/2012
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] tsc: Detected 2000.160 MHz processor
[    0.002335] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.002337] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.002341] last_pfn = 0x1060000 max_arch_pfn = 0x400000000
[    0.002346] MTRR default type: uncachable
[    0.002346] MTRR fixed ranges enabled:
[    0.002347]   00000-9FFFF write-back
[    0.002348]   A0000-BFFFF uncachable
[    0.002349]   C0000-C7FFF write-protect
[    0.002350]   C8000-D3FFF write-back
[    0.002350]   D4000-EBFFF uncachable
[    0.002351]   EC000-FFFFF write-protect
[    0.002352] MTRR variable ranges enabled:
[    0.002353]   0 base 000000000000 mask 3FFF80000000 write-back
[    0.002354]   1 base 000080000000 mask 3FFFE0000000 write-back
[    0.002355]   2 base 000100000000 mask 3FFF00000000 write-back
[    0.002356]   3 base 000200000000 mask 3FFE00000000 write-back
[    0.002357]   4 base 000400000000 mask 3FFC00000000 write-back
[    0.002358]   5 base 000800000000 mask 3FF800000000 write-back
[    0.002359]   6 base 001000000000 mask 3FFFC0000000 write-back
[    0.002360]   7 base 001040000000 mask 3FFFE0000000 write-back
[    0.002360]   8 disabled
[    0.002361]   9 disabled
[    0.005266] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.005675] e820: update [mem 0xa0000000-0xffffffff] usable ==> reserved
[    0.005680] last_pfn = 0x9b2e0 max_arch_pfn = 0x400000000
[    0.016631] found SMP MP-table at [mem 0x000fe710-0x000fe71f] mapped at [(____ptrval____)]
[    0.027478] Base memory trampoline at [(____ptrval____)] 98000 size 24576
[    0.027482] Using GB pages for direct mapping
[    0.027485] BRK [0x110c01000, 0x110c01fff] PGTABLE
[    0.027487] BRK [0x110c02000, 0x110c02fff] PGTABLE
[    0.027488] BRK [0x110c03000, 0x110c03fff] PGTABLE
[    0.027527] BRK [0x110c04000, 0x110c04fff] PGTABLE
[    0.027529] BRK [0x110c05000, 0x110c05fff] PGTABLE
[    0.027708] BRK [0x110c06000, 0x110c06fff] PGTABLE
[    0.027755] BRK [0x110c07000, 0x110c07fff] PGTABLE
[    0.027890] RAMDISK: [mem 0x32bbf000-0x355d6fff]
[    0.027896] ACPI: Early table checksum verification disabled
[    0.030663] ACPI: RSDP 0x00000000000F1090 000024 (v02 DELL  )
[    0.030667] ACPI: XSDT 0x00000000000F1194 00009C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030672] ACPI: FACP 0x000000009D34115C 0000F4 (v03 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030678] ACPI: DSDT 0x000000009D31C000 00723C (v01 DELL   PE_SC3   00000001 INTL 20110211)
[    0.030681] ACPI: FACS 0x000000009D343000 000040
[    0.030684] ACPI: FACS 0x000000009D343000 000040
[    0.030687] ACPI: APIC 0x000000009D340478 00016A (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030690] ACPI: SPCR 0x000000009D3405E4 000050 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030693] ACPI: HPET 0x000000009D340638 000038 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030696] ACPI: DMAR 0x000000009D340674 000198 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030699] ACPI: MCFG 0x000000009D340990 00003C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030702] ACPI: WD__ 0x000000009D3409D0 000134 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030705] ACPI: SLIC 0x000000009D340B08 000024 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030709] ACPI: ERST 0x000000009D3233FC 000270 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030712] ACPI: HEST 0x000000009D32366C 00059C (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030715] ACPI: BERT 0x000000009D32323C 000030 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030718] ACPI: EINJ 0x000000009D32326C 000190 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030721] ACPI: TCPA 0x000000009D3410F4 000064 (v02 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030724] ACPI: SRAT 0x000000009D340D30 0003C0 (v01 DELL   PE_SC3   00000001 DELL 00000001)
[    0.030727] ACPI: SSDT 0x000000009D344000 008054 (v01 INTEL  PPM RCM  80000001 INTL 20061109)
[    0.030736] ACPI: Local APIC address 0xfee00000
[    0.030761] SRAT: PXM 1 -> APIC 0x00 -> Node 0
[    0.030763] SRAT: PXM 2 -> APIC 0x20 -> Node 1
[    0.030764] SRAT: PXM 1 -> APIC 0x02 -> Node 0
[    0.030765] SRAT: PXM 2 -> APIC 0x22 -> Node 1
[    0.030765] SRAT: PXM 1 -> APIC 0x04 -> Node 0
[    0.030766] SRAT: PXM 2 -> APIC 0x24 -> Node 1
[    0.030767] SRAT: PXM 1 -> APIC 0x06 -> Node 0
[    0.030768] SRAT: PXM 2 -> APIC 0x26 -> Node 1
[    0.030769] SRAT: PXM 1 -> APIC 0x08 -> Node 0
[    0.030770] SRAT: PXM 2 -> APIC 0x28 -> Node 1
[    0.030770] SRAT: PXM 1 -> APIC 0x0a -> Node 0
[    0.030771] SRAT: PXM 2 -> APIC 0x2a -> Node 1
[    0.030772] SRAT: PXM 1 -> APIC 0x0c -> Node 0
[    0.030773] SRAT: PXM 2 -> APIC 0x2c -> Node 1
[    0.030774] SRAT: PXM 1 -> APIC 0x0e -> Node 0
[    0.030775] SRAT: PXM 2 -> APIC 0x2e -> Node 1
[    0.030775] SRAT: PXM 1 -> APIC 0x01 -> Node 0
[    0.030776] SRAT: PXM 2 -> APIC 0x21 -> Node 1
[    0.030777] SRAT: PXM 1 -> APIC 0x03 -> Node 0
[    0.030778] SRAT: PXM 2 -> APIC 0x23 -> Node 1
[    0.030779] SRAT: PXM 1 -> APIC 0x05 -> Node 0
[    0.030780] SRAT: PXM 2 -> APIC 0x25 -> Node 1
[    0.030781] SRAT: PXM 1 -> APIC 0x07 -> Node 0
[    0.030781] SRAT: PXM 2 -> APIC 0x27 -> Node 1
[    0.030782] SRAT: PXM 1 -> APIC 0x09 -> Node 0
[    0.030783] SRAT: PXM 2 -> APIC 0x29 -> Node 1
[    0.030784] SRAT: PXM 1 -> APIC 0x0b -> Node 0
[    0.030785] SRAT: PXM 2 -> APIC 0x2b -> Node 1
[    0.030786] SRAT: PXM 1 -> APIC 0x0d -> Node 0
[    0.030786] SRAT: PXM 2 -> APIC 0x2d -> Node 1
[    0.030787] SRAT: PXM 1 -> APIC 0x0f -> Node 0
[    0.030788] SRAT: PXM 2 -> APIC 0x2f -> Node 1
[    0.030792] ACPI: SRAT: Node 0 PXM 1 [mem 0x00000000-0x85fffffff]
[    0.030793] ACPI: SRAT: Node 1 PXM 2 [mem 0x860000000-0x105fffffff]
[    0.030799] NODE_DATA(0) allocated [mem 0x85fffb000-0x85fffffff]
[    0.030803] NODE_DATA(1) allocated [mem 0x105fffb000-0x105fffffff]
[    0.030855] Zone ranges:
[    0.030856]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.030857]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.030859]   Normal   [mem 0x0000000100000000-0x000000105fffffff]
[    0.030860]   Device   empty
[    0.030861] Movable zone start for each node
[    0.030862] Early memory node ranges
[    0.030863]   node   0: [mem 0x0000000000001000-0x000000000009dfff]
[    0.030864]   node   0: [mem 0x0000000000100000-0x000000009b2dffff]
[    0.030865]   node   0: [mem 0x0000000100000000-0x00000001bfffffff]
[    0.030866]   node   0: [mem 0x00000007c0000000-0x000000085fffffff]
[    0.030867]   node   1: [mem 0x0000000860000000-0x00000009bfffffff]
[    0.030868]   node   1: [mem 0x0000000fc0000000-0x000000105fffffff]
[    0.031412] Zeroed struct page in unavailable ranges: 19843 pages
[    0.031414] Initmem setup node 0 [mem 0x0000000000001000-0x000000085fffffff]
[    0.031416] On node 0 totalpages: 2077309
[    0.031417]   DMA zone: 64 pages used for memmap
[    0.031418]   DMA zone: 21 pages reserved
[    0.031418]   DMA zone: 3997 pages, LIFO batch:0
[    0.031558]   DMA32 zone: 9868 pages used for memmap
[    0.031559]   DMA32 zone: 631520 pages, LIFO batch:63
[    0.052617]   Normal zone: 22528 pages used for memmap
[    0.052619]   Normal zone: 1441792 pages, LIFO batch:63
[    0.119063] Initmem setup node 1 [mem 0x0000000860000000-0x000000105fffffff]
[    0.119067] On node 1 totalpages: 2097152
[    0.119068]   Normal zone: 32768 pages used for memmap
[    0.119069]   Normal zone: 2097152 pages, LIFO batch:63
[    0.206850] ACPI: PM-Timer IO Port: 0x808
[    0.206855] ACPI: Local APIC address 0xfee00000
[    0.206865] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.206876] IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23
[    0.206881] IOAPIC[1]: apic_id 1, version 32, address 0xfec3f000, GSI 32-55
[    0.206885] IOAPIC[2]: apic_id 2, version 32, address 0xfec7f000, GSI 64-87
[    0.206888] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.206890] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.206892] ACPI: IRQ0 used by override.
[    0.206893] ACPI: IRQ9 used by override.
[    0.206895] Using ACPI (MADT) for SMP configuration information
[    0.206896] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.206901] ACPI: SPCR: SPCR table version 1
[    0.206903] ACPI: SPCR: console: uart,io,0x2f8,115200
[    0.206906] smpboot: Allowing 32 CPUs, 0 hotplug CPUs
[    0.206920] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.206922] PM: Registered nosave memory: [mem 0x0009e000-0x000fffff]
[    0.206924] PM: Registered nosave memory: [mem 0x9b2e0000-0x9d31bfff]
[    0.206924] PM: Registered nosave memory: [mem 0x9d31c000-0x9d35afff]
[    0.206925] PM: Registered nosave memory: [mem 0x9d35b000-0x9fffffff]
[    0.206926] PM: Registered nosave memory: [mem 0xa0000000-0xdfffffff]
[    0.206927] PM: Registered nosave memory: [mem 0xe0000000-0xefffffff]
[    0.206928] PM: Registered nosave memory: [mem 0xf0000000-0xfdffffff]
[    0.206929] PM: Registered nosave memory: [mem 0xfe000000-0xffffffff]
[    0.206931] PM: Registered nosave memory: [mem 0x1c0000000-0x7bfffffff]
[    0.206932] PM: Registered nosave memory: [mem 0x9c0000000-0xfbfffffff]
[    0.206935] [mem 0xa0000000-0xdfffffff] available for PCI devices
[    0.206936] Booting paravirtualized kernel on bare hardware
[    0.206940] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.321002] random: get_random_bytes called from start_kernel+0x93/0x4a9 with crng_init=0
[    0.321010] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:32 nr_node_ids:2
[    0.322543] percpu: Embedded 44 pages/cpu @(____ptrval____) s142168 r8192 d29864 u262144
[    0.322551] pcpu-alloc: s142168 r8192 d29864 u262144 alloc=1*2097152
[    0.322552] pcpu-alloc: [0] 00 02 04 06 08 10 12 14 [0] 16 18 20 22 24 26 28 30 
[    0.322557] pcpu-alloc: [1] 01 03 05 07 09 11 13 15 [1] 17 19 21 23 25 27 29 31 
[    0.322583] Built 2 zonelists, mobility grouping on.  Total pages: 4109212
[    0.322584] Policy zone: Normal
[    0.322587] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.0.0-rc6+ root=UUID=f37dbe66-2ff2-4d99-bc44-1c6e36c2e0e2 ro console=tty0 console=ttyS1,115200n8 memmap=24G!7G memmap=24G!39G cgroup_no_v1=all libnvdimm.dyndbg
[    0.322690] printk: log_buf_len individual max cpu contribution: 4096 bytes
[    0.322691] printk: log_buf_len total cpu_extra contributions: 126976 bytes
[    0.322692] printk: log_buf_len min size: 131072 bytes
[    0.322749] printk: log_buf_len: 262144 bytes
[    0.322750] printk: early log buf free: 117620(89%)
[    0.332903] Calgary: detecting Calgary via BIOS EBDA area
[    0.332905] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.380104] Memory: 16295836K/16697844K available (10243K kernel code, 1191K rwdata, 3228K rodata, 1572K init, 2380K bss, 402008K reserved, 0K cma-reserved)
[    0.380398] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=32, Nodes=2
[    0.380409] Kernel/User page tables isolation: enabled
[    0.380433] ftrace: allocating 31607 entries in 124 pages
[    0.393256] rcu: Hierarchical RCU implementation.
[    0.393258] rcu: 	RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=32.
[    0.393259] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.393260] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=32
[    0.396737] NR_IRQS: 33024, nr_irqs: 1768, preallocated irqs: 16
[    0.405216] Console: colour VGA+ 80x25
[    0.423467] printk: console [tty0] enabled
[    1.566960] printk: console [ttyS1] enabled
[    1.571761] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[    1.584442] ACPI: Core revision 20181213
[    1.589159] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[    1.599494] hpet clockevent registered
[    1.599498] APIC: Switch to symmetric I/O mode setup
[    1.605154] DMAR: Host address width 46
[    1.609543] DMAR: DRHD base: 0x000000be200000 flags: 0x0
[    1.615587] DMAR: dmar0: reg_base_addr be200000 ver 1:0 cap d2078c106f0462 ecap f020fe
[    1.624564] DMAR: DRHD base: 0x000000dd900000 flags: 0x1
[    1.630608] DMAR: dmar1: reg_base_addr dd900000 ver 1:0 cap d2078c106f0462 ecap f020fe
[    1.639585] DMAR: RMRR base: 0x0000009f458000 end: 0x0000009f46ffff
[    1.646693] DMAR: RMRR base: 0x0000009f450000 end: 0x0000009f450fff
[    1.653792] DMAR: RMRR base: 0x0000009f452000 end: 0x0000009f452fff
[    1.660902] DMAR: ATSR flags: 0x0
[    1.664708] DMAR-IR: IOAPIC id 2 under DRHD base  0xbe200000 IOMMU 0
[    1.671913] DMAR-IR: IOAPIC id 0 under DRHD base  0xdd900000 IOMMU 1
[    1.679111] DMAR-IR: IOAPIC id 1 under DRHD base  0xdd900000 IOMMU 1
[    1.686317] DMAR-IR: HPET id 0 under DRHD base 0xdd900000
[    1.692445] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit.
[    1.692446] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting.
[    1.709602] DMAR-IR: Enabled IRQ remapping in xapic mode
[    1.715636] x2apic: IRQ remapping doesn't support X2APIC mode
[    1.722157] Switched APIC routing to physical flat.
[    1.728322] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    1.751488] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x1cd4c5474ee, max_idle_ns: 440795209573 ns
[    1.763384] Calibrating delay loop (skipped), value calculated using timer frequency.. 4000.32 BogoMIPS (lpj=8000640)
[    1.767375] pid_max: default: 32768 minimum: 301
[    1.771431] LSM: Security Framework initializing
[    1.775375] Yama: becoming mindful.
[    1.779408] AppArmor: AppArmor initialized
[    1.789229] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    1.792738] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[    1.795440] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes)
[    1.799420] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes)
[    1.807611] Disabling cpuset control group subsystem in v1 mounts
[    1.811380] Disabling cpu control group subsystem in v1 mounts
[    1.815376] Disabling cpuacct control group subsystem in v1 mounts
[    1.819377] Disabling io control group subsystem in v1 mounts
[    1.823396] Disabling memory control group subsystem in v1 mounts
[    1.827377] Disabling devices control group subsystem in v1 mounts
[    1.831376] Disabling freezer control group subsystem in v1 mounts
[    1.835375] Disabling net_cls control group subsystem in v1 mounts
[    1.839377] Disabling perf_event control group subsystem in v1 mounts
[    1.843375] Disabling net_prio control group subsystem in v1 mounts
[    1.847375] Disabling pids control group subsystem in v1 mounts
[    1.851427] mce: CPU supports 20 MCE banks
[    1.855390] mce: CPU0: Thermal monitoring enabled (TM1)
[    1.859404] process: using mwait in idle threads
[    1.863377] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[    1.867375] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0
[    1.871376] Spectre V2 : Mitigation: Full generic retpoline
[    1.875374] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    1.879375] Speculative Store Bypass: Vulnerable
[    1.883528] Freeing SMP alternatives memory: 28K
[    1.889922] TSC deadline timer enabled
[    1.889927] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz (family: 0x6, model: 0x2d, stepping: 0x7)
[    1.891535] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    1.895379] core: PEBS disabled due to CPU errata, please upgrade microcode
[    1.899384] ... version:                3
[    1.903375] ... bit width:              48
[    1.907375] ... generic registers:      4
[    1.911375] ... value mask:             0000ffffffffffff
[    1.915375] ... max period:             00007fffffffffff
[    1.919375] ... fixed-purpose events:   3
[    1.923375] ... event mask:             000000070000000f
[    1.927432] rcu: Hierarchical SRCU implementation.
[    1.933843] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[    1.935842] smp: Bringing up secondary CPUs ...
[    1.939499] x86: Booting SMP configuration:
[    1.943378] .... node  #1, CPUs:        #1
[    2.031377] .... node  #0, CPUs:    #2
[    2.039377] .... node  #1, CPUs:    #3
[    2.043377] .... node  #0, CPUs:    #4
[    2.047377] .... node  #1, CPUs:    #5
[    2.051376] .... node  #0, CPUs:    #6
[    2.055378] .... node  #1, CPUs:    #7
[    2.059377] .... node  #0, CPUs:    #8
[    2.063377] .... node  #1, CPUs:    #9
[    2.067376] .... node  #0, CPUs:   #10
[    2.071378] .... node  #1, CPUs:   #11
[    2.075377] .... node  #0, CPUs:   #12
[    2.079378] .... node  #1, CPUs:   #13
[    2.083376] .... node  #0, CPUs:   #14
[    2.087378] .... node  #1, CPUs:   #15
[    2.091377] .... node  #0, CPUs:   #16
[    2.095378] .... node  #1, CPUs:   #17
[    2.099376] .... node  #0, CPUs:   #18
[    2.103378] .... node  #1, CPUs:   #19
[    2.107377] .... node  #0, CPUs:   #20
[    2.111378] .... node  #1, CPUs:   #21
[    2.115376] .... node  #0, CPUs:   #22
[    2.119378] .... node  #1, CPUs:   #23
[    2.123377] .... node  #0, CPUs:   #24
[    2.127378] .... node  #1, CPUs:   #25
[    2.131376] .... node  #0, CPUs:   #26
[    2.135378] .... node  #1, CPUs:   #27
[    2.139377] .... node  #0, CPUs:   #28
[    2.143378] .... node  #1, CPUs:   #29
[    2.147376] .... node  #0, CPUs:   #30
[    2.151378] .... node  #1, CPUs:   #31
[    2.154145] smp: Brought up 2 nodes, 32 CPUs
[    2.159376] smpboot: Max logical packages: 2
[    2.163376] smpboot: Total of 32 processors activated (128029.68 BogoMIPS)
[    2.173328] devtmpfs: initialized
[    2.175450] x86/mm: Memory block size: 512MB
[    2.179872] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    2.191411] futex hash table entries: 8192 (order: 7, 524288 bytes)
[    2.199629] pinctrl core: initialized pinctrl subsystem
[    2.203628] NET: Registered protocol family 16
[    2.211489] audit: initializing netlink subsys (disabled)
[    2.215395] audit: type=2000 audit(1552722322.548:1): state=initialized audit_enabled=0 res=1
[    2.227377] cpuidle: using governor ladder
[    2.231397] cpuidle: using governor menu
[    2.235439] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    2.243376] ACPI: bus type PCI registered
[    2.247376] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    2.255489] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0xe0000000-0xefffffff] (base 0xe0000000)
[    2.267378] PCI: MMCONFIG at [mem 0xe0000000-0xefffffff] reserved in E820
[    2.275393] PCI: Using configuration type 1 for base access
[    2.279389] PCI: Dell System detected, enabling pci=bfsort.
[    2.287409] core: PMU erratum BJ122, BV98, HSD29 worked around, HT is on
[    2.297046] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    2.303377] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    2.311574] ACPI: Added _OSI(Module Device)
[    2.315377] ACPI: Added _OSI(Processor Device)
[    2.323376] ACPI: Added _OSI(3.0 _SCP Extensions)
[    2.327375] ACPI: Added _OSI(Processor Aggregator Device)
[    2.335376] ACPI: Added _OSI(Linux-Dell-Video)
[    2.339375] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    2.343375] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    2.354267] ACPI: 2 ACPI AML tables successfully acquired and loaded
[    2.359927] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    2.371101] ACPI: Interpreter enabled
[    2.375389] ACPI: (supports S0 S4 S5)
[    2.379376] ACPI: Using IOAPIC for interrupt routing
[    2.387503] HEST: Table parsing has been initialized.
[    2.391377] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    2.403544] ACPI: Enabled 4 GPEs in block 00 to 3F
[    2.416205] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3d])
[    2.423383] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.431464] acpi PNP0A08:00: PCIe AER handled by firmware
[    2.439544] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    2.451377] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.459981] PCI host bridge to bus 0000:00
[    2.463378] pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
[    2.471376] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
[    2.479376] pci_bus 0000:00: root bus resource [io  0x03b0-0x03df window]
[    2.487376] pci_bus 0000:00: root bus resource [io  0x0d00-0x1fff window]
[    2.495376] pci_bus 0000:00: root bus resource [io  0x8000-0x9fff window]
[    2.503376] pci_bus 0000:00: root bus resource [io  0xa000-0xbfff window]
[    2.511376] pci_bus 0000:00: root bus resource [io  0xc000-0xdfff window]
[    2.519376] pci_bus 0000:00: root bus resource [io  0xe000-0xffff window]
[    2.527376] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    2.535376] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xdfffffff window]
[    2.543376] pci_bus 0000:00: root bus resource [mem 0xfed40000-0xfed44fff window]
[    2.551378] pci_bus 0000:00: root bus resource [bus 00-3d]
[    2.559387] pci 0000:00:00.0: [8086:3c00] type 00 class 0x060000
[    2.559467] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    2.559548] pci 0000:00:01.0: [8086:3c02] type 01 class 0x060400
[    2.559632] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    2.559739] pci 0000:00:01.1: [8086:3c03] type 01 class 0x060400
[    2.559822] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
[    2.559913] pci 0000:00:02.0: [8086:3c04] type 01 class 0x060400
[    2.559996] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[    2.560113] pci 0000:00:02.2: [8086:3c06] type 01 class 0x060400
[    2.560198] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[    2.560283] pci 0000:00:03.0: [8086:3c08] type 01 class 0x060400
[    2.560323] pci 0000:00:03.0: enabling Extended Tags
[    2.567424] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    2.567544] pci 0000:00:04.0: [8086:3c20] type 00 class 0x088000
[    2.567563] pci 0000:00:04.0: reg 0x10: [mem 0xdd8dc000-0xdd8dffff 64bit]
[    2.567691] pci 0000:00:04.1: [8086:3c21] type 00 class 0x088000
[    2.567709] pci 0000:00:04.1: reg 0x10: [mem 0xdd8e0000-0xdd8e3fff 64bit]
[    2.567830] pci 0000:00:04.2: [8086:3c22] type 00 class 0x088000
[    2.567849] pci 0000:00:04.2: reg 0x10: [mem 0xdd8e4000-0xdd8e7fff 64bit]
[    2.567970] pci 0000:00:04.3: [8086:3c23] type 00 class 0x088000
[    2.567989] pci 0000:00:04.3: reg 0x10: [mem 0xdd8e8000-0xdd8ebfff 64bit]
[    2.568109] pci 0000:00:04.4: [8086:3c24] type 00 class 0x088000
[    2.568127] pci 0000:00:04.4: reg 0x10: [mem 0xdd8ec000-0xdd8effff 64bit]
[    2.568247] pci 0000:00:04.5: [8086:3c25] type 00 class 0x088000
[    2.568265] pci 0000:00:04.5: reg 0x10: [mem 0xdd8f0000-0xdd8f3fff 64bit]
[    2.568387] pci 0000:00:04.6: [8086:3c26] type 00 class 0x088000
[    2.568406] pci 0000:00:04.6: reg 0x10: [mem 0xdd8f4000-0xdd8f7fff 64bit]
[    2.568530] pci 0000:00:04.7: [8086:3c27] type 00 class 0x088000
[    2.568548] pci 0000:00:04.7: reg 0x10: [mem 0xdd8f8000-0xdd8fbfff 64bit]
[    2.568669] pci 0000:00:05.0: [8086:3c28] type 00 class 0x088000
[    2.568792] pci 0000:00:05.2: [8086:3c2a] type 00 class 0x088000
[    2.568915] pci 0000:00:11.0: [8086:1d3e] type 01 class 0x060400
[    2.569013] pci 0000:00:11.0: PME# supported from D0 D3hot D3cold
[    2.569098] pci 0000:00:16.0: [8086:1d3a] type 00 class 0x078000
[    2.569119] pci 0000:00:16.0: reg 0x10: [mem 0xdd8fc000-0xdd8fc00f 64bit]
[    2.569181] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[    2.569244] pci 0000:00:16.1: [8086:1d3b] type 00 class 0x078000
[    2.569265] pci 0000:00:16.1: reg 0x10: [mem 0xdd8fd000-0xdd8fd00f 64bit]
[    2.569327] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
[    2.569403] pci 0000:00:1a.0: [8086:1d2d] type 00 class 0x0c0320
[    2.569425] pci 0000:00:1a.0: reg 0x10: [mem 0xdd8fe000-0xdd8fe3ff]
[    2.569508] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[    2.569575] pci 0000:00:1c.0: [8086:1d10] type 01 class 0x060400
[    2.569657] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    2.569760] pci 0000:00:1c.7: [8086:1d1e] type 01 class 0x060400
[    2.569844] pci 0000:00:1c.7: PME# supported from D0 D3hot D3cold
[    2.569925] pci 0000:00:1d.0: [8086:1d26] type 00 class 0x0c0320
[    2.569947] pci 0000:00:1d.0: reg 0x10: [mem 0xdd8ff000-0xdd8ff3ff]
[    2.570031] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[    2.570098] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
[    2.570201] pci 0000:00:1f.0: [8086:1d41] type 00 class 0x060100
[    2.570447] pci 0000:02:00.0: [14e4:165f] type 00 class 0x020000
[    2.570469] pci 0000:02:00.0: reg 0x10: [mem 0xd10a0000-0xd10affff 64bit pref]
[    2.570481] pci 0000:02:00.0: reg 0x18: [mem 0xd10b0000-0xd10bffff 64bit pref]
[    2.570492] pci 0000:02:00.0: reg 0x20: [mem 0xd10c0000-0xd10cffff 64bit pref]
[    2.570500] pci 0000:02:00.0: reg 0x30: [mem 0xda000000-0xda03ffff pref]
[    2.570560] pci 0000:02:00.0: PME# supported from D0 D3hot D3cold
[    2.570588] pci 0000:02:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5 GT/s x1 link at 0000:00:01.0 (capable of 8.000 Gb/s with 5 GT/s x2 link)
[    2.583460] pci 0000:02:00.1: [14e4:165f] type 00 class 0x020000
[    2.583483] pci 0000:02:00.1: reg 0x10: [mem 0xd10d0000-0xd10dffff 64bit pref]
[    2.583494] pci 0000:02:00.1: reg 0x18: [mem 0xd10e0000-0xd10effff 64bit pref]
[    2.583506] pci 0000:02:00.1: reg 0x20: [mem 0xd10f0000-0xd10fffff 64bit pref]
[    2.583513] pci 0000:02:00.1: reg 0x30: [mem 0xda000000-0xda03ffff pref]
[    2.583574] pci 0000:02:00.1: PME# supported from D0 D3hot D3cold
[    2.583688] pci 0000:00:01.0: PCI bridge to [bus 02]
[    2.591381] pci 0000:00:01.0:   bridge window [mem 0xda000000-0xda7fffff]
[    2.591385] pci 0000:00:01.0:   bridge window [mem 0xd1000000-0xd10fffff 64bit pref]
[    2.591450] pci 0000:01:00.0: [14e4:165f] type 00 class 0x020000
[    2.591472] pci 0000:01:00.0: reg 0x10: [mem 0xd11a0000-0xd11affff 64bit pref]
[    2.591483] pci 0000:01:00.0: reg 0x18: [mem 0xd11b0000-0xd11bffff 64bit pref]
[    2.591494] pci 0000:01:00.0: reg 0x20: [mem 0xd11c0000-0xd11cffff 64bit pref]
[    2.591502] pci 0000:01:00.0: reg 0x30: [mem 0xda800000-0xda83ffff pref]
[    2.591562] pci 0000:01:00.0: PME# supported from D0 D3hot D3cold
[    2.591588] pci 0000:01:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5 GT/s x1 link at 0000:00:01.1 (capable of 8.000 Gb/s with 5 GT/s x2 link)
[    2.607454] pci 0000:01:00.1: [14e4:165f] type 00 class 0x020000
[    2.607477] pci 0000:01:00.1: reg 0x10: [mem 0xd11d0000-0xd11dffff 64bit pref]
[    2.607488] pci 0000:01:00.1: reg 0x18: [mem 0xd11e0000-0xd11effff 64bit pref]
[    2.607499] pci 0000:01:00.1: reg 0x20: [mem 0xd11f0000-0xd11fffff 64bit pref]
[    2.607507] pci 0000:01:00.1: reg 0x30: [mem 0xda800000-0xda83ffff pref]
[    2.607566] pci 0000:01:00.1: PME# supported from D0 D3hot D3cold
[    2.607679] pci 0000:00:01.1: PCI bridge to [bus 01]
[    2.611380] pci 0000:00:01.1:   bridge window [mem 0xda800000-0xdaffffff]
[    2.611385] pci 0000:00:01.1:   bridge window [mem 0xd1100000-0xd11fffff 64bit pref]
[    2.611427] pci 0000:00:02.0: PCI bridge to [bus 04]
[    2.619425] pci 0000:03:00.0: [1000:0073] type 00 class 0x010400
[    2.619437] pci 0000:03:00.0: reg 0x10: [io  0xfc00-0xfcff]
[    2.619445] pci 0000:03:00.0: reg 0x14: [mem 0xdbffc000-0xdbffffff 64bit]
[    2.619454] pci 0000:03:00.0: reg 0x1c: [mem 0xdbf80000-0xdbfbffff 64bit]
[    2.619464] pci 0000:03:00.0: reg 0x30: [mem 0xdb000000-0xdb01ffff pref]
[    2.619469] pci 0000:03:00.0: enabling Extended Tags
[    2.623409] pci 0000:03:00.0: supports D1 D2
[    2.623460] pci 0000:00:02.2: PCI bridge to [bus 03]
[    2.627378] pci 0000:00:02.2:   bridge window [io  0xf000-0xffff]
[    2.627381] pci 0000:00:02.2:   bridge window [mem 0xdb000000-0xdbffffff]
[    2.627430] pci 0000:05:00.0: [10de:1094] type 00 class 0x030200
[    2.627445] pci 0000:05:00.0: reg 0x10: [mem 0xd8000000-0xd8ffffff]
[    2.627454] pci 0000:05:00.0: reg 0x14: [mem 0xc0000000-0xc7ffffff 64bit pref]
[    2.627464] pci 0000:05:00.0: reg 0x1c: [mem 0xce000000-0xcfffffff 64bit pref]
[    2.627470] pci 0000:05:00.0: reg 0x24: [io  0xec80-0xecff]
[    2.627476] pci 0000:05:00.0: reg 0x30: [mem 0xd9800000-0xd987ffff pref]
[    2.627482] pci 0000:05:00.0: enabling Extended Tags
[    2.635481] pci 0000:00:03.0: PCI bridge to [bus 05]
[    2.639378] pci 0000:00:03.0:   bridge window [io  0xe000-0xefff]
[    2.639381] pci 0000:00:03.0:   bridge window [mem 0xd8000000-0xd9ffffff]
[    2.639386] pci 0000:00:03.0:   bridge window [mem 0xc0000000-0xcfffffff 64bit pref]
[    2.639430] pci 0000:00:11.0: PCI bridge to [bus 06]
[    2.647428] pci 0000:00:1c.0: PCI bridge to [bus 07]
[    2.651729] pci 0000:08:00.0: [1912:0013] type 01 class 0x060400
[    2.654283] pci 0000:08:00.0: PME# supported from D0 D3hot D3cold
[    2.655297] pci 0000:00:1c.7: PCI bridge to [bus 08-0c]
[    2.663381] pci 0000:00:1c.7:   bridge window [mem 0xdc000000-0xdd7fffff]
[    2.663386] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    2.664456] pci 0000:09:00.0: [1912:0013] type 01 class 0x060400
[    2.667377] pci 0000:09:00.0: PME# supported from D0 D3hot D3cold
[    2.668452] pci 0000:09:01.0: [1912:0013] type 01 class 0x060400
[    2.671557] pci 0000:09:01.0: PME# supported from D0 D3hot D3cold
[    2.673938] pci 0000:08:00.0: PCI bridge to [bus 09-0c]
[    2.679563] pci 0000:08:00.0:   bridge window [mem 0xdc000000-0xdd7fffff]
[    2.679688] pci 0000:08:00.0:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    2.680798] pci 0000:0a:00.0: [1912:0012] type 01 class 0x060400
[    2.684636] pci 0000:09:00.0: PCI bridge to [bus 0a-0b]
[    2.691589] pci 0000:09:00.0:   bridge window [mem 0xdc000000-0xdcffffff]
[    2.691733] pci 0000:09:00.0:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    2.692654] pci_bus 0000:0b: extended config space not accessible
[    2.699606] pci 0000:0b:00.0: [102b:0534] type 00 class 0x030000
[    2.700090] pci 0000:0b:00.0: reg 0x10: [mem 0xd0000000-0xd0ffffff pref]
[    2.700351] pci 0000:0b:00.0: reg 0x14: [mem 0xdcffc000-0xdcffffff]
[    2.700611] pci 0000:0b:00.0: reg 0x18: [mem 0xdc000000-0xdc7fffff]
[    2.704755] pci 0000:0a:00.0: PCI bridge to [bus 0b]
[    2.707590] pci 0000:0a:00.0:   bridge window [mem 0xdc000000-0xdcffffff]
[    2.707734] pci 0000:0a:00.0:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    2.708867] pci 0000:09:01.0: PCI bridge to [bus 0c]
[    2.715589] pci 0000:09:01.0:   bridge window [mem 0xdd700000-0xdd7fffff]
[    2.716717] pci_bus 0000:0d: extended config space not accessible
[    2.723426] pci 0000:00:1e.0: PCI bridge to [bus 0d] (subtractive decode)
[    2.731384] pci 0000:00:1e.0:   bridge window [io  0x0000-0x03af window] (subtractive decode)
[    2.731386] pci 0000:00:1e.0:   bridge window [io  0x03e0-0x0cf7 window] (subtractive decode)
[    2.731387] pci 0000:00:1e.0:   bridge window [io  0x03b0-0x03df window] (subtractive decode)
[    2.731389] pci 0000:00:1e.0:   bridge window [io  0x0d00-0x1fff window] (subtractive decode)
[    2.731391] pci 0000:00:1e.0:   bridge window [io  0x8000-0x9fff window] (subtractive decode)
[    2.731392] pci 0000:00:1e.0:   bridge window [io  0xa000-0xbfff window] (subtractive decode)
[    2.731394] pci 0000:00:1e.0:   bridge window [io  0xc000-0xdfff window] (subtractive decode)
[    2.731395] pci 0000:00:1e.0:   bridge window [io  0xe000-0xffff window] (subtractive decode)
[    2.731396] pci 0000:00:1e.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    2.731398] pci 0000:00:1e.0:   bridge window [mem 0xc0000000-0xdfffffff window] (subtractive decode)
[    2.731399] pci 0000:00:1e.0:   bridge window [mem 0xfed40000-0xfed44fff window] (subtractive decode)
[    2.731451] pci_bus 0000:00: on NUMA node 0
[    2.732545] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 40-7e])
[    2.739380] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.751462] acpi PNP0A08:01: PCIe AER handled by firmware
[    2.755543] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    2.767376] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.775938] PCI host bridge to bus 0000:40
[    2.779379] pci_bus 0000:40: root bus resource [io  0x2000-0x3fff window]
[    2.787376] pci_bus 0000:40: root bus resource [io  0x4000-0x5fff window]
[    2.795376] pci_bus 0000:40: root bus resource [io  0x6000-0x7fff window]
[    2.803377] pci_bus 0000:40: root bus resource [mem 0xa8000000-0xbfffffff window]
[    2.811378] pci_bus 0000:40: root bus resource [bus 40-7e]
[    2.819389] pci 0000:40:01.0: [8086:3c02] type 01 class 0x060400
[    2.819481] pci 0000:40:01.0: PME# supported from D0 D3hot D3cold
[    2.819607] pci 0000:40:02.0: [8086:3c04] type 01 class 0x060400
[    2.819697] pci 0000:40:02.0: PME# supported from D0 D3hot D3cold
[    2.819811] pci 0000:40:03.0: [8086:3c08] type 01 class 0x060400
[    2.819854] pci 0000:40:03.0: enabling Extended Tags
[    2.823427] pci 0000:40:03.0: PME# supported from D0 D3hot D3cold
[    2.823540] pci 0000:40:03.2: [8086:3c0a] type 01 class 0x060400
[    2.823630] pci 0000:40:03.2: PME# supported from D0 D3hot D3cold
[    2.823738] pci 0000:40:04.0: [8086:3c20] type 00 class 0x088000
[    2.823758] pci 0000:40:04.0: reg 0x10: [mem 0xbe1e0000-0xbe1e3fff 64bit]
[    2.823879] pci 0000:40:04.1: [8086:3c21] type 00 class 0x088000
[    2.823899] pci 0000:40:04.1: reg 0x10: [mem 0xbe1e4000-0xbe1e7fff 64bit]
[    2.824016] pci 0000:40:04.2: [8086:3c22] type 00 class 0x088000
[    2.824035] pci 0000:40:04.2: reg 0x10: [mem 0xbe1e8000-0xbe1ebfff 64bit]
[    2.824152] pci 0000:40:04.3: [8086:3c23] type 00 class 0x088000
[    2.824171] pci 0000:40:04.3: reg 0x10: [mem 0xbe1ec000-0xbe1effff 64bit]
[    2.824295] pci 0000:40:04.4: [8086:3c24] type 00 class 0x088000
[    2.824314] pci 0000:40:04.4: reg 0x10: [mem 0xbe1f0000-0xbe1f3fff 64bit]
[    2.824435] pci 0000:40:04.5: [8086:3c25] type 00 class 0x088000
[    2.824455] pci 0000:40:04.5: reg 0x10: [mem 0xbe1f4000-0xbe1f7fff 64bit]
[    2.824574] pci 0000:40:04.6: [8086:3c26] type 00 class 0x088000
[    2.824593] pci 0000:40:04.6: reg 0x10: [mem 0xbe1f8000-0xbe1fbfff 64bit]
[    2.824714] pci 0000:40:04.7: [8086:3c27] type 00 class 0x088000
[    2.824733] pci 0000:40:04.7: reg 0x10: [mem 0xbe1fc000-0xbe1fffff 64bit]
[    2.824848] pci 0000:40:05.0: [8086:3c28] type 00 class 0x088000
[    2.824962] pci 0000:40:05.2: [8086:3c2a] type 00 class 0x088000
[    2.825284] pci 0000:41:00.0: [15b3:1003] type 00 class 0x028000
[    2.825643] pci 0000:41:00.0: reg 0x10: [mem 0xbe000000-0xbe0fffff 64bit]
[    2.825818] pci 0000:41:00.0: reg 0x18: [mem 0xb8000000-0xb87fffff 64bit pref]
[    2.827365] pci 0000:40:01.0: PCI bridge to [bus 41]
[    2.835381] pci 0000:40:01.0:   bridge window [mem 0xbe000000-0xbe0fffff]
[    2.835386] pci 0000:40:01.0:   bridge window [mem 0xb8000000-0xb87fffff 64bit pref]
[    2.835434] pci 0000:42:00.0: [10de:1094] type 00 class 0x030200
[    2.835450] pci 0000:42:00.0: reg 0x10: [mem 0xbc000000-0xbcffffff]
[    2.835460] pci 0000:42:00.0: reg 0x14: [mem 0xa8000000-0xafffffff 64bit pref]
[    2.835470] pci 0000:42:00.0: reg 0x1c: [mem 0xb6000000-0xb7ffffff 64bit pref]
[    2.835476] pci 0000:42:00.0: reg 0x24: [io  0x7c80-0x7cff]
[    2.835483] pci 0000:42:00.0: reg 0x30: [mem 0xbd800000-0xbd87ffff pref]
[    2.835489] pci 0000:42:00.0: enabling Extended Tags
[    2.839485] pci 0000:40:02.0: PCI bridge to [bus 42]
[    2.847378] pci 0000:40:02.0:   bridge window [io  0x7000-0x7fff]
[    2.847381] pci 0000:40:02.0:   bridge window [mem 0xbc000000-0xbdffffff]
[    2.847386] pci 0000:40:02.0:   bridge window [mem 0xa8000000-0xb7ffffff 64bit pref]
[    2.847425] pci 0000:40:03.0: PCI bridge to [bus 43]
[    2.851422] pci 0000:40:03.2: PCI bridge to [bus 44]
[    2.855409] pci_bus 0000:40: on NUMA node 1
[    2.855481] ACPI: PCI Root Bridge [P0B1] (domain 0000 [bus 3f])
[    2.863379] acpi PNP0A08:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.871462] acpi PNP0A08:02: PCIe AER handled by firmware
[    2.879543] acpi PNP0A08:02: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    2.891376] acpi PNP0A08:02: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.899442] PCI host bridge to bus 0000:3f
[    2.903377] pci_bus 0000:3f: root bus resource [bus 3f]
[    2.911384] pci 0000:3f:08.0: [8086:3c80] type 00 class 0x088000
[    2.911448] pci 0000:3f:09.0: [8086:3c90] type 00 class 0x088000
[    2.911506] pci 0000:3f:0a.0: [8086:3cc0] type 00 class 0x088000
[    2.911560] pci 0000:3f:0a.1: [8086:3cc1] type 00 class 0x088000
[    2.911611] pci 0000:3f:0a.2: [8086:3cc2] type 00 class 0x088000
[    2.911661] pci 0000:3f:0a.3: [8086:3cd0] type 00 class 0x088000
[    2.911712] pci 0000:3f:0b.0: [8086:3ce0] type 00 class 0x088000
[    2.911763] pci 0000:3f:0b.3: [8086:3ce3] type 00 class 0x088000
[    2.911819] pci 0000:3f:0c.0: [8086:3ce8] type 00 class 0x088000
[    2.911868] pci 0000:3f:0c.1: [8086:3ce8] type 00 class 0x088000
[    2.911916] pci 0000:3f:0c.2: [8086:3ce8] type 00 class 0x088000
[    2.911966] pci 0000:3f:0c.3: [8086:3ce8] type 00 class 0x088000
[    2.912016] pci 0000:3f:0c.6: [8086:3cf4] type 00 class 0x088000
[    2.912066] pci 0000:3f:0c.7: [8086:3cf6] type 00 class 0x088000
[    2.912114] pci 0000:3f:0d.0: [8086:3ce8] type 00 class 0x088000
[    2.912162] pci 0000:3f:0d.1: [8086:3ce8] type 00 class 0x088000
[    2.912211] pci 0000:3f:0d.2: [8086:3ce8] type 00 class 0x088000
[    2.912259] pci 0000:3f:0d.3: [8086:3ce8] type 00 class 0x088000
[    2.912310] pci 0000:3f:0d.6: [8086:3cf5] type 00 class 0x088000
[    2.912362] pci 0000:3f:0e.0: [8086:3ca0] type 00 class 0x088000
[    2.912415] pci 0000:3f:0e.1: [8086:3c46] type 00 class 0x110100
[    2.912474] pci 0000:3f:0f.0: [8086:3ca8] type 00 class 0x088000
[    2.912545] pci 0000:3f:0f.1: [8086:3c71] type 00 class 0x088000
[    2.912611] pci 0000:3f:0f.2: [8086:3caa] type 00 class 0x088000
[    2.912683] pci 0000:3f:0f.3: [8086:3cab] type 00 class 0x088000
[    2.912751] pci 0000:3f:0f.4: [8086:3cac] type 00 class 0x088000
[    2.912816] pci 0000:3f:0f.5: [8086:3cad] type 00 class 0x088000
[    2.912882] pci 0000:3f:0f.6: [8086:3cae] type 00 class 0x088000
[    2.912939] pci 0000:3f:10.0: [8086:3cb0] type 00 class 0x088000
[    2.913008] pci 0000:3f:10.1: [8086:3cb1] type 00 class 0x088000
[    2.913074] pci 0000:3f:10.2: [8086:3cb2] type 00 class 0x088000
[    2.913142] pci 0000:3f:10.3: [8086:3cb3] type 00 class 0x088000
[    2.913211] pci 0000:3f:10.4: [8086:3cb4] type 00 class 0x088000
[    2.913278] pci 0000:3f:10.5: [8086:3cb5] type 00 class 0x088000
[    2.913349] pci 0000:3f:10.6: [8086:3cb6] type 00 class 0x088000
[    2.913418] pci 0000:3f:10.7: [8086:3cb7] type 00 class 0x088000
[    2.913482] pci 0000:3f:11.0: [8086:3cb8] type 00 class 0x088000
[    2.913539] pci 0000:3f:13.0: [8086:3ce4] type 00 class 0x088000
[    2.913588] pci 0000:3f:13.1: [8086:3c43] type 00 class 0x110100
[    2.913642] pci 0000:3f:13.4: [8086:3ce6] type 00 class 0x110100
[    2.913691] pci 0000:3f:13.5: [8086:3c44] type 00 class 0x110100
[    2.913741] pci 0000:3f:13.6: [8086:3c45] type 00 class 0x088000
[    2.913798] pci_bus 0000:3f: on NUMA node 0
[    2.913855] ACPI: PCI Root Bridge [P1B1] (domain 0000 [bus 7f])
[    2.919379] acpi PNP0A08:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    2.927462] acpi PNP0A08:03: PCIe AER handled by firmware
[    2.935543] acpi PNP0A08:03: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME PCIeCapability LTR]
[    2.943378] acpi PNP0A08:03: FADT indicates ASPM is unsupported, using BIOS configuration
[    2.955425] PCI host bridge to bus 0000:7f
[    2.959377] pci_bus 0000:7f: root bus resource [bus 7f]
[    2.963385] pci 0000:7f:08.0: [8086:3c80] type 00 class 0x088000
[    2.963453] pci 0000:7f:09.0: [8086:3c90] type 00 class 0x088000
[    2.963512] pci 0000:7f:0a.0: [8086:3cc0] type 00 class 0x088000
[    2.963563] pci 0000:7f:0a.1: [8086:3cc1] type 00 class 0x088000
[    2.963613] pci 0000:7f:0a.2: [8086:3cc2] type 00 class 0x088000
[    2.963663] pci 0000:7f:0a.3: [8086:3cd0] type 00 class 0x088000
[    2.963718] pci 0000:7f:0b.0: [8086:3ce0] type 00 class 0x088000
[    2.963767] pci 0000:7f:0b.3: [8086:3ce3] type 00 class 0x088000
[    2.963816] pci 0000:7f:0c.0: [8086:3ce8] type 00 class 0x088000
[    2.963866] pci 0000:7f:0c.1: [8086:3ce8] type 00 class 0x088000
[    2.963915] pci 0000:7f:0c.2: [8086:3ce8] type 00 class 0x088000
[    2.963967] pci 0000:7f:0c.3: [8086:3ce8] type 00 class 0x088000
[    2.964016] pci 0000:7f:0c.6: [8086:3cf4] type 00 class 0x088000
[    2.964065] pci 0000:7f:0c.7: [8086:3cf6] type 00 class 0x088000
[    2.964114] pci 0000:7f:0d.0: [8086:3ce8] type 00 class 0x088000
[    2.964165] pci 0000:7f:0d.1: [8086:3ce8] type 00 class 0x088000
[    2.964217] pci 0000:7f:0d.2: [8086:3ce8] type 00 class 0x088000
[    2.964267] pci 0000:7f:0d.3: [8086:3ce8] type 00 class 0x088000
[    2.964317] pci 0000:7f:0d.6: [8086:3cf5] type 00 class 0x088000
[    2.964370] pci 0000:7f:0e.0: [8086:3ca0] type 00 class 0x088000
[    2.964423] pci 0000:7f:0e.1: [8086:3c46] type 00 class 0x110100
[    2.964488] pci 0000:7f:0f.0: [8086:3ca8] type 00 class 0x088000
[    2.964555] pci 0000:7f:0f.1: [8086:3c71] type 00 class 0x088000
[    2.964622] pci 0000:7f:0f.2: [8086:3caa] type 00 class 0x088000
[    2.964689] pci 0000:7f:0f.3: [8086:3cab] type 00 class 0x088000
[    2.964757] pci 0000:7f:0f.4: [8086:3cac] type 00 class 0x088000
[    2.964823] pci 0000:7f:0f.5: [8086:3cad] type 00 class 0x088000
[    2.964889] pci 0000:7f:0f.6: [8086:3cae] type 00 class 0x088000
[    2.964944] pci 0000:7f:10.0: [8086:3cb0] type 00 class 0x088000
[    2.965012] pci 0000:7f:10.1: [8086:3cb1] type 00 class 0x088000
[    2.965078] pci 0000:7f:10.2: [8086:3cb2] type 00 class 0x088000
[    2.965146] pci 0000:7f:10.3: [8086:3cb3] type 00 class 0x088000
[    2.965213] pci 0000:7f:10.4: [8086:3cb4] type 00 class 0x088000
[    2.965283] pci 0000:7f:10.5: [8086:3cb5] type 00 class 0x088000
[    2.965353] pci 0000:7f:10.6: [8086:3cb6] type 00 class 0x088000
[    2.965420] pci 0000:7f:10.7: [8086:3cb7] type 00 class 0x088000
[    2.965486] pci 0000:7f:11.0: [8086:3cb8] type 00 class 0x088000
[    2.965547] pci 0000:7f:13.0: [8086:3ce4] type 00 class 0x088000
[    2.965596] pci 0000:7f:13.1: [8086:3c43] type 00 class 0x110100
[    2.965652] pci 0000:7f:13.4: [8086:3ce6] type 00 class 0x110100
[    2.965702] pci 0000:7f:13.5: [8086:3c44] type 00 class 0x110100
[    2.965753] pci 0000:7f:13.6: [8086:3c45] type 00 class 0x088000
[    2.965814] pci_bus 0000:7f: on NUMA node 1
[    2.965910] ACPI: PCI Interrupt Link [LK00] (IRQs 3 4 5 6 7 11 14 *15)
[    2.975437] ACPI: PCI Interrupt Link [LK01] (IRQs 3 4 5 6 7 11 *14 15)
[    2.983433] ACPI: PCI Interrupt Link [LK02] (IRQs 3 4 5 6 7 11 *14 15)
[    2.991432] ACPI: PCI Interrupt Link [LK03] (IRQs 3 4 5 6 7 *11 14 15)
[    2.995432] ACPI: PCI Interrupt Link [LK04] (IRQs 3 4 *5 6 7 11 14 15)
[    3.003432] ACPI: PCI Interrupt Link [LK05] (IRQs 3 4 5 6 7 11 *14 15)
[    3.011432] ACPI: PCI Interrupt Link [LK06] (IRQs 3 4 5 *6 7 11 14 15)
[    3.019432] ACPI: PCI Interrupt Link [LK07] (IRQs 3 4 5 6 7 11 *14 15)
[    3.027527] pci 0000:0b:00.0: vgaarb: setting as boot VGA device
[    3.031373] pci 0000:0b:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    3.043393] pci 0000:0b:00.0: vgaarb: bridge control possible
[    3.051375] vgaarb: loaded
[    3.054595] pps_core: LinuxPPS API ver. 1 registered
[    3.059376] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    3.067378] PTP clock support registered
[    3.075393] EDAC MC: Ver: 3.0.0
[    3.079713] PCI: Using ACPI for IRQ routing
[    3.088679] PCI: pci_cache_line_size set to 64 bytes
[    3.089231] e820: reserve RAM buffer [mem 0x0009e000-0x0009ffff]
[    3.089233] e820: reserve RAM buffer [mem 0x9b2e0000-0x9bffffff]
[    3.089510] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    3.095377] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    3.105451] clocksource: Switched to clocksource tsc-early
[    3.120497] VFS: Disk quotas dquot_6.6.0
[    3.125015] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    3.132935] AppArmor: AppArmor Filesystem Enabled
[    3.138309] pnp: PnP ACPI init
[    3.142019] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
[    3.142052] pnp 00:01: Plug and Play ACPI device, IDs PNP0b00 (active)
[    3.142233] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active)
[    3.142405] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[    3.142764] system 00:04: [io  0x0800-0x087f] has been reserved
[    3.149485] system 00:04: [io  0x0880-0x08ff] has been reserved
[    3.156204] system 00:04: [io  0x0900-0x091f] has been reserved
[    3.162921] system 00:04: [io  0x0920-0x0923] has been reserved
[    3.169638] system 00:04: [io  0x0924] has been reserved
[    3.175676] system 00:04: [io  0x0370-0x0377] has been reserved
[    3.182392] system 00:04: [io  0x0ca0-0x0ca7] has been reserved
[    3.189109] system 00:04: [io  0x0ca9-0x0cab] has been reserved
[    3.195826] system 00:04: [io  0x0cad-0x0caf] has been reserved
[    3.202545] system 00:04: [io  0x0cb0-0x0cbf] has been reserved
[    3.209265] system 00:04: Plug and Play ACPI device, IDs PNP0c01 (active)
[    3.209358] system 00:05: [io  0x0ca8] has been reserved
[    3.215398] system 00:05: [io  0x0cac] has been reserved
[    3.221439] system 00:05: Plug and Play ACPI device, IDs IPI0001 PNP0c01 (active)
[    3.221845] system 00:06: [mem 0xe0000000-0xe3efffff] has been reserved
[    3.229348] system 00:06: Plug and Play ACPI device, IDs PNP0c02 (active)
[    3.229544] system 00:07: [mem 0xe4000000-0xe7ffffff] has been reserved
[    3.237045] system 00:07: Plug and Play ACPI device, IDs PNP0c02 (active)
[    3.237152] system 00:08: [mem 0xe3f00000-0xe3ffffff] has been reserved
[    3.244651] system 00:08: Plug and Play ACPI device, IDs PNP0c02 (active)
[    3.244765] system 00:09: [mem 0xdd900000-0xdd901fff] could not be reserved
[    3.252653] system 00:09: Plug and Play ACPI device, IDs PNP0c02 (active)
[    3.252783] system 00:0a: [mem 0xbe200000-0xbe201fff] could not be reserved
[    3.260671] system 00:0a: Plug and Play ACPI device, IDs PNP0c02 (active)
[    3.260812] pnp: PnP ACPI: found 11 devices
[    3.271654] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    3.281700] pci 0000:02:00.1: can't claim BAR 6 [mem 0xda000000-0xda03ffff pref]: address conflict with 0000:02:00.0 [mem 0xda000000-0xda03ffff pref]
[    3.296796] pci 0000:01:00.1: can't claim BAR 6 [mem 0xda800000-0xda83ffff pref]: address conflict with 0000:01:00.0 [mem 0xda800000-0xda83ffff pref]
[    3.312883] pci 0000:02:00.1: BAR 6: assigned [mem 0xda040000-0xda07ffff pref]
[    3.321080] pci 0000:00:01.0: PCI bridge to [bus 02]
[    3.326729] pci 0000:00:01.0:   bridge window [mem 0xda000000-0xda7fffff]
[    3.334420] pci 0000:00:01.0:   bridge window [mem 0xd1000000-0xd10fffff 64bit pref]
[    3.343203] pci 0000:01:00.1: BAR 6: assigned [mem 0xda840000-0xda87ffff pref]
[    3.351390] pci 0000:00:01.1: PCI bridge to [bus 01]
[    3.357040] pci 0000:00:01.1:   bridge window [mem 0xda800000-0xdaffffff]
[    3.364730] pci 0000:00:01.1:   bridge window [mem 0xd1100000-0xd11fffff 64bit pref]
[    3.373503] pci 0000:00:02.0: PCI bridge to [bus 04]
[    3.379157] pci 0000:00:02.2: PCI bridge to [bus 03]
[    3.384805] pci 0000:00:02.2:   bridge window [io  0xf000-0xffff]
[    3.391717] pci 0000:00:02.2:   bridge window [mem 0xdb000000-0xdbffffff]
[    3.399410] pci 0000:00:03.0: PCI bridge to [bus 05]
[    3.405059] pci 0000:00:03.0:   bridge window [io  0xe000-0xefff]
[    3.411973] pci 0000:00:03.0:   bridge window [mem 0xd8000000-0xd9ffffff]
[    3.419662] pci 0000:00:03.0:   bridge window [mem 0xc0000000-0xcfffffff 64bit pref]
[    3.428442] pci 0000:00:11.0: PCI bridge to [bus 06]
[    3.434101] pci 0000:00:1c.0: PCI bridge to [bus 07]
[    3.439760] pci 0000:0a:00.0: PCI bridge to [bus 0b]
[    3.445545] pci 0000:0a:00.0:   bridge window [mem 0xdc000000-0xdcffffff]
[    3.453325] pci 0000:0a:00.0:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.462296] pci 0000:09:00.0: PCI bridge to [bus 0a-0b]
[    3.468373] pci 0000:09:00.0:   bridge window [mem 0xdc000000-0xdcffffff]
[    3.476152] pci 0000:09:00.0:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.485118] pci 0000:09:01.0: PCI bridge to [bus 0c]
[    3.490908] pci 0000:09:01.0:   bridge window [mem 0xdd700000-0xdd7fffff]
[    3.498943] pci 0000:08:00.0: PCI bridge to [bus 09-0c]
[    3.505010] pci 0000:08:00.0:   bridge window [mem 0xdc000000-0xdd7fffff]
[    3.512780] pci 0000:08:00.0:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.521795] pci 0000:00:1c.7: PCI bridge to [bus 08-0c]
[    3.527737] pci 0000:00:1c.7:   bridge window [mem 0xdc000000-0xdd7fffff]
[    3.535428] pci 0000:00:1c.7:   bridge window [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.544209] pci 0000:00:1e.0: PCI bridge to [bus 0d]
[    3.549865] pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    3.549867] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    3.549868] pci_bus 0000:00: resource 6 [io  0x03b0-0x03df window]
[    3.549870] pci_bus 0000:00: resource 7 [io  0x0d00-0x1fff window]
[    3.549871] pci_bus 0000:00: resource 8 [io  0x8000-0x9fff window]
[    3.549873] pci_bus 0000:00: resource 9 [io  0xa000-0xbfff window]
[    3.549874] pci_bus 0000:00: resource 10 [io  0xc000-0xdfff window]
[    3.549875] pci_bus 0000:00: resource 11 [io  0xe000-0xffff window]
[    3.549877] pci_bus 0000:00: resource 12 [mem 0x000a0000-0x000bffff window]
[    3.549878] pci_bus 0000:00: resource 13 [mem 0xc0000000-0xdfffffff window]
[    3.549880] pci_bus 0000:00: resource 14 [mem 0xfed40000-0xfed44fff window]
[    3.549881] pci_bus 0000:02: resource 1 [mem 0xda000000-0xda7fffff]
[    3.549883] pci_bus 0000:02: resource 2 [mem 0xd1000000-0xd10fffff 64bit pref]
[    3.549884] pci_bus 0000:01: resource 1 [mem 0xda800000-0xdaffffff]
[    3.549886] pci_bus 0000:01: resource 2 [mem 0xd1100000-0xd11fffff 64bit pref]
[    3.549888] pci_bus 0000:03: resource 0 [io  0xf000-0xffff]
[    3.549889] pci_bus 0000:03: resource 1 [mem 0xdb000000-0xdbffffff]
[    3.549890] pci_bus 0000:05: resource 0 [io  0xe000-0xefff]
[    3.549892] pci_bus 0000:05: resource 1 [mem 0xd8000000-0xd9ffffff]
[    3.549893] pci_bus 0000:05: resource 2 [mem 0xc0000000-0xcfffffff 64bit pref]
[    3.549895] pci_bus 0000:08: resource 1 [mem 0xdc000000-0xdd7fffff]
[    3.549896] pci_bus 0000:08: resource 2 [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.549898] pci_bus 0000:09: resource 1 [mem 0xdc000000-0xdd7fffff]
[    3.549899] pci_bus 0000:09: resource 2 [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.549901] pci_bus 0000:0a: resource 1 [mem 0xdc000000-0xdcffffff]
[    3.549902] pci_bus 0000:0a: resource 2 [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.549904] pci_bus 0000:0b: resource 1 [mem 0xdc000000-0xdcffffff]
[    3.549905] pci_bus 0000:0b: resource 2 [mem 0xd0000000-0xd0ffffff 64bit pref]
[    3.549906] pci_bus 0000:0c: resource 1 [mem 0xdd700000-0xdd7fffff]
[    3.549908] pci_bus 0000:0d: resource 4 [io  0x0000-0x03af window]
[    3.549909] pci_bus 0000:0d: resource 5 [io  0x03e0-0x0cf7 window]
[    3.549911] pci_bus 0000:0d: resource 6 [io  0x03b0-0x03df window]
[    3.549912] pci_bus 0000:0d: resource 7 [io  0x0d00-0x1fff window]
[    3.549914] pci_bus 0000:0d: resource 8 [io  0x8000-0x9fff window]
[    3.549915] pci_bus 0000:0d: resource 9 [io  0xa000-0xbfff window]
[    3.549916] pci_bus 0000:0d: resource 10 [io  0xc000-0xdfff window]
[    3.549918] pci_bus 0000:0d: resource 11 [io  0xe000-0xffff window]
[    3.549919] pci_bus 0000:0d: resource 12 [mem 0x000a0000-0x000bffff window]
[    3.549921] pci_bus 0000:0d: resource 13 [mem 0xc0000000-0xdfffffff window]
[    3.549922] pci_bus 0000:0d: resource 14 [mem 0xfed40000-0xfed44fff window]
[    3.549968] pci 0000:40:01.0: PCI bridge to [bus 41]
[    3.555619] pci 0000:40:01.0:   bridge window [mem 0xbe000000-0xbe0fffff]
[    3.563308] pci 0000:40:01.0:   bridge window [mem 0xb8000000-0xb87fffff 64bit pref]
[    3.572091] pci 0000:40:02.0: PCI bridge to [bus 42]
[    3.577738] pci 0000:40:02.0:   bridge window [io  0x7000-0x7fff]
[    3.584652] pci 0000:40:02.0:   bridge window [mem 0xbc000000-0xbdffffff]
[    3.592335] pci 0000:40:02.0:   bridge window [mem 0xa8000000-0xb7ffffff 64bit pref]
[    3.601108] pci 0000:40:03.0: PCI bridge to [bus 43]
[    3.606763] pci 0000:40:03.2: PCI bridge to [bus 44]
[    3.612419] pci_bus 0000:40: resource 4 [io  0x2000-0x3fff window]
[    3.612420] pci_bus 0000:40: resource 5 [io  0x4000-0x5fff window]
[    3.612422] pci_bus 0000:40: resource 6 [io  0x6000-0x7fff window]
[    3.612423] pci_bus 0000:40: resource 7 [mem 0xa8000000-0xbfffffff window]
[    3.612425] pci_bus 0000:41: resource 1 [mem 0xbe000000-0xbe0fffff]
[    3.612427] pci_bus 0000:41: resource 2 [mem 0xb8000000-0xb87fffff 64bit pref]
[    3.612428] pci_bus 0000:42: resource 0 [io  0x7000-0x7fff]
[    3.612430] pci_bus 0000:42: resource 1 [mem 0xbc000000-0xbdffffff]
[    3.612431] pci_bus 0000:42: resource 2 [mem 0xa8000000-0xb7ffffff 64bit pref]
[    3.612501] NET: Registered protocol family 2
[    3.617656] tcp_listen_portaddr_hash hash table entries: 8192 (order: 5, 131072 bytes)
[    3.626691] TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
[    3.635305] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    3.643028] TCP: Hash tables configured (established 131072 bind 65536)
[    3.650602] UDP hash table entries: 8192 (order: 6, 262144 bytes)
[    3.657570] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes)
[    3.667047] NET: Registered protocol family 1
[    3.691555] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x6a7 took 19030 usecs
[    3.700290] pci 0000:03:00.0: [Firmware Bug]: disabling VPD access (can't determine size of non-standard VPD format)
[    3.712184] pci 0000:03:00.0: quirk_blacklist_vpd+0x0/0x30 took 11612 usecs
[    3.720428] pci 0000:0b:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    3.730094] PCI: CLS 64 bytes, default 64
[    3.730135] Unpacking initramfs...
[    4.479542] Freeing initrd memory: 43104K
[    4.503393] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    4.510699] software IO TLB: mapped [mem 0x972e0000-0x9b2e0000] (64MB)
[    4.518439] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    4.527413] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    4.533933] RAPL PMU: hw unit of domain package 2^-16 Joules
[    4.540356] RAPL PMU: hw unit of domain dram 2^-16 Joules
[    4.549557] Initialise system trusted keyrings
[    4.554693] workingset: timestamp_bits=40 max_order=22 bucket_order=0
[    4.563484] zbud: loaded
[    4.566643] fuse init (API version 7.28)
[    4.960471] Key type asymmetric registered
[    4.965153] Asymmetric key parser 'x509' registered
[    4.970721] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    4.979190] io scheduler mq-deadline registered
[    4.984354] io scheduler kyber registered
[    4.989741] pcieport 0000:00:01.0: Signaling PME with IRQ 25
[    4.996507] pcieport 0000:00:01.1: Signaling PME with IRQ 26
[    5.003253] pcieport 0000:00:02.0: Signaling PME with IRQ 27
[    5.010000] pcieport 0000:00:02.2: Signaling PME with IRQ 28
[    5.016747] pcieport 0000:00:03.0: Signaling PME with IRQ 29
[    5.023468] pcieport 0000:00:11.0: Signaling PME with IRQ 30
[    5.030013] pcieport 0000:00:1c.0: Signaling PME with IRQ 31
[    5.036713] pcieport 0000:00:1c.7: Signaling PME with IRQ 32
[    5.047072] pcieport 0000:40:01.0: Signaling PME with IRQ 34
[    5.053781] pcieport 0000:40:02.0: Signaling PME with IRQ 35
[    5.060467] pcieport 0000:40:03.0: Signaling PME with IRQ 36
[    5.067147] pcieport 0000:40:03.2: Signaling PME with IRQ 37
[    5.073861] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    5.081469] intel_idle: MWAIT substates: 0x21120
[    5.081470] intel_idle: v0.4.1 model 0x2D
[    5.083150] intel_idle: lapic_timer_reliable_states 0xffffffff
[    5.084215] ERST: Error Record Serialization Table (ERST) support is initialized.
[    5.092705] pstore: Registered erst as persistent store backend
[    5.099596] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[    5.108140] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    5.135708] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    5.164544] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    5.173457] Linux agpgart interface v0.103
[    5.178333] AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel <jroedel@suse.de>
[    5.185915] AMD-Vi: AMD IOMMUv2 functionality not available on this system
[    5.198184] i8042: PNP: No PS/2 controller found.
[    5.203745] mousedev: PS/2 mouse device common for all mice
[    5.210112] rtc_cmos 00:01: RTC can wake from S4
[    5.215649] rtc_cmos 00:01: registered as rtc0
[    5.220742] rtc_cmos 00:01: alarms up to one day, y3k, 242 bytes nvram, hpet irqs
[    5.229239] intel_pstate: Intel P-state driver initializing
[    5.238545] ledtrig-cpu: registered to indicate activity on CPUs
[    5.246648] NET: Registered protocol family 10
[    5.252115] Segment Routing with IPv6
[    5.256335] mip6: Mobile IPv6
[    5.259747] NET: Registered protocol family 17
[    5.264813] mpls_gso: MPLS GSO support
[    5.274355] microcode: sig=0x206d7, pf=0x1, revision=0x70b
[    5.281617] microcode: Microcode Update Driver: v2.2.
[    5.281635] sched_clock: Marking stable (4011165883, 1270439541)->(5576492233, -294886809)
[    5.298129] registered taskstats version 1
[    5.302813] Loading compiled-in X.509 certificates
[    5.308311] zswap: loaded using pool lzo/zbud
[    5.314259] pstore: Using crash dump compression: deflate
[    5.320406] AppArmor: AppArmor sha1 policy hashing enabled
[    5.328163] rtc_cmos 00:01: setting system clock to 2019-03-16T07:45:27 UTC (1552722327)
[    5.338744] Freeing unused kernel image memory: 1572K
[    5.363429] Write protecting the kernel read-only data: 16384k
[    5.371182] Freeing unused kernel image memory: 2016K
[    5.377502] Freeing unused kernel image memory: 868K
[    5.390960] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    5.398258] x86/mm: Checking user space page tables
[    5.411316] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    5.418615] Run /init as init process
[    5.525487] SCSI subsystem initialized
[    5.530825] tg3.c:v3.137 (May 11, 2014)
[    5.530997] ACPI: bus type USB registered
[    5.539844] usbcore: registered new interface driver usbfs
[    5.546105] usbcore: registered new interface driver hub
[    5.552370] usbcore: registered new device driver usb
[    5.559088] tg3 0000:01:00.0 eth0: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d4:ae:52:98:c4:38
[    5.559248] mlx4_core: Mellanox ConnectX core driver v4.0-0
[    5.567404] tsc: Refined TSC clocksource calibration: 1999.999 MHz
[    5.567445] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x39a85afc727, max_idle_ns: 881590685098 ns
[    5.570993] tg3 0000:01:00.0 eth0: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    5.606746] tg3 0000:01:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    5.615623] tg3 0000:01:00.0 eth0: dma_rwctrl[00000001] dma_mask[64-bit]
[    5.623282] clocksource: Switched to clocksource tsc
[    5.623289] mlx4_core: Initializing 0000:41:00.0
[    5.634955] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    5.642881] megasas: 07.707.50.00-rc1
[    5.647268] ehci-pci: EHCI PCI platform driver
[    5.647506] megaraid_sas 0000:03:00.0: FW now in Ready state
[    5.658764] megaraid_sas 0000:03:00.0: 63 bit DMA mask and 32 bit consistent mask
[    5.667803] megaraid_sas 0000:03:00.0: firmware supports msix	: (0)
[    5.674909] megaraid_sas 0000:03:00.0: current msix/online cpus	: (1/32)
[    5.682499] megaraid_sas 0000:03:00.0: RDPQ mode	: (disabled)
[    5.689378] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    5.695325] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    5.703824] ehci-pci 0000:00:1a.0: debug port 2
[    5.712968] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[    5.713079] ehci-pci 0000:00:1a.0: irq 23, io mem 0xdd8fe000
[    5.723671] tg3 0000:01:00.1 eth1: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d4:ae:52:98:c4:39
[    5.735562] tg3 0000:01:00.1 eth1: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    5.746673] tg3 0000:01:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    5.755552] tg3 0000:01:00.1 eth1: dma_rwctrl[00000001] dma_mask[64-bit]
[    5.763186] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    5.769745] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.00
[    5.779110] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.787298] usb usb1: Product: EHCI Host Controller
[    5.792848] usb usb1: Manufacturer: Linux 5.0.0-rc6+ ehci_hcd
[    5.799371] usb usb1: SerialNumber: 0000:00:1a.0
[    5.804634] megaraid_sas 0000:03:00.0: controller type	: iMR(0MB)
[    5.811543] megaraid_sas 0000:03:00.0: Online Controller Reset(OCR)	: Enabled
[    5.819621] megaraid_sas 0000:03:00.0: Secure JBOD support	: No
[    5.826337] megaraid_sas 0000:03:00.0: NVMe passthru support	: No
[    5.833248] megaraid_sas 0000:03:00.0: FW provided TM TaskAbort/Reset timeout	: 0 secs/0 secs
[    5.842902] megaraid_sas 0000:03:00.0: megasas_init_mfi: fw_support_ieee=67108864
[    5.851465] megaraid_sas 0000:03:00.0: INIT adapter done
[    5.857505] megaraid_sas 0000:03:00.0: Jbod map is not supported megasas_setup_jbod_map 5267
[    5.867112] hub 1-0:1.0: USB hub found
[    5.871416] hub 1-0:1.0: 2 ports detected
[    5.876733] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    5.882680] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    5.891308] ehci-pci 0000:00:1d.0: debug port 2
[    5.900464] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[    5.900576] ehci-pci 0000:00:1d.0: irq 22, io mem 0xdd8ff000
[    5.919397] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    5.926057] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.00
[    5.935425] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    5.943621] usb usb2: Product: EHCI Host Controller
[    5.949171] usb usb2: Manufacturer: Linux 5.0.0-rc6+ ehci_hcd
[    5.955693] usb usb2: SerialNumber: 0000:00:1d.0
[    5.961054] megaraid_sas 0000:03:00.0: pci id		: (0x1000)/(0x0073)/(0x1028)/(0x1f51)
[    5.969832] megaraid_sas 0000:03:00.0: unevenspan support	: no
[    5.976451] megaraid_sas 0000:03:00.0: firmware crash dump	: no
[    5.983168] megaraid_sas 0000:03:00.0: jbod sync map		: no
[    5.989399] scsi host0: Avago SAS based MegaRAID driver
[    5.996207] hub 2-0:1.0: USB hub found
[    6.000622] hub 2-0:1.0: 2 ports detected
[    6.009280] tg3 0000:02:00.0 eth2: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d4:ae:52:98:c4:3a
[    6.020059] scsi 0:2:0:0: Direct-Access     DELL     PERC H310        2.12 PQ: 0 ANSI: 5
[    6.021172] tg3 0000:02:00.0 eth2: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    6.041443] tg3 0000:02:00.0 eth2: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    6.050322] tg3 0000:02:00.0 eth2: dma_rwctrl[00000001] dma_mask[64-bit]
[    6.059608] sd 0:2:0:0: [sda] 487325696 512-byte logical blocks: (250 GB/232 GiB)
[    6.068230] sd 0:2:0:0: [sda] Write Protect is off
[    6.073679] sd 0:2:0:0: [sda] Mode Sense: 1f 00 10 08
[    6.073742] sd 0:2:0:0: [sda] Write cache: disabled, read cache: disabled, supports DPO and FUA
[    6.084220] tg3 0000:02:00.1 eth3: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address d4:ae:52:98:c4:3b
[    6.097450] tg3 0000:02:00.1 eth3: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1])
[    6.108024]  sda: sda1 sda2 sda3 < sda5 sda6 sda7 >
[    6.108563] tg3 0000:02:00.1 eth3: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1]
[    6.115828] sd 0:2:0:0: [sda] Attached SCSI disk
[    6.122985] tg3 0000:02:00.1 eth3: dma_rwctrl[00000001] dma_mask[64-bit]
[    6.247421] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    6.349208] random: fast init done
[    6.351437] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    6.408151] usb 1-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[    6.417456] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    6.425911] hub 1-1:1.0: USB hub found
[    6.430645] hub 1-1:1.0: 6 ports detected
[    6.515890] usb 2-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[    6.525174] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    6.533686] hub 2-1:1.0: USB hub found
[    6.538129] hub 2-1:1.0: 8 ports detected
[    6.727418] usb 1-1.6: new high-speed USB device number 3 using ehci-pci
[    6.845015] usb 1-1.6: New USB device found, idVendor=0624, idProduct=0248, bcdDevice= 0.00
[    6.854500] usb 1-1.6: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    6.862794] usb 1-1.6: Product: Gadget USB HUB
[    6.867859] usb 1-1.6: Manufacturer: no manufacturer
[    6.873507] usb 1-1.6: SerialNumber: 0123456789
[    6.879038] hub 1-1.6:1.0: USB hub found
[    6.883758] hub 1-1.6:1.0: 6 ports detected
[    7.191421] usb 1-1.6.1: new high-speed USB device number 4 using ehci-pci
[    7.317026] usb 1-1.6.1: New USB device found, idVendor=0624, idProduct=0249, bcdDevice= 0.00
[    7.326717] usb 1-1.6.1: New USB device strings: Mfr=4, Product=5, SerialNumber=6
[    7.335204] usb 1-1.6.1: Product: Keyboard/Mouse Function
[    7.341338] usb 1-1.6.1: Manufacturer: Avocent
[    7.346403] usb 1-1.6.1: SerialNumber: 20110426
[    7.360564] hidraw: raw HID events driver (C) Jiri Kosina
[    7.370554] usbcore: registered new interface driver usbhid
[    7.376893] usbhid: USB HID core driver
[    7.383570] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.0/0003:0624:0249.0001/input/input0
[    7.449563] mlx4_core 0000:41:00.0: Old device ETS support detected
[    7.456676] mlx4_core 0000:41:00.0: Consider upgrading device FW.
[    7.459617] hid-generic 0003:0624:0249.0001: input,hidraw0: USB HID v1.00 Keyboard [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input0
[    7.478804] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.1/0003:0624:0249.0002/input/input1
[    7.494609] hid-generic 0003:0624:0249.0002: input,hidraw1: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input1
[    7.509519] input: Avocent Keyboard/Mouse Function as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.6/1-1.6.1/1-1.6.1:1.2/0003:0624:0249.0003/input/input2
[    7.525338] hid-generic 0003:0624:0249.0003: input,hidraw2: USB HID v1.00 Mouse [Avocent Keyboard/Mouse Function] on usb-0000:00:1a.0-1.6.1/input2
[    8.141059] mlx4_core 0000:41:00.0: 63.008 Gb/s available PCIe bandwidth (8 GT/s x8 link)
[    8.293306] <mlx4_ib> mlx4_ib_add: mlx4_ib: Mellanox ConnectX InfiniBand driver v4.0-0
[    8.295035] PM: Image not found (code -22)
[    8.303264] <mlx4_ib> mlx4_ib_add: counter index 0 for port 1 allocated 0
[    8.403839] EXT4-fs (sda5): mounted filesystem with ordered data mode. Opts: (null)
[    9.689660] ERST: NVRAM ERST Log Address Range not implemented yet.
[    9.744806] systemd[1]: systemd 239 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 +IDN -PCRE2 default-hierarchy=hybrid)
[    9.789272] systemd[1]: Detected architecture x86-64.
[    9.843881] systemd[1]: Set hostname to <averell1>.
[   11.958035] random: systemd: uninitialized urandom read (16 bytes read)
[   11.965633] systemd[1]: Listening on udev Control Socket.
[   11.987468] random: systemd: uninitialized urandom read (16 bytes read)
[   11.995224] systemd[1]: Listening on Journal Socket (/dev/log).
[   12.015498] random: systemd: uninitialized urandom read (16 bytes read)
[   12.023453] systemd[1]: Created slice system-postfix.slice.
[   12.043692] systemd[1]: Created slice system-getty.slice.
[   12.068916] systemd[1]: Listening on RPCbind Server Activation Socket.
[   12.091744] systemd[1]: Listening on Journal Audit Socket.
[   12.111627] systemd[1]: Listening on udev Kernel Socket.
[   12.300621] loop: module loaded
[   12.441467] EXT4-fs (sda5): re-mounted. Opts: errors=remount-ro
[   12.763765] RPC: Registered named UNIX socket transport module.
[   12.771105] RPC: Registered udp transport module.
[   12.777902] RPC: Registered tcp transport module.
[   12.784752] RPC: Registered tcp NFSv4.1 backchannel transport module.
[   13.100010] systemd-journald[472]: Received request to flush runtime journal from PID 1
[   13.446846] ACPI Error: No handler for Region [SYSI] ((____ptrval____)) [IPMI] (20181213/evregion-132)
[   13.457392] ACPI Error: Region IPMI (ID=7) has no handler (20181213/exfldio-265)
[   13.465802] ACPI Error: Method parse/execution failed \_SB.PMI0._GHL, AE_NOT_EXIST (20181213/psparse-531)
[   13.476635] ACPI Error: Method parse/execution failed \_SB.PMI0._PMC, AE_NOT_EXIST (20181213/psparse-531)
[   13.487462] ACPI Error: AE_NOT_EXIST, Evaluating _PMC (20181213/power_meter-756)
[   13.497267] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input3
[   13.505696] ACPI: Power Button [PWRF]
[   13.518619] iTCO_vendor_support: vendor-support=0
[   13.561134] IPMI message handler: version 39.2
[   13.573800] dcdbas dcdbas: Dell Systems Management Base Driver (version 5.6.0-3.3)
[   13.613929] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[   13.620334] iTCO_wdt: Found a Patsburg TCO device (Version=2, TCOBASE=0x0860)
[   13.628738] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
[   13.750716] input: PC Speaker as /devices/platform/pcspkr/input/input4
[   13.765226] ipmi device interface
[   13.776583] dca service started, version 1.12.1
[   13.931885] ipmi_si: IPMI System Interface driver
[   13.937296] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS
[   13.944517] ipmi_platform: ipmi_si: SMBIOS: io 0xca8 regsize 1 spacing 4 irq 10
[   13.952834] ipmi_si: Adding SMBIOS-specified kcs state machine
[   13.959650] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca8, slave address 0x20, irq 10
[   13.971457] ioatdma: Intel(R) QuickData Technology Driver 4.00
[   14.116274] cryptd: max_cpu_qlen set to 1000
[   14.134183] sd 0:2:0:0: Attached scsi generic sg0 type 0
[   14.158298] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[   14.221884] [TTM] Zone  kernel: Available graphics memory: 8171712 kiB
[   14.229284] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[   14.236683] [TTM] Initializing pool allocator
[   14.241666] [TTM] Initializing DMA pool allocator
[   14.285107] fbcon: mgadrmfb (fb0) is primary device
[   14.293999] nd_bus ndbus0: START: nd_bus.probe(ndbus0)
[   14.294035] nd_bus ndbus0: END: nd_bus.probe(ndbus0) = 0
[   14.294111] nd_bus ndbus0: START: nd_region.probe(region0)
[   14.294124] nd_bus ndbus0: START: nd_region.probe(region1)
[   14.294135] nd_bus ndbus0: END: nd_region.probe(region0) = 0
[   14.294150] nd_bus ndbus0: END: nd_region.probe(region1) = 0
[   14.339454] ipmi_si dmi-ipmi-si.0: The BMC does not support setting the recv irq bit, compensating, but the BMC needs to be fixed.
[   14.374393] Console: switching to colour frame buffer device 128x48
[   14.418459] mgag200 0000:0b:00.0: fb0: mgadrmfb frame buffer device
[   14.435468] ipmi_si dmi-ipmi-si.0: Using irq 10
[   14.443411] [drm] Initialized mgag200 1.0.0 20110418 for 0000:0b:00.0 on minor 0
[   14.450885] ipmi_si dmi-ipmi-si.0: IPMI message handler: Found new BMC (man_id: 0x0002a2, prod_id: 0x0100, dev_id: 0x20)
[   14.464347] nd_bus ndbus0: START: nd_pmem.probe(namespace0.0)
[   14.464392] nd_pmem namespace0.0: btt: <none>
[   14.464394]  btt0.1: trace
[   14.464400] nd_pmem namespace0.0: pfn: <none>
[   14.464401]  pfn0.1: trace
[   14.464406] nd_pmem namespace0.0: dax: <none>
[   14.464407]  dax0.1: trace
[   14.464466] nd_pmem namespace0.0: unable to guarantee persistence of writes
[   14.473519] ipmi_si dmi-ipmi-si.0: IPMI kcs interface initialized
[   14.517649] AVX version of gcm_enc/dec engaged.
[   14.522736] AES CTR mode by8 optimization enabled
[   14.669381] namespace0.0 initialised, 6291456 pages in 124ms
[   14.676200] pmem0: detected capacity change from 0 to 25769803776
[   14.683046] nd_bus ndbus0: END: nd_pmem.probe(namespace0.0) = 0
[   14.683074] nd_bus ndbus0: START: nd_pmem.probe(btt0.0)
[   14.683077] nd_bus ndbus0: END: nd_pmem.probe(btt0.0) = -19
[   14.683086] nd_bus ndbus0: START: nd_pmem.probe(namespace1.0)
[   14.683140] nd_pmem namespace1.0: btt: <none>
[   14.683141]  btt1.1: trace
[   14.683147] nd_pmem namespace1.0: pfn: <none>
[   14.683148]  pfn1.1: trace
[   14.683152] nd_pmem namespace1.0: dax: <none>
[   14.683154]  dax1.1: trace
[   14.683235] nd_pmem namespace1.0: unable to guarantee persistence of writes
[   14.867893] namespace1.0 initialised, 6291456 pages in 132ms
[   14.874713] pmem1: detected capacity change from 0 to 25769803776
[   14.881561] nd_bus ndbus0: END: nd_pmem.probe(namespace1.0) = 0
[   14.881589] nd_bus ndbus0: START: nd_pmem.probe(pfn0.0)
[   14.881592] nd_bus ndbus0: END: nd_pmem.probe(pfn0.0) = -19
[   14.881602] nd_bus ndbus0: START: nd_pmem.probe(btt1.0)
[   14.881615] nd_bus ndbus0: END: nd_pmem.probe(btt1.0) = -19
[   14.881620] nd_bus ndbus0: START: nd_pmem.probe(pfn1.0)
[   14.881622] nd_bus ndbus0: END: nd_pmem.probe(pfn1.0) = -19
[   15.125037] Adding 15624188k swap on /dev/sda6.  Priority:-2 extents:1 across:15624188k FS
[   15.644395] EXT4-fs (sda7): mounted filesystem with ordered data mode. Opts: (null)
[   15.962420] intel_rapl: Found RAPL domain package
[   15.967704] intel_rapl: Found RAPL domain core
[   15.972688] intel_rapl: Found RAPL domain dram
[   15.977785] intel_rapl: Found RAPL domain package
[   15.983069] intel_rapl: Found RAPL domain core
[   15.989236] intel_rapl: Found RAPL domain dram
[   19.675220] tg3 0000:01:00.0 eth0: Link is up at 1000 Mbps, full duplex
[   19.683511] tg3 0000:01:00.0 eth0: Flow control is off for TX and off for RX
[   19.692333] tg3 0000:01:00.0 eth0: EEE is disabled
[   19.698565] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[   29.525624] random: crng init done
[   29.529439] random: 7 urandom warning(s) missed due to ratelimiting
[   33.413722] FS-Cache: Loaded
[   33.646387] FS-Cache: Netfs 'nfs' registered for caching

_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: failure to setup devdax over fake nvdimm
  2019-03-16  7:50       ` Brice Goglin
@ 2019-03-16 16:16         ` Dan Williams
  2019-03-16 18:16           ` Brice Goglin
  0 siblings, 1 reply; 10+ messages in thread
From: Dan Williams @ 2019-03-16 16:16 UTC (permalink / raw)
  To: Brice Goglin; +Cc: linux-nvdimm

On Sat, Mar 16, 2019 at 12:50 AM Brice Goglin <Brice.Goglin@inria.fr> wrote:
>
> Le 16/03/2019 à 02:19, Dan Williams a écrit :
>
> >
> > Hmm, ok. Can you boot with libnvdimm.dyndbg and see if it squawks
> > about the problem? If this is 1ffc664f9b8c then you need to have the
> > dax_pmem_compat driver or the dax_pmem driver to attach, and this also
> > won't work if you've hotplugged it with the kmem driver.
>
>
> Things work when dax_pmem_compat is loaded.
>
> [   93.387078] nd_bus ndbus0: START: dax_pmem_compat.probe(dax0.0)
> [   93.387082] nd_bus ndbus0: END: dax_pmem_compat.probe(dax0.0) = -19
> [   93.387101] nd_bus ndbus0: START: dax_pmem_compat.probe(dax1.0)
> [   93.387103] nd_bus ndbus0: END: dax_pmem_compat.probe(dax1.0) = -19
> [   96.741806] nd_bus ndbus0: nd_pmem.remove(namespace1.0) = 0
> [   96.940567] nd namespace1.0: fail (-6)
> [   96.941343] nd namespace1.0: fail (-6)
> [   96.941488] nd dax1.0: result: 0 wrote: 1cdae3a1-5ede-45d6-a3fc-31bb5c4c891a
> [   96.941583] nd dax1.0: result: 0 wrote: pmem
> [   96.941650] nd dax1.0: result: 0 wrote: 2097152
>
> [   96.941745] nd dax1.0: result: 13 wrote: namespace1.0
> [   96.942445] nd_bus ndbus0: START: dax_pmem_compat.probe(dax1.0)
> [   97.087764] dax1.0 initialised, 6192640 pages in 124ms
> [   97.093554] nd_bus ndbus0: END: dax_pmem_compat.probe(dax1.0) = 0
> [   97.093673] nd_bus ndbus0: START: dax_pmem_compat.probe(dax1.1)
> [   97.093677] nd_bus ndbus0: END: dax_pmem_compat.probe(dax1.1) = -19
>
>
> When only dax_pmem is loaded (compat is blacklisted), it fails with:
>
> [   36.141032] nd_bus ndbus0: nd_pmem.remove(namespace1.0) = 0
> [   36.343444] nd namespace1.0: fail (-6)
> [   36.344268] nd namespace1.0: fail (-6)
> [   36.344440] nd dax1.0: result: 0 wrote: bf1ed9eb-5fc1-4637-85e5-c67a59c7c59d
> [   36.344528] nd dax1.0: result: 0 wrote: pmem
> [   36.344595] nd dax1.0: result: 0 wrote: 2097152
>
> [   36.344704] nd dax1.0: result: 13 wrote: namespace1.0
> [   36.345802] nd dax1.0: result: 2 wrote:
>
> Boot dmesg below (before running ndctl).

What version of ndctl? Sounds like you may be running something prior
to v64 that does not understand the new device topology.
_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: failure to setup devdax over fake nvdimm
  2019-03-16 16:16         ` Dan Williams
@ 2019-03-16 18:16           ` Brice Goglin
  2019-03-16 19:48             ` Dan Williams
  0 siblings, 1 reply; 10+ messages in thread
From: Brice Goglin @ 2019-03-16 18:16 UTC (permalink / raw)
  To: Dan Williams; +Cc: linux-nvdimm

Le 16/03/2019 à 17:16, Dan Williams a écrit :
>
> What version of ndctl? Sounds like you may be running something prior
> to v64 that does not understand the new device topology.


It's ndctl from git master, hence 64.1.

I am using a similar software kernel+ndctl on a machine with real
nvdimms, no problem there. It's only the machine with fake nvdimm using
memmap that show this issue.

Brice


_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: failure to setup devdax over fake nvdimm
  2019-03-16 18:16           ` Brice Goglin
@ 2019-03-16 19:48             ` Dan Williams
  2019-03-19  0:34               ` Dan Williams
  0 siblings, 1 reply; 10+ messages in thread
From: Dan Williams @ 2019-03-16 19:48 UTC (permalink / raw)
  To: Brice Goglin; +Cc: linux-nvdimm

On Sat, Mar 16, 2019 at 11:16 AM Brice Goglin <Brice.Goglin@inria.fr> wrote:
>
> Le 16/03/2019 à 17:16, Dan Williams a écrit :
> >
> > What version of ndctl? Sounds like you may be running something prior
> > to v64 that does not understand the new device topology.
>
>
> It's ndctl from git master, hence 64.1.
>
> I am using a similar software kernel+ndctl on a machine with real
> nvdimms, no problem there. It's only the machine with fake nvdimm using
> memmap that show this issue.
>

Hmm, all my guesses are coming up empty... which usually means there
is indeed a bug. Let me try some experiments here, but I may need to
send you a debug patch for more info. Thanks for the memmap=
insight... I do test with that, but let me see if there is something
specific about your config.
_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: failure to setup devdax over fake nvdimm
  2019-03-16 19:48             ` Dan Williams
@ 2019-03-19  0:34               ` Dan Williams
  2019-03-19  6:38                 ` Brice Goglin
  0 siblings, 1 reply; 10+ messages in thread
From: Dan Williams @ 2019-03-19  0:34 UTC (permalink / raw)
  To: Brice Goglin; +Cc: linux-nvdimm

On Sat, Mar 16, 2019 at 12:48 PM Dan Williams <dan.j.williams@intel.com> wrote:
>
> On Sat, Mar 16, 2019 at 11:16 AM Brice Goglin <Brice.Goglin@inria.fr> wrote:
> >
> > Le 16/03/2019 à 17:16, Dan Williams a écrit :
> > >
> > > What version of ndctl? Sounds like you may be running something prior
> > > to v64 that does not understand the new device topology.
> >
> >
> > It's ndctl from git master, hence 64.1.
> >
> > I am using a similar software kernel+ndctl on a machine with real
> > nvdimms, no problem there. It's only the machine with fake nvdimm using
> > memmap that show this issue.
> >
>
> Hmm, all my guesses are coming up empty... which usually means there
> is indeed a bug. Let me try some experiments here, but I may need to
> send you a debug patch for more info. Thanks for the memmap=
> insight... I do test with that, but let me see if there is something
> specific about your config.

Brice, may I ask you to run:

    udevadm monitor -p

...while running the "ndctl create-namespace" command and send the output?
_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: failure to setup devdax over fake nvdimm
  2019-03-19  0:34               ` Dan Williams
@ 2019-03-19  6:38                 ` Brice Goglin
  0 siblings, 0 replies; 10+ messages in thread
From: Brice Goglin @ 2019-03-19  6:38 UTC (permalink / raw)
  To: Dan Williams; +Cc: linux-nvdimm

Le 19/03/2019 à 01:34, Dan Williams a écrit :
> On Sat, Mar 16, 2019 at 12:48 PM Dan Williams <dan.j.williams@intel.com> wrote:
>> On Sat, Mar 16, 2019 at 11:16 AM Brice Goglin <Brice.Goglin@inria.fr> wrote:
>>> Le 16/03/2019 à 17:16, Dan Williams a écrit :
>>>> What version of ndctl? Sounds like you may be running something prior
>>>> to v64 that does not understand the new device topology.
>>>
>>> It's ndctl from git master, hence 64.1.
>>>
>>> I am using a similar software kernel+ndctl on a machine with real
>>> nvdimms, no problem there. It's only the machine with fake nvdimm using
>>> memmap that show this issue.
>>>
>> Hmm, all my guesses are coming up empty... which usually means there
>> is indeed a bug. Let me try some experiments here, but I may need to
>> send you a debug patch for more info. Thanks for the memmap=
>> insight... I do test with that, but let me see if there is something
>> specific about your config.
> Brice, may I ask you to run:
>
>     udevadm monitor -p
>
> ...while running the "ndctl create-namespace" command and send the output?


KERNEL[347.386349] remove   /devices/virtual/bdi/259:0 (bdi)
ACTION=remove
DEVPATH=/devices/virtual/bdi/259:0
SEQNUM=3105
SUBSYSTEM=bdi

KERNEL[347.386414] remove  
/devices/platform/e820_pmem/ndbus0/region0/namespace0.0/block/pmem0 (block)
ACTION=remove
DEVNAME=/dev/pmem0
DEVPATH=/devices/platform/e820_pmem/ndbus0/region0/namespace0.0/block/pmem0
DEVTYPE=disk
MAJOR=259
MINOR=0
SEQNUM=3106
SUBSYSTEM=block

UDEV  [347.387134] remove   /devices/virtual/bdi/259:0 (bdi)
ACTION=remove
DEVPATH=/devices/virtual/bdi/259:0
SEQNUM=3105
SUBSYSTEM=bdi
USEC_INITIALIZED=347386388

UDEV  [347.388330] remove  
/devices/platform/e820_pmem/ndbus0/region0/namespace0.0/block/pmem0 (block)
ACTION=remove
DEVLINKS=/dev/disk/by-path/platform-e820_pmem
DEVNAME=/dev/pmem0
DEVPATH=/devices/platform/e820_pmem/ndbus0/region0/namespace0.0/block/pmem0
DEVTYPE=disk
ID_PATH=platform-e820_pmem
ID_PATH_TAG=platform-e820_pmem
MAJOR=259
MINOR=0
SEQNUM=3106
SUBSYSTEM=block
TAGS=:systemd:
USEC_INITIALIZED=13709764

KERNEL[347.567484] unbind  
/devices/platform/e820_pmem/ndbus0/region0/namespace0.0 (nd)
ACTION=unbind
DEVPATH=/devices/platform/e820_pmem/ndbus0/region0/namespace0.0
DEVTYPE=nd_namespace_io
SEQNUM=3107
SUBSYSTEM=nd

UDEV  [347.568474] unbind  
/devices/platform/e820_pmem/ndbus0/region0/namespace0.0 (nd)
ACTION=unbind
DEVPATH=/devices/platform/e820_pmem/ndbus0/region0/namespace0.0
DEVTYPE=nd_namespace_io
SEQNUM=3107
SUBSYSTEM=nd
USEC_INITIALIZED=347568424


_______________________________________________
Linux-nvdimm mailing list
Linux-nvdimm@lists.01.org
https://lists.01.org/mailman/listinfo/linux-nvdimm

^ permalink raw reply	[flat|nested] 10+ messages in thread

end of thread, other threads:[~2019-03-19  6:38 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-03-15 22:31 failure to setup devdax over fake nvdimm Brice Goglin
2019-03-15 23:12 ` Dan Williams
2019-03-15 23:42   ` Brice Goglin
2019-03-16  1:19     ` Dan Williams
2019-03-16  7:50       ` Brice Goglin
2019-03-16 16:16         ` Dan Williams
2019-03-16 18:16           ` Brice Goglin
2019-03-16 19:48             ` Dan Williams
2019-03-19  0:34               ` Dan Williams
2019-03-19  6:38                 ` Brice Goglin

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.