* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-12 16:41 ` Gruher, Joseph R
0 siblings, 0 replies; 26+ messages in thread
From: Gruher, Joseph R @ 2017-04-12 16:41 UTC (permalink / raw)
To: 'linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r@public.gmane.org',
'linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org'
Cc: Sen, Sujoy, Riches Jr, Robert M
[-- Attachment #1: Type: text/plain, Size: 2629 bytes --]
Hi folks-
Wanted to put this issue out there and see if anyone had thoughts.
Target system - 100Gb dual port CX5, FW 16.19.1000, through Arista 7060X switch with Ethernet flow control
Initiator system - 25Gb dual port CX4, FW 14.18.2000, through Arista 7060X switch with Ethernet flow control
We attach 16 drives from target to initiator, but are only running IO on four of them in this test, two drives per network port on initiator/target. Drives in use are Intel P3700 400GB.
We are running Ubuntu 16.10 with the 4.11-rc6 kernel and this patch from Max:
diff --git a/drivers/infiniband/hw/mlx5/qp.c b/drivers/infiniband/hw/mlx5/qp.c index ad8a263..c38c4fa 100644
--- a/drivers/infiniband/hw/mlx5/qp.c
+++ b/drivers/infiniband/hw/mlx5/qp.c
@@ -3737,8 +3737,7 @@ static void dump_wqe(struct mlx5_ib_qp *qp, int idx, int size_16)
static u8 get_fence(u8 fence, struct ib_send_wr *wr)
{
- if (unlikely(wr->opcode == IB_WR_LOCAL_INV &&
- wr->send_flags & IB_SEND_FENCE))
+ if (wr->opcode == IB_WR_LOCAL_INV || wr->opcode == IB_WR_REG_MR)
return MLX5_FENCE_MODE_STRONG_ORDERING;
if (unlikely(fence)) {
For the most part we can run FIO IO on the initiator against the attached subsystems without problems. 4KB random read and write, 64KB sequential writes are working OK on this setup. We seem to encounter errors when we run a 64KB sequential read workload. I would not the 64KB sequential read workload is the only one which generates enough traffic that we could bottleneck on the initiator NIC throughput - not sure if that is relevant, or just a coincidence. We can reproduce these errors fairly reliably at this time. See attached dmesg and example below:
[12728.885267] mlx5_1:dump_cqe:262:(pid 2943): dump error cqe
[12728.885271] 00000000 00000000 00000000 00000000
[12728.885272] 00000000 00000000 00000000 00000000
[12728.885274] 00000000 00000000 00000000 00000000
[12728.885275] 00000000 00008813 08000240 0255bcd3
[12728.885852] mlx5_1:dump_cqe:262:(pid 2829): dump error cqe
[12728.885855] 00000000 00000000 00000000 00000000
[12728.885857] 00000000 00000000 00000000 00000000
[12728.885859] 00000000 00000000 00000000 00000000
[12728.885861] 00000000 00008813 08000239 c2e59fd3
[12735.782466] nvmet: ctrl 17 keep-alive timer (15 seconds) expired!
[12735.784949] nvmet: ctrl 17 fatal error occurred!
These target side error prints seem correlated with IO failures and disconnect/reconnect events on the initiator so they are a problem. Any ideas? Any additional info we can provide?
Thanks,
Joe
[-- Attachment #2: initiator-dmesg.txt --]
[-- Type: text/plain, Size: 95448 bytes --]
[ 0.000000] Linux version 4.11.0-rc6patch-2-get-fence (r1@rrpatch) (gcc version 6.2.0 20161005 (Ubuntu 6.2.0-5ubuntu12) ) #1 SMP Tue Apr 11 08:56:12 PDT 2017
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.11.0-rc6patch-2-get-fence root=UUID=8f6dc1c5-b811-4ac9-aa98-7ea337785c73 ro
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009b3ff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009b400-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000079fd0fff] usable
[ 0.000000] BIOS-e820: [mem 0x0000000079fd1000-0x000000007ac50fff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000007ac51000-0x000000007b680fff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x000000007b681000-0x000000007b7cefff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x000000007b7cf000-0x000000007b7fffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007b800000-0x000000008fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000ff400000-0x00000000ffffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000107fffffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.7 present.
[ 0.000000] DMI: Intel Corporation S2600WT2R/S2600WT2R, BIOS SE5C610.86B.01.01.0019.101220160604 10/12/2016
[ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[ 0.000000] e820: last_pfn = 0x1080000 max_arch_pfn = 0x400000000
[ 0.000000] MTRR default type: write-back
[ 0.000000] MTRR fixed ranges enabled:
[ 0.000000] 00000-9FFFF write-back
[ 0.000000] A0000-BFFFF uncachable
[ 0.000000] C0000-FFFFF write-protect
[ 0.000000] MTRR variable ranges enabled:
[ 0.000000] 0 base 000080000000 mask 3FFF80000000 uncachable
[ 0.000000] 1 base 380000000000 mask 3F8000000000 uncachable
[ 0.000000] 2 disabled
[ 0.000000] 3 disabled
[ 0.000000] 4 disabled
[ 0.000000] 5 disabled
[ 0.000000] 6 disabled
[ 0.000000] 7 disabled
[ 0.000000] 8 disabled
[ 0.000000] 9 disabled
[ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WC UC- WT
[ 0.000000] e820: last_pfn = 0x7b800 max_arch_pfn = 0x400000000
[ 0.000000] found SMP MP-table at [mem 0x000fd850-0x000fd85f] mapped at [ffff89e6400fd850]
[ 0.000000] Scanning 1 areas for low memory corruption
[ 0.000000] Base memory trampoline at [ffff89e640095000] 95000 size 24576
[ 0.000000] Using GB pages for direct mapping
[ 0.000000] BRK [0xc32a0b000, 0xc32a0bfff] PGTABLE
[ 0.000000] BRK [0xc32a0c000, 0xc32a0cfff] PGTABLE
[ 0.000000] BRK [0xc32a0d000, 0xc32a0dfff] PGTABLE
[ 0.000000] BRK [0xc32a0e000, 0xc32a0efff] PGTABLE
[ 0.000000] BRK [0xc32a0f000, 0xc32a0ffff] PGTABLE
[ 0.000000] BRK [0xc32a10000, 0xc32a10fff] PGTABLE
[ 0.000000] BRK [0xc32a11000, 0xc32a11fff] PGTABLE
[ 0.000000] RAMDISK: [mem 0x33132000-0x35890fff]
[ 0.000000] ACPI: Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 0x00000000000F0460 000024 (v02 INTEL )
[ 0.000000] ACPI: XSDT 0x000000007B7CD0E8 0000BC (v01 INTEL S2600WT 00000000 INTL 01000013)
[ 0.000000] ACPI: FACP 0x000000007B7CC000 0000F4 (v04 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: DSDT 0x000000007B791000 032D76 (v02 INTEL S2600WT 00000003 INTL 20091013)
[ 0.000000] ACPI: FACS 0x000000007B650000 000040
[ 0.000000] ACPI: HPET 0x000000007B7CB000 000038 (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: APIC 0x000000007B7CA000 000AFC (v03 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: MCFG 0x000000007B7C9000 00003C (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: MSCT 0x000000007B7C8000 000090 (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SLIT 0x000000007B7C7000 00006C (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SRAT 0x000000007B7C6000 000770 (v03 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SPMI 0x000000007B7C5000 000041 (v05 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: WDDT 0x000000007B7C4000 000040 (v01 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: NITR 0x000000007B6A6000 000071 (v02 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: PRAD 0x000000007B6A1000 000102 (v02 INTEL SpsPrAgg 00000002 INTL 20130328)
[ 0.000000] ACPI: UEFI 0x000000007B679000 000042 (v01 INTEL S2600WT 00000002 INTL 01000013)
[ 0.000000] ACPI: SSDT 0x000000007B6A7000 0E96B0 (v02 INTEL S2600WT 00004000 INTL 20130328)
[ 0.000000] ACPI: SSDT 0x000000007B6A3000 002679 (v02 INTEL S2600WT 00000002 INTL 20130328)
[ 0.000000] ACPI: SSDT 0x000000007B6A2000 000064 (v02 INTEL S2600WT 00000002 INTL 20130328)
[ 0.000000] ACPI: HEST 0x000000007B6A0000 0000A8 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: BERT 0x000000007B69F000 000030 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: ERST 0x000000007B69E000 000230 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: EINJ 0x000000007B69D000 000130 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x10 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x12 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x14 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x16 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x20 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x22 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x24 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x26 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x28 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x30 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x32 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x34 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x36 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x40 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x42 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x44 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x46 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x48 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x50 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x52 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x54 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x56 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x60 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x62 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x64 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x66 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x68 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x70 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x72 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x74 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x76 -> Node 1
[ 0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[ 0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x87fffffff]
[ 0.000000] ACPI: SRAT: Node 1 PXM 1 [mem 0x880000000-0x107fffffff]
[ 0.000000] NUMA: Initialized distance table, cnt=2
[ 0.000000] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x87fffffff] -> [mem 0x00000000-0x87fffffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff]
[ 0.000000] NODE_DATA(1) allocated [mem 0x107ffd4000-0x107fffefff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]
[ 0.000000] Normal [mem 0x0000000100000000-0x000000107fffffff]
[ 0.000000] Device empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009afff]
[ 0.000000] node 0: [mem 0x0000000000100000-0x0000000079fd0fff]
[ 0.000000] node 0: [mem 0x000000007b7cf000-0x000000007b7fffff]
[ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff]
[ 0.000000] node 1: [mem 0x0000000880000000-0x000000107fffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff]
[ 0.000000] On node 0 totalpages: 8363932
[ 0.000000] DMA zone: 64 pages used for memmap
[ 0.000000] DMA zone: 21 pages reserved
[ 0.000000] DMA zone: 3994 pages, LIFO batch:0
[ 0.000000] DMA32 zone: 7745 pages used for memmap
[ 0.000000] DMA32 zone: 495618 pages, LIFO batch:31
[ 0.000000] Normal zone: 122880 pages used for memmap
[ 0.000000] Normal zone: 7864320 pages, LIFO batch:31
[ 0.000000] Initmem setup node 1 [mem 0x0000000880000000-0x000000107fffffff]
[ 0.000000] On node 1 totalpages: 8388608
[ 0.000000] Normal zone: 131072 pages used for memmap
[ 0.000000] Normal zone: 8388608 pages, LIFO batch:31
[ 0.000000] ACPI: PM-Timer IO Port: 0x408
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x08] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x09] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x10] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x11] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x12] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x13] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x14] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x15] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x16] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x17] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x18] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x19] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x20] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x21] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x22] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x23] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x24] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x25] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x26] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x27] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x28] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x29] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x30] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x31] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x32] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x33] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x34] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x35] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x36] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x37] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x38] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x39] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x40] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x41] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x42] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x43] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x44] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x45] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x46] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x47] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x48] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x49] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x50] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x51] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x52] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x53] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x54] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x55] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x56] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x57] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x58] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x59] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x60] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x61] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x62] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x63] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x64] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x65] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x66] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x67] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x68] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x69] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x70] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x71] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x72] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x73] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x74] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x75] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x76] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x77] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x78] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x79] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x80] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x81] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x82] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x83] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x84] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x85] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x86] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x87] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x88] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x89] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x90] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x91] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x92] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x93] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x94] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x95] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x96] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x97] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x98] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x99] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa0] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa1] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa2] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa3] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa4] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa5] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa6] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa7] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa8] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa9] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xaa] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xab] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xac] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xad] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xae] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xaf] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb0] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb1] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb2] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb3] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb4] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb5] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb6] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb7] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb8] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb9] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xba] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbb] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbc] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbd] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbe] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbf] high level lint[0x1])
[ 0.000000] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[ 0.000000] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47
[ 0.000000] IOAPIC[2]: apic_id 10, version 32, address 0xfec40000, GSI 48-71
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] ACPI: IRQ0 used by override.
[ 0.000000] ACPI: IRQ9 used by override.
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[ 0.000000] smpboot: Allowing 36 CPUs, 0 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009b000-0x0009bfff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009c000-0x0009ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x79fd1000-0x7ac50fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7ac51000-0x7b680fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b681000-0x7b7cefff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b800000-0x8fffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xff3fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xff400000-0xffffffff]
[ 0.000000] e820: [mem 0x90000000-0xfed1bfff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on bare hardware
[ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:36 nr_cpu_ids:36 nr_node_ids:2
[ 0.000000] percpu: Embedded 38 pages/cpu @ffff89ee9f800000 s115608 r8192 d31848 u262144
[ 0.000000] pcpu-alloc: s115608 r8192 d31848 u262144 alloc=1*2097152
[ 0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15
[ 0.000000] pcpu-alloc: [0] 16 17 -- -- -- -- -- -- [1] 18 19 20 21 22 23 24 25
[ 0.000000] pcpu-alloc: [1] 26 27 28 29 30 31 32 33 [1] 34 35 -- -- -- -- -- --
[ 0.000000] Built 2 zonelists in Node order, mobility grouping on. Total pages: 16490758
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.11.0-rc6patch-2-get-fence root=UUID=8f6dc1c5-b811-4ac9-aa98-7ea337785c73 ro
[ 0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[ 0.000000] log_buf_len total cpu_extra contributions: 143360 bytes
[ 0.000000] log_buf_len min size: 262144 bytes
[ 0.000000] log_buf_len: 524288 bytes
[ 0.000000] early log buf free: 236080(90%)
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Calgary: detecting Calgary via BIOS EBDA area
[ 0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[ 0.000000] Memory: 65828244K/67010160K available (9075K kernel code, 1697K rwdata, 3884K rodata, 2212K init, 2232K bss, 1181916K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=36, Nodes=2
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] Build-time adjustment of leaf fanout to 64.
[ 0.000000] RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=36.
[ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=36
[ 0.000000] NR_IRQS:524544 nr_irqs:1528 16
[ 0.000000] Console: colour dummy device 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[ 0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[ 0.000000] hpet clockevent registered
[ 0.000000] tsc: Fast TSC calibration using PIT
[ 0.004000] tsc: Detected 2294.478 MHz processor
[ 0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4588.95 BogoMIPS (lpj=9177912)
[ 0.004000] pid_max: default: 36864 minimum: 301
[ 0.004000] ACPI: Core revision 20170119
[ 0.101571] ACPI: 4 ACPI AML tables successfully acquired and loaded
[ 0.101655] Security Framework initialized
[ 0.101659] Yama: becoming mindful.
[ 0.101709] AppArmor: AppArmor initialized
[ 0.104376] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[ 0.117284] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[ 0.122990] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.123042] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.123769] CPU: Physical Processor ID: 0
[ 0.123773] CPU: Processor Core ID: 0
[ 0.123781] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[ 0.123784] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[ 0.123791] mce: CPU supports 22 MCE banks
[ 0.123813] CPU0: Thermal monitoring enabled (TM1)
[ 0.123866] process: using mwait in idle threads
[ 0.123872] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024
[ 0.123876] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4
[ 0.124720] Freeing SMP alternatives memory: 32K
[ 0.128005] ftrace: allocating 34213 entries in 134 pages
[ 0.140114] smpboot: Max logical packages: 2
[ 0.140256] x2apic: IRQ remapping doesn't support X2APIC mode
[ 0.140332] Switched APIC routing to physical flat.
[ 0.144588] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.184284] TSC deadline timer enabled
[ 0.184289] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz (family: 0x6, model: 0x3f, stepping: 0x2)
[ 0.184440] Performance Events: PEBS fmt2+, Haswell events, 16-deep LBR, full-width counters, Intel PMU driver.
[ 0.184484] ... version: 3
[ 0.184486] ... bit width: 48
[ 0.184489] ... generic registers: 8
[ 0.184491] ... value mask: 0000ffffffffffff
[ 0.184494] ... max period: 00007fffffffffff
[ 0.184496] ... fixed-purpose events: 3
[ 0.184499] ... event mask: 00000007000000ff
[ 0.186972] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[ 0.186993] smp: Bringing up secondary CPUs ...
[ 0.187104] x86: Booting SMP configuration:
[ 0.187108] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 #11 #12 #13 #14 #15 #16 #17
[ 1.548179] .... node #1, CPUs: #18 #19 #20 #21 #22 #23 #24 #25 #26 #27 #28 #29 #30 #31 #32 #33 #34 #35
[ 2.992067] smp: Brought up 2 nodes, 36 CPUs
[ 2.992067] smpboot: Total of 36 processors activated (165271.92 BogoMIPS)
[ 2.996708] sched_clock: Marking stable (2996000000, 0)->(3166693560, -170693560)
[ 2.998729] devtmpfs: initialized
[ 2.998798] x86/mm: Memory block size: 2048MB
[ 3.000642] evm: security.selinux
[ 3.000645] evm: security.SMACK64
[ 3.000647] evm: security.SMACK64EXEC
[ 3.000650] evm: security.SMACK64TRANSMUTE
[ 3.000652] evm: security.SMACK64MMAP
[ 3.000655] evm: security.ima
[ 3.000657] evm: security.capability
[ 3.000745] PM: Registering ACPI NVS region [mem 0x7ac51000-0x7b680fff] (10682368 bytes)
[ 3.001145] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 3.001215] futex hash table entries: 16384 (order: 8, 1048576 bytes)
[ 3.001567] pinctrl core: initialized pinctrl subsystem
[ 3.001696] RTC time: 0:28:23, date: 04/12/17
[ 3.002908] NET: Registered protocol family 16
[ 3.003121] cpuidle: using governor ladder
[ 3.003128] cpuidle: using governor menu
[ 3.003133] PCCT header not found.
[ 3.003177] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[ 3.003182] ACPI: bus type PCI registered
[ 3.003185] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 3.003287] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[ 3.003302] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[ 3.003319] PCI: Using configuration type 1 for base access
[ 3.005340] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[ 3.005379] core: PMU erratum BJ122, BV98, HSD29 workaround disabled, HT off
[ 3.007487] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[ 3.007491] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 3.008144] ACPI: Added _OSI(Module Device)
[ 3.008148] ACPI: Added _OSI(Processor Device)
[ 3.008151] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 3.008153] ACPI: Added _OSI(Processor Aggregator Device)
[ 3.008326] ACPI: Executed 1 blocks of module-level executable AML code
[ 3.138708] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[ 3.312902] ACPI: Dynamic OEM Table Load:
[ 3.338535] ACPI: Interpreter enabled
[ 3.338551] ACPI: (supports S0 S5)
[ 3.338554] ACPI: Using IOAPIC for interrupt routing
[ 3.338612] HEST: Table parsing has been initialized.
[ 3.338618] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 3.374111] ACPI: PCI Root Bridge [UNC1] (domain 0000 [bus ff])
[ 3.374120] acpi PNP0A03:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 5.413384] acpi PNP0A03:02: _OSC: platform does not support [PCIeHotplug]
[ 7.462165] acpi PNP0A03:02: _OSC: OS now controls [PME AER PCIeCapability]
[ 7.462170] acpi PNP0A03:02: FADT indicates ASPM is unsupported, using BIOS configuration
[ 7.462228] PCI host bridge to bus 0000:ff
[ 7.462233] pci_bus 0000:ff: root bus resource [bus ff]
[ 7.462247] pci 0000:ff:08.0: [8086:2f80] type 00 class 0x088000
[ 7.462317] pci 0000:ff:08.2: [8086:2f32] type 00 class 0x110100
[ 7.462370] pci 0000:ff:08.3: [8086:2f83] type 00 class 0x088000
[ 7.462435] pci 0000:ff:09.0: [8086:2f90] type 00 class 0x088000
[ 7.462487] pci 0000:ff:09.2: [8086:2f33] type 00 class 0x110100
[ 7.462537] pci 0000:ff:09.3: [8086:2f93] type 00 class 0x088000
[ 7.462591] pci 0000:ff:0b.0: [8086:2f81] type 00 class 0x088000
[ 7.462639] pci 0000:ff:0b.1: [8086:2f36] type 00 class 0x110100
[ 7.462688] pci 0000:ff:0b.2: [8086:2f37] type 00 class 0x110100
[ 7.462739] pci 0000:ff:0c.0: [8086:2fe0] type 00 class 0x088000
[ 7.462788] pci 0000:ff:0c.1: [8086:2fe1] type 00 class 0x088000
[ 7.462839] pci 0000:ff:0c.2: [8086:2fe2] type 00 class 0x088000
[ 7.462886] pci 0000:ff:0c.3: [8086:2fe3] type 00 class 0x088000
[ 7.462936] pci 0000:ff:0c.4: [8086:2fe4] type 00 class 0x088000
[ 7.462983] pci 0000:ff:0c.5: [8086:2fe5] type 00 class 0x088000
[ 7.463030] pci 0000:ff:0c.6: [8086:2fe6] type 00 class 0x088000
[ 7.463076] pci 0000:ff:0c.7: [8086:2fe7] type 00 class 0x088000
[ 7.463133] pci 0000:ff:0d.0: [8086:2fe8] type 00 class 0x088000
[ 7.463180] pci 0000:ff:0d.1: [8086:2fe9] type 00 class 0x088000
[ 7.463228] pci 0000:ff:0d.2: [8086:2fea] type 00 class 0x088000
[ 7.463274] pci 0000:ff:0d.3: [8086:2feb] type 00 class 0x088000
[ 7.463324] pci 0000:ff:0d.4: [8086:2fec] type 00 class 0x088000
[ 7.463372] pci 0000:ff:0d.5: [8086:2fed] type 00 class 0x088000
[ 7.463428] pci 0000:ff:0d.6: [8086:2fee] type 00 class 0x088000
[ 7.463477] pci 0000:ff:0d.7: [8086:2fef] type 00 class 0x088000
[ 7.463527] pci 0000:ff:0e.0: [8086:2ff0] type 00 class 0x088000
[ 7.463577] pci 0000:ff:0e.1: [8086:2ff1] type 00 class 0x088000
[ 7.463632] pci 0000:ff:0f.0: [8086:2ff8] type 00 class 0x088000
[ 7.463679] pci 0000:ff:0f.1: [8086:2ff9] type 00 class 0x088000
[ 7.463732] pci 0000:ff:0f.2: [8086:2ffa] type 00 class 0x088000
[ 7.463782] pci 0000:ff:0f.3: [8086:2ffb] type 00 class 0x088000
[ 7.463832] pci 0000:ff:0f.4: [8086:2ffc] type 00 class 0x088000
[ 7.463881] pci 0000:ff:0f.5: [8086:2ffd] type 00 class 0x088000
[ 7.463931] pci 0000:ff:0f.6: [8086:2ffe] type 00 class 0x088000
[ 7.463982] pci 0000:ff:10.0: [8086:2f1d] type 00 class 0x088000
[ 7.464032] pci 0000:ff:10.1: [8086:2f34] type 00 class 0x110100
[ 7.464085] pci 0000:ff:10.5: [8086:2f1e] type 00 class 0x088000
[ 7.464135] pci 0000:ff:10.6: [8086:2f7d] type 00 class 0x110100
[ 7.464185] pci 0000:ff:10.7: [8086:2f1f] type 00 class 0x088000
[ 7.464235] pci 0000:ff:12.0: [8086:2fa0] type 00 class 0x088000
[ 7.464292] pci 0000:ff:12.1: [8086:2f30] type 00 class 0x110100
[ 7.464348] pci 0000:ff:12.4: [8086:2f60] type 00 class 0x088000
[ 7.464402] pci 0000:ff:12.5: [8086:2f38] type 00 class 0x110100
[ 7.464459] pci 0000:ff:13.0: [8086:2fa8] type 00 class 0x088000
[ 7.464516] pci 0000:ff:13.1: [8086:2f71] type 00 class 0x088000
[ 7.464584] pci 0000:ff:13.2: [8086:2faa] type 00 class 0x088000
[ 7.464642] pci 0000:ff:13.3: [8086:2fab] type 00 class 0x088000
[ 7.464700] pci 0000:ff:13.6: [8086:2fae] type 00 class 0x088000
[ 7.464754] pci 0000:ff:13.7: [8086:2faf] type 00 class 0x088000
[ 7.464808] pci 0000:ff:14.0: [8086:2fb0] type 00 class 0x088000
[ 7.464866] pci 0000:ff:14.1: [8086:2fb1] type 00 class 0x088000
[ 7.464923] pci 0000:ff:14.2: [8086:2fb2] type 00 class 0x088000
[ 7.464981] pci 0000:ff:14.3: [8086:2fb3] type 00 class 0x088000
[ 7.465041] pci 0000:ff:14.4: [8086:2fbc] type 00 class 0x088000
[ 7.465095] pci 0000:ff:14.5: [8086:2fbd] type 00 class 0x088000
[ 7.465149] pci 0000:ff:14.6: [8086:2fbe] type 00 class 0x088000
[ 7.465200] pci 0000:ff:14.7: [8086:2fbf] type 00 class 0x088000
[ 7.465260] pci 0000:ff:16.0: [8086:2f68] type 00 class 0x088000
[ 7.465318] pci 0000:ff:16.1: [8086:2f79] type 00 class 0x088000
[ 7.465377] pci 0000:ff:16.2: [8086:2f6a] type 00 class 0x088000
[ 7.465436] pci 0000:ff:16.3: [8086:2f6b] type 00 class 0x088000
[ 7.465502] pci 0000:ff:16.6: [8086:2f6e] type 00 class 0x088000
[ 7.465557] pci 0000:ff:16.7: [8086:2f6f] type 00 class 0x088000
[ 7.465611] pci 0000:ff:17.0: [8086:2fd0] type 00 class 0x088000
[ 7.465672] pci 0000:ff:17.1: [8086:2fd1] type 00 class 0x088000
[ 7.465732] pci 0000:ff:17.2: [8086:2fd2] type 00 class 0x088000
[ 7.465791] pci 0000:ff:17.3: [8086:2fd3] type 00 class 0x088000
[ 7.465852] pci 0000:ff:17.4: [8086:2fb8] type 00 class 0x088000
[ 7.465907] pci 0000:ff:17.5: [8086:2fb9] type 00 class 0x088000
[ 7.465966] pci 0000:ff:17.6: [8086:2fba] type 00 class 0x088000
[ 7.466021] pci 0000:ff:17.7: [8086:2fbb] type 00 class 0x088000
[ 7.466094] pci 0000:ff:1e.0: [8086:2f98] type 00 class 0x088000
[ 7.466153] pci 0000:ff:1e.1: [8086:2f99] type 00 class 0x088000
[ 7.466207] pci 0000:ff:1e.2: [8086:2f9a] type 00 class 0x088000
[ 7.466265] pci 0000:ff:1e.3: [8086:2fc0] type 00 class 0x088000
[ 7.466304] pci 0000:ff:1e.4: [8086:2f9c] type 00 class 0x088000
[ 7.466368] pci 0000:ff:1f.0: [8086:2f88] type 00 class 0x088000
[ 7.466428] pci 0000:ff:1f.2: [8086:2f8a] type 00 class 0x088000
[ 7.466576] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus 7f])
[ 7.466583] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 9.510911] acpi PNP0A03:03: _OSC: platform does not support [PCIeHotplug]
[ 11.559552] acpi PNP0A03:03: _OSC: OS now controls [PME AER PCIeCapability]
[ 11.559556] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration
[ 11.559607] PCI host bridge to bus 0000:7f
[ 11.559611] pci_bus 0000:7f: root bus resource [bus 7f]
[ 11.559622] pci 0000:7f:08.0: [8086:2f80] type 00 class 0x088000
[ 11.559677] pci 0000:7f:08.2: [8086:2f32] type 00 class 0x110100
[ 11.559727] pci 0000:7f:08.3: [8086:2f83] type 00 class 0x088000
[ 11.559781] pci 0000:7f:09.0: [8086:2f90] type 00 class 0x088000
[ 11.559830] pci 0000:7f:09.2: [8086:2f33] type 00 class 0x110100
[ 11.559879] pci 0000:7f:09.3: [8086:2f93] type 00 class 0x088000
[ 11.559942] pci 0000:7f:0b.0: [8086:2f81] type 00 class 0x088000
[ 11.559992] pci 0000:7f:0b.1: [8086:2f36] type 00 class 0x110100
[ 11.560039] pci 0000:7f:0b.2: [8086:2f37] type 00 class 0x110100
[ 11.560090] pci 0000:7f:0c.0: [8086:2fe0] type 00 class 0x088000
[ 11.560136] pci 0000:7f:0c.1: [8086:2fe1] type 00 class 0x088000
[ 11.560182] pci 0000:7f:0c.2: [8086:2fe2] type 00 class 0x088000
[ 11.560228] pci 0000:7f:0c.3: [8086:2fe3] type 00 class 0x088000
[ 11.560276] pci 0000:7f:0c.4: [8086:2fe4] type 00 class 0x088000
[ 11.560324] pci 0000:7f:0c.5: [8086:2fe5] type 00 class 0x088000
[ 11.560371] pci 0000:7f:0c.6: [8086:2fe6] type 00 class 0x088000
[ 11.560416] pci 0000:7f:0c.7: [8086:2fe7] type 00 class 0x088000
[ 11.560463] pci 0000:7f:0d.0: [8086:2fe8] type 00 class 0x088000
[ 11.560508] pci 0000:7f:0d.1: [8086:2fe9] type 00 class 0x088000
[ 11.560554] pci 0000:7f:0d.2: [8086:2fea] type 00 class 0x088000
[ 11.560599] pci 0000:7f:0d.3: [8086:2feb] type 00 class 0x088000
[ 11.560643] pci 0000:7f:0d.4: [8086:2fec] type 00 class 0x088000
[ 11.560687] pci 0000:7f:0d.5: [8086:2fed] type 00 class 0x088000
[ 11.560740] pci 0000:7f:0d.6: [8086:2fee] type 00 class 0x088000
[ 11.560786] pci 0000:7f:0d.7: [8086:2fef] type 00 class 0x088000
[ 11.560834] pci 0000:7f:0e.0: [8086:2ff0] type 00 class 0x088000
[ 11.560881] pci 0000:7f:0e.1: [8086:2ff1] type 00 class 0x088000
[ 11.560932] pci 0000:7f:0f.0: [8086:2ff8] type 00 class 0x088000
[ 11.560978] pci 0000:7f:0f.1: [8086:2ff9] type 00 class 0x088000
[ 11.561022] pci 0000:7f:0f.2: [8086:2ffa] type 00 class 0x088000
[ 11.561068] pci 0000:7f:0f.3: [8086:2ffb] type 00 class 0x088000
[ 11.561122] pci 0000:7f:0f.4: [8086:2ffc] type 00 class 0x088000
[ 11.561172] pci 0000:7f:0f.5: [8086:2ffd] type 00 class 0x088000
[ 11.561220] pci 0000:7f:0f.6: [8086:2ffe] type 00 class 0x088000
[ 11.561266] pci 0000:7f:10.0: [8086:2f1d] type 00 class 0x088000
[ 11.561312] pci 0000:7f:10.1: [8086:2f34] type 00 class 0x110100
[ 11.561362] pci 0000:7f:10.5: [8086:2f1e] type 00 class 0x088000
[ 11.561405] pci 0000:7f:10.6: [8086:2f7d] type 00 class 0x110100
[ 11.561450] pci 0000:7f:10.7: [8086:2f1f] type 00 class 0x088000
[ 11.561498] pci 0000:7f:12.0: [8086:2fa0] type 00 class 0x088000
[ 11.561549] pci 0000:7f:12.1: [8086:2f30] type 00 class 0x110100
[ 11.561602] pci 0000:7f:12.4: [8086:2f60] type 00 class 0x088000
[ 11.561655] pci 0000:7f:12.5: [8086:2f38] type 00 class 0x110100
[ 11.561709] pci 0000:7f:13.0: [8086:2fa8] type 00 class 0x088000
[ 11.561762] pci 0000:7f:13.1: [8086:2f71] type 00 class 0x088000
[ 11.561815] pci 0000:7f:13.2: [8086:2faa] type 00 class 0x088000
[ 11.561869] pci 0000:7f:13.3: [8086:2fab] type 00 class 0x088000
[ 11.561926] pci 0000:7f:13.6: [8086:2fae] type 00 class 0x088000
[ 11.561993] pci 0000:7f:13.7: [8086:2faf] type 00 class 0x088000
[ 11.562044] pci 0000:7f:14.0: [8086:2fb0] type 00 class 0x088000
[ 11.562099] pci 0000:7f:14.1: [8086:2fb1] type 00 class 0x088000
[ 11.562153] pci 0000:7f:14.2: [8086:2fb2] type 00 class 0x088000
[ 11.562208] pci 0000:7f:14.3: [8086:2fb3] type 00 class 0x088000
[ 11.562262] pci 0000:7f:14.4: [8086:2fbc] type 00 class 0x088000
[ 11.562313] pci 0000:7f:14.5: [8086:2fbd] type 00 class 0x088000
[ 11.562365] pci 0000:7f:14.6: [8086:2fbe] type 00 class 0x088000
[ 11.562415] pci 0000:7f:14.7: [8086:2fbf] type 00 class 0x088000
[ 11.562468] pci 0000:7f:16.0: [8086:2f68] type 00 class 0x088000
[ 11.562523] pci 0000:7f:16.1: [8086:2f79] type 00 class 0x088000
[ 11.562580] pci 0000:7f:16.2: [8086:2f6a] type 00 class 0x088000
[ 11.562635] pci 0000:7f:16.3: [8086:2f6b] type 00 class 0x088000
[ 11.562693] pci 0000:7f:16.6: [8086:2f6e] type 00 class 0x088000
[ 11.562744] pci 0000:7f:16.7: [8086:2f6f] type 00 class 0x088000
[ 11.562797] pci 0000:7f:17.0: [8086:2fd0] type 00 class 0x088000
[ 11.562852] pci 0000:7f:17.1: [8086:2fd1] type 00 class 0x088000
[ 11.562907] pci 0000:7f:17.2: [8086:2fd2] type 00 class 0x088000
[ 11.562962] pci 0000:7f:17.3: [8086:2fd3] type 00 class 0x088000
[ 11.563017] pci 0000:7f:17.4: [8086:2fb8] type 00 class 0x088000
[ 11.563068] pci 0000:7f:17.5: [8086:2fb9] type 00 class 0x088000
[ 11.563118] pci 0000:7f:17.6: [8086:2fba] type 00 class 0x088000
[ 11.563169] pci 0000:7f:17.7: [8086:2fbb] type 00 class 0x088000
[ 11.563239] pci 0000:7f:1e.0: [8086:2f98] type 00 class 0x088000
[ 11.563288] pci 0000:7f:1e.1: [8086:2f99] type 00 class 0x088000
[ 11.563337] pci 0000:7f:1e.2: [8086:2f9a] type 00 class 0x088000
[ 11.563385] pci 0000:7f:1e.3: [8086:2fc0] type 00 class 0x088000
[ 11.563421] pci 0000:7f:1e.4: [8086:2f9c] type 00 class 0x088000
[ 11.563481] pci 0000:7f:1f.0: [8086:2f88] type 00 class 0x088000
[ 11.563538] pci 0000:7f:1f.2: [8086:2f8a] type 00 class 0x088000
[ 11.572760] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[ 11.572768] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 11.574700] acpi PNP0A08:00: _OSC: platform does not support [AER]
[ 11.575534] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 11.575544] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[ 11.575870] PCI host bridge to bus 0000:00
[ 11.575875] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 11.575879] pci_bus 0000:00: root bus resource [io 0x1000-0x7fff window]
[ 11.575882] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 11.575887] pci_bus 0000:00: root bus resource [mem 0x90000000-0xc7ffbfff window]
[ 11.575892] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x383fffffffff window]
[ 11.575897] pci_bus 0000:00: root bus resource [bus 00-7e]
[ 11.575907] pci 0000:00:00.0: [8086:2f00] type 00 class 0x060000
[ 11.576053] pci 0000:00:01.0: [8086:2f02] type 01 class 0x060400
[ 11.576101] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[ 11.576175] pci 0000:00:01.0: System wakeup disabled by ACPI
[ 11.576212] pci 0000:00:02.0: [8086:2f04] type 01 class 0x060400
[ 11.576259] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[ 11.576339] pci 0000:00:02.0: System wakeup disabled by ACPI
[ 11.576376] pci 0000:00:02.2: [8086:2f06] type 01 class 0x060400
[ 11.576423] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[ 11.576496] pci 0000:00:02.2: System wakeup disabled by ACPI
[ 11.576539] pci 0000:00:03.0: [8086:2f08] type 01 class 0x060400
[ 11.576586] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[ 11.576658] pci 0000:00:03.0: System wakeup disabled by ACPI
[ 11.576692] pci 0000:00:04.0: [8086:2f20] type 00 class 0x088000
[ 11.576702] pci 0000:00:04.0: reg 0x10: [mem 0x383fff12c000-0x383fff12ffff 64bit]
[ 11.576828] pci 0000:00:04.1: [8086:2f21] type 00 class 0x088000
[ 11.576838] pci 0000:00:04.1: reg 0x10: [mem 0x383fff128000-0x383fff12bfff 64bit]
[ 11.576972] pci 0000:00:04.2: [8086:2f22] type 00 class 0x088000
[ 11.576982] pci 0000:00:04.2: reg 0x10: [mem 0x383fff124000-0x383fff127fff 64bit]
[ 11.577108] pci 0000:00:04.3: [8086:2f23] type 00 class 0x088000
[ 11.577117] pci 0000:00:04.3: reg 0x10: [mem 0x383fff120000-0x383fff123fff 64bit]
[ 11.577244] pci 0000:00:04.4: [8086:2f24] type 00 class 0x088000
[ 11.577253] pci 0000:00:04.4: reg 0x10: [mem 0x383fff11c000-0x383fff11ffff 64bit]
[ 11.577377] pci 0000:00:04.5: [8086:2f25] type 00 class 0x088000
[ 11.577386] pci 0000:00:04.5: reg 0x10: [mem 0x383fff118000-0x383fff11bfff 64bit]
[ 11.577516] pci 0000:00:04.6: [8086:2f26] type 00 class 0x088000
[ 11.577526] pci 0000:00:04.6: reg 0x10: [mem 0x383fff114000-0x383fff117fff 64bit]
[ 11.577650] pci 0000:00:04.7: [8086:2f27] type 00 class 0x088000
[ 11.577660] pci 0000:00:04.7: reg 0x10: [mem 0x383fff110000-0x383fff113fff 64bit]
[ 11.577783] pci 0000:00:05.0: [8086:2f28] type 00 class 0x088000
[ 11.577902] pci 0000:00:05.1: [8086:2f29] type 00 class 0x088000
[ 11.578032] pci 0000:00:05.2: [8086:2f2a] type 00 class 0x088000
[ 11.578148] pci 0000:00:05.4: [8086:2f2c] type 00 class 0x080020
[ 11.578155] pci 0000:00:05.4: reg 0x10: [mem 0x91a06000-0x91a06fff]
[ 11.578292] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000
[ 11.578478] pci 0000:00:11.1: [8086:8d7d] type 00 class 0x0c0500
[ 11.578492] pci 0000:00:11.1: reg 0x10: [mem 0x91a05000-0x91a05fff]
[ 11.578525] pci 0000:00:11.1: reg 0x20: [io 0x3060-0x307f]
[ 11.578680] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601
[ 11.578695] pci 0000:00:11.4: reg 0x10: [io 0x3098-0x309f]
[ 11.578703] pci 0000:00:11.4: reg 0x14: [io 0x30cc-0x30cf]
[ 11.578711] pci 0000:00:11.4: reg 0x18: [io 0x3090-0x3097]
[ 11.578719] pci 0000:00:11.4: reg 0x1c: [io 0x30c8-0x30cb]
[ 11.578727] pci 0000:00:11.4: reg 0x20: [io 0x3020-0x303f]
[ 11.578734] pci 0000:00:11.4: reg 0x24: [mem 0x91a00000-0x91a007ff]
[ 11.578776] pci 0000:00:11.4: PME# supported from D3hot
[ 11.578874] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330
[ 11.578890] pci 0000:00:14.0: reg 0x10: [mem 0x383fff100000-0x383fff10ffff 64bit]
[ 11.578943] pci 0000:00:14.0: PME# supported from D3hot D3cold
[ 11.579032] pci 0000:00:14.0: System wakeup disabled by ACPI
[ 11.579072] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000
[ 11.579089] pci 0000:00:16.0: reg 0x10: [mem 0x383fff133000-0x383fff13300f 64bit]
[ 11.579151] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[ 11.579246] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000
[ 11.579263] pci 0000:00:16.1: reg 0x10: [mem 0x383fff132000-0x383fff13200f 64bit]
[ 11.579324] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
[ 11.579435] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320
[ 11.579452] pci 0000:00:1a.0: reg 0x10: [mem 0x91a02000-0x91a023ff]
[ 11.579535] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[ 11.579615] pci 0000:00:1a.0: System wakeup disabled by ACPI
[ 11.579656] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400
[ 11.579722] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[ 11.579803] pci 0000:00:1c.0: System wakeup disabled by ACPI
[ 11.579845] pci 0000:00:1c.3: [8086:8d16] type 01 class 0x060400
[ 11.579911] pci 0000:00:1c.3: PME# supported from D0 D3hot D3cold
[ 11.579978] pci 0000:00:1c.3: System wakeup disabled by ACPI
[ 11.580027] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320
[ 11.580044] pci 0000:00:1d.0: reg 0x10: [mem 0x91a01000-0x91a013ff]
[ 11.580127] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[ 11.580203] pci 0000:00:1d.0: System wakeup disabled by ACPI
[ 11.580243] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100
[ 11.580434] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601
[ 11.580447] pci 0000:00:1f.2: reg 0x10: [io 0x30c0-0x30c7]
[ 11.580454] pci 0000:00:1f.2: reg 0x14: [io 0x30dc-0x30df]
[ 11.580462] pci 0000:00:1f.2: reg 0x18: [io 0x30b8-0x30bf]
[ 11.580469] pci 0000:00:1f.2: reg 0x1c: [io 0x30d8-0x30db]
[ 11.580476] pci 0000:00:1f.2: reg 0x20: [io 0x3040-0x305f]
[ 11.580483] pci 0000:00:1f.2: reg 0x24: [mem 0x91a04000-0x91a047ff]
[ 11.580519] pci 0000:00:1f.2: PME# supported from D3hot
[ 11.580609] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500
[ 11.580623] pci 0000:00:1f.3: reg 0x10: [mem 0x383fff131000-0x383fff1310ff 64bit]
[ 11.580642] pci 0000:00:1f.3: reg 0x20: [io 0x3000-0x301f]
[ 11.580908] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 11.581064] pci 0000:00:02.0: PCI bridge to [bus 02]
[ 11.581231] pci 0000:03:00.0: [8086:1521] type 00 class 0x020000
[ 11.581243] pci 0000:03:00.0: reg 0x10: [mem 0x91920000-0x9193ffff]
[ 11.581256] pci 0000:03:00.0: reg 0x18: [io 0x2020-0x203f]
[ 11.581263] pci 0000:03:00.0: reg 0x1c: [mem 0x91944000-0x91947fff]
[ 11.581338] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[ 11.581364] pci 0000:03:00.0: reg 0x184: [mem 0x383fff060000-0x383fff063fff 64bit pref]
[ 11.581365] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x383fff060000-0x383fff07ffff 64bit pref] (contains BAR0 for 8 VFs)
[ 11.581384] pci 0000:03:00.0: reg 0x190: [mem 0x383fff040000-0x383fff043fff 64bit pref]
[ 11.581385] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x383fff040000-0x383fff05ffff 64bit pref] (contains BAR3 for 8 VFs)
[ 11.581490] pci 0000:03:00.3: [8086:1521] type 00 class 0x020000
[ 11.581502] pci 0000:03:00.3: reg 0x10: [mem 0x91900000-0x9191ffff]
[ 11.581515] pci 0000:03:00.3: reg 0x18: [io 0x2000-0x201f]
[ 11.581522] pci 0000:03:00.3: reg 0x1c: [mem 0x91940000-0x91943fff]
[ 11.581593] pci 0000:03:00.3: PME# supported from D0 D3hot D3cold
[ 11.581615] pci 0000:03:00.3: reg 0x184: [mem 0x383fff020000-0x383fff023fff 64bit pref]
[ 11.581617] pci 0000:03:00.3: VF(n) BAR0 space: [mem 0x383fff020000-0x383fff03ffff 64bit pref] (contains BAR0 for 8 VFs)
[ 11.581635] pci 0000:03:00.3: reg 0x190: [mem 0x383fff000000-0x383fff003fff 64bit pref]
[ 11.581636] pci 0000:03:00.3: VF(n) BAR3 space: [mem 0x383fff000000-0x383fff01ffff 64bit pref] (contains BAR3 for 8 VFs)
[ 11.582272] pci 0000:00:02.2: PCI bridge to [bus 03-04]
[ 11.582277] pci 0000:00:02.2: bridge window [io 0x2000-0x2fff]
[ 11.582279] pci 0000:00:02.2: bridge window [mem 0x91900000-0x919fffff]
[ 11.582282] pci 0000:00:02.2: bridge window [mem 0x383fff000000-0x383fff0fffff 64bit pref]
[ 11.582599] pci 0000:05:00.0: [15b3:1015] type 00 class 0x020000
[ 11.582731] pci 0000:05:00.0: reg 0x10: [mem 0x383ffc000000-0x383ffdffffff 64bit pref]
[ 11.583037] pci 0000:05:00.0: reg 0x30: [mem 0xfff00000-0xffffffff pref]
[ 11.583701] pci 0000:05:00.0: PME# supported from D3cold
[ 11.583973] pci 0000:05:00.0: reg 0x1a4: [mem 0x383ffe800000-0x383ffe8fffff 64bit pref]
[ 11.583976] pci 0000:05:00.0: VF(n) BAR0 space: [mem 0x383ffe800000-0x383ffeffffff 64bit pref] (contains BAR0 for 8 VFs)
[ 11.584849] pci 0000:05:00.1: [15b3:1015] type 00 class 0x020000
[ 11.584979] pci 0000:05:00.1: reg 0x10: [mem 0x383ffa000000-0x383ffbffffff 64bit pref]
[ 11.585284] pci 0000:05:00.1: reg 0x30: [mem 0xfff00000-0xffffffff pref]
[ 11.585887] pci 0000:05:00.1: PME# supported from D3cold
[ 11.586140] pci 0000:05:00.1: reg 0x1a4: [mem 0x383ffe000000-0x383ffe0fffff 64bit pref]
[ 11.586142] pci 0000:05:00.1: VF(n) BAR0 space: [mem 0x383ffe000000-0x383ffe7fffff 64bit pref] (contains BAR0 for 8 VFs)
[ 11.587003] pci 0000:00:03.0: PCI bridge to [bus 05-06]
[ 11.587012] pci 0000:00:03.0: bridge window [mem 0x383ffa000000-0x383ffeffffff 64bit pref]
[ 11.587048] pci 0000:00:1c.0: PCI bridge to [bus 07]
[ 11.587124] pci 0000:08:00.0: [102b:0522] type 00 class 0x030000
[ 11.587148] pci 0000:08:00.0: reg 0x10: [mem 0x90000000-0x90ffffff pref]
[ 11.587162] pci 0000:08:00.0: reg 0x14: [mem 0x91800000-0x91803fff]
[ 11.587176] pci 0000:08:00.0: reg 0x18: [mem 0x91000000-0x917fffff]
[ 11.587230] pci 0000:08:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.599576] pci 0000:00:1c.3: PCI bridge to [bus 08]
[ 11.599583] pci 0000:00:1c.3: bridge window [mem 0x91000000-0x918fffff]
[ 11.599588] pci 0000:00:1c.3: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 11.599615] pci_bus 0000:00: on NUMA node 0
[ 11.599980] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 *10 11 12 14 15)
[ 11.600030] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *9 10 11 12 14 15)
[ 11.600076] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 7 9 10 11 12 14 15)
[ 11.600121] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[ 11.600166] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[ 11.600211] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 11.600257] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 11.600303] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 11.600619] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[ 11.600626] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 11.601115] acpi PNP0A08:01: _OSC: platform does not support [AER]
[ 11.601939] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 11.601945] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[ 11.602156] PCI host bridge to bus 0000:80
[ 11.602160] pci_bus 0000:80: root bus resource [io 0x8000-0xffff window]
[ 11.602164] pci_bus 0000:80: root bus resource [mem 0xc8000000-0xfbffbfff window]
[ 11.602169] pci_bus 0000:80: root bus resource [mem 0x384000000000-0x387fffffffff window]
[ 11.602174] pci_bus 0000:80: root bus resource [bus 80-fe]
[ 11.602187] pci 0000:80:04.0: [8086:2f20] type 00 class 0x088000
[ 11.602199] pci 0000:80:04.0: reg 0x10: [mem 0x387ffff1c000-0x387ffff1ffff 64bit]
[ 11.602315] pci 0000:80:04.1: [8086:2f21] type 00 class 0x088000
[ 11.602326] pci 0000:80:04.1: reg 0x10: [mem 0x387ffff18000-0x387ffff1bfff 64bit]
[ 11.602434] pci 0000:80:04.2: [8086:2f22] type 00 class 0x088000
[ 11.602444] pci 0000:80:04.2: reg 0x10: [mem 0x387ffff14000-0x387ffff17fff 64bit]
[ 11.602560] pci 0000:80:04.3: [8086:2f23] type 00 class 0x088000
[ 11.602571] pci 0000:80:04.3: reg 0x10: [mem 0x387ffff10000-0x387ffff13fff 64bit]
[ 11.602676] pci 0000:80:04.4: [8086:2f24] type 00 class 0x088000
[ 11.602687] pci 0000:80:04.4: reg 0x10: [mem 0x387ffff0c000-0x387ffff0ffff 64bit]
[ 11.602793] pci 0000:80:04.5: [8086:2f25] type 00 class 0x088000
[ 11.602803] pci 0000:80:04.5: reg 0x10: [mem 0x387ffff08000-0x387ffff0bfff 64bit]
[ 11.602911] pci 0000:80:04.6: [8086:2f26] type 00 class 0x088000
[ 11.602922] pci 0000:80:04.6: reg 0x10: [mem 0x387ffff04000-0x387ffff07fff 64bit]
[ 11.603028] pci 0000:80:04.7: [8086:2f27] type 00 class 0x088000
[ 11.603039] pci 0000:80:04.7: reg 0x10: [mem 0x387ffff00000-0x387ffff03fff 64bit]
[ 11.603144] pci 0000:80:05.0: [8086:2f28] type 00 class 0x088000
[ 11.603242] pci 0000:80:05.1: [8086:2f29] type 00 class 0x088000
[ 11.603363] pci 0000:80:05.2: [8086:2f2a] type 00 class 0x088000
[ 11.603461] pci 0000:80:05.4: [8086:2f2c] type 00 class 0x080020
[ 11.603469] pci 0000:80:05.4: reg 0x10: [mem 0xc8000000-0xc8000fff]
[ 11.603590] pci_bus 0000:80: on NUMA node 1
[ 11.603893] ACPI: Enabled 4 GPEs in block 00 to 3F
[ 11.604335] pci 0000:08:00.0: vgaarb: setting as boot VGA device
[ 11.604340] pci 0000:08:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[ 11.604347] pci 0000:08:00.0: vgaarb: bridge control possible
[ 11.604350] vgaarb: loaded
[ 11.604606] SCSI subsystem initialized
[ 11.604732] libata version 3.00 loaded.
[ 11.604762] ACPI: bus type USB registered
[ 11.604779] usbcore: registered new interface driver usbfs
[ 11.604788] usbcore: registered new interface driver hub
[ 11.604901] usbcore: registered new device driver usb
[ 11.605229] PCI: Using ACPI for IRQ routing
[ 11.609857] PCI: pci_cache_line_size set to 64 bytes
[ 11.610122] e820: reserve RAM buffer [mem 0x0009b400-0x0009ffff]
[ 11.610124] e820: reserve RAM buffer [mem 0x79fd1000-0x7bffffff]
[ 11.610124] e820: reserve RAM buffer [mem 0x7b800000-0x7bffffff]
[ 11.610255] NetLabel: Initializing
[ 11.610259] NetLabel: domain hash size = 128
[ 11.610262] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 11.610285] NetLabel: unlabeled traffic allowed by default
[ 11.610435] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[ 11.610442] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[ 11.612599] clocksource: Switched to clocksource hpet
[ 11.627323] VFS: Disk quotas dquot_6.6.0
[ 11.627368] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 11.627511] AppArmor: AppArmor Filesystem Enabled
[ 11.627549] pnp: PnP ACPI init
[ 11.628235] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[ 11.628383] system 00:01: [io 0x0500-0x053f] has been reserved
[ 11.628388] system 00:01: [io 0x0400-0x047f] has been reserved
[ 11.628392] system 00:01: [io 0x0540-0x057f] has been reserved
[ 11.628395] system 00:01: [io 0x0600-0x061f] has been reserved
[ 11.628399] system 00:01: [io 0x0ca0-0x0ca5] has been reserved
[ 11.628402] system 00:01: [io 0x0880-0x0883] has been reserved
[ 11.628405] system 00:01: [io 0x0800-0x081f] has been reserved
[ 11.628410] system 00:01: [mem 0xfed1c000-0xfed3ffff] could not be reserved
[ 11.628413] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved
[ 11.628417] system 00:01: [mem 0xff000000-0xffffffff] could not be reserved
[ 11.628420] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved
[ 11.628424] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved
[ 11.628428] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved
[ 11.628431] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved
[ 11.628436] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[ 11.628596] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active)
[ 11.628741] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[ 11.628987] pnp: PnP ACPI: found 4 devices
[ 11.635294] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 11.635309] pci 0000:05:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window
[ 11.635314] pci 0000:05:00.1: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window
[ 11.635320] pci 0000:08:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.635406] pci 0000:00:03.0: BAR 14: assigned [mem 0x91b00000-0x91cfffff]
[ 11.635410] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 11.635419] pci 0000:00:02.0: PCI bridge to [bus 02]
[ 11.635427] pci 0000:00:02.2: PCI bridge to [bus 03-04]
[ 11.635431] pci 0000:00:02.2: bridge window [io 0x2000-0x2fff]
[ 11.635435] pci 0000:00:02.2: bridge window [mem 0x91900000-0x919fffff]
[ 11.635440] pci 0000:00:02.2: bridge window [mem 0x383fff000000-0x383fff0fffff 64bit pref]
[ 11.635448] pci 0000:05:00.0: BAR 6: assigned [mem 0x91b00000-0x91bfffff pref]
[ 11.635453] pci 0000:05:00.1: BAR 6: assigned [mem 0x91c00000-0x91cfffff pref]
[ 11.635457] pci 0000:00:03.0: PCI bridge to [bus 05-06]
[ 11.635462] pci 0000:00:03.0: bridge window [mem 0x91b00000-0x91cfffff]
[ 11.635466] pci 0000:00:03.0: bridge window [mem 0x383ffa000000-0x383ffeffffff 64bit pref]
[ 11.635474] pci 0000:00:1c.0: PCI bridge to [bus 07]
[ 11.635485] pci 0000:08:00.0: BAR 6: assigned [mem 0x91810000-0x9181ffff pref]
[ 11.635490] pci 0000:00:1c.3: PCI bridge to [bus 08]
[ 11.635495] pci 0000:00:1c.3: bridge window [mem 0x91000000-0x918fffff]
[ 11.635500] pci 0000:00:1c.3: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 11.635509] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
[ 11.635510] pci_bus 0000:00: resource 5 [io 0x1000-0x7fff window]
[ 11.635511] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[ 11.635512] pci_bus 0000:00: resource 7 [mem 0x90000000-0xc7ffbfff window]
[ 11.635513] pci_bus 0000:00: resource 8 [mem 0x380000000000-0x383fffffffff window]
[ 11.635515] pci_bus 0000:03: resource 0 [io 0x2000-0x2fff]
[ 11.635515] pci_bus 0000:03: resource 1 [mem 0x91900000-0x919fffff]
[ 11.635517] pci_bus 0000:03: resource 2 [mem 0x383fff000000-0x383fff0fffff 64bit pref]
[ 11.635518] pci_bus 0000:05: resource 1 [mem 0x91b00000-0x91cfffff]
[ 11.635519] pci_bus 0000:05: resource 2 [mem 0x383ffa000000-0x383ffeffffff 64bit pref]
[ 11.635521] pci_bus 0000:08: resource 1 [mem 0x91000000-0x918fffff]
[ 11.635522] pci_bus 0000:08: resource 2 [mem 0x90000000-0x90ffffff 64bit pref]
[ 11.635640] pci_bus 0000:80: resource 4 [io 0x8000-0xffff window]
[ 11.635641] pci_bus 0000:80: resource 5 [mem 0xc8000000-0xfbffbfff window]
[ 11.635642] pci_bus 0000:80: resource 6 [mem 0x384000000000-0x387fffffffff window]
[ 11.635779] NET: Registered protocol family 2
[ 11.636291] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[ 11.637095] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 11.637291] TCP: Hash tables configured (established 524288 bind 65536)
[ 11.637442] UDP hash table entries: 32768 (order: 8, 1048576 bytes)
[ 11.637679] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes)
[ 11.638099] NET: Registered protocol family 1
[ 11.696957] pci 0000:08:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[ 11.696983] PCI: CLS 32 bytes, default 64
[ 11.697035] Unpacking initramfs...
[ 12.356434] Freeing initrd memory: 40316K
[ 12.356446] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 12.356451] software IO TLB [mem 0x75fd1000-0x79fd1000] (64MB) mapped at [ffff89e6b5fd1000-ffff89e6b9fd0fff]
[ 12.356510] Intel CQM monitoring enabled
[ 12.359595] Scanning for low memory corruption every 60 seconds
[ 12.360507] audit: initializing netlink subsys (disabled)
[ 12.361522] Initialise system trusted keyrings
[ 12.361601] workingset: timestamp_bits=36 max_order=24 bucket_order=0
[ 12.362885] zbud: loaded
[ 12.363650] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 12.363872] fuse init (API version 7.26)
[ 12.366114] Key type asymmetric registered
[ 12.366118] Asymmetric key parser 'x509' registered
[ 12.366132] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[ 12.366218] io scheduler noop registered
[ 12.366221] io scheduler deadline registered
[ 12.366260] io scheduler cfq registered (default)
[ 12.367993] pcieport 0000:00:01.0: Signaling PME with IRQ 25
[ 12.368018] pcieport 0000:00:02.0: Signaling PME with IRQ 26
[ 12.368037] pcieport 0000:00:02.2: Signaling PME with IRQ 27
[ 12.368055] pcieport 0000:00:03.0: Signaling PME with IRQ 28
[ 12.368086] pcieport 0000:00:1c.0: Signaling PME with IRQ 29
[ 12.368110] pcieport 0000:00:1c.3: Signaling PME with IRQ 30
[ 12.368194] vesafb: mode is 640x480x32, linelength=2560, pages=0
[ 12.368198] vesafb: scrolling: redraw
[ 12.368201] vesafb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[ 12.368222] vesafb: framebuffer at 0x90000000, mapped to 0xffffa6e208200000, using 1216k, total 1216k
[ 12.454948] Console: switching to colour frame buffer device 80x30
[ 12.544104] fb0: VESA VGA frame buffer device
[ 12.545926] intel_idle: MWAIT substates: 0x2120
[ 12.545927] intel_idle: v0.4.1 model 0x3F
[ 12.547506] intel_idle: lapic_timer_reliable_states 0xffffffff
[ 12.547753] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 12.550817] ACPI: Power Button [PWRF]
[ 12.597660] ERST: Error Record Serialization Table (ERST) support is initialized.
[ 12.693775] pstore: using zlib compression
[ 12.741896] pstore: Registered erst as persistent store backend
[ 12.790626] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[ 12.890923] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 12.962145] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 13.083995] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[ 13.187561] Linux agpgart interface v0.103
[ 13.249825] loop: module loaded
[ 13.303831] libphy: Fixed MDIO Bus: probed
[ 13.357713] tun: Universal TUN/TAP device driver, 1.6
[ 13.413411] tsc: Refined TSC clocksource calibration: 2294.686 MHz
[ 13.416943] PPP generic driver version 2.4.2
[ 13.417022] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 13.417026] ehci-pci: EHCI PCI platform driver
[ 13.417337] ehci-pci 0000:00:1a.0: EHCI Host Controller
[ 13.417350] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[ 13.417397] ehci-pci 0000:00:1a.0: debug port 2
[ 13.421372] ehci-pci 0000:00:1a.0: cache line size of 32 is not supported
[ 13.421386] ehci-pci 0000:00:1a.0: irq 18, io mem 0x91a02000
[ 13.432836] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[ 13.432902] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[ 13.432903] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 13.432904] usb usb1: Product: EHCI Host Controller
[ 13.432905] usb usb1: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence ehci_hcd
[ 13.432907] usb usb1: SerialNumber: 0000:00:1a.0
[ 13.433077] hub 1-0:1.0: USB hub found
[ 13.433081] hub 1-0:1.0: 2 ports detected
[ 13.433402] ehci-pci 0000:00:1d.0: EHCI Host Controller
[ 13.433407] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[ 13.433454] ehci-pci 0000:00:1d.0: debug port 2
[ 13.437428] ehci-pci 0000:00:1d.0: cache line size of 32 is not supported
[ 13.437434] ehci-pci 0000:00:1d.0: irq 18, io mem 0x91a01000
[ 13.448829] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[ 13.448863] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[ 13.448865] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 13.448866] usb usb2: Product: EHCI Host Controller
[ 13.448867] usb usb2: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence ehci_hcd
[ 13.448868] usb usb2: SerialNumber: 0000:00:1d.0
[ 13.449018] hub 2-0:1.0: USB hub found
[ 13.449022] hub 2-0:1.0: 2 ports detected
[ 13.449170] ehci-platform: EHCI generic platform driver
[ 13.449188] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 13.449191] ohci-pci: OHCI PCI platform driver
[ 13.449214] ohci-platform: OHCI generic platform driver
[ 13.449220] uhci_hcd: USB Universal Host Controller Interface driver
[ 13.449432] xhci_hcd 0000:00:14.0: xHCI Host Controller
[ 13.449437] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3
[ 13.450828] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x00009810
[ 13.450845] xhci_hcd 0000:00:14.0: cache line size of 32 is not supported
[ 13.450957] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[ 13.450959] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 13.450960] usb usb3: Product: xHCI Host Controller
[ 13.450961] usb usb3: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence xhci-hcd
[ 13.450962] usb usb3: SerialNumber: 0000:00:14.0
[ 13.451143] hub 3-0:1.0: USB hub found
[ 13.451215] hub 3-0:1.0: 15 ports detected
[ 13.453541] xhci_hcd 0000:00:14.0: xHCI Host Controller
[ 13.453550] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4
[ 13.453593] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
[ 13.453594] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 13.453595] usb usb4: Product: xHCI Host Controller
[ 13.453596] usb usb4: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence xhci-hcd
[ 13.453597] usb usb4: SerialNumber: 0000:00:14.0
[ 13.453764] hub 4-0:1.0: USB hub found
[ 13.453795] hub 4-0:1.0: 6 ports detected
[ 13.454929] i8042: PNP: No PS/2 controller found.
[ 13.455073] mousedev: PS/2 mouse device common for all mice
[ 13.455274] rtc_cmos 00:00: RTC can wake from S4
[ 13.455813] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[ 13.455918] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[ 13.455923] i2c /dev entries driver
[ 13.455979] device-mapper: uevent: version 1.0.3
[ 13.456125] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com
[ 13.456135] intel_pstate: Intel P-state driver initializing
[ 13.760861] usb 1-1: new high-speed USB device number 2 using ehci-pci
[ 13.776860] usb 2-1: new high-speed USB device number 2 using ehci-pci
[ 13.776882] usb 3-1: new low-speed USB device number 2 using xhci_hcd
[ 13.965592] usb 1-1: New USB device found, idVendor=8087, idProduct=800a
[ 13.965593] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 13.965638] usb 2-1: New USB device found, idVendor=8087, idProduct=8002
[ 13.965639] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 13.965952] hub 2-1:1.0: USB hub found
[ 13.965996] hub 1-1:1.0: USB hub found
[ 13.966165] hub 2-1:1.0: 8 ports detected
[ 13.966173] hub 1-1:1.0: 6 ports detected
[ 13.972197] usb 3-1: New USB device found, idVendor=14dd, idProduct=1007
[ 13.972198] usb 3-1: New USB device strings: Mfr=1, Product=2, SerialNumber=7
[ 13.972198] usb 3-1: Product: D2CIM-DVUSB
[ 13.972200] usb 3-1: Manufacturer: Raritan
[ 13.972201] usb 3-1: SerialNumber: PQ254006510000007
[ 14.096897] usb 3-9: new full-speed USB device number 3 using xhci_hcd
[ 14.258106] usb 3-9: New USB device found, idVendor=046b, idProduct=ff10
[ 14.258107] usb 3-9: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 14.258108] usb 3-9: Product: Virtual Keyboard and Mouse
[ 14.258109] usb 3-9: Manufacturer: American Megatrends Inc.
[ 14.258110] usb 3-9: SerialNumber: serial
[ 18.846715] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x211399552f8, max_idle_ns: 440795292447 ns
[ 18.946820] ledtrig-cpu: registered to indicate activity on CPUs
[ 18.998927] NET: Registered protocol family 10
[ 19.054120] Segment Routing with IPv6
[ 19.104738] NET: Registered protocol family 17
[ 19.154348] Key type dns_resolver registered
[ 19.207114] microcode: sig=0x306f2, pf=0x1, revision=0x37
[ 19.255392] microcode: Microcode Update Driver: v2.2.
[ 19.255510] registered taskstats version 1
[ 19.351554] Loading compiled-in X.509 certificates
[ 19.401145] Loaded X.509 cert 'Build time autogenerated kernel key: de39ac008d1fce01b49462a1060a30c176fa995c'
[ 19.498822] zswap: loaded using pool lzo/zbud
[ 19.557977] Key type big_key registered
[ 19.606240] Key type trusted registered
[ 19.656263] Key type encrypted registered
[ 19.704996] AppArmor: AppArmor sha1 policy hashing enabled
[ 19.755952] ima: No TPM chip found, activating TPM-bypass! (rc=-19)
[ 19.807278] evm: HMAC attrs: 0x1
[ 19.858571] Magic number: 13:809:455
[ 19.908787] rtc_cmos 00:00: setting system clock to 2017-04-12 00:28:40 UTC (1491956920)
[ 20.013088] clocksource: Switched to clocksource tsc
[ 20.013130] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[ 20.013130] EDD information not available.
[ 20.013155] PM: Hibernation image not present or could not be loaded.
[ 20.174531] Freeing unused kernel memory: 2212K
[ 20.227275] Write protecting the kernel read-only data: 14336k
[ 20.281637] Freeing unused kernel memory: 1148K
[ 20.335905] Freeing unused kernel memory: 212K
[ 20.388915] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 20.549466] random: systemd-udevd: uninitialized urandom read (16 bytes read)
[ 20.550333] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.550362] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.553393] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.553445] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.553493] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.553548] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.553586] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.553624] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.553678] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.037360] wmi: Mapper loaded
[ 21.077292] pps_core: LinuxPPS API ver. 1 registered
[ 21.118078] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 21.202903] hidraw: raw HID events driver (C) Jiri Kosina
[ 21.246451] PTP clock support registered
[ 21.289555] dca service started, version 1.12.1
[ 21.300073] usbcore: registered new interface driver usbhid
[ 21.300074] usbhid: USB HID core driver
[ 21.415848] ahci 0000:00:11.4: version 3.0
[ 21.416025] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode
[ 21.498921] ahci 0000:00:11.4: flags: 64bit ncq led clo pio slum part ems apst
[ 21.584649] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.0/0003:14DD:1007.0001/input/input1
[ 21.621988] scsi host0: ahci
[ 21.622103] scsi host1: ahci
[ 21.625526] scsi host2: ahci
[ 21.625620] scsi host3: ahci
[ 21.625660] ata1: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00100 irq 31
[ 21.625666] ata2: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00180 irq 31
[ 21.625672] ata3: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00200 irq 31
[ 21.625679] ata4: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00280 irq 31
[ 21.626233] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[ 21.626234] ahci 0000:00:1f.2: flags: 64bit ncq led clo pio slum part ems apst
[ 21.686060] scsi host4: ahci
[ 21.686188] scsi host5: ahci
[ 21.686306] scsi host6: ahci
[ 21.686430] scsi host7: ahci
[ 21.686558] scsi host8: ahci
[ 21.686661] scsi host9: ahci
[ 21.686716] ata5: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04100 irq 32
[ 21.686722] ata6: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04180 irq 32
[ 21.686729] ata7: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04200 irq 32
[ 21.686736] ata8: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04280 irq 32
[ 21.686742] ata9: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04300 irq 32
[ 21.686749] ata10: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04380 irq 32
[ 21.940962] ata4: SATA link down (SStatus 0 SControl 300)
[ 21.941074] ata2: SATA link down (SStatus 0 SControl 300)
[ 21.941184] ata3: SATA link down (SStatus 0 SControl 300)
[ 21.944669] ata1: SATA link down (SStatus 0 SControl 300)
[ 22.004583] ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[ 22.004675] ata6: SATA link down (SStatus 0 SControl 300)
[ 22.036958] ata9: SATA link down (SStatus 0 SControl 300)
[ 22.037066] ata8: SATA link down (SStatus 0 SControl 300)
[ 22.040446] ata7: SATA link down (SStatus 0 SControl 300)
[ 22.040587] ata10: SATA link down (SStatus 0 SControl 300)
[ 22.124928] ata5.00: ATA-8: INTEL SSDSA2BW300G3, 4PC10302, max UDMA/133
[ 22.124929] ata5.00: 586072368 sectors, multi 1: LBA48 NCQ (depth 31/32)
[ 22.478473] ata5.00: configured for UDMA/133
[ 22.478700] scsi 4:0:0:0: Direct-Access ATA INTEL SSDSA2BW30 0302 PQ: 0 ANSI: 5
[ 22.539214] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[ 22.539214] igb: Copyright (c) 2007-2014 Intel Corporation.
[ 22.539508] AVX2 version of gcm_enc/dec engaged.
[ 22.539508] AES CTR mode by8 optimization enabled
[ 22.623475] igb 0000:03:00.0: added PHC on eth0
[ 22.623475] igb 0000:03:00.0: Intel(R) Gigabit Ethernet Network Connection
[ 22.623476] igb 0000:03:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:fe:f6:8f
[ 22.623550] igb 0000:03:00.0: eth0: PBA No: 100000-000
[ 22.623551] igb 0000:03:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[ 22.691598] igb 0000:03:00.3: added PHC on eth1
[ 22.691600] igb 0000:03:00.3: Intel(R) Gigabit Ethernet Network Connection
[ 22.691601] igb 0000:03:00.3: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:fe:f6:90
[ 22.691676] igb 0000:03:00.3: eth1: PBA No: 100000-000
[ 22.691677] igb 0000:03:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[ 23.361384] mlx5_core 0000:05:00.0: firmware version: 14.18.2000
[ 23.923325] igb 0000:03:00.0 eno1: renamed from eth0
[ 24.037755] (0000:05:00.0): E-Switch: Total vports 9, l2 table size(65536), per vport: max uc(1024) max mc(16384)
[ 24.105242] mlx5_core 0000:05:00.0: Port module event: module 0, Cable plugged
[ 25.367569] mlx5_core 0000:05:00.1: firmware version: 14.18.2000
[ 25.417937] hid-generic 0003:14DD:1007.0001: input,hidraw0: USB HID v1.10 Keyboard [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input0
[ 25.418043] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.1/0003:14DD:1007.0002/input/input2
[ 25.418102] hid-generic 0003:14DD:1007.0002: input,hidraw1: USB HID v1.10 Mouse [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input1
[ 25.427093] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.2/0003:14DD:1007.0003/input/input3
[ 25.427184] hid-generic 0003:14DD:1007.0003: input,hidraw2: USB HID v1.10 Mouse [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input2
[ 25.427273] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb3/3-9/3-9:1.0/0003:046B:FF10.0004/input/input4
[ 25.427312] hid-generic 0003:046B:FF10.0004: input,hidraw3: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:14.0-9/input0
[ 25.427390] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb3/3-9/3-9:1.1/0003:046B:FF10.0005/input/input5
[ 25.427438] hid-generic 0003:046B:FF10.0005: input,hidraw4: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:14.0-9/input1
[ 26.806079] igb 0000:03:00.3 eno2: renamed from eth1
[ 26.918241] ata5.00: Enabling discard_zeroes_data
[ 26.918247] sd 4:0:0:0: Attached scsi generic sg0 type 0
[ 27.071986] sd 4:0:0:0: [sda] 586072368 512-byte logical blocks: (300 GB/279 GiB)
[ 27.224306] sd 4:0:0:0: [sda] Write Protect is off
[ 27.300184] sd 4:0:0:0: [sda] Mode Sense: 00 3a 00 00
[ 27.300189] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 27.449763] ata5.00: Enabling discard_zeroes_data
[ 27.524778] sda: sda1 sda2 < sda5 >
[ 27.585020] (0000:05:00.1): E-Switch: Total vports 9, l2 table size(65536), per vport: max uc(1024) max mc(16384)
[ 27.744396] mlx5_core 0000:05:00.1: Port module event: module 1, Cable plugged
[ 27.888595] ata5.00: Enabling discard_zeroes_data
[ 27.899748] mlx5_core 0000:05:00.0: MLX5E: StrdRq(1) RqSz(8) StrdSz(64) RxCqeCmprss(0)
[ 28.018144] random: fast init done
[ 28.072837] mlx5_core 0000:05:00.1: MLX5E: StrdRq(1) RqSz(8) StrdSz(64) RxCqeCmprss(0)
[ 28.310354] sd 4:0:0:0: [sda] Attached SCSI disk
[ 28.379998] mlx5_core 0000:05:00.1 ens785f1: renamed from eth1
[ 28.482230] mlx5_core 0000:05:00.0 ens785f0: renamed from eth0
[ 29.838257] raid6: sse2x1 gen() 10446 MB/s
[ 30.030268] raid6: sse2x1 xor() 8727 MB/s
[ 30.158278] raid6: sse2x2 gen() 14279 MB/s
[ 30.286291] raid6: sse2x2 xor() 9556 MB/s
[ 30.410305] raid6: sse2x4 gen() 16427 MB/s
[ 30.530322] raid6: sse2x4 xor() 11554 MB/s
[ 30.650321] raid6: avx2x1 gen() 21791 MB/s
[ 30.770336] raid6: avx2x1 xor() 16651 MB/s
[ 30.890346] raid6: avx2x2 gen() 25256 MB/s
[ 31.006365] raid6: avx2x2 xor() 17185 MB/s
[ 31.122364] raid6: avx2x4 gen() 29166 MB/s
[ 31.234394] raid6: avx2x4 xor() 19910 MB/s
[ 31.280705] raid6: using algorithm avx2x4 gen() 29166 MB/s
[ 31.326485] raid6: .... xor() 19910 MB/s, rmw enabled
[ 31.371821] raid6: using avx2x2 recovery algorithm
[ 31.417979] xor: automatically using best checksumming function avx
[ 31.464891] async_tx: api initialized (async)
[ 31.668022] Btrfs loaded, crc32c=crc32c-intel
[ 32.085591] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[ 32.449124] ip_tables: (C) 2000-2006 Netfilter Core Team
[ 32.548876] systemd[1]: systemd 231 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[ 32.704841] systemd[1]: Detected architecture x86-64.
[ 32.925359] systemd[1]: Set hostname to <nvmfji02>.
[ 33.066104] systemd[1]: Listening on udev Control Socket.
[ 33.179025] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[ 33.351878] systemd[1]: Reached target User and Group Name Lookups.
[ 33.469086] systemd[1]: Listening on LVM2 metadata daemon socket.
[ 33.586849] systemd[1]: Listening on Journal Audit Socket.
[ 33.707530] systemd[1]: Listening on udev Kernel Socket.
[ 33.826961] systemd[1]: Listening on Journal Socket (/dev/log).
[ 34.913899] mlx5_ib: Mellanox Connect-IB Infiniband driver v2.2-1 (Feb 2014)
[ 35.898198] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro
[ 36.405400] ipmi message handler version 39.2
[ 36.408066] ipmi device interface
[ 36.410785] IPMI System Interface driver.
[ 36.410854] ipmi_si: probing via SMBIOS
[ 36.410855] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[ 36.410856] ipmi_si: Adding SMBIOS-specified kcs state machine
[ 36.410857] ipmi_si: probing via SPMI
[ 36.410858] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[ 36.410858] ipmi_si: SPMI-specified kcs state machine: duplicate
[ 36.410860] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[ 36.423080] power_meter ACPI000D:00: Found ACPI power meter.
[ 36.423329] power_meter ACPI000D:00: Ignoring unsafe software power cap!
[ 36.423614] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info().
[ 36.781380] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x006f, dev_id: 0x21)
[ 36.781414] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[ 37.174259] random: crng init done
[ 37.378197] ioatdma: Intel(R) QuickData Technology Driver 4.00
[ 37.378242] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 37.379807] IPMI SSIF Interface driver
[ 37.392555] igb 0000:03:00.0: DCA enabled
[ 37.392578] igb 0000:03:00.3: DCA enabled
[ 37.403987] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[ 37.405148] Loading iSCSI transport class v2.0-870.
[ 37.411434] iscsi: registered transport (tcp)
[ 37.414391] iscsi: registered transport (iser)
[ 37.518189] RAPL PMU: API unit is 2^-32 Joules, 4 fixed counters, 655360 ms ovfl timer
[ 37.518189] RAPL PMU: hw unit of domain pp0-core 2^-14 Joules
[ 37.518190] RAPL PMU: hw unit of domain package 2^-14 Joules
[ 37.518190] RAPL PMU: hw unit of domain dram 2^-14 Joules
[ 37.518190] RAPL PMU: hw unit of domain pp1-gpu 2^-14 Joules
[ 38.299901] kvm: disabled by bios
[ 38.590694] EDAC MC: Ver: 3.0.0
[ 38.593640] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[ 38.593652] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[ 38.593664] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[ 38.593675] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[ 38.593679] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[ 38.593684] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[ 38.593688] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[ 38.593691] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[ 38.593696] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[ 38.593700] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[ 38.593703] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[ 38.593708] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[ 38.593712] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[ 38.593715] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[ 38.593720] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[ 38.593723] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[ 38.593727] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[ 38.593732] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[ 38.593735] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[ 38.593739] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[ 38.593744] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[ 38.593747] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[ 38.593750] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[ 38.593755] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[ 38.593759] EDAC sbridge: Seeking for: PCI ID 8086:2fac
[ 38.593767] EDAC sbridge: Seeking for: PCI ID 8086:2fad
[ 38.593775] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[ 38.593779] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[ 38.593784] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[ 38.593787] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[ 38.593791] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[ 38.593796] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[ 38.593799] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[ 38.593803] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[ 38.593808] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[ 38.593811] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[ 38.593815] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[ 38.593820] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[ 38.593822] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[ 38.593826] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[ 38.593831] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[ 38.593834] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[ 38.593838] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[ 38.593843] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[ 38.593846] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[ 38.593850] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[ 38.593855] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[ 38.593858] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[ 38.593862] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[ 38.593867] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[ 38.593870] EDAC sbridge: Seeking for: PCI ID 8086:2f6c
[ 38.593878] EDAC sbridge: Seeking for: PCI ID 8086:2f6d
[ 38.594040] EDAC MC0: Giving out device to module sbridge_edac.c controller Haswell Socket#0: DEV 0000:ff:12.0 (INTERRUPT)
[ 38.594203] EDAC MC1: Giving out device to module sbridge_edac.c controller Haswell Socket#1: DEV 0000:7f:12.0 (INTERRUPT)
[ 38.594203] EDAC sbridge: Ver: 1.1.1
[ 38.976054] systemd-journald[766]: Received request to flush runtime journal from PID 1
[ 39.299519] intel_rapl: Found RAPL domain package
[ 39.299523] intel_rapl: Found RAPL domain dram
[ 39.299525] intel_rapl: DRAM domain energy unit 15300pj
[ 39.299813] intel_rapl: Found RAPL domain package
[ 39.299816] intel_rapl: Found RAPL domain dram
[ 39.299817] intel_rapl: DRAM domain energy unit 15300pj
[ 39.716453] Adding 67008508k swap on /dev/sda5. Priority:-1 extents:1 across:67008508k SSFS
[ 41.754033] mlx5_core 0000:05:00.0 ens785f0: Link up
[ 42.086180] mlx5_core 0000:05:00.1 ens785f1: Link up
[ 42.223460] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready
[ 42.482541] new mount options do not match the existing superblock, will be ignored
[ 43.109589] systemd[1]: apt-daily.timer: Adding 10h 37min 26.979726s random time.
[ 43.109836] systemd[1]: snapd.refresh.timer: Adding 9min 54.926461s random time.
[ 43.109840] systemd[1]: snapd.refresh.timer: Adding 4h 7min 38.023381s random time.
[ 43.140125] systemd[1]: Started ACPI event daemon.
[ 43.184101] systemd[1]: apt-daily.timer: Adding 1h 27min 3.365812s random time.
[ 43.184294] systemd[1]: snapd.refresh.timer: Adding 5h 29min 54.048433s random time.
[ 43.184297] systemd[1]: snapd.refresh.timer: Adding 46min 10.190972s random time.
[ 43.215770] systemd[1]: Started ACPI event daemon.
[ 43.258179] systemd[1]: apt-daily.timer: Adding 4h 46min 49.712232s random time.
[ 43.258363] systemd[1]: snapd.refresh.timer: Adding 5h 42min 26.204336s random time.
[ 45.425014] igb 0000:03:00.0 eno1: igb: eno1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
[ 45.425153] IPv6: ADDRCONF(NETDEV_CHANGE): eno1: link becomes ready
[ 577.049109] nvme nvme0: creating 32 I/O queues.
[ 577.873731] nvme nvme0: new ctrl: NQN "subsys0", addr 10.10.0.1:4420
[ 577.895233] nvme nvme1: creating 32 I/O queues.
[ 578.707774] nvme nvme1: new ctrl: NQN "subsys1", addr 10.11.0.1:4420
[ 578.729003] nvme nvme2: creating 32 I/O queues.
[ 579.550553] nvme nvme2: new ctrl: NQN "subsys2", addr 10.10.0.1:4420
[ 579.569722] nvme nvme3: creating 32 I/O queues.
[ 580.385071] nvme nvme3: new ctrl: NQN "subsys3", addr 10.11.0.1:4420
[ 580.404759] nvme nvme4: creating 32 I/O queues.
[ 581.223788] nvme nvme4: new ctrl: NQN "subsys4", addr 10.10.0.1:4420
[ 581.245933] nvme nvme5: creating 32 I/O queues.
[ 582.115338] nvme nvme5: new ctrl: NQN "subsys5", addr 10.11.0.1:4420
[ 582.136462] nvme nvme6: creating 32 I/O queues.
[ 582.943950] nvme nvme6: new ctrl: NQN "subsys6", addr 10.10.0.1:4420
[ 582.964102] nvme nvme7: creating 32 I/O queues.
[ 583.781990] nvme nvme7: new ctrl: NQN "subsys7", addr 10.11.0.1:4420
[ 583.789844] nvme7n1:
[ 583.801708] nvme nvme8: creating 32 I/O queues.
[ 584.614926] nvme nvme8: new ctrl: NQN "subsys8", addr 10.10.0.1:4420
[ 584.634082] nvme nvme9: creating 32 I/O queues.
[ 585.451677] nvme nvme9: new ctrl: NQN "subsys9", addr 10.11.0.1:4420
[ 585.472643] nvme nvme10: creating 32 I/O queues.
[ 586.282520] nvme nvme10: new ctrl: NQN "subsys10", addr 10.10.0.1:4420
[ 586.302884] nvme nvme11: creating 32 I/O queues.
[ 587.111769] nvme nvme11: new ctrl: NQN "subsys11", addr 10.11.0.1:4420
[ 587.132276] nvme nvme12: creating 32 I/O queues.
[ 587.942206] nvme nvme12: new ctrl: NQN "subsys12", addr 10.10.0.1:4420
[ 587.963774] nvme nvme13: creating 32 I/O queues.
[ 588.780099] nvme nvme13: new ctrl: NQN "subsys13", addr 10.11.0.1:4420
[ 588.799974] nvme nvme14: creating 32 I/O queues.
[ 589.609155] nvme nvme14: new ctrl: NQN "subsys14", addr 10.10.0.1:4420
[ 589.630566] nvme nvme15: creating 32 I/O queues.
[ 590.511926] nvme nvme15: new ctrl: NQN "subsys15", addr 10.11.0.1:4420
[ 8628.697722] perf: interrupt took too long (2533 > 2500), lowering kernel.perf_event_max_sample_rate to 78750
[12415.085099] blk_update_request: I/O error, dev nvme9n1, sector 567420032
[12415.087844] blk_update_request: I/O error, dev nvme9n1, sector 567419520
[12415.090592] blk_update_request: I/O error, dev nvme9n1, sector 567419776
[12415.090596] blk_update_request: I/O error, dev nvme9n1, sector 567420160
[12415.090600] blk_update_request: I/O error, dev nvme9n1, sector 567420288
[12415.090604] blk_update_request: I/O error, dev nvme9n1, sector 567420416
[12415.153188] nvme nvme9: reconnecting in 10 seconds
[12425.378237] nvme nvme9: creating 32 I/O queues.
[12425.490543] nvme nvme9: Successfully reconnected
[12727.017381] blk_update_request: I/O error, dev nvme9n1, sector 709031680
[12727.066342] blk_update_request: I/O error, dev nvme9n1, sector 709033984
[12727.113251] blk_update_request: I/O error, dev nvme9n1, sector 709034112
[12727.113255] blk_update_request: I/O error, dev nvme9n1, sector 709032960
[12727.113260] blk_update_request: I/O error, dev nvme9n1, sector 709031936
[12727.113263] blk_update_request: I/O error, dev nvme9n1, sector 709032064
[12727.113267] blk_update_request: I/O error, dev nvme9n1, sector 709031808
[12727.113271] blk_update_request: I/O error, dev nvme9n1, sector 709031168
[12727.113276] blk_update_request: I/O error, dev nvme9n1, sector 709032576
[12727.113279] blk_update_request: I/O error, dev nvme9n1, sector 709030784
[12727.757507] nvme nvme9: reconnecting in 10 seconds
[12737.974185] nvme nvme9: creating 32 I/O queues.
[12738.085555] nvme nvme9: Successfully reconnected
[12799.055878] blk_update_request: 21 callbacks suppressed
[12799.055881] blk_update_request: I/O error, dev nvme11n1, sector 18304
[12799.107761] blk_update_request: I/O error, dev nvme11n1, sector 20352
[12799.119870] blk_update_request: I/O error, dev nvme9n1, sector 4096
[12799.119876] blk_update_request: I/O error, dev nvme9n1, sector 12032
[12799.119885] blk_update_request: I/O error, dev nvme9n1, sector 3968
[12799.119888] blk_update_request: I/O error, dev nvme9n1, sector 18688
[12799.119891] blk_update_request: I/O error, dev nvme9n1, sector 18816
[12799.119894] blk_update_request: I/O error, dev nvme9n1, sector 19456
[12799.119898] blk_update_request: I/O error, dev nvme9n1, sector 19584
[12799.119904] blk_update_request: I/O error, dev nvme9n1, sector 19712
[12799.603981] nvme nvme11: reconnecting in 10 seconds
[12799.759947] nvme nvme9: reconnecting in 10 seconds
[12809.935924] nvme nvme11: creating 32 I/O queues.
[12810.052354] nvme nvme11: Successfully reconnected
[12810.174771] nvme nvme9: creating 32 I/O queues.
[12810.290674] nvme nvme9: Successfully reconnected
[-- Attachment #3: target-dmesg.txt --]
[-- Type: text/plain, Size: 169835 bytes --]
[ 0.000000] Linux version 4.11.0-rc6patch-2-get-fence (r1@rrpatch) (gcc version 6.2.0 20161005 (Ubuntu 6.2.0-5ubuntu12) ) #1 SMP Tue Apr 11 08:56:12 PDT 2017
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.11.0-rc6patch-2-get-fence root=UUID=55c1c371-fc16-4703-9808-e5e2c2ba309a ro
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009b3ff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009b400-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000079fc4fff] usable
[ 0.000000] BIOS-e820: [mem 0x0000000079fc5000-0x000000007ac50fff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000007ac51000-0x000000007b680fff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x000000007b681000-0x000000007b7cefff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x000000007b7cf000-0x000000007b7fffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007b800000-0x000000008fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000ff400000-0x00000000ffffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000107fffffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.7 present.
[ 0.000000] DMI: Intel Corporation S2600WT2/S2600WT2, BIOS SE5C610.86B.11.01.0132.060620160917 06/06/2016
[ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[ 0.000000] e820: last_pfn = 0x1080000 max_arch_pfn = 0x400000000
[ 0.000000] MTRR default type: write-back
[ 0.000000] MTRR fixed ranges enabled:
[ 0.000000] 00000-9FFFF write-back
[ 0.000000] A0000-BFFFF uncachable
[ 0.000000] C0000-FFFFF write-protect
[ 0.000000] MTRR variable ranges enabled:
[ 0.000000] 0 base 000080000000 mask 3FFF80000000 uncachable
[ 0.000000] 1 base 380000000000 mask 3F8000000000 uncachable
[ 0.000000] 2 disabled
[ 0.000000] 3 disabled
[ 0.000000] 4 disabled
[ 0.000000] 5 disabled
[ 0.000000] 6 disabled
[ 0.000000] 7 disabled
[ 0.000000] 8 disabled
[ 0.000000] 9 disabled
[ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WC UC- WT
[ 0.000000] e820: last_pfn = 0x7b800 max_arch_pfn = 0x400000000
[ 0.000000] found SMP MP-table at [mem 0x000fd850-0x000fd85f] mapped at [ffff88c3400fd850]
[ 0.000000] Scanning 1 areas for low memory corruption
[ 0.000000] Base memory trampoline at [ffff88c340095000] 95000 size 24576
[ 0.000000] Using GB pages for direct mapping
[ 0.000000] BRK [0x2f40b000, 0x2f40bfff] PGTABLE
[ 0.000000] BRK [0x2f40c000, 0x2f40cfff] PGTABLE
[ 0.000000] BRK [0x2f40d000, 0x2f40dfff] PGTABLE
[ 0.000000] BRK [0x2f40e000, 0x2f40efff] PGTABLE
[ 0.000000] BRK [0x2f40f000, 0x2f40ffff] PGTABLE
[ 0.000000] RAMDISK: [mem 0x33130000-0x3588ffff]
[ 0.000000] ACPI: Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 0x00000000000F0460 000024 (v02 INTEL )
[ 0.000000] ACPI: XSDT 0x000000007B7CD0E8 0000BC (v01 INTEL S2600WT 00000000 INTL 01000013)
[ 0.000000] ACPI: FACP 0x000000007B7CC000 0000F4 (v04 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: DSDT 0x000000007B791000 032D68 (v02 INTEL S2600WT 00000003 INTL 20091013)
[ 0.000000] ACPI: FACS 0x000000007B650000 000040
[ 0.000000] ACPI: HPET 0x000000007B7CB000 000038 (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: APIC 0x000000007B7CA000 000AFC (v03 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: MCFG 0x000000007B7C9000 00003C (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: MSCT 0x000000007B7C8000 000090 (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SLIT 0x000000007B7C7000 00006C (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SRAT 0x000000007B7C6000 000770 (v03 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SPMI 0x000000007B7C5000 000041 (v05 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: WDDT 0x000000007B7C4000 000040 (v01 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: NITR 0x000000007B6A6000 000071 (v02 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: PRAD 0x000000007B6A1000 000102 (v02 INTEL SpsPrAgg 00000002 INTL 20130328)
[ 0.000000] ACPI: UEFI 0x000000007B679000 000042 (v01 INTEL S2600WT 00000002 INTL 01000013)
[ 0.000000] ACPI: SSDT 0x000000007B6A7000 0E96B0 (v02 INTEL S2600WT 00004000 INTL 20130328)
[ 0.000000] ACPI: SSDT 0x000000007B6A3000 002679 (v02 INTEL S2600WT 00000002 INTL 20130328)
[ 0.000000] ACPI: SSDT 0x000000007B6A2000 000064 (v02 INTEL S2600WT 00000002 INTL 20130328)
[ 0.000000] ACPI: HEST 0x000000007B6A0000 0000A8 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: BERT 0x000000007B69F000 000030 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: ERST 0x000000007B69E000 000230 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: EINJ 0x000000007B69D000 000130 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x10 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x12 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x14 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x16 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x20 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x22 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x24 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x26 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x28 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x30 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x32 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x34 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x36 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x40 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x42 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x44 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x46 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x48 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x50 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x52 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x54 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x56 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x60 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x62 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x64 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x66 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x68 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x70 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x72 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x74 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x76 -> Node 1
[ 0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[ 0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x87fffffff]
[ 0.000000] ACPI: SRAT: Node 1 PXM 1 [mem 0x880000000-0x107fffffff]
[ 0.000000] NUMA: Initialized distance table, cnt=2
[ 0.000000] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x87fffffff] -> [mem 0x00000000-0x87fffffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff]
[ 0.000000] NODE_DATA(1) allocated [mem 0x107ffd2000-0x107fffcfff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]
[ 0.000000] Normal [mem 0x0000000100000000-0x000000107fffffff]
[ 0.000000] Device empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009afff]
[ 0.000000] node 0: [mem 0x0000000000100000-0x0000000079fc4fff]
[ 0.000000] node 0: [mem 0x000000007b7cf000-0x000000007b7fffff]
[ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff]
[ 0.000000] node 1: [mem 0x0000000880000000-0x000000107fffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff]
[ 0.000000] On node 0 totalpages: 8363920
[ 0.000000] DMA zone: 64 pages used for memmap
[ 0.000000] DMA zone: 21 pages reserved
[ 0.000000] DMA zone: 3994 pages, LIFO batch:0
[ 0.000000] DMA32 zone: 7744 pages used for memmap
[ 0.000000] DMA32 zone: 495606 pages, LIFO batch:31
[ 0.000000] Normal zone: 122880 pages used for memmap
[ 0.000000] Normal zone: 7864320 pages, LIFO batch:31
[ 0.000000] Initmem setup node 1 [mem 0x0000000880000000-0x000000107fffffff]
[ 0.000000] On node 1 totalpages: 8388608
[ 0.000000] Normal zone: 131072 pages used for memmap
[ 0.000000] Normal zone: 8388608 pages, LIFO batch:31
[ 0.000000] ACPI: PM-Timer IO Port: 0x408
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x08] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x09] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x10] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x11] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x12] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x13] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x14] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x15] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x16] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x17] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x18] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x19] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x20] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x21] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x22] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x23] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x24] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x25] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x26] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x27] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x28] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x29] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x30] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x31] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x32] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x33] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x34] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x35] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x36] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x37] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x38] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x39] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x40] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x41] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x42] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x43] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x44] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x45] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x46] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x47] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x48] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x49] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x50] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x51] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x52] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x53] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x54] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x55] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x56] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x57] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x58] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x59] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x60] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x61] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x62] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x63] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x64] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x65] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x66] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x67] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x68] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x69] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x70] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x71] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x72] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x73] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x74] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x75] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x76] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x77] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x78] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x79] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x80] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x81] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x82] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x83] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x84] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x85] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x86] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x87] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x88] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x89] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x90] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x91] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x92] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x93] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x94] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x95] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x96] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x97] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x98] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x99] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa0] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa1] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa2] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa3] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa4] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa5] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa6] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa7] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa8] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa9] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xaa] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xab] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xac] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xad] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xae] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xaf] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb0] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb1] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb2] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb3] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb4] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb5] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb6] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb7] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb8] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb9] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xba] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbb] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbc] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbd] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbe] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbf] high level lint[0x1])
[ 0.000000] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[ 0.000000] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47
[ 0.000000] IOAPIC[2]: apic_id 10, version 32, address 0xfec40000, GSI 48-71
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] ACPI: IRQ0 used by override.
[ 0.000000] ACPI: IRQ9 used by override.
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[ 0.000000] smpboot: Allowing 36 CPUs, 0 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009b000-0x0009bfff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009c000-0x0009ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x79fc5000-0x7ac50fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7ac51000-0x7b680fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b681000-0x7b7cefff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b800000-0x8fffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xff3fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xff400000-0xffffffff]
[ 0.000000] e820: [mem 0x90000000-0xfed1bfff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on bare hardware
[ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:36 nr_cpu_ids:36 nr_node_ids:2
[ 0.000000] percpu: Embedded 38 pages/cpu @ffff88cb9f800000 s115608 r8192 d31848 u262144
[ 0.000000] pcpu-alloc: s115608 r8192 d31848 u262144 alloc=1*2097152
[ 0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15
[ 0.000000] pcpu-alloc: [0] 16 17 -- -- -- -- -- -- [1] 18 19 20 21 22 23 24 25
[ 0.000000] pcpu-alloc: [1] 26 27 28 29 30 31 32 33 [1] 34 35 -- -- -- -- -- --
[ 0.000000] Built 2 zonelists in Node order, mobility grouping on. Total pages: 16490747
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.11.0-rc6patch-2-get-fence root=UUID=55c1c371-fc16-4703-9808-e5e2c2ba309a ro
[ 0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[ 0.000000] log_buf_len total cpu_extra contributions: 143360 bytes
[ 0.000000] log_buf_len min size: 262144 bytes
[ 0.000000] log_buf_len: 524288 bytes
[ 0.000000] early log buf free: 236212(90%)
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Calgary: detecting Calgary via BIOS EBDA area
[ 0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[ 0.000000] Memory: 65828184K/67010112K available (9075K kernel code, 1697K rwdata, 3884K rodata, 2212K init, 2232K bss, 1181928K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=36, Nodes=2
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] Build-time adjustment of leaf fanout to 64.
[ 0.000000] RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=36.
[ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=36
[ 0.000000] NR_IRQS:524544 nr_irqs:1528 16
[ 0.000000] Console: colour dummy device 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[ 0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[ 0.000000] hpet clockevent registered
[ 0.000000] tsc: Fast TSC calibration using PIT
[ 0.004000] tsc: Detected 2299.864 MHz processor
[ 0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4599.72 BogoMIPS (lpj=9199456)
[ 0.004000] pid_max: default: 36864 minimum: 301
[ 0.004000] ACPI: Core revision 20170119
[ 0.100789] ACPI: 4 ACPI AML tables successfully acquired and loaded
[ 0.100871] Security Framework initialized
[ 0.100875] Yama: becoming mindful.
[ 0.100923] AppArmor: AppArmor initialized
[ 0.103552] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[ 0.116444] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[ 0.122391] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.122447] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.123120] CPU: Physical Processor ID: 0
[ 0.123124] CPU: Processor Core ID: 0
[ 0.123131] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[ 0.123134] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[ 0.123140] mce: CPU supports 22 MCE banks
[ 0.123166] CPU0: Thermal monitoring enabled (TM1)
[ 0.123220] process: using mwait in idle threads
[ 0.123225] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024
[ 0.123228] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4
[ 0.123390] Freeing SMP alternatives memory: 32K
[ 0.128004] ftrace: allocating 34213 entries in 134 pages
[ 0.140109] smpboot: Max logical packages: 2
[ 0.140247] x2apic: IRQ remapping doesn't support X2APIC mode
[ 0.140322] Switched APIC routing to physical flat.
[ 0.144393] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.184088] TSC deadline timer enabled
[ 0.184094] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz (family: 0x6, model: 0x3f, stepping: 0x2)
[ 0.184194] mce: [Hardware Error]: CPU 0: Machine Check: 0 Bank 20: ea00000000100e0f
[ 0.184198] mce: [Hardware Error]: TSC 0 MISC 100000000000000
[ 0.184203] mce: [Hardware Error]: PROCESSOR 0:306f2 TIME 1491956989 SOCKET 0 APIC 0 microcode 37
[ 0.184268] Performance Events: PEBS fmt2+, Haswell events, 16-deep LBR, full-width counters, Intel PMU driver.
[ 0.184309] ... version: 3
[ 0.184312] ... bit width: 48
[ 0.184314] ... generic registers: 8
[ 0.184316] ... value mask: 0000ffffffffffff
[ 0.184319] ... max period: 00007fffffffffff
[ 0.184322] ... fixed-purpose events: 3
[ 0.184325] ... event mask: 00000007000000ff
[ 0.186737] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[ 0.186758] smp: Bringing up secondary CPUs ...
[ 0.186860] x86: Booting SMP configuration:
[ 0.186864] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 #11 #12 #13 #14 #15 #16 #17
[ 1.548188] .... node #1, CPUs: #18 #19 #20 #21 #22 #23 #24 #25 #26 #27 #28 #29 #30 #31 #32 #33 #34 #35
[ 2.992070] smp: Brought up 2 nodes, 36 CPUs
[ 2.992070] smpboot: Total of 36 processors activated (165639.86 BogoMIPS)
[ 2.996714] sched_clock: Marking stable (2996000000, 0)->(3158145126, -162145126)
[ 2.998715] devtmpfs: initialized
[ 2.998777] x86/mm: Memory block size: 2048MB
[ 3.000578] evm: security.selinux
[ 3.000581] evm: security.SMACK64
[ 3.000584] evm: security.SMACK64EXEC
[ 3.000586] evm: security.SMACK64TRANSMUTE
[ 3.000588] evm: security.SMACK64MMAP
[ 3.000591] evm: security.ima
[ 3.000593] evm: security.capability
[ 3.000682] PM: Registering ACPI NVS region [mem 0x7ac51000-0x7b680fff] (10682368 bytes)
[ 3.001096] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 3.001168] futex hash table entries: 16384 (order: 8, 1048576 bytes)
[ 3.001513] pinctrl core: initialized pinctrl subsystem
[ 3.001627] RTC time: 0:29:52, date: 04/12/17
[ 3.002830] NET: Registered protocol family 16
[ 3.003036] cpuidle: using governor ladder
[ 3.003043] cpuidle: using governor menu
[ 3.003047] PCCT header not found.
[ 3.003083] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[ 3.003088] ACPI: bus type PCI registered
[ 3.003091] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 3.003187] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[ 3.003201] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[ 3.003219] PCI: Using configuration type 1 for base access
[ 3.005256] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[ 3.005293] core: PMU erratum BJ122, BV98, HSD29 workaround disabled, HT off
[ 3.007338] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[ 3.007343] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 3.008049] ACPI: Added _OSI(Module Device)
[ 3.008053] ACPI: Added _OSI(Processor Device)
[ 3.008056] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 3.008059] ACPI: Added _OSI(Processor Aggregator Device)
[ 3.008232] ACPI: Executed 1 blocks of module-level executable AML code
[ 3.138572] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[ 3.312561] ACPI: Dynamic OEM Table Load:
[ 3.338428] ACPI: Interpreter enabled
[ 3.338443] ACPI: (supports S0 S5)
[ 3.338447] ACPI: Using IOAPIC for interrupt routing
[ 3.338495] HEST: Table parsing has been initialized.
[ 3.338500] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 3.373912] ACPI: PCI Root Bridge [UNC1] (domain 0000 [bus ff])
[ 3.373920] acpi PNP0A03:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 5.414770] acpi PNP0A03:02: _OSC: platform does not support [PCIeHotplug]
[ 7.463554] acpi PNP0A03:02: _OSC: OS now controls [PME AER PCIeCapability]
[ 7.463558] acpi PNP0A03:02: FADT indicates ASPM is unsupported, using BIOS configuration
[ 7.463620] PCI host bridge to bus 0000:ff
[ 7.463625] pci_bus 0000:ff: root bus resource [bus ff]
[ 7.463639] pci 0000:ff:08.0: [8086:2f80] type 00 class 0x088000
[ 7.463705] pci 0000:ff:08.2: [8086:2f32] type 00 class 0x110100
[ 7.463763] pci 0000:ff:08.3: [8086:2f83] type 00 class 0x088000
[ 7.463818] pci 0000:ff:09.0: [8086:2f90] type 00 class 0x088000
[ 7.463869] pci 0000:ff:09.2: [8086:2f33] type 00 class 0x110100
[ 7.463918] pci 0000:ff:09.3: [8086:2f93] type 00 class 0x088000
[ 7.463973] pci 0000:ff:0b.0: [8086:2f81] type 00 class 0x088000
[ 7.464019] pci 0000:ff:0b.1: [8086:2f36] type 00 class 0x110100
[ 7.464067] pci 0000:ff:0b.2: [8086:2f37] type 00 class 0x110100
[ 7.464116] pci 0000:ff:0c.0: [8086:2fe0] type 00 class 0x088000
[ 7.464169] pci 0000:ff:0c.1: [8086:2fe1] type 00 class 0x088000
[ 7.464216] pci 0000:ff:0c.2: [8086:2fe2] type 00 class 0x088000
[ 7.464261] pci 0000:ff:0c.3: [8086:2fe3] type 00 class 0x088000
[ 7.464309] pci 0000:ff:0c.4: [8086:2fe4] type 00 class 0x088000
[ 7.464354] pci 0000:ff:0c.5: [8086:2fe5] type 00 class 0x088000
[ 7.464400] pci 0000:ff:0c.6: [8086:2fe6] type 00 class 0x088000
[ 7.464447] pci 0000:ff:0c.7: [8086:2fe7] type 00 class 0x088000
[ 7.464494] pci 0000:ff:0d.0: [8086:2fe8] type 00 class 0x088000
[ 7.464538] pci 0000:ff:0d.1: [8086:2fe9] type 00 class 0x088000
[ 7.464585] pci 0000:ff:0d.2: [8086:2fea] type 00 class 0x088000
[ 7.464631] pci 0000:ff:0d.3: [8086:2feb] type 00 class 0x088000
[ 7.464679] pci 0000:ff:0d.4: [8086:2fec] type 00 class 0x088000
[ 7.464725] pci 0000:ff:0d.5: [8086:2fed] type 00 class 0x088000
[ 7.464775] pci 0000:ff:0d.6: [8086:2fee] type 00 class 0x088000
[ 7.464824] pci 0000:ff:0d.7: [8086:2fef] type 00 class 0x088000
[ 7.464874] pci 0000:ff:0e.0: [8086:2ff0] type 00 class 0x088000
[ 7.464922] pci 0000:ff:0e.1: [8086:2ff1] type 00 class 0x088000
[ 7.464976] pci 0000:ff:0f.0: [8086:2ff8] type 00 class 0x088000
[ 7.465022] pci 0000:ff:0f.1: [8086:2ff9] type 00 class 0x088000
[ 7.465076] pci 0000:ff:0f.2: [8086:2ffa] type 00 class 0x088000
[ 7.465124] pci 0000:ff:0f.3: [8086:2ffb] type 00 class 0x088000
[ 7.465174] pci 0000:ff:0f.4: [8086:2ffc] type 00 class 0x088000
[ 7.465226] pci 0000:ff:0f.5: [8086:2ffd] type 00 class 0x088000
[ 7.465275] pci 0000:ff:0f.6: [8086:2ffe] type 00 class 0x088000
[ 7.465327] pci 0000:ff:10.0: [8086:2f1d] type 00 class 0x088000
[ 7.465377] pci 0000:ff:10.1: [8086:2f34] type 00 class 0x110100
[ 7.465435] pci 0000:ff:10.5: [8086:2f1e] type 00 class 0x088000
[ 7.465483] pci 0000:ff:10.6: [8086:2f7d] type 00 class 0x110100
[ 7.465531] pci 0000:ff:10.7: [8086:2f1f] type 00 class 0x088000
[ 7.465580] pci 0000:ff:12.0: [8086:2fa0] type 00 class 0x088000
[ 7.465638] pci 0000:ff:12.1: [8086:2f30] type 00 class 0x110100
[ 7.465694] pci 0000:ff:12.4: [8086:2f60] type 00 class 0x088000
[ 7.465753] pci 0000:ff:12.5: [8086:2f38] type 00 class 0x110100
[ 7.465811] pci 0000:ff:13.0: [8086:2fa8] type 00 class 0x088000
[ 7.465870] pci 0000:ff:13.1: [8086:2f71] type 00 class 0x088000
[ 7.465927] pci 0000:ff:13.2: [8086:2faa] type 00 class 0x088000
[ 7.465985] pci 0000:ff:13.3: [8086:2fab] type 00 class 0x088000
[ 7.466043] pci 0000:ff:13.6: [8086:2fae] type 00 class 0x088000
[ 7.466100] pci 0000:ff:13.7: [8086:2faf] type 00 class 0x088000
[ 7.466153] pci 0000:ff:14.0: [8086:2fb0] type 00 class 0x088000
[ 7.466210] pci 0000:ff:14.1: [8086:2fb1] type 00 class 0x088000
[ 7.466267] pci 0000:ff:14.2: [8086:2fb2] type 00 class 0x088000
[ 7.466334] pci 0000:ff:14.3: [8086:2fb3] type 00 class 0x088000
[ 7.466392] pci 0000:ff:14.4: [8086:2fbc] type 00 class 0x088000
[ 7.466446] pci 0000:ff:14.5: [8086:2fbd] type 00 class 0x088000
[ 7.466500] pci 0000:ff:14.6: [8086:2fbe] type 00 class 0x088000
[ 7.466555] pci 0000:ff:14.7: [8086:2fbf] type 00 class 0x088000
[ 7.466612] pci 0000:ff:16.0: [8086:2f68] type 00 class 0x088000
[ 7.466671] pci 0000:ff:16.1: [8086:2f79] type 00 class 0x088000
[ 7.466730] pci 0000:ff:16.2: [8086:2f6a] type 00 class 0x088000
[ 7.466788] pci 0000:ff:16.3: [8086:2f6b] type 00 class 0x088000
[ 7.466849] pci 0000:ff:16.6: [8086:2f6e] type 00 class 0x088000
[ 7.466904] pci 0000:ff:16.7: [8086:2f6f] type 00 class 0x088000
[ 7.466958] pci 0000:ff:17.0: [8086:2fd0] type 00 class 0x088000
[ 7.467020] pci 0000:ff:17.1: [8086:2fd1] type 00 class 0x088000
[ 7.467079] pci 0000:ff:17.2: [8086:2fd2] type 00 class 0x088000
[ 7.467139] pci 0000:ff:17.3: [8086:2fd3] type 00 class 0x088000
[ 7.467198] pci 0000:ff:17.4: [8086:2fb8] type 00 class 0x088000
[ 7.467253] pci 0000:ff:17.5: [8086:2fb9] type 00 class 0x088000
[ 7.467307] pci 0000:ff:17.6: [8086:2fba] type 00 class 0x088000
[ 7.467368] pci 0000:ff:17.7: [8086:2fbb] type 00 class 0x088000
[ 7.467444] pci 0000:ff:1e.0: [8086:2f98] type 00 class 0x088000
[ 7.467499] pci 0000:ff:1e.1: [8086:2f99] type 00 class 0x088000
[ 7.467557] pci 0000:ff:1e.2: [8086:2f9a] type 00 class 0x088000
[ 7.467610] pci 0000:ff:1e.3: [8086:2fc0] type 00 class 0x088000
[ 7.467647] pci 0000:ff:1e.4: [8086:2f9c] type 00 class 0x088000
[ 7.467712] pci 0000:ff:1f.0: [8086:2f88] type 00 class 0x088000
[ 7.467769] pci 0000:ff:1f.2: [8086:2f8a] type 00 class 0x088000
[ 7.467922] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus 7f])
[ 7.467929] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 9.512335] acpi PNP0A03:03: _OSC: platform does not support [PCIeHotplug]
[ 11.561112] acpi PNP0A03:03: _OSC: OS now controls [PME AER PCIeCapability]
[ 11.561117] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration
[ 11.561171] PCI host bridge to bus 0000:7f
[ 11.561176] pci_bus 0000:7f: root bus resource [bus 7f]
[ 11.561187] pci 0000:7f:08.0: [8086:2f80] type 00 class 0x088000
[ 11.561244] pci 0000:7f:08.2: [8086:2f32] type 00 class 0x110100
[ 11.561299] pci 0000:7f:08.3: [8086:2f83] type 00 class 0x088000
[ 11.561355] pci 0000:7f:09.0: [8086:2f90] type 00 class 0x088000
[ 11.561410] pci 0000:7f:09.2: [8086:2f33] type 00 class 0x110100
[ 11.561462] pci 0000:7f:09.3: [8086:2f93] type 00 class 0x088000
[ 11.561516] pci 0000:7f:0b.0: [8086:2f81] type 00 class 0x088000
[ 11.561566] pci 0000:7f:0b.1: [8086:2f36] type 00 class 0x110100
[ 11.561612] pci 0000:7f:0b.2: [8086:2f37] type 00 class 0x110100
[ 11.561661] pci 0000:7f:0c.0: [8086:2fe0] type 00 class 0x088000
[ 11.561710] pci 0000:7f:0c.1: [8086:2fe1] type 00 class 0x088000
[ 11.561755] pci 0000:7f:0c.2: [8086:2fe2] type 00 class 0x088000
[ 11.561799] pci 0000:7f:0c.3: [8086:2fe3] type 00 class 0x088000
[ 11.561853] pci 0000:7f:0c.4: [8086:2fe4] type 00 class 0x088000
[ 11.561900] pci 0000:7f:0c.5: [8086:2fe5] type 00 class 0x088000
[ 11.561949] pci 0000:7f:0c.6: [8086:2fe6] type 00 class 0x088000
[ 11.561995] pci 0000:7f:0c.7: [8086:2fe7] type 00 class 0x088000
[ 11.562043] pci 0000:7f:0d.0: [8086:2fe8] type 00 class 0x088000
[ 11.562094] pci 0000:7f:0d.1: [8086:2fe9] type 00 class 0x088000
[ 11.562141] pci 0000:7f:0d.2: [8086:2fea] type 00 class 0x088000
[ 11.562187] pci 0000:7f:0d.3: [8086:2feb] type 00 class 0x088000
[ 11.562237] pci 0000:7f:0d.4: [8086:2fec] type 00 class 0x088000
[ 11.562284] pci 0000:7f:0d.5: [8086:2fed] type 00 class 0x088000
[ 11.562332] pci 0000:7f:0d.6: [8086:2fee] type 00 class 0x088000
[ 11.562380] pci 0000:7f:0d.7: [8086:2fef] type 00 class 0x088000
[ 11.562427] pci 0000:7f:0e.0: [8086:2ff0] type 00 class 0x088000
[ 11.562477] pci 0000:7f:0e.1: [8086:2ff1] type 00 class 0x088000
[ 11.562535] pci 0000:7f:0f.0: [8086:2ff8] type 00 class 0x088000
[ 11.562584] pci 0000:7f:0f.1: [8086:2ff9] type 00 class 0x088000
[ 11.562632] pci 0000:7f:0f.2: [8086:2ffa] type 00 class 0x088000
[ 11.562681] pci 0000:7f:0f.3: [8086:2ffb] type 00 class 0x088000
[ 11.562731] pci 0000:7f:0f.4: [8086:2ffc] type 00 class 0x088000
[ 11.562782] pci 0000:7f:0f.5: [8086:2ffd] type 00 class 0x088000
[ 11.562831] pci 0000:7f:0f.6: [8086:2ffe] type 00 class 0x088000
[ 11.562886] pci 0000:7f:10.0: [8086:2f1d] type 00 class 0x088000
[ 11.562941] pci 0000:7f:10.1: [8086:2f34] type 00 class 0x110100
[ 11.562993] pci 0000:7f:10.5: [8086:2f1e] type 00 class 0x088000
[ 11.563040] pci 0000:7f:10.6: [8086:2f7d] type 00 class 0x110100
[ 11.563088] pci 0000:7f:10.7: [8086:2f1f] type 00 class 0x088000
[ 11.563136] pci 0000:7f:12.0: [8086:2fa0] type 00 class 0x088000
[ 11.563189] pci 0000:7f:12.1: [8086:2f30] type 00 class 0x110100
[ 11.563243] pci 0000:7f:12.4: [8086:2f60] type 00 class 0x088000
[ 11.563300] pci 0000:7f:12.5: [8086:2f38] type 00 class 0x110100
[ 11.563357] pci 0000:7f:13.0: [8086:2fa8] type 00 class 0x088000
[ 11.563412] pci 0000:7f:13.1: [8086:2f71] type 00 class 0x088000
[ 11.563467] pci 0000:7f:13.2: [8086:2faa] type 00 class 0x088000
[ 11.563521] pci 0000:7f:13.3: [8086:2fab] type 00 class 0x088000
[ 11.563582] pci 0000:7f:13.6: [8086:2fae] type 00 class 0x088000
[ 11.563634] pci 0000:7f:13.7: [8086:2faf] type 00 class 0x088000
[ 11.563687] pci 0000:7f:14.0: [8086:2fb0] type 00 class 0x088000
[ 11.563745] pci 0000:7f:14.1: [8086:2fb1] type 00 class 0x088000
[ 11.563802] pci 0000:7f:14.2: [8086:2fb2] type 00 class 0x088000
[ 11.563857] pci 0000:7f:14.3: [8086:2fb3] type 00 class 0x088000
[ 11.563914] pci 0000:7f:14.4: [8086:2fbc] type 00 class 0x088000
[ 11.563966] pci 0000:7f:14.5: [8086:2fbd] type 00 class 0x088000
[ 11.564027] pci 0000:7f:14.6: [8086:2fbe] type 00 class 0x088000
[ 11.564080] pci 0000:7f:14.7: [8086:2fbf] type 00 class 0x088000
[ 11.564137] pci 0000:7f:16.0: [8086:2f68] type 00 class 0x088000
[ 11.564197] pci 0000:7f:16.1: [8086:2f79] type 00 class 0x088000
[ 11.564255] pci 0000:7f:16.2: [8086:2f6a] type 00 class 0x088000
[ 11.564313] pci 0000:7f:16.3: [8086:2f6b] type 00 class 0x088000
[ 11.564380] pci 0000:7f:16.6: [8086:2f6e] type 00 class 0x088000
[ 11.564434] pci 0000:7f:16.7: [8086:2f6f] type 00 class 0x088000
[ 11.564489] pci 0000:7f:17.0: [8086:2fd0] type 00 class 0x088000
[ 11.564546] pci 0000:7f:17.1: [8086:2fd1] type 00 class 0x088000
[ 11.564603] pci 0000:7f:17.2: [8086:2fd2] type 00 class 0x088000
[ 11.564662] pci 0000:7f:17.3: [8086:2fd3] type 00 class 0x088000
[ 11.564719] pci 0000:7f:17.4: [8086:2fb8] type 00 class 0x088000
[ 11.564772] pci 0000:7f:17.5: [8086:2fb9] type 00 class 0x088000
[ 11.564825] pci 0000:7f:17.6: [8086:2fba] type 00 class 0x088000
[ 11.564878] pci 0000:7f:17.7: [8086:2fbb] type 00 class 0x088000
[ 11.564948] pci 0000:7f:1e.0: [8086:2f98] type 00 class 0x088000
[ 11.564999] pci 0000:7f:1e.1: [8086:2f99] type 00 class 0x088000
[ 11.565051] pci 0000:7f:1e.2: [8086:2f9a] type 00 class 0x088000
[ 11.565112] pci 0000:7f:1e.3: [8086:2fc0] type 00 class 0x088000
[ 11.565150] pci 0000:7f:1e.4: [8086:2f9c] type 00 class 0x088000
[ 11.565215] pci 0000:7f:1f.0: [8086:2f88] type 00 class 0x088000
[ 11.565274] pci 0000:7f:1f.2: [8086:2f8a] type 00 class 0x088000
[ 11.575987] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[ 11.575996] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 11.578070] acpi PNP0A08:00: _OSC: platform does not support [AER]
[ 11.578966] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 11.578973] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[ 11.579319] PCI host bridge to bus 0000:00
[ 11.579324] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 11.579328] pci_bus 0000:00: root bus resource [io 0x1000-0x7fff window]
[ 11.579333] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 11.579340] pci_bus 0000:00: root bus resource [mem 0x90000000-0xc7ffbfff window]
[ 11.579345] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x383fffffffff window]
[ 11.579351] pci_bus 0000:00: root bus resource [bus 00-7e]
[ 11.579362] pci 0000:00:00.0: [8086:2f00] type 00 class 0x060000
[ 11.579511] pci 0000:00:01.0: [8086:2f02] type 01 class 0x060400
[ 11.579560] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[ 11.579637] pci 0000:00:01.0: System wakeup disabled by ACPI
[ 11.579683] pci 0000:00:02.0: [8086:2f04] type 01 class 0x060400
[ 11.579731] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[ 11.579806] pci 0000:00:02.0: System wakeup disabled by ACPI
[ 11.579846] pci 0000:00:02.2: [8086:2f06] type 01 class 0x060400
[ 11.579893] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[ 11.579969] pci 0000:00:02.2: System wakeup disabled by ACPI
[ 11.580013] pci 0000:00:03.0: [8086:2f08] type 01 class 0x060400
[ 11.580060] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[ 11.580136] pci 0000:00:03.0: System wakeup disabled by ACPI
[ 11.580180] pci 0000:00:04.0: [8086:2f20] type 00 class 0x088000
[ 11.580190] pci 0000:00:04.0: reg 0x10: [mem 0x383ffe12c000-0x383ffe12ffff 64bit]
[ 11.580332] pci 0000:00:04.1: [8086:2f21] type 00 class 0x088000
[ 11.580342] pci 0000:00:04.1: reg 0x10: [mem 0x383ffe128000-0x383ffe12bfff 64bit]
[ 11.580474] pci 0000:00:04.2: [8086:2f22] type 00 class 0x088000
[ 11.580484] pci 0000:00:04.2: reg 0x10: [mem 0x383ffe124000-0x383ffe127fff 64bit]
[ 11.580615] pci 0000:00:04.3: [8086:2f23] type 00 class 0x088000
[ 11.580625] pci 0000:00:04.3: reg 0x10: [mem 0x383ffe120000-0x383ffe123fff 64bit]
[ 11.580755] pci 0000:00:04.4: [8086:2f24] type 00 class 0x088000
[ 11.580764] pci 0000:00:04.4: reg 0x10: [mem 0x383ffe11c000-0x383ffe11ffff 64bit]
[ 11.580893] pci 0000:00:04.5: [8086:2f25] type 00 class 0x088000
[ 11.580903] pci 0000:00:04.5: reg 0x10: [mem 0x383ffe118000-0x383ffe11bfff 64bit]
[ 11.581033] pci 0000:00:04.6: [8086:2f26] type 00 class 0x088000
[ 11.581044] pci 0000:00:04.6: reg 0x10: [mem 0x383ffe114000-0x383ffe117fff 64bit]
[ 11.581185] pci 0000:00:04.7: [8086:2f27] type 00 class 0x088000
[ 11.581195] pci 0000:00:04.7: reg 0x10: [mem 0x383ffe110000-0x383ffe113fff 64bit]
[ 11.581323] pci 0000:00:05.0: [8086:2f28] type 00 class 0x088000
[ 11.581452] pci 0000:00:05.1: [8086:2f29] type 00 class 0x088000
[ 11.581595] pci 0000:00:05.2: [8086:2f2a] type 00 class 0x088000
[ 11.581717] pci 0000:00:05.4: [8086:2f2c] type 00 class 0x080020
[ 11.581724] pci 0000:00:05.4: reg 0x10: [mem 0x91a06000-0x91a06fff]
[ 11.581863] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000
[ 11.582055] pci 0000:00:11.1: [8086:8d7d] type 00 class 0x0c0500
[ 11.582071] pci 0000:00:11.1: reg 0x10: [mem 0x91a05000-0x91a05fff]
[ 11.582103] pci 0000:00:11.1: reg 0x20: [io 0x3060-0x307f]
[ 11.582263] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601
[ 11.582278] pci 0000:00:11.4: reg 0x10: [io 0x3098-0x309f]
[ 11.582286] pci 0000:00:11.4: reg 0x14: [io 0x30cc-0x30cf]
[ 11.582294] pci 0000:00:11.4: reg 0x18: [io 0x3090-0x3097]
[ 11.582302] pci 0000:00:11.4: reg 0x1c: [io 0x30c8-0x30cb]
[ 11.582310] pci 0000:00:11.4: reg 0x20: [io 0x3020-0x303f]
[ 11.582318] pci 0000:00:11.4: reg 0x24: [mem 0x91a00000-0x91a007ff]
[ 11.582360] pci 0000:00:11.4: PME# supported from D3hot
[ 11.582466] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330
[ 11.582482] pci 0000:00:14.0: reg 0x10: [mem 0x383ffe100000-0x383ffe10ffff 64bit]
[ 11.582536] pci 0000:00:14.0: PME# supported from D3hot D3cold
[ 11.582616] pci 0000:00:14.0: System wakeup disabled by ACPI
[ 11.582660] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000
[ 11.582677] pci 0000:00:16.0: reg 0x10: [mem 0x383ffe133000-0x383ffe13300f 64bit]
[ 11.582739] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[ 11.582846] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000
[ 11.582863] pci 0000:00:16.1: reg 0x10: [mem 0x383ffe132000-0x383ffe13200f 64bit]
[ 11.582925] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
[ 11.583037] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320
[ 11.583054] pci 0000:00:1a.0: reg 0x10: [mem 0x91a02000-0x91a023ff]
[ 11.583136] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[ 11.583216] pci 0000:00:1a.0: System wakeup disabled by ACPI
[ 11.583261] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400
[ 11.583327] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[ 11.583407] pci 0000:00:1c.0: System wakeup disabled by ACPI
[ 11.583452] pci 0000:00:1c.3: [8086:8d16] type 01 class 0x060400
[ 11.583518] pci 0000:00:1c.3: PME# supported from D0 D3hot D3cold
[ 11.583595] pci 0000:00:1c.3: System wakeup disabled by ACPI
[ 11.583642] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320
[ 11.583659] pci 0000:00:1d.0: reg 0x10: [mem 0x91a01000-0x91a013ff]
[ 11.583743] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[ 11.583825] pci 0000:00:1d.0: System wakeup disabled by ACPI
[ 11.583876] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100
[ 11.584076] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601
[ 11.584089] pci 0000:00:1f.2: reg 0x10: [io 0x30c0-0x30c7]
[ 11.584097] pci 0000:00:1f.2: reg 0x14: [io 0x30dc-0x30df]
[ 11.584105] pci 0000:00:1f.2: reg 0x18: [io 0x30b8-0x30bf]
[ 11.584112] pci 0000:00:1f.2: reg 0x1c: [io 0x30d8-0x30db]
[ 11.584119] pci 0000:00:1f.2: reg 0x20: [io 0x3040-0x305f]
[ 11.584126] pci 0000:00:1f.2: reg 0x24: [mem 0x91a04000-0x91a047ff]
[ 11.584162] pci 0000:00:1f.2: PME# supported from D3hot
[ 11.584269] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500
[ 11.584283] pci 0000:00:1f.3: reg 0x10: [mem 0x383ffe131000-0x383ffe1310ff 64bit]
[ 11.584302] pci 0000:00:1f.3: reg 0x20: [io 0x3000-0x301f]
[ 11.584581] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 11.584748] pci 0000:00:02.0: PCI bridge to [bus 02]
[ 11.584935] pci 0000:03:00.0: [8086:1521] type 00 class 0x020000
[ 11.584947] pci 0000:03:00.0: reg 0x10: [mem 0x91920000-0x9193ffff]
[ 11.584959] pci 0000:03:00.0: reg 0x18: [io 0x2020-0x203f]
[ 11.584967] pci 0000:03:00.0: reg 0x1c: [mem 0x91944000-0x91947fff]
[ 11.585042] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[ 11.585067] pci 0000:03:00.0: reg 0x184: [mem 0x383ffe060000-0x383ffe063fff 64bit pref]
[ 11.585070] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x383ffe060000-0x383ffe07ffff 64bit pref] (contains BAR0 for 8 VFs)
[ 11.585091] pci 0000:03:00.0: reg 0x190: [mem 0x383ffe040000-0x383ffe043fff 64bit pref]
[ 11.585092] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x383ffe040000-0x383ffe05ffff 64bit pref] (contains BAR3 for 8 VFs)
[ 11.585209] pci 0000:03:00.3: [8086:1521] type 00 class 0x020000
[ 11.585221] pci 0000:03:00.3: reg 0x10: [mem 0x91900000-0x9191ffff]
[ 11.585234] pci 0000:03:00.3: reg 0x18: [io 0x2000-0x201f]
[ 11.585241] pci 0000:03:00.3: reg 0x1c: [mem 0x91940000-0x91943fff]
[ 11.585331] pci 0000:03:00.3: PME# supported from D0 D3hot D3cold
[ 11.585353] pci 0000:03:00.3: reg 0x184: [mem 0x383ffe020000-0x383ffe023fff 64bit pref]
[ 11.585355] pci 0000:03:00.3: VF(n) BAR0 space: [mem 0x383ffe020000-0x383ffe03ffff 64bit pref] (contains BAR0 for 8 VFs)
[ 11.585374] pci 0000:03:00.3: reg 0x190: [mem 0x383ffe000000-0x383ffe003fff 64bit pref]
[ 11.585375] pci 0000:03:00.3: VF(n) BAR3 space: [mem 0x383ffe000000-0x383ffe01ffff 64bit pref] (contains BAR3 for 8 VFs)
[ 11.586010] pci 0000:00:02.2: PCI bridge to [bus 03-04]
[ 11.586015] pci 0000:00:02.2: bridge window [io 0x2000-0x2fff]
[ 11.586017] pci 0000:00:02.2: bridge window [mem 0x91900000-0x919fffff]
[ 11.586021] pci 0000:00:02.2: bridge window [mem 0x383ffe000000-0x383ffe0fffff 64bit pref]
[ 11.586349] pci 0000:05:00.0: [15b3:1017] type 00 class 0x020000
[ 11.586530] pci 0000:05:00.0: reg 0x10: [mem 0x383ffc000000-0x383ffdffffff 64bit pref]
[ 11.586943] pci 0000:05:00.0: reg 0x30: [mem 0xfff00000-0xffffffff pref]
[ 11.587751] pci 0000:05:00.0: PME# supported from D3cold
[ 11.588221] pci 0000:05:00.1: [15b3:1017] type 00 class 0x020000
[ 11.588400] pci 0000:05:00.1: reg 0x10: [mem 0x383ffa000000-0x383ffbffffff 64bit pref]
[ 11.588812] pci 0000:05:00.1: reg 0x30: [mem 0xfff00000-0xffffffff pref]
[ 11.589573] pci 0000:05:00.1: PME# supported from D3cold
[ 11.589974] pci 0000:00:03.0: PCI bridge to [bus 05]
[ 11.589982] pci 0000:00:03.0: bridge window [mem 0x383ffa000000-0x383ffdffffff 64bit pref]
[ 11.590024] pci 0000:00:1c.0: PCI bridge to [bus 06]
[ 11.590091] pci 0000:07:00.0: [102b:0522] type 00 class 0x030000
[ 11.590115] pci 0000:07:00.0: reg 0x10: [mem 0x90000000-0x90ffffff pref]
[ 11.590129] pci 0000:07:00.0: reg 0x14: [mem 0x91800000-0x91803fff]
[ 11.590144] pci 0000:07:00.0: reg 0x18: [mem 0x91000000-0x917fffff]
[ 11.590197] pci 0000:07:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.601134] pci 0000:00:1c.3: PCI bridge to [bus 07]
[ 11.601143] pci 0000:00:1c.3: bridge window [mem 0x91000000-0x918fffff]
[ 11.601148] pci 0000:00:1c.3: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 11.601175] pci_bus 0000:00: on NUMA node 0
[ 11.601543] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 *10 11 12 14 15)
[ 11.601594] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *9 10 11 12 14 15)
[ 11.601640] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 7 9 10 11 12 14 15)
[ 11.601685] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[ 11.601730] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[ 11.601777] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 11.601823] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 11.601870] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 11.602165] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[ 11.602172] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 11.602652] acpi PNP0A08:01: _OSC: platform does not support [AER]
[ 11.603476] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 11.603481] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[ 11.603684] PCI host bridge to bus 0000:80
[ 11.603689] pci_bus 0000:80: root bus resource [io 0x8000-0xffff window]
[ 11.603692] pci_bus 0000:80: root bus resource [mem 0xc8000000-0xfbffbfff window]
[ 11.603698] pci_bus 0000:80: root bus resource [mem 0x384000000000-0x387fffffffff window]
[ 11.603703] pci_bus 0000:80: root bus resource [bus 80-fe]
[ 11.603716] pci 0000:80:02.0: [8086:2f04] type 01 class 0x060400
[ 11.603771] pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
[ 11.603822] pci 0000:80:02.0: System wakeup disabled by ACPI
[ 11.603868] pci 0000:80:04.0: [8086:2f20] type 00 class 0x088000
[ 11.603879] pci 0000:80:04.0: reg 0x10: [mem 0x387ffff1c000-0x387ffff1ffff 64bit]
[ 11.603987] pci 0000:80:04.1: [8086:2f21] type 00 class 0x088000
[ 11.603997] pci 0000:80:04.1: reg 0x10: [mem 0x387ffff18000-0x387ffff1bfff 64bit]
[ 11.604100] pci 0000:80:04.2: [8086:2f22] type 00 class 0x088000
[ 11.604110] pci 0000:80:04.2: reg 0x10: [mem 0x387ffff14000-0x387ffff17fff 64bit]
[ 11.604213] pci 0000:80:04.3: [8086:2f23] type 00 class 0x088000
[ 11.604224] pci 0000:80:04.3: reg 0x10: [mem 0x387ffff10000-0x387ffff13fff 64bit]
[ 11.604326] pci 0000:80:04.4: [8086:2f24] type 00 class 0x088000
[ 11.604337] pci 0000:80:04.4: reg 0x10: [mem 0x387ffff0c000-0x387ffff0ffff 64bit]
[ 11.604447] pci 0000:80:04.5: [8086:2f25] type 00 class 0x088000
[ 11.604457] pci 0000:80:04.5: reg 0x10: [mem 0x387ffff08000-0x387ffff0bfff 64bit]
[ 11.604560] pci 0000:80:04.6: [8086:2f26] type 00 class 0x088000
[ 11.604570] pci 0000:80:04.6: reg 0x10: [mem 0x387ffff04000-0x387ffff07fff 64bit]
[ 11.604674] pci 0000:80:04.7: [8086:2f27] type 00 class 0x088000
[ 11.604684] pci 0000:80:04.7: reg 0x10: [mem 0x387ffff00000-0x387ffff03fff 64bit]
[ 11.604789] pci 0000:80:05.0: [8086:2f28] type 00 class 0x088000
[ 11.604885] pci 0000:80:05.1: [8086:2f29] type 00 class 0x088000
[ 11.604997] pci 0000:80:05.2: [8086:2f2a] type 00 class 0x088000
[ 11.605093] pci 0000:80:05.4: [8086:2f2c] type 00 class 0x080020
[ 11.605101] pci 0000:80:05.4: reg 0x10: [mem 0xc9000000-0xc9000fff]
[ 11.605547] pci 0000:81:00.0: [11f8:8536] type 01 class 0x060400
[ 11.606873] pci 0000:81:00.0: PME# supported from D0 D3hot D3cold
[ 11.607506] pci 0000:80:02.0: PCI bridge to [bus 81-92]
[ 11.607513] pci 0000:80:02.0: bridge window [mem 0xc8000000-0xc8ffffff]
[ 11.607894] pci 0000:82:00.0: [11f8:8536] type 01 class 0x060400
[ 11.610776] pci 0000:82:00.0: PME# supported from D0 D3hot D3cold
[ 11.611312] pci 0000:82:01.0: [11f8:8536] type 01 class 0x060400
[ 11.614203] pci 0000:82:01.0: PME# supported from D0 D3hot D3cold
[ 11.614739] pci 0000:82:02.0: [11f8:8536] type 01 class 0x060400
[ 11.617672] pci 0000:82:02.0: PME# supported from D0 D3hot D3cold
[ 11.618200] pci 0000:82:03.0: [11f8:8536] type 01 class 0x060400
[ 11.621115] pci 0000:82:03.0: PME# supported from D0 D3hot D3cold
[ 11.621639] pci 0000:82:04.0: [11f8:8536] type 01 class 0x060400
[ 11.624567] pci 0000:82:04.0: PME# supported from D0 D3hot D3cold
[ 11.625114] pci 0000:82:05.0: [11f8:8536] type 01 class 0x060400
[ 11.628055] pci 0000:82:05.0: PME# supported from D0 D3hot D3cold
[ 11.628582] pci 0000:82:06.0: [11f8:8536] type 01 class 0x060400
[ 11.631538] pci 0000:82:06.0: PME# supported from D0 D3hot D3cold
[ 11.632067] pci 0000:82:07.0: [11f8:8536] type 01 class 0x060400
[ 11.635057] pci 0000:82:07.0: PME# supported from D0 D3hot D3cold
[ 11.635586] pci 0000:82:08.0: [11f8:8536] type 01 class 0x060400
[ 11.638564] pci 0000:82:08.0: PME# supported from D0 D3hot D3cold
[ 11.639100] pci 0000:82:09.0: [11f8:8536] type 01 class 0x060400
[ 11.642091] pci 0000:82:09.0: PME# supported from D0 D3hot D3cold
[ 11.642622] pci 0000:82:0a.0: [11f8:8536] type 01 class 0x060400
[ 11.645648] pci 0000:82:0a.0: PME# supported from D0 D3hot D3cold
[ 11.646183] pci 0000:82:0b.0: [11f8:8536] type 01 class 0x060400
[ 11.649200] pci 0000:82:0b.0: PME# supported from D0 D3hot D3cold
[ 11.649740] pci 0000:82:0c.0: [11f8:8536] type 01 class 0x060400
[ 11.652768] pci 0000:82:0c.0: PME# supported from D0 D3hot D3cold
[ 11.653302] pci 0000:82:0d.0: [11f8:8536] type 01 class 0x060400
[ 11.656368] pci 0000:82:0d.0: PME# supported from D0 D3hot D3cold
[ 11.656905] pci 0000:82:0e.0: [11f8:8536] type 01 class 0x060400
[ 11.659957] pci 0000:82:0e.0: PME# supported from D0 D3hot D3cold
[ 11.660497] pci 0000:82:0f.0: [11f8:8536] type 01 class 0x060400
[ 11.663565] pci 0000:82:0f.0: PME# supported from D0 D3hot D3cold
[ 11.664197] pci 0000:81:00.0: PCI bridge to [bus 82-92]
[ 11.664268] pci 0000:81:00.0: bridge window [mem 0xc8000000-0xc8ffffff]
[ 11.664711] pci 0000:83:00.0: [8086:0953] type 00 class 0x010802
[ 11.664910] pci 0000:83:00.0: reg 0x10: [mem 0xc8f00000-0xc8f03fff 64bit]
[ 11.665315] pci 0000:83:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.666959] pci 0000:82:00.0: PCI bridge to [bus 83]
[ 11.667031] pci 0000:82:00.0: bridge window [mem 0xc8f00000-0xc8ffffff]
[ 11.667498] pci 0000:84:00.0: [8086:0953] type 00 class 0x010802
[ 11.667700] pci 0000:84:00.0: reg 0x10: [mem 0xc8e00000-0xc8e03fff 64bit]
[ 11.668087] pci 0000:84:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.669753] pci 0000:82:01.0: PCI bridge to [bus 84]
[ 11.669826] pci 0000:82:01.0: bridge window [mem 0xc8e00000-0xc8efffff]
[ 11.670289] pci 0000:85:00.0: [8086:0953] type 00 class 0x010802
[ 11.670494] pci 0000:85:00.0: reg 0x10: [mem 0xc8d00000-0xc8d03fff 64bit]
[ 11.670889] pci 0000:85:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.672599] pci 0000:82:02.0: PCI bridge to [bus 85]
[ 11.672672] pci 0000:82:02.0: bridge window [mem 0xc8d00000-0xc8dfffff]
[ 11.673142] pci 0000:86:00.0: [8086:0953] type 00 class 0x010802
[ 11.673350] pci 0000:86:00.0: reg 0x10: [mem 0xc8c00000-0xc8c03fff 64bit]
[ 11.673752] pci 0000:86:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.675595] pci 0000:82:03.0: PCI bridge to [bus 86]
[ 11.675669] pci 0000:82:03.0: bridge window [mem 0xc8c00000-0xc8cfffff]
[ 11.676145] pci 0000:87:00.0: [8086:0953] type 00 class 0x010802
[ 11.676357] pci 0000:87:00.0: reg 0x10: [mem 0xc8b00000-0xc8b03fff 64bit]
[ 11.676769] pci 0000:87:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.678513] pci 0000:82:04.0: PCI bridge to [bus 87]
[ 11.678586] pci 0000:82:04.0: bridge window [mem 0xc8b00000-0xc8bfffff]
[ 11.679062] pci 0000:88:00.0: [8086:0953] type 00 class 0x010802
[ 11.679277] pci 0000:88:00.0: reg 0x10: [mem 0xc8a00000-0xc8a03fff 64bit]
[ 11.679694] pci 0000:88:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.681462] pci 0000:82:05.0: PCI bridge to [bus 88]
[ 11.681535] pci 0000:82:05.0: bridge window [mem 0xc8a00000-0xc8afffff]
[ 11.682018] pci 0000:89:00.0: [8086:0953] type 00 class 0x010802
[ 11.682237] pci 0000:89:00.0: reg 0x10: [mem 0xc8900000-0xc8903fff 64bit]
[ 11.682661] pci 0000:89:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.684465] pci 0000:82:06.0: PCI bridge to [bus 89]
[ 11.684538] pci 0000:82:06.0: bridge window [mem 0xc8900000-0xc89fffff]
[ 11.685016] pci 0000:8a:00.0: [8086:0953] type 00 class 0x010802
[ 11.685347] pci 0000:8a:00.0: reg 0x10: [mem 0xc8800000-0xc8803fff 64bit]
[ 11.685778] pci 0000:8a:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.687611] pci 0000:82:07.0: PCI bridge to [bus 8a]
[ 11.687684] pci 0000:82:07.0: bridge window [mem 0xc8800000-0xc88fffff]
[ 11.688170] pci 0000:8b:00.0: [8086:0953] type 00 class 0x010802
[ 11.688396] pci 0000:8b:00.0: reg 0x10: [mem 0xc8700000-0xc8703fff 64bit]
[ 11.688834] pci 0000:8b:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.690674] pci 0000:82:08.0: PCI bridge to [bus 8b]
[ 11.690747] pci 0000:82:08.0: bridge window [mem 0xc8700000-0xc87fffff]
[ 11.691236] pci 0000:8c:00.0: [8086:0953] type 00 class 0x010802
[ 11.691465] pci 0000:8c:00.0: reg 0x10: [mem 0xc8600000-0xc8603fff 64bit]
[ 11.691911] pci 0000:8c:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.693777] pci 0000:82:09.0: PCI bridge to [bus 8c]
[ 11.693851] pci 0000:82:09.0: bridge window [mem 0xc8600000-0xc86fffff]
[ 11.694337] pci 0000:8d:00.0: [8086:0953] type 00 class 0x010802
[ 11.694569] pci 0000:8d:00.0: reg 0x10: [mem 0xc8500000-0xc8503fff 64bit]
[ 11.695023] pci 0000:8d:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.696924] pci 0000:82:0a.0: PCI bridge to [bus 8d]
[ 11.696999] pci 0000:82:0a.0: bridge window [mem 0xc8500000-0xc85fffff]
[ 11.697490] pci 0000:8e:00.0: [8086:0953] type 00 class 0x010802
[ 11.697726] pci 0000:8e:00.0: reg 0x10: [mem 0xc8400000-0xc8403fff 64bit]
[ 11.698186] pci 0000:8e:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.700106] pci 0000:82:0b.0: PCI bridge to [bus 8e]
[ 11.700180] pci 0000:82:0b.0: bridge window [mem 0xc8400000-0xc84fffff]
[ 11.700677] pci 0000:8f:00.0: [8086:0953] type 00 class 0x010802
[ 11.700916] pci 0000:8f:00.0: reg 0x10: [mem 0xc8300000-0xc8303fff 64bit]
[ 11.701383] pci 0000:8f:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.703327] pci 0000:82:0c.0: PCI bridge to [bus 8f]
[ 11.703405] pci 0000:82:0c.0: bridge window [mem 0xc8300000-0xc83fffff]
[ 11.703909] pci 0000:90:00.0: [8086:0953] type 00 class 0x010802
[ 11.704151] pci 0000:90:00.0: reg 0x10: [mem 0xc8200000-0xc8203fff 64bit]
[ 11.704626] pci 0000:90:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.706598] pci 0000:82:0d.0: PCI bridge to [bus 90]
[ 11.706674] pci 0000:82:0d.0: bridge window [mem 0xc8200000-0xc82fffff]
[ 11.707176] pci 0000:91:00.0: [8086:0953] type 00 class 0x010802
[ 11.707421] pci 0000:91:00.0: reg 0x10: [mem 0xc8100000-0xc8103fff 64bit]
[ 11.707904] pci 0000:91:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.709901] pci 0000:82:0e.0: PCI bridge to [bus 91]
[ 11.709975] pci 0000:82:0e.0: bridge window [mem 0xc8100000-0xc81fffff]
[ 11.710474] pci 0000:92:00.0: [8086:0953] type 00 class 0x010802
[ 11.710723] pci 0000:92:00.0: reg 0x10: [mem 0xc8000000-0xc8003fff 64bit]
[ 11.711213] pci 0000:92:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.713234] pci 0000:82:0f.0: PCI bridge to [bus 92]
[ 11.713308] pci 0000:82:0f.0: bridge window [mem 0xc8000000-0xc80fffff]
[ 11.714281] pci_bus 0000:80: on NUMA node 1
[ 11.714599] ACPI: Enabled 4 GPEs in block 00 to 3F
[ 11.714813] pci 0000:07:00.0: vgaarb: setting as boot VGA device
[ 11.714818] pci 0000:07:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[ 11.714829] pci 0000:07:00.0: vgaarb: bridge control possible
[ 11.714832] vgaarb: loaded
[ 11.715046] SCSI subsystem initialized
[ 11.715152] libata version 3.00 loaded.
[ 11.715168] ACPI: bus type USB registered
[ 11.715197] usbcore: registered new interface driver usbfs
[ 11.715206] usbcore: registered new interface driver hub
[ 11.715307] usbcore: registered new device driver usb
[ 11.715550] PCI: Using ACPI for IRQ routing
[ 11.719742] PCI: pci_cache_line_size set to 64 bytes
[ 11.720803] e820: reserve RAM buffer [mem 0x0009b400-0x0009ffff]
[ 11.720804] e820: reserve RAM buffer [mem 0x79fc5000-0x7bffffff]
[ 11.720806] e820: reserve RAM buffer [mem 0x7b800000-0x7bffffff]
[ 11.720916] NetLabel: Initializing
[ 11.720919] NetLabel: domain hash size = 128
[ 11.720922] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 11.720940] NetLabel: unlabeled traffic allowed by default
[ 11.721092] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[ 11.721099] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[ 11.723229] clocksource: Switched to clocksource hpet
[ 11.737299] VFS: Disk quotas dquot_6.6.0
[ 11.737340] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 11.737464] AppArmor: AppArmor Filesystem Enabled
[ 11.737501] pnp: PnP ACPI init
[ 11.738175] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[ 11.738335] system 00:01: [io 0x0500-0x053f] has been reserved
[ 11.738340] system 00:01: [io 0x0400-0x047f] has been reserved
[ 11.738343] system 00:01: [io 0x0540-0x057f] has been reserved
[ 11.738347] system 00:01: [io 0x0600-0x061f] has been reserved
[ 11.738350] system 00:01: [io 0x0ca0-0x0ca5] has been reserved
[ 11.738354] system 00:01: [io 0x0880-0x0883] has been reserved
[ 11.738357] system 00:01: [io 0x0800-0x081f] has been reserved
[ 11.738361] system 00:01: [mem 0xfed1c000-0xfed3ffff] could not be reserved
[ 11.738365] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved
[ 11.738369] system 00:01: [mem 0xff000000-0xffffffff] could not be reserved
[ 11.738372] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved
[ 11.738376] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved
[ 11.738379] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved
[ 11.738383] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved
[ 11.738388] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[ 11.738545] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active)
[ 11.738673] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[ 11.738911] pnp: PnP ACPI: found 4 devices
[ 11.745055] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 11.745069] pci 0000:05:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window
[ 11.745074] pci 0000:05:00.1: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window
[ 11.745080] pci 0000:07:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745086] pci 0000:83:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745091] pci 0000:84:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745096] pci 0000:85:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745101] pci 0000:86:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745106] pci 0000:87:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745112] pci 0000:88:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745117] pci 0000:89:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745122] pci 0000:8a:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745127] pci 0000:8b:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745131] pci 0000:8c:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745136] pci 0000:8d:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745141] pci 0000:8e:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745146] pci 0000:8f:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745151] pci 0000:90:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745156] pci 0000:91:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745161] pci 0000:92:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.745240] pci 0000:00:03.0: BAR 14: assigned [mem 0x91b00000-0x91cfffff]
[ 11.745244] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 11.745252] pci 0000:00:02.0: PCI bridge to [bus 02]
[ 11.745260] pci 0000:00:02.2: PCI bridge to [bus 03-04]
[ 11.745263] pci 0000:00:02.2: bridge window [io 0x2000-0x2fff]
[ 11.745268] pci 0000:00:02.2: bridge window [mem 0x91900000-0x919fffff]
[ 11.745273] pci 0000:00:02.2: bridge window [mem 0x383ffe000000-0x383ffe0fffff 64bit pref]
[ 11.745280] pci 0000:05:00.0: BAR 6: assigned [mem 0x91b00000-0x91bfffff pref]
[ 11.745285] pci 0000:05:00.1: BAR 6: assigned [mem 0x91c00000-0x91cfffff pref]
[ 11.745290] pci 0000:00:03.0: PCI bridge to [bus 05]
[ 11.745294] pci 0000:00:03.0: bridge window [mem 0x91b00000-0x91cfffff]
[ 11.745299] pci 0000:00:03.0: bridge window [mem 0x383ffa000000-0x383ffdffffff 64bit pref]
[ 11.745306] pci 0000:00:1c.0: PCI bridge to [bus 06]
[ 11.745317] pci 0000:07:00.0: BAR 6: assigned [mem 0x91810000-0x9181ffff pref]
[ 11.745322] pci 0000:00:1c.3: PCI bridge to [bus 07]
[ 11.745327] pci 0000:00:1c.3: bridge window [mem 0x91000000-0x918fffff]
[ 11.745332] pci 0000:00:1c.3: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 11.745341] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
[ 11.745342] pci_bus 0000:00: resource 5 [io 0x1000-0x7fff window]
[ 11.745343] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[ 11.745344] pci_bus 0000:00: resource 7 [mem 0x90000000-0xc7ffbfff window]
[ 11.745345] pci_bus 0000:00: resource 8 [mem 0x380000000000-0x383fffffffff window]
[ 11.745347] pci_bus 0000:03: resource 0 [io 0x2000-0x2fff]
[ 11.745348] pci_bus 0000:03: resource 1 [mem 0x91900000-0x919fffff]
[ 11.745349] pci_bus 0000:03: resource 2 [mem 0x383ffe000000-0x383ffe0fffff 64bit pref]
[ 11.745350] pci_bus 0000:05: resource 1 [mem 0x91b00000-0x91cfffff]
[ 11.745351] pci_bus 0000:05: resource 2 [mem 0x383ffa000000-0x383ffdffffff 64bit pref]
[ 11.745353] pci_bus 0000:07: resource 1 [mem 0x91000000-0x918fffff]
[ 11.745354] pci_bus 0000:07: resource 2 [mem 0x90000000-0x90ffffff 64bit pref]
[ 11.745678] pci 0000:82:00.0: bridge window [io 0x1000-0x0fff] to [bus 83] add_size 1000
[ 11.745682] pci 0000:82:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 83] add_size 200000 add_align 100000
[ 11.745892] pci 0000:82:01.0: bridge window [io 0x1000-0x0fff] to [bus 84] add_size 1000
[ 11.745894] pci 0000:82:01.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 84] add_size 200000 add_align 100000
[ 11.746104] pci 0000:82:02.0: bridge window [io 0x1000-0x0fff] to [bus 85] add_size 1000
[ 11.746106] pci 0000:82:02.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 85] add_size 200000 add_align 100000
[ 11.746317] pci 0000:82:03.0: bridge window [io 0x1000-0x0fff] to [bus 86] add_size 1000
[ 11.746319] pci 0000:82:03.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 86] add_size 200000 add_align 100000
[ 11.746531] pci 0000:82:04.0: bridge window [io 0x1000-0x0fff] to [bus 87] add_size 1000
[ 11.746533] pci 0000:82:04.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 87] add_size 200000 add_align 100000
[ 11.746748] pci 0000:82:05.0: bridge window [io 0x1000-0x0fff] to [bus 88] add_size 1000
[ 11.746749] pci 0000:82:05.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 88] add_size 200000 add_align 100000
[ 11.746964] pci 0000:82:06.0: bridge window [io 0x1000-0x0fff] to [bus 89] add_size 1000
[ 11.746965] pci 0000:82:06.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 89] add_size 200000 add_align 100000
[ 11.747182] pci 0000:82:07.0: bridge window [io 0x1000-0x0fff] to [bus 8a] add_size 1000
[ 11.747183] pci 0000:82:07.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 8a] add_size 200000 add_align 100000
[ 11.747406] pci 0000:82:08.0: bridge window [io 0x1000-0x0fff] to [bus 8b] add_size 1000
[ 11.747407] pci 0000:82:08.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 8b] add_size 200000 add_align 100000
[ 11.747626] pci 0000:82:09.0: bridge window [io 0x1000-0x0fff] to [bus 8c] add_size 1000
[ 11.747627] pci 0000:82:09.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 8c] add_size 200000 add_align 100000
[ 11.747847] pci 0000:82:0a.0: bridge window [io 0x1000-0x0fff] to [bus 8d] add_size 1000
[ 11.747849] pci 0000:82:0a.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 8d] add_size 200000 add_align 100000
[ 11.748070] pci 0000:82:0b.0: bridge window [io 0x1000-0x0fff] to [bus 8e] add_size 1000
[ 11.748071] pci 0000:82:0b.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 8e] add_size 200000 add_align 100000
[ 11.748294] pci 0000:82:0c.0: bridge window [io 0x1000-0x0fff] to [bus 8f] add_size 1000
[ 11.748296] pci 0000:82:0c.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 8f] add_size 200000 add_align 100000
[ 11.748521] pci 0000:82:0d.0: bridge window [io 0x1000-0x0fff] to [bus 90] add_size 1000
[ 11.748522] pci 0000:82:0d.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 90] add_size 200000 add_align 100000
[ 11.748756] pci 0000:82:0e.0: bridge window [io 0x1000-0x0fff] to [bus 91] add_size 1000
[ 11.748758] pci 0000:82:0e.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 91] add_size 200000 add_align 100000
[ 11.748986] pci 0000:82:0f.0: bridge window [io 0x1000-0x0fff] to [bus 92] add_size 1000
[ 11.748987] pci 0000:82:0f.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 92] add_size 200000 add_align 100000
[ 11.749196] pci 0000:81:00.0: bridge window [io 0x1000-0x0fff] to [bus 82-92] add_size 10000
[ 11.749201] pci 0000:81:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 82-92] add_size 2000000 add_align 100000
[ 11.749207] pci 0000:80:02.0: bridge window [io 0x1000-0x0fff] to [bus 81-92] add_size 10000
[ 11.749208] pci 0000:80:02.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 81-92] add_size 2000000 add_align 100000
[ 11.749214] pci 0000:80:02.0: BAR 15: assigned [mem 0x384000000000-0x384001ffffff 64bit pref]
[ 11.749220] pci 0000:80:02.0: BAR 13: no space for [io size 0x10000]
[ 11.749223] pci 0000:80:02.0: BAR 13: failed to assign [io size 0x10000]
[ 11.749227] pci 0000:80:02.0: BAR 13: no space for [io size 0x10000]
[ 11.749230] pci 0000:80:02.0: BAR 13: failed to assign [io size 0x10000]
[ 11.749235] pci 0000:81:00.0: BAR 15: assigned [mem 0x384000000000-0x384001ffffff 64bit pref]
[ 11.749240] pci 0000:81:00.0: BAR 13: no space for [io size 0x10000]
[ 11.749243] pci 0000:81:00.0: BAR 13: failed to assign [io size 0x10000]
[ 11.749246] pci 0000:81:00.0: BAR 13: no space for [io size 0x10000]
[ 11.749249] pci 0000:81:00.0: BAR 13: failed to assign [io size 0x10000]
[ 11.749265] pci 0000:82:00.0: BAR 15: assigned [mem 0x384000000000-0x3840001fffff 64bit pref]
[ 11.749270] pci 0000:82:01.0: BAR 15: assigned [mem 0x384000200000-0x3840003fffff 64bit pref]
[ 11.749275] pci 0000:82:02.0: BAR 15: assigned [mem 0x384000400000-0x3840005fffff 64bit pref]
[ 11.749280] pci 0000:82:03.0: BAR 15: assigned [mem 0x384000600000-0x3840007fffff 64bit pref]
[ 11.749285] pci 0000:82:04.0: BAR 15: assigned [mem 0x384000800000-0x3840009fffff 64bit pref]
[ 11.749290] pci 0000:82:05.0: BAR 15: assigned [mem 0x384000a00000-0x384000bfffff 64bit pref]
[ 11.749295] pci 0000:82:06.0: BAR 15: assigned [mem 0x384000c00000-0x384000dfffff 64bit pref]
[ 11.749300] pci 0000:82:07.0: BAR 15: assigned [mem 0x384000e00000-0x384000ffffff 64bit pref]
[ 11.749305] pci 0000:82:08.0: BAR 15: assigned [mem 0x384001000000-0x3840011fffff 64bit pref]
[ 11.749310] pci 0000:82:09.0: BAR 15: assigned [mem 0x384001200000-0x3840013fffff 64bit pref]
[ 11.749315] pci 0000:82:0a.0: BAR 15: assigned [mem 0x384001400000-0x3840015fffff 64bit pref]
[ 11.749320] pci 0000:82:0b.0: BAR 15: assigned [mem 0x384001600000-0x3840017fffff 64bit pref]
[ 11.749325] pci 0000:82:0c.0: BAR 15: assigned [mem 0x384001800000-0x3840019fffff 64bit pref]
[ 11.749330] pci 0000:82:0d.0: BAR 15: assigned [mem 0x384001a00000-0x384001bfffff 64bit pref]
[ 11.749335] pci 0000:82:0e.0: BAR 15: assigned [mem 0x384001c00000-0x384001dfffff 64bit pref]
[ 11.749340] pci 0000:82:0f.0: BAR 15: assigned [mem 0x384001e00000-0x384001ffffff 64bit pref]
[ 11.749345] pci 0000:82:00.0: BAR 13: no space for [io size 0x1000]
[ 11.749348] pci 0000:82:00.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749351] pci 0000:82:01.0: BAR 13: no space for [io size 0x1000]
[ 11.749355] pci 0000:82:01.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749358] pci 0000:82:02.0: BAR 13: no space for [io size 0x1000]
[ 11.749361] pci 0000:82:02.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749364] pci 0000:82:03.0: BAR 13: no space for [io size 0x1000]
[ 11.749368] pci 0000:82:03.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749371] pci 0000:82:04.0: BAR 13: no space for [io size 0x1000]
[ 11.749374] pci 0000:82:04.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749378] pci 0000:82:05.0: BAR 13: no space for [io size 0x1000]
[ 11.749381] pci 0000:82:05.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749384] pci 0000:82:06.0: BAR 13: no space for [io size 0x1000]
[ 11.749387] pci 0000:82:06.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749390] pci 0000:82:07.0: BAR 13: no space for [io size 0x1000]
[ 11.749394] pci 0000:82:07.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749397] pci 0000:82:08.0: BAR 13: no space for [io size 0x1000]
[ 11.749400] pci 0000:82:08.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749403] pci 0000:82:09.0: BAR 13: no space for [io size 0x1000]
[ 11.749406] pci 0000:82:09.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749410] pci 0000:82:0a.0: BAR 13: no space for [io size 0x1000]
[ 11.749413] pci 0000:82:0a.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749416] pci 0000:82:0b.0: BAR 13: no space for [io size 0x1000]
[ 11.749419] pci 0000:82:0b.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749422] pci 0000:82:0c.0: BAR 13: no space for [io size 0x1000]
[ 11.749426] pci 0000:82:0c.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749429] pci 0000:82:0d.0: BAR 13: no space for [io size 0x1000]
[ 11.749432] pci 0000:82:0d.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749435] pci 0000:82:0e.0: BAR 13: no space for [io size 0x1000]
[ 11.749438] pci 0000:82:0e.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749442] pci 0000:82:0f.0: BAR 13: no space for [io size 0x1000]
[ 11.749445] pci 0000:82:0f.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749453] pci 0000:82:0f.0: BAR 13: no space for [io size 0x1000]
[ 11.749456] pci 0000:82:0f.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749459] pci 0000:82:0e.0: BAR 13: no space for [io size 0x1000]
[ 11.749462] pci 0000:82:0e.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749466] pci 0000:82:0d.0: BAR 13: no space for [io size 0x1000]
[ 11.749469] pci 0000:82:0d.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749472] pci 0000:82:0c.0: BAR 13: no space for [io size 0x1000]
[ 11.749476] pci 0000:82:0c.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749479] pci 0000:82:0b.0: BAR 13: no space for [io size 0x1000]
[ 11.749483] pci 0000:82:0b.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749486] pci 0000:82:0a.0: BAR 13: no space for [io size 0x1000]
[ 11.749489] pci 0000:82:0a.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749492] pci 0000:82:09.0: BAR 13: no space for [io size 0x1000]
[ 11.749496] pci 0000:82:09.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749499] pci 0000:82:08.0: BAR 13: no space for [io size 0x1000]
[ 11.749502] pci 0000:82:08.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749505] pci 0000:82:07.0: BAR 13: no space for [io size 0x1000]
[ 11.749508] pci 0000:82:07.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749512] pci 0000:82:06.0: BAR 13: no space for [io size 0x1000]
[ 11.749515] pci 0000:82:06.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749518] pci 0000:82:05.0: BAR 13: no space for [io size 0x1000]
[ 11.749521] pci 0000:82:05.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749525] pci 0000:82:04.0: BAR 13: no space for [io size 0x1000]
[ 11.749528] pci 0000:82:04.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749531] pci 0000:82:03.0: BAR 13: no space for [io size 0x1000]
[ 11.749534] pci 0000:82:03.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749538] pci 0000:82:02.0: BAR 13: no space for [io size 0x1000]
[ 11.749541] pci 0000:82:02.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749544] pci 0000:82:01.0: BAR 13: no space for [io size 0x1000]
[ 11.749547] pci 0000:82:01.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749550] pci 0000:82:00.0: BAR 13: no space for [io size 0x1000]
[ 11.749553] pci 0000:82:00.0: BAR 13: failed to assign [io size 0x1000]
[ 11.749558] pci 0000:83:00.0: BAR 6: assigned [mem 0xc8f10000-0xc8f1ffff pref]
[ 11.749563] pci 0000:82:00.0: PCI bridge to [bus 83]
[ 11.749805] pci 0000:82:00.0: bridge window [mem 0xc8f00000-0xc8ffffff]
[ 11.749966] pci 0000:82:00.0: bridge window [mem 0x384000000000-0x3840001fffff 64bit pref]
[ 11.750226] pci 0000:84:00.0: BAR 6: assigned [mem 0xc8e10000-0xc8e1ffff pref]
[ 11.750231] pci 0000:82:01.0: PCI bridge to [bus 84]
[ 11.750473] pci 0000:82:01.0: bridge window [mem 0xc8e00000-0xc8efffff]
[ 11.750636] pci 0000:82:01.0: bridge window [mem 0x384000200000-0x3840003fffff 64bit pref]
[ 11.750897] pci 0000:85:00.0: BAR 6: assigned [mem 0xc8d10000-0xc8d1ffff pref]
[ 11.750902] pci 0000:82:02.0: PCI bridge to [bus 85]
[ 11.751146] pci 0000:82:02.0: bridge window [mem 0xc8d00000-0xc8dfffff]
[ 11.751313] pci 0000:82:02.0: bridge window [mem 0x384000400000-0x3840005fffff 64bit pref]
[ 11.751577] pci 0000:86:00.0: BAR 6: assigned [mem 0xc8c10000-0xc8c1ffff pref]
[ 11.751581] pci 0000:82:03.0: PCI bridge to [bus 86]
[ 11.751827] pci 0000:82:03.0: bridge window [mem 0xc8c00000-0xc8cfffff]
[ 11.751993] pci 0000:82:03.0: bridge window [mem 0x384000600000-0x3840007fffff 64bit pref]
[ 11.752258] pci 0000:87:00.0: BAR 6: assigned [mem 0xc8b10000-0xc8b1ffff pref]
[ 11.752262] pci 0000:82:04.0: PCI bridge to [bus 87]
[ 11.752510] pci 0000:82:04.0: bridge window [mem 0xc8b00000-0xc8bfffff]
[ 11.752676] pci 0000:82:04.0: bridge window [mem 0x384000800000-0x3840009fffff 64bit pref]
[ 11.752942] pci 0000:88:00.0: BAR 6: assigned [mem 0xc8a10000-0xc8a1ffff pref]
[ 11.752946] pci 0000:82:05.0: PCI bridge to [bus 88]
[ 11.753196] pci 0000:82:05.0: bridge window [mem 0xc8a00000-0xc8afffff]
[ 11.753362] pci 0000:82:05.0: bridge window [mem 0x384000a00000-0x384000bfffff 64bit pref]
[ 11.753632] pci 0000:89:00.0: BAR 6: assigned [mem 0xc8910000-0xc891ffff pref]
[ 11.753637] pci 0000:82:06.0: PCI bridge to [bus 89]
[ 11.753888] pci 0000:82:06.0: bridge window [mem 0xc8900000-0xc89fffff]
[ 11.754056] pci 0000:82:06.0: bridge window [mem 0x384000c00000-0x384000dfffff 64bit pref]
[ 11.754326] pci 0000:8a:00.0: BAR 6: assigned [mem 0xc8810000-0xc881ffff pref]
[ 11.754330] pci 0000:82:07.0: PCI bridge to [bus 8a]
[ 11.754583] pci 0000:82:07.0: bridge window [mem 0xc8800000-0xc88fffff]
[ 11.754752] pci 0000:82:07.0: bridge window [mem 0x384000e00000-0x384000ffffff 64bit pref]
[ 11.755024] pci 0000:8b:00.0: BAR 6: assigned [mem 0xc8710000-0xc871ffff pref]
[ 11.755028] pci 0000:82:08.0: PCI bridge to [bus 8b]
[ 11.755293] pci 0000:82:08.0: bridge window [mem 0xc8700000-0xc87fffff]
[ 11.755464] pci 0000:82:08.0: bridge window [mem 0x384001000000-0x3840011fffff 64bit pref]
[ 11.755737] pci 0000:8c:00.0: BAR 6: assigned [mem 0xc8610000-0xc861ffff pref]
[ 11.755742] pci 0000:82:09.0: PCI bridge to [bus 8c]
[ 11.755998] pci 0000:82:09.0: bridge window [mem 0xc8600000-0xc86fffff]
[ 11.756169] pci 0000:82:09.0: bridge window [mem 0x384001200000-0x3840013fffff 64bit pref]
[ 11.756445] pci 0000:8d:00.0: BAR 6: assigned [mem 0xc8510000-0xc851ffff pref]
[ 11.756449] pci 0000:82:0a.0: PCI bridge to [bus 8d]
[ 11.756708] pci 0000:82:0a.0: bridge window [mem 0xc8500000-0xc85fffff]
[ 11.756882] pci 0000:82:0a.0: bridge window [mem 0x384001400000-0x3840015fffff 64bit pref]
[ 11.757160] pci 0000:8e:00.0: BAR 6: assigned [mem 0xc8410000-0xc841ffff pref]
[ 11.757165] pci 0000:82:0b.0: PCI bridge to [bus 8e]
[ 11.757424] pci 0000:82:0b.0: bridge window [mem 0xc8400000-0xc84fffff]
[ 11.757598] pci 0000:82:0b.0: bridge window [mem 0x384001600000-0x3840017fffff 64bit pref]
[ 11.757876] pci 0000:8f:00.0: BAR 6: assigned [mem 0xc8310000-0xc831ffff pref]
[ 11.757881] pci 0000:82:0c.0: PCI bridge to [bus 8f]
[ 11.758142] pci 0000:82:0c.0: bridge window [mem 0xc8300000-0xc83fffff]
[ 11.758317] pci 0000:82:0c.0: bridge window [mem 0x384001800000-0x3840019fffff 64bit pref]
[ 11.758597] pci 0000:90:00.0: BAR 6: assigned [mem 0xc8210000-0xc821ffff pref]
[ 11.758602] pci 0000:82:0d.0: PCI bridge to [bus 90]
[ 11.758865] pci 0000:82:0d.0: bridge window [mem 0xc8200000-0xc82fffff]
[ 11.759041] pci 0000:82:0d.0: bridge window [mem 0x384001a00000-0x384001bfffff 64bit pref]
[ 11.759326] pci 0000:91:00.0: BAR 6: assigned [mem 0xc8110000-0xc811ffff pref]
[ 11.759330] pci 0000:82:0e.0: PCI bridge to [bus 91]
[ 11.759595] pci 0000:82:0e.0: bridge window [mem 0xc8100000-0xc81fffff]
[ 11.759772] pci 0000:82:0e.0: bridge window [mem 0x384001c00000-0x384001dfffff 64bit pref]
[ 11.760056] pci 0000:92:00.0: BAR 6: assigned [mem 0xc8010000-0xc801ffff pref]
[ 11.760060] pci 0000:82:0f.0: PCI bridge to [bus 92]
[ 11.760327] pci 0000:82:0f.0: bridge window [mem 0xc8000000-0xc80fffff]
[ 11.760505] pci 0000:82:0f.0: bridge window [mem 0x384001e00000-0x384001ffffff 64bit pref]
[ 11.760790] pci 0000:81:00.0: PCI bridge to [bus 82-92]
[ 11.761027] pci 0000:81:00.0: bridge window [mem 0xc8000000-0xc8ffffff]
[ 11.761187] pci 0000:81:00.0: bridge window [mem 0x384000000000-0x384001ffffff 64bit pref]
[ 11.761446] pci 0000:80:02.0: PCI bridge to [bus 81-92]
[ 11.761451] pci 0000:80:02.0: bridge window [mem 0xc8000000-0xc8ffffff]
[ 11.761455] pci 0000:80:02.0: bridge window [mem 0x384000000000-0x384001ffffff 64bit pref]
[ 11.761463] pci_bus 0000:80: resource 4 [io 0x8000-0xffff window]
[ 11.761464] pci_bus 0000:80: resource 5 [mem 0xc8000000-0xfbffbfff window]
[ 11.761465] pci_bus 0000:80: resource 6 [mem 0x384000000000-0x387fffffffff window]
[ 11.761466] pci_bus 0000:81: resource 1 [mem 0xc8000000-0xc8ffffff]
[ 11.761467] pci_bus 0000:81: resource 2 [mem 0x384000000000-0x384001ffffff 64bit pref]
[ 11.761468] pci_bus 0000:82: resource 1 [mem 0xc8000000-0xc8ffffff]
[ 11.761469] pci_bus 0000:82: resource 2 [mem 0x384000000000-0x384001ffffff 64bit pref]
[ 11.761470] pci_bus 0000:83: resource 1 [mem 0xc8f00000-0xc8ffffff]
[ 11.761471] pci_bus 0000:83: resource 2 [mem 0x384000000000-0x3840001fffff 64bit pref]
[ 11.761472] pci_bus 0000:84: resource 1 [mem 0xc8e00000-0xc8efffff]
[ 11.761473] pci_bus 0000:84: resource 2 [mem 0x384000200000-0x3840003fffff 64bit pref]
[ 11.761474] pci_bus 0000:85: resource 1 [mem 0xc8d00000-0xc8dfffff]
[ 11.761475] pci_bus 0000:85: resource 2 [mem 0x384000400000-0x3840005fffff 64bit pref]
[ 11.761476] pci_bus 0000:86: resource 1 [mem 0xc8c00000-0xc8cfffff]
[ 11.761477] pci_bus 0000:86: resource 2 [mem 0x384000600000-0x3840007fffff 64bit pref]
[ 11.761478] pci_bus 0000:87: resource 1 [mem 0xc8b00000-0xc8bfffff]
[ 11.761478] pci_bus 0000:87: resource 2 [mem 0x384000800000-0x3840009fffff 64bit pref]
[ 11.761479] pci_bus 0000:88: resource 1 [mem 0xc8a00000-0xc8afffff]
[ 11.761480] pci_bus 0000:88: resource 2 [mem 0x384000a00000-0x384000bfffff 64bit pref]
[ 11.761481] pci_bus 0000:89: resource 1 [mem 0xc8900000-0xc89fffff]
[ 11.761482] pci_bus 0000:89: resource 2 [mem 0x384000c00000-0x384000dfffff 64bit pref]
[ 11.761483] pci_bus 0000:8a: resource 1 [mem 0xc8800000-0xc88fffff]
[ 11.761484] pci_bus 0000:8a: resource 2 [mem 0x384000e00000-0x384000ffffff 64bit pref]
[ 11.761485] pci_bus 0000:8b: resource 1 [mem 0xc8700000-0xc87fffff]
[ 11.761486] pci_bus 0000:8b: resource 2 [mem 0x384001000000-0x3840011fffff 64bit pref]
[ 11.761487] pci_bus 0000:8c: resource 1 [mem 0xc8600000-0xc86fffff]
[ 11.761488] pci_bus 0000:8c: resource 2 [mem 0x384001200000-0x3840013fffff 64bit pref]
[ 11.761489] pci_bus 0000:8d: resource 1 [mem 0xc8500000-0xc85fffff]
[ 11.761490] pci_bus 0000:8d: resource 2 [mem 0x384001400000-0x3840015fffff 64bit pref]
[ 11.761491] pci_bus 0000:8e: resource 1 [mem 0xc8400000-0xc84fffff]
[ 11.761491] pci_bus 0000:8e: resource 2 [mem 0x384001600000-0x3840017fffff 64bit pref]
[ 11.761492] pci_bus 0000:8f: resource 1 [mem 0xc8300000-0xc83fffff]
[ 11.761493] pci_bus 0000:8f: resource 2 [mem 0x384001800000-0x3840019fffff 64bit pref]
[ 11.761494] pci_bus 0000:90: resource 1 [mem 0xc8200000-0xc82fffff]
[ 11.761495] pci_bus 0000:90: resource 2 [mem 0x384001a00000-0x384001bfffff 64bit pref]
[ 11.761496] pci_bus 0000:91: resource 1 [mem 0xc8100000-0xc81fffff]
[ 11.761497] pci_bus 0000:91: resource 2 [mem 0x384001c00000-0x384001dfffff 64bit pref]
[ 11.761498] pci_bus 0000:92: resource 1 [mem 0xc8000000-0xc80fffff]
[ 11.761499] pci_bus 0000:92: resource 2 [mem 0x384001e00000-0x384001ffffff 64bit pref]
[ 11.761640] NET: Registered protocol family 2
[ 11.762119] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[ 11.762859] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 11.763038] TCP: Hash tables configured (established 524288 bind 65536)
[ 11.763192] UDP hash table entries: 32768 (order: 8, 1048576 bytes)
[ 11.763419] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes)
[ 11.763791] NET: Registered protocol family 1
[ 11.823334] pci 0000:07:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[ 11.823782] PCI: CLS 32 bytes, default 64
[ 11.823830] Unpacking initramfs...
[ 12.483602] Freeing initrd memory: 40320K
[ 12.483634] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 12.483639] software IO TLB [mem 0x75fc5000-0x79fc5000] (64MB) mapped at [ffff88c3b5fc5000-ffff88c3b9fc4fff]
[ 12.483688] Intel CQM monitoring enabled
[ 12.486837] Scanning for low memory corruption every 60 seconds
[ 12.487746] audit: initializing netlink subsys (disabled)
[ 12.488714] Initialise system trusted keyrings
[ 12.488785] workingset: timestamp_bits=36 max_order=24 bucket_order=0
[ 12.490059] zbud: loaded
[ 12.490791] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 12.490997] fuse init (API version 7.26)
[ 12.493232] Key type asymmetric registered
[ 12.493236] Asymmetric key parser 'x509' registered
[ 12.493250] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[ 12.493339] io scheduler noop registered
[ 12.493342] io scheduler deadline registered
[ 12.493378] io scheduler cfq registered (default)
[ 12.512291] pcieport 0000:00:01.0: Signaling PME with IRQ 25
[ 12.512320] pcieport 0000:00:02.0: Signaling PME with IRQ 26
[ 12.512340] pcieport 0000:00:02.2: Signaling PME with IRQ 27
[ 12.512366] pcieport 0000:00:03.0: Signaling PME with IRQ 28
[ 12.512386] pcieport 0000:00:1c.0: Signaling PME with IRQ 29
[ 12.512409] pcieport 0000:00:1c.3: Signaling PME with IRQ 30
[ 12.512427] pcieport 0000:80:02.0: Signaling PME with IRQ 32
[ 12.512613] dpc 0000:82:00.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.512790] dpc 0000:82:01.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.512975] dpc 0000:82:02.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.513151] dpc 0000:82:03.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.513333] dpc 0000:82:04.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.513511] dpc 0000:82:05.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.513694] dpc 0000:82:06.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.513872] dpc 0000:82:07.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.514060] dpc 0000:82:08.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.514244] dpc 0000:82:09.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.514423] dpc 0000:82:0a.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.514602] dpc 0000:82:0b.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.514782] dpc 0000:82:0c.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.514961] dpc 0000:82:0d.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.515158] dpc 0000:82:0e.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.515352] dpc 0000:82:0f.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.515402] pciehp 0000:82:00.0:pcie204: Slot #1 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.515585] pciehp 0000:82:01.0:pcie204: Slot #2 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.515746] pciehp 0000:82:02.0:pcie204: Slot #3 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.515914] pciehp 0000:82:03.0:pcie204: Slot #4 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.516073] pciehp 0000:82:04.0:pcie204: Slot #5 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.516241] pciehp 0000:82:05.0:pcie204: Slot #6 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.516401] pciehp 0000:82:06.0:pcie204: Slot #7 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.516561] pciehp 0000:82:07.0:pcie204: Slot #8 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.516717] pciehp 0000:82:08.0:pcie204: Slot #9 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.516910] pciehp 0000:82:09.0:pcie204: Slot #10 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.517077] pciehp 0000:82:0a.0:pcie204: Slot #11 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.517236] pciehp 0000:82:0b.0:pcie204: Slot #12 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.517401] pciehp 0000:82:0c.0:pcie204: Slot #13 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.517560] pciehp 0000:82:0d.0:pcie204: Slot #14 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.517717] pciehp 0000:82:0e.0:pcie204: Slot #15 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.517876] pciehp 0000:82:0f.0:pcie204: Slot #16 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.518075] vesafb: mode is 640x480x32, linelength=2560, pages=0
[ 12.518079] vesafb: scrolling: redraw
[ 12.518082] vesafb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[ 12.518103] vesafb: framebuffer at 0x90000000, mapped to 0xffffa0db48200000, using 1216k, total 1216k
[ 12.604658] Console: switching to colour frame buffer device 80x30
[ 12.693538] fb0: VESA VGA frame buffer device
[ 12.695347] intel_idle: MWAIT substates: 0x2120
[ 12.695348] intel_idle: v0.4.1 model 0x3F
[ 12.696896] intel_idle: lapic_timer_reliable_states 0xffffffff
[ 12.697125] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 12.700184] ACPI: Power Button [PWRF]
[ 12.747003] ERST: Error Record Serialization Table (ERST) support is initialized.
[ 12.900997] pstore: using zlib compression
[ 12.976759] pstore: Registered erst as persistent store backend
[ 13.052558] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[ 13.200353] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 13.292535] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 13.453049] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[ 13.507414] tsc: Refined TSC clocksource calibration: 2299.986 MHz
[ 13.507442] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x212727fc292, max_idle_ns: 440795258401 ns
[ 13.799618] Linux agpgart interface v0.103
[ 13.876507] loop: module loaded
[ 13.944001] libphy: Fixed MDIO Bus: probed
[ 14.010444] tun: Universal TUN/TAP device driver, 1.6
[ 14.076279] PPP generic driver version 2.4.2
[ 14.138390] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 14.201170] ehci-pci: EHCI PCI platform driver
[ 14.263692] ehci-pci 0000:00:1a.0: EHCI Host Controller
[ 14.326291] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[ 14.448938] ehci-pci 0000:00:1a.0: debug port 2
[ 14.513705] ehci-pci 0000:00:1a.0: cache line size of 32 is not supported
[ 14.513717] ehci-pci 0000:00:1a.0: irq 18, io mem 0x91a02000
[ 14.574190] clocksource: Switched to clocksource tsc
[ 14.587424] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[ 14.587460] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[ 14.587461] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.587462] usb usb1: Product: EHCI Host Controller
[ 14.587463] usb usb1: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence ehci_hcd
[ 14.587464] usb usb1: SerialNumber: 0000:00:1a.0
[ 14.587581] hub 1-0:1.0: USB hub found
[ 14.587585] hub 1-0:1.0: 2 ports detected
[ 14.587869] ehci-pci 0000:00:1d.0: EHCI Host Controller
[ 14.587873] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[ 14.587919] ehci-pci 0000:00:1d.0: debug port 2
[ 14.591893] ehci-pci 0000:00:1d.0: cache line size of 32 is not supported
[ 14.591898] ehci-pci 0000:00:1d.0: irq 18, io mem 0x91a01000
[ 14.607423] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[ 14.607460] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[ 14.607462] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.607463] usb usb2: Product: EHCI Host Controller
[ 14.607464] usb usb2: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence ehci_hcd
[ 14.607465] usb usb2: SerialNumber: 0000:00:1d.0
[ 14.607575] hub 2-0:1.0: USB hub found
[ 14.607579] hub 2-0:1.0: 2 ports detected
[ 14.607706] ehci-platform: EHCI generic platform driver
[ 14.607717] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 14.607719] ohci-pci: OHCI PCI platform driver
[ 14.607740] ohci-platform: OHCI generic platform driver
[ 14.607746] uhci_hcd: USB Universal Host Controller Interface driver
[ 14.607937] xhci_hcd 0000:00:14.0: xHCI Host Controller
[ 14.607941] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3
[ 14.609318] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x00009810
[ 14.609334] xhci_hcd 0000:00:14.0: cache line size of 32 is not supported
[ 14.609441] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[ 14.609442] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.609443] usb usb3: Product: xHCI Host Controller
[ 14.609444] usb usb3: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence xhci-hcd
[ 14.609445] usb usb3: SerialNumber: 0000:00:14.0
[ 14.609571] hub 3-0:1.0: USB hub found
[ 14.609642] hub 3-0:1.0: 15 ports detected
[ 14.611860] xhci_hcd 0000:00:14.0: xHCI Host Controller
[ 14.611863] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4
[ 14.611908] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
[ 14.611909] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.611910] usb usb4: Product: xHCI Host Controller
[ 14.611911] usb usb4: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence xhci-hcd
[ 14.611912] usb usb4: SerialNumber: 0000:00:14.0
[ 14.612021] hub 4-0:1.0: USB hub found
[ 14.612053] hub 4-0:1.0: 6 ports detected
[ 14.613123] i8042: PNP: No PS/2 controller found.
[ 14.613199] mousedev: PS/2 mouse device common for all mice
[ 14.613312] rtc_cmos 00:00: RTC can wake from S4
[ 14.613803] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[ 14.613905] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[ 14.613909] i2c /dev entries driver
[ 14.613961] device-mapper: uevent: version 1.0.3
[ 14.614056] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com
[ 14.614063] intel_pstate: Intel P-state driver initializing
[ 14.919463] usb 1-1: new high-speed USB device number 2 using ehci-pci
[ 14.935463] usb 2-1: new high-speed USB device number 2 using ehci-pci
[ 14.939454] usb 3-1: new low-speed USB device number 2 using xhci_hcd
[ 15.068134] usb 1-1: New USB device found, idVendor=8087, idProduct=800a
[ 15.068137] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 15.068405] hub 1-1:1.0: USB hub found
[ 15.068581] hub 1-1:1.0: 6 ports detected
[ 15.083863] usb 2-1: New USB device found, idVendor=8087, idProduct=8002
[ 15.083865] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 15.084175] hub 2-1:1.0: USB hub found
[ 15.084430] hub 2-1:1.0: 8 ports detected
[ 15.086449] usb 3-1: New USB device found, idVendor=14dd, idProduct=1007
[ 15.086451] usb 3-1: New USB device strings: Mfr=1, Product=2, SerialNumber=7
[ 15.086453] usb 3-1: Product: D2CIM-DVUSB
[ 15.086456] usb 3-1: Manufacturer: Raritan
[ 15.086457] usb 3-1: SerialNumber: PQ254006500000007
[ 15.211477] usb 3-9: new full-speed USB device number 3 using xhci_hcd
[ 15.372616] usb 3-9: New USB device found, idVendor=046b, idProduct=ff10
[ 15.372619] usb 3-9: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 15.372621] usb 3-9: Product: Virtual Keyboard and Mouse
[ 15.372622] usb 3-9: Manufacturer: American Megatrends Inc.
[ 15.372624] usb 3-9: SerialNumber: serial
[ 19.582198] ledtrig-cpu: registered to indicate activity on CPUs
[ 19.634893] NET: Registered protocol family 10
[ 19.689243] Segment Routing with IPv6
[ 19.739872] NET: Registered protocol family 17
[ 19.790816] Key type dns_resolver registered
[ 19.844960] microcode: sig=0x306f2, pf=0x1, revision=0x37
[ 19.894353] microcode: Microcode Update Driver: v2.2.
[ 19.894457] registered taskstats version 1
[ 19.988208] Loading compiled-in X.509 certificates
[ 20.038333] Loaded X.509 cert 'Build time autogenerated kernel key: de39ac008d1fce01b49462a1060a30c176fa995c'
[ 20.136447] zswap: loaded using pool lzo/zbud
[ 20.194805] Key type big_key registered
[ 20.243024] Key type trusted registered
[ 20.292531] Key type encrypted registered
[ 20.339491] AppArmor: AppArmor sha1 policy hashing enabled
[ 20.387269] ima: No TPM chip found, activating TPM-bypass! (rc=-19)
[ 20.435453] evm: HMAC attrs: 0x1
[ 20.486342] Magic number: 13:809:455
[ 20.534295] rtc_cmos 00:00: setting system clock to 2017-04-12 00:30:10 UTC (1491957010)
[ 20.631974] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[ 20.683200] EDD information not available.
[ 20.734517] PM: Hibernation image not present or could not be loaded.
[ 20.736055] Freeing unused kernel memory: 2212K
[ 20.787243] Write protecting the kernel read-only data: 14336k
[ 20.839514] Freeing unused kernel memory: 1148K
[ 20.891496] Freeing unused kernel memory: 212K
[ 20.942604] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 21.107183] random: systemd-udevd: uninitialized urandom read (16 bytes read)
[ 21.107568] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.107592] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.111221] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.111261] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.111308] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.111339] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.111367] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.111396] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.111426] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.597137] wmi: Mapper loaded
[ 21.638478] hidraw: raw HID events driver (C) Jiri Kosina
[ 21.678821] pps_core: LinuxPPS API ver. 1 registered
[ 21.720010] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 21.806685] PTP clock support registered
[ 21.806795] nvme nvme0: pci function 0000:83:00.0
[ 21.806840] nvme nvme1: pci function 0000:84:00.0
[ 21.806891] nvme nvme2: pci function 0000:85:00.0
[ 21.806927] nvme nvme3: pci function 0000:86:00.0
[ 21.806970] nvme nvme4: pci function 0000:87:00.0
[ 21.807001] nvme nvme5: pci function 0000:88:00.0
[ 21.807034] nvme nvme6: pci function 0000:89:00.0
[ 21.807075] nvme nvme7: pci function 0000:8a:00.0
[ 21.807112] nvme nvme8: pci function 0000:8b:00.0
[ 21.807142] nvme nvme9: pci function 0000:8c:00.0
[ 21.807171] nvme nvme10: pci function 0000:8d:00.0
[ 21.807218] nvme nvme11: pci function 0000:8e:00.0
[ 21.807260] nvme nvme12: pci function 0000:8f:00.0
[ 21.807302] nvme nvme13: pci function 0000:90:00.0
[ 21.807334] nvme nvme14: pci function 0000:91:00.0
[ 21.807378] nvme nvme15: pci function 0000:92:00.0
[ 21.817119] usbcore: registered new interface driver usbhid
[ 21.817120] usbhid: USB HID core driver
[ 21.918419] random: fast init done
[ 21.927501] nvme7n1:
[ 22.424334] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.0/0003:14DD:1007.0001/input/input1
[ 22.483472] dca service started, version 1.12.1
[ 22.515415] AVX2 version of gcm_enc/dec engaged.
[ 22.515492] ahci 0000:00:11.4: version 3.0
[ 22.516042] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode
[ 22.516043] ahci 0000:00:11.4: flags: 64bit ncq led clo pio slum part ems apst
[ 22.543901] hid-generic 0003:14DD:1007.0001: input,hidraw0: USB HID v1.10 Keyboard [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input0
[ 22.544019] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.1/0003:14DD:1007.0002/input/input2
[ 22.544073] hid-generic 0003:14DD:1007.0002: input,hidraw1: USB HID v1.10 Mouse [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input1
[ 22.544651] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.2/0003:14DD:1007.0003/input/input3
[ 22.544786] hid-generic 0003:14DD:1007.0003: input,hidraw2: USB HID v1.10 Mouse [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input2
[ 22.544876] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb3/3-9/3-9:1.0/0003:046B:FF10.0004/input/input4
[ 22.544911] hid-generic 0003:046B:FF10.0004: input,hidraw3: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:14.0-9/input0
[ 22.544984] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb3/3-9/3-9:1.1/0003:046B:FF10.0005/input/input5
[ 22.545029] hid-generic 0003:046B:FF10.0005: input,hidraw4: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:14.0-9/input1
[ 22.560272] scsi host0: ahci
[ 22.560356] scsi host1: ahci
[ 22.560450] scsi host2: ahci
[ 22.560582] scsi host3: ahci
[ 22.560621] ata1: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00100 irq 549
[ 22.560627] ata2: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00180 irq 549
[ 22.560634] ata3: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00200 irq 549
[ 22.560641] ata4: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00280 irq 549
[ 22.561193] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[ 22.561195] ahci 0000:00:1f.2: flags: 64bit ncq led clo pio slum part ems apst
[ 22.624330] scsi host4: ahci
[ 22.624418] scsi host5: ahci
[ 22.624549] scsi host6: ahci
[ 22.624652] scsi host7: ahci
[ 22.624752] scsi host8: ahci
[ 22.624867] scsi host9: ahci
[ 22.624897] ata5: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04100 irq 550
[ 22.624904] ata6: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04180 irq 550
[ 22.624910] ata7: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04200 irq 550
[ 22.624917] ata8: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04280 irq 550
[ 22.624924] ata9: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04300 irq 550
[ 22.624930] ata10: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04380 irq 550
[ 22.874951] ata4: SATA link down (SStatus 0 SControl 300)
[ 22.875074] ata3: SATA link down (SStatus 0 SControl 300)
[ 22.878905] ata2: SATA link down (SStatus 0 SControl 300)
[ 22.879014] ata1: SATA link down (SStatus 0 SControl 300)
[ 22.939065] ata10: SATA link down (SStatus 0 SControl 300)
[ 22.939132] ata8: SATA link down (SStatus 0 SControl 300)
[ 22.939256] ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[ 22.939352] ata9: SATA link down (SStatus 0 SControl 300)
[ 22.939601] ata5.00: ATA-8: INTEL SSDSA2BW300G3, 4PC10302, max UDMA/133
[ 22.939602] ata5.00: 586072368 sectors, multi 1: LBA48 NCQ (depth 31/32)
[ 22.939974] ata5.00: configured for UDMA/133
[ 22.940196] scsi 4:0:0:0: Direct-Access ATA INTEL SSDSA2BW30 0302 PQ: 0 ANSI: 5
[ 22.943290] ata6: SATA link down (SStatus 0 SControl 300)
[ 22.943405] ata7: SATA link down (SStatus 0 SControl 300)
[ 23.242482] mlx5_core 0000:05:00.0: firmware version: 16.19.1000
[ 23.875947] (0000:05:00.0): E-Switch: Total vports 1, l2 table size(65536), per vport: max uc(1024) max mc(16384)
[ 23.892450] mlx5_core 0000:05:00.0: Port module event: module 0, Cable plugged
[ 23.915659] mlx5_core 0000:05:00.1: firmware version: 16.19.1000
[ 24.551975] (0000:05:00.1): E-Switch: Total vports 1, l2 table size(65536), per vport: max uc(1024) max mc(16384)
[ 24.568299] mlx5_core 0000:05:00.1: Port module event: module 1, Cable plugged
[ 24.591625] mlx5_core 0000:05:00.0: MLX5E: StrdRq(1) RqSz(8) StrdSz(64) RxCqeCmprss(0)
[ 25.062405] mlx5_core 0000:05:00.1: MLX5E: StrdRq(1) RqSz(8) StrdSz(64) RxCqeCmprss(0)
[ 25.140086] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[ 25.140086] igb: Copyright (c) 2007-2014 Intel Corporation.
[ 25.225918] igb 0000:03:00.0: added PHC on eth2
[ 25.225919] igb 0000:03:00.0: Intel(R) Gigabit Ethernet Network Connection
[ 25.225920] igb 0000:03:00.0: eth2: (PCIe:5.0Gb/s:Width x4) 00:1e:67:f1:25:08
[ 25.225994] igb 0000:03:00.0: eth2: PBA No: 100000-000
[ 25.225996] igb 0000:03:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[ 25.293980] igb 0000:03:00.3: added PHC on eth3
[ 25.293981] igb 0000:03:00.3: Intel(R) Gigabit Ethernet Network Connection
[ 25.293982] igb 0000:03:00.3: eth3: (PCIe:5.0Gb/s:Width x4) 00:1e:67:f1:25:09
[ 25.294056] igb 0000:03:00.3: eth3: PBA No: 100000-000
[ 25.294057] igb 0000:03:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[ 25.633467] igb 0000:03:00.0 eno1: renamed from eth2
[ 28.539963] AES CTR mode by8 optimization enabled
[ 28.649232] mlx5_core 0000:05:00.1 ens785f1: renamed from eth1
[ 28.780240] mlx5_core 0000:05:00.0 ens785f0: renamed from eth0
[ 28.848367] ata5.00: Enabling discard_zeroes_data
[ 28.848386] sd 4:0:0:0: Attached scsi generic sg0 type 0
[ 28.969518] sd 4:0:0:0: [sda] 586072368 512-byte logical blocks: (300 GB/279 GiB)
[ 28.972268] igb 0000:03:00.3 enp3s0f3: renamed from eth3
[ 29.147975] sd 4:0:0:0: [sda] Write Protect is off
[ 29.206280] sd 4:0:0:0: [sda] Mode Sense: 00 3a 00 00
[ 29.206288] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 29.320902] ata5.00: Enabling discard_zeroes_data
[ 29.377811] sda: sda1 sda2 < sda5 >
[ 29.432856] ata5.00: Enabling discard_zeroes_data
[ 29.487063] sd 4:0:0:0: [sda] Attached SCSI disk
[ 30.788245] raid6: sse2x1 gen() 9791 MB/s
[ 30.960251] raid6: sse2x1 xor() 8311 MB/s
[ 31.080291] raid6: sse2x2 gen() 13581 MB/s
[ 31.200304] raid6: sse2x2 xor() 9266 MB/s
[ 31.320312] raid6: sse2x4 gen() 16400 MB/s
[ 31.440322] raid6: sse2x4 xor() 11498 MB/s
[ 31.556319] raid6: avx2x1 gen() 21704 MB/s
[ 31.672332] raid6: avx2x1 xor() 16669 MB/s
[ 31.788328] raid6: avx2x2 gen() 25045 MB/s
[ 31.900331] raid6: avx2x2 xor() 17403 MB/s
[ 32.012342] raid6: avx2x4 gen() 28843 MB/s
[ 32.124347] raid6: avx2x4 xor() 19361 MB/s
[ 32.166926] raid6: using algorithm avx2x4 gen() 28843 MB/s
[ 32.209762] raid6: .... xor() 19361 MB/s, rmw enabled
[ 32.252380] raid6: using avx2x2 recovery algorithm
[ 32.295407] xor: automatically using best checksumming function avx
[ 32.339653] async_tx: api initialized (async)
[ 32.538305] Btrfs loaded, crc32c=crc32c-intel
[ 33.002453] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[ 33.370379] ip_tables: (C) 2000-2006 Netfilter Core Team
[ 33.453950] systemd[1]: systemd 231 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[ 33.607282] systemd[1]: Detected architecture x86-64.
[ 33.824450] systemd[1]: Set hostname to <nvmfjt01>.
[ 33.967893] systemd[1]: Created slice User and Session Slice.
[ 34.081670] systemd[1]: Listening on /dev/initctl Compatibility Named Pipe.
[ 34.198849] systemd[1]: Created slice System Slice.
[ 34.315819] systemd[1]: Listening on fsck to fsckd communication Socket.
[ 34.434325] systemd[1]: Listening on Syslog Socket.
[ 34.550876] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[ 34.732746] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[ 35.648927] mlx5_ib: Mellanox Connect-IB Infiniband driver v2.2-1 (Feb 2014)
[ 36.836300] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro
[ 37.338609] Loading iSCSI transport class v2.0-870.
[ 37.391282] iscsi: registered transport (tcp)
[ 37.394083] iscsi: registered transport (iser)
[ 37.667026] random: crng init done
[ 37.900049] ipmi message handler version 39.2
[ 37.902189] ipmi device interface
[ 37.905282] IPMI System Interface driver.
[ 37.905499] ipmi_si: probing via SMBIOS
[ 37.905500] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[ 37.905501] ipmi_si: Adding SMBIOS-specified kcs state machine
[ 37.905502] ipmi_si: probing via SPMI
[ 37.905503] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[ 37.905504] ipmi_si: SPMI-specified kcs state machine: duplicate
[ 37.905505] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[ 37.928995] power_meter ACPI000D:00: Found ACPI power meter.
[ 37.929126] power_meter ACPI000D:00: Ignoring unsafe software power cap!
[ 37.929272] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info().
[ 38.098632] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x006f, dev_id: 0x21)
[ 38.098749] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[ 38.282577] IPMI SSIF Interface driver
[ 38.733431] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 38.781621] ioatdma: Intel(R) QuickData Technology Driver 4.00
[ 38.834828] igb 0000:03:00.0: DCA enabled
[ 38.834851] igb 0000:03:00.3: DCA enabled
[ 38.996735] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[ 39.176380] RAPL PMU: API unit is 2^-32 Joules, 4 fixed counters, 655360 ms ovfl timer
[ 39.176381] RAPL PMU: hw unit of domain pp0-core 2^-14 Joules
[ 39.176381] RAPL PMU: hw unit of domain package 2^-14 Joules
[ 39.176382] RAPL PMU: hw unit of domain dram 2^-14 Joules
[ 39.176382] RAPL PMU: hw unit of domain pp1-gpu 2^-14 Joules
[ 39.627384] kvm: disabled by bios
[ 39.836052] EDAC MC: Ver: 3.0.0
[ 39.839603] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[ 39.839613] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[ 39.839623] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[ 39.839637] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[ 39.839639] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[ 39.839644] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[ 39.839648] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[ 39.839651] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[ 39.839655] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[ 39.839659] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[ 39.839662] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[ 39.839666] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[ 39.839670] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[ 39.839673] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[ 39.839678] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[ 39.839682] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[ 39.839685] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[ 39.839689] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[ 39.839693] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[ 39.839696] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[ 39.839700] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[ 39.839704] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[ 39.839707] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[ 39.839711] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[ 39.839715] EDAC sbridge: Seeking for: PCI ID 8086:2fac
[ 39.839724] EDAC sbridge: Seeking for: PCI ID 8086:2fad
[ 39.839732] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[ 39.839735] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[ 39.839739] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[ 39.839743] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[ 39.839746] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[ 39.839750] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[ 39.839754] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[ 39.839758] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[ 39.839762] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[ 39.839765] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[ 39.839769] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[ 39.839773] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[ 39.839776] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[ 39.839780] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[ 39.839784] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[ 39.839787] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[ 39.839791] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[ 39.839795] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[ 39.839799] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[ 39.839802] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[ 39.839806] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[ 39.839810] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[ 39.839813] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[ 39.839817] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[ 39.839821] EDAC sbridge: Seeking for: PCI ID 8086:2f6c
[ 39.839829] EDAC sbridge: Seeking for: PCI ID 8086:2f6d
[ 39.839998] EDAC MC0: Giving out device to module sbridge_edac.c controller Haswell Socket#0: DEV 0000:ff:12.0 (INTERRUPT)
[ 39.840132] EDAC MC1: Giving out device to module sbridge_edac.c controller Haswell Socket#1: DEV 0000:7f:12.0 (INTERRUPT)
[ 39.840132] EDAC sbridge: Ver: 1.1.1
[ 39.843260] intel_rapl: Found RAPL domain package
[ 39.843263] intel_rapl: Found RAPL domain dram
[ 39.843265] intel_rapl: DRAM domain energy unit 15300pj
[ 39.843932] intel_rapl: Found RAPL domain package
[ 39.843935] intel_rapl: Found RAPL domain dram
[ 39.843936] intel_rapl: DRAM domain energy unit 15300pj
[ 40.578473] systemd-journald[804]: Received request to flush runtime journal from PID 1
[ 41.097780] Adding 67008508k swap on /dev/sda5. Priority:-1 extents:1 across:67008508k SSFS
[ 42.220072] mlx5_core 0000:05:00.0 ens785f0: Link up
[ 42.509800] mlx5_core 0000:05:00.1 ens785f1: Link up
[ 42.646769] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready
[ 43.374031] new mount options do not match the existing superblock, will be ignored
[ 44.019885] systemd[1]: apt-daily.timer: Adding 8h 57min 39.253877s random time.
[ 44.051455] systemd[1]: apt-daily.timer: Adding 8h 3min 23.335029s random time.
[ 44.051544] systemd[1]: Started ACPI event daemon.
[ 46.154404] igb 0000:03:00.0 eno1: igb: eno1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
[ 46.154545] IPv6: ADDRCONF(NETDEV_CHANGE): eno1: link becomes ready
[ 49.648666] systemd[1]: apt-daily.timer: Adding 9h 22min 16.082452s random time.
[ 49.695236] systemd[1]: apt-daily.timer: Adding 8h 2min 44.323555s random time.
[ 332.948296] mce: [Hardware Error]: Machine check events logged
[ 555.950772] nvmet: adding nsid 1 to subsystem subsys0
[ 555.951131] nvmet: adding nsid 1 to subsystem subsys1
[ 555.951453] nvmet: adding nsid 1 to subsystem subsys2
[ 555.951752] nvmet: adding nsid 1 to subsystem subsys3
[ 555.952074] nvmet: adding nsid 1 to subsystem subsys4
[ 555.952436] nvmet: adding nsid 1 to subsystem subsys5
[ 555.952738] nvmet: adding nsid 1 to subsystem subsys6
[ 555.953030] nvmet: adding nsid 1 to subsystem subsys7
[ 555.953346] nvmet: adding nsid 1 to subsystem subsys8
[ 555.953632] nvmet: adding nsid 1 to subsystem subsys9
[ 555.953935] nvmet: adding nsid 1 to subsystem subsys10
[ 555.954225] nvmet: adding nsid 1 to subsystem subsys11
[ 555.954543] nvmet: adding nsid 1 to subsystem subsys12
[ 555.954829] nvmet: adding nsid 1 to subsystem subsys13
[ 555.955124] nvmet: adding nsid 1 to subsystem subsys14
[ 555.955409] nvmet: adding nsid 1 to subsystem subsys15
[ 555.956701] nvmet_rdma: enabling port 1 (10.10.0.1:4420)
[ 555.957142] nvmet_rdma: enabling port 2 (10.11.0.1:4420)
[ 575.663396] nvmet: creating controller 1 for subsystem subsys0 for NQN nvmfji01.
[ 576.481455] nvmet: adding queue 1 to ctrl 1.
[ 576.481710] nvmet: adding queue 2 to ctrl 1.
[ 576.481823] nvmet: adding queue 3 to ctrl 1.
[ 576.481967] nvmet: adding queue 4 to ctrl 1.
[ 576.482253] nvmet: adding queue 5 to ctrl 1.
[ 576.482403] nvmet: adding queue 6 to ctrl 1.
[ 576.482664] nvmet: adding queue 7 to ctrl 1.
[ 576.483059] nvmet: adding queue 8 to ctrl 1.
[ 576.483207] nvmet: adding queue 9 to ctrl 1.
[ 576.483446] nvmet: adding queue 10 to ctrl 1.
[ 576.483626] nvmet: adding queue 11 to ctrl 1.
[ 576.483895] nvmet: adding queue 12 to ctrl 1.
[ 576.484203] nvmet: adding queue 13 to ctrl 1.
[ 576.484443] nvmet: adding queue 14 to ctrl 1.
[ 576.484754] nvmet: adding queue 15 to ctrl 1.
[ 576.485040] nvmet: adding queue 16 to ctrl 1.
[ 576.485267] nvmet: adding queue 17 to ctrl 1.
[ 576.485532] nvmet: adding queue 18 to ctrl 1.
[ 576.485739] nvmet: adding queue 19 to ctrl 1.
[ 576.485917] nvmet: adding queue 20 to ctrl 1.
[ 576.486089] nvmet: adding queue 21 to ctrl 1.
[ 576.486264] nvmet: adding queue 22 to ctrl 1.
[ 576.486456] nvmet: adding queue 23 to ctrl 1.
[ 576.486662] nvmet: adding queue 24 to ctrl 1.
[ 576.486834] nvmet: adding queue 25 to ctrl 1.
[ 576.487007] nvmet: adding queue 26 to ctrl 1.
[ 576.487191] nvmet: adding queue 27 to ctrl 1.
[ 576.487375] nvmet: adding queue 28 to ctrl 1.
[ 576.487563] nvmet: adding queue 29 to ctrl 1.
[ 576.487749] nvmet: adding queue 30 to ctrl 1.
[ 576.487941] nvmet: adding queue 31 to ctrl 1.
[ 576.488131] nvmet: adding queue 32 to ctrl 1.
[ 576.509496] nvmet: creating controller 2 for subsystem subsys1 for NQN nvmfji01.
[ 577.317263] nvmet: adding queue 1 to ctrl 2.
[ 577.317403] nvmet: adding queue 2 to ctrl 2.
[ 577.317517] nvmet: adding queue 3 to ctrl 2.
[ 577.317632] nvmet: adding queue 4 to ctrl 2.
[ 577.317741] nvmet: adding queue 5 to ctrl 2.
[ 577.317857] nvmet: adding queue 6 to ctrl 2.
[ 577.318005] nvmet: adding queue 7 to ctrl 2.
[ 577.318151] nvmet: adding queue 8 to ctrl 2.
[ 577.318293] nvmet: adding queue 9 to ctrl 2.
[ 577.318439] nvmet: adding queue 10 to ctrl 2.
[ 577.318585] nvmet: adding queue 11 to ctrl 2.
[ 577.318738] nvmet: adding queue 12 to ctrl 2.
[ 577.318889] nvmet: adding queue 13 to ctrl 2.
[ 577.319043] nvmet: adding queue 14 to ctrl 2.
[ 577.319205] nvmet: adding queue 15 to ctrl 2.
[ 577.319325] nvmet: adding queue 16 to ctrl 2.
[ 577.319486] nvmet: adding queue 17 to ctrl 2.
[ 577.319651] nvmet: adding queue 18 to ctrl 2.
[ 577.319783] nvmet: adding queue 19 to ctrl 2.
[ 577.319964] nvmet: adding queue 20 to ctrl 2.
[ 577.320151] nvmet: adding queue 21 to ctrl 2.
[ 577.320331] nvmet: adding queue 22 to ctrl 2.
[ 577.320510] nvmet: adding queue 23 to ctrl 2.
[ 577.320691] nvmet: adding queue 24 to ctrl 2.
[ 577.320870] nvmet: adding queue 25 to ctrl 2.
[ 577.321054] nvmet: adding queue 26 to ctrl 2.
[ 577.321235] nvmet: adding queue 27 to ctrl 2.
[ 577.321414] nvmet: adding queue 28 to ctrl 2.
[ 577.321591] nvmet: adding queue 29 to ctrl 2.
[ 577.321781] nvmet: adding queue 30 to ctrl 2.
[ 577.321958] nvmet: adding queue 31 to ctrl 2.
[ 577.322142] nvmet: adding queue 32 to ctrl 2.
[ 577.343225] nvmet: creating controller 3 for subsystem subsys2 for NQN nvmfji01.
[ 578.159963] nvmet: adding queue 1 to ctrl 3.
[ 578.160138] nvmet: adding queue 2 to ctrl 3.
[ 578.160296] nvmet: adding queue 3 to ctrl 3.
[ 578.160482] nvmet: adding queue 4 to ctrl 3.
[ 578.160675] nvmet: adding queue 5 to ctrl 3.
[ 578.160806] nvmet: adding queue 6 to ctrl 3.
[ 578.160973] nvmet: adding queue 7 to ctrl 3.
[ 578.161140] nvmet: adding queue 8 to ctrl 3.
[ 578.161327] nvmet: adding queue 9 to ctrl 3.
[ 578.161436] nvmet: adding queue 10 to ctrl 3.
[ 578.161580] nvmet: adding queue 11 to ctrl 3.
[ 578.161741] nvmet: adding queue 12 to ctrl 3.
[ 578.161870] nvmet: adding queue 13 to ctrl 3.
[ 578.162008] nvmet: adding queue 14 to ctrl 3.
[ 578.162172] nvmet: adding queue 15 to ctrl 3.
[ 578.162308] nvmet: adding queue 16 to ctrl 3.
[ 578.162437] nvmet: adding queue 17 to ctrl 3.
[ 578.162640] nvmet: adding queue 18 to ctrl 3.
[ 578.162833] nvmet: adding queue 19 to ctrl 3.
[ 578.162963] nvmet: adding queue 20 to ctrl 3.
[ 578.163129] nvmet: adding queue 21 to ctrl 3.
[ 578.163256] nvmet: adding queue 22 to ctrl 3.
[ 578.163410] nvmet: adding queue 23 to ctrl 3.
[ 578.163583] nvmet: adding queue 24 to ctrl 3.
[ 578.163747] nvmet: adding queue 25 to ctrl 3.
[ 578.163910] nvmet: adding queue 26 to ctrl 3.
[ 578.164075] nvmet: adding queue 27 to ctrl 3.
[ 578.164244] nvmet: adding queue 28 to ctrl 3.
[ 578.164406] nvmet: adding queue 29 to ctrl 3.
[ 578.164566] nvmet: adding queue 30 to ctrl 3.
[ 578.164731] nvmet: adding queue 31 to ctrl 3.
[ 578.164900] nvmet: adding queue 32 to ctrl 3.
[ 578.183920] nvmet: creating controller 4 for subsystem subsys3 for NQN nvmfji01.
[ 578.994526] nvmet: adding queue 1 to ctrl 4.
[ 578.994696] nvmet: adding queue 2 to ctrl 4.
[ 578.994858] nvmet: adding queue 3 to ctrl 4.
[ 578.995036] nvmet: adding queue 4 to ctrl 4.
[ 578.995219] nvmet: adding queue 5 to ctrl 4.
[ 578.995380] nvmet: adding queue 6 to ctrl 4.
[ 578.995554] nvmet: adding queue 7 to ctrl 4.
[ 578.995679] nvmet: adding queue 8 to ctrl 4.
[ 578.995803] nvmet: adding queue 9 to ctrl 4.
[ 578.995911] nvmet: adding queue 10 to ctrl 4.
[ 578.996058] nvmet: adding queue 11 to ctrl 4.
[ 578.996233] nvmet: adding queue 12 to ctrl 4.
[ 578.996401] nvmet: adding queue 13 to ctrl 4.
[ 578.996543] nvmet: adding queue 14 to ctrl 4.
[ 578.996713] nvmet: adding queue 15 to ctrl 4.
[ 578.996851] nvmet: adding queue 16 to ctrl 4.
[ 578.996971] nvmet: adding queue 17 to ctrl 4.
[ 578.997168] nvmet: adding queue 18 to ctrl 4.
[ 578.997367] nvmet: adding queue 19 to ctrl 4.
[ 578.997522] nvmet: adding queue 20 to ctrl 4.
[ 578.997700] nvmet: adding queue 21 to ctrl 4.
[ 578.997861] nvmet: adding queue 22 to ctrl 4.
[ 578.997992] nvmet: adding queue 23 to ctrl 4.
[ 578.998122] nvmet: adding queue 24 to ctrl 4.
[ 578.998286] nvmet: adding queue 25 to ctrl 4.
[ 578.998440] nvmet: adding queue 26 to ctrl 4.
[ 578.998608] nvmet: adding queue 27 to ctrl 4.
[ 578.998777] nvmet: adding queue 28 to ctrl 4.
[ 578.998939] nvmet: adding queue 29 to ctrl 4.
[ 578.999071] nvmet: adding queue 30 to ctrl 4.
[ 578.999237] nvmet: adding queue 31 to ctrl 4.
[ 578.999404] nvmet: adding queue 32 to ctrl 4.
[ 579.018930] nvmet: creating controller 5 for subsystem subsys4 for NQN nvmfji01.
[ 579.833185] nvmet: adding queue 1 to ctrl 5.
[ 579.833313] nvmet: adding queue 2 to ctrl 5.
[ 579.833452] nvmet: adding queue 3 to ctrl 5.
[ 579.833623] nvmet: adding queue 4 to ctrl 5.
[ 579.833802] nvmet: adding queue 5 to ctrl 5.
[ 579.833973] nvmet: adding queue 6 to ctrl 5.
[ 579.834140] nvmet: adding queue 7 to ctrl 5.
[ 579.834316] nvmet: adding queue 8 to ctrl 5.
[ 579.834485] nvmet: adding queue 9 to ctrl 5.
[ 579.834632] nvmet: adding queue 10 to ctrl 5.
[ 579.834765] nvmet: adding queue 11 to ctrl 5.
[ 579.834934] nvmet: adding queue 12 to ctrl 5.
[ 579.835057] nvmet: adding queue 13 to ctrl 5.
[ 579.835174] nvmet: adding queue 14 to ctrl 5.
[ 579.835335] nvmet: adding queue 15 to ctrl 5.
[ 579.835439] nvmet: adding queue 16 to ctrl 5.
[ 579.835590] nvmet: adding queue 17 to ctrl 5.
[ 579.835788] nvmet: adding queue 18 to ctrl 5.
[ 579.835989] nvmet: adding queue 19 to ctrl 5.
[ 579.836190] nvmet: adding queue 20 to ctrl 5.
[ 579.836342] nvmet: adding queue 21 to ctrl 5.
[ 579.836508] nvmet: adding queue 22 to ctrl 5.
[ 579.836703] nvmet: adding queue 23 to ctrl 5.
[ 579.836871] nvmet: adding queue 24 to ctrl 5.
[ 579.837035] nvmet: adding queue 25 to ctrl 5.
[ 579.837174] nvmet: adding queue 26 to ctrl 5.
[ 579.837335] nvmet: adding queue 27 to ctrl 5.
[ 579.837454] nvmet: adding queue 28 to ctrl 5.
[ 579.837583] nvmet: adding queue 29 to ctrl 5.
[ 579.837755] nvmet: adding queue 30 to ctrl 5.
[ 579.837919] nvmet: adding queue 31 to ctrl 5.
[ 579.838085] nvmet: adding queue 32 to ctrl 5.
[ 579.860082] nvmet: creating controller 6 for subsystem subsys5 for NQN nvmfji01.
[ 580.724974] nvmet: adding queue 1 to ctrl 6.
[ 580.725130] nvmet: adding queue 2 to ctrl 6.
[ 580.725272] nvmet: adding queue 3 to ctrl 6.
[ 580.725440] nvmet: adding queue 4 to ctrl 6.
[ 580.725578] nvmet: adding queue 5 to ctrl 6.
[ 580.725705] nvmet: adding queue 6 to ctrl 6.
[ 580.725872] nvmet: adding queue 7 to ctrl 6.
[ 580.725998] nvmet: adding queue 8 to ctrl 6.
[ 580.726149] nvmet: adding queue 9 to ctrl 6.
[ 580.726286] nvmet: adding queue 10 to ctrl 6.
[ 580.726423] nvmet: adding queue 11 to ctrl 6.
[ 580.726593] nvmet: adding queue 12 to ctrl 6.
[ 580.726763] nvmet: adding queue 13 to ctrl 6.
[ 580.726893] nvmet: adding queue 14 to ctrl 6.
[ 580.727014] nvmet: adding queue 15 to ctrl 6.
[ 580.727131] nvmet: adding queue 16 to ctrl 6.
[ 580.727279] nvmet: adding queue 17 to ctrl 6.
[ 580.727481] nvmet: adding queue 18 to ctrl 6.
[ 580.727664] nvmet: adding queue 19 to ctrl 6.
[ 580.727806] nvmet: adding queue 20 to ctrl 6.
[ 580.727999] nvmet: adding queue 21 to ctrl 6.
[ 580.728190] nvmet: adding queue 22 to ctrl 6.
[ 580.728358] nvmet: adding queue 23 to ctrl 6.
[ 580.728518] nvmet: adding queue 24 to ctrl 6.
[ 580.728683] nvmet: adding queue 25 to ctrl 6.
[ 580.728806] nvmet: adding queue 26 to ctrl 6.
[ 580.728942] nvmet: adding queue 27 to ctrl 6.
[ 580.729105] nvmet: adding queue 28 to ctrl 6.
[ 580.729267] nvmet: adding queue 29 to ctrl 6.
[ 580.729362] nvmet: adding queue 30 to ctrl 6.
[ 580.729504] nvmet: adding queue 31 to ctrl 6.
[ 580.729637] nvmet: adding queue 32 to ctrl 6.
[ 580.750565] nvmet: creating controller 7 for subsystem subsys6 for NQN nvmfji01.
[ 581.553346] nvmet: adding queue 1 to ctrl 7.
[ 581.553530] nvmet: adding queue 2 to ctrl 7.
[ 581.553641] nvmet: adding queue 3 to ctrl 7.
[ 581.553815] nvmet: adding queue 4 to ctrl 7.
[ 581.553988] nvmet: adding queue 5 to ctrl 7.
[ 581.554159] nvmet: adding queue 6 to ctrl 7.
[ 581.554329] nvmet: adding queue 7 to ctrl 7.
[ 581.554466] nvmet: adding queue 8 to ctrl 7.
[ 581.554636] nvmet: adding queue 9 to ctrl 7.
[ 581.554750] nvmet: adding queue 10 to ctrl 7.
[ 581.554908] nvmet: adding queue 11 to ctrl 7.
[ 581.555085] nvmet: adding queue 12 to ctrl 7.
[ 581.555208] nvmet: adding queue 13 to ctrl 7.
[ 581.555356] nvmet: adding queue 14 to ctrl 7.
[ 581.555495] nvmet: adding queue 15 to ctrl 7.
[ 581.555628] nvmet: adding queue 16 to ctrl 7.
[ 581.555735] nvmet: adding queue 17 to ctrl 7.
[ 581.555902] nvmet: adding queue 18 to ctrl 7.
[ 581.556107] nvmet: adding queue 19 to ctrl 7.
[ 581.556269] nvmet: adding queue 20 to ctrl 7.
[ 581.556446] nvmet: adding queue 21 to ctrl 7.
[ 581.556612] nvmet: adding queue 22 to ctrl 7.
[ 581.556798] nvmet: adding queue 23 to ctrl 7.
[ 581.556957] nvmet: adding queue 24 to ctrl 7.
[ 581.557120] nvmet: adding queue 25 to ctrl 7.
[ 581.557288] nvmet: adding queue 26 to ctrl 7.
[ 581.557430] nvmet: adding queue 27 to ctrl 7.
[ 581.557591] nvmet: adding queue 28 to ctrl 7.
[ 581.557732] nvmet: adding queue 29 to ctrl 7.
[ 581.557892] nvmet: adding queue 30 to ctrl 7.
[ 581.558028] nvmet: adding queue 31 to ctrl 7.
[ 581.558193] nvmet: adding queue 32 to ctrl 7.
[ 581.578192] nvmet: creating controller 8 for subsystem subsys7 for NQN nvmfji01.
[ 582.391190] nvmet: adding queue 1 to ctrl 8.
[ 582.391370] nvmet: adding queue 2 to ctrl 8.
[ 582.391514] nvmet: adding queue 3 to ctrl 8.
[ 582.391685] nvmet: adding queue 4 to ctrl 8.
[ 582.391854] nvmet: adding queue 5 to ctrl 8.
[ 582.392020] nvmet: adding queue 6 to ctrl 8.
[ 582.392145] nvmet: adding queue 7 to ctrl 8.
[ 582.392286] nvmet: adding queue 8 to ctrl 8.
[ 582.392444] nvmet: adding queue 9 to ctrl 8.
[ 582.392594] nvmet: adding queue 10 to ctrl 8.
[ 582.392701] nvmet: adding queue 11 to ctrl 8.
[ 582.392865] nvmet: adding queue 12 to ctrl 8.
[ 582.393040] nvmet: adding queue 13 to ctrl 8.
[ 582.393184] nvmet: adding queue 14 to ctrl 8.
[ 582.393351] nvmet: adding queue 15 to ctrl 8.
[ 582.393556] nvmet: adding queue 16 to ctrl 8.
[ 582.393733] nvmet: adding queue 17 to ctrl 8.
[ 582.393931] nvmet: adding queue 18 to ctrl 8.
[ 582.394126] nvmet: adding queue 19 to ctrl 8.
[ 582.394283] nvmet: adding queue 20 to ctrl 8.
[ 582.394431] nvmet: adding queue 21 to ctrl 8.
[ 582.394588] nvmet: adding queue 22 to ctrl 8.
[ 582.394811] nvmet: adding queue 23 to ctrl 8.
[ 582.394970] nvmet: adding queue 24 to ctrl 8.
[ 582.395129] nvmet: adding queue 25 to ctrl 8.
[ 582.395295] nvmet: adding queue 26 to ctrl 8.
[ 582.395457] nvmet: adding queue 27 to ctrl 8.
[ 582.395625] nvmet: adding queue 28 to ctrl 8.
[ 582.395760] nvmet: adding queue 29 to ctrl 8.
[ 582.395893] nvmet: adding queue 30 to ctrl 8.
[ 582.396056] nvmet: adding queue 31 to ctrl 8.
[ 582.396222] nvmet: adding queue 32 to ctrl 8.
[ 582.415782] nvmet: creating controller 9 for subsystem subsys8 for NQN nvmfji01.
[ 583.224199] nvmet: adding queue 1 to ctrl 9.
[ 583.224340] nvmet: adding queue 2 to ctrl 9.
[ 583.224485] nvmet: adding queue 3 to ctrl 9.
[ 583.224621] nvmet: adding queue 4 to ctrl 9.
[ 583.224794] nvmet: adding queue 5 to ctrl 9.
[ 583.224937] nvmet: adding queue 6 to ctrl 9.
[ 583.225107] nvmet: adding queue 7 to ctrl 9.
[ 583.225278] nvmet: adding queue 8 to ctrl 9.
[ 583.225449] nvmet: adding queue 9 to ctrl 9.
[ 583.225598] nvmet: adding queue 10 to ctrl 9.
[ 583.225730] nvmet: adding queue 11 to ctrl 9.
[ 583.225907] nvmet: adding queue 12 to ctrl 9.
[ 583.226004] nvmet: adding queue 13 to ctrl 9.
[ 583.226145] nvmet: adding queue 14 to ctrl 9.
[ 583.226310] nvmet: adding queue 15 to ctrl 9.
[ 583.226450] nvmet: adding queue 16 to ctrl 9.
[ 583.226601] nvmet: adding queue 17 to ctrl 9.
[ 583.226804] nvmet: adding queue 18 to ctrl 9.
[ 583.226998] nvmet: adding queue 19 to ctrl 9.
[ 583.227163] nvmet: adding queue 20 to ctrl 9.
[ 583.227314] nvmet: adding queue 21 to ctrl 9.
[ 583.227479] nvmet: adding queue 22 to ctrl 9.
[ 583.227641] nvmet: adding queue 23 to ctrl 9.
[ 583.227805] nvmet: adding queue 24 to ctrl 9.
[ 583.227959] nvmet: adding queue 25 to ctrl 9.
[ 583.228128] nvmet: adding queue 26 to ctrl 9.
[ 583.228292] nvmet: adding queue 27 to ctrl 9.
[ 583.228456] nvmet: adding queue 28 to ctrl 9.
[ 583.228623] nvmet: adding queue 29 to ctrl 9.
[ 583.228784] nvmet: adding queue 30 to ctrl 9.
[ 583.228953] nvmet: adding queue 31 to ctrl 9.
[ 583.229120] nvmet: adding queue 32 to ctrl 9.
[ 583.248139] nvmet: creating controller 10 for subsystem subsys9 for NQN nvmfji01.
[ 584.061121] nvmet: adding queue 1 to ctrl 10.
[ 584.061269] nvmet: adding queue 2 to ctrl 10.
[ 584.061414] nvmet: adding queue 3 to ctrl 10.
[ 584.061593] nvmet: adding queue 4 to ctrl 10.
[ 584.061737] nvmet: adding queue 5 to ctrl 10.
[ 584.061837] nvmet: adding queue 6 to ctrl 10.
[ 584.062016] nvmet: adding queue 7 to ctrl 10.
[ 584.062142] nvmet: adding queue 8 to ctrl 10.
[ 584.062298] nvmet: adding queue 9 to ctrl 10.
[ 584.062455] nvmet: adding queue 10 to ctrl 10.
[ 584.062596] nvmet: adding queue 11 to ctrl 10.
[ 584.062769] nvmet: adding queue 12 to ctrl 10.
[ 584.062910] nvmet: adding queue 13 to ctrl 10.
[ 584.063064] nvmet: adding queue 14 to ctrl 10.
[ 584.063233] nvmet: adding queue 15 to ctrl 10.
[ 584.063395] nvmet: adding queue 16 to ctrl 10.
[ 584.063503] nvmet: adding queue 17 to ctrl 10.
[ 584.063677] nvmet: adding queue 18 to ctrl 10.
[ 584.063901] nvmet: adding queue 19 to ctrl 10.
[ 584.064036] nvmet: adding queue 20 to ctrl 10.
[ 584.064201] nvmet: adding queue 21 to ctrl 10.
[ 584.064362] nvmet: adding queue 22 to ctrl 10.
[ 584.064523] nvmet: adding queue 23 to ctrl 10.
[ 584.064687] nvmet: adding queue 24 to ctrl 10.
[ 584.064844] nvmet: adding queue 25 to ctrl 10.
[ 584.065005] nvmet: adding queue 26 to ctrl 10.
[ 584.065122] nvmet: adding queue 27 to ctrl 10.
[ 584.065280] nvmet: adding queue 28 to ctrl 10.
[ 584.065443] nvmet: adding queue 29 to ctrl 10.
[ 584.065577] nvmet: adding queue 30 to ctrl 10.
[ 584.065716] nvmet: adding queue 31 to ctrl 10.
[ 584.065845] nvmet: adding queue 32 to ctrl 10.
[ 584.086636] nvmet: creating controller 11 for subsystem subsys10 for NQN nvmfji01.
[ 584.891722] nvmet: adding queue 1 to ctrl 11.
[ 584.891895] nvmet: adding queue 2 to ctrl 11.
[ 584.892033] nvmet: adding queue 3 to ctrl 11.
[ 584.892230] nvmet: adding queue 4 to ctrl 11.
[ 584.892374] nvmet: adding queue 5 to ctrl 11.
[ 584.892513] nvmet: adding queue 6 to ctrl 11.
[ 584.892687] nvmet: adding queue 7 to ctrl 11.
[ 584.892822] nvmet: adding queue 8 to ctrl 11.
[ 584.892987] nvmet: adding queue 9 to ctrl 11.
[ 584.893095] nvmet: adding queue 10 to ctrl 11.
[ 584.893241] nvmet: adding queue 11 to ctrl 11.
[ 584.893412] nvmet: adding queue 12 to ctrl 11.
[ 584.893564] nvmet: adding queue 13 to ctrl 11.
[ 584.893720] nvmet: adding queue 14 to ctrl 11.
[ 584.893860] nvmet: adding queue 15 to ctrl 11.
[ 584.893960] nvmet: adding queue 16 to ctrl 11.
[ 584.894091] nvmet: adding queue 17 to ctrl 11.
[ 584.894290] nvmet: adding queue 18 to ctrl 11.
[ 584.894455] nvmet: adding queue 19 to ctrl 11.
[ 584.894634] nvmet: adding queue 20 to ctrl 11.
[ 584.894814] nvmet: adding queue 21 to ctrl 11.
[ 584.895015] nvmet: adding queue 22 to ctrl 11.
[ 584.895181] nvmet: adding queue 23 to ctrl 11.
[ 584.895344] nvmet: adding queue 24 to ctrl 11.
[ 584.895507] nvmet: adding queue 25 to ctrl 11.
[ 584.895675] nvmet: adding queue 26 to ctrl 11.
[ 584.895841] nvmet: adding queue 27 to ctrl 11.
[ 584.896005] nvmet: adding queue 28 to ctrl 11.
[ 584.896167] nvmet: adding queue 29 to ctrl 11.
[ 584.896328] nvmet: adding queue 30 to ctrl 11.
[ 584.896492] nvmet: adding queue 31 to ctrl 11.
[ 584.896659] nvmet: adding queue 32 to ctrl 11.
[ 584.916878] nvmet: creating controller 12 for subsystem subsys11 for NQN nvmfji01.
[ 585.720901] nvmet: adding queue 1 to ctrl 12.
[ 585.721072] nvmet: adding queue 2 to ctrl 12.
[ 585.721219] nvmet: adding queue 3 to ctrl 12.
[ 585.721401] nvmet: adding queue 4 to ctrl 12.
[ 585.721545] nvmet: adding queue 5 to ctrl 12.
[ 585.721702] nvmet: adding queue 6 to ctrl 12.
[ 585.721872] nvmet: adding queue 7 to ctrl 12.
[ 585.722009] nvmet: adding queue 8 to ctrl 12.
[ 585.722183] nvmet: adding queue 9 to ctrl 12.
[ 585.722314] nvmet: adding queue 10 to ctrl 12.
[ 585.722450] nvmet: adding queue 11 to ctrl 12.
[ 585.722594] nvmet: adding queue 12 to ctrl 12.
[ 585.722762] nvmet: adding queue 13 to ctrl 12.
[ 585.722926] nvmet: adding queue 14 to ctrl 12.
[ 585.723071] nvmet: adding queue 15 to ctrl 12.
[ 585.723207] nvmet: adding queue 16 to ctrl 12.
[ 585.723357] nvmet: adding queue 17 to ctrl 12.
[ 585.723552] nvmet: adding queue 18 to ctrl 12.
[ 585.723719] nvmet: adding queue 19 to ctrl 12.
[ 585.723854] nvmet: adding queue 20 to ctrl 12.
[ 585.724053] nvmet: adding queue 21 to ctrl 12.
[ 585.724249] nvmet: adding queue 22 to ctrl 12.
[ 585.724402] nvmet: adding queue 23 to ctrl 12.
[ 585.724563] nvmet: adding queue 24 to ctrl 12.
[ 585.724756] nvmet: adding queue 25 to ctrl 12.
[ 585.724924] nvmet: adding queue 26 to ctrl 12.
[ 585.725085] nvmet: adding queue 27 to ctrl 12.
[ 585.725249] nvmet: adding queue 28 to ctrl 12.
[ 585.725409] nvmet: adding queue 29 to ctrl 12.
[ 585.725541] nvmet: adding queue 30 to ctrl 12.
[ 585.725721] nvmet: adding queue 31 to ctrl 12.
[ 585.725886] nvmet: adding queue 32 to ctrl 12.
[ 585.746241] nvmet: creating controller 13 for subsystem subsys12 for NQN nvmfji01.
[ 586.551495] nvmet: adding queue 1 to ctrl 13.
[ 586.551639] nvmet: adding queue 2 to ctrl 13.
[ 586.551768] nvmet: adding queue 3 to ctrl 13.
[ 586.551905] nvmet: adding queue 4 to ctrl 13.
[ 586.552080] nvmet: adding queue 5 to ctrl 13.
[ 586.552190] nvmet: adding queue 6 to ctrl 13.
[ 586.552370] nvmet: adding queue 7 to ctrl 13.
[ 586.552536] nvmet: adding queue 8 to ctrl 13.
[ 586.552699] nvmet: adding queue 9 to ctrl 13.
[ 586.552843] nvmet: adding queue 10 to ctrl 13.
[ 586.553010] nvmet: adding queue 11 to ctrl 13.
[ 586.553185] nvmet: adding queue 12 to ctrl 13.
[ 586.553344] nvmet: adding queue 13 to ctrl 13.
[ 586.553457] nvmet: adding queue 14 to ctrl 13.
[ 586.553637] nvmet: adding queue 15 to ctrl 13.
[ 586.553700] nvmet: adding queue 16 to ctrl 13.
[ 586.553808] nvmet: adding queue 17 to ctrl 13.
[ 586.553971] nvmet: adding queue 18 to ctrl 13.
[ 586.554163] nvmet: adding queue 19 to ctrl 13.
[ 586.554357] nvmet: adding queue 20 to ctrl 13.
[ 586.554520] nvmet: adding queue 21 to ctrl 13.
[ 586.554687] nvmet: adding queue 22 to ctrl 13.
[ 586.554854] nvmet: adding queue 23 to ctrl 13.
[ 586.555016] nvmet: adding queue 24 to ctrl 13.
[ 586.555181] nvmet: adding queue 25 to ctrl 13.
[ 586.555345] nvmet: adding queue 26 to ctrl 13.
[ 586.555509] nvmet: adding queue 27 to ctrl 13.
[ 586.555676] nvmet: adding queue 28 to ctrl 13.
[ 586.555831] nvmet: adding queue 29 to ctrl 13.
[ 586.555997] nvmet: adding queue 30 to ctrl 13.
[ 586.556160] nvmet: adding queue 31 to ctrl 13.
[ 586.556298] nvmet: adding queue 32 to ctrl 13.
[ 586.577671] nvmet: creating controller 14 for subsystem subsys13 for NQN nvmfji01.
[ 587.389266] nvmet: adding queue 1 to ctrl 14.
[ 587.389425] nvmet: adding queue 2 to ctrl 14.
[ 587.389531] nvmet: adding queue 3 to ctrl 14.
[ 587.389671] nvmet: adding queue 4 to ctrl 14.
[ 587.389854] nvmet: adding queue 5 to ctrl 14.
[ 587.389994] nvmet: adding queue 6 to ctrl 14.
[ 587.390162] nvmet: adding queue 7 to ctrl 14.
[ 587.390292] nvmet: adding queue 8 to ctrl 14.
[ 587.390466] nvmet: adding queue 9 to ctrl 14.
[ 587.390636] nvmet: adding queue 10 to ctrl 14.
[ 587.390746] nvmet: adding queue 11 to ctrl 14.
[ 587.390920] nvmet: adding queue 12 to ctrl 14.
[ 587.391098] nvmet: adding queue 13 to ctrl 14.
[ 587.391267] nvmet: adding queue 14 to ctrl 14.
[ 587.391444] nvmet: adding queue 15 to ctrl 14.
[ 587.391614] nvmet: adding queue 16 to ctrl 14.
[ 587.391763] nvmet: adding queue 17 to ctrl 14.
[ 587.391925] nvmet: adding queue 18 to ctrl 14.
[ 587.392133] nvmet: adding queue 19 to ctrl 14.
[ 587.392262] nvmet: adding queue 20 to ctrl 14.
[ 587.392437] nvmet: adding queue 21 to ctrl 14.
[ 587.392599] nvmet: adding queue 22 to ctrl 14.
[ 587.392760] nvmet: adding queue 23 to ctrl 14.
[ 587.392932] nvmet: adding queue 24 to ctrl 14.
[ 587.393092] nvmet: adding queue 25 to ctrl 14.
[ 587.393255] nvmet: adding queue 26 to ctrl 14.
[ 587.393415] nvmet: adding queue 27 to ctrl 14.
[ 587.393580] nvmet: adding queue 28 to ctrl 14.
[ 587.393717] nvmet: adding queue 29 to ctrl 14.
[ 587.393868] nvmet: adding queue 30 to ctrl 14.
[ 587.394010] nvmet: adding queue 31 to ctrl 14.
[ 587.394177] nvmet: adding queue 32 to ctrl 14.
[ 587.413897] nvmet: creating controller 15 for subsystem subsys14 for NQN nvmfji01.
[ 588.218405] nvmet: adding queue 1 to ctrl 15.
[ 588.218586] nvmet: adding queue 2 to ctrl 15.
[ 588.218698] nvmet: adding queue 3 to ctrl 15.
[ 588.218873] nvmet: adding queue 4 to ctrl 15.
[ 588.219014] nvmet: adding queue 5 to ctrl 15.
[ 588.219156] nvmet: adding queue 6 to ctrl 15.
[ 588.219331] nvmet: adding queue 7 to ctrl 15.
[ 588.219502] nvmet: adding queue 8 to ctrl 15.
[ 588.219668] nvmet: adding queue 9 to ctrl 15.
[ 588.219778] nvmet: adding queue 10 to ctrl 15.
[ 588.219941] nvmet: adding queue 11 to ctrl 15.
[ 588.220108] nvmet: adding queue 12 to ctrl 15.
[ 588.220236] nvmet: adding queue 13 to ctrl 15.
[ 588.220376] nvmet: adding queue 14 to ctrl 15.
[ 588.220491] nvmet: adding queue 15 to ctrl 15.
[ 588.220627] nvmet: adding queue 16 to ctrl 15.
[ 588.220759] nvmet: adding queue 17 to ctrl 15.
[ 588.220895] nvmet: adding queue 18 to ctrl 15.
[ 588.221059] nvmet: adding queue 19 to ctrl 15.
[ 588.221279] nvmet: adding queue 20 to ctrl 15.
[ 588.221431] nvmet: adding queue 21 to ctrl 15.
[ 588.221553] nvmet: adding queue 22 to ctrl 15.
[ 588.221724] nvmet: adding queue 23 to ctrl 15.
[ 588.221895] nvmet: adding queue 24 to ctrl 15.
[ 588.222032] nvmet: adding queue 25 to ctrl 15.
[ 588.222199] nvmet: adding queue 26 to ctrl 15.
[ 588.222363] nvmet: adding queue 27 to ctrl 15.
[ 588.222527] nvmet: adding queue 28 to ctrl 15.
[ 588.222690] nvmet: adding queue 29 to ctrl 15.
[ 588.222855] nvmet: adding queue 30 to ctrl 15.
[ 588.223023] nvmet: adding queue 31 to ctrl 15.
[ 588.223195] nvmet: adding queue 32 to ctrl 15.
[ 588.244457] nvmet: creating controller 16 for subsystem subsys15 for NQN nvmfji01.
[ 589.121235] nvmet: adding queue 1 to ctrl 16.
[ 589.121408] nvmet: adding queue 2 to ctrl 16.
[ 589.121522] nvmet: adding queue 3 to ctrl 16.
[ 589.121690] nvmet: adding queue 4 to ctrl 16.
[ 589.121835] nvmet: adding queue 5 to ctrl 16.
[ 589.121998] nvmet: adding queue 6 to ctrl 16.
[ 589.122170] nvmet: adding queue 7 to ctrl 16.
[ 589.122331] nvmet: adding queue 8 to ctrl 16.
[ 589.122427] nvmet: adding queue 9 to ctrl 16.
[ 589.122563] nvmet: adding queue 10 to ctrl 16.
[ 589.122677] nvmet: adding queue 11 to ctrl 16.
[ 589.122833] nvmet: adding queue 12 to ctrl 16.
[ 589.122999] nvmet: adding queue 13 to ctrl 16.
[ 589.123132] nvmet: adding queue 14 to ctrl 16.
[ 589.123302] nvmet: adding queue 15 to ctrl 16.
[ 589.123429] nvmet: adding queue 16 to ctrl 16.
[ 589.123547] nvmet: adding queue 17 to ctrl 16.
[ 589.123696] nvmet: adding queue 18 to ctrl 16.
[ 589.123860] nvmet: adding queue 19 to ctrl 16.
[ 589.123995] nvmet: adding queue 20 to ctrl 16.
[ 589.124165] nvmet: adding queue 21 to ctrl 16.
[ 589.124324] nvmet: adding queue 22 to ctrl 16.
[ 589.124487] nvmet: adding queue 23 to ctrl 16.
[ 589.124621] nvmet: adding queue 24 to ctrl 16.
[ 589.124783] nvmet: adding queue 25 to ctrl 16.
[ 589.124944] nvmet: adding queue 26 to ctrl 16.
[ 589.125119] nvmet: adding queue 27 to ctrl 16.
[ 589.125282] nvmet: adding queue 28 to ctrl 16.
[ 589.125447] nvmet: adding queue 29 to ctrl 16.
[ 589.125578] nvmet: adding queue 30 to ctrl 16.
[ 589.125742] nvmet: adding queue 31 to ctrl 16.
[ 589.125938] nvmet: adding queue 32 to ctrl 16.
[ 8928.818755] perf: interrupt took too long (2509 > 2500), lowering kernel.perf_event_max_sample_rate to 79500
[12417.483770] mlx5_1:dump_cqe:262:(pid 1594): dump error cqe
[12417.483774] 00000000 00000000 00000000 00000000
[12417.483776] 00000000 00000000 00000000 00000000
[12417.483777] 00000000 00000000 00000000 00000000
[12417.483778] 00000000 00008813 080001c1 63b4b6d2
[12417.483786] mlx5_1:dump_cqe:262:(pid 2807): dump error cqe
[12417.483789] 00000000 00000000 00000000 00000000
[12417.483790] 00000000 00000000 00000000 00000000
[12417.483791] 00000000 00000000 00000000 00000000
[12417.483794] 00000000 00008813 080001ba 524434d3
[12417.483846] mlx5_1:dump_cqe:262:(pid 2808): dump error cqe
[12417.483849] 00000000 00000000 00000000 00000000
[12417.483850] 00000000 00000000 00000000 00000000
[12417.483852] 00000000 00000000 00000000 00000000
[12417.483854] 00000000 00008813 080001b4 e11af1d2
[12417.483995] mlx5_1:dump_cqe:262:(pid 2941): dump error cqe
[12417.483998] 00000000 00000000 00000000 00000000
[12417.484000] 00000000 00000000 00000000 00000000
[12417.484001] 00000000 00000000 00000000 00000000
[12417.484002] 00000000 00008813 080001b2 30daf3d2
[12423.450673] nvmet_rdma: freeing queue 298
[12423.456575] nvmet_rdma: freeing queue 299
[12423.458845] nvmet_rdma: freeing queue 300
[12423.462937] nvmet_rdma: freeing queue 301
[12423.466299] nvmet_rdma: freeing queue 302
[12423.470060] nvmet_rdma: freeing queue 303
[12423.473983] nvmet_rdma: freeing queue 304
[12423.476809] nvmet_rdma: freeing queue 305
[12423.478146] nvmet_rdma: freeing queue 306
[12423.481880] nvmet_rdma: freeing queue 307
[12423.485084] nvmet_rdma: freeing queue 308
[12423.487873] nvmet_rdma: freeing queue 309
[12423.491230] nvmet_rdma: freeing queue 310
[12423.494014] nvmet_rdma: freeing queue 311
[12423.496995] nvmet_rdma: freeing queue 312
[12423.498346] nvmet_rdma: freeing queue 313
[12423.502320] nvmet_rdma: freeing queue 314
[12423.505202] nvmet_rdma: freeing queue 315
[12423.507795] nvmet_rdma: freeing queue 316
[12423.510659] nvmet_rdma: freeing queue 317
[12423.513529] nvmet_rdma: freeing queue 318
[12423.516360] nvmet_rdma: freeing queue 319
[12423.519181] nvmet_rdma: freeing queue 320
[12423.522017] nvmet_rdma: freeing queue 321
[12423.525750] nvmet_rdma: freeing queue 322
[12423.527653] nvmet_rdma: freeing queue 323
[12423.530456] nvmet_rdma: freeing queue 324
[12423.533522] nvmet_rdma: freeing queue 325
[12423.536372] nvmet_rdma: freeing queue 326
[12423.539176] nvmet_rdma: freeing queue 327
[12423.541965] nvmet_rdma: freeing queue 328
[12423.544843] nvmet_rdma: freeing queue 329
[12423.621043] nvmet_rdma: freeing queue 297
[12423.630263] nvmet: creating controller 17 for subsystem subsys9 for NQN nvmfji01.
[12423.738398] nvmet: adding queue 1 to ctrl 17.
[12423.738522] nvmet: adding queue 2 to ctrl 17.
[12423.738594] nvmet: adding queue 3 to ctrl 17.
[12423.738712] nvmet: adding queue 4 to ctrl 17.
[12423.738790] nvmet: adding queue 5 to ctrl 17.
[12423.738943] nvmet: adding queue 6 to ctrl 17.
[12423.739066] nvmet: adding queue 7 to ctrl 17.
[12423.739221] nvmet: adding queue 8 to ctrl 17.
[12423.739347] nvmet: adding queue 9 to ctrl 17.
[12423.739453] nvmet: adding queue 10 to ctrl 17.
[12423.739603] nvmet: adding queue 11 to ctrl 17.
[12423.739767] nvmet: adding queue 12 to ctrl 17.
[12423.739891] nvmet: adding queue 13 to ctrl 17.
[12423.740039] nvmet: adding queue 14 to ctrl 17.
[12423.740185] nvmet: adding queue 15 to ctrl 17.
[12423.740265] nvmet: adding queue 16 to ctrl 17.
[12423.740403] nvmet: adding queue 17 to ctrl 17.
[12423.740537] nvmet: adding queue 18 to ctrl 17.
[12423.740695] nvmet: adding queue 19 to ctrl 17.
[12423.740854] nvmet: adding queue 20 to ctrl 17.
[12423.741010] nvmet: adding queue 21 to ctrl 17.
[12423.741144] nvmet: adding queue 22 to ctrl 17.
[12423.741277] nvmet: adding queue 23 to ctrl 17.
[12423.741415] nvmet: adding queue 24 to ctrl 17.
[12423.741578] nvmet: adding queue 25 to ctrl 17.
[12423.741708] nvmet: adding queue 26 to ctrl 17.
[12423.741867] nvmet: adding queue 27 to ctrl 17.
[12423.742000] nvmet: adding queue 28 to ctrl 17.
[12423.742123] nvmet: adding queue 29 to ctrl 17.
[12423.742224] nvmet: adding queue 30 to ctrl 17.
[12423.742389] nvmet: adding queue 31 to ctrl 17.
[12423.742547] nvmet: adding queue 32 to ctrl 17.
[12728.885267] mlx5_1:dump_cqe:262:(pid 2943): dump error cqe
[12728.885271] 00000000 00000000 00000000 00000000
[12728.885272] 00000000 00000000 00000000 00000000
[12728.885274] 00000000 00000000 00000000 00000000
[12728.885275] 00000000 00008813 08000240 0255bcd3
[12728.885852] mlx5_1:dump_cqe:262:(pid 2829): dump error cqe
[12728.885855] 00000000 00000000 00000000 00000000
[12728.885857] 00000000 00000000 00000000 00000000
[12728.885859] 00000000 00000000 00000000 00000000
[12728.885861] 00000000 00008813 08000239 c2e59fd3
[12735.782466] nvmet: ctrl 17 keep-alive timer (15 seconds) expired!
[12735.784949] nvmet: ctrl 17 fatal error occurred!
[12735.826802] nvmet_rdma: freeing queue 298
[12735.827481] nvmet_rdma: freeing queue 299
[12735.828094] nvmet_rdma: freeing queue 297
[12735.828848] nvmet_rdma: freeing queue 300
[12735.828914] nvmet_rdma: freeing queue 301
[12735.829553] nvmet_rdma: freeing queue 302
[12735.830380] nvmet_rdma: freeing queue 303
[12735.831342] nvmet_rdma: freeing queue 304
[12735.832355] nvmet_rdma: freeing queue 305
[12735.833446] nvmet_rdma: freeing queue 306
[12735.834529] nvmet_rdma: freeing queue 307
[12735.834590] nvmet_rdma: freeing queue 308
[12735.835601] nvmet_rdma: freeing queue 309
[12735.836357] nvmet_rdma: freeing queue 310
[12735.837456] nvmet_rdma: freeing queue 311
[12735.838082] nvmet_rdma: freeing queue 312
[12735.838921] nvmet_rdma: freeing queue 313
[12735.839609] nvmet_rdma: freeing queue 314
[12735.840435] nvmet_rdma: freeing queue 315
[12735.841461] nvmet_rdma: freeing queue 316
[12735.842291] nvmet_rdma: freeing queue 317
[12735.843393] nvmet_rdma: freeing queue 318
[12735.844115] nvmet_rdma: freeing queue 319
[12735.845185] nvmet_rdma: freeing queue 320
[12735.846206] nvmet_rdma: freeing queue 321
[12735.847087] nvmet_rdma: freeing queue 322
[12735.848168] nvmet_rdma: freeing queue 323
[12735.849286] nvmet_rdma: freeing queue 324
[12735.850325] nvmet_rdma: freeing queue 325
[12735.851337] nvmet_rdma: freeing queue 326
[12735.852355] nvmet_rdma: freeing queue 327
[12735.853641] nvmet_rdma: freeing queue 328
[12735.854626] nvmet_rdma: freeing queue 329
[12736.216640] nvmet: creating controller 10 for subsystem subsys9 for NQN nvmfji01.
[12736.323771] nvmet: adding queue 1 to ctrl 10.
[12736.323851] nvmet: adding queue 2 to ctrl 10.
[12736.323924] nvmet: adding queue 3 to ctrl 10.
[12736.324026] nvmet: adding queue 4 to ctrl 10.
[12736.324165] nvmet: adding queue 5 to ctrl 10.
[12736.324326] nvmet: adding queue 6 to ctrl 10.
[12736.324482] nvmet: adding queue 7 to ctrl 10.
[12736.324608] nvmet: adding queue 8 to ctrl 10.
[12736.324725] nvmet: adding queue 9 to ctrl 10.
[12736.324865] nvmet: adding queue 10 to ctrl 10.
[12736.324988] nvmet: adding queue 11 to ctrl 10.
[12736.325133] nvmet: adding queue 12 to ctrl 10.
[12736.325242] nvmet: adding queue 13 to ctrl 10.
[12736.325391] nvmet: adding queue 14 to ctrl 10.
[12736.325493] nvmet: adding queue 15 to ctrl 10.
[12736.325596] nvmet: adding queue 16 to ctrl 10.
[12736.325757] nvmet: adding queue 17 to ctrl 10.
[12736.325904] nvmet: adding queue 18 to ctrl 10.
[12736.326021] nvmet: adding queue 19 to ctrl 10.
[12736.326157] nvmet: adding queue 20 to ctrl 10.
[12736.326311] nvmet: adding queue 21 to ctrl 10.
[12736.326482] nvmet: adding queue 22 to ctrl 10.
[12736.326618] nvmet: adding queue 23 to ctrl 10.
[12736.326735] nvmet: adding queue 24 to ctrl 10.
[12736.326896] nvmet: adding queue 25 to ctrl 10.
[12736.327078] nvmet: adding queue 26 to ctrl 10.
[12736.327233] nvmet: adding queue 27 to ctrl 10.
[12736.327382] nvmet: adding queue 28 to ctrl 10.
[12736.327540] nvmet: adding queue 29 to ctrl 10.
[12736.327674] nvmet: adding queue 30 to ctrl 10.
[12736.327824] nvmet: adding queue 31 to ctrl 10.
[12736.327982] nvmet: adding queue 32 to ctrl 10.
[12799.756245] mlx5_1:dump_cqe:262:(pid 2829): dump error cqe
[12799.756248] 00000000 00000000 00000000 00000000
[12799.756249] 00000000 00000000 00000000 00000000
[12799.756250] 00000000 00000000 00000000 00000000
[12799.756252] 00000000 00008813 0800025a 027dccd2
[12799.756664] mlx5_1:dump_cqe:262:(pid 2940): dump error cqe
[12799.756667] 00000000 00000000 00000000 00000000
[12799.756669] 00000000 00000000 00000000 00000000
[12799.756671] 00000000 00000000 00000000 00000000
[12799.756672] 00000000 00008813 080001e0 83d66cd3
[12799.757163] mlx5_1:dump_cqe:262:(pid 2945): dump error cqe
[12799.757167] 00000000 00000000 00000000 00000000
[12799.757169] 00000000 00000000 00000000 00000000
[12799.757170] 00000000 00000000 00000000 00000000
[12799.757172] 00000000 00008813 080001df 9b4e18d2
[12799.757821] mlx5_1:dump_cqe:262:(pid 2343): dump error cqe
[12799.757830] 00000000 00000000 00000000 00000000
[12799.757837] 00000000 00000000 00000000 00000000
[12799.757841] 00000000 00000000 00000000 00000000
[12799.757846] 00000000 00008813 080001dd 77a6ccd3
[12799.758804] mlx5_1:dump_cqe:262:(pid 2941): dump error cqe
[12799.758806] 00000000 00000000 00000000 00000000
[12799.758808] 00000000 00000000 00000000 00000000
[12799.758809] 00000000 00000000 00000000 00000000
[12799.758810] 00000000 00008813 080001db 342c21d3
[12799.759177] mlx5_1:dump_cqe:262:(pid 2941): dump error cqe
[12799.759178] 00000000 00000000 00000000 00000000
[12799.759179] 00000000 00000000 00000000 00000000
[12799.759180] 00000000 00000000 00000000 00000000
[12799.759181] 00000000 00008813 080001da 197cdbd3
[12799.759563] mlx5_1:dump_cqe:262:(pid 2944): dump error cqe
[12799.759566] 00000000 00000000 00000000 00000000
[12799.759567] 00000000 00000000 00000000 00000000
[12799.759568] 00000000 00000000 00000000 00000000
[12799.759570] 00000000 00008813 080001d6 332f7dd2
[12804.052179] mlx5_1:dump_cqe:262:(pid 2940): dump error cqe
[12804.052181] 00000000 00000000 00000000 00000000
[12804.052183] 00000000 00000000 00000000 00000000
[12804.052184] 00000000 00000000 00000000 00000000
[12804.052185] 00000000 00008813 080001d3 17be7fd3
[12807.722283] nvmet: ctrl 10 keep-alive timer (15 seconds) expired!
[12807.764707] nvmet: ctrl 10 fatal error occurred!
[12807.807931] nvmet_rdma: freeing queue 297
[12807.808890] nvmet_rdma: freeing queue 298
[12807.809962] nvmet_rdma: freeing queue 299
[12807.810743] nvmet_rdma: freeing queue 300
[12807.810808] nvmet_rdma: freeing queue 301
[12807.811809] nvmet_rdma: freeing queue 302
[12807.812912] nvmet_rdma: freeing queue 303
[12807.813665] nvmet_rdma: freeing queue 304
[12807.814782] nvmet_rdma: freeing queue 305
[12807.815815] nvmet_rdma: freeing queue 306
[12807.816638] nvmet_rdma: freeing queue 307
[12807.817714] nvmet_rdma: freeing queue 308
[12807.818843] nvmet_rdma: freeing queue 309
[12807.819907] nvmet_rdma: freeing queue 310
[12807.820747] nvmet_rdma: freeing queue 311
[12807.821544] nvmet_rdma: freeing queue 312
[12807.822321] nvmet_rdma: freeing queue 313
[12807.823334] nvmet_rdma: freeing queue 314
[12807.824505] nvmet_rdma: freeing queue 315
[12807.825593] nvmet_rdma: freeing queue 316
[12807.826714] nvmet_rdma: freeing queue 317
[12807.827814] nvmet_rdma: freeing queue 318
[12807.828897] nvmet_rdma: freeing queue 319
[12807.829985] nvmet_rdma: freeing queue 320
[12807.831119] nvmet_rdma: freeing queue 321
[12807.832241] nvmet_rdma: freeing queue 322
[12807.833340] nvmet_rdma: freeing queue 323
[12807.834394] nvmet_rdma: freeing queue 324
[12807.835552] nvmet_rdma: freeing queue 325
[12807.836656] nvmet_rdma: freeing queue 326
[12807.837668] nvmet_rdma: freeing queue 327
[12807.838772] nvmet_rdma: freeing queue 328
[12807.839502] nvmet_rdma: freeing queue 329
[12807.985559] nvmet_rdma: freeing queue 364
[12807.991123] nvmet_rdma: freeing queue 365
[12807.997029] nvmet_rdma: freeing queue 366
[12808.000384] nvmet_rdma: freeing queue 367
[12808.005312] nvmet_rdma: freeing queue 368
[12808.010679] nvmet_rdma: freeing queue 369
[12808.015090] nvmet_rdma: freeing queue 370
[12808.017372] nvmet_rdma: freeing queue 371
[12808.020694] nvmet_rdma: freeing queue 372
[12808.025550] nvmet_rdma: freeing queue 373
[12808.027782] nvmet_rdma: freeing queue 374
[12808.032222] nvmet_rdma: freeing queue 375
[12808.034254] nvmet_rdma: freeing queue 376
[12808.036683] nvmet_rdma: freeing queue 377
[12808.040639] nvmet_rdma: freeing queue 378
[12808.044123] nvmet_rdma: freeing queue 379
[12808.047327] nvmet_rdma: freeing queue 380
[12808.050488] nvmet_rdma: freeing queue 381
[12808.053350] nvmet_rdma: freeing queue 382
[12808.057335] nvmet_rdma: freeing queue 383
[12808.059685] nvmet_rdma: freeing queue 384
[12808.062328] nvmet_rdma: freeing queue 385
[12808.065155] nvmet_rdma: freeing queue 386
[12808.067907] nvmet_rdma: freeing queue 387
[12808.071329] nvmet_rdma: freeing queue 388
[12808.074297] nvmet_rdma: freeing queue 389
[12808.077084] nvmet_rdma: freeing queue 390
[12808.079657] nvmet_rdma: freeing queue 391
[12808.082375] nvmet_rdma: freeing queue 392
[12808.085509] nvmet_rdma: freeing queue 393
[12808.088454] nvmet_rdma: freeing queue 394
[12808.091248] nvmet_rdma: freeing queue 395
[12808.170710] nvmet_rdma: freeing queue 363
[12808.176168] nvmet: creating controller 10 for subsystem subsys11 for NQN nvmfji01.
[12808.288423] nvmet: adding queue 1 to ctrl 10.
[12808.288504] nvmet: adding queue 2 to ctrl 10.
[12808.288577] nvmet: adding queue 3 to ctrl 10.
[12808.288651] nvmet: adding queue 4 to ctrl 10.
[12808.288797] nvmet: adding queue 5 to ctrl 10.
[12808.288950] nvmet: adding queue 6 to ctrl 10.
[12808.289075] nvmet: adding queue 7 to ctrl 10.
[12808.289191] nvmet: adding queue 8 to ctrl 10.
[12808.289331] nvmet: adding queue 9 to ctrl 10.
[12808.289443] nvmet: adding queue 10 to ctrl 10.
[12808.289593] nvmet: adding queue 11 to ctrl 10.
[12808.289697] nvmet: adding queue 12 to ctrl 10.
[12808.289843] nvmet: adding queue 13 to ctrl 10.
[12808.289965] nvmet: adding queue 14 to ctrl 10.
[12808.290072] nvmet: adding queue 15 to ctrl 10.
[12808.290199] nvmet: adding queue 16 to ctrl 10.
[12808.290329] nvmet: adding queue 17 to ctrl 10.
[12808.290455] nvmet: adding queue 18 to ctrl 10.
[12808.290541] nvmet: adding queue 19 to ctrl 10.
[12808.290703] nvmet: adding queue 20 to ctrl 10.
[12808.290849] nvmet: adding queue 21 to ctrl 10.
[12808.291012] nvmet: adding queue 22 to ctrl 10.
[12808.291169] nvmet: adding queue 23 to ctrl 10.
[12808.291333] nvmet: adding queue 24 to ctrl 10.
[12808.291501] nvmet: adding queue 25 to ctrl 10.
[12808.291641] nvmet: adding queue 26 to ctrl 10.
[12808.291782] nvmet: adding queue 27 to ctrl 10.
[12808.291944] nvmet: adding queue 28 to ctrl 10.
[12808.292107] nvmet: adding queue 29 to ctrl 10.
[12808.292267] nvmet: adding queue 30 to ctrl 10.
[12808.292417] nvmet: adding queue 31 to ctrl 10.
[12808.292582] nvmet: adding queue 32 to ctrl 10.
[12808.415014] nvmet: creating controller 12 for subsystem subsys9 for NQN nvmfji01.
[12808.526767] nvmet: adding queue 1 to ctrl 12.
[12808.526856] nvmet: adding queue 2 to ctrl 12.
[12808.526948] nvmet: adding queue 3 to ctrl 12.
[12808.527041] nvmet: adding queue 4 to ctrl 12.
[12808.527190] nvmet: adding queue 5 to ctrl 12.
[12808.527340] nvmet: adding queue 6 to ctrl 12.
[12808.527442] nvmet: adding queue 7 to ctrl 12.
[12808.527516] nvmet: adding queue 8 to ctrl 12.
[12808.527615] nvmet: adding queue 9 to ctrl 12.
[12808.527741] nvmet: adding queue 10 to ctrl 12.
[12808.527896] nvmet: adding queue 11 to ctrl 12.
[12808.528048] nvmet: adding queue 12 to ctrl 12.
[12808.528170] nvmet: adding queue 13 to ctrl 12.
[12808.528318] nvmet: adding queue 14 to ctrl 12.
[12808.528399] nvmet: adding queue 15 to ctrl 12.
[12808.528520] nvmet: adding queue 16 to ctrl 12.
[12808.528644] nvmet: adding queue 17 to ctrl 12.
[12808.528812] nvmet: adding queue 18 to ctrl 12.
[12808.528962] nvmet: adding queue 19 to ctrl 12.
[12808.529146] nvmet: adding queue 20 to ctrl 12.
[12808.529333] nvmet: adding queue 21 to ctrl 12.
[12808.529521] nvmet: adding queue 22 to ctrl 12.
[12808.529702] nvmet: adding queue 23 to ctrl 12.
[12808.529857] nvmet: adding queue 24 to ctrl 12.
[12808.530004] nvmet: adding queue 25 to ctrl 12.
[12808.530088] nvmet: adding queue 26 to ctrl 12.
[12808.530205] nvmet: adding queue 27 to ctrl 12.
[12808.530363] nvmet: adding queue 28 to ctrl 12.
[12808.530510] nvmet: adding queue 29 to ctrl 12.
[12808.530627] nvmet: adding queue 30 to ctrl 12.
[12808.530784] nvmet: adding queue 31 to ctrl 12.
[12808.530916] nvmet: adding queue 32 to ctrl 12.
[36225.245831] perf: interrupt took too long (3149 > 3136), lowering kernel.perf_event_max_sample_rate to 63500
[-- Attachment #4: joe16b.json --]
[-- Type: application/octet-stream, Size: 6393 bytes --]
{
"hosts": [],
"ports": [
{
"addr": {
"adrfam": "ipv4",
"traddr": "10.10.0.1",
"treq": "not specified",
"trsvcid": "4420",
"trtype": "rdma"
},
"portid": 1,
"referrals": [],
"subsystems": [
"subsys0",
"subsys2",
"subsys4",
"subsys6",
"subsys8",
"subsys10",
"subsys12",
"subsys14"
]
},
{
"addr": {
"adrfam": "ipv4",
"traddr": "10.11.0.1",
"treq": "not specified",
"trsvcid": "4420",
"trtype": "rdma"
},
"portid": 2,
"referrals": [],
"subsystems": [
"subsys1",
"subsys3",
"subsys5",
"subsys7",
"subsys9",
"subsys11",
"subsys13",
"subsys15"
]
}
],
"subsystems": [
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme0n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys0"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme1n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys1"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme2n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys2"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme3n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys3"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme4n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys4"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme5n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys5"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme6n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys6"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme7n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys7"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme8n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys8"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme9n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys9"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme10n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys10"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme11n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys11"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme12n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys12"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme13n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys13"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme14n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys14"
},
{
"allowed_hosts": [],
"attr": {
"allow_any_host": "1"
},
"namespaces": [
{
"device": {
"nguid": "00000000-0000-0000-0000-000000000000",
"path": "/dev/nvme15n1"
},
"enable": 1,
"nsid": 1
}
],
"nqn": "subsys15"
}
]
}
^ permalink raw reply [flat|nested] 26+ messages in thread
* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-12 16:41 ` Gruher, Joseph R
0 siblings, 0 replies; 26+ messages in thread
From: Gruher, Joseph R @ 2017-04-12 16:41 UTC (permalink / raw)
Hi folks-
Wanted to put this issue out there and see if anyone had thoughts.
Target system - 100Gb dual port CX5, FW 16.19.1000, through Arista 7060X switch with Ethernet flow control
Initiator system - 25Gb dual port CX4, FW 14.18.2000, through Arista 7060X switch with Ethernet flow control
We attach 16 drives from target to initiator, but are only running IO on four of them in this test, two drives per network port on initiator/target. Drives in use are Intel P3700 400GB.
We are running Ubuntu 16.10 with the 4.11-rc6 kernel and this patch from Max:
diff --git a/drivers/infiniband/hw/mlx5/qp.c b/drivers/infiniband/hw/mlx5/qp.c index ad8a263..c38c4fa 100644
--- a/drivers/infiniband/hw/mlx5/qp.c
+++ b/drivers/infiniband/hw/mlx5/qp.c
@@ -3737,8 +3737,7 @@ static void dump_wqe(struct mlx5_ib_qp *qp, int idx, int size_16)
static u8 get_fence(u8 fence, struct ib_send_wr *wr)
{
- if (unlikely(wr->opcode == IB_WR_LOCAL_INV &&
- wr->send_flags & IB_SEND_FENCE))
+ if (wr->opcode == IB_WR_LOCAL_INV || wr->opcode == IB_WR_REG_MR)
return MLX5_FENCE_MODE_STRONG_ORDERING;
if (unlikely(fence)) {
For the most part we can run FIO IO on the initiator against the attached subsystems without problems. 4KB random read and write, 64KB sequential writes are working OK on this setup. We seem to encounter errors when we run a 64KB sequential read workload. I would not the 64KB sequential read workload is the only one which generates enough traffic that we could bottleneck on the initiator NIC throughput - not sure if that is relevant, or just a coincidence. We can reproduce these errors fairly reliably at this time. See attached dmesg and example below:
[12728.885267] mlx5_1:dump_cqe:262:(pid 2943): dump error cqe
[12728.885271] 00000000 00000000 00000000 00000000
[12728.885272] 00000000 00000000 00000000 00000000
[12728.885274] 00000000 00000000 00000000 00000000
[12728.885275] 00000000 00008813 08000240 0255bcd3
[12728.885852] mlx5_1:dump_cqe:262:(pid 2829): dump error cqe
[12728.885855] 00000000 00000000 00000000 00000000
[12728.885857] 00000000 00000000 00000000 00000000
[12728.885859] 00000000 00000000 00000000 00000000
[12728.885861] 00000000 00008813 08000239 c2e59fd3
[12735.782466] nvmet: ctrl 17 keep-alive timer (15 seconds) expired!
[12735.784949] nvmet: ctrl 17 fatal error occurred!
These target side error prints seem correlated with IO failures and disconnect/reconnect events on the initiator so they are a problem. Any ideas? Any additional info we can provide?
Thanks,
Joe
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: initiator-dmesg.txt
URL: <http://lists.infradead.org/pipermail/linux-nvme/attachments/20170412/5dcfdcd1/attachment-0002.txt>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: target-dmesg.txt
URL: <http://lists.infradead.org/pipermail/linux-nvme/attachments/20170412/5dcfdcd1/attachment-0003.txt>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: joe16b.json
Type: application/octet-stream
Size: 6393 bytes
Desc: joe16b.json
URL: <http://lists.infradead.org/pipermail/linux-nvme/attachments/20170412/5dcfdcd1/attachment-0001.obj>
^ permalink raw reply [flat|nested] 26+ messages in thread
* Re: cqe dump errors on target while running nvme-of large block read IO
2017-04-12 16:41 ` Gruher, Joseph R
@ 2017-04-13 11:29 ` Max Gurtovoy
-1 siblings, 0 replies; 26+ messages in thread
From: Max Gurtovoy @ 2017-04-13 11:29 UTC (permalink / raw)
To: Gruher, Joseph R,
'linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r@public.gmane.org',
'linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org'
Cc: Sen, Sujoy, Riches Jr, Robert M
On 4/12/2017 7:41 PM, Gruher, Joseph R wrote:
> Hi folks-
>
> Wanted to put this issue out there and see if anyone had thoughts.
>
> Target system - 100Gb dual port CX5, FW 16.19.1000, through Arista 7060X switch with Ethernet flow control
> Initiator system - 25Gb dual port CX4, FW 14.18.2000, through Arista 7060X switch with Ethernet flow control
>
> We attach 16 drives from target to initiator, but are only running IO on four of them in this test, two drives per network port on initiator/target. Drives in use are Intel P3700 400GB.
>
> We are running Ubuntu 16.10 with the 4.11-rc6 kernel and this patch from Max:
>
> diff --git a/drivers/infiniband/hw/mlx5/qp.c b/drivers/infiniband/hw/mlx5/qp.c index ad8a263..c38c4fa 100644
> --- a/drivers/infiniband/hw/mlx5/qp.c
> +++ b/drivers/infiniband/hw/mlx5/qp.c
> @@ -3737,8 +3737,7 @@ static void dump_wqe(struct mlx5_ib_qp *qp, int idx, int size_16)
>
> static u8 get_fence(u8 fence, struct ib_send_wr *wr)
> {
> - if (unlikely(wr->opcode == IB_WR_LOCAL_INV &&
> - wr->send_flags & IB_SEND_FENCE))
> + if (wr->opcode == IB_WR_LOCAL_INV || wr->opcode == IB_WR_REG_MR)
> return MLX5_FENCE_MODE_STRONG_ORDERING;
>
> if (unlikely(fence)) {
>
> For the most part we can run FIO IO on the initiator against the attached subsystems without problems. 4KB random read and write, 64KB sequential writes are working OK on this setup. We seem to encounter errors when we run a 64KB sequential read workload. I would not the 64KB sequential read workload is the only one which generates enough traffic that we could bottleneck on the initiator NIC throughput - not sure if that is relevant, or just a coincidence. We can reproduce these errors fairly reliably at this time. See attached dmesg and example below:
>
> [12728.885267] mlx5_1:dump_cqe:262:(pid 2943): dump error cqe
> [12728.885271] 00000000 00000000 00000000 00000000
> [12728.885272] 00000000 00000000 00000000 00000000
> [12728.885274] 00000000 00000000 00000000 00000000
> [12728.885275] 00000000 00008813 08000240 0255bcd3
> [12728.885852] mlx5_1:dump_cqe:262:(pid 2829): dump error cqe
> [12728.885855] 00000000 00000000 00000000 00000000
> [12728.885857] 00000000 00000000 00000000 00000000
> [12728.885859] 00000000 00000000 00000000 00000000
> [12728.885861] 00000000 00008813 08000239 c2e59fd3
> [12735.782466] nvmet: ctrl 17 keep-alive timer (15 seconds) expired!
> [12735.784949] nvmet: ctrl 17 fatal error occurred!
>
> These target side error prints seem correlated with IO failures and disconnect/reconnect events on the initiator so they are a problem. Any ideas? Any additional info we can provide?
hi Joe,
can you run and repro it with null_blk backing store instead the nvme ?
you can emulate the delay of the nvme device using module param
completion_nsec.
is it reproducable in case B2B connectivity ?
>
> Thanks,
> Joe
>
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 26+ messages in thread
* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-13 11:29 ` Max Gurtovoy
0 siblings, 0 replies; 26+ messages in thread
From: Max Gurtovoy @ 2017-04-13 11:29 UTC (permalink / raw)
On 4/12/2017 7:41 PM, Gruher, Joseph R wrote:
> Hi folks-
>
> Wanted to put this issue out there and see if anyone had thoughts.
>
> Target system - 100Gb dual port CX5, FW 16.19.1000, through Arista 7060X switch with Ethernet flow control
> Initiator system - 25Gb dual port CX4, FW 14.18.2000, through Arista 7060X switch with Ethernet flow control
>
> We attach 16 drives from target to initiator, but are only running IO on four of them in this test, two drives per network port on initiator/target. Drives in use are Intel P3700 400GB.
>
> We are running Ubuntu 16.10 with the 4.11-rc6 kernel and this patch from Max:
>
> diff --git a/drivers/infiniband/hw/mlx5/qp.c b/drivers/infiniband/hw/mlx5/qp.c index ad8a263..c38c4fa 100644
> --- a/drivers/infiniband/hw/mlx5/qp.c
> +++ b/drivers/infiniband/hw/mlx5/qp.c
> @@ -3737,8 +3737,7 @@ static void dump_wqe(struct mlx5_ib_qp *qp, int idx, int size_16)
>
> static u8 get_fence(u8 fence, struct ib_send_wr *wr)
> {
> - if (unlikely(wr->opcode == IB_WR_LOCAL_INV &&
> - wr->send_flags & IB_SEND_FENCE))
> + if (wr->opcode == IB_WR_LOCAL_INV || wr->opcode == IB_WR_REG_MR)
> return MLX5_FENCE_MODE_STRONG_ORDERING;
>
> if (unlikely(fence)) {
>
> For the most part we can run FIO IO on the initiator against the attached subsystems without problems. 4KB random read and write, 64KB sequential writes are working OK on this setup. We seem to encounter errors when we run a 64KB sequential read workload. I would not the 64KB sequential read workload is the only one which generates enough traffic that we could bottleneck on the initiator NIC throughput - not sure if that is relevant, or just a coincidence. We can reproduce these errors fairly reliably at this time. See attached dmesg and example below:
>
> [12728.885267] mlx5_1:dump_cqe:262:(pid 2943): dump error cqe
> [12728.885271] 00000000 00000000 00000000 00000000
> [12728.885272] 00000000 00000000 00000000 00000000
> [12728.885274] 00000000 00000000 00000000 00000000
> [12728.885275] 00000000 00008813 08000240 0255bcd3
> [12728.885852] mlx5_1:dump_cqe:262:(pid 2829): dump error cqe
> [12728.885855] 00000000 00000000 00000000 00000000
> [12728.885857] 00000000 00000000 00000000 00000000
> [12728.885859] 00000000 00000000 00000000 00000000
> [12728.885861] 00000000 00008813 08000239 c2e59fd3
> [12735.782466] nvmet: ctrl 17 keep-alive timer (15 seconds) expired!
> [12735.784949] nvmet: ctrl 17 fatal error occurred!
>
> These target side error prints seem correlated with IO failures and disconnect/reconnect events on the initiator so they are a problem. Any ideas? Any additional info we can provide?
hi Joe,
can you run and repro it with null_blk backing store instead the nvme ?
you can emulate the delay of the nvme device using module param
completion_nsec.
is it reproducable in case B2B connectivity ?
>
> Thanks,
> Joe
>
^ permalink raw reply [flat|nested] 26+ messages in thread
* RE: cqe dump errors on target while running nvme-of large block read IO
2017-04-13 11:29 ` Max Gurtovoy
@ 2017-04-14 16:38 ` Gruher, Joseph R
-1 siblings, 0 replies; 26+ messages in thread
From: Gruher, Joseph R @ 2017-04-14 16:38 UTC (permalink / raw)
To: Max Gurtovoy,
'linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r@public.gmane.org',
'linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org'
Cc: Sen, Sujoy, Riches Jr, Robert M
> hi Joe,
> can you run and repro it with null_blk backing store instead the nvme ?
> you can emulate the delay of the nvme device using module param
> completion_nsec.
> is it reproducable in case B2B connectivity ?
Hey Max,
I ran overnight using null_blk devices but was unable to reproduce in that configuration. I set completion_nsec to 50000. Although my measured completion latencies in FIO were more like 17-18usec so not sure why they did not come in closer to 50usec. Anyway, failure did not reproduce using null_blk instead of real NVMe SSDs.
By B2B connectivity do you mean direct target-to-initiator connection with no switch? I don't think that is possible in this configuration since target uses a 100Gb QSFP NIC and initiator uses a 25Gb SFP28 NIC. I could perhaps swap the target side NIC for a matching 25Gb device and run direct connected that way if we think we need that data point, we would need to first establish if the failure even happens in that configuration, based on other testing we've done on an all-25Gb configuration I suspect it may not.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 26+ messages in thread
* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-14 16:38 ` Gruher, Joseph R
0 siblings, 0 replies; 26+ messages in thread
From: Gruher, Joseph R @ 2017-04-14 16:38 UTC (permalink / raw)
> hi Joe,
> can you run and repro it with null_blk backing store instead the nvme ?
> you can emulate the delay of the nvme device using module param
> completion_nsec.
> is it reproducable in case B2B connectivity ?
Hey Max,
I ran overnight using null_blk devices but was unable to reproduce in that configuration. I set completion_nsec to 50000. Although my measured completion latencies in FIO were more like 17-18usec so not sure why they did not come in closer to 50usec. Anyway, failure did not reproduce using null_blk instead of real NVMe SSDs.
By B2B connectivity do you mean direct target-to-initiator connection with no switch? I don't think that is possible in this configuration since target uses a 100Gb QSFP NIC and initiator uses a 25Gb SFP28 NIC. I could perhaps swap the target side NIC for a matching 25Gb device and run direct connected that way if we think we need that data point, we would need to first establish if the failure even happens in that configuration, based on other testing we've done on an all-25Gb configuration I suspect it may not.
^ permalink raw reply [flat|nested] 26+ messages in thread
* Re: cqe dump errors on target while running nvme-of large block read IO
2017-04-14 16:38 ` Gruher, Joseph R
@ 2017-04-18 12:17 ` Max Gurtovoy
-1 siblings, 0 replies; 26+ messages in thread
From: Max Gurtovoy @ 2017-04-18 12:17 UTC (permalink / raw)
To: Gruher, Joseph R,
'linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r@public.gmane.org',
'linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org'
Cc: Sen, Sujoy, Riches Jr, Robert M
On 4/14/2017 7:38 PM, Gruher, Joseph R wrote:
>> hi Joe,
>> can you run and repro it with null_blk backing store instead the nvme ?
>> you can emulate the delay of the nvme device using module param
>> completion_nsec.
>> is it reproducable in case B2B connectivity ?
>
> Hey Max,
>
> I ran overnight using null_blk devices but was unable to reproduce in that configuration. I set completion_nsec to 50000. Although my measured completion latencies in FIO were more like 17-18usec so not sure why they did not come in closer to 50usec. Anyway, failure did not reproduce using null_blk instead of real NVMe SSDs.
Hi,
you should set also the irqmode=2 (timer) and run local fio with
iodepth=1 and numjobs=1 to verify the latency (worked for me).
Let's try to repro again with the new configuration, to be sure that
this is not a transport issue.
Thanks.
>
> By B2B connectivity do you mean direct target-to-initiator connection with no switch? I don't think that is possible in this configuration since target uses a 100Gb QSFP NIC and initiator uses a 25Gb SFP28 NIC. I could perhaps swap the target side NIC for a matching 25Gb device and run direct connected that way if we think we need that data point, we would need to first establish if the failure even happens in that configuration, based on other testing we've done on an all-25Gb configuration I suspect it may not.
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 26+ messages in thread
* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-18 12:17 ` Max Gurtovoy
0 siblings, 0 replies; 26+ messages in thread
From: Max Gurtovoy @ 2017-04-18 12:17 UTC (permalink / raw)
On 4/14/2017 7:38 PM, Gruher, Joseph R wrote:
>> hi Joe,
>> can you run and repro it with null_blk backing store instead the nvme ?
>> you can emulate the delay of the nvme device using module param
>> completion_nsec.
>> is it reproducable in case B2B connectivity ?
>
> Hey Max,
>
> I ran overnight using null_blk devices but was unable to reproduce in that configuration. I set completion_nsec to 50000. Although my measured completion latencies in FIO were more like 17-18usec so not sure why they did not come in closer to 50usec. Anyway, failure did not reproduce using null_blk instead of real NVMe SSDs.
Hi,
you should set also the irqmode=2 (timer) and run local fio with
iodepth=1 and numjobs=1 to verify the latency (worked for me).
Let's try to repro again with the new configuration, to be sure that
this is not a transport issue.
Thanks.
>
> By B2B connectivity do you mean direct target-to-initiator connection with no switch? I don't think that is possible in this configuration since target uses a 100Gb QSFP NIC and initiator uses a 25Gb SFP28 NIC. I could perhaps swap the target side NIC for a matching 25Gb device and run direct connected that way if we think we need that data point, we would need to first establish if the failure even happens in that configuration, based on other testing we've done on an all-25Gb configuration I suspect it may not.
>
> --
> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
> the body of a message to majordomo at vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
>
^ permalink raw reply [flat|nested] 26+ messages in thread
* Re: cqe dump errors on target while running nvme-of large block read IO
2017-04-18 12:17 ` Max Gurtovoy
@ 2017-04-20 13:23 ` Sagi Grimberg
-1 siblings, 0 replies; 26+ messages in thread
From: Sagi Grimberg @ 2017-04-20 13:23 UTC (permalink / raw)
To: Max Gurtovoy, Gruher, Joseph R,
'linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r@public.gmane.org',
'linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org'
Cc: Sen, Sujoy, Riches Jr, Robert M
>>> hi Joe,
>>> can you run and repro it with null_blk backing store instead the nvme ?
>>> you can emulate the delay of the nvme device using module param
>>> completion_nsec.
>>> is it reproducable in case B2B connectivity ?
>>
>> Hey Max,
>>
>> I ran overnight using null_blk devices but was unable to reproduce in
>> that configuration. I set completion_nsec to 50000. Although my
>> measured completion latencies in FIO were more like 17-18usec so not
>> sure why they did not come in closer to 50usec. Anyway, failure did
>> not reproduce using null_blk instead of real NVMe SSDs.
>
> Hi,
> you should set also the irqmode=2 (timer) and run local fio with
> iodepth=1 and numjobs=1 to verify the latency (worked for me).
> Let's try to repro again with the new configuration, to be sure that
> this is not a transport issue.
The backend has absolutely nothing to do with these errors.
The target side cqe dumps indicate failures for RDMA write operations,
because we don't ask for completions on those we don't see logging from
the nvmet-rdma code, we simply trigger fatal errors from the rain of
flush errors that follow the queue-pair moving to error state.
These errors are either from:
1. mapping error on the host side - not sure given we don't see
any error completions/events from the rdma device. However, can you
turn on dynamic debug to see QP events?
echo "func nvme_rdma_qp_event +p" > /sys/kernel/debug/dynamic_debug/control
2. retry exhaustions due to network congestion - likely due to the
topology used.
3. Maybe something I'm missing...
The fact that null_blk didn't reproduce this was probably because it is
less bursty (which can cause network congestion).
On the host side we see I/O failures which immediately followed by
reconnect. On reconnects we stop all incoming IO and fail all IO
inflight so we can safely handle the reestablishment of the controller
queues. The fact that we fail the IO and remove the buffer mappings
correlates with the cqe dumps we see on the target.
So what I suspect happening is:
1. target tries to ingest a lot servicing large reads (more than 25G)
2. either flow control stop the target device (in case flow
control works as expected) or target retries handling drops.
3. these rdma writes stall so much that the host gives up on
I/O timeout (30 seconds)
4. host error recovery kicks in, host stops queues and fast fail
inflight IO, removing buffer mappings
5. target retries finally passes switch congestion, makes it to the
host but the buffer mappings are gone, host device fails rdma write
operations.
6. target generates these CQE dumps.
If this is the case, I'm not exactly sure how to resolve this.
Joseph, are you sure that flow control is correctly configured
and working reliably?
Perhaps the experts in Linux-rdma can help...
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 26+ messages in thread
* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-20 13:23 ` Sagi Grimberg
0 siblings, 0 replies; 26+ messages in thread
From: Sagi Grimberg @ 2017-04-20 13:23 UTC (permalink / raw)
>>> hi Joe,
>>> can you run and repro it with null_blk backing store instead the nvme ?
>>> you can emulate the delay of the nvme device using module param
>>> completion_nsec.
>>> is it reproducable in case B2B connectivity ?
>>
>> Hey Max,
>>
>> I ran overnight using null_blk devices but was unable to reproduce in
>> that configuration. I set completion_nsec to 50000. Although my
>> measured completion latencies in FIO were more like 17-18usec so not
>> sure why they did not come in closer to 50usec. Anyway, failure did
>> not reproduce using null_blk instead of real NVMe SSDs.
>
> Hi,
> you should set also the irqmode=2 (timer) and run local fio with
> iodepth=1 and numjobs=1 to verify the latency (worked for me).
> Let's try to repro again with the new configuration, to be sure that
> this is not a transport issue.
The backend has absolutely nothing to do with these errors.
The target side cqe dumps indicate failures for RDMA write operations,
because we don't ask for completions on those we don't see logging from
the nvmet-rdma code, we simply trigger fatal errors from the rain of
flush errors that follow the queue-pair moving to error state.
These errors are either from:
1. mapping error on the host side - not sure given we don't see
any error completions/events from the rdma device. However, can you
turn on dynamic debug to see QP events?
echo "func nvme_rdma_qp_event +p" > /sys/kernel/debug/dynamic_debug/control
2. retry exhaustions due to network congestion - likely due to the
topology used.
3. Maybe something I'm missing...
The fact that null_blk didn't reproduce this was probably because it is
less bursty (which can cause network congestion).
On the host side we see I/O failures which immediately followed by
reconnect. On reconnects we stop all incoming IO and fail all IO
inflight so we can safely handle the reestablishment of the controller
queues. The fact that we fail the IO and remove the buffer mappings
correlates with the cqe dumps we see on the target.
So what I suspect happening is:
1. target tries to ingest a lot servicing large reads (more than 25G)
2. either flow control stop the target device (in case flow
control works as expected) or target retries handling drops.
3. these rdma writes stall so much that the host gives up on
I/O timeout (30 seconds)
4. host error recovery kicks in, host stops queues and fast fail
inflight IO, removing buffer mappings
5. target retries finally passes switch congestion, makes it to the
host but the buffer mappings are gone, host device fails rdma write
operations.
6. target generates these CQE dumps.
If this is the case, I'm not exactly sure how to resolve this.
Joseph, are you sure that flow control is correctly configured
and working reliably?
Perhaps the experts in Linux-rdma can help...
^ permalink raw reply [flat|nested] 26+ messages in thread
* RE: cqe dump errors on target while running nvme-of large block read IO
2017-04-18 12:17 ` Max Gurtovoy
@ 2017-04-20 16:23 ` Gruher, Joseph R
-1 siblings, 0 replies; 26+ messages in thread
From: Gruher, Joseph R @ 2017-04-20 16:23 UTC (permalink / raw)
To: Max Gurtovoy,
'linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r@public.gmane.org',
'linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org'
Cc: Sen, Sujoy, Riches Jr, Robert M
[-- Attachment #1: Type: text/plain, Size: 1069 bytes --]
> you should set also the irqmode=2 (timer) and run local fio with
> iodepth=1 and numjobs=1 to verify the latency (worked for me).
> Let's try to repro again with the new configuration, to be sure that this is not a
> transport issue.
Adding irqmode=2 definitely corrected the latency behavior. Now for 1 job with QD=1 on 4K random reads I get average latency 74usec and writes are 67usec. I set the null_blk devices to 50000nsec so adding in some latency for NVMf this seems reasonable.
I believe I was able to reproduce an instance of the problem using the null_blk devices as the backend. We configured 16 null_blk devices an attached four to initiator 1 and four to initiator 2. Initiators are each using both ports of a dual-ported 25Gb CX4 and target is using both ports of a dual-ported 100Gb CX5 (dual ports are on separate subnets). Then we ran a variety of workloads overnight. The dmesg logs are attached. We see "dump error cqe" at various points in the target dmesg and we see IO errors and reconnects on both initiators.
Thanks,
Joe
[-- Attachment #2: init1.txt --]
[-- Type: text/plain, Size: 96470 bytes --]
[ 0.000000] Linux version 4.11.0-rc6patch-2-get-fence (r1@rrpatch) (gcc version 6.2.0 20161005 (Ubuntu 6.2.0-5ubuntu12) ) #1 SMP Tue Apr 11 08:56:12 PDT 2017
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.11.0-rc6patch-2-get-fence root=UUID=a0743b47-df25-4ba0-8386-a044d37f33d1 ro
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009b3ff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009b400-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000079fc5fff] usable
[ 0.000000] BIOS-e820: [mem 0x0000000079fc6000-0x000000007ac51fff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000007ac52000-0x000000007b681fff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x000000007b682000-0x000000007b7cefff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x000000007b7cf000-0x000000007b7fffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007b800000-0x000000008fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000ff400000-0x00000000ffffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000107fffffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.7 present.
[ 0.000000] DMI: Intel Corporation S2600WT2R/S2600WT2R, BIOS SE5C610.86B.01.01.0016.033120161139 03/31/2016
[ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[ 0.000000] e820: last_pfn = 0x1080000 max_arch_pfn = 0x400000000
[ 0.000000] MTRR default type: write-back
[ 0.000000] MTRR fixed ranges enabled:
[ 0.000000] 00000-9FFFF write-back
[ 0.000000] A0000-BFFFF uncachable
[ 0.000000] C0000-FFFFF write-protect
[ 0.000000] MTRR variable ranges enabled:
[ 0.000000] 0 base 000080000000 mask 3FFF80000000 uncachable
[ 0.000000] 1 base 380000000000 mask 3F8000000000 uncachable
[ 0.000000] 2 disabled
[ 0.000000] 3 disabled
[ 0.000000] 4 disabled
[ 0.000000] 5 disabled
[ 0.000000] 6 disabled
[ 0.000000] 7 disabled
[ 0.000000] 8 disabled
[ 0.000000] 9 disabled
[ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WC UC- WT
[ 0.000000] e820: last_pfn = 0x7b800 max_arch_pfn = 0x400000000
[ 0.000000] found SMP MP-table at [mem 0x000fd850-0x000fd85f] mapped at [ffff8a13400fd850]
[ 0.000000] Scanning 1 areas for low memory corruption
[ 0.000000] Base memory trampoline at [ffff8a1340095000] 95000 size 24576
[ 0.000000] Using GB pages for direct mapping
[ 0.000000] BRK [0x3aba0b000, 0x3aba0bfff] PGTABLE
[ 0.000000] BRK [0x3aba0c000, 0x3aba0cfff] PGTABLE
[ 0.000000] BRK [0x3aba0d000, 0x3aba0dfff] PGTABLE
[ 0.000000] BRK [0x3aba0e000, 0x3aba0efff] PGTABLE
[ 0.000000] BRK [0x3aba0f000, 0x3aba0ffff] PGTABLE
[ 0.000000] BRK [0x3aba10000, 0x3aba10fff] PGTABLE
[ 0.000000] BRK [0x3aba11000, 0x3aba11fff] PGTABLE
[ 0.000000] RAMDISK: [mem 0x32ecd000-0x3575dfff]
[ 0.000000] ACPI: Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 0x00000000000F0460 000024 (v02 INTEL )
[ 0.000000] ACPI: XSDT 0x000000007B7CD0E8 0000B4 (v01 INTEL S2600WT 00000000 INTL 01000013)
[ 0.000000] ACPI: FACP 0x000000007B7CC000 0000F4 (v04 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: DSDT 0x000000007B791000 032AEE (v02 INTEL S2600WT 00000003 INTL 20091013)
[ 0.000000] ACPI: FACS 0x000000007B649000 000040
[ 0.000000] ACPI: HPET 0x000000007B7CB000 000038 (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: APIC 0x000000007B7CA000 000AFC (v03 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: MCFG 0x000000007B7C9000 00003C (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: MSCT 0x000000007B7C8000 000090 (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SLIT 0x000000007B7C7000 00006C (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SRAT 0x000000007B7C6000 0007F0 (v03 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SPMI 0x000000007B7C5000 000041 (v05 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: WDDT 0x000000007B7C4000 000040 (v01 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: PRAD 0x000000007B6A2000 000102 (v02 INTEL SpsPrAgg 00000002 INTL 20130328)
[ 0.000000] ACPI: UEFI 0x000000007B67A000 000042 (v01 INTEL S2600WT 00000002 INTL 01000013)
[ 0.000000] ACPI: SSDT 0x000000007B6A7000 0E96B0 (v02 INTEL S2600WT 00004000 INTL 20130328)
[ 0.000000] ACPI: SSDT 0x000000007B6A4000 002679 (v02 INTEL S2600WT 00000002 INTL 20130328)
[ 0.000000] ACPI: SSDT 0x000000007B6A3000 000064 (v02 INTEL S2600WT 00000002 INTL 20130328)
[ 0.000000] ACPI: HEST 0x000000007B6A1000 0000A8 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: BERT 0x000000007B6A0000 000030 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: ERST 0x000000007B69F000 000230 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: EINJ 0x000000007B69E000 000130 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x0a -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x10 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x12 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x14 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x16 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x18 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x20 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x22 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x24 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x26 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x28 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x2a -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x30 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x32 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x34 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x36 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x38 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x40 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x42 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x44 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x46 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x48 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x4a -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x50 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x52 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x54 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x56 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x58 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x60 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x62 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x64 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x66 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x68 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x6a -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x70 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x72 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x74 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x76 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x78 -> Node 1
[ 0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[ 0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x87fffffff]
[ 0.000000] ACPI: SRAT: Node 1 PXM 1 [mem 0x880000000-0x107fffffff]
[ 0.000000] NUMA: Initialized distance table, cnt=2
[ 0.000000] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x87fffffff] -> [mem 0x00000000-0x87fffffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff]
[ 0.000000] NODE_DATA(1) allocated [mem 0x107ffd4000-0x107fffefff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]
[ 0.000000] Normal [mem 0x0000000100000000-0x000000107fffffff]
[ 0.000000] Device empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009afff]
[ 0.000000] node 0: [mem 0x0000000000100000-0x0000000079fc5fff]
[ 0.000000] node 0: [mem 0x000000007b7cf000-0x000000007b7fffff]
[ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff]
[ 0.000000] node 1: [mem 0x0000000880000000-0x000000107fffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff]
[ 0.000000] On node 0 totalpages: 8363921
[ 0.000000] DMA zone: 64 pages used for memmap
[ 0.000000] DMA zone: 21 pages reserved
[ 0.000000] DMA zone: 3994 pages, LIFO batch:0
[ 0.000000] DMA32 zone: 7744 pages used for memmap
[ 0.000000] DMA32 zone: 495607 pages, LIFO batch:31
[ 0.000000] Normal zone: 122880 pages used for memmap
[ 0.000000] Normal zone: 7864320 pages, LIFO batch:31
[ 0.000000] Initmem setup node 1 [mem 0x0000000880000000-0x000000107fffffff]
[ 0.000000] On node 1 totalpages: 8388608
[ 0.000000] Normal zone: 131072 pages used for memmap
[ 0.000000] Normal zone: 8388608 pages, LIFO batch:31
[ 0.000000] ACPI: PM-Timer IO Port: 0x408
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x08] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x09] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x10] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x11] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x12] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x13] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x14] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x15] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x16] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x17] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x18] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x19] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x20] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x21] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x22] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x23] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x24] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x25] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x26] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x27] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x28] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x29] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x30] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x31] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x32] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x33] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x34] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x35] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x36] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x37] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x38] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x39] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x40] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x41] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x42] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x43] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x44] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x45] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x46] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x47] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x48] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x49] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x50] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x51] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x52] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x53] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x54] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x55] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x56] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x57] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x58] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x59] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x60] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x61] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x62] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x63] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x64] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x65] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x66] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x67] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x68] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x69] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x70] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x71] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x72] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x73] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x74] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x75] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x76] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x77] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x78] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x79] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x80] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x81] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x82] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x83] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x84] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x85] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x86] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x87] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x88] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x89] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x90] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x91] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x92] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x93] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x94] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x95] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x96] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x97] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x98] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x99] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa0] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa1] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa2] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa3] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa4] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa5] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa6] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa7] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa8] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa9] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xaa] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xab] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xac] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xad] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xae] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xaf] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb0] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb1] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb2] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb3] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb4] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb5] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb6] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb7] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb8] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb9] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xba] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbb] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbc] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbd] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbe] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbf] high level lint[0x1])
[ 0.000000] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[ 0.000000] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47
[ 0.000000] IOAPIC[2]: apic_id 10, version 32, address 0xfec40000, GSI 48-71
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] ACPI: IRQ0 used by override.
[ 0.000000] ACPI: IRQ9 used by override.
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[ 0.000000] smpboot: Allowing 44 CPUs, 0 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009b000-0x0009bfff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009c000-0x0009ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x79fc6000-0x7ac51fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7ac52000-0x7b681fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b682000-0x7b7cefff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b800000-0x8fffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xff3fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xff400000-0xffffffff]
[ 0.000000] e820: [mem 0x90000000-0xfed1bfff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on bare hardware
[ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:44 nr_cpu_ids:44 nr_node_ids:2
[ 0.000000] percpu: Embedded 38 pages/cpu @ffff8a1b9f800000 s115608 r8192 d31848 u262144
[ 0.000000] pcpu-alloc: s115608 r8192 d31848 u262144 alloc=1*2097152
[ 0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15
[ 0.000000] pcpu-alloc: [0] 16 17 18 19 20 21 -- -- [1] 22 23 24 25 26 27 28 29
[ 0.000000] pcpu-alloc: [1] 30 31 32 33 34 35 36 37 [1] 38 39 40 41 42 43 -- --
[ 0.000000] Built 2 zonelists in Node order, mobility grouping on. Total pages: 16490748
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.11.0-rc6patch-2-get-fence root=UUID=a0743b47-df25-4ba0-8386-a044d37f33d1 ro
[ 0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[ 0.000000] log_buf_len total cpu_extra contributions: 176128 bytes
[ 0.000000] log_buf_len min size: 262144 bytes
[ 0.000000] log_buf_len: 524288 bytes
[ 0.000000] early log buf free: 235764(89%)
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Calgary: detecting Calgary via BIOS EBDA area
[ 0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[ 0.000000] Memory: 65825760K/67010116K available (9075K kernel code, 1697K rwdata, 3884K rodata, 2212K init, 2232K bss, 1184356K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=44, Nodes=2
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] Build-time adjustment of leaf fanout to 64.
[ 0.000000] RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=44.
[ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=44
[ 0.000000] NR_IRQS:524544 nr_irqs:1592 16
[ 0.000000] Console: colour dummy device 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[ 0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[ 0.000000] hpet clockevent registered
[ 0.000000] tsc: Fast TSC calibration using PIT
[ 0.004000] tsc: Detected 2194.917 MHz processor
[ 0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4389.83 BogoMIPS (lpj=8779668)
[ 0.004000] pid_max: default: 45056 minimum: 352
[ 0.004000] ACPI: Core revision 20170119
[ 0.108198] ACPI: 4 ACPI AML tables successfully acquired and loaded
[ 0.108288] Security Framework initialized
[ 0.108291] Yama: becoming mindful.
[ 0.108348] AppArmor: AppArmor initialized
[ 0.111074] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[ 0.124654] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[ 0.130694] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.130746] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.131507] CPU: Physical Processor ID: 0
[ 0.131511] CPU: Processor Core ID: 0
[ 0.131518] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[ 0.131521] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[ 0.131527] mce: CPU supports 22 MCE banks
[ 0.131545] CPU0: Thermal monitoring enabled (TM1)
[ 0.131600] process: using mwait in idle threads
[ 0.131605] Last level iTLB entries: 4KB 128, 2MB 8, 4MB 8
[ 0.131608] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4
[ 0.132347] Freeing SMP alternatives memory: 32K
[ 0.136004] ftrace: allocating 34213 entries in 134 pages
[ 0.148115] smpboot: Max logical packages: 2
[ 0.148257] x2apic: IRQ remapping doesn't support X2APIC mode
[ 0.148336] Switched APIC routing to physical flat.
[ 0.148950] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.190418] TSC deadline timer enabled
[ 0.190424] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2699 v4 @ 2.20GHz (family: 0x6, model: 0x4f, stepping: 0x1)
[ 0.190579] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver.
[ 0.190605] ... version: 3
[ 0.190607] ... bit width: 48
[ 0.190610] ... generic registers: 8
[ 0.190613] ... value mask: 0000ffffffffffff
[ 0.190616] ... max period: 00007fffffffffff
[ 0.190618] ... fixed-purpose events: 3
[ 0.190621] ... event mask: 00000007000000ff
[ 0.192000] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[ 0.192000] smp: Bringing up secondary CPUs ...
[ 0.192000] x86: Booting SMP configuration:
[ 0.192000] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20 #21
[ 1.872381] .... node #1, CPUs: #22 #23 #24 #25 #26 #27 #28 #29 #30 #31 #32 #33 #34 #35 #36 #37 #38 #39 #40 #41 #42 #43
[ 3.640075] smp: Brought up 2 nodes, 44 CPUs
[ 3.640075] smpboot: Total of 44 processors activated (193217.02 BogoMIPS)
[ 3.644774] sched_clock: Marking stable (3644000000, 0)->(3857780649, -213780649)
[ 3.646518] devtmpfs: initialized
[ 3.646575] x86/mm: Memory block size: 2048MB
[ 3.648340] evm: security.selinux
[ 3.648343] evm: security.SMACK64
[ 3.648345] evm: security.SMACK64EXEC
[ 3.648348] evm: security.SMACK64TRANSMUTE
[ 3.648350] evm: security.SMACK64MMAP
[ 3.648353] evm: security.ima
[ 3.648355] evm: security.capability
[ 3.648445] PM: Registering ACPI NVS region [mem 0x7ac52000-0x7b681fff] (10682368 bytes)
[ 3.648836] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 3.648908] futex hash table entries: 16384 (order: 8, 1048576 bytes)
[ 3.649288] pinctrl core: initialized pinctrl subsystem
[ 3.649403] RTC time: 15:56:16, date: 04/19/17
[ 3.650652] NET: Registered protocol family 16
[ 3.650846] cpuidle: using governor ladder
[ 3.650853] cpuidle: using governor menu
[ 3.650857] PCCT header not found.
[ 3.650970] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[ 3.650974] ACPI: bus type PCI registered
[ 3.650978] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 3.651083] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[ 3.651098] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[ 3.651116] PCI: Using configuration type 1 for base access
[ 3.653827] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[ 3.653834] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 3.654636] ACPI: Added _OSI(Module Device)
[ 3.654639] ACPI: Added _OSI(Processor Device)
[ 3.654642] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 3.654645] ACPI: Added _OSI(Processor Aggregator Device)
[ 3.654831] ACPI: Executed 1 blocks of module-level executable AML code
[ 3.787914] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[ 3.962237] ACPI: Dynamic OEM Table Load:
[ 3.990487] ACPI: Interpreter enabled
[ 3.990502] ACPI: (supports S0 S5)
[ 3.990506] ACPI: Using IOAPIC for interrupt routing
[ 3.990556] HEST: Table parsing has been initialized.
[ 3.990561] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 4.026546] ACPI: PCI Root Bridge [UNC1] (domain 0000 [bus ff])
[ 4.026554] acpi PNP0A03:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 6.082255] acpi PNP0A03:02: _OSC: platform does not support [PCIeHotplug]
[ 8.130818] acpi PNP0A03:02: _OSC: OS now controls [PME AER PCIeCapability]
[ 8.130821] acpi PNP0A03:02: FADT indicates ASPM is unsupported, using BIOS configuration
[ 8.130870] PCI host bridge to bus 0000:ff
[ 8.130874] pci_bus 0000:ff: root bus resource [bus ff]
[ 8.130886] pci 0000:ff:08.0: [8086:6f80] type 00 class 0x088000
[ 8.130942] pci 0000:ff:08.2: [8086:6f32] type 00 class 0x110100
[ 8.130986] pci 0000:ff:08.3: [8086:6f83] type 00 class 0x088000
[ 8.131047] pci 0000:ff:09.0: [8086:6f90] type 00 class 0x088000
[ 8.131090] pci 0000:ff:09.2: [8086:6f33] type 00 class 0x110100
[ 8.131134] pci 0000:ff:09.3: [8086:6f93] type 00 class 0x088000
[ 8.131184] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000
[ 8.131222] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100
[ 8.131263] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100
[ 8.131303] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000
[ 8.131351] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000
[ 8.131391] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000
[ 8.131430] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000
[ 8.131468] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000
[ 8.131507] pci 0000:ff:0c.4: [8086:6fe4] type 00 class 0x088000
[ 8.131546] pci 0000:ff:0c.5: [8086:6fe5] type 00 class 0x088000
[ 8.131586] pci 0000:ff:0c.6: [8086:6fe6] type 00 class 0x088000
[ 8.131625] pci 0000:ff:0c.7: [8086:6fe7] type 00 class 0x088000
[ 8.131664] pci 0000:ff:0d.0: [8086:6fe8] type 00 class 0x088000
[ 8.131704] pci 0000:ff:0d.1: [8086:6fe9] type 00 class 0x088000
[ 8.131742] pci 0000:ff:0d.2: [8086:6fea] type 00 class 0x088000
[ 8.131781] pci 0000:ff:0d.3: [8086:6feb] type 00 class 0x088000
[ 8.131819] pci 0000:ff:0d.4: [8086:6fec] type 00 class 0x088000
[ 8.131857] pci 0000:ff:0d.5: [8086:6fed] type 00 class 0x088000
[ 8.131894] pci 0000:ff:0d.6: [8086:6fee] type 00 class 0x088000
[ 8.131933] pci 0000:ff:0d.7: [8086:6fef] type 00 class 0x088000
[ 8.131970] pci 0000:ff:0e.0: [8086:6ff0] type 00 class 0x088000
[ 8.132010] pci 0000:ff:0e.1: [8086:6ff1] type 00 class 0x088000
[ 8.132049] pci 0000:ff:0e.2: [8086:6ff2] type 00 class 0xffffff
[ 8.132093] pci 0000:ff:0e.3: [8086:6ff3] type 00 class 0xffffff
[ 8.132133] pci 0000:ff:0e.4: [8086:6ff4] type 00 class 0xffffff
[ 8.132171] pci 0000:ff:0e.5: [8086:6ff5] type 00 class 0xffffff
[ 8.132211] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000
[ 8.132251] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000
[ 8.132291] pci 0000:ff:0f.2: [8086:6ffa] type 00 class 0x088000
[ 8.132332] pci 0000:ff:0f.3: [8086:6ffb] type 00 class 0x088000
[ 8.132372] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000
[ 8.132416] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000
[ 8.132455] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000
[ 8.132495] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000
[ 8.132537] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100
[ 8.132578] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000
[ 8.132616] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100
[ 8.132657] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000
[ 8.132697] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000
[ 8.132727] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100
[ 8.132770] pci 0000:ff:12.4: [8086:6f60] type 00 class 0x088000
[ 8.132800] pci 0000:ff:12.5: [8086:6f38] type 00 class 0x110100
[ 8.132846] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000
[ 8.132924] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000
[ 8.133000] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000
[ 8.133074] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000
[ 8.133153] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000
[ 8.133217] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000
[ 8.133283] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000
[ 8.133356] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000
[ 8.133431] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000
[ 8.133505] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000
[ 8.133577] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000
[ 8.133644] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000
[ 8.133709] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000
[ 8.133774] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000
[ 8.133842] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000
[ 8.133920] pci 0000:ff:16.1: [8086:6f79] type 00 class 0x088000
[ 8.133996] pci 0000:ff:16.2: [8086:6f6a] type 00 class 0x088000
[ 8.134073] pci 0000:ff:16.3: [8086:6f6b] type 00 class 0x088000
[ 8.134149] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000
[ 8.134218] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000
[ 8.134286] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000
[ 8.134365] pci 0000:ff:17.1: [8086:6fd1] type 00 class 0x088000
[ 8.134442] pci 0000:ff:17.2: [8086:6fd2] type 00 class 0x088000
[ 8.134524] pci 0000:ff:17.3: [8086:6fd3] type 00 class 0x088000
[ 8.134601] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000
[ 8.134669] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000
[ 8.134738] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000
[ 8.134807] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000
[ 8.134866] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000
[ 8.134910] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000
[ 8.134953] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000
[ 8.134996] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000
[ 8.135027] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000
[ 8.135076] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000
[ 8.135120] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000
[ 8.135238] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus 7f])
[ 8.135244] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 10.179386] acpi PNP0A03:03: _OSC: platform does not support [PCIeHotplug]
[ 12.227953] acpi PNP0A03:03: _OSC: OS now controls [PME AER PCIeCapability]
[ 12.227957] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration
[ 12.227998] PCI host bridge to bus 0000:7f
[ 12.228002] pci_bus 0000:7f: root bus resource [bus 7f]
[ 12.228012] pci 0000:7f:08.0: [8086:6f80] type 00 class 0x088000
[ 12.228060] pci 0000:7f:08.2: [8086:6f32] type 00 class 0x110100
[ 12.228107] pci 0000:7f:08.3: [8086:6f83] type 00 class 0x088000
[ 12.228165] pci 0000:7f:09.0: [8086:6f90] type 00 class 0x088000
[ 12.228209] pci 0000:7f:09.2: [8086:6f33] type 00 class 0x110100
[ 12.228254] pci 0000:7f:09.3: [8086:6f93] type 00 class 0x088000
[ 12.228307] pci 0000:7f:0b.0: [8086:6f81] type 00 class 0x088000
[ 12.228348] pci 0000:7f:0b.1: [8086:6f36] type 00 class 0x110100
[ 12.228395] pci 0000:7f:0b.2: [8086:6f37] type 00 class 0x110100
[ 12.228436] pci 0000:7f:0b.3: [8086:6f76] type 00 class 0x088000
[ 12.228480] pci 0000:7f:0c.0: [8086:6fe0] type 00 class 0x088000
[ 12.228520] pci 0000:7f:0c.1: [8086:6fe1] type 00 class 0x088000
[ 12.228561] pci 0000:7f:0c.2: [8086:6fe2] type 00 class 0x088000
[ 12.228601] pci 0000:7f:0c.3: [8086:6fe3] type 00 class 0x088000
[ 12.228642] pci 0000:7f:0c.4: [8086:6fe4] type 00 class 0x088000
[ 12.228683] pci 0000:7f:0c.5: [8086:6fe5] type 00 class 0x088000
[ 12.228725] pci 0000:7f:0c.6: [8086:6fe6] type 00 class 0x088000
[ 12.228766] pci 0000:7f:0c.7: [8086:6fe7] type 00 class 0x088000
[ 12.228808] pci 0000:7f:0d.0: [8086:6fe8] type 00 class 0x088000
[ 12.228849] pci 0000:7f:0d.1: [8086:6fe9] type 00 class 0x088000
[ 12.228891] pci 0000:7f:0d.2: [8086:6fea] type 00 class 0x088000
[ 12.228932] pci 0000:7f:0d.3: [8086:6feb] type 00 class 0x088000
[ 12.228973] pci 0000:7f:0d.4: [8086:6fec] type 00 class 0x088000
[ 12.229018] pci 0000:7f:0d.5: [8086:6fed] type 00 class 0x088000
[ 12.229060] pci 0000:7f:0d.6: [8086:6fee] type 00 class 0x088000
[ 12.229101] pci 0000:7f:0d.7: [8086:6fef] type 00 class 0x088000
[ 12.229142] pci 0000:7f:0e.0: [8086:6ff0] type 00 class 0x088000
[ 12.229182] pci 0000:7f:0e.1: [8086:6ff1] type 00 class 0x088000
[ 12.229224] pci 0000:7f:0e.2: [8086:6ff2] type 00 class 0xffffff
[ 12.229264] pci 0000:7f:0e.3: [8086:6ff3] type 00 class 0xffffff
[ 12.229310] pci 0000:7f:0e.4: [8086:6ff4] type 00 class 0xffffff
[ 12.229352] pci 0000:7f:0e.5: [8086:6ff5] type 00 class 0xffffff
[ 12.229400] pci 0000:7f:0f.0: [8086:6ff8] type 00 class 0x088000
[ 12.229443] pci 0000:7f:0f.1: [8086:6ff9] type 00 class 0x088000
[ 12.229486] pci 0000:7f:0f.2: [8086:6ffa] type 00 class 0x088000
[ 12.229528] pci 0000:7f:0f.3: [8086:6ffb] type 00 class 0x088000
[ 12.229571] pci 0000:7f:0f.4: [8086:6ffc] type 00 class 0x088000
[ 12.229614] pci 0000:7f:0f.5: [8086:6ffd] type 00 class 0x088000
[ 12.229658] pci 0000:7f:0f.6: [8086:6ffe] type 00 class 0x088000
[ 12.229703] pci 0000:7f:10.0: [8086:6f1d] type 00 class 0x088000
[ 12.229748] pci 0000:7f:10.1: [8086:6f34] type 00 class 0x110100
[ 12.229794] pci 0000:7f:10.5: [8086:6f1e] type 00 class 0x088000
[ 12.229837] pci 0000:7f:10.6: [8086:6f7d] type 00 class 0x110100
[ 12.229880] pci 0000:7f:10.7: [8086:6f1f] type 00 class 0x088000
[ 12.229925] pci 0000:7f:12.0: [8086:6fa0] type 00 class 0x088000
[ 12.229956] pci 0000:7f:12.1: [8086:6f30] type 00 class 0x110100
[ 12.230004] pci 0000:7f:12.4: [8086:6f60] type 00 class 0x088000
[ 12.230035] pci 0000:7f:12.5: [8086:6f38] type 00 class 0x110100
[ 12.230086] pci 0000:7f:13.0: [8086:6fa8] type 00 class 0x088000
[ 12.230172] pci 0000:7f:13.1: [8086:6f71] type 00 class 0x088000
[ 12.230260] pci 0000:7f:13.2: [8086:6faa] type 00 class 0x088000
[ 12.230341] pci 0000:7f:13.3: [8086:6fab] type 00 class 0x088000
[ 12.230423] pci 0000:7f:13.6: [8086:6fae] type 00 class 0x088000
[ 12.230494] pci 0000:7f:13.7: [8086:6faf] type 00 class 0x088000
[ 12.230565] pci 0000:7f:14.0: [8086:6fb0] type 00 class 0x088000
[ 12.230644] pci 0000:7f:14.1: [8086:6fb1] type 00 class 0x088000
[ 12.230725] pci 0000:7f:14.2: [8086:6fb2] type 00 class 0x088000
[ 12.230808] pci 0000:7f:14.3: [8086:6fb3] type 00 class 0x088000
[ 12.230885] pci 0000:7f:14.4: [8086:6fbc] type 00 class 0x088000
[ 12.230953] pci 0000:7f:14.5: [8086:6fbd] type 00 class 0x088000
[ 12.231021] pci 0000:7f:14.6: [8086:6fbe] type 00 class 0x088000
[ 12.231089] pci 0000:7f:14.7: [8086:6fbf] type 00 class 0x088000
[ 12.231160] pci 0000:7f:16.0: [8086:6f68] type 00 class 0x088000
[ 12.231243] pci 0000:7f:16.1: [8086:6f79] type 00 class 0x088000
[ 12.231326] pci 0000:7f:16.2: [8086:6f6a] type 00 class 0x088000
[ 12.231406] pci 0000:7f:16.3: [8086:6f6b] type 00 class 0x088000
[ 12.231488] pci 0000:7f:16.6: [8086:6f6e] type 00 class 0x088000
[ 12.231558] pci 0000:7f:16.7: [8086:6f6f] type 00 class 0x088000
[ 12.231630] pci 0000:7f:17.0: [8086:6fd0] type 00 class 0x088000
[ 12.231719] pci 0000:7f:17.1: [8086:6fd1] type 00 class 0x088000
[ 12.231800] pci 0000:7f:17.2: [8086:6fd2] type 00 class 0x088000
[ 12.231882] pci 0000:7f:17.3: [8086:6fd3] type 00 class 0x088000
[ 12.231953] pci 0000:7f:17.4: [8086:6fb8] type 00 class 0x088000
[ 12.232000] pci 0000:7f:17.5: [8086:6fb9] type 00 class 0x088000
[ 12.232047] pci 0000:7f:17.6: [8086:6fba] type 00 class 0x088000
[ 12.232094] pci 0000:7f:17.7: [8086:6fbb] type 00 class 0x088000
[ 12.232154] pci 0000:7f:1e.0: [8086:6f98] type 00 class 0x088000
[ 12.232200] pci 0000:7f:1e.1: [8086:6f99] type 00 class 0x088000
[ 12.232247] pci 0000:7f:1e.2: [8086:6f9a] type 00 class 0x088000
[ 12.232293] pci 0000:7f:1e.3: [8086:6fc0] type 00 class 0x088000
[ 12.232328] pci 0000:7f:1e.4: [8086:6f9c] type 00 class 0x088000
[ 12.232381] pci 0000:7f:1f.0: [8086:6f88] type 00 class 0x088000
[ 12.232429] pci 0000:7f:1f.2: [8086:6f8a] type 00 class 0x088000
[ 12.242774] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[ 12.242780] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 12.244694] acpi PNP0A08:00: _OSC: platform does not support [AER]
[ 12.245492] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 12.245497] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[ 12.245822] PCI host bridge to bus 0000:00
[ 12.245827] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 12.245830] pci_bus 0000:00: root bus resource [io 0x1000-0x7fff window]
[ 12.245834] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 12.245839] pci_bus 0000:00: root bus resource [mem 0x90000000-0xc7ffbfff window]
[ 12.245844] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x383fffffffff window]
[ 12.245848] pci_bus 0000:00: root bus resource [bus 00-7e]
[ 12.245858] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000
[ 12.246002] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400
[ 12.246049] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[ 12.246123] pci 0000:00:01.0: System wakeup disabled by ACPI
[ 12.246157] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400
[ 12.246203] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[ 12.246275] pci 0000:00:02.0: System wakeup disabled by ACPI
[ 12.246313] pci 0000:00:02.2: [8086:6f06] type 01 class 0x060400
[ 12.246359] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[ 12.246432] pci 0000:00:02.2: System wakeup disabled by ACPI
[ 12.246466] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400
[ 12.246512] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[ 12.246583] pci 0000:00:03.0: System wakeup disabled by ACPI
[ 12.246617] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000
[ 12.246627] pci 0000:00:04.0: reg 0x10: [mem 0x383fff12c000-0x383fff12ffff 64bit]
[ 12.246751] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000
[ 12.246761] pci 0000:00:04.1: reg 0x10: [mem 0x383fff128000-0x383fff12bfff 64bit]
[ 12.246894] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000
[ 12.246903] pci 0000:00:04.2: reg 0x10: [mem 0x383fff124000-0x383fff127fff 64bit]
[ 12.247027] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000
[ 12.247036] pci 0000:00:04.3: reg 0x10: [mem 0x383fff120000-0x383fff123fff 64bit]
[ 12.247159] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000
[ 12.247168] pci 0000:00:04.4: reg 0x10: [mem 0x383fff11c000-0x383fff11ffff 64bit]
[ 12.247292] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000
[ 12.247301] pci 0000:00:04.5: reg 0x10: [mem 0x383fff118000-0x383fff11bfff 64bit]
[ 12.247425] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000
[ 12.247434] pci 0000:00:04.6: reg 0x10: [mem 0x383fff114000-0x383fff117fff 64bit]
[ 12.247559] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000
[ 12.247569] pci 0000:00:04.7: reg 0x10: [mem 0x383fff110000-0x383fff113fff 64bit]
[ 12.247693] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000
[ 12.247810] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000
[ 12.247943] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000
[ 12.248060] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020
[ 12.248067] pci 0000:00:05.4: reg 0x10: [mem 0x91a06000-0x91a06fff]
[ 12.248201] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000
[ 12.248387] pci 0000:00:11.1: [8086:8d7d] type 00 class 0x0c0500
[ 12.248401] pci 0000:00:11.1: reg 0x10: [mem 0x91a05000-0x91a05fff]
[ 12.248434] pci 0000:00:11.1: reg 0x20: [io 0x3060-0x307f]
[ 12.248589] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601
[ 12.248604] pci 0000:00:11.4: reg 0x10: [io 0x3098-0x309f]
[ 12.248612] pci 0000:00:11.4: reg 0x14: [io 0x30cc-0x30cf]
[ 12.248620] pci 0000:00:11.4: reg 0x18: [io 0x3090-0x3097]
[ 12.248628] pci 0000:00:11.4: reg 0x1c: [io 0x30c8-0x30cb]
[ 12.248636] pci 0000:00:11.4: reg 0x20: [io 0x3020-0x303f]
[ 12.248644] pci 0000:00:11.4: reg 0x24: [mem 0x91a00000-0x91a007ff]
[ 12.248686] pci 0000:00:11.4: PME# supported from D3hot
[ 12.248790] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330
[ 12.248807] pci 0000:00:14.0: reg 0x10: [mem 0x383fff100000-0x383fff10ffff 64bit]
[ 12.248867] pci 0000:00:14.0: PME# supported from D3hot D3cold
[ 12.248949] pci 0000:00:14.0: System wakeup disabled by ACPI
[ 12.248989] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000
[ 12.249006] pci 0000:00:16.0: reg 0x10: [mem 0x383fff133000-0x383fff13300f 64bit]
[ 12.249068] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[ 12.249165] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000
[ 12.249182] pci 0000:00:16.1: reg 0x10: [mem 0x383fff132000-0x383fff13200f 64bit]
[ 12.249244] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
[ 12.249348] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320
[ 12.249365] pci 0000:00:1a.0: reg 0x10: [mem 0x91a02000-0x91a023ff]
[ 12.249448] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[ 12.249531] pci 0000:00:1a.0: System wakeup disabled by ACPI
[ 12.249567] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400
[ 12.249633] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[ 12.249705] pci 0000:00:1c.0: System wakeup disabled by ACPI
[ 12.249746] pci 0000:00:1c.3: [8086:8d16] type 01 class 0x060400
[ 12.249813] pci 0000:00:1c.3: PME# supported from D0 D3hot D3cold
[ 12.249880] pci 0000:00:1c.3: System wakeup disabled by ACPI
[ 12.249921] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320
[ 12.249938] pci 0000:00:1d.0: reg 0x10: [mem 0x91a01000-0x91a013ff]
[ 12.250021] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[ 12.250097] pci 0000:00:1d.0: System wakeup disabled by ACPI
[ 12.250133] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100
[ 12.250322] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601
[ 12.250335] pci 0000:00:1f.2: reg 0x10: [io 0x30c0-0x30c7]
[ 12.250342] pci 0000:00:1f.2: reg 0x14: [io 0x30dc-0x30df]
[ 12.250349] pci 0000:00:1f.2: reg 0x18: [io 0x30b8-0x30bf]
[ 12.250356] pci 0000:00:1f.2: reg 0x1c: [io 0x30d8-0x30db]
[ 12.250362] pci 0000:00:1f.2: reg 0x20: [io 0x3040-0x305f]
[ 12.250369] pci 0000:00:1f.2: reg 0x24: [mem 0x91a04000-0x91a047ff]
[ 12.250405] pci 0000:00:1f.2: PME# supported from D3hot
[ 12.250502] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500
[ 12.250516] pci 0000:00:1f.3: reg 0x10: [mem 0x383fff131000-0x383fff1310ff 64bit]
[ 12.250536] pci 0000:00:1f.3: reg 0x20: [io 0x3000-0x301f]
[ 12.250791] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 12.250940] pci 0000:00:02.0: PCI bridge to [bus 02]
[ 12.251105] pci 0000:03:00.0: [8086:1521] type 00 class 0x020000
[ 12.251117] pci 0000:03:00.0: reg 0x10: [mem 0x91920000-0x9193ffff]
[ 12.251130] pci 0000:03:00.0: reg 0x18: [io 0x2020-0x203f]
[ 12.251137] pci 0000:03:00.0: reg 0x1c: [mem 0x91944000-0x91947fff]
[ 12.251212] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[ 12.251238] pci 0000:03:00.0: reg 0x184: [mem 0x383fff060000-0x383fff063fff 64bit pref]
[ 12.251240] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x383fff060000-0x383fff07ffff 64bit pref] (contains BAR0 for 8 VFs)
[ 12.251258] pci 0000:03:00.0: reg 0x190: [mem 0x383fff040000-0x383fff043fff 64bit pref]
[ 12.251260] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x383fff040000-0x383fff05ffff 64bit pref] (contains BAR3 for 8 VFs)
[ 12.251355] pci 0000:03:00.3: [8086:1521] type 00 class 0x020000
[ 12.251367] pci 0000:03:00.3: reg 0x10: [mem 0x91900000-0x9191ffff]
[ 12.251380] pci 0000:03:00.3: reg 0x18: [io 0x2000-0x201f]
[ 12.251387] pci 0000:03:00.3: reg 0x1c: [mem 0x91940000-0x91943fff]
[ 12.251459] pci 0000:03:00.3: PME# supported from D0 D3hot D3cold
[ 12.251481] pci 0000:03:00.3: reg 0x184: [mem 0x383fff020000-0x383fff023fff 64bit pref]
[ 12.251482] pci 0000:03:00.3: VF(n) BAR0 space: [mem 0x383fff020000-0x383fff03ffff 64bit pref] (contains BAR0 for 8 VFs)
[ 12.251500] pci 0000:03:00.3: reg 0x190: [mem 0x383fff000000-0x383fff003fff 64bit pref]
[ 12.251501] pci 0000:03:00.3: VF(n) BAR3 space: [mem 0x383fff000000-0x383fff01ffff 64bit pref] (contains BAR3 for 8 VFs)
[ 12.254882] pci 0000:00:02.2: PCI bridge to [bus 03-04]
[ 12.254887] pci 0000:00:02.2: bridge window [io 0x2000-0x2fff]
[ 12.254889] pci 0000:00:02.2: bridge window [mem 0x91900000-0x919fffff]
[ 12.254892] pci 0000:00:02.2: bridge window [mem 0x383fff000000-0x383fff0fffff 64bit pref]
[ 12.255202] pci 0000:05:00.0: [15b3:1015] type 00 class 0x020000
[ 12.255334] pci 0000:05:00.0: reg 0x10: [mem 0x383ffc000000-0x383ffdffffff 64bit pref]
[ 12.255639] pci 0000:05:00.0: reg 0x30: [mem 0xfff00000-0xffffffff pref]
[ 12.256278] pci 0000:05:00.0: PME# supported from D3cold
[ 12.256550] pci 0000:05:00.0: reg 0x1a4: [mem 0x383ffe800000-0x383ffe8fffff 64bit pref]
[ 12.256552] pci 0000:05:00.0: VF(n) BAR0 space: [mem 0x383ffe800000-0x383ffeffffff 64bit pref] (contains BAR0 for 8 VFs)
[ 12.257425] pci 0000:05:00.1: [15b3:1015] type 00 class 0x020000
[ 12.257555] pci 0000:05:00.1: reg 0x10: [mem 0x383ffa000000-0x383ffbffffff 64bit pref]
[ 12.257859] pci 0000:05:00.1: reg 0x30: [mem 0xfff00000-0xffffffff pref]
[ 12.258459] pci 0000:05:00.1: PME# supported from D3cold
[ 12.258711] pci 0000:05:00.1: reg 0x1a4: [mem 0x383ffe000000-0x383ffe0fffff 64bit pref]
[ 12.258713] pci 0000:05:00.1: VF(n) BAR0 space: [mem 0x383ffe000000-0x383ffe7fffff 64bit pref] (contains BAR0 for 8 VFs)
[ 12.259577] pci 0000:00:03.0: PCI bridge to [bus 05-06]
[ 12.259585] pci 0000:00:03.0: bridge window [mem 0x383ffa000000-0x383ffeffffff 64bit pref]
[ 12.259630] pci 0000:00:1c.0: PCI bridge to [bus 07]
[ 12.259699] pci 0000:08:00.0: [102b:0522] type 00 class 0x030000
[ 12.259723] pci 0000:08:00.0: reg 0x10: [mem 0x90000000-0x90ffffff pref]
[ 12.259737] pci 0000:08:00.0: reg 0x14: [mem 0x91800000-0x91803fff]
[ 12.259751] pci 0000:08:00.0: reg 0x18: [mem 0x91000000-0x917fffff]
[ 12.259805] pci 0000:08:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 12.270892] pci 0000:00:1c.3: PCI bridge to [bus 08]
[ 12.270899] pci 0000:00:1c.3: bridge window [mem 0x91000000-0x918fffff]
[ 12.270903] pci 0000:00:1c.3: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 12.270931] pci_bus 0000:00: on NUMA node 0
[ 12.271278] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 *10 11 12 14 15)
[ 12.271328] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *9 10 11 12 14 15)
[ 12.271374] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 7 9 10 11 12 14 15)
[ 12.271420] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[ 12.271466] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[ 12.271512] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 12.271559] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 12.271605] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 12.271903] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[ 12.271909] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 12.272370] acpi PNP0A08:01: _OSC: platform does not support [AER]
[ 12.273159] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 12.273164] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[ 12.273350] PCI host bridge to bus 0000:80
[ 12.273354] pci_bus 0000:80: root bus resource [io 0x8000-0xffff window]
[ 12.273358] pci_bus 0000:80: root bus resource [mem 0xc8000000-0xfbffbfff window]
[ 12.273363] pci_bus 0000:80: root bus resource [mem 0x384000000000-0x387fffffffff window]
[ 12.273368] pci_bus 0000:80: root bus resource [bus 80-fe]
[ 12.273379] pci 0000:80:04.0: [8086:6f20] type 00 class 0x088000
[ 12.273389] pci 0000:80:04.0: reg 0x10: [mem 0x387ffff1c000-0x387ffff1ffff 64bit]
[ 12.273496] pci 0000:80:04.1: [8086:6f21] type 00 class 0x088000
[ 12.273504] pci 0000:80:04.1: reg 0x10: [mem 0x387ffff18000-0x387ffff1bfff 64bit]
[ 12.273601] pci 0000:80:04.2: [8086:6f22] type 00 class 0x088000
[ 12.273609] pci 0000:80:04.2: reg 0x10: [mem 0x387ffff14000-0x387ffff17fff 64bit]
[ 12.273703] pci 0000:80:04.3: [8086:6f23] type 00 class 0x088000
[ 12.273712] pci 0000:80:04.3: reg 0x10: [mem 0x387ffff10000-0x387ffff13fff 64bit]
[ 12.273806] pci 0000:80:04.4: [8086:6f24] type 00 class 0x088000
[ 12.273815] pci 0000:80:04.4: reg 0x10: [mem 0x387ffff0c000-0x387ffff0ffff 64bit]
[ 12.273905] pci 0000:80:04.5: [8086:6f25] type 00 class 0x088000
[ 12.273913] pci 0000:80:04.5: reg 0x10: [mem 0x387ffff08000-0x387ffff0bfff 64bit]
[ 12.274015] pci 0000:80:04.6: [8086:6f26] type 00 class 0x088000
[ 12.274024] pci 0000:80:04.6: reg 0x10: [mem 0x387ffff04000-0x387ffff07fff 64bit]
[ 12.274116] pci 0000:80:04.7: [8086:6f27] type 00 class 0x088000
[ 12.274125] pci 0000:80:04.7: reg 0x10: [mem 0x387ffff00000-0x387ffff03fff 64bit]
[ 12.274216] pci 0000:80:05.0: [8086:6f28] type 00 class 0x088000
[ 12.274303] pci 0000:80:05.1: [8086:6f29] type 00 class 0x088000
[ 12.274410] pci 0000:80:05.2: [8086:6f2a] type 00 class 0x088000
[ 12.274496] pci 0000:80:05.4: [8086:6f2c] type 00 class 0x080020
[ 12.274502] pci 0000:80:05.4: reg 0x10: [mem 0xc8000000-0xc8000fff]
[ 12.274601] pci_bus 0000:80: on NUMA node 1
[ 12.274892] ACPI: Enabled 4 GPEs in block 00 to 3F
[ 12.275204] pci 0000:08:00.0: vgaarb: setting as boot VGA device
[ 12.275211] pci 0000:08:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[ 12.275222] pci 0000:08:00.0: vgaarb: bridge control possible
[ 12.275225] vgaarb: loaded
[ 12.275453] SCSI subsystem initialized
[ 12.275553] libata version 3.00 loaded.
[ 12.275577] ACPI: bus type USB registered
[ 12.275592] usbcore: registered new interface driver usbfs
[ 12.275601] usbcore: registered new interface driver hub
[ 12.275712] usbcore: registered new device driver usb
[ 12.275972] PCI: Using ACPI for IRQ routing
[ 12.280287] PCI: pci_cache_line_size set to 64 bytes
[ 12.280550] e820: reserve RAM buffer [mem 0x0009b400-0x0009ffff]
[ 12.280552] e820: reserve RAM buffer [mem 0x79fc6000-0x7bffffff]
[ 12.280553] e820: reserve RAM buffer [mem 0x7b800000-0x7bffffff]
[ 12.280655] NetLabel: Initializing
[ 12.280658] NetLabel: domain hash size = 128
[ 12.280660] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 12.280677] NetLabel: unlabeled traffic allowed by default
[ 12.280799] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[ 12.280807] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[ 12.282922] clocksource: Switched to clocksource hpet
[ 12.295393] VFS: Disk quotas dquot_6.6.0
[ 12.295434] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 12.295562] AppArmor: AppArmor Filesystem Enabled
[ 12.295600] pnp: PnP ACPI init
[ 12.296465] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[ 12.296608] system 00:01: [io 0x0500-0x053f] has been reserved
[ 12.296613] system 00:01: [io 0x0400-0x047f] has been reserved
[ 12.296617] system 00:01: [io 0x0540-0x057f] has been reserved
[ 12.296620] system 00:01: [io 0x0600-0x061f] has been reserved
[ 12.296630] system 00:01: [io 0x0ca0-0x0ca5] has been reserved
[ 12.296633] system 00:01: [io 0x0880-0x0883] has been reserved
[ 12.296636] system 00:01: [io 0x0800-0x081f] has been reserved
[ 12.296641] system 00:01: [mem 0xfed1c000-0xfed3ffff] could not be reserved
[ 12.296645] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved
[ 12.296648] system 00:01: [mem 0xff000000-0xffffffff] could not be reserved
[ 12.296652] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved
[ 12.296655] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved
[ 12.296659] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved
[ 12.296663] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved
[ 12.296667] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[ 12.296819] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active)
[ 12.296948] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[ 12.297238] pnp: PnP ACPI: found 4 devices
[ 12.303315] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 12.303327] pci 0000:05:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window
[ 12.303333] pci 0000:05:00.1: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window
[ 12.303339] pci 0000:08:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 12.303414] pci 0000:00:03.0: BAR 14: assigned [mem 0x91b00000-0x91cfffff]
[ 12.303419] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 12.303427] pci 0000:00:02.0: PCI bridge to [bus 02]
[ 12.303436] pci 0000:00:02.2: PCI bridge to [bus 03-04]
[ 12.303440] pci 0000:00:02.2: bridge window [io 0x2000-0x2fff]
[ 12.303444] pci 0000:00:02.2: bridge window [mem 0x91900000-0x919fffff]
[ 12.303449] pci 0000:00:02.2: bridge window [mem 0x383fff000000-0x383fff0fffff 64bit pref]
[ 12.303457] pci 0000:05:00.0: BAR 6: assigned [mem 0x91b00000-0x91bfffff pref]
[ 12.303462] pci 0000:05:00.1: BAR 6: assigned [mem 0x91c00000-0x91cfffff pref]
[ 12.303467] pci 0000:00:03.0: PCI bridge to [bus 05-06]
[ 12.303471] pci 0000:00:03.0: bridge window [mem 0x91b00000-0x91cfffff]
[ 12.303476] pci 0000:00:03.0: bridge window [mem 0x383ffa000000-0x383ffeffffff 64bit pref]
[ 12.303483] pci 0000:00:1c.0: PCI bridge to [bus 07]
[ 12.303495] pci 0000:08:00.0: BAR 6: assigned [mem 0x91810000-0x9181ffff pref]
[ 12.303500] pci 0000:00:1c.3: PCI bridge to [bus 08]
[ 12.303505] pci 0000:00:1c.3: bridge window [mem 0x91000000-0x918fffff]
[ 12.303511] pci 0000:00:1c.3: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 12.303520] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
[ 12.303521] pci_bus 0000:00: resource 5 [io 0x1000-0x7fff window]
[ 12.303522] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[ 12.303523] pci_bus 0000:00: resource 7 [mem 0x90000000-0xc7ffbfff window]
[ 12.303524] pci_bus 0000:00: resource 8 [mem 0x380000000000-0x383fffffffff window]
[ 12.303525] pci_bus 0000:03: resource 0 [io 0x2000-0x2fff]
[ 12.303526] pci_bus 0000:03: resource 1 [mem 0x91900000-0x919fffff]
[ 12.303528] pci_bus 0000:03: resource 2 [mem 0x383fff000000-0x383fff0fffff 64bit pref]
[ 12.303529] pci_bus 0000:05: resource 1 [mem 0x91b00000-0x91cfffff]
[ 12.303530] pci_bus 0000:05: resource 2 [mem 0x383ffa000000-0x383ffeffffff 64bit pref]
[ 12.303531] pci_bus 0000:08: resource 1 [mem 0x91000000-0x918fffff]
[ 12.303532] pci_bus 0000:08: resource 2 [mem 0x90000000-0x90ffffff 64bit pref]
[ 12.303648] pci_bus 0000:80: resource 4 [io 0x8000-0xffff window]
[ 12.303649] pci_bus 0000:80: resource 5 [mem 0xc8000000-0xfbffbfff window]
[ 12.303650] pci_bus 0000:80: resource 6 [mem 0x384000000000-0x387fffffffff window]
[ 12.303789] NET: Registered protocol family 2
[ 12.304277] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[ 12.304983] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 12.305154] TCP: Hash tables configured (established 524288 bind 65536)
[ 12.305292] UDP hash table entries: 32768 (order: 8, 1048576 bytes)
[ 12.305498] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes)
[ 12.305844] NET: Registered protocol family 1
[ 12.363275] pci 0000:08:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[ 12.363300] PCI: CLS 32 bytes, default 64
[ 12.363339] Unpacking initramfs...
[ 13.055838] Freeing initrd memory: 41540K
[ 13.055879] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 13.055883] software IO TLB [mem 0x75fc6000-0x79fc6000] (64MB) mapped at [ffff8a13b5fc6000-ffff8a13b9fc5fff]
[ 13.055928] Intel CQM monitoring enabled
[ 13.055930] Intel MBM enabled
[ 13.058613] Scanning for low memory corruption every 60 seconds
[ 13.059477] audit: initializing netlink subsys (disabled)
[ 13.060463] Initialise system trusted keyrings
[ 13.060531] workingset: timestamp_bits=36 max_order=24 bucket_order=0
[ 13.061736] zbud: loaded
[ 13.062478] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 13.062678] fuse init (API version 7.26)
[ 13.064832] Key type asymmetric registered
[ 13.064836] Asymmetric key parser 'x509' registered
[ 13.064849] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[ 13.064926] io scheduler noop registered
[ 13.064929] io scheduler deadline registered
[ 13.064964] io scheduler cfq registered (default)
[ 13.066437] pcieport 0000:00:01.0: Signaling PME with IRQ 25
[ 13.066465] pcieport 0000:00:02.0: Signaling PME with IRQ 26
[ 13.066481] pcieport 0000:00:02.2: Signaling PME with IRQ 27
[ 13.066495] pcieport 0000:00:03.0: Signaling PME with IRQ 28
[ 13.066511] pcieport 0000:00:1c.0: Signaling PME with IRQ 29
[ 13.066529] pcieport 0000:00:1c.3: Signaling PME with IRQ 30
[ 13.066597] vesafb: mode is 640x480x32, linelength=2560, pages=0
[ 13.066600] vesafb: scrolling: redraw
[ 13.066604] vesafb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[ 13.066620] vesafb: framebuffer at 0x90000000, mapped to 0xffffb87688600000, using 1216k, total 1216k
[ 13.153170] Console: switching to colour frame buffer device 80x30
[ 13.242225] fb0: VESA VGA frame buffer device
[ 13.244046] intel_idle: MWAIT substates: 0x2120
[ 13.244047] intel_idle: v0.4.1 model 0x4F
[ 13.245759] intel_idle: lapic_timer_reliable_states 0xffffffff
[ 13.245917] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 13.248980] ACPI: Power Button [PWRF]
[ 13.305430] ERST: Error Record Serialization Table (ERST) support is initialized.
[ 13.401112] pstore: using zlib compression
[ 13.449006] pstore: Registered erst as persistent store backend
[ 13.497519] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[ 13.593899] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 13.664986] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 13.786610] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[ 13.889891] Linux agpgart interface v0.103
[ 13.954139] loop: module loaded
[ 14.006623] libphy: Fixed MDIO Bus: probed
[ 14.058628] tun: Universal TUN/TAP device driver, 1.6
[ 14.112375] tsc: Refined TSC clocksource calibration: 2194.917 MHz
[ 14.168342] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x1fa37107ca2, max_idle_ns: 440795258165 ns
[ 14.168627] PPP generic driver version 2.4.2
[ 14.168722] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 14.168726] ehci-pci: EHCI PCI platform driver
[ 14.168985] ehci-pci 0000:00:1a.0: EHCI Host Controller
[ 14.168991] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[ 14.169039] ehci-pci 0000:00:1a.0: debug port 2
[ 14.173029] ehci-pci 0000:00:1a.0: cache line size of 32 is not supported
[ 14.173042] ehci-pci 0000:00:1a.0: irq 18, io mem 0x91a02000
[ 14.187028] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[ 14.187071] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[ 14.187073] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.187074] usb usb1: Product: EHCI Host Controller
[ 14.187075] usb usb1: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence ehci_hcd
[ 14.187076] usb usb1: SerialNumber: 0000:00:1a.0
[ 14.187264] hub 1-0:1.0: USB hub found
[ 14.187268] hub 1-0:1.0: 2 ports detected
[ 14.187582] ehci-pci 0000:00:1d.0: EHCI Host Controller
[ 14.187587] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[ 14.187636] ehci-pci 0000:00:1d.0: debug port 2
[ 14.191617] ehci-pci 0000:00:1d.0: cache line size of 32 is not supported
[ 14.191622] ehci-pci 0000:00:1d.0: irq 18, io mem 0x91a01000
[ 14.203019] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[ 14.203072] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[ 14.203074] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.203076] usb usb2: Product: EHCI Host Controller
[ 14.203078] usb usb2: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence ehci_hcd
[ 14.203079] usb usb2: SerialNumber: 0000:00:1d.0
[ 14.203271] hub 2-0:1.0: USB hub found
[ 14.203274] hub 2-0:1.0: 2 ports detected
[ 14.203424] ehci-platform: EHCI generic platform driver
[ 14.203436] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 14.203439] ohci-pci: OHCI PCI platform driver
[ 14.203469] ohci-platform: OHCI generic platform driver
[ 14.203475] uhci_hcd: USB Universal Host Controller Interface driver
[ 14.203690] xhci_hcd 0000:00:14.0: xHCI Host Controller
[ 14.203695] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3
[ 14.205085] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x00009810
[ 14.205103] xhci_hcd 0000:00:14.0: cache line size of 32 is not supported
[ 14.205338] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[ 14.205339] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.205340] usb usb3: Product: xHCI Host Controller
[ 14.205341] usb usb3: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence xhci-hcd
[ 14.205342] usb usb3: SerialNumber: 0000:00:14.0
[ 14.205531] hub 3-0:1.0: USB hub found
[ 14.205604] hub 3-0:1.0: 15 ports detected
[ 14.208558] xhci_hcd 0000:00:14.0: xHCI Host Controller
[ 14.208561] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4
[ 14.208604] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
[ 14.208606] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.208607] usb usb4: Product: xHCI Host Controller
[ 14.208608] usb usb4: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence xhci-hcd
[ 14.208609] usb usb4: SerialNumber: 0000:00:14.0
[ 14.208775] hub 4-0:1.0: USB hub found
[ 14.208805] hub 4-0:1.0: 6 ports detected
[ 14.210187] i8042: PNP: No PS/2 controller found.
[ 14.210353] mousedev: PS/2 mouse device common for all mice
[ 14.210555] rtc_cmos 00:00: RTC can wake from S4
[ 14.211124] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[ 14.211233] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[ 14.211238] i2c /dev entries driver
[ 14.211294] device-mapper: uevent: version 1.0.3
[ 14.211414] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com
[ 14.211423] intel_pstate: Intel P-state driver initializing
[ 14.518993] usb 1-1: new high-speed USB device number 2 using ehci-pci
[ 14.538999] usb 3-1: new low-speed USB device number 2 using xhci_hcd
[ 14.539014] usb 2-1: new high-speed USB device number 2 using ehci-pci
[ 14.667635] usb 1-1: New USB device found, idVendor=8087, idProduct=800a
[ 14.667636] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 14.667898] hub 1-1:1.0: USB hub found
[ 14.668129] hub 1-1:1.0: 6 ports detected
[ 14.686377] usb 3-1: New USB device found, idVendor=14dd, idProduct=1007
[ 14.686378] usb 3-1: New USB device strings: Mfr=1, Product=2, SerialNumber=7
[ 14.686379] usb 3-1: Product: D2CIM-DVUSB
[ 14.686380] usb 3-1: Manufacturer: Raritan
[ 14.686380] usb 3-1: SerialNumber: PQ254006640000007
[ 14.687508] usb 2-1: New USB device found, idVendor=8087, idProduct=8002
[ 14.687509] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 14.687775] hub 2-1:1.0: USB hub found
[ 14.687897] hub 2-1:1.0: 8 ports detected
[ 14.810990] usb 3-9: new full-speed USB device number 3 using xhci_hcd
[ 14.972512] usb 3-9: New USB device found, idVendor=046b, idProduct=ff10
[ 14.972513] usb 3-9: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 14.972514] usb 3-9: Product: Virtual Keyboard and Mouse
[ 14.972515] usb 3-9: Manufacturer: American Megatrends Inc.
[ 14.972515] usb 3-9: SerialNumber: serial
[ 19.567413] ledtrig-cpu: registered to indicate activity on CPUs
[ 19.619846] NET: Registered protocol family 10
[ 19.674470] Segment Routing with IPv6
[ 19.725207] NET: Registered protocol family 17
[ 19.776333] Key type dns_resolver registered
[ 19.834956] intel_rdt: Intel RDT L3 allocation detected
[ 19.884992] intel_rdt: Intel RDT L3DATA allocation detected
[ 19.934051] intel_rdt: Intel RDT L3CODE allocation detected
[ 19.981395] microcode: sig=0x406f1, pf=0x1, revision=0xb000017
[ 20.031097] microcode: Microcode Update Driver: v2.2.
[ 20.031254] registered taskstats version 1
[ 20.124767] Loading compiled-in X.509 certificates
[ 20.173457] Loaded X.509 cert 'Build time autogenerated kernel key: de39ac008d1fce01b49462a1060a30c176fa995c'
[ 20.269373] zswap: loaded using pool lzo/zbud
[ 20.326747] Key type big_key registered
[ 20.374360] Key type trusted registered
[ 20.421734] Key type encrypted registered
[ 20.467951] AppArmor: AppArmor sha1 policy hashing enabled
[ 20.515525] ima: No TPM chip found, activating TPM-bypass! (rc=-19)
[ 20.563545] evm: HMAC attrs: 0x1
[ 20.610698] clocksource: Switched to clocksource tsc
[ 20.611908] Magic number: 13:895:942
[ 20.658140] rtc_cmos 00:00: setting system clock to 2017-04-19 15:56:33 UTC (1492617393)
[ 20.658249] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[ 20.658250] EDD information not available.
[ 20.903629] PM: Hibernation image not present or could not be loaded.
[ 20.905280] Freeing unused kernel memory: 2212K
[ 20.955074] Write protecting the kernel read-only data: 14336k
[ 21.006666] Freeing unused kernel memory: 1148K
[ 21.057382] Freeing unused kernel memory: 212K
[ 21.107423] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 21.268194] random: systemd-udevd: uninitialized urandom read (16 bytes read)
[ 21.268848] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.268871] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.271659] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.271691] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.271720] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.271770] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.271799] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.271825] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.271855] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.760672] wmi: Mapper loaded
[ 21.801428] pps_core: LinuxPPS API ver. 1 registered
[ 21.842907] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 21.929073] hidraw: raw HID events driver (C) Jiri Kosina
[ 21.973238] PTP clock support registered
[ 21.973818] ahci 0000:00:11.4: version 3.0
[ 21.974310] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode
[ 21.974311] ahci 0000:00:11.4: flags: 64bit ncq led clo pio slum part ems apst
[ 22.007319] scsi host0: ahci
[ 22.007419] scsi host1: ahci
[ 22.010935] scsi host2: ahci
[ 22.011037] scsi host3: ahci
[ 22.011086] ata1: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00100 irq 32
[ 22.011093] ata2: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00180 irq 32
[ 22.011099] ata3: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00200 irq 32
[ 22.011106] ata4: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00280 irq 32
[ 22.011619] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[ 22.011621] ahci 0000:00:1f.2: flags: 64bit ncq led clo pio slum part ems apst
[ 22.071435] scsi host4: ahci
[ 22.074935] scsi host5: ahci
[ 22.075033] scsi host6: ahci
[ 22.078908] scsi host7: ahci
[ 22.078988] scsi host8: ahci
[ 22.082907] scsi host9: ahci
[ 22.082947] ata5: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04100 irq 33
[ 22.082953] ata6: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04180 irq 33
[ 22.082960] ata7: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04200 irq 33
[ 22.082966] ata8: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04280 irq 33
[ 22.082973] ata9: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04300 irq 33
[ 22.082980] ata10: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04380 irq 33
[ 22.329873] ata2: SATA link down (SStatus 0 SControl 300)
[ 22.329969] ata1: SATA link down (SStatus 0 SControl 300)
[ 22.330068] ata4: SATA link down (SStatus 0 SControl 300)
[ 22.330167] ata3: SATA link down (SStatus 0 SControl 300)
[ 22.398010] ata5: SATA link down (SStatus 0 SControl 300)
[ 22.401802] ata10: SATA link down (SStatus 0 SControl 300)
[ 22.401891] ata7: SATA link down (SStatus 0 SControl 300)
[ 22.401988] ata6: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[ 22.402064] ata8: SATA link down (SStatus 0 SControl 300)
[ 22.402154] ata9: SATA link down (SStatus 0 SControl 300)
[ 22.402488] ata6.00: ATA-9: INTEL SSDSC2BB240G6, G2010140, max UDMA/133
[ 22.402489] ata6.00: 468862128 sectors, multi 1: LBA48 NCQ (depth 31/32)
[ 22.403041] ata6.00: configured for UDMA/133
[ 22.403273] scsi 5:0:0:0: Direct-Access ATA INTEL SSDSC2BB24 0140 PQ: 0 ANSI: 5
[ 24.654350] AVX2 version of gcm_enc/dec engaged.
[ 24.665203] usbcore: registered new interface driver usbhid
[ 24.665204] usbhid: USB HID core driver
[ 24.818086] AES CTR mode by8 optimization enabled
[ 24.871934] dca service started, version 1.12.1
[ 25.012012] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.0/0003:14DD:1007.0001/input/input1
[ 25.118957] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[ 25.119279] mlx5_core 0000:05:00.0: firmware version: 14.18.2000
[ 25.175038] hid-generic 0003:14DD:1007.0001: input,hidraw0: USB HID v1.10 Keyboard [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input0
[ 25.175150] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.1/0003:14DD:1007.0002/input/input2
[ 25.175211] hid-generic 0003:14DD:1007.0002: input,hidraw1: USB HID v1.10 Mouse [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input1
[ 25.175860] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.2/0003:14DD:1007.0003/input/input3
[ 25.175962] hid-generic 0003:14DD:1007.0003: input,hidraw2: USB HID v1.10 Mouse [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input2
[ 25.176075] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb3/3-9/3-9:1.0/0003:046B:FF10.0004/input/input4
[ 25.176115] hid-generic 0003:046B:FF10.0004: input,hidraw3: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:14.0-9/input0
[ 25.176210] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb3/3-9/3-9:1.1/0003:046B:FF10.0005/input/input5
[ 25.176264] hid-generic 0003:046B:FF10.0005: input,hidraw4: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:14.0-9/input1
[ 25.861282] (0000:05:00.0): E-Switch: Total vports 9, l2 table size(65536), per vport: max uc(1024) max mc(16384)
[ 25.882808] mlx5_core 0000:05:00.0: Port module event: module 0, Cable plugged
[ 25.896414] mlx5_core 0000:05:00.1: firmware version: 14.18.2000
[ 26.639637] (0000:05:00.1): E-Switch: Total vports 9, l2 table size(65536), per vport: max uc(1024) max mc(16384)
[ 26.660963] mlx5_core 0000:05:00.1: Port module event: module 1, Cable plugged
[ 26.674075] mlx5_core 0000:05:00.0: MLX5E: StrdRq(1) RqSz(8) StrdSz(64) RxCqeCmprss(0)
[ 26.734487] random: fast init done
[ 26.857156] mlx5_core 0000:05:00.1: MLX5E: StrdRq(1) RqSz(8) StrdSz(64) RxCqeCmprss(0)
[ 27.418044] mlx5_core 0000:05:00.0 ens785f0: renamed from eth0
[ 27.696387] igb: Copyright (c) 2007-2014 Intel Corporation.
[ 27.823034] ata6.00: Enabling discard_zeroes_data
[ 27.823054] sd 5:0:0:0: Attached scsi generic sg0 type 0
[ 27.847374] mlx5_core 0000:05:00.1 ens785f1: renamed from eth1
[ 28.049059] sd 5:0:0:0: [sda] 468862128 512-byte logical blocks: (240 GB/224 GiB)
[ 28.194958] sd 5:0:0:0: [sda] 4096-byte physical blocks
[ 28.267411] sd 5:0:0:0: [sda] Write Protect is off
[ 28.337972] sd 5:0:0:0: [sda] Mode Sense: 00 3a 00 00
[ 28.337979] sd 5:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 28.351393] igb 0000:03:00.0: added PHC on eth0
[ 28.351394] igb 0000:03:00.0: Intel(R) Gigabit Ethernet Network Connection
[ 28.351395] igb 0000:03:00.0: eth0: (PCIe:5.0Gb/s:Width x4) a4:bf:01:01:a9:de
[ 28.351469] igb 0000:03:00.0: eth0: PBA No: 100000-000
[ 28.351469] igb 0000:03:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[ 28.418893] igb 0000:03:00.3: added PHC on eth1
[ 28.418893] igb 0000:03:00.3: Intel(R) Gigabit Ethernet Network Connection
[ 28.418898] igb 0000:03:00.3: eth1: (PCIe:5.0Gb/s:Width x4) a4:bf:01:01:a9:df
[ 28.418983] igb 0000:03:00.3: eth1: PBA No: 100000-000
[ 28.418984] igb 0000:03:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[ 28.613578] igb 0000:03:00.3 enp3s0f3: renamed from eth1
[ 29.295834] ata6.00: Enabling discard_zeroes_data
[ 29.353923] sda: sda1
[ 29.409841] ata6.00: Enabling discard_zeroes_data
[ 29.427332] igb 0000:03:00.0 eno1: renamed from eth0
[ 29.523260] sd 5:0:0:0: [sda] Attached SCSI disk
[ 30.822900] raid6: sse2x1 gen() 9978 MB/s
[ 30.998898] raid6: sse2x1 xor() 7442 MB/s
[ 31.118897] raid6: sse2x2 gen() 12108 MB/s
[ 31.238900] raid6: sse2x2 xor() 8145 MB/s
[ 31.358899] raid6: sse2x4 gen() 14216 MB/s
[ 31.474899] raid6: sse2x4 xor() 9918 MB/s
[ 31.590898] raid6: avx2x1 gen() 19292 MB/s
[ 31.702898] raid6: avx2x1 xor() 14148 MB/s
[ 31.814900] raid6: avx2x2 gen() 22348 MB/s
[ 31.926897] raid6: avx2x2 xor() 15019 MB/s
[ 32.034898] raid6: avx2x4 gen() 25574 MB/s
[ 32.142898] raid6: avx2x4 xor() 18300 MB/s
[ 32.184019] raid6: using algorithm avx2x4 gen() 25574 MB/s
[ 32.225424] raid6: .... xor() 18300 MB/s, rmw enabled
[ 32.266679] raid6: using avx2x2 recovery algorithm
[ 32.308911] xor: automatically using best checksumming function avx
[ 32.351569] async_tx: api initialized (async)
[ 32.546754] Btrfs loaded, crc32c=crc32c-intel
[ 32.914432] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[ 33.221933] ip_tables: (C) 2000-2006 Netfilter Core Team
[ 33.274892] systemd[1]: systemd 232 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[ 33.427461] systemd[1]: Detected architecture x86-64.
[ 33.643994] systemd[1]: Set hostname to <nvmfji01>.
[ 33.756321] systemd[1]: Created slice User and Session Slice.
[ 33.870020] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[ 34.045375] systemd[1]: Reached target User and Group Name Lookups.
[ 34.165970] systemd[1]: Listening on udev Kernel Socket.
[ 34.284230] systemd[1]: Created slice System Slice.
[ 34.403838] systemd[1]: Listening on Device-mapper event daemon FIFOs.
[ 34.526969] systemd[1]: Mounting Debug File System...
[ 35.404542] mlx5_ib: Mellanox Connect-IB Infiniband driver v2.2-1 (Feb 2014)
[ 36.476588] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro
[ 36.708379] Adding 2097148k swap on /swapfile. Priority:-1 extents:6 across:2260988k SSFS
[ 37.162622] random: crng init done
[ 37.260060] ipmi message handler version 39.2
[ 37.263163] ipmi device interface
[ 37.267715] IPMI System Interface driver.
[ 37.268184] ipmi_si: probing via SMBIOS
[ 37.268185] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[ 37.268185] ipmi_si: Adding SMBIOS-specified kcs state machine
[ 37.268187] ipmi_si: probing via SPMI
[ 37.268188] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[ 37.268188] ipmi_si: SPMI-specified kcs state machine: duplicate
[ 37.268190] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[ 37.279229] power_meter ACPI000D:00: Found ACPI power meter.
[ 37.279516] power_meter ACPI000D:00: Ignoring unsafe software power cap!
[ 37.279742] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info().
[ 37.298485] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 37.300120] Loading iSCSI transport class v2.0-870.
[ 38.236277] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x006f, dev_id: 0x21)
[ 38.236346] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[ 38.371169] RAPL PMU: API unit is 2^-32 Joules, 4 fixed counters, 655360 ms ovfl timer
[ 38.371170] RAPL PMU: hw unit of domain pp0-core 2^-14 Joules
[ 38.371170] RAPL PMU: hw unit of domain package 2^-14 Joules
[ 38.371171] RAPL PMU: hw unit of domain dram 2^-14 Joules
[ 38.371171] RAPL PMU: hw unit of domain pp1-gpu 2^-14 Joules
[ 38.751639] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[ 38.751673] ioatdma: Intel(R) QuickData Technology Driver 4.00
[ 38.859528] IPMI SSIF Interface driver
[ 38.860459] iscsi: registered transport (tcp)
[ 38.863725] iscsi: registered transport (iser)
[ 38.875743] igb 0000:03:00.0: DCA enabled
[ 38.875828] igb 0000:03:00.3: DCA enabled
[ 38.894759] kvm: disabled by bios
[ 39.351542] EDAC MC: Ver: 3.0.0
[ 39.354099] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[ 39.354108] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[ 39.354119] EDAC sbridge: Seeking for: PCI ID 8086:6fa0
[ 39.354128] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[ 39.354131] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[ 39.354135] EDAC sbridge: Seeking for: PCI ID 8086:6ffc
[ 39.354138] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[ 39.354141] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[ 39.354146] EDAC sbridge: Seeking for: PCI ID 8086:6ffd
[ 39.354149] EDAC sbridge: Seeking for: PCI ID 8086:6f60
[ 39.354152] EDAC sbridge: Seeking for: PCI ID 8086:6f60
[ 39.354156] EDAC sbridge: Seeking for: PCI ID 8086:6f60
[ 39.354160] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[ 39.354163] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[ 39.354167] EDAC sbridge: Seeking for: PCI ID 8086:6fa8
[ 39.354170] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[ 39.354173] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[ 39.354177] EDAC sbridge: Seeking for: PCI ID 8086:6f71
[ 39.354180] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[ 39.354184] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[ 39.354188] EDAC sbridge: Seeking for: PCI ID 8086:6faa
[ 39.354191] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[ 39.354194] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[ 39.354199] EDAC sbridge: Seeking for: PCI ID 8086:6fab
[ 39.354201] EDAC sbridge: Seeking for: PCI ID 8086:6fac
[ 39.354209] EDAC sbridge: Seeking for: PCI ID 8086:6fad
[ 39.354216] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[ 39.354219] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[ 39.354224] EDAC sbridge: Seeking for: PCI ID 8086:6faf
[ 39.354227] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[ 39.354230] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[ 39.354235] EDAC sbridge: Seeking for: PCI ID 8086:6f68
[ 39.354237] EDAC sbridge: Seeking for: PCI ID 8086:6f79
[ 39.354241] EDAC sbridge: Seeking for: PCI ID 8086:6f79
[ 39.354245] EDAC sbridge: Seeking for: PCI ID 8086:6f79
[ 39.354248] EDAC sbridge: Seeking for: PCI ID 8086:6f6a
[ 39.354252] EDAC sbridge: Seeking for: PCI ID 8086:6f6a
[ 39.354256] EDAC sbridge: Seeking for: PCI ID 8086:6f6a
[ 39.354259] EDAC sbridge: Seeking for: PCI ID 8086:6f6b
[ 39.354262] EDAC sbridge: Seeking for: PCI ID 8086:6f6b
[ 39.354267] EDAC sbridge: Seeking for: PCI ID 8086:6f6b
[ 39.354269] EDAC sbridge: Seeking for: PCI ID 8086:6f6c
[ 39.354276] EDAC sbridge: Seeking for: PCI ID 8086:6f6d
[ 39.354410] EDAC MC0: Giving out device to module sbridge_edac.c controller Broadwell Socket#0: DEV 0000:ff:12.0 (INTERRUPT)
[ 39.354558] EDAC MC1: Giving out device to module sbridge_edac.c controller Broadwell Socket#1: DEV 0000:7f:12.0 (INTERRUPT)
[ 39.354558] EDAC sbridge: Ver: 1.1.1
[ 39.356885] intel_rapl: Found RAPL domain package
[ 39.356888] intel_rapl: Found RAPL domain dram
[ 39.356889] intel_rapl: DRAM domain energy unit 15300pj
[ 39.485773] intel_rapl: Found RAPL domain package
[ 39.485776] intel_rapl: Found RAPL domain dram
[ 39.485778] intel_rapl: DRAM domain energy unit 15300pj
[ 40.655698] systemd-journald[852]: Received request to flush runtime journal from PID 1
[ 41.756757] mlx5_core 0000:05:00.0 ens785f0: Link up
[ 42.159697] mlx5_core 0000:05:00.1 ens785f1: Link up
[ 42.292965] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready
[ 43.073220] new mount options do not match the existing superblock, will be ignored
[ 43.780184] systemd[1]: apt-daily.timer: Adding 8h 17min 22.339136s random time.
[ 43.780297] systemd[1]: snapd.refresh.timer: Adding 1h 15min 52.822912s random time.
[ 43.780300] systemd[1]: snapd.refresh.timer: Adding 1h 45min 38.445351s random time.
[ 43.780472] systemd[1]: motd-news.timer: Adding 3min 28.289964s random time.
[ 45.799322] igb 0000:03:00.0 eno1: igb: eno1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
[ 45.799463] IPv6: ADDRCONF(NETDEV_CHANGE): eno1: link becomes ready
[ 54.284550] systemd[1]: apt-daily.timer: Adding 4h 5min 24.748638s random time.
[ 54.284748] systemd[1]: snapd.refresh.timer: Adding 4h 58min 16.807666s random time.
[ 54.284755] systemd[1]: snapd.refresh.timer: Adding 1h 16min 46.757885s random time.
[ 54.285063] systemd[1]: motd-news.timer: Adding 58min 54.010480s random time.
[ 54.376374] systemd[1]: apt-daily.timer: Adding 21min 9.999063s random time.
[ 54.376561] systemd[1]: snapd.refresh.timer: Adding 3h 35min 42.051190s random time.
[ 54.376567] systemd[1]: snapd.refresh.timer: Adding 5h 19min 8.757068s random time.
[ 54.376876] systemd[1]: motd-news.timer: Adding 35min 57.172748s random time.
[ 1346.075694] nvme nvme0: creating 32 I/O queues.
[ 1346.907412] nvme nvme0: new ctrl: NQN "subsys4", addr 10.10.0.1:4420
[ 1346.927813] nvme nvme1: creating 32 I/O queues.
[ 1347.741494] nvme nvme1: new ctrl: NQN "subsys5", addr 10.11.0.1:4420
[ 1347.762478] nvme nvme2: creating 32 I/O queues.
[ 1348.575658] nvme nvme2: new ctrl: NQN "subsys6", addr 10.10.0.1:4420
[ 1348.596110] nvme nvme3: creating 32 I/O queues.
[ 1349.409373] nvme nvme3: new ctrl: NQN "subsys7", addr 10.11.0.1:4420
[24818.360389] perf: interrupt took too long (2506 > 2500), lowering kernel.perf_event_max_sample_rate to 79750
[24977.021722] blk_update_request: I/O error, dev nvme1n1, sector 16243840
[24977.062639] blk_update_request: I/O error, dev nvme1n1, sector 16243968
[24977.103019] blk_update_request: I/O error, dev nvme1n1, sector 16244096
[24977.142874] blk_update_request: I/O error, dev nvme1n1, sector 16244224
[24977.182372] blk_update_request: I/O error, dev nvme1n1, sector 16244352
[24977.221411] blk_update_request: I/O error, dev nvme1n1, sector 16244480
[24977.258761] blk_update_request: I/O error, dev nvme1n1, sector 16244608
[24977.293942] blk_update_request: I/O error, dev nvme1n1, sector 16244736
[24977.327110] blk_update_request: I/O error, dev nvme1n1, sector 16244864
[24977.359238] blk_update_request: I/O error, dev nvme1n1, sector 16244992
[24977.417769] nvme nvme1: reconnecting in 10 seconds
[24987.690841] nvme nvme1: creating 32 I/O queues.
[24987.796274] nvme nvme1: Successfully reconnected
[26134.909668] blk_update_request: 13 callbacks suppressed
[26134.909671] blk_update_request: I/O error, dev nvme1n1, sector 2480896
[26134.940283] blk_update_request: I/O error, dev nvme1n1, sector 2481024
[26134.969872] blk_update_request: I/O error, dev nvme1n1, sector 2481152
[26134.998932] blk_update_request: I/O error, dev nvme1n1, sector 2481280
[26135.027197] blk_update_request: I/O error, dev nvme1n1, sector 2481408
[26135.054815] blk_update_request: I/O error, dev nvme1n1, sector 2481536
[26135.105724] nvme nvme1: reconnecting in 10 seconds
[26145.325263] nvme nvme1: creating 32 I/O queues.
[26145.434039] nvme nvme1: Successfully reconnected
[28530.813505] blk_update_request: I/O error, dev nvme1n1, sector 1865088
[28530.841129] blk_update_request: I/O error, dev nvme1n1, sector 1866368
[28530.866496] blk_update_request: I/O error, dev nvme1n1, sector 1863168
[28530.889596] blk_update_request: I/O error, dev nvme1n1, sector 1865344
[28530.911800] blk_update_request: I/O error, dev nvme1n1, sector 1866624
[28530.932096] blk_update_request: I/O error, dev nvme1n1, sector 1867904
[28530.952609] blk_update_request: I/O error, dev nvme1n1, sector 1861888
[28530.973333] blk_update_request: I/O error, dev nvme1n1, sector 1863424
[28530.994308] blk_update_request: I/O error, dev nvme1n1, sector 1867648
[28531.013381] blk_update_request: I/O error, dev nvme1n1, sector 1863680
[28531.081549] nvme nvme1: reconnecting in 10 seconds
[28541.466965] nvme nvme1: creating 32 I/O queues.
[28541.590685] nvme nvme1: Successfully reconnected
[29854.813484] blk_update_request: 45 callbacks suppressed
[29854.813487] blk_update_request: I/O error, dev nvme3n1, sector 19456
[29854.830848] blk_update_request: I/O error, dev nvme3n1, sector 19584
[29854.847303] blk_update_request: I/O error, dev nvme3n1, sector 19712
[29854.862755] blk_update_request: I/O error, dev nvme3n1, sector 19840
[29854.876011] blk_update_request: I/O error, dev nvme3n1, sector 19968
[29854.889270] blk_update_request: I/O error, dev nvme3n1, sector 18176
[29854.902521] blk_update_request: I/O error, dev nvme3n1, sector 20096
[29854.915844] blk_update_request: I/O error, dev nvme3n1, sector 18560
[29854.929306] blk_update_request: I/O error, dev nvme3n1, sector 18944
[29854.942735] blk_update_request: I/O error, dev nvme3n1, sector 18304
[29854.977428] nvme nvme3: reconnecting in 10 seconds
[29865.255155] nvme nvme3: creating 32 I/O queues.
[29865.363345] nvme nvme3: Successfully reconnected
[30521.725407] blk_update_request: 96 callbacks suppressed
[30521.725411] blk_update_request: I/O error, dev nvme1n1, sector 1026176
[30521.739292] blk_update_request: I/O error, dev nvme1n1, sector 1028352
[30521.753159] blk_update_request: I/O error, dev nvme1n1, sector 1028736
[30521.767019] blk_update_request: I/O error, dev nvme1n1, sector 1027840
[30521.780595] blk_update_request: I/O error, dev nvme1n1, sector 1026048
[30521.794134] blk_update_request: I/O error, dev nvme1n1, sector 1026304
[30521.807681] blk_update_request: I/O error, dev nvme1n1, sector 1024768
[30521.821321] blk_update_request: I/O error, dev nvme1n1, sector 1027968
[30521.834819] blk_update_request: I/O error, dev nvme1n1, sector 1024896
[30521.848357] blk_update_request: I/O error, dev nvme1n1, sector 1028096
[30521.877504] nvme nvme1: reconnecting in 10 seconds
[30532.142571] nvme nvme1: creating 32 I/O queues.
[30532.254103] nvme nvme1: Successfully reconnected
[-- Attachment #3: init2.txt --]
[-- Type: text/plain, Size: 93526 bytes --]
[ 0.000000] Linux version 4.11.0-rc6patch-2-get-fence (r1@rrpatch) (gcc version 6.2.0 20161005 (Ubuntu 6.2.0-5ubuntu12) ) #1 SMP Tue Apr 11 08:56:12 PDT 2017
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.11.0-rc6patch-2-get-fence root=UUID=8f6dc1c5-b811-4ac9-aa98-7ea337785c73 ro
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009b3ff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009b400-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000079fd0fff] usable
[ 0.000000] BIOS-e820: [mem 0x0000000079fd1000-0x000000007ac50fff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000007ac51000-0x000000007b680fff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x000000007b681000-0x000000007b7cefff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x000000007b7cf000-0x000000007b7fffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007b800000-0x000000008fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000ff400000-0x00000000ffffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000107fffffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.7 present.
[ 0.000000] DMI: Intel Corporation S2600WT2R/S2600WT2R, BIOS SE5C610.86B.01.01.0019.101220160604 10/12/2016
[ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[ 0.000000] e820: last_pfn = 0x1080000 max_arch_pfn = 0x400000000
[ 0.000000] MTRR default type: write-back
[ 0.000000] MTRR fixed ranges enabled:
[ 0.000000] 00000-9FFFF write-back
[ 0.000000] A0000-BFFFF uncachable
[ 0.000000] C0000-FFFFF write-protect
[ 0.000000] MTRR variable ranges enabled:
[ 0.000000] 0 base 000080000000 mask 3FFF80000000 uncachable
[ 0.000000] 1 base 380000000000 mask 3F8000000000 uncachable
[ 0.000000] 2 disabled
[ 0.000000] 3 disabled
[ 0.000000] 4 disabled
[ 0.000000] 5 disabled
[ 0.000000] 6 disabled
[ 0.000000] 7 disabled
[ 0.000000] 8 disabled
[ 0.000000] 9 disabled
[ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WC UC- WT
[ 0.000000] e820: last_pfn = 0x7b800 max_arch_pfn = 0x400000000
[ 0.000000] found SMP MP-table at [mem 0x000fd850-0x000fd85f] mapped at [ffff9f03000fd850]
[ 0.000000] Scanning 1 areas for low memory corruption
[ 0.000000] Base memory trampoline at [ffff9f0300095000] 95000 size 24576
[ 0.000000] Using GB pages for direct mapping
[ 0.000000] BRK [0x1f520b000, 0x1f520bfff] PGTABLE
[ 0.000000] BRK [0x1f520c000, 0x1f520cfff] PGTABLE
[ 0.000000] BRK [0x1f520d000, 0x1f520dfff] PGTABLE
[ 0.000000] BRK [0x1f520e000, 0x1f520efff] PGTABLE
[ 0.000000] BRK [0x1f520f000, 0x1f520ffff] PGTABLE
[ 0.000000] BRK [0x1f5210000, 0x1f5210fff] PGTABLE
[ 0.000000] BRK [0x1f5211000, 0x1f5211fff] PGTABLE
[ 0.000000] RAMDISK: [mem 0x33132000-0x35890fff]
[ 0.000000] ACPI: Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 0x00000000000F0460 000024 (v02 INTEL )
[ 0.000000] ACPI: XSDT 0x000000007B7CD0E8 0000BC (v01 INTEL S2600WT 00000000 INTL 01000013)
[ 0.000000] ACPI: FACP 0x000000007B7CC000 0000F4 (v04 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: DSDT 0x000000007B791000 032D76 (v02 INTEL S2600WT 00000003 INTL 20091013)
[ 0.000000] ACPI: FACS 0x000000007B650000 000040
[ 0.000000] ACPI: HPET 0x000000007B7CB000 000038 (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: APIC 0x000000007B7CA000 000AFC (v03 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: MCFG 0x000000007B7C9000 00003C (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: MSCT 0x000000007B7C8000 000090 (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SLIT 0x000000007B7C7000 00006C (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SRAT 0x000000007B7C6000 000770 (v03 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SPMI 0x000000007B7C5000 000041 (v05 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: WDDT 0x000000007B7C4000 000040 (v01 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: NITR 0x000000007B6A6000 000071 (v02 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: PRAD 0x000000007B6A1000 000102 (v02 INTEL SpsPrAgg 00000002 INTL 20130328)
[ 0.000000] ACPI: UEFI 0x000000007B679000 000042 (v01 INTEL S2600WT 00000002 INTL 01000013)
[ 0.000000] ACPI: SSDT 0x000000007B6A7000 0E96B0 (v02 INTEL S2600WT 00004000 INTL 20130328)
[ 0.000000] ACPI: SSDT 0x000000007B6A3000 002679 (v02 INTEL S2600WT 00000002 INTL 20130328)
[ 0.000000] ACPI: SSDT 0x000000007B6A2000 000064 (v02 INTEL S2600WT 00000002 INTL 20130328)
[ 0.000000] ACPI: HEST 0x000000007B6A0000 0000A8 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: BERT 0x000000007B69F000 000030 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: ERST 0x000000007B69E000 000230 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: EINJ 0x000000007B69D000 000130 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x10 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x12 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x14 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x16 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x20 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x22 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x24 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x26 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x28 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x30 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x32 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x34 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x36 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x40 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x42 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x44 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x46 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x48 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x50 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x52 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x54 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x56 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x60 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x62 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x64 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x66 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x68 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x70 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x72 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x74 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x76 -> Node 1
[ 0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[ 0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x87fffffff]
[ 0.000000] ACPI: SRAT: Node 1 PXM 1 [mem 0x880000000-0x107fffffff]
[ 0.000000] NUMA: Initialized distance table, cnt=2
[ 0.000000] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x87fffffff] -> [mem 0x00000000-0x87fffffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff]
[ 0.000000] NODE_DATA(1) allocated [mem 0x107ffd4000-0x107fffefff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]
[ 0.000000] Normal [mem 0x0000000100000000-0x000000107fffffff]
[ 0.000000] Device empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009afff]
[ 0.000000] node 0: [mem 0x0000000000100000-0x0000000079fd0fff]
[ 0.000000] node 0: [mem 0x000000007b7cf000-0x000000007b7fffff]
[ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff]
[ 0.000000] node 1: [mem 0x0000000880000000-0x000000107fffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff]
[ 0.000000] On node 0 totalpages: 8363932
[ 0.000000] DMA zone: 64 pages used for memmap
[ 0.000000] DMA zone: 21 pages reserved
[ 0.000000] DMA zone: 3994 pages, LIFO batch:0
[ 0.000000] DMA32 zone: 7745 pages used for memmap
[ 0.000000] DMA32 zone: 495618 pages, LIFO batch:31
[ 0.000000] Normal zone: 122880 pages used for memmap
[ 0.000000] Normal zone: 7864320 pages, LIFO batch:31
[ 0.000000] Initmem setup node 1 [mem 0x0000000880000000-0x000000107fffffff]
[ 0.000000] On node 1 totalpages: 8388608
[ 0.000000] Normal zone: 131072 pages used for memmap
[ 0.000000] Normal zone: 8388608 pages, LIFO batch:31
[ 0.000000] ACPI: PM-Timer IO Port: 0x408
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x08] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x09] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x10] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x11] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x12] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x13] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x14] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x15] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x16] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x17] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x18] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x19] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x20] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x21] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x22] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x23] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x24] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x25] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x26] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x27] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x28] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x29] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x30] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x31] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x32] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x33] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x34] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x35] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x36] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x37] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x38] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x39] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x40] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x41] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x42] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x43] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x44] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x45] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x46] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x47] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x48] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x49] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x50] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x51] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x52] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x53] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x54] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x55] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x56] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x57] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x58] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x59] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x60] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x61] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x62] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x63] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x64] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x65] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x66] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x67] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x68] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x69] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x70] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x71] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x72] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x73] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x74] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x75] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x76] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x77] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x78] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x79] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x80] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x81] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x82] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x83] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x84] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x85] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x86] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x87] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x88] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x89] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x90] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x91] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x92] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x93] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x94] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x95] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x96] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x97] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x98] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x99] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa0] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa1] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa2] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa3] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa4] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa5] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa6] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa7] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa8] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa9] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xaa] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xab] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xac] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xad] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xae] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xaf] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb0] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb1] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb2] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb3] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb4] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb5] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb6] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb7] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb8] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb9] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xba] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbb] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbc] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbd] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbe] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbf] high level lint[0x1])
[ 0.000000] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[ 0.000000] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47
[ 0.000000] IOAPIC[2]: apic_id 10, version 32, address 0xfec40000, GSI 48-71
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] ACPI: IRQ0 used by override.
[ 0.000000] ACPI: IRQ9 used by override.
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[ 0.000000] smpboot: Allowing 36 CPUs, 0 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009b000-0x0009bfff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009c000-0x0009ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x79fd1000-0x7ac50fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7ac51000-0x7b680fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b681000-0x7b7cefff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b800000-0x8fffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xff3fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xff400000-0xffffffff]
[ 0.000000] e820: [mem 0x90000000-0xfed1bfff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on bare hardware
[ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:36 nr_cpu_ids:36 nr_node_ids:2
[ 0.000000] percpu: Embedded 38 pages/cpu @ffff9f0b5f800000 s115608 r8192 d31848 u262144
[ 0.000000] pcpu-alloc: s115608 r8192 d31848 u262144 alloc=1*2097152
[ 0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15
[ 0.000000] pcpu-alloc: [0] 16 17 -- -- -- -- -- -- [1] 18 19 20 21 22 23 24 25
[ 0.000000] pcpu-alloc: [1] 26 27 28 29 30 31 32 33 [1] 34 35 -- -- -- -- -- --
[ 0.000000] Built 2 zonelists in Node order, mobility grouping on. Total pages: 16490758
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.11.0-rc6patch-2-get-fence root=UUID=8f6dc1c5-b811-4ac9-aa98-7ea337785c73 ro
[ 0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[ 0.000000] log_buf_len total cpu_extra contributions: 143360 bytes
[ 0.000000] log_buf_len min size: 262144 bytes
[ 0.000000] log_buf_len: 524288 bytes
[ 0.000000] early log buf free: 236080(90%)
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Calgary: detecting Calgary via BIOS EBDA area
[ 0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[ 0.000000] Memory: 65828244K/67010160K available (9075K kernel code, 1697K rwdata, 3884K rodata, 2212K init, 2232K bss, 1181916K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=36, Nodes=2
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] Build-time adjustment of leaf fanout to 64.
[ 0.000000] RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=36.
[ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=36
[ 0.000000] NR_IRQS:524544 nr_irqs:1528 16
[ 0.000000] Console: colour dummy device 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[ 0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[ 0.000000] hpet clockevent registered
[ 0.000000] tsc: Fast TSC calibration using PIT
[ 0.004000] tsc: Detected 2294.683 MHz processor
[ 0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4589.36 BogoMIPS (lpj=9178732)
[ 0.004000] pid_max: default: 36864 minimum: 301
[ 0.004000] ACPI: Core revision 20170119
[ 0.102107] ACPI: 4 ACPI AML tables successfully acquired and loaded
[ 0.102190] Security Framework initialized
[ 0.102194] Yama: becoming mindful.
[ 0.102241] AppArmor: AppArmor initialized
[ 0.104911] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[ 0.117796] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[ 0.123348] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.123399] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.124085] CPU: Physical Processor ID: 0
[ 0.124089] CPU: Processor Core ID: 0
[ 0.124096] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[ 0.124098] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[ 0.124105] mce: CPU supports 22 MCE banks
[ 0.124124] CPU0: Thermal monitoring enabled (TM1)
[ 0.124177] process: using mwait in idle threads
[ 0.124182] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024
[ 0.124185] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4
[ 0.125018] Freeing SMP alternatives memory: 32K
[ 0.128005] ftrace: allocating 34213 entries in 134 pages
[ 0.136105] smpboot: Max logical packages: 2
[ 0.136242] x2apic: IRQ remapping doesn't support X2APIC mode
[ 0.136317] Switched APIC routing to physical flat.
[ 0.136930] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.176918] TSC deadline timer enabled
[ 0.176924] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz (family: 0x6, model: 0x3f, stepping: 0x2)
[ 0.177072] Performance Events: PEBS fmt2+, Haswell events, 16-deep LBR, full-width counters, Intel PMU driver.
[ 0.177113] ... version: 3
[ 0.177116] ... bit width: 48
[ 0.177118] ... generic registers: 8
[ 0.177121] ... value mask: 0000ffffffffffff
[ 0.177124] ... max period: 00007fffffffffff
[ 0.177126] ... fixed-purpose events: 3
[ 0.177129] ... event mask: 00000007000000ff
[ 0.179550] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[ 0.179569] smp: Bringing up secondary CPUs ...
[ 0.179678] x86: Booting SMP configuration:
[ 0.179682] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 #11 #12 #13 #14 #15 #16 #17
[ 1.540178] .... node #1, CPUs: #18 #19 #20 #21 #22 #23 #24 #25 #26 #27 #28 #29 #30 #31 #32 #33 #34 #35
[ 2.984071] smp: Brought up 2 nodes, 36 CPUs
[ 2.984071] smpboot: Total of 36 processors activated (165272.55 BogoMIPS)
[ 2.988703] sched_clock: Marking stable (2988000000, 0)->(3163258116, -175258116)
[ 2.990705] devtmpfs: initialized
[ 2.990766] x86/mm: Memory block size: 2048MB
[ 2.992603] evm: security.selinux
[ 2.992606] evm: security.SMACK64
[ 2.992608] evm: security.SMACK64EXEC
[ 2.992611] evm: security.SMACK64TRANSMUTE
[ 2.992613] evm: security.SMACK64MMAP
[ 2.992616] evm: security.ima
[ 2.992618] evm: security.capability
[ 2.992706] PM: Registering ACPI NVS region [mem 0x7ac51000-0x7b680fff] (10682368 bytes)
[ 2.993106] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 2.993176] futex hash table entries: 16384 (order: 8, 1048576 bytes)
[ 2.993522] pinctrl core: initialized pinctrl subsystem
[ 2.993648] RTC time: 23:05:44, date: 04/19/17
[ 2.994863] NET: Registered protocol family 16
[ 2.995083] cpuidle: using governor ladder
[ 2.995090] cpuidle: using governor menu
[ 2.995094] PCCT header not found.
[ 2.995138] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[ 2.995143] ACPI: bus type PCI registered
[ 2.995146] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 2.995245] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[ 2.995260] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[ 2.995278] PCI: Using configuration type 1 for base access
[ 2.997320] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[ 2.997352] core: PMU erratum BJ122, BV98, HSD29 workaround disabled, HT off
[ 2.999481] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[ 2.999486] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 3.000133] ACPI: Added _OSI(Module Device)
[ 3.000137] ACPI: Added _OSI(Processor Device)
[ 3.000140] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 3.000142] ACPI: Added _OSI(Processor Aggregator Device)
[ 3.000304] ACPI: Executed 1 blocks of module-level executable AML code
[ 3.131320] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[ 3.307162] ACPI: Dynamic OEM Table Load:
[ 3.330942] ACPI: Interpreter enabled
[ 3.330957] ACPI: (supports S0 S5)
[ 3.330960] ACPI: Using IOAPIC for interrupt routing
[ 3.331018] HEST: Table parsing has been initialized.
[ 3.331024] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 3.366344] ACPI: PCI Root Bridge [UNC1] (domain 0000 [bus ff])
[ 3.366352] acpi PNP0A03:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 5.410004] acpi PNP0A03:02: _OSC: platform does not support [PCIeHotplug]
[ 7.458611] acpi PNP0A03:02: _OSC: OS now controls [PME AER PCIeCapability]
[ 7.458615] acpi PNP0A03:02: FADT indicates ASPM is unsupported, using BIOS configuration
[ 7.458673] PCI host bridge to bus 0000:ff
[ 7.458677] pci_bus 0000:ff: root bus resource [bus ff]
[ 7.458691] pci 0000:ff:08.0: [8086:2f80] type 00 class 0x088000
[ 7.458759] pci 0000:ff:08.2: [8086:2f32] type 00 class 0x110100
[ 7.458811] pci 0000:ff:08.3: [8086:2f83] type 00 class 0x088000
[ 7.458877] pci 0000:ff:09.0: [8086:2f90] type 00 class 0x088000
[ 7.458929] pci 0000:ff:09.2: [8086:2f33] type 00 class 0x110100
[ 7.458981] pci 0000:ff:09.3: [8086:2f93] type 00 class 0x088000
[ 7.459036] pci 0000:ff:0b.0: [8086:2f81] type 00 class 0x088000
[ 7.459084] pci 0000:ff:0b.1: [8086:2f36] type 00 class 0x110100
[ 7.459133] pci 0000:ff:0b.2: [8086:2f37] type 00 class 0x110100
[ 7.459183] pci 0000:ff:0c.0: [8086:2fe0] type 00 class 0x088000
[ 7.459230] pci 0000:ff:0c.1: [8086:2fe1] type 00 class 0x088000
[ 7.459278] pci 0000:ff:0c.2: [8086:2fe2] type 00 class 0x088000
[ 7.459324] pci 0000:ff:0c.3: [8086:2fe3] type 00 class 0x088000
[ 7.459374] pci 0000:ff:0c.4: [8086:2fe4] type 00 class 0x088000
[ 7.459420] pci 0000:ff:0c.5: [8086:2fe5] type 00 class 0x088000
[ 7.459470] pci 0000:ff:0c.6: [8086:2fe6] type 00 class 0x088000
[ 7.459520] pci 0000:ff:0c.7: [8086:2fe7] type 00 class 0x088000
[ 7.459578] pci 0000:ff:0d.0: [8086:2fe8] type 00 class 0x088000
[ 7.459626] pci 0000:ff:0d.1: [8086:2fe9] type 00 class 0x088000
[ 7.459674] pci 0000:ff:0d.2: [8086:2fea] type 00 class 0x088000
[ 7.459722] pci 0000:ff:0d.3: [8086:2feb] type 00 class 0x088000
[ 7.459775] pci 0000:ff:0d.4: [8086:2fec] type 00 class 0x088000
[ 7.459824] pci 0000:ff:0d.5: [8086:2fed] type 00 class 0x088000
[ 7.459880] pci 0000:ff:0d.6: [8086:2fee] type 00 class 0x088000
[ 7.459930] pci 0000:ff:0d.7: [8086:2fef] type 00 class 0x088000
[ 7.459979] pci 0000:ff:0e.0: [8086:2ff0] type 00 class 0x088000
[ 7.460027] pci 0000:ff:0e.1: [8086:2ff1] type 00 class 0x088000
[ 7.460082] pci 0000:ff:0f.0: [8086:2ff8] type 00 class 0x088000
[ 7.460131] pci 0000:ff:0f.1: [8086:2ff9] type 00 class 0x088000
[ 7.460182] pci 0000:ff:0f.2: [8086:2ffa] type 00 class 0x088000
[ 7.460238] pci 0000:ff:0f.3: [8086:2ffb] type 00 class 0x088000
[ 7.460289] pci 0000:ff:0f.4: [8086:2ffc] type 00 class 0x088000
[ 7.460341] pci 0000:ff:0f.5: [8086:2ffd] type 00 class 0x088000
[ 7.460393] pci 0000:ff:0f.6: [8086:2ffe] type 00 class 0x088000
[ 7.460446] pci 0000:ff:10.0: [8086:2f1d] type 00 class 0x088000
[ 7.460497] pci 0000:ff:10.1: [8086:2f34] type 00 class 0x110100
[ 7.460551] pci 0000:ff:10.5: [8086:2f1e] type 00 class 0x088000
[ 7.460602] pci 0000:ff:10.6: [8086:2f7d] type 00 class 0x110100
[ 7.460651] pci 0000:ff:10.7: [8086:2f1f] type 00 class 0x088000
[ 7.460702] pci 0000:ff:12.0: [8086:2fa0] type 00 class 0x088000
[ 7.460756] pci 0000:ff:12.1: [8086:2f30] type 00 class 0x110100
[ 7.460812] pci 0000:ff:12.4: [8086:2f60] type 00 class 0x088000
[ 7.460868] pci 0000:ff:12.5: [8086:2f38] type 00 class 0x110100
[ 7.460926] pci 0000:ff:13.0: [8086:2fa8] type 00 class 0x088000
[ 7.460984] pci 0000:ff:13.1: [8086:2f71] type 00 class 0x088000
[ 7.461054] pci 0000:ff:13.2: [8086:2faa] type 00 class 0x088000
[ 7.461112] pci 0000:ff:13.3: [8086:2fab] type 00 class 0x088000
[ 7.461171] pci 0000:ff:13.6: [8086:2fae] type 00 class 0x088000
[ 7.461226] pci 0000:ff:13.7: [8086:2faf] type 00 class 0x088000
[ 7.461280] pci 0000:ff:14.0: [8086:2fb0] type 00 class 0x088000
[ 7.461339] pci 0000:ff:14.1: [8086:2fb1] type 00 class 0x088000
[ 7.461397] pci 0000:ff:14.2: [8086:2fb2] type 00 class 0x088000
[ 7.461455] pci 0000:ff:14.3: [8086:2fb3] type 00 class 0x088000
[ 7.461515] pci 0000:ff:14.4: [8086:2fbc] type 00 class 0x088000
[ 7.461571] pci 0000:ff:14.5: [8086:2fbd] type 00 class 0x088000
[ 7.461626] pci 0000:ff:14.6: [8086:2fbe] type 00 class 0x088000
[ 7.461680] pci 0000:ff:14.7: [8086:2fbf] type 00 class 0x088000
[ 7.461743] pci 0000:ff:16.0: [8086:2f68] type 00 class 0x088000
[ 7.461803] pci 0000:ff:16.1: [8086:2f79] type 00 class 0x088000
[ 7.461863] pci 0000:ff:16.2: [8086:2f6a] type 00 class 0x088000
[ 7.461927] pci 0000:ff:16.3: [8086:2f6b] type 00 class 0x088000
[ 7.461992] pci 0000:ff:16.6: [8086:2f6e] type 00 class 0x088000
[ 7.462047] pci 0000:ff:16.7: [8086:2f6f] type 00 class 0x088000
[ 7.462102] pci 0000:ff:17.0: [8086:2fd0] type 00 class 0x088000
[ 7.462162] pci 0000:ff:17.1: [8086:2fd1] type 00 class 0x088000
[ 7.462222] pci 0000:ff:17.2: [8086:2fd2] type 00 class 0x088000
[ 7.462282] pci 0000:ff:17.3: [8086:2fd3] type 00 class 0x088000
[ 7.462341] pci 0000:ff:17.4: [8086:2fb8] type 00 class 0x088000
[ 7.462394] pci 0000:ff:17.5: [8086:2fb9] type 00 class 0x088000
[ 7.462451] pci 0000:ff:17.6: [8086:2fba] type 00 class 0x088000
[ 7.462505] pci 0000:ff:17.7: [8086:2fbb] type 00 class 0x088000
[ 7.462576] pci 0000:ff:1e.0: [8086:2f98] type 00 class 0x088000
[ 7.462633] pci 0000:ff:1e.1: [8086:2f99] type 00 class 0x088000
[ 7.462686] pci 0000:ff:1e.2: [8086:2f9a] type 00 class 0x088000
[ 7.462738] pci 0000:ff:1e.3: [8086:2fc0] type 00 class 0x088000
[ 7.462776] pci 0000:ff:1e.4: [8086:2f9c] type 00 class 0x088000
[ 7.462840] pci 0000:ff:1f.0: [8086:2f88] type 00 class 0x088000
[ 7.462899] pci 0000:ff:1f.2: [8086:2f8a] type 00 class 0x088000
[ 7.463046] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus 7f])
[ 7.463053] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 9.507224] acpi PNP0A03:03: _OSC: platform does not support [PCIeHotplug]
[ 11.555847] acpi PNP0A03:03: _OSC: OS now controls [PME AER PCIeCapability]
[ 11.555852] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration
[ 11.555902] PCI host bridge to bus 0000:7f
[ 11.555906] pci_bus 0000:7f: root bus resource [bus 7f]
[ 11.555916] pci 0000:7f:08.0: [8086:2f80] type 00 class 0x088000
[ 11.555969] pci 0000:7f:08.2: [8086:2f32] type 00 class 0x110100
[ 11.556019] pci 0000:7f:08.3: [8086:2f83] type 00 class 0x088000
[ 11.556072] pci 0000:7f:09.0: [8086:2f90] type 00 class 0x088000
[ 11.556121] pci 0000:7f:09.2: [8086:2f33] type 00 class 0x110100
[ 11.556168] pci 0000:7f:09.3: [8086:2f93] type 00 class 0x088000
[ 11.556228] pci 0000:7f:0b.0: [8086:2f81] type 00 class 0x088000
[ 11.556274] pci 0000:7f:0b.1: [8086:2f36] type 00 class 0x110100
[ 11.556319] pci 0000:7f:0b.2: [8086:2f37] type 00 class 0x110100
[ 11.556367] pci 0000:7f:0c.0: [8086:2fe0] type 00 class 0x088000
[ 11.556415] pci 0000:7f:0c.1: [8086:2fe1] type 00 class 0x088000
[ 11.556462] pci 0000:7f:0c.2: [8086:2fe2] type 00 class 0x088000
[ 11.556507] pci 0000:7f:0c.3: [8086:2fe3] type 00 class 0x088000
[ 11.556552] pci 0000:7f:0c.4: [8086:2fe4] type 00 class 0x088000
[ 11.556601] pci 0000:7f:0c.5: [8086:2fe5] type 00 class 0x088000
[ 11.556648] pci 0000:7f:0c.6: [8086:2fe6] type 00 class 0x088000
[ 11.556692] pci 0000:7f:0c.7: [8086:2fe7] type 00 class 0x088000
[ 11.556737] pci 0000:7f:0d.0: [8086:2fe8] type 00 class 0x088000
[ 11.556781] pci 0000:7f:0d.1: [8086:2fe9] type 00 class 0x088000
[ 11.556827] pci 0000:7f:0d.2: [8086:2fea] type 00 class 0x088000
[ 11.556873] pci 0000:7f:0d.3: [8086:2feb] type 00 class 0x088000
[ 11.556918] pci 0000:7f:0d.4: [8086:2fec] type 00 class 0x088000
[ 11.556962] pci 0000:7f:0d.5: [8086:2fed] type 00 class 0x088000
[ 11.557020] pci 0000:7f:0d.6: [8086:2fee] type 00 class 0x088000
[ 11.557066] pci 0000:7f:0d.7: [8086:2fef] type 00 class 0x088000
[ 11.557112] pci 0000:7f:0e.0: [8086:2ff0] type 00 class 0x088000
[ 11.557159] pci 0000:7f:0e.1: [8086:2ff1] type 00 class 0x088000
[ 11.557211] pci 0000:7f:0f.0: [8086:2ff8] type 00 class 0x088000
[ 11.557257] pci 0000:7f:0f.1: [8086:2ff9] type 00 class 0x088000
[ 11.557301] pci 0000:7f:0f.2: [8086:2ffa] type 00 class 0x088000
[ 11.557347] pci 0000:7f:0f.3: [8086:2ffb] type 00 class 0x088000
[ 11.557396] pci 0000:7f:0f.4: [8086:2ffc] type 00 class 0x088000
[ 11.557444] pci 0000:7f:0f.5: [8086:2ffd] type 00 class 0x088000
[ 11.557492] pci 0000:7f:0f.6: [8086:2ffe] type 00 class 0x088000
[ 11.557541] pci 0000:7f:10.0: [8086:2f1d] type 00 class 0x088000
[ 11.557587] pci 0000:7f:10.1: [8086:2f34] type 00 class 0x110100
[ 11.557635] pci 0000:7f:10.5: [8086:2f1e] type 00 class 0x088000
[ 11.557678] pci 0000:7f:10.6: [8086:2f7d] type 00 class 0x110100
[ 11.557722] pci 0000:7f:10.7: [8086:2f1f] type 00 class 0x088000
[ 11.557772] pci 0000:7f:12.0: [8086:2fa0] type 00 class 0x088000
[ 11.557821] pci 0000:7f:12.1: [8086:2f30] type 00 class 0x110100
[ 11.557872] pci 0000:7f:12.4: [8086:2f60] type 00 class 0x088000
[ 11.557923] pci 0000:7f:12.5: [8086:2f38] type 00 class 0x110100
[ 11.557976] pci 0000:7f:13.0: [8086:2fa8] type 00 class 0x088000
[ 11.558028] pci 0000:7f:13.1: [8086:2f71] type 00 class 0x088000
[ 11.558079] pci 0000:7f:13.2: [8086:2faa] type 00 class 0x088000
[ 11.558130] pci 0000:7f:13.3: [8086:2fab] type 00 class 0x088000
[ 11.558188] pci 0000:7f:13.6: [8086:2fae] type 00 class 0x088000
[ 11.558253] pci 0000:7f:13.7: [8086:2faf] type 00 class 0x088000
[ 11.558304] pci 0000:7f:14.0: [8086:2fb0] type 00 class 0x088000
[ 11.558358] pci 0000:7f:14.1: [8086:2fb1] type 00 class 0x088000
[ 11.558413] pci 0000:7f:14.2: [8086:2fb2] type 00 class 0x088000
[ 11.558468] pci 0000:7f:14.3: [8086:2fb3] type 00 class 0x088000
[ 11.558522] pci 0000:7f:14.4: [8086:2fbc] type 00 class 0x088000
[ 11.558573] pci 0000:7f:14.5: [8086:2fbd] type 00 class 0x088000
[ 11.558627] pci 0000:7f:14.6: [8086:2fbe] type 00 class 0x088000
[ 11.558678] pci 0000:7f:14.7: [8086:2fbf] type 00 class 0x088000
[ 11.558731] pci 0000:7f:16.0: [8086:2f68] type 00 class 0x088000
[ 11.558786] pci 0000:7f:16.1: [8086:2f79] type 00 class 0x088000
[ 11.558842] pci 0000:7f:16.2: [8086:2f6a] type 00 class 0x088000
[ 11.558897] pci 0000:7f:16.3: [8086:2f6b] type 00 class 0x088000
[ 11.558954] pci 0000:7f:16.6: [8086:2f6e] type 00 class 0x088000
[ 11.559005] pci 0000:7f:16.7: [8086:2f6f] type 00 class 0x088000
[ 11.559059] pci 0000:7f:17.0: [8086:2fd0] type 00 class 0x088000
[ 11.559115] pci 0000:7f:17.1: [8086:2fd1] type 00 class 0x088000
[ 11.559172] pci 0000:7f:17.2: [8086:2fd2] type 00 class 0x088000
[ 11.559227] pci 0000:7f:17.3: [8086:2fd3] type 00 class 0x088000
[ 11.559281] pci 0000:7f:17.4: [8086:2fb8] type 00 class 0x088000
[ 11.559333] pci 0000:7f:17.5: [8086:2fb9] type 00 class 0x088000
[ 11.559385] pci 0000:7f:17.6: [8086:2fba] type 00 class 0x088000
[ 11.559436] pci 0000:7f:17.7: [8086:2fbb] type 00 class 0x088000
[ 11.559510] pci 0000:7f:1e.0: [8086:2f98] type 00 class 0x088000
[ 11.559559] pci 0000:7f:1e.1: [8086:2f99] type 00 class 0x088000
[ 11.559611] pci 0000:7f:1e.2: [8086:2f9a] type 00 class 0x088000
[ 11.559660] pci 0000:7f:1e.3: [8086:2fc0] type 00 class 0x088000
[ 11.559696] pci 0000:7f:1e.4: [8086:2f9c] type 00 class 0x088000
[ 11.559757] pci 0000:7f:1f.0: [8086:2f88] type 00 class 0x088000
[ 11.559810] pci 0000:7f:1f.2: [8086:2f8a] type 00 class 0x088000
[ 11.570432] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[ 11.570440] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 11.572365] acpi PNP0A08:00: _OSC: platform does not support [AER]
[ 11.573214] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 11.573219] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[ 11.573547] PCI host bridge to bus 0000:00
[ 11.573552] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 11.573556] pci_bus 0000:00: root bus resource [io 0x1000-0x7fff window]
[ 11.573560] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 11.573565] pci_bus 0000:00: root bus resource [mem 0x90000000-0xc7ffbfff window]
[ 11.573570] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x383fffffffff window]
[ 11.573574] pci_bus 0000:00: root bus resource [bus 00-7e]
[ 11.573584] pci 0000:00:00.0: [8086:2f00] type 00 class 0x060000
[ 11.573731] pci 0000:00:01.0: [8086:2f02] type 01 class 0x060400
[ 11.573780] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[ 11.573853] pci 0000:00:01.0: System wakeup disabled by ACPI
[ 11.573891] pci 0000:00:02.0: [8086:2f04] type 01 class 0x060400
[ 11.573938] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[ 11.574017] pci 0000:00:02.0: System wakeup disabled by ACPI
[ 11.574053] pci 0000:00:02.2: [8086:2f06] type 01 class 0x060400
[ 11.574099] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[ 11.574171] pci 0000:00:02.2: System wakeup disabled by ACPI
[ 11.574214] pci 0000:00:03.0: [8086:2f08] type 01 class 0x060400
[ 11.574261] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[ 11.574333] pci 0000:00:03.0: System wakeup disabled by ACPI
[ 11.574367] pci 0000:00:04.0: [8086:2f20] type 00 class 0x088000
[ 11.574377] pci 0000:00:04.0: reg 0x10: [mem 0x383fff12c000-0x383fff12ffff 64bit]
[ 11.574504] pci 0000:00:04.1: [8086:2f21] type 00 class 0x088000
[ 11.574514] pci 0000:00:04.1: reg 0x10: [mem 0x383fff128000-0x383fff12bfff 64bit]
[ 11.574653] pci 0000:00:04.2: [8086:2f22] type 00 class 0x088000
[ 11.574663] pci 0000:00:04.2: reg 0x10: [mem 0x383fff124000-0x383fff127fff 64bit]
[ 11.574788] pci 0000:00:04.3: [8086:2f23] type 00 class 0x088000
[ 11.574798] pci 0000:00:04.3: reg 0x10: [mem 0x383fff120000-0x383fff123fff 64bit]
[ 11.574924] pci 0000:00:04.4: [8086:2f24] type 00 class 0x088000
[ 11.574933] pci 0000:00:04.4: reg 0x10: [mem 0x383fff11c000-0x383fff11ffff 64bit]
[ 11.575057] pci 0000:00:04.5: [8086:2f25] type 00 class 0x088000
[ 11.575066] pci 0000:00:04.5: reg 0x10: [mem 0x383fff118000-0x383fff11bfff 64bit]
[ 11.575196] pci 0000:00:04.6: [8086:2f26] type 00 class 0x088000
[ 11.575206] pci 0000:00:04.6: reg 0x10: [mem 0x383fff114000-0x383fff117fff 64bit]
[ 11.575329] pci 0000:00:04.7: [8086:2f27] type 00 class 0x088000
[ 11.575339] pci 0000:00:04.7: reg 0x10: [mem 0x383fff110000-0x383fff113fff 64bit]
[ 11.575461] pci 0000:00:05.0: [8086:2f28] type 00 class 0x088000
[ 11.575581] pci 0000:00:05.1: [8086:2f29] type 00 class 0x088000
[ 11.575709] pci 0000:00:05.2: [8086:2f2a] type 00 class 0x088000
[ 11.575825] pci 0000:00:05.4: [8086:2f2c] type 00 class 0x080020
[ 11.575832] pci 0000:00:05.4: reg 0x10: [mem 0x91a06000-0x91a06fff]
[ 11.575976] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000
[ 11.576163] pci 0000:00:11.1: [8086:8d7d] type 00 class 0x0c0500
[ 11.576177] pci 0000:00:11.1: reg 0x10: [mem 0x91a05000-0x91a05fff]
[ 11.576210] pci 0000:00:11.1: reg 0x20: [io 0x3060-0x307f]
[ 11.576365] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601
[ 11.576380] pci 0000:00:11.4: reg 0x10: [io 0x3098-0x309f]
[ 11.576388] pci 0000:00:11.4: reg 0x14: [io 0x30cc-0x30cf]
[ 11.576396] pci 0000:00:11.4: reg 0x18: [io 0x3090-0x3097]
[ 11.576403] pci 0000:00:11.4: reg 0x1c: [io 0x30c8-0x30cb]
[ 11.576411] pci 0000:00:11.4: reg 0x20: [io 0x3020-0x303f]
[ 11.576419] pci 0000:00:11.4: reg 0x24: [mem 0x91a00000-0x91a007ff]
[ 11.576461] pci 0000:00:11.4: PME# supported from D3hot
[ 11.576559] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330
[ 11.576574] pci 0000:00:14.0: reg 0x10: [mem 0x383fff100000-0x383fff10ffff 64bit]
[ 11.576628] pci 0000:00:14.0: PME# supported from D3hot D3cold
[ 11.576712] pci 0000:00:14.0: System wakeup disabled by ACPI
[ 11.576751] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000
[ 11.576768] pci 0000:00:16.0: reg 0x10: [mem 0x383fff133000-0x383fff13300f 64bit]
[ 11.576830] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[ 11.576924] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000
[ 11.576941] pci 0000:00:16.1: reg 0x10: [mem 0x383fff132000-0x383fff13200f 64bit]
[ 11.577002] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
[ 11.577113] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320
[ 11.577130] pci 0000:00:1a.0: reg 0x10: [mem 0x91a02000-0x91a023ff]
[ 11.577213] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[ 11.577288] pci 0000:00:1a.0: System wakeup disabled by ACPI
[ 11.577329] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400
[ 11.577395] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[ 11.577474] pci 0000:00:1c.0: System wakeup disabled by ACPI
[ 11.577515] pci 0000:00:1c.3: [8086:8d16] type 01 class 0x060400
[ 11.577581] pci 0000:00:1c.3: PME# supported from D0 D3hot D3cold
[ 11.577647] pci 0000:00:1c.3: System wakeup disabled by ACPI
[ 11.577696] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320
[ 11.577713] pci 0000:00:1d.0: reg 0x10: [mem 0x91a01000-0x91a013ff]
[ 11.577796] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[ 11.577872] pci 0000:00:1d.0: System wakeup disabled by ACPI
[ 11.577913] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100
[ 11.578103] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601
[ 11.578116] pci 0000:00:1f.2: reg 0x10: [io 0x30c0-0x30c7]
[ 11.578123] pci 0000:00:1f.2: reg 0x14: [io 0x30dc-0x30df]
[ 11.578131] pci 0000:00:1f.2: reg 0x18: [io 0x30b8-0x30bf]
[ 11.578138] pci 0000:00:1f.2: reg 0x1c: [io 0x30d8-0x30db]
[ 11.578145] pci 0000:00:1f.2: reg 0x20: [io 0x3040-0x305f]
[ 11.578152] pci 0000:00:1f.2: reg 0x24: [mem 0x91a04000-0x91a047ff]
[ 11.578188] pci 0000:00:1f.2: PME# supported from D3hot
[ 11.578278] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500
[ 11.578292] pci 0000:00:1f.3: reg 0x10: [mem 0x383fff131000-0x383fff1310ff 64bit]
[ 11.578311] pci 0000:00:1f.3: reg 0x20: [io 0x3000-0x301f]
[ 11.578575] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 11.578731] pci 0000:00:02.0: PCI bridge to [bus 02]
[ 11.578917] pci 0000:03:00.0: [8086:1521] type 00 class 0x020000
[ 11.578929] pci 0000:03:00.0: reg 0x10: [mem 0x91920000-0x9193ffff]
[ 11.578941] pci 0000:03:00.0: reg 0x18: [io 0x2020-0x203f]
[ 11.578949] pci 0000:03:00.0: reg 0x1c: [mem 0x91944000-0x91947fff]
[ 11.579023] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[ 11.579048] pci 0000:03:00.0: reg 0x184: [mem 0x383fff060000-0x383fff063fff 64bit pref]
[ 11.579050] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x383fff060000-0x383fff07ffff 64bit pref] (contains BAR0 for 8 VFs)
[ 11.579070] pci 0000:03:00.0: reg 0x190: [mem 0x383fff040000-0x383fff043fff 64bit pref]
[ 11.579072] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x383fff040000-0x383fff05ffff 64bit pref] (contains BAR3 for 8 VFs)
[ 11.579173] pci 0000:03:00.3: [8086:1521] type 00 class 0x020000
[ 11.579185] pci 0000:03:00.3: reg 0x10: [mem 0x91900000-0x9191ffff]
[ 11.579198] pci 0000:03:00.3: reg 0x18: [io 0x2000-0x201f]
[ 11.579205] pci 0000:03:00.3: reg 0x1c: [mem 0x91940000-0x91943fff]
[ 11.579276] pci 0000:03:00.3: PME# supported from D0 D3hot D3cold
[ 11.579298] pci 0000:03:00.3: reg 0x184: [mem 0x383fff020000-0x383fff023fff 64bit pref]
[ 11.579299] pci 0000:03:00.3: VF(n) BAR0 space: [mem 0x383fff020000-0x383fff03ffff 64bit pref] (contains BAR0 for 8 VFs)
[ 11.579318] pci 0000:03:00.3: reg 0x190: [mem 0x383fff000000-0x383fff003fff 64bit pref]
[ 11.579319] pci 0000:03:00.3: VF(n) BAR3 space: [mem 0x383fff000000-0x383fff01ffff 64bit pref] (contains BAR3 for 8 VFs)
[ 11.579946] pci 0000:00:02.2: PCI bridge to [bus 03-04]
[ 11.579952] pci 0000:00:02.2: bridge window [io 0x2000-0x2fff]
[ 11.579954] pci 0000:00:02.2: bridge window [mem 0x91900000-0x919fffff]
[ 11.579957] pci 0000:00:02.2: bridge window [mem 0x383fff000000-0x383fff0fffff 64bit pref]
[ 11.580274] pci 0000:05:00.0: [15b3:1015] type 00 class 0x020000
[ 11.580408] pci 0000:05:00.0: reg 0x10: [mem 0x383ffc000000-0x383ffdffffff 64bit pref]
[ 11.580714] pci 0000:05:00.0: reg 0x30: [mem 0xfff00000-0xffffffff pref]
[ 11.581360] pci 0000:05:00.0: PME# supported from D3cold
[ 11.581634] pci 0000:05:00.0: reg 0x1a4: [mem 0x383ffe800000-0x383ffe8fffff 64bit pref]
[ 11.581636] pci 0000:05:00.0: VF(n) BAR0 space: [mem 0x383ffe800000-0x383ffeffffff 64bit pref] (contains BAR0 for 8 VFs)
[ 11.582510] pci 0000:05:00.1: [15b3:1015] type 00 class 0x020000
[ 11.582641] pci 0000:05:00.1: reg 0x10: [mem 0x383ffa000000-0x383ffbffffff 64bit pref]
[ 11.582944] pci 0000:05:00.1: reg 0x30: [mem 0xfff00000-0xffffffff pref]
[ 11.583547] pci 0000:05:00.1: PME# supported from D3cold
[ 11.583800] pci 0000:05:00.1: reg 0x1a4: [mem 0x383ffe000000-0x383ffe0fffff 64bit pref]
[ 11.583802] pci 0000:05:00.1: VF(n) BAR0 space: [mem 0x383ffe000000-0x383ffe7fffff 64bit pref] (contains BAR0 for 8 VFs)
[ 11.584669] pci 0000:00:03.0: PCI bridge to [bus 05-06]
[ 11.584677] pci 0000:00:03.0: bridge window [mem 0x383ffa000000-0x383ffeffffff 64bit pref]
[ 11.584713] pci 0000:00:1c.0: PCI bridge to [bus 07]
[ 11.584786] pci 0000:08:00.0: [102b:0522] type 00 class 0x030000
[ 11.584810] pci 0000:08:00.0: reg 0x10: [mem 0x90000000-0x90ffffff pref]
[ 11.584824] pci 0000:08:00.0: reg 0x14: [mem 0x91800000-0x91803fff]
[ 11.584838] pci 0000:08:00.0: reg 0x18: [mem 0x91000000-0x917fffff]
[ 11.584892] pci 0000:08:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.595976] pci 0000:00:1c.3: PCI bridge to [bus 08]
[ 11.595985] pci 0000:00:1c.3: bridge window [mem 0x91000000-0x918fffff]
[ 11.595989] pci 0000:00:1c.3: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 11.596017] pci_bus 0000:00: on NUMA node 0
[ 11.596383] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 *10 11 12 14 15)
[ 11.596433] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *9 10 11 12 14 15)
[ 11.596479] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 7 9 10 11 12 14 15)
[ 11.596524] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[ 11.596569] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[ 11.596615] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 11.596661] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 11.596706] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 11.597000] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[ 11.597007] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 11.597481] acpi PNP0A08:01: _OSC: platform does not support [AER]
[ 11.598299] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 11.598304] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[ 11.598513] PCI host bridge to bus 0000:80
[ 11.598518] pci_bus 0000:80: root bus resource [io 0x8000-0xffff window]
[ 11.598521] pci_bus 0000:80: root bus resource [mem 0xc8000000-0xfbffbfff window]
[ 11.598526] pci_bus 0000:80: root bus resource [mem 0x384000000000-0x387fffffffff window]
[ 11.598531] pci_bus 0000:80: root bus resource [bus 80-fe]
[ 11.598544] pci 0000:80:04.0: [8086:2f20] type 00 class 0x088000
[ 11.598556] pci 0000:80:04.0: reg 0x10: [mem 0x387ffff1c000-0x387ffff1ffff 64bit]
[ 11.598669] pci 0000:80:04.1: [8086:2f21] type 00 class 0x088000
[ 11.598680] pci 0000:80:04.1: reg 0x10: [mem 0x387ffff18000-0x387ffff1bfff 64bit]
[ 11.598785] pci 0000:80:04.2: [8086:2f22] type 00 class 0x088000
[ 11.598796] pci 0000:80:04.2: reg 0x10: [mem 0x387ffff14000-0x387ffff17fff 64bit]
[ 11.598908] pci 0000:80:04.3: [8086:2f23] type 00 class 0x088000
[ 11.598919] pci 0000:80:04.3: reg 0x10: [mem 0x387ffff10000-0x387ffff13fff 64bit]
[ 11.599022] pci 0000:80:04.4: [8086:2f24] type 00 class 0x088000
[ 11.599033] pci 0000:80:04.4: reg 0x10: [mem 0x387ffff0c000-0x387ffff0ffff 64bit]
[ 11.599137] pci 0000:80:04.5: [8086:2f25] type 00 class 0x088000
[ 11.599147] pci 0000:80:04.5: reg 0x10: [mem 0x387ffff08000-0x387ffff0bfff 64bit]
[ 11.599253] pci 0000:80:04.6: [8086:2f26] type 00 class 0x088000
[ 11.599264] pci 0000:80:04.6: reg 0x10: [mem 0x387ffff04000-0x387ffff07fff 64bit]
[ 11.599369] pci 0000:80:04.7: [8086:2f27] type 00 class 0x088000
[ 11.599380] pci 0000:80:04.7: reg 0x10: [mem 0x387ffff00000-0x387ffff03fff 64bit]
[ 11.599483] pci 0000:80:05.0: [8086:2f28] type 00 class 0x088000
[ 11.599580] pci 0000:80:05.1: [8086:2f29] type 00 class 0x088000
[ 11.599696] pci 0000:80:05.2: [8086:2f2a] type 00 class 0x088000
[ 11.599793] pci 0000:80:05.4: [8086:2f2c] type 00 class 0x080020
[ 11.599800] pci 0000:80:05.4: reg 0x10: [mem 0xc8000000-0xc8000fff]
[ 11.599914] pci_bus 0000:80: on NUMA node 1
[ 11.600216] ACPI: Enabled 4 GPEs in block 00 to 3F
[ 11.600648] pci 0000:08:00.0: vgaarb: setting as boot VGA device
[ 11.600652] pci 0000:08:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[ 11.600659] pci 0000:08:00.0: vgaarb: bridge control possible
[ 11.600662] vgaarb: loaded
[ 11.600893] SCSI subsystem initialized
[ 11.601013] libata version 3.00 loaded.
[ 11.601035] ACPI: bus type USB registered
[ 11.601051] usbcore: registered new interface driver usbfs
[ 11.601059] usbcore: registered new interface driver hub
[ 11.601170] usbcore: registered new device driver usb
[ 11.601464] PCI: Using ACPI for IRQ routing
[ 11.606054] PCI: pci_cache_line_size set to 64 bytes
[ 11.606316] e820: reserve RAM buffer [mem 0x0009b400-0x0009ffff]
[ 11.606317] e820: reserve RAM buffer [mem 0x79fd1000-0x7bffffff]
[ 11.606318] e820: reserve RAM buffer [mem 0x7b800000-0x7bffffff]
[ 11.606434] NetLabel: Initializing
[ 11.606438] NetLabel: domain hash size = 128
[ 11.606440] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 11.606461] NetLabel: unlabeled traffic allowed by default
[ 11.606605] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[ 11.606612] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[ 11.608768] clocksource: Switched to clocksource hpet
[ 11.623202] VFS: Disk quotas dquot_6.6.0
[ 11.623245] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 11.623383] AppArmor: AppArmor Filesystem Enabled
[ 11.623420] pnp: PnP ACPI init
[ 11.624093] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[ 11.624238] system 00:01: [io 0x0500-0x053f] has been reserved
[ 11.624243] system 00:01: [io 0x0400-0x047f] has been reserved
[ 11.624247] system 00:01: [io 0x0540-0x057f] has been reserved
[ 11.624250] system 00:01: [io 0x0600-0x061f] has been reserved
[ 11.624253] system 00:01: [io 0x0ca0-0x0ca5] has been reserved
[ 11.624257] system 00:01: [io 0x0880-0x0883] has been reserved
[ 11.624260] system 00:01: [io 0x0800-0x081f] has been reserved
[ 11.624265] system 00:01: [mem 0xfed1c000-0xfed3ffff] could not be reserved
[ 11.624268] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved
[ 11.624272] system 00:01: [mem 0xff000000-0xffffffff] could not be reserved
[ 11.624275] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved
[ 11.624279] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved
[ 11.624282] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved
[ 11.624286] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved
[ 11.624291] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[ 11.624437] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active)
[ 11.624568] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[ 11.624824] pnp: PnP ACPI: found 4 devices
[ 11.631040] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 11.631054] pci 0000:05:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window
[ 11.631060] pci 0000:05:00.1: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window
[ 11.631067] pci 0000:08:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.631149] pci 0000:00:03.0: BAR 14: assigned [mem 0x91b00000-0x91cfffff]
[ 11.631154] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 11.631162] pci 0000:00:02.0: PCI bridge to [bus 02]
[ 11.631170] pci 0000:00:02.2: PCI bridge to [bus 03-04]
[ 11.631174] pci 0000:00:02.2: bridge window [io 0x2000-0x2fff]
[ 11.631179] pci 0000:00:02.2: bridge window [mem 0x91900000-0x919fffff]
[ 11.631183] pci 0000:00:02.2: bridge window [mem 0x383fff000000-0x383fff0fffff 64bit pref]
[ 11.631191] pci 0000:05:00.0: BAR 6: assigned [mem 0x91b00000-0x91bfffff pref]
[ 11.631196] pci 0000:05:00.1: BAR 6: assigned [mem 0x91c00000-0x91cfffff pref]
[ 11.631200] pci 0000:00:03.0: PCI bridge to [bus 05-06]
[ 11.631205] pci 0000:00:03.0: bridge window [mem 0x91b00000-0x91cfffff]
[ 11.631209] pci 0000:00:03.0: bridge window [mem 0x383ffa000000-0x383ffeffffff 64bit pref]
[ 11.631217] pci 0000:00:1c.0: PCI bridge to [bus 07]
[ 11.631228] pci 0000:08:00.0: BAR 6: assigned [mem 0x91810000-0x9181ffff pref]
[ 11.631232] pci 0000:00:1c.3: PCI bridge to [bus 08]
[ 11.631238] pci 0000:00:1c.3: bridge window [mem 0x91000000-0x918fffff]
[ 11.631243] pci 0000:00:1c.3: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 11.631252] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
[ 11.631253] pci_bus 0000:00: resource 5 [io 0x1000-0x7fff window]
[ 11.631254] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[ 11.631255] pci_bus 0000:00: resource 7 [mem 0x90000000-0xc7ffbfff window]
[ 11.631256] pci_bus 0000:00: resource 8 [mem 0x380000000000-0x383fffffffff window]
[ 11.631257] pci_bus 0000:03: resource 0 [io 0x2000-0x2fff]
[ 11.631258] pci_bus 0000:03: resource 1 [mem 0x91900000-0x919fffff]
[ 11.631259] pci_bus 0000:03: resource 2 [mem 0x383fff000000-0x383fff0fffff 64bit pref]
[ 11.631261] pci_bus 0000:05: resource 1 [mem 0x91b00000-0x91cfffff]
[ 11.631262] pci_bus 0000:05: resource 2 [mem 0x383ffa000000-0x383ffeffffff 64bit pref]
[ 11.631264] pci_bus 0000:08: resource 1 [mem 0x91000000-0x918fffff]
[ 11.631265] pci_bus 0000:08: resource 2 [mem 0x90000000-0x90ffffff 64bit pref]
[ 11.631381] pci_bus 0000:80: resource 4 [io 0x8000-0xffff window]
[ 11.631382] pci_bus 0000:80: resource 5 [mem 0xc8000000-0xfbffbfff window]
[ 11.631383] pci_bus 0000:80: resource 6 [mem 0x384000000000-0x387fffffffff window]
[ 11.631517] NET: Registered protocol family 2
[ 11.632007] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[ 11.632792] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 11.632984] TCP: Hash tables configured (established 524288 bind 65536)
[ 11.633128] UDP hash table entries: 32768 (order: 8, 1048576 bytes)
[ 11.633356] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes)
[ 11.633749] NET: Registered protocol family 1
[ 11.693117] pci 0000:08:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[ 11.693143] PCI: CLS 32 bytes, default 64
[ 11.693192] Unpacking initramfs...
[ 12.352664] Freeing initrd memory: 40316K
[ 12.352674] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 12.352679] software IO TLB [mem 0x75fd1000-0x79fd1000] (64MB) mapped at [ffff9f0375fd1000-ffff9f0379fd0fff]
[ 12.352732] Intel CQM monitoring enabled
[ 12.355819] Scanning for low memory corruption every 60 seconds
[ 12.356679] audit: initializing netlink subsys (disabled)
[ 12.357720] Initialise system trusted keyrings
[ 12.357796] workingset: timestamp_bits=36 max_order=24 bucket_order=0
[ 12.359070] zbud: loaded
[ 12.359799] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 12.360007] fuse init (API version 7.26)
[ 12.362284] Key type asymmetric registered
[ 12.362288] Asymmetric key parser 'x509' registered
[ 12.362302] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[ 12.362388] io scheduler noop registered
[ 12.362391] io scheduler deadline registered
[ 12.362428] io scheduler cfq registered (default)
[ 12.364042] pcieport 0000:00:01.0: Signaling PME with IRQ 25
[ 12.364062] pcieport 0000:00:02.0: Signaling PME with IRQ 26
[ 12.364077] pcieport 0000:00:02.2: Signaling PME with IRQ 27
[ 12.364095] pcieport 0000:00:03.0: Signaling PME with IRQ 28
[ 12.364137] pcieport 0000:00:1c.0: Signaling PME with IRQ 29
[ 12.364157] pcieport 0000:00:1c.3: Signaling PME with IRQ 30
[ 12.364227] vesafb: mode is 640x480x32, linelength=2560, pages=0
[ 12.364230] vesafb: scrolling: redraw
[ 12.364234] vesafb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[ 12.364251] vesafb: framebuffer at 0x90000000, mapped to 0xffffc14588200000, using 1216k, total 1216k
[ 12.450838] Console: switching to colour frame buffer device 80x30
[ 12.539958] fb0: VESA VGA frame buffer device
[ 12.541785] intel_idle: MWAIT substates: 0x2120
[ 12.541786] intel_idle: v0.4.1 model 0x3F
[ 12.543344] intel_idle: lapic_timer_reliable_states 0xffffffff
[ 12.543614] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 12.546688] ACPI: Power Button [PWRF]
[ 12.593635] ERST: Error Record Serialization Table (ERST) support is initialized.
[ 12.689642] pstore: using zlib compression
[ 12.737688] pstore: Registered erst as persistent store backend
[ 12.786308] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[ 12.886133] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 12.957206] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 13.078716] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[ 13.181942] Linux agpgart interface v0.103
[ 13.243576] loop: module loaded
[ 13.297236] libphy: Fixed MDIO Bus: probed
[ 13.350780] tun: Universal TUN/TAP device driver, 1.6
[ 13.406414] tsc: Refined TSC clocksource calibration: 2294.686 MHz
[ 13.408964] PPP generic driver version 2.4.2
[ 13.409045] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 13.409050] ehci-pci: EHCI PCI platform driver
[ 13.409320] ehci-pci 0000:00:1a.0: EHCI Host Controller
[ 13.409332] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[ 13.409379] ehci-pci 0000:00:1a.0: debug port 2
[ 13.413340] ehci-pci 0000:00:1a.0: cache line size of 32 is not supported
[ 13.413354] ehci-pci 0000:00:1a.0: irq 18, io mem 0x91a02000
[ 13.424856] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[ 13.424903] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[ 13.424905] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 13.424906] usb usb1: Product: EHCI Host Controller
[ 13.424907] usb usb1: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence ehci_hcd
[ 13.424908] usb usb1: SerialNumber: 0000:00:1a.0
[ 13.425071] hub 1-0:1.0: USB hub found
[ 13.425075] hub 1-0:1.0: 2 ports detected
[ 13.425381] ehci-pci 0000:00:1d.0: EHCI Host Controller
[ 13.425386] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[ 13.425432] ehci-pci 0000:00:1d.0: debug port 2
[ 13.429389] ehci-pci 0000:00:1d.0: cache line size of 32 is not supported
[ 13.429401] ehci-pci 0000:00:1d.0: irq 18, io mem 0x91a01000
[ 13.440840] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[ 13.440881] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[ 13.440882] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 13.440883] usb usb2: Product: EHCI Host Controller
[ 13.440884] usb usb2: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence ehci_hcd
[ 13.440885] usb usb2: SerialNumber: 0000:00:1d.0
[ 13.441038] hub 2-0:1.0: USB hub found
[ 13.441041] hub 2-0:1.0: 2 ports detected
[ 13.441184] ehci-platform: EHCI generic platform driver
[ 13.441195] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 13.441199] ohci-pci: OHCI PCI platform driver
[ 13.441227] ohci-platform: OHCI generic platform driver
[ 13.441233] uhci_hcd: USB Universal Host Controller Interface driver
[ 13.441448] xhci_hcd 0000:00:14.0: xHCI Host Controller
[ 13.441458] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3
[ 13.442846] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x00009810
[ 13.442861] xhci_hcd 0000:00:14.0: cache line size of 32 is not supported
[ 13.442980] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[ 13.442981] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 13.442982] usb usb3: Product: xHCI Host Controller
[ 13.442983] usb usb3: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence xhci-hcd
[ 13.442984] usb usb3: SerialNumber: 0000:00:14.0
[ 13.443162] hub 3-0:1.0: USB hub found
[ 13.443233] hub 3-0:1.0: 15 ports detected
[ 13.445532] xhci_hcd 0000:00:14.0: xHCI Host Controller
[ 13.445536] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4
[ 13.445578] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
[ 13.445579] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 13.445580] usb usb4: Product: xHCI Host Controller
[ 13.445581] usb usb4: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence xhci-hcd
[ 13.445582] usb usb4: SerialNumber: 0000:00:14.0
[ 13.445759] hub 4-0:1.0: USB hub found
[ 13.445790] hub 4-0:1.0: 6 ports detected
[ 13.446872] i8042: PNP: No PS/2 controller found.
[ 13.447031] mousedev: PS/2 mouse device common for all mice
[ 13.447229] rtc_cmos 00:00: RTC can wake from S4
[ 13.447766] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[ 13.447873] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[ 13.447879] i2c /dev entries driver
[ 13.447936] device-mapper: uevent: version 1.0.3
[ 13.448073] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com
[ 13.448083] intel_pstate: Intel P-state driver initializing
[ 13.752829] usb 1-1: new high-speed USB device number 2 using ehci-pci
[ 13.768896] usb 3-1: new low-speed USB device number 2 using xhci_hcd
[ 13.768914] usb 2-1: new high-speed USB device number 2 using ehci-pci
[ 13.901446] usb 1-1: New USB device found, idVendor=8087, idProduct=800a
[ 13.901449] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 13.901718] hub 1-1:1.0: USB hub found
[ 13.901818] hub 1-1:1.0: 6 ports detected
[ 13.916149] usb 3-1: New USB device found, idVendor=14dd, idProduct=1007
[ 13.916153] usb 3-1: New USB device strings: Mfr=1, Product=2, SerialNumber=7
[ 13.916155] usb 3-1: Product: D2CIM-DVUSB
[ 13.916157] usb 3-1: Manufacturer: Raritan
[ 13.916159] usb 3-1: SerialNumber: PQ254006510000007
[ 13.925504] usb 2-1: New USB device found, idVendor=8087, idProduct=8002
[ 13.925506] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 13.925916] hub 2-1:1.0: USB hub found
[ 13.926124] hub 2-1:1.0: 8 ports detected
[ 14.072851] usb 3-9: new full-speed USB device number 3 using xhci_hcd
[ 14.234769] usb 3-9: New USB device found, idVendor=046b, idProduct=ff10
[ 14.234770] usb 3-9: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 14.234771] usb 3-9: Product: Virtual Keyboard and Mouse
[ 14.234772] usb 3-9: Manufacturer: American Megatrends Inc.
[ 14.234774] usb 3-9: SerialNumber: serial
[ 18.903926] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x211399552f8, max_idle_ns: 440795292447 ns
[ 19.012731] ledtrig-cpu: registered to indicate activity on CPUs
[ 19.069392] NET: Registered protocol family 10
[ 19.128975] Segment Routing with IPv6
[ 19.184020] NET: Registered protocol family 17
[ 19.237964] Key type dns_resolver registered
[ 19.295211] microcode: sig=0x306f2, pf=0x1, revision=0x37
[ 19.347777] microcode: Microcode Update Driver: v2.2.
[ 19.347886] registered taskstats version 1
[ 19.449432] Loading compiled-in X.509 certificates
[ 19.501954] Loaded X.509 cert 'Build time autogenerated kernel key: de39ac008d1fce01b49462a1060a30c176fa995c'
[ 19.605134] zswap: loaded using pool lzo/zbud
[ 19.667289] Key type big_key registered
[ 19.719038] Key type trusted registered
[ 19.771096] Key type encrypted registered
[ 19.820719] AppArmor: AppArmor sha1 policy hashing enabled
[ 19.871919] ima: No TPM chip found, activating TPM-bypass! (rc=-19)
[ 19.924389] evm: HMAC attrs: 0x1
[ 19.976285] Magic number: 13:369:100
[ 20.027497] rtc_cmos 00:00: setting system clock to 2017-04-19 23:06:01 UTC (1492643161)
[ 20.132303] clocksource: Switched to clocksource tsc
[ 20.132332] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[ 20.132332] EDD information not available.
[ 20.132362] PM: Hibernation image not present or could not be loaded.
[ 20.294528] Freeing unused kernel memory: 2212K
[ 20.347593] Write protecting the kernel read-only data: 14336k
[ 20.402184] Freeing unused kernel memory: 1148K
[ 20.456758] Freeing unused kernel memory: 212K
[ 20.510034] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 20.673357] random: systemd-udevd: uninitialized urandom read (16 bytes read)
[ 20.674235] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.674262] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.677158] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.677197] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.677230] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.677285] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.677318] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.677350] random: udevadm: uninitialized urandom read (16 bytes read)
[ 20.677387] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.161682] wmi: Mapper loaded
[ 21.202197] hidraw: raw HID events driver (C) Jiri Kosina
[ 21.202222] pps_core: LinuxPPS API ver. 1 registered
[ 21.202222] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 21.370216] PTP clock support registered
[ 21.412724] ahci 0000:00:11.4: version 3.0
[ 21.412968] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode
[ 21.412981] dca service started, version 1.12.1
[ 21.540694] ahci 0000:00:11.4: flags: 64bit ncq led clo pio slum part ems apst
[ 21.626996] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[ 21.634292] usbcore: registered new interface driver usbhid
[ 21.634293] usbhid: USB HID core driver
[ 21.665169] scsi host0: ahci
[ 21.665259] scsi host1: ahci
[ 21.665364] scsi host2: ahci
[ 21.665477] scsi host3: ahci
[ 21.665513] ata1: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00100 irq 31
[ 21.665519] ata2: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00180 irq 31
[ 21.665525] ata3: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00200 irq 31
[ 21.665532] ata4: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00280 irq 31
[ 21.666050] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[ 21.666052] ahci 0000:00:1f.2: flags: 64bit ncq led clo pio slum part ems apst
[ 21.729277] scsi host4: ahci
[ 21.729393] scsi host5: ahci
[ 21.729525] scsi host6: ahci
[ 21.729651] scsi host7: ahci
[ 21.729776] scsi host8: ahci
[ 21.729902] scsi host9: ahci
[ 21.729939] ata5: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04100 irq 32
[ 21.729942] ata6: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04180 irq 32
[ 21.729948] ata7: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04200 irq 32
[ 21.729955] ata8: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04280 irq 32
[ 21.729962] ata9: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04300 irq 32
[ 21.729969] ata10: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04380 irq 32
[ 21.979838] ata3: SATA link down (SStatus 0 SControl 300)
[ 21.983632] ata1: SATA link down (SStatus 0 SControl 300)
[ 21.983751] ata4: SATA link down (SStatus 0 SControl 300)
[ 21.983852] ata2: SATA link down (SStatus 0 SControl 300)
[ 22.044067] ata9: SATA link down (SStatus 0 SControl 300)
[ 22.044180] ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[ 22.044542] ata5.00: ATA-8: INTEL SSDSA2BW300G3, 4PC10302, max UDMA/133
[ 22.044543] ata5.00: 586072368 sectors, multi 1: LBA48 NCQ (depth 31/32)
[ 22.044963] ata5.00: configured for UDMA/133
[ 22.045221] scsi 4:0:0:0: Direct-Access ATA INTEL SSDSA2BW30 0302 PQ: 0 ANSI: 5
[ 22.047984] ata6: SATA link down (SStatus 0 SControl 300)
[ 22.048080] ata7: SATA link down (SStatus 0 SControl 300)
[ 22.048189] ata10: SATA link down (SStatus 0 SControl 300)
[ 22.048292] ata8: SATA link down (SStatus 0 SControl 300)
[ 22.095767] AVX2 version of gcm_enc/dec engaged.
[ 22.095767] AES CTR mode by8 optimization enabled
[ 24.461256] igb: Copyright (c) 2007-2014 Intel Corporation.
[ 24.553223] mlx5_core 0000:05:00.0: firmware version: 14.18.2000
[ 24.608607] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.0/0003:14DD:1007.0001/input/input1
[ 24.651134] igb 0000:03:00.0: added PHC on eth0
[ 24.651135] igb 0000:03:00.0: Intel(R) Gigabit Ethernet Network Connection
[ 24.651137] igb 0000:03:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:fe:f6:8f
[ 24.651214] igb 0000:03:00.0: eth0: PBA No: 100000-000
[ 24.651214] igb 0000:03:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[ 24.721271] igb 0000:03:00.3: added PHC on eth1
[ 24.721272] igb 0000:03:00.3: Intel(R) Gigabit Ethernet Network Connection
[ 24.721272] igb 0000:03:00.3: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:fe:f6:90
[ 24.721345] igb 0000:03:00.3: eth1: PBA No: 100000-000
[ 24.721346] igb 0000:03:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[ 24.930623] igb 0000:03:00.0 eno1: renamed from eth0
[ 25.296860] (0000:05:00.0): E-Switch: Total vports 9, l2 table size(65536), per vport: max uc(1024) max mc(16384)
[ 25.313439] mlx5_core 0000:05:00.0: Port module event: module 0, Cable plugged
[ 25.327090] mlx5_core 0000:05:00.1: firmware version: 14.18.2000
[ 25.721037] ata5.00: Enabling discard_zeroes_data
[ 25.721040] sd 4:0:0:0: Attached scsi generic sg0 type 0
[ 25.725021] igb 0000:03:00.3 eno2: renamed from eth1
[ 25.744882] hid-generic 0003:14DD:1007.0001: input,hidraw0: USB HID v1.10 Keyboard [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input0
[ 25.745022] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.1/0003:14DD:1007.0002/input/input2
[ 25.745118] hid-generic 0003:14DD:1007.0002: input,hidraw1: USB HID v1.10 Mouse [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input1
[ 25.745787] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.2/0003:14DD:1007.0003/input/input3
[ 25.745917] hid-generic 0003:14DD:1007.0003: input,hidraw2: USB HID v1.10 Mouse [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input2
[ 25.746038] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb3/3-9/3-9:1.0/0003:046B:FF10.0004/input/input4
[ 25.746088] hid-generic 0003:046B:FF10.0004: input,hidraw3: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:14.0-9/input0
[ 25.746223] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb3/3-9/3-9:1.1/0003:046B:FF10.0005/input/input5
[ 25.746279] hid-generic 0003:046B:FF10.0005: input,hidraw4: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:14.0-9/input1
[ 27.253415] sd 4:0:0:0: [sda] 586072368 512-byte logical blocks: (300 GB/279 GiB)
[ 27.406831] sd 4:0:0:0: [sda] Write Protect is off
[ 27.428810] (0000:05:00.1): E-Switch: Total vports 9, l2 table size(65536), per vport: max uc(1024) max mc(16384)
[ 27.445236] mlx5_core 0000:05:00.1: Port module event: module 1, Cable plugged
[ 27.456975] mlx5_core 0000:05:00.0: MLX5E: StrdRq(1) RqSz(8) StrdSz(64) RxCqeCmprss(0)
[ 27.604299] random: fast init done
[ 28.022043] sd 4:0:0:0: [sda] Mode Sense: 00 3a 00 00
[ 28.022050] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 28.043430] mlx5_core 0000:05:00.1: MLX5E: StrdRq(1) RqSz(8) StrdSz(64) RxCqeCmprss(0)
[ 28.331453] ata5.00: Enabling discard_zeroes_data
[ 28.332504] mlx5_core 0000:05:00.1 ens785f1: renamed from eth1
[ 28.483888] sda: sda1 sda2 < sda5 >
[ 28.557866] ata5.00: Enabling discard_zeroes_data
[ 28.631071] sd 4:0:0:0: [sda] Attached SCSI disk
[ 28.703055] mlx5_core 0000:05:00.0 ens785f0: renamed from eth0
[ 30.020789] raid6: sse2x1 gen() 10923 MB/s
[ 30.224792] raid6: sse2x1 xor() 8756 MB/s
[ 30.360789] raid6: sse2x2 gen() 14302 MB/s
[ 30.492791] raid6: sse2x2 xor() 9567 MB/s
[ 30.624792] raid6: sse2x4 gen() 16520 MB/s
[ 30.752790] raid6: sse2x4 xor() 11597 MB/s
[ 30.876804] raid6: avx2x1 gen() 21864 MB/s
[ 31.000807] raid6: avx2x1 xor() 16675 MB/s
[ 31.120789] raid6: avx2x2 gen() 25423 MB/s
[ 31.240789] raid6: avx2x2 xor() 17209 MB/s
[ 31.356789] raid6: avx2x4 gen() 29460 MB/s
[ 31.472790] raid6: avx2x4 xor() 17990 MB/s
[ 31.521270] raid6: using algorithm avx2x4 gen() 29460 MB/s
[ 31.569209] raid6: .... xor() 17990 MB/s, rmw enabled
[ 31.615845] raid6: using avx2x2 recovery algorithm
[ 31.662300] xor: automatically using best checksumming function avx
[ 31.709254] async_tx: api initialized (async)
[ 31.915993] Btrfs loaded, crc32c=crc32c-intel
[ 32.293290] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[ 32.653932] ip_tables: (C) 2000-2006 Netfilter Core Team
[ 32.752341] systemd[1]: systemd 231 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[ 32.905226] systemd[1]: Detected architecture x86-64.
[ 33.122334] systemd[1]: Set hostname to <nvmfji02>.
[ 33.264620] systemd[1]: Created slice System Slice.
[ 33.376771] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[ 33.548924] systemd[1]: Listening on LVM2 poll daemon socket.
[ 33.666591] systemd[1]: Listening on udev Kernel Socket.
[ 33.781787] systemd[1]: Reached target Encrypted Volumes.
[ 33.899539] systemd[1]: Reached target User and Group Name Lookups.
[ 34.019426] systemd[1]: Listening on Syslog Socket.
[ 34.396311] mlx5_ib: Mellanox Connect-IB Infiniband driver v2.2-1 (Feb 2014)
[ 36.148916] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro
[ 36.272199] Loading iSCSI transport class v2.0-870.
[ 36.277925] iscsi: registered transport (tcp)
[ 36.280727] iscsi: registered transport (iser)
[ 37.085410] systemd-journald[766]: Received request to flush runtime journal from PID 1
[ 37.188570] ipmi message handler version 39.2
[ 37.191417] ipmi device interface
[ 37.194434] IPMI System Interface driver.
[ 37.194620] ipmi_si: probing via SMBIOS
[ 37.194621] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[ 37.194622] ipmi_si: Adding SMBIOS-specified kcs state machine
[ 37.194624] ipmi_si: probing via SPMI
[ 37.194624] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[ 37.194625] ipmi_si: SPMI-specified kcs state machine: duplicate
[ 37.194626] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[ 37.201086] power_meter ACPI000D:00: Found ACPI power meter.
[ 37.201427] power_meter ACPI000D:00: Ignoring unsafe software power cap!
[ 37.201489] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info().
[ 37.253441] random: crng init done
[ 37.286582] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 37.286784] ioatdma: Intel(R) QuickData Technology Driver 4.00
[ 37.309946] igb 0000:03:00.0: DCA enabled
[ 37.310274] igb 0000:03:00.3: DCA enabled
[ 37.321714] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[ 37.530737] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x006f, dev_id: 0x21)
[ 37.530857] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[ 37.532823] IPMI SSIF Interface driver
[ 37.742381] RAPL PMU: API unit is 2^-32 Joules, 4 fixed counters, 655360 ms ovfl timer
[ 37.742381] RAPL PMU: hw unit of domain pp0-core 2^-14 Joules
[ 37.742382] RAPL PMU: hw unit of domain package 2^-14 Joules
[ 37.742382] RAPL PMU: hw unit of domain dram 2^-14 Joules
[ 37.742383] RAPL PMU: hw unit of domain pp1-gpu 2^-14 Joules
[ 37.783634] kvm: disabled by bios
[ 38.018365] EDAC MC: Ver: 3.0.0
[ 38.021338] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[ 38.021346] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[ 38.021354] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[ 38.021361] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[ 38.021364] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[ 38.021368] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[ 38.021372] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[ 38.021375] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[ 38.021379] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[ 38.021383] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[ 38.021387] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[ 38.021391] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[ 38.021395] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[ 38.021398] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[ 38.021402] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[ 38.021406] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[ 38.021409] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[ 38.021413] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[ 38.021417] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[ 38.021420] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[ 38.021425] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[ 38.021428] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[ 38.021431] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[ 38.021436] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[ 38.021439] EDAC sbridge: Seeking for: PCI ID 8086:2fac
[ 38.021447] EDAC sbridge: Seeking for: PCI ID 8086:2fad
[ 38.021455] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[ 38.021459] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[ 38.021463] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[ 38.021466] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[ 38.021470] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[ 38.021474] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[ 38.021477] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[ 38.021482] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[ 38.021486] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[ 38.021489] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[ 38.021493] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[ 38.021497] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[ 38.021500] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[ 38.021504] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[ 38.021508] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[ 38.021511] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[ 38.021515] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[ 38.021520] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[ 38.021522] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[ 38.021526] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[ 38.021531] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[ 38.021534] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[ 38.021538] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[ 38.021542] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[ 38.021545] EDAC sbridge: Seeking for: PCI ID 8086:2f6c
[ 38.021553] EDAC sbridge: Seeking for: PCI ID 8086:2f6d
[ 38.021696] EDAC MC0: Giving out device to module sbridge_edac.c controller Haswell Socket#0: DEV 0000:ff:12.0 (INTERRUPT)
[ 38.021934] EDAC MC1: Giving out device to module sbridge_edac.c controller Haswell Socket#1: DEV 0000:7f:12.0 (INTERRUPT)
[ 38.021935] EDAC sbridge: Ver: 1.1.1
[ 38.026031] intel_rapl: Found RAPL domain package
[ 38.026035] intel_rapl: Found RAPL domain dram
[ 38.026037] intel_rapl: DRAM domain energy unit 15300pj
[ 38.026912] intel_rapl: Found RAPL domain package
[ 38.026915] intel_rapl: Found RAPL domain dram
[ 38.026917] intel_rapl: DRAM domain energy unit 15300pj
[ 38.362943] Adding 67008508k swap on /dev/sda5. Priority:-1 extents:1 across:67008508k SSFS
[ 38.883418] mlx5_core 0000:05:00.0 ens785f0: Link up
[ 39.210344] mlx5_core 0000:05:00.1 ens785f1: Link up
[ 39.345569] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready
[ 40.164608] new mount options do not match the existing superblock, will be ignored
[ 43.014099] igb 0000:03:00.0 eno1: igb: eno1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
[ 43.014236] IPv6: ADDRCONF(NETDEV_CHANGE): eno1: link becomes ready
[ 1305.098645] nvme nvme0: creating 32 I/O queues.
[ 1305.908062] nvme nvme0: new ctrl: NQN "subsys0", addr 10.10.0.1:4420
[ 1305.927689] nvme nvme1: creating 32 I/O queues.
[ 1306.745501] nvme nvme1: new ctrl: NQN "subsys1", addr 10.11.0.1:4420
[ 1306.765171] nvme nvme2: creating 32 I/O queues.
[ 1307.570046] nvme nvme2: new ctrl: NQN "subsys2", addr 10.10.0.1:4420
[ 1307.589248] nvme nvme3: creating 32 I/O queues.
[ 1308.401804] nvme nvme3: new ctrl: NQN "subsys3", addr 10.11.0.1:4420
[ 8298.200984] perf: interrupt took too long (2508 > 2500), lowering kernel.perf_event_max_sample_rate to 79500
[11081.337510] perf: interrupt took too long (3139 > 3135), lowering kernel.perf_event_max_sample_rate to 63500
[27917.701647] blk_update_request: I/O error, dev nvme1n1, sector 14361472
[27917.742489] blk_update_request: I/O error, dev nvme1n1, sector 14365568
[27917.781352] blk_update_request: I/O error, dev nvme1n1, sector 14362368
[27917.819088] blk_update_request: I/O error, dev nvme1n1, sector 14362624
[27917.855937] blk_update_request: I/O error, dev nvme1n1, sector 14364288
[27917.891947] blk_update_request: I/O error, dev nvme1n1, sector 14364544
[27917.926850] blk_update_request: I/O error, dev nvme1n1, sector 14363392
[27917.961278] blk_update_request: I/O error, dev nvme1n1, sector 14361984
[27917.994955] blk_update_request: I/O error, dev nvme1n1, sector 14362496
[27918.027947] blk_update_request: I/O error, dev nvme1n1, sector 14362752
[27918.085696] nvme nvme1: reconnecting in 10 seconds
[27928.386169] nvme nvme1: creating 32 I/O queues.
[27928.487779] nvme nvme1: Successfully reconnected
[28572.006509] blk_update_request: 34 callbacks suppressed
[28572.006512] blk_update_request: I/O error, dev nvme1n1, sector 69376
[28572.037988] blk_update_request: I/O error, dev nvme1n1, sector 69504
[28572.068413] blk_update_request: I/O error, dev nvme1n1, sector 69632
[28572.099120] blk_update_request: I/O error, dev nvme1n1, sector 69760
[28572.129276] blk_update_request: I/O error, dev nvme1n1, sector 69888
[28572.158867] blk_update_request: I/O error, dev nvme1n1, sector 70016
[28572.187417] blk_update_request: I/O error, dev nvme1n1, sector 70144
[28572.214854] blk_update_request: I/O error, dev nvme1n1, sector 70272
[28572.240052] blk_update_request: I/O error, dev nvme1n1, sector 70400
[28572.262995] blk_update_request: I/O error, dev nvme1n1, sector 70528
[28572.306523] nvme nvme1: reconnecting in 10 seconds
[28582.481490] nvme nvme1: creating 32 I/O queues.
[28582.580620] nvme nvme1: Successfully reconnected
[29807.784167] blk_update_request: 66 callbacks suppressed
[29807.784170] blk_update_request: I/O error, dev nvme3n1, sector 6016
[29807.804541] blk_update_request: I/O error, dev nvme3n1, sector 6144
[29807.825129] blk_update_request: I/O error, dev nvme3n1, sector 6272
[29807.845928] blk_update_request: I/O error, dev nvme3n1, sector 6400
[29807.866860] blk_update_request: I/O error, dev nvme3n1, sector 6528
[29807.885893] blk_update_request: I/O error, dev nvme3n1, sector 6656
[29807.903996] blk_update_request: I/O error, dev nvme3n1, sector 6784
[29807.921125] blk_update_request: I/O error, dev nvme3n1, sector 6912
[29807.937356] blk_update_request: I/O error, dev nvme3n1, sector 7040
[29807.952611] blk_update_request: I/O error, dev nvme3n1, sector 7168
[29807.980174] nvme nvme3: reconnecting in 10 seconds
[29808.028179] nvme nvme1: reconnecting in 10 seconds
[29818.269544] nvme nvme3: creating 32 I/O queues.
[29818.461976] nvme nvme1: creating 32 I/O queues.
[29818.503149] nvme nvme3: Successfully reconnected
[29818.571945] nvme nvme1: Successfully reconnected
[-- Attachment #4: target.txt --]
[-- Type: text/plain, Size: 172878 bytes --]
[ 0.000000] Linux version 4.11.0-rc6patch-2-get-fence (r1@rrpatch) (gcc version 6.2.0 20161005 (Ubuntu 6.2.0-5ubuntu12) ) #1 SMP Tue Apr 11 08:56:12 PDT 2017
[ 0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.11.0-rc6patch-2-get-fence root=UUID=55c1c371-fc16-4703-9808-e5e2c2ba309a ro
[ 0.000000] KERNEL supported cpus:
[ 0.000000] Intel GenuineIntel
[ 0.000000] AMD AuthenticAMD
[ 0.000000] Centaur CentaurHauls
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256
[ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format.
[ 0.000000] e820: BIOS-provided physical RAM map:
[ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009b3ff] usable
[ 0.000000] BIOS-e820: [mem 0x000000000009b400-0x000000000009ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000079fc4fff] usable
[ 0.000000] BIOS-e820: [mem 0x0000000079fc5000-0x000000007ac50fff] reserved
[ 0.000000] BIOS-e820: [mem 0x000000007ac51000-0x000000007b680fff] ACPI NVS
[ 0.000000] BIOS-e820: [mem 0x000000007b681000-0x000000007b7cefff] ACPI data
[ 0.000000] BIOS-e820: [mem 0x000000007b7cf000-0x000000007b7fffff] usable
[ 0.000000] BIOS-e820: [mem 0x000000007b800000-0x000000008fffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[ 0.000000] BIOS-e820: [mem 0x00000000ff400000-0x00000000ffffffff] reserved
[ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000107fffffff] usable
[ 0.000000] NX (Execute Disable) protection: active
[ 0.000000] SMBIOS 2.7 present.
[ 0.000000] DMI: Intel Corporation S2600WT2/S2600WT2, BIOS SE5C610.86B.11.01.0132.060620160917 06/06/2016
[ 0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[ 0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[ 0.000000] e820: last_pfn = 0x1080000 max_arch_pfn = 0x400000000
[ 0.000000] MTRR default type: write-back
[ 0.000000] MTRR fixed ranges enabled:
[ 0.000000] 00000-9FFFF write-back
[ 0.000000] A0000-BFFFF uncachable
[ 0.000000] C0000-FFFFF write-protect
[ 0.000000] MTRR variable ranges enabled:
[ 0.000000] 0 base 000080000000 mask 3FFF80000000 uncachable
[ 0.000000] 1 base 380000000000 mask 3F8000000000 uncachable
[ 0.000000] 2 disabled
[ 0.000000] 3 disabled
[ 0.000000] 4 disabled
[ 0.000000] 5 disabled
[ 0.000000] 6 disabled
[ 0.000000] 7 disabled
[ 0.000000] 8 disabled
[ 0.000000] 9 disabled
[ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WC UC- WT
[ 0.000000] e820: last_pfn = 0x7b800 max_arch_pfn = 0x400000000
[ 0.000000] found SMP MP-table at [mem 0x000fd850-0x000fd85f] mapped at [ffff9934800fd850]
[ 0.000000] Scanning 1 areas for low memory corruption
[ 0.000000] Base memory trampoline at [ffff993480095000] 95000 size 24576
[ 0.000000] Using GB pages for direct mapping
[ 0.000000] BRK [0x103960b000, 0x103960bfff] PGTABLE
[ 0.000000] BRK [0x103960c000, 0x103960cfff] PGTABLE
[ 0.000000] BRK [0x103960d000, 0x103960dfff] PGTABLE
[ 0.000000] BRK [0x103960e000, 0x103960efff] PGTABLE
[ 0.000000] BRK [0x103960f000, 0x103960ffff] PGTABLE
[ 0.000000] BRK [0x1039610000, 0x1039610fff] PGTABLE
[ 0.000000] BRK [0x1039611000, 0x1039611fff] PGTABLE
[ 0.000000] RAMDISK: [mem 0x33130000-0x3588ffff]
[ 0.000000] ACPI: Early table checksum verification disabled
[ 0.000000] ACPI: RSDP 0x00000000000F0460 000024 (v02 INTEL )
[ 0.000000] ACPI: XSDT 0x000000007B7CD0E8 0000BC (v01 INTEL S2600WT 00000000 INTL 01000013)
[ 0.000000] ACPI: FACP 0x000000007B7CC000 0000F4 (v04 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: DSDT 0x000000007B791000 032D68 (v02 INTEL S2600WT 00000003 INTL 20091013)
[ 0.000000] ACPI: FACS 0x000000007B650000 000040
[ 0.000000] ACPI: HPET 0x000000007B7CB000 000038 (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: APIC 0x000000007B7CA000 000AFC (v03 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: MCFG 0x000000007B7C9000 00003C (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: MSCT 0x000000007B7C8000 000090 (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SLIT 0x000000007B7C7000 00006C (v01 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SRAT 0x000000007B7C6000 000770 (v03 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: SPMI 0x000000007B7C5000 000041 (v05 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: WDDT 0x000000007B7C4000 000040 (v01 INTEL S2600WT 00000000 INTL 20091013)
[ 0.000000] ACPI: NITR 0x000000007B6A6000 000071 (v02 INTEL S2600WT 00000001 INTL 20091013)
[ 0.000000] ACPI: PRAD 0x000000007B6A1000 000102 (v02 INTEL SpsPrAgg 00000002 INTL 20130328)
[ 0.000000] ACPI: UEFI 0x000000007B679000 000042 (v01 INTEL S2600WT 00000002 INTL 01000013)
[ 0.000000] ACPI: SSDT 0x000000007B6A7000 0E96B0 (v02 INTEL S2600WT 00004000 INTL 20130328)
[ 0.000000] ACPI: SSDT 0x000000007B6A3000 002679 (v02 INTEL S2600WT 00000002 INTL 20130328)
[ 0.000000] ACPI: SSDT 0x000000007B6A2000 000064 (v02 INTEL S2600WT 00000002 INTL 20130328)
[ 0.000000] ACPI: HEST 0x000000007B6A0000 0000A8 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: BERT 0x000000007B69F000 000030 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: ERST 0x000000007B69E000 000230 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: EINJ 0x000000007B69D000 000130 (v01 INTEL S2600WT 00000001 INTL 00000001)
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] SRAT: PXM 0 -> APIC 0x00 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x02 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x04 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x06 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x08 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x10 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x12 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x14 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x16 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x20 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x22 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x24 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x26 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x28 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x30 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x32 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x34 -> Node 0
[ 0.000000] SRAT: PXM 0 -> APIC 0x36 -> Node 0
[ 0.000000] SRAT: PXM 1 -> APIC 0x40 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x42 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x44 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x46 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x48 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x50 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x52 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x54 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x56 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x60 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x62 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x64 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x66 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x68 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x70 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x72 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x74 -> Node 1
[ 0.000000] SRAT: PXM 1 -> APIC 0x76 -> Node 1
[ 0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[ 0.000000] ACPI: SRAT: Node 0 PXM 0 [mem 0x100000000-0x87fffffff]
[ 0.000000] ACPI: SRAT: Node 1 PXM 1 [mem 0x880000000-0x107fffffff]
[ 0.000000] NUMA: Initialized distance table, cnt=2
[ 0.000000] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem 0x100000000-0x87fffffff] -> [mem 0x00000000-0x87fffffff]
[ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff]
[ 0.000000] NODE_DATA(1) allocated [mem 0x107ffd4000-0x107fffefff]
[ 0.000000] Zone ranges:
[ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff]
[ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff]
[ 0.000000] Normal [mem 0x0000000100000000-0x000000107fffffff]
[ 0.000000] Device empty
[ 0.000000] Movable zone start for each node
[ 0.000000] Early memory node ranges
[ 0.000000] node 0: [mem 0x0000000000001000-0x000000000009afff]
[ 0.000000] node 0: [mem 0x0000000000100000-0x0000000079fc4fff]
[ 0.000000] node 0: [mem 0x000000007b7cf000-0x000000007b7fffff]
[ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff]
[ 0.000000] node 1: [mem 0x0000000880000000-0x000000107fffffff]
[ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff]
[ 0.000000] On node 0 totalpages: 8363920
[ 0.000000] DMA zone: 64 pages used for memmap
[ 0.000000] DMA zone: 21 pages reserved
[ 0.000000] DMA zone: 3994 pages, LIFO batch:0
[ 0.000000] DMA32 zone: 7744 pages used for memmap
[ 0.000000] DMA32 zone: 495606 pages, LIFO batch:31
[ 0.000000] Normal zone: 122880 pages used for memmap
[ 0.000000] Normal zone: 7864320 pages, LIFO batch:31
[ 0.000000] Initmem setup node 1 [mem 0x0000000880000000-0x000000107fffffff]
[ 0.000000] On node 1 totalpages: 8388608
[ 0.000000] Normal zone: 131072 pages used for memmap
[ 0.000000] Normal zone: 8388608 pages, LIFO batch:31
[ 0.000000] ACPI: PM-Timer IO Port: 0x408
[ 0.000000] ACPI: Local APIC address 0xfee00000
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x08] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x09] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x0f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x10] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x11] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x12] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x13] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x14] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x15] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x16] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x17] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x18] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x19] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x1f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x20] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x21] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x22] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x23] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x24] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x25] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x26] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x27] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x28] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x29] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x2f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x30] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x31] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x32] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x33] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x34] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x35] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x36] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x37] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x38] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x39] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x3f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x40] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x41] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x42] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x43] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x44] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x45] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x46] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x47] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x48] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x49] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x4f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x50] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x51] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x52] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x53] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x54] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x55] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x56] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x57] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x58] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x59] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x5f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x60] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x61] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x62] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x63] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x64] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x65] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x66] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x67] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x68] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x69] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x6f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x70] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x71] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x72] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x73] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x74] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x75] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x76] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x77] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x78] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x79] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x7f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x80] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x81] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x82] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x83] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x84] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x85] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x86] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x87] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x88] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x89] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x8f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x90] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x91] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x92] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x93] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x94] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x95] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x96] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x97] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x98] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x99] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9a] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9b] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9c] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9d] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9e] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x9f] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa0] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa1] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa2] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa3] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa4] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa5] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa6] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa7] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa8] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xa9] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xaa] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xab] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xac] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xad] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xae] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xaf] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb0] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb1] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb2] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb3] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb4] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb5] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb6] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb7] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb8] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xb9] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xba] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbb] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbc] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbd] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbe] high level lint[0x1])
[ 0.000000] ACPI: LAPIC_NMI (acpi_id[0xbf] high level lint[0x1])
[ 0.000000] IOAPIC[0]: apic_id 8, version 32, address 0xfec00000, GSI 0-23
[ 0.000000] IOAPIC[1]: apic_id 9, version 32, address 0xfec01000, GSI 24-47
[ 0.000000] IOAPIC[2]: apic_id 10, version 32, address 0xfec40000, GSI 48-71
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[ 0.000000] ACPI: IRQ0 used by override.
[ 0.000000] ACPI: IRQ9 used by override.
[ 0.000000] Using ACPI (MADT) for SMP configuration information
[ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[ 0.000000] smpboot: Allowing 36 CPUs, 0 hotplug CPUs
[ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009b000-0x0009bfff]
[ 0.000000] PM: Registered nosave memory: [mem 0x0009c000-0x0009ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x79fc5000-0x7ac50fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7ac51000-0x7b680fff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b681000-0x7b7cefff]
[ 0.000000] PM: Registered nosave memory: [mem 0x7b800000-0x8fffffff]
[ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xff3fffff]
[ 0.000000] PM: Registered nosave memory: [mem 0xff400000-0xffffffff]
[ 0.000000] e820: [mem 0x90000000-0xfed1bfff] available for PCI devices
[ 0.000000] Booting paravirtualized kernel on bare hardware
[ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:36 nr_cpu_ids:36 nr_node_ids:2
[ 0.000000] percpu: Embedded 38 pages/cpu @ffff993cdf800000 s115608 r8192 d31848 u262144
[ 0.000000] pcpu-alloc: s115608 r8192 d31848 u262144 alloc=1*2097152
[ 0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15
[ 0.000000] pcpu-alloc: [0] 16 17 -- -- -- -- -- -- [1] 18 19 20 21 22 23 24 25
[ 0.000000] pcpu-alloc: [1] 26 27 28 29 30 31 32 33 [1] 34 35 -- -- -- -- -- --
[ 0.000000] Built 2 zonelists in Node order, mobility grouping on. Total pages: 16490747
[ 0.000000] Policy zone: Normal
[ 0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.11.0-rc6patch-2-get-fence root=UUID=55c1c371-fc16-4703-9808-e5e2c2ba309a ro
[ 0.000000] log_buf_len individual max cpu contribution: 4096 bytes
[ 0.000000] log_buf_len total cpu_extra contributions: 143360 bytes
[ 0.000000] log_buf_len min size: 262144 bytes
[ 0.000000] log_buf_len: 524288 bytes
[ 0.000000] early log buf free: 236080(90%)
[ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes)
[ 0.000000] Calgary: detecting Calgary via BIOS EBDA area
[ 0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[ 0.000000] Memory: 65828192K/67010112K available (9075K kernel code, 1697K rwdata, 3884K rodata, 2212K init, 2232K bss, 1181920K reserved, 0K cma-reserved)
[ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=36, Nodes=2
[ 0.000000] Hierarchical RCU implementation.
[ 0.000000] Build-time adjustment of leaf fanout to 64.
[ 0.000000] RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=36.
[ 0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=64, nr_cpu_ids=36
[ 0.000000] NR_IRQS:524544 nr_irqs:1528 16
[ 0.000000] Console: colour dummy device 80x25
[ 0.000000] console [tty0] enabled
[ 0.000000] mempolicy: Enabling automatic NUMA balancing. Configure with numa_balancing= or the kernel.numa_balancing sysctl
[ 0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[ 0.000000] hpet clockevent registered
[ 0.000000] tsc: Fast TSC calibration using PIT
[ 0.004000] tsc: Detected 2299.964 MHz processor
[ 0.004000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4599.92 BogoMIPS (lpj=9199856)
[ 0.004000] pid_max: default: 36864 minimum: 301
[ 0.004000] ACPI: Core revision 20170119
[ 0.101697] ACPI: 4 ACPI AML tables successfully acquired and loaded
[ 0.101776] Security Framework initialized
[ 0.101781] Yama: becoming mindful.
[ 0.101830] AppArmor: AppArmor initialized
[ 0.104479] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[ 0.117372] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[ 0.123067] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.123124] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[ 0.123828] CPU: Physical Processor ID: 0
[ 0.123832] CPU: Processor Core ID: 0
[ 0.123840] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[ 0.123843] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[ 0.123850] mce: CPU supports 22 MCE banks
[ 0.123871] CPU0: Thermal monitoring enabled (TM1)
[ 0.123927] process: using mwait in idle threads
[ 0.123933] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 1024
[ 0.123936] Last level dTLB entries: 4KB 1024, 2MB 1024, 4MB 1024, 1GB 4
[ 0.124860] Freeing SMP alternatives memory: 32K
[ 0.128005] ftrace: allocating 34213 entries in 134 pages
[ 0.140117] smpboot: Max logical packages: 2
[ 0.140257] x2apic: IRQ remapping doesn't support X2APIC mode
[ 0.140334] Switched APIC routing to physical flat.
[ 0.140942] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[ 0.181384] TSC deadline timer enabled
[ 0.181389] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-2699 v3 @ 2.30GHz (family: 0x6, model: 0x3f, stepping: 0x2)
[ 0.181541] Performance Events: PEBS fmt2+, Haswell events, 16-deep LBR, full-width counters, Intel PMU driver.
[ 0.181585] ... version: 3
[ 0.181588] ... bit width: 48
[ 0.181590] ... generic registers: 8
[ 0.181593] ... value mask: 0000ffffffffffff
[ 0.181596] ... max period: 00007fffffffffff
[ 0.181598] ... fixed-purpose events: 3
[ 0.181601] ... event mask: 00000007000000ff
[ 0.184000] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[ 0.184000] smp: Bringing up secondary CPUs ...
[ 0.184000] x86: Booting SMP configuration:
[ 0.184000] .... node #0, CPUs: #1 #2 #3 #4 #5 #6 #7 #8 #9 #10 #11 #12 #13 #14 #15 #16 #17
[ 1.544197] .... node #1, CPUs: #18
[ 0.004000] mce: [Hardware Error]: Machine check events logged
[ 1.628030] mce: [Hardware Error]: CPU 18: Machine Check: 0 Bank 20: ea00000000100e0f
[ 1.628035] mce: [Hardware Error]: TSC 0 MISC 100000000000000
[ 1.628042] mce: [Hardware Error]: PROCESSOR 0:306f2 TIME 1492643325 SOCKET 1 APIC 40 microcode 37
[ 1.628130] #19 #20 #21 #22 #23 #24 #25 #26 #27 #28 #29 #30 #31 #32 #33 #34 #35
[ 2.988066] smp: Brought up 2 nodes, 36 CPUs
[ 2.988066] smpboot: Total of 36 processors activated (165673.91 BogoMIPS)
[ 2.992715] sched_clock: Marking stable (2992000000, 0)->(3163664125, -171664125)
[ 2.994742] devtmpfs: initialized
[ 2.994809] x86/mm: Memory block size: 2048MB
[ 2.996620] evm: security.selinux
[ 2.996623] evm: security.SMACK64
[ 2.996625] evm: security.SMACK64EXEC
[ 2.996627] evm: security.SMACK64TRANSMUTE
[ 2.996630] evm: security.SMACK64MMAP
[ 2.996632] evm: security.ima
[ 2.996635] evm: security.capability
[ 2.996732] PM: Registering ACPI NVS region [mem 0x7ac51000-0x7b680fff] (10682368 bytes)
[ 2.997108] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[ 2.997181] futex hash table entries: 16384 (order: 8, 1048576 bytes)
[ 2.997532] pinctrl core: initialized pinctrl subsystem
[ 2.997651] RTC time: 23:08:47, date: 04/19/17
[ 2.998640] NET: Registered protocol family 16
[ 2.998858] cpuidle: using governor ladder
[ 2.998865] cpuidle: using governor menu
[ 2.998870] PCCT header not found.
[ 2.998909] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[ 2.998914] ACPI: bus type PCI registered
[ 2.998918] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[ 2.999017] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000)
[ 2.999032] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820
[ 2.999051] PCI: Using configuration type 1 for base access
[ 3.001084] NMI watchdog: enabled on all CPUs, permanently consumes one hw-PMU counter.
[ 3.001120] core: PMU erratum BJ122, BV98, HSD29 workaround disabled, HT off
[ 3.003189] HugeTLB registered 1 GB page size, pre-allocated 0 pages
[ 3.003194] HugeTLB registered 2 MB page size, pre-allocated 0 pages
[ 3.003909] ACPI: Added _OSI(Module Device)
[ 3.003912] ACPI: Added _OSI(Processor Device)
[ 3.003915] ACPI: Added _OSI(3.0 _SCP Extensions)
[ 3.003918] ACPI: Added _OSI(Processor Aggregator Device)
[ 3.004092] ACPI: Executed 1 blocks of module-level executable AML code
[ 3.133289] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[ 3.307053] ACPI: Dynamic OEM Table Load:
[ 3.332742] ACPI: Interpreter enabled
[ 3.332757] ACPI: (supports S0 S5)
[ 3.332761] ACPI: Using IOAPIC for interrupt routing
[ 3.332809] HEST: Table parsing has been initialized.
[ 3.332814] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[ 3.367947] ACPI: PCI Root Bridge [UNC1] (domain 0000 [bus ff])
[ 3.367956] acpi PNP0A03:02: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 5.411689] acpi PNP0A03:02: _OSC: platform does not support [PCIeHotplug]
[ 7.460524] acpi PNP0A03:02: _OSC: OS now controls [PME AER PCIeCapability]
[ 7.460528] acpi PNP0A03:02: FADT indicates ASPM is unsupported, using BIOS configuration
[ 7.460589] PCI host bridge to bus 0000:ff
[ 7.460593] pci_bus 0000:ff: root bus resource [bus ff]
[ 7.460607] pci 0000:ff:08.0: [8086:2f80] type 00 class 0x088000
[ 7.460676] pci 0000:ff:08.2: [8086:2f32] type 00 class 0x110100
[ 7.460734] pci 0000:ff:08.3: [8086:2f83] type 00 class 0x088000
[ 7.460789] pci 0000:ff:09.0: [8086:2f90] type 00 class 0x088000
[ 7.460839] pci 0000:ff:09.2: [8086:2f33] type 00 class 0x110100
[ 7.460892] pci 0000:ff:09.3: [8086:2f93] type 00 class 0x088000
[ 7.460947] pci 0000:ff:0b.0: [8086:2f81] type 00 class 0x088000
[ 7.460993] pci 0000:ff:0b.1: [8086:2f36] type 00 class 0x110100
[ 7.461042] pci 0000:ff:0b.2: [8086:2f37] type 00 class 0x110100
[ 7.461090] pci 0000:ff:0c.0: [8086:2fe0] type 00 class 0x088000
[ 7.461144] pci 0000:ff:0c.1: [8086:2fe1] type 00 class 0x088000
[ 7.461192] pci 0000:ff:0c.2: [8086:2fe2] type 00 class 0x088000
[ 7.461238] pci 0000:ff:0c.3: [8086:2fe3] type 00 class 0x088000
[ 7.461285] pci 0000:ff:0c.4: [8086:2fe4] type 00 class 0x088000
[ 7.461331] pci 0000:ff:0c.5: [8086:2fe5] type 00 class 0x088000
[ 7.461377] pci 0000:ff:0c.6: [8086:2fe6] type 00 class 0x088000
[ 7.461425] pci 0000:ff:0c.7: [8086:2fe7] type 00 class 0x088000
[ 7.461471] pci 0000:ff:0d.0: [8086:2fe8] type 00 class 0x088000
[ 7.461517] pci 0000:ff:0d.1: [8086:2fe9] type 00 class 0x088000
[ 7.461565] pci 0000:ff:0d.2: [8086:2fea] type 00 class 0x088000
[ 7.461613] pci 0000:ff:0d.3: [8086:2feb] type 00 class 0x088000
[ 7.461660] pci 0000:ff:0d.4: [8086:2fec] type 00 class 0x088000
[ 7.461706] pci 0000:ff:0d.5: [8086:2fed] type 00 class 0x088000
[ 7.461753] pci 0000:ff:0d.6: [8086:2fee] type 00 class 0x088000
[ 7.461803] pci 0000:ff:0d.7: [8086:2fef] type 00 class 0x088000
[ 7.461851] pci 0000:ff:0e.0: [8086:2ff0] type 00 class 0x088000
[ 7.461899] pci 0000:ff:0e.1: [8086:2ff1] type 00 class 0x088000
[ 7.461952] pci 0000:ff:0f.0: [8086:2ff8] type 00 class 0x088000
[ 7.462000] pci 0000:ff:0f.1: [8086:2ff9] type 00 class 0x088000
[ 7.462052] pci 0000:ff:0f.2: [8086:2ffa] type 00 class 0x088000
[ 7.462098] pci 0000:ff:0f.3: [8086:2ffb] type 00 class 0x088000
[ 7.462145] pci 0000:ff:0f.4: [8086:2ffc] type 00 class 0x088000
[ 7.462195] pci 0000:ff:0f.5: [8086:2ffd] type 00 class 0x088000
[ 7.462244] pci 0000:ff:0f.6: [8086:2ffe] type 00 class 0x088000
[ 7.462295] pci 0000:ff:10.0: [8086:2f1d] type 00 class 0x088000
[ 7.462343] pci 0000:ff:10.1: [8086:2f34] type 00 class 0x110100
[ 7.462399] pci 0000:ff:10.5: [8086:2f1e] type 00 class 0x088000
[ 7.462446] pci 0000:ff:10.6: [8086:2f7d] type 00 class 0x110100
[ 7.462494] pci 0000:ff:10.7: [8086:2f1f] type 00 class 0x088000
[ 7.462542] pci 0000:ff:12.0: [8086:2fa0] type 00 class 0x088000
[ 7.462597] pci 0000:ff:12.1: [8086:2f30] type 00 class 0x110100
[ 7.462651] pci 0000:ff:12.4: [8086:2f60] type 00 class 0x088000
[ 7.462705] pci 0000:ff:12.5: [8086:2f38] type 00 class 0x110100
[ 7.462761] pci 0000:ff:13.0: [8086:2fa8] type 00 class 0x088000
[ 7.462815] pci 0000:ff:13.1: [8086:2f71] type 00 class 0x088000
[ 7.462871] pci 0000:ff:13.2: [8086:2faa] type 00 class 0x088000
[ 7.462926] pci 0000:ff:13.3: [8086:2fab] type 00 class 0x088000
[ 7.462984] pci 0000:ff:13.6: [8086:2fae] type 00 class 0x088000
[ 7.463038] pci 0000:ff:13.7: [8086:2faf] type 00 class 0x088000
[ 7.463091] pci 0000:ff:14.0: [8086:2fb0] type 00 class 0x088000
[ 7.463148] pci 0000:ff:14.1: [8086:2fb1] type 00 class 0x088000
[ 7.463204] pci 0000:ff:14.2: [8086:2fb2] type 00 class 0x088000
[ 7.463268] pci 0000:ff:14.3: [8086:2fb3] type 00 class 0x088000
[ 7.463325] pci 0000:ff:14.4: [8086:2fbc] type 00 class 0x088000
[ 7.463378] pci 0000:ff:14.5: [8086:2fbd] type 00 class 0x088000
[ 7.463430] pci 0000:ff:14.6: [8086:2fbe] type 00 class 0x088000
[ 7.463485] pci 0000:ff:14.7: [8086:2fbf] type 00 class 0x088000
[ 7.463539] pci 0000:ff:16.0: [8086:2f68] type 00 class 0x088000
[ 7.463596] pci 0000:ff:16.1: [8086:2f79] type 00 class 0x088000
[ 7.463655] pci 0000:ff:16.2: [8086:2f6a] type 00 class 0x088000
[ 7.463713] pci 0000:ff:16.3: [8086:2f6b] type 00 class 0x088000
[ 7.463773] pci 0000:ff:16.6: [8086:2f6e] type 00 class 0x088000
[ 7.463825] pci 0000:ff:16.7: [8086:2f6f] type 00 class 0x088000
[ 7.463879] pci 0000:ff:17.0: [8086:2fd0] type 00 class 0x088000
[ 7.463939] pci 0000:ff:17.1: [8086:2fd1] type 00 class 0x088000
[ 7.464000] pci 0000:ff:17.2: [8086:2fd2] type 00 class 0x088000
[ 7.464059] pci 0000:ff:17.3: [8086:2fd3] type 00 class 0x088000
[ 7.464116] pci 0000:ff:17.4: [8086:2fb8] type 00 class 0x088000
[ 7.464170] pci 0000:ff:17.5: [8086:2fb9] type 00 class 0x088000
[ 7.464223] pci 0000:ff:17.6: [8086:2fba] type 00 class 0x088000
[ 7.464282] pci 0000:ff:17.7: [8086:2fbb] type 00 class 0x088000
[ 7.464355] pci 0000:ff:1e.0: [8086:2f98] type 00 class 0x088000
[ 7.464408] pci 0000:ff:1e.1: [8086:2f99] type 00 class 0x088000
[ 7.464460] pci 0000:ff:1e.2: [8086:2f9a] type 00 class 0x088000
[ 7.464517] pci 0000:ff:1e.3: [8086:2fc0] type 00 class 0x088000
[ 7.464556] pci 0000:ff:1e.4: [8086:2f9c] type 00 class 0x088000
[ 7.464620] pci 0000:ff:1f.0: [8086:2f88] type 00 class 0x088000
[ 7.464676] pci 0000:ff:1f.2: [8086:2f8a] type 00 class 0x088000
[ 7.464823] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus 7f])
[ 7.464830] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 9.509350] acpi PNP0A03:03: _OSC: platform does not support [PCIeHotplug]
[ 11.558205] acpi PNP0A03:03: _OSC: OS now controls [PME AER PCIeCapability]
[ 11.558210] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration
[ 11.558260] PCI host bridge to bus 0000:7f
[ 11.558264] pci_bus 0000:7f: root bus resource [bus 7f]
[ 11.558275] pci 0000:7f:08.0: [8086:2f80] type 00 class 0x088000
[ 11.558330] pci 0000:7f:08.2: [8086:2f32] type 00 class 0x110100
[ 11.558381] pci 0000:7f:08.3: [8086:2f83] type 00 class 0x088000
[ 11.558432] pci 0000:7f:09.0: [8086:2f90] type 00 class 0x088000
[ 11.558478] pci 0000:7f:09.2: [8086:2f33] type 00 class 0x110100
[ 11.558525] pci 0000:7f:09.3: [8086:2f93] type 00 class 0x088000
[ 11.558576] pci 0000:7f:0b.0: [8086:2f81] type 00 class 0x088000
[ 11.558621] pci 0000:7f:0b.1: [8086:2f36] type 00 class 0x110100
[ 11.558665] pci 0000:7f:0b.2: [8086:2f37] type 00 class 0x110100
[ 11.558711] pci 0000:7f:0c.0: [8086:2fe0] type 00 class 0x088000
[ 11.558756] pci 0000:7f:0c.1: [8086:2fe1] type 00 class 0x088000
[ 11.558800] pci 0000:7f:0c.2: [8086:2fe2] type 00 class 0x088000
[ 11.558844] pci 0000:7f:0c.3: [8086:2fe3] type 00 class 0x088000
[ 11.558898] pci 0000:7f:0c.4: [8086:2fe4] type 00 class 0x088000
[ 11.558943] pci 0000:7f:0c.5: [8086:2fe5] type 00 class 0x088000
[ 11.558988] pci 0000:7f:0c.6: [8086:2fe6] type 00 class 0x088000
[ 11.559036] pci 0000:7f:0c.7: [8086:2fe7] type 00 class 0x088000
[ 11.559080] pci 0000:7f:0d.0: [8086:2fe8] type 00 class 0x088000
[ 11.559128] pci 0000:7f:0d.1: [8086:2fe9] type 00 class 0x088000
[ 11.559176] pci 0000:7f:0d.2: [8086:2fea] type 00 class 0x088000
[ 11.559223] pci 0000:7f:0d.3: [8086:2feb] type 00 class 0x088000
[ 11.559270] pci 0000:7f:0d.4: [8086:2fec] type 00 class 0x088000
[ 11.559315] pci 0000:7f:0d.5: [8086:2fed] type 00 class 0x088000
[ 11.559363] pci 0000:7f:0d.6: [8086:2fee] type 00 class 0x088000
[ 11.559407] pci 0000:7f:0d.7: [8086:2fef] type 00 class 0x088000
[ 11.559453] pci 0000:7f:0e.0: [8086:2ff0] type 00 class 0x088000
[ 11.559502] pci 0000:7f:0e.1: [8086:2ff1] type 00 class 0x088000
[ 11.559558] pci 0000:7f:0f.0: [8086:2ff8] type 00 class 0x088000
[ 11.559602] pci 0000:7f:0f.1: [8086:2ff9] type 00 class 0x088000
[ 11.559646] pci 0000:7f:0f.2: [8086:2ffa] type 00 class 0x088000
[ 11.559690] pci 0000:7f:0f.3: [8086:2ffb] type 00 class 0x088000
[ 11.559736] pci 0000:7f:0f.4: [8086:2ffc] type 00 class 0x088000
[ 11.559783] pci 0000:7f:0f.5: [8086:2ffd] type 00 class 0x088000
[ 11.559828] pci 0000:7f:0f.6: [8086:2ffe] type 00 class 0x088000
[ 11.559879] pci 0000:7f:10.0: [8086:2f1d] type 00 class 0x088000
[ 11.559931] pci 0000:7f:10.1: [8086:2f34] type 00 class 0x110100
[ 11.559980] pci 0000:7f:10.5: [8086:2f1e] type 00 class 0x088000
[ 11.560025] pci 0000:7f:10.6: [8086:2f7d] type 00 class 0x110100
[ 11.560069] pci 0000:7f:10.7: [8086:2f1f] type 00 class 0x088000
[ 11.560114] pci 0000:7f:12.0: [8086:2fa0] type 00 class 0x088000
[ 11.560162] pci 0000:7f:12.1: [8086:2f30] type 00 class 0x110100
[ 11.560212] pci 0000:7f:12.4: [8086:2f60] type 00 class 0x088000
[ 11.560266] pci 0000:7f:12.5: [8086:2f38] type 00 class 0x110100
[ 11.560319] pci 0000:7f:13.0: [8086:2fa8] type 00 class 0x088000
[ 11.560371] pci 0000:7f:13.1: [8086:2f71] type 00 class 0x088000
[ 11.560423] pci 0000:7f:13.2: [8086:2faa] type 00 class 0x088000
[ 11.560475] pci 0000:7f:13.3: [8086:2fab] type 00 class 0x088000
[ 11.560529] pci 0000:7f:13.6: [8086:2fae] type 00 class 0x088000
[ 11.560578] pci 0000:7f:13.7: [8086:2faf] type 00 class 0x088000
[ 11.560628] pci 0000:7f:14.0: [8086:2fb0] type 00 class 0x088000
[ 11.560684] pci 0000:7f:14.1: [8086:2fb1] type 00 class 0x088000
[ 11.560736] pci 0000:7f:14.2: [8086:2fb2] type 00 class 0x088000
[ 11.560789] pci 0000:7f:14.3: [8086:2fb3] type 00 class 0x088000
[ 11.560845] pci 0000:7f:14.4: [8086:2fbc] type 00 class 0x088000
[ 11.560894] pci 0000:7f:14.5: [8086:2fbd] type 00 class 0x088000
[ 11.560953] pci 0000:7f:14.6: [8086:2fbe] type 00 class 0x088000
[ 11.561003] pci 0000:7f:14.7: [8086:2fbf] type 00 class 0x088000
[ 11.561055] pci 0000:7f:16.0: [8086:2f68] type 00 class 0x088000
[ 11.561111] pci 0000:7f:16.1: [8086:2f79] type 00 class 0x088000
[ 11.561165] pci 0000:7f:16.2: [8086:2f6a] type 00 class 0x088000
[ 11.561220] pci 0000:7f:16.3: [8086:2f6b] type 00 class 0x088000
[ 11.561283] pci 0000:7f:16.6: [8086:2f6e] type 00 class 0x088000
[ 11.561333] pci 0000:7f:16.7: [8086:2f6f] type 00 class 0x088000
[ 11.561384] pci 0000:7f:17.0: [8086:2fd0] type 00 class 0x088000
[ 11.561438] pci 0000:7f:17.1: [8086:2fd1] type 00 class 0x088000
[ 11.561492] pci 0000:7f:17.2: [8086:2fd2] type 00 class 0x088000
[ 11.561549] pci 0000:7f:17.3: [8086:2fd3] type 00 class 0x088000
[ 11.561603] pci 0000:7f:17.4: [8086:2fb8] type 00 class 0x088000
[ 11.561653] pci 0000:7f:17.5: [8086:2fb9] type 00 class 0x088000
[ 11.561704] pci 0000:7f:17.6: [8086:2fba] type 00 class 0x088000
[ 11.561753] pci 0000:7f:17.7: [8086:2fbb] type 00 class 0x088000
[ 11.561821] pci 0000:7f:1e.0: [8086:2f98] type 00 class 0x088000
[ 11.561869] pci 0000:7f:1e.1: [8086:2f99] type 00 class 0x088000
[ 11.561918] pci 0000:7f:1e.2: [8086:2f9a] type 00 class 0x088000
[ 11.561968] pci 0000:7f:1e.3: [8086:2fc0] type 00 class 0x088000
[ 11.562004] pci 0000:7f:1e.4: [8086:2f9c] type 00 class 0x088000
[ 11.562063] pci 0000:7f:1f.0: [8086:2f88] type 00 class 0x088000
[ 11.562116] pci 0000:7f:1f.2: [8086:2f8a] type 00 class 0x088000
[ 11.571331] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-7e])
[ 11.571339] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 11.573265] acpi PNP0A08:00: _OSC: platform does not support [AER]
[ 11.574102] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 11.574108] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[ 11.574442] PCI host bridge to bus 0000:00
[ 11.574447] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window]
[ 11.574451] pci_bus 0000:00: root bus resource [io 0x1000-0x7fff window]
[ 11.574454] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[ 11.574459] pci_bus 0000:00: root bus resource [mem 0x90000000-0xc7ffbfff window]
[ 11.574463] pci_bus 0000:00: root bus resource [mem 0x380000000000-0x383fffffffff window]
[ 11.574468] pci_bus 0000:00: root bus resource [bus 00-7e]
[ 11.574478] pci 0000:00:00.0: [8086:2f00] type 00 class 0x060000
[ 11.574622] pci 0000:00:01.0: [8086:2f02] type 01 class 0x060400
[ 11.574670] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[ 11.574744] pci 0000:00:01.0: System wakeup disabled by ACPI
[ 11.574786] pci 0000:00:02.0: [8086:2f04] type 01 class 0x060400
[ 11.574833] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold
[ 11.574904] pci 0000:00:02.0: System wakeup disabled by ACPI
[ 11.574939] pci 0000:00:02.2: [8086:2f06] type 01 class 0x060400
[ 11.574985] pci 0000:00:02.2: PME# supported from D0 D3hot D3cold
[ 11.575057] pci 0000:00:02.2: System wakeup disabled by ACPI
[ 11.575097] pci 0000:00:03.0: [8086:2f08] type 01 class 0x060400
[ 11.575144] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[ 11.575216] pci 0000:00:03.0: System wakeup disabled by ACPI
[ 11.575255] pci 0000:00:04.0: [8086:2f20] type 00 class 0x088000
[ 11.575265] pci 0000:00:04.0: reg 0x10: [mem 0x383ffe12c000-0x383ffe12ffff 64bit]
[ 11.575405] pci 0000:00:04.1: [8086:2f21] type 00 class 0x088000
[ 11.575415] pci 0000:00:04.1: reg 0x10: [mem 0x383ffe128000-0x383ffe12bfff 64bit]
[ 11.575539] pci 0000:00:04.2: [8086:2f22] type 00 class 0x088000
[ 11.575549] pci 0000:00:04.2: reg 0x10: [mem 0x383ffe124000-0x383ffe127fff 64bit]
[ 11.575672] pci 0000:00:04.3: [8086:2f23] type 00 class 0x088000
[ 11.575681] pci 0000:00:04.3: reg 0x10: [mem 0x383ffe120000-0x383ffe123fff 64bit]
[ 11.575803] pci 0000:00:04.4: [8086:2f24] type 00 class 0x088000
[ 11.575813] pci 0000:00:04.4: reg 0x10: [mem 0x383ffe11c000-0x383ffe11ffff 64bit]
[ 11.575937] pci 0000:00:04.5: [8086:2f25] type 00 class 0x088000
[ 11.575947] pci 0000:00:04.5: reg 0x10: [mem 0x383ffe118000-0x383ffe11bfff 64bit]
[ 11.576066] pci 0000:00:04.6: [8086:2f26] type 00 class 0x088000
[ 11.576076] pci 0000:00:04.6: reg 0x10: [mem 0x383ffe114000-0x383ffe117fff 64bit]
[ 11.576201] pci 0000:00:04.7: [8086:2f27] type 00 class 0x088000
[ 11.576211] pci 0000:00:04.7: reg 0x10: [mem 0x383ffe110000-0x383ffe113fff 64bit]
[ 11.576339] pci 0000:00:05.0: [8086:2f28] type 00 class 0x088000
[ 11.576463] pci 0000:00:05.1: [8086:2f29] type 00 class 0x088000
[ 11.576598] pci 0000:00:05.2: [8086:2f2a] type 00 class 0x088000
[ 11.576714] pci 0000:00:05.4: [8086:2f2c] type 00 class 0x080020
[ 11.576721] pci 0000:00:05.4: reg 0x10: [mem 0x91a06000-0x91a06fff]
[ 11.576855] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000
[ 11.577040] pci 0000:00:11.1: [8086:8d7d] type 00 class 0x0c0500
[ 11.577054] pci 0000:00:11.1: reg 0x10: [mem 0x91a05000-0x91a05fff]
[ 11.577087] pci 0000:00:11.1: reg 0x20: [io 0x3060-0x307f]
[ 11.577240] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601
[ 11.577255] pci 0000:00:11.4: reg 0x10: [io 0x3098-0x309f]
[ 11.577262] pci 0000:00:11.4: reg 0x14: [io 0x30cc-0x30cf]
[ 11.577270] pci 0000:00:11.4: reg 0x18: [io 0x3090-0x3097]
[ 11.577278] pci 0000:00:11.4: reg 0x1c: [io 0x30c8-0x30cb]
[ 11.577286] pci 0000:00:11.4: reg 0x20: [io 0x3020-0x303f]
[ 11.577294] pci 0000:00:11.4: reg 0x24: [mem 0x91a00000-0x91a007ff]
[ 11.577335] pci 0000:00:11.4: PME# supported from D3hot
[ 11.577434] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330
[ 11.577450] pci 0000:00:14.0: reg 0x10: [mem 0x383ffe100000-0x383ffe10ffff 64bit]
[ 11.577503] pci 0000:00:14.0: PME# supported from D3hot D3cold
[ 11.577579] pci 0000:00:14.0: System wakeup disabled by ACPI
[ 11.577619] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000
[ 11.577636] pci 0000:00:16.0: reg 0x10: [mem 0x383ffe133000-0x383ffe13300f 64bit]
[ 11.577697] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[ 11.577798] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000
[ 11.577814] pci 0000:00:16.1: reg 0x10: [mem 0x383ffe132000-0x383ffe13200f 64bit]
[ 11.577875] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold
[ 11.577983] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320
[ 11.577999] pci 0000:00:1a.0: reg 0x10: [mem 0x91a02000-0x91a023ff]
[ 11.578081] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[ 11.578157] pci 0000:00:1a.0: System wakeup disabled by ACPI
[ 11.578200] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400
[ 11.578267] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[ 11.578345] pci 0000:00:1c.0: System wakeup disabled by ACPI
[ 11.578385] pci 0000:00:1c.3: [8086:8d16] type 01 class 0x060400
[ 11.578450] pci 0000:00:1c.3: PME# supported from D0 D3hot D3cold
[ 11.578516] pci 0000:00:1c.3: System wakeup disabled by ACPI
[ 11.578559] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320
[ 11.578576] pci 0000:00:1d.0: reg 0x10: [mem 0x91a01000-0x91a013ff]
[ 11.578658] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[ 11.578734] pci 0000:00:1d.0: System wakeup disabled by ACPI
[ 11.578779] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100
[ 11.578972] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601
[ 11.578986] pci 0000:00:1f.2: reg 0x10: [io 0x30c0-0x30c7]
[ 11.578993] pci 0000:00:1f.2: reg 0x14: [io 0x30dc-0x30df]
[ 11.578999] pci 0000:00:1f.2: reg 0x18: [io 0x30b8-0x30bf]
[ 11.579007] pci 0000:00:1f.2: reg 0x1c: [io 0x30d8-0x30db]
[ 11.579013] pci 0000:00:1f.2: reg 0x20: [io 0x3040-0x305f]
[ 11.579020] pci 0000:00:1f.2: reg 0x24: [mem 0x91a04000-0x91a047ff]
[ 11.579055] pci 0000:00:1f.2: PME# supported from D3hot
[ 11.579155] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500
[ 11.579169] pci 0000:00:1f.3: reg 0x10: [mem 0x383ffe131000-0x383ffe1310ff 64bit]
[ 11.579188] pci 0000:00:1f.3: reg 0x20: [io 0x3000-0x301f]
[ 11.579450] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 11.579595] pci 0000:00:02.0: PCI bridge to [bus 02]
[ 11.579762] pci 0000:03:00.0: [8086:1521] type 00 class 0x020000
[ 11.579774] pci 0000:03:00.0: reg 0x10: [mem 0x91920000-0x9193ffff]
[ 11.579787] pci 0000:03:00.0: reg 0x18: [io 0x2020-0x203f]
[ 11.579793] pci 0000:03:00.0: reg 0x1c: [mem 0x91944000-0x91947fff]
[ 11.579868] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold
[ 11.579894] pci 0000:03:00.0: reg 0x184: [mem 0x383ffe060000-0x383ffe063fff 64bit pref]
[ 11.579895] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x383ffe060000-0x383ffe07ffff 64bit pref] (contains BAR0 for 8 VFs)
[ 11.579914] pci 0000:03:00.0: reg 0x190: [mem 0x383ffe040000-0x383ffe043fff 64bit pref]
[ 11.579915] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x383ffe040000-0x383ffe05ffff 64bit pref] (contains BAR3 for 8 VFs)
[ 11.580020] pci 0000:03:00.3: [8086:1521] type 00 class 0x020000
[ 11.580032] pci 0000:03:00.3: reg 0x10: [mem 0x91900000-0x9191ffff]
[ 11.580044] pci 0000:03:00.3: reg 0x18: [io 0x2000-0x201f]
[ 11.580051] pci 0000:03:00.3: reg 0x1c: [mem 0x91940000-0x91943fff]
[ 11.580123] pci 0000:03:00.3: PME# supported from D0 D3hot D3cold
[ 11.580145] pci 0000:03:00.3: reg 0x184: [mem 0x383ffe020000-0x383ffe023fff 64bit pref]
[ 11.580146] pci 0000:03:00.3: VF(n) BAR0 space: [mem 0x383ffe020000-0x383ffe03ffff 64bit pref] (contains BAR0 for 8 VFs)
[ 11.580165] pci 0000:03:00.3: reg 0x190: [mem 0x383ffe000000-0x383ffe003fff 64bit pref]
[ 11.580166] pci 0000:03:00.3: VF(n) BAR3 space: [mem 0x383ffe000000-0x383ffe01ffff 64bit pref] (contains BAR3 for 8 VFs)
[ 11.580807] pci 0000:00:02.2: PCI bridge to [bus 03-04]
[ 11.580812] pci 0000:00:02.2: bridge window [io 0x2000-0x2fff]
[ 11.580814] pci 0000:00:02.2: bridge window [mem 0x91900000-0x919fffff]
[ 11.580817] pci 0000:00:02.2: bridge window [mem 0x383ffe000000-0x383ffe0fffff 64bit pref]
[ 11.581156] pci 0000:05:00.0: [15b3:1017] type 00 class 0x020000
[ 11.581336] pci 0000:05:00.0: reg 0x10: [mem 0x383ffc000000-0x383ffdffffff 64bit pref]
[ 11.581767] pci 0000:05:00.0: reg 0x30: [mem 0xfff00000-0xffffffff pref]
[ 11.582575] pci 0000:05:00.0: PME# supported from D3cold
[ 11.583045] pci 0000:05:00.1: [15b3:1017] type 00 class 0x020000
[ 11.583224] pci 0000:05:00.1: reg 0x10: [mem 0x383ffa000000-0x383ffbffffff 64bit pref]
[ 11.583636] pci 0000:05:00.1: reg 0x30: [mem 0xfff00000-0xffffffff pref]
[ 11.584394] pci 0000:05:00.1: PME# supported from D3cold
[ 11.584795] pci 0000:00:03.0: PCI bridge to [bus 05]
[ 11.584804] pci 0000:00:03.0: bridge window [mem 0x383ffa000000-0x383ffdffffff 64bit pref]
[ 11.584846] pci 0000:00:1c.0: PCI bridge to [bus 06]
[ 11.584913] pci 0000:07:00.0: [102b:0522] type 00 class 0x030000
[ 11.584937] pci 0000:07:00.0: reg 0x10: [mem 0x90000000-0x90ffffff pref]
[ 11.584951] pci 0000:07:00.0: reg 0x14: [mem 0x91800000-0x91803fff]
[ 11.584965] pci 0000:07:00.0: reg 0x18: [mem 0x91000000-0x917fffff]
[ 11.585019] pci 0000:07:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.598231] pci 0000:00:1c.3: PCI bridge to [bus 07]
[ 11.598238] pci 0000:00:1c.3: bridge window [mem 0x91000000-0x918fffff]
[ 11.598243] pci 0000:00:1c.3: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 11.598270] pci_bus 0000:00: on NUMA node 0
[ 11.598653] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 *10 11 12 14 15)
[ 11.598704] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *9 10 11 12 14 15)
[ 11.598750] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 *5 6 7 9 10 11 12 14 15)
[ 11.598796] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[ 11.598842] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[ 11.598888] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 11.598942] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 11.598988] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[ 11.599279] ACPI: PCI Root Bridge [PCI1] (domain 0000 [bus 80-fe])
[ 11.599286] acpi PNP0A08:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[ 11.599766] acpi PNP0A08:01: _OSC: platform does not support [AER]
[ 11.600592] acpi PNP0A08:01: _OSC: OS now controls [PCIeHotplug PME PCIeCapability]
[ 11.600598] acpi PNP0A08:01: FADT indicates ASPM is unsupported, using BIOS configuration
[ 11.600809] PCI host bridge to bus 0000:80
[ 11.600813] pci_bus 0000:80: root bus resource [io 0x8000-0xffff window]
[ 11.600817] pci_bus 0000:80: root bus resource [mem 0xc8000000-0xfbffbfff window]
[ 11.600822] pci_bus 0000:80: root bus resource [mem 0x384000000000-0x387fffffffff window]
[ 11.600826] pci_bus 0000:80: root bus resource [bus 80-fe]
[ 11.600839] pci 0000:80:02.0: [8086:2f04] type 01 class 0x060400
[ 11.600895] pci 0000:80:02.0: PME# supported from D0 D3hot D3cold
[ 11.600947] pci 0000:80:02.0: System wakeup disabled by ACPI
[ 11.600994] pci 0000:80:04.0: [8086:2f20] type 00 class 0x088000
[ 11.601005] pci 0000:80:04.0: reg 0x10: [mem 0x387ffff1c000-0x387ffff1ffff 64bit]
[ 11.601112] pci 0000:80:04.1: [8086:2f21] type 00 class 0x088000
[ 11.601123] pci 0000:80:04.1: reg 0x10: [mem 0x387ffff18000-0x387ffff1bfff 64bit]
[ 11.601231] pci 0000:80:04.2: [8086:2f22] type 00 class 0x088000
[ 11.601241] pci 0000:80:04.2: reg 0x10: [mem 0x387ffff14000-0x387ffff17fff 64bit]
[ 11.601345] pci 0000:80:04.3: [8086:2f23] type 00 class 0x088000
[ 11.601356] pci 0000:80:04.3: reg 0x10: [mem 0x387ffff10000-0x387ffff13fff 64bit]
[ 11.601459] pci 0000:80:04.4: [8086:2f24] type 00 class 0x088000
[ 11.601470] pci 0000:80:04.4: reg 0x10: [mem 0x387ffff0c000-0x387ffff0ffff 64bit]
[ 11.601581] pci 0000:80:04.5: [8086:2f25] type 00 class 0x088000
[ 11.601592] pci 0000:80:04.5: reg 0x10: [mem 0x387ffff08000-0x387ffff0bfff 64bit]
[ 11.601696] pci 0000:80:04.6: [8086:2f26] type 00 class 0x088000
[ 11.601707] pci 0000:80:04.6: reg 0x10: [mem 0x387ffff04000-0x387ffff07fff 64bit]
[ 11.601812] pci 0000:80:04.7: [8086:2f27] type 00 class 0x088000
[ 11.601823] pci 0000:80:04.7: reg 0x10: [mem 0x387ffff00000-0x387ffff03fff 64bit]
[ 11.601928] pci 0000:80:05.0: [8086:2f28] type 00 class 0x088000
[ 11.602026] pci 0000:80:05.1: [8086:2f29] type 00 class 0x088000
[ 11.602138] pci 0000:80:05.2: [8086:2f2a] type 00 class 0x088000
[ 11.602241] pci 0000:80:05.4: [8086:2f2c] type 00 class 0x080020
[ 11.602249] pci 0000:80:05.4: reg 0x10: [mem 0xc9000000-0xc9000fff]
[ 11.602694] pci 0000:81:00.0: [11f8:8536] type 01 class 0x060400
[ 11.604012] pci 0000:81:00.0: PME# supported from D0 D3hot D3cold
[ 11.604644] pci 0000:80:02.0: PCI bridge to [bus 81-92]
[ 11.604651] pci 0000:80:02.0: bridge window [mem 0xc8000000-0xc8ffffff]
[ 11.605027] pci 0000:82:00.0: [11f8:8536] type 01 class 0x060400
[ 11.607913] pci 0000:82:00.0: PME# supported from D0 D3hot D3cold
[ 11.608448] pci 0000:82:01.0: [11f8:8536] type 01 class 0x060400
[ 11.611356] pci 0000:82:01.0: PME# supported from D0 D3hot D3cold
[ 11.611885] pci 0000:82:02.0: [11f8:8536] type 01 class 0x060400
[ 11.614800] pci 0000:82:02.0: PME# supported from D0 D3hot D3cold
[ 11.615325] pci 0000:82:03.0: [11f8:8536] type 01 class 0x060400
[ 11.618240] pci 0000:82:03.0: PME# supported from D0 D3hot D3cold
[ 11.618764] pci 0000:82:04.0: [11f8:8536] type 01 class 0x060400
[ 11.621708] pci 0000:82:04.0: PME# supported from D0 D3hot D3cold
[ 11.622249] pci 0000:82:05.0: [11f8:8536] type 01 class 0x060400
[ 11.625191] pci 0000:82:05.0: PME# supported from D0 D3hot D3cold
[ 11.625716] pci 0000:82:06.0: [11f8:8536] type 01 class 0x060400
[ 11.628669] pci 0000:82:06.0: PME# supported from D0 D3hot D3cold
[ 11.629209] pci 0000:82:07.0: [11f8:8536] type 01 class 0x060400
[ 11.632173] pci 0000:82:07.0: PME# supported from D0 D3hot D3cold
[ 11.632710] pci 0000:82:08.0: [11f8:8536] type 01 class 0x060400
[ 11.635689] pci 0000:82:08.0: PME# supported from D0 D3hot D3cold
[ 11.636222] pci 0000:82:09.0: [11f8:8536] type 01 class 0x060400
[ 11.639231] pci 0000:82:09.0: PME# supported from D0 D3hot D3cold
[ 11.639760] pci 0000:82:0a.0: [11f8:8536] type 01 class 0x060400
[ 11.642772] pci 0000:82:0a.0: PME# supported from D0 D3hot D3cold
[ 11.643306] pci 0000:82:0b.0: [11f8:8536] type 01 class 0x060400
[ 11.646321] pci 0000:82:0b.0: PME# supported from D0 D3hot D3cold
[ 11.646857] pci 0000:82:0c.0: [11f8:8536] type 01 class 0x060400
[ 11.649899] pci 0000:82:0c.0: PME# supported from D0 D3hot D3cold
[ 11.650433] pci 0000:82:0d.0: [11f8:8536] type 01 class 0x060400
[ 11.653488] pci 0000:82:0d.0: PME# supported from D0 D3hot D3cold
[ 11.654021] pci 0000:82:0e.0: [11f8:8536] type 01 class 0x060400
[ 11.657074] pci 0000:82:0e.0: PME# supported from D0 D3hot D3cold
[ 11.657609] pci 0000:82:0f.0: [11f8:8536] type 01 class 0x060400
[ 11.660689] pci 0000:82:0f.0: PME# supported from D0 D3hot D3cold
[ 11.661317] pci 0000:81:00.0: PCI bridge to [bus 82-92]
[ 11.661388] pci 0000:81:00.0: bridge window [mem 0xc8000000-0xc8ffffff]
[ 11.661830] pci 0000:83:00.0: [8086:0953] type 00 class 0x010802
[ 11.662029] pci 0000:83:00.0: reg 0x10: [mem 0xc8f00000-0xc8f03fff 64bit]
[ 11.662409] pci 0000:83:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.664057] pci 0000:82:00.0: PCI bridge to [bus 83]
[ 11.664130] pci 0000:82:00.0: bridge window [mem 0xc8f00000-0xc8ffffff]
[ 11.664595] pci 0000:84:00.0: [8086:0953] type 00 class 0x010802
[ 11.664797] pci 0000:84:00.0: reg 0x10: [mem 0xc8e00000-0xc8e03fff 64bit]
[ 11.665184] pci 0000:84:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.666849] pci 0000:82:01.0: PCI bridge to [bus 84]
[ 11.666922] pci 0000:82:01.0: bridge window [mem 0xc8e00000-0xc8efffff]
[ 11.667385] pci 0000:85:00.0: [8086:0953] type 00 class 0x010802
[ 11.667590] pci 0000:85:00.0: reg 0x10: [mem 0xc8d00000-0xc8d03fff 64bit]
[ 11.667984] pci 0000:85:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.669706] pci 0000:82:02.0: PCI bridge to [bus 85]
[ 11.669779] pci 0000:82:02.0: bridge window [mem 0xc8d00000-0xc8dfffff]
[ 11.670245] pci 0000:86:00.0: [8086:0953] type 00 class 0x010802
[ 11.670453] pci 0000:86:00.0: reg 0x10: [mem 0xc8c00000-0xc8c03fff 64bit]
[ 11.670855] pci 0000:86:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.672686] pci 0000:82:03.0: PCI bridge to [bus 86]
[ 11.672760] pci 0000:82:03.0: bridge window [mem 0xc8c00000-0xc8cfffff]
[ 11.673234] pci 0000:87:00.0: [8086:0953] type 00 class 0x010802
[ 11.673445] pci 0000:87:00.0: reg 0x10: [mem 0xc8b00000-0xc8b03fff 64bit]
[ 11.673854] pci 0000:87:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.675595] pci 0000:82:04.0: PCI bridge to [bus 87]
[ 11.675668] pci 0000:82:04.0: bridge window [mem 0xc8b00000-0xc8bfffff]
[ 11.676140] pci 0000:88:00.0: [8086:0953] type 00 class 0x010802
[ 11.676355] pci 0000:88:00.0: reg 0x10: [mem 0xc8a00000-0xc8a03fff 64bit]
[ 11.676771] pci 0000:88:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.678540] pci 0000:82:05.0: PCI bridge to [bus 88]
[ 11.678629] pci 0000:82:05.0: bridge window [mem 0xc8a00000-0xc8afffff]
[ 11.679110] pci 0000:89:00.0: [8086:0953] type 00 class 0x010802
[ 11.679329] pci 0000:89:00.0: reg 0x10: [mem 0xc8900000-0xc8903fff 64bit]
[ 11.679752] pci 0000:89:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.681549] pci 0000:82:06.0: PCI bridge to [bus 89]
[ 11.681623] pci 0000:82:06.0: bridge window [mem 0xc8900000-0xc89fffff]
[ 11.682100] pci 0000:8a:00.0: [8086:0953] type 00 class 0x010802
[ 11.682321] pci 0000:8a:00.0: reg 0x10: [mem 0xc8800000-0xc8803fff 64bit]
[ 11.682859] pci 0000:8a:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.684679] pci 0000:82:07.0: PCI bridge to [bus 8a]
[ 11.684754] pci 0000:82:07.0: bridge window [mem 0xc8800000-0xc88fffff]
[ 11.685238] pci 0000:8b:00.0: [8086:0953] type 00 class 0x010802
[ 11.685463] pci 0000:8b:00.0: reg 0x10: [mem 0xc8700000-0xc8703fff 64bit]
[ 11.685901] pci 0000:8b:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.687740] pci 0000:82:08.0: PCI bridge to [bus 8b]
[ 11.687815] pci 0000:82:08.0: bridge window [mem 0xc8700000-0xc87fffff]
[ 11.688302] pci 0000:8c:00.0: [8086:0953] type 00 class 0x010802
[ 11.688531] pci 0000:8c:00.0: reg 0x10: [mem 0xc8600000-0xc8603fff 64bit]
[ 11.688976] pci 0000:8c:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.690856] pci 0000:82:09.0: PCI bridge to [bus 8c]
[ 11.690931] pci 0000:82:09.0: bridge window [mem 0xc8600000-0xc86fffff]
[ 11.691416] pci 0000:8d:00.0: [8086:0953] type 00 class 0x010802
[ 11.691648] pci 0000:8d:00.0: reg 0x10: [mem 0xc8500000-0xc8503fff 64bit]
[ 11.692102] pci 0000:8d:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.694107] pci 0000:82:0a.0: PCI bridge to [bus 8d]
[ 11.694181] pci 0000:82:0a.0: bridge window [mem 0xc8500000-0xc85fffff]
[ 11.694674] pci 0000:8e:00.0: [8086:0953] type 00 class 0x010802
[ 11.694910] pci 0000:8e:00.0: reg 0x10: [mem 0xc8400000-0xc8403fff 64bit]
[ 11.695370] pci 0000:8e:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.697286] pci 0000:82:0b.0: PCI bridge to [bus 8e]
[ 11.697359] pci 0000:82:0b.0: bridge window [mem 0xc8400000-0xc84fffff]
[ 11.697852] pci 0000:8f:00.0: [8086:0953] type 00 class 0x010802
[ 11.698090] pci 0000:8f:00.0: reg 0x10: [mem 0xc8300000-0xc8303fff 64bit]
[ 11.698558] pci 0000:8f:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.700503] pci 0000:82:0c.0: PCI bridge to [bus 8f]
[ 11.700576] pci 0000:82:0c.0: bridge window [mem 0xc8300000-0xc83fffff]
[ 11.701076] pci 0000:90:00.0: [8086:0953] type 00 class 0x010802
[ 11.701318] pci 0000:90:00.0: reg 0x10: [mem 0xc8200000-0xc8203fff 64bit]
[ 11.701793] pci 0000:90:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.703866] pci 0000:82:0d.0: PCI bridge to [bus 90]
[ 11.703940] pci 0000:82:0d.0: bridge window [mem 0xc8200000-0xc82fffff]
[ 11.704443] pci 0000:91:00.0: [8086:0953] type 00 class 0x010802
[ 11.704689] pci 0000:91:00.0: reg 0x10: [mem 0xc8100000-0xc8103fff 64bit]
[ 11.705171] pci 0000:91:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.707167] pci 0000:82:0e.0: PCI bridge to [bus 91]
[ 11.707240] pci 0000:82:0e.0: bridge window [mem 0xc8100000-0xc81fffff]
[ 11.707742] pci 0000:92:00.0: [8086:0953] type 00 class 0x010802
[ 11.707992] pci 0000:92:00.0: reg 0x10: [mem 0xc8000000-0xc8003fff 64bit]
[ 11.708482] pci 0000:92:00.0: reg 0x30: [mem 0xffff0000-0xffffffff pref]
[ 11.710504] pci 0000:82:0f.0: PCI bridge to [bus 92]
[ 11.710578] pci 0000:82:0f.0: bridge window [mem 0xc8000000-0xc80fffff]
[ 11.711551] pci_bus 0000:80: on NUMA node 1
[ 11.711861] ACPI: Enabled 4 GPEs in block 00 to 3F
[ 11.712082] pci 0000:07:00.0: vgaarb: setting as boot VGA device
[ 11.712087] pci 0000:07:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[ 11.712098] pci 0000:07:00.0: vgaarb: bridge control possible
[ 11.712101] vgaarb: loaded
[ 11.712305] SCSI subsystem initialized
[ 11.712410] libata version 3.00 loaded.
[ 11.712426] ACPI: bus type USB registered
[ 11.712454] usbcore: registered new interface driver usbfs
[ 11.712463] usbcore: registered new interface driver hub
[ 11.712562] usbcore: registered new device driver usb
[ 11.712807] PCI: Using ACPI for IRQ routing
[ 11.717009] PCI: pci_cache_line_size set to 64 bytes
[ 11.718072] e820: reserve RAM buffer [mem 0x0009b400-0x0009ffff]
[ 11.718073] e820: reserve RAM buffer [mem 0x79fc5000-0x7bffffff]
[ 11.718074] e820: reserve RAM buffer [mem 0x7b800000-0x7bffffff]
[ 11.718185] NetLabel: Initializing
[ 11.718188] NetLabel: domain hash size = 128
[ 11.718191] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO
[ 11.718210] NetLabel: unlabeled traffic allowed by default
[ 11.718340] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[ 11.718347] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[ 11.720497] clocksource: Switched to clocksource hpet
[ 11.734322] VFS: Disk quotas dquot_6.6.0
[ 11.734362] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[ 11.734483] AppArmor: AppArmor Filesystem Enabled
[ 11.734520] pnp: PnP ACPI init
[ 11.735179] pnp 00:00: Plug and Play ACPI device, IDs PNP0b00 (active)
[ 11.735338] system 00:01: [io 0x0500-0x053f] has been reserved
[ 11.735348] system 00:01: [io 0x0400-0x047f] has been reserved
[ 11.735352] system 00:01: [io 0x0540-0x057f] has been reserved
[ 11.735355] system 00:01: [io 0x0600-0x061f] has been reserved
[ 11.735358] system 00:01: [io 0x0ca0-0x0ca5] has been reserved
[ 11.735362] system 00:01: [io 0x0880-0x0883] has been reserved
[ 11.735365] system 00:01: [io 0x0800-0x081f] has been reserved
[ 11.735369] system 00:01: [mem 0xfed1c000-0xfed3ffff] could not be reserved
[ 11.735373] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved
[ 11.735377] system 00:01: [mem 0xff000000-0xffffffff] could not be reserved
[ 11.735380] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved
[ 11.735384] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved
[ 11.735387] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved
[ 11.735390] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved
[ 11.735395] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[ 11.735543] pnp 00:02: Plug and Play ACPI device, IDs PNP0501 (active)
[ 11.735665] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[ 11.735901] pnp: PnP ACPI: found 4 devices
[ 11.742003] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[ 11.742016] pci 0000:05:00.0: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window
[ 11.742021] pci 0000:05:00.1: can't claim BAR 6 [mem 0xfff00000-0xffffffff pref]: no compatible bridge window
[ 11.742027] pci 0000:07:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742032] pci 0000:83:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742037] pci 0000:84:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742042] pci 0000:85:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742047] pci 0000:86:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742052] pci 0000:87:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742058] pci 0000:88:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742062] pci 0000:89:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742067] pci 0000:8a:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742072] pci 0000:8b:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742077] pci 0000:8c:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742082] pci 0000:8d:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742087] pci 0000:8e:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742092] pci 0000:8f:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742097] pci 0000:90:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742102] pci 0000:91:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742107] pci 0000:92:00.0: can't claim BAR 6 [mem 0xffff0000-0xffffffff pref]: no compatible bridge window
[ 11.742184] pci 0000:00:03.0: BAR 14: assigned [mem 0x91b00000-0x91cfffff]
[ 11.742188] pci 0000:00:01.0: PCI bridge to [bus 01]
[ 11.742196] pci 0000:00:02.0: PCI bridge to [bus 02]
[ 11.742204] pci 0000:00:02.2: PCI bridge to [bus 03-04]
[ 11.742208] pci 0000:00:02.2: bridge window [io 0x2000-0x2fff]
[ 11.742212] pci 0000:00:02.2: bridge window [mem 0x91900000-0x919fffff]
[ 11.742217] pci 0000:00:02.2: bridge window [mem 0x383ffe000000-0x383ffe0fffff 64bit pref]
[ 11.742224] pci 0000:05:00.0: BAR 6: assigned [mem 0x91b00000-0x91bfffff pref]
[ 11.742230] pci 0000:05:00.1: BAR 6: assigned [mem 0x91c00000-0x91cfffff pref]
[ 11.742234] pci 0000:00:03.0: PCI bridge to [bus 05]
[ 11.742239] pci 0000:00:03.0: bridge window [mem 0x91b00000-0x91cfffff]
[ 11.742243] pci 0000:00:03.0: bridge window [mem 0x383ffa000000-0x383ffdffffff 64bit pref]
[ 11.742250] pci 0000:00:1c.0: PCI bridge to [bus 06]
[ 11.742261] pci 0000:07:00.0: BAR 6: assigned [mem 0x91810000-0x9181ffff pref]
[ 11.742266] pci 0000:00:1c.3: PCI bridge to [bus 07]
[ 11.742271] pci 0000:00:1c.3: bridge window [mem 0x91000000-0x918fffff]
[ 11.742276] pci 0000:00:1c.3: bridge window [mem 0x90000000-0x90ffffff 64bit pref]
[ 11.742285] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window]
[ 11.742286] pci_bus 0000:00: resource 5 [io 0x1000-0x7fff window]
[ 11.742287] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[ 11.742288] pci_bus 0000:00: resource 7 [mem 0x90000000-0xc7ffbfff window]
[ 11.742289] pci_bus 0000:00: resource 8 [mem 0x380000000000-0x383fffffffff window]
[ 11.742290] pci_bus 0000:03: resource 0 [io 0x2000-0x2fff]
[ 11.742291] pci_bus 0000:03: resource 1 [mem 0x91900000-0x919fffff]
[ 11.742292] pci_bus 0000:03: resource 2 [mem 0x383ffe000000-0x383ffe0fffff 64bit pref]
[ 11.742294] pci_bus 0000:05: resource 1 [mem 0x91b00000-0x91cfffff]
[ 11.742295] pci_bus 0000:05: resource 2 [mem 0x383ffa000000-0x383ffdffffff 64bit pref]
[ 11.742297] pci_bus 0000:07: resource 1 [mem 0x91000000-0x918fffff]
[ 11.742298] pci_bus 0000:07: resource 2 [mem 0x90000000-0x90ffffff 64bit pref]
[ 11.742630] pci 0000:82:00.0: bridge window [io 0x1000-0x0fff] to [bus 83] add_size 1000
[ 11.742632] pci 0000:82:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 83] add_size 200000 add_align 100000
[ 11.742842] pci 0000:82:01.0: bridge window [io 0x1000-0x0fff] to [bus 84] add_size 1000
[ 11.742843] pci 0000:82:01.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 84] add_size 200000 add_align 100000
[ 11.743053] pci 0000:82:02.0: bridge window [io 0x1000-0x0fff] to [bus 85] add_size 1000
[ 11.743060] pci 0000:82:02.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 85] add_size 200000 add_align 100000
[ 11.743272] pci 0000:82:03.0: bridge window [io 0x1000-0x0fff] to [bus 86] add_size 1000
[ 11.743274] pci 0000:82:03.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 86] add_size 200000 add_align 100000
[ 11.743486] pci 0000:82:04.0: bridge window [io 0x1000-0x0fff] to [bus 87] add_size 1000
[ 11.743488] pci 0000:82:04.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 87] add_size 200000 add_align 100000
[ 11.743701] pci 0000:82:05.0: bridge window [io 0x1000-0x0fff] to [bus 88] add_size 1000
[ 11.743702] pci 0000:82:05.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 88] add_size 200000 add_align 100000
[ 11.743917] pci 0000:82:06.0: bridge window [io 0x1000-0x0fff] to [bus 89] add_size 1000
[ 11.743918] pci 0000:82:06.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 89] add_size 200000 add_align 100000
[ 11.744135] pci 0000:82:07.0: bridge window [io 0x1000-0x0fff] to [bus 8a] add_size 1000
[ 11.744137] pci 0000:82:07.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 8a] add_size 200000 add_align 100000
[ 11.744355] pci 0000:82:08.0: bridge window [io 0x1000-0x0fff] to [bus 8b] add_size 1000
[ 11.744358] pci 0000:82:08.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 8b] add_size 200000 add_align 100000
[ 11.744581] pci 0000:82:09.0: bridge window [io 0x1000-0x0fff] to [bus 8c] add_size 1000
[ 11.744582] pci 0000:82:09.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 8c] add_size 200000 add_align 100000
[ 11.744802] pci 0000:82:0a.0: bridge window [io 0x1000-0x0fff] to [bus 8d] add_size 1000
[ 11.744804] pci 0000:82:0a.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 8d] add_size 200000 add_align 100000
[ 11.745026] pci 0000:82:0b.0: bridge window [io 0x1000-0x0fff] to [bus 8e] add_size 1000
[ 11.745028] pci 0000:82:0b.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 8e] add_size 200000 add_align 100000
[ 11.745251] pci 0000:82:0c.0: bridge window [io 0x1000-0x0fff] to [bus 8f] add_size 1000
[ 11.745252] pci 0000:82:0c.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 8f] add_size 200000 add_align 100000
[ 11.745476] pci 0000:82:0d.0: bridge window [io 0x1000-0x0fff] to [bus 90] add_size 1000
[ 11.745477] pci 0000:82:0d.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 90] add_size 200000 add_align 100000
[ 11.745702] pci 0000:82:0e.0: bridge window [io 0x1000-0x0fff] to [bus 91] add_size 1000
[ 11.745703] pci 0000:82:0e.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 91] add_size 200000 add_align 100000
[ 11.745931] pci 0000:82:0f.0: bridge window [io 0x1000-0x0fff] to [bus 92] add_size 1000
[ 11.745933] pci 0000:82:0f.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 92] add_size 200000 add_align 100000
[ 11.746142] pci 0000:81:00.0: bridge window [io 0x1000-0x0fff] to [bus 82-92] add_size 10000
[ 11.746146] pci 0000:81:00.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 82-92] add_size 2000000 add_align 100000
[ 11.746152] pci 0000:80:02.0: bridge window [io 0x1000-0x0fff] to [bus 81-92] add_size 10000
[ 11.746153] pci 0000:80:02.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 81-92] add_size 2000000 add_align 100000
[ 11.746158] pci 0000:80:02.0: BAR 15: assigned [mem 0x384000000000-0x384001ffffff 64bit pref]
[ 11.746164] pci 0000:80:02.0: BAR 13: no space for [io size 0x10000]
[ 11.746167] pci 0000:80:02.0: BAR 13: failed to assign [io size 0x10000]
[ 11.746171] pci 0000:80:02.0: BAR 13: no space for [io size 0x10000]
[ 11.746174] pci 0000:80:02.0: BAR 13: failed to assign [io size 0x10000]
[ 11.746179] pci 0000:81:00.0: BAR 15: assigned [mem 0x384000000000-0x384001ffffff 64bit pref]
[ 11.746183] pci 0000:81:00.0: BAR 13: no space for [io size 0x10000]
[ 11.746186] pci 0000:81:00.0: BAR 13: failed to assign [io size 0x10000]
[ 11.746190] pci 0000:81:00.0: BAR 13: no space for [io size 0x10000]
[ 11.746193] pci 0000:81:00.0: BAR 13: failed to assign [io size 0x10000]
[ 11.746214] pci 0000:82:00.0: BAR 15: assigned [mem 0x384000000000-0x3840001fffff 64bit pref]
[ 11.746219] pci 0000:82:01.0: BAR 15: assigned [mem 0x384000200000-0x3840003fffff 64bit pref]
[ 11.746224] pci 0000:82:02.0: BAR 15: assigned [mem 0x384000400000-0x3840005fffff 64bit pref]
[ 11.746229] pci 0000:82:03.0: BAR 15: assigned [mem 0x384000600000-0x3840007fffff 64bit pref]
[ 11.746234] pci 0000:82:04.0: BAR 15: assigned [mem 0x384000800000-0x3840009fffff 64bit pref]
[ 11.746239] pci 0000:82:05.0: BAR 15: assigned [mem 0x384000a00000-0x384000bfffff 64bit pref]
[ 11.746244] pci 0000:82:06.0: BAR 15: assigned [mem 0x384000c00000-0x384000dfffff 64bit pref]
[ 11.746249] pci 0000:82:07.0: BAR 15: assigned [mem 0x384000e00000-0x384000ffffff 64bit pref]
[ 11.746254] pci 0000:82:08.0: BAR 15: assigned [mem 0x384001000000-0x3840011fffff 64bit pref]
[ 11.746259] pci 0000:82:09.0: BAR 15: assigned [mem 0x384001200000-0x3840013fffff 64bit pref]
[ 11.746264] pci 0000:82:0a.0: BAR 15: assigned [mem 0x384001400000-0x3840015fffff 64bit pref]
[ 11.746269] pci 0000:82:0b.0: BAR 15: assigned [mem 0x384001600000-0x3840017fffff 64bit pref]
[ 11.746274] pci 0000:82:0c.0: BAR 15: assigned [mem 0x384001800000-0x3840019fffff 64bit pref]
[ 11.746279] pci 0000:82:0d.0: BAR 15: assigned [mem 0x384001a00000-0x384001bfffff 64bit pref]
[ 11.746284] pci 0000:82:0e.0: BAR 15: assigned [mem 0x384001c00000-0x384001dfffff 64bit pref]
[ 11.746289] pci 0000:82:0f.0: BAR 15: assigned [mem 0x384001e00000-0x384001ffffff 64bit pref]
[ 11.746294] pci 0000:82:00.0: BAR 13: no space for [io size 0x1000]
[ 11.746297] pci 0000:82:00.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746300] pci 0000:82:01.0: BAR 13: no space for [io size 0x1000]
[ 11.746303] pci 0000:82:01.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746307] pci 0000:82:02.0: BAR 13: no space for [io size 0x1000]
[ 11.746310] pci 0000:82:02.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746313] pci 0000:82:03.0: BAR 13: no space for [io size 0x1000]
[ 11.746316] pci 0000:82:03.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746319] pci 0000:82:04.0: BAR 13: no space for [io size 0x1000]
[ 11.746323] pci 0000:82:04.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746326] pci 0000:82:05.0: BAR 13: no space for [io size 0x1000]
[ 11.746329] pci 0000:82:05.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746332] pci 0000:82:06.0: BAR 13: no space for [io size 0x1000]
[ 11.746335] pci 0000:82:06.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746339] pci 0000:82:07.0: BAR 13: no space for [io size 0x1000]
[ 11.746342] pci 0000:82:07.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746345] pci 0000:82:08.0: BAR 13: no space for [io size 0x1000]
[ 11.746348] pci 0000:82:08.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746351] pci 0000:82:09.0: BAR 13: no space for [io size 0x1000]
[ 11.746355] pci 0000:82:09.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746358] pci 0000:82:0a.0: BAR 13: no space for [io size 0x1000]
[ 11.746361] pci 0000:82:0a.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746364] pci 0000:82:0b.0: BAR 13: no space for [io size 0x1000]
[ 11.746367] pci 0000:82:0b.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746371] pci 0000:82:0c.0: BAR 13: no space for [io size 0x1000]
[ 11.746374] pci 0000:82:0c.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746377] pci 0000:82:0d.0: BAR 13: no space for [io size 0x1000]
[ 11.746380] pci 0000:82:0d.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746383] pci 0000:82:0e.0: BAR 13: no space for [io size 0x1000]
[ 11.746387] pci 0000:82:0e.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746390] pci 0000:82:0f.0: BAR 13: no space for [io size 0x1000]
[ 11.746393] pci 0000:82:0f.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746401] pci 0000:82:0f.0: BAR 13: no space for [io size 0x1000]
[ 11.746405] pci 0000:82:0f.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746408] pci 0000:82:0e.0: BAR 13: no space for [io size 0x1000]
[ 11.746411] pci 0000:82:0e.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746415] pci 0000:82:0d.0: BAR 13: no space for [io size 0x1000]
[ 11.746418] pci 0000:82:0d.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746421] pci 0000:82:0c.0: BAR 13: no space for [io size 0x1000]
[ 11.746424] pci 0000:82:0c.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746427] pci 0000:82:0b.0: BAR 13: no space for [io size 0x1000]
[ 11.746431] pci 0000:82:0b.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746434] pci 0000:82:0a.0: BAR 13: no space for [io size 0x1000]
[ 11.746437] pci 0000:82:0a.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746440] pci 0000:82:09.0: BAR 13: no space for [io size 0x1000]
[ 11.746444] pci 0000:82:09.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746447] pci 0000:82:08.0: BAR 13: no space for [io size 0x1000]
[ 11.746450] pci 0000:82:08.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746453] pci 0000:82:07.0: BAR 13: no space for [io size 0x1000]
[ 11.746456] pci 0000:82:07.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746460] pci 0000:82:06.0: BAR 13: no space for [io size 0x1000]
[ 11.746463] pci 0000:82:06.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746466] pci 0000:82:05.0: BAR 13: no space for [io size 0x1000]
[ 11.746469] pci 0000:82:05.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746473] pci 0000:82:04.0: BAR 13: no space for [io size 0x1000]
[ 11.746476] pci 0000:82:04.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746479] pci 0000:82:03.0: BAR 13: no space for [io size 0x1000]
[ 11.746482] pci 0000:82:03.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746485] pci 0000:82:02.0: BAR 13: no space for [io size 0x1000]
[ 11.746489] pci 0000:82:02.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746492] pci 0000:82:01.0: BAR 13: no space for [io size 0x1000]
[ 11.746495] pci 0000:82:01.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746498] pci 0000:82:00.0: BAR 13: no space for [io size 0x1000]
[ 11.746501] pci 0000:82:00.0: BAR 13: failed to assign [io size 0x1000]
[ 11.746506] pci 0000:83:00.0: BAR 6: assigned [mem 0xc8f10000-0xc8f1ffff pref]
[ 11.746511] pci 0000:82:00.0: PCI bridge to [bus 83]
[ 11.746753] pci 0000:82:00.0: bridge window [mem 0xc8f00000-0xc8ffffff]
[ 11.746914] pci 0000:82:00.0: bridge window [mem 0x384000000000-0x3840001fffff 64bit pref]
[ 11.747174] pci 0000:84:00.0: BAR 6: assigned [mem 0xc8e10000-0xc8e1ffff pref]
[ 11.747178] pci 0000:82:01.0: PCI bridge to [bus 84]
[ 11.747421] pci 0000:82:01.0: bridge window [mem 0xc8e00000-0xc8efffff]
[ 11.747583] pci 0000:82:01.0: bridge window [mem 0x384000200000-0x3840003fffff 64bit pref]
[ 11.747844] pci 0000:85:00.0: BAR 6: assigned [mem 0xc8d10000-0xc8d1ffff pref]
[ 11.747849] pci 0000:82:02.0: PCI bridge to [bus 85]
[ 11.748093] pci 0000:82:02.0: bridge window [mem 0xc8d00000-0xc8dfffff]
[ 11.748256] pci 0000:82:02.0: bridge window [mem 0x384000400000-0x3840005fffff 64bit pref]
[ 11.748522] pci 0000:86:00.0: BAR 6: assigned [mem 0xc8c10000-0xc8c1ffff pref]
[ 11.748527] pci 0000:82:03.0: PCI bridge to [bus 86]
[ 11.748773] pci 0000:82:03.0: bridge window [mem 0xc8c00000-0xc8cfffff]
[ 11.748937] pci 0000:82:03.0: bridge window [mem 0x384000600000-0x3840007fffff 64bit pref]
[ 11.749202] pci 0000:87:00.0: BAR 6: assigned [mem 0xc8b10000-0xc8b1ffff pref]
[ 11.749206] pci 0000:82:04.0: PCI bridge to [bus 87]
[ 11.749454] pci 0000:82:04.0: bridge window [mem 0xc8b00000-0xc8bfffff]
[ 11.749620] pci 0000:82:04.0: bridge window [mem 0x384000800000-0x3840009fffff 64bit pref]
[ 11.749886] pci 0000:88:00.0: BAR 6: assigned [mem 0xc8a10000-0xc8a1ffff pref]
[ 11.749890] pci 0000:82:05.0: PCI bridge to [bus 88]
[ 11.750140] pci 0000:82:05.0: bridge window [mem 0xc8a00000-0xc8afffff]
[ 11.750306] pci 0000:82:05.0: bridge window [mem 0x384000a00000-0x384000bfffff 64bit pref]
[ 11.750575] pci 0000:89:00.0: BAR 6: assigned [mem 0xc8910000-0xc891ffff pref]
[ 11.750580] pci 0000:82:06.0: PCI bridge to [bus 89]
[ 11.750831] pci 0000:82:06.0: bridge window [mem 0xc8900000-0xc89fffff]
[ 11.750999] pci 0000:82:06.0: bridge window [mem 0x384000c00000-0x384000dfffff 64bit pref]
[ 11.751269] pci 0000:8a:00.0: BAR 6: assigned [mem 0xc8810000-0xc881ffff pref]
[ 11.751273] pci 0000:82:07.0: PCI bridge to [bus 8a]
[ 11.751528] pci 0000:82:07.0: bridge window [mem 0xc8800000-0xc88fffff]
[ 11.751696] pci 0000:82:07.0: bridge window [mem 0x384000e00000-0x384000ffffff 64bit pref]
[ 11.751968] pci 0000:8b:00.0: BAR 6: assigned [mem 0xc8710000-0xc871ffff pref]
[ 11.751972] pci 0000:82:08.0: PCI bridge to [bus 8b]
[ 11.752227] pci 0000:82:08.0: bridge window [mem 0xc8700000-0xc87fffff]
[ 11.752397] pci 0000:82:08.0: bridge window [mem 0x384001000000-0x3840011fffff 64bit pref]
[ 11.752685] pci 0000:8c:00.0: BAR 6: assigned [mem 0xc8610000-0xc861ffff pref]
[ 11.752690] pci 0000:82:09.0: PCI bridge to [bus 8c]
[ 11.752945] pci 0000:82:09.0: bridge window [mem 0xc8600000-0xc86fffff]
[ 11.753116] pci 0000:82:09.0: bridge window [mem 0x384001200000-0x3840013fffff 64bit pref]
[ 11.753392] pci 0000:8d:00.0: BAR 6: assigned [mem 0xc8510000-0xc851ffff pref]
[ 11.753396] pci 0000:82:0a.0: PCI bridge to [bus 8d]
[ 11.753654] pci 0000:82:0a.0: bridge window [mem 0xc8500000-0xc85fffff]
[ 11.753827] pci 0000:82:0a.0: bridge window [mem 0x384001400000-0x3840015fffff 64bit pref]
[ 11.754104] pci 0000:8e:00.0: BAR 6: assigned [mem 0xc8410000-0xc841ffff pref]
[ 11.754109] pci 0000:82:0b.0: PCI bridge to [bus 8e]
[ 11.754369] pci 0000:82:0b.0: bridge window [mem 0xc8400000-0xc84fffff]
[ 11.754545] pci 0000:82:0b.0: bridge window [mem 0x384001600000-0x3840017fffff 64bit pref]
[ 11.754823] pci 0000:8f:00.0: BAR 6: assigned [mem 0xc8310000-0xc831ffff pref]
[ 11.754828] pci 0000:82:0c.0: PCI bridge to [bus 8f]
[ 11.755089] pci 0000:82:0c.0: bridge window [mem 0xc8300000-0xc83fffff]
[ 11.755264] pci 0000:82:0c.0: bridge window [mem 0x384001800000-0x3840019fffff 64bit pref]
[ 11.755544] pci 0000:90:00.0: BAR 6: assigned [mem 0xc8210000-0xc821ffff pref]
[ 11.755548] pci 0000:82:0d.0: PCI bridge to [bus 90]
[ 11.755812] pci 0000:82:0d.0: bridge window [mem 0xc8200000-0xc82fffff]
[ 11.755987] pci 0000:82:0d.0: bridge window [mem 0x384001a00000-0x384001bfffff 64bit pref]
[ 11.756269] pci 0000:91:00.0: BAR 6: assigned [mem 0xc8110000-0xc811ffff pref]
[ 11.756274] pci 0000:82:0e.0: PCI bridge to [bus 91]
[ 11.756543] pci 0000:82:0e.0: bridge window [mem 0xc8100000-0xc81fffff]
[ 11.756722] pci 0000:82:0e.0: bridge window [mem 0x384001c00000-0x384001dfffff 64bit pref]
[ 11.757006] pci 0000:92:00.0: BAR 6: assigned [mem 0xc8010000-0xc801ffff pref]
[ 11.757010] pci 0000:82:0f.0: PCI bridge to [bus 92]
[ 11.757277] pci 0000:82:0f.0: bridge window [mem 0xc8000000-0xc80fffff]
[ 11.757455] pci 0000:82:0f.0: bridge window [mem 0x384001e00000-0x384001ffffff 64bit pref]
[ 11.757740] pci 0000:81:00.0: PCI bridge to [bus 82-92]
[ 11.757977] pci 0000:81:00.0: bridge window [mem 0xc8000000-0xc8ffffff]
[ 11.758137] pci 0000:81:00.0: bridge window [mem 0x384000000000-0x384001ffffff 64bit pref]
[ 11.758396] pci 0000:80:02.0: PCI bridge to [bus 81-92]
[ 11.758401] pci 0000:80:02.0: bridge window [mem 0xc8000000-0xc8ffffff]
[ 11.758405] pci 0000:80:02.0: bridge window [mem 0x384000000000-0x384001ffffff 64bit pref]
[ 11.758413] pci_bus 0000:80: resource 4 [io 0x8000-0xffff window]
[ 11.758414] pci_bus 0000:80: resource 5 [mem 0xc8000000-0xfbffbfff window]
[ 11.758415] pci_bus 0000:80: resource 6 [mem 0x384000000000-0x387fffffffff window]
[ 11.758416] pci_bus 0000:81: resource 1 [mem 0xc8000000-0xc8ffffff]
[ 11.758417] pci_bus 0000:81: resource 2 [mem 0x384000000000-0x384001ffffff 64bit pref]
[ 11.758418] pci_bus 0000:82: resource 1 [mem 0xc8000000-0xc8ffffff]
[ 11.758420] pci_bus 0000:82: resource 2 [mem 0x384000000000-0x384001ffffff 64bit pref]
[ 11.758421] pci_bus 0000:83: resource 1 [mem 0xc8f00000-0xc8ffffff]
[ 11.758422] pci_bus 0000:83: resource 2 [mem 0x384000000000-0x3840001fffff 64bit pref]
[ 11.758423] pci_bus 0000:84: resource 1 [mem 0xc8e00000-0xc8efffff]
[ 11.758424] pci_bus 0000:84: resource 2 [mem 0x384000200000-0x3840003fffff 64bit pref]
[ 11.758425] pci_bus 0000:85: resource 1 [mem 0xc8d00000-0xc8dfffff]
[ 11.758426] pci_bus 0000:85: resource 2 [mem 0x384000400000-0x3840005fffff 64bit pref]
[ 11.758427] pci_bus 0000:86: resource 1 [mem 0xc8c00000-0xc8cfffff]
[ 11.758428] pci_bus 0000:86: resource 2 [mem 0x384000600000-0x3840007fffff 64bit pref]
[ 11.758429] pci_bus 0000:87: resource 1 [mem 0xc8b00000-0xc8bfffff]
[ 11.758430] pci_bus 0000:87: resource 2 [mem 0x384000800000-0x3840009fffff 64bit pref]
[ 11.758431] pci_bus 0000:88: resource 1 [mem 0xc8a00000-0xc8afffff]
[ 11.758432] pci_bus 0000:88: resource 2 [mem 0x384000a00000-0x384000bfffff 64bit pref]
[ 11.758432] pci_bus 0000:89: resource 1 [mem 0xc8900000-0xc89fffff]
[ 11.758433] pci_bus 0000:89: resource 2 [mem 0x384000c00000-0x384000dfffff 64bit pref]
[ 11.758434] pci_bus 0000:8a: resource 1 [mem 0xc8800000-0xc88fffff]
[ 11.758435] pci_bus 0000:8a: resource 2 [mem 0x384000e00000-0x384000ffffff 64bit pref]
[ 11.758436] pci_bus 0000:8b: resource 1 [mem 0xc8700000-0xc87fffff]
[ 11.758437] pci_bus 0000:8b: resource 2 [mem 0x384001000000-0x3840011fffff 64bit pref]
[ 11.758438] pci_bus 0000:8c: resource 1 [mem 0xc8600000-0xc86fffff]
[ 11.758439] pci_bus 0000:8c: resource 2 [mem 0x384001200000-0x3840013fffff 64bit pref]
[ 11.758440] pci_bus 0000:8d: resource 1 [mem 0xc8500000-0xc85fffff]
[ 11.758441] pci_bus 0000:8d: resource 2 [mem 0x384001400000-0x3840015fffff 64bit pref]
[ 11.758442] pci_bus 0000:8e: resource 1 [mem 0xc8400000-0xc84fffff]
[ 11.758443] pci_bus 0000:8e: resource 2 [mem 0x384001600000-0x3840017fffff 64bit pref]
[ 11.758444] pci_bus 0000:8f: resource 1 [mem 0xc8300000-0xc83fffff]
[ 11.758445] pci_bus 0000:8f: resource 2 [mem 0x384001800000-0x3840019fffff 64bit pref]
[ 11.758445] pci_bus 0000:90: resource 1 [mem 0xc8200000-0xc82fffff]
[ 11.758446] pci_bus 0000:90: resource 2 [mem 0x384001a00000-0x384001bfffff 64bit pref]
[ 11.758447] pci_bus 0000:91: resource 1 [mem 0xc8100000-0xc81fffff]
[ 11.758448] pci_bus 0000:91: resource 2 [mem 0x384001c00000-0x384001dfffff 64bit pref]
[ 11.758449] pci_bus 0000:92: resource 1 [mem 0xc8000000-0xc80fffff]
[ 11.758450] pci_bus 0000:92: resource 2 [mem 0x384001e00000-0x384001ffffff 64bit pref]
[ 11.758590] NET: Registered protocol family 2
[ 11.759064] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[ 11.759790] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[ 11.759967] TCP: Hash tables configured (established 524288 bind 65536)
[ 11.760117] UDP hash table entries: 32768 (order: 8, 1048576 bytes)
[ 11.760326] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes)
[ 11.760705] NET: Registered protocol family 1
[ 11.820572] pci 0000:07:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[ 11.821021] PCI: CLS 32 bytes, default 64
[ 11.821077] Unpacking initramfs...
[ 12.478930] Freeing initrd memory: 40320K
[ 12.478975] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[ 12.478980] software IO TLB [mem 0x75fc5000-0x79fc5000] (64MB) mapped at [ffff9934f5fc5000-ffff9934f9fc4fff]
[ 12.479036] Intel CQM monitoring enabled
[ 12.482180] Scanning for low memory corruption every 60 seconds
[ 12.483079] audit: initializing netlink subsys (disabled)
[ 12.484052] Initialise system trusted keyrings
[ 12.484144] workingset: timestamp_bits=36 max_order=24 bucket_order=0
[ 12.485405] zbud: loaded
[ 12.486195] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[ 12.486414] fuse init (API version 7.26)
[ 12.488657] Key type asymmetric registered
[ 12.488662] Asymmetric key parser 'x509' registered
[ 12.488677] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[ 12.488773] io scheduler noop registered
[ 12.488775] io scheduler deadline registered
[ 12.488814] io scheduler cfq registered (default)
[ 12.508146] pcieport 0000:00:01.0: Signaling PME with IRQ 25
[ 12.508175] pcieport 0000:00:02.0: Signaling PME with IRQ 26
[ 12.508191] pcieport 0000:00:02.2: Signaling PME with IRQ 27
[ 12.508206] pcieport 0000:00:03.0: Signaling PME with IRQ 28
[ 12.508232] pcieport 0000:00:1c.0: Signaling PME with IRQ 29
[ 12.508252] pcieport 0000:00:1c.3: Signaling PME with IRQ 30
[ 12.508272] pcieport 0000:80:02.0: Signaling PME with IRQ 32
[ 12.508490] dpc 0000:82:00.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.508669] dpc 0000:82:01.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.508846] dpc 0000:82:02.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.509048] dpc 0000:82:03.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.509226] dpc 0000:82:04.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.509404] dpc 0000:82:05.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.509583] dpc 0000:82:06.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.509762] dpc 0000:82:07.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.509941] dpc 0000:82:08.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.510135] dpc 0000:82:09.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.510315] dpc 0000:82:0a.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.510495] dpc 0000:82:0b.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.510676] dpc 0000:82:0c.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.510856] dpc 0000:82:0d.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.511037] dpc 0000:82:0e.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.511228] dpc 0000:82:0f.0:pcie210: DPC error containment capabilities: Int Msg #0, RPExt- PoisonedTLP+ SwTrigger+ RP PIO Log 0, DL_ActiveErr+
[ 12.511278] pciehp 0000:82:00.0:pcie204: Slot #1 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.511438] pciehp 0000:82:01.0:pcie204: Slot #2 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.511596] pciehp 0000:82:02.0:pcie204: Slot #3 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.511746] pciehp 0000:82:03.0:pcie204: Slot #4 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.511895] pciehp 0000:82:04.0:pcie204: Slot #5 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.512051] pciehp 0000:82:05.0:pcie204: Slot #6 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.512207] pciehp 0000:82:06.0:pcie204: Slot #7 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.512358] pciehp 0000:82:07.0:pcie204: Slot #8 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.512538] pciehp 0000:82:08.0:pcie204: Slot #9 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.512726] pciehp 0000:82:09.0:pcie204: Slot #10 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.512885] pciehp 0000:82:0a.0:pcie204: Slot #11 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.513039] pciehp 0000:82:0b.0:pcie204: Slot #12 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.513193] pciehp 0000:82:0c.0:pcie204: Slot #13 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.513362] pciehp 0000:82:0d.0:pcie204: Slot #14 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.513517] pciehp 0000:82:0e.0:pcie204: Slot #15 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.513672] pciehp 0000:82:0f.0:pcie204: Slot #16 AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise- Interlock- NoCompl+ LLActRep+
[ 12.513894] vesafb: mode is 640x480x32, linelength=2560, pages=0
[ 12.513897] vesafb: scrolling: redraw
[ 12.513900] vesafb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[ 12.513929] vesafb: framebuffer at 0x90000000, mapped to 0xffffbcf0c8200000, using 1216k, total 1216k
[ 12.600394] Console: switching to colour frame buffer device 80x30
[ 12.689275] fb0: VESA VGA frame buffer device
[ 12.691085] intel_idle: MWAIT substates: 0x2120
[ 12.691086] intel_idle: v0.4.1 model 0x3F
[ 12.692697] intel_idle: lapic_timer_reliable_states 0xffffffff
[ 12.692963] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input0
[ 12.696011] ACPI: Power Button [PWRF]
[ 12.742677] ERST: Error Record Serialization Table (ERST) support is initialized.
[ 12.891295] pstore: using zlib compression
[ 12.964340] pstore: Registered erst as persistent store backend
[ 13.037381] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC.
[ 13.185175] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[ 13.277494] 00:02: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[ 13.438350] 00:03: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[ 13.512591] tsc: Refined TSC clocksource calibration: 2299.986 MHz
[ 13.512625] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x212727fc292, max_idle_ns: 440795258401 ns
[ 13.785823] Linux agpgart interface v0.103
[ 13.863080] loop: module loaded
[ 13.930702] libphy: Fixed MDIO Bus: probed
[ 13.997261] tun: Universal TUN/TAP device driver, 1.6
[ 14.063258] PPP generic driver version 2.4.2
[ 14.125578] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[ 14.188531] ehci-pci: EHCI PCI platform driver
[ 14.251181] ehci-pci 0000:00:1a.0: EHCI Host Controller
[ 14.313885] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[ 14.436809] ehci-pci 0000:00:1a.0: debug port 2
[ 14.501726] ehci-pci 0000:00:1a.0: cache line size of 32 is not supported
[ 14.501736] ehci-pci 0000:00:1a.0: irq 18, io mem 0x91a02000
[ 14.562296] clocksource: Switched to clocksource tsc
[ 14.576567] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[ 14.576606] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002
[ 14.576607] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.576609] usb usb1: Product: EHCI Host Controller
[ 14.576610] usb usb1: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence ehci_hcd
[ 14.576611] usb usb1: SerialNumber: 0000:00:1a.0
[ 14.576731] hub 1-0:1.0: USB hub found
[ 14.576736] hub 1-0:1.0: 2 ports detected
[ 14.577034] ehci-pci 0000:00:1d.0: EHCI Host Controller
[ 14.577038] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[ 14.577080] ehci-pci 0000:00:1d.0: debug port 2
[ 14.581038] ehci-pci 0000:00:1d.0: cache line size of 32 is not supported
[ 14.581043] ehci-pci 0000:00:1d.0: irq 18, io mem 0x91a01000
[ 14.596566] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[ 14.596598] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002
[ 14.596599] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.596600] usb usb2: Product: EHCI Host Controller
[ 14.596601] usb usb2: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence ehci_hcd
[ 14.596602] usb usb2: SerialNumber: 0000:00:1d.0
[ 14.596716] hub 2-0:1.0: USB hub found
[ 14.596720] hub 2-0:1.0: 2 ports detected
[ 14.596849] ehci-platform: EHCI generic platform driver
[ 14.596860] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[ 14.596862] ohci-pci: OHCI PCI platform driver
[ 14.596884] ohci-platform: OHCI generic platform driver
[ 14.596890] uhci_hcd: USB Universal Host Controller Interface driver
[ 14.597096] xhci_hcd 0000:00:14.0: xHCI Host Controller
[ 14.597100] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3
[ 14.598477] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x00009810
[ 14.598492] xhci_hcd 0000:00:14.0: cache line size of 32 is not supported
[ 14.598598] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002
[ 14.598599] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.598600] usb usb3: Product: xHCI Host Controller
[ 14.598601] usb usb3: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence xhci-hcd
[ 14.598602] usb usb3: SerialNumber: 0000:00:14.0
[ 14.598728] hub 3-0:1.0: USB hub found
[ 14.598801] hub 3-0:1.0: 15 ports detected
[ 14.601026] xhci_hcd 0000:00:14.0: xHCI Host Controller
[ 14.601034] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4
[ 14.601075] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003
[ 14.601076] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[ 14.601077] usb usb4: Product: xHCI Host Controller
[ 14.601078] usb usb4: Manufacturer: Linux 4.11.0-rc6patch-2-get-fence xhci-hcd
[ 14.601079] usb usb4: SerialNumber: 0000:00:14.0
[ 14.601188] hub 4-0:1.0: USB hub found
[ 14.601220] hub 4-0:1.0: 6 ports detected
[ 14.602285] i8042: PNP: No PS/2 controller found.
[ 14.602361] mousedev: PS/2 mouse device common for all mice
[ 14.602478] rtc_cmos 00:00: RTC can wake from S4
[ 14.602966] rtc_cmos 00:00: rtc core: registered rtc_cmos as rtc0
[ 14.603068] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[ 14.603073] i2c /dev entries driver
[ 14.603125] device-mapper: uevent: version 1.0.3
[ 14.603197] device-mapper: ioctl: 4.35.0-ioctl (2016-06-23) initialised: dm-devel@redhat.com
[ 14.603205] intel_pstate: Intel P-state driver initializing
[ 14.908600] usb 1-1: new high-speed USB device number 2 using ehci-pci
[ 14.924564] usb 2-1: new high-speed USB device number 2 using ehci-pci
[ 14.928567] usb 3-1: new low-speed USB device number 2 using xhci_hcd
[ 15.056935] usb 1-1: New USB device found, idVendor=8087, idProduct=800a
[ 15.056936] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 15.057231] hub 1-1:1.0: USB hub found
[ 15.057434] hub 1-1:1.0: 6 ports detected
[ 15.072935] usb 2-1: New USB device found, idVendor=8087, idProduct=8002
[ 15.072937] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[ 15.073232] hub 2-1:1.0: USB hub found
[ 15.073308] hub 2-1:1.0: 8 ports detected
[ 15.075539] usb 3-1: New USB device found, idVendor=14dd, idProduct=1007
[ 15.075542] usb 3-1: New USB device strings: Mfr=1, Product=2, SerialNumber=7
[ 15.075544] usb 3-1: Product: D2CIM-DVUSB
[ 15.075545] usb 3-1: Manufacturer: Raritan
[ 15.075546] usb 3-1: SerialNumber: PQ254006500000007
[ 15.200565] usb 3-9: new full-speed USB device number 3 using xhci_hcd
[ 15.362100] usb 3-9: New USB device found, idVendor=046b, idProduct=ff10
[ 15.362102] usb 3-9: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[ 15.362104] usb 3-9: Product: Virtual Keyboard and Mouse
[ 15.362105] usb 3-9: Manufacturer: American Megatrends Inc.
[ 15.362105] usb 3-9: SerialNumber: serial
[ 19.573281] ledtrig-cpu: registered to indicate activity on CPUs
[ 19.625883] NET: Registered protocol family 10
[ 19.680293] Segment Routing with IPv6
[ 19.730973] NET: Registered protocol family 17
[ 19.781997] Key type dns_resolver registered
[ 19.836509] microcode: sig=0x306f2, pf=0x1, revision=0x37
[ 19.885859] microcode: Microcode Update Driver: v2.2.
[ 19.885968] registered taskstats version 1
[ 19.979854] Loading compiled-in X.509 certificates
[ 20.029966] Loaded X.509 cert 'Build time autogenerated kernel key: de39ac008d1fce01b49462a1060a30c176fa995c'
[ 20.127927] zswap: loaded using pool lzo/zbud
[ 20.186244] Key type big_key registered
[ 20.234389] Key type trusted registered
[ 20.283813] Key type encrypted registered
[ 20.330777] AppArmor: AppArmor sha1 policy hashing enabled
[ 20.378595] ima: No TPM chip found, activating TPM-bypass! (rc=-19)
[ 20.426816] evm: HMAC attrs: 0x1
[ 20.477700] Magic number: 13:919:150
[ 20.525397] pci 0000:7f:13.1: hash matches
[ 20.573193] rtc_cmos 00:00: setting system clock to 2017-04-19 23:09:04 UTC (1492643344)
[ 20.670615] BIOS EDD facility v0.16 2004-Jun-25, 0 devices found
[ 20.722045] EDD information not available.
[ 20.772755] PM: Hibernation image not present or could not be loaded.
[ 20.774310] Freeing unused kernel memory: 2212K
[ 20.824905] Write protecting the kernel read-only data: 14336k
[ 20.876798] Freeing unused kernel memory: 1148K
[ 20.927877] Freeing unused kernel memory: 212K
[ 20.978869] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[ 21.142480] random: systemd-udevd: uninitialized urandom read (16 bytes read)
[ 21.142790] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.142813] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.146296] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.146334] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.146377] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.146408] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.146435] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.146463] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.146494] random: udevadm: uninitialized urandom read (16 bytes read)
[ 21.630330] wmi: Mapper loaded
[ 21.671077] pps_core: LinuxPPS API ver. 1 registered
[ 21.671108] hidraw: raw HID events driver (C) Jiri Kosina
[ 21.753467] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[ 21.839752] nvme nvme0: pci function 0000:83:00.0
[ 21.881981] nvme nvme1: pci function 0000:84:00.0
[ 21.923425] PTP clock support registered
[ 21.923497] nvme nvme2: pci function 0000:85:00.0
[ 21.923537] ahci 0000:00:11.4: version 3.0
[ 21.923571] nvme nvme3: pci function 0000:86:00.0
[ 21.924159] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode
[ 21.924160] ahci 0000:00:11.4: flags: 64bit ncq led clo pio slum part ems apst
[ 21.924402] nvme nvme4: pci function 0000:87:00.0
[ 21.926492] nvme nvme5: pci function 0000:88:00.0
[ 21.926600] nvme nvme6: pci function 0000:89:00.0
[ 21.926643] nvme nvme7: pci function 0000:8a:00.0
[ 21.926695] nvme nvme8: pci function 0000:8b:00.0
[ 21.926746] nvme nvme9: pci function 0000:8c:00.0
[ 21.926797] nvme nvme10: pci function 0000:8d:00.0
[ 21.926852] nvme nvme11: pci function 0000:8e:00.0
[ 21.926911] nvme nvme12: pci function 0000:8f:00.0
[ 21.926964] nvme nvme13: pci function 0000:90:00.0
[ 21.927003] nvme nvme14: pci function 0000:91:00.0
[ 21.927042] nvme nvme15: pci function 0000:92:00.0
[ 21.969000] scsi host0: ahci
[ 21.969106] scsi host1: ahci
[ 21.969199] scsi host2: ahci
[ 21.972617] scsi host3: ahci
[ 21.972654] ata1: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00100 irq 53
[ 21.972661] ata2: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00180 irq 53
[ 21.972667] ata3: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00200 irq 53
[ 21.972674] ata4: SATA max UDMA/133 abar m2048@0x91a00000 port 0x91a00280 irq 53
[ 21.973171] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode
[ 21.973172] ahci 0000:00:1f.2: flags: 64bit ncq led clo pio slum part ems apst
[ 22.038362] random: fast init done
[ 22.044130] nvme7n1:
[ 22.049204] scsi host4: ahci
[ 22.049328] scsi host5: ahci
[ 22.049502] scsi host6: ahci
[ 22.049631] scsi host7: ahci
[ 22.049744] scsi host8: ahci
[ 22.049915] scsi host9: ahci
[ 22.049948] ata5: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04100 irq 70
[ 22.049950] ata6: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04180 irq 70
[ 22.049951] ata7: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04200 irq 70
[ 22.049953] ata8: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04280 irq 70
[ 22.049954] ata9: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04300 irq 70
[ 22.049956] ata10: SATA max UDMA/133 abar m2048@0x91a04000 port 0x91a04380 irq 70
[ 22.286287] ata4: SATA link down (SStatus 0 SControl 300)
[ 22.291519] ata2: SATA link down (SStatus 0 SControl 300)
[ 22.291615] ata1: SATA link down (SStatus 0 SControl 300)
[ 22.291711] ata3: SATA link down (SStatus 0 SControl 300)
[ 22.362255] ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[ 22.362619] ata5.00: ATA-8: INTEL SSDSA2BW300G3, 4PC10302, max UDMA/133
[ 22.362620] ata5.00: 586072368 sectors, multi 1: LBA48 NCQ (depth 31/32)
[ 22.363020] ata5.00: configured for UDMA/133
[ 22.363272] scsi 4:0:0:0: Direct-Access ATA INTEL SSDSA2BW30 0302 PQ: 0 ANSI: 5
[ 22.363373] ata10: SATA link down (SStatus 0 SControl 300)
[ 22.363713] ata8: SATA link down (SStatus 0 SControl 300)
[ 22.363975] ata7: SATA link down (SStatus 0 SControl 300)
[ 22.364050] ata6: SATA link down (SStatus 0 SControl 300)
[ 22.366213] ata9: SATA link down (SStatus 0 SControl 300)
[ 22.366345] usbcore: registered new interface driver usbhid
[ 22.366345] usbhid: USB HID core driver
[ 23.792650] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.0/0003:14DD:1007.0001/input/input1
[ 23.852686] hid-generic 0003:14DD:1007.0001: input,hidraw0: USB HID v1.10 Keyboard [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input0
[ 23.852777] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.1/0003:14DD:1007.0002/input/input2
[ 23.852835] hid-generic 0003:14DD:1007.0002: input,hidraw1: USB HID v1.10 Mouse [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input1
[ 23.853394] input: Raritan D2CIM-DVUSB as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.2/0003:14DD:1007.0003/input/input3
[ 23.853541] hid-generic 0003:14DD:1007.0003: input,hidraw2: USB HID v1.10 Mouse [Raritan D2CIM-DVUSB] on usb-0000:00:14.0-1/input2
[ 23.853640] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb3/3-9/3-9:1.0/0003:046B:FF10.0004/input/input4
[ 23.853681] hid-generic 0003:046B:FF10.0004: input,hidraw3: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:14.0-9/input0
[ 23.853760] input: American Megatrends Inc. Virtual Keyboard and Mouse as /devices/pci0000:00/0000:00:14.0/usb3/3-9/3-9:1.1/0003:046B:FF10.0005/input/input5
[ 23.853809] hid-generic 0003:046B:FF10.0005: input,hidraw4: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:14.0-9/input1
[ 24.698485] AVX2 version of gcm_enc/dec engaged.
[ 24.698486] AES CTR mode by8 optimization enabled
[ 26.484826] dca service started, version 1.12.1
[ 26.628893] ata5.00: Enabling discard_zeroes_data
[ 26.628939] sd 4:0:0:0: Attached scsi generic sg0 type 0
[ 26.775599] sd 4:0:0:0: [sda] 586072368 512-byte logical blocks: (300 GB/279 GiB)
[ 26.923967] sd 4:0:0:0: [sda] Write Protect is off
[ 26.998228] sd 4:0:0:0: [sda] Mode Sense: 00 3a 00 00
[ 26.998246] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[ 27.143730] ata5.00: Enabling discard_zeroes_data
[ 27.215876] sda: sda1 sda2 < sda5 >
[ 27.285652] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[ 27.285971] mlx5_core 0000:05:00.0: firmware version: 16.19.1000
[ 27.288695] ata5.00: Enabling discard_zeroes_data
[ 27.288729] sd 4:0:0:0: [sda] Attached SCSI disk
[ 27.562123] igb: Copyright (c) 2007-2014 Intel Corporation.
[ 27.711059] igb 0000:03:00.0: added PHC on eth0
[ 27.776187] igb 0000:03:00.0: Intel(R) Gigabit Ethernet Network Connection
[ 27.841345] igb 0000:03:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 00:1e:67:f1:25:08
[ 27.905888] igb 0000:03:00.0: eth0: PBA No: 100000-000
[ 27.968357] igb 0000:03:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[ 28.156329] igb 0000:03:00.3: added PHC on eth1
[ 28.216086] igb 0000:03:00.3: Intel(R) Gigabit Ethernet Network Connection
[ 28.275937] igb 0000:03:00.3: eth1: (PCIe:5.0Gb/s:Width x4) 00:1e:67:f1:25:09
[ 28.335005] igb 0000:03:00.3: eth1: PBA No: 100000-000
[ 28.391954] igb 0000:03:00.3: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s)
[ 28.503460] igb 0000:03:00.0 eno1: renamed from eth0
[ 28.572759] igb 0000:03:00.3 enp3s0f3: renamed from eth1
[ 28.700164] (0000:05:00.0): E-Switch: Total vports 1, l2 table size(65536), per vport: max uc(1024) max mc(16384)
[ 28.835525] mlx5_core 0000:05:00.0: Port module event: module 0, Cable plugged
[ 28.975482] mlx5_core 0000:05:00.1: firmware version: 16.19.1000
[ 29.746663] (0000:05:00.1): E-Switch: Total vports 1, l2 table size(65536), per vport: max uc(1024) max mc(16384)
[ 29.887890] mlx5_core 0000:05:00.1: Port module event: module 1, Cable plugged
[ 30.031732] mlx5_core 0000:05:00.0: MLX5E: StrdRq(1) RqSz(8) StrdSz(64) RxCqeCmprss(0)
[ 30.277776] mlx5_core 0000:05:00.1: MLX5E: StrdRq(1) RqSz(8) StrdSz(64) RxCqeCmprss(0)
[ 30.543013] mlx5_core 0000:05:00.1 ens785f1: renamed from eth1
[ 30.624784] mlx5_core 0000:05:00.0 ens785f0: renamed from eth0
[ 31.984704] raid6: sse2x1 gen() 9910 MB/s
[ 32.176708] raid6: sse2x1 xor() 8308 MB/s
[ 32.304708] raid6: sse2x2 gen() 13650 MB/s
[ 32.432705] raid6: sse2x2 xor() 9109 MB/s
[ 32.560707] raid6: sse2x4 gen() 15672 MB/s
[ 32.684711] raid6: sse2x4 xor() 11009 MB/s
[ 32.808711] raid6: avx2x1 gen() 20721 MB/s
[ 32.932721] raid6: avx2x1 xor() 15822 MB/s
[ 33.052723] raid6: avx2x2 gen() 24264 MB/s
[ 33.172714] raid6: avx2x2 xor() 16522 MB/s
[ 33.292714] raid6: avx2x4 gen() 27941 MB/s
[ 33.408716] raid6: avx2x4 xor() 17324 MB/s
[ 33.458367] raid6: using algorithm avx2x4 gen() 27941 MB/s
[ 33.508925] raid6: .... xor() 17324 MB/s, rmw enabled
[ 33.558551] raid6: using avx2x2 recovery algorithm
[ 33.607890] xor: automatically using best checksumming function avx
[ 33.657568] async_tx: api initialized (async)
[ 33.873269] Btrfs loaded, crc32c=crc32c-intel
[ 34.355644] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[ 34.719892] ip_tables: (C) 2000-2006 Netfilter Core Team
[ 34.802477] systemd[1]: systemd 231 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ -LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN)
[ 34.954553] systemd[1]: Detected architecture x86-64.
[ 35.170815] systemd[1]: Set hostname to <nvmfjt01>.
[ 35.314007] systemd[1]: Reached target Encrypted Volumes.
[ 35.427091] systemd[1]: Listening on Journal Socket.
[ 35.539761] systemd[1]: Listening on Journal Socket (/dev/log).
[ 35.655151] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[ 35.829843] systemd[1]: Reached target User and Group Name Lookups.
[ 35.951010] systemd[1]: Listening on udev Kernel Socket.
[ 36.072165] systemd[1]: Listening on Device-mapper event daemon FIFOs.
[ 36.457988] mlx5_ib: Mellanox Connect-IB Infiniband driver v2.2-1 (Feb 2014)
[ 38.160899] Loading iSCSI transport class v2.0-870.
[ 38.166902] iscsi: registered transport (tcp)
[ 38.169748] iscsi: registered transport (iser)
[ 38.538229] random: crng init done
[ 38.610223] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro
[ 39.389141] systemd-journald[833]: Received request to flush runtime journal from PID 1
[ 39.516723] ipmi message handler version 39.2
[ 39.524366] ipmi device interface
[ 39.527303] IPMI System Interface driver.
[ 39.527500] ipmi_si: probing via SMBIOS
[ 39.527501] ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0
[ 39.527502] ipmi_si: Adding SMBIOS-specified kcs state machine
[ 39.527504] ipmi_si: probing via SPMI
[ 39.527504] ipmi_si: SPMI: io 0xca2 regsize 1 spacing 1 irq 0
[ 39.527505] ipmi_si: SPMI-specified kcs state machine: duplicate
[ 39.527506] ipmi_si: Trying SMBIOS-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0
[ 39.557060] power_meter ACPI000D:00: Found ACPI power meter.
[ 39.557442] power_meter ACPI000D:00: Ignoring unsafe software power cap!
[ 39.557584] power_meter ACPI000D:00: hwmon_device_register() is deprecated. Please convert the driver to use hwmon_device_register_with_info().
[ 39.613426] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[ 39.614441] ioatdma: Intel(R) QuickData Technology Driver 4.00
[ 39.630607] igb 0000:03:00.0: DCA enabled
[ 39.631392] igb 0000:03:00.3: DCA enabled
[ 39.644508] mei_me 0000:00:16.0: Device doesn't have valid ME Interface
[ 39.775756] RAPL PMU: API unit is 2^-32 Joules, 4 fixed counters, 655360 ms ovfl timer
[ 39.775756] RAPL PMU: hw unit of domain pp0-core 2^-14 Joules
[ 39.775757] RAPL PMU: hw unit of domain package 2^-14 Joules
[ 39.775757] RAPL PMU: hw unit of domain dram 2^-14 Joules
[ 39.775757] RAPL PMU: hw unit of domain pp1-gpu 2^-14 Joules
[ 39.820094] kvm: disabled by bios
[ 39.869246] ipmi_si ipmi_si.0: Found new BMC (man_id: 0x000157, prod_id: 0x006f, dev_id: 0x21)
[ 39.869346] ipmi_si ipmi_si.0: IPMI kcs interface initialized
[ 39.871642] IPMI SSIF Interface driver
[ 40.240234] EDAC MC: Ver: 3.0.0
[ 40.244125] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[ 40.244133] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[ 40.244138] EDAC sbridge: Seeking for: PCI ID 8086:2fa0
[ 40.244144] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[ 40.244146] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[ 40.244150] EDAC sbridge: Seeking for: PCI ID 8086:2ffc
[ 40.244155] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[ 40.244157] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[ 40.244161] EDAC sbridge: Seeking for: PCI ID 8086:2ffd
[ 40.244166] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[ 40.244169] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[ 40.244173] EDAC sbridge: Seeking for: PCI ID 8086:2f60
[ 40.244177] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[ 40.244180] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[ 40.244184] EDAC sbridge: Seeking for: PCI ID 8086:2fa8
[ 40.244188] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[ 40.244191] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[ 40.244195] EDAC sbridge: Seeking for: PCI ID 8086:2f71
[ 40.244199] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[ 40.244202] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[ 40.244206] EDAC sbridge: Seeking for: PCI ID 8086:2faa
[ 40.244210] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[ 40.244213] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[ 40.244217] EDAC sbridge: Seeking for: PCI ID 8086:2fab
[ 40.244221] EDAC sbridge: Seeking for: PCI ID 8086:2fac
[ 40.244230] EDAC sbridge: Seeking for: PCI ID 8086:2fad
[ 40.244238] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[ 40.244241] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[ 40.244245] EDAC sbridge: Seeking for: PCI ID 8086:2fbd
[ 40.244249] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[ 40.244252] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[ 40.244256] EDAC sbridge: Seeking for: PCI ID 8086:2fbf
[ 40.244260] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[ 40.244263] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[ 40.244267] EDAC sbridge: Seeking for: PCI ID 8086:2fb9
[ 40.244271] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[ 40.244275] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[ 40.244278] EDAC sbridge: Seeking for: PCI ID 8086:2fbb
[ 40.244282] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[ 40.244285] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[ 40.244289] EDAC sbridge: Seeking for: PCI ID 8086:2f68
[ 40.244293] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[ 40.244296] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[ 40.244300] EDAC sbridge: Seeking for: PCI ID 8086:2f79
[ 40.244304] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[ 40.244308] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[ 40.244311] EDAC sbridge: Seeking for: PCI ID 8086:2f6a
[ 40.244315] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[ 40.244319] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[ 40.244322] EDAC sbridge: Seeking for: PCI ID 8086:2f6b
[ 40.244326] EDAC sbridge: Seeking for: PCI ID 8086:2f6c
[ 40.244334] EDAC sbridge: Seeking for: PCI ID 8086:2f6d
[ 40.244468] EDAC MC0: Giving out device to module sbridge_edac.c controller Haswell Socket#0: DEV 0000:ff:12.0 (INTERRUPT)
[ 40.244646] EDAC MC1: Giving out device to module sbridge_edac.c controller Haswell Socket#1: DEV 0000:7f:12.0 (INTERRUPT)
[ 40.244646] EDAC sbridge: Ver: 1.1.1
[ 40.247942] intel_rapl: Found RAPL domain package
[ 40.247945] intel_rapl: Found RAPL domain dram
[ 40.247946] intel_rapl: DRAM domain energy unit 15300pj
[ 40.248614] intel_rapl: Found RAPL domain package
[ 40.248617] intel_rapl: Found RAPL domain dram
[ 40.248619] intel_rapl: DRAM domain energy unit 15300pj
[ 40.494380] Adding 67008508k swap on /dev/sda5. Priority:-1 extents:1 across:67008508k SSFS
[ 40.976739] mlx5_core 0000:05:00.1 ens785f1: Link up
[ 41.263300] mlx5_core 0000:05:00.0 ens785f0: Link up
[ 41.400883] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready
[ 42.146503] new mount options do not match the existing superblock, will be ignored
[ 42.879366] systemd[1]: snapd.refresh.timer: Adding 3h 15min 24.154216s random time.
[ 42.879370] systemd[1]: snapd.refresh.timer: Adding 1h 16min 32.391377s random time.
[ 44.601208] igb 0000:03:00.0 eno1: igb: eno1 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
[ 44.601344] IPv6: ADDRCONF(NETDEV_CHANGE): eno1: link becomes ready
[ 51.169159] systemd[1]: snapd.refresh.timer: Adding 47.869037s random time.
[ 51.169168] systemd[1]: snapd.refresh.timer: Adding 35min 903.845ms random time.
[ 51.273073] systemd[1]: snapd.refresh.timer: Adding 2h 9min 48.658745s random time.
[ 51.273081] systemd[1]: snapd.refresh.timer: Adding 1h 37min 33.627602s random time.
[ 1158.865205] null: module loaded
[ 1175.479135] nvmet: adding nsid 1 to subsystem subsys0
[ 1175.479529] nvmet: adding nsid 1 to subsystem subsys1
[ 1175.479895] nvmet: adding nsid 1 to subsystem subsys2
[ 1175.480228] nvmet: adding nsid 1 to subsystem subsys3
[ 1175.480573] nvmet: adding nsid 1 to subsystem subsys4
[ 1175.480898] nvmet: adding nsid 1 to subsystem subsys5
[ 1175.481222] nvmet: adding nsid 1 to subsystem subsys6
[ 1175.481542] nvmet: adding nsid 1 to subsystem subsys7
[ 1175.481881] nvmet: adding nsid 1 to subsystem subsys8
[ 1175.482205] nvmet: adding nsid 1 to subsystem subsys9
[ 1175.482526] nvmet: adding nsid 1 to subsystem subsys10
[ 1175.482851] nvmet: adding nsid 1 to subsystem subsys11
[ 1175.483190] nvmet: adding nsid 1 to subsystem subsys12
[ 1175.483512] nvmet: adding nsid 1 to subsystem subsys13
[ 1175.483859] nvmet: adding nsid 1 to subsystem subsys14
[ 1175.484171] nvmet: adding nsid 1 to subsystem subsys15
[ 1175.485584] nvmet_rdma: enabling port 1 (10.10.0.1:4420)
[ 1175.486148] nvmet_rdma: enabling port 2 (10.11.0.1:4420)
[ 1207.413910] nvmet: creating controller 1 for subsystem subsys4 for NQN nvmfji01.
[ 1208.238677] nvmet: adding queue 1 to ctrl 1.
[ 1208.238968] nvmet: adding queue 2 to ctrl 1.
[ 1208.239257] nvmet: adding queue 3 to ctrl 1.
[ 1208.239425] nvmet: adding queue 4 to ctrl 1.
[ 1208.239751] nvmet: adding queue 5 to ctrl 1.
[ 1208.239964] nvmet: adding queue 6 to ctrl 1.
[ 1208.240149] nvmet: adding queue 7 to ctrl 1.
[ 1208.240586] nvmet: adding queue 8 to ctrl 1.
[ 1208.240900] nvmet: adding queue 9 to ctrl 1.
[ 1208.241206] nvmet: adding queue 10 to ctrl 1.
[ 1208.241670] nvmet: adding queue 11 to ctrl 1.
[ 1208.241819] nvmet: adding queue 12 to ctrl 1.
[ 1208.242139] nvmet: adding queue 13 to ctrl 1.
[ 1208.242396] nvmet: adding queue 14 to ctrl 1.
[ 1208.242577] nvmet: adding queue 15 to ctrl 1.
[ 1208.242725] nvmet: adding queue 16 to ctrl 1.
[ 1208.242903] nvmet: adding queue 17 to ctrl 1.
[ 1208.243139] nvmet: adding queue 18 to ctrl 1.
[ 1208.243322] nvmet: adding queue 19 to ctrl 1.
[ 1208.243517] nvmet: adding queue 20 to ctrl 1.
[ 1208.243715] nvmet: adding queue 21 to ctrl 1.
[ 1208.243914] nvmet: adding queue 22 to ctrl 1.
[ 1208.244078] nvmet: adding queue 23 to ctrl 1.
[ 1208.244233] nvmet: adding queue 24 to ctrl 1.
[ 1208.244401] nvmet: adding queue 25 to ctrl 1.
[ 1208.244594] nvmet: adding queue 26 to ctrl 1.
[ 1208.244796] nvmet: adding queue 27 to ctrl 1.
[ 1208.244988] nvmet: adding queue 28 to ctrl 1.
[ 1208.245186] nvmet: adding queue 29 to ctrl 1.
[ 1208.245384] nvmet: adding queue 30 to ctrl 1.
[ 1208.245575] nvmet: adding queue 31 to ctrl 1.
[ 1208.245773] nvmet: adding queue 32 to ctrl 1.
[ 1208.266063] nvmet: creating controller 2 for subsystem subsys5 for NQN nvmfji01.
[ 1209.074299] nvmet: adding queue 1 to ctrl 2.
[ 1209.074506] nvmet: adding queue 2 to ctrl 2.
[ 1209.074655] nvmet: adding queue 3 to ctrl 2.
[ 1209.074776] nvmet: adding queue 4 to ctrl 2.
[ 1209.074964] nvmet: adding queue 5 to ctrl 2.
[ 1209.075150] nvmet: adding queue 6 to ctrl 2.
[ 1209.075279] nvmet: adding queue 7 to ctrl 2.
[ 1209.075439] nvmet: adding queue 8 to ctrl 2.
[ 1209.075589] nvmet: adding queue 9 to ctrl 2.
[ 1209.075768] nvmet: adding queue 10 to ctrl 2.
[ 1209.075971] nvmet: adding queue 11 to ctrl 2.
[ 1209.076111] nvmet: adding queue 12 to ctrl 2.
[ 1209.076292] nvmet: adding queue 13 to ctrl 2.
[ 1209.076458] nvmet: adding queue 14 to ctrl 2.
[ 1209.076611] nvmet: adding queue 15 to ctrl 2.
[ 1209.076789] nvmet: adding queue 16 to ctrl 2.
[ 1209.076977] nvmet: adding queue 17 to ctrl 2.
[ 1209.077185] nvmet: adding queue 18 to ctrl 2.
[ 1209.077340] nvmet: adding queue 19 to ctrl 2.
[ 1209.077522] nvmet: adding queue 20 to ctrl 2.
[ 1209.077719] nvmet: adding queue 21 to ctrl 2.
[ 1209.077914] nvmet: adding queue 22 to ctrl 2.
[ 1209.078112] nvmet: adding queue 23 to ctrl 2.
[ 1209.078312] nvmet: adding queue 24 to ctrl 2.
[ 1209.078502] nvmet: adding queue 25 to ctrl 2.
[ 1209.078704] nvmet: adding queue 26 to ctrl 2.
[ 1209.078904] nvmet: adding queue 27 to ctrl 2.
[ 1209.079100] nvmet: adding queue 28 to ctrl 2.
[ 1209.079294] nvmet: adding queue 29 to ctrl 2.
[ 1209.079488] nvmet: adding queue 30 to ctrl 2.
[ 1209.079682] nvmet: adding queue 31 to ctrl 2.
[ 1209.079877] nvmet: adding queue 32 to ctrl 2.
[ 1209.100724] nvmet: creating controller 3 for subsystem subsys6 for NQN nvmfji01.
[ 1209.908620] nvmet: adding queue 1 to ctrl 3.
[ 1209.908758] nvmet: adding queue 2 to ctrl 3.
[ 1209.908959] nvmet: adding queue 3 to ctrl 3.
[ 1209.909148] nvmet: adding queue 4 to ctrl 3.
[ 1209.909324] nvmet: adding queue 5 to ctrl 3.
[ 1209.909504] nvmet: adding queue 6 to ctrl 3.
[ 1209.909654] nvmet: adding queue 7 to ctrl 3.
[ 1209.909833] nvmet: adding queue 8 to ctrl 3.
[ 1209.909964] nvmet: adding queue 9 to ctrl 3.
[ 1209.910107] nvmet: adding queue 10 to ctrl 3.
[ 1209.910268] nvmet: adding queue 11 to ctrl 3.
[ 1209.910458] nvmet: adding queue 12 to ctrl 3.
[ 1209.910563] nvmet: adding queue 13 to ctrl 3.
[ 1209.910740] nvmet: adding queue 14 to ctrl 3.
[ 1209.910928] nvmet: adding queue 15 to ctrl 3.
[ 1209.911105] nvmet: adding queue 16 to ctrl 3.
[ 1209.911293] nvmet: adding queue 17 to ctrl 3.
[ 1209.911510] nvmet: adding queue 18 to ctrl 3.
[ 1209.911710] nvmet: adding queue 19 to ctrl 3.
[ 1209.911915] nvmet: adding queue 20 to ctrl 3.
[ 1209.912093] nvmet: adding queue 21 to ctrl 3.
[ 1209.912280] nvmet: adding queue 22 to ctrl 3.
[ 1209.912453] nvmet: adding queue 23 to ctrl 3.
[ 1209.912629] nvmet: adding queue 24 to ctrl 3.
[ 1209.912800] nvmet: adding queue 25 to ctrl 3.
[ 1209.912942] nvmet: adding queue 26 to ctrl 3.
[ 1209.913117] nvmet: adding queue 27 to ctrl 3.
[ 1209.913293] nvmet: adding queue 28 to ctrl 3.
[ 1209.913528] nvmet: adding queue 29 to ctrl 3.
[ 1209.913710] nvmet: adding queue 30 to ctrl 3.
[ 1209.913888] nvmet: adding queue 31 to ctrl 3.
[ 1209.914059] nvmet: adding queue 32 to ctrl 3.
[ 1209.934359] nvmet: creating controller 4 for subsystem subsys7 for NQN nvmfji01.
[ 1210.742545] nvmet: adding queue 1 to ctrl 4.
[ 1210.742722] nvmet: adding queue 2 to ctrl 4.
[ 1210.742876] nvmet: adding queue 3 to ctrl 4.
[ 1210.743041] nvmet: adding queue 4 to ctrl 4.
[ 1210.743229] nvmet: adding queue 5 to ctrl 4.
[ 1210.743366] nvmet: adding queue 6 to ctrl 4.
[ 1210.743510] nvmet: adding queue 7 to ctrl 4.
[ 1210.743669] nvmet: adding queue 8 to ctrl 4.
[ 1210.743819] nvmet: adding queue 9 to ctrl 4.
[ 1210.743996] nvmet: adding queue 10 to ctrl 4.
[ 1210.744178] nvmet: adding queue 11 to ctrl 4.
[ 1210.744298] nvmet: adding queue 12 to ctrl 4.
[ 1210.744443] nvmet: adding queue 13 to ctrl 4.
[ 1210.744613] nvmet: adding queue 14 to ctrl 4.
[ 1210.744785] nvmet: adding queue 15 to ctrl 4.
[ 1210.744947] nvmet: adding queue 16 to ctrl 4.
[ 1210.745145] nvmet: adding queue 17 to ctrl 4.
[ 1210.745355] nvmet: adding queue 18 to ctrl 4.
[ 1210.745570] nvmet: adding queue 19 to ctrl 4.
[ 1210.745776] nvmet: adding queue 20 to ctrl 4.
[ 1210.745957] nvmet: adding queue 21 to ctrl 4.
[ 1210.746172] nvmet: adding queue 22 to ctrl 4.
[ 1210.746347] nvmet: adding queue 23 to ctrl 4.
[ 1210.746488] nvmet: adding queue 24 to ctrl 4.
[ 1210.746656] nvmet: adding queue 25 to ctrl 4.
[ 1210.746827] nvmet: adding queue 26 to ctrl 4.
[ 1210.746973] nvmet: adding queue 27 to ctrl 4.
[ 1210.747145] nvmet: adding queue 28 to ctrl 4.
[ 1210.747318] nvmet: adding queue 29 to ctrl 4.
[ 1210.747486] nvmet: adding queue 30 to ctrl 4.
[ 1210.747625] nvmet: adding queue 31 to ctrl 4.
[ 1210.747790] nvmet: adding queue 32 to ctrl 4.
[ 1213.245661] nvmet: creating controller 5 for subsystem subsys0 for NQN nvmfji01.
[ 1214.049684] nvmet: adding queue 1 to ctrl 5.
[ 1214.049935] nvmet: adding queue 2 to ctrl 5.
[ 1214.050092] nvmet: adding queue 3 to ctrl 5.
[ 1214.050273] nvmet: adding queue 4 to ctrl 5.
[ 1214.050553] nvmet: adding queue 5 to ctrl 5.
[ 1214.050694] nvmet: adding queue 6 to ctrl 5.
[ 1214.050843] nvmet: adding queue 7 to ctrl 5.
[ 1214.050944] nvmet: adding queue 8 to ctrl 5.
[ 1214.051084] nvmet: adding queue 9 to ctrl 5.
[ 1214.051314] nvmet: adding queue 10 to ctrl 5.
[ 1214.051567] nvmet: adding queue 11 to ctrl 5.
[ 1214.051801] nvmet: adding queue 12 to ctrl 5.
[ 1214.052028] nvmet: adding queue 13 to ctrl 5.
[ 1214.052248] nvmet: adding queue 14 to ctrl 5.
[ 1214.052479] nvmet: adding queue 15 to ctrl 5.
[ 1214.052614] nvmet: adding queue 16 to ctrl 5.
[ 1214.052769] nvmet: adding queue 17 to ctrl 5.
[ 1214.052903] nvmet: adding queue 18 to ctrl 5.
[ 1214.053014] nvmet: adding queue 19 to ctrl 5.
[ 1214.053182] nvmet: adding queue 20 to ctrl 5.
[ 1214.053345] nvmet: adding queue 21 to ctrl 5.
[ 1214.053512] nvmet: adding queue 22 to ctrl 5.
[ 1214.053672] nvmet: adding queue 23 to ctrl 5.
[ 1214.053842] nvmet: adding queue 24 to ctrl 5.
[ 1214.054007] nvmet: adding queue 25 to ctrl 5.
[ 1214.054170] nvmet: adding queue 26 to ctrl 5.
[ 1214.054350] nvmet: adding queue 27 to ctrl 5.
[ 1214.054523] nvmet: adding queue 28 to ctrl 5.
[ 1214.054700] nvmet: adding queue 29 to ctrl 5.
[ 1214.054877] nvmet: adding queue 30 to ctrl 5.
[ 1214.055056] nvmet: adding queue 31 to ctrl 5.
[ 1214.055229] nvmet: adding queue 32 to ctrl 5.
[ 1214.074704] nvmet: creating controller 6 for subsystem subsys1 for NQN nvmfji01.
[ 1214.887772] nvmet: adding queue 1 to ctrl 6.
[ 1214.887905] nvmet: adding queue 2 to ctrl 6.
[ 1214.888050] nvmet: adding queue 3 to ctrl 6.
[ 1214.888200] nvmet: adding queue 4 to ctrl 6.
[ 1214.888337] nvmet: adding queue 5 to ctrl 6.
[ 1214.888478] nvmet: adding queue 6 to ctrl 6.
[ 1214.888635] nvmet: adding queue 7 to ctrl 6.
[ 1214.888733] nvmet: adding queue 8 to ctrl 6.
[ 1214.888876] nvmet: adding queue 9 to ctrl 6.
[ 1214.888994] nvmet: adding queue 10 to ctrl 6.
[ 1214.889151] nvmet: adding queue 11 to ctrl 6.
[ 1214.889324] nvmet: adding queue 12 to ctrl 6.
[ 1214.889505] nvmet: adding queue 13 to ctrl 6.
[ 1214.889661] nvmet: adding queue 14 to ctrl 6.
[ 1214.889841] nvmet: adding queue 15 to ctrl 6.
[ 1214.890136] nvmet: adding queue 16 to ctrl 6.
[ 1214.890321] nvmet: adding queue 17 to ctrl 6.
[ 1214.890475] nvmet: adding queue 18 to ctrl 6.
[ 1214.890607] nvmet: adding queue 19 to ctrl 6.
[ 1214.890780] nvmet: adding queue 20 to ctrl 6.
[ 1214.890950] nvmet: adding queue 21 to ctrl 6.
[ 1214.891099] nvmet: adding queue 22 to ctrl 6.
[ 1214.891265] nvmet: adding queue 23 to ctrl 6.
[ 1214.891435] nvmet: adding queue 24 to ctrl 6.
[ 1214.891609] nvmet: adding queue 25 to ctrl 6.
[ 1214.891781] nvmet: adding queue 26 to ctrl 6.
[ 1214.891931] nvmet: adding queue 27 to ctrl 6.
[ 1214.892092] nvmet: adding queue 28 to ctrl 6.
[ 1214.892244] nvmet: adding queue 29 to ctrl 6.
[ 1214.892387] nvmet: adding queue 30 to ctrl 6.
[ 1214.892548] nvmet: adding queue 31 to ctrl 6.
[ 1214.892686] nvmet: adding queue 32 to ctrl 6.
[ 1214.912216] nvmet: creating controller 7 for subsystem subsys2 for NQN nvmfji01.
[ 1215.712369] nvmet: adding queue 1 to ctrl 7.
[ 1215.712513] nvmet: adding queue 2 to ctrl 7.
[ 1215.712649] nvmet: adding queue 3 to ctrl 7.
[ 1215.712822] nvmet: adding queue 4 to ctrl 7.
[ 1215.712997] nvmet: adding queue 5 to ctrl 7.
[ 1215.713137] nvmet: adding queue 6 to ctrl 7.
[ 1215.713294] nvmet: adding queue 7 to ctrl 7.
[ 1215.713465] nvmet: adding queue 8 to ctrl 7.
[ 1215.713630] nvmet: adding queue 9 to ctrl 7.
[ 1215.713806] nvmet: adding queue 10 to ctrl 7.
[ 1215.713944] nvmet: adding queue 11 to ctrl 7.
[ 1215.714124] nvmet: adding queue 12 to ctrl 7.
[ 1215.714282] nvmet: adding queue 13 to ctrl 7.
[ 1215.714387] nvmet: adding queue 14 to ctrl 7.
[ 1215.714550] nvmet: adding queue 15 to ctrl 7.
[ 1215.714655] nvmet: adding queue 16 to ctrl 7.
[ 1215.714803] nvmet: adding queue 17 to ctrl 7.
[ 1215.714994] nvmet: adding queue 18 to ctrl 7.
[ 1215.715193] nvmet: adding queue 19 to ctrl 7.
[ 1215.715347] nvmet: adding queue 20 to ctrl 7.
[ 1215.715499] nvmet: adding queue 21 to ctrl 7.
[ 1215.715619] nvmet: adding queue 22 to ctrl 7.
[ 1215.715787] nvmet: adding queue 23 to ctrl 7.
[ 1215.715951] nvmet: adding queue 24 to ctrl 7.
[ 1215.716088] nvmet: adding queue 25 to ctrl 7.
[ 1215.716253] nvmet: adding queue 26 to ctrl 7.
[ 1215.716423] nvmet: adding queue 27 to ctrl 7.
[ 1215.716590] nvmet: adding queue 28 to ctrl 7.
[ 1215.716754] nvmet: adding queue 29 to ctrl 7.
[ 1215.716916] nvmet: adding queue 30 to ctrl 7.
[ 1215.717080] nvmet: adding queue 31 to ctrl 7.
[ 1215.717249] nvmet: adding queue 32 to ctrl 7.
[ 1215.736281] nvmet: creating controller 8 for subsystem subsys3 for NQN nvmfji01.
[ 1216.544065] nvmet: adding queue 1 to ctrl 8.
[ 1216.544224] nvmet: adding queue 2 to ctrl 8.
[ 1216.544336] nvmet: adding queue 3 to ctrl 8.
[ 1216.544480] nvmet: adding queue 4 to ctrl 8.
[ 1216.544648] nvmet: adding queue 5 to ctrl 8.
[ 1216.544782] nvmet: adding queue 6 to ctrl 8.
[ 1216.544956] nvmet: adding queue 7 to ctrl 8.
[ 1216.545115] nvmet: adding queue 8 to ctrl 8.
[ 1216.545270] nvmet: adding queue 9 to ctrl 8.
[ 1216.545416] nvmet: adding queue 10 to ctrl 8.
[ 1216.545555] nvmet: adding queue 11 to ctrl 8.
[ 1216.545729] nvmet: adding queue 12 to ctrl 8.
[ 1216.545905] nvmet: adding queue 13 to ctrl 8.
[ 1216.546048] nvmet: adding queue 14 to ctrl 8.
[ 1216.546218] nvmet: adding queue 15 to ctrl 8.
[ 1216.546387] nvmet: adding queue 16 to ctrl 8.
[ 1216.546541] nvmet: adding queue 17 to ctrl 8.
[ 1216.546737] nvmet: adding queue 18 to ctrl 8.
[ 1216.546887] nvmet: adding queue 19 to ctrl 8.
[ 1216.547014] nvmet: adding queue 20 to ctrl 8.
[ 1216.547203] nvmet: adding queue 21 to ctrl 8.
[ 1216.547396] nvmet: adding queue 22 to ctrl 8.
[ 1216.547590] nvmet: adding queue 23 to ctrl 8.
[ 1216.547751] nvmet: adding queue 24 to ctrl 8.
[ 1216.547910] nvmet: adding queue 25 to ctrl 8.
[ 1216.548120] nvmet: adding queue 26 to ctrl 8.
[ 1216.548259] nvmet: adding queue 27 to ctrl 8.
[ 1216.548428] nvmet: adding queue 28 to ctrl 8.
[ 1216.548590] nvmet: adding queue 29 to ctrl 8.
[ 1216.548723] nvmet: adding queue 30 to ctrl 8.
[ 1216.548864] nvmet: adding queue 31 to ctrl 8.
[ 1216.549031] nvmet: adding queue 32 to ctrl 8.
[ 1234.267495] hrtimer: interrupt took 12543 ns
[ 8840.940034] perf: interrupt took too long (2502 > 2500), lowering kernel.perf_event_max_sample_rate to 79750
[24839.863343] mlx5_1:dump_cqe:262:(pid 3969): dump error cqe
[24839.863346] 00000000 00000000 00000000 00000000
[24839.863347] 00000000 00000000 00000000 00000000
[24839.863349] 00000000 00000000 00000000 00000000
[24839.863350] 00000000 00008813 0800013d 400dd9d3
[24839.863393] mlx5_1:dump_cqe:262:(pid 3903): dump error cqe
[24839.863395] 00000000 00000000 00000000 00000000
[24839.863396] 00000000 00000000 00000000 00000000
[24839.863397] 00000000 00000000 00000000 00000000
[24839.863399] 00000000 00008813 08000136 e1df0fd3
[24849.256701] nvmet_rdma: freeing queue 34
[24849.261141] nvmet_rdma: freeing queue 35
[24849.264507] nvmet_rdma: freeing queue 36
[24849.268433] nvmet_rdma: freeing queue 37
[24849.271827] nvmet_rdma: freeing queue 38
[24849.275333] nvmet_rdma: freeing queue 39
[24849.279337] nvmet_rdma: freeing queue 40
[24849.282773] nvmet_rdma: freeing queue 41
[24849.284331] nvmet_rdma: freeing queue 42
[24849.287944] nvmet_rdma: freeing queue 43
[24849.290733] nvmet_rdma: freeing queue 44
[24849.294273] nvmet_rdma: freeing queue 45
[24849.297542] nvmet_rdma: freeing queue 46
[24849.300385] nvmet_rdma: freeing queue 47
[24849.302824] nvmet_rdma: freeing queue 48
[24849.303890] nvmet_rdma: freeing queue 49
[24849.307374] nvmet_rdma: freeing queue 50
[24849.309752] nvmet_rdma: freeing queue 51
[24849.312956] nvmet_rdma: freeing queue 52
[24849.315457] nvmet_rdma: freeing queue 53
[24849.318283] nvmet_rdma: freeing queue 54
[24849.321396] nvmet_rdma: freeing queue 55
[24849.323945] nvmet_rdma: freeing queue 56
[24849.326397] nvmet_rdma: freeing queue 57
[24849.328980] nvmet_rdma: freeing queue 58
[24849.332137] nvmet_rdma: freeing queue 59
[24849.334608] nvmet_rdma: freeing queue 60
[24849.337133] nvmet_rdma: freeing queue 61
[24849.339976] nvmet_rdma: freeing queue 62
[24849.343142] nvmet_rdma: freeing queue 63
[24849.345755] nvmet_rdma: freeing queue 64
[24849.349069] nvmet_rdma: freeing queue 65
[24849.417847] nvmet_rdma: freeing queue 33
[24849.427370] nvmet: creating controller 9 for subsystem subsys5 for NQN nvmfji01.
[24849.528385] nvmet: adding queue 1 to ctrl 9.
[24849.528509] nvmet: adding queue 2 to ctrl 9.
[24849.528603] nvmet: adding queue 3 to ctrl 9.
[24849.528700] nvmet: adding queue 4 to ctrl 9.
[24849.528798] nvmet: adding queue 5 to ctrl 9.
[24849.528892] nvmet: adding queue 6 to ctrl 9.
[24849.529004] nvmet: adding queue 7 to ctrl 9.
[24849.529157] nvmet: adding queue 8 to ctrl 9.
[24849.529273] nvmet: adding queue 9 to ctrl 9.
[24849.529401] nvmet: adding queue 10 to ctrl 9.
[24849.529520] nvmet: adding queue 11 to ctrl 9.
[24849.529624] nvmet: adding queue 12 to ctrl 9.
[24849.529788] nvmet: adding queue 13 to ctrl 9.
[24849.529932] nvmet: adding queue 14 to ctrl 9.
[24849.530096] nvmet: adding queue 15 to ctrl 9.
[24849.530276] nvmet: adding queue 16 to ctrl 9.
[24849.530409] nvmet: adding queue 17 to ctrl 9.
[24849.530523] nvmet: adding queue 18 to ctrl 9.
[24849.530719] nvmet: adding queue 19 to ctrl 9.
[24849.530815] nvmet: adding queue 20 to ctrl 9.
[24849.531003] nvmet: adding queue 21 to ctrl 9.
[24849.531197] nvmet: adding queue 22 to ctrl 9.
[24849.531321] nvmet: adding queue 23 to ctrl 9.
[24849.531498] nvmet: adding queue 24 to ctrl 9.
[24849.531633] nvmet: adding queue 25 to ctrl 9.
[24849.531797] nvmet: adding queue 26 to ctrl 9.
[24849.531929] nvmet: adding queue 27 to ctrl 9.
[24849.532088] nvmet: adding queue 28 to ctrl 9.
[24849.532266] nvmet: adding queue 29 to ctrl 9.
[24849.532436] nvmet: adding queue 30 to ctrl 9.
[24849.532609] nvmet: adding queue 31 to ctrl 9.
[24849.532776] nvmet: adding queue 32 to ctrl 9.
[25999.518049] mlx5_1:dump_cqe:262:(pid 3903): dump error cqe
[25999.518052] 00000000 00000000 00000000 00000000
[25999.518053] 00000000 00000000 00000000 00000000
[25999.518055] 00000000 00000000 00000000 00000000
[25999.518056] 00000000 00008813 080001ba bcbb28d2
[25999.519341] mlx5_1:dump_cqe:262:(pid 3969): dump error cqe
[25999.519343] 00000000 00000000 00000000 00000000
[25999.519343] 00000000 00000000 00000000 00000000
[25999.519344] 00000000 00000000 00000000 00000000
[25999.519344] 00000000 00008813 080001c1 053b83d2
[26006.907630] nvmet_rdma: freeing queue 35
[26006.911355] nvmet_rdma: freeing queue 36
[26006.914790] nvmet_rdma: freeing queue 37
[26006.918163] nvmet_rdma: freeing queue 38
[26006.921554] nvmet_rdma: freeing queue 33
[26006.924601] nvmet_rdma: freeing queue 39
[26006.928041] nvmet_rdma: freeing queue 40
[26006.931029] nvmet_rdma: freeing queue 41
[26006.932624] nvmet_rdma: freeing queue 42
[26006.936571] nvmet_rdma: freeing queue 43
[26006.939631] nvmet_rdma: freeing queue 44
[26006.942711] nvmet_rdma: freeing queue 45
[26006.946048] nvmet_rdma: freeing queue 46
[26006.948927] nvmet_rdma: freeing queue 47
[26006.951784] nvmet_rdma: freeing queue 48
[26006.953010] nvmet_rdma: freeing queue 49
[26006.956427] nvmet_rdma: freeing queue 50
[26006.959678] nvmet_rdma: freeing queue 51
[26006.962165] nvmet_rdma: freeing queue 52
[26006.965387] nvmet_rdma: freeing queue 53
[26006.968204] nvmet_rdma: freeing queue 54
[26006.971155] nvmet_rdma: freeing queue 55
[26006.973426] nvmet_rdma: freeing queue 56
[26006.975974] nvmet_rdma: freeing queue 57
[26006.978817] nvmet_rdma: freeing queue 58
[26006.981678] nvmet_rdma: freeing queue 59
[26006.984138] nvmet_rdma: freeing queue 60
[26006.986659] nvmet_rdma: freeing queue 61
[26006.989502] nvmet_rdma: freeing queue 62
[26006.992355] nvmet_rdma: freeing queue 63
[26006.995257] nvmet_rdma: freeing queue 64
[26006.997691] nvmet_rdma: freeing queue 65
[26007.075634] nvmet_rdma: freeing queue 34
[26007.081095] nvmet: creating controller 2 for subsystem subsys5 for NQN nvmfji01.
[26007.185674] nvmet: adding queue 1 to ctrl 2.
[26007.185834] nvmet: adding queue 2 to ctrl 2.
[26007.185912] nvmet: adding queue 3 to ctrl 2.
[26007.186015] nvmet: adding queue 4 to ctrl 2.
[26007.186109] nvmet: adding queue 5 to ctrl 2.
[26007.186190] nvmet: adding queue 6 to ctrl 2.
[26007.186322] nvmet: adding queue 7 to ctrl 2.
[26007.186449] nvmet: adding queue 8 to ctrl 2.
[26007.186560] nvmet: adding queue 9 to ctrl 2.
[26007.186702] nvmet: adding queue 10 to ctrl 2.
[26007.186868] nvmet: adding queue 11 to ctrl 2.
[26007.186946] nvmet: adding queue 12 to ctrl 2.
[26007.187062] nvmet: adding queue 13 to ctrl 2.
[26007.187201] nvmet: adding queue 14 to ctrl 2.
[26007.187362] nvmet: adding queue 15 to ctrl 2.
[26007.187484] nvmet: adding queue 16 to ctrl 2.
[26007.187604] nvmet: adding queue 17 to ctrl 2.
[26007.187787] nvmet: adding queue 18 to ctrl 2.
[26007.187928] nvmet: adding queue 19 to ctrl 2.
[26007.188134] nvmet: adding queue 20 to ctrl 2.
[26007.188232] nvmet: adding queue 21 to ctrl 2.
[26007.188374] nvmet: adding queue 22 to ctrl 2.
[26007.188501] nvmet: adding queue 23 to ctrl 2.
[26007.188682] nvmet: adding queue 24 to ctrl 2.
[26007.188849] nvmet: adding queue 25 to ctrl 2.
[26007.189022] nvmet: adding queue 26 to ctrl 2.
[26007.189134] nvmet: adding queue 27 to ctrl 2.
[26007.189259] nvmet: adding queue 28 to ctrl 2.
[26007.189396] nvmet: adding queue 29 to ctrl 2.
[26007.189540] nvmet: adding queue 30 to ctrl 2.
[26007.189699] nvmet: adding queue 31 to ctrl 2.
[26007.189831] nvmet: adding queue 32 to ctrl 2.
[27834.866155] mlx5_1:dump_cqe:262:(pid 3831): dump error cqe
[27834.866158] 00000000 00000000 00000000 00000000
[27834.866159] 00000000 00000000 00000000 00000000
[27834.866160] 00000000 00000000 00000000 00000000
[27834.866162] 00000000 00008813 0800018a b4ced7d3
[27836.791143] nvmet_rdma: freeing queue 166
[27836.796080] nvmet_rdma: freeing queue 167
[27836.799033] nvmet_rdma: freeing queue 168
[27836.802064] nvmet_rdma: freeing queue 169
[27836.805327] nvmet_rdma: freeing queue 170
[27836.808489] nvmet_rdma: freeing queue 171
[27836.812276] nvmet_rdma: freeing queue 172
[27836.815429] nvmet_rdma: freeing queue 173
[27836.818542] nvmet_rdma: freeing queue 174
[27836.821361] nvmet_rdma: freeing queue 175
[27836.824686] nvmet_rdma: freeing queue 176
[27836.827913] nvmet_rdma: freeing queue 177
[27836.831113] nvmet_rdma: freeing queue 178
[27836.834302] nvmet_rdma: freeing queue 179
[27836.837766] nvmet_rdma: freeing queue 180
[27836.840679] nvmet_rdma: freeing queue 181
[27836.843449] nvmet_rdma: freeing queue 182
[27836.846527] nvmet_rdma: freeing queue 183
[27836.849383] nvmet_rdma: freeing queue 184
[27836.852253] nvmet_rdma: freeing queue 185
[27836.855798] nvmet_rdma: freeing queue 186
[27836.859355] nvmet_rdma: freeing queue 187
[27836.862956] nvmet_rdma: freeing queue 188
[27836.866184] nvmet_rdma: freeing queue 189
[27836.869721] nvmet_rdma: freeing queue 190
[27836.872180] nvmet_rdma: freeing queue 191
[27836.875470] nvmet_rdma: freeing queue 192
[27836.879261] nvmet_rdma: freeing queue 193
[27836.882187] nvmet_rdma: freeing queue 194
[27836.884356] nvmet_rdma: freeing queue 195
[27836.887198] nvmet_rdma: freeing queue 196
[27836.889981] nvmet_rdma: freeing queue 197
[27836.938474] nvmet_rdma: freeing queue 165
[27836.945626] nvmet: creating controller 9 for subsystem subsys1 for NQN nvmfji01.
[27837.044189] nvmet: adding queue 1 to ctrl 9.
[27837.044293] nvmet: adding queue 2 to ctrl 9.
[27837.044406] nvmet: adding queue 3 to ctrl 9.
[27837.044525] nvmet: adding queue 4 to ctrl 9.
[27837.044680] nvmet: adding queue 5 to ctrl 9.
[27837.044788] nvmet: adding queue 6 to ctrl 9.
[27837.044914] nvmet: adding queue 7 to ctrl 9.
[27837.044952] nvmet: adding queue 8 to ctrl 9.
[27837.045030] nvmet: adding queue 9 to ctrl 9.
[27837.045115] nvmet: adding queue 10 to ctrl 9.
[27837.045169] nvmet: adding queue 11 to ctrl 9.
[27837.045233] nvmet: adding queue 12 to ctrl 9.
[27837.045313] nvmet: adding queue 13 to ctrl 9.
[27837.045363] nvmet: adding queue 14 to ctrl 9.
[27837.045464] nvmet: adding queue 15 to ctrl 9.
[27837.045603] nvmet: adding queue 16 to ctrl 9.
[27837.045644] nvmet: adding queue 17 to ctrl 9.
[27837.045716] nvmet: adding queue 18 to ctrl 9.
[27837.045786] nvmet: adding queue 19 to ctrl 9.
[27837.045901] nvmet: adding queue 20 to ctrl 9.
[27837.045973] nvmet: adding queue 21 to ctrl 9.
[27837.046099] nvmet: adding queue 22 to ctrl 9.
[27837.046248] nvmet: adding queue 23 to ctrl 9.
[27837.046392] nvmet: adding queue 24 to ctrl 9.
[27837.046481] nvmet: adding queue 25 to ctrl 9.
[27837.046593] nvmet: adding queue 26 to ctrl 9.
[27837.046715] nvmet: adding queue 27 to ctrl 9.
[27837.046856] nvmet: adding queue 28 to ctrl 9.
[27837.046930] nvmet: adding queue 29 to ctrl 9.
[27837.047050] nvmet: adding queue 30 to ctrl 9.
[27837.047115] nvmet: adding queue 31 to ctrl 9.
[27837.047217] nvmet: adding queue 32 to ctrl 9.
[28396.147037] mlx5_1:dump_cqe:262:(pid 3965): dump error cqe
[28396.147041] 00000000 00000000 00000000 00000000
[28396.147042] 00000000 00000000 00000000 00000000
[28396.147044] 00000000 00000000 00000000 00000000
[28396.147045] 00000000 00008813 080001e5 54e164d2
[28403.096654] nvmet: ctrl 2 keep-alive timer (15 seconds) expired!
[28403.143167] nvmet: ctrl 2 fatal error occurred!
[28403.189201] nvmet_rdma: freeing queue 35
[28403.189882] nvmet_rdma: freeing queue 33
[28403.189892] nvmet_rdma: freeing queue 36
[28403.190544] nvmet_rdma: freeing queue 37
[28403.190627] nvmet_rdma: freeing queue 38
[28403.191257] nvmet_rdma: freeing queue 39
[28403.191498] nvmet_rdma: freeing queue 40
[28403.191956] nvmet_rdma: freeing queue 41
[28403.192543] nvmet_rdma: freeing queue 34
[28403.192553] nvmet_rdma: freeing queue 42
[28403.193391] nvmet_rdma: freeing queue 43
[28403.193703] nvmet_rdma: freeing queue 44
[28403.194284] nvmet_rdma: freeing queue 45
[28403.194479] nvmet_rdma: freeing queue 46
[28403.195199] nvmet_rdma: freeing queue 48
[28403.195330] nvmet_rdma: freeing queue 47
[28403.196206] nvmet_rdma: freeing queue 49
[28403.196461] nvmet_rdma: freeing queue 50
[28403.196536] nvmet_rdma: freeing queue 52
[28403.196865] nvmet_rdma: freeing queue 51
[28403.197640] nvmet_rdma: freeing queue 54
[28403.197647] nvmet_rdma: freeing queue 53
[28403.198759] nvmet_rdma: freeing queue 55
[28403.198873] nvmet_rdma: freeing queue 56
[28403.199699] nvmet_rdma: freeing queue 57
[28403.199979] nvmet_rdma: freeing queue 58
[28403.200499] nvmet_rdma: freeing queue 59
[28403.200818] nvmet_rdma: freeing queue 60
[28403.201317] nvmet_rdma: freeing queue 61
[28403.201586] nvmet_rdma: freeing queue 62
[28403.202158] nvmet_rdma: freeing queue 63
[28403.202401] nvmet_rdma: freeing queue 64
[28403.202826] nvmet_rdma: freeing queue 65
[28403.262707] nvmet: creating controller 2 for subsystem subsys5 for NQN nvmfji01.
[28403.381952] nvmet: adding queue 1 to ctrl 2.
[28403.382097] nvmet: adding queue 2 to ctrl 2.
[28403.382210] nvmet: adding queue 3 to ctrl 2.
[28403.382342] nvmet: adding queue 4 to ctrl 2.
[28403.382450] nvmet: adding queue 5 to ctrl 2.
[28403.382566] nvmet: adding queue 6 to ctrl 2.
[28403.382672] nvmet: adding queue 7 to ctrl 2.
[28403.382857] nvmet: adding queue 8 to ctrl 2.
[28403.382984] nvmet: adding queue 9 to ctrl 2.
[28403.383145] nvmet: adding queue 10 to ctrl 2.
[28403.383315] nvmet: adding queue 11 to ctrl 2.
[28403.383443] nvmet: adding queue 12 to ctrl 2.
[28403.383567] nvmet: adding queue 13 to ctrl 2.
[28403.383716] nvmet: adding queue 14 to ctrl 2.
[28403.383894] nvmet: adding queue 15 to ctrl 2.
[28403.384055] nvmet: adding queue 16 to ctrl 2.
[28403.384200] nvmet: adding queue 17 to ctrl 2.
[28403.384312] nvmet: adding queue 18 to ctrl 2.
[28403.384395] nvmet: adding queue 19 to ctrl 2.
[28403.384553] nvmet: adding queue 20 to ctrl 2.
[28403.384723] nvmet: adding queue 21 to ctrl 2.
[28403.384892] nvmet: adding queue 22 to ctrl 2.
[28403.385054] nvmet: adding queue 23 to ctrl 2.
[28403.385205] nvmet: adding queue 24 to ctrl 2.
[28403.385378] nvmet: adding queue 25 to ctrl 2.
[28403.385545] nvmet: adding queue 26 to ctrl 2.
[28403.385668] nvmet: adding queue 27 to ctrl 2.
[28403.385816] nvmet: adding queue 28 to ctrl 2.
[28403.385990] nvmet: adding queue 29 to ctrl 2.
[28403.386122] nvmet: adding queue 30 to ctrl 2.
[28403.386291] nvmet: adding queue 31 to ctrl 2.
[28403.386455] nvmet: adding queue 32 to ctrl 2.
[28484.044641] mlx5_1:dump_cqe:262:(pid 3969): dump error cqe
[28484.044644] 00000000 00000000 00000000 00000000
[28484.044645] 00000000 00000000 00000000 00000000
[28484.044646] 00000000 00000000 00000000 00000000
[28484.044648] 00000000 00008813 080001fd 00a9add2
[28484.192282] mlx5_1:dump_cqe:262:(pid 3835): dump error cqe
[28484.192285] 00000000 00000000 00000000 00000000
[28484.192286] 00000000 00000000 00000000 00000000
[28484.192287] 00000000 00000000 00000000 00000000
[28484.192289] 00000000 00008813 080001f5 017bd4d2
[28488.343844] mlx5_1:dump_cqe:262:(pid 3835): dump error cqe
[28488.343846] 00000000 00000000 00000000 00000000
[28488.343847] 00000000 00000000 00000000 00000000
[28488.343849] 00000000 00000000 00000000 00000000
[28488.343851] 00000000 00008813 080001fb 00c7c9d2
[28488.344753] mlx5_1:dump_cqe:262:(pid 3973): dump error cqe
[28488.344755] 00000000 00000000 00000000 00000000
[28488.344756] 00000000 00000000 00000000 00000000
[28488.344758] 00000000 00000000 00000000 00000000
[28488.344760] 00000000 00008813 080001fa 00a9a8d2
[28490.882016] nvmet_rdma: freeing queue 167
[28490.884616] nvmet_rdma: freeing queue 168
[28490.889351] nvmet_rdma: freeing queue 169
[28490.893144] nvmet_rdma: freeing queue 170
[28490.896771] nvmet_rdma: freeing queue 171
[28490.900297] nvmet_rdma: freeing queue 165
[28490.902738] nvmet_rdma: freeing queue 172
[28490.904460] nvmet_rdma: freeing queue 173
[28490.908240] nvmet_rdma: freeing queue 174
[28490.909689] nvmet_rdma: freeing queue 175
[28490.913247] nvmet_rdma: freeing queue 176
[28490.916100] nvmet_rdma: freeing queue 177
[28490.919274] nvmet_rdma: freeing queue 178
[28490.922765] nvmet_rdma: freeing queue 179
[28490.925862] nvmet_rdma: freeing queue 180
[28490.928706] nvmet_rdma: freeing queue 181
[28490.931477] nvmet_rdma: freeing queue 182
[28490.933658] nvmet_rdma: freeing queue 183
[28490.936153] nvmet_rdma: freeing queue 184
[28490.939074] nvmet_rdma: freeing queue 185
[28490.941212] nvmet_rdma: freeing queue 186
[28490.944062] nvmet_rdma: freeing queue 187
[28490.946556] nvmet_rdma: freeing queue 188
[28490.949390] nvmet_rdma: freeing queue 189
[28490.951870] nvmet_rdma: freeing queue 190
[28490.954348] nvmet_rdma: freeing queue 191
[28490.957171] nvmet_rdma: freeing queue 192
[28490.959683] nvmet_rdma: freeing queue 193
[28490.962100] nvmet_rdma: freeing queue 194
[28490.964936] nvmet_rdma: freeing queue 195
[28490.967740] nvmet_rdma: freeing queue 196
[28490.969907] nvmet_rdma: freeing queue 197
[28491.045975] nvmet_rdma: freeing queue 166
[28491.051066] nvmet: creating controller 6 for subsystem subsys1 for NQN nvmfji01.
[28491.146875] nvmet: adding queue 1 to ctrl 6.
[28491.146939] nvmet: adding queue 2 to ctrl 6.
[28491.147046] nvmet: adding queue 3 to ctrl 6.
[28491.147130] nvmet: adding queue 4 to ctrl 6.
[28491.147272] nvmet: adding queue 5 to ctrl 6.
[28491.147383] nvmet: adding queue 6 to ctrl 6.
[28491.147516] nvmet: adding queue 7 to ctrl 6.
[28491.147603] nvmet: adding queue 8 to ctrl 6.
[28491.147675] nvmet: adding queue 9 to ctrl 6.
[28491.147752] nvmet: adding queue 10 to ctrl 6.
[28491.147854] nvmet: adding queue 11 to ctrl 6.
[28491.147952] nvmet: adding queue 12 to ctrl 6.
[28491.148077] nvmet: adding queue 13 to ctrl 6.
[28491.148163] nvmet: adding queue 14 to ctrl 6.
[28491.148275] nvmet: adding queue 15 to ctrl 6.
[28491.148413] nvmet: adding queue 16 to ctrl 6.
[28491.148531] nvmet: adding queue 17 to ctrl 6.
[28491.148662] nvmet: adding queue 18 to ctrl 6.
[28491.148736] nvmet: adding queue 19 to ctrl 6.
[28491.148853] nvmet: adding queue 20 to ctrl 6.
[28491.148929] nvmet: adding queue 21 to ctrl 6.
[28491.149040] nvmet: adding queue 22 to ctrl 6.
[28491.149183] nvmet: adding queue 23 to ctrl 6.
[28491.149332] nvmet: adding queue 24 to ctrl 6.
[28491.149464] nvmet: adding queue 25 to ctrl 6.
[28491.149564] nvmet: adding queue 26 to ctrl 6.
[28491.149709] nvmet: adding queue 27 to ctrl 6.
[28491.149794] nvmet: adding queue 28 to ctrl 6.
[28491.149869] nvmet: adding queue 29 to ctrl 6.
[28491.149975] nvmet: adding queue 30 to ctrl 6.
[28491.150056] nvmet: adding queue 31 to ctrl 6.
[28491.150191] nvmet: adding queue 32 to ctrl 6.
[29719.015211] mlx5_1:dump_cqe:262:(pid 3835): dump error cqe
[29719.015214] 00000000 00000000 00000000 00000000
[29719.015215] 00000000 00000000 00000000 00000000
[29719.015216] 00000000 00000000 00000000 00000000
[29719.015218] 00000000 00008813 08000240 0109abd2
[29719.016447] mlx5_1:dump_cqe:262:(pid 3835): dump error cqe
[29719.016449] 00000000 00000000 00000000 00000000
[29719.016450] 00000000 00000000 00000000 00000000
[29719.016452] 00000000 00000000 00000000 00000000
[29719.016453] 00000000 00008813 0800023d 0193e2d2
[29719.016835] mlx5_1:dump_cqe:262:(pid 3912): dump error cqe
[29719.016837] 00000000 00000000 00000000 00000000
[29719.016838] 00000000 00000000 00000000 00000000
[29719.016839] 00000000 00000000 00000000 00000000
[29719.016839] 00000000 00008813 0800023c 014bb0d2
[29719.017478] mlx5_1:dump_cqe:262:(pid 3835): dump error cqe
[29719.017479] 00000000 00000000 00000000 00000000
[29719.017481] 00000000 00000000 00000000 00000000
[29719.017483] 00000000 00000000 00000000 00000000
[29719.017484] 00000000 00008813 08000237 075dafd3
[29719.017884] mlx5_1:dump_cqe:262:(pid 3978): dump error cqe
[29719.017886] 00000000 00000000 00000000 00000000
[29719.017887] 00000000 00000000 00000000 00000000
[29719.017889] 00000000 00000000 00000000 00000000
[29719.017890] 00000000 00008813 080001af f3f995d3
[29723.312945] mlx5_1:dump_cqe:262:(pid 3835): dump error cqe
[29723.312948] 00000000 00000000 00000000 00000000
[29723.312949] 00000000 00000000 00000000 00000000
[29723.312950] 00000000 00000000 00000000 00000000
[29723.312952] 00000000 00008813 0800015e 83e59bd2
[29726.615746] nvmet_rdma: freeing queue 232
[29726.620340] nvmet_rdma: freeing queue 233
[29726.624874] nvmet_rdma: freeing queue 234
[29726.629873] nvmet_rdma: freeing queue 235
[29726.634261] nvmet_rdma: freeing queue 236
[29726.638441] nvmet_rdma: freeing queue 237
[29726.642669] nvmet_rdma: freeing queue 238
[29726.647299] nvmet_rdma: freeing queue 239
[29726.651863] nvmet_rdma: freeing queue 240
[29726.655754] nvmet_rdma: freeing queue 241
[29726.659695] nvmet_rdma: freeing queue 242
[29726.663608] nvmet_rdma: freeing queue 243
[29726.668203] nvmet_rdma: freeing queue 244
[29726.672743] nvmet_rdma: freeing queue 245
[29726.676356] nvmet_rdma: freeing queue 246
[29726.681039] nvmet_rdma: freeing queue 247
[29726.685881] nvmet_rdma: freeing queue 248
[29726.690436] nvmet_rdma: freeing queue 249
[29726.694888] nvmet_rdma: freeing queue 250
[29726.699184] nvmet_rdma: freeing queue 251
[29726.703791] nvmet_rdma: freeing queue 252
[29726.708119] nvmet_rdma: freeing queue 253
[29726.711623] nvmet_rdma: freeing queue 254
[29726.716177] nvmet_rdma: freeing queue 255
[29726.721142] nvmet_rdma: freeing queue 256
[29726.725505] nvmet_rdma: freeing queue 257
[29726.729758] nvmet_rdma: freeing queue 258
[29726.733954] nvmet_rdma: freeing queue 259
[29726.738137] nvmet_rdma: freeing queue 260
[29726.742805] nvmet_rdma: freeing queue 261
[29726.745192] nvmet_rdma: freeing queue 262
[29726.749527] nvmet_rdma: freeing queue 263
[29726.851106] nvmet_rdma: freeing queue 231
[29726.858222] nvmet: creating controller 9 for subsystem subsys3 for NQN nvmfji01.
[29726.870700] nvmet_rdma: freeing queue 167
[29726.873128] nvmet_rdma: freeing queue 168
[29726.877529] nvmet_rdma: freeing queue 169
[29726.882026] nvmet_rdma: freeing queue 170
[29726.885343] nvmet: ctrl 4 keep-alive timer (15 seconds) expired!
[29726.932864] nvmet_rdma: freeing queue 166
[29726.932881] nvmet: ctrl 4 fatal error occurred!
[29726.981161] nvmet_rdma: freeing queue 99
[29726.982091] nvmet_rdma: freeing queue 100
[29726.982777] nvmet_rdma: freeing queue 171
[29726.982813] nvmet_rdma: freeing queue 172
[29726.982875] nvmet_rdma: freeing queue 173
[29726.982884] nvmet_rdma: freeing queue 101
[29726.983596] nvmet_rdma: freeing queue 174
[29726.983604] nvmet_rdma: freeing queue 102
[29726.984390] nvmet_rdma: freeing queue 103
[29726.984398] nvmet_rdma: freeing queue 175
[29726.984434] nvmet_rdma: freeing queue 176
[29726.985165] nvmet_rdma: freeing queue 104
[29726.985636] nvmet_rdma: freeing queue 177
[29726.986175] nvmet_rdma: freeing queue 105
[29726.986387] nvmet_rdma: freeing queue 178
[29726.987150] nvmet_rdma: freeing queue 106
[29726.987223] nvmet_rdma: freeing queue 179
[29726.988070] nvmet_rdma: freeing queue 107
[29726.988257] nvmet_rdma: freeing queue 180
[29726.988866] nvmet_rdma: freeing queue 108
[29726.989120] nvmet_rdma: freeing queue 181
[29726.989680] nvmet_rdma: freeing queue 109
[29726.989979] nvmet_rdma: freeing queue 182
[29726.990485] nvmet_rdma: freeing queue 110
[29726.990795] nvmet_rdma: freeing queue 183
[29726.991286] nvmet_rdma: freeing queue 111
[29726.991598] nvmet_rdma: freeing queue 184
[29726.992129] nvmet_rdma: freeing queue 112
[29726.992397] nvmet_rdma: freeing queue 185
[29726.992958] nvmet_rdma: freeing queue 113
[29726.993187] nvmet_rdma: freeing queue 186
[29726.993694] nvmet_rdma: freeing queue 114
[29726.993783] nvmet_rdma: freeing queue 115
[29726.993987] nvmet_rdma: freeing queue 187
[29726.994492] nvmet_rdma: freeing queue 116
[29726.994796] nvmet_rdma: freeing queue 188
[29726.995189] nvmet_rdma: freeing queue 117
[29726.995627] nvmet_rdma: freeing queue 189
[29726.996101] nvmet_rdma: freeing queue 118
[29726.996394] nvmet_rdma: freeing queue 190
[29726.996967] nvmet_rdma: freeing queue 119
[29726.997211] nvmet_rdma: freeing queue 191
[29726.997722] nvmet_rdma: freeing queue 120
[29726.998035] nvmet_rdma: freeing queue 192
[29726.998587] nvmet_rdma: freeing queue 121
[29726.998818] nvmet_rdma: freeing queue 193
[29726.999329] nvmet_rdma: freeing queue 122
[29726.999637] nvmet_rdma: freeing queue 194
[29727.000162] nvmet_rdma: freeing queue 123
[29727.000457] nvmet_rdma: freeing queue 195
[29727.000976] nvmet_rdma: freeing queue 124
[29727.001252] nvmet_rdma: freeing queue 196
[29727.001766] nvmet_rdma: freeing queue 125
[29727.002045] nvmet_rdma: freeing queue 197
[29727.002598] nvmet_rdma: freeing queue 126
[29727.002873] nvmet_rdma: freeing queue 127
[29727.003294] nvmet_rdma: freeing queue 128
[29727.004027] nvmet_rdma: freeing queue 129
[29727.004868] nvmet_rdma: freeing queue 130
[29727.005683] nvmet_rdma: freeing queue 131
[29727.045000] nvmet_rdma: freeing queue 165
[29727.050654] nvmet: creating controller 4 for subsystem subsys1 for NQN nvmfji01.
[29727.072968] nvmet: creating controller 8 for subsystem subsys7 for NQN nvmfji01.
[29727.088303] nvmet: adding queue 1 to ctrl 9.
[29727.088502] nvmet: adding queue 2 to ctrl 9.
[29727.088660] nvmet: adding queue 3 to ctrl 9.
[29727.088802] nvmet: adding queue 4 to ctrl 9.
[29727.088925] nvmet: adding queue 5 to ctrl 9.
[29727.089006] nvmet: adding queue 6 to ctrl 9.
[29727.089135] nvmet: adding queue 7 to ctrl 9.
[29727.089214] nvmet: adding queue 8 to ctrl 9.
[29727.089252] nvmet: adding queue 9 to ctrl 9.
[29727.089324] nvmet: adding queue 10 to ctrl 9.
[29727.089370] nvmet: adding queue 11 to ctrl 9.
[29727.089466] nvmet: adding queue 12 to ctrl 9.
[29727.089575] nvmet: adding queue 13 to ctrl 9.
[29727.089759] nvmet: adding queue 14 to ctrl 9.
[29727.089858] nvmet: adding queue 15 to ctrl 9.
[29727.089964] nvmet: adding queue 16 to ctrl 9.
[29727.090113] nvmet: adding queue 17 to ctrl 9.
[29727.090223] nvmet: adding queue 18 to ctrl 9.
[29727.090350] nvmet: adding queue 19 to ctrl 9.
[29727.090429] nvmet: adding queue 20 to ctrl 9.
[29727.090549] nvmet: adding queue 21 to ctrl 9.
[29727.090655] nvmet: adding queue 22 to ctrl 9.
[29727.090809] nvmet: adding queue 23 to ctrl 9.
[29727.090960] nvmet: adding queue 24 to ctrl 9.
[29727.091080] nvmet: adding queue 25 to ctrl 9.
[29727.091202] nvmet: adding queue 26 to ctrl 9.
[29727.091358] nvmet: adding queue 27 to ctrl 9.
[29727.091445] nvmet: adding queue 28 to ctrl 9.
[29727.091553] nvmet: adding queue 29 to ctrl 9.
[29727.091720] nvmet: adding queue 30 to ctrl 9.
[29727.091764] nvmet: adding queue 31 to ctrl 9.
[29727.091835] nvmet: adding queue 32 to ctrl 9.
[29727.157375] nvmet: adding queue 1 to ctrl 4.
[29727.157419] nvmet: adding queue 2 to ctrl 4.
[29727.157532] nvmet: adding queue 3 to ctrl 4.
[29727.157611] nvmet: adding queue 4 to ctrl 4.
[29727.157730] nvmet: adding queue 5 to ctrl 4.
[29727.157837] nvmet: adding queue 6 to ctrl 4.
[29727.157945] nvmet: adding queue 7 to ctrl 4.
[29727.158015] nvmet: adding queue 8 to ctrl 4.
[29727.158061] nvmet: adding queue 9 to ctrl 4.
[29727.158122] nvmet: adding queue 10 to ctrl 4.
[29727.158155] nvmet: adding queue 11 to ctrl 4.
[29727.158227] nvmet: adding queue 12 to ctrl 4.
[29727.158307] nvmet: adding queue 13 to ctrl 4.
[29727.158414] nvmet: adding queue 14 to ctrl 4.
[29727.158494] nvmet: adding queue 15 to ctrl 4.
[29727.158619] nvmet: adding queue 16 to ctrl 4.
[29727.158771] nvmet: adding queue 17 to ctrl 4.
[29727.158892] nvmet: adding queue 18 to ctrl 4.
[29727.159022] nvmet: adding queue 19 to ctrl 4.
[29727.159147] nvmet: adding queue 20 to ctrl 4.
[29727.159270] nvmet: adding queue 21 to ctrl 4.
[29727.159352] nvmet: adding queue 22 to ctrl 4.
[29727.159506] nvmet: adding queue 23 to ctrl 4.
[29727.159626] nvmet: adding queue 24 to ctrl 4.
[29727.159773] nvmet: adding queue 25 to ctrl 4.
[29727.159879] nvmet: adding queue 26 to ctrl 4.
[29727.160018] nvmet: adding queue 27 to ctrl 4.
[29727.160124] nvmet: adding queue 28 to ctrl 4.
[29727.160274] nvmet: adding queue 29 to ctrl 4.
[29727.160384] nvmet: adding queue 30 to ctrl 4.
[29727.160489] nvmet: adding queue 31 to ctrl 4.
[29727.160640] nvmet: adding queue 32 to ctrl 4.
[29727.177372] nvmet: adding queue 1 to ctrl 8.
[29727.177469] nvmet: adding queue 2 to ctrl 8.
[29727.177542] nvmet: adding queue 3 to ctrl 8.
[29727.177582] nvmet: adding queue 4 to ctrl 8.
[29727.177716] nvmet: adding queue 5 to ctrl 8.
[29727.177820] nvmet: adding queue 6 to ctrl 8.
[29727.177920] nvmet: adding queue 7 to ctrl 8.
[29727.178073] nvmet: adding queue 8 to ctrl 8.
[29727.178171] nvmet: adding queue 9 to ctrl 8.
[29727.178249] nvmet: adding queue 10 to ctrl 8.
[29727.178359] nvmet: adding queue 11 to ctrl 8.
[29727.178474] nvmet: adding queue 12 to ctrl 8.
[29727.178588] nvmet: adding queue 13 to ctrl 8.
[29727.178674] nvmet: adding queue 14 to ctrl 8.
[29727.178781] nvmet: adding queue 15 to ctrl 8.
[29727.178920] nvmet: adding queue 16 to ctrl 8.
[29727.179091] nvmet: adding queue 17 to ctrl 8.
[29727.179266] nvmet: adding queue 18 to ctrl 8.
[29727.179392] nvmet: adding queue 19 to ctrl 8.
[29727.179523] nvmet: adding queue 20 to ctrl 8.
[29727.179670] nvmet: adding queue 21 to ctrl 8.
[29727.179801] nvmet: adding queue 22 to ctrl 8.
[29727.179962] nvmet: adding queue 23 to ctrl 8.
[29727.180134] nvmet: adding queue 24 to ctrl 8.
[29727.180219] nvmet: adding queue 25 to ctrl 8.
[29727.180382] nvmet: adding queue 26 to ctrl 8.
[29727.180509] nvmet: adding queue 27 to ctrl 8.
[29727.180638] nvmet: adding queue 28 to ctrl 8.
[29727.180798] nvmet: adding queue 29 to ctrl 8.
[29727.180922] nvmet: adding queue 30 to ctrl 8.
[29727.181092] nvmet: adding queue 31 to ctrl 8.
[29727.181217] nvmet: adding queue 32 to ctrl 8.
[30386.892497] mlx5_1:dump_cqe:262:(pid 3912): dump error cqe
[30386.892499] 00000000 00000000 00000000 00000000
[30386.892501] 00000000 00000000 00000000 00000000
[30386.892502] 00000000 00000000 00000000 00000000
[30386.892503] 00000000 00008813 08000227 b86599d3
[30393.796058] nvmet_rdma: freeing queue 34
[30393.799505] nvmet_rdma: freeing queue 35
[30393.803156] nvmet_rdma: freeing queue 36
[30393.806136] nvmet_rdma: freeing queue 37
[30393.809609] nvmet_rdma: freeing queue 38
[30393.812472] nvmet_rdma: freeing queue 39
[30393.815756] nvmet_rdma: freeing queue 40
[30393.818813] nvmet_rdma: freeing queue 41
[30393.822090] nvmet_rdma: freeing queue 42
[30393.825333] nvmet_rdma: freeing queue 43
[30393.828498] nvmet_rdma: freeing queue 44
[30393.831639] nvmet_rdma: freeing queue 45
[30393.834842] nvmet_rdma: freeing queue 46
[30393.838035] nvmet_rdma: freeing queue 47
[30393.841286] nvmet_rdma: freeing queue 48
[30393.844468] nvmet_rdma: freeing queue 49
[30393.847642] nvmet_rdma: freeing queue 50
[30393.850132] nvmet_rdma: freeing queue 51
[30393.851550] nvmet_rdma: freeing queue 52
[30393.855364] nvmet_rdma: freeing queue 53
[30393.857493] nvmet_rdma: freeing queue 54
[30393.860731] nvmet_rdma: freeing queue 55
[30393.863879] nvmet_rdma: freeing queue 56
[30393.867059] nvmet_rdma: freeing queue 57
[30393.870432] nvmet_rdma: freeing queue 58
[30393.873148] nvmet_rdma: freeing queue 59
[30393.876367] nvmet_rdma: freeing queue 60
[30393.878838] nvmet_rdma: freeing queue 61
[30393.882067] nvmet_rdma: freeing queue 62
[30393.885039] nvmet_rdma: freeing queue 63
[30393.888305] nvmet_rdma: freeing queue 64
[30393.891429] nvmet_rdma: freeing queue 65
[30393.966321] nvmet_rdma: freeing queue 33
[30393.971535] nvmet: creating controller 6 for subsystem subsys5 for NQN nvmfji01.
[30394.078959] nvmet: adding queue 1 to ctrl 6.
[30394.079154] nvmet: adding queue 2 to ctrl 6.
[30394.079243] nvmet: adding queue 3 to ctrl 6.
[30394.079289] nvmet: adding queue 4 to ctrl 6.
[30394.079427] nvmet: adding queue 5 to ctrl 6.
[30394.079528] nvmet: adding queue 6 to ctrl 6.
[30394.079666] nvmet: adding queue 7 to ctrl 6.
[30394.079802] nvmet: adding queue 8 to ctrl 6.
[30394.079923] nvmet: adding queue 9 to ctrl 6.
[30394.080039] nvmet: adding queue 10 to ctrl 6.
[30394.080184] nvmet: adding queue 11 to ctrl 6.
[30394.080298] nvmet: adding queue 12 to ctrl 6.
[30394.080421] nvmet: adding queue 13 to ctrl 6.
[30394.080534] nvmet: adding queue 14 to ctrl 6.
[30394.080655] nvmet: adding queue 15 to ctrl 6.
[30394.080776] nvmet: adding queue 16 to ctrl 6.
[30394.080933] nvmet: adding queue 17 to ctrl 6.
[30394.081103] nvmet: adding queue 18 to ctrl 6.
[30394.081231] nvmet: adding queue 19 to ctrl 6.
[30394.081334] nvmet: adding queue 20 to ctrl 6.
[30394.081521] nvmet: adding queue 21 to ctrl 6.
[30394.081666] nvmet: adding queue 22 to ctrl 6.
[30394.081811] nvmet: adding queue 23 to ctrl 6.
[30394.081985] nvmet: adding queue 24 to ctrl 6.
[30394.082129] nvmet: adding queue 25 to ctrl 6.
[30394.082252] nvmet: adding queue 26 to ctrl 6.
[30394.082376] nvmet: adding queue 27 to ctrl 6.
[30394.082499] nvmet: adding queue 28 to ctrl 6.
[30394.082666] nvmet: adding queue 29 to ctrl 6.
[30394.082792] nvmet: adding queue 30 to ctrl 6.
[30394.082911] nvmet: adding queue 31 to ctrl 6.
[30394.083052] nvmet: adding queue 32 to ctrl 6.
^ permalink raw reply [flat|nested] 26+ messages in thread
* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-20 16:23 ` Gruher, Joseph R
0 siblings, 0 replies; 26+ messages in thread
From: Gruher, Joseph R @ 2017-04-20 16:23 UTC (permalink / raw)
> you should set also the irqmode=2 (timer) and run local fio with
> iodepth=1 and numjobs=1 to verify the latency (worked for me).
> Let's try to repro again with the new configuration, to be sure that this is not a
> transport issue.
Adding irqmode=2 definitely corrected the latency behavior. Now for 1 job with QD=1 on 4K random reads I get average latency 74usec and writes are 67usec. I set the null_blk devices to 50000nsec so adding in some latency for NVMf this seems reasonable.
I believe I was able to reproduce an instance of the problem using the null_blk devices as the backend. We configured 16 null_blk devices an attached four to initiator 1 and four to initiator 2. Initiators are each using both ports of a dual-ported 25Gb CX4 and target is using both ports of a dual-ported 100Gb CX5 (dual ports are on separate subnets). Then we ran a variety of workloads overnight. The dmesg logs are attached. We see "dump error cqe" at various points in the target dmesg and we see IO errors and reconnects on both initiators.
Thanks,
Joe
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: init1.txt
URL: <http://lists.infradead.org/pipermail/linux-nvme/attachments/20170420/6e4e0538/attachment-0003.txt>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: init2.txt
URL: <http://lists.infradead.org/pipermail/linux-nvme/attachments/20170420/6e4e0538/attachment-0004.txt>
-------------- next part --------------
An embedded and charset-unspecified text was scrubbed...
Name: target.txt
URL: <http://lists.infradead.org/pipermail/linux-nvme/attachments/20170420/6e4e0538/attachment-0005.txt>
^ permalink raw reply [flat|nested] 26+ messages in thread
* RE: cqe dump errors on target while running nvme-of large block read IO
2017-04-20 13:23 ` Sagi Grimberg
@ 2017-04-20 17:30 ` Gruher, Joseph R
-1 siblings, 0 replies; 26+ messages in thread
From: Gruher, Joseph R @ 2017-04-20 17:30 UTC (permalink / raw)
To: Sagi Grimberg, Max Gurtovoy,
'linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r@public.gmane.org',
'linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org'
Cc: Sen, Sujoy, Riches Jr, Robert M
> These errors are either from:
> 1. mapping error on the host side - not sure given we don't see any error
> completions/events from the rdma device. However, can you turn on dynamic
> debug to see QP events?
>
> echo "func nvme_rdma_qp_event +p" >
> /sys/kernel/debug/dynamic_debug/control
Yes, I can try this out. Will this just print to dmesg or do I need to collect a log from somewhere?
> The fact that null_blk didn't reproduce this was probably because it is less
> bursty (which can cause network congestion).
See email I just now sent in reply to Max (this same thread). I believe we reproduced the same issue with null_blk last night after correctly configuring some latency into the null_blk devices.
> Joseph, are you sure that flow control is correctly configured and working
> reliably?
I believe it is set up correctly. Running ethtool against the NIC interfaces in use reports:
Supported pause frame use: Symmetric Receive-only
And all ports in use on the Arista 7060X switch report it turned on in both directions:
flowcontrol send on
flowcontrol receive on
If there's anywhere else we can check, or any direct test of flow control we can run, happy to try it. Should we be OK with only Rx flow control at the NIC (this seems to be the default behavior) or is it recommended to set up Tx flow control as well?
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 26+ messages in thread
* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-20 17:30 ` Gruher, Joseph R
0 siblings, 0 replies; 26+ messages in thread
From: Gruher, Joseph R @ 2017-04-20 17:30 UTC (permalink / raw)
> These errors are either from:
> 1. mapping error on the host side - not sure given we don't see any error
> completions/events from the rdma device. However, can you turn on dynamic
> debug to see QP events?
>
> echo "func nvme_rdma_qp_event +p" >
> /sys/kernel/debug/dynamic_debug/control
Yes, I can try this out. Will this just print to dmesg or do I need to collect a log from somewhere?
> The fact that null_blk didn't reproduce this was probably because it is less
> bursty (which can cause network congestion).
See email I just now sent in reply to Max (this same thread). I believe we reproduced the same issue with null_blk last night after correctly configuring some latency into the null_blk devices.
> Joseph, are you sure that flow control is correctly configured and working
> reliably?
I believe it is set up correctly. Running ethtool against the NIC interfaces in use reports:
Supported pause frame use: Symmetric Receive-only
And all ports in use on the Arista 7060X switch report it turned on in both directions:
flowcontrol send on
flowcontrol receive on
If there's anywhere else we can check, or any direct test of flow control we can run, happy to try it. Should we be OK with only Rx flow control at the NIC (this seems to be the default behavior) or is it recommended to set up Tx flow control as well?
^ permalink raw reply [flat|nested] 26+ messages in thread
* RE: cqe dump errors on target while running nvme-of large block read IO
2017-04-20 13:23 ` Sagi Grimberg
@ 2017-04-26 17:17 ` Gruher, Joseph R
-1 siblings, 0 replies; 26+ messages in thread
From: Gruher, Joseph R @ 2017-04-26 17:17 UTC (permalink / raw)
To: Sagi Grimberg, Max Gurtovoy,
'linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r@public.gmane.org',
'linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org'
> Joseph, are you sure that flow control is correctly configured and working
> reliably?
Folks, I have to apologize here. Flow control was at one point configured correctly, but we had a power outage in our lab two weeks ago. We thought the switch had come back up OK, but late week we were double-checking all the ports in use and we found one port had lost some settings and no longer had flow control enabled (it had also reverted from 100Gb to 50Gb for some reason). After fixing the port settings we ran IO through the weekend and the early part of this week on a variety of workloads. We don't seem to be able to reproduce the failure after fixing the port settings. It looks like this one may have been caused by the lost flow control setting on the switch. Sorry for the confusion!
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 26+ messages in thread
* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-26 17:17 ` Gruher, Joseph R
0 siblings, 0 replies; 26+ messages in thread
From: Gruher, Joseph R @ 2017-04-26 17:17 UTC (permalink / raw)
> Joseph, are you sure that flow control is correctly configured and working
> reliably?
Folks, I have to apologize here. Flow control was at one point configured correctly, but we had a power outage in our lab two weeks ago. We thought the switch had come back up OK, but late week we were double-checking all the ports in use and we found one port had lost some settings and no longer had flow control enabled (it had also reverted from 100Gb to 50Gb for some reason). After fixing the port settings we ran IO through the weekend and the early part of this week on a variety of workloads. We don't seem to be able to reproduce the failure after fixing the port settings. It looks like this one may have been caused by the lost flow control setting on the switch. Sorry for the confusion!
^ permalink raw reply [flat|nested] 26+ messages in thread
* Re: cqe dump errors on target while running nvme-of large block read IO
2017-04-26 17:17 ` Gruher, Joseph R
@ 2017-04-26 18:56 ` Sagi Grimberg
-1 siblings, 0 replies; 26+ messages in thread
From: Sagi Grimberg @ 2017-04-26 18:56 UTC (permalink / raw)
To: Gruher, Joseph R, Max Gurtovoy,
'linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r@public.gmane.org',
'linux-rdma-u79uwXL29TY76Z2rM5mHXA@public.gmane.org'
> Folks, I have to apologize here. Flow control was at one point configured correctly, but we had a power outage in our lab two weeks ago.
> We thought the switch had come back up OK, but late week we were double-checking all the ports in use and we found one port had lost some
> settings and no longer had flow control enabled (it had also reverted from 100Gb to 50Gb for some reason). After fixing the port settings
> we ran IO through the weekend and the early part of this week on a variety of workloads. We don't seem to be able to reproduce the failure
> after fixing the port settings. It looks like this one may have been caused by the lost flow control setting on the switch. Sorry for the confusion!
Yep, don't expect RoCE to work without flow-control.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 26+ messages in thread
* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-26 18:56 ` Sagi Grimberg
0 siblings, 0 replies; 26+ messages in thread
From: Sagi Grimberg @ 2017-04-26 18:56 UTC (permalink / raw)
> Folks, I have to apologize here. Flow control was at one point configured correctly, but we had a power outage in our lab two weeks ago.
> We thought the switch had come back up OK, but late week we were double-checking all the ports in use and we found one port had lost some
> settings and no longer had flow control enabled (it had also reverted from 100Gb to 50Gb for some reason). After fixing the port settings
> we ran IO through the weekend and the early part of this week on a variety of workloads. We don't seem to be able to reproduce the failure
> after fixing the port settings. It looks like this one may have been caused by the lost flow control setting on the switch. Sorry for the confusion!
Yep, don't expect RoCE to work without flow-control.
^ permalink raw reply [flat|nested] 26+ messages in thread
* Re: cqe dump errors on target while running nvme-of large block read IO
2017-04-26 18:56 ` Sagi Grimberg
@ 2017-04-27 4:29 ` Majd Dibbiny
-1 siblings, 0 replies; 26+ messages in thread
From: Majd Dibbiny @ 2017-04-27 4:29 UTC (permalink / raw)
To: Sagi Grimberg
Cc: Gruher, Joseph R, Max Gurtovoy,
linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r,
linux-rdma-u79uwXL29TY76Z2rM5mHXA
> On Apr 27, 2017, at 2:57 AM, Sagi Grimberg <sagi-NQWnxTmZq1alnMjI0IkVqw@public.gmane.org> wrote:
>
>
>> Folks, I have to apologize here. Flow control was at one point configured correctly, but we had a power outage in our lab two weeks ago.
>> We thought the switch had come back up OK, but late week we were double-checking all the ports in use and we found one port had lost some
>> settings and no longer had flow control enabled (it had also reverted from 100Gb to 50Gb for some reason). After fixing the port settings
>> we ran IO through the weekend and the early part of this week on a variety of workloads. We don't seem to be able to reproduce the failure
>> after fixing the port settings. It looks like this one may have been caused by the lost flow control setting on the switch. Sorry for the confusion!
>
> Yep, don't expect RoCE to work without flow-control.
Sagi and all,
Starting in next release, for ConnectX-4 and above PFC isn't required as long as ECN is enabled.
With current release we also expect to get good results with ECN and no PFC.
Joseph - is ECN enabled on your system?
Thanks
> --
> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
> the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 26+ messages in thread
* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-27 4:29 ` Majd Dibbiny
0 siblings, 0 replies; 26+ messages in thread
From: Majd Dibbiny @ 2017-04-27 4:29 UTC (permalink / raw)
> On Apr 27, 2017,@2:57 AM, Sagi Grimberg <sagi@grimberg.me> wrote:
>
>
>> Folks, I have to apologize here. Flow control was at one point configured correctly, but we had a power outage in our lab two weeks ago.
>> We thought the switch had come back up OK, but late week we were double-checking all the ports in use and we found one port had lost some
>> settings and no longer had flow control enabled (it had also reverted from 100Gb to 50Gb for some reason). After fixing the port settings
>> we ran IO through the weekend and the early part of this week on a variety of workloads. We don't seem to be able to reproduce the failure
>> after fixing the port settings. It looks like this one may have been caused by the lost flow control setting on the switch. Sorry for the confusion!
>
> Yep, don't expect RoCE to work without flow-control.
Sagi and all,
Starting in next release, for ConnectX-4 and above PFC isn't required as long as ECN is enabled.
With current release we also expect to get good results with ECN and no PFC.
Joseph - is ECN enabled on your system?
Thanks
> --
> To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
> the body of a message to majordomo at vger.kernel.org
> More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 26+ messages in thread
* Re: cqe dump errors on target while running nvme-of large block read IO
2017-04-27 4:29 ` Majd Dibbiny
@ 2017-04-27 6:39 ` Christoph Hellwig
-1 siblings, 0 replies; 26+ messages in thread
From: Christoph Hellwig @ 2017-04-27 6:39 UTC (permalink / raw)
To: Majd Dibbiny
Cc: Sagi Grimberg, Gruher, Joseph R, Max Gurtovoy,
linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r,
linux-rdma-u79uwXL29TY76Z2rM5mHXA
On Thu, Apr 27, 2017 at 04:29:27AM +0000, Majd Dibbiny wrote:
> Starting in next release, for ConnectX-4 and above PFC isn't required as long as ECN is enabled.
What does "release" mean in this context? Firmware version?
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 26+ messages in thread
* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-27 6:39 ` Christoph Hellwig
0 siblings, 0 replies; 26+ messages in thread
From: Christoph Hellwig @ 2017-04-27 6:39 UTC (permalink / raw)
On Thu, Apr 27, 2017@04:29:27AM +0000, Majd Dibbiny wrote:
> Starting in next release, for ConnectX-4 and above PFC isn't required as long as ECN is enabled.
What does "release" mean in this context? Firmware version?
^ permalink raw reply [flat|nested] 26+ messages in thread
* Re: cqe dump errors on target while running nvme-of large block read IO
2017-04-27 6:39 ` Christoph Hellwig
@ 2017-04-27 6:40 ` Majd Dibbiny
-1 siblings, 0 replies; 26+ messages in thread
From: Majd Dibbiny @ 2017-04-27 6:40 UTC (permalink / raw)
To: Christoph Hellwig
Cc: Sagi Grimberg, Gruher, Joseph R, Max Gurtovoy,
linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r,
linux-rdma-u79uwXL29TY76Z2rM5mHXA
> On Apr 27, 2017, at 2:39 PM, Christoph Hellwig <hch-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org> wrote:
>
>> On Thu, Apr 27, 2017 at 04:29:27AM +0000, Majd Dibbiny wrote:
>> Starting in next release, for ConnectX-4 and above PFC isn't required as long as ECN is enabled.
>
> What does "release" mean in this context? Firmware version?
Yes, next Firmware release.--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 26+ messages in thread
* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-27 6:40 ` Majd Dibbiny
0 siblings, 0 replies; 26+ messages in thread
From: Majd Dibbiny @ 2017-04-27 6:40 UTC (permalink / raw)
> On Apr 27, 2017,@2:39 PM, Christoph Hellwig <hch@infradead.org> wrote:
>
>> On Thu, Apr 27, 2017@04:29:27AM +0000, Majd Dibbiny wrote:
>> Starting in next release, for ConnectX-4 and above PFC isn't required as long as ECN is enabled.
>
> What does "release" mean in this context? Firmware version?
Yes, next Firmware release.
^ permalink raw reply [flat|nested] 26+ messages in thread
* RE: cqe dump errors on target while running nvme-of large block read IO
2017-04-27 4:29 ` Majd Dibbiny
@ 2017-04-27 15:59 ` Gruher, Joseph R
-1 siblings, 0 replies; 26+ messages in thread
From: Gruher, Joseph R @ 2017-04-27 15:59 UTC (permalink / raw)
To: Majd Dibbiny, Sagi Grimberg
Cc: Max Gurtovoy, linux-nvme-IAPFreCvJWM7uuMidbF8XUB+6BGkLq7r,
linux-rdma-u79uwXL29TY76Z2rM5mHXA
> Starting in next release, for ConnectX-4 and above PFC isn't required as long as
> ECN is enabled.
>
> With current release we also expect to get good results with ECN and no PFC.
>
> Joseph - is ECN enabled on your system?
No, we haven't done anything to set up ECN, so I assume it is not enabled.
--
To unsubscribe from this list: send the line "unsubscribe linux-rdma" in
the body of a message to majordomo-u79uwXL29TY76Z2rM5mHXA@public.gmane.org
More majordomo info at http://vger.kernel.org/majordomo-info.html
^ permalink raw reply [flat|nested] 26+ messages in thread
* cqe dump errors on target while running nvme-of large block read IO
@ 2017-04-27 15:59 ` Gruher, Joseph R
0 siblings, 0 replies; 26+ messages in thread
From: Gruher, Joseph R @ 2017-04-27 15:59 UTC (permalink / raw)
> Starting in next release, for ConnectX-4 and above PFC isn't required as long as
> ECN is enabled.
>
> With current release we also expect to get good results with ECN and no PFC.
>
> Joseph - is ECN enabled on your system?
No, we haven't done anything to set up ECN, so I assume it is not enabled.
^ permalink raw reply [flat|nested] 26+ messages in thread
end of thread, other threads:[~2017-04-27 15:59 UTC | newest]
Thread overview: 26+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2017-04-12 16:41 cqe dump errors on target while running nvme-of large block read IO Gruher, Joseph R
2017-04-12 16:41 ` Gruher, Joseph R
[not found] ` <DE927C68B458BE418D582EC97927A9285505C9EA-8oqHQFITsIFQxe9IK+vIArfspsVTdybXVpNB7YpNyf8@public.gmane.org>
2017-04-13 11:29 ` Max Gurtovoy
2017-04-13 11:29 ` Max Gurtovoy
[not found] ` <47f19583-1882-09d4-ce1c-534b8e59068b-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2017-04-14 16:38 ` Gruher, Joseph R
2017-04-14 16:38 ` Gruher, Joseph R
[not found] ` <DE927C68B458BE418D582EC97927A9285505F0C9-8oqHQFITsIFQxe9IK+vIArfspsVTdybXVpNB7YpNyf8@public.gmane.org>
2017-04-18 12:17 ` Max Gurtovoy
2017-04-18 12:17 ` Max Gurtovoy
[not found] ` <52c550c1-849b-7ea5-ab34-56543cb9069d-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2017-04-20 13:23 ` Sagi Grimberg
2017-04-20 13:23 ` Sagi Grimberg
[not found] ` <991b26ec-69d3-9e1c-ed3e-0d6e6618e73a-NQWnxTmZq1alnMjI0IkVqw@public.gmane.org>
2017-04-20 17:30 ` Gruher, Joseph R
2017-04-20 17:30 ` Gruher, Joseph R
2017-04-26 17:17 ` Gruher, Joseph R
2017-04-26 17:17 ` Gruher, Joseph R
[not found] ` <DE927C68B458BE418D582EC97927A92855072ECF-8oqHQFITsIFQxe9IK+vIArfspsVTdybXVpNB7YpNyf8@public.gmane.org>
2017-04-26 18:56 ` Sagi Grimberg
2017-04-26 18:56 ` Sagi Grimberg
[not found] ` <8521776c-9557-04f1-9c7c-8389e083052b-NQWnxTmZq1alnMjI0IkVqw@public.gmane.org>
2017-04-27 4:29 ` Majd Dibbiny
2017-04-27 4:29 ` Majd Dibbiny
[not found] ` <209CAF47-1CE4-4A22-9E11-6377CEF62495-VPRAkNaXOzVWk0Htik3J/w@public.gmane.org>
2017-04-27 6:39 ` Christoph Hellwig
2017-04-27 6:39 ` Christoph Hellwig
[not found] ` <20170427063917.GA28074-wEGCiKHe2LqWVfeAwA7xHQ@public.gmane.org>
2017-04-27 6:40 ` Majd Dibbiny
2017-04-27 6:40 ` Majd Dibbiny
2017-04-27 15:59 ` Gruher, Joseph R
2017-04-27 15:59 ` Gruher, Joseph R
2017-04-20 16:23 ` Gruher, Joseph R
2017-04-20 16:23 ` Gruher, Joseph R
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.