All of lore.kernel.org
 help / color / mirror / Atom feed
* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.17
@ 2018-06-05  8:12 Marco Berizzi
  2018-07-05 13:22 ` Marco Berizzi
  0 siblings, 1 reply; 15+ messages in thread
From: Marco Berizzi @ 2018-06-05  8:12 UTC (permalink / raw)
  To: intel-wired-lan

Hi Folks,

after upgrading from 4.16.13 to 4.17 I got this error message.

Any feedback are welcome.

Marco Berizzi

PS: this system is running oracle virtualbox 5.2.12

[    0.000000] Linux version 4.17.0 (root at Kaa) (gcc version 5.5.0 (GCC)) #1 SMP Mon Jun 4 13:51:52 CEST 2018
[    0.000000] Command line: auto BOOT_IMAGE=Linux ro root=802 vt.default_utf8=0
[    0.000000] x86/fpu: x87 FPU will use FXSAVE
[    0.000000] e820: BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009bfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009c000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e4000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bf69ffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bf6a0000-0x00000000bf6b9fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bf6ba000-0x00000000bf6bafff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bf6bb000-0x00000000bfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fecfffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa00000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000103fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.5 present.
[    0.000000] DMI: FUJITSU                          PRIMERGY RX300 S6             /D2619, BIOS 6.00 Rev. 1.13.2619.N1           01/19/2012
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] e820: last_pfn = 0x1040000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 00C0000000 mask FFC0000000 uncachable
[    0.000000]   1 base 0000000000 mask F000000000 write-back
[    0.000000]   2 base 1000000000 mask FFC0000000 write-back
[    0.000000]   3 disabled
[    0.000000]   4 disabled
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000]   8 disabled
[    0.000000]   9 disabled
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.000000] e820: update [mem 0xc0000000-0xffffffff] usable ==> reserved
[    0.000000] e820: last_pfn = 0xbf6a0 max_arch_pfn = 0x400000000
[    0.000000] Base memory trampoline at [        (ptrval)] 96000 size 24576
[    0.000000] Using GB pages for direct mapping
[    0.000000] BRK [0x01f6c000, 0x01f6cfff] PGTABLE
[    0.000000] BRK [0x01f6d000, 0x01f6dfff] PGTABLE
[    0.000000] BRK [0x01f6e000, 0x01f6efff] PGTABLE
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F7EB0 000024 (v02 PTLTD )
[    0.000000] ACPI: XSDT 0x00000000BF6AF6FF 00021C (v01 PTLTD  ? XSDT   00060000  LTP 00000000)
[    0.000000] ACPI: FACP 0x00000000BF6B5883 0000F4 (v03 FSC    TYLERBRG 00060000 PTL  000F4240)
[    0.000000] ACPI: DSDT 0x00000000BF6AF91B 005EE4 (v01 FSC    D2619    00060000 MSFT 03000001)
[    0.000000] ACPI: FACS 0x00000000BF6BAFC0 000040
[    0.000000] ACPI: FACS 0x00000000BF6BAFC0 000040
[    0.000000] ACPI: TCPA 0x00000000BF6B5977 000032 (v01 Phoeni x        00060000 TL   00000000)
[    0.000000] ACPI: SLIT 0x00000000BF6B59A9 000030 (v01 FSC             00060000      0000005A)
[    0.000000] ACPI: SRAT 0x00000000BF6B59D9 000228 (v01 Intel  Tylerbrg 00060000 PHX. 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5C01 0000D8 (v01 FSC    CST_PR00 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5CD9 0000D8 (v01 FSC    CST_PR01 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5DB1 0000D8 (v01 FSC    CST_PR02 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5E89 0000D8 (v01 FSC    CST_PR03 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5F61 0000D8 (v01 FSC    CST_PR04 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6039 0000D8 (v01 FSC    CST_PR05 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6111 0000D8 (v01 FSC    CST_PR10 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B61E9 0000D8 (v01 FSC    CST_PR11 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B62C1 0000D8 (v01 FSC    CST_PR12 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6399 0000D8 (v01 FSC    CST_PR13 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6471 0000D8 (v01 FSC    CST_PR14 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6549 0000D8 (v01 FSC    CST_PR15 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6621 0000D8 (v01 FSC    CST_PR20 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B66F9 0000D8 (v01 FSC    CST_PR21 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B67D1 0000D8 (v01 FSC    CST_PR22 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B68A9 0000D8 (v01 FSC    CST_PR23 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6981 0000D8 (v01 FSC    CST_PR24 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6A59 0000D8 (v01 FSC    CST_PR25 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6B31 0000D8 (v01 FSC    CST_PR30 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6C09 0000D8 (v01 FSC    CST_PR31 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6CE1 0000D8 (v01 FSC    CST_PR32 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6DB9 0000D8 (v01 FSC    CST_PR33 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6E91 0000D8 (v01 FSC    CST_PR34 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6F69 0000D8 (v01 FSC    CST_PR35 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7041 00017C (v01 FSC    PST_PR00 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B71BD 00017C (v01 FSC    PST_PR01 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7339 00017C (v01 FSC    PST_PR02 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B74B5 00017C (v01 FSC    PST_PR03 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7631 00017C (v01 FSC    PST_PR04 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B77AD 00017C (v01 FSC    PST_PR05 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7929 00017C (v01 FSC    PST_PR10 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7AA5 00017C (v01 FSC    PST_PR11 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7C21 00017C (v01 FSC    PST_PR12 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7D9D 00017C (v01 FSC    PST_PR13 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7F19 00017C (v01 FSC    PST_PR14 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8095 00017C (v01 FSC    PST_PR15 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8211 00017C (v01 FSC    PST_PR20 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B838D 00017C (v01 FSC    PST_PR21 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8509 00017C (v01 FSC    PST_PR22 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8685 00017C (v01 FSC    PST_PR23 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8801 00017C (v01 FSC    PST_PR24 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B897D 00017C (v01 FSC    PST_PR25 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8AF9 00017C (v01 FSC    PST_PR30 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8C75 00017C (v01 FSC    PST_PR31 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8DF1 00017C (v01 FSC    PST_PR32 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8F6D 00017C (v01 FSC    PST_PR33 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B90E9 00017C (v01 FSC    PST_PR34 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B9265 00017C (v01 FSC    PST_PR35 00060000  CSF 00000001)
[    0.000000] ACPI: EINJ 0x00000000BF6B93E1 0001B0 (v01 PTL    WHEAPTL  00060000 PTL  00000001)
[    0.000000] ACPI: HEST 0x00000000BF6B9591 000268 (v01 PTL    WHEAPTL  00060000 PTL  00000001)
[    0.000000] ACPI: BERT 0x00000000BF6B97F9 000030 (v01 PTL    WHEAPTL  00060000 PTL  00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B9829 0000EB (v01 wheaos wheaosc  00060000 MSFT 03000001)
[    0.000000] ACPI: ERST 0x00000000BF6B9914 000270 (v01 PTL    WHEAPTL  00060000 PTL  00000001)
[    0.000000] ACPI: SPCR 0x00000000BF6B9B84 000050 (v01 PTLTD  $UCRTBL$ 00060000 PTL  00000001)
[    0.000000] ACPI: DMAR 0x00000000BF6B9BD4 0001E8 (v01 Intel  OEMDMAR  00060000 LOHR 00000001)
[    0.000000] ACPI: MCFG 0x00000000BF6B9DBC 00003C (v01 PTLTD    MCFG   00060000  LTP 00000000)
[    0.000000] ACPI: HPET 0x00000000BF6B9DF8 000038 (v01 PTLTD  HPETTBL  00060000  LTP 00000001)
[    0.000000] ACPI: APIC 0x00000000BF6B9E30 0001A8 (v01 PTLTD  ? APIC   00060000  LTP 00000000)
[    0.000000] ACPI: BOOT 0x00000000BF6B9FD8 000028 (v01 PTLTD  $SBFTBL$ 00060000  LTP 00000001)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000103fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009bfff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x00000000bf69ffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x000000103fffffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000103fffffff]
[    0.000000] On node 0 totalpages: 16774715
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 21 pages reserved
[    0.000000]   DMA zone: 3995 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 12187 pages used for memmap
[    0.000000]   DMA32 zone: 779936 pages, LIFO batch:31
[    0.000000]   Normal zone: 249856 pages used for memmap
[    0.000000]   Normal zone: 15990784 pages, LIFO batch:31
[    0.000000] Reserved but unavailable: 101 pages
[    0.000000] ACPI: PM-Timer IO Port: 0x1008
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x09] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0a] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0b] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0c] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0d] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0e] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0f] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x10] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x11] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x12] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x13] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x14] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x15] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x16] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x17] high edge lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 6, version 32, address 0xfec00000, GSI 0-23
[    0.000000] IOAPIC[1]: apic_id 7, version 32, address 0xfec80000, GSI 24-47
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[    0.000000] ACPI: SPCR: SPCR table version 1
[    0.000000] ACPI: SPCR: Unexpected SPCR Access Width.  Defaulting to byte size
[    0.000000] smpboot: Allowing 24 CPUs, 0 hotplug CPUs
[    0.000000] e820: [mem 0xc0000000-0xdfffffff] available for PCI devices
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.000000] setup_percpu: NR_CPUS:24 nr_cpumask_bits:24 nr_cpu_ids:24 nr_node_ids:1
[    0.000000] percpu: Embedded 41 pages/cpu @        (ptrval) s130520 r8192 d29224 u262144
[    0.000000] pcpu-alloc: s130520 r8192 d29224 u262144 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15 
[    0.000000] pcpu-alloc: [0] 16 17 18 19 20 21 22 23 
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 16512587
[    0.000000] Kernel command line: auto BOOT_IMAGE=Linux ro root=802 vt.default_utf8=0
[    0.000000] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[    0.000000] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.000000] Memory: 65866116K/67098860K available (8200K kernel code, 339K rwdata, 1464K rodata, 780K init, 452K bss, 1232744K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=24, Nodes=1
[    0.000000] Kernel/User page tables isolation: enabled
[    0.000000] Hierarchical RCU implementation.
[    0.000000] NR_IRQS: 4352, nr_irqs: 1024, preallocated irqs: 16
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] ACPI: Core revision 20180313
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[    0.000000] hpet clockevent registered
[    0.000000] APIC: Switch to symmetric I/O mode setup
[    0.000000] DMAR-IR: This system BIOS has enabled interrupt remapping
               on a chipset that contains an erratum making that
               feature unstable.  To maintain system stability
               interrupt remapping is being disabled.  Please
               contact your BIOS vendor for an update
[    0.000000] Switched APIC routing to physical flat.
[    0.000000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.005000] tsc: Fast TSC calibration using PIT
[    0.006000] tsc: Detected 2399.809 MHz processor
[    0.007000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x22978334789, max_idle_ns: 440795320838 ns
[    0.007000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4799.61 BogoMIPS (lpj=2399809)
[    0.007000] pid_max: default: 32768 minimum: 301
[    0.007000] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.008228] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.008491] CPU: Physical Processor ID: 0
[    0.008585] CPU: Processor Core ID: 0
[    0.008681] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[    0.008781] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[    0.008888] process: using mwait in idle threads
[    0.008985] Last level iTLB entries: 4KB 512, 2MB 7, 4MB 7
[    0.009001] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0
[    0.009103] Spectre V2 : Mitigation: Full generic retpoline
[    0.009202] Speculative Store Bypass: Vulnerable
[    0.009381] Freeing SMP alternatives memory: 20K
[    0.011000] smpboot: CPU0: Intel(R) Xeon(R) CPU           E5645  @ 2.40GHz (family: 0x6, model: 0x2c, stepping: 0x2)
[    0.011000] Performance Events: PEBS fmt1+, Westmere events, 16-deep LBR, Intel PMU driver.
[    0.011000] core: CPUID marked event: 'bus cycles' unavailable
[    0.011000] ... version:                3
[    0.011000] ... bit width:              48
[    0.011000] ... generic registers:      4
[    0.011000] ... value mask:             0000ffffffffffff
[    0.011000] ... max period:             000000007fffffff
[    0.011000] ... fixed-purpose events:   3
[    0.011002] ... event mask:             000000070000000f
[    0.011149] Hierarchical SRCU implementation.
[    0.011534] smp: Bringing up secondary CPUs ...
[    0.011707] x86: Booting SMP configuration:
[    0.011801] .... node  #0, CPUs:        #1  #2  #3  #4  #5  #6  #7  #8  #9 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20 #21 #22 #23
[    0.113045] smp: Brought up 1 node, 24 CPUs
[    0.113245] smpboot: Max logical packages: 2
[    0.113341] smpboot: Total of 24 processors activated (115194.00 BogoMIPS)
[    0.116208] devtmpfs: initialized
[    0.116211] random: get_random_u32 called from bucket_table_alloc+0x7a/0x1a0 with crng_init=0
[    0.116367] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    0.116367] futex hash table entries: 8192 (order: 7, 524288 bytes)
[    0.117117] xor: measuring software checksum speed
[    0.127002]    prefetch64-sse: 12904.000 MB/sec
[    0.137001]    generic_sse: 10980.000 MB/sec
[    0.137095] xor: using function: prefetch64-sse (12904.000 MB/sec)
[    0.138758] NET: Registered protocol family 16
[    0.139027] cpuidle: using governor ladder
[    0.139107] cpuidle: using governor menu
[    0.139114] Simple Boot Flag at 0x7c set to 0x1
[    0.139218] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    0.139323] ACPI: bus type PCI registered
[    0.139427] PCI: MMCONFIG for domain 0000 [bus 00-0a] at [mem 0xe0000000-0xe0afffff] (base 0xe0000000)
[    0.139565] PCI: MMCONFIG at [mem 0xe0000000-0xe0afffff] reserved in E820
[    0.139674] pmd_set_huge: Cannot satisfy [mem 0xe0000000-0xe0200000] with a huge-page mapping due to MTRR override.
[    0.139827] PCI: Using configuration type 1 for base access
[    0.158003] raid6: sse2x1   gen()  5929 MB/s
[    0.175006] raid6: sse2x1   xor()  4669 MB/s
[    0.192007] raid6: sse2x2   gen()  6996 MB/s
[    0.209004] raid6: sse2x2   xor()  5533 MB/s
[    0.226006] raid6: sse2x4   gen()  7667 MB/s
[    0.243001] raid6: sse2x4   xor()  6218 MB/s
[    0.243096] raid6: using algorithm sse2x4 gen() 7667 MB/s
[    0.243195] raid6: .... xor() 6218 MB/s, rmw enabled
[    0.243291] raid6: using ssse3x2 recovery algorithm
[    0.243461] ACPI: Added _OSI(Module Device)
[    0.243556] ACPI: Added _OSI(Processor Device)
[    0.243651] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.243746] ACPI: Added _OSI(Processor Aggregator Device)
[    0.243845] ACPI: Added _OSI(Linux-Dell-Video)
[    0.248322] ACPI: 50 ACPI AML tables successfully acquired and loaded
[    0.262488] ACPI: Interpreter enabled
[    0.262586] ACPI: (supports S0 S5)
[    0.262677] ACPI: Using IOAPIC for interrupt routing
[    0.263000] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.263063] ACPI: Enabled 10 GPEs in block 00 to 3F
[    0.267011] ACPI: PCI Root Bridge [CPU0] (domain 0000 [bus ff])
[    0.267011] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.267116] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.267220] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[    0.267392] PCI host bridge to bus 0000:ff
[    0.267488] pci_bus 0000:ff: root bus resource [bus ff]
[    0.267591] pci 0000:ff:00.0: [8086:2c70] type 00 class 0x060000
[    0.268012] pci 0000:ff:00.1: [8086:2d81] type 00 class 0x060000
[    0.268012] pci 0000:ff:02.0: [8086:2d90] type 00 class 0x060000
[    0.268012] pci 0000:ff:02.1: [8086:2d91] type 00 class 0x060000
[    0.268012] pci 0000:ff:02.2: [8086:2d92] type 00 class 0x060000
[    0.268012] pci 0000:ff:02.3: [8086:2d93] type 00 class 0x060000
[    0.268012] pci 0000:ff:02.4: [8086:2d94] type 00 class 0x060000
[    0.268012] pci 0000:ff:02.5: [8086:2d95] type 00 class 0x060000
[    0.268012] pci 0000:ff:03.0: [8086:2d98] type 00 class 0x060000
[    0.268012] pci 0000:ff:03.1: [8086:2d99] type 00 class 0x060000
[    0.268032] pci 0000:ff:03.2: [8086:2d9a] type 00 class 0x060000
[    0.268069] pci 0000:ff:03.4: [8086:2d9c] type 00 class 0x060000
[    0.268107] pci 0000:ff:04.0: [8086:2da0] type 00 class 0x060000
[    0.268144] pci 0000:ff:04.1: [8086:2da1] type 00 class 0x060000
[    0.268181] pci 0000:ff:04.2: [8086:2da2] type 00 class 0x060000
[    0.268218] pci 0000:ff:04.3: [8086:2da3] type 00 class 0x060000
[    0.268257] pci 0000:ff:05.0: [8086:2da8] type 00 class 0x060000
[    0.268293] pci 0000:ff:05.1: [8086:2da9] type 00 class 0x060000
[    0.268330] pci 0000:ff:05.2: [8086:2daa] type 00 class 0x060000
[    0.268367] pci 0000:ff:05.3: [8086:2dab] type 00 class 0x060000
[    0.268406] pci 0000:ff:06.0: [8086:2db0] type 00 class 0x060000
[    0.269008] pci 0000:ff:06.1: [8086:2db1] type 00 class 0x060000
[    0.269008] pci 0000:ff:06.2: [8086:2db2] type 00 class 0x060000
[    0.269009] pci 0000:ff:06.3: [8086:2db3] type 00 class 0x060000
[    0.269009] pci_bus 0000:ff: on NUMA node 0
[    0.269009] ACPI: PCI Root Bridge [CPU1] (domain 0000 [bus fe])
[    0.269009] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.269009] acpi PNP0A03:01: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.269009] acpi PNP0A03:01: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[    0.269024] PCI host bridge to bus 0000:fe
[    0.269119] pci_bus 0000:fe: root bus resource [bus fe]
[    0.269221] pci 0000:fe:00.0: [8086:2c70] type 00 class 0x060000
[    0.269264] pci 0000:fe:00.1: [8086:2d81] type 00 class 0x060000
[    0.269311] pci 0000:fe:02.0: [8086:2d90] type 00 class 0x060000
[    0.269351] pci 0000:fe:02.1: [8086:2d91] type 00 class 0x060000
[    0.270009] pci 0000:fe:02.2: [8086:2d92] type 00 class 0x060000
[    0.270009] pci 0000:fe:02.3: [8086:2d93] type 00 class 0x060000
[    0.270009] pci 0000:fe:02.4: [8086:2d94] type 00 class 0x060000
[    0.270009] pci 0000:fe:02.5: [8086:2d95] type 00 class 0x060000
[    0.270009] pci 0000:fe:03.0: [8086:2d98] type 00 class 0x060000
[    0.270009] pci 0000:fe:03.1: [8086:2d99] type 00 class 0x060000
[    0.270009] pci 0000:fe:03.2: [8086:2d9a] type 00 class 0x060000
[    0.270009] pci 0000:fe:03.4: [8086:2d9c] type 00 class 0x060000
[    0.270010] pci 0000:fe:04.0: [8086:2da0] type 00 class 0x060000
[    0.270013] pci 0000:fe:04.1: [8086:2da1] type 00 class 0x060000
[    0.270013] pci 0000:fe:04.2: [8086:2da2] type 00 class 0x060000
[    0.270013] pci 0000:fe:04.3: [8086:2da3] type 00 class 0x060000
[    0.270013] pci 0000:fe:05.0: [8086:2da8] type 00 class 0x060000
[    0.270013] pci 0000:fe:05.1: [8086:2da9] type 00 class 0x060000
[    0.270013] pci 0000:fe:05.2: [8086:2daa] type 00 class 0x060000
[    0.270045] pci 0000:fe:05.3: [8086:2dab] type 00 class 0x060000
[    0.270086] pci 0000:fe:06.0: [8086:2db0] type 00 class 0x060000
[    0.270126] pci 0000:fe:06.1: [8086:2db1] type 00 class 0x060000
[    0.270166] pci 0000:fe:06.2: [8086:2db2] type 00 class 0x060000
[    0.270206] pci 0000:fe:06.3: [8086:2db3] type 00 class 0x060000
[    0.270257] pci_bus 0000:fe: on NUMA node 0
[    0.270323] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3d])
[    0.270428] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.270538] acpi PNP0A08:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.270642] acpi PNP0A08:00: [Firmware Info]: MMCONFIG for domain 0000 [bus 00-0a] only partially covers this bridge
[    0.271000] PCI host bridge to bus 0000:00
[    0.271000] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.271002] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.271106] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.271212] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000dffff window]
[    0.271317] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xdfffffff window]
[    0.271423] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfebfffff window]
[    0.271529] pci_bus 0000:00: root bus resource [mem 0xfed00000-0xfedfffff window]
[    0.271635] pci_bus 0000:00: root bus resource [mem 0xfef00000-0xffbfffff window]
[    0.271740] pci_bus 0000:00: root bus resource [bus 00-3d]
[    0.271848] pci 0000:00:00.0: [8086:3406] type 00 class 0x060000
[    0.271880] pci 0000:00:00.0: enabling Extended Tags
[    0.272033] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    0.272109] pci 0000:00:01.0: [8086:3408] type 01 class 0x060400
[    0.272138] pci 0000:00:01.0: enabling Extended Tags
[    0.272269] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    0.272344] pci 0000:00:03.0: [8086:340a] type 01 class 0x060400
[    0.272373] pci 0000:00:03.0: enabling Extended Tags
[    0.272504] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    0.273000] pci 0000:00:05.0: [8086:340c] type 01 class 0x060400
[    0.273000] pci 0000:00:05.0: enabling Extended Tags
[    0.273000] pci 0000:00:05.0: PME# supported from D0 D3hot D3cold
[    0.273008] pci 0000:00:07.0: [8086:340e] type 01 class 0x060400
[    0.273008] pci 0000:00:07.0: enabling Extended Tags
[    0.273008] pci 0000:00:07.0: PME# supported from D0 D3hot D3cold
[    0.273074] pci 0000:00:08.0: [8086:340f] type 01 class 0x060400
[    0.273101] pci 0000:00:08.0: enabling Extended Tags
[    0.273230] pci 0000:00:08.0: PME# supported from D0 D3hot D3cold
[    0.273304] pci 0000:00:09.0: [8086:3410] type 01 class 0x060400
[    0.273332] pci 0000:00:09.0: enabling Extended Tags
[    0.273462] pci 0000:00:09.0: PME# supported from D0 D3hot D3cold
[    0.273536] pci 0000:00:0a.0: [8086:3411] type 01 class 0x060400
[    0.273563] pci 0000:00:0a.0: enabling Extended Tags
[    0.273692] pci 0000:00:0a.0: PME# supported from D0 D3hot D3cold
[    0.274009] pci 0000:00:10.0: [8086:3425] type 00 class 0x080000
[    0.274009] pci 0000:00:10.1: [8086:3426] type 00 class 0x080000
[    0.274009] pci 0000:00:11.0: [8086:3427] type 00 class 0x080000
[    0.274051] pci 0000:00:11.1: [8086:3428] type 00 class 0x080000
[    0.274144] pci 0000:00:14.0: [8086:342e] type 00 class 0x080000
[    0.274252] pci 0000:00:14.1: [8086:3422] type 00 class 0x080000
[    0.274357] pci 0000:00:14.2: [8086:3423] type 00 class 0x080000
[    0.274461] pci 0000:00:14.3: [8086:3438] type 00 class 0x080000
[    0.275008] pci 0000:00:15.0: [8086:342f] type 00 class 0x080020
[    0.275012] pci 0000:00:1a.0: [8086:3a37] type 00 class 0x0c0300
[    0.275012] pci 0000:00:1a.0: reg 0x20: [io  0x1820-0x183f]
[    0.275012] pci 0000:00:1a.1: [8086:3a38] type 00 class 0x0c0300
[    0.275012] pci 0000:00:1a.1: reg 0x20: [io  0x1840-0x185f]
[    0.275012] pci 0000:00:1a.2: [8086:3a39] type 00 class 0x0c0300
[    0.275012] pci 0000:00:1a.2: reg 0x20: [io  0x1860-0x187f]
[    0.275058] pci 0000:00:1a.7: [8086:3a3c] type 00 class 0x0c0320
[    0.275079] pci 0000:00:1a.7: reg 0x10: [mem 0xce000000-0xce0003ff]
[    0.275158] pci 0000:00:1a.7: PME# supported from D0 D3hot D3cold
[    0.275228] pci 0000:00:1c.0: [8086:3a40] type 01 class 0x060400
[    0.275300] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    0.275377] pci 0000:00:1c.4: [8086:3a48] type 01 class 0x060400
[    0.275450] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[    0.275527] pci 0000:00:1d.0: [8086:3a34] type 00 class 0x0c0300
[    0.275569] pci 0000:00:1d.0: reg 0x20: [io  0x1880-0x189f]
[    0.276010] pci 0000:00:1d.1: [8086:3a35] type 00 class 0x0c0300
[    0.276010] pci 0000:00:1d.1: reg 0x20: [io  0x18a0-0x18bf]
[    0.276010] pci 0000:00:1d.2: [8086:3a36] type 00 class 0x0c0300
[    0.276010] pci 0000:00:1d.2: reg 0x20: [io  0x18c0-0x18df]
[    0.276010] pci 0000:00:1d.7: [8086:3a3a] type 00 class 0x0c0320
[    0.276010] pci 0000:00:1d.7: reg 0x10: [mem 0xce001000-0xce0013ff]
[    0.276048] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[    0.276115] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
[    0.276222] pci 0000:00:1f.0: [8086:3a18] type 00 class 0x060100
[    0.276379] pci 0000:00:1f.2: [8086:3a20] type 00 class 0x01018f
[    0.276395] pci 0000:00:1f.2: reg 0x10: [io  0x1c50-0x1c57]
[    0.276402] pci 0000:00:1f.2: reg 0x14: [io  0x1c44-0x1c47]
[    0.276410] pci 0000:00:1f.2: reg 0x18: [io  0x1c48-0x1c4f]
[    0.276416] pci 0000:00:1f.2: reg 0x1c: [io  0x1c40-0x1c43]
[    0.276424] pci 0000:00:1f.2: reg 0x20: [io  0x1c10-0x1c1f]
[    0.276431] pci 0000:00:1f.2: reg 0x24: [io  0x1c00-0x1c0f]
[    0.276520] pci 0000:00:1f.3: [8086:3a30] type 00 class 0x0c0500
[    0.276538] pci 0000:00:1f.3: reg 0x10: [mem 0xce002000-0xce0020ff 64bit]
[    0.276557] pci 0000:00:1f.3: reg 0x20: [io  0x18e0-0x18ff]
[    0.277009] pci 0000:00:1f.5: [8086:3a26] type 00 class 0x010185
[    0.277009] pci 0000:00:1f.5: reg 0x10: [io  0x1c68-0x1c6f]
[    0.277009] pci 0000:00:1f.5: reg 0x14: [io  0x1c5c-0x1c5f]
[    0.277009] pci 0000:00:1f.5: reg 0x18: [io  0x1c60-0x1c67]
[    0.277009] pci 0000:00:1f.5: reg 0x1c: [io  0x1c58-0x1c5b]
[    0.277009] pci 0000:00:1f.5: reg 0x20: [io  0x1c30-0x1c3f]
[    0.277009] pci 0000:00:1f.5: reg 0x24: [io  0x1c20-0x1c2f]
[    0.277009] pci 0000:01:00.0: [1000:0079] type 00 class 0x010400
[    0.277009] pci 0000:01:00.0: reg 0x10: [io  0x2000-0x20ff]
[    0.277009] pci 0000:01:00.0: reg 0x14: [mem 0xce100000-0xce103fff 64bit]
[    0.277009] pci 0000:01:00.0: reg 0x1c: [mem 0xce180000-0xce1bffff 64bit]
[    0.277009] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0003ffff pref]
[    0.277009] pci 0000:01:00.0: enabling Extended Tags
[    0.277009] pci 0000:01:00.0: supports D1 D2
[    0.277044] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.277143] pci 0000:00:01.0:   bridge window [io  0x2000-0x2fff]
[    0.277146] pci 0000:00:01.0:   bridge window [mem 0xce100000-0xce1fffff]
[    0.277179] pci 0000:00:03.0: PCI bridge to [bus 02]
[    0.277309] pci 0000:00:05.0: PCI bridge to [bus 03]
[    0.277440] pci 0000:00:07.0: PCI bridge to [bus 04]
[    0.278009] pci 0000:00:08.0: PCI bridge to [bus 05]
[    0.278009] pci 0000:00:09.0: PCI bridge to [bus 06]
[    0.278009] pci 0000:00:0a.0: PCI bridge to [bus 07]
[    0.278010] pci 0000:08:00.0: [8086:10a7] type 00 class 0x020000
[    0.278010] pci 0000:08:00.0: reg 0x10: [mem 0xce260000-0xce27ffff]
[    0.278016] pci 0000:08:00.0: reg 0x14: [mem 0xce240000-0xce25ffff]
[    0.278026] pci 0000:08:00.0: reg 0x18: [io  0x3000-0x301f]
[    0.278037] pci 0000:08:00.0: reg 0x1c: [mem 0xce200000-0xce203fff]
[    0.278067] pci 0000:08:00.0: reg 0x30: [mem 0x00000000-0x0001ffff pref]
[    0.278134] pci 0000:08:00.0: PME# supported from D0 D3hot D3cold
[    0.278209] pci 0000:08:00.1: [8086:10a7] type 00 class 0x020000
[    0.278234] pci 0000:08:00.1: reg 0x10: [mem 0xce2c0000-0xce2dffff]
[    0.278245] pci 0000:08:00.1: reg 0x14: [mem 0xce2a0000-0xce2bffff]
[    0.278256] pci 0000:08:00.1: reg 0x18: [io  0x3020-0x303f]
[    0.278267] pci 0000:08:00.1: reg 0x1c: [mem 0xce204000-0xce207fff]
[    0.278296] pci 0000:08:00.1: reg 0x30: [mem 0x00000000-0x0001ffff pref]
[    0.278363] pci 0000:08:00.1: PME# supported from D0 D3hot D3cold
[    0.278454] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    0.278554] pci 0000:00:1c.0:   bridge window [io  0x3000-0x3fff]
[    0.278557] pci 0000:00:1c.0:   bridge window [mem 0xce200000-0xce2fffff]
[    0.279009] pci 0000:09:00.0: [102b:0522] type 00 class 0x030000
[    0.279009] pci 0000:09:00.0: reg 0x10: [mem 0xcf000000-0xcfffffff pref]
[    0.279009] pci 0000:09:00.0: reg 0x14: [mem 0xce300000-0xce303fff]
[    0.279009] pci 0000:09:00.0: reg 0x18: [mem 0xce800000-0xceffffff]
[    0.279014] pci 0000:00:1c.4: PCI bridge to [bus 09]
[    0.279014] pci 0000:00:1c.4:   bridge window [mem 0xce300000-0xceffffff]
[    0.279014] pci 0000:00:1c.4:   bridge window [mem 0xcf000000-0xcfffffff 64bit pref]
[    0.279033] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    0.279144] pci 0000:00:1e.0:   bridge window [io  0x0000-0x0cf7 window] (subtractive decode)
[    0.279146] pci 0000:00:1e.0:   bridge window [io  0x0d00-0xffff window] (subtractive decode)
[    0.279148] pci 0000:00:1e.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    0.279149] pci 0000:00:1e.0:   bridge window [mem 0x000c8000-0x000dffff window] (subtractive decode)
[    0.279151] pci 0000:00:1e.0:   bridge window [mem 0xc0000000-0xdfffffff window] (subtractive decode)
[    0.279152] pci 0000:00:1e.0:   bridge window [mem 0xf0000000-0xfebfffff window] (subtractive decode)
[    0.279154] pci 0000:00:1e.0:   bridge window [mem 0xfed00000-0xfedfffff window] (subtractive decode)
[    0.279155] pci 0000:00:1e.0:   bridge window [mem 0xfef00000-0xffbfffff window] (subtractive decode)
[    0.279202] pci_bus 0000:00: on NUMA node 0
[    0.279358] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    0.279518] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    0.279675] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 *9 10 11 12 14 15)
[    0.279832] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 *10 11 12 14 15)
[    0.279982] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[    0.280050] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    0.280207] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    0.280366] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 *5 6 7 9 10 11 12 14 15)
[    0.281019] pci 0000:09:00.0: vgaarb: setting as boot VGA device
[    0.282000] pci 0000:09:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.283017] pci 0000:09:00.0: vgaarb: bridge control possible
[    0.283117] vgaarb: loaded
[    0.283320] SCSI subsystem initialized
[    0.283434] PCI: Using ACPI for IRQ routing
[    0.283434] PCI: pci_cache_line_size set to 64 bytes
[    0.283434] Expanded resource Reserved due to conflict with PCI Bus 0000:00
[    0.283434] e820: reserve RAM buffer [mem 0x0009c000-0x0009ffff]
[    0.283434] e820: reserve RAM buffer [mem 0xbf6a0000-0xbfffffff]
[    0.284015] clocksource: Switched to clocksource tsc-early
[    0.284175] pnp: PnP ACPI init
[    0.284388] system 00:00: [mem 0xe0000000-0xefffffff] has been reserved
[    0.284504] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.284801] system 00:01: [io  0x0200-0x020f] has been reserved
[    0.284904] system 00:01: [io  0x04d0-0x04d1] has been reserved
[    0.285005] system 00:01: [io  0x0500-0x057f] has been reserved
[    0.285105] system 00:01: [io  0x0800-0x080f] has been reserved
[    0.285206] system 00:01: [io  0x0810-0x081f] has been reserved
[    0.285307] system 00:01: [io  0x0ca0-0x0ca1] has been reserved
[    0.285407] system 00:01: [io  0x0ca4-0x0ca7] has been reserved
[    0.285510] system 00:01: [io  0x0ca8-0x0cab] has been reserved
[    0.285611] system 00:01: [io  0x0cae-0x0caf] has been reserved
[    0.285712] system 00:01: [io  0x0e00-0x0e7f] has been reserved
[    0.285812] system 00:01: [io  0x1000-0x107f] has been reserved
[    0.285913] system 00:01: [io  0x1100-0x110f] has been reserved
[    0.286014] system 00:01: [io  0x1180-0x11ff] has been reserved
[    0.286115] system 00:01: [io  0xfe00] has been reserved
[    0.286214] system 00:01: [io  0xff00] has been reserved
[    0.286313] system 00:01: [mem 0xfec00000-0xfecfffff] could not be reserved
[    0.286417] system 00:01: [mem 0xfee00000-0xfeefffff] could not be reserved
[    0.286523] system 00:01: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    0.286632] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.286670] pnp 00:02: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.286874] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.287025] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.287081] pnp: PnP ACPI: found 5 devices
[    0.292879] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.293066] pci 0000:00:1c.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 08] add_size 200000 add_align 100000
[    0.293074] pci 0000:00:1c.4: bridge window [io  0x1000-0x0fff] to [bus 09] add_size 1000
[    0.293094] pci 0000:00:1c.0: BAR 9: assigned [mem 0xc0000000-0xc01fffff 64bit pref]
[    0.293203] pci 0000:00:1c.4: BAR 7: assigned [io  0x4000-0x4fff]
[    0.293305] pci 0000:01:00.0: BAR 6: assigned [mem 0xce140000-0xce17ffff pref]
[    0.293410] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.293510] pci 0000:00:01.0:   bridge window [io  0x2000-0x2fff]
[    0.293613] pci 0000:00:01.0:   bridge window [mem 0xce100000-0xce1fffff]
[    0.293720] pci 0000:00:03.0: PCI bridge to [bus 02]
[    0.293823] pci 0000:00:05.0: PCI bridge to [bus 03]
[    0.293927] pci 0000:00:07.0: PCI bridge to [bus 04]
[    0.294029] pci 0000:00:08.0: PCI bridge to [bus 05]
[    0.294132] pci 0000:00:09.0: PCI bridge to [bus 06]
[    0.294235] pci 0000:00:0a.0: PCI bridge to [bus 07]
[    0.294339] pci 0000:08:00.0: BAR 6: assigned [mem 0xce220000-0xce23ffff pref]
[    0.294445] pci 0000:08:00.1: BAR 6: assigned [mem 0xce280000-0xce29ffff pref]
[    0.294551] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    0.294649] pci 0000:00:1c.0:   bridge window [io  0x3000-0x3fff]
[    0.294752] pci 0000:00:1c.0:   bridge window [mem 0xce200000-0xce2fffff]
[    0.294857] pci 0000:00:1c.0:   bridge window [mem 0xc0000000-0xc01fffff 64bit pref]
[    0.294967] pci 0000:00:1c.4: PCI bridge to [bus 09]
[    0.295064] pci 0000:00:1c.4:   bridge window [io  0x4000-0x4fff]
[    0.295168] pci 0000:00:1c.4:   bridge window [mem 0xce300000-0xceffffff]
[    0.295272] pci 0000:00:1c.4:   bridge window [mem 0xcf000000-0xcfffffff 64bit pref]
[    0.295382] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    0.295489] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    0.295490] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    0.295492] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.295493] pci_bus 0000:00: resource 7 [mem 0x000c8000-0x000dffff window]
[    0.295495] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xdfffffff window]
[    0.295496] pci_bus 0000:00: resource 9 [mem 0xf0000000-0xfebfffff window]
[    0.295498] pci_bus 0000:00: resource 10 [mem 0xfed00000-0xfedfffff window]
[    0.295500] pci_bus 0000:00: resource 11 [mem 0xfef00000-0xffbfffff window]
[    0.295501] pci_bus 0000:01: resource 0 [io  0x2000-0x2fff]
[    0.295503] pci_bus 0000:01: resource 1 [mem 0xce100000-0xce1fffff]
[    0.295505] pci_bus 0000:08: resource 0 [io  0x3000-0x3fff]
[    0.295506] pci_bus 0000:08: resource 1 [mem 0xce200000-0xce2fffff]
[    0.295508] pci_bus 0000:08: resource 2 [mem 0xc0000000-0xc01fffff 64bit pref]
[    0.295509] pci_bus 0000:09: resource 0 [io  0x4000-0x4fff]
[    0.295511] pci_bus 0000:09: resource 1 [mem 0xce300000-0xceffffff]
[    0.295512] pci_bus 0000:09: resource 2 [mem 0xcf000000-0xcfffffff 64bit pref]
[    0.295514] pci_bus 0000:0a: resource 4 [io  0x0000-0x0cf7 window]
[    0.295516] pci_bus 0000:0a: resource 5 [io  0x0d00-0xffff window]
[    0.295517] pci_bus 0000:0a: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.295519] pci_bus 0000:0a: resource 7 [mem 0x000c8000-0x000dffff window]
[    0.295520] pci_bus 0000:0a: resource 8 [mem 0xc0000000-0xdfffffff window]
[    0.295522] pci_bus 0000:0a: resource 9 [mem 0xf0000000-0xfebfffff window]
[    0.295523] pci_bus 0000:0a: resource 10 [mem 0xfed00000-0xfedfffff window]
[    0.295525] pci_bus 0000:0a: resource 11 [mem 0xfef00000-0xffbfffff window]
[    0.295589] NET: Registered protocol family 2
[    0.295807] tcp_listen_portaddr_hash hash table entries: 32768 (order: 7, 524288 bytes)
[    0.296043] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.297126] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.297470] TCP: Hash tables configured (established 524288 bind 65536)
[    0.297646] UDP hash table entries: 32768 (order: 8, 1048576 bytes)
[    0.297997] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes)
[    0.298419] NET: Registered protocol family 1
[    0.301521] pci 0000:08:00.0: Disabling L0s
[    0.301616] pci 0000:08:00.0: can't disable ASPM; OS doesn't have ASPM control
[    0.301723] pci 0000:08:00.1: Disabling L0s
[    0.301818] pci 0000:08:00.1: can't disable ASPM; OS doesn't have ASPM control
[    0.301934] pci 0000:09:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.302044] PCI: CLS 64 bytes, default 64
[    0.302067] DMAR: Host address width 40
[    0.302161] DMAR: DRHD base: 0x000000fed14000 flags: 0x1
[    0.302266] DMAR: dmar0: reg_base_addr fed14000 ver 1:0 cap c90780106f0462 ecap f02076
[    0.302372] DMAR: RMRR base: 0x000000bf6d0000 end: 0x000000bf6e7fff
[    0.302476] DMAR: RMRR base: 0x000000bf6f0000 end: 0x000000bf6f0fff
[    0.302577] DMAR: RMRR base: 0x000000bf6f1000 end: 0x000000bf6f1fff
[    0.302678] DMAR: RMRR base: 0x000000bf6f2000 end: 0x000000bf6f2fff
[    0.302779] DMAR: RMRR base: 0x000000bf6fa000 end: 0x000000bf6fafff
[    0.302880] DMAR: RMRR base: 0x000000bf6f3000 end: 0x000000bf6f3fff
[    0.302982] DMAR: RMRR base: 0x000000bf6f4000 end: 0x000000bf6f4fff
[    0.303083] DMAR: RMRR base: 0x000000bf6f5000 end: 0x000000bf6f5fff
[    0.303184] DMAR: RMRR base: 0x000000bf6fb000 end: 0x000000bf6fbfff
[    0.303285] DMAR: ATSR flags: 0x0
[    0.303627] DMAR: dmar0: Using Queued invalidation
[    0.303741] DMAR: Setting RMRR:
[    0.304098] DMAR: Setting identity map for device 0000:00:1d.7 [0xbf6fb000 - 0xbf6fbfff]
[    0.304488] DMAR: Setting identity map for device 0000:00:1d.2 [0xbf6f5000 - 0xbf6f5fff]
[    0.304949] DMAR: Setting identity map for device 0000:00:1d.1 [0xbf6f4000 - 0xbf6f4fff]
[    0.305344] DMAR: Setting identity map for device 0000:00:1d.0 [0xbf6f3000 - 0xbf6f3fff]
[    0.305745] DMAR: Setting identity map for device 0000:00:1a.7 [0xbf6fa000 - 0xbf6fafff]
[    0.306138] DMAR: Setting identity map for device 0000:00:1a.2 [0xbf6f2000 - 0xbf6f2fff]
[    0.306538] DMAR: Setting identity map for device 0000:00:1a.1 [0xbf6f1000 - 0xbf6f1fff]
[    0.306934] DMAR: Setting identity map for device 0000:00:1a.0 [0xbf6f0000 - 0xbf6f0fff]
[    0.307070] DMAR: Setting identity map for device 0000:00:1a.0 [0xbf6d0000 - 0xbf6e7fff]
[    0.307178] DMAR: Setting identity map for device 0000:00:1a.1 [0xbf6d0000 - 0xbf6e7fff]
[    0.307287] DMAR: Setting identity map for device 0000:00:1a.2 [0xbf6d0000 - 0xbf6e7fff]
[    0.307395] DMAR: Setting identity map for device 0000:00:1a.7 [0xbf6d0000 - 0xbf6e7fff]
[    0.307506] DMAR: Setting identity map for device 0000:00:1d.0 [0xbf6d0000 - 0xbf6e7fff]
[    0.307615] DMAR: Setting identity map for device 0000:00:1d.1 [0xbf6d0000 - 0xbf6e7fff]
[    0.307723] DMAR: Setting identity map for device 0000:00:1d.2 [0xbf6d0000 - 0xbf6e7fff]
[    0.307832] DMAR: Setting identity map for device 0000:00:1d.7 [0xbf6d0000 - 0xbf6e7fff]
[    0.307944] DMAR: Prepare 0-16MiB unity mapping for LPC
[    0.308303] DMAR: Setting identity map for device 0000:00:1f.0 [0x0 - 0xffffff]
[    0.308628] DMAR: Intel(R) Virtualization Technology for Directed I/O
[    0.308799] iommu: Adding device 0000:ff:00.0 to group 0
[    0.308912] iommu: Adding device 0000:ff:00.1 to group 0
[    0.309077] iommu: Adding device 0000:ff:02.0 to group 1
[    0.309188] iommu: Adding device 0000:ff:02.1 to group 1
[    0.309299] iommu: Adding device 0000:ff:02.2 to group 1
[    0.309410] iommu: Adding device 0000:ff:02.3 to group 1
[    0.309523] iommu: Adding device 0000:ff:02.4 to group 1
[    0.309634] iommu: Adding device 0000:ff:02.5 to group 1
[    0.309781] iommu: Adding device 0000:ff:03.0 to group 2
[    0.309894] iommu: Adding device 0000:ff:03.1 to group 2
[    0.310007] iommu: Adding device 0000:ff:03.2 to group 2
[    0.310118] iommu: Adding device 0000:ff:03.4 to group 2
[    0.310265] iommu: Adding device 0000:ff:04.0 to group 3
[    0.310376] iommu: Adding device 0000:ff:04.1 to group 3
[    0.310491] iommu: Adding device 0000:ff:04.2 to group 3
[    0.310602] iommu: Adding device 0000:ff:04.3 to group 3
[    0.310751] iommu: Adding device 0000:ff:05.0 to group 4
[    0.310862] iommu: Adding device 0000:ff:05.1 to group 4
[    0.310975] iommu: Adding device 0000:ff:05.2 to group 4
[    0.311087] iommu: Adding device 0000:ff:05.3 to group 4
[    0.311234] iommu: Adding device 0000:ff:06.0 to group 5
[    0.311347] iommu: Adding device 0000:ff:06.1 to group 5
[    0.311462] iommu: Adding device 0000:ff:06.2 to group 5
[    0.311575] iommu: Adding device 0000:ff:06.3 to group 5
[    0.311705] iommu: Adding device 0000:fe:00.0 to group 6
[    0.311818] iommu: Adding device 0000:fe:00.1 to group 6
[    0.311983] iommu: Adding device 0000:fe:02.0 to group 7
[    0.312096] iommu: Adding device 0000:fe:02.1 to group 7
[    0.312210] iommu: Adding device 0000:fe:02.2 to group 7
[    0.312323] iommu: Adding device 0000:fe:02.3 to group 7
[    0.312435] iommu: Adding device 0000:fe:02.4 to group 7
[    0.312551] iommu: Adding device 0000:fe:02.5 to group 7
[    0.312699] iommu: Adding device 0000:fe:03.0 to group 8
[    0.312811] iommu: Adding device 0000:fe:03.1 to group 8
[    0.312926] iommu: Adding device 0000:fe:03.2 to group 8
[    0.313040] iommu: Adding device 0000:fe:03.4 to group 8
[    0.313187] iommu: Adding device 0000:fe:04.0 to group 9
[    0.313300] iommu: Adding device 0000:fe:04.1 to group 9
[    0.313414] iommu: Adding device 0000:fe:04.2 to group 9
[    0.313530] iommu: Adding device 0000:fe:04.3 to group 9
[    0.313676] iommu: Adding device 0000:fe:05.0 to group 10
[    0.313792] iommu: Adding device 0000:fe:05.1 to group 10
[    0.313908] iommu: Adding device 0000:fe:05.2 to group 10
[    0.314023] iommu: Adding device 0000:fe:05.3 to group 10
[    0.314171] iommu: Adding device 0000:fe:06.0 to group 11
[    0.314286] iommu: Adding device 0000:fe:06.1 to group 11
[    0.314400] iommu: Adding device 0000:fe:06.2 to group 11
[    0.314518] iommu: Adding device 0000:fe:06.3 to group 11
[    0.314631] iommu: Adding device 0000:00:00.0 to group 12
[    0.314745] iommu: Adding device 0000:00:01.0 to group 13
[    0.314857] iommu: Adding device 0000:00:03.0 to group 14
[    0.314970] iommu: Adding device 0000:00:05.0 to group 15
[    0.315082] iommu: Adding device 0000:00:07.0 to group 16
[    0.315194] iommu: Adding device 0000:00:08.0 to group 17
[    0.315306] iommu: Adding device 0000:00:09.0 to group 18
[    0.315418] iommu: Adding device 0000:00:0a.0 to group 19
[    0.315552] iommu: Adding device 0000:00:10.0 to group 20
[    0.315668] iommu: Adding device 0000:00:10.1 to group 20
[    0.315799] iommu: Adding device 0000:00:11.0 to group 21
[    0.315916] iommu: Adding device 0000:00:11.1 to group 21
[    0.316066] iommu: Adding device 0000:00:14.0 to group 22
[    0.316184] iommu: Adding device 0000:00:14.1 to group 22
[    0.316303] iommu: Adding device 0000:00:14.2 to group 22
[    0.316420] iommu: Adding device 0000:00:14.3 to group 22
[    0.316544] iommu: Adding device 0000:00:15.0 to group 23
[    0.316692] iommu: Adding device 0000:00:1a.0 to group 24
[    0.316808] iommu: Adding device 0000:00:1a.1 to group 24
[    0.316927] iommu: Adding device 0000:00:1a.2 to group 24
[    0.317051] iommu: Adding device 0000:00:1a.7 to group 24
[    0.317184] iommu: Adding device 0000:00:1c.0 to group 25
[    0.317305] iommu: Adding device 0000:00:1c.4 to group 25
[    0.317454] iommu: Adding device 0000:00:1d.0 to group 26
[    0.317575] iommu: Adding device 0000:00:1d.1 to group 26
[    0.317693] iommu: Adding device 0000:00:1d.2 to group 26
[    0.317812] iommu: Adding device 0000:00:1d.7 to group 26
[    0.317925] iommu: Adding device 0000:00:1e.0 to group 27
[    0.318073] iommu: Adding device 0000:00:1f.0 to group 28
[    0.318191] iommu: Adding device 0000:00:1f.2 to group 28
[    0.318309] iommu: Adding device 0000:00:1f.3 to group 28
[    0.319679] iommu: Adding device 0000:00:1f.5 to group 28
[    0.319795] iommu: Adding device 0000:01:00.0 to group 29
[    0.319900] iommu: Adding device 0000:08:00.0 to group 25
[    0.320003] iommu: Adding device 0000:08:00.1 to group 25
[    0.320105] iommu: Adding device 0000:09:00.0 to group 25
[    0.322623] workingset: timestamp_bits=62 max_order=24 bucket_order=0
[    0.324531] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)
[    0.324639] io scheduler noop registered
[    0.324732] io scheduler deadline registered
[    0.324868] io scheduler cfq registered (default)
[    0.324964] io scheduler mq-deadline registered
[    0.325060] io scheduler kyber registered
[    0.330470] megasas: 07.704.04.00-rc1
[    0.330812] megaraid_sas 0000:01:00.0: FW now in Ready state
[    0.330916] megaraid_sas 0000:01:00.0: 64 bit DMA mask and 32 bit consistent mask
[    0.331518] megaraid_sas 0000:01:00.0: firmware supports msix        : (0)
[    0.331621] megaraid_sas 0000:01:00.0: current msix/online cpus      : (1/24)
[    0.331726] megaraid_sas 0000:01:00.0: RDPQ mode     : (disabled)
[    0.420555] megaraid_sas 0000:01:00.0: controller type       : MR(512MB)
[    0.420661] megaraid_sas 0000:01:00.0: Online Controller Reset(OCR)  : Enabled
[    0.420769] megaraid_sas 0000:01:00.0: Secure JBOD support   : No
[    0.420874] megaraid_sas 0000:01:00.0: NVMe passthru support : No
[    0.420984] megaraid_sas 0000:01:00.0: megasas_init_mfi: fw_support_ieee=0
[    0.421105] megaraid_sas 0000:01:00.0: INIT adapter done
[    0.421207] megaraid_sas 0000:01:00.0: Jbod map is not supported megasas_setup_jbod_map 5132
[    0.465569] megaraid_sas 0000:01:00.0: pci id                : (0x1000)/(0x0079)/(0x1734)/(0x1176)
[    0.465680] megaraid_sas 0000:01:00.0: unevenspan support    : no
[    0.465788] megaraid_sas 0000:01:00.0: firmware crash dump   : no
[    0.465888] megaraid_sas 0000:01:00.0: jbod sync map         : no
[    0.465997] scsi host0: Avago SAS based MegaRAID driver
[    0.471310] scsi 0:2:0:0: Direct-Access     LSI      RAID 5/6 SAS 6G  2.90 PQ: 0 ANSI: 5
[    0.472134] scsi 0:2:1:0: Direct-Access     LSI      RAID 5/6 SAS 6G  2.90 PQ: 0 ANSI: 5
[    0.482013] rtc_cmos 00:02: RTC can wake from S4
[    0.482260] rtc_cmos 00:02: registered as rtc0
[    0.482309] random: fast init done
[    0.482375] rtc_cmos 00:02: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[    0.482470] sd 0:2:1:0: [sdb] 1171062784 512-byte logical blocks: (600 GB/558 GiB)
[    0.482489] sd 0:2:0:0: [sda] 285671424 512-byte logical blocks: (146 GB/136 GiB)
[    0.482512] sd 0:2:0:0: [sda] Write Protect is off
[    0.482514] sd 0:2:0:0: [sda] Mode Sense: 1f 00 10 08
[    0.482552] sd 0:2:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
[    0.483120] sd 0:2:1:0: [sdb] Write Protect is off
[    0.483219] sd 0:2:1:0: [sdb] Mode Sense: 1f 00 10 08
[    0.483334] NET: Registered protocol family 17
[    0.483340] sd 0:2:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA
[    0.483451] sched_clock: Marking stable (482565454, 0)->(653518254, -170952800)
[    0.483936] registered taskstats version 1
[    0.484100]  sdb: sdb1
[    0.484365] Btrfs loaded, crc32c=crc32c-generic
[    0.484583] sd 0:2:1:0: [sdb] Attached SCSI disk
[    0.485533] rtc_cmos 00:02: setting system clock to 2018-06-04 19:11:27 UTC (1528139487)
[    0.488769]  sda: sda1 sda2 sda3
[    0.489634] sd 0:2:0:0: [sda] Attached SCSI disk
[    0.495058] BTRFS: device fsid 473b3d83-48a1-4653-b073-5b55b600badd devid 1 transid 356978 /dev/root
[    0.496298] BTRFS info (device sda2): disk space caching is enabled
[    0.496406] BTRFS info (device sda2): has skinny extents
[    0.587549] VFS: Mounted root (btrfs filesystem) readonly on device 0:13.
[    0.592606] devtmpfs: mounted
[    0.595520] Freeing unused kernel memory: 780K
[    0.597164] Write protecting the kernel read-only data: 12288k
[    0.602558] Freeing unused kernel memory: 2020K
[    0.606105] Freeing unused kernel memory: 584K
[    1.025019] loop: module loaded
[    1.246147] random: udevd: uninitialized urandom read (16 bytes read)
[    1.248759] random: udevd: uninitialized urandom read (16 bytes read)
[    1.248871] random: udevd: uninitialized urandom read (16 bytes read)
[    1.375044] tsc: Refined TSC clocksource calibration: 2400.084 MHz
[    1.376222] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229886f1f14, max_idle_ns: 440795306808 ns
[    1.376964] clocksource: Switched to clocksource tsc
[    1.453486] random: crng init done
[    1.453580] random: 2 urandom warning(s) missed due to ratelimiting
[    1.462527] udevd[1014]: starting eudev-3.1.5
[    1.518277] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[    1.524864] ACPI: bus type USB registered
[    1.524976] usbcore: registered new interface driver usbfs
[    1.525096] usbcore: registered new interface driver hub
[    1.525265] usbcore: registered new device driver usb
[    1.529476] pps_core: LinuxPPS API ver. 1 registered
[    1.529574] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    1.549376] PTP clock support registered
[    1.557032] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
[    1.577827] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    1.598633] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    1.598999] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.599522] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
[    1.599633] ACPI: Power Button [PWRB]
[    1.599789] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1
[    1.599895] ACPI: Power Button [PWRF]
[    1.601852] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    1.601956] igb: Copyright (c) 2007-2014 Intel Corporation.
[    1.651427] ehci-pci: EHCI PCI platform driver
[    1.651765] ehci-pci 0000:00:1a.7: EHCI Host Controller
[    1.651867] ehci-pci 0000:00:1a.7: new USB bus registered, assigned bus number 1
[    1.651981] ehci-pci 0000:00:1a.7: debug port 1
[    1.656014] ehci-pci 0000:00:1a.7: cache line size of 64 is not supported
[    1.656028] ehci-pci 0000:00:1a.7: irq 18, io mem 0xce000000
[    1.663054] ehci-pci 0000:00:1a.7: USB 2.0 started, EHCI 1.00
[    1.663975] hub 1-0:1.0: USB hub found
[    1.664158] hub 1-0:1.0: 6 ports detected
[    1.664946] ehci-pci 0000:00:1d.7: EHCI Host Controller
[    1.665064] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2
[    1.665179] ehci-pci 0000:00:1d.7: debug port 1
[    1.669199] ehci-pci 0000:00:1d.7: cache line size of 64 is not supported
[    1.669210] ehci-pci 0000:00:1d.7: irq 23, io mem 0xce001000
[    1.676048] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[    1.676356] hub 2-0:1.0: USB hub found
[    1.676467] hub 2-0:1.0: 6 ports detected
[    1.713887] uhci_hcd: USB Universal Host Controller Interface driver
[    1.714242] uhci_hcd 0000:00:1a.0: UHCI Host Controller
[    1.714346] uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 3
[    1.714482] uhci_hcd 0000:00:1a.0: irq 19, io base 0x00001820
[    1.715163] hub 3-0:1.0: USB hub found
[    1.715270] hub 3-0:1.0: 2 ports detected
[    1.715798] uhci_hcd 0000:00:1a.1: UHCI Host Controller
[    1.715901] uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4
[    1.716034] uhci_hcd 0000:00:1a.1: irq 18, io base 0x00001840
[    1.716520] hub 4-0:1.0: USB hub found
[    1.716629] hub 4-0:1.0: 2 ports detected
[    1.717059] uhci_hcd 0000:00:1a.2: UHCI Host Controller
[    1.717164] uhci_hcd 0000:00:1a.2: new USB bus registered, assigned bus number 5
[    1.717290] uhci_hcd 0000:00:1a.2: irq 18, io base 0x00001860
[    1.717733] hub 5-0:1.0: USB hub found
[    1.717910] hub 5-0:1.0: 2 ports detected
[    1.718597] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    1.718700] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 6
[    1.718826] uhci_hcd 0000:00:1d.0: irq 23, io base 0x00001880
[    1.719276] hub 6-0:1.0: USB hub found
[    1.719440] hub 6-0:1.0: 2 ports detected
[    1.719845] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    1.719947] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 7
[    1.720089] uhci_hcd 0000:00:1d.1: irq 22, io base 0x000018a0
[    1.720446] hub 7-0:1.0: USB hub found
[    1.720554] hub 7-0:1.0: 2 ports detected
[    1.720973] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    1.721082] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 8
[    1.721213] uhci_hcd 0000:00:1d.2: irq 21, io base 0x000018c0
[    1.721828] hub 8-0:1.0: USB hub found
[    1.721935] hub 8-0:1.0: 2 ports detected
[    1.804077] igb 0000:08:00.0: Intel(R) Gigabit Ethernet Network Connection
[    1.804182] igb 0000:08:00.0: eth0: (PCIe:2.5Gb/s:Width x4) 00:19:99:ab:0b:38
[    1.804288] igb 0000:08:00.0: eth0: PBA No: Unknown
[    1.804385] igb 0000:08:00.0: Using MSI-X interrupts. 4 rx queue(s), 4 tx queue(s)
[    2.012115] igb 0000:08:00.1: Intel(R) Gigabit Ethernet Network Connection
[    2.012225] igb 0000:08:00.1: eth1: (PCIe:2.5Gb/s:Width x4) 00:19:99:ab:0b:39
[    2.012331] igb 0000:08:00.1: eth1: PBA No: Unknown
[    2.012429] igb 0000:08:00.1: Using MSI-X interrupts. 4 rx queue(s), 4 tx queue(s)
[    2.067108] BTRFS: device fsid 77ad40e4-d53c-4b3b-b135-7c3db9ee21fb devid 1 transid 507181 /dev/sdb1
[    2.164642] Adding 10451964k swap on /dev/sda3.  Priority:-2 extents:1 across:10451964k FS
[    2.309297] BTRFS info (device sda2): disk space caching is enabled
[    5.437118] BTRFS info (device sdb1): disk space caching is enabled
[    5.437222] BTRFS info (device sdb1): has skinny extents
[   10.763865] igb 0000:08:00.0: changing MTU from 1500 to 9000
[   13.214576] igb 0000:08:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   15.112934] vboxdrv: loading out-of-tree module taints kernel.
[   15.125946] vboxdrv: Found 24 processor cores
[   15.144502] vboxdrv: TSC mode is Invariant, tentative frequency 2400052042 Hz
[   15.144503] vboxdrv: Successfully loaded version 5.2.12 (interface 0x00290001)
[   15.192821] VBoxNetAdp: Successfully started.
[   15.229984] VBoxNetFlt: Successfully started.
[   15.240730] VBoxPciLinuxInit
[   15.240735] vboxpci: pci-stub module not available, cannot detach PCI devices
[   15.240735] vboxpci: IOMMU found
[   15.562552] SUPR0GipMap: fGetGipCpu=0xb
[   17.415903] vboxdrv: 00000000cdbcec4c VMMR0.r0
[   17.763782] vboxdrv: 000000001fc9bd6e VBoxDDR0.r0
[   17.786780] VBoxNetFlt: attached to 'eth0' / 00:19:99:ab:0b:38
[   17.810493] vboxpci: created IOMMU domain 00000000f60d2819
[   17.812470] vboxpci: created IOMMU domain 00000000c0a3f6d2
[   17.812472] vboxpci: created IOMMU domain 00000000ee100703
[   17.903856] vboxdrv: 000000001bfdcf4c VBoxEhciR0.r0
[   18.839240] vboxpci: created IOMMU domain 00000000564b0fae
[   21.755305] device eth0 entered promiscuous mode
[   21.974019] vboxpci: created IOMMU domain 000000004a72e381
[   23.063862] vboxpci: created IOMMU domain 000000000de0fce8
[   24.374749] vboxpci: created IOMMU domain 00000000d77817f8
[   27.821775] vboxpci: created IOMMU domain 00000000ea90c630
[   28.364920] vboxpci: created IOMMU domain 0000000007423792
[   28.450067] vboxpci: created IOMMU domain 00000000e22c8b48
[   29.033369] vboxpci: created IOMMU domain 0000000007f903f8
[   34.729839] vboxpci: created IOMMU domain 000000000e7e23cd
[19389.458286] igb 0000:08:00.0: Detected Tx Unit Hang
                 Tx Queue             <1>
                 TDH                  <3f>
                 TDT                  <3f>
                 next_to_use          <41>
                 next_to_clean        <3f>
               buffer_info[next_to_clean]
                 time_stamp           <101234494>
                 next_to_watch        <00000000930717e8>
                 jiffies              <101234940>
                 desc.status          <160210>
[19391.442150] igb 0000:08:00.0: Detected Tx Unit Hang
                 Tx Queue             <1>
                 TDH                  <3f>
                 TDT                  <3f>
                 next_to_use          <41>
                 next_to_clean        <3f>
               buffer_info[next_to_clean]
                 time_stamp           <101234494>
                 next_to_watch        <00000000930717e8>
                 jiffies              <101235100>
                 desc.status          <160210>
[19393.426033] igb 0000:08:00.0: Detected Tx Unit Hang
                 Tx Queue             <1>
                 TDH                  <3f>
                 TDT                  <3f>
                 next_to_use          <41>
                 next_to_clean        <3f>
               buffer_info[next_to_clean]
                 time_stamp           <101234494>
                 next_to_watch        <00000000930717e8>
                 jiffies              <1012358c0>
                 desc.status          <160210>
[19394.769755] ------------[ cut here ]------------
[19394.769779] NETDEV WATCHDOG: eth0 (igb): transmit queue 1 timed out
[19394.769804] WARNING: CPU: 10 PID: 0 at net/sched/sch_generic.c:473 dev_watchdog+0x1d9/0x1e0
[19394.769806] Modules linked in: vboxpci(O) vboxnetflt(O) vboxnetadp(O) vboxdrv(O) uhci_hcd evdev ehci_pci igb button ehci_hcd 8250 ptp 8250_base pps_core usbcore i2c_i801 i2c_algo_bit usb_common serial_core i2c_core loop
[19394.769827] CPU: 10 PID: 0 Comm: swapper/10 Tainted: G          IO      4.17.0 #1
[19394.769829] Hardware name: FUJITSU                          PRIMERGY RX300 S6             /D2619, BIOS 6.00 Rev. 1.13.2619.N1           01/19/2012
[19394.769832] RIP: 0010:dev_watchdog+0x1d9/0x1e0
[19394.769834] RSP: 0018:ffff880fff283ed0 EFLAGS: 00010282
[19394.769839] RAX: 0000000000000037 RBX: 0000000000000001 RCX: ffffffff81c2aa58
[19394.769843] RDX: 0000000000000001 RSI: 0000000000000092 RDI: ffffffff81f0cfec
[19394.769849] RBP: ffff880ff23683b0 R08: 0000000000000001 R09: 000000000000036d
[19394.769853] R10: ffffffff81c05100 R11: 000000000000036d R12: ffff880ff2368000
[19394.769856] R13: 000000000000000a R14: 0000000000000002 R15: ffffffff81c05108
[19394.769861] FS:  0000000000000000(0000) GS:ffff880fff280000(0000) knlGS:0000000000000000
[19394.769864] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[19394.769868] CR2: 0000000002f20000 CR3: 0000000001c0a005 CR4: 00000000000226a0
[19394.769871] Call Trace:
[19394.769875]  <IRQ>
[19394.769879]  ? qdisc_reset+0xe0/0xe0
[19394.769885]  call_timer_fn+0x13/0x80
[19394.769891]  expire_timers+0x70/0x80
[19394.769893]  run_timer_softirq+0x6e/0x120
[19394.769896]  ? __hrtimer_run_queues+0xfd/0x190
[19394.769900]  ? recalibrate_cpu_khz+0x10/0x10
[19394.769902]  ? ktime_get+0x33/0x90
[19394.769905]  ? default_inquire_remote_apic+0x10/0x10
[19394.769908]  ? lapic_next_event+0x17/0x20
[19394.769911]  ? clockevents_program_event+0x7e/0xf0
[19394.769914]  __do_softirq+0xd4/0x1c9
[19394.769917]  irq_exit+0xa3/0xb0
[19394.769919]  smp_apic_timer_interrupt+0x59/0x90
[19394.769921]  apic_timer_interrupt+0xf/0x20
[19394.769922]  </IRQ>
[19394.769927] RIP: 0010:cpuidle_enter_state+0x127/0x200
[19394.769928] RSP: 0018:ffffc900000c3ed0 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
[19394.769930] RAX: ffff880fff29edc0 RBX: 0000000000000003 RCX: 000000000000001f
[19394.769931] RDX: 20c49ba5e353f7cf RSI: 000000003554db01 RDI: 0000000000000000
[19394.769932] RBP: ffff880ff7da7600 R08: 000000000000000f R09: 0000000000000002
[19394.769933] R10: 0000000000000000 R11: 0000000000000040 R12: 000011a3b25c6d63
[19394.769934] R13: 000011a3b19adb11 R14: 0000000000000003 R15: ffff880ff8c9d200
[19394.769942]  do_idle+0x103/0x1d0
[19394.769945]  cpu_startup_entry+0x14/0x20
[19394.769948]  secondary_startup_64+0xa5/0xb0
[19394.769950] Code: 41 00 48 63 4d f0 eb 97 4c 89 e7 c6 05 8b 24 86 00 01 e8 2b 19 fe ff 89 d9 4c 89 e6 48 c7 c7 f8 fc b2 81 48 89 c2 e8 17 4f c5 ff <0f> 0b eb c0 0f 1f 00 48 c7 47 08 00 00 00 00 48 c7 07 00 00 00 
[19394.769990] ---[ end trace 3092c0fa7af64591 ]---
[19394.770010] igb 0000:08:00.0 eth0: Reset adapter
[19397.940296] igb 0000:08:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX

root at Kaa:~# ethtool -k eth0
Features for eth0:
Cannot get device udp-fragmentation-offload settings: Operation not supported
rx-checksumming: on
tx-checksumming: on
        tx-checksum-ipv4: off [fixed]
        tx-checksum-ip-generic: on
        tx-checksum-ipv6: off [fixed]
        tx-checksum-fcoe-crc: off [fixed]
        tx-checksum-sctp: off [fixed]
scatter-gather: on
        tx-scatter-gather: on
        tx-scatter-gather-fraglist: off [fixed]
tcp-segmentation-offload: on
        tx-tcp-segmentation: on
        tx-tcp-ecn-segmentation: off [fixed]
        tx-tcp-mangleid-segmentation: off
        tx-tcp6-segmentation: on
udp-fragmentation-offload: off
generic-segmentation-offload: on
generic-receive-offload: on
large-receive-offload: off [fixed]
rx-vlan-offload: on
tx-vlan-offload: on
ntuple-filters: off [fixed]
receive-hashing: on
highdma: on [fixed]
rx-vlan-filter: on [fixed]
vlan-challenged: off [fixed]
tx-lockless: off [fixed]
netns-local: off [fixed]
tx-gso-robust: off [fixed]
tx-fcoe-segmentation: off [fixed]
tx-gre-segmentation: on
tx-gre-csum-segmentation: on
tx-ipxip4-segmentation: on
tx-ipxip6-segmentation: on
tx-udp_tnl-segmentation: on
tx-udp_tnl-csum-segmentation: on
tx-gso-partial: on
tx-sctp-segmentation: off [fixed]
tx-esp-segmentation: off [fixed]
fcoe-mtu: off [fixed]
tx-nocache-copy: off
loopback: off [fixed]
rx-fcs: off [fixed]
rx-all: off
tx-vlan-stag-hw-insert: off [fixed]
rx-vlan-stag-hw-parse: off [fixed]
rx-vlan-stag-filter: off [fixed]
l2-fwd-offload: off [fixed]
hw-tc-offload: off [fixed]
esp-hw-offload: off [fixed]
esp-tx-csum-hw-offload: off [fixed]
rx-udp_tunnel-port-offload: off [fixed]
rx-gro-hw: off [fixed]
tls-hw-record: off [fixed]
root at Kaa:~# ethtool eth0
Settings for eth0:
        Supported ports: [ TP ]
        Supported link modes:   10baseT/Half 10baseT/Full 
                                100baseT/Half 100baseT/Full 
                                1000baseT/Full 
        Supported pause frame use: Symmetric
        Supports auto-negotiation: Yes
        Advertised link modes:  10baseT/Half 10baseT/Full 
                                100baseT/Half 100baseT/Full 
                                1000baseT/Full 
        Advertised pause frame use: Symmetric
        Advertised auto-negotiation: Yes
        Speed: 1000Mb/s
        Duplex: Full
        Port: Twisted Pair
        PHYAD: 1
        Transceiver: internal
        Auto-negotiation: on
        MDI-X: off (auto)
        Supports Wake-on: pumbg
        Wake-on: g
        Current message level: 0x00000007 (7)
                               drv probe link
        Link detected: yes

^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.17
  2018-06-05  8:12 [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.17 Marco Berizzi
@ 2018-07-05 13:22 ` Marco Berizzi
  2018-07-26 11:56   ` [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17] Marco Berizzi
  0 siblings, 1 reply; 15+ messages in thread
From: Marco Berizzi @ 2018-07-05 13:22 UTC (permalink / raw)
  To: intel-wired-lan

> Il 5 giugno 2018 alle 10.12 Marco Berizzi <pupilla@libero.it> ha scritto:
> 
> Hi Folks,
> 
> after upgrading from 4.16.13 to 4.17 I got this error message.
> 
> Any feedback are welcome.
> 
> Marco Berizzi
> 
> PS: this system is running oracle virtualbox 5.2.12

Hi Folks,

I'm getting the same error also with 4.17.3:

[717164.170363] igb 0000:08:00.0: Detected Tx Unit Hang
                  Tx Queue             <1>
                  TDH                  <e1>
                  TDT                  <e1>
                  next_to_use          <e2>
                  next_to_clean        <e1>
                buffer_info[next_to_clean]
                  time_stamp           <12aba9c00>
                  next_to_watch        <0000000048469c50>
                  jiffies              <12abaa000>
                  desc.status          <a8010>
[717166.154208] igb 0000:08:00.0: Detected Tx Unit Hang
                  Tx Queue             <1>
                  TDH                  <e1>
                  TDT                  <e1>
                  next_to_use          <e2>
                  next_to_clean        <e1>
                buffer_info[next_to_clean]
                  time_stamp           <12aba9c00>
                  next_to_watch        <0000000048469c50>
                  jiffies              <12abaa7c0>
                  desc.status          <a8010>
[717168.139178] igb 0000:08:00.0: Detected Tx Unit Hang
                  Tx Queue             <1>
                  TDH                  <e1>
                  TDT                  <e1>
                  next_to_use          <e2>
                  next_to_clean        <e1>
                buffer_info[next_to_clean]
                  time_stamp           <12aba9c00>
                  next_to_watch        <0000000048469c50>
                  jiffies              <12abaaf81>
                  desc.status          <a8010>
[717170.122069] igb 0000:08:00.0: Detected Tx Unit Hang
                  Tx Queue             <1>
                  TDH                  <e1>
                  TDT                  <e1>
                  next_to_use          <e2>
                  next_to_clean        <e1>
                buffer_info[next_to_clean]
                  time_stamp           <12aba9c00>
                  next_to_watch        <0000000048469c50>
                  jiffies              <12abab740>
                  desc.status          <a8010>
[717172.171042] igb 0000:08:00.0: Detected Tx Unit Hang
                  Tx Queue             <1>
                  TDH                  <e1>
                  TDT                  <e1>
                  next_to_use          <e2>
                  next_to_clean        <e1>
                buffer_info[next_to_clean]
                  time_stamp           <12aba9c00>
                  next_to_watch        <0000000048469c50>
                  jiffies              <12ababf41>
                  desc.status          <a8010>
[717172.362925] ------------[ cut here ]------------
[717172.362930] NETDEV WATCHDOG: eth0 (igb): transmit queue 1 timed out
[717172.362952] WARNING: CPU: 10 PID: 0 at net/sched/sch_generic.c:473 dev_watchdog+0x1d9/0x1e0
[717172.362953] Modules linked in: mousedev hid_generic usbhid hid vboxpci(O) vboxnetflt(O) vboxnetadp(O) vboxdrv(O) igb uhci_hcd 8250 ptp evdev button ehci_pci 8250_base pps_core ehci_hcd i2c_i801 i2c_algo_bit usbcore i2c_core serial_core usb_common loop
[717172.362978] CPU: 10 PID: 0 Comm: swapper/10 Tainted: G          IO      4.17.3 #1
[717172.362979] Hardware name: FUJITSU                          PRIMERGY RX300 S6             /D2619, BIOS 6.00 Rev. 1.13.2619.N1           01/19/2012
[717172.362982] RIP: 0010:dev_watchdog+0x1d9/0x1e0
[717172.362984] RSP: 0018:ffff880fff283ed0 EFLAGS: 00010282
[717172.362986] RAX: 0000000000000037 RBX: 0000000000000001 RCX: 0000000000000006
[717172.362987] RDX: 0000000000000007 RSI: 0000000000000092 RDI: ffff880fff294ff0
[717172.362989] RBP: ffff880ff0cd83b0 R08: 0000000000000001 R09: 00000000000003a5
[717172.362990] R10: ffffffff81c05100 R11: 00000000000003a5 R12: ffff880ff0cd8000
[717172.362992] R13: 000000000000000a R14: 0000000000000002 R15: ffffffff81c05108
[717172.362994] FS:  0000000000000000(0000) GS:ffff880fff280000(0000) knlGS:0000000000000000
[717172.362996] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[717172.362997] CR2: 000007fffffab478 CR3: 0000000001c0a005 CR4: 00000000000226a0
[717172.362998] Call Trace:
[717172.363002]  <IRQ>
[717172.363006]  ? qdisc_reset+0xe0/0xe0
[717172.363011]  call_timer_fn+0x13/0x80
[717172.363015]  expire_timers+0x70/0x80
[717172.363017]  run_timer_softirq+0x6e/0x120
[717172.363020]  ? __hrtimer_run_queues+0x130/0x190
[717172.363024]  ? recalibrate_cpu_khz+0x10/0x10
[717172.363027]  ? ktime_get+0x33/0x90
[717172.363030]  ? default_inquire_remote_apic+0x10/0x10
[717172.363034]  ? lapic_next_event+0x17/0x20
[717172.363037]  ? clockevents_program_event+0x7e/0xf0
[717172.363041]  __do_softirq+0xd4/0x1c9
[717172.363045]  irq_exit+0xa3/0xb0
[717172.363047]  smp_apic_timer_interrupt+0x59/0x90
[717172.363050]  apic_timer_interrupt+0xf/0x20
[717172.363051]  </IRQ>
[717172.363057] RIP: 0010:acpi_idle_do_entry+0x2b/0x40
[717172.363058] RSP: 0018:ffffc900000c3e88 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[717172.363061] RAX: 0000000080000000 RBX: ffff880ff7c07400 RCX: 0000000000000034
[717172.363063] RDX: 4ec4ec4ec4ec4ec5 RSI: ffffffff81c37d20 RDI: ffff880ff7c07464
[717172.363064] RBP: ffff880ff7c07464 R08: ffff880fff29e048 R09: 0000000000000018
[717172.363065] R10: 000000000000009d R11: 00000000000000c8 R12: 0000000000000001
[717172.363067] R13: 0000000000000001 R14: 0000000000000001 R15: ffff880ff8c9d200
[717172.363074]  acpi_idle_enter+0x7d/0x220
[717172.363077]  ? menu_select+0x377/0x530
[717172.363082]  cpuidle_enter_state+0xff/0x200
[717172.363086]  do_idle+0x103/0x1d0
[717172.363088]  cpu_startup_entry+0x14/0x20
[717172.363090]  secondary_startup_64+0xa5/0xb0
[717172.363091] Code: 41 00 48 63 4d f0 eb 97 4c 89 e7 c6 05 eb 2a 86 00 01 e8 5b 19 fe ff 89 d9 4c 89 e6 48 c7 c7 58 fc b2 81 48 89 c2 e8 d7 55 c5 ff <0f> 0b eb c0 0f 1f 00 48 c7 47 08 00 00 00 00 48 c7 07 00 00 00 
[717172.363118] ---[ end trace 43df48974a590f3d ]---
[717172.363130] igb 0000:08:00.0 eth0: Reset adapter
[717175.512405] igb 0000:08:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX

^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
  2018-07-05 13:22 ` Marco Berizzi
@ 2018-07-26 11:56   ` Marco Berizzi
  2018-07-26 14:32     ` Alexander Duyck
  0 siblings, 1 reply; 15+ messages in thread
From: Marco Berizzi @ 2018-07-26 11:56 UTC (permalink / raw)
  To: intel-wired-lan

> Il 5 luglio 2018 alle 15.22 Marco Berizzi <pupilla@libero.it> ha scritto:
> 
> > Il 5 giugno 2018 alle 10.12 Marco Berizzi <pupilla@libero.it> ha scritto:
> > 
> > Hi Folks,
> > 
> > after upgrading from 4.16.13 to 4.17 I got this error message.
> > 
> > Any feedback are welcome.
> > 
> > Marco Berizzi
> > 
> > PS: this system is running oracle virtualbox 5.2.12
> 
> Hi Folks,
> 
> I'm getting the same error also with 4.17.3:

Hi Folks,

I'm getting the same error also with 4.18-r6 (this system is
running oracle virtualbox 5.2.16):

[    0.000000] Linux version 4.18.0-rc6 (root at Kaa) (gcc version 5.5.0 (GCC)) #1 SMP Mon Jul 23 10:55:30 CEST 2018
[    0.000000] Command line: auto BOOT_IMAGE=Linux ro root=802 vt.default_utf8=0
[    0.000000] x86/fpu: x87 FPU will use FXSAVE
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009bfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009c000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e4000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bf69ffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bf6a0000-0x00000000bf6b9fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bf6ba000-0x00000000bf6bafff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bf6bb000-0x00000000bfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fecfffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa00000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000103fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.5 present.
[    0.000000] DMI: FUJITSU                          PRIMERGY RX300 S6             /D2619, BIOS 6.00 Rev. 1.13.2619.N1           01/19/2012
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] last_pfn = 0x1040000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 00C0000000 mask FFC0000000 uncachable
[    0.000000]   1 base 0000000000 mask F000000000 write-back
[    0.000000]   2 base 1000000000 mask FFC0000000 write-back
[    0.000000]   3 disabled
[    0.000000]   4 disabled
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000]   8 disabled
[    0.000000]   9 disabled
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.000000] e820: update [mem 0xc0000000-0xffffffff] usable ==> reserved
[    0.000000] last_pfn = 0xbf6a0 max_arch_pfn = 0x400000000
[    0.000000] Base memory trampoline at [(____ptrval____)] 96000 size 24576
[    0.000000] Using GB pages for direct mapping
[    0.000000] BRK [0x01f5e000, 0x01f5efff] PGTABLE
[    0.000000] BRK [0x01f5f000, 0x01f5ffff] PGTABLE
[    0.000000] BRK [0x01f60000, 0x01f60fff] PGTABLE
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F7EB0 000024 (v02 PTLTD )
[    0.000000] ACPI: XSDT 0x00000000BF6AF6FF 00021C (v01 PTLTD  ? XSDT   00060000  LTP 00000000)
[    0.000000] ACPI: FACP 0x00000000BF6B5883 0000F4 (v03 FSC    TYLERBRG 00060000 PTL  000F4240)
[    0.000000] ACPI: DSDT 0x00000000BF6AF91B 005EE4 (v01 FSC    D2619    00060000 MSFT 03000001)
[    0.000000] ACPI: FACS 0x00000000BF6BAFC0 000040
[    0.000000] ACPI: FACS 0x00000000BF6BAFC0 000040
[    0.000000] ACPI: TCPA 0x00000000BF6B5977 000032 (v01 Phoeni x        00060000 TL   00000000)
[    0.000000] ACPI: SLIT 0x00000000BF6B59A9 000030 (v01 FSC             00060000      0000005A)
[    0.000000] ACPI: SRAT 0x00000000BF6B59D9 000228 (v01 Intel  Tylerbrg 00060000 PHX. 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5C01 0000D8 (v01 FSC    CST_PR00 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5CD9 0000D8 (v01 FSC    CST_PR01 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5DB1 0000D8 (v01 FSC    CST_PR02 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5E89 0000D8 (v01 FSC    CST_PR03 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5F61 0000D8 (v01 FSC    CST_PR04 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6039 0000D8 (v01 FSC    CST_PR05 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6111 0000D8 (v01 FSC    CST_PR10 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B61E9 0000D8 (v01 FSC    CST_PR11 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B62C1 0000D8 (v01 FSC    CST_PR12 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6399 0000D8 (v01 FSC    CST_PR13 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6471 0000D8 (v01 FSC    CST_PR14 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6549 0000D8 (v01 FSC    CST_PR15 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6621 0000D8 (v01 FSC    CST_PR20 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B66F9 0000D8 (v01 FSC    CST_PR21 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B67D1 0000D8 (v01 FSC    CST_PR22 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B68A9 0000D8 (v01 FSC    CST_PR23 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6981 0000D8 (v01 FSC    CST_PR24 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6A59 0000D8 (v01 FSC    CST_PR25 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6B31 0000D8 (v01 FSC    CST_PR30 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6C09 0000D8 (v01 FSC    CST_PR31 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6CE1 0000D8 (v01 FSC    CST_PR32 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6DB9 0000D8 (v01 FSC    CST_PR33 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6E91 0000D8 (v01 FSC    CST_PR34 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6F69 0000D8 (v01 FSC    CST_PR35 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7041 00017C (v01 FSC    PST_PR00 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B71BD 00017C (v01 FSC    PST_PR01 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7339 00017C (v01 FSC    PST_PR02 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B74B5 00017C (v01 FSC    PST_PR03 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7631 00017C (v01 FSC    PST_PR04 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B77AD 00017C (v01 FSC    PST_PR05 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7929 00017C (v01 FSC    PST_PR10 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7AA5 00017C (v01 FSC    PST_PR11 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7C21 00017C (v01 FSC    PST_PR12 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7D9D 00017C (v01 FSC    PST_PR13 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7F19 00017C (v01 FSC    PST_PR14 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8095 00017C (v01 FSC    PST_PR15 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8211 00017C (v01 FSC    PST_PR20 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B838D 00017C (v01 FSC    PST_PR21 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8509 00017C (v01 FSC    PST_PR22 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8685 00017C (v01 FSC    PST_PR23 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8801 00017C (v01 FSC    PST_PR24 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B897D 00017C (v01 FSC    PST_PR25 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8AF9 00017C (v01 FSC    PST_PR30 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8C75 00017C (v01 FSC    PST_PR31 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8DF1 00017C (v01 FSC    PST_PR32 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8F6D 00017C (v01 FSC    PST_PR33 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B90E9 00017C (v01 FSC    PST_PR34 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B9265 00017C (v01 FSC    PST_PR35 00060000  CSF 00000001)
[    0.000000] ACPI: EINJ 0x00000000BF6B93E1 0001B0 (v01 PTL    WHEAPTL  00060000 PTL  00000001)
[    0.000000] ACPI: HEST 0x00000000BF6B9591 000268 (v01 PTL    WHEAPTL  00060000 PTL  00000001)
[    0.000000] ACPI: BERT 0x00000000BF6B97F9 000030 (v01 PTL    WHEAPTL  00060000 PTL  00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B9829 0000EB (v01 wheaos wheaosc  00060000 MSFT 03000001)
[    0.000000] ACPI: ERST 0x00000000BF6B9914 000270 (v01 PTL    WHEAPTL  00060000 PTL  00000001)
[    0.000000] ACPI: SPCR 0x00000000BF6B9B84 000050 (v01 PTLTD  $UCRTBL$ 00060000 PTL  00000001)
[    0.000000] ACPI: DMAR 0x00000000BF6B9BD4 0001E8 (v01 Intel  OEMDMAR  00060000 LOHR 00000001)
[    0.000000] ACPI: MCFG 0x00000000BF6B9DBC 00003C (v01 PTLTD    MCFG   00060000  LTP 00000000)
[    0.000000] ACPI: HPET 0x00000000BF6B9DF8 000038 (v01 PTLTD  HPETTBL  00060000  LTP 00000001)
[    0.000000] ACPI: APIC 0x00000000BF6B9E30 0001A8 (v01 PTLTD  ? APIC   00060000  LTP 00000000)
[    0.000000] ACPI: BOOT 0x00000000BF6B9FD8 000028 (v01 PTLTD  $SBFTBL$ 00060000  LTP 00000001)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000103fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009bfff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x00000000bf69ffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x000000103fffffff]
[    0.000000] Reserved but unavailable: 2501 pages
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000103fffffff]
[    0.000000] On node 0 totalpages: 16774715
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 21 pages reserved
[    0.000000]   DMA zone: 3995 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 12187 pages used for memmap
[    0.000000]   DMA32 zone: 779936 pages, LIFO batch:31
[    0.000000]   Normal zone: 249856 pages used for memmap
[    0.000000]   Normal zone: 15990784 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x1008
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x09] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0a] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0b] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0c] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0d] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0e] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0f] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x10] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x11] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x12] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x13] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x14] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x15] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x16] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x17] high edge lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 6, version 32, address 0xfec00000, GSI 0-23
[    0.000000] IOAPIC[1]: apic_id 7, version 32, address 0xfec80000, GSI 24-47
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[    0.000000] ACPI: SPCR: SPCR table version 1
[    0.000000] ACPI: SPCR: Unexpected SPCR Access Width.  Defaulting to byte size
[    0.000000] smpboot: Allowing 24 CPUs, 0 hotplug CPUs
[    0.000000] [mem 0xc0000000-0xdfffffff] available for PCI devices
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.000000] random: get_random_bytes called from start_kernel+0x86/0x39f with crng_init=0
[    0.000000] setup_percpu: NR_CPUS:24 nr_cpumask_bits:24 nr_cpu_ids:24 nr_node_ids:1
[    0.000000] percpu: Embedded 41 pages/cpu @(____ptrval____) s130776 r8192 d28968 u262144
[    0.000000] pcpu-alloc: s130776 r8192 d28968 u262144 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15 
[    0.000000] pcpu-alloc: [0] 16 17 18 19 20 21 22 23 
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 16512587
[    0.000000] Kernel command line: auto BOOT_IMAGE=Linux ro root=802 vt.default_utf8=0
[    0.000000] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[    0.000000] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.000000] Memory: 65866172K/67098860K available (8200K kernel code, 343K rwdata, 1484K rodata, 780K init, 452K bss, 1232688K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=24, Nodes=1
[    0.000000] Kernel/User page tables isolation: enabled
[    0.000000] Hierarchical RCU implementation.
[    0.000000] NR_IRQS: 4352, nr_irqs: 1024, preallocated irqs: 16
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] ACPI: Core revision 20180531
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[    0.000000] hpet clockevent registered
[    0.000000] APIC: Switch to symmetric I/O mode setup
[    0.000000] DMAR-IR: This system BIOS has enabled interrupt remapping
               on a chipset that contains an erratum making that
               feature unstable.  To maintain system stability
               interrupt remapping is being disabled.  Please
               contact your BIOS vendor for an update
[    0.000000] Switched APIC routing to physical flat.
[    0.000000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.005000] tsc: Fast TSC calibration using PIT
[    0.006000] tsc: Detected 2400.204 MHz processor
[    0.007000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2298f808ae0, max_idle_ns: 440795257023 ns
[    0.007000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4800.40 BogoMIPS (lpj=2400204)
[    0.007000] pid_max: default: 32768 minimum: 301
[    0.007000] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.008232] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.008497] CPU: Physical Processor ID: 0
[    0.008590] CPU: Processor Core ID: 0
[    0.008687] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[    0.008787] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[    0.008894] process: using mwait in idle threads
[    0.008991] Last level iTLB entries: 4KB 512, 2MB 7, 4MB 7
[    0.009001] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0
[    0.009103] Spectre V2 : Mitigation: Full generic retpoline
[    0.009202] Speculative Store Bypass: Vulnerable
[    0.009374] Freeing SMP alternatives memory: 20K
[    0.011000] smpboot: CPU0: Intel(R) Xeon(R) CPU           E5645  @ 2.40GHz (family: 0x6, model: 0x2c, stepping: 0x2)
[    0.011000] Performance Events: PEBS fmt1+, Westmere events, 16-deep LBR, Intel PMU driver.
[    0.011000] core: CPUID marked event: 'bus cycles' unavailable
[    0.011000] ... version:                3
[    0.011000] ... bit width:              48
[    0.011000] ... generic registers:      4
[    0.011000] ... value mask:             0000ffffffffffff
[    0.011000] ... max period:             000000007fffffff
[    0.011000] ... fixed-purpose events:   3
[    0.011002] ... event mask:             000000070000000f
[    0.011149] Hierarchical SRCU implementation.
[    0.011530] smp: Bringing up secondary CPUs ...
[    0.011695] x86: Booting SMP configuration:
[    0.011790] .... node  #0, CPUs:        #1  #2  #3  #4  #5  #6  #7  #8  #9 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20 #21 #22 #23
[    0.113047] smp: Brought up 1 node, 24 CPUs
[    0.113249] smpboot: Max logical packages: 2
[    0.113344] smpboot: Total of 24 processors activated (115203.72 BogoMIPS)
[    0.115449] devtmpfs: initialized
[    0.115449] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    0.115449] futex hash table entries: 8192 (order: 7, 524288 bytes)
[    0.116124] xor: measuring software checksum speed
[    0.126002]    prefetch64-sse: 12920.000 MB/sec
[    0.136001]    generic_sse: 10992.000 MB/sec
[    0.136095] xor: using function: prefetch64-sse (12920.000 MB/sec)
[    0.137558] NET: Registered protocol family 16
[    0.137774] cpuidle: using governor ladder
[    0.137774] cpuidle: using governor menu
[    0.138116] Simple Boot Flag at 0x7c set to 0x1
[    0.138220] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    0.138326] ACPI: bus type PCI registered
[    0.138430] PCI: MMCONFIG for domain 0000 [bus 00-0a] at [mem 0xe0000000-0xe0afffff] (base 0xe0000000)
[    0.138568] PCI: MMCONFIG at [mem 0xe0000000-0xe0afffff] reserved in E820
[    0.138678] pmd_set_huge: Cannot satisfy [mem 0xe0000000-0xe0200000] with a huge-page mapping due to MTRR override.
[    0.138833] PCI: Using configuration type 1 for base access
[    0.157003] raid6: sse2x1   gen()  5921 MB/s
[    0.174004] raid6: sse2x1   xor()  4660 MB/s
[    0.191007] raid6: sse2x2   gen()  6988 MB/s
[    0.208006] raid6: sse2x2   xor()  5527 MB/s
[    0.225008] raid6: sse2x4   gen()  7851 MB/s
[    0.242006] raid6: sse2x4   xor()  6214 MB/s
[    0.242100] raid6: using algorithm sse2x4 gen() 7851 MB/s
[    0.242199] raid6: .... xor() 6214 MB/s, rmw enabled
[    0.242296] raid6: using ssse3x2 recovery algorithm
[    0.242463] ACPI: Added _OSI(Module Device)
[    0.242557] ACPI: Added _OSI(Processor Device)
[    0.242652] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.242748] ACPI: Added _OSI(Processor Aggregator Device)
[    0.242846] ACPI: Added _OSI(Linux-Dell-Video)
[    0.247285] ACPI: 50 ACPI AML tables successfully acquired and loaded
[    0.261673] ACPI: Interpreter enabled
[    0.261770] ACPI: (supports S0 S5)
[    0.261862] ACPI: Using IOAPIC for interrupt routing
[    0.261981] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.262131] ACPI: Enabled 10 GPEs in block 00 to 3F
[    0.266253] ACPI: PCI Root Bridge [CPU0] (domain 0000 [bus ff])
[    0.266357] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.266469] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.266573] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[    0.266743] PCI host bridge to bus 0000:ff
[    0.266839] pci_bus 0000:ff: root bus resource [bus ff]
[    0.266943] pci 0000:ff:00.0: [8086:2c70] type 00 class 0x060000
[    0.267009] pci 0000:ff:00.1: [8086:2d81] type 00 class 0x060000
[    0.267038] pci 0000:ff:02.0: [8086:2d90] type 00 class 0x060000
[    0.267076] pci 0000:ff:02.1: [8086:2d91] type 00 class 0x060000
[    0.267113] pci 0000:ff:02.2: [8086:2d92] type 00 class 0x060000
[    0.267152] pci 0000:ff:02.3: [8086:2d93] type 00 class 0x060000
[    0.267190] pci 0000:ff:02.4: [8086:2d94] type 00 class 0x060000
[    0.267228] pci 0000:ff:02.5: [8086:2d95] type 00 class 0x060000
[    0.267266] pci 0000:ff:03.0: [8086:2d98] type 00 class 0x060000
[    0.267304] pci 0000:ff:03.1: [8086:2d99] type 00 class 0x060000
[    0.267347] pci 0000:ff:03.2: [8086:2d9a] type 00 class 0x060000
[    0.267386] pci 0000:ff:03.4: [8086:2d9c] type 00 class 0x060000
[    0.267426] pci 0000:ff:04.0: [8086:2da0] type 00 class 0x060000
[    0.268008] pci 0000:ff:04.1: [8086:2da1] type 00 class 0x060000
[    0.268008] pci 0000:ff:04.2: [8086:2da2] type 00 class 0x060000
[    0.268008] pci 0000:ff:04.3: [8086:2da3] type 00 class 0x060000
[    0.268009] pci 0000:ff:05.0: [8086:2da8] type 00 class 0x060000
[    0.268011] pci 0000:ff:05.1: [8086:2da9] type 00 class 0x060000
[    0.268011] pci 0000:ff:05.2: [8086:2daa] type 00 class 0x060000
[    0.268011] pci 0000:ff:05.3: [8086:2dab] type 00 class 0x060000
[    0.268011] pci 0000:ff:06.0: [8086:2db0] type 00 class 0x060000
[    0.268011] pci 0000:ff:06.1: [8086:2db1] type 00 class 0x060000
[    0.268011] pci 0000:ff:06.2: [8086:2db2] type 00 class 0x060000
[    0.268011] pci 0000:ff:06.3: [8086:2db3] type 00 class 0x060000
[    0.268011] pci_bus 0000:ff: on NUMA node 0
[    0.268011] ACPI: PCI Root Bridge [CPU1] (domain 0000 [bus fe])
[    0.268011] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.268115] acpi PNP0A03:01: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.268218] acpi PNP0A03:01: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[    0.268387] PCI host bridge to bus 0000:fe
[    0.268482] pci_bus 0000:fe: root bus resource [bus fe]
[    0.268584] pci 0000:fe:00.0: [8086:2c70] type 00 class 0x060000
[    0.269009] pci 0000:fe:00.1: [8086:2d81] type 00 class 0x060000
[    0.269009] pci 0000:fe:02.0: [8086:2d90] type 00 class 0x060000
[    0.269010] pci 0000:fe:02.1: [8086:2d91] type 00 class 0x060000
[    0.269010] pci 0000:fe:02.2: [8086:2d92] type 00 class 0x060000
[    0.269010] pci 0000:fe:02.3: [8086:2d93] type 00 class 0x060000
[    0.269010] pci 0000:fe:02.4: [8086:2d94] type 00 class 0x060000
[    0.269010] pci 0000:fe:02.5: [8086:2d95] type 00 class 0x060000
[    0.269010] pci 0000:fe:03.0: [8086:2d98] type 00 class 0x060000
[    0.269010] pci 0000:fe:03.1: [8086:2d99] type 00 class 0x060000
[    0.269018] pci 0000:fe:03.2: [8086:2d9a] type 00 class 0x060000
[    0.269060] pci 0000:fe:03.4: [8086:2d9c] type 00 class 0x060000
[    0.269101] pci 0000:fe:04.0: [8086:2da0] type 00 class 0x060000
[    0.269142] pci 0000:fe:04.1: [8086:2da1] type 00 class 0x060000
[    0.269183] pci 0000:fe:04.2: [8086:2da2] type 00 class 0x060000
[    0.269223] pci 0000:fe:04.3: [8086:2da3] type 00 class 0x060000
[    0.269265] pci 0000:fe:05.0: [8086:2da8] type 00 class 0x060000
[    0.269306] pci 0000:fe:05.1: [8086:2da9] type 00 class 0x060000
[    0.269347] pci 0000:fe:05.2: [8086:2daa] type 00 class 0x060000
[    0.269392] pci 0000:fe:05.3: [8086:2dab] type 00 class 0x060000
[    0.269435] pci 0000:fe:06.0: [8086:2db0] type 00 class 0x060000
[    0.270008] pci 0000:fe:06.1: [8086:2db1] type 00 class 0x060000
[    0.270009] pci 0000:fe:06.2: [8086:2db2] type 00 class 0x060000
[    0.270009] pci 0000:fe:06.3: [8086:2db3] type 00 class 0x060000
[    0.270010] pci_bus 0000:fe: on NUMA node 0
[    0.270010] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3d])
[    0.270010] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.270010] acpi PNP0A08:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.270010] acpi PNP0A08:00: [Firmware Info]: MMCONFIG for domain 0000 [bus 00-0a] only partially covers this bridge
[    0.270069] PCI host bridge to bus 0000:00
[    0.270165] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.270269] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.270373] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.270478] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000dffff window]
[    0.270584] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xdfffffff window]
[    0.270690] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfebfffff window]
[    0.270796] pci_bus 0000:00: root bus resource [mem 0xfed00000-0xfedfffff window]
[    0.271002] pci_bus 0000:00: root bus resource [mem 0xfef00000-0xffbfffff window]
[    0.271108] pci_bus 0000:00: root bus resource [bus 00-3d]
[    0.271216] pci 0000:00:00.0: [8086:3406] type 00 class 0x060000
[    0.271248] pci 0000:00:00.0: enabling Extended Tags
[    0.271376] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    0.271453] pci 0000:00:01.0: [8086:3408] type 01 class 0x060400
[    0.271482] pci 0000:00:01.0: enabling Extended Tags
[    0.271613] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    0.272012] pci 0000:00:03.0: [8086:340a] type 01 class 0x060400
[    0.272012] pci 0000:00:03.0: enabling Extended Tags
[    0.272012] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    0.272012] pci 0000:00:05.0: [8086:340c] type 01 class 0x060400
[    0.272012] pci 0000:00:05.0: enabling Extended Tags
[    0.272034] pci 0000:00:05.0: PME# supported from D0 D3hot D3cold
[    0.272110] pci 0000:00:07.0: [8086:340e] type 01 class 0x060400
[    0.272139] pci 0000:00:07.0: enabling Extended Tags
[    0.272269] pci 0000:00:07.0: PME# supported from D0 D3hot D3cold
[    0.272347] pci 0000:00:08.0: [8086:340f] type 01 class 0x060400
[    0.272374] pci 0000:00:08.0: enabling Extended Tags
[    0.272503] pci 0000:00:08.0: PME# supported from D0 D3hot D3cold
[    0.273009] pci 0000:00:09.0: [8086:3410] type 01 class 0x060400
[    0.273009] pci 0000:00:09.0: enabling Extended Tags
[    0.273009] pci 0000:00:09.0: PME# supported from D0 D3hot D3cold
[    0.273010] pci 0000:00:0a.0: [8086:3411] type 01 class 0x060400
[    0.273010] pci 0000:00:0a.0: enabling Extended Tags
[    0.273034] pci 0000:00:0a.0: PME# supported from D0 D3hot D3cold
[    0.273111] pci 0000:00:10.0: [8086:3425] type 00 class 0x080000
[    0.273209] pci 0000:00:10.1: [8086:3426] type 00 class 0x080000
[    0.273302] pci 0000:00:11.0: [8086:3427] type 00 class 0x080000
[    0.273403] pci 0000:00:11.1: [8086:3428] type 00 class 0x080000
[    0.274011] pci 0000:00:14.0: [8086:342e] type 00 class 0x080000
[    0.274011] pci 0000:00:14.1: [8086:3422] type 00 class 0x080000
[    0.274011] pci 0000:00:14.2: [8086:3423] type 00 class 0x080000
[    0.274011] pci 0000:00:14.3: [8086:3438] type 00 class 0x080000
[    0.274013] pci 0000:00:15.0: [8086:342f] type 00 class 0x080020
[    0.274032] pci 0000:00:1a.0: [8086:3a37] type 00 class 0x0c0300
[    0.274075] pci 0000:00:1a.0: reg 0x20: [io  0x1820-0x183f]
[    0.274170] pci 0000:00:1a.1: [8086:3a38] type 00 class 0x0c0300
[    0.274212] pci 0000:00:1a.1: reg 0x20: [io  0x1840-0x185f]
[    0.274308] pci 0000:00:1a.2: [8086:3a39] type 00 class 0x0c0300
[    0.274350] pci 0000:00:1a.2: reg 0x20: [io  0x1860-0x187f]
[    0.274454] pci 0000:00:1a.7: [8086:3a3c] type 00 class 0x0c0320
[    0.274475] pci 0000:00:1a.7: reg 0x10: [mem 0xce000000-0xce0003ff]
[    0.274554] pci 0000:00:1a.7: PME# supported from D0 D3hot D3cold
[    0.275009] pci 0000:00:1c.0: [8086:3a40] type 01 class 0x060400
[    0.275009] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    0.275011] pci 0000:00:1c.4: [8086:3a48] type 01 class 0x060400
[    0.275011] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[    0.275011] pci 0000:00:1d.0: [8086:3a34] type 00 class 0x0c0300
[    0.275011] pci 0000:00:1d.0: reg 0x20: [io  0x1880-0x189f]
[    0.275066] pci 0000:00:1d.1: [8086:3a35] type 00 class 0x0c0300
[    0.275109] pci 0000:00:1d.1: reg 0x20: [io  0x18a0-0x18bf]
[    0.275205] pci 0000:00:1d.2: [8086:3a36] type 00 class 0x0c0300
[    0.275248] pci 0000:00:1d.2: reg 0x20: [io  0x18c0-0x18df]
[    0.275350] pci 0000:00:1d.7: [8086:3a3a] type 00 class 0x0c0320
[    0.275371] pci 0000:00:1d.7: reg 0x10: [mem 0xce001000-0xce0013ff]
[    0.275451] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[    0.275521] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
[    0.276010] pci 0000:00:1f.0: [8086:3a18] type 00 class 0x060100
[    0.276010] pci 0000:00:1f.2: [8086:3a20] type 00 class 0x01018f
[    0.276010] pci 0000:00:1f.2: reg 0x10: [io  0x1c50-0x1c57]
[    0.276010] pci 0000:00:1f.2: reg 0x14: [io  0x1c44-0x1c47]
[    0.276010] pci 0000:00:1f.2: reg 0x18: [io  0x1c48-0x1c4f]
[    0.276010] pci 0000:00:1f.2: reg 0x1c: [io  0x1c40-0x1c43]
[    0.276010] pci 0000:00:1f.2: reg 0x20: [io  0x1c10-0x1c1f]
[    0.276010] pci 0000:00:1f.2: reg 0x24: [io  0x1c00-0x1c0f]
[    0.276011] pci 0000:00:1f.3: [8086:3a30] type 00 class 0x0c0500
[    0.276011] pci 0000:00:1f.3: reg 0x10: [mem 0xce002000-0xce0020ff 64bit]
[    0.276011] pci 0000:00:1f.3: reg 0x20: [io  0x18e0-0x18ff]
[    0.276055] pci 0000:00:1f.5: [8086:3a26] type 00 class 0x010185
[    0.276071] pci 0000:00:1f.5: reg 0x10: [io  0x1c68-0x1c6f]
[    0.276078] pci 0000:00:1f.5: reg 0x14: [io  0x1c5c-0x1c5f]
[    0.276085] pci 0000:00:1f.5: reg 0x18: [io  0x1c60-0x1c67]
[    0.276092] pci 0000:00:1f.5: reg 0x1c: [io  0x1c58-0x1c5b]
[    0.276099] pci 0000:00:1f.5: reg 0x20: [io  0x1c30-0x1c3f]
[    0.276106] pci 0000:00:1f.5: reg 0x24: [io  0x1c20-0x1c2f]
[    0.276229] pci 0000:01:00.0: [1000:0079] type 00 class 0x010400
[    0.276244] pci 0000:01:00.0: reg 0x10: [io  0x2000-0x20ff]
[    0.276253] pci 0000:01:00.0: reg 0x14: [mem 0xce100000-0xce103fff 64bit]
[    0.276263] pci 0000:01:00.0: reg 0x1c: [mem 0xce180000-0xce1bffff 64bit]
[    0.276275] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0003ffff pref]
[    0.276281] pci 0000:01:00.0: enabling Extended Tags
[    0.276414] pci 0000:01:00.0: supports D1 D2
[    0.276465] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.276564] pci 0000:00:01.0:   bridge window [io  0x2000-0x2fff]
[    0.276567] pci 0000:00:01.0:   bridge window [mem 0xce100000-0xce1fffff]
[    0.277012] pci 0000:00:03.0: PCI bridge to [bus 02]
[    0.277012] pci 0000:00:05.0: PCI bridge to [bus 03]
[    0.277012] pci 0000:00:07.0: PCI bridge to [bus 04]
[    0.277012] pci 0000:00:08.0: PCI bridge to [bus 05]
[    0.277035] pci 0000:00:09.0: PCI bridge to [bus 06]
[    0.277165] pci 0000:00:0a.0: PCI bridge to [bus 07]
[    0.277316] pci 0000:08:00.0: [8086:10a7] type 00 class 0x020000
[    0.277342] pci 0000:08:00.0: reg 0x10: [mem 0xce260000-0xce27ffff]
[    0.277353] pci 0000:08:00.0: reg 0x14: [mem 0xce240000-0xce25ffff]
[    0.277363] pci 0000:08:00.0: reg 0x18: [io  0x3000-0x301f]
[    0.277374] pci 0000:08:00.0: reg 0x1c: [mem 0xce200000-0xce203fff]
[    0.277403] pci 0000:08:00.0: reg 0x30: [mem 0x00000000-0x0001ffff pref]
[    0.277470] pci 0000:08:00.0: PME# supported from D0 D3hot D3cold
[    0.277544] pci 0000:08:00.1: [8086:10a7] type 00 class 0x020000
[    0.277569] pci 0000:08:00.1: reg 0x10: [mem 0xce2c0000-0xce2dffff]
[    0.277580] pci 0000:08:00.1: reg 0x14: [mem 0xce2a0000-0xce2bffff]
[    0.277591] pci 0000:08:00.1: reg 0x18: [io  0x3020-0x303f]
[    0.277602] pci 0000:08:00.1: reg 0x1c: [mem 0xce204000-0xce207fff]
[    0.277631] pci 0000:08:00.1: reg 0x30: [mem 0x00000000-0x0001ffff pref]
[    0.277696] pci 0000:08:00.1: PME# supported from D0 D3hot D3cold
[    0.278009] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    0.278009] pci 0000:00:1c.0:   bridge window [io  0x3000-0x3fff]
[    0.278009] pci 0000:00:1c.0:   bridge window [mem 0xce200000-0xce2fffff]
[    0.278033] pci 0000:09:00.0: [102b:0522] type 00 class 0x030000
[    0.278065] pci 0000:09:00.0: reg 0x10: [mem 0xcf000000-0xcfffffff pref]
[    0.278079] pci 0000:09:00.0: reg 0x14: [mem 0xce300000-0xce303fff]
[    0.278093] pci 0000:09:00.0: reg 0x18: [mem 0xce800000-0xceffffff]
[    0.278287] pci 0000:00:1c.4: PCI bridge to [bus 09]
[    0.278389] pci 0000:00:1c.4:   bridge window [mem 0xce300000-0xceffffff]
[    0.278394] pci 0000:00:1c.4:   bridge window [mem 0xcf000000-0xcfffffff 64bit pref]
[    0.278411] pci_bus 0000:0a: extended config space not accessible
[    0.278557] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    0.278667] pci 0000:00:1e.0:   bridge window [io  0x0000-0x0cf7 window] (subtractive decode)
[    0.278669] pci 0000:00:1e.0:   bridge window [io  0x0d00-0xffff window] (subtractive decode)
[    0.278671] pci 0000:00:1e.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    0.278672] pci 0000:00:1e.0:   bridge window [mem 0x000c8000-0x000dffff window] (subtractive decode)
[    0.278674] pci 0000:00:1e.0:   bridge window [mem 0xc0000000-0xdfffffff window] (subtractive decode)
[    0.278675] pci 0000:00:1e.0:   bridge window [mem 0xf0000000-0xfebfffff window] (subtractive decode)
[    0.278677] pci 0000:00:1e.0:   bridge window [mem 0xfed00000-0xfedfffff window] (subtractive decode)
[    0.278678] pci 0000:00:1e.0:   bridge window [mem 0xfef00000-0xffbfffff window] (subtractive decode)
[    0.278725] pci_bus 0000:00: on NUMA node 0
[    0.278886] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    0.279049] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    0.279205] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 *9 10 11 12 14 15)
[    0.279362] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 *10 11 12 14 15)
[    0.279513] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[    0.279674] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    0.279831] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    0.279988] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 *5 6 7 9 10 11 12 14 15)
[    0.281019] pci 0000:09:00.0: vgaarb: setting as boot VGA device
[    0.282000] pci 0000:09:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.282004] pci 0000:09:00.0: vgaarb: bridge control possible
[    0.282103] vgaarb: loaded
[    0.282309] SCSI subsystem initialized
[    0.283014] PCI: Using ACPI for IRQ routing
[    0.283014] PCI: pci_cache_line_size set to 64 bytes
[    0.283014] Expanded resource Reserved due to conflict with PCI Bus 0000:00
[    0.283014] e820: reserve RAM buffer [mem 0x0009c000-0x0009ffff]
[    0.283014] e820: reserve RAM buffer [mem 0xbf6a0000-0xbfffffff]
[    0.283026] clocksource: Switched to clocksource tsc-early
[    0.283168] pnp: PnP ACPI init
[    0.283369] system 00:00: [mem 0xe0000000-0xefffffff] has been reserved
[    0.283478] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.283768] system 00:01: [io  0x0200-0x020f] has been reserved
[    0.283870] system 00:01: [io  0x04d0-0x04d1] has been reserved
[    0.283971] system 00:01: [io  0x0500-0x057f] has been reserved
[    0.284071] system 00:01: [io  0x0800-0x080f] has been reserved
[    0.284176] system 00:01: [io  0x0810-0x081f] has been reserved
[    0.284277] system 00:01: [io  0x0ca0-0x0ca1] has been reserved
[    0.284377] system 00:01: [io  0x0ca4-0x0ca7] has been reserved
[    0.284478] system 00:01: [io  0x0ca8-0x0cab] has been reserved
[    0.284579] system 00:01: [io  0x0cae-0x0caf] has been reserved
[    0.284680] system 00:01: [io  0x0e00-0x0e7f] has been reserved
[    0.284780] system 00:01: [io  0x1000-0x107f] has been reserved
[    0.284881] system 00:01: [io  0x1100-0x110f] has been reserved
[    0.284982] system 00:01: [io  0x1180-0x11ff] has been reserved
[    0.285084] system 00:01: [io  0xfe00] has been reserved
[    0.285183] system 00:01: [io  0xff00] has been reserved
[    0.285282] system 00:01: [mem 0xfec00000-0xfecfffff] could not be reserved
[    0.285386] system 00:01: [mem 0xfee00000-0xfeefffff] could not be reserved
[    0.285491] system 00:01: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    0.285598] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.285628] pnp 00:02: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.285825] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.285966] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.286016] pnp: PnP ACPI: found 5 devices
[    0.291583] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.291769] pci 0000:00:1c.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 08] add_size 200000 add_align 100000
[    0.291776] pci 0000:00:1c.4: bridge window [io  0x1000-0x0fff] to [bus 09] add_size 1000
[    0.291797] pci 0000:00:1c.0: BAR 9: assigned [mem 0xc0000000-0xc01fffff 64bit pref]
[    0.291905] pci 0000:00:1c.4: BAR 7: assigned [io  0x4000-0x4fff]
[    0.292008] pci 0000:01:00.0: BAR 6: assigned [mem 0xce140000-0xce17ffff pref]
[    0.292115] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.292213] pci 0000:00:01.0:   bridge window [io  0x2000-0x2fff]
[    0.292316] pci 0000:00:01.0:   bridge window [mem 0xce100000-0xce1fffff]
[    0.292423] pci 0000:00:03.0: PCI bridge to [bus 02]
[    0.292526] pci 0000:00:05.0: PCI bridge to [bus 03]
[    0.292629] pci 0000:00:07.0: PCI bridge to [bus 04]
[    0.292732] pci 0000:00:08.0: PCI bridge to [bus 05]
[    0.292835] pci 0000:00:09.0: PCI bridge to [bus 06]
[    0.292938] pci 0000:00:0a.0: PCI bridge to [bus 07]
[    0.293042] pci 0000:08:00.0: BAR 6: assigned [mem 0xce220000-0xce23ffff pref]
[    0.293150] pci 0000:08:00.1: BAR 6: assigned [mem 0xce280000-0xce29ffff pref]
[    0.293254] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    0.293352] pci 0000:00:1c.0:   bridge window [io  0x3000-0x3fff]
[    0.293457] pci 0000:00:1c.0:   bridge window [mem 0xce200000-0xce2fffff]
[    0.293562] pci 0000:00:1c.0:   bridge window [mem 0xc0000000-0xc01fffff 64bit pref]
[    0.293672] pci 0000:00:1c.4: PCI bridge to [bus 09]
[    0.293769] pci 0000:00:1c.4:   bridge window [io  0x4000-0x4fff]
[    0.293873] pci 0000:00:1c.4:   bridge window [mem 0xce300000-0xceffffff]
[    0.293978] pci 0000:00:1c.4:   bridge window [mem 0xcf000000-0xcfffffff 64bit pref]
[    0.294089] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    0.294194] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    0.294196] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    0.294197] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.294199] pci_bus 0000:00: resource 7 [mem 0x000c8000-0x000dffff window]
[    0.294200] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xdfffffff window]
[    0.294202] pci_bus 0000:00: resource 9 [mem 0xf0000000-0xfebfffff window]
[    0.294203] pci_bus 0000:00: resource 10 [mem 0xfed00000-0xfedfffff window]
[    0.294205] pci_bus 0000:00: resource 11 [mem 0xfef00000-0xffbfffff window]
[    0.294206] pci_bus 0000:01: resource 0 [io  0x2000-0x2fff]
[    0.294208] pci_bus 0000:01: resource 1 [mem 0xce100000-0xce1fffff]
[    0.294210] pci_bus 0000:08: resource 0 [io  0x3000-0x3fff]
[    0.294211] pci_bus 0000:08: resource 1 [mem 0xce200000-0xce2fffff]
[    0.294213] pci_bus 0000:08: resource 2 [mem 0xc0000000-0xc01fffff 64bit pref]
[    0.294214] pci_bus 0000:09: resource 0 [io  0x4000-0x4fff]
[    0.294216] pci_bus 0000:09: resource 1 [mem 0xce300000-0xceffffff]
[    0.294217] pci_bus 0000:09: resource 2 [mem 0xcf000000-0xcfffffff 64bit pref]
[    0.294219] pci_bus 0000:0a: resource 4 [io  0x0000-0x0cf7 window]
[    0.294220] pci_bus 0000:0a: resource 5 [io  0x0d00-0xffff window]
[    0.294222] pci_bus 0000:0a: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.294223] pci_bus 0000:0a: resource 7 [mem 0x000c8000-0x000dffff window]
[    0.294225] pci_bus 0000:0a: resource 8 [mem 0xc0000000-0xdfffffff window]
[    0.294226] pci_bus 0000:0a: resource 9 [mem 0xf0000000-0xfebfffff window]
[    0.294228] pci_bus 0000:0a: resource 10 [mem 0xfed00000-0xfedfffff window]
[    0.294229] pci_bus 0000:0a: resource 11 [mem 0xfef00000-0xffbfffff window]
[    0.294293] NET: Registered protocol family 2
[    0.294507] tcp_listen_portaddr_hash hash table entries: 32768 (order: 7, 524288 bytes)
[    0.294736] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.295822] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.296166] TCP: Hash tables configured (established 524288 bind 65536)
[    0.296346] UDP hash table entries: 32768 (order: 8, 1048576 bytes)
[    0.296688] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes)
[    0.297104] NET: Registered protocol family 1
[    0.300223] pci 0000:08:00.0: Disabling L0s
[    0.300319] pci 0000:08:00.0: can't disable ASPM; OS doesn't have ASPM control
[    0.300426] pci 0000:08:00.1: Disabling L0s
[    0.300521] pci 0000:08:00.1: can't disable ASPM; OS doesn't have ASPM control
[    0.300636] pci 0000:09:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.300746] PCI: CLS 64 bytes, default 64
[    0.300772] DMAR: Host address width 40
[    0.300865] DMAR: DRHD base: 0x000000fed14000 flags: 0x1
[    0.300970] DMAR: dmar0: reg_base_addr fed14000 ver 1:0 cap c90780106f0462 ecap f02076
[    0.301079] DMAR: RMRR base: 0x000000bf6d0000 end: 0x000000bf6e7fff
[    0.301181] DMAR: RMRR base: 0x000000bf6f0000 end: 0x000000bf6f0fff
[    0.301282] DMAR: RMRR base: 0x000000bf6f1000 end: 0x000000bf6f1fff
[    0.301383] DMAR: RMRR base: 0x000000bf6f2000 end: 0x000000bf6f2fff
[    0.301484] DMAR: RMRR base: 0x000000bf6fa000 end: 0x000000bf6fafff
[    0.301586] DMAR: RMRR base: 0x000000bf6f3000 end: 0x000000bf6f3fff
[    0.301686] DMAR: RMRR base: 0x000000bf6f4000 end: 0x000000bf6f4fff
[    0.301787] DMAR: RMRR base: 0x000000bf6f5000 end: 0x000000bf6f5fff
[    0.301888] DMAR: RMRR base: 0x000000bf6fb000 end: 0x000000bf6fbfff
[    0.301989] DMAR: ATSR flags: 0x0
[    0.302337] DMAR: dmar0: Using Queued invalidation
[    0.302451] DMAR: Setting RMRR:
[    0.302808] DMAR: Setting identity map for device 0000:00:1d.7 [0xbf6fb000 - 0xbf6fbfff]
[    0.303262] DMAR: Setting identity map for device 0000:00:1d.2 [0xbf6f5000 - 0xbf6f5fff]
[    0.303663] DMAR: Setting identity map for device 0000:00:1d.1 [0xbf6f4000 - 0xbf6f4fff]
[    0.304057] DMAR: Setting identity map for device 0000:00:1d.0 [0xbf6f3000 - 0xbf6f3fff]
[    0.304461] DMAR: Setting identity map for device 0000:00:1a.7 [0xbf6fa000 - 0xbf6fafff]
[    0.304877] DMAR: Setting identity map for device 0000:00:1a.2 [0xbf6f2000 - 0xbf6f2fff]
[    0.305279] DMAR: Setting identity map for device 0000:00:1a.1 [0xbf6f1000 - 0xbf6f1fff]
[    0.305682] DMAR: Setting identity map for device 0000:00:1a.0 [0xbf6f0000 - 0xbf6f0fff]
[    0.305820] DMAR: Setting identity map for device 0000:00:1a.0 [0xbf6d0000 - 0xbf6e7fff]
[    0.305929] DMAR: Setting identity map for device 0000:00:1a.1 [0xbf6d0000 - 0xbf6e7fff]
[    0.306038] DMAR: Setting identity map for device 0000:00:1a.2 [0xbf6d0000 - 0xbf6e7fff]
[    0.306149] DMAR: Setting identity map for device 0000:00:1a.7 [0xbf6d0000 - 0xbf6e7fff]
[    0.306258] DMAR: Setting identity map for device 0000:00:1d.0 [0xbf6d0000 - 0xbf6e7fff]
[    0.306367] DMAR: Setting identity map for device 0000:00:1d.1 [0xbf6d0000 - 0xbf6e7fff]
[    0.306476] DMAR: Setting identity map for device 0000:00:1d.2 [0xbf6d0000 - 0xbf6e7fff]
[    0.306585] DMAR: Setting identity map for device 0000:00:1d.7 [0xbf6d0000 - 0xbf6e7fff]
[    0.306697] DMAR: Prepare 0-16MiB unity mapping for LPC
[    0.307062] DMAR: Setting identity map for device 0000:00:1f.0 [0x0 - 0xffffff]
[    0.307389] DMAR: Intel(R) Virtualization Technology for Directed I/O
[    0.307553] iommu: Adding device 0000:ff:00.0 to group 0
[    0.307666] iommu: Adding device 0000:ff:00.1 to group 0
[    0.307832] iommu: Adding device 0000:ff:02.0 to group 1
[    0.307943] iommu: Adding device 0000:ff:02.1 to group 1
[    0.308053] iommu: Adding device 0000:ff:02.2 to group 1
[    0.308167] iommu: Adding device 0000:ff:02.3 to group 1
[    0.308278] iommu: Adding device 0000:ff:02.4 to group 1
[    0.308389] iommu: Adding device 0000:ff:02.5 to group 1
[    0.308541] iommu: Adding device 0000:ff:03.0 to group 2
[    0.308652] iommu: Adding device 0000:ff:03.1 to group 2
[    0.308763] iommu: Adding device 0000:ff:03.2 to group 2
[    0.308874] iommu: Adding device 0000:ff:03.4 to group 2
[    0.309022] iommu: Adding device 0000:ff:04.0 to group 3
[    0.309136] iommu: Adding device 0000:ff:04.1 to group 3
[    0.309249] iommu: Adding device 0000:ff:04.2 to group 3
[    0.309361] iommu: Adding device 0000:ff:04.3 to group 3
[    0.309509] iommu: Adding device 0000:ff:05.0 to group 4
[    0.309622] iommu: Adding device 0000:ff:05.1 to group 4
[    0.309734] iommu: Adding device 0000:ff:05.2 to group 4
[    0.309846] iommu: Adding device 0000:ff:05.3 to group 4
[    0.309997] iommu: Adding device 0000:ff:06.0 to group 5
[    0.310112] iommu: Adding device 0000:ff:06.1 to group 5
[    0.310225] iommu: Adding device 0000:ff:06.2 to group 5
[    0.310338] iommu: Adding device 0000:ff:06.3 to group 5
[    0.310468] iommu: Adding device 0000:fe:00.0 to group 6
[    0.310583] iommu: Adding device 0000:fe:00.1 to group 6
[    0.310750] iommu: Adding device 0000:fe:02.0 to group 7
[    0.310863] iommu: Adding device 0000:fe:02.1 to group 7
[    0.310976] iommu: Adding device 0000:fe:02.2 to group 7
[    0.311092] iommu: Adding device 0000:fe:02.3 to group 7
[    0.311205] iommu: Adding device 0000:fe:02.4 to group 7
[    0.311318] iommu: Adding device 0000:fe:02.5 to group 7
[    0.311468] iommu: Adding device 0000:fe:03.0 to group 8
[    0.311583] iommu: Adding device 0000:fe:03.1 to group 8
[    0.311696] iommu: Adding device 0000:fe:03.2 to group 8
[    0.311810] iommu: Adding device 0000:fe:03.4 to group 8
[    0.311957] iommu: Adding device 0000:fe:04.0 to group 9
[    0.312074] iommu: Adding device 0000:fe:04.1 to group 9
[    0.312188] iommu: Adding device 0000:fe:04.2 to group 9
[    0.312303] iommu: Adding device 0000:fe:04.3 to group 9
[    0.312451] iommu: Adding device 0000:fe:05.0 to group 10
[    0.312567] iommu: Adding device 0000:fe:05.1 to group 10
[    0.312682] iommu: Adding device 0000:fe:05.2 to group 10
[    0.312797] iommu: Adding device 0000:fe:05.3 to group 10
[    0.312946] iommu: Adding device 0000:fe:06.0 to group 11
[    0.313063] iommu: Adding device 0000:fe:06.1 to group 11
[    0.313181] iommu: Adding device 0000:fe:06.2 to group 11
[    0.313296] iommu: Adding device 0000:fe:06.3 to group 11
[    0.313410] iommu: Adding device 0000:00:00.0 to group 12
[    0.313524] iommu: Adding device 0000:00:01.0 to group 13
[    0.313637] iommu: Adding device 0000:00:03.0 to group 14
[    0.313749] iommu: Adding device 0000:00:05.0 to group 15
[    0.313862] iommu: Adding device 0000:00:07.0 to group 16
[    0.313974] iommu: Adding device 0000:00:08.0 to group 17
[    0.314089] iommu: Adding device 0000:00:09.0 to group 18
[    0.314203] iommu: Adding device 0000:00:0a.0 to group 19
[    0.314333] iommu: Adding device 0000:00:10.0 to group 20
[    0.314449] iommu: Adding device 0000:00:10.1 to group 20
[    0.314581] iommu: Adding device 0000:00:11.0 to group 21
[    0.314698] iommu: Adding device 0000:00:11.1 to group 21
[    0.314849] iommu: Adding device 0000:00:14.0 to group 22
[    0.314967] iommu: Adding device 0000:00:14.1 to group 22
[    0.315088] iommu: Adding device 0000:00:14.2 to group 22
[    0.315206] iommu: Adding device 0000:00:14.3 to group 22
[    0.315328] iommu: Adding device 0000:00:15.0 to group 23
[    0.315479] iommu: Adding device 0000:00:1a.0 to group 24
[    0.315597] iommu: Adding device 0000:00:1a.1 to group 24
[    0.315720] iommu: Adding device 0000:00:1a.2 to group 24
[    0.315838] iommu: Adding device 0000:00:1a.7 to group 24
[    0.315971] iommu: Adding device 0000:00:1c.0 to group 25
[    0.316095] iommu: Adding device 0000:00:1c.4 to group 25
[    0.316245] iommu: Adding device 0000:00:1d.0 to group 26
[    0.316364] iommu: Adding device 0000:00:1d.1 to group 26
[    0.316483] iommu: Adding device 0000:00:1d.2 to group 26
[    0.316602] iommu: Adding device 0000:00:1d.7 to group 26
[    0.316714] iommu: Adding device 0000:00:1e.0 to group 27
[    0.316862] iommu: Adding device 0000:00:1f.0 to group 28
[    0.316982] iommu: Adding device 0000:00:1f.2 to group 28
[    0.317103] iommu: Adding device 0000:00:1f.3 to group 28
[    0.318469] iommu: Adding device 0000:00:1f.5 to group 28
[    0.318585] iommu: Adding device 0000:01:00.0 to group 29
[    0.318689] iommu: Adding device 0000:08:00.0 to group 25
[    0.318792] iommu: Adding device 0000:08:00.1 to group 25
[    0.318895] iommu: Adding device 0000:09:00.0 to group 25
[    0.321371] workingset: timestamp_bits=62 max_order=24 bucket_order=0
[    0.322977] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)
[    0.323089] io scheduler noop registered
[    0.323182] io scheduler deadline registered
[    0.323317] io scheduler cfq registered (default)
[    0.323413] io scheduler mq-deadline registered
[    0.323508] io scheduler kyber registered
[    0.328677] megasas: 07.705.02.00-rc1
[    0.328923] megaraid_sas 0000:01:00.0: FW now in Ready state
[    0.329026] megaraid_sas 0000:01:00.0: 64 bit DMA mask and 32 bit consistent mask
[    0.329668] megaraid_sas 0000:01:00.0: firmware supports msix        : (0)
[    0.329773] megaraid_sas 0000:01:00.0: current msix/online cpus      : (1/24)
[    0.329877] megaraid_sas 0000:01:00.0: RDPQ mode     : (disabled)
[    0.419127] megaraid_sas 0000:01:00.0: controller type       : MR(512MB)
[    0.419237] megaraid_sas 0000:01:00.0: Online Controller Reset(OCR)  : Enabled
[    0.419346] megaraid_sas 0000:01:00.0: Secure JBOD support   : No
[    0.419449] megaraid_sas 0000:01:00.0: NVMe passthru support : No
[    0.419556] megaraid_sas 0000:01:00.0: megasas_init_mfi: fw_support_ieee=0
[    0.419681] megaraid_sas 0000:01:00.0: INIT adapter done
[    0.419782] megaraid_sas 0000:01:00.0: Jbod map is not supported megasas_setup_jbod_map 5128
[    0.464135] megaraid_sas 0000:01:00.0: pci id                : (0x1000)/(0x0079)/(0x1734)/(0x1176)
[    0.464245] megaraid_sas 0000:01:00.0: unevenspan support    : no
[    0.464352] megaraid_sas 0000:01:00.0: firmware crash dump   : no
[    0.464459] megaraid_sas 0000:01:00.0: jbod sync map         : no
[    0.464563] scsi host0: Avago SAS based MegaRAID driver
[    0.469703] scsi 0:2:0:0: Direct-Access     LSI      RAID 5/6 SAS 6G  2.90 PQ: 0 ANSI: 5
[    0.470709] scsi 0:2:1:0: Direct-Access     LSI      RAID 5/6 SAS 6G  2.90 PQ: 0 ANSI: 5
[    0.481335] rtc_cmos 00:02: RTC can wake from S4
[    0.481531] random: fast init done
[    0.481703] rtc_cmos 00:02: registered as rtc0
[    0.481705] sd 0:2:1:0: [sdb] 1171062784 512-byte logical blocks: (600 GB/558 GiB)
[    0.481789] sd 0:2:0:0: [sda] 285671424 512-byte logical blocks: (146 GB/136 GiB)
[    0.481817] rtc_cmos 00:02: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[    0.481819] sd 0:2:0:0: [sda] Write Protect is off
[    0.481821] sd 0:2:0:0: [sda] Mode Sense: 1f 00 10 08
[    0.481956] sd 0:2:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
[    0.481956] sd 0:2:1:0: [sdb] Write Protect is off
[    0.481958] sd 0:2:1:0: [sdb] Mode Sense: 1f 00 10 08
[    0.482005] sd 0:2:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA
[    0.482988] NET: Registered protocol family 17
[    0.483102] sched_clock: Marking stable (482934334, 0)->(655335020, -172400686)
[    0.483480] registered taskstats version 1
[    0.483843] Btrfs loaded, crc32c=crc32c-generic
[    0.484914] rtc_cmos 00:02: setting system clock to 2018-07-23 13:18:43 UTC (1532351923)
[    0.487014]  sdb: sdb1
[    0.487413]  sda: sda1 sda2 sda3
[    0.487605] sd 0:2:1:0: [sdb] Attached SCSI disk
[    0.487953] sd 0:2:0:0: [sda] Attached SCSI disk
[    0.497996] BTRFS: device fsid 473b3d83-48a1-4653-b073-5b55b600badd devid 1 transid 446116 /dev/root
[    0.499154] BTRFS info (device sda2): disk space caching is enabled
[    0.499262] BTRFS info (device sda2): has skinny extents
[    0.808979] VFS: Mounted root (btrfs filesystem) readonly on device 0:13.
[    0.814435] devtmpfs: mounted
[    0.817214] Freeing unused kernel memory: 780K
[    0.820452] Write protecting the kernel read-only data: 12288k
[    0.825724] Freeing unused kernel memory: 2020K
[    0.828954] Freeing unused kernel memory: 564K
[    1.250040] loop: module loaded
[    1.375141] tsc: Refined TSC clocksource calibration: 2400.084 MHz
[    1.376258] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229886f1f14, max_idle_ns: 440795306808 ns
[    1.377084] clocksource: Switched to clocksource tsc
[    1.505161] random: crng init done
[    1.694934] udevd[1014]: starting eudev-3.1.5
[    1.756741] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[    1.775069] ACPI: bus type USB registered
[    1.775186] usbcore: registered new interface driver usbfs
[    1.775295] usbcore: registered new interface driver hub
[    1.777283] usbcore: registered new device driver usb
[    1.780772] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
[    1.780884] ACPI: Power Button [PWRB]
[    1.781030] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1
[    1.781143] ACPI: Power Button [PWRF]
[    1.790332] pps_core: LinuxPPS API ver. 1 registered
[    1.790432] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    1.847383] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
[    1.868156] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    1.889034] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    1.894651] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.939651] PTP clock support registered
[    1.945133] ehci-pci: EHCI PCI platform driver
[    1.945515] ehci-pci 0000:00:1a.7: EHCI Host Controller
[    1.945618] ehci-pci 0000:00:1a.7: new USB bus registered, assigned bus number 1
[    1.945733] ehci-pci 0000:00:1a.7: debug port 1
[    1.949727] ehci-pci 0000:00:1a.7: cache line size of 64 is not supported
[    1.949743] ehci-pci 0000:00:1a.7: irq 18, io mem 0xce000000
[    1.957013] ehci-pci 0000:00:1a.7: USB 2.0 started, EHCI 1.00
[    1.958089] hub 1-0:1.0: USB hub found
[    1.958227] hub 1-0:1.0: 6 ports detected
[    1.959284] ehci-pci 0000:00:1d.7: EHCI Host Controller
[    1.959387] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2
[    1.959502] ehci-pci 0000:00:1d.7: debug port 1
[    1.963520] ehci-pci 0000:00:1d.7: cache line size of 64 is not supported
[    1.963529] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    1.963532] ehci-pci 0000:00:1d.7: irq 23, io mem 0xce001000
[    1.963634] igb: Copyright (c) 2007-2014 Intel Corporation.
[    1.971022] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[    1.971427] hub 2-0:1.0: USB hub found
[    1.971530] hub 2-0:1.0: 6 ports detected
[    2.000275] uhci_hcd: USB Universal Host Controller Interface driver
[    2.000613] uhci_hcd 0000:00:1a.0: UHCI Host Controller
[    2.000717] uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 3
[    2.000853] uhci_hcd 0000:00:1a.0: irq 19, io base 0x00001820
[    2.001605] hub 3-0:1.0: USB hub found
[    2.001757] hub 3-0:1.0: 2 ports detected
[    2.002226] uhci_hcd 0000:00:1a.1: UHCI Host Controller
[    2.002329] uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4
[    2.002457] uhci_hcd 0000:00:1a.1: irq 18, io base 0x00001840
[    2.003070] hub 4-0:1.0: USB hub found
[    2.003245] hub 4-0:1.0: 2 ports detected
[    2.003986] uhci_hcd 0000:00:1a.2: UHCI Host Controller
[    2.004104] uhci_hcd 0000:00:1a.2: new USB bus registered, assigned bus number 5
[    2.004232] uhci_hcd 0000:00:1a.2: irq 18, io base 0x00001860
[    2.004797] hub 5-0:1.0: USB hub found
[    2.004971] hub 5-0:1.0: 2 ports detected
[    2.005728] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    2.005831] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 6
[    2.005959] uhci_hcd 0000:00:1d.0: irq 23, io base 0x00001880
[    2.006624] hub 6-0:1.0: USB hub found
[    2.006768] hub 6-0:1.0: 2 ports detected
[    2.007175] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    2.007278] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 7
[    2.007410] uhci_hcd 0000:00:1d.1: irq 22, io base 0x000018a0
[    2.007998] hub 7-0:1.0: USB hub found
[    2.008157] hub 7-0:1.0: 2 ports detected
[    2.008624] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    2.008727] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 8
[    2.008860] uhci_hcd 0000:00:1d.2: irq 21, io base 0x000018c0
[    2.009299] hub 8-0:1.0: USB hub found
[    2.009445] hub 8-0:1.0: 2 ports detected
[    2.180129] igb 0000:08:00.0: Intel(R) Gigabit Ethernet Network Connection
[    2.180236] igb 0000:08:00.0: eth0: (PCIe:2.5Gb/s:Width x4) 00:19:99:ab:0b:38
[    2.180341] igb 0000:08:00.0: eth0: PBA No: Unknown
[    2.180438] igb 0000:08:00.0: Using MSI-X interrupts. 4 rx queue(s), 4 tx queue(s)
[    2.288110] BTRFS: device fsid 77ad40e4-d53c-4b3b-b135-7c3db9ee21fb devid 1 transid 627173 /dev/sdb1
[    2.396182] igb 0000:08:00.1: Intel(R) Gigabit Ethernet Network Connection
[    2.396287] igb 0000:08:00.1: eth1: (PCIe:2.5Gb/s:Width x4) 00:19:99:ab:0b:39
[    2.396393] igb 0000:08:00.1: eth1: PBA No: Unknown
[    2.396490] igb 0000:08:00.1: Using MSI-X interrupts. 4 rx queue(s), 4 tx queue(s)
[    2.450254] Adding 10451964k swap on /dev/sda3.  Priority:-2 extents:1 across:10451964k FS
[    2.997408] BTRFS info (device sda2): disk space caching is enabled
[    6.117523] BTRFS info (device sdb1): disk space caching is enabled
[    6.117628] BTRFS info (device sdb1): has skinny extents
[   12.233646] igb 0000:08:00.0: changing MTU from 1500 to 9000
[   14.677564] igb 0000:08:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   16.687919] vboxdrv: loading out-of-tree module taints kernel.
[   16.700867] vboxdrv: Found 24 processor cores
[   16.719679] vboxdrv: TSC mode is Invariant, tentative frequency 2400052291 Hz
[   16.719680] vboxdrv: Successfully loaded version 5.2.16 (interface 0x00290001)
[   16.819790] VBoxNetAdp: Successfully started.
[   16.865608] VBoxNetFlt: Successfully started.
[   16.906037] VBoxPciLinuxInit
[   16.906041] vboxpci: pci-stub module not available, cannot detach PCI devices
[   16.906041] vboxpci: IOMMU found
[   17.249930] SUPR0GipMap: fGetGipCpu=0xb
[   20.494736] vboxdrv: 000000003578d9f3 VMMR0.r0
[   20.910688] vboxdrv: 000000001208b0e7 VBoxDDR0.r0
[   20.944982] VBoxNetFlt: attached to 'eth0' / 00:19:99:ab:0b:38
[   20.966411] vboxpci: created IOMMU domain 00000000b7a309ce
[   20.968955] vboxpci: created IOMMU domain 00000000ddb8b5a8
[   20.969557] vboxpci: created IOMMU domain 000000004d2d6c45
[   20.996022] vboxpci: created IOMMU domain 00000000f51fe837
[   21.012536] vboxdrv: 00000000ef35e632 VBoxEhciR0.r0
[   24.927778] vboxpci: created IOMMU domain 00000000de9efd67
[   27.857259] device eth0 entered promiscuous mode
[   28.597515] vboxpci: created IOMMU domain 000000005c1cff53
[   29.422962] vboxpci: created IOMMU domain 0000000047538b73
[   33.414501] vboxpci: created IOMMU domain 00000000c887c04f
[   33.552714] vboxpci: created IOMMU domain 00000000233d8290
[   42.002817] vboxpci: created IOMMU domain 000000006366e8ae
[   42.256600] vboxpci: created IOMMU domain 00000000b0159a37
[   43.999946] vboxpci: created IOMMU domain 00000000d57e5c28
[53264.665564] hrtimer: interrupt took 7220 ns
[226277.797573] igb 0000:08:00.0: Detected Tx Unit Hang
                  Tx Queue             <2>
                  TDH                  <de>
                  TDT                  <de>
                  next_to_use          <e0>
                  next_to_clean        <de>
                buffer_info[next_to_clean]
                  time_stamp           <10d782971>
                  next_to_watch        <0000000095a05ad2>
                  jiffies              <10d783141>
                  desc.status          <238220>
[226279.780541] igb 0000:08:00.0: Detected Tx Unit Hang
                  Tx Queue             <2>
                  TDH                  <de>
                  TDT                  <de>
                  next_to_use          <e0>
                  next_to_clean        <de>
                buffer_info[next_to_clean]
                  time_stamp           <10d782971>
                  next_to_watch        <0000000095a05ad2>
                  jiffies              <10d783900>
                  desc.status          <238220>
[226281.764513] igb 0000:08:00.0: Detected Tx Unit Hang
                  Tx Queue             <2>
                  TDH                  <de>
                  TDT                  <de>
                  next_to_use          <e0>
                  next_to_clean        <de>
                buffer_info[next_to_clean]
                  time_stamp           <10d782971>
                  next_to_watch        <0000000095a05ad2>
                  jiffies              <10d7840c0>
                  desc.status          <238220>
[226283.749485] igb 0000:08:00.0: Detected Tx Unit Hang
                  Tx Queue             <2>
                  TDH                  <de>
                  TDT                  <de>
                  next_to_use          <e0>
                  next_to_clean        <de>
                buffer_info[next_to_clean]
                  time_stamp           <10d782971>
                  next_to_watch        <0000000095a05ad2>
                  jiffies              <10d784881>
                  desc.status          <238220>
[226285.156354] ------------[ cut here ]------------
[226285.156359] NETDEV WATCHDOG: eth0 (igb): transmit queue 2 timed out
[226285.156381] WARNING: CPU: 10 PID: 0 at net/sched/sch_generic.c:461 dev_watchdog+0x1d9/0x1e0
[226285.156382] Modules linked in: vboxpci(O) vboxnetflt(O) vboxnetadp(O) vboxdrv(O) uhci_hcd igb ehci_pci ptp ehci_hcd 8250 evdev pps_core button 8250_base usbcore i2c_i801 i2c_algo_bit serial_core usb_common i2c_core loop
[226285.156399] CPU: 10 PID: 0 Comm: swapper/10 Tainted: G          IO      4.18.0-rc6 #1
[226285.156400] Hardware name: FUJITSU                          PRIMERGY RX300 S6             /D2619, BIOS 6.00 Rev. 1.13.2619.N1           01/19/2012
[226285.156403] RIP: 0010:dev_watchdog+0x1d9/0x1e0
[226285.156404] Code: 00 48 63 4d f0 eb 97 4c 89 e7 c6 05 ca e3 83 00 01 e8 ab eb fd ff 89 d9 4c 89 e6 48 c7 c7 c0 48 b3 81 48 89 c2 e8 97 22 c3 ff <0f> 0b eb c0 0f 1f 00 48 c7 47 08 00 00 00 00 48 c7 07 00 00 00 00 
[226285.156437] RSP: 0018:ffff880fff283ec8 EFLAGS: 00010286
[226285.156439] RAX: 0000000000000000 RBX: 0000000000000002 RCX: 0000000000000006
[226285.156440] RDX: 0000000000000007 RSI: 0000000000000096 RDI: ffff880fff294ff0
[226285.156441] RBP: ffff880ff11903b0 R08: 0000000000000001 R09: 000000000000036c
[226285.156443] R10: ffffffff81c05100 R11: 000000000000036c R12: ffff880ff1190000
[226285.156444] R13: 000000000000000a R14: 0000000000000202 R15: ffffffff81c05108
[226285.156446] FS:  0000000000000000(0000) GS:ffff880fff280000(0000) knlGS:0000000000000000
[226285.156447] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[226285.156448] CR2: 0000000000310c00 CR3: 0000000001c0a003 CR4: 00000000000226a0
[226285.156449] Call Trace:
[226285.156452]  <IRQ>
[226285.156456]  ? qdisc_reset+0xe0/0xe0
[226285.156460]  call_timer_fn+0x13/0x80
[226285.156462]  expire_timers+0x70/0x80
[226285.156464]  run_timer_softirq+0x7e/0x150
[226285.156467]  ? __hrtimer_run_queues+0x130/0x190
[226285.156471]  ? recalibrate_cpu_khz+0x10/0x10
[226285.156474]  ? ktime_get+0x33/0x90
[226285.156477]  ? default_inquire_remote_apic+0x10/0x10
[226285.156481]  ? lapic_next_event+0x17/0x20
[226285.156485]  __do_softirq+0xd4/0x1c9
[226285.156488]  irq_exit+0xa7/0xb0
[226285.156490]  smp_apic_timer_interrupt+0x59/0x90
[226285.156492]  apic_timer_interrupt+0xf/0x20
[226285.156493]  </IRQ>
[226285.156496] RIP: 0010:acpi_idle_do_entry+0x2b/0x40
[226285.156496] Code: b6 47 08 3c 01 74 25 3c 02 74 0d 8b 57 04 ec 48 8b 15 fd 8f ac 00 ed c3 65 48 8b 04 25 40 4c 01 00 48 8b 00 a8 08 75 ef fb f4 <fa> c3 e9 ae fe ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 41 
[226285.156522] RSP: 0018:ffffc900000cbe48 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
[226285.156524] RAX: 0000000080000000 RBX: ffff880ff83bf400 RCX: 0000000000000034
[226285.156525] RDX: 4ec4ec4ec4ec4ec5 RSI: ffffffff81c386e0 RDI: ffff880ff83bf464
[226285.156526] RBP: ffff880ff83bf464 R08: ffff880fff29e1c8 R09: 0000000000000008
[226285.156527] R10: 0000000000000003 R11: 0000000000000009 R12: 0000000000000001
[226285.156528] R13: 0000000000000001 R14: 0000000000000001 R15: ffff880ff8c9de80
[226285.156532]  acpi_idle_enter+0x8d/0x250
[226285.156536]  ? menu_select+0x399/0x550
[226285.156537]  cpuidle_enter_state+0xff/0x200
[226285.156541]  do_idle+0x113/0x200
[226285.156543]  cpu_startup_entry+0x6a/0x70
[226285.156545]  start_secondary+0x183/0x1b0
[226285.156547]  secondary_startup_64+0xa5/0xb0
[226285.156549] ---[ end trace 66fae9a7fe07d63b ]---
[226285.156564] igb 0000:08:00.0 eth0: Reset adapter
[226288.173886] igb 0000:08:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX

^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
  2018-07-26 11:56   ` [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17] Marco Berizzi
@ 2018-07-26 14:32     ` Alexander Duyck
  2018-07-26 15:03       ` Marco Berizzi
  0 siblings, 1 reply; 15+ messages in thread
From: Alexander Duyck @ 2018-07-26 14:32 UTC (permalink / raw)
  To: intel-wired-lan

On Thu, Jul 26, 2018 at 4:56 AM, Marco Berizzi <pupilla@libero.it> wrote:
>> Il 5 luglio 2018 alle 15.22 Marco Berizzi <pupilla@libero.it> ha scritto:
>>
>> > Il 5 giugno 2018 alle 10.12 Marco Berizzi <pupilla@libero.it> ha scritto:
>> >
>> > Hi Folks,
>> >
>> > after upgrading from 4.16.13 to 4.17 I got this error message.
>> >
>> > Any feedback are welcome.
>> >
>> > Marco Berizzi
>> >
>> > PS: this system is running oracle virtualbox 5.2.12
>>
>> Hi Folks,
>>
>> I'm getting the same error also with 4.17.3:
>
> Hi Folks,
>
> I'm getting the same error also with 4.18-r6 (this system is
> running oracle virtualbox 5.2.16):

Could you include an lspci -vvv for the igb functions. Also I assume
this is a direct assigned port?

From what I can get based on the log below somehow the driver and the
device are falling out of sync. It looks like either we missed a tail
update at some point after we stopped the queue.

It looks like the error took 2 to 3 days to show up. Do you know if
there are any reproduction steps that might let us start bisecting
this, or that would at least allow us to reproduce the issue more
quickly? Also, what sort of traffic are you sending over the port?

> [226277.797573] igb 0000:08:00.0: Detected Tx Unit Hang
>                   Tx Queue             <2>
>                   TDH                  <de>
>                   TDT                  <de>
>                   next_to_use          <e0>
>                   next_to_clean        <de>
>                 buffer_info[next_to_clean]
>                   time_stamp           <10d782971>
>                   next_to_watch        <0000000095a05ad2>
>                   jiffies              <10d783141>
>                   desc.status          <238220>
> [226279.780541] igb 0000:08:00.0: Detected Tx Unit Hang
>                   Tx Queue             <2>
>                   TDH                  <de>
>                   TDT                  <de>
>                   next_to_use          <e0>
>                   next_to_clean        <de>
>                 buffer_info[next_to_clean]
>                   time_stamp           <10d782971>
>                   next_to_watch        <0000000095a05ad2>
>                   jiffies              <10d783900>
>                   desc.status          <238220>
> [226281.764513] igb 0000:08:00.0: Detected Tx Unit Hang
>                   Tx Queue             <2>
>                   TDH                  <de>
>                   TDT                  <de>
>                   next_to_use          <e0>
>                   next_to_clean        <de>
>                 buffer_info[next_to_clean]
>                   time_stamp           <10d782971>
>                   next_to_watch        <0000000095a05ad2>
>                   jiffies              <10d7840c0>
>                   desc.status          <238220>
> [226283.749485] igb 0000:08:00.0: Detected Tx Unit Hang
>                   Tx Queue             <2>
>                   TDH                  <de>
>                   TDT                  <de>
>                   next_to_use          <e0>
>                   next_to_clean        <de>
>                 buffer_info[next_to_clean]
>                   time_stamp           <10d782971>
>                   next_to_watch        <0000000095a05ad2>
>                   jiffies              <10d784881>
>                   desc.status          <238220>
> [226285.156354] ------------[ cut here ]------------
> [226285.156359] NETDEV WATCHDOG: eth0 (igb): transmit queue 2 timed out
> [226285.156381] WARNING: CPU: 10 PID: 0 at net/sched/sch_generic.c:461 dev_watchdog+0x1d9/0x1e0
> [226285.156382] Modules linked in: vboxpci(O) vboxnetflt(O) vboxnetadp(O) vboxdrv(O) uhci_hcd igb ehci_pci ptp ehci_hcd 8250 evdev pps_core button 8250_base usbcore i2c_i801 i2c_algo_bit serial_core usb_common i2c_core loop
> [226285.156399] CPU: 10 PID: 0 Comm: swapper/10 Tainted: G          IO      4.18.0-rc6 #1
> [226285.156400] Hardware name: FUJITSU                          PRIMERGY RX300 S6             /D2619, BIOS 6.00 Rev. 1.13.2619.N1           01/19/2012
> [226285.156403] RIP: 0010:dev_watchdog+0x1d9/0x1e0
> [226285.156404] Code: 00 48 63 4d f0 eb 97 4c 89 e7 c6 05 ca e3 83 00 01 e8 ab eb fd ff 89 d9 4c 89 e6 48 c7 c7 c0 48 b3 81 48 89 c2 e8 97 22 c3 ff <0f> 0b eb c0 0f 1f 00 48 c7 47 08 00 00 00 00 48 c7 07 00 00 00 00
> [226285.156437] RSP: 0018:ffff880fff283ec8 EFLAGS: 00010286
> [226285.156439] RAX: 0000000000000000 RBX: 0000000000000002 RCX: 0000000000000006
> [226285.156440] RDX: 0000000000000007 RSI: 0000000000000096 RDI: ffff880fff294ff0
> [226285.156441] RBP: ffff880ff11903b0 R08: 0000000000000001 R09: 000000000000036c
> [226285.156443] R10: ffffffff81c05100 R11: 000000000000036c R12: ffff880ff1190000
> [226285.156444] R13: 000000000000000a R14: 0000000000000202 R15: ffffffff81c05108
> [226285.156446] FS:  0000000000000000(0000) GS:ffff880fff280000(0000) knlGS:0000000000000000
> [226285.156447] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [226285.156448] CR2: 0000000000310c00 CR3: 0000000001c0a003 CR4: 00000000000226a0
> [226285.156449] Call Trace:
> [226285.156452]  <IRQ>
> [226285.156456]  ? qdisc_reset+0xe0/0xe0
> [226285.156460]  call_timer_fn+0x13/0x80
> [226285.156462]  expire_timers+0x70/0x80
> [226285.156464]  run_timer_softirq+0x7e/0x150
> [226285.156467]  ? __hrtimer_run_queues+0x130/0x190
> [226285.156471]  ? recalibrate_cpu_khz+0x10/0x10
> [226285.156474]  ? ktime_get+0x33/0x90
> [226285.156477]  ? default_inquire_remote_apic+0x10/0x10
> [226285.156481]  ? lapic_next_event+0x17/0x20
> [226285.156485]  __do_softirq+0xd4/0x1c9
> [226285.156488]  irq_exit+0xa7/0xb0
> [226285.156490]  smp_apic_timer_interrupt+0x59/0x90
> [226285.156492]  apic_timer_interrupt+0xf/0x20
> [226285.156493]  </IRQ>
> [226285.156496] RIP: 0010:acpi_idle_do_entry+0x2b/0x40
> [226285.156496] Code: b6 47 08 3c 01 74 25 3c 02 74 0d 8b 57 04 ec 48 8b 15 fd 8f ac 00 ed c3 65 48 8b 04 25 40 4c 01 00 48 8b 00 a8 08 75 ef fb f4 <fa> c3 e9 ae fe ff ff 90 90 90 90 90 90 90 90 90 90 90 90 90 90 41
> [226285.156522] RSP: 0018:ffffc900000cbe48 EFLAGS: 00000246 ORIG_RAX: ffffffffffffff13
> [226285.156524] RAX: 0000000080000000 RBX: ffff880ff83bf400 RCX: 0000000000000034
> [226285.156525] RDX: 4ec4ec4ec4ec4ec5 RSI: ffffffff81c386e0 RDI: ffff880ff83bf464
> [226285.156526] RBP: ffff880ff83bf464 R08: ffff880fff29e1c8 R09: 0000000000000008
> [226285.156527] R10: 0000000000000003 R11: 0000000000000009 R12: 0000000000000001
> [226285.156528] R13: 0000000000000001 R14: 0000000000000001 R15: ffff880ff8c9de80
> [226285.156532]  acpi_idle_enter+0x8d/0x250
> [226285.156536]  ? menu_select+0x399/0x550
> [226285.156537]  cpuidle_enter_state+0xff/0x200
> [226285.156541]  do_idle+0x113/0x200
> [226285.156543]  cpu_startup_entry+0x6a/0x70
> [226285.156545]  start_secondary+0x183/0x1b0
> [226285.156547]  secondary_startup_64+0xa5/0xb0
> [226285.156549] ---[ end trace 66fae9a7fe07d63b ]---
> [226285.156564] igb 0000:08:00.0 eth0: Reset adapter
> [226288.173886] igb 0000:08:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
> _______________________________________________
> Intel-wired-lan mailing list
> Intel-wired-lan at osuosl.org
> https://lists.osuosl.org/mailman/listinfo/intel-wired-lan

^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
  2018-07-26 14:32     ` Alexander Duyck
@ 2018-07-26 15:03       ` Marco Berizzi
  2018-07-26 16:05         ` Alexander Duyck
  0 siblings, 1 reply; 15+ messages in thread
From: Marco Berizzi @ 2018-07-26 15:03 UTC (permalink / raw)
  To: intel-wired-lan

> Il 26 luglio 2018 alle 16.32 Alexander Duyck <alexander.duyck@gmail.com> ha scritto:
> Could you include an lspci -vvv for the igb functions.

Hi Alexander.
Thanks for the reply.
Here is the output from lspci -vvv

08:00.0 Ethernet controller: Intel Corporation 82575EB Gigabit Network Connection (rev 02)
        Subsystem: Fujitsu Technology Solutions 82575EB Gigabit Network Connection
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin A routed to IRQ 16
        Region 0: Memory at ce260000 (32-bit, non-prefetchable) [size=128K]
        Region 1: Memory at ce240000 (32-bit, non-prefetchable) [size=128K]
        Region 2: I/O ports at 3000 [size=32]
        Region 3: Memory at ce200000 (32-bit, non-prefetchable) [size=16K]
        [virtual] Expansion ROM@ce220000 [disabled] [size=128K]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
        Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
                Address: 0000000000000000  Data: 0000
        Capabilities: [60] MSI-X: Enable+ Count=10 Masked-
                Vector table: BAR=3 offset=00000000
                PBA: BAR=3 offset=00002000
        Capabilities: [a0] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 0.000W
                DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
                LnkCap: Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1, Exit Latency L0s <4us, L1 <64us
                        ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported
                DevCtl2: Completion Timeout: 16ms to 55ms, TimeoutDis-, LTR-, OBFF Disabled
                LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
                         Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
                         Compliance De-emphasis: -6dB
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
                UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                CEMsk:  RxErr- BadTLP+ BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
        Capabilities: [140 v1] Device Serial Number 00-19-99-ff-ff-ab-0b-38
        Kernel driver in use: igb
        Kernel modules: igb

08:00.1 Ethernet controller: Intel Corporation 82575EB Gigabit Network Connection (rev 02)
        Subsystem: Fujitsu Technology Solutions 82575EB Gigabit Network Connection
        Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
        Latency: 0, Cache Line Size: 64 bytes
        Interrupt: pin B routed to IRQ 17
        Region 0: Memory at ce2c0000 (32-bit, non-prefetchable) [size=128K]
        Region 1: Memory at ce2a0000 (32-bit, non-prefetchable) [size=128K]
        Region 2: I/O ports at 3020 [size=32]
        Region 3: Memory at ce204000 (32-bit, non-prefetchable) [size=16K]
        [virtual] Expansion ROM@ce280000 [disabled] [size=128K]
        Capabilities: [40] Power Management version 2
                Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
        Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
                Address: 0000000000000000  Data: 0000
        Capabilities: [60] MSI-X: Enable+ Count=10 Masked-
                Vector table: BAR=3 offset=00000000
                PBA: BAR=3 offset=00002000
        Capabilities: [a0] Express (v2) Endpoint, MSI 00
                DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 0.000W
                DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
                LnkCap: Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1, Exit Latency L0s <4us, L1 <64us
                        ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
                DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported
                DevCtl2: Completion Timeout: 16ms to 55ms, TimeoutDis-, LTR-, OBFF Disabled
                LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
                         EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
                UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                CEMsk:  RxErr- BadTLP+ BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
        Capabilities: [140 v1] Device Serial Number 00-19-99-ff-ff-ab-0b-38
        Kernel driver in use: igb
        Kernel modules: igb


> Also I assume
> this is a direct assigned port?

Apologies, but I did not understand this question.

> From what I can get based on the log below somehow the driver and the
> device are falling out of sync. It looks like either we missed a tail
> update at some point after we stopped the queue.
> 
> It looks like the error took 2 to 3 days to show up.

yes, indeed.

> Do you know if
> there are any reproduction steps that might let us start bisecting
> this, or that would at least allow us to reproduce the issue more
> quickly?

Impossibile for me to reproduce. I'm not able to understand
why/when it is happening.

> Also, what sort of traffic are you sending over the port?

this host is running slackware linux 14.2 64bit with oracle
virtualbox 5.2.16
The traffic to this hosts is small: after 3 dayes uptime
it is less than 10GBytes:

root at Kaa:~# last | head | grep reboot
reboot   system boot  4.18.0-rc6       Mon Jul 23 13:18 - 16:52 (3+03:33)   
root at Kaa:~# ifconfig  eth0
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 9000
        inet 10.81.110.15  netmask 255.255.255.0  broadcast 10.81.110.255
        ether 00:19:99:ab:0b:38  txqueuelen 1000  (Ethernet)
        RX packets 10813141  bytes 2139165411 (1.9 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 10860078  bytes 4702798829 (4.3 GiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
        device memory 0xce260000-ce27ffff  

there are around 12 virtual machine hosted running (mainly windows7).

bind/dhcp/proftpd/openssh/ntp and the above mentioned oracle virtualbox
are the only running applications on this host.

Problem popped up from linux 4.17.0

root at Kaa:~# ethtool -k eth0
Features for eth0:
Cannot get device udp-fragmentation-offload settings: Operation not supported
rx-checksumming: on
tx-checksumming: on
        tx-checksum-ipv4: off [fixed]
        tx-checksum-ip-generic: on
        tx-checksum-ipv6: off [fixed]
        tx-checksum-fcoe-crc: off [fixed]
        tx-checksum-sctp: off [fixed]
scatter-gather: on
        tx-scatter-gather: on
        tx-scatter-gather-fraglist: off [fixed]
tcp-segmentation-offload: on
        tx-tcp-segmentation: on
        tx-tcp-ecn-segmentation: off [fixed]
        tx-tcp-mangleid-segmentation: off
        tx-tcp6-segmentation: on
udp-fragmentation-offload: off
generic-segmentation-offload: on
generic-receive-offload: on
large-receive-offload: off [fixed]
rx-vlan-offload: on
tx-vlan-offload: on
ntuple-filters: off [fixed]
receive-hashing: on
highdma: on [fixed]
rx-vlan-filter: on [fixed]
vlan-challenged: off [fixed]
tx-lockless: off [fixed]
netns-local: off [fixed]
tx-gso-robust: off [fixed]
tx-fcoe-segmentation: off [fixed]
tx-gre-segmentation: on
tx-gre-csum-segmentation: on
tx-ipxip4-segmentation: on
tx-ipxip6-segmentation: on
tx-udp_tnl-segmentation: on
tx-udp_tnl-csum-segmentation: on
tx-gso-partial: on
tx-sctp-segmentation: off [fixed]
tx-esp-segmentation: off [fixed]
tx-udp-segmentation: off [fixed]
fcoe-mtu: off [fixed]
tx-nocache-copy: off
loopback: off [fixed]
rx-fcs: off [fixed]
rx-all: off
tx-vlan-stag-hw-insert: off [fixed]
rx-vlan-stag-hw-parse: off [fixed]
rx-vlan-stag-filter: off [fixed]
l2-fwd-offload: off [fixed]
hw-tc-offload: off [fixed]
esp-hw-offload: off [fixed]
esp-tx-csum-hw-offload: off [fixed]
rx-udp_tunnel-port-offload: off [fixed]
tls-hw-tx-offload: off [fixed]
rx-gro-hw: off [fixed]
tls-hw-record: off [fixed]

^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
  2018-07-26 15:03       ` Marco Berizzi
@ 2018-07-26 16:05         ` Alexander Duyck
  2018-07-27  8:47           ` Marco Berizzi
  0 siblings, 1 reply; 15+ messages in thread
From: Alexander Duyck @ 2018-07-26 16:05 UTC (permalink / raw)
  To: intel-wired-lan

On Thu, Jul 26, 2018 at 8:03 AM, Marco Berizzi <pupilla@libero.it> wrote:
>> Il 26 luglio 2018 alle 16.32 Alexander Duyck <alexander.duyck@gmail.com> ha scritto:
>> Could you include an lspci -vvv for the igb functions.
>
> Hi Alexander.
> Thanks for the reply.
> Here is the output from lspci -vvv
>
> 08:00.0 Ethernet controller: Intel Corporation 82575EB Gigabit Network Connection (rev 02)
>         Subsystem: Fujitsu Technology Solutions 82575EB Gigabit Network Connection
>         Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
>         Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
>         Latency: 0, Cache Line Size: 64 bytes
>         Interrupt: pin A routed to IRQ 16
>         Region 0: Memory at ce260000 (32-bit, non-prefetchable) [size=128K]
>         Region 1: Memory at ce240000 (32-bit, non-prefetchable) [size=128K]
>         Region 2: I/O ports at 3000 [size=32]
>         Region 3: Memory at ce200000 (32-bit, non-prefetchable) [size=16K]
>         [virtual] Expansion ROM at ce220000 [disabled] [size=128K]
>         Capabilities: [40] Power Management version 2
>                 Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
>                 Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
>         Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
>                 Address: 0000000000000000  Data: 0000
>         Capabilities: [60] MSI-X: Enable+ Count=10 Masked-
>                 Vector table: BAR=3 offset=00000000
>                 PBA: BAR=3 offset=00002000
>         Capabilities: [a0] Express (v2) Endpoint, MSI 00
>                 DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
>                         ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 0.000W
>                 DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
>                         RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
>                         MaxPayload 128 bytes, MaxReadReq 512 bytes
>                 DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
>                 LnkCap: Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1, Exit Latency L0s <4us, L1 <64us
>                         ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
>                 LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
>                         ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
>                 LnkSta: Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
>                 DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported
>                 DevCtl2: Completion Timeout: 16ms to 55ms, TimeoutDis-, LTR-, OBFF Disabled
>                 LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-
>                          Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
>                          Compliance De-emphasis: -6dB
>                 LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
>                          EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
>         Capabilities: [100 v1] Advanced Error Reporting
>                 UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
>                 UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
>                 UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
>                 CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>                 CEMsk:  RxErr- BadTLP+ BadDLLP- Rollover- Timeout- NonFatalErr+
>                 AERCap: First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
>         Capabilities: [140 v1] Device Serial Number 00-19-99-ff-ff-ab-0b-38
>         Kernel driver in use: igb
>         Kernel modules: igb
>
> 08:00.1 Ethernet controller: Intel Corporation 82575EB Gigabit Network Connection (rev 02)
>         Subsystem: Fujitsu Technology Solutions 82575EB Gigabit Network Connection
>         Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr+ Stepping- SERR+ FastB2B- DisINTx+
>         Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
>         Latency: 0, Cache Line Size: 64 bytes
>         Interrupt: pin B routed to IRQ 17
>         Region 0: Memory at ce2c0000 (32-bit, non-prefetchable) [size=128K]
>         Region 1: Memory at ce2a0000 (32-bit, non-prefetchable) [size=128K]
>         Region 2: I/O ports at 3020 [size=32]
>         Region 3: Memory at ce204000 (32-bit, non-prefetchable) [size=16K]
>         [virtual] Expansion ROM at ce280000 [disabled] [size=128K]
>         Capabilities: [40] Power Management version 2
>                 Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
>                 Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
>         Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
>                 Address: 0000000000000000  Data: 0000
>         Capabilities: [60] MSI-X: Enable+ Count=10 Masked-
>                 Vector table: BAR=3 offset=00000000
>                 PBA: BAR=3 offset=00002000
>         Capabilities: [a0] Express (v2) Endpoint, MSI 00
>                 DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
>                         ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset- SlotPowerLimit 0.000W
>                 DevCtl: Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
>                         RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
>                         MaxPayload 128 bytes, MaxReadReq 512 bytes
>                 DevSta: CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
>                 LnkCap: Port #0, Speed 2.5GT/s, Width x4, ASPM L0s L1, Exit Latency L0s <4us, L1 <64us
>                         ClockPM- Surprise- LLActRep- BwNot- ASPMOptComp-
>                 LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- CommClk+
>                         ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
>                 LnkSta: Speed 2.5GT/s, Width x4, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
>                 DevCap2: Completion Timeout: Range ABCD, TimeoutDis+, LTR-, OBFF Not Supported
>                 DevCtl2: Completion Timeout: 16ms to 55ms, TimeoutDis-, LTR-, OBFF Disabled
>                 LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
>                          EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
>         Capabilities: [100 v1] Advanced Error Reporting
>                 UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
>                 UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
>                 UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
>                 CESta:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>                 CEMsk:  RxErr- BadTLP+ BadDLLP- Rollover- Timeout- NonFatalErr+
>                 AERCap: First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
>         Capabilities: [140 v1] Device Serial Number 00-19-99-ff-ff-ab-0b-38
>         Kernel driver in use: igb
>         Kernel modules: igb
>


This is helpful. At least now we know we are dealing with an 82575. So
the upper limit is 4 queues, and no support for SR-IOV.

>> Also I assume
>> this is a direct assigned port?
>
> Apologies, but I did not understand this question.

Is the adapter above running in the VM and passed through, or is it
just running in the host? You mentioned virtualbox so I thought you
were implying that this was being used inside of a VM.

>> From what I can get based on the log below somehow the driver and the
>> device are falling out of sync. It looks like either we missed a tail
>> update at some point after we stopped the queue.
>>
>> It looks like the error took 2 to 3 days to show up.
>
> yes, indeed.

I don't suppose by any chance you would be willing to try and bisect
the issue? Unfortunately there haven't been that many changes to igb
itself so my concern is that we are looking at a change in the traffic
behavior and that is somehow triggering issues in igb. Being able to
bisect it would be very useful.

>> Do you know if
>> there are any reproduction steps that might let us start bisecting
>> this, or that would at least allow us to reproduce the issue more
>> quickly?
>
> Impossibile for me to reproduce. I'm not able to understand
> why/when it is happening.

We can try and see if we can reproduce it, but we haven't seen any
similar issues in our validation environment so I don't know if we
could be able to get to root cause as there isn't anything obvious
that should be causing the issue.

>> Also, what sort of traffic are you sending over the port?
>
> this host is running slackware linux 14.2 64bit with oracle
> virtualbox 5.2.16
> The traffic to this hosts is small: after 3 dayes uptime
> it is less than 10GBytes:
>
> root at Kaa:~# last | head | grep reboot
> reboot   system boot  4.18.0-rc6       Mon Jul 23 13:18 - 16:52 (3+03:33)
> root at Kaa:~# ifconfig  eth0
> eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 9000
>         inet 10.81.110.15  netmask 255.255.255.0  broadcast 10.81.110.255
>         ether 00:19:99:ab:0b:38  txqueuelen 1000  (Ethernet)
>         RX packets 10813141  bytes 2139165411 (1.9 GiB)
>         RX errors 0  dropped 0  overruns 0  frame 0
>         TX packets 10860078  bytes 4702798829 (4.3 GiB)
>         TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0
>         device memory 0xce260000-ce27ffff
>
> there are around 12 virtual machine hosted running (mainly windows7).
>
> bind/dhcp/proftpd/openssh/ntp and the above mentioned oracle virtualbox
> are the only running applications on this host.
>
> Problem popped up from linux 4.17.0
>
> root at Kaa:~# ethtool -k eth0
> Features for eth0:
> Cannot get device udp-fragmentation-offload settings: Operation not supported
> rx-checksumming: on
> tx-checksumming: on
>         tx-checksum-ipv4: off [fixed]
>         tx-checksum-ip-generic: on
>         tx-checksum-ipv6: off [fixed]
>         tx-checksum-fcoe-crc: off [fixed]
>         tx-checksum-sctp: off [fixed]
> scatter-gather: on
>         tx-scatter-gather: on
>         tx-scatter-gather-fraglist: off [fixed]
> tcp-segmentation-offload: on
>         tx-tcp-segmentation: on
>         tx-tcp-ecn-segmentation: off [fixed]
>         tx-tcp-mangleid-segmentation: off
>         tx-tcp6-segmentation: on
> udp-fragmentation-offload: off
> generic-segmentation-offload: on
> generic-receive-offload: on
> large-receive-offload: off [fixed]
> rx-vlan-offload: on
> tx-vlan-offload: on
> ntuple-filters: off [fixed]
> receive-hashing: on
> highdma: on [fixed]
> rx-vlan-filter: on [fixed]
> vlan-challenged: off [fixed]
> tx-lockless: off [fixed]
> netns-local: off [fixed]
> tx-gso-robust: off [fixed]
> tx-fcoe-segmentation: off [fixed]
> tx-gre-segmentation: on
> tx-gre-csum-segmentation: on
> tx-ipxip4-segmentation: on
> tx-ipxip6-segmentation: on
> tx-udp_tnl-segmentation: on
> tx-udp_tnl-csum-segmentation: on
> tx-gso-partial: on
> tx-sctp-segmentation: off [fixed]
> tx-esp-segmentation: off [fixed]
> tx-udp-segmentation: off [fixed]
> fcoe-mtu: off [fixed]
> tx-nocache-copy: off
> loopback: off [fixed]
> rx-fcs: off [fixed]
> rx-all: off
> tx-vlan-stag-hw-insert: off [fixed]
> rx-vlan-stag-hw-parse: off [fixed]
> rx-vlan-stag-filter: off [fixed]
> l2-fwd-offload: off [fixed]
> hw-tc-offload: off [fixed]
> esp-hw-offload: off [fixed]
> esp-tx-csum-hw-offload: off [fixed]
> rx-udp_tunnel-port-offload: off [fixed]
> tls-hw-tx-offload: off [fixed]
> rx-gro-hw: off [fixed]
> tls-hw-record: off [fixed]

The only thing I can think of that you might want to try as an
alternative to bisecting might be to try disabling features.
Specifically you could start by disabling TSO. If disabling that
causes the issue to disappear then that would be at least a data-point
that would push us toward the direction of identifying the root cause.
Other than that the only other thing I could think of would be to look
at disabling scatter-gather. But it is unlikely that it is causing the
issue.

^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
  2018-07-26 16:05         ` Alexander Duyck
@ 2018-07-27  8:47           ` Marco Berizzi
  2018-07-30 13:11             ` Marco Berizzi
  0 siblings, 1 reply; 15+ messages in thread
From: Marco Berizzi @ 2018-07-27  8:47 UTC (permalink / raw)
  To: intel-wired-lan

> Il 26 luglio 2018 alle 18.05 Alexander Duyck <alexander.duyck@gmail.com> ha scritto:

> > > Also I assume
> > > this is a direct assigned port?
> > 
> > Apologies, but I did not understand this question.
> 
> Is the adapter above running in the VM and passed through, or is it
> just running in the host?

the problem is happening on the host machine.

> You mentioned virtualbox so I thought you
> were implying that this was being used inside of a VM.

no no. I mentioned virtualbox because it add kernel modules
to the vanilla kernel.
 
> I don't suppose by any chance you would be willing to try and bisect
> the issue? Unfortunately there haven't been that many changes to igb
> itself so my concern is that we are looking at a change in the traffic
> behavior and that is somehow triggering issues in igb. Being able to
> bisect it would be very useful.
> 
> > > Do you know if
> > > there are any reproduction steps that might let us start bisecting
> > > this, or that would at least allow us to reproduce the issue more
> > > quickly?
> > 
> > Impossibile for me to reproduce. I'm not able to understand
> > why/when it is happening.
> 
> We can try and see if we can reproduce it, but we haven't seen any
> similar issues in our validation environment so I don't know if we
> could be able to get to root cause as there isn't anything obvious
> that should be causing the issue.

I think I have found the problem. Apologies it is not related
to the kernel version.

> Specifically you could start by disabling TSO. If disabling that
> causes the issue to disappear then that would be at least a data-point
> that would push us toward the direction of identifying the root cause.
> Other than that the only other thing I could think of would be to look
> at disabling scatter-gather. But it is unlikely that it is causing the
> issue.

this machine (which is called Kaa) is connected to an HPE5130 switch.
There is only another machine running on the network with MTU=9000
(which is called Pleiadi).
The problem has started to pop up on Kaa when I changed the MTU on
Pleiadi from MTU=1500 to MTU=9000 (for fixing the same error message,
however Pleiadi is runnig on an older intel NIC)

see this thread:

https://lists.osuosl.org/pipermail/intel-wired-lan/Week-of-Mon-20180326/012410.html

Let me know what kind of test should I do.

Should I disable the TSO? Or should I set all my linux boxes MTU to 1500?

^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
  2018-07-27  8:47           ` Marco Berizzi
@ 2018-07-30 13:11             ` Marco Berizzi
  2018-08-06 11:39               ` Marco Berizzi
  0 siblings, 1 reply; 15+ messages in thread
From: Marco Berizzi @ 2018-07-30 13:11 UTC (permalink / raw)
  To: intel-wired-lan

> Il 27 luglio 2018 alle 10.47 Marco Berizzi <pupilla@libero.it> ha scritto:

> Should I disable the TSO? Or should I set all my linux boxes MTU to 1500?

Hello everyone,

One hour ago I upgraded to linux 4.18-rc7 and I set the MTU=1500

I will keep you updated.

^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
  2018-07-30 13:11             ` Marco Berizzi
@ 2018-08-06 11:39               ` Marco Berizzi
  2018-08-28 15:20                 ` Marco Berizzi
  0 siblings, 1 reply; 15+ messages in thread
From: Marco Berizzi @ 2018-08-06 11:39 UTC (permalink / raw)
  To: intel-wired-lan

> Il 30 luglio 2018 alle 15.11 Marco Berizzi <pupilla@libero.it> ha scritto:
> 
> > Il 27 luglio 2018 alle 10.47 Marco Berizzi <pupilla@libero.it> ha scritto:
> > 
> > Should I disable the TSO? Or should I set all my linux boxes MTU to 1500?
> 
> Hello everyone,
> 
> One hour ago I upgraded to linux 4.18-rc7 and I set the MTU=1500
> 
> I will keep you updated.

After 6 days uptime I got the same error message with MTU=1500.
Now I will upgrade to 4.18-rc8 with MTU=1500 and I will disable
the tso with the following command: ethtool -K eth0 tso off

[    0.000000] Linux version 4.18.0-rc7 (root at Kaa) (gcc version 5.5.0 (GCC)) #1 SMP Mon Jul 30 11:06:16 CEST 2018
[    0.000000] Command line: auto BOOT_IMAGE=Linux ro root=802 vt.default_utf8=0
[    0.000000] x86/fpu: x87 FPU will use FXSAVE
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009bfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009c000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e4000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x00000000bf69ffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000bf6a0000-0x00000000bf6b9fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000bf6ba000-0x00000000bf6bafff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000bf6bb000-0x00000000bfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000e0000000-0x00000000efffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fecfffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ffa00000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000103fffffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.5 present.
[    0.000000] DMI: FUJITSU                          PRIMERGY RX300 S6             /D2619, BIOS 6.00 Rev. 1.13.2619.N1           01/19/2012
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] last_pfn = 0x1040000 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 00C0000000 mask FFC0000000 uncachable
[    0.000000]   1 base 0000000000 mask F000000000 write-back
[    0.000000]   2 base 1000000000 mask FFC0000000 write-back
[    0.000000]   3 disabled
[    0.000000]   4 disabled
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000]   8 disabled
[    0.000000]   9 disabled
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.000000] e820: update [mem 0xc0000000-0xffffffff] usable ==> reserved
[    0.000000] last_pfn = 0xbf6a0 max_arch_pfn = 0x400000000
[    0.000000] Base memory trampoline at [(____ptrval____)] 96000 size 24576
[    0.000000] Using GB pages for direct mapping
[    0.000000] BRK [0x01f5e000, 0x01f5efff] PGTABLE
[    0.000000] BRK [0x01f5f000, 0x01f5ffff] PGTABLE
[    0.000000] BRK [0x01f60000, 0x01f60fff] PGTABLE
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F7EB0 000024 (v02 PTLTD )
[    0.000000] ACPI: XSDT 0x00000000BF6AF6FF 00021C (v01 PTLTD  ? XSDT   00060000  LTP 00000000)
[    0.000000] ACPI: FACP 0x00000000BF6B5883 0000F4 (v03 FSC    TYLERBRG 00060000 PTL  000F4240)
[    0.000000] ACPI: DSDT 0x00000000BF6AF91B 005EE4 (v01 FSC    D2619    00060000 MSFT 03000001)
[    0.000000] ACPI: FACS 0x00000000BF6BAFC0 000040
[    0.000000] ACPI: FACS 0x00000000BF6BAFC0 000040
[    0.000000] ACPI: TCPA 0x00000000BF6B5977 000032 (v01 Phoeni x        00060000 TL   00000000)
[    0.000000] ACPI: SLIT 0x00000000BF6B59A9 000030 (v01 FSC             00060000      0000005A)
[    0.000000] ACPI: SRAT 0x00000000BF6B59D9 000228 (v01 Intel  Tylerbrg 00060000 PHX. 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5C01 0000D8 (v01 FSC    CST_PR00 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5CD9 0000D8 (v01 FSC    CST_PR01 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5DB1 0000D8 (v01 FSC    CST_PR02 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5E89 0000D8 (v01 FSC    CST_PR03 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B5F61 0000D8 (v01 FSC    CST_PR04 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6039 0000D8 (v01 FSC    CST_PR05 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6111 0000D8 (v01 FSC    CST_PR10 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B61E9 0000D8 (v01 FSC    CST_PR11 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B62C1 0000D8 (v01 FSC    CST_PR12 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6399 0000D8 (v01 FSC    CST_PR13 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6471 0000D8 (v01 FSC    CST_PR14 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6549 0000D8 (v01 FSC    CST_PR15 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6621 0000D8 (v01 FSC    CST_PR20 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B66F9 0000D8 (v01 FSC    CST_PR21 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B67D1 0000D8 (v01 FSC    CST_PR22 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B68A9 0000D8 (v01 FSC    CST_PR23 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6981 0000D8 (v01 FSC    CST_PR24 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6A59 0000D8 (v01 FSC    CST_PR25 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6B31 0000D8 (v01 FSC    CST_PR30 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6C09 0000D8 (v01 FSC    CST_PR31 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6CE1 0000D8 (v01 FSC    CST_PR32 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6DB9 0000D8 (v01 FSC    CST_PR33 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6E91 0000D8 (v01 FSC    CST_PR34 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B6F69 0000D8 (v01 FSC    CST_PR35 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7041 00017C (v01 FSC    PST_PR00 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B71BD 00017C (v01 FSC    PST_PR01 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7339 00017C (v01 FSC    PST_PR02 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B74B5 00017C (v01 FSC    PST_PR03 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7631 00017C (v01 FSC    PST_PR04 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B77AD 00017C (v01 FSC    PST_PR05 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7929 00017C (v01 FSC    PST_PR10 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7AA5 00017C (v01 FSC    PST_PR11 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7C21 00017C (v01 FSC    PST_PR12 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7D9D 00017C (v01 FSC    PST_PR13 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B7F19 00017C (v01 FSC    PST_PR14 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8095 00017C (v01 FSC    PST_PR15 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8211 00017C (v01 FSC    PST_PR20 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B838D 00017C (v01 FSC    PST_PR21 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8509 00017C (v01 FSC    PST_PR22 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8685 00017C (v01 FSC    PST_PR23 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8801 00017C (v01 FSC    PST_PR24 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B897D 00017C (v01 FSC    PST_PR25 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8AF9 00017C (v01 FSC    PST_PR30 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8C75 00017C (v01 FSC    PST_PR31 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8DF1 00017C (v01 FSC    PST_PR32 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B8F6D 00017C (v01 FSC    PST_PR33 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B90E9 00017C (v01 FSC    PST_PR34 00060000  CSF 00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B9265 00017C (v01 FSC    PST_PR35 00060000  CSF 00000001)
[    0.000000] ACPI: EINJ 0x00000000BF6B93E1 0001B0 (v01 PTL    WHEAPTL  00060000 PTL  00000001)
[    0.000000] ACPI: HEST 0x00000000BF6B9591 000268 (v01 PTL    WHEAPTL  00060000 PTL  00000001)
[    0.000000] ACPI: BERT 0x00000000BF6B97F9 000030 (v01 PTL    WHEAPTL  00060000 PTL  00000001)
[    0.000000] ACPI: SSDT 0x00000000BF6B9829 0000EB (v01 wheaos wheaosc  00060000 MSFT 03000001)
[    0.000000] ACPI: ERST 0x00000000BF6B9914 000270 (v01 PTL    WHEAPTL  00060000 PTL  00000001)
[    0.000000] ACPI: SPCR 0x00000000BF6B9B84 000050 (v01 PTLTD  $UCRTBL$ 00060000 PTL  00000001)
[    0.000000] ACPI: DMAR 0x00000000BF6B9BD4 0001E8 (v01 Intel  OEMDMAR  00060000 LOHR 00000001)
[    0.000000] ACPI: MCFG 0x00000000BF6B9DBC 00003C (v01 PTLTD    MCFG   00060000  LTP 00000000)
[    0.000000] ACPI: HPET 0x00000000BF6B9DF8 000038 (v01 PTLTD  HPETTBL  00060000  LTP 00000001)
[    0.000000] ACPI: APIC 0x00000000BF6B9E30 0001A8 (v01 PTLTD  ? APIC   00060000  LTP 00000000)
[    0.000000] ACPI: BOOT 0x00000000BF6B9FD8 000028 (v01 PTLTD  $SBFTBL$ 00060000  LTP 00000001)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000103fffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009bfff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x00000000bf69ffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x000000103fffffff]
[    0.000000] Reserved but unavailable: 2501 pages
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000103fffffff]
[    0.000000] On node 0 totalpages: 16774715
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 21 pages reserved
[    0.000000]   DMA zone: 3995 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 12187 pages used for memmap
[    0.000000]   DMA32 zone: 779936 pages, LIFO batch:31
[    0.000000]   Normal zone: 249856 pages used for memmap
[    0.000000]   Normal zone: 15990784 pages, LIFO batch:31
[    0.000000] ACPI: PM-Timer IO Port: 0x1008
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x09] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0a] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0b] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0c] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0d] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0e] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x0f] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x10] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x11] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x12] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x13] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x14] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x15] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x16] high edge lint[0x1])
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0x17] high edge lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 6, version 32, address 0xfec00000, GSI 0-23
[    0.000000] IOAPIC[1]: apic_id 7, version 32, address 0xfec80000, GSI 24-47
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 high edge)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a301 base: 0xfed00000
[    0.000000] ACPI: SPCR: SPCR table version 1
[    0.000000] ACPI: SPCR: Unexpected SPCR Access Width.  Defaulting to byte size
[    0.000000] smpboot: Allowing 24 CPUs, 0 hotplug CPUs
[    0.000000] [mem 0xc0000000-0xdfffffff] available for PCI devices
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns
[    0.000000] random: get_random_bytes called from start_kernel+0x86/0x39f with crng_init=0
[    0.000000] setup_percpu: NR_CPUS:24 nr_cpumask_bits:24 nr_cpu_ids:24 nr_node_ids:1
[    0.000000] percpu: Embedded 41 pages/cpu @(____ptrval____) s130776 r8192 d28968 u262144
[    0.000000] pcpu-alloc: s130776 r8192 d28968 u262144 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15 
[    0.000000] pcpu-alloc: [0] 16 17 18 19 20 21 22 23 
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 16512587
[    0.000000] Kernel command line: auto BOOT_IMAGE=Linux ro root=802 vt.default_utf8=0
[    0.000000] Dentry cache hash table entries: 8388608 (order: 14, 67108864 bytes)
[    0.000000] Inode-cache hash table entries: 4194304 (order: 13, 33554432 bytes)
[    0.000000] Memory: 65866172K/67098860K available (8200K kernel code, 343K rwdata, 1484K rodata, 780K init, 452K bss, 1232688K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=24, Nodes=1
[    0.000000] Kernel/User page tables isolation: enabled
[    0.000000] Hierarchical RCU implementation.
[    0.000000] NR_IRQS: 4352, nr_irqs: 1024, preallocated irqs: 16
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] ACPI: Core revision 20180531
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[    0.000000] hpet clockevent registered
[    0.000000] APIC: Switch to symmetric I/O mode setup
[    0.000000] DMAR-IR: This system BIOS has enabled interrupt remapping
               on a chipset that contains an erratum making that
               feature unstable.  To maintain system stability
               interrupt remapping is being disabled.  Please
               contact your BIOS vendor for an update
[    0.000000] Switched APIC routing to physical flat.
[    0.000000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.005000] tsc: Fast TSC calibration using PIT
[    0.006000] tsc: Detected 2399.929 MHz processor
[    0.007000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2297f48f5eb, max_idle_ns: 440795257017 ns
[    0.007000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4799.85 BogoMIPS (lpj=2399929)
[    0.007000] pid_max: default: 32768 minimum: 301
[    0.007000] Mount-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.008228] Mountpoint-cache hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.008494] CPU: Physical Processor ID: 0
[    0.008588] CPU: Processor Core ID: 0
[    0.008688] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[    0.008788] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[    0.008894] process: using mwait in idle threads
[    0.008991] Last level iTLB entries: 4KB 512, 2MB 7, 4MB 7
[    0.009001] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0
[    0.009103] Spectre V2 : Mitigation: Full generic retpoline
[    0.009202] Speculative Store Bypass: Vulnerable
[    0.009373] Freeing SMP alternatives memory: 20K
[    0.011000] smpboot: CPU0: Intel(R) Xeon(R) CPU           E5645  @ 2.40GHz (family: 0x6, model: 0x2c, stepping: 0x2)
[    0.011000] Performance Events: PEBS fmt1+, Westmere events, 16-deep LBR, Intel PMU driver.
[    0.011000] core: CPUID marked event: 'bus cycles' unavailable
[    0.011000] ... version:                3
[    0.011000] ... bit width:              48
[    0.011000] ... generic registers:      4
[    0.011000] ... value mask:             0000ffffffffffff
[    0.011000] ... max period:             000000007fffffff
[    0.011000] ... fixed-purpose events:   3
[    0.011002] ... event mask:             000000070000000f
[    0.011149] Hierarchical SRCU implementation.
[    0.011532] smp: Bringing up secondary CPUs ...
[    0.011698] x86: Booting SMP configuration:
[    0.011793] .... node  #0, CPUs:        #1  #2  #3  #4  #5  #6  #7  #8  #9 #10 #11 #12 #13 #14 #15 #16 #17 #18 #19 #20 #21 #22 #23
[    0.113045] smp: Brought up 1 node, 24 CPUs
[    0.113248] smpboot: Max logical packages: 2
[    0.113343] smpboot: Total of 24 processors activated (115196.64 BogoMIPS)
[    0.116417] devtmpfs: initialized
[    0.116417] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns
[    0.116417] futex hash table entries: 8192 (order: 7, 524288 bytes)
[    0.117124] xor: measuring software checksum speed
[    0.127002]    prefetch64-sse: 12920.000 MB/sec
[    0.137001]    generic_sse: 10992.000 MB/sec
[    0.137095] xor: using function: prefetch64-sse (12920.000 MB/sec)
[    0.138756] NET: Registered protocol family 16
[    0.139043] cpuidle: using governor ladder
[    0.139109] cpuidle: using governor menu
[    0.139117] Simple Boot Flag at 0x7c set to 0x1
[    0.139221] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    0.139326] ACPI: bus type PCI registered
[    0.139430] PCI: MMCONFIG for domain 0000 [bus 00-0a] at [mem 0xe0000000-0xe0afffff] (base 0xe0000000)
[    0.139568] PCI: MMCONFIG at [mem 0xe0000000-0xe0afffff] reserved in E820
[    0.139677] pmd_set_huge: Cannot satisfy [mem 0xe0000000-0xe0200000] with a huge-page mapping due to MTRR override.
[    0.140017] PCI: Using configuration type 1 for base access
[    0.158004] raid6: sse2x1   gen()  5929 MB/s
[    0.175002] raid6: sse2x1   xor()  4658 MB/s
[    0.192009] raid6: sse2x2   gen()  6988 MB/s
[    0.209002] raid6: sse2x2   xor()  5521 MB/s
[    0.226008] raid6: sse2x4   gen()  7851 MB/s
[    0.243003] raid6: sse2x4   xor()  6201 MB/s
[    0.243098] raid6: using algorithm sse2x4 gen() 7851 MB/s
[    0.243196] raid6: .... xor() 6201 MB/s, rmw enabled
[    0.243293] raid6: using ssse3x2 recovery algorithm
[    0.243459] ACPI: Added _OSI(Module Device)
[    0.243554] ACPI: Added _OSI(Processor Device)
[    0.243649] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.243745] ACPI: Added _OSI(Processor Aggregator Device)
[    0.243843] ACPI: Added _OSI(Linux-Dell-Video)
[    0.248396] ACPI: 50 ACPI AML tables successfully acquired and loaded
[    0.262849] ACPI: Interpreter enabled
[    0.262947] ACPI: (supports S0 S5)
[    0.263002] ACPI: Using IOAPIC for interrupt routing
[    0.263122] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.263390] ACPI: Enabled 10 GPEs in block 00 to 3F
[    0.267431] ACPI: PCI Root Bridge [CPU0] (domain 0000 [bus ff])
[    0.267536] acpi PNP0A03:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.267646] acpi PNP0A03:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.267750] acpi PNP0A03:00: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[    0.268009] PCI host bridge to bus 0000:ff
[    0.268009] pci_bus 0000:ff: root bus resource [bus ff]
[    0.268108] pci 0000:ff:00.0: [8086:2c70] type 00 class 0x060000
[    0.268156] pci 0000:ff:00.1: [8086:2d81] type 00 class 0x060000
[    0.268200] pci 0000:ff:02.0: [8086:2d90] type 00 class 0x060000
[    0.268238] pci 0000:ff:02.1: [8086:2d91] type 00 class 0x060000
[    0.268276] pci 0000:ff:02.2: [8086:2d92] type 00 class 0x060000
[    0.268314] pci 0000:ff:02.3: [8086:2d93] type 00 class 0x060000
[    0.268352] pci 0000:ff:02.4: [8086:2d94] type 00 class 0x060000
[    0.268390] pci 0000:ff:02.5: [8086:2d95] type 00 class 0x060000
[    0.269014] pci 0000:ff:03.0: [8086:2d98] type 00 class 0x060000
[    0.269014] pci 0000:ff:03.1: [8086:2d99] type 00 class 0x060000
[    0.269014] pci 0000:ff:03.2: [8086:2d9a] type 00 class 0x060000
[    0.269014] pci 0000:ff:03.4: [8086:2d9c] type 00 class 0x060000
[    0.269014] pci 0000:ff:04.0: [8086:2da0] type 00 class 0x060000
[    0.269014] pci 0000:ff:04.1: [8086:2da1] type 00 class 0x060000
[    0.269014] pci 0000:ff:04.2: [8086:2da2] type 00 class 0x060000
[    0.269014] pci 0000:ff:04.3: [8086:2da3] type 00 class 0x060000
[    0.269014] pci 0000:ff:05.0: [8086:2da8] type 00 class 0x060000
[    0.269014] pci 0000:ff:05.1: [8086:2da9] type 00 class 0x060000
[    0.269014] pci 0000:ff:05.2: [8086:2daa] type 00 class 0x060000
[    0.269014] pci 0000:ff:05.3: [8086:2dab] type 00 class 0x060000
[    0.269014] pci 0000:ff:06.0: [8086:2db0] type 00 class 0x060000
[    0.269014] pci 0000:ff:06.1: [8086:2db1] type 00 class 0x060000
[    0.269014] pci 0000:ff:06.2: [8086:2db2] type 00 class 0x060000
[    0.269028] pci 0000:ff:06.3: [8086:2db3] type 00 class 0x060000
[    0.269077] pci_bus 0000:ff: on NUMA node 0
[    0.269097] ACPI: PCI Root Bridge [CPU1] (domain 0000 [bus fe])
[    0.269199] acpi PNP0A03:01: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.269310] acpi PNP0A03:01: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.269414] acpi PNP0A03:01: fail to add MMCONFIG information, can't access extended PCI configuration space under this bridge.
[    0.270000] PCI host bridge to bus 0000:fe
[    0.270000] pci_bus 0000:fe: root bus resource [bus fe]
[    0.270000] pci 0000:fe:00.0: [8086:2c70] type 00 class 0x060000
[    0.270009] pci 0000:fe:00.1: [8086:2d81] type 00 class 0x060000
[    0.270009] pci 0000:fe:02.0: [8086:2d90] type 00 class 0x060000
[    0.270009] pci 0000:fe:02.1: [8086:2d91] type 00 class 0x060000
[    0.270009] pci 0000:fe:02.2: [8086:2d92] type 00 class 0x060000
[    0.270009] pci 0000:fe:02.3: [8086:2d93] type 00 class 0x060000
[    0.270038] pci 0000:fe:02.4: [8086:2d94] type 00 class 0x060000
[    0.270079] pci 0000:fe:02.5: [8086:2d95] type 00 class 0x060000
[    0.270121] pci 0000:fe:03.0: [8086:2d98] type 00 class 0x060000
[    0.270162] pci 0000:fe:03.1: [8086:2d99] type 00 class 0x060000
[    0.270202] pci 0000:fe:03.2: [8086:2d9a] type 00 class 0x060000
[    0.270243] pci 0000:fe:03.4: [8086:2d9c] type 00 class 0x060000
[    0.270285] pci 0000:fe:04.0: [8086:2da0] type 00 class 0x060000
[    0.270327] pci 0000:fe:04.1: [8086:2da1] type 00 class 0x060000
[    0.270368] pci 0000:fe:04.2: [8086:2da2] type 00 class 0x060000
[    0.270409] pci 0000:fe:04.3: [8086:2da3] type 00 class 0x060000
[    0.271009] pci 0000:fe:05.0: [8086:2da8] type 00 class 0x060000
[    0.271009] pci 0000:fe:05.1: [8086:2da9] type 00 class 0x060000
[    0.271009] pci 0000:fe:05.2: [8086:2daa] type 00 class 0x060000
[    0.271009] pci 0000:fe:05.3: [8086:2dab] type 00 class 0x060000
[    0.271009] pci 0000:fe:06.0: [8086:2db0] type 00 class 0x060000
[    0.271010] pci 0000:fe:06.1: [8086:2db1] type 00 class 0x060000
[    0.271010] pci 0000:fe:06.2: [8086:2db2] type 00 class 0x060000
[    0.271010] pci 0000:fe:06.3: [8086:2db3] type 00 class 0x060000
[    0.271010] pci_bus 0000:fe: on NUMA node 0
[    0.271010] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3d])
[    0.271010] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.271010] acpi PNP0A08:00: _OSC failed (AE_NOT_FOUND); disabling ASPM
[    0.271109] acpi PNP0A08:00: [Firmware Info]: MMCONFIG for domain 0000 [bus 00-0a] only partially covers this bridge
[    0.271318] PCI host bridge to bus 0000:00
[    0.271414] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.271517] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.271620] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.271726] pci_bus 0000:00: root bus resource [mem 0x000c8000-0x000dffff window]
[    0.271832] pci_bus 0000:00: root bus resource [mem 0xc0000000-0xdfffffff window]
[    0.272002] pci_bus 0000:00: root bus resource [mem 0xf0000000-0xfebfffff window]
[    0.272108] pci_bus 0000:00: root bus resource [mem 0xfed00000-0xfedfffff window]
[    0.272213] pci_bus 0000:00: root bus resource [mem 0xfef00000-0xffbfffff window]
[    0.272319] pci_bus 0000:00: root bus resource [bus 00-3d]
[    0.272428] pci 0000:00:00.0: [8086:3406] type 00 class 0x060000
[    0.272459] pci 0000:00:00.0: enabling Extended Tags
[    0.272586] pci 0000:00:00.0: PME# supported from D0 D3hot D3cold
[    0.273000] pci 0000:00:01.0: [8086:3408] type 01 class 0x060400
[    0.273000] pci 0000:00:01.0: enabling Extended Tags
[    0.273000] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    0.273010] pci 0000:00:03.0: [8086:340a] type 01 class 0x060400
[    0.273010] pci 0000:00:03.0: enabling Extended Tags
[    0.273035] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold
[    0.273113] pci 0000:00:05.0: [8086:340c] type 01 class 0x060400
[    0.273140] pci 0000:00:05.0: enabling Extended Tags
[    0.273269] pci 0000:00:05.0: PME# supported from D0 D3hot D3cold
[    0.273345] pci 0000:00:07.0: [8086:340e] type 01 class 0x060400
[    0.273374] pci 0000:00:07.0: enabling Extended Tags
[    0.273505] pci 0000:00:07.0: PME# supported from D0 D3hot D3cold
[    0.274000] pci 0000:00:08.0: [8086:340f] type 01 class 0x060400
[    0.274000] pci 0000:00:08.0: enabling Extended Tags
[    0.274000] pci 0000:00:08.0: PME# supported from D0 D3hot D3cold
[    0.274009] pci 0000:00:09.0: [8086:3410] type 01 class 0x060400
[    0.274009] pci 0000:00:09.0: enabling Extended Tags
[    0.274015] pci 0000:00:09.0: PME# supported from D0 D3hot D3cold
[    0.274093] pci 0000:00:0a.0: [8086:3411] type 01 class 0x060400
[    0.274120] pci 0000:00:0a.0: enabling Extended Tags
[    0.274249] pci 0000:00:0a.0: PME# supported from D0 D3hot D3cold
[    0.274325] pci 0000:00:10.0: [8086:3425] type 00 class 0x080000
[    0.274424] pci 0000:00:10.1: [8086:3426] type 00 class 0x080000
[    0.275009] pci 0000:00:11.0: [8086:3427] type 00 class 0x080000
[    0.275009] pci 0000:00:11.1: [8086:3428] type 00 class 0x080000
[    0.275010] pci 0000:00:14.0: [8086:342e] type 00 class 0x080000
[    0.275013] pci 0000:00:14.1: [8086:3422] type 00 class 0x080000
[    0.275013] pci 0000:00:14.2: [8086:3423] type 00 class 0x080000
[    0.275035] pci 0000:00:14.3: [8086:3438] type 00 class 0x080000
[    0.275125] pci 0000:00:15.0: [8086:342f] type 00 class 0x080020
[    0.275221] pci 0000:00:1a.0: [8086:3a37] type 00 class 0x0c0300
[    0.275264] pci 0000:00:1a.0: reg 0x20: [io  0x1820-0x183f]
[    0.275359] pci 0000:00:1a.1: [8086:3a38] type 00 class 0x0c0300
[    0.275402] pci 0000:00:1a.1: reg 0x20: [io  0x1840-0x185f]
[    0.275499] pci 0000:00:1a.2: [8086:3a39] type 00 class 0x0c0300
[    0.275541] pci 0000:00:1a.2: reg 0x20: [io  0x1860-0x187f]
[    0.276010] pci 0000:00:1a.7: [8086:3a3c] type 00 class 0x0c0320
[    0.276010] pci 0000:00:1a.7: reg 0x10: [mem 0xce000000-0xce0003ff]
[    0.276010] pci 0000:00:1a.7: PME# supported from D0 D3hot D3cold
[    0.276010] pci 0000:00:1c.0: [8086:3a40] type 01 class 0x060400
[    0.276010] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    0.276010] pci 0000:00:1c.4: [8086:3a48] type 01 class 0x060400
[    0.276040] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold
[    0.276118] pci 0000:00:1d.0: [8086:3a34] type 00 class 0x0c0300
[    0.276160] pci 0000:00:1d.0: reg 0x20: [io  0x1880-0x189f]
[    0.276257] pci 0000:00:1d.1: [8086:3a35] type 00 class 0x0c0300
[    0.276299] pci 0000:00:1d.1: reg 0x20: [io  0x18a0-0x18bf]
[    0.276395] pci 0000:00:1d.2: [8086:3a36] type 00 class 0x0c0300
[    0.276438] pci 0000:00:1d.2: reg 0x20: [io  0x18c0-0x18df]
[    0.277009] pci 0000:00:1d.7: [8086:3a3a] type 00 class 0x0c0320
[    0.277009] pci 0000:00:1d.7: reg 0x10: [mem 0xce001000-0xce0013ff]
[    0.277009] pci 0000:00:1d.7: PME# supported from D0 D3hot D3cold
[    0.277012] pci 0000:00:1e.0: [8086:244e] type 01 class 0x060401
[    0.277012] pci 0000:00:1f.0: [8086:3a18] type 00 class 0x060100
[    0.277012] pci 0000:00:1f.2: [8086:3a20] type 00 class 0x01018f
[    0.277012] pci 0000:00:1f.2: reg 0x10: [io  0x1c50-0x1c57]
[    0.277012] pci 0000:00:1f.2: reg 0x14: [io  0x1c44-0x1c47]
[    0.277012] pci 0000:00:1f.2: reg 0x18: [io  0x1c48-0x1c4f]
[    0.277019] pci 0000:00:1f.2: reg 0x1c: [io  0x1c40-0x1c43]
[    0.277026] pci 0000:00:1f.2: reg 0x20: [io  0x1c10-0x1c1f]
[    0.277033] pci 0000:00:1f.2: reg 0x24: [io  0x1c00-0x1c0f]
[    0.277129] pci 0000:00:1f.3: [8086:3a30] type 00 class 0x0c0500
[    0.277146] pci 0000:00:1f.3: reg 0x10: [mem 0xce002000-0xce0020ff 64bit]
[    0.277165] pci 0000:00:1f.3: reg 0x20: [io  0x18e0-0x18ff]
[    0.277245] pci 0000:00:1f.5: [8086:3a26] type 00 class 0x010185
[    0.277261] pci 0000:00:1f.5: reg 0x10: [io  0x1c68-0x1c6f]
[    0.277268] pci 0000:00:1f.5: reg 0x14: [io  0x1c5c-0x1c5f]
[    0.277275] pci 0000:00:1f.5: reg 0x18: [io  0x1c60-0x1c67]
[    0.277282] pci 0000:00:1f.5: reg 0x1c: [io  0x1c58-0x1c5b]
[    0.277289] pci 0000:00:1f.5: reg 0x20: [io  0x1c30-0x1c3f]
[    0.277296] pci 0000:00:1f.5: reg 0x24: [io  0x1c20-0x1c2f]
[    0.277420] pci 0000:01:00.0: [1000:0079] type 00 class 0x010400
[    0.277435] pci 0000:01:00.0: reg 0x10: [io  0x2000-0x20ff]
[    0.277444] pci 0000:01:00.0: reg 0x14: [mem 0xce100000-0xce103fff 64bit]
[    0.277454] pci 0000:01:00.0: reg 0x1c: [mem 0xce180000-0xce1bffff 64bit]
[    0.277466] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0003ffff pref]
[    0.277472] pci 0000:01:00.0: enabling Extended Tags
[    0.277604] pci 0000:01:00.0: supports D1 D2
[    0.278011] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.278011] pci 0000:00:01.0:   bridge window [io  0x2000-0x2fff]
[    0.278011] pci 0000:00:01.0:   bridge window [mem 0xce100000-0xce1fffff]
[    0.278011] pci 0000:00:03.0: PCI bridge to [bus 02]
[    0.278011] pci 0000:00:05.0: PCI bridge to [bus 03]
[    0.278036] pci 0000:00:07.0: PCI bridge to [bus 04]
[    0.278165] pci 0000:00:08.0: PCI bridge to [bus 05]
[    0.278295] pci 0000:00:09.0: PCI bridge to [bus 06]
[    0.278427] pci 0000:00:0a.0: PCI bridge to [bus 07]
[    0.279013] pci 0000:08:00.0: [8086:10a7] type 00 class 0x020000
[    0.279013] pci 0000:08:00.0: reg 0x10: [mem 0xce260000-0xce27ffff]
[    0.279013] pci 0000:08:00.0: reg 0x14: [mem 0xce240000-0xce25ffff]
[    0.279013] pci 0000:08:00.0: reg 0x18: [io  0x3000-0x301f]
[    0.279013] pci 0000:08:00.0: reg 0x1c: [mem 0xce200000-0xce203fff]
[    0.279013] pci 0000:08:00.0: reg 0x30: [mem 0x00000000-0x0001ffff pref]
[    0.279013] pci 0000:08:00.0: PME# supported from D0 D3hot D3cold
[    0.279013] pci 0000:08:00.1: [8086:10a7] type 00 class 0x020000
[    0.279013] pci 0000:08:00.1: reg 0x10: [mem 0xce2c0000-0xce2dffff]
[    0.279013] pci 0000:08:00.1: reg 0x14: [mem 0xce2a0000-0xce2bffff]
[    0.279013] pci 0000:08:00.1: reg 0x18: [io  0x3020-0x303f]
[    0.279013] pci 0000:08:00.1: reg 0x1c: [mem 0xce204000-0xce207fff]
[    0.279013] pci 0000:08:00.1: reg 0x30: [mem 0x00000000-0x0001ffff pref]
[    0.279013] pci 0000:08:00.1: PME# supported from D0 D3hot D3cold
[    0.279069] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    0.279169] pci 0000:00:1c.0:   bridge window [io  0x3000-0x3fff]
[    0.279172] pci 0000:00:1c.0:   bridge window [mem 0xce200000-0xce2fffff]
[    0.279227] pci 0000:09:00.0: [102b:0522] type 00 class 0x030000
[    0.279258] pci 0000:09:00.0: reg 0x10: [mem 0xcf000000-0xcfffffff pref]
[    0.279272] pci 0000:09:00.0: reg 0x14: [mem 0xce300000-0xce303fff]
[    0.279286] pci 0000:09:00.0: reg 0x18: [mem 0xce800000-0xceffffff]
[    0.279483] pci 0000:00:1c.4: PCI bridge to [bus 09]
[    0.279584] pci 0000:00:1c.4:   bridge window [mem 0xce300000-0xceffffff]
[    0.279589] pci 0000:00:1c.4:   bridge window [mem 0xcf000000-0xcfffffff 64bit pref]
[    0.279606] pci_bus 0000:0a: extended config space not accessible
[    0.280009] pci 0000:00:1e.0: PCI bridge to [bus 0a] (subtractive decode)
[    0.280009] pci 0000:00:1e.0:   bridge window [io  0x0000-0x0cf7 window] (subtractive decode)
[    0.280009] pci 0000:00:1e.0:   bridge window [io  0x0d00-0xffff window] (subtractive decode)
[    0.280009] pci 0000:00:1e.0:   bridge window [mem 0x000a0000-0x000bffff window] (subtractive decode)
[    0.280009] pci 0000:00:1e.0:   bridge window [mem 0x000c8000-0x000dffff window] (subtractive decode)
[    0.280009] pci 0000:00:1e.0:   bridge window [mem 0xc0000000-0xdfffffff window] (subtractive decode)
[    0.280009] pci 0000:00:1e.0:   bridge window [mem 0xf0000000-0xfebfffff window] (subtractive decode)
[    0.280009] pci 0000:00:1e.0:   bridge window [mem 0xfed00000-0xfedfffff window] (subtractive decode)
[    0.280009] pci 0000:00:1e.0:   bridge window [mem 0xfef00000-0xffbfffff window] (subtractive decode)
[    0.280009] pci_bus 0000:00: on NUMA node 0
[    0.280087] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    0.280246] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    0.280404] ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 *9 10 11 12 14 15)
[    0.280564] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 7 9 *10 11 12 14 15)
[    0.280715] ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 9 10 11 12 14 15) *0, disabled.
[    0.280877] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    0.281038] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 7 9 10 *11 12 14 15)
[    0.281196] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 *5 6 7 9 10 11 12 14 15)
[    0.282032] pci 0000:09:00.0: vgaarb: setting as boot VGA device
[    0.283000] pci 0000:09:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.283005] pci 0000:09:00.0: vgaarb: bridge control possible
[    0.283104] vgaarb: loaded
[    0.284038] SCSI subsystem initialized
[    0.284038] PCI: Using ACPI for IRQ routing
[    0.284038] PCI: pci_cache_line_size set to 64 bytes
[    0.284038] Expanded resource Reserved due to conflict with PCI Bus 0000:00
[    0.284038] e820: reserve RAM buffer [mem 0x0009c000-0x0009ffff]
[    0.284038] e820: reserve RAM buffer [mem 0xbf6a0000-0xbfffffff]
[    0.284137] clocksource: Switched to clocksource tsc-early
[    0.284170] pnp: PnP ACPI init
[    0.284382] system 00:00: [mem 0xe0000000-0xefffffff] has been reserved
[    0.284490] system 00:00: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.284791] system 00:01: [io  0x0200-0x020f] has been reserved
[    0.284892] system 00:01: [io  0x04d0-0x04d1] has been reserved
[    0.284993] system 00:01: [io  0x0500-0x057f] has been reserved
[    0.285095] system 00:01: [io  0x0800-0x080f] has been reserved
[    0.285195] system 00:01: [io  0x0810-0x081f] has been reserved
[    0.285296] system 00:01: [io  0x0ca0-0x0ca1] has been reserved
[    0.285396] system 00:01: [io  0x0ca4-0x0ca7] has been reserved
[    0.285497] system 00:01: [io  0x0ca8-0x0cab] has been reserved
[    0.285601] system 00:01: [io  0x0cae-0x0caf] has been reserved
[    0.285702] system 00:01: [io  0x0e00-0x0e7f] has been reserved
[    0.285802] system 00:01: [io  0x1000-0x107f] has been reserved
[    0.285903] system 00:01: [io  0x1100-0x110f] has been reserved
[    0.286004] system 00:01: [io  0x1180-0x11ff] has been reserved
[    0.286104] system 00:01: [io  0xfe00] has been reserved
[    0.286203] system 00:01: [io  0xff00] has been reserved
[    0.286302] system 00:01: [mem 0xfec00000-0xfecfffff] could not be reserved
[    0.286406] system 00:01: [mem 0xfee00000-0xfeefffff] could not be reserved
[    0.286511] system 00:01: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    0.286620] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.286653] pnp 00:02: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.286854] pnp 00:03: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.286998] pnp 00:04: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.287051] pnp: PnP ACPI: found 5 devices
[    0.292635] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.292821] pci 0000:00:1c.0: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 08] add_size 200000 add_align 100000
[    0.292829] pci 0000:00:1c.4: bridge window [io  0x1000-0x0fff] to [bus 09] add_size 1000
[    0.292850] pci 0000:00:1c.0: BAR 9: assigned [mem 0xc0000000-0xc01fffff 64bit pref]
[    0.292958] pci 0000:00:1c.4: BAR 7: assigned [io  0x4000-0x4fff]
[    0.293060] pci 0000:01:00.0: BAR 6: assigned [mem 0xce140000-0xce17ffff pref]
[    0.293166] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.293263] pci 0000:00:01.0:   bridge window [io  0x2000-0x2fff]
[    0.293367] pci 0000:00:01.0:   bridge window [mem 0xce100000-0xce1fffff]
[    0.293474] pci 0000:00:03.0: PCI bridge to [bus 02]
[    0.293579] pci 0000:00:05.0: PCI bridge to [bus 03]
[    0.293682] pci 0000:00:07.0: PCI bridge to [bus 04]
[    0.293785] pci 0000:00:08.0: PCI bridge to [bus 05]
[    0.293887] pci 0000:00:09.0: PCI bridge to [bus 06]
[    0.293990] pci 0000:00:0a.0: PCI bridge to [bus 07]
[    0.294095] pci 0000:08:00.0: BAR 6: assigned [mem 0xce220000-0xce23ffff pref]
[    0.294200] pci 0000:08:00.1: BAR 6: assigned [mem 0xce280000-0xce29ffff pref]
[    0.294305] pci 0000:00:1c.0: PCI bridge to [bus 08]
[    0.294402] pci 0000:00:1c.0:   bridge window [io  0x3000-0x3fff]
[    0.294506] pci 0000:00:1c.0:   bridge window [mem 0xce200000-0xce2fffff]
[    0.294612] pci 0000:00:1c.0:   bridge window [mem 0xc0000000-0xc01fffff 64bit pref]
[    0.294721] pci 0000:00:1c.4: PCI bridge to [bus 09]
[    0.294819] pci 0000:00:1c.4:   bridge window [io  0x4000-0x4fff]
[    0.294922] pci 0000:00:1c.4:   bridge window [mem 0xce300000-0xceffffff]
[    0.295028] pci 0000:00:1c.4:   bridge window [mem 0xcf000000-0xcfffffff 64bit pref]
[    0.295137] pci 0000:00:1e.0: PCI bridge to [bus 0a]
[    0.295242] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    0.295244] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    0.295245] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.295247] pci_bus 0000:00: resource 7 [mem 0x000c8000-0x000dffff window]
[    0.295248] pci_bus 0000:00: resource 8 [mem 0xc0000000-0xdfffffff window]
[    0.295250] pci_bus 0000:00: resource 9 [mem 0xf0000000-0xfebfffff window]
[    0.295251] pci_bus 0000:00: resource 10 [mem 0xfed00000-0xfedfffff window]
[    0.295253] pci_bus 0000:00: resource 11 [mem 0xfef00000-0xffbfffff window]
[    0.295254] pci_bus 0000:01: resource 0 [io  0x2000-0x2fff]
[    0.295256] pci_bus 0000:01: resource 1 [mem 0xce100000-0xce1fffff]
[    0.295258] pci_bus 0000:08: resource 0 [io  0x3000-0x3fff]
[    0.295259] pci_bus 0000:08: resource 1 [mem 0xce200000-0xce2fffff]
[    0.295261] pci_bus 0000:08: resource 2 [mem 0xc0000000-0xc01fffff 64bit pref]
[    0.295262] pci_bus 0000:09: resource 0 [io  0x4000-0x4fff]
[    0.295264] pci_bus 0000:09: resource 1 [mem 0xce300000-0xceffffff]
[    0.295265] pci_bus 0000:09: resource 2 [mem 0xcf000000-0xcfffffff 64bit pref]
[    0.295267] pci_bus 0000:0a: resource 4 [io  0x0000-0x0cf7 window]
[    0.295269] pci_bus 0000:0a: resource 5 [io  0x0d00-0xffff window]
[    0.295270] pci_bus 0000:0a: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.295272] pci_bus 0000:0a: resource 7 [mem 0x000c8000-0x000dffff window]
[    0.295273] pci_bus 0000:0a: resource 8 [mem 0xc0000000-0xdfffffff window]
[    0.295275] pci_bus 0000:0a: resource 9 [mem 0xf0000000-0xfebfffff window]
[    0.295276] pci_bus 0000:0a: resource 10 [mem 0xfed00000-0xfedfffff window]
[    0.295278] pci_bus 0000:0a: resource 11 [mem 0xfef00000-0xffbfffff window]
[    0.295342] NET: Registered protocol family 2
[    0.295559] tcp_listen_portaddr_hash hash table entries: 32768 (order: 7, 524288 bytes)
[    0.295787] TCP established hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.296867] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.297204] TCP: Hash tables configured (established 524288 bind 65536)
[    0.297380] UDP hash table entries: 32768 (order: 8, 1048576 bytes)
[    0.297736] UDP-Lite hash table entries: 32768 (order: 8, 1048576 bytes)
[    0.298159] NET: Registered protocol family 1
[    0.301277] pci 0000:08:00.0: Disabling L0s
[    0.301373] pci 0000:08:00.0: can't disable ASPM; OS doesn't have ASPM control
[    0.301480] pci 0000:08:00.1: Disabling L0s
[    0.301577] pci 0000:08:00.1: can't disable ASPM; OS doesn't have ASPM control
[    0.301693] pci 0000:09:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.301803] PCI: CLS 64 bytes, default 64
[    0.301830] DMAR: Host address width 40
[    0.301924] DMAR: DRHD base: 0x000000fed14000 flags: 0x1
[    0.302029] DMAR: dmar0: reg_base_addr fed14000 ver 1:0 cap c90780106f0462 ecap f02076
[    0.302136] DMAR: RMRR base: 0x000000bf6d0000 end: 0x000000bf6e7fff
[    0.302237] DMAR: RMRR base: 0x000000bf6f0000 end: 0x000000bf6f0fff
[    0.302338] DMAR: RMRR base: 0x000000bf6f1000 end: 0x000000bf6f1fff
[    0.302439] DMAR: RMRR base: 0x000000bf6f2000 end: 0x000000bf6f2fff
[    0.302540] DMAR: RMRR base: 0x000000bf6fa000 end: 0x000000bf6fafff
[    0.302644] DMAR: RMRR base: 0x000000bf6f3000 end: 0x000000bf6f3fff
[    0.302744] DMAR: RMRR base: 0x000000bf6f4000 end: 0x000000bf6f4fff
[    0.302845] DMAR: RMRR base: 0x000000bf6f5000 end: 0x000000bf6f5fff
[    0.302946] DMAR: RMRR base: 0x000000bf6fb000 end: 0x000000bf6fbfff
[    0.303048] DMAR: ATSR flags: 0x0
[    0.303367] DMAR: dmar0: Using Queued invalidation
[    0.303481] DMAR: Setting RMRR:
[    0.303847] DMAR: Setting identity map for device 0000:00:1d.7 [0xbf6fb000 - 0xbf6fbfff]
[    0.304325] DMAR: Setting identity map for device 0000:00:1d.2 [0xbf6f5000 - 0xbf6f5fff]
[    0.304637] DMAR: Setting identity map for device 0000:00:1d.1 [0xbf6f4000 - 0xbf6f4fff]
[    0.304949] DMAR: Setting identity map for device 0000:00:1d.0 [0xbf6f3000 - 0xbf6f3fff]
[    0.305268] DMAR: Setting identity map for device 0000:00:1a.7 [0xbf6fa000 - 0xbf6fafff]
[    0.305581] DMAR: Setting identity map for device 0000:00:1a.2 [0xbf6f2000 - 0xbf6f2fff]
[    0.305897] DMAR: Setting identity map for device 0000:00:1a.1 [0xbf6f1000 - 0xbf6f1fff]
[    0.306216] DMAR: Setting identity map for device 0000:00:1a.0 [0xbf6f0000 - 0xbf6f0fff]
[    0.306345] DMAR: Setting identity map for device 0000:00:1a.0 [0xbf6d0000 - 0xbf6e7fff]
[    0.306453] DMAR: Setting identity map for device 0000:00:1a.1 [0xbf6d0000 - 0xbf6e7fff]
[    0.306562] DMAR: Setting identity map for device 0000:00:1a.2 [0xbf6d0000 - 0xbf6e7fff]
[    0.306670] DMAR: Setting identity map for device 0000:00:1a.7 [0xbf6d0000 - 0xbf6e7fff]
[    0.306778] DMAR: Setting identity map for device 0000:00:1d.0 [0xbf6d0000 - 0xbf6e7fff]
[    0.306886] DMAR: Setting identity map for device 0000:00:1d.1 [0xbf6d0000 - 0xbf6e7fff]
[    0.306995] DMAR: Setting identity map for device 0000:00:1d.2 [0xbf6d0000 - 0xbf6e7fff]
[    0.307103] DMAR: Setting identity map for device 0000:00:1d.7 [0xbf6d0000 - 0xbf6e7fff]
[    0.307221] DMAR: Prepare 0-16MiB unity mapping for LPC
[    0.307517] DMAR: Setting identity map for device 0000:00:1f.0 [0x0 - 0xffffff]
[    0.307798] DMAR: Intel(R) Virtualization Technology for Directed I/O
[    0.307975] iommu: Adding device 0000:ff:00.0 to group 0
[    0.308088] iommu: Adding device 0000:ff:00.1 to group 0
[    0.308257] iommu: Adding device 0000:ff:02.0 to group 1
[    0.308367] iommu: Adding device 0000:ff:02.1 to group 1
[    0.308478] iommu: Adding device 0000:ff:02.2 to group 1
[    0.308588] iommu: Adding device 0000:ff:02.3 to group 1
[    0.308698] iommu: Adding device 0000:ff:02.4 to group 1
[    0.308808] iommu: Adding device 0000:ff:02.5 to group 1
[    0.308956] iommu: Adding device 0000:ff:03.0 to group 2
[    0.309067] iommu: Adding device 0000:ff:03.1 to group 2
[    0.309177] iommu: Adding device 0000:ff:03.2 to group 2
[    0.309290] iommu: Adding device 0000:ff:03.4 to group 2
[    0.309437] iommu: Adding device 0000:ff:04.0 to group 3
[    0.309548] iommu: Adding device 0000:ff:04.1 to group 3
[    0.309660] iommu: Adding device 0000:ff:04.2 to group 3
[    0.309771] iommu: Adding device 0000:ff:04.3 to group 3
[    0.309918] iommu: Adding device 0000:ff:05.0 to group 4
[    0.310030] iommu: Adding device 0000:ff:05.1 to group 4
[    0.310142] iommu: Adding device 0000:ff:05.2 to group 4
[    0.310256] iommu: Adding device 0000:ff:05.3 to group 4
[    0.310404] iommu: Adding device 0000:ff:06.0 to group 5
[    0.310516] iommu: Adding device 0000:ff:06.1 to group 5
[    0.310628] iommu: Adding device 0000:ff:06.2 to group 5
[    0.310740] iommu: Adding device 0000:ff:06.3 to group 5
[    0.310869] iommu: Adding device 0000:fe:00.0 to group 6
[    0.310982] iommu: Adding device 0000:fe:00.1 to group 6
[    0.311149] iommu: Adding device 0000:fe:02.0 to group 7
[    0.311264] iommu: Adding device 0000:fe:02.1 to group 7
[    0.311377] iommu: Adding device 0000:fe:02.2 to group 7
[    0.311490] iommu: Adding device 0000:fe:02.3 to group 7
[    0.311602] iommu: Adding device 0000:fe:02.4 to group 7
[    0.311714] iommu: Adding device 0000:fe:02.5 to group 7
[    0.311861] iommu: Adding device 0000:fe:03.0 to group 8
[    0.311975] iommu: Adding device 0000:fe:03.1 to group 8
[    0.312088] iommu: Adding device 0000:fe:03.2 to group 8
[    0.312201] iommu: Adding device 0000:fe:03.4 to group 8
[    0.312351] iommu: Adding device 0000:fe:04.0 to group 9
[    0.312465] iommu: Adding device 0000:fe:04.1 to group 9
[    0.312578] iommu: Adding device 0000:fe:04.2 to group 9
[    0.312693] iommu: Adding device 0000:fe:04.3 to group 9
[    0.312840] iommu: Adding device 0000:fe:05.0 to group 10
[    0.312955] iommu: Adding device 0000:fe:05.1 to group 10
[    0.313070] iommu: Adding device 0000:fe:05.2 to group 10
[    0.313185] iommu: Adding device 0000:fe:05.3 to group 10
[    0.313334] iommu: Adding device 0000:fe:06.0 to group 11
[    0.313452] iommu: Adding device 0000:fe:06.1 to group 11
[    0.313567] iommu: Adding device 0000:fe:06.2 to group 11
[    0.313682] iommu: Adding device 0000:fe:06.3 to group 11
[    0.313794] iommu: Adding device 0000:00:00.0 to group 12
[    0.313905] iommu: Adding device 0000:00:01.0 to group 13
[    0.314018] iommu: Adding device 0000:00:03.0 to group 14
[    0.314131] iommu: Adding device 0000:00:05.0 to group 15
[    0.314246] iommu: Adding device 0000:00:07.0 to group 16
[    0.314357] iommu: Adding device 0000:00:08.0 to group 17
[    0.314469] iommu: Adding device 0000:00:09.0 to group 18
[    0.314582] iommu: Adding device 0000:00:0a.0 to group 19
[    0.314712] iommu: Adding device 0000:00:10.0 to group 20
[    0.314829] iommu: Adding device 0000:00:10.1 to group 20
[    0.314959] iommu: Adding device 0000:00:11.0 to group 21
[    0.315076] iommu: Adding device 0000:00:11.1 to group 21
[    0.315230] iommu: Adding device 0000:00:14.0 to group 22
[    0.315348] iommu: Adding device 0000:00:14.1 to group 22
[    0.315466] iommu: Adding device 0000:00:14.2 to group 22
[    0.315583] iommu: Adding device 0000:00:14.3 to group 22
[    0.315703] iommu: Adding device 0000:00:15.0 to group 23
[    0.315851] iommu: Adding device 0000:00:1a.0 to group 24
[    0.315969] iommu: Adding device 0000:00:1a.1 to group 24
[    0.316087] iommu: Adding device 0000:00:1a.2 to group 24
[    0.316204] iommu: Adding device 0000:00:1a.7 to group 24
[    0.316340] iommu: Adding device 0000:00:1c.0 to group 25
[    0.316461] iommu: Adding device 0000:00:1c.4 to group 25
[    0.316609] iommu: Adding device 0000:00:1d.0 to group 26
[    0.316727] iommu: Adding device 0000:00:1d.1 to group 26
[    0.316845] iommu: Adding device 0000:00:1d.2 to group 26
[    0.316963] iommu: Adding device 0000:00:1d.7 to group 26
[    0.317076] iommu: Adding device 0000:00:1e.0 to group 27
[    0.317226] iommu: Adding device 0000:00:1f.0 to group 28
[    0.317345] iommu: Adding device 0000:00:1f.2 to group 28
[    0.317464] iommu: Adding device 0000:00:1f.3 to group 28
[    0.318817] iommu: Adding device 0000:00:1f.5 to group 28
[    0.318932] iommu: Adding device 0000:01:00.0 to group 29
[    0.319036] iommu: Adding device 0000:08:00.0 to group 25
[    0.319139] iommu: Adding device 0000:08:00.1 to group 25
[    0.319244] iommu: Adding device 0000:09:00.0 to group 25
[    0.321705] workingset: timestamp_bits=62 max_order=24 bucket_order=0
[    0.323431] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 250)
[    0.323537] io scheduler noop registered
[    0.323630] io scheduler deadline registered
[    0.323769] io scheduler cfq registered (default)
[    0.323865] io scheduler mq-deadline registered
[    0.323961] io scheduler kyber registered
[    0.329026] megasas: 07.705.02.00-rc1
[    0.329270] megaraid_sas 0000:01:00.0: FW now in Ready state
[    0.329374] megaraid_sas 0000:01:00.0: 64 bit DMA mask and 32 bit consistent mask
[    0.329905] megaraid_sas 0000:01:00.0: firmware supports msix        : (0)
[    0.330010] megaraid_sas 0000:01:00.0: current msix/online cpus      : (1/24)
[    0.330115] megaraid_sas 0000:01:00.0: RDPQ mode     : (disabled)
[    0.419248] megaraid_sas 0000:01:00.0: controller type       : MR(512MB)
[    0.419360] megaraid_sas 0000:01:00.0: Online Controller Reset(OCR)  : Enabled
[    0.419471] megaraid_sas 0000:01:00.0: Secure JBOD support   : No
[    0.419577] megaraid_sas 0000:01:00.0: NVMe passthru support : No
[    0.419680] megaraid_sas 0000:01:00.0: megasas_init_mfi: fw_support_ieee=0
[    0.419797] megaraid_sas 0000:01:00.0: INIT adapter done
[    0.419901] megaraid_sas 0000:01:00.0: Jbod map is not supported megasas_setup_jbod_map 5128
[    0.464258] megaraid_sas 0000:01:00.0: pci id                : (0x1000)/(0x0079)/(0x1734)/(0x1176)
[    0.464374] megaraid_sas 0000:01:00.0: unevenspan support    : no
[    0.464482] megaraid_sas 0000:01:00.0: firmware crash dump   : no
[    0.464585] megaraid_sas 0000:01:00.0: jbod sync map         : no
[    0.464686] scsi host0: Avago SAS based MegaRAID driver
[    0.469948] scsi 0:2:0:0: Direct-Access     LSI      RAID 5/6 SAS 6G  2.90 PQ: 0 ANSI: 5
[    0.471114] scsi 0:2:1:0: Direct-Access     LSI      RAID 5/6 SAS 6G  2.90 PQ: 0 ANSI: 5
[    0.482332] rtc_cmos 00:02: RTC can wake from S4
[    0.482724] random: fast init done
[    0.482734] rtc_cmos 00:02: registered as rtc0
[    0.482930] rtc_cmos 00:02: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[    0.482989] sd 0:2:0:0: [sda] 285671424 512-byte logical blocks: (146 GB/136 GiB)
[    0.483064] sd 0:2:1:0: [sdb] 1171062784 512-byte logical blocks: (600 GB/558 GiB)
[    0.483254] sd 0:2:0:0: [sda] Write Protect is off
[    0.483302] sd 0:2:1:0: [sdb] Write Protect is off
[    0.483371] sd 0:2:0:0: [sda] Mode Sense: 1f 00 10 08
[    0.483469] sd 0:2:1:0: [sdb] Mode Sense: 1f 00 10 08
[    0.483779] sd 0:2:1:0: [sdb] Write cache: disabled, read cache: enabled, supports DPO and FUA
[    0.483782] sd 0:2:0:0: [sda] Write cache: disabled, read cache: enabled, supports DPO and FUA
[    0.483922] NET: Registered protocol family 17
[    0.484179] sched_clock: Marking stable (483853967, 0)->(655552400, -171698433)
[    0.484546] registered taskstats version 1
[    0.484615]  sdb: sdb1
[    0.484987] Btrfs loaded, crc32c=crc32c-generic
[    0.485062] sd 0:2:1:0: [sdb] Attached SCSI disk
[    0.485746] rtc_cmos 00:02: setting system clock to 2018-07-30 14:09:47 UTC (1532959787)
[    0.492262]  sda: sda1 sda2 sda3
[    0.493377] sd 0:2:0:0: [sda] Attached SCSI disk
[    0.501206] BTRFS: device fsid 473b3d83-48a1-4653-b073-5b55b600badd devid 1 transid 459686 /dev/root
[    0.502634] BTRFS info (device sda2): disk space caching is enabled
[    0.502756] BTRFS info (device sda2): has skinny extents
[    0.735104] VFS: Mounted root (btrfs filesystem) readonly on device 0:13.
[    0.739573] devtmpfs: mounted
[    0.742282] Freeing unused kernel memory: 780K
[    0.745915] Write protecting the kernel read-only data: 12288k
[    0.751546] Freeing unused kernel memory: 2020K
[    0.754978] Freeing unused kernel memory: 564K
[    1.206649] loop: module loaded
[    1.375143] tsc: Refined TSC clocksource calibration: 2400.085 MHz
[    1.376387] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x229887d25b0, max_idle_ns: 440795264680 ns
[    1.377118] clocksource: Switched to clocksource tsc
[    1.463209] random: udevd: uninitialized urandom read (16 bytes read)
[    1.466347] random: udevd: uninitialized urandom read (16 bytes read)
[    1.466459] random: udevd: uninitialized urandom read (16 bytes read)
[    1.473319] random: crng init done
[    1.473413] random: 2 urandom warning(s) missed due to ratelimiting
[    1.700486] udevd[1021]: starting eudev-3.1.5
[    1.902225] ACPI: bus type USB registered
[    1.902343] usbcore: registered new interface driver usbfs
[    1.902449] usbcore: registered new interface driver hub
[    1.903839] usbcore: registered new device driver usb
[    1.948543] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
[    1.948657] ACPI: Power Button [PWRB]
[    1.948798] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1
[    1.948903] ACPI: Power Button [PWRF]
[    1.988855] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[    2.043072] pps_core: LinuxPPS API ver. 1 registered
[    2.043172] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    2.091555] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    2.130658] ehci-pci: EHCI PCI platform driver
[    2.131012] ehci-pci 0000:00:1a.7: EHCI Host Controller
[    2.131116] ehci-pci 0000:00:1a.7: new USB bus registered, assigned bus number 1
[    2.131231] ehci-pci 0000:00:1a.7: debug port 1
[    2.135220] ehci-pci 0000:00:1a.7: cache line size of 64 is not supported
[    2.135233] ehci-pci 0000:00:1a.7: irq 18, io mem 0xce000000
[    2.142102] ehci-pci 0000:00:1a.7: USB 2.0 started, EHCI 1.00
[    2.142830] hub 1-0:1.0: USB hub found
[    2.142982] hub 1-0:1.0: 6 ports detected
[    2.143576] ehci-pci 0000:00:1d.7: EHCI Host Controller
[    2.143679] ehci-pci 0000:00:1d.7: new USB bus registered, assigned bus number 2
[    2.143793] ehci-pci 0000:00:1d.7: debug port 1
[    2.147794] ehci-pci 0000:00:1d.7: cache line size of 64 is not supported
[    2.147806] ehci-pci 0000:00:1d.7: irq 23, io mem 0xce001000
[    2.154084] ehci-pci 0000:00:1d.7: USB 2.0 started, EHCI 1.00
[    2.154776] hub 2-0:1.0: USB hub found
[    2.154895] hub 2-0:1.0: 6 ports detected
[    2.172398] Serial: 8250/16550 driver, 4 ports, IRQ sharing disabled
[    2.172408] PTP clock support registered
[    2.193168] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    2.214040] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A
[    2.215961] uhci_hcd: USB Universal Host Controller Interface driver
[    2.216279] uhci_hcd 0000:00:1a.0: UHCI Host Controller
[    2.216381] uhci_hcd 0000:00:1a.0: new USB bus registered, assigned bus number 3
[    2.216514] uhci_hcd 0000:00:1a.0: irq 19, io base 0x00001820
[    2.216788] hub 3-0:1.0: USB hub found
[    2.216894] hub 3-0:1.0: 2 ports detected
[    2.217274] uhci_hcd 0000:00:1a.1: UHCI Host Controller
[    2.217376] uhci_hcd 0000:00:1a.1: new USB bus registered, assigned bus number 4
[    2.217502] uhci_hcd 0000:00:1a.1: irq 18, io base 0x00001840
[    2.217758] hub 4-0:1.0: USB hub found
[    2.217863] hub 4-0:1.0: 2 ports detected
[    2.218323] uhci_hcd 0000:00:1a.2: UHCI Host Controller
[    2.218426] uhci_hcd 0000:00:1a.2: new USB bus registered, assigned bus number 5
[    2.218552] uhci_hcd 0000:00:1a.2: irq 18, io base 0x00001860
[    2.218813] hub 5-0:1.0: USB hub found
[    2.218918] hub 5-0:1.0: 2 ports detected
[    2.219306] uhci_hcd 0000:00:1d.0: UHCI Host Controller
[    2.219408] uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 6
[    2.219535] uhci_hcd 0000:00:1d.0: irq 23, io base 0x00001880
[    2.219899] hub 6-0:1.0: USB hub found
[    2.220010] hub 6-0:1.0: 2 ports detected
[    2.220398] uhci_hcd 0000:00:1d.1: UHCI Host Controller
[    2.220502] uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 7
[    2.220639] uhci_hcd 0000:00:1d.1: irq 22, io base 0x000018a0
[    2.220994] hub 7-0:1.0: USB hub found
[    2.221116] hub 7-0:1.0: 2 ports detected
[    2.221544] uhci_hcd 0000:00:1d.2: UHCI Host Controller
[    2.221646] uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 8
[    2.221777] uhci_hcd 0000:00:1d.2: irq 21, io base 0x000018c0
[    2.222341] hub 8-0:1.0: USB hub found
[    2.222450] hub 8-0:1.0: 2 ports detected
[    2.349833] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    2.349938] igb: Copyright (c) 2007-2014 Intel Corporation.
[    2.489474] BTRFS: device fsid 77ad40e4-d53c-4b3b-b135-7c3db9ee21fb devid 1 transid 644604 /dev/sdb1
[    2.565144] igb 0000:08:00.0: Intel(R) Gigabit Ethernet Network Connection
[    2.565252] igb 0000:08:00.0: eth0: (PCIe:2.5Gb/s:Width x4) 00:19:99:ab:0b:38
[    2.565358] igb 0000:08:00.0: eth0: PBA No: Unknown
[    2.565456] igb 0000:08:00.0: Using MSI-X interrupts. 4 rx queue(s), 4 tx queue(s)
[    2.780153] igb 0000:08:00.1: Intel(R) Gigabit Ethernet Network Connection
[    2.780258] igb 0000:08:00.1: eth1: (PCIe:2.5Gb/s:Width x4) 00:19:99:ab:0b:39
[    2.780364] igb 0000:08:00.1: eth1: PBA No: Unknown
[    2.780461] igb 0000:08:00.1: Using MSI-X interrupts. 4 rx queue(s), 4 tx queue(s)
[    2.821806] Adding 10451964k swap on /dev/sda3.  Priority:-2 extents:1 across:10451964k FS
[    3.038614] BTRFS info (device sda2): disk space caching is enabled
[    6.172613] BTRFS info (device sdb1): disk space caching is enabled
[    6.172716] BTRFS info (device sdb1): has skinny extents
[   13.678524] igb 0000:08:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
[   15.986005] vboxdrv: loading out-of-tree module taints kernel.
[   15.999934] vboxdrv: Found 24 processor cores
[   16.018167] vboxdrv: TSC mode is Invariant, tentative frequency 2400054158 Hz
[   16.018168] vboxdrv: Successfully loaded version 5.2.16 (interface 0x00290001)
[   16.041728] VBoxNetAdp: Successfully started.
[   16.067723] VBoxNetFlt: Successfully started.
[   16.091988] VBoxPciLinuxInit
[   16.091993] vboxpci: pci-stub module not available, cannot detach PCI devices
[   16.091993] vboxpci: IOMMU found
[   16.369632] SUPR0GipMap: fGetGipCpu=0xb
[   18.248121] vboxdrv: 00000000881526ac VMMR0.r0
[   18.739377] vboxdrv: 000000003a1a14e1 VBoxDDR0.r0
[   18.765360] VBoxNetFlt: attached to 'eth0' / 00:19:99:ab:0b:38
[   18.780026] vboxpci: created IOMMU domain 00000000d484a79e
[   18.780028] vboxpci: created IOMMU domain 000000006e044039
[   18.844414] vboxpci: created IOMMU domain 000000004ae1f849
[   18.850616] vboxdrv: 00000000ade09819 VBoxEhciR0.r0
[   21.224480] vboxpci: created IOMMU domain 00000000b71d898c
[   23.474490] vboxpci: created IOMMU domain 00000000b56b67cd
[   24.700057] device eth0 entered promiscuous mode
[   26.883569] vboxpci: created IOMMU domain 0000000024991026
[   27.802108] vboxpci: created IOMMU domain 000000009e100ecb
[   32.443105] vboxpci: created IOMMU domain 0000000097fb3d02
[   33.835008] vboxpci: created IOMMU domain 000000007880b684
[   37.269955] vboxpci: created IOMMU domain 000000002ea74cc5
[   37.759160] vboxpci: created IOMMU domain 00000000bcefe813
[   37.789438] vboxpci: created IOMMU domain 0000000051a3e809
[72024.007074] hrtimer: interrupt took 94671 ns
[526394.608753] igb 0000:08:00.0: Detected Tx Unit Hang
                  Tx Queue             
                  TDH                  
                  TDT                  
                  next_to_use          
                  next_to_clean        
                buffer_info[next_to_clean]
                  time_stamp           
                  next_to_watch        
                  jiffies              
                  desc.status          
[526396.593717] igb 0000:08:00.0: Detected Tx Unit Hang
                  Tx Queue             
                  TDH                  
                  TDT                  
                  next_to_use          
                  next_to_clean        
                buffer_info[next_to_clean]
                  time_stamp           
                  next_to_watch        
                  jiffies              
                  desc.status          
[526398.576746] igb 0000:08:00.0: Detected Tx Unit Hang
                  Tx Queue             
                  TDH                  
                  TDT                  
                  next_to_use          
                  next_to_clean        
                buffer_info[next_to_clean]
                  time_stamp           
                  next_to_watch        
                  jiffies              
                  desc.status          
[526400.560676] igb 0000:08:00.0: Detected Tx Unit Hang
                  Tx Queue             
                  TDH                  
                  TDT                  
                  next_to_use          
                  next_to_clean        
                buffer_info[next_to_clean]
                  time_stamp           
                  next_to_watch        
                  jiffies              
                  desc.status          
[526401.584539] ------------[ cut here ]------------
[526401.584543] NETDEV WATCHDOG: eth0 (igb): transmit queue 1 timed out
[526401.584565] WARNING: CPU: 22 PID: 0 at net/sched/sch_generic.c:461 dev_watchdog+0x1d9/0x1e0
[526401.584566] Modules linked in: vboxpci(O) vboxnetflt(O) vboxnetadp(O) vboxdrv(O) igb uhci_hcd ptp 8250 ehci_pci ehci_hcd 8250_base pps_core i2c_algo_bit evdev i2c_i801 button serial_core i2c_core usbcore usb_common loop
[526401.584582] CPU: 22 PID: 0 Comm: swapper/22 Tainted: G          IO      4.18.0-rc7 #1
[526401.584583] Hardware name: FUJITSU                          PRIMERGY RX300 S6             /D2619, BIOS 6.00 Rev. 1.13.2619.N1           01/19/2012
[526401.584585] RIP: 0010:dev_watchdog+0x1d9/0x1e0
[526401.584586] Code: 00 48 63 4d f0 eb 97 4c 89 e7 c6 05 0a e2 83 00 01 e8 8b eb fd ff 89 d9 4c 89 e6 48 c7 c7 f0 49 b3 81 48 89 c2 e8 e7 20 c3 ff  0b eb c0 0f 1f 00 48 c7 47 08 00 00 00 00 48 c7 07 00 00 00 00 
[526401.584612] RSP: 0018:ffff880fff583ec8 EFLAGS: 00010286
[526401.584613] RAX: 0000000000000000 RBX: 0000000000000001 RCX: 0000000000000006
[526401.584614] RDX: 0000000000000007 RSI: 0000000000000096 RDI: ffff880fff594ff0
[526401.584615] RBP: ffff880ff7ddc3b0 R08: 0000000000000001 R09: 000000000000036f
[526401.584616] R10: ffffffff81c05100 R11: 000000000000036f R12: ffff880ff7ddc000
[526401.584617] R13: 0000000000000016 R14: 0000000000000002 R15: ffffffff81c05108
[526401.584619] FS:  0000000000000000(0000) GS:ffff880fff580000(0000) knlGS:0000000000000000
[526401.584620] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[526401.584621] CR2: 000000000185e4d8 CR3: 0000000001c0a004 CR4: 00000000000226a0
[526401.584621] Call Trace:
[526401.584624]  
[526401.584627]  ? qdisc_reset+0xe0/0xe0
[526401.584630]  call_timer_fn+0x13/0x80
[526401.584633]  expire_timers+0x70/0x80
[526401.584634]  run_timer_softirq+0x7e/0x150
[526401.584636]  ? __hrtimer_run_queues+0x130/0x190
[526401.584640]  ? recalibrate_cpu_khz+0x10/0x10
[526401.584642]  ? ktime_get+0x33/0x90
[526401.584645]  ? default_inquire_remote_apic+0x10/0x10
[526401.584648]  ? lapic_next_event+0x17/0x20
[526401.584652]  __do_softirq+0xd4/0x1c9
[526401.584655]  irq_exit+0xa7/0xb0
[526401.584657]  smp_apic_timer_interrupt+0x59/0x90
[526401.584659]  apic_timer_interrupt+0xf/0x20
[526401.584660]  
[526401.584663] RIP: 0010:cpuidle_enter_state+0x127/0x200
[526401.584663] Code: 43 00 89 c3 e8 da f0 c9 ff 65 8b 3d 53 c5 c4 7e e8 ee ef c9 ff 31 ff 49 89 c4 e8 94 f8 c9 ff fb 48 ba cf f7 53 e3 a5 9b c4 20  89 e1 4c 29 e9 48 89 c8 48 c1 f9 3f 48 f7 ea b8 ff ff ff 7f 48 
[526401.584689] RSP: 0018:ffffc9000012be98 EFLAGS: 00000286 ORIG_RAX: ffffffffffffff13
[526401.584691] RAX: ffff880fff59eec0 RBX: 0000000000000003 RCX: 000000000000001f
[526401.584692] RDX: 20c49ba5e353f7cf RSI: 000000003554d98c RDI: 0000000000000000
[526401.584693] RBP: ffff880ff7dfd800 R08: 000000000000000f R09: 0000000000000002
[526401.584694] R10: 0000000000000000 R11: 0000000000000040 R12: 0001dec26b748498
[526401.584695] R13: 0001dec26b6a9da8 R14: 0000000000000003 R15: ffff880ff8cede80
[526401.584697]  ? cpuidle_enter_state+0x11c/0x200
[526401.584700]  do_idle+0x113/0x200
[526401.584702]  cpu_startup_entry+0x6a/0x70
[526401.584704]  start_secondary+0x183/0x1b0
[526401.584707]  secondary_startup_64+0xa5/0xb0
[526401.584709] ---[ end trace 66b857b7877218ad ]---
[526401.584721] igb 0000:08:00.0 eth0: Reset adapter
[526404.640014] igb 0000:08:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX

^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
  2018-08-06 11:39               ` Marco Berizzi
@ 2018-08-28 15:20                 ` Marco Berizzi
  2018-08-28 17:01                   ` Alexander Duyck
  2018-08-28 18:07                   ` Wyborny, Carolyn
  0 siblings, 2 replies; 15+ messages in thread
From: Marco Berizzi @ 2018-08-28 15:20 UTC (permalink / raw)
  To: intel-wired-lan

> Il 6 agosto 2018 alle 13.39 Marco Berizzi <pupilla@libero.it> ha scritto:
> 
> > Il 30 luglio 2018 alle 15.11 Marco Berizzi <pupilla@libero.it> ha scritto:
> > 
> > > Il 27 luglio 2018 alle 10.47 Marco Berizzi <pupilla@libero.it> ha scritto:
> > > 
> > > Should I disable the TSO? Or should I set all my linux boxes MTU to 1500?
> > 
> > Hello everyone,
> > 
> > One hour ago I upgraded to linux 4.18-rc7 and I set the MTU=1500
> > 
> > I will keep you updated.
> 
> After 6 days uptime I got the same error message with MTU=1500.
> Now I will upgrade to 4.18-rc8 with MTU=1500 and I will disable
> the tso with the following command: ethtool -K eth0 tso off

Hello everyone,
same error also with tso disabled:

[2226325.797978] igb 0000:08:00.0: Detected Tx Unit Hang
                   Tx Queue             <1>
                   TDH                  <cf>
                   TDT                  <cf>
                   next_to_use          <d0>
                   next_to_clean        <cf>
                 buffer_info[next_to_clean]
                   time_stamp           <184aee600>
                   next_to_watch        <000000003e213f5a>
                   jiffies              <184aeea00>
                   desc.status          <a8010>
[2226327.782078] igb 0000:08:00.0: Detected Tx Unit Hang
                   Tx Queue             <1>
                   TDH                  <cf>
                   TDT                  <cf>
                   next_to_use          <d0>
                   next_to_clean        <cf>
                 buffer_info[next_to_clean]
                   time_stamp           <184aee600>
                   next_to_watch        <000000003e213f5a>
                   jiffies              <184aef1c0>
                   desc.status          <a8010>
[2226329.765929] igb 0000:08:00.0: Detected Tx Unit Hang
                   Tx Queue             <1>
                   TDH                  <cf>
                   TDT                  <cf>
                   next_to_use          <d0>
                   next_to_clean        <cf>
                 buffer_info[next_to_clean]
                   time_stamp           <184aee600>
                   next_to_watch        <000000003e213f5a>
                   jiffies              <184aef980>
                   desc.status          <a8010>
[2226331.813901] igb 0000:08:00.0: Detected Tx Unit Hang
                   Tx Queue             <1>
                   TDH                  <cf>
                   TDT                  <cf>
                   next_to_use          <d0>
                   next_to_clean        <cf>
                 buffer_info[next_to_clean]
                   time_stamp           <184aee600>
                   next_to_watch        <000000003e213f5a>
                   jiffies              <184af0180>
                   desc.status          <a8010>
[2226333.797875] igb 0000:08:00.0: Detected Tx Unit Hang
                   Tx Queue             <1>
                   TDH                  <cf>
                   TDT                  <cf>
                   next_to_use          <d0>
                   next_to_clean        <cf>
                 buffer_info[next_to_clean]
                   time_stamp           <184aee600>
                   next_to_watch        <000000003e213f5a>
                   jiffies              <184af0940>
                   desc.status          <a8010>
[2226333.989876] igb 0000:08:00.0 eth0: Reset adapter
[2226337.054234] igb 0000:08:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX
root at Kaa:~# ethtool -k eth0
Features for eth0:
Cannot get device udp-fragmentation-offload settings: Operation not supported
rx-checksumming: on
tx-checksumming: on
        tx-checksum-ipv4: off [fixed]
        tx-checksum-ip-generic: on
        tx-checksum-ipv6: off [fixed]
        tx-checksum-fcoe-crc: off [fixed]
        tx-checksum-sctp: off [fixed]
scatter-gather: on
        tx-scatter-gather: on
        tx-scatter-gather-fraglist: off [fixed]
tcp-segmentation-offload: off
        tx-tcp-segmentation: off
        tx-tcp-ecn-segmentation: off [fixed]
        tx-tcp-mangleid-segmentation: off
        tx-tcp6-segmentation: off
udp-fragmentation-offload: off
generic-segmentation-offload: on
generic-receive-offload: on
large-receive-offload: off [fixed]
rx-vlan-offload: on
tx-vlan-offload: on
ntuple-filters: off [fixed]
receive-hashing: on
highdma: on [fixed]
rx-vlan-filter: on [fixed]
vlan-challenged: off [fixed]
tx-lockless: off [fixed]
netns-local: off [fixed]
tx-gso-robust: off [fixed]
tx-fcoe-segmentation: off [fixed]
tx-gre-segmentation: on
tx-gre-csum-segmentation: on
tx-ipxip4-segmentation: on
tx-ipxip6-segmentation: on
tx-udp_tnl-segmentation: on
tx-udp_tnl-csum-segmentation: on
tx-gso-partial: on
tx-sctp-segmentation: off [fixed]
tx-esp-segmentation: off [fixed]
tx-udp-segmentation: off [fixed]
fcoe-mtu: off [fixed]
tx-nocache-copy: off
loopback: off [fixed]
rx-fcs: off [fixed]
rx-all: off
tx-vlan-stag-hw-insert: off [fixed]
rx-vlan-stag-hw-parse: off [fixed]
rx-vlan-stag-filter: off [fixed]
l2-fwd-offload: off [fixed]
hw-tc-offload: off [fixed]
esp-hw-offload: off [fixed]
esp-tx-csum-hw-offload: off [fixed]
rx-udp_tunnel-port-offload: off [fixed]
tls-hw-tx-offload: off [fixed]
rx-gro-hw: off [fixed]
tls-hw-record: off [fixed]

^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
  2018-08-28 15:20                 ` Marco Berizzi
@ 2018-08-28 17:01                   ` Alexander Duyck
  2018-08-31  9:00                     ` Marco Berizzi
  2018-08-28 18:07                   ` Wyborny, Carolyn
  1 sibling, 1 reply; 15+ messages in thread
From: Alexander Duyck @ 2018-08-28 17:01 UTC (permalink / raw)
  To: intel-wired-lan

On Tue, Aug 28, 2018 at 8:20 AM Marco Berizzi <pupilla@libero.it> wrote:
>
> > Il 6 agosto 2018 alle 13.39 Marco Berizzi <pupilla@libero.it> ha scritto:
> >
> > > Il 30 luglio 2018 alle 15.11 Marco Berizzi <pupilla@libero.it> ha scritto:
> > >
> > > > Il 27 luglio 2018 alle 10.47 Marco Berizzi <pupilla@libero.it> ha scritto:
> > > >
> > > > Should I disable the TSO? Or should I set all my linux boxes MTU to 1500?
> > >
> > > Hello everyone,
> > >
> > > One hour ago I upgraded to linux 4.18-rc7 and I set the MTU=1500
> > >
> > > I will keep you updated.
> >
> > After 6 days uptime I got the same error message with MTU=1500.
> > Now I will upgrade to 4.18-rc8 with MTU=1500 and I will disable
> > the tso with the following command: ethtool -K eth0 tso off
>
> Hello everyone,
> same error also with tso disabled:
>
> [2226325.797978] igb 0000:08:00.0: Detected Tx Unit Hang
>                    Tx Queue             <1>
>                    TDH                  <cf>
>                    TDT                  <cf>
>                    next_to_use          <d0>
>                    next_to_clean        <cf>
>                  buffer_info[next_to_clean]
>                    time_stamp           <184aee600>
>                    next_to_watch        <000000003e213f5a>
>                    jiffies              <184aeea00>
>                    desc.status          <a8010>

Okay, so this looks like a Tx hang of some sort where writeback is not
being triggered.

What we may want do is turn up the level of information we are getting
out of the error. You can do that by running:
ethtool -s eth0 msglvl hw on tx_done on pktdata on

That should cause us to dump the Tx descriptor rings and packet data
when we encounter one of these hangs. It is possible we are looking at
some sort of error in the way the data is being formatted on the
descriptor ring that is resulting int he device stopping on whatever
descriptor is at offset <d0>.

Thanks.

- Alex

^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
  2018-08-28 15:20                 ` Marco Berizzi
  2018-08-28 17:01                   ` Alexander Duyck
@ 2018-08-28 18:07                   ` Wyborny, Carolyn
  1 sibling, 0 replies; 15+ messages in thread
From: Wyborny, Carolyn @ 2018-08-28 18:07 UTC (permalink / raw)
  To: intel-wired-lan

> -----Original Message-----
> From: Intel-wired-lan [mailto:intel-wired-lan-bounces at osuosl.org] On
> Behalf Of Marco Berizzi
> Sent: Tuesday, August 28, 2018 8:20 AM
> To: intel-wired-lan at lists.osuosl.org
> Subject: Re: [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to
> 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
> 
> > Il 6 agosto 2018 alle 13.39 Marco Berizzi <pupilla@libero.it> ha scritto:
> >
> > > Il 30 luglio 2018 alle 15.11 Marco Berizzi <pupilla@libero.it> ha scritto:
> > >
> > > > Il 27 luglio 2018 alle 10.47 Marco Berizzi <pupilla@libero.it> ha scritto:
> > > >
> > > > Should I disable the TSO? Or should I set all my linux boxes MTU to
> 1500?
> > >
> > > Hello everyone,
> > >
> > > One hour ago I upgraded to linux 4.18-rc7 and I set the MTU=1500
> > >
> > > I will keep you updated.
> >
> > After 6 days uptime I got the same error message with MTU=1500.
> > Now I will upgrade to 4.18-rc8 with MTU=1500 and I will disable
> > the tso with the following command: ethtool -K eth0 tso off
> 
> Hello everyone,
> same error also with tso disabled:
> 

Thanks for the update.  We'll take a look into it.  

Carolyn

Carolyn Wyborny 
Linux Development 
Networking Division 
Intel Corporation 



^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
  2018-08-28 17:01                   ` Alexander Duyck
@ 2018-08-31  9:00                     ` Marco Berizzi
  2018-09-01  2:01                       ` Alexander Duyck
  0 siblings, 1 reply; 15+ messages in thread
From: Marco Berizzi @ 2018-08-31  9:00 UTC (permalink / raw)
  To: intel-wired-lan

> Il 28 agosto 2018 alle 19.01 Alexander Duyck <alexander.duyck@gmail.com> ha scritto:

> Okay, so this looks like a Tx hang of some sort where writeback is not
> being triggered.
> 
> What we may want do is turn up the level of information we are getting
> out of the error. You can do that by running:
> ethtool -s eth0 msglvl hw on tx_done on pktdata on
> 
> That should cause us to dump the Tx descriptor rings and packet data
> when we encounter one of these hangs. It is possible we are looking at
> some sort of error in the way the data is being formatted on the
> descriptor ring that is resulting int he device stopping on whatever
> descriptor is at offset .

Hello Alexander, everyone

Here is the output:

[2712507.323017] igb 0000:08:00.0: Detected Tx Unit Hang
                   Tx Queue             <1>
                   TDH                  <7c>
                   TDT                  <7c>
                   next_to_use          <7d>
                   next_to_clean        <7c>
                 buffer_info[next_to_clean]
                   time_stamp           <1a1a98a00>
                   next_to_watch        <00000000c658a9f5>
                   jiffies              <1a1a98e00>
                   desc.status          <a8010>
[2712509.306973] igb 0000:08:00.0: Detected Tx Unit Hang
                   Tx Queue             <1>
                   TDH                  <7c>
                   TDT                  <7c>
                   next_to_use          <7d>
                   next_to_clean        <7c>
                 buffer_info[next_to_clean]
                   time_stamp           <1a1a98a00>
                   next_to_watch        <00000000c658a9f5>
                   jiffies              <1a1a995c0>
                   desc.status          <a8010>
[2712511.291988] igb 0000:08:00.0: Detected Tx Unit Hang
                   Tx Queue             <1>
                   TDH                  <7c>
                   TDT                  <7c>
                   next_to_use          <7d>
                   next_to_clean        <7c>
                 buffer_info[next_to_clean]
                   time_stamp           <1a1a98a00>
                   next_to_watch        <00000000c658a9f5>
                   jiffies              <1a1a99d81>
                   desc.status          <a8010>
[2712513.338926] igb 0000:08:00.0: Detected Tx Unit Hang
                   Tx Queue             <1>
                   TDH                  <7c>
                   TDT                  <7c>
                   next_to_use          <7d>
                   next_to_clean        <7c>
                 buffer_info[next_to_clean]
                   time_stamp           <1a1a98a00>
                   next_to_watch        <00000000c658a9f5>
                   jiffies              <1a1a9a580>
                   desc.status          <a8010>
[2712515.322904] igb 0000:08:00.0: Detected Tx Unit Hang
                   Tx Queue             <1>
                   TDH                  <7c>
                   TDT                  <7c>
                   next_to_use          <7d>
                   next_to_clean        <7c>
                 buffer_info[next_to_clean]
                   time_stamp           <1a1a98a00>
                   next_to_watch        <00000000c658a9f5>
                   jiffies              <1a1a9ad40>
                   desc.status          <a8010>
[2712515.514852] igb 0000:08:00.0: Net device Info
[2712515.514854] igb: Device Name     state            trans_start
[2712515.514857] igb: eth0            0000000000000003 00000001A1A9ADD6
[2712515.514858] igb 0000:08:00.0: Register Dump
[2712515.514859] igb:  Register Name   Value
[2712515.514861] igb: CTRL            48c00241
[2712515.514863] igb: STATUS          00080783
[2712515.514865] igb: CTRL_EXT        91180c01
[2712515.514867] igb: ICR             00000081
[2712515.514869] igb: RCTL            0400803a
[2712515.514875] igb: RDLEN[0-3]      00001000 00001000 00001000 00001000
[2712515.514882] igb: RDH[0-3]        00000087 000000a5 0000006a 00000087
[2712515.514888] igb: RDT[0-3]        00000086 000000a4 00000069 00000086
[2712515.514894] igb: RXDCTL[0-3]     02040808 02040808 02040808 02040808
[2712515.514900] igb: RDBAL[0-3]      ffffb000 ffffa000 ffff9000 ffff8000
[2712515.514906] igb: RDBAH[0-3]      00000000 00000000 00000000 00000000
[2712515.514908] igb: TCTL            a503f0fa
[2712515.514914] igb: TDBAL[0-3]      ffffb000 ffffa000 ffff9000 ffff8000
[2712515.514920] igb: TDBAH[0-3]      00000000 00000000 00000000 00000000
[2712515.514927] igb: TDLEN[0-3]      00001000 00001000 00001000 00001000
[2712515.514933] igb: TDH[0-3]        000000e7 0000007c 0000003c 00000015
[2712515.514939] igb: TDT[0-3]        000000e7 0000007c 0000003c 00000015
[2712515.514945] igb: TXDCTL[0-3]     02100108 02100108 02100108 02100108
[2712515.514947] igb: TDFH            000015be
[2712515.514949] igb: TDFT            000015ca
[2712515.514950] igb: TDFHS           000015ca
[2712515.514952] igb: TDFPC           00000000
[2712515.514954] igb 0000:08:00.0: TX Rings Summary
[2712515.514954] igb: Queue [NTU] [NTC] [bi(ntc)->dma  ] leng ntw timestamp
[2712515.514957] igb:      0    E7    E7 00000000FF71E7C0 0000           (null) 00000001A1A8B476
[2712515.514959] igb:      1    7D    7C 00000000FF6E6C02 002A 00000000c658a9f5 00000001A1A98A00
[2712515.514961] igb:      2    3C    3C 00000000FF375D40 0000           (null) 00000001A1A951B0
[2712515.514962] igb:      3    15    15 00000000FF709040 0000           (null) 00000001A1A6FB5E
[2712515.514963] igb 0000:08:00.0: TX Rings Dump
[2712515.514964] igb: ------------------------------------
[2712515.514964] igb: TX QUEUE INDEX = 0
[2712515.514965] igb: ------------------------------------
[2712515.514965] igb: T [desc]     [address 63:0  ] [PlPOCIStDDM Ln] [bi->dma       ] leng  ntw timestamp        bi->skb
[2712515.514968] igb: T [0x000]    00000000FF2B81C0 016680092B30059A 00000000FF2B81C0 0000            (null) 00000001A1A8B574 000000007738125a
[2712515.514970] igb: T [0x001]    00000000FE154A80 016680092B30059A 00000000FE154A80 0000            (null) 00000001A1A8B574 000000004b9eeae6
[2712515.514972] igb: T [0x002]    00000000FF6884C0 010300092B30040C 00000000FF6884C0 0000            (null) 00000001A1A8B574 000000008e69c59a
[2712515.514974] igb: T [0x003]    00000000FD6D25C0 008040092B300201 00000000FD6D25C0 0000            (null) 00000001A1A8B57F 0000000008cd7ef8
[2712515.514976] igb: T [0x004]    00000000FD2233C0 001AC0092B30006B 00000000FD2233C0 0000            (null) 00000001A1A8B585 00000000dfe795c5
[2712515.514978] igb: T [0x005]    00000000FF9AD1C0 0058C0092B300163 00000000FF9AD1C0 0000            (null) 00000001A1A8B589 00000000345fd6ab
[2712515.514979] igb: T [0x006]    00000000FF7FC9C0 003980092B3000E6 00000000FF7FC9C0 0000            (null) 00000001A1A8B58D 00000000bf61aa84
[2712515.514981] igb: T [0x007]    00000000FD3F57C0 0010C0092B300043 00000000FD3F57C0 0000            (null) 00000001A1A8B591 0000000089ce4669
[2712515.514983] igb: T [0x008]    00000000FF487600 001000092B300040 00000000FF487600 0000            (null) 00000001A1A8B597 0000000086a9961e
[2712515.514985] igb: T [0x009]    00000000FEF39440 000F00092B30003C 00000000FEF39440 0000            (null) 00000001A1A8B597 00000000067ec85f
[2712515.514987] igb: T [0x00A]    00000000FEBBD240 001280092B30004A 00000000FEBBD240 0000            (null) 00000001A1A8B598 00000000d079ac31
[2712515.514989] igb: T [0x00B]    00000000FF2B1080 000F00092B30003C 00000000FF2B1080 0000            (null) 00000001A1A8B59A 000000006b88a84c
[2712515.514991] igb: T [0x00C]    00000000FF88AEC0 000F00092B30003C 00000000FF88AEC0 0000            (null) 00000001A1A8B59B 000000003dd29a5e
[2712515.514993] igb: T [0x00D]    00000000FF6C4BC0 005840092B300161 00000000FF6C4BC0 0000            (null) 00000001A1A8B59B 00000000c763fda8
[2712515.514994] igb: T [0x00E]    00000000FF083A00 000F00092B30003C 00000000FF083A00 0000            (null) 00000001A1A8B59F 00000000a6fb5fe6
[2712515.514996] igb: T [0x00F]    00000000FFA28840 000F00092B30003C 00000000FFA28840 0000            (null) 00000001A1A8B59F 0000000068427b37
[2712515.514998] igb: T [0x010]    00000000FD420680 000F00092B30003C 00000000FD420680 0000            (null) 00000001A1A8B59F 0000000027b23040
[2712515.515000] igb: T [0x011]    00000000FD444900 001280092B30004A 00000000FD444900 0000            (null) 00000001A1A8B5A1 000000007475d707
[2712515.515002] igb: T [0x012]    00000000FFBD0740 000F00092B30003C 00000000FFBD0740 0000            (null) 00000001A1A8B5A4 00000000285c06af
[2712515.515004] igb: T [0x013]    00000000FF609540 001F00092B30007C 00000000FF609540 0000            (null) 00000001A1A8B5A4 000000009f6d07b1
[2712515.515006] igb: T [0x014]    00000000FFB1B280 004EC0092B30013B 00000000FFB1B280 0000            (null) 00000001A1A8B5A8 00000000285c06af
[2712515.515007] igb: T [0x015]    00000000FFA4C0C0 000F00092B30003C 00000000FFA4C0C0 0000            (null) 00000001A1A8B5BB 000000007475d707
[2712515.515009] igb: T [0x016]    00000000FFAF8EC0 001F00092B30007C 00000000FFAF8EC0 0000            (null) 00000001A1A8B5BB 000000009292cfd0
[2712515.515011] igb: T [0x017]    00000000FEFD7500 004EC0092B30013B 00000000FEFD7500 0000            (null) 00000001A1A8B5E6 0000000047759458
[2712515.515013] igb: T [0x018]    00000000FF66E280 003680092B3000DA 00000000FF66E280 0000            (null) 00000001A1A8B5EA 0000000009dd8b65
[2712515.515014] igb: T [0x019]    00000000FF7FC080 001700092B30005C 00000000FF7FC080 0000            (null) 00000001A1A8B5EE 00000000155f4bc3
[2712515.515016] igb: T [0x01A]    00000000FF66EE40 002200092B300088 00000000FF66EE40 0000            (null) 00000001A1A8B5F2 0000000034eac6af
[2712515.515018] igb: T [0x01B]    00000000FEFD7B80 004C80092B300132 00000000FEFD7B80 0000            (null) 00000001A1A8B5F8 00000000257124fe
[2712515.515020] igb: T [0x01C]    00000000FF9AD3C0 013E00092B3004F8 00000000FF9AD3C0 0000            (null) 00000001A1A8B622 00000000224dabc9
[2712515.515022] igb: T [0x01D]    00000000FF71E600 000F00092B30003C 00000000FF71E600 0000            (null) 00000001A1A8B664 00000000f706fd56
[2712515.515024] igb: T [0x01E]    00000000FF2D9400 001C80092B300072 00000000FF2D9400 0000            (null) 00000001A1A8B665 00000000d4e56815
[2712515.515026] igb: T [0x01F]    00000000FD3F6580 005F40092B30017D 00000000FD3F6580 0000            (null) 00000001A1A8B669 0000000017fcb9b3
[2712515.515027] igb: T [0x020]    00000000FEDA9380 0012C0092B30004B 00000000FEDA9380 0000            (null) 00000001A1A8B66E 000000001980273c
[2712515.515029] igb: T [0x021]    00000000FEFAB000 007540092B3001D5 00000000FEFAB000 0000            (null) 00000001A1A8B672 00000000f52224b7
[2712515.515031] igb: T [0x022]    00000000FF1ECC80 007B00092B3001EC 00000000FF1ECC80 0000            (null) 00000001A1A8B678 000000002b69780c
[2712515.515033] igb: T [0x023]    00000000FF580940 006900092B3001A4 00000000FF580940 0000            (null) 00000001A1A8B67E 00000000a140d9e3
[2712515.515035] igb: T [0x024]    00000000FFBE1600 006300092B30018C 00000000FFBE1600 0000            (null) 00000001A1A8B683 00000000c9b84e29
[2712515.515036] igb: T [0x025]    00000000FFB46A40 001680092B30005A 00000000FFB46A40 0000            (null) 00000001A1A8B689 0000000004b8bf0f
[2712515.515038] igb: T [0x026]    00000000FEF011C0 0010C0092B300043 00000000FEF011C0 0000            (null) 00000001A1A8B68D 00000000e2f1b790
[2712515.515040] igb: T [0x027]    00000000FF16AD40 005200092B300148 00000000FF16AD40 0000            (null) 00000001A1A8B691 00000000faf455be
[2712515.515042] igb: T [0x028]    00000000FFCB8AC0 003980092B3000E6 00000000FFCB8AC0 0000            (null) 00000001A1A8B696 00000000b9829d1f
[2712515.515044] igb: T [0x029]    00000000FF0CD380 003600092B3000D8 00000000FF0CD380 0000            (null) 00000001A1A8B6B9 00000000e06f0ed3
[2712515.515046] igb: T [0x02A]    00000000FF21C040 006100092B300184 00000000FF21C040 0000            (null) 00000001A1A8B6BD 000000003fae9c45
[2712515.515047] igb: T [0x02B]    00000000FF9D7E40 0012C0092B30004B 00000000FF9D7E40 0000            (null) 00000001A1A8B6C2 00000000dbc98e98
[2712515.515049] igb: T [0x02C]    00000000FF860700 008040092B300201 00000000FF860700 0000            (null) 00000001A1A8B6C6 00000000e34c7566
[2712515.515051] igb: T [0x02D]    00000000FFCB86C0 005AC0092B30016B 00000000FFCB86C0 0000            (null) 00000001A1A8B6CC 00000000d31a8fcc
[2712515.515053] igb: T [0x02E]    00000000FF16A300 008040092B300201 00000000FF16A300 0000            (null) 00000001A1A8B6D1 00000000d31a8fcc
[2712515.515054] igb: T [0x02F]    00000000FDA80F00 009E80092B30027A 00000000FDA80F00 0000            (null) 00000001A1A8B6D6 00000000d31a8fcc
[2712515.515056] igb: T [0x030]    00000000FEF01B40 008040092B300201 00000000FEF01B40 0000            (null) 00000001A1A8B6DB 00000000d31a8fcc
[2712515.515058] igb: T [0x031]    00000000FEDA9800 006640092B300199 00000000FEDA9800 0000            (null) 00000001A1A8B6E0 00000000d31a8fcc
[2712515.515060] igb: T [0x032]    00000000FEDA9440 008040092B300201 00000000FEDA9440 0000            (null) 00000001A1A8B6E5 00000000d31a8fcc
[2712515.515061] igb: T [0x033]    00000000FEF01140 005180092B300146 00000000FEF01140 0000            (null) 00000001A1A8B6EA 00000000d31a8fcc
[2712515.515063] igb: T [0x034]    00000000FEDCF100 008040092B300201 00000000FEDCF100 0000            (null) 00000001A1A8B73D 00000000e05e3c3b
[2712515.515065] igb: T [0x035]    00000000FFFC7D40 005BC0092B30016F 00000000FFFC7D40 0000            (null) 00000001A1A8B742 00000000df76e003
[2712515.515067] igb: T [0x036]    00000000FEBD1980 008040092B300201 00000000FEBD1980 0000            (null) 00000001A1A8B747 00000000153f8b46
[2712515.515069] igb: T [0x037]    00000000FFA34640 006880092B3001A2 00000000FFA34640 0000            (null) 00000001A1A8B74C 0000000040359d20
[2712515.515070] igb: T [0x038]    00000000FD40D680 008040092B300201 00000000FD40D680 0000            (null) 00000001A1A8B751 000000008daafba3
[2712515.515072] igb: T [0x039]    00000000FFA5E380 005BC0092B30016F 00000000FFA5E380 0000            (null) 00000001A1A8B756 00000000c1e71797
[2712515.515074] igb: T [0x03A]    00000000FEFC6FC0 008040092B300201 00000000FEFC6FC0 0000            (null) 00000001A1A8B75B 0000000084433f1b
[2712515.515076] igb: T [0x03B]    00000000FED14D00 016680092B30059A 00000000FED14D00 0000            (null) 00000001A1A8B761 00000000aabac8bf
[2712515.515078] igb: T [0x03C]    00000000FEF735C0 016680092B30059A 00000000FEF735C0 0000            (null) 00000001A1A8B761 0000000062ce0c33
[2712515.515080] igb: T [0x03D]    00000000FD3C0E80 016680092B30059A 00000000FD3C0E80 0000            (null) 00000001A1A8B762 00000000c905e458
[2712515.515081] igb: T [0x03E]    00000000FF879740 016680092B30059A 00000000FF879740 0000            (null) 00000001A1A8B762 0000000062ce0c33
[2712515.515083] igb: T [0x03F]    00000000FF7D6000 016680092B30059A 00000000FF7D6000 0000            (null) 00000001A1A8B762 00000000aabac8bf
[2712515.515085] igb: T [0x040]    00000000FD536980 013C40092B3004F1 00000000FD536980 0000            (null) 00000001A1A8B762 0000000073e121db
[2712515.515087] igb: T [0x041]    00000000FF6C8240 016680092B30059A 00000000FF6C8240 0000            (null) 00000001A1A8B762 000000001950a4fa
[2712515.515088] igb: T [0x042]    00000000FE402B00 016680092B30059A 00000000FE402B00 0000            (null) 00000001A1A8B762 00000000a7736c96
[2712515.515090] igb: T [0x043]    00000000FF2243C0 016680092B30059A 00000000FF2243C0 0000            (null) 00000001A1A8B762 000000009fc3ab54
[2712515.515092] igb: T [0x044]    00000000FF16A280 00B340092B3002CD 00000000FF16A280 0000            (null) 00000001A1A8B766 00000000f24480a3
[2712515.515094] igb: T [0x045]    0000000000001C14 0000000020200000 00000000FFCB8802 0000            (null) 00000001A1A8BFB5 00000000a92a1882
[2712515.515096] igb: T [0x046]    00000000FFCB8802 008942092B300225 00000000FF196800 0000            (null) 00000001A1A841CC 00000000f9071d90
[2712515.515097] igb: T [0x047]    0000000000001C14 0000000020200000 00000000FFC49402 0000            (null) 00000001A1A8BFC1 000000000dc54bce
[2712515.515099] igb: T [0x048]    00000000FFC49402 008582092B300216 00000000FF1D2900 0000            (null) 00000001A1A841CC 000000006105294e
[2712515.515101] igb: T [0x049]    0000000000001C14 0000000020200800 00000000FEFB165E 0000            (null) 00000001A1A8C18B 00000000ae440e06
[2712515.515103] igb: T [0x04A]    00000000FEFB165E 001082092B300042 00000000FF123202 0000            (null) 00000001A1A84F5E 000000008eb9f554
[2712515.515105] igb: T [0x04B]    0000000000001C14 0000000020200800 00000000FF7F906A 0000            (null) 00000001A1A8C18C 00000000a54547eb
[2712515.515107] igb: T [0x04C]    00000000FF7F906A 000D82092B300036 00000000FFA0206A 0000            (null) 00000001A1A882DB 000000005189a80f
[2712515.515108] igb: T [0x04D]    0000000000001C14 0000000020200800 00000000FF69C86A 0000            (null) 00000001A1A8C18C 000000004696d248
[2712515.515110] igb: T [0x04E]    00000000FF69C86A 017282092B3005CA 00000000FF75F508 0000            (null) 00000001A1A852BF 00000000298b6996
[2712515.515112] igb: T [0x04F]    0000000000001C14 0000000020200800 00000000FF3C9C6A 0000            (null) 00000001A1A8C18C 000000008dcf5435
[2712515.515114] igb: T [0x050]    00000000FF3C9C6A 01728201223000C2 00000000FD2535C0 0000            (null) 00000001A1A852BF 0000000056876f14
[2712515.515116] igb: T [0x051]    00000000FF58E000 000000092B300508 00000000FF58E000 0000            (null) 00000001A1A88356 0000000047f33a64
[2712515.515118] igb: T [0x052]    0000000000001C14 0000000020200800 00000000FF786E6A 0000            (null) 00000001A1A8C18C 00000000aa1a7e7b
[2712515.515120] igb: T [0x053]    00000000FF786E6A 00AD020122300036 00000000FF36A86A 0000            (null) 00000001A1A88357 000000000966288c
[2712515.515121] igb: T [0x054]    00000000FF21C508 000000092B30027E 00000000FF21C508 0000            (null) 00000001A1A852BF 00000000298b6996
[2712515.515123] igb: T [0x055]    0000000000001C14 0000000020200800 00000000FFA4C26A 0000            (null) 00000001A1A8C18D 0000000013f72b01
[2712515.515125] igb: T [0x056]    00000000FFA4C26A 000D82092B300036 00000000FD306E00 0000            (null) 00000001A1A852C3 000000008a5e817c
[2712515.515127] igb: T [0x057]    00000000FEF53980 008040092B300201 00000000FEF53980 0000            (null) 00000001A1A8C326 00000000740fde78
[2712515.515129] igb: T [0x058]    00000000FEC547C0 000F00092B30003C 00000000FEC547C0 0000            (null) 00000001A1A8C32B 00000000e2f2971a
[2712515.515131] igb: T [0x059]    00000000FF895080 016680092B30059A 00000000FF895080 0000            (null) 00000001A1A8C32E 00000000af0c7866
[2712515.515134] igb: T [0x05A]    00000000FD231940 016680092B30059A 00000000FD231940 0000            (null) 00000001A1A8C32E 000000006e5c8432
[2712515.515136] igb: T [0x05B]    00000000FEDD7200 016680092B30059A 00000000FEDD7200 0000            (null) 00000001A1A8C32E 000000007a58df74
[2712515.515139] igb: T [0x05C]    00000000FE096AC0 016680092B30059A 00000000FE096AC0 0000            (null) 00000001A1A8C32E 000000006667b511
[2712515.515141] igb: T [0x05D]    00000000FF99E380 016680092B30059A 00000000FF99E380 0000            (null) 00000001A1A8C32E 0000000051f7fc0e
[2712515.515143] igb: T [0x05E]    00000000FF6929C0 013C40092B3004F1 00000000FF6929C0 0000            (null) 00000001A1A8C32E 0000000043cbd9cb
[2712515.515146] igb: T [0x05F]    00000000FF532280 016680092B30059A 00000000FF532280 0000            (null) 00000001A1A8C32E 0000000038675357
[2712515.515148] igb: T [0x060]    00000000FD466B40 016680092B30059A 00000000FD466B40 0000            (null) 00000001A1A8C32E 00000000a52bcade
[2712515.515151] igb: T [0x061]    00000000FF5F8900 002040092B300081 00000000FF5F8900 0000            (null) 00000001A1A8C332 0000000058f2e106
[2712515.515153] igb: T [0x062]    00000000FE454E40 008040092B300201 00000000FE454E40 0000            (null) 00000001A1A8C4BB 0000000098e74e30
[2712515.515155] igb: T [0x063]    00000000FF373A40 016680092B30059A 00000000FF373A40 0000            (null) 00000001A1A8C4C1 00000000a376413e
[2712515.515158] igb: T [0x064]    00000000FF583480 0100C0092B300403 00000000FF583480 0000            (null) 00000001A1A8C4C2 00000000935114b8
[2712515.515160] igb: T [0x065]    00000000FF0B10C0 008040092B300201 00000000FF0B10C0 0000            (null) 00000001A1A8C4E0 00000000b7c8b5cb
[2712515.515163] igb: T [0x066]    00000000FF52C480 006980092B3001A6 00000000FF52C480 0000            (null) 00000001A1A8C4E5 00000000fd8203c5
[2712515.515165] igb: T [0x067]    00000000FF48DA80 008040092B300201 00000000FF48DA80 0000            (null) 00000001A1A8C4EA 00000000324da710
[2712515.515169] igb: T [0x068]    00000000FD86C680 009B80092B30026E 00000000FD86C680 0000            (null) 00000001A1A8C4EF 00000000fd39d9ec
[2712515.515172] igb: T [0x069]    00000000FF75FD00 008040092B300201 00000000FF75FD00 0000            (null) 00000001A1A8C4F4 00000000514f23ef
[2712515.515175] igb: T [0x06A]    00000000FFA02A00 005180092B300146 00000000FFA02A00 0000            (null) 00000001A1A8C510 00000000176f56e9
[2712515.515177] igb: T [0x06B]    00000000FFA4C0C0 008040092B300201 00000000FFA4C0C0 0000            (null) 00000001A1A8C518 00000000f1af39e5
[2712515.515179] igb: T [0x06C]    00000000FF16A080 0010C0092B300043 00000000FF16A080 0000            (null) 00000001A1A8C51D 0000000089ce4669
[2712515.515181] igb: T [0x06D]    00000000FF6C4EC0 001000092B300040 00000000FF6C4EC0 0000            (null) 00000001A1A8C527 00000000bf61aa84
[2712515.515184] igb: T [0x06E]    00000000FF912D00 000F00092B30003C 00000000FF912D00 0000            (null) 00000001A1A8C527 000000005cc6b0f0
[2712515.515186] igb: T [0x06F]    00000000FFA3BB40 000F00092B30003C 00000000FFA3BB40 0000            (null) 00000001A1A8C52B 000000000406db2c
[2712515.515188] igb: T [0x070]    0000000000001C14 0000000020200800 00000000FFDF7A5E 0000            (null) 00000001A1A8C8FB 0000000004925919
[2712515.515190] igb: T [0x071]    00000000FFDF7A5E 001082092B300042 00000000FF41D46A 0000            (null) 00000001A1A885CA 00000000cfaf34b1
[2712515.515193] igb: T [0x072]    0000000000001C14 0000000020200800 00000000FF7A086A 0000            (null) 00000001A1A8C8FC 00000000aa0c3183
[2712515.515195] igb: T [0x073]    00000000FF7A086A 000D82092B300036 00000000FF555C02 0000            (null) 00000001A1A88642 00000000a6fb5fe6
[2712515.515197] igb: T [0x074]    0000000000001C14 0000000020200800 00000000FF52506A 0000            (null) 00000001A1A8C8FD 000000000f6da68e
[2712515.515200] igb: T [0x075]    00000000FF52506A 017282092B3005CA 00000000FD53605E 0000            (null) 00000001A1A886C2 000000004b49d95d
[2712515.515202] igb: T [0x076]    0000000000001C14 0000000020200800 00000000FF81E46A 0000            (null) 00000001A1A8C8FD 0000000004b9c762
[2712515.515204] igb: T [0x077]    00000000FF81E46A 01728201223000C2 00000000FF7D646A 0000            (null) 00000001A1A886C2 00000000df36ad0e
[2712515.515206] igb: T [0x078]    00000000FF957000 000000092B300508 00000000FF957000 0000            (null) 00000001A1A80A20 0000000034eac6af
[2712515.515210] igb: T [0x079]    0000000000001C14 0000000020200800 00000000FD40466A 0000            (null) 00000001A1A8C8FD 0000000093544bdc
[2712515.515212] igb: T [0x07A]    00000000FD40466A 00B6420122300036 00000000FFB27A6A 0000            (null) 00000001A1A80A20 0000000071320d0b
[2712515.515214] igb: T [0x07B]    00000000FEF6A508 000000092B3002A3 00000000FEF6A508 0000            (null) 00000001A1A886C3 00000000c35154c0
[2712515.515216] igb: T [0x07C]    0000000000001C14 0000000020200800 00000000FF498A6A 0000            (null) 00000001A1A8C8FE 00000000da08208b
[2712515.515219] igb: T [0x07D]    00000000FF498A6A 000D82092B300036 00000000FEF3A000 0000            (null) 00000001A1A82B18 00000000af10838e
[2712515.515221] igb: T [0x07E]    0000000000001C14 0000000020200000 00000000FF451802 0000            (null) 00000001A1A8C903 00000000e61d8a4a
[2712515.515223] igb: T [0x07F]    00000000FF451802 008A82092B30022A 00000000FF7E3A02 0000            (null) 00000001A1A82BB3 000000007fa272d8
[2712515.515226] igb: T [0x080]    0000000000001C14 0000000020200000 00000000FF88A002 0000            (null) 00000001A1A8C933 0000000014fd9571
[2712515.515228] igb: T [0x081]    00000000FF88A002 001802092B300060 00000000FFF3586A 0000            (null) 00000001A1A886C4 0000000092edd8a5
[2712515.515231] igb: T [0x082]    0000000000001C14 0000000020200800 00000000FFAA845E 0000            (null) 00000001A1A8CA59 00000000abf1ec97
[2712515.515233] igb: T [0x083]    00000000FFAA845E 001082092B300042 00000000FF62EC02 0000            (null) 00000001A1A8873C 00000000884cf21f
[2712515.515235] igb: T [0x084]    0000000000001C14 0000000020200800 00000000FF2DD46A 0000            (null) 00000001A1A8CA5A 00000000896e656c
[2712515.515237] igb: T [0x085]    00000000FF2DD46A 000D82092B300036 00000000FF54405E 0000            (null) 00000001A1A8873E 00000000bc691c8e
[2712515.515239] igb: T [0x086]    0000000000001C14 0000000020200800 00000000FF37586A 0000            (null) 00000001A1A8CA5A 00000000a2dd7049
[2712515.515241] igb: T [0x087]    00000000FF37586A 017282092B3005CA 00000000FECC506A 0000            (null) 00000001A1A8873F 00000000d38767b4
[2712515.515243] igb: T [0x088]    0000000000001C14 0000000020200800 00000000FF76D46A 0000            (null) 00000001A1A8CA5A 000000009cfc35e1
[2712515.515245] igb: T [0x089]    00000000FF76D46A 01728201223000C2 00000000FF78286A 0000            (null) 00000001A1A88740 0000000078ef8fa9
[2712515.515246] igb: T [0x08A]    00000000FF664000 000000092B300508 00000000FF664000 0000            (null) 00000001A1A80BC5 000000009268bbcf
[2712515.515248] igb: T [0x08B]    0000000000001C14 0000000020200800 00000000FF1E1A6A 0000            (null) 00000001A1A8CA5A 0000000088b320ea
[2712515.515250] igb: T [0x08C]    00000000FF1E1A6A 00AA820122300036 00000000FF2BD06A 0000            (null) 00000001A1A80BC6 00000000224dabc9
[2712515.515252] igb: T [0x08D]    00000000FECCC508 000000092B300274 00000000FECCC508 0000            (null) 00000001A1A86472 00000000689246ad
[2712515.515253] igb: T [0x08E]    0000000000001C14 0000000020200800 00000000FF2E806A 0000            (null) 00000001A1A8CA5B 000000006227b75c
[2712515.515255] igb: T [0x08F]    00000000FF2E806A 000D82092B300036 00000000FF6B6C6A 0000            (null) 00000001A1A86472 00000000a70f85ae
[2712515.515257] igb: T [0x090]    0000000000001C14 0000000020200000 00000000FD2F4002 0000            (null) 00000001A1A8CA5F 00000000e05e3c3b
[2712515.515259] igb: T [0x091]    00000000FD2F4002 008742092B30021D 00000000FF370C6A 0000            (null) 00000001A1A88741 00000000870626a3
[2712515.515261] igb: T [0x092]    0000000000001C14 0000000020200000 00000000FF6C8C02 0000            (null) 00000001A1A8CA7E 00000000a70f85ae
[2712515.515263] igb: T [0x093]    00000000FF6C8C02 008502092B300214 00000000FF9E2602 0000            (null) 00000001A1A88989 00000000481cc8bc
[2712515.515265] igb: T [0x094]    0000000000001C14 0000000020200000 00000000FF273802 0000            (null) 00000001A1A8D408 000000008eb9f554
[2712515.515266] igb: T [0x095]    00000000FF273802 002402092B300090 00000000FD2C525E 0000            (null) 00000001A1A88B27 0000000017fcb9b3
[2712515.515268] igb: T [0x096]    0000000000001C14 0000000020200000 00000000FF11B802 0000            (null) 00000001A1A8E70D 0000000070849254
[2712515.515270] igb: T [0x097]    00000000FF11B802 002402092B300090 00000000FF5DB86A 0000            (null) 00000001A1A88B27 000000001980273c
[2712515.515272] igb: T [0x098]    0000000000001C14 0000000020200000 00000000FF072202 0000            (null) 00000001A1A8E9DB 0000000075c3e342
[2712515.515273] igb: T [0x099]    00000000FF072202 002382092B30008E 00000000FF5DA86A 0000            (null) 00000001A1A88B28 00000000cd812a0f
[2712515.515275] igb: T [0x09A]    0000000000001C14 0000000020200000 00000000FF091402 0000            (null) 00000001A1A8F135 00000000a20c42af
[2712515.515277] igb: T [0x09B]    00000000FF091402 008442092B300211 00000000FFAB006A 0000            (null) 00000001A1A88B28 0000000083d2a59f
[2712515.515279] igb: T [0x09C]    00000000FF7D6840 003CC0092B3000F3 00000000FF7D6840 0000            (null) 00000001A1A90531 000000004afd2866
[2712515.515280] igb: T [0x09D]    0000000000001C14 0000000020200000 00000000FF3F8802 0000            (null) 00000001A1A92354 00000000c905e458
[2712515.515282] igb: T [0x09E]    00000000FF3F8802 0086C2092B30021B 00000000FD44666A 0000            (null) 00000001A1A88B28 00000000763ed557
[2712515.515284] igb: T [0x09F]    0000000000001C14 0000000020200000 00000000FF5EC602 0000            (null) 00000001A1A925DF 00000000976d13ff
[2712515.515286] igb: T [0x0A0]    00000000FF5EC602 002382092B30008E 00000000FF92C508 0000            (null) 00000001A1A71BEA 000000007621f7a4
[2712515.515288] igb: T [0x0A1]    00000000FF622C40 001280092B30004A 00000000FF622C40 0000            (null) 00000001A1A92982 00000000df9b14c6
[2712515.515289] igb: T [0x0A2]    00000000FF165A80 000F00092B30003C 00000000FF165A80 0000            (null) 00000001A1A92986 0000000040359d20
[2712515.515291] igb: T [0x0A3]    00000000FF545780 005840092B300161 00000000FF545780 0000            (null) 00000001A1A92986 00000000deac8a57
[2712515.515293] igb: T [0x0A4]    00000000FF7185C0 000F00092B30003C 00000000FF7185C0 0000            (null) 00000001A1A9298A 000000001ee9319f
[2712515.515295] igb: T [0x0A5]    00000000FF5BC400 000F00092B30003C 00000000FF5BC400 0000            (null) 00000001A1A9298A 00000000ad2c0068
[2712515.515297] igb: T [0x0A6]    00000000FECDD240 000F00092B30003C 00000000FECDD240 0000            (null) 00000001A1A9298A 0000000010efe30b
[2712515.515299] igb: T [0x0A7]    00000000FF416C40 001280092B30004A 00000000FF416C40 0000            (null) 00000001A1A9298B 000000000530e769
[2712515.515300] igb: T [0x0A8]    00000000FF416A80 000F00092B30003C 00000000FF416A80 0000            (null) 00000001A1A9298E 0000000049341e5b
[2712515.515302] igb: T [0x0A9]    00000000FECDD880 001F00092B30007C 00000000FECDD880 0000            (null) 00000001A1A9298F 0000000049623ead
[2712515.515304] igb: T [0x0AA]    00000000FF5BC5C0 004EC0092B30013B 00000000FF5BC5C0 0000            (null) 00000001A1A92992 000000009726d210
[2712515.515306] igb: T [0x0AB]    00000000FF183440 000F00092B30003C 00000000FF183440 0000            (null) 00000001A1A929A8 000000003607ab60
[2712515.515308] igb: T [0x0AC]    00000000FF4D6240 001F00092B30007C 00000000FF4D6240 0000            (null) 00000001A1A929A8 00000000b0dd8c21
[2712515.515310] igb: T [0x0AD]    00000000FD9BEF80 004EC0092B30013B 00000000FD9BEF80 0000            (null) 00000001A1A929D3 00000000ab80aaba
[2712515.515311] igb: T [0x0AE]    00000000FF229D00 003680092B3000DA 00000000FF229D00 0000            (null) 00000001A1A929D7 00000000b5a3c5cf
[2712515.515313] igb: T [0x0AF]    00000000FFCC4B00 001700092B30005C 00000000FFCC4B00 0000            (null) 00000001A1A929DC 000000005c51ec63
[2712515.515315] igb: T [0x0B0]    00000000FF9BA8C0 002200092B300088 00000000FF9BA8C0 0000            (null) 00000001A1A929E0 0000000022ba7c7c
[2712515.515317] igb: T [0x0B1]    00000000FD6B7600 004C80092B300132 00000000FD6B7600 0000            (null) 00000001A1A929E6 0000000075c3e342
[2712515.515319] igb: T [0x0B2]    00000000FD5A8F00 014080092B300502 00000000FD5A8F00 0000            (null) 00000001A1A92A10 000000007dbafeca
[2712515.515320] igb: T [0x0B3]    00000000FF718D40 000F00092B30003C 00000000FF718D40 0000            (null) 00000001A1A92A58 000000007c5e1b86
[2712515.515322] igb: T [0x0B4]    00000000FF545B40 001C80092B300072 00000000FF545B40 0000            (null) 00000001A1A92A59 0000000045f2e31b
[2712515.515324] igb: T [0x0B5]    00000000FF165840 005F40092B30017D 00000000FF165840 0000            (null) 00000001A1A92A5C 000000007dbafeca
[2712515.515326] igb: T [0x0B6]    00000000FF622640 0012C0092B30004B 00000000FF622640 0000            (null) 00000001A1A92A61 0000000074d16874
[2712515.515328] igb: T [0x0B7]    00000000FF07A340 005680092B30015A 00000000FF07A340 0000            (null) 00000001A1A92A65 000000001bcc6c91
[2712515.515329] igb: T [0x0B8]    00000000FEA50FC0 007540092B3001D5 00000000FEA50FC0 0000            (null) 00000001A1A92A69 00000000e34a7259
[2712515.515331] igb: T [0x0B9]    00000000FFABFC40 007B00092B3001EC 00000000FFABFC40 0000            (null) 00000001A1A92A6D 000000009726d210
[2712515.515333] igb: T [0x0BA]    00000000FF736900 006900092B3001A4 00000000FF736900 0000            (null) 00000001A1A92A71 0000000049623ead
[2712515.515335] igb: T [0x0BB]    00000000FFF322C0 006300092B30018C 00000000FFF322C0 0000            (null) 00000001A1A92A76 00000000b987e2c0
[2712515.515337] igb: T [0x0BC]    00000000FF6610C0 001680092B30005A 00000000FF6610C0 0000            (null) 00000001A1A92A7A 00000000c8926fa0
[2712515.515338] igb: T [0x0BD]    00000000FFB50EC0 0010C0092B300043 00000000FFB50EC0 0000            (null) 00000001A1A92A7E 0000000004b8bf0f
[2712515.515340] igb: T [0x0BE]    00000000FFC78BC0 006000092B300180 00000000FFC78BC0 0000            (null) 00000001A1A92A82 000000008daafba3
[2712515.515342] igb: T [0x0BF]    00000000FFA66E80 0012C0092B30004B 00000000FFA66E80 0000            (null) 00000001A1A92A86 000000002d39f65b
[2712515.515344] igb: T [0x0C0]    00000000FFF98B80 0057C0092B30015F 00000000FFF98B80 0000            (null) 00000001A1A92A8A 00000000c517e418
[2712515.515345] igb: T [0x0C1]    00000000FEDC11C0 003980092B3000E6 00000000FEDC11C0 0000            (null) 00000001A1A92A8F 00000000763ed557
[2712515.515347] igb: T [0x0C2]    00000000FE10AF40 003600092B3000D8 00000000FE10AF40 0000            (null) 00000001A1A92A93 0000000083d2a59f
[2712515.515349] igb: T [0x0C3]    00000000FF9F1800 016680092B30059A 00000000FF9F1800 0000            (null) 00000001A1A92A98 00000000cd812a0f
[2712515.515351] igb: T [0x0C4]    00000000FFA8F0C0 016680092B30059A 00000000FFA8F0C0 0000            (null) 00000001A1A92A98 00000000adce3324
[2712515.515352] igb: T [0x0C5]    00000000FDB9C980 016680092B30059A 00000000FDB9C980 0000            (null) 00000001A1A92A98 000000000fbad8d7
[2712515.515354] igb: T [0x0C6]    00000000FEDEE240 016680092B30059A 00000000FEDEE240 0000            (null) 00000001A1A92A98 00000000c803c462
[2712515.515356] igb: T [0x0C7]    00000000FE8F8C80 010300092B30040C 00000000FE8F8C80 0000            (null) 00000001A1A92A98 00000000b7669aa2
[2712515.515358] igb: T [0x0C8]    00000000FF8238C0 008040092B300201 00000000FF8238C0 0000            (null) 00000001A1A92AA4 00000000a5fb9984
[2712515.515360] igb: T [0x0C9]    00000000FF6006C0 001AC0092B30006B 00000000FF6006C0 0000            (null) 00000001A1A92AA9 00000000c30222c0
[2712515.515362] igb: T [0x0CA]    00000000FF7EA8C0 0058C0092B300163 00000000FF7EA8C0 0000            (null) 00000001A1A92AAE 00000000c1e71797
[2712515.515364] igb: T [0x0CB]    00000000FF401D00 003980092B3000E6 00000000FF401D00 0000            (null) 00000001A1A92AB2 00000000fd0804c4
[2712515.515365] igb: T [0x0CC]    00000000FEC9BB00 0010C0092B300043 00000000FEC9BB00 0000            (null) 00000001A1A92AB6 00000000104b35a9
[2712515.515367] igb: T [0x0CD]    00000000FEBEB940 001000092B300040 00000000FEBEB940 0000            (null) 00000001A1A92ABC 0000000061ed90fd
[2712515.515369] igb: T [0x0CE]    00000000FF143780 000F00092B30003C 00000000FF143780 0000            (null) 00000001A1A92ABC 0000000015c37a85
[2712515.515371] igb: T [0x0CF]    00000000FFA8B3C0 000F00092B30003C 00000000FFA8B3C0 0000            (null) 00000001A1A92AC0 0000000071e16785
[2712515.515373] igb: T [0x0D0]    00000000FEF40200 003E40092B3000F9 00000000FEF40200 0000            (null) 00000001A1A9333A 00000000a7e15a71
[2712515.515375] igb: T [0x0D1]    0000000000001C14 0000000020200000 00000000FFBF5002 0000            (null) 00000001A1A93B6D 000000001cdbc73a
[2712515.515376] igb: T [0x0D2]    00000000FFBF5002 008702092B30021C 00000000FFA72C6A 0000            (null) 00000001A1A88F10 0000000097a8d7f6
[2712515.515378] igb: T [0x0D3]    00000000FF1C7440 0015C0092B300057 00000000FF1C7440 0000            (null) 00000001A1A93EC5 00000000acf61d7b
[2712515.515380] igb: T [0x0D4]    00000000FF1E1F80 0015C0092B300057 00000000FF1E1F80 0000            (null) 00000001A1A93F31 00000000e5f49c62
[2712515.515382] igb: T [0x0D5]    00000000FEF40940 0010C0092B300043 00000000FEF40940 0000            (null) 00000001A1A951B0 000000002740b7c1
[2712515.515384] igb: T [0x0D6]    00000000FF545140 0010C0092B300043 00000000FF545140 0000            (null) 00000001A1A9521D 000000009deddda0
[2712515.515385] igb: T [0x0D7]    0000000000001C14 0000000020200000 00000000FF4AF802 0000            (null) 00000001A1A97746 0000000020dd0329
[2712515.515387] igb: T [0x0D8]    00000000FF4AF802 001502092B300054 00000000FF9E2000 0000            (null) 00000001A1A87932 00000000b96946a1
[2712515.515389] igb: T [0x0D9]    0000000000001C14 0000000020200000 00000000FF8D4002 0000            (null) 00000001A1A97785 0000000080f0e154
[2712515.515391] igb: T [0x0DA]    00000000FF8D4002 008942092B300225 00000000FF32586A 0000            (null) 00000001A1A87932 0000000017fcb9b3
[2712515.515392] igb: T [0x0DB]    0000000000001C14 0000000020200000 00000000FF385E02 0000            (null) 00000001A1A982AF 00000000d5b07c90
[2712515.515394] igb: T [0x0DC]    00000000FF385E02 001982092B300066 00000000FFF99E6A 0000            (null) 00000001A1A88F12 00000000f642825b
[2712515.515396] igb: T [0x0DD]    00000000FF773140 001280092B30004A 00000000FF773140 0000            (null) 00000001A1A9854D 00000000cd812a0f
[2712515.515398] igb: T [0x0DE]    00000000FFEFAF80 000F00092B30003C 00000000FFEFAF80 0000            (null) 00000001A1A98550 00000000763ed557
[2712515.515400] igb: T [0x0DF]    00000000FFBA5C80 005840092B300161 00000000FFBA5C80 0000            (null) 00000001A1A98551 000000005f134476
[2712515.515401] igb: T [0x0E0]    00000000FEFAEAC0 000F00092B30003C 00000000FEFAEAC0 0000            (null) 00000001A1A98554 00000000e1c016a6
[2712515.515403] igb: T [0x0E1]    00000000FEDE5900 000F00092B30003C 00000000FEDE5900 0000            (null) 00000001A1A98554 0000000013ba157f
[2712515.515405] igb: T [0x0E2]    00000000FFAC6740 000F00092B30003C 00000000FFAC6740 0000            (null) 00000001A1A98555 000000004b45fcae
[2712515.515407] igb: T [0x0E3]    0000000000001C14 0000000020200000 00000000FFC4C802 0000            (null) 00000001A1A995DC 0000000056fbf9f5
[2712515.515409] igb: T [0x0E4]    00000000FFC4C802 002382092B30008E 00000000FF072A00 0000            (null) 00000001A1A8B460 00000000abf1ec97
[2712515.515410] igb: T [0x0E5]    0000000000001C14 0000000020200000 00000000FF6D2C02 0000            (null) 00000001A1A9A6E1 000000008663f12e
[2712515.515412] igb: T [0x0E6]    00000000FF6D2C02 002382092B30008E 00000000FF2D99C0 0000            (null) 00000001A1A8B476 0000000075b0ee84
[2712515.515414] igb: T [0x0E7]    00000000FF71E7C0 001F00092B30007C 00000000FF71E7C0 0000            (null) 00000001A1A8B476 00000000d7e644fa NTC/U
[2712515.515416] igb: T [0x0E8]    00000000FF83F740 004EC0092B30013B 00000000FF83F740 0000            (null) 00000001A1A8B4A1 0000000075e0c95a
[2712515.515418] igb: T [0x0E9]    00000000FF6CCE00 003680092B3000DA 00000000FF6CCE00 0000            (null) 00000001A1A8B4A5 00000000d31a8fcc
[2712515.515420] igb: T [0x0EA]    00000000FF0D1C00 001700092B30005C 00000000FF0D1C00 0000            (null) 00000001A1A8B4AB 00000000d31a8fcc
[2712515.515421] igb: T [0x0EB]    00000000FF4A29C0 002200092B300088 00000000FF4A29C0 0000            (null) 00000001A1A8B4AF 00000000d31a8fcc
[2712515.515423] igb: T [0x0EC]    00000000FF4C3480 004C80092B300132 00000000FF4C3480 0000            (null) 00000001A1A8B4B4 000000001384b82e
[2712515.515425] igb: T [0x0ED]    00000000FF66E080 014080092B300502 00000000FF66E080 0000            (null) 00000001A1A8B4DC 00000000896e656c
[2712515.515427] igb: T [0x0EE]    00000000FF66EEC0 000F00092B30003C 00000000FF66EEC0 0000            (null) 00000001A1A8B534 00000000a1f08b85
[2712515.515428] igb: T [0x0EF]    00000000FFFC1CC0 001C80092B300072 00000000FFFC1CC0 0000            (null) 00000001A1A8B535 00000000239ea72c
[2712515.515430] igb: T [0x0F0]    00000000FF4489C0 005F40092B30017D 00000000FF4489C0 0000            (null) 00000001A1A8B539 000000003e5635b3
[2712515.515432] igb: T [0x0F1]    00000000FD2167C0 0012C0092B30004B 00000000FD2167C0 0000            (null) 00000001A1A8B53D 0000000064b09a0e
[2712515.515434] igb: T [0x0F2]    00000000FFB1D4C0 005680092B30015A 00000000FFB1D4C0 0000            (null) 00000001A1A8B541 00000000178f2ddb
[2712515.515435] igb: T [0x0F3]    00000000FF8A1140 007540092B3001D5 00000000FF8A1140 0000            (null) 00000001A1A8B545 000000009268bbcf
[2712515.515437] igb: T [0x0F4]    00000000FEF6BDC0 007B00092B3001EC 00000000FEF6BDC0 0000            (null) 00000001A1A8B549 000000002890a59b
[2712515.515439] igb: T [0x0F5]    00000000FF4C0A80 006900092B3001A4 00000000FF4C0A80 0000            (null) 00000001A1A8B54D 00000000e097b6c6
[2712515.515441] igb: T [0x0F6]    00000000FD2160C0 006300092B30018C 00000000FD2160C0 0000            (null) 00000001A1A8B551 00000000cac9f00b
[2712515.515442] igb: T [0x0F7]    00000000FF448EC0 001680092B30005A 00000000FF448EC0 0000            (null) 00000001A1A8B555 000000005f116580
[2712515.515444] igb: T [0x0F8]    00000000FFFC1CC0 0010C0092B300043 00000000FFFC1CC0 0000            (null) 00000001A1A8B559 000000001c484eb4
[2712515.515446] igb: T [0x0F9]    00000000FF66E9C0 006000092B300180 00000000FF66E9C0 0000            (null) 00000001A1A8B55D 000000008fb9a2e9
[2712515.515448] igb: T [0x0FA]    00000000FEFD7E40 0012C0092B30004B 00000000FEFD7E40 0000            (null) 00000001A1A8B562 000000000406db2c
[2712515.515450] igb: T [0x0FB]    00000000FFFE9240 0057C0092B30015F 00000000FFFE9240 0000            (null) 00000001A1A8B566 0000000049234f77
[2712515.515451] igb: T [0x0FC]    00000000FDA80FC0 003980092B3000E6 00000000FDA80FC0 0000            (null) 00000001A1A8B56A 000000008dbc455b
[2712515.515453] igb: T [0x0FD]    00000000FFA03D40 003600092B3000D8 00000000FFA03D40 0000            (null) 00000001A1A8B56E 00000000e065fc9d
[2712515.515455] igb: T [0x0FE]    00000000FF18D600 016680092B30059A 00000000FF18D600 0000            (null) 00000001A1A8B574 00000000f95a6d3f
[2712515.515457] igb: T [0x0FF]    00000000FF5F5900 016680092B30059A 00000000FF5F5900 0000            (null) 00000001A1A8B574 00000000cf797b90
[2712515.515457] igb: ------------------------------------
[2712515.515458] igb: TX QUEUE INDEX = 1
[2712515.515458] igb: ------------------------------------
[2712515.515459] igb: T [desc]     [address 63:0  ] [PlPOCIStDDM Ln] [bi->dma       ] leng  ntw timestamp        bi->skb
[2712515.515461] igb: T [0x000]    00000000FF5B3C6A 000D82192B300036 00000000FFDF286A 0000            (null) 00000001A1A82B98 00000000bd93ac73
[2712515.515463] igb: T [0x001]    0000000000001C14 0000001020200800 00000000FF48DC5E 0000            (null) 00000001A1A8CA61 0000000064b09a0e
[2712515.515465] igb: T [0x002]    00000000FF48DC5E 001082192B300042 00000000FFDE186A 0000            (null) 00000001A1A87A92 000000002cfeb56f
[2712515.515466] igb: T [0x003]    0000000000001C14 0000001020200800 00000000FF92AA6A 0000            (null) 00000001A1A8CA61 000000003e5635b3
[2712515.515468] igb: T [0x004]    00000000FF92AA6A 000D82192B300036 00000000FEB42802 0000            (null) 00000001A1A87B0A 000000002e13a21e
[2712515.515470] igb: T [0x005]    0000000000001C14 0000001020200800 00000000FEDD786A 0000            (null) 00000001A1A8CA62 000000000500b1dc
[2712515.515472] igb: T [0x006]    00000000FEDD786A 017282192B3005CA 00000000FD2EB802 0000            (null) 00000001A1A87B87 000000009292cfd0
[2712515.515474] igb: T [0x007]    0000000000001C14 0000001020200800 00000000FD23186A 0000            (null) 00000001A1A8CA62 00000000f40903ac
[2712515.515475] igb: T [0x008]    00000000FD23186A 01728211223000C2 00000000FF13E05E 0000            (null) 00000001A1A87D01 00000000e097b6c6
[2712515.515477] igb: T [0x009]    00000000FF895000 000000092B300508 00000000FF895000 0000            (null) 00000001A1A81807 0000000074c78b1f
[2712515.515479] igb: T [0x00A]    0000000000001C14 0000001020200800 00000000FEC54C6A 0000            (null) 00000001A1A8CA62 0000000013a0ebf3
[2712515.515481] igb: T [0x00B]    00000000FEC54C6A 00AA821122300036 00000000FF2EA508 0000            (null) 00000001A1A7CC71 0000000060e0b1c4
[2712515.515483] igb: T [0x00C]    00000000FEF53508 000000092B300274 00000000FEF53508 0000            (null) 00000001A1A87D03 00000000f03227b9
[2712515.515485] igb: T [0x00D]    0000000000001C14 0000001020200800 00000000FD23086A 0000            (null) 00000001A1A8CA63 00000000676d194c
[2712515.515486] igb: T [0x00E]    00000000FD23086A 000D82192B300036 00000000FFDE7C6A 0000            (null) 00000001A1A87D03 0000000014e01d2f
[2712515.515488] igb: T [0x00F]    0000000000001C14 0000001020200800 00000000FF071E5E 0000            (null) 00000001A1A8CA68 0000000021776f3b
[2712515.515490] igb: T [0x010]    00000000FF071E5E 001082192B300042 00000000FF62E000 0000            (null) 00000001A1A82E09 0000000099809c59
[2712515.515492] igb: T [0x011]    0000000000001C14 0000001020200800 00000000FDB8EC6A 0000            (null) 00000001A1A8CA69 000000002356a847
[2712515.515494] igb: T [0x012]    00000000FDB8EC6A 000D82192B300036 00000000FF19606A 0000            (null) 00000001A1A82E0A 00000000b156aca3
[2712515.515496] igb: T [0x013]    0000000000001C14 0000001020200800 00000000FF37386A 0000            (null) 00000001A1A8CA6A 00000000f9e9bf4d
[2712515.515498] igb: T [0x014]    00000000FF37386A 017282192B3005CA 00000000FFFD786A 0000            (null) 00000001A1A87D04 000000000d697b81
[2712515.515499] igb: T [0x015]    0000000000001C14 0000001020200800 00000000FF58386A 0000            (null) 00000001A1A8CA6A 00000000b58e7488
[2712515.515501] igb: T [0x016]    00000000FF58386A 01728211223000C2 00000000FF5B205E 0000            (null) 00000001A1A87D7E 0000000080375d0d
[2712515.515503] igb: T [0x017]    00000000FF977000 000000092B300508 00000000FF977000 0000            (null) 00000001A1A82E0A 00000000a7eb7d66
[2712515.515505] igb: T [0x018]    0000000000001C14 0000001020200800 00000000FF2E726A 0000            (null) 00000001A1A8CA6A 00000000436c6e61
[2712515.515507] igb: T [0x019]    00000000FF2E726A 00AA821122300036 00000000FFDD5508 0000            (null) 00000001A1A7CCAC 00000000d38767b4
[2712515.515509] igb: T [0x01A]    00000000FF588508 000000092B300274 00000000FF588508 0000            (null) 00000001A1A87D80 00000000345fd6ab
[2712515.515510] igb: T [0x01B]    0000000000001C14 0000001020200800 00000000FF2B1C6A 0000            (null) 00000001A1A8CA6A 00000000870626a3
[2712515.515512] igb: T [0x01C]    00000000FF2B1C6A 000D82192B300036 00000000FF06C46A 0000            (null) 00000001A1A87D80 000000007738125a
[2712515.515514] igb: T [0x01D]    00000000FF2B1640 001AC0192B30006B 00000000FF2B1640 0000            (null) 00000001A1A8CADA 00000000e5f49c62
[2712515.515516] igb: T [0x01E]    0000000000001C14 0000001020200000 00000000FFBE6802 0000            (null) 00000001A1A8D2EB 00000000e5957932
[2712515.515517] igb: T [0x01F]    00000000FFBE6802 008942192B300225 00000000FF3D2C6A 0000            (null) 00000001A1A87D80 00000000cf797b90
[2712515.515519] igb: T [0x020]    00000000FE2E0880 000A80192B30002A 00000000FE2E0880 0000            (null) 00000001A1A8DC81 00000000a494a219
[2712515.515521] igb: T [0x021]    00000000FD40B140 000A80192B30002A 00000000FD40B140 0000            (null) 00000001A1A8DCA0 00000000a02e9b39
[2712515.515523] igb: T [0x022]    00000000FD6C0E00 000A80192B30002A 00000000FD6C0E00 0000            (null) 00000001A1A8DCDA 00000000cf797b90
[2712515.515525] igb: T [0x023]    00000000FF681E00 000A80192B30002A 00000000FF681E00 0000            (null) 00000001A1A8DE5A 000000000dbe46ea
[2712515.515526] igb: T [0x024]    00000000FFD37840 000A80192B30002A 00000000FFD37840 0000            (null) 00000001A1A8E05A 000000004374ea86
[2712515.515528] igb: T [0x025]    00000000FF2E7200 000A80192B30002A 00000000FF2E7200 0000            (null) 00000001A1A8E451 0000000073e121db
[2712515.515530] igb: T [0x026]    00000000FFA3FD00 001EC0192B30007B 00000000FFA3FD00 0000            (null) 00000001A1A8E8B2 00000000202c6654
[2712515.515532] igb: T [0x027]    0000000000001C14 0000001020200000 00000000FF487002 0000            (null) 00000001A1A8ED25 00000000d0c42cf0
[2712515.515533] igb: T [0x028]    00000000FF487002 003182192B3000C6 00000000FF52786A 0000            (null) 00000001A1A87DFE 00000000b8ee1fb7
[2712515.515535] igb: T [0x029]    0000000000001C14 0000001020200000 00000000FFA3F802 0000            (null) 00000001A1A8F127 00000000e5f49c62
[2712515.515537] igb: T [0x02A]    00000000FFA3F802 001702192B30005C 00000000FEF51C6A 0000            (null) 00000001A1A87DFE 0000000067c947fc
[2712515.515539] igb: T [0x02B]    0000000000001C14 0000001020200000 00000000FF82D002 0000            (null) 00000001A1A8F13A 00000000b5a3c5cf
[2712515.515541] igb: T [0x02C]    00000000FF82D002 008442192B300211 00000000FF6BC000 0000            (null) 00000001A1A8307D 00000000ec185085
[2712515.515543] igb: T [0x02D]    00000000FD239002 000A80192B30002A 00000000FD239002 0000            (null) 00000001A1A8F601 00000000f7aaae8b
[2712515.515544] igb: T [0x02E]    00000000FFFF2080 000A80192B30002A 00000000FFFF2080 0000            (null) 00000001A1A8FC1B 00000000aa0c3183
[2712515.515546] igb: T [0x02F]    00000000FF201A02 000A80192B30002A 00000000FF201A02 0000            (null) 00000001A1A90200 0000000050cb4c08
[2712515.515548] igb: T [0x030]    00000000FEDCC002 000A80192B30002A 00000000FEDCC002 0000            (null) 00000001A1A91000 0000000015c37a85
[2712515.515550] igb: T [0x031]    0000000000001C14 0000001020200000 00000000FFA05402 0000            (null) 00000001A1A91223 000000004421d4ba
[2712515.515552] igb: T [0x032]    00000000FFA05402 008442192B300211 00000000FD527002 0000            (null) 00000001A1A87FED 0000000020a6b172
[2712515.515553] igb: T [0x033]    0000000000001C14 0000001020200000 00000000FF163002 0000            (null) 00000001A1A918B7 000000004bbbc42c
[2712515.515555] igb: T [0x034]    00000000FF163002 005582192B300156 00000000FF6A305E 0000            (null) 00000001A1A87FF0 00000000176f56e9
[2712515.515557] igb: T [0x035]    00000000FF38F602 000A80192B30002A 00000000FF38F602 0000            (null) 00000001A1A91C59 00000000058d2491
[2712515.515559] igb: T [0x036]    0000000000001C14 0000001020200000 00000000FD23BC02 0000            (null) 00000001A1A9233A 0000000080375d0d
[2712515.515561] igb: T [0x037]    00000000FD23BC02 005582192B300156 00000000FDB8B402 0000            (null) 00000001A1A7DD51 00000000ab80aaba
[2712515.515562] igb: T [0x038]    00000000FF882402 000A80192B30002A 00000000FF882402 0000            (null) 00000001A1A92343 00000000227ee0ea
[2712515.515564] igb: T [0x039]    00000000FF4C9602 000A80192B30002A 00000000FF4C9602 0000            (null) 00000001A1A92600 00000000119a4492
[2712515.515566] igb: T [0x03A]    00000000FFB8C002 000A80192B30002A 00000000FFB8C002 0000            (null) 00000001A1A92600 000000008e69c59a
[2712515.515568] igb: T [0x03B]    00000000FFBB0200 0025C0192B300097 00000000FFBB0200 0000            (null) 00000001A1A9270D 000000002ced5511
[2712515.515570] igb: T [0x03C]    00000000FF431580 001280192B30004A 00000000FF431580 0000            (null) 00000001A1A92ABD 00000000b93d7fff
[2712515.515571] igb: T [0x03D]    00000000FF2F5200 000F00192B30003C 00000000FF2F5200 0000            (null) 00000001A1A92AC1 00000000d8f90a5f
[2712515.515573] igb: T [0x03E]    00000000FDE6EF00 005840192B300161 00000000FDE6EF00 0000            (null) 00000001A1A92AC1 00000000a50360db
[2712515.515575] igb: T [0x03F]    00000000FF924D40 000F00192B30003C 00000000FF924D40 0000            (null) 00000001A1A92AC5 00000000a85379fe
[2712515.515577] igb: T [0x040]    00000000FF385B80 000F00192B30003C 00000000FF385B80 0000            (null) 00000001A1A92AC5 00000000186696da
[2712515.515579] igb: T [0x041]    00000000FD3EC9C0 000F00192B30003C 00000000FD3EC9C0 0000            (null) 00000001A1A92AC5 00000000e9791660
[2712515.515581] igb: T [0x042]    00000000FD3F3E00 0025C0192B300097 00000000FD3F3E00 0000            (null) 00000001A1A92AEF 0000000078c2de0c
[2712515.515583] igb: T [0x043]    00000000FEF402C0 0025C0192B300097 00000000FEF402C0 0000            (null) 00000001A1A932C0 0000000048317bce
[2712515.515584] igb: T [0x044]    0000000000001C14 0000001020200000 00000000FFC3AC02 0000            (null) 00000001A1A93587 00000000b16699b1
[2712515.515586] igb: T [0x045]    00000000FFC3AC02 002382192B30008E 00000000FE2DE280 0000            (null) 00000001A1A7EDE5 000000004c4e54a4
[2712515.515588] igb: T [0x046]    00000000FF4D4002 000A80192B30002A 00000000FF4D4002 0000            (null) 00000001A1A93801 00000000b4dcf5d1
[2712515.515590] igb: T [0x047]    00000000FF07AE80 000F00192B30003C 00000000FF07AE80 0000            (null) 00000001A1A93C59 000000006445107c
[2712515.515592] igb: T [0x048]    0000000000001C14 0000001020200000 00000000FF460802 0000            (null) 00000001A1A93DEB 0000000073259631
[2712515.515593] igb: T [0x049]    00000000FF460802 002382192B30008E 00000000FDB9366A 0000            (null) 00000001A1A8354F 0000000080f4665a
[2712515.515595] igb: T [0x04A]    00000000FFC8A040 0010C0192B300043 00000000FFC8A040 0000            (null) 00000001A1A93EC5 00000000cc5be6ca
[2712515.515597] igb: T [0x04B]    00000000FECCCB80 0010C0192B300043 00000000FECCCB80 0000            (null) 00000001A1A93F31 0000000060e0b1c4
[2712515.515599] igb: T [0x04C]    00000000FF8A6340 000A80192B30002A 00000000FF8A6340 0000            (null) 00000001A1A9403C 00000000257124fe
[2712515.515601] igb: T [0x04D]    00000000FEF1F340 000A80192B30002A 00000000FEF1F340 0000            (null) 00000001A1A94259 00000000514f23ef
[2712515.515602] igb: T [0x04E]    00000000FF6FCE00 0025C0192B300097 00000000FF6FCE00 0000            (null) 00000001A1A94265 00000000be74e4c6
[2712515.515604] igb: T [0x04F]    00000000FFA09C02 000A80192B30002A 00000000FFA09C02 0000            (null) 00000001A1A95000 000000003174f5b1
[2712515.515606] igb: T [0x050]    00000000FF5FD240 0025C0192B300097 00000000FF5FD240 0000            (null) 00000001A1A9619F 00000000d96ce975
[2712515.515608] igb: T [0x051]    0000000000001C14 0000001020200000 00000000FD404202 0000            (null) 00000001A1A96477 0000000063eb0539
[2712515.515610] igb: T [0x052]    00000000FD404202 002642192B300099 00000000FF4C986A 0000            (null) 00000001A1A881E0 00000000aa0c3183
[2712515.515611] igb: T [0x053]    00000000FF1EF602 000A80192B30002A 00000000FF1EF602 0000            (null) 00000001A1A96C00 0000000082af5858
[2712515.515613] igb: T [0x054]    00000000FFA18E00 000A80192B30002A 00000000FFA18E00 0000            (null) 00000001A1A974B9 00000000a92a1882
[2712515.515615] igb: T [0x055]    0000000000001C14 0000001020200000 00000000FFA6FC02 0000            (null) 00000001A1A974BD 000000004808e556
[2712515.515617] igb: T [0x056]    00000000FFA6FC02 001902192B300064 00000000FF88246A 0000            (null) 00000001A1A881E1 00000000be74e4c6
[2712515.515619] igb: T [0x057]    00000000FF214AC0 000A80192B30002A 00000000FF214AC0 0000            (null) 00000001A1A974CD 0000000050cb4c08
[2712515.515620] igb: T [0x058]    00000000FF70F002 000A80192B30002A 00000000FF70F002 0000            (null) 00000001A1A97729 00000000a4e9ec0d
[2712515.515622] igb: T [0x059]    0000000000001C14 0000001020200000 00000000FF71C402 0000            (null) 00000001A1A97B47 00000000d20fdf61
[2712515.515624] igb: T [0x05A]    00000000FF71C402 002402192B300090 00000000FFC6BE5E 0000            (null) 00000001A1A81F49 000000001161c22b
[2712515.515626] igb: T [0x05B]    00000000FEBB8002 000A80192B30002A 00000000FEBB8002 0000            (null) 00000001A1A98401 000000005e9cb244
[2712515.515628] igb: T [0x05C]    00000000FFA08140 001280192B30004A 00000000FFA08140 0000            (null) 00000001A1A98556 00000000b16699b1
[2712515.515629] igb: T [0x05D]    00000000FFA08F80 000F00192B30003C 00000000FFA08F80 0000            (null) 00000001A1A98559 00000000119a4492
[2712515.515631] igb: T [0x05E]    00000000FFAC6D80 001F00192B30007C 00000000FFAC6D80 0000            (null) 00000001A1A9855A 00000000176f56e9
[2712515.515633] igb: T [0x05F]    00000000FEDE5AC0 004EC0192B30013B 00000000FEDE5AC0 0000            (null) 00000001A1A9855D 00000000a376413e
[2712515.515635] igb: T [0x060]    00000000FF957A80 000F00192B30003C 00000000FF957A80 0000            (null) 00000001A1A98570 000000004e08bc40
[2712515.515637] igb: T [0x061]    00000000FF81E880 001F00192B30007C 00000000FF81E880 0000            (null) 00000001A1A98570 000000000f8e71b9
[2712515.515638] igb: T [0x062]    00000000FF9F11C0 004EC0192B30013B 00000000FF9F11C0 0000            (null) 00000001A1A9859B 00000000a35316d6
[2712515.515640] igb: T [0x063]    00000000FE8F8F40 003680192B3000DA 00000000FE8F8F40 0000            (null) 00000001A1A9859F 00000000e74afa00
[2712515.515642] igb: T [0x064]    00000000FEDC1D40 001700192B30005C 00000000FEDC1D40 0000            (null) 00000001A1A985A5 0000000008d7e241
[2712515.515644] igb: T [0x065]    00000000FEDC1B00 002200192B300088 00000000FEDC1B00 0000            (null) 00000001A1A985A9 00000000f56285fe
[2712515.515646] igb: T [0x066]    00000000FF9F1840 004C80192B300132 00000000FF9F1840 0000            (null) 00000001A1A985AF 00000000819cdfb5
[2712515.515647] igb: T [0x067]    00000000FF70F740 013E00192B3004F8 00000000FF70F740 0000            (null) 00000001A1A985D8 000000001163c2ff
[2712515.515649] igb: T [0x068]    00000000FF70F580 000F00192B30003C 00000000FF70F580 0000            (null) 00000001A1A9861A 000000001163c2ff
[2712515.515651] igb: T [0x069]    00000000FF214380 001C80192B300072 00000000FF214380 0000            (null) 00000001A1A9861A 000000001163c2ff
[2712515.515653] igb: T [0x06A]    00000000FF5FD080 005F40192B30017D 00000000FF5FD080 0000            (null) 00000001A1A9861E 000000001163c2ff
[2712515.515654] igb: T [0x06B]    00000000FD2DFE40 0012C0192B30004B 00000000FD2DFE40 0000            (null) 00000001A1A98623 000000001163c2ff
[2712515.515656] igb: T [0x06C]    00000000FD2DFB40 005680192B30015A 00000000FD2DFB40 0000            (null) 00000001A1A98627 000000001163c2ff
[2712515.515658] igb: T [0x06D]    00000000FF5FD7C0 007540192B3001D5 00000000FF5FD7C0 0000            (null) 00000001A1A9862C 000000001163c2ff
[2712515.515660] igb: T [0x06E]    00000000FF214440 007B00192B3001EC 00000000FF214440 0000            (null) 00000001A1A98631 000000001163c2ff
[2712515.515661] igb: T [0x06F]    00000000FF4A0340 006900192B3001A4 00000000FF4A0340 0000            (null) 00000001A1A98636 0000000021776f3b
[2712515.515663] igb: T [0x070]    00000000FF3AE100 006300192B30018C 00000000FF3AE100 0000            (null) 00000001A1A9863B 000000001163c2ff
[2712515.515665] igb: T [0x071]    00000000FF214F00 001680192B30005A 00000000FF214F00 0000            (null) 00000001A1A98641 000000001163c2ff
[2712515.515667] igb: T [0x072]    00000000FF214D00 0010C0192B300043 00000000FF214D00 0000            (null) 00000001A1A98645 000000001163c2ff
[2712515.515668] igb: T [0x073]    00000000FD72ED40 0053C0192B30014F 00000000FD72ED40 0000            (null) 00000001A1A98649 000000000339ac31
[2712515.515670] igb: T [0x074]    00000000FF2F5B40 0012C0192B30004B 00000000FF2F5B40 0000            (null) 00000001A1A9864D 000000009976f72e
[2712515.515672] igb: T [0x075]    00000000FF7D0840 005A00192B300168 00000000FF7D0840 0000            (null) 00000001A1A98651 000000002e13a21e
[2712515.515674] igb: T [0x076]    00000000FFA2B500 006080192B300182 00000000FFA2B500 0000            (null) 00000001A1A98657 00000000c5ed1096
[2712515.515676] igb: T [0x077]    00000000FF0EF200 0050C0192B300143 00000000FF0EF200 0000            (null) 00000001A1A9865D 00000000a20c42af
[2712515.515677] igb: T [0x078]    00000000FEFCB000 0010C0192B300043 00000000FEFCB000 0000            (null) 00000001A1A98667 00000000c5ed1096
[2712515.515679] igb: T [0x079]    00000000FD7DBE40 001000192B300040 00000000FD7DBE40 0000            (null) 00000001A1A98671 000000002e13a21e
[2712515.515681] igb: T [0x07A]    00000000FF930C80 000F00192B30003C 00000000FF930C80 0000            (null) 00000001A1A98672 000000009976f72e
[2712515.515682] igb: T [0x07B]    00000000FF71CAC0 000F00192B30003C 00000000FF71CAC0 0000            (null) 00000001A1A98675 000000000339ac31
[2712515.515684] igb: T [0x07C]    00000000FF6E6C02 000A80102B30002A 00000000FF6E6C02 002A  00000000c658a9f5 00000001A1A98A00 00000000b1f60b47 NTC
[2712515.515687] 00000000d7c2311d: b4 96 91 0e fd 1f 00 19 99 ab 0b 38 08 06 00 01  ...........8....
[2712515.515687] 00000000922018be: 08 00 06 04 00 01 00 19 99 ab 0b 38 0a 51 6e 0f  ...........8.Qn.
[2712515.515688] 00000000a423f9da: 00 00 00 00 00 00 0a 51 6e fe                    .......Qn.
[2712515.515690] igb: T [0x07D]    0000000000001C14 0000001020200800 00000000FEFAB46A 0000            (null) 00000001A1A8883A 0000000047f33a64 NTU
[2712515.515692] igb: T [0x07E]    00000000FEFAB46A 00AA821122300036 00000000FF542D00 0000            (null) 00000001A1A83F2A 00000000b9702733
[2712515.515694] igb: T [0x07F]    00000000FF1EC508 000000092B300274 00000000FF1EC508 0000            (null) 00000001A1A83F2E 00000000bd02a543
[2712515.515696] igb: T [0x080]    0000000000001C14 0000001020200800 00000000FF580E6A 0000            (null) 00000001A1A8883B 0000000022159cc3
[2712515.515697] igb: T [0x081]    00000000FF580E6A 000D82192B300036 00000000FEBD5680 0000            (null) 00000001A1A83F32 000000001c484eb4
[2712515.515699] igb: T [0x082]    0000000000001C14 0000001020200000 00000000FF06C002 0000            (null) 00000001A1A888B3 0000000050cb4c08
[2712515.515701] igb: T [0x083]    00000000FF06C002 008982192B300226 00000000FD225AC0 0000            (null) 00000001A1A83F43 00000000391c4144
[2712515.515703] igb: T [0x084]    0000000000001C14 0000001020200000 00000000FF7A0402 0000            (null) 00000001A1A88930 0000000058952717
[2712515.515705] igb: T [0x085]    00000000FF7A0402 008682192B30021A 00000000FEF6EA00 0000            (null) 00000001A1A83F72 000000002740b7c1
[2712515.515706] igb: T [0x086]    0000000000001C14 0000001020200800 00000000FFDF7E5E 0000            (null) 00000001A1A88932 0000000075e0c95a
[2712515.515708] igb: T [0x087]    00000000FFDF7E5E 001082192B300042 00000000FFA2A5C0 0000            (null) 00000001A1A83F7C 000000007c0089da
[2712515.515710] igb: T [0x088]    0000000000001C14 0000001020200800 00000000FFBE106A 0000            (null) 00000001A1A88933 00000000896e656c
[2712515.515712] igb: T [0x089]    00000000FFBE106A 000D82192B300036 00000000FE0C0D80 0000            (null) 00000001A1A83FAB 000000002e4d9dd8
[2712515.515713] igb: T [0x08A]    0000000000001C14 0000001020200800 00000000FF58086A 0000            (null) 00000001A1A88934 000000006105294e
[2712515.515715] igb: T [0x08B]    00000000FF58086A 017282192B3005CA 00000000FF65B3C0 0000            (null) 00000001A1A83FF1 0000000039bed37d
[2712515.515717] igb: T [0x08C]    0000000000001C14 0000001020200800 00000000FF1EC46A 0000            (null) 00000001A1A88934 000000008f4f6977
[2712515.515719] igb: T [0x08D]    00000000FF1EC46A 01728211223000C2 00000000FD225E00 0000            (null) 00000001A1A83FF9 00000000d692b686
[2712515.515720] igb: T [0x08E]    00000000FEFAB000 000000092B300508 00000000FEFAB000 0000            (null) 00000001A1A83FFD 00000000b156aca3
[2712515.515722] igb: T [0x08F]    0000000000001C14 0000001020200800 00000000FEDA986A 0000            (null) 00000001A1A88934 00000000dd252b12
[2712515.515724] igb: T [0x090]    00000000FEDA986A 00AA821122300036 00000000FD441A00 0000            (null) 00000001A1A84005 000000004e182c21
[2712515.515726] igb: T [0x091]    00000000FF7AB508 000000092B300274 00000000FF7AB508 0000            (null) 00000001A1A84009 00000000bd93ac73
[2712515.515727] igb: T [0x092]    0000000000001C14 0000001020200800 00000000FFAF366A 0000            (null) 00000001A1A88935 00000000aaabeba4
[2712515.515729] igb: T [0x093]    00000000FFAF366A 000D82192B300036 00000000FF59E180 0000            (null) 00000001A1A84011 00000000a57a8e76
[2712515.515731] igb: T [0x094]    0000000000001C14 0000001020200000 00000000FFBAF002 0000            (null) 00000001A1A88A2A 00000000c2ca438e
[2712515.515733] igb: T [0x095]    00000000FFBAF002 008A02192B300228 00000000FF59EC80 0000            (null) 00000001A1A84019 00000000791ff1da
[2712515.515735] igb: T [0x096]    0000000000001C14 0000001020200000 00000000FEF72802 0000            (null) 00000001A1A88C1E 000000007475d707
[2712515.515736] igb: T [0x097]    00000000FEF72802 008482192B300212 00000000FD594EC0 0000            (null) 00000001A1A84022 00000000ef10a042
[2712515.515738] igb: T [0x098]    0000000000001C14 0000001020200000 00000000FF3F1002 0000            (null) 00000001A1A88E13 0000000081ad7644
[2712515.515740] igb: T [0x099]    00000000FF3F1002 008942192B300225 00000000FF6B6640 0000            (null) 00000001A1A8402A 0000000045b9568a
[2712515.515742] igb: T [0x09A]    00000000FF0D1B80 000A80192B30002A 00000000FF0D1B80 0000            (null) 00000001A1A88E72 000000004e08bc40
[2712515.515744] igb: T [0x09B]    0000000000001C14 0000001020200000 00000000FD3F6C02 0000            (null) 00000001A1A88E90 0000000020a6b172
[2712515.515745] igb: T [0x09C]    00000000FD3F6C02 008482192B300212 00000000FF8F5080 0000            (null) 00000001A1A8402F 0000000097a8d7f6
[2712515.515747] igb: T [0x09D]    0000000000001C14 0000001020200800 00000000FFC4145E 0000            (null) 00000001A1A88F8C 00000000f6f80402
[2712515.515749] igb: T [0x09E]    00000000FFC4145E 001082192B300042 00000000FF424380 0000            (null) 00000001A1A8402F 00000000b39f0d6c
[2712515.515751] igb: T [0x09F]    0000000000001C14 0000001020200800 00000000FF076C6A 0000            (null) 00000001A1A88F8D 00000000b7c8b5cb
[2712515.515752] igb: T [0x0A0]    00000000FF076C6A 000D82192B300036 00000000FF732DC0 0000            (null) 00000001A1A84041 00000000acf61d7b
[2712515.515754] igb: T [0x0A1]    0000000000001C14 0000001020200800 00000000FF7A186A 0000            (null) 00000001A1A88F8E 000000006567f236
[2712515.515756] igb: T [0x0A2]    00000000FF7A186A 017282192B3005CA 00000000FF086840 0000            (null) 00000001A1A8404A 00000000cc5be6ca
[2712515.515758] igb: T [0x0A3]    0000000000001C14 0000001020200800 00000000FF86046A 0000            (null) 00000001A1A88F8E 0000000071e16785
[2712515.515760] igb: T [0x0A4]    00000000FF86046A 01728211223000C2 00000000FD441E00 0000            (null) 00000001A1A84053 00000000f3c5a34b
[2712515.515761] igb: T [0x0A5]    00000000FFCB8000 000000092B300508 00000000FFCB8000 0000            (null) 00000001A1A84053 00000000b8ee1fb7
[2712515.515763] igb: T [0x0A6]    0000000000001C14 0000001020200800 00000000FF16AC6A 0000            (null) 00000001A1A88F8E 00000000d8f90a5f
[2712515.515765] igb: T [0x0A7]    00000000FF16AC6A 00AA821122300036 00000000FF286880 0000            (null) 00000001A1A84056 00000000574e2764
[2712515.515767] igb: T [0x0A8]    00000000FEF01508 000000092B300274 00000000FEF01508 0000            (null) 00000001A1A84058 0000000080375d0d
[2712515.515769] igb: T [0x0A9]    0000000000001C14 0000001020200800 00000000FEBDBA6A 0000            (null) 00000001A1A88F8F 000000009ea6ab15
[2712515.515771] igb: T [0x0AA]    00000000FEBDBA6A 000D82192B300036 00000000FFF05AC0 0000            (null) 00000001A1A8405B 0000000064b09a0e
[2712515.515772] igb: T [0x0AB]    00000000FF36AC40 000F80192B30003E 00000000FF36AC40 0000            (null) 00000001A1A8995D 000000003aedea36
[2712515.515820] igb: T [0x0AC]    0000000000001C14 0000001020200000 00000000FF3C9402 0000            (null) 00000001A1A89EC1 000000007fc42ea3
[2712515.515822] igb: T [0x0AD]    00000000FF3C9402 008582192B300216 00000000FF9E5D80 0000            (null) 00000001A1A8446C 00000000b4410474
[2712515.515824] igb: T [0x0AE]    0000000000001C14 0000001020200000 00000000FF660802 0000            (null) 00000001A1A8A4B4 00000000cfefe3c8
[2712515.515830] igb: T [0x0AF]    00000000FF660802 008A42192B300229 00000000FEDC0002 0000            (null) 00000001A1A84D8B 0000000064e4ee1d
[2712515.515835] igb: T [0x0B0]    0000000000001C14 0000001020200000 00000000FEF3A802 0000            (null) 00000001A1A8A661 000000008dade264
[2712515.515840] igb: T [0x0B1]    00000000FEF3A802 008442192B300211 00000000FEC68802 0000            (null) 00000001A1A84FB7 0000000039854cc7
[2712515.515845] igb: T [0x0B2]    00000000FEC54402 000A80192B30002A 00000000FEC54402 0000            (null) 00000001A1A8B000 00000000f5e94d6c
[2712515.515850] igb: T [0x0B3]    0000000000001C14 0000001020200800 00000000FE2E0E5E 0000            (null) 00000001A1A8B1F0 00000000119a4492
[2712515.515854] igb: T [0x0B4]    00000000FE2E0E5E 001082192B300042 00000000FFFD7AC0 0000            (null) 00000001A1A853EB 0000000030467c7b
[2712515.515859] igb: T [0x0B5]    0000000000001C14 0000001020200800 00000000FF65586A 0000            (null) 00000001A1A8B1F1 00000000bc7d7d30
[2712515.515864] igb: T [0x0B6]    00000000FF65586A 000D82192B300036 00000000FF5BF602 0000            (null) 00000001A1A86195 0000000072480647
[2712515.515868] igb: T [0x0B7]    0000000000001C14 0000001020200800 00000000FD40B06A 0000            (null) 00000001A1A8B1F2 000000003fdf6da6
[2712515.515873] igb: T [0x0B8]    00000000FD40B06A 017282192B3005CA 00000000FF72C66A 0000            (null) 00000001A1A82535 00000000e097b6c6
[2712515.515875] igb: T [0x0B9]    0000000000001C14 0000001020200800 00000000FFB2B46A 0000            (null) 00000001A1A8B1F2 00000000f9a1bdaf
[2712515.515881] igb: T [0x0BA]    00000000FFB2B46A 01728211223000C2 00000000FD743C02 0000            (null) 00000001A1A8645F 00000000b1f60b47
[2712515.515884] igb: T [0x0BB]    00000000FDB8E000 000000092B300508 00000000FDB8E000 0000            (null) 00000001A1A7C795 00000000f291aef3
[2712515.515885] igb: T [0x0BC]    0000000000001C14 0000001020200800 00000000FF07186A 0000            (null) 00000001A1A8B1F2 00000000a15b1894
[2712515.515890] igb: T [0x0BD]    00000000FF07186A 00AD021122300036 00000000FEF61580 0000            (null) 00000001A1A7C9F1 00000000391c4144
[2712515.515895] igb: T [0x0BE]    00000000FF93B508 000000092B30027E 00000000FF93B508 0000            (null) 00000001A1A86BC3 000000007fc42ea3
[2712515.515899] igb: T [0x0BF]    0000000000001C14 0000001020200800 00000000FFBE606A 0000            (null) 00000001A1A8B1F3 000000005f731a34
[2712515.515904] igb: T [0x0C0]    00000000FFBE606A 000D82192B300036 00000000FEF69000 0000            (null) 00000001A1A8752E 00000000a20c42af
[2712515.515907] igb: T [0x0C1]    0000000000001C14 0000001020200000 00000000FD235602 0000            (null) 00000001A1A8BBCB 00000000e065fc9d
[2712515.515912] igb: T [0x0C2]    00000000FD235602 001A82192B30006A 00000000FFC3B26A 0000            (null) 00000001A1A82537 0000000051b05a26
[2712515.515916] igb: T [0x0C3]    0000000000001C14 0000001020200000 00000000FD317402 0000            (null) 00000001A1A8BFBB 0000000072dadddf
[2712515.515921] igb: T [0x0C4]    00000000FD317402 008942192B300225 00000000FF22A802 0000            (null) 00000001A1A87823 00000000c803c462
[2712515.515924] igb: T [0x0C5]    0000000000001C14 0000001020200000 00000000FEDB7C02 0000            (null) 00000001A1A8BFCC 00000000bfd37291
[2712515.515926] igb: T [0x0C6]    00000000FEDB7C02 008582192B300216 00000000FF601402 0000            (null) 00000001A1A8260E 000000005b8a2895
[2712515.515928] igb: T [0x0C7]    0000000000001C14 0000001020200800 00000000FF58325E 0000            (null) 00000001A1A8C905 00000000936c29cb
[2712515.515930] igb: T [0x0C8]    00000000FF58325E 001082192B300042 00000000FF766802 0000            (null) 00000001A1A8263B 000000008254c739
[2712515.515931] igb: T [0x0C9]    0000000000001C14 0000001020200800 00000000FF37326A 0000            (null) 00000001A1A8C905 00000000d964d2a2
[2712515.515933] igb: T [0x0CA]    00000000FF37326A 000D82192B300036 00000000FF666402 0000            (null) 00000001A1A82659 000000006642b20e
[2712515.515935] igb: T [0x0CB]    0000000000001C14 0000001020200800 00000000FECCC06A 0000            (null) 00000001A1A8C906 00000000f56285fe
[2712515.515937] igb: T [0x0CC]    00000000FECCC06A 017282192B3005CA 00000000FFBC2002 0000            (null) 00000001A1A82693 0000000073e121db
[2712515.515938] igb: T [0x0CD]    0000000000001C14 0000001020200800 00000000FF1E186A 0000            (null) 00000001A1A8C906 00000000a35316d6
[2712515.515940] igb: T [0x0CE]    00000000FF1E186A 01728211223000C2 00000000FF58326A 0000            (null) 00000001A1A87847 00000000177d5e9d
[2712515.515942] igb: T [0x0CF]    00000000FF664000 000000092B300508 00000000FF664000 0000            (null) 00000001A1A80A23 00000000ff4f0610
[2712515.515944] igb: T [0x0D0]    0000000000001C14 0000001020200800 00000000FF76DA6A 0000            (null) 00000001A1A8C906 00000000e74afa00
[2712515.515945] igb: T [0x0D1]    00000000FF76DA6A 00A6821122300036 00000000FF5D6C6A 0000            (null) 00000001A1A87848 000000001353c3ee
[2712515.515947] igb: T [0x0D2]    00000000FF375508 000000092B300264 00000000FF375508 0000            (null) 00000001A1A8272B 00000000643c5ea5
[2712515.515949] igb: T [0x0D3]    0000000000001C14 0000001020200800 00000000FF5ED06A 0000            (null) 00000001A1A8C906 0000000013f72b01
[2712515.515951] igb: T [0x0D4]    00000000FF5ED06A 000D82192B300036 00000000FFB8BC6A 0000            (null) 00000001A1A8272B 000000000ec0e4d1
[2712515.515952] igb: T [0x0D5]    0000000000001C14 0000001020200000 00000000FFA4CC02 0000            (null) 00000001A1A8C9DB 00000000a7eb7d66
[2712515.515954] igb: T [0x0D6]    00000000FFA4CC02 008482192B300212 00000000FD3FF000 0000            (null) 00000001A1A80A35 000000005ac28f3c
[2712515.515956] igb: T [0x0D7]    0000000000001C14 0000001020200800 00000000FEF3AA5E 0000            (null) 00000001A1A8C9DD 000000004bbbc42c
[2712515.515958] igb: T [0x0D8]    00000000FEF3AA5E 001082192B300042 00000000FD3FFC02 0000            (null) 00000001A1A80EFD 000000001980273c
[2712515.515959] igb: T [0x0D9]    0000000000001C14 0000001020200800 00000000FFA65A6A 0000            (null) 00000001A1A8C9DD 00000000b4ce24f7
[2712515.515961] igb: T [0x0DA]    00000000FFA65A6A 000D82192B300036 00000000FD7DDA6A 0000            (null) 00000001A1A8272C 00000000236141b5
[2712515.515963] igb: T [0x0DB]    0000000000001C14 0000001020200800 00000000FF47786A 0000            (null) 00000001A1A8C9DF 0000000084fd213e
[2712515.515965] igb: T [0x0DC]    00000000FF47786A 017282192B3005CA 00000000FF65F402 0000            (null) 00000001A1A8276D 000000008d822a6f
[2712515.515966] igb: T [0x0DD]    0000000000001C14 0000001020200800 00000000FFA0206A 0000            (null) 00000001A1A8C9DF 000000002c471da3
[2712515.515968] igb: T [0x0DE]    00000000FFA0206A 01728211223000C2 00000000FD24E66A 0000            (null) 00000001A1A87855 000000009deddda0
[2712515.515970] igb: T [0x0DF]    00000000FF5F8000 000000092B300508 00000000FF5F8000 0000            (null) 00000001A1A7CB16 0000000024e3d996
[2712515.515972] igb: T [0x0E0]    0000000000001C14 0000001020200800 00000000FD31786A 0000            (null) 00000001A1A8C9DF 00000000d66ace81
[2712515.515974] igb: T [0x0E1]    00000000FD31786A 0172821122300036 00000000FF25626A 0000            (null) 00000001A1A87856 00000000965f1e1c
[2712515.515975] igb: T [0x0E2]    00000000FFCB8508 000000092B300594 00000000FFCB8508 0000            (null) 00000001A1A82A21 00000000d7e644fa
[2712515.515977] igb: T [0x0E3]    0000000000001C14 0000001020200800 00000000FF6CC06A 0000            (null) 00000001A1A8C9DF 0000000090d05c4d
[2712515.515979] igb: T [0x0E4]    00000000FF6CC06A 0172821122300036 00000000FFA2A86A 0000            (null) 00000001A1A82A22 00000000a140d9e3
[2712515.515981] igb: T [0x0E5]    00000000FE37AA9C 000000092B300594 00000000FE37AA9C 0000            (null) 00000001A1A87878 00000000bc7d7d30
[2712515.515982] igb: T [0x0E6]    0000000000001C14 0000001020200800 00000000FFA5EA6A 0000            (null) 00000001A1A8C9DF 00000000cf6bde43
[2712515.515984] igb: T [0x0E7]    00000000FFA5EA6A 0122421122300036 00000000FFF3586A 0000            (null) 00000001A1A87879 000000000117b727
[2712515.515986] igb: T [0x0E8]    00000000FF610030 000000092B300453 00000000FF610030 0000            (null) 00000001A1A80FC6 0000000053aaa1bc
[2712515.515988] igb: T [0x0E9]    0000000000001C14 0000001020200800 00000000FF580A6A 0000            (null) 00000001A1A8C9E0 000000001f125d10
[2712515.515990] igb: T [0x0EA]    00000000FF580A6A 000D82192B300036 00000000FF904FC0 0000            (null) 00000001A1A7CB3A 000000006c32b685
[2712515.515991] igb: T [0x0EB]    0000000000001C14 0000001020200000 00000000FFAF8A02 0000            (null) 00000001A1A8C9E6 0000000030467c7b
[2712515.515993] igb: T [0x0EC]    00000000FFAF8A02 0018C2192B300063 00000000FDB9CE6A 0000            (null) 00000001A1A87879 0000000070508fdd
[2712515.515995] igb: T [0x0ED]    0000000000001C14 0000001020200000 00000000FF580802 0000            (null) 00000001A1A8CA3B 00000000b156aca3
[2712515.515996] igb: T [0x0EE]    00000000FF580802 008A02192B300228 00000000FF6A3508 0000            (null) 00000001A1A82A9C 000000009268bbcf
[2712515.515998] igb: T [0x0EF]    0000000000001C14 0000001020200000 00000000FF7AE802 0000            (null) 00000001A1A8CA48 00000000a60d61cf
[2712515.516000] igb: T [0x0F0]    00000000FF7AE802 0089C2192B300227 00000000FD24E66A 0000            (null) 00000001A1A82A9D 00000000ebddeee0
[2712515.516002] igb: T [0x0F1]    0000000000001C14 0000001020200000 00000000FF52CC02 0000            (null) 00000001A1A8CA50 0000000039854cc7
[2712515.516003] igb: T [0x0F2]    00000000FF52CC02 008A02192B300228 00000000FF9F406A 0000            (null) 00000001A1A82A9E 000000002d9a46e6
[2712515.516005] igb: T [0x0F3]    0000000000001C14 0000001020200800 00000000FF65FC5E 0000            (null) 00000001A1A8CA52 00000000a4e9ec0d
[2712515.516007] igb: T [0x0F4]    00000000FF65FC5E 001082192B300042 00000000FF592402 0000            (null) 00000001A1A87A8C 0000000020dd0329
[2712515.516009] igb: T [0x0F5]    0000000000001C14 0000001020200800 00000000FFB7BA6A 0000            (null) 00000001A1A8CA52 000000000fa9cff6
[2712515.516010] igb: T [0x0F6]    00000000FFB7BA6A 000D82192B300036 00000000FF37105E 0000            (null) 00000001A1A87A8F 00000000b4ce24f7
[2712515.516012] igb: T [0x0F7]    0000000000001C14 0000001020200800 00000000FF4EA86A 0000            (null) 00000001A1A8CA53 00000000a1f08b85
[2712515.516014] igb: T [0x0F8]    00000000FF4EA86A 017282192B3005CA 00000000FF87006A 0000            (null) 00000001A1A87A90 00000000f3c5a34b
[2712515.516015] igb: T [0x0F9]    0000000000001C14 0000001020200800 00000000FF78746A 0000            (null) 00000001A1A8CA53 00000000896e656c
[2712515.516017] igb: T [0x0FA]    00000000FF78746A 01728211223000C2 00000000FFF9506A 0000            (null) 00000001A1A87A90 000000002e9d58de
[2712515.516019] igb: T [0x0FB]    00000000FFAF8000 000000092B300508 00000000FFAF8000 0000            (null) 00000001A1A7CC09 00000000fe6d6a0a
[2712515.516021] igb: T [0x0FC]    0000000000001C14 0000001020200800 00000000FFBE6E6A 0000            (null) 00000001A1A8CA53 0000000075e0c95a
[2712515.516023] igb: T [0x0FD]    00000000FFBE6E6A 00AA821122300036 00000000FE4ECF40 0000            (null) 00000001A1A7CC12 000000003fa9a09f
[2712515.516024] igb: T [0x0FE]    00000000FF1EC508 000000092B300274 00000000FF1EC508 0000            (null) 00000001A1A82B97 00000000d4e56815
[2712515.516026] igb: T [0x0FF]    0000000000001C14 0000001020200800 00000000FF5B3C6A 0000            (null) 00000001A1A8CA54 0000000081042ac3
[2712515.516027] igb: ------------------------------------
[2712515.516027] igb: TX QUEUE INDEX = 2
[2712515.516028] igb: ------------------------------------
[2712515.516028] igb: T [desc]     [address 63:0  ] [PlPOCIStDDM Ln] [bi->dma       ] leng  ntw timestamp        bi->skb
[2712515.516030] igb: T [0x000]    00000000FF88D9C0 001100292B300044 00000000FF88D9C0 0000            (null) 00000001A1A99804 000000007475d707
[2712515.516032] igb: T [0x001]    00000000FF431E40 001100292B300044 00000000FF431E40 0000            (null) 00000001A1A99869 000000000dae7a2c
[2712515.516034] igb: T [0x002]    0000000000001C14 0000002020200000 00000000FF721E02 0000            (null) 00000001A1A99887 0000000082b3cbce
[2712515.516035] igb: T [0x003]    00000000FF721E02 002402292B300090 00000000FF4A7500 0000            (null) 00000001A1A93D90 00000000155f4bc3
[2712515.516037] igb: T [0x004]    00000000FFF27500 001100292B300044 00000000FFF27500 0000            (null) 00000001A1A998CF 00000000b987e2c0
[2712515.516039] igb: T [0x005]    00000000FF88D7C0 001100292B300044 00000000FF88D7C0 0000            (null) 00000001A1A99934 000000001493c3cd
[2712515.516041] igb: T [0x006]    00000000FD7E1140 001100292B300044 00000000FD7E1140 0000            (null) 00000001A1A9999A 0000000058a07574
[2712515.516042] igb: T [0x007]    00000000FF0E3300 001100292B300044 00000000FF0E3300 0000            (null) 00000001A1A99A00 0000000004b8bf0f
[2712515.516044] igb: T [0x008]    00000000FEB44C40 001100292B300044 00000000FEB44C40 0000            (null) 00000001A1A99A65 000000002afa522e
[2712515.516046] igb: T [0x009]    00000000FF4785C0 001100292B300044 00000000FF4785C0 0000            (null) 00000001A1A99ACB 000000009f6d07b1
[2712515.516048] igb: T [0x00A]    00000000FF43A8C0 001100292B300044 00000000FF43A8C0 0000            (null) 00000001A1A99B31 0000000029e96eb9
[2712515.516049] igb: T [0x00B]    00000000FFB41600 001100292B300044 00000000FFB41600 0000            (null) 00000001A1A99B96 0000000073e121db
[2712515.516051] igb: T [0x00C]    00000000FF721E80 000F80292B30003E 00000000FF721E80 0000            (null) 00000001A1A99BB7 000000004aae1462
[2712515.516053] igb: T [0x00D]    00000000FFA27240 001100292B300044 00000000FFA27240 0000            (null) 00000001A1A99BFB 00000000831f69be
[2712515.516055] igb: T [0x00E]    00000000FF89B940 001100292B300044 00000000FF89B940 0000            (null) 00000001A1A99C61 00000000324da710
[2712515.516056] igb: T [0x00F]    00000000FEC6B600 001100292B300044 00000000FEC6B600 0000            (null) 00000001A1A99CC7 00000000e065fc9d
[2712515.516058] igb: T [0x010]    00000000FF814A80 000F80292B30003E 00000000FF814A80 0000            (null) 00000001A1A99CDC 000000002afa522e
[2712515.516060] igb: T [0x011]    00000000FEBEB740 001100292B300044 00000000FEBEB740 0000            (null) 00000001A1A99D2C 00000000fd39d9ec
[2712515.516061] igb: T [0x012]    00000000FF79A880 001100292B300044 00000000FF79A880 0000            (null) 00000001A1A99D92 000000006642b20e
[2712515.516063] igb: T [0x013]    00000000FFBA5E40 001100292B300044 00000000FFBA5E40 0000            (null) 00000001A1A99DF8 0000000003bfd5ef
[2712515.516065] igb: T [0x014]    00000000FF7D6F00 001100292B300044 00000000FF7D6F00 0000            (null) 00000001A1A99E5D 000000003d1afc35
[2712515.516067] igb: T [0x015]    00000000FF622540 001100292B300044 00000000FF622540 0000            (null) 00000001A1A99EC2 000000007c8836da
[2712515.516068] igb: T [0x016]    00000000FF163100 001100292B300044 00000000FF163100 0000            (null) 00000001A1A99F28 000000009e27efdc
[2712515.516070] igb: T [0x017]    00000000FFBA5F00 001100292B300044 00000000FFBA5F00 0000            (null) 00000001A1A99F8D 00000000ab1221a7
[2712515.516072] igb: T [0x018]    00000000FFEFAC40 001100292B300044 00000000FFEFAC40 0000            (null) 00000001A1A99FF3 000000000fbad8d7
[2712515.516074] igb: T [0x019]    00000000FF773A40 001100292B300044 00000000FF773A40 0000            (null) 00000001A1A9A059 00000000b7669aa2
[2712515.516076] igb: T [0x01A]    00000000FD873BC0 001100292B300044 00000000FD873BC0 0000            (null) 00000001A1A9A0BE 000000006567f236
[2712515.516077] igb: T [0x01B]    00000000FF38A3C0 001100292B300044 00000000FF38A3C0 0000            (null) 00000001A1A9A125 00000000191a9586
[2712515.516079] igb: T [0x01C]    00000000FEDD2040 001100292B300044 00000000FEDD2040 0000            (null) 00000001A1A9A189 00000000b6e65a7b
[2712515.516081] igb: T [0x01D]    00000000FF2E26C0 001100292B300044 00000000FF2E26C0 0000            (null) 00000001A1A9A1EF 0000000058952717
[2712515.516083] igb: T [0x01E]    00000000FFCFC440 001100292B300044 00000000FFCFC440 0000            (null) 00000001A1A9A254 0000000032cb46e8
[2712515.516084] igb: T [0x01F]    00000000FFBB0340 001100292B300044 00000000FFBB0340 0000            (null) 00000001A1A9A2BA 000000003fae9c45
[2712515.516086] igb: T [0x020]    00000000FFF45940 001100292B300044 00000000FFF45940 0000            (null) 00000001A1A9A320 00000000f0a59227
[2712515.516088] igb: T [0x021]    00000000FF3F9400 001100292B300044 00000000FF3F9400 0000            (null) 00000001A1A9A385 0000000003a1c4e7
[2712515.516090] igb: T [0x022]    00000000FF8A5000 001100292B300044 00000000FF8A5000 0000            (null) 00000001A1A9A3EB 00000000a5826abd
[2712515.516091] igb: T [0x023]    00000000FEF1D240 001100292B300044 00000000FEF1D240 0000            (null) 00000001A1A9A451 00000000dfcf43e5
[2712515.516093] igb: T [0x024]    00000000FF2A0740 001100292B300044 00000000FF2A0740 0000            (null) 00000001A1A9A4B6 00000000c517e418
[2712515.516095] igb: T [0x025]    00000000FF6D24C0 001100292B300044 00000000FF6D24C0 0000            (null) 00000001A1A9A51C 0000000020dd0329
[2712515.516096] igb: T [0x026]    00000000FF532E00 001100292B300044 00000000FF532E00 0000            (null) 00000001A1A9A581 00000000a92a1882
[2712515.516098] igb: T [0x027]    00000000FF9C8040 001100292B300044 00000000FF9C8040 0000            (null) 00000001A1A9A5E6 00000000901db150
[2712515.516100] igb: T [0x028]    00000000FF2E6200 001100292B300044 00000000FF2E6200 0000            (null) 00000001A1A9A64C 000000008dade264
[2712515.516102] igb: T [0x029]    00000000FF589540 001100292B300044 00000000FF589540 0000            (null) 00000001A1A9A6B2 00000000e3e2b6cc
[2712515.516103] igb: T [0x02A]    00000000FD2E42C0 001100292B300044 00000000FD2E42C0 0000            (null) 00000001A1A9A717 00000000d816cf67
[2712515.516105] igb: T [0x02B]    00000000FFA0CD00 001100292B300044 00000000FFA0CD00 0000            (null) 00000001A1A9A77D 000000009e27efdc
[2712515.516107] igb: T [0x02C]    00000000FFBF60C0 001100292B300044 00000000FFBF60C0 0000            (null) 00000001A1A9A7E2 00000000fec912c5
[2712515.516109] igb: T [0x02D]    00000000FF636B00 001100292B300044 00000000FF636B00 0000            (null) 00000001A1A9A848 0000000041438f0a
[2712515.516110] igb: T [0x02E]    00000000FD2BCE40 001100292B300044 00000000FD2BCE40 0000            (null) 00000001A1A9A8AF 000000000dc20f93
[2712515.516112] igb: T [0x02F]    00000000FFC46F00 001100292B300044 00000000FFC46F00 0000            (null) 00000001A1A9A913 0000000098022f80
[2712515.516114] igb: T [0x030]    00000000FFA0CB40 001100292B300044 00000000FFA0CB40 0000            (null) 00000001A1A9A979 00000000ab3365b8
[2712515.516117] igb: T [0x031]    00000000FF77DEC0 001100292B300044 00000000FF77DEC0 0000            (null) 00000001A1A9A9DF 0000000005824907
[2712515.516119] igb: T [0x032]    00000000FEFCD700 001100292B300044 00000000FEFCD700 0000            (null) 00000001A1A9AA44 0000000087a3cd0e
[2712515.516121] igb: T [0x033]    00000000FF084840 001100292B300044 00000000FF084840 0000            (null) 00000001A1A9AAA9 00000000119a4492
[2712515.516124] igb: T [0x034]    00000000FEFAC1C0 001100292B300044 00000000FEFAC1C0 0000            (null) 00000001A1A9AB0F 000000004824f440
[2712515.516126] igb: T [0x035]    00000000FD42C340 001100292B300044 00000000FD42C340 0000            (null) 00000001A1A9AB74 000000002d39f65b
[2712515.516128] igb: T [0x036]    00000000FFB28D00 001100292B300044 00000000FFB28D00 0000            (null) 00000001A1A9ABDA 000000004fabde2c
[2712515.516130] igb: T [0x037]    00000000FEF06140 001100292B300044 00000000FEF06140 0000            (null) 00000001A1A9AC40 00000000b985d073
[2712515.516133] igb: T [0x038]    00000000FFDD6640 001100292B300044 00000000FFDD6640 0000            (null) 00000001A1A9ACA5 0000000084e9536a
[2712515.516135] igb: T [0x039]    00000000FFA67440 001100292B300044 00000000FFA67440 0000            (null) 00000001A1A9AD0B 0000000099809c59
[2712515.516138] igb: T [0x03A]    00000000FE6F4FC0 001100292B300044 00000000FE6F4FC0 0000            (null) 00000001A1A9AD71 00000000a0bd8dd9
[2712515.516140] igb: T [0x03B]    00000000FF7E4F40 001100292B300044 00000000FF7E4F40 0000            (null) 00000001A1A9ADD6 00000000af756208
[2712515.516143] igb: T [0x03C]    00000000FF375D40 0015C0292B300057 00000000FF375D40 0000            (null) 00000001A1A951B0 000000006777fb6f NTC/U
[2712515.516145] igb: T [0x03D]    00000000FF976E80 001100292B300044 00000000FF976E80 0000            (null) 00000001A1A951CC 0000000005824907
[2712515.516148] igb: T [0x03E]    00000000FF165540 0015C0292B300057 00000000FF165540 0000            (null) 00000001A1A9521C 000000002740b7c1
[2712515.516151] igb: T [0x03F]    00000000FF2CE440 001100292B300044 00000000FF2CE440 0000            (null) 00000001A1A95231 00000000faf455be
[2712515.516155] igb: T [0x040]    00000000FD2DF340 001100292B300044 00000000FD2DF340 0000            (null) 00000001A1A95296 00000000324da710
[2712515.516158] igb: T [0x041]    00000000FF718D40 001700292B30005C 00000000FF718D40 0000            (null) 00000001A1A952E8 00000000689246ad
[2712515.516160] igb: T [0x042]    00000000FFC78EC0 001100292B300044 00000000FFC78EC0 0000            (null) 00000001A1A952FC 0000000071e16785
[2712515.516163] igb: T [0x043]    00000000FF1C4140 001100292B300044 00000000FF1C4140 0000            (null) 00000001A1A95362 00000000b16699b1
[2712515.516164] igb: T [0x044]    00000000FF718BC0 001100292B300044 00000000FF718BC0 0000            (null) 00000001A1A953C8 00000000171bf01d
[2712515.516168] igb: T [0x045]    00000000FF1C4B40 001100292B300044 00000000FF1C4B40 0000            (null) 00000001A1A9542D 0000000034eac6af
[2712515.516170] igb: T [0x046]    00000000FF7AD840 001100292B300044 00000000FF7AD840 0000            (null) 00000001A1A95493 00000000c936cc9c
[2712515.516172] igb: T [0x047]    00000000FF07ACC0 001100292B300044 00000000FF07ACC0 0000            (null) 00000001A1A954F8 000000006567f236
[2712515.516177] igb: T [0x048]    00000000FFC3AAC0 001100292B300044 00000000FFC3AAC0 0000            (null) 00000001A1A9555E 00000000a85379fe
[2712515.516179] igb: T [0x049]    00000000FF03B300 001100292B300044 00000000FF03B300 0000            (null) 00000001A1A955C3 00000000afa96854
[2712515.516182] igb: T [0x04A]    00000000FF9585C0 001700292B30005C 00000000FF9585C0 0000            (null) 00000001A1A955D5 00000000c5deccae
[2712515.516185] igb: T [0x04B]    00000000FFCB3100 001100292B300044 00000000FFCB3100 0000            (null) 00000001A1A95628 000000001b3a034a
[2712515.516187] igb: T [0x04C]    00000000FFF978C0 001100292B300044 00000000FFF978C0 0000            (null) 00000001A1A9568E 00000000a50360db
[2712515.516190] igb: T [0x04D]    00000000FF4517C0 001100292B300044 00000000FF4517C0 0000            (null) 00000001A1A956F4 0000000019730659
[2712515.516194] igb: T [0x04E]    00000000FF9C64C0 001100292B300044 00000000FF9C64C0 0000            (null) 00000001A1A95759 000000000dae7a2c
[2712515.516195] igb: T [0x04F]    00000000FEDFC140 001100292B300044 00000000FEDFC140 0000            (null) 00000001A1A957BF 00000000417d0e6e
[2712515.516198] igb: T [0x050]    00000000FF89A7C0 001100292B300044 00000000FF89A7C0 0000            (null) 00000001A1A95824 00000000f4218a46
[2712515.516200] igb: T [0x051]    00000000FF8D4F40 001100292B300044 00000000FF8D4F40 0000            (null) 00000001A1A9588A 000000001beac40e
[2712515.516203] igb: T [0x052]    00000000FF22D240 001700292B30005C 00000000FF22D240 0000            (null) 00000001A1A958C3 00000000d7e644fa
[2712515.516205] igb: T [0x053]    00000000FF3A6F00 001100292B300044 00000000FF3A6F00 0000            (null) 00000001A1A958F0 000000009e27efdc
[2712515.516208] igb: T [0x054]    00000000FF165080 001100292B300044 00000000FF165080 0000            (null) 00000001A1A95955 00000000a4d6a433
[2712515.516210] igb: T [0x055]    00000000FF4985C0 001100292B300044 00000000FF4985C0 0000            (null) 00000001A1A959BB 00000000943ffe1f
[2712515.516212] igb: T [0x056]    00000000FF68B240 001100292B300044 00000000FF68B240 0000            (null) 00000001A1A95A20 00000000e374272b
[2712515.516214] igb: T [0x057]    00000000FF4B6400 001100292B300044 00000000FF4B6400 0000            (null) 00000001A1A95A86 00000000c905e458
[2712515.516217] igb: T [0x058]    00000000FF918C80 001100292B300044 00000000FF918C80 0000            (null) 00000001A1A95AEB 0000000058952717
[2712515.516220] igb: T [0x059]    00000000FFAFDF40 001100292B300044 00000000FFAFDF40 0000            (null) 00000001A1A95B51 000000005f134476
[2712515.516222] igb: T [0x05A]    00000000FF68B040 001100292B300044 00000000FF68B040 0000            (null) 00000001A1A95BB6 00000000160eb8a9
[2712515.516224] igb: T [0x05B]    00000000FF557D40 001100292B300044 00000000FF557D40 0000            (null) 00000001A1A95C1C 00000000a5fb9984
[2712515.516226] igb: T [0x05C]    00000000FF9A6D40 001100292B300044 00000000FF9A6D40 0000            (null) 00000001A1A95C83 000000007530cb5f
[2712515.516228] igb: T [0x05D]    00000000FFC822C0 001100292B300044 00000000FFC822C0 0000            (null) 00000001A1A95CE7 0000000095095418
[2712515.516229] igb: T [0x05E]    00000000FF6151C0 001100292B300044 00000000FF6151C0 0000            (null) 00000001A1A95D4D 0000000087837974
[2712515.516231] igb: T [0x05F]    00000000FF77BD00 001100292B300044 00000000FF77BD00 0000            (null) 00000001A1A95DB2 00000000b62895b3
[2712515.516233] igb: T [0x060]    00000000FEF6A3C0 001100292B300044 00000000FEF6A3C0 0000            (null) 00000001A1A95E18 000000007004058f
[2712515.516235] igb: T [0x061]    00000000FF7765C0 001100292B300044 00000000FF7765C0 0000            (null) 00000001A1A95E7D 00000000d57a4024
[2712515.516236] igb: T [0x062]    00000000FF5FDB40 001100292B300044 00000000FF5FDB40 0000            (null) 00000001A1A95EE3 000000007f0478b1
[2712515.516238] igb: T [0x063]    00000000FFBA0A80 001100292B300044 00000000FFBA0A80 0000            (null) 00000001A1A95F49 00000000e61d8a4a
[2712515.516240] igb: T [0x064]    00000000FF5B0940 001100292B300044 00000000FF5B0940 0000            (null) 00000001A1A95FAE 000000005a133b5c
[2712515.516242] igb: T [0x065]    00000000FF44E880 001100292B300044 00000000FF44E880 0000            (null) 00000001A1A96014 000000008e47ef88
[2712515.516243] igb: T [0x066]    00000000FF7CDB00 001100292B300044 00000000FF7CDB00 0000            (null) 00000001A1A96079 00000000ecde5986
[2712515.516245] igb: T [0x067]    00000000FF221B40 001100292B300044 00000000FF221B40 0000            (null) 00000001A1A960DF 00000000c30222c0
[2712515.516247] igb: T [0x068]    00000000FF214740 001100292B300044 00000000FF214740 0000            (null) 00000001A1A96145 000000007530cb5f
[2712515.516248] igb: T [0x069]    00000000FF68F200 001100292B300044 00000000FF68F200 0000            (null) 00000001A1A961AA 00000000878d8315
[2712515.516250] igb: T [0x06A]    00000000FD4041C0 001100292B300044 00000000FD4041C0 0000            (null) 00000001A1A9620F 000000004afd2866
[2712515.516252] igb: T [0x06B]    00000000FD2B5900 001100292B300044 00000000FD2B5900 0000            (null) 00000001A1A96275 0000000080d18607
[2712515.516254] igb: T [0x06C]    00000000FF7CD940 001100292B300044 00000000FF7CD940 0000            (null) 00000001A1A962DB 000000002d9a46e6
[2712515.516255] igb: T [0x06D]    00000000FFA7B540 001100292B300044 00000000FFA7B540 0000            (null) 00000001A1A96340 0000000096fa1ed2
[2712515.516257] igb: T [0x06E]    00000000FF2219C0 001100292B300044 00000000FF2219C0 0000            (null) 00000001A1A963A6 00000000ab3365b8
[2712515.516259] igb: T [0x06F]    00000000FF68FBC0 001100292B300044 00000000FF68FBC0 0000            (null) 00000001A1A9640B 000000002b18b5fc
[2712515.516261] igb: T [0x070]    00000000FF2AB680 001100292B300044 00000000FF2AB680 0000            (null) 00000001A1A96471 00000000e05e3c3b
[2712515.516262] igb: T [0x071]    00000000FF2286C0 001100292B300044 00000000FF2286C0 0000            (null) 00000001A1A964D6 0000000071e16785
[2712515.516264] igb: T [0x072]    00000000FDC38FC0 001100292B300044 00000000FDC38FC0 0000            (null) 00000001A1A9653C 00000000943ffe1f
[2712515.516266] igb: T [0x073]    00000000FF2284C0 001100292B300044 00000000FF2284C0 0000            (null) 00000001A1A965A1 00000000c35154c0
[2712515.516268] igb: T [0x074]    00000000FEF45600 001100292B300044 00000000FEF45600 0000            (null) 00000001A1A96607 0000000005315116
[2712515.516269] igb: T [0x075]    00000000FEBE6480 001100292B300044 00000000FEBE6480 0000            (null) 00000001A1A9666D 00000000a8383ca6
[2712515.516271] igb: T [0x076]    00000000FF97D280 001100292B300044 00000000FF97D280 0000            (null) 00000001A1A966D2 0000000029e96eb9
[2712515.516273] igb: T [0x077]    00000000FEF45400 001100292B300044 00000000FEF45400 0000            (null) 00000001A1A96738 00000000e93cfcb4
[2712515.516275] igb: T [0x078]    00000000FF6CA700 001100292B300044 00000000FF6CA700 0000            (null) 00000001A1A9679E 00000000f997295b
[2712515.516276] igb: T [0x079]    00000000FF684E40 001100292B300044 00000000FF684E40 0000            (null) 00000001A1A96803 00000000481cc8bc
[2712515.516278] igb: T [0x07A]    00000000FF740000 001100292B300044 00000000FF740000 0000            (null) 00000001A1A96868 00000000e5843c9a
[2712515.516280] igb: T [0x07B]    00000000FDB9D2C0 001100292B300044 00000000FDB9D2C0 0000            (null) 00000001A1A968CE 00000000a6fb5fe6
[2712515.516282] igb: T [0x07C]    00000000FF7AFC40 001100292B300044 00000000FF7AFC40 0000            (null) 00000001A1A96933 00000000a141cda4
[2712515.516283] igb: T [0x07D]    00000000FF3D4500 001100292B300044 00000000FF3D4500 0000            (null) 00000001A1A96999 0000000065a0bcbe
[2712515.516285] igb: T [0x07E]    00000000FF959940 001100292B300044 00000000FF959940 0000            (null) 00000001A1A969FF 00000000a376413e
[2712515.516287] igb: T [0x07F]    00000000FF8E0E40 001100292B300044 00000000FF8E0E40 0000            (null) 00000001A1A96A64 00000000f8282507
[2712515.516289] igb: T [0x080]    00000000FF2140C0 001100292B300044 00000000FF2140C0 0000            (null) 00000001A1A96ACA 000000001ee9319f
[2712515.516290] igb: T [0x081]    0000000000001C14 0000002020200000 00000000FF8E0002 0000            (null) 00000001A1A96AED 00000000c8640caf
[2712515.516292] igb: T [0x082]    00000000FF8E0002 002382292B30008E 00000000FF4FB500 0000            (null) 00000001A1A92AC9 0000000082bcdca0
[2712515.516294] igb: T [0x083]    00000000FFA6F080 001100292B300044 00000000FFA6F080 0000            (null) 00000001A1A96B2F 000000000f6da68e
[2712515.516295] igb: T [0x084]    00000000FF7EA280 001100292B300044 00000000FF7EA280 0000            (null) 00000001A1A96B95 00000000239ea72c
[2712515.516297] igb: T [0x085]    00000000FF765EC0 001100292B300044 00000000FF765EC0 0000            (null) 00000001A1A96BFA 0000000010efe30b
[2712515.516299] igb: T [0x086]    00000000FF959F80 001100292B300044 00000000FF959F80 0000            (null) 00000001A1A96C60 00000000a7e15a71
[2712515.516301] igb: T [0x087]    00000000FF5EA880 001100292B300044 00000000FF5EA880 0000            (null) 00000001A1A96CC6 00000000bc691c8e
[2712515.516302] igb: T [0x088]    00000000FF68F9C0 001100292B300044 00000000FF68F9C0 0000            (null) 00000001A1A96D2B 00000000dd252b12
[2712515.516304] igb: T [0x089]    00000000FF600080 001100292B300044 00000000FF600080 0000            (null) 00000001A1A96D91 0000000071320d0b
[2712515.516306] igb: T [0x08A]    00000000FD2B5E00 001100292B300044 00000000FD2B5E00 0000            (null) 00000001A1A96DF6 00000000517a0e54
[2712515.516308] igb: T [0x08B]    00000000FF823E80 001100292B300044 00000000FF823E80 0000            (null) 00000001A1A96E5D 0000000075e0c95a
[2712515.516310] igb: T [0x08C]    00000000FF8E0640 001100292B300044 00000000FF8E0640 0000            (null) 00000001A1A96EC2 000000001f9ed7d5
[2712515.516311] igb: T [0x08D]    00000000FFA7B440 001100292B300044 00000000FFA7B440 0000            (null) 00000001A1A96F27 0000000090e09891
[2712515.516313] igb: T [0x08E]    00000000FF8D4940 001100292B300044 00000000FF8D4940 0000            (null) 00000001A1A96F8C 000000009935c068
[2712515.516315] igb: T [0x08F]    00000000FFF977C0 001100292B300044 00000000FFF977C0 0000            (null) 00000001A1A96FF2 000000008f4f6977
[2712515.516317] igb: T [0x090]    00000000FFC82C00 001100292B300044 00000000FFC82C00 0000            (null) 00000001A1A97058 00000000177d5e9d
[2712515.516318] igb: T [0x091]    00000000FF4A0680 001100292B300044 00000000FF4A0680 0000            (null) 00000001A1A970BD 00000000882bd759
[2712515.516320] igb: T [0x092]    00000000FF5BC740 001100292B300044 00000000FF5BC740 0000            (null) 00000001A1A97123 000000000559fdf5
[2712515.516322] igb: T [0x093]    00000000FFAFD240 001100292B300044 00000000FFAFD240 0000            (null) 00000001A1A97189 00000000436c6e61
[2712515.516324] igb: T [0x094]    00000000FFC827C0 001100292B300044 00000000FFC827C0 0000            (null) 00000001A1A971EE 00000000ab3365b8
[2712515.516326] igb: T [0x095]    00000000FFA7BE80 001100292B300044 00000000FFA7BE80 0000            (null) 00000001A1A97253 0000000039bed37d
[2712515.516327] igb: T [0x096]    00000000FF03B040 001100292B300044 00000000FF03B040 0000            (null) 00000001A1A972B9 00000000b1134203
[2712515.516329] igb: T [0x097]    00000000FFF975C0 001100292B300044 00000000FFF975C0 0000            (null) 00000001A1A9731F 00000000d5f86819
[2712515.516331] igb: T [0x098]    00000000FFA7BC80 001100292B300044 00000000FFA7BC80 0000            (null) 00000001A1A97384 00000000e9e4fe51
[2712515.516333] igb: T [0x099]    00000000FF03BD80 001100292B300044 00000000FF03BD80 0000            (null) 00000001A1A973EA 00000000500e7c53
[2712515.516334] igb: T [0x09A]    00000000FF600E40 001100292B300044 00000000FF600E40 0000            (null) 00000001A1A97450 0000000097a8d7f6
[2712515.516336] igb: T [0x09B]    00000000FF684C40 001100292B300044 00000000FF684C40 0000            (null) 00000001A1A974B5 00000000b562c8fa
[2712515.516338] igb: T [0x09C]    00000000FD2E6E80 001080292B300042 00000000FD2E6E80 0000            (null) 00000001A1A974CE 0000000058952717
[2712515.516339] igb: T [0x09D]    00000000FEDEEC80 001100292B300044 00000000FEDEEC80 0000            (null) 00000001A1A9751B 0000000064b09a0e
[2712515.516341] igb: T [0x09E]    00000000FF6005C0 001100292B300044 00000000FF6005C0 0000            (null) 00000001A1A97580 0000000024ebc9d4
[2712515.516343] igb: T [0x09F]    00000000FD2B5B80 001080292B300042 00000000FD2B5B80 0000            (null) 00000001A1A975E0 00000000977601f0
[2712515.516345] igb: T [0x0A0]    00000000FEDEEA80 001100292B300044 00000000FEDEEA80 0000            (null) 00000001A1A975E5 000000003e5635b3
[2712515.516346] igb: T [0x0A1]    00000000FF684E40 001100292B300044 00000000FF684E40 0000            (null) 00000001A1A9764B 00000000b58e7488
[2712515.516348] igb: T [0x0A2]    00000000FF4B6700 001100292B300044 00000000FF4B6700 0000            (null) 00000001A1A976B1 000000007a7c21fd
[2712515.516350] igb: T [0x0A3]    00000000FD2E63C0 001100292B300044 00000000FD2E63C0 0000            (null) 00000001A1A97717 000000005da2baf7
[2712515.516352] igb: T [0x0A4]    00000000FF44EA40 001100292B300044 00000000FF44EA40 0000            (null) 00000001A1A9777C 00000000073266ae
[2712515.516353] igb: T [0x0A5]    00000000FF70F1C0 001100292B300044 00000000FF70F1C0 0000            (null) 00000001A1A977E1 00000000f9b118f3
[2712515.516355] igb: T [0x0A6]    00000000FDB9C880 001100292B300044 00000000FDB9C880 0000            (null) 00000001A1A97847 000000009268bbcf
[2712515.516357] igb: T [0x0A7]    00000000FF5EA980 001100292B300044 00000000FF5EA980 0000            (null) 00000001A1A978AD 000000008b7332d0
[2712515.516359] igb: T [0x0A8]    00000000FFA6FC40 001100292B300044 00000000FFA6FC40 0000            (null) 00000001A1A97913 00000000f9e9bf4d
[2712515.516361] igb: T [0x0A9]    00000000FDC92FC0 001100292B300044 00000000FDC92FC0 0000            (null) 00000001A1A97978 00000000bc0a2791
[2712515.516362] igb: T [0x0AA]    00000000FFFB63C0 001100292B300044 00000000FFFB63C0 0000            (null) 00000001A1A979DD 000000005f116580
[2712515.516364] igb: T [0x0AB]    00000000FFFB63C0 001100292B300044 00000000FFFB63C0 0000            (null) 00000001A1A97A43 0000000024ebc9d4
[2712515.516366] igb: T [0x0AC]    00000000FF4AF540 001100292B300044 00000000FF4AF540 0000            (null) 00000001A1A97AA8 0000000096fb6cfc
[2712515.516368] igb: T [0x0AD]    00000000FFA8F680 001100292B300044 00000000FFA8F680 0000            (null) 00000001A1A97B0E 00000000f52224b7
[2712515.516369] igb: T [0x0AE]    00000000FF44E1C0 001100292B300044 00000000FF44E1C0 0000            (null) 00000001A1A97B73 00000000b9702733
[2712515.516371] igb: T [0x0AF]    00000000FF44E1C0 001100292B300044 00000000FF44E1C0 0000            (null) 00000001A1A97BD9 0000000024ebc9d4
[2712515.516373] igb: T [0x0B0]    00000000FF71CDC0 001100292B300044 00000000FF71CDC0 0000            (null) 00000001A1A97C3F 00000000c566416e
[2712515.516375] igb: T [0x0B1]    00000000FF1D7E00 001100292B300044 00000000FF1D7E00 0000            (null) 00000001A1A97CA5 00000000aabac8bf
[2712515.516376] igb: T [0x0B2]    00000000FD3EC0C0 001100292B300044 00000000FD3EC0C0 0000            (null) 00000001A1A97D0A 0000000086a9961e
[2712515.516378] igb: T [0x0B3]    00000000FF79AC00 001100292B300044 00000000FF79AC00 0000            (null) 00000001A1A97D6F 000000009fc3ab54
[2712515.516380] igb: T [0x0B4]    00000000FF71C500 001100292B300044 00000000FF71C500 0000            (null) 00000001A1A97DD5 00000000076042f7
[2712515.516381] igb: T [0x0B5]    00000000FF4AFA00 001100292B300044 00000000FF4AFA00 0000            (null) 00000001A1A97E3A 0000000048317bce
[2712515.516383] igb: T [0x0B6]    00000000FF71C300 001100292B300044 00000000FF71C300 0000            (null) 00000001A1A97EA0 00000000a013e713
[2712515.516385] igb: T [0x0B7]    00000000FEDD0100 001100292B300044 00000000FEDD0100 0000            (null) 00000001A1A97F06 00000000f997295b
[2712515.516387] igb: T [0x0B8]    00000000FF930000 001100292B300044 00000000FF930000 0000            (null) 00000001A1A97F6B 00000000ac0f08b0
[2712515.516388] igb: T [0x0B9]    00000000FFDE8F00 001100292B300044 00000000FFDE8F00 0000            (null) 00000001A1A97FD1 00000000ab1221a7
[2712515.516390] igb: T [0x0BA]    00000000FF141340 001100292B300044 00000000FF141340 0000            (null) 00000001A1A98036 00000000e96049c5
[2712515.516392] igb: T [0x0BB]    00000000FD7DBA40 001100292B300044 00000000FD7DBA40 0000            (null) 00000001A1A9809C 00000000a4052979
[2712515.516394] igb: T [0x0BC]    00000000FEFCB740 001100292B300044 00000000FEFCB740 0000            (null) 00000001A1A98101 0000000003bfd5ef
[2712515.516395] igb: T [0x0BD]    00000000FFFA0C40 001100292B300044 00000000FFFA0C40 0000            (null) 00000001A1A98167 00000000766b6171
[2712515.516397] igb: T [0x0BE]    00000000FF385EC0 001080292B300042 00000000FF385EC0 0000            (null) 00000001A1A98171 0000000089ce4669
[2712515.516399] igb: T [0x0BF]    00000000FF924CC0 001100292B300044 00000000FF924CC0 0000            (null) 00000001A1A981CD 000000003dd29a5e
[2712515.516400] igb: T [0x0C0]    00000000FEBB8E00 001100292B300044 00000000FEBB8E00 0000            (null) 00000001A1A98232 00000000bfd37291
[2712515.516402] igb: T [0x0C1]    00000000FF9F1480 001080292B300042 00000000FF9F1480 0000            (null) 00000001A1A9826E 00000000a817c27d
[2712515.516404] igb: T [0x0C2]    00000000FF0EF8C0 001100292B300044 00000000FF0EF8C0 0000            (null) 00000001A1A98298 00000000afec988f
[2712515.516406] igb: T [0x0C3]    00000000FFA2B540 001100292B300044 00000000FFA2B540 0000            (null) 00000001A1A982FD 00000000a5fb9984
[2712515.516408] igb: T [0x0C4]    00000000FF7D0CC0 001100292B300044 00000000FF7D0CC0 0000            (null) 00000001A1A98363 000000007c5e1b86
[2712515.516409] igb: T [0x0C5]    00000000FF542340 001100292B300044 00000000FF542340 0000            (null) 00000001A1A983C8 00000000c803c462
[2712515.516411] igb: T [0x0C6]    00000000FF2F5AC0 001100292B300044 00000000FF2F5AC0 0000            (null) 00000001A1A9842E 00000000d8f90a5f
[2712515.516413] igb: T [0x0C7]    00000000FD72E6C0 001100292B300044 00000000FD72E6C0 0000            (null) 00000001A1A98494 00000000e1e5df10
[2712515.516414] igb: T [0x0C8]    00000000FF3D9C00 001100292B300044 00000000FF3D9C00 0000            (null) 00000001A1A984F9 00000000d641c41b
[2712515.516416] igb: T [0x0C9]    00000000FFA8E840 001100292B300044 00000000FFA8E840 0000            (null) 00000001A1A9855E 000000002a211516
[2712515.516418] igb: T [0x0CA]    00000000FFC47A00 001100292B300044 00000000FFC47A00 0000            (null) 00000001A1A985C5 0000000098022f80
[2712515.516420] igb: T [0x0CB]    00000000FF3AE800 001100292B300044 00000000FF3AE800 0000            (null) 00000001A1A9862A 000000004fabde2c
[2712515.516421] igb: T [0x0CC]    00000000FEBD03C0 001100292B300044 00000000FEBD03C0 0000            (null) 00000001A1A9868F 0000000078c2de0c
[2712515.516423] igb: T [0x0CD]    00000000FD3EC8C0 001280292B30004A 00000000FD3EC8C0 0000            (null) 00000001A1A98694 000000001b9f0a97
[2712515.516425] igb: T [0x0CE]    00000000FF44E700 000F00292B30003C 00000000FF44E700 0000            (null) 00000001A1A98698 000000001b9f0a97
[2712515.516427] igb: T [0x0CF]    00000000FFA8F400 005840292B300161 00000000FFA8F400 0000            (null) 00000001A1A98698 000000001b9f0a97
[2712515.516428] igb: T [0x0D0]    00000000FFC47780 000F00292B30003C 00000000FFC47780 0000            (null) 00000001A1A9869B 00000000ee5d0cee
[2712515.516430] igb: T [0x0D1]    00000000FFDE85C0 000F00292B30003C 00000000FFDE85C0 0000            (null) 00000001A1A9869B 0000000047759458
[2712515.516432] igb: T [0x0D2]    00000000FF4AF400 000F00292B30003C 00000000FF4AF400 0000            (null) 00000001A1A9869C 00000000ab8d8c7b
[2712515.516433] igb: T [0x0D3]    00000000FD428140 001100292B300044 00000000FD428140 0000            (null) 00000001A1A986F5 000000003fae9c45
[2712515.516435] igb: T [0x0D4]    00000000FFFBD4C0 001100292B300044 00000000FFFBD4C0 0000            (null) 00000001A1A9875B 00000000fec912c5
[2712515.516437] igb: T [0x0D5]    00000000FFA27A00 001100292B300044 00000000FFA27A00 0000            (null) 00000001A1A987C1 00000000878d8315
[2712515.516438] igb: T [0x0D6]    00000000FF37C1C0 001100292B300044 00000000FF37C1C0 0000            (null) 00000001A1A98825 00000000687077d2
[2712515.516440] igb: T [0x0D7]    00000000FF81ED00 001100292B300044 00000000FF81ED00 0000            (null) 00000001A1A9888B 00000000b987e2c0
[2712515.516442] igb: T [0x0D8]    00000000FF930AC0 001100292B300044 00000000FF930AC0 0000            (null) 00000001A1A988F0 0000000045f2e31b
[2712515.516444] igb: T [0x0D9]    00000000FF4318C0 001100292B300044 00000000FF4318C0 0000            (null) 00000001A1A98956 00000000a85379fe
[2712515.516445] igb: T [0x0DA]    00000000FD45B8C0 001100292B300044 00000000FD45B8C0 0000            (null) 00000001A1A989BC 000000007dbafeca
[2712515.516447] igb: T [0x0DB]    00000000FFDD7640 001100292B300044 00000000FFDD7640 0000            (null) 00000001A1A98A21 00000000e2f1b790
[2712515.516449] igb: T [0x0DC]    00000000FD7DBB00 001100292B300044 00000000FD7DBB00 0000            (null) 00000001A1A98A87 0000000022ba7c7c
[2712515.516450] igb: T [0x0DD]    00000000FDAC4FC0 001100292B300044 00000000FDAC4FC0 0000            (null) 00000001A1A98AED 00000000171b2455
[2712515.516452] igb: T [0x0DE]    00000000FFA2B840 001100292B300044 00000000FFA2B840 0000            (null) 00000001A1A98B52 00000000b562c8fa
[2712515.516454] igb: T [0x0DF]    00000000FF02F6C0 001100292B300044 00000000FF02F6C0 0000            (null) 00000001A1A98BB8 000000001bcc6c91
[2712515.516456] igb: T [0x0E0]    00000000FF5EC4C0 001100292B300044 00000000FF5EC4C0 0000            (null) 00000001A1A98C1E 00000000ad2c0068
[2712515.516457] igb: T [0x0E1]    00000000FFA8E8C0 001100292B300044 00000000FFA8E8C0 0000            (null) 00000001A1A98C83 000000000fa9cff6
[2712515.516459] igb: T [0x0E2]    00000000FFA8B6C0 001100292B300044 00000000FFA8B6C0 0000            (null) 00000001A1A98CE9 00000000186696da
[2712515.516461] igb: T [0x0E3]    00000000FF36C2C0 001100292B300044 00000000FF36C2C0 0000            (null) 00000001A1A98D4E 00000000202c6654
[2712515.516463] igb: T [0x0E4]    00000000FEDE56C0 001100292B300044 00000000FEDE56C0 0000            (null) 00000001A1A98DB3 0000000099809c59
[2712515.516464] igb: T [0x0E5]    00000000FFFA0A40 001100292B300044 00000000FFFA0A40 0000            (null) 00000001A1A98E19 0000000080e22d19
[2712515.516466] igb: T [0x0E6]    00000000FD2CDF40 001100292B300044 00000000FD2CDF40 0000            (null) 00000001A1A98E7F 0000000027fb2c4f
[2712515.516468] igb: T [0x0E7]    00000000FFB03840 001100292B300044 00000000FFB03840 0000            (null) 00000001A1A98EE4 0000000087837974
[2712515.516470] igb: T [0x0E8]    0000000000001C14 0000002020200000 00000000FF02A402 0000            (null) 00000001A1A98F0F 0000000061ed90fd
[2712515.516471] igb: T [0x0E9]    00000000FF02A402 008A82292B30022A 00000000FF06EAC0 0000            (null) 00000001A1A9392D 000000005d4870a7
[2712515.516473] igb: T [0x0EA]    00000000FF71C900 001100292B300044 00000000FF71C900 0000            (null) 00000001A1A98F49 000000005c51ec63
[2712515.516475] igb: T [0x0EB]    00000000FF6A0DC0 001100292B300044 00000000FF6A0DC0 0000            (null) 00000001A1A98FAF 00000000d57a4024
[2712515.516476] igb: T [0x0EC]    00000000FF9E3D40 001100292B300044 00000000FF9E3D40 0000            (null) 00000001A1A99015 000000007530cb5f
[2712515.516478] igb: T [0x0ED]    00000000FF9BA680 001100292B300044 00000000FF9BA680 0000            (null) 00000001A1A9907A 000000007b10e140
[2712515.516480] igb: T [0x0EE]    00000000FF9EF4C0 001100292B300044 00000000FF9EF4C0 0000            (null) 00000001A1A990E0 0000000078ef8fa9
[2712515.516482] igb: T [0x0EF]    00000000FF36C0C0 001100292B300044 00000000FF36C0C0 0000            (null) 00000001A1A99145 000000001cdbc73a
[2712515.516483] igb: T [0x0F0]    00000000FF46F800 001100292B300044 00000000FF46F800 0000            (null) 00000001A1A991AB 000000004939c2c6
[2712515.516485] igb: T [0x0F1]    00000000FFC4C640 001100292B300044 00000000FFC4C640 0000            (null) 00000001A1A99210 0000000097211509
[2712515.516487] igb: T [0x0F2]    00000000FEB44EC0 001100292B300044 00000000FEB44EC0 0000            (null) 00000001A1A99276 00000000813ab01f
[2712515.516489] igb: T [0x0F3]    00000000FFAC64C0 001100292B300044 00000000FFAC64C0 0000            (null) 00000001A1A992DC 00000000227ee0ea
[2712515.516490] igb: T [0x0F4]    00000000FF7EB2C0 001100292B300044 00000000FF7EB2C0 0000            (null) 00000001A1A99341 000000000406db2c
[2712515.516492] igb: T [0x0F5]    00000000FF814700 001100292B300044 00000000FF814700 0000            (null) 00000001A1A993A7 00000000ab80aaba
[2712515.516494] igb: T [0x0F6]    00000000FFB50B40 001100292B300044 00000000FFB50B40 0000            (null) 00000001A1A9940C 000000007f0478b1
[2712515.516496] igb: T [0x0F7]    00000000FFA082C0 001100292B300044 00000000FFA082C0 0000            (null) 00000001A1A99472 00000000b7c8b5cb
[2712515.516497] igb: T [0x0F8]    00000000FF8A8CC0 001100292B300044 00000000FF8A8CC0 0000            (null) 00000001A1A994D8 0000000004b9c762
[2712515.516499] igb: T [0x0F9]    00000000FF37C2C0 001100292B300044 00000000FF37C2C0 0000            (null) 00000001A1A9953D 000000008c4d905b
[2712515.516501] igb: T [0x0FA]    00000000FF4310C0 001100292B300044 00000000FF4310C0 0000            (null) 00000001A1A995A2 000000001f984bf1
[2712515.516503] igb: T [0x0FB]    00000000FF197AC0 001100292B300044 00000000FF197AC0 0000            (null) 00000001A1A99608 00000000e61d8a4a
[2712515.516504] igb: T [0x0FC]    00000000FFFE2440 001100292B300044 00000000FFFE2440 0000            (null) 00000001A1A9966E 0000000035adb966
[2712515.516506] igb: T [0x0FD]    00000000FFB17640 001100292B300044 00000000FFB17640 0000            (null) 00000001A1A996D3 00000000177d5e9d
[2712515.516508] igb: T [0x0FE]    00000000FD448BC0 001100292B300044 00000000FD448BC0 0000            (null) 00000001A1A99739 00000000b5776b70
[2712515.516510] igb: T [0x0FF]    00000000FEFAE0C0 001100292B300044 00000000FEFAE0C0 0000            (null) 00000001A1A9979E 00000000763ed557
[2712515.516510] igb: ------------------------------------
[2712515.516511] igb: TX QUEUE INDEX = 3
[2712515.516511] igb: ------------------------------------
[2712515.516512] igb: T [desc]     [address 63:0  ] [PlPOCIStDDM Ln] [bi->dma       ] leng  ntw timestamp        bi->skb
[2712515.516514] igb: T [0x000]    00000000FF6A0880 013C40392B3004F1 00000000FF6A0880 0000            (null) 00000001A1A991D5 00000000ab3365b8
[2712515.516515] igb: T [0x001]    00000000FF02F140 016680392B30059A 00000000FF02F140 0000            (null) 00000001A1A991D5 0000000064e4ee1d
[2712515.516517] igb: T [0x002]    00000000FD7DBA00 016680392B30059A 00000000FD7DBA00 0000            (null) 00000001A1A991D5 0000000047cf6796
[2712515.516519] igb: T [0x003]    00000000FFDD7800 001EC0392B30007B 00000000FFDD7800 0000            (null) 00000001A1A991D9 0000000014fd9571
[2712515.516521] igb: T [0x004]    00000000FF385180 008040392B300201 00000000FF385180 0000            (null) 00000001A1A99376 00000000a70f85ae
[2712515.516522] igb: T [0x005]    00000000FECDDA40 016680392B30059A 00000000FECDDA40 0000            (null) 00000001A1A9937C 0000000013a0ebf3
[2712515.516524] igb: T [0x006]    00000000FF4164C0 010000392B300400 00000000FF4164C0 0000            (null) 00000001A1A9937D 000000000500b1dc
[2712515.516526] igb: T [0x007]    00000000FEB44440 008040392B300201 00000000FEB44440 0000            (null) 00000001A1A9939E 00000000b156aca3
[2712515.516528] igb: T [0x008]    00000000FF431100 006880392B3001A2 00000000FF431100 0000            (null) 00000001A1A993A3 00000000a7eb7d66
[2712515.516529] igb: T [0x009]    00000000FF37CD40 008040392B300201 00000000FF37CD40 0000            (null) 00000001A1A993A8 00000000e1a1de70
[2712515.516531] igb: T [0x00A]    00000000FF7EB900 006980392B3001A6 00000000FF7EB900 0000            (null) 00000001A1A993AD 000000002c471da3
[2712515.516533] igb: T [0x00B]    00000000FF2E1100 008040392B300201 00000000FF2E1100 0000            (null) 00000001A1A993B2 000000008fbb85fa
[2712515.516535] igb: T [0x00C]    00000000FFAC65C0 006980392B3001A6 00000000FFAC65C0 0000            (null) 00000001A1A993B7 00000000d66ace81
[2712515.516536] igb: T [0x00D]    00000000FFC4C200 008040392B300201 00000000FFC4C200 0000            (null) 00000001A1A993BC 0000000030467c7b
[2712515.516538] igb: T [0x00E]    00000000FF532840 000F00392B30003C 00000000FF532840 0000            (null) 00000001A1A993E8 00000000f89c6a19
[2712515.516540] igb: T [0x00F]    00000000FF163040 003600392B3000D8 00000000FF163040 0000            (null) 00000001A1A99DF0 00000000d8f90a5f
[2712515.516542] igb: T [0x010]    00000000FF8A5DC0 003600392B3000D8 00000000FF8A5DC0 0000            (null) 00000001A1A9A1E4 00000000481cc8bc
[2712515.516543] igb: T [0x011]    0000000000001C14 0000003020200000 00000000FF2A0602 0000            (null) 00000001A1A9A336 00000000fbcc9f6e
[2712515.516545] igb: T [0x012]    00000000FF2A0602 002382392B30008E 00000000FF5F6A5E 0000            (null) 00000001A1A88450 000000002b69780c
[2712515.516550] igb: T [0x013]    00000000FEFCD380 003600392B3000D8 00000000FEFCD380 0000            (null) 00000001A1A9A5DB 000000002a83c40f
[2712515.516555] igb: T [0x014]    00000000FEFCDB80 003600392B3000D8 00000000FEFCDB80 0000            (null) 00000001A1A9A9C4 0000000087a3cd0e
[2712515.516560] igb: T [0x015]    00000000FFEF5C6A 000D82392B300036 00000000FF709040 0000            (null) 00000001A1A6FB5E 00000000c30222c0 NTC/U
[2712515.516564] igb: T [0x016]    0000000000001C14 0000003020200800 00000000FFDEC06A 0000            (null) 00000001A1A88452 00000000987cad78
[2712515.516569] igb: T [0x017]    00000000FFDEC06A 017282392B3005CA 00000000FD2D95C0 0000            (null) 00000001A1A70139 00000000752eb554
[2712515.516574] igb: T [0x018]    0000000000001C14 0000003020200800 00000000FD2BE06A 0000            (null) 00000001A1A88452 00000000823f90b0
[2712515.516577] igb: T [0x019]    00000000FD2BE06A 01728231223000C2 00000000FEFCF508 0000            (null) 00000001A1A60E2C 00000000a6d16f83
[2712515.516582] igb: T [0x01A]    00000000FD2F1000 000000092B300508 00000000FD2F1000 0000            (null) 00000001A1A82E87 000000001c8ba264
[2712515.516586] igb: T [0x01B]    0000000000001C14 0000003020200800 00000000FF4EDE6A 0000            (null) 00000001A1A88452 0000000032cb46e8
[2712515.516591] igb: T [0x01C]    00000000FF4EDE6A 00AA823122300036 00000000FF8ED000 0000            (null) 00000001A1A70ACE 0000000021e08755
[2712515.516596] igb: T [0x01D]    00000000FF511508 000000092B300274 00000000FF511508 0000            (null) 00000001A1A82E87 0000000077cb73e5
[2712515.516599] igb: T [0x01E]    0000000000001C14 0000003020200800 00000000FEBB326A 0000            (null) 00000001A1A88453 000000005f731a34
[2712515.516601] igb: T [0x01F]    00000000FEBB326A 000D82392B300036 00000000FF283508 0000            (null) 00000001A1A60F14 0000000080375d0d
[2712515.516603] igb: T [0x020]    0000000000001C14 0000003020200800 00000000FD73F65E 0000            (null) 00000001A1A884CD 00000000bc7d7d30
[2712515.516604] igb: T [0x021]    00000000FD73F65E 001082392B300042 00000000FF666F40 0000            (null) 00000001A1A60F18 00000000a09aec9b
[2712515.516606] igb: T [0x022]    0000000000001C14 0000003020200800 00000000FF73CA6A 0000            (null) 00000001A1A884CE 00000000763ed557
[2712515.516608] igb: T [0x023]    00000000FF73CA6A 000D82392B300036 00000000FEDE4B80 0000            (null) 00000001A1A60F1D 00000000a09aec9b
[2712515.516610] igb: T [0x024]    0000000000001C14 0000003020200800 00000000FF37F06A 0000            (null) 00000001A1A884CF 000000003c3ef046
[2712515.516611] igb: T [0x025]    00000000FF37F06A 017282392B3005CA 00000000FFBA27C0 0000            (null) 00000001A1A60F23 0000000080375d0d
[2712515.516613] igb: T [0x026]    0000000000001C14 0000003020200800 00000000FF0F906A 0000            (null) 00000001A1A884CF 00000000d4d1663e
[2712515.516615] igb: T [0x027]    00000000FF0F906A 01728231223000C2 00000000FF03226A 0000            (null) 00000001A1A66F52 00000000c5deccae
[2712515.516617] igb: T [0x028]    00000000FF36B000 000000092B300508 00000000FF36B000 0000            (null) 00000001A1A82FFE 000000008eb9f554
[2712515.516618] igb: T [0x029]    0000000000001C14 0000003020200800 00000000FF4EB06A 0000            (null) 00000001A1A884CF 000000004c035d48
[2712515.516620] igb: T [0x02A]    00000000FF4EB06A 00AA823122300036 00000000FF22E46A 0000            (null) 00000001A1A82FFE 000000003173f4bd
[2712515.516622] igb: T [0x02B]    00000000FFA1B508 000000092B300274 00000000FFA1B508 0000            (null) 00000001A1A81884 00000000ed09cbc8
[2712515.516624] igb: T [0x02C]    0000000000001C14 0000003020200800 00000000FF429A6A 0000            (null) 00000001A1A884D0 0000000084278fc5
[2712515.516626] igb: T [0x02D]    00000000FF429A6A 000D82392B300036 00000000FF9C9A6A 0000            (null) 00000001A1A82FFE 00000000b41f0c89
[2712515.516627] igb: T [0x02E]    0000000000001C14 0000003020200800 00000000FFE1B25E 0000            (null) 00000001A1A8854A 000000009268bbcf
[2712515.516629] igb: T [0x02F]    00000000FFE1B25E 001082392B300042 00000000FF994508 0000            (null) 00000001A1A755F3 000000004aae1462
[2712515.516631] igb: T [0x030]    0000000000001C14 0000003020200800 00000000FD23606A 0000            (null) 00000001A1A8854B 000000002890a59b
[2712515.516633] igb: T [0x031]    00000000FD23606A 000D82392B300036 00000000FF932B80 0000            (null) 00000001A1A6124F 00000000ad038250
[2712515.516634] igb: T [0x032]    0000000000001C14 0000003020200800 00000000FFDE786A 0000            (null) 00000001A1A8854C 000000001950a4fa
[2712515.516636] igb: T [0x033]    00000000FFDE786A 017282392B3005CA 00000000FD24A680 0000            (null) 00000001A1A61259 00000000643c5ea5
[2712515.516638] igb: T [0x034]    0000000000001C14 0000003020200800 00000000FEDC9C6A 0000            (null) 00000001A1A8854C 0000000073e121db
[2712515.516640] igb: T [0x035]    00000000FEDC9C6A 01728231223000C2 00000000FF58186A 0000            (null) 00000001A1A66FAD 000000007a7c21fd
[2712515.516641] igb: T [0x036]    00000000FFDE0000 000000092B300508 00000000FFDE0000 0000            (null) 00000001A1A831EF 0000000029c76f77
[2712515.516643] igb: T [0x037]    0000000000001C14 0000003020200800 00000000FF13E46A 0000            (null) 00000001A1A8854C 00000000a7736c96
[2712515.516645] igb: T [0x038]    00000000FF13E46A 00AA823122300036 00000000FF86FE5E 0000            (null) 00000001A1A832EB 000000000fa9cff6
[2712515.516647] igb: T [0x039]    00000000FF900508 000000092B300274 00000000FF900508 0000            (null) 00000001A1A66388 000000005189a80f
[2712515.516648] igb: T [0x03A]    0000000000001C14 0000003020200800 00000000FF62E66A 0000            (null) 00000001A1A8854D 0000000024433b4c
[2712515.516650] igb: T [0x03B]    00000000FF62E66A 000D82392B300036 00000000FF34066A 0000            (null) 00000001A1A81AD3 00000000a60d61cf
[2712515.516652] igb: T [0x03C]    0000000000001C14 0000003020200000 00000000FF41D802 0000            (null) 00000001A1A886BF 00000000f9071d90
[2712515.516653] igb: T [0x03D]    00000000FF41D802 008A82392B30022A 00000000FD2BA508 0000            (null) 00000001A1A612EC 0000000034262aa6
[2712515.516655] igb: T [0x03E]    0000000000001C14 0000003020200800 00000000FFA7D65E 0000            (null) 00000001A1A887BB 00000000d7e644fa
[2712515.516657] igb: T [0x03F]    00000000FFA7D65E 001082392B300042 00000000FD3F5E6A 0000            (null) 00000001A1A781E8 000000001163c2ff
[2712515.516659] igb: T [0x040]    0000000000001C14 0000003020200800 00000000FFC8E46A 0000            (null) 00000001A1A887BC 0000000075b0ee84
[2712515.516660] igb: T [0x041]    00000000FFC8E46A 000D82392B300036 00000000FD7DD86A 0000            (null) 00000001A1A832EC 00000000b35596d5
[2712515.516662] igb: T [0x042]    0000000000001C14 0000003020200800 00000000FFA9606A 0000            (null) 00000001A1A887BD 00000000aa87729d
[2712515.516664] igb: T [0x043]    00000000FFA9606A 017282392B3005CA 00000000FD2BA508 0000            (null) 00000001A1A66FCE 0000000081ad7644
[2712515.516665] igb: T [0x044]    0000000000001C14 0000003020200800 00000000FF28546A 0000            (null) 00000001A1A887BD 000000002356a847
[2712515.516667] igb: T [0x045]    00000000FF28546A 01728231223000C2 00000000FFB10508 0000            (null) 00000001A1A6131F 000000004e182c21
[2712515.516669] igb: T [0x046]    00000000FEC5A000 000000092B300508 00000000FEC5A000 0000            (null) 00000001A1A833DC 0000000072480647
[2712515.516671] igb: T [0x047]    0000000000001C14 0000003020200800 00000000FD2FF66A 0000            (null) 00000001A1A887BD 0000000096624c40
[2712515.516672] igb: T [0x048]    00000000FD2FF66A 00AA823122300036 00000000FF340002 0000            (null) 00000001A1A834CE 000000001cd734a0
[2712515.516674] igb: T [0x049]    00000000FF5C5508 000000092B300274 00000000FF5C5508 0000            (null) 00000001A1A81AEB 00000000c566416e
[2712515.516676] igb: T [0x04A]    0000000000001C14 0000003020200800 00000000FFBC706A 0000            (null) 00000001A1A887BE 000000004ef1a335
[2712515.516678] igb: T [0x04B]    00000000FFBC706A 000D82392B300036 00000000FF396508 0000            (null) 00000001A1A5DFCA 0000000005256b94
[2712515.516679] igb: T [0x04C]    00000000FF8BAD00 001080392B300042 00000000FF8BAD00 0000            (null) 00000001A1A88A12 00000000e9e4fe51
[2712515.516681] igb: T [0x04D]    00000000FF964540 008DC0392B300237 00000000FF964540 0000            (null) 00000001A1A88A78 0000000028795e78
[2712515.516683] igb: T [0x04E]    0000000000001C14 0000003020200000 00000000FFB26802 0000            (null) 00000001A1A88AA7 000000006777fb6f
[2712515.516685] igb: T [0x04F]    00000000FFB26802 008A02392B300228 00000000FF5C5BC0 0000            (null) 00000001A1A79E85 00000000c40e74f4
[2712515.516687] igb: T [0x050]    0000000000001C14 0000003020200800 00000000FF61225E 0000            (null) 00000001A1A88AAA 00000000178f2ddb
[2712515.516688] igb: T [0x051]    00000000FF61225E 001082392B300042 00000000FFFDB46A 0000            (null) 00000001A1A6702B 000000008e47ef88
[2712515.516690] igb: T [0x052]    0000000000001C14 0000003020200800 00000000FF22F66A 0000            (null) 00000001A1A88AAB 000000009268bbcf
[2712515.516692] igb: T [0x053]    00000000FF22F66A 000D82392B300036 00000000FFBA0C6A 0000            (null) 00000001A1A682B5 00000000f3b16dad
[2712515.516694] igb: T [0x054]    0000000000001C14 0000003020200800 00000000FFA9A86A 0000            (null) 00000001A1A88AAB 00000000a4d6a433
[2712515.516695] igb: T [0x055]    00000000FFA9A86A 017282392B3005CA 00000000FF7BE508 0000            (null) 00000001A1A5E330 00000000d31a8fcc
[2712515.516697] igb: T [0x056]    0000000000001C14 0000003020200800 00000000FF3F786A 0000            (null) 00000001A1A88AAB 0000000039bed37d
[2712515.516699] igb: T [0x057]    00000000FF3F786A 01728231223000C2 00000000FEF73A00 0000            (null) 00000001A1A7C5A7 000000008eae16bd
[2712515.516701] igb: T [0x058]    00000000FF033000 000000092B300508 00000000FF033000 0000            (null) 00000001A1A83985 00000000c803c462
[2712515.516702] igb: T [0x059]    0000000000001C14 0000003020200800 00000000FEFA3A6A 0000            (null) 00000001A1A88AAB 000000002329c057
[2712515.516704] igb: T [0x05A]    00000000FEFA3A6A 00AA823122300036 00000000FFB77A5E 0000            (null) 00000001A1A83985 00000000cd812a0f
[2712515.516706] igb: T [0x05B]    00000000FFE20508 000000092B300274 00000000FFE20508 0000            (null) 00000001A1A7CB3F 000000002811d849
[2712515.516708] igb: T [0x05C]    0000000000001C14 0000003020200800 00000000FD24C86A 0000            (null) 00000001A1A88AAD 000000008219502e
[2712515.516709] igb: T [0x05D]    00000000FD24C86A 000D82392B300036 00000000FFB8D280 0000            (null) 00000001A1A7CB43 0000000007750b8a
[2712515.516711] igb: T [0x05E]    0000000000001C14 0000003020200000 00000000FF5DD802 0000            (null) 00000001A1A88B24 000000007c0089da
[2712515.516713] igb: T [0x05F]    00000000FF5DD802 008742392B30021D 00000000FF527B80 0000            (null) 00000001A1A7CD23 00000000686633bc
[2712515.516715] igb: T [0x060]    0000000000001C14 0000003020200800 00000000FEBE025E 0000            (null) 00000001A1A88C21 00000000e1c016a6
[2712515.516716] igb: T [0x061]    00000000FEBE025E 001082392B300042 00000000FF5BFBC0 0000            (null) 00000001A1A7D4F9 0000000084989838
[2712515.516718] igb: T [0x062]    0000000000001C14 0000003020200800 00000000FFBA966A 0000            (null) 00000001A1A88C22 000000004b45fcae
[2712515.516720] igb: T [0x063]    00000000FFBA966A 000D82392B300036 00000000FD868C40 0000            (null) 00000001A1A7E2C6 000000001493c3cd
[2712515.516721] igb: T [0x064]    0000000000001C14 0000003020200800 00000000FF67F86A 0000            (null) 00000001A1A88C22 00000000a1bf6ad3
[2712515.516723] igb: T [0x065]    00000000FF67F86A 017282392B3005CA 00000000FF86FA80 0000            (null) 00000001A1A7E370 000000008f19ca4c
[2712515.516725] igb: T [0x066]    0000000000001C14 0000003020200800 00000000FF44B46A 0000            (null) 00000001A1A88C22 00000000417d0e6e
[2712515.516727] igb: T [0x067]    00000000FF44B46A 01728231223000C2 00000000FFACD86A 0000            (null) 00000001A1A8398B 00000000af1b2ed1
[2712515.516728] igb: T [0x068]    00000000FF73B000 000000092B300508 00000000FF73B000 0000            (null) 00000001A1A81F61 0000000058a07574
[2712515.516730] igb: T [0x069]    0000000000001C14 0000003020200800 00000000FF66926A 0000            (null) 00000001A1A88C22 0000000053aaa1bc
[2712515.516732] igb: T [0x06A]    00000000FF66926A 00AA823122300036 00000000FF127C6A 0000            (null) 00000001A1A8398C 000000003ebe0718
[2712515.516734] igb: T [0x06B]    00000000FD2F0508 000000092B300274 00000000FD2F0508 0000            (null) 00000001A1A5E528 000000006942af0c
[2712515.516736] igb: T [0x06C]    0000000000001C14 0000003020200800 00000000FF3F106A 0000            (null) 00000001A1A88C23 000000007f48174a
[2712515.516737] igb: T [0x06D]    00000000FF3F106A 000D82392B300036 00000000FF1953C0 0000            (null) 00000001A1A7ECC6 00000000a805416c
[2712515.516739] igb: T [0x06E]    0000000000001C14 0000003020200000 00000000FF673402 0000            (null) 00000001A1A88C9B 00000000e046dd1c
[2712515.516741] igb: T [0x06F]    00000000FF673402 008482392B300212 00000000FF998C80 0000            (null) 00000001A1A7ED2C 000000003980ef91
[2712515.516743] igb: T [0x070]    0000000000001C14 0000003020200800 00000000FF90365E 0000            (null) 00000001A1A88D1B 00000000a35316d6
[2712515.516745] igb: T [0x071]    00000000FF90365E 001082392B300042 00000000FFF8D240 0000            (null) 00000001A1A7F8BD 00000000962f6fc3
[2712515.516746] igb: T [0x072]    0000000000001C14 0000003020200800 00000000FF74126A 0000            (null) 00000001A1A88D1B 00000000819cdfb5
[2712515.516748] igb: T [0x073]    00000000FF74126A 000D82392B300036 00000000FDF4146A 0000            (null) 00000001A1A81F65 0000000076d89d9f
[2712515.516750] igb: T [0x074]    0000000000001C14 0000003020200800 00000000FF5DF06A 0000            (null) 00000001A1A88D1C 0000000006e6e328
[2712515.516752] igb: T [0x075]    00000000FF5DF06A 017282392B3005CA 00000000FD6C8508 0000            (null) 00000001A1A668C9 00000000eab09a5f
[2712515.516753] igb: T [0x076]    0000000000001C14 0000003020200800 00000000FF3ED06A 0000            (null) 00000001A1A88D1C 00000000d09ccef2
[2712515.516755] igb: T [0x077]    00000000FF3ED06A 01728231223000C2 00000000FF20C86A 0000            (null) 00000001A1A83A11 000000009fb7d5f3
[2712515.516757] igb: T [0x078]    00000000FF95D000 000000092B300508 00000000FF95D000 0000            (null) 00000001A1A81FC3 000000009f524343
[2712515.516759] igb: T [0x079]    0000000000001C14 0000003020200800 00000000FF324E6A 0000            (null) 00000001A1A88D1C 00000000282c3312
[2712515.516760] igb: T [0x07A]    00000000FF324E6A 00AA823122300036 00000000FD6C946A 0000            (null) 00000001A1A83A12 00000000fb3e439d
[2712515.516762] igb: T [0x07B]    00000000FF81C508 000000092B300274 00000000FF81C508 0000            (null) 00000001A1A80A4A 0000000077da13c2
[2712515.516764] igb: T [0x07C]    0000000000001C14 0000003020200800 00000000FFFAAE6A 0000            (null) 00000001A1A88D1D 00000000c729aca2
[2712515.516766] igb: T [0x07D]    00000000FFFAAE6A 000D82392B300036 00000000FFCAC86A 0000            (null) 00000001A1A80A4B 00000000943ffe1f
[2712515.516768] igb: T [0x07E]    0000000000001C14 0000003020200000 00000000FFAF3002 0000            (null) 00000001A1A88D96 00000000f03227b9
[2712515.516769] igb: T [0x07F]    00000000FFAF3002 008442392B300211 00000000FF1EB85E 0000            (null) 00000001A1A83B80 00000000119a4492
[2712515.516771] igb: T [0x080]    0000000000001C14 0000003020200000 00000000FF9FC002 0000            (null) 00000001A1A88F8A 00000000e046dd1c
[2712515.516778] igb: T [0x081]    00000000FF9FC002 008802392B300220 00000000FFCCC26A 0000            (null) 00000001A1A83B81 00000000514f23ef
[2712515.516780] igb: T [0x082]    0000000000001C14 0000003020200000 00000000FD423802 0000            (null) 00000001A1A89BA9 0000000008cd7ef8
[2712515.516782] igb: T [0x083]    00000000FD423802 002382392B30008E 00000000FF4AD06A 0000            (null) 00000001A1A83B82 00000000bedbf43c
[2712515.516784] igb: T [0x084]    0000000000001C14 0000003020200000 00000000FF69C402 0000            (null) 00000001A1A89EBB 0000000096fa1ed2
[2712515.516786] igb: T [0x085]    00000000FF69C402 008582392B300216 00000000FFCB506A 0000            (null) 00000001A1A83B82 00000000496fd4ff
[2712515.516788] igb: T [0x086]    00000000FF596E40 001280392B30004A 00000000FF596E40 0000            (null) 00000001A1A8B453 00000000d964d2a2
[2712515.516790] igb: T [0x087]    00000000FF681C80 000F00392B30003C 00000000FF681C80 0000            (null) 00000001A1A8B457 00000000936c29cb
[2712515.516792] igb: T [0x088]    00000000FD230980 005840392B300161 00000000FD230980 0000            (null) 00000001A1A8B457 00000000c228466e
[2712515.516793] igb: T [0x089]    00000000FFA5E7C0 000F00392B30003C 00000000FFA5E7C0 0000            (null) 00000001A1A8B45B 0000000098e74e30
[2712515.516795] igb: T [0x08A]    00000000FD40D600 000F00392B30003C 00000000FD40D600 0000            (null) 00000001A1A8B45B 00000000e7e5bd31
[2712515.516797] igb: T [0x08B]    00000000FFB46440 000F00392B30003C 00000000FFB46440 0000            (null) 00000001A1A8B45C 00000000a54547eb
[2712515.516799] igb: T [0x08C]    0000000000001C14 0000003020200000 00000000FF6C4402 0000            (null) 00000001A1A8BBAD 000000008fb78a98
[2712515.516801] igb: T [0x08D]    00000000FF6C4402 001A82392B30006A 00000000FF8ECC80 0000            (null) 00000001A1A83BD2 00000000f52224b7
[2712515.516802] igb: T [0x08E]    0000000000001C14 0000003020200000 00000000FFCB8C02 0000            (null) 00000001A1A8BBE9 00000000f0a59227
[2712515.516804] igb: T [0x08F]    00000000FFCB8C02 007142392B3001C5 00000000FD229E5E 0000            (null) 00000001A1A80FCA 00000000d7e644fa
[2712515.516806] igb: T [0x090]    0000000000001C14 0000003020200000 00000000FF3C9C02 0000            (null) 00000001A1A8BFD1 000000001decd19e
[2712515.516807] igb: T [0x091]    00000000FF3C9C02 008582392B300216 00000000FDBB1980 0000            (null) 00000001A1A83F25 00000000a60d61cf
[2712515.516809] igb: T [0x092]    0000000000001C14 0000003020200000 00000000FF52C002 0000            (null) 00000001A1A8C188 000000000d399bf8
[2712515.516811] igb: T [0x093]    00000000FF52C002 0089C2392B300227 00000000FFAEB680 0000            (null) 00000001A1A83F29 000000003fa9a09f
[2712515.516813] igb: T [0x094]    0000000000001C14 0000003020200000 00000000FFA3B402 0000            (null) 00000001A1A8C8F9 00000000190e0636
[2712515.516814] igb: T [0x095]    00000000FFA3B402 008982392B300226 00000000FF54B300 0000            (null) 00000001A1A83F29 000000002811d849
[2712515.516816] igb: T [0x096]    0000000000001C14 0000003020200000 00000000FF1EC202 0000            (null) 00000001A1A8C9E7 00000000257124fe
[2712515.516818] igb: T [0x097]    00000000FF1EC202 0018C2392B300063 00000000FD6D5000 0000            (null) 00000001A1A67494 00000000d57a4024
[2712515.516819] igb: T [0x098]    00000000FDC38F40 006EC0392B3001BB 00000000FDC38F40 0000            (null) 00000001A1A8CACE 00000000b1134203
[2712515.516821] igb: T [0x099]    0000000000001C14 0000003020200000 00000000FF532002 0000            (null) 00000001A1A8CE8D 00000000073266ae
[2712515.516823] igb: T [0x09A]    00000000FF532002 002382392B30008E 00000000FFBED602 0000            (null) 00000001A1A84F7B 0000000051f7fc0e
[2712515.516825] igb: T [0x09B]    00000000FF1EC680 001AC0392B30006B 00000000FF1EC680 0000            (null) 00000001A1A8D2AE 000000001163c2ff
[2712515.516826] igb: T [0x09C]    0000000000001C14 0000003020200000 00000000FFAF8802 0000            (null) 00000001A1A8D2F1 00000000e5957932
[2712515.516828] igb: T [0x09D]    00000000FFAF8802 008942392B300225 00000000FF67FE80 0000            (null) 00000001A1A8102D 00000000eb6f75bb
[2712515.516830] igb: T [0x09E]    0000000000001C14 0000003020200000 00000000FF6FC602 0000            (null) 00000001A1A8D795 00000000f7aaae8b
[2712515.516831] igb: T [0x09F]    00000000FF6FC602 002382392B30008E 00000000FF742A6A 0000            (null) 00000001A1A6B596 0000000049623ead
[2712515.516833] igb: T [0x0A0]    00000000FF2E7E40 001080392B300042 00000000FF2E7E40 0000            (null) 00000001A1A8D8B8 000000008b6cdf62
[2712515.516835] igb: T [0x0A1]    00000000FF977A80 008DC0392B300237 00000000FF977A80 0000            (null) 00000001A1A8D91F 00000000752eb554
[2712515.516837] igb: T [0x0A2]    0000000000001C14 0000003020200000 00000000FF7D6C02 0000            (null) 00000001A1A8E0B7 00000000e7603ad1
[2712515.516839] igb: T [0x0A3]    00000000FF7D6C02 008482392B300212 00000000FD2C5A6A 0000            (null) 00000001A1A659A7 0000000088b320ea
[2712515.516840] igb: T [0x0A4]    0000000000001C14 0000003020200000 00000000FF091402 0000            (null) 00000001A1A8F105 0000000022ba7c7c
[2712515.516842] igb: T [0x0A5]    00000000FF091402 008942392B300225 00000000FFE1D06A 0000            (null) 00000001A1A825CB 0000000008d7e241
[2712515.516844] igb: T [0x0A6]    0000000000001C14 0000003020200000 00000000FF9A5002 0000            (null) 00000001A1A8FA9A 00000000d8f90a5f
[2712515.516846] igb: T [0x0A7]    00000000FF9A5002 002382392B30008E 00000000FF27C508 0000            (null) 00000001A1A58679 00000000dfe795c5
[2712515.516847] igb: T [0x0A8]    0000000000001C14 0000003020200000 00000000FF4AC002 0000            (null) 00000001A1A9121A 00000000ef55f953
[2712515.516849] igb: T [0x0A9]    00000000FF4AC002 008942392B300225 00000000FF195A6A 0000            (null) 00000001A1A810A6 00000000fe6d6a0a
[2712515.516851] igb: T [0x0AA]    0000000000001C14 0000003020200000 00000000FF770202 0000            (null) 00000001A1A918A4 00000000893ac143
[2712515.516853] igb: T [0x0AB]    00000000FF770202 002382392B30008E 00000000FF954508 0000            (null) 00000001A1A5E71D 00000000119a9a36
[2712515.516854] igb: T [0x0AC]    0000000000001C14 0000003020200000 00000000FF824202 0000            (null) 00000001A1A92344 000000000dae7a2c
[2712515.516856] igb: T [0x0AD]    00000000FF824202 002382392B30008E 00000000FF67446A 0000            (null) 00000001A1A66A41 000000004aae1462
[2712515.516858] igb: T [0x0AE]    00000000FF66A340 001080392B300042 00000000FF66A340 0000            (null) 00000001A1A9275F 00000000a6fb5fe6
[2712515.516860] igb: T [0x0AF]    00000000FDF64F80 008DC0392B300237 00000000FDF64F80 0000            (null) 00000001A1A927C5 000000006b88a84c
[2712515.516861] igb: T [0x0B0]    0000000000001C14 0000003020200000 00000000FF2F0C02 0000            (null) 00000001A1A9380B 000000007fc42ea3
[2712515.516863] igb: T [0x0B1]    00000000FF2F0C02 002382392B30008E 00000000FF808508 0000            (null) 00000001A1A5EB8F 0000000058a07574
[2712515.516865] igb: T [0x0B2]    0000000000001C14 0000003020200000 00000000FDB90402 0000            (null) 00000001A1A957CA 0000000082bcdca0
[2712515.516866] igb: T [0x0B3]    00000000FDB90402 002382392B30008E 00000000FF14806A 0000            (null) 00000001A1A5EB90 0000000067c947fc
[2712515.516868] igb: T [0x0B4]    0000000000001C14 0000003020200000 00000000FF930402 0000            (null) 00000001A1A96EE7 00000000cf797b90
[2712515.516870] igb: T [0x0B5]    00000000FF930402 008502392B300214 00000000FF838E6A 0000            (null) 00000001A1A6C7B9 0000000050cb4c08
[2712515.516872] igb: T [0x0B6]    0000000000001C14 0000003020200000 00000000FF397802 0000            (null) 00000001A1A96EF0 0000000027fb2c4f
[2712515.516873] igb: T [0x0B7]    00000000FF397802 008502392B300214 00000000FDB9886A 0000            (null) 00000001A1A82631 00000000686633bc
[2712515.516875] igb: T [0x0B8]    0000000000001C14 0000003020200000 00000000FFA18002 0000            (null) 00000001A1A9740F 000000000530e769
[2712515.516877] igb: T [0x0B9]    00000000FFA18002 002382392B30008E 00000000FEDB2508 0000            (null) 00000001A1A58B39 0000000039854cc7
[2712515.516878] igb: T [0x0BA]    00000000FF397200 001080392B300042 00000000FF397200 0000            (null) 00000001A1A97606 000000004b9eeae6
[2712515.516880] igb: T [0x0BB]    00000000FF4B7AC0 008DC0392B300237 00000000FF4B7AC0 0000            (null) 00000001A1A9766B 00000000e6c8a55f
[2712515.516882] igb: T [0x0BC]    0000000000001C14 0000003020200000 00000000FFFB6802 0000            (null) 00000001A1A9777C 00000000bf61aa84
[2712515.516884] igb: T [0x0BD]    00000000FFFB6802 008942392B300225 00000000FD533508 0000            (null) 00000001A1A5EB92 00000000f368d6dd
[2712515.516885] igb: T [0x0BE]    0000000000001C14 0000003020200000 00000000FEDD0402 0000            (null) 00000001A1A978CA 00000000935114b8
[2712515.516887] igb: T [0x0BF]    00000000FEDD0402 002382392B30008E 00000000FF86305E 0000            (null) 00000001A1A5EC0D 0000000070849254
[2712515.516889] igb: T [0x0C0]    0000000000001C14 0000003020200000 00000000FF7D0802 0000            (null) 00000001A1A982D2 0000000081d31513
[2712515.516891] igb: T [0x0C1]    00000000FF7D0802 007142392B3001C5 00000000FFB67E6A 0000            (null) 00000001A1A5EC0E 00000000a805416c
[2712515.516892] igb: T [0x0C2]    00000000FFA6FE00 001280392B30004A 00000000FFA6FE00 0000            (null) 00000001A1A9869D 00000000155f4bc3
[2712515.516894] igb: T [0x0C3]    00000000FF03BC40 000F00392B30003C 00000000FF03BC40 0000            (null) 00000001A1A986A1 0000000009dd8b65
[2712515.516896] igb: T [0x0C4]    00000000FFAFDA40 001F00392B30007C 00000000FFAFDA40 0000            (null) 00000001A1A986A1 00000000257124fe
[2712515.516898] igb: T [0x0C5]    00000000FF5BC780 004EC0392B30013B 00000000FF5BC780 0000            (null) 00000001A1A986A4 0000000034eac6af
[2712515.516899] igb: T [0x0C6]    00000000FF5BC5C0 000F00392B30003C 00000000FF5BC5C0 0000            (null) 00000001A1A986B5 0000000090d05c4d
[2712515.516901] igb: T [0x0C7]    00000000FFAFD3C0 001F00392B30007C 00000000FFAFD3C0 0000            (null) 00000001A1A986B5 00000000cf6bde43
[2712515.516903] igb: T [0x0C8]    00000000FFAFD100 004EC0392B30013B 00000000FFAFD100 0000            (null) 00000001A1A986E0 0000000029c76f77
[2712515.516905] igb: T [0x0C9]    00000000FF5BCE80 003680392B3000DA 00000000FF5BCE80 0000            (null) 00000001A1A986E4 0000000084fd213e
[2712515.516906] igb: T [0x0CA]    00000000FFA8F200 001700392B30005C 00000000FFA8F200 0000            (null) 00000001A1A986EA 000000001b9f0a97
[2712515.516908] igb: T [0x0CB]    00000000FFA8FC40 002200392B300088 00000000FFA8FC40 0000            (null) 00000001A1A986EE 0000000029c76f77
[2712515.516910] igb: T [0x0CC]    00000000FDC92F40 004C80392B300132 00000000FDC92F40 0000            (null) 00000001A1A986F3 000000006d2ddacd
[2712515.516912] igb: T [0x0CD]    00000000FF44E8C0 013E00392B3004F8 00000000FF44E8C0 0000            (null) 00000001A1A9871E 000000006c507e47
[2712515.516913] igb: T [0x0CE]    00000000FF89A840 000F00392B30003C 00000000FF89A840 0000            (null) 00000001A1A9875F 00000000391c4144
[2712515.516915] igb: T [0x0CF]    00000000FF451640 001C80392B300072 00000000FF451640 0000            (null) 00000001A1A9875F 000000007307cff9
[2712515.516917] igb: T [0x0D0]    00000000FF07A340 005F40392B30017D 00000000FF07A340 0000            (null) 00000001A1A98763 000000003eb7e39b
[2712515.516919] igb: T [0x0D1]    00000000FF16A140 0012C0392B30004B 00000000FF16A140 0000            (null) 00000001A1A98768 0000000028795e78
[2712515.516920] igb: T [0x0D2]    00000000FD6B7E40 005680392B30015A 00000000FD6B7E40 0000            (null) 00000001A1A9876B 000000003be88728
[2712515.516922] igb: T [0x0D3]    00000000FF9BAAC0 007540392B3001D5 00000000FF9BAAC0 0000            (null) 00000001A1A98770 00000000dbc8a08d
[2712515.516924] igb: T [0x0D4]    00000000FF5EC740 007B00392B3001EC 00000000FF5EC740 0000            (null) 00000001A1A98776 000000003ab09c5b
[2712515.516926] igb: T [0x0D5]    00000000FF02F400 006900392B3001A4 00000000FF02F400 0000            (null) 00000001A1A9877B 0000000053817a43
[2712515.516927] igb: T [0x0D6]    00000000FD45B0C0 006300392B30018C 00000000FD45B0C0 0000            (null) 00000001A1A98780 00000000d5b97ea3
[2712515.516929] igb: T [0x0D7]    00000000FDC38FC0 001680392B30005A 00000000FDC38FC0 0000            (null) 00000001A1A98785 00000000686633bc
[2712515.516931] igb: T [0x0D8]    00000000FF71CDC0 0010C0392B300043 00000000FF71CDC0 0000            (null) 00000001A1A98789 00000000b9702733
[2712515.516933] igb: T [0x0D9]    00000000FF930AC0 005200392B300148 00000000FF930AC0 0000            (null) 00000001A1A9878D 000000005f116580
[2712515.516934] igb: T [0x0DA]    00000000FF930840 003980392B3000E6 00000000FF930840 0000            (null) 00000001A1A98792 000000001c484eb4
[2712515.516936] igb: T [0x0DB]    00000000FF71C5C0 003600392B3000D8 00000000FF71C5C0 0000            (null) 00000001A1A987AC 00000000cac9f00b
[2712515.516938] igb: T [0x0DC]    00000000FD7DB280 006040392B300181 00000000FD7DB280 0000            (null) 00000001A1A987B0 0000000091fceb07
[2712515.516940] igb: T [0x0DD]    00000000FF81E080 0012C0392B30004B 00000000FF81E080 0000            (null) 00000001A1A987B5 00000000cf964981
[2712515.516941] igb: T [0x0DE]    00000000FFFE2D00 008040392B300201 00000000FFFE2D00 0000            (null) 00000001A1A987B9 0000000032141d6c
[2712515.516943] igb: T [0x0DF]    00000000FFDD7A00 005B00392B30016C 00000000FFDD7A00 0000            (null) 00000001A1A987BE 0000000058f2e106
[2712515.516945] igb: T [0x0E0]    00000000FD6A4F40 008040392B300201 00000000FD6A4F40 0000            (null) 00000001A1A987C3 00000000ed09cbc8
[2712515.516947] igb: T [0x0E1]    00000000FF5EA800 016680392B30059A 00000000FF5EA800 0000            (null) 00000001A1A987C9 00000000dab483ed
[2712515.516949] igb: T [0x0E2]    00000000FF1650C0 016680392B30059A 00000000FF1650C0 0000            (null) 00000001A1A987C9 000000002b409a25
[2712515.516950] igb: T [0x0E3]    00000000FF545980 016680392B30059A 00000000FF545980 0000            (null) 00000001A1A987C9 00000000a02e9b39
[2712515.516952] igb: T [0x0E4]    00000000FF4D6240 016680392B30059A 00000000FF4D6240 0000            (null) 00000001A1A987C9 0000000069a76a88
[2712515.516954] igb: T [0x0E5]    00000000FE992B00 016680392B30059A 00000000FE992B00 0000            (null) 00000001A1A987CA 000000007621f7a4
[2712515.516955] igb: T [0x0E6]    00000000FF183480 013C40392B3004F1 00000000FF183480 0000            (null) 00000001A1A987CA 000000006ac1a1de
[2712515.516957] igb: T [0x0E7]    00000000FE870D40 016680392B30059A 00000000FE870D40 0000            (null) 00000001A1A987CA 000000002b409a25
[2712515.516959] igb: T [0x0E8]    00000000FFB18600 016680392B30059A 00000000FFB18600 0000            (null) 00000001A1A987CA 00000000dab483ed
[2712515.516961] igb: T [0x0E9]    00000000FE1E8EC0 016680392B30059A 00000000FE1E8EC0 0000            (null) 00000001A1A987CA 00000000ed09cbc8
[2712515.516962] igb: T [0x0EA]    00000000FF30FA40 00B080392B3002C2 00000000FF30FA40 0000            (null) 00000001A1A987CE 00000000d0c42cf0
[2712515.516964] igb: T [0x0EB]    0000000000001C14 0000003020200800 00000000FFA8985E 0000            (null) 00000001A1A98F11 0000000075014509
[2712515.516966] igb: T [0x0EC]    00000000FFA8985E 001082392B300042 00000000FF176802 0000            (null) 00000001A1A87CFF 000000004939c2c6
[2712515.516967] igb: T [0x0ED]    0000000000001C14 0000003020200800 00000000FDF4266A 0000            (null) 00000001A1A98F11 00000000a09aec9b
[2712515.516969] igb: T [0x0EE]    00000000FDF4266A 000D82392B300036 00000000FEDC1002 0000            (null) 00000001A1A87D7C 000000001cdbc73a
[2712515.516971] igb: T [0x0EF]    0000000000001C14 0000003020200800 00000000FD40986A 0000            (null) 00000001A1A98F12 00000000753b9008
[2712515.516973] igb: T [0x0F0]    00000000FD40986A 017282392B3005CA 00000000FF36B402 0000            (null) 00000001A1A87DFA 000000006c32b685
[2712515.516974] igb: T [0x0F1]    0000000000001C14 0000003020200800 00000000FFF3A86A 0000            (null) 00000001A1A98F12 000000007fc42ea3
[2712515.516976] igb: T [0x0F2]    00000000FFF3A86A 01728231223000C2 00000000FD6C265E 0000            (null) 00000001A1A87EF5 00000000b4ce24f7
[2712515.516978] igb: T [0x0F3]    00000000FF808000 000000092B300508 00000000FF808000 0000            (null) 00000001A1A6C7F0 00000000a57a8e76
[2712515.516979] igb: T [0x0F4]    0000000000001C14 0000003020200800 00000000FD41FA6A 0000            (null) 00000001A1A98F12 0000000048fe6269
[2712515.516981] igb: T [0x0F5]    00000000FD41FA6A 00A6423122300036 00000000FF9FD508 0000            (null) 00000001A1A65F06 000000005b8a2895
[2712515.516983] igb: T [0x0F6]    00000000FFA0E508 000000092B300263 00000000FFA0E508 0000            (null) 00000001A1A87EF7 000000002d9a46e6
[2712515.516985] igb: T [0x0F7]    0000000000001C14 0000003020200800 00000000FF67266A 0000            (null) 00000001A1A98F12 00000000c3424b3f
[2712515.516987] igb: T [0x0F8]    00000000FF67266A 000D82392B300036 00000000FF033C6A 0000            (null) 00000001A1A87EF7 00000000791ff1da
[2712515.516988] igb: T [0x0F9]    00000000FF46F500 008040392B300201 00000000FF46F500 0000            (null) 00000001A1A991CD 00000000f3cc5ff4
[2712515.516994] igb: T [0x0FA]    00000000FF9EF340 000F00392B30003C 00000000FF9EF340 0000            (null) 00000001A1A991D2 000000004696d248
[2712515.516999] igb: T [0x0FB]    00000000FDAC4C00 016680392B30059A 00000000FDAC4C00 0000            (null) 00000001A1A991D5 000000008dcf5435
[2712515.517003] igb: T [0x0FC]    00000000FF9BA4C0 016680392B30059A 00000000FF9BA4C0 0000            (null) 00000001A1A991D5 00000000d30d37a9
[2712515.517008] igb: T [0x0FD]    00000000FD6DED80 016680392B30059A 00000000FD6DED80 0000            (null) 00000001A1A991D5 00000000d882203e
[2712515.517013] igb: T [0x0FE]    00000000FF9E3640 016680392B30059A 00000000FF9E3640 0000            (null) 00000001A1A991D5 00000000dc007caf
[2712515.517018] igb: T [0x0FF]    00000000FE4E0F00 016680392B30059A 00000000FE4E0F00 0000            (null) 00000001A1A991D5 00000000aa1a7e7b
[2712515.517022] igb 0000:08:00.0: RX Rings Summary
[2712515.517025] igb: Queue [NTU] [NTC]
[2712515.517029] igb:      0    86    87
[2712515.517033] igb:      1    A4    A5
[2712515.517035] igb:      2    69    6A
[2712515.517036] igb:      3    87    88
[2712515.517038] igb 0000:08:00.0 eth0: Reset adapter
[2712518.509262] igb 0000:08:00.0 eth0: igb: eth0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX

^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
  2018-08-31  9:00                     ` Marco Berizzi
@ 2018-09-01  2:01                       ` Alexander Duyck
  2018-09-03 10:09                         ` Marco Berizzi
  0 siblings, 1 reply; 15+ messages in thread
From: Alexander Duyck @ 2018-09-01  2:01 UTC (permalink / raw)
  To: intel-wired-lan

On Fri, Aug 31, 2018 at 2:00 AM Marco Berizzi <pupilla@libero.it> wrote:
>
> > Il 28 agosto 2018 alle 19.01 Alexander Duyck <alexander.duyck@gmail.com> ha scritto:
>
> > Okay, so this looks like a Tx hang of some sort where writeback is not
> > being triggered.
> >
> > What we may want do is turn up the level of information we are getting
> > out of the error. You can do that by running:
> > ethtool -s eth0 msglvl hw on tx_done on pktdata on
> >
> > That should cause us to dump the Tx descriptor rings and packet data
> > when we encounter one of these hangs. It is possible we are looking at
> > some sort of error in the way the data is being formatted on the
> > descriptor ring that is resulting int he device stopping on whatever
> > descriptor is at offset .
>
> Hello Alexander, everyone
>
> Here is the output:
>
> [2712507.323017] igb 0000:08:00.0: Detected Tx Unit Hang
>                    Tx Queue             <1>
>                    TDH                  <7c>
>                    TDT                  <7c>
>                    next_to_use          <7d>
>                    next_to_clean        <7c>
>                  buffer_info[next_to_clean]
>                    time_stamp           <1a1a98a00>
>                    next_to_watch        <00000000c658a9f5>
>                    jiffies              <1a1a98e00>
>                    desc.status          <a8010>

<snip>

> [2712515.514954] igb 0000:08:00.0: TX Rings Summary
> [2712515.514954] igb: Queue [NTU] [NTC] [bi(ntc)->dma  ] leng ntw timestamp
> [2712515.514957] igb:      0    E7    E7 00000000FF71E7C0 0000           (null) 00000001A1A8B476
> [2712515.514959] igb:      1    7D    7C 00000000FF6E6C02 002A 00000000c658a9f5 00000001A1A98A00
> [2712515.514961] igb:      2    3C    3C 00000000FF375D40 0000           (null) 00000001A1A951B0
> [2712515.514962] igb:      3    15    15 00000000FF709040 0000           (null) 00000001A1A6FB5E
> [2712515.514963] igb 0000:08:00.0: TX Rings Dump

<snip>

> [2712515.515457] igb: ------------------------------------
> [2712515.515458] igb: TX QUEUE INDEX = 1
> [2712515.515458] igb: ------------------------------------
> [2712515.515459] igb: T [desc]     [address 63:0  ] [PlPOCIStDDM Ln] [bi->dma       ] leng  ntw timestamp        bi->skb

<snip>

> [2712515.515677] igb: T [0x078]    00000000FEFCB000 0010C0192B300043 00000000FEFCB000 0000            (null) 00000001A1A98667 00000000c5ed1096
> [2712515.515679] igb: T [0x079]    00000000FD7DBE40 001000192B300040 00000000FD7DBE40 0000            (null) 00000001A1A98671 000000002e13a21e
> [2712515.515681] igb: T [0x07A]    00000000FF930C80 000F00192B30003C 00000000FF930C80 0000            (null) 00000001A1A98672 000000009976f72e
> [2712515.515682] igb: T [0x07B]    00000000FF71CAC0 000F00192B30003C 00000000FF71CAC0 0000            (null) 00000001A1A98675 000000000339ac31
> [2712515.515684] igb: T [0x07C]    00000000FF6E6C02 000A80102B30002A 00000000FF6E6C02 002A  00000000c658a9f5 00000001A1A98A00 00000000b1f60b47 NTC
> [2712515.515687] 00000000d7c2311d: b4 96 91 0e fd 1f 00 19 99 ab 0b 38 08 06 00 01  ...........8....
> [2712515.515687] 00000000922018be: 08 00 06 04 00 01 00 19 99 ab 0b 38 0a 51 6e 0f  ...........8.Qn.
> [2712515.515688] 00000000a423f9da: 00 00 00 00 00 00 0a 51 6e fe                    .......Qn.
> [2712515.515690] igb: T [0x07D]    0000000000001C14 0000001020200800 00000000FEFAB46A 0000            (null) 00000001A1A8883A 0000000047f33a64 NTU
> [2712515.515692] igb: T [0x07E]    00000000FEFAB46A 00AA821122300036 00000000FF542D00 0000            (null) 00000001A1A83F2A 00000000b9702733
> [2712515.515694] igb: T [0x07F]    00000000FF1EC508 000000092B300274 00000000FF1EC508 0000            (null) 00000001A1A83F2E 00000000bd02a543

Okay so looking over the data everything here is correct except for
the fact that NTU and the tail register values don't match. The only
way that should be able to happen is if the xmit_more hint is set on
the packet, which unfortunately we don't dump.

However with that being said it does occur to me that you mentioned
using VirtualBox. I dug back through the dmesg output and found the
line:
[   20.944982] VBoxNetFlt: attached to 'eth0' / 00:19:99:ab:0b:38

I think there may be an issue with the filter stripping out packets at
the end of a queue and as a result we are receiving packets with
xmit_more set and not updating tail. At least that is my understanding
of things for now as I am not that familiar with the VBoxNetFlt
driver.

There are two ways to verify if this is the case. The first and more
correct solution might be to look at updating
vboxNetFltLinuxStartXmitFilter so that it will clear the xmit_more bit
before handing it off to the lower device. If you don't have access to
that an alternative would be to just modify the igb driver you have so
that you replace "skb->xmit_more" with "true" and just force the tail
to always be written out. It will cause a small performance hit but it
will work around the issue in the driver that overwrote our network
device ops.

Hope that helps.

- Alex

^ permalink raw reply	[flat|nested] 15+ messages in thread

* [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17]
  2018-09-01  2:01                       ` Alexander Duyck
@ 2018-09-03 10:09                         ` Marco Berizzi
  0 siblings, 0 replies; 15+ messages in thread
From: Marco Berizzi @ 2018-09-03 10:09 UTC (permalink / raw)
  To: intel-wired-lan

> Il 1 settembre 2018 alle 4.01 Alexander Duyck <alexander.duyck@gmail.com> ha scritto:

> However with that being said it does occur to me that you mentioned
> using VirtualBox. I dug back through the dmesg output and found the
> line:
> [   20.944982] VBoxNetFlt: attached to 'eth0' / 00:19:99:ab:0b:38
> 
> I think there may be an issue with the filter stripping out packets at
> the end of a queue and as a result we are receiving packets with
> xmit_more set and not updating tail. At least that is my understanding
> of things for now as I am not that familiar with the VBoxNetFlt
> driver.
> 
> There are two ways to verify if this is the case. The first and more
> correct solution might be to look at updating
> vboxNetFltLinuxStartXmitFilter so that it will clear the xmit_more bit
> before handing it off to the lower device. If you don't have access to
> that an alternative would be to just modify the igb driver you have so
> that you replace "skb->xmit_more" with "true" and just force the tail
> to always be written out. It will cause a small performance hit but it
> will work around the issue in the driver that overwrote our network
> device ops.
> 
> Hope that helps.
> 
> - Alex

Thanks a lot Alexander for debugging this problem.
I'm confident the virtualbox people will take care
of this problem.

Thanks again for your prompt response.

^ permalink raw reply	[flat|nested] 15+ messages in thread

end of thread, other threads:[~2018-09-03 10:09 UTC | newest]

Thread overview: 15+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2018-06-05  8:12 [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.17 Marco Berizzi
2018-07-05 13:22 ` Marco Berizzi
2018-07-26 11:56   ` [Intel-wired-lan] igb Detected Tx Unit Hang after upgrade to 4.18-rc6 [was Re: igb Detected Tx Unit Hang after upgrade to 4.17] Marco Berizzi
2018-07-26 14:32     ` Alexander Duyck
2018-07-26 15:03       ` Marco Berizzi
2018-07-26 16:05         ` Alexander Duyck
2018-07-27  8:47           ` Marco Berizzi
2018-07-30 13:11             ` Marco Berizzi
2018-08-06 11:39               ` Marco Berizzi
2018-08-28 15:20                 ` Marco Berizzi
2018-08-28 17:01                   ` Alexander Duyck
2018-08-31  9:00                     ` Marco Berizzi
2018-09-01  2:01                       ` Alexander Duyck
2018-09-03 10:09                         ` Marco Berizzi
2018-08-28 18:07                   ` Wyborny, Carolyn

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.