linux-lvm.redhat.com archive mirror
 help / color / mirror / Atom feed
* [linux-lvm] LVM RAID: task mdX_raid1:221 blocked for more than 120 seconds
@ 2018-11-24 15:43 Cesare Leonardi
  0 siblings, 0 replies; 7+ messages in thread
From: Cesare Leonardi @ 2018-11-24 15:43 UTC (permalink / raw)
  To: linux-lvm

Hello, I'm writing here to have your opinion and possibly some advice 
about some Debian bugs related to LVM RAID that are still unresolved:
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=913119
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=913138
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=904822

Bug #913119 was filed by me, so I can personally provide some more 
information and do tests.

Premises related di Debian unstable:
* Debian's kernel is currently 4.18.20.
* From kernel 4.17~rc7 Debian enabled SCSI_MQ_DEFAULT and DM_MQ_DEFAULT.
* Debian's LVM userland is 2.02.176

The above reports shows blocked I/O with different type of LVM RAID and 
with #913119 I've succesfully workarounded passing the following kernel 
parameters:
scsi_mod.use_blk_mq=0 dm_mod.use_blk_mq=0

I've read that RHEL will default to enabling SCSI_MQ_DEFAULT and 
DM_MQ_DEFAULT and will use kernel 4.18. Maybe you have already 
encountered this bug and it's already resolved. Or there are patches 
pending.

What do you think? Should I file a bug in Red Hat bug tracker?

Please, keep me in CC as I'm not subscribed to the list.

Cesare.

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [linux-lvm] LVM RAID: task mdX_raid1:221 blocked for more than 120 seconds
  2018-11-26 11:40     ` Zdenek Kabelac
@ 2018-11-26 12:43       ` Cesare Leonardi
  0 siblings, 0 replies; 7+ messages in thread
From: Cesare Leonardi @ 2018-11-26 12:43 UTC (permalink / raw)
  To: Zdenek Kabelac; +Cc: linux-raid, LVM general discussion and development

[-- Attachment #1: Type: text/plain, Size: 1092 bytes --]

Il giorno lun 26 nov 2018 alle ore 12:40 Zdenek Kabelac
<zkabelac@redhat.com> ha scritto:
> So you should probably start first with running latest available kernel - 4.19.
>
> You also should collect 'dmesg' report

I've already the last Debian kernel (4.18.20). Kernel 4.19 is not packaged yet.
In #913119 there was a complete dmesg, that I've also attached here.

> Aren't you running out-of-memory ?

Not that I'm aware of. In the top bar I have an applet that shows cpu, ram
and swap usage and I've never noticed too high ram usage. I'll pay more
attention to that the next time I'll make a test.

> > I've not noticed any corruption due to these freeze but often they are very
> > long and very impacting. The only reliable workaround found was to reboot with:
> > scsi_mod.use_blk_mq=0 dm_mod.use_blk_mq=0
>
> I doubt this have anything in common with this.

That's surprising to me. I assure you that, until now, it's the only
thing that really resolved for me and that let me use Debian kernels
from 4.17 to 4.18.
I look forward to test 4.19 as soon as it will be available.

Cesare.

[-- Attachment #2: dmesg_2018-11-06.txt --]
[-- Type: text/plain, Size: 70131 bytes --]

[    0.000000] microcode: microcode updated early to revision 0x2e, date = 2018-04-10
[    0.000000] Linux version 4.18.0-2-amd64 (debian-kernel@lists.debian.org) (gcc version 7.3.0 (Debian 7.3.0-30)) #1 SMP Debian 4.18.10-2 (2018-11-02)
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-4.18.0-2-amd64 root=/dev/mapper/vg0-root ro quiet systemd.show_status=1 consoleblank=0 fsck.mode=force
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Enabled xstate features 0x3, context size is 576 bytes, using 'standard' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009bfff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009c000-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x000000001fffffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000020000000-0x00000000201fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000020200000-0x000000003fffffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000040000000-0x00000000401fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000040200000-0x00000000d5abdfff] usable
[    0.000000] BIOS-e820: [mem 0x00000000d5abe000-0x00000000d6064fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000d6065000-0x00000000d6074fff] ACPI data
[    0.000000] BIOS-e820: [mem 0x00000000d6075000-0x00000000d617dfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000d617e000-0x00000000d66f7fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000d66f8000-0x00000000d66f8fff] usable
[    0.000000] BIOS-e820: [mem 0x00000000d66f9000-0x00000000d673bfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x00000000d673c000-0x00000000d6ffffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000d7800000-0x00000000df9fffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000f8000000-0x00000000fbffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec00000-0x00000000fec00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed00000-0x00000000fed03fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed1ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000fee00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000021f5fffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 2.7 present.
[    0.000000] DMI:  /DH61CR, BIOS BEH6110H.86A.0120.2013.1112.1412 11/12/2013
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] last_pfn = 0x21f600 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF uncachable
[    0.000000]   C0000-D3FFF write-protect
[    0.000000]   D4000-E7FFF uncachable
[    0.000000]   E8000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 000000000 mask E00000000 write-back
[    0.000000]   1 base 200000000 mask FE0000000 write-back
[    0.000000]   2 base 0E0000000 mask FE0000000 uncachable
[    0.000000]   3 base 0D8000000 mask FF8000000 uncachable
[    0.000000]   4 base 0D7800000 mask FFF800000 uncachable
[    0.000000]   5 base 21F800000 mask FFF800000 uncachable
[    0.000000]   6 base 21F600000 mask FFFE00000 uncachable
[    0.000000]   7 disabled
[    0.000000]   8 disabled
[    0.000000]   9 disabled
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.000000] e820: update [mem 0xd7800000-0xffffffff] usable ==> reserved
[    0.000000] last_pfn = 0xd7000 max_arch_pfn = 0x400000000
[    0.000000] found SMP MP-table at [mem 0x000fd720-0x000fd72f] mapped at [(____ptrval____)]
[    0.000000] Base memory trampoline at [(____ptrval____)] 96000 size 24576
[    0.000000] reserving inaccessible SNB gfx pages
[    0.000000] BRK [0x1d4c4b000, 0x1d4c4bfff] PGTABLE
[    0.000000] BRK [0x1d4c4c000, 0x1d4c4cfff] PGTABLE
[    0.000000] BRK [0x1d4c4d000, 0x1d4c4dfff] PGTABLE
[    0.000000] BRK [0x1d4c4e000, 0x1d4c4efff] PGTABLE
[    0.000000] BRK [0x1d4c4f000, 0x1d4c4ffff] PGTABLE
[    0.000000] BRK [0x1d4c50000, 0x1d4c50fff] PGTABLE
[    0.000000] BRK [0x1d4c51000, 0x1d4c51fff] PGTABLE
[    0.000000] BRK [0x1d4c52000, 0x1d4c52fff] PGTABLE
[    0.000000] BRK [0x1d4c53000, 0x1d4c53fff] PGTABLE
[    0.000000] BRK [0x1d4c54000, 0x1d4c54fff] PGTABLE
[    0.000000] BRK [0x1d4c55000, 0x1d4c55fff] PGTABLE
[    0.000000] RAMDISK: [mem 0x34791000-0x363bffff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F0490 000024 (v02 INTEL )
[    0.000000] ACPI: XSDT 0x00000000D6069070 000064 (v01 INTEL  DH61CR   00000078 AMI  00010013)
[    0.000000] ACPI: FACP 0x00000000D6072CF8 00010C (v05 INTEL  DH61CR   00000078 AMI  00010013)
[    0.000000] ACPI: DSDT 0x00000000D6069168 009B8B (v02 INTEL  DH61CR   00000078 INTL 20051117)
[    0.000000] ACPI: FACS 0x00000000D617C080 000040
[    0.000000] ACPI: APIC 0x00000000D6072E08 000062 (v03 INTEL  DH61CR   00000078 AMI  00010013)
[    0.000000] ACPI: FPDT 0x00000000D6072E70 000044 (v01 INTEL  DH61CR   00000078 AMI  00010013)
[    0.000000] ACPI: MCFG 0x00000000D6072EB8 00003C (v01 INTEL  DH61CR   00000078 MSFT 00000097)
[    0.000000] ACPI: HPET 0x00000000D6072EF8 000038 (v01 INTEL  DH61CR   00000078 AMI. 00000005)
[    0.000000] ACPI: SSDT 0x00000000D6072F30 00036D (v01 INTEL  DH61CR   00000078 INTL 20091112)
[    0.000000] ACPI: SSDT 0x00000000D60732A0 00079A (v01 INTEL  DH61CR   00000078 INTL 20051117)
[    0.000000] ACPI: SSDT 0x00000000D6073A40 000A92 (v01 INTEL  DH61CR   00000078 INTL 20051117)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000021f5fffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x21f5f8000-0x21f5fcfff]
[    0.000000] tsc: Fast TSC calibration using PIT
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000021f5fffff]
[    0.000000]   Device   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009bfff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x000000001fffffff]
[    0.000000]   node   0: [mem 0x0000000020200000-0x000000003fffffff]
[    0.000000]   node   0: [mem 0x0000000040200000-0x00000000d5abdfff]
[    0.000000]   node   0: [mem 0x00000000d66f8000-0x00000000d66f8fff]
[    0.000000]   node   0: [mem 0x00000000d673c000-0x00000000d6ffffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x000000021f5fffff]
[    0.000000] Reserved but unavailable: 8418 pages
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000021f5fffff]
[    0.000000] On node 0 totalpages: 2053406
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 155 pages reserved
[    0.000000]   DMA zone: 3995 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 13631 pages used for memmap
[    0.000000]   DMA32 zone: 872323 pages, LIFO batch:31
[    0.000000]   Normal zone: 18392 pages used for memmap
[    0.000000]   Normal zone: 1177088 pages, LIFO batch:31
[    0.000000] Reserving Intel graphics memory at [mem 0xd7a00000-0xdf9fffff]
[    0.000000] ACPI: PM-Timer IO Port: 0x408
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 2, version 32, address 0xfec00000, GSI 0-23
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000
[    0.000000] smpboot: Allowing 2 CPUs, 0 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009c000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x20000000-0x201fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x40000000-0x401fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd5abe000-0xd6064fff]
[    0.000000] PM: Registered nosave memory: [mem 0xd6065000-0xd6074fff]
[    0.000000] PM: Registered nosave memory: [mem 0xd6075000-0xd617dfff]
[    0.000000] PM: Registered nosave memory: [mem 0xd617e000-0xd66f7fff]
[    0.000000] PM: Registered nosave memory: [mem 0xd66f9000-0xd673bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xd7000000-0xd77fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xd7800000-0xdf9fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xdfa00000-0xf7ffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xf8000000-0xfbffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfc000000-0xfebfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec00000-0xfec00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec01000-0xfecfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed00000-0xfed03fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed04000-0xfed1bfff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed1ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed20000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfee00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee01000-0xfeffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff]
[    0.000000] [mem 0xdfa00000-0xf7ffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.000000] random: get_random_bytes called from start_kernel+0x94/0x52e with crng_init=0
[    0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:2 nr_node_ids:1
[    0.000000] percpu: Embedded 44 pages/cpu @(____ptrval____) s142744 r8192 d29288 u1048576
[    0.000000] pcpu-alloc: s142744 r8192 d29288 u1048576 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 0 1 
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 2021164
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-4.18.0-2-amd64 root=/dev/mapper/vg0-root ro quiet systemd.show_status=1 consoleblank=0 fsck.mode=force
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 7965836K/8213624K available (10252K kernel code, 1223K rwdata, 3260K rodata, 1548K init, 656K bss, 247788K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=2, Nodes=1
[    0.000000] Kernel/User page tables isolation: enabled
[    0.000000] ftrace: allocating 31267 entries in 123 pages
[    0.000000] Hierarchical RCU implementation.
[    0.000000] 	RCU restricting CPUs from NR_CPUS=512 to nr_cpu_ids=2.
[    0.000000] RCU: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=2
[    0.000000] NR_IRQS: 33024, nr_irqs: 440, preallocated irqs: 16
[    0.000000] Console: colour VGA+ 80x25
[    0.000000] console [tty0] enabled
[    0.000000] ACPI: Core revision 20180531
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns
[    0.000000] hpet clockevent registered
[    0.000000] APIC: Switch to symmetric I/O mode setup
[    0.000000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.020000] tsc: Fast TSC calibration using PIT
[    0.024000] tsc: Detected 2294.608 MHz processor
[    0.024000] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x21134f58f0d, max_idle_ns: 440795217993 ns
[    0.024000] Calibrating delay loop (skipped), value calculated using timer frequency.. 4589.21 BogoMIPS (lpj=9178432)
[    0.024000] pid_max: default: 32768 minimum: 301
[    0.024000] Security Framework initialized
[    0.024000] Yama: disabled by default; enable with sysctl kernel.yama.*
[    0.024000] AppArmor: AppArmor initialized
[    0.024000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[    0.024000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.024000] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.024000] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.024000] ENERGY_PERF_BIAS: Set to 'normal', was 'performance'
[    0.024000] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8)
[    0.024000] mce: CPU supports 7 MCE banks
[    0.024000] CPU0: Thermal monitoring enabled (TM1)
[    0.024000] process: using mwait in idle threads
[    0.024000] Last level iTLB entries: 4KB 512, 2MB 8, 4MB 8
[    0.024000] Last level dTLB entries: 4KB 512, 2MB 32, 4MB 32, 1GB 0
[    0.024000] Spectre V2 : Mitigation: Full generic retpoline
[    0.024000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.024000] Spectre V2 : Spectre v2 mitigation: Enabling Indirect Branch Prediction Barrier
[    0.024000] Spectre V2 : Enabling Restricted Speculation for firmware calls
[    0.024000] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.024000] Freeing SMP alternatives memory: 24K
[    0.024000] TSC deadline timer enabled
[    0.024000] smpboot: CPU0: Intel(R) Pentium(R) CPU G630T @ 2.30GHz (family: 0x6, model: 0x2a, stepping: 0x7)
[    0.024000] Performance Events: PEBS fmt1+, SandyBridge events, 16-deep LBR, full-width counters, Intel PMU driver.
[    0.024000] ... version:                3
[    0.024000] ... bit width:              48
[    0.024000] ... generic registers:      8
[    0.024000] ... value mask:             0000ffffffffffff
[    0.024000] ... max period:             00007fffffffffff
[    0.024000] ... fixed-purpose events:   3
[    0.024000] ... event mask:             00000007000000ff
[    0.024000] Hierarchical SRCU implementation.
[    0.024000] smp: Bringing up secondary CPUs ...
[    0.024000] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[    0.024000] x86: Booting SMP configuration:
[    0.024000] .... node  #0, CPUs:      #1
[    0.028070] smp: Brought up 1 node, 2 CPUs
[    0.028070] smpboot: Max logical packages: 1
[    0.028070] smpboot: Total of 2 processors activated (9178.43 BogoMIPS)
[    0.029565] devtmpfs: initialized
[    0.029565] x86/mm: Memory block size: 128MB
[    0.029565] PM: Registering ACPI NVS region [mem 0xd6075000-0xd617dfff] (1085440 bytes)
[    0.029565] PM: Registering ACPI NVS region [mem 0xd66f9000-0xd673bfff] (274432 bytes)
[    0.029565] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.029565] futex hash table entries: 512 (order: 3, 32768 bytes)
[    0.029565] pinctrl core: initialized pinctrl subsystem
[    0.029565] NET: Registered protocol family 16
[    0.029565] audit: initializing netlink subsys (disabled)
[    0.029565] audit: type=2000 audit(1541399120.028:1): state=initialized audit_enabled=0 res=1
[    0.029565] cpuidle: using governor ladder
[    0.029565] cpuidle: using governor menu
[    0.029565] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it
[    0.029565] ACPI: bus type PCI registered
[    0.029565] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.029565] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xf8000000-0xfbffffff] (base 0xf8000000)
[    0.029565] PCI: MMCONFIG at [mem 0xf8000000-0xfbffffff] reserved in E820
[    0.029565] pmd_set_huge: Cannot satisfy [mem 0xf8000000-0xf8200000] with a huge-page mapping due to MTRR override.
[    0.029565] PCI: Using configuration type 1 for base access
[    0.029565] core: PMU erratum BJ122, BV98, HSD29 workaround disabled, HT off
[    0.032363] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.032363] ACPI: Added _OSI(Module Device)
[    0.032363] ACPI: Added _OSI(Processor Device)
[    0.032363] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.032363] ACPI: Added _OSI(Processor Aggregator Device)
[    0.032363] ACPI: Added _OSI(Linux-Dell-Video)
[    0.038389] ACPI: 4 ACPI AML tables successfully acquired and loaded
[    0.041090] ACPI: Dynamic OEM Table Load:
[    0.041097] ACPI: SSDT 0xFFFF8A7116925000 00083B (v01 PmRef  Cpu0Cst  00003001 INTL 20051117)
[    0.041499] ACPI: Dynamic OEM Table Load:
[    0.041503] ACPI: SSDT 0xFFFF8A711543D400 000303 (v01 PmRef  ApIst    00003000 INTL 20051117)
[    0.041754] ACPI: Dynamic OEM Table Load:
[    0.041758] ACPI: SSDT 0xFFFF8A7115BA3E00 000119 (v01 PmRef  ApCst    00003000 INTL 20051117)
[    0.042398] ACPI: Interpreter enabled
[    0.042417] ACPI: (supports S0 S3 S4 S5)
[    0.042418] ACPI: Using IOAPIC for interrupt routing
[    0.042444] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.042710] ACPI: Enabled 14 GPEs in block 00 to 3F
[    0.050558] ACPI: Power Resource [FN00] (off)
[    0.050640] ACPI: Power Resource [FN01] (off)
[    0.050720] ACPI: Power Resource [FN02] (off)
[    0.050798] ACPI: Power Resource [FN03] (off)
[    0.050880] ACPI: Power Resource [FN04] (off)
[    0.051430] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-3e])
[    0.051435] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.052060] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug SHPCHotplug PME AER PCIeCapability LTR]
[    0.052062] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration
[    0.052552] PCI host bridge to bus 0000:00
[    0.052555] pci_bus 0000:00: root bus resource [io  0x0000-0x0cf7 window]
[    0.052556] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.052558] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.052559] pci_bus 0000:00: root bus resource [mem 0x000d4000-0x000d7fff window]
[    0.052561] pci_bus 0000:00: root bus resource [mem 0x000d8000-0x000dbfff window]
[    0.052562] pci_bus 0000:00: root bus resource [mem 0x000dc000-0x000dffff window]
[    0.052564] pci_bus 0000:00: root bus resource [mem 0x000e0000-0x000e3fff window]
[    0.052565] pci_bus 0000:00: root bus resource [mem 0x000e4000-0x000e7fff window]
[    0.052567] pci_bus 0000:00: root bus resource [mem 0xdfa00000-0xfeafffff window]
[    0.052569] pci_bus 0000:00: root bus resource [bus 00-3e]
[    0.052578] pci 0000:00:00.0: [8086:0100] type 00 class 0x060000
[    0.052688] pci 0000:00:01.0: [8086:0101] type 01 class 0x060400
[    0.052727] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold
[    0.052818] pci 0000:00:02.0: [8086:0102] type 00 class 0x030000
[    0.052829] pci 0000:00:02.0: reg 0x10: [mem 0xf7800000-0xf7bfffff 64bit]
[    0.052835] pci 0000:00:02.0: reg 0x18: [mem 0xe0000000-0xefffffff 64bit pref]
[    0.052839] pci 0000:00:02.0: reg 0x20: [io  0xf000-0xf03f]
[    0.052977] pci 0000:00:16.0: [8086:1c3a] type 00 class 0x078000
[    0.053004] pci 0000:00:16.0: reg 0x10: [mem 0xf7d2b000-0xf7d2b00f 64bit]
[    0.053082] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold
[    0.053179] pci 0000:00:19.0: [8086:1503] type 00 class 0x020000
[    0.053200] pci 0000:00:19.0: reg 0x10: [mem 0xf7d00000-0xf7d1ffff]
[    0.053209] pci 0000:00:19.0: reg 0x14: [mem 0xf7d29000-0xf7d29fff]
[    0.053218] pci 0000:00:19.0: reg 0x18: [io  0xf080-0xf09f]
[    0.053284] pci 0000:00:19.0: PME# supported from D0 D3hot D3cold
[    0.053381] pci 0000:00:1a.0: [8086:1c2d] type 00 class 0x0c0320
[    0.053404] pci 0000:00:1a.0: reg 0x10: [mem 0xf7d28000-0xf7d283ff]
[    0.053493] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold
[    0.053588] pci 0000:00:1b.0: [8086:1c20] type 00 class 0x040300
[    0.053612] pci 0000:00:1b.0: reg 0x10: [mem 0xf7d20000-0xf7d23fff 64bit]
[    0.053691] pci 0000:00:1b.0: PME# supported from D0 D3hot D3cold
[    0.053786] pci 0000:00:1c.0: [8086:1c10] type 01 class 0x060400
[    0.053877] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold
[    0.053986] pci 0000:00:1d.0: [8086:1c26] type 00 class 0x0c0320
[    0.054009] pci 0000:00:1d.0: reg 0x10: [mem 0xf7d27000-0xf7d273ff]
[    0.054098] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold
[    0.054194] pci 0000:00:1f.0: [8086:1c5c] type 00 class 0x060100
[    0.054392] pci 0000:00:1f.2: [8086:1c02] type 00 class 0x010601
[    0.054412] pci 0000:00:1f.2: reg 0x10: [io  0xf0d0-0xf0d7]
[    0.054421] pci 0000:00:1f.2: reg 0x14: [io  0xf0c0-0xf0c3]
[    0.054429] pci 0000:00:1f.2: reg 0x18: [io  0xf0b0-0xf0b7]
[    0.054437] pci 0000:00:1f.2: reg 0x1c: [io  0xf0a0-0xf0a3]
[    0.054446] pci 0000:00:1f.2: reg 0x20: [io  0xf060-0xf07f]
[    0.054454] pci 0000:00:1f.2: reg 0x24: [mem 0xf7d26000-0xf7d267ff]
[    0.054498] pci 0000:00:1f.2: PME# supported from D3hot
[    0.054586] pci 0000:00:1f.3: [8086:1c22] type 00 class 0x0c0500
[    0.054606] pci 0000:00:1f.3: reg 0x10: [mem 0xf7d25000-0xf7d250ff 64bit]
[    0.054628] pci 0000:00:1f.3: reg 0x20: [io  0xf040-0xf05f]
[    0.054771] pci 0000:01:00.0: [1b4b:9215] type 00 class 0x010601
[    0.054785] pci 0000:01:00.0: reg 0x10: [io  0xe050-0xe057]
[    0.054791] pci 0000:01:00.0: reg 0x14: [io  0xe040-0xe043]
[    0.054798] pci 0000:01:00.0: reg 0x18: [io  0xe030-0xe037]
[    0.054805] pci 0000:01:00.0: reg 0x1c: [io  0xe020-0xe023]
[    0.054811] pci 0000:01:00.0: reg 0x20: [io  0xe000-0xe01f]
[    0.054818] pci 0000:01:00.0: reg 0x24: [mem 0xf7c10000-0xf7c107ff]
[    0.054825] pci 0000:01:00.0: reg 0x30: [mem 0xf7c00000-0xf7c0ffff pref]
[    0.054865] pci 0000:01:00.0: PME# supported from D3hot
[    0.054925] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.054927] pci 0000:00:01.0:   bridge window [io  0xe000-0xefff]
[    0.054930] pci 0000:00:01.0:   bridge window [mem 0xf7c00000-0xf7cfffff]
[    0.055016] pci 0000:02:00.0: [1283:8892] type 01 class 0x060401
[    0.055229] pci 0000:02:00.0: supports D1 D2
[    0.055231] pci 0000:02:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.055305] pci 0000:00:1c.0: PCI bridge to [bus 02-03]
[    0.055376] pci_bus 0000:03: extended config space not accessible
[    0.055493] pci 0000:02:00.0: PCI bridge to [bus 03] (subtractive decode)
[    0.056246] ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 10 *11 12 14 15)
[    0.056300] ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 10 11 12 14 15) *0, disabled.
[    0.056353] ACPI: PCI Interrupt Link [LNKC] (IRQs *3 4 5 6 10 11 12 14 15)
[    0.056405] ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 5 6 *10 11 12 14 15)
[    0.056457] ACPI: PCI Interrupt Link [LNKE] (IRQs *3 4 5 6 10 11 12 14 15)
[    0.056511] ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 5 6 10 11 12 14 15) *0, disabled.
[    0.056564] ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 10 *11 12 14 15)
[    0.056616] ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 6 *10 11 12 14 15)
[    0.056937] pci 0000:00:02.0: vgaarb: setting as boot VGA device
[    0.056937] pci 0000:00:02.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.056937] pci 0000:00:02.0: vgaarb: bridge control possible
[    0.056937] vgaarb: loaded
[    0.056937] pps_core: LinuxPPS API ver. 1 registered
[    0.056937] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.056937] PTP clock support registered
[    0.056937] EDAC MC: Ver: 3.0.0
[    0.056937] PCI: Using ACPI for IRQ routing
[    0.057640] PCI: pci_cache_line_size set to 64 bytes
[    0.057690] e820: reserve RAM buffer [mem 0x0009c000-0x0009ffff]
[    0.057692] e820: reserve RAM buffer [mem 0xd5abe000-0xd7ffffff]
[    0.057693] e820: reserve RAM buffer [mem 0xd66f9000-0xd7ffffff]
[    0.057694] e820: reserve RAM buffer [mem 0xd7000000-0xd7ffffff]
[    0.057696] e820: reserve RAM buffer [mem 0x21f600000-0x21fffffff]
[    0.057800] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0
[    0.057800] hpet0: 8 comparators, 64-bit 14.318180 MHz counter
[    0.061027] clocksource: Switched to clocksource tsc-early
[    0.070223] VFS: Disk quotas dquot_6.6.0
[    0.070241] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.070350] AppArmor: AppArmor Filesystem Enabled
[    0.070370] pnp: PnP ACPI init
[    0.070491] system 00:00: [mem 0xfed40000-0xfed44fff] has been reserved
[    0.070497] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.070584] system 00:01: [io  0x0680-0x069f] has been reserved
[    0.070586] system 00:01: [io  0x1000-0x100f] has been reserved
[    0.070588] system 00:01: [io  0xffff] has been reserved
[    0.070590] system 00:01: [io  0xffff] has been reserved
[    0.070592] system 00:01: [io  0x0400-0x0453] has been reserved
[    0.070594] system 00:01: [io  0x0458-0x047f] has been reserved
[    0.070595] system 00:01: [io  0x0500-0x057f] has been reserved
[    0.070597] system 00:01: [io  0x164e-0x164f] has been reserved
[    0.070601] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.070629] pnp 00:02: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.070677] system 00:03: [io  0x0454-0x0457] has been reserved
[    0.070681] system 00:03: Plug and Play ACPI device, IDs INT3f0d PNP0c02 (active)
[    0.070857] system 00:04: [io  0x0290-0x029f] has been reserved
[    0.070859] system 00:04: [io  0x0778-0x077f] has been reserved
[    0.070863] system 00:04: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.071181] pnp 00:05: [dma 0 disabled]
[    0.071236] pnp 00:05: Plug and Play ACPI device, IDs PNP0501 (active)
[    0.071503] pnp 00:06: [dma 3]
[    0.071617] pnp 00:06: Plug and Play ACPI device, IDs PNP0400 (active)
[    0.071718] system 00:07: [io  0x04d0-0x04d1] has been reserved
[    0.071723] system 00:07: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.071928] system 00:08: [mem 0xfed1c000-0xfed1ffff] has been reserved
[    0.071930] system 00:08: [mem 0xfed10000-0xfed17fff] has been reserved
[    0.071932] system 00:08: [mem 0xfed18000-0xfed18fff] has been reserved
[    0.071934] system 00:08: [mem 0xfed19000-0xfed19fff] has been reserved
[    0.071936] system 00:08: [mem 0xf8000000-0xfbffffff] has been reserved
[    0.071938] system 00:08: [mem 0xfed20000-0xfed3ffff] has been reserved
[    0.071940] system 00:08: [mem 0xfed90000-0xfed93fff] has been reserved
[    0.071941] system 00:08: [mem 0xfed45000-0xfed8ffff] has been reserved
[    0.071943] system 00:08: [mem 0xff000000-0xffffffff] has been reserved
[    0.071945] system 00:08: [mem 0xfee00000-0xfeefffff] could not be reserved
[    0.071947] system 00:08: [mem 0xdfa00000-0xdfa00fff] has been reserved
[    0.071952] system 00:08: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.072117] system 00:09: [mem 0x20000000-0x201fffff] has been reserved
[    0.072119] system 00:09: [mem 0x40000000-0x401fffff] has been reserved
[    0.072123] system 00:09: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.072143] pnp: PnP ACPI: found 10 devices
[    0.078015] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.078055] pci 0000:00:01.0: PCI bridge to [bus 01]
[    0.078058] pci 0000:00:01.0:   bridge window [io  0xe000-0xefff]
[    0.078061] pci 0000:00:01.0:   bridge window [mem 0xf7c00000-0xf7cfffff]
[    0.078066] pci 0000:02:00.0: PCI bridge to [bus 03]
[    0.078094] pci 0000:00:1c.0: PCI bridge to [bus 02-03]
[    0.078106] pci_bus 0000:00: resource 4 [io  0x0000-0x0cf7 window]
[    0.078108] pci_bus 0000:00: resource 5 [io  0x0d00-0xffff window]
[    0.078110] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window]
[    0.078111] pci_bus 0000:00: resource 7 [mem 0x000d4000-0x000d7fff window]
[    0.078113] pci_bus 0000:00: resource 8 [mem 0x000d8000-0x000dbfff window]
[    0.078114] pci_bus 0000:00: resource 9 [mem 0x000dc000-0x000dffff window]
[    0.078116] pci_bus 0000:00: resource 10 [mem 0x000e0000-0x000e3fff window]
[    0.078117] pci_bus 0000:00: resource 11 [mem 0x000e4000-0x000e7fff window]
[    0.078119] pci_bus 0000:00: resource 12 [mem 0xdfa00000-0xfeafffff window]
[    0.078121] pci_bus 0000:01: resource 0 [io  0xe000-0xefff]
[    0.078122] pci_bus 0000:01: resource 1 [mem 0xf7c00000-0xf7cfffff]
[    0.078221] NET: Registered protocol family 2
[    0.078365] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes)
[    0.078398] TCP established hash table entries: 65536 (order: 7, 524288 bytes)
[    0.078530] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.078674] TCP: Hash tables configured (established 65536 bind 65536)
[    0.078715] UDP hash table entries: 4096 (order: 5, 131072 bytes)
[    0.078743] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)
[    0.078800] NET: Registered protocol family 1
[    0.078831] pci 0000:00:02.0: BIOS left Intel GPU interrupts enabled; disabling
[    0.078847] pci 0000:00:02.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.100116] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x6b0 took 20754 usecs
[    0.124106] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x6b0 took 23413 usecs
[    0.124127] PCI: CLS mismatch (64 != 32), using 64 bytes
[    0.124176] Unpacking initramfs...
[    0.640331] Freeing initrd memory: 28860K
[    0.640414] PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
[    0.640417] software IO TLB [mem 0xd1abe000-0xd5abe000] (64MB) mapped at [(____ptrval____)-(____ptrval____)]
[    0.641059] Initialise system trusted keyrings
[    0.641113] workingset: timestamp_bits=40 max_order=21 bucket_order=0
[    0.642411] zbud: loaded
[    0.642677] pstore: using deflate compression
[    1.050315] Key type asymmetric registered
[    1.050317] Asymmetric key parser 'x509' registered
[    1.050360] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 248)
[    1.050385] io scheduler noop registered
[    1.050386] io scheduler deadline registered
[    1.050429] io scheduler cfq registered (default)
[    1.050430] io scheduler mq-deadline registered
[    1.050918] pcieport 0000:00:01.0: Signaling PME with IRQ 24
[    1.050941] pcieport 0000:00:1c.0: Signaling PME with IRQ 25
[    1.050968] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    1.050982] intel_idle: MWAIT substates: 0x1120
[    1.050983] intel_idle: v0.4.1 model 0x2A
[    1.051055] intel_idle: lapic_timer_reliable_states 0xffffffff
[    1.051246] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    1.071969] 00:05: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    1.072500] Linux agpgart interface v0.103
[    1.072543] AMD IOMMUv2 driver by Joerg Roedel <jroedel@suse.de>
[    1.072544] AMD IOMMUv2 functionality not available on this system
[    1.072721] i8042: PNP: No PS/2 controller found.
[    1.072770] mousedev: PS/2 mouse device common for all mice
[    1.072800] rtc_cmos 00:02: RTC can wake from S4
[    1.072945] rtc_cmos 00:02: registered as rtc0
[    1.072961] rtc_cmos 00:02: alarms up to one month, y3k, 242 bytes nvram, hpet irqs
[    1.072972] intel_pstate: Intel P-state driver initializing
[    1.073021] ledtrig-cpu: registered to indicate activity on CPUs
[    1.073608] NET: Registered protocol family 10
[    1.079253] Segment Routing with IPv6
[    1.079282] mip6: Mobile IPv6
[    1.079285] NET: Registered protocol family 17
[    1.079290] mpls_gso: MPLS GSO support
[    1.079490] microcode: sig=0x206a7, pf=0x2, revision=0x2e
[    1.079548] microcode: Microcode Update Driver: v2.2.
[    1.079562] sched_clock: Marking stable (1079540637, 0)->(1061002707, 18537930)
[    1.079773] registered taskstats version 1
[    1.079774] Loading compiled-in X.509 certificates
[    1.136225] Loaded X.509 cert 'secure-boot-test-key-lfaraone: 97c1b25cddf9873ca78a58f3d73bf727d2cf78ff'
[    1.136244] zswap: loaded using pool lzo/zbud
[    1.136333] AppArmor: AppArmor sha1 policy hashing enabled
[    1.136727] rtc_cmos 00:02: setting system clock to 2018-11-05 06:25:21 UTC (1541399121)
[    1.138602] Freeing unused kernel image memory: 1548K
[    1.156050] Write protecting the kernel read-only data: 16384k
[    1.156722] Freeing unused kernel image memory: 2028K
[    1.157003] Freeing unused kernel image memory: 836K
[    1.169504] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    1.169505] x86/mm: Checking user space page tables
[    1.179343] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    1.265678] SCSI subsystem initialized
[    1.270786] libata version 3.00 loaded.
[    1.272312] ahci 0000:00:1f.2: version 3.0
[    1.280184] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k
[    1.280185] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[    1.280395] e1000e 0000:00:19.0: Interrupt Throttling Rate (ints/sec) set to dynamic conservative mode
[    1.283048] ACPI: bus type USB registered
[    1.283072] usbcore: registered new interface driver usbfs
[    1.283081] usbcore: registered new interface driver hub
[    1.283101] usbcore: registered new device driver usb
[    1.284386] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.284562] ehci-pci: EHCI PCI platform driver
[    1.284686] ehci-pci 0000:00:1a.0: EHCI Host Controller
[    1.284693] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1
[    1.284706] ehci-pci 0000:00:1a.0: debug port 2
[    1.288597] ehci-pci 0000:00:1a.0: cache line size of 64 is not supported
[    1.290222] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt
[    1.291878] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 4 ports 3 Gbps 0x33 impl SATA mode
[    1.291881] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst 
[    1.296502] thermal LNXTHERM:00: registered as thermal_zone0
[    1.296504] ACPI: Thermal Zone [TZ00] (28 C)
[    1.296744] thermal LNXTHERM:01: registered as thermal_zone1
[    1.296745] ACPI: Thermal Zone [TZ01] (30 C)
[    1.299119] ehci-pci 0000:00:1a.0: irq 16, io mem 0xf7d28000
[    1.312016] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00
[    1.312105] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18
[    1.312107] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.312108] usb usb1: Product: EHCI Host Controller
[    1.312110] usb usb1: Manufacturer: Linux 4.18.0-2-amd64 ehci_hcd
[    1.312111] usb usb1: SerialNumber: 0000:00:1a.0
[    1.312240] hub 1-0:1.0: USB hub found
[    1.312249] hub 1-0:1.0: 2 ports detected
[    1.312572] ehci-pci 0000:00:1d.0: EHCI Host Controller
[    1.312578] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2
[    1.312591] ehci-pci 0000:00:1d.0: debug port 2
[    1.316493] ehci-pci 0000:00:1d.0: cache line size of 64 is not supported
[    1.316525] ehci-pci 0000:00:1d.0: irq 23, io mem 0xf7d27000
[    1.324768] scsi host0: ahci
[    1.324945] scsi host1: ahci
[    1.325056] scsi host2: ahci
[    1.325162] scsi host3: ahci
[    1.325265] scsi host4: ahci
[    1.325364] scsi host5: ahci
[    1.325430] ata1: SATA max UDMA/133 abar m2048@0xf7d26000 port 0xf7d26100 irq 26
[    1.325432] ata2: SATA max UDMA/133 abar m2048@0xf7d26000 port 0xf7d26180 irq 26
[    1.325433] ata3: DUMMY
[    1.325434] ata4: DUMMY
[    1.325437] ata5: SATA max UDMA/133 abar m2048@0xf7d26000 port 0xf7d26300 irq 26
[    1.325440] ata6: SATA max UDMA/133 abar m2048@0xf7d26000 port 0xf7d26380 irq 26
[    1.332049] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00
[    1.332429] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18
[    1.332432] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    1.332434] usb usb2: Product: EHCI Host Controller
[    1.332436] usb usb2: Manufacturer: Linux 4.18.0-2-amd64 ehci_hcd
[    1.332438] usb usb2: SerialNumber: 0000:00:1d.0
[    1.332704] hub 2-0:1.0: USB hub found
[    1.332717] hub 2-0:1.0: 2 ports detected
[    1.336047] ahci 0000:01:00.0: AHCI 0001.0000 32 slots 4 ports 6 Gbps 0xf impl SATA mode
[    1.336052] ahci 0000:01:00.0: flags: 64bit ncq sntf led only pmp fbs pio slum part sxs 
[    1.337056] scsi host6: ahci
[    1.337285] scsi host7: ahci
[    1.337457] scsi host8: ahci
[    1.337597] scsi host9: ahci
[    1.337678] ata7: SATA max UDMA/133 abar m2048@0xf7c10000 port 0xf7c10100 irq 28
[    1.337681] ata8: SATA max UDMA/133 abar m2048@0xf7c10000 port 0xf7c10180 irq 28
[    1.337683] ata9: SATA max UDMA/133 abar m2048@0xf7c10000 port 0xf7c10200 irq 28
[    1.337685] ata10: SATA max UDMA/133 abar m2048@0xf7c10000 port 0xf7c10280 irq 28
[    1.429010] e1000e 0000:00:19.0 0000:00:19.0 (uninitialized): registered PHC clock
[    1.557872] e1000e 0000:00:19.0 eth0: (PCI Express:2.5GT/s:Width x1) e8:40:f2:0b:c9:47
[    1.557874] e1000e 0000:00:19.0 eth0: Intel(R) PRO/1000 Network Connection
[    1.557955] e1000e 0000:00:19.0 eth0: MAC: 10, PHY: 11, PBA No: FFFFFF-0FF
[    1.560373] e1000e 0000:00:19.0 enp0s25: renamed from eth0
[    1.638486] ata5: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    1.638513] ata1: SATA link up 3.0 Gbps (SStatus 123 SControl 300)
[    1.638670] ata2: SATA link down (SStatus 0 SControl 300)
[    1.638692] ata6: SATA link up 1.5 Gbps (SStatus 113 SControl 300)
[    1.639491] ata1.00: ACPI cmd ef/10:06:00:00:00:00 (SET FEATURES) succeeded
[    1.639496] ata1.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out
[    1.639499] ata1.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out
[    1.640375] ata5.00: ACPI cmd ef/10:06:00:00:00:00 (SET FEATURES) succeeded
[    1.640379] ata5.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out
[    1.640383] ata5.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out
[    1.640495] ata1.00: ATA-9: ST2000DM001-1ER164, CC25, max UDMA/133
[    1.640498] ata1.00: 3907029168 sectors, multi 16: LBA48 NCQ (depth 32), AA
[    1.640568] ata6.00: ACPI cmd ef/10:06:00:00:00:00 (SET FEATURES) succeeded
[    1.640573] ata6.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out
[    1.640576] ata6.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out
[    1.640638] ata5.00: supports DRM functions and may not be fully accessible
[    1.641432] ata1.00: ACPI cmd ef/10:06:00:00:00:00 (SET FEATURES) succeeded
[    1.641436] ata1.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out
[    1.641439] ata1.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out
[    1.641529] ata5.00: disabling queued TRIM support
[    1.641532] ata5.00: ATA-9: Samsung SSD 850 EVO 500GB, EMT02B6Q, max UDMA/133
[    1.641535] ata5.00: 976773168 sectors, multi 1: LBA48 NCQ (depth 32), AA
[    1.641603] ata6.00: ATAPI: HL-DT-ST DVDRAM GH24NSC0, LK00, max UDMA/133
[    1.642093] ata1.00: configured for UDMA/133
[    1.642289] scsi 0:0:0:0: Direct-Access     ATA      ST2000DM001-1ER1 CC25 PQ: 0 ANSI: 5
[    1.643488] ata6.00: ACPI cmd ef/10:06:00:00:00:00 (SET FEATURES) succeeded
[    1.643492] ata6.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out
[    1.643495] ata6.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out
[    1.644474] sd 0:0:0:0: [sda] 3907029168 512-byte logical blocks: (2.00 TB/1.82 TiB)
[    1.644479] ata6.00: configured for UDMA/133
[    1.644480] sd 0:0:0:0: [sda] 4096-byte physical blocks
[    1.644489] sd 0:0:0:0: [sda] Write Protect is off
[    1.644498] sd 0:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    1.644511] sd 0:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    1.644922] ata5.00: ACPI cmd ef/10:06:00:00:00:00 (SET FEATURES) succeeded
[    1.644926] ata5.00: ACPI cmd f5/00:00:00:00:00:00 (SECURITY FREEZE LOCK) filtered out
[    1.644930] ata5.00: ACPI cmd b1/c1:00:00:00:00:00 (DEVICE CONFIGURATION OVERLAY) filtered out
[    1.645159] ata5.00: supports DRM functions and may not be fully accessible
[    1.645824] ata5.00: disabling queued TRIM support
[    1.646746] ata5.00: configured for UDMA/133
[    1.646880] scsi 4:0:0:0: Direct-Access     ATA      Samsung SSD 850  2B6Q PQ: 0 ANSI: 5
[    1.647121] sd 4:0:0:0: [sdb] 976773168 512-byte logical blocks: (500 GB/466 GiB)
[    1.647129] sd 4:0:0:0: [sdb] Write Protect is off
[    1.647131] sd 4:0:0:0: [sdb] Mode Sense: 00 3a 00 00
[    1.647143] sd 4:0:0:0: [sdb] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    1.648018] usb 1-1: new high-speed USB device number 2 using ehci-pci
[    1.648099] scsi 5:0:0:0: CD-ROM            HL-DT-ST DVDRAM GH24NSC0  LK00 PQ: 0 ANSI: 5
[    1.649285]  sdb: sdb1 sdb2 sdb3
[    1.649879] sd 4:0:0:0: [sdb] supports TCG Opal
[    1.649881] sd 4:0:0:0: [sdb] Attached SCSI disk
[    1.650496] ata8: SATA link down (SStatus 0 SControl 300)
[    1.650514] ata9: SATA link down (SStatus 0 SControl 300)
[    1.650539] ata7: SATA link down (SStatus 0 SControl 300)
[    1.660026] tsc: Refined TSC clocksource calibration: 2294.787 MHz
[    1.660032] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2113f8b171d, max_idle_ns: 440795241185 ns
[    1.660043] clocksource: Switched to clocksource tsc
[    1.668023] usb 2-1: new high-speed USB device number 2 using ehci-pci
[    1.693737]  sda: sda1
[    1.694054] sd 0:0:0:0: [sda] Attached SCSI disk
[    1.707018] sr 5:0:0:0: [sr0] scsi3-mmc drive: 48x/12x writer dvd-ram cd/rw xa/form2 cdda tray
[    1.707020] cdrom: Uniform CD-ROM driver Revision: 3.20
[    1.707343] sr 5:0:0:0: Attached scsi CD-ROM sr0
[    1.804485] usb 1-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[    1.804488] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    1.804876] hub 1-1:1.0: USB hub found
[    1.804936] hub 1-1:1.0: 4 ports detected
[    1.812048] ata10: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    1.813625] ata10.00: supports DRM functions and may not be fully accessible
[    1.814217] ata10.00: disabling queued TRIM support
[    1.814220] ata10.00: ATA-9: Samsung SSD 850 EVO 500GB, EMT02B6Q, max UDMA/133
[    1.814222] ata10.00: 976773168 sectors, multi 1: LBA48 NCQ (depth 32), AA
[    1.815212] ata10.00: supports DRM functions and may not be fully accessible
[    1.815735] ata10.00: disabling queued TRIM support
[    1.816496] ata10.00: configured for UDMA/133
[    1.816663] scsi 9:0:0:0: Direct-Access     ATA      Samsung SSD 850  2B6Q PQ: 0 ANSI: 5
[    1.816906] sd 9:0:0:0: [sdc] 976773168 512-byte logical blocks: (500 GB/466 GiB)
[    1.816915] sd 9:0:0:0: [sdc] Write Protect is off
[    1.816917] sd 9:0:0:0: [sdc] Mode Sense: 00 3a 00 00
[    1.816930] sd 9:0:0:0: [sdc] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    1.818365]  sdc: sdc1 sdc2 sdc3
[    1.818859] sd 9:0:0:0: [sdc] supports TCG Opal
[    1.818860] sd 9:0:0:0: [sdc] Attached SCSI removable disk
[    1.824314] usb 2-1: New USB device found, idVendor=8087, idProduct=0024, bcdDevice= 0.00
[    1.824316] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    1.825043] hub 2-1:1.0: USB hub found
[    1.825300] hub 2-1:1.0: 6 ports detected
[    1.825565] random: fast init done
[    2.020008] raid6: sse2x1   gen()  7041 MB/s
[    2.088004] raid6: sse2x1   xor()  4886 MB/s
[    2.156007] raid6: sse2x2   gen()  8195 MB/s
[    2.224005] raid6: sse2x2   xor()  5525 MB/s
[    2.292006] raid6: sse2x4   gen()  9751 MB/s
[    2.360007] raid6: sse2x4   xor()  6477 MB/s
[    2.360008] raid6: using algorithm sse2x4 gen() 9751 MB/s
[    2.360009] raid6: .... xor() 6477 MB/s, rmw enabled
[    2.360010] raid6: using ssse3x2 recovery algorithm
[    2.360338] xor: measuring software checksum speed
[    2.400005]    prefetch64-sse: 12202.000 MB/sec
[    2.440004]    generic_sse: 11256.000 MB/sec
[    2.440005] xor: using function: prefetch64-sse (12202.000 MB/sec)
[    2.440019] usb 1-1.3: new low-speed USB device number 3 using ehci-pci
[    2.440357] async_tx: api initialized (async)
[    2.456339] random: lvm: uninitialized urandom read (4 bytes read)
[    2.483220] device-mapper: uevent: version 1.0.3
[    2.483291] device-mapper: ioctl: 4.39.0-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[    2.490853] device-mapper: raid: Loading target version 1.13.2
[    2.492377] random: lvm: uninitialized urandom read (2 bytes read)
[    2.501049] md/raid1:mdX: active with 2 out of 2 mirrors
[    2.555452] usb 1-1.3: New USB device found, idVendor=045e, idProduct=0750, bcdDevice= 1.10
[    2.555455] usb 1-1.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    2.555458] usb 1-1.3: Product: Wired Keyboard 600
[    2.555459] usb 1-1.3: Manufacturer: Microsoft
[    2.574703] hidraw: raw HID events driver (C) Jiri Kosina
[    2.578870] Btrfs loaded, crc32c=crc32c-intel
[    2.583650] usbcore: registered new interface driver usbhid
[    2.583652] usbhid: USB HID core driver
[    2.585518] input: Microsoft Wired Keyboard 600 as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.3/1-1.3:1.0/0003:045E:0750.0001/input/input0
[    2.636036] usb 1-1.4: new low-speed USB device number 4 using ehci-pci
[    2.644222] microsoft 0003:045E:0750.0001: input,hidraw0: USB HID v1.11 Keyboard [Microsoft Wired Keyboard 600] on usb-0000:00:1a.0-1.3/input0
[    2.644652] input: Microsoft Wired Keyboard 600 as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.3/1-1.3:1.1/0003:045E:0750.0002/input/input1
[    2.708092] microsoft 0003:045E:0750.0002: input,hidraw1: USB HID v1.11 Device [Microsoft Wired Keyboard 600] on usb-0000:00:1a.0-1.3/input1
[    2.724490] BTRFS: device label backup devid 3 transid 34615 /dev/sda1
[    2.749472] usb 1-1.4: New USB device found, idVendor=045e, idProduct=0040, bcdDevice= 3.00
[    2.749475] usb 1-1.4: New USB device strings: Mfr=1, Product=3, SerialNumber=0
[    2.749478] usb 1-1.4: Product: Microsoft 3-Button Mouse with IntelliEye(TM)
[    2.749479] usb 1-1.4: Manufacturer: Microsoft
[    2.752457] input: Microsoft Microsoft 3-Button Mouse with IntelliEye(TM) as /devices/pci0000:00/0000:00:1a.0/usb1/1-1/1-1.4/1-1.4:1.0/0003:045E:0040.0003/input/input2
[    2.752528] hid-generic 0003:045E:0040.0003: input,hidraw2: USB HID v1.10 Mouse [Microsoft Microsoft 3-Button Mouse with IntelliEye(TM)] on usb-0000:00:1a.0-1.4/input0
[    2.753946] cryptd: max_cpu_qlen set to 1000
[    4.653739] EXT4-fs (dm-4): mounted filesystem with ordered data mode. Opts: (null)
[    4.792120] systemd[1]: systemd 239 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 +IDN -PCRE2 default-hierarchy=hybrid)
[    4.812167] systemd[1]: Detected architecture x86-64.
[    4.816480] systemd[1]: Set hostname to <barone>.
[    4.990089] random: systemd: uninitialized urandom read (16 bytes read)
[    4.990219] systemd[1]: Listening on Journal Socket (/dev/log).
[    4.990580] random: systemd: uninitialized urandom read (16 bytes read)
[    4.990631] systemd[1]: Listening on initctl Compatibility Named Pipe.
[    4.990969] random: systemd: uninitialized urandom read (16 bytes read)
[    4.991025] systemd[1]: Listening on Journal Audit Socket.
[    4.991311] systemd[1]: Reached target User and Group Name Lookups.
[    4.992161] systemd[1]: Created slice User and Session Slice.
[    4.992520] systemd[1]: Listening on udev Kernel Socket.
[    4.993768] systemd[1]: Listening on Syslog Socket.
[    5.066671] EXT4-fs (dm-4): re-mounted. Opts: errors=remount-ro
[    5.076193] lp: driver loaded but no devices found
[    5.092086] ppdev: user-space parallel port driver
[    5.093200] parport_pc 00:06: reported by Plug and Play ACPI
[    5.093274] parport0: PC-style at 0x378, irq 5 [PCSPP,TRISTATE,EPP]
[    5.188098] lp0: using parport0 (interrupt-driven).
[    5.193830] nct6775: Found NCT6775F or compatible chip at 0x2e:0xa00
[    5.368888] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input3
[    5.368907] ACPI: Power Button [PWRB]
[    5.368959] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input4
[    5.368968] ACPI: Power Button [PWRF]
[    5.429999] systemd-journald[324]: Received request to flush runtime journal from PID 1
[    5.517388] iTCO_vendor_support: vendor-support=0
[    5.518010] sd 0:0:0:0: Attached scsi generic sg0 type 0
[    5.519089] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11
[    5.519131] iTCO_wdt: Found a Cougar Point TCO device (Version=2, TCOBASE=0x0460)
[    5.520285] sd 4:0:0:0: Attached scsi generic sg1 type 0
[    5.520316] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0)
[    5.520450] sr 5:0:0:0: Attached scsi generic sg2 type 5
[    5.520488] sd 9:0:0:0: Attached scsi generic sg3 type 0
[    5.568674] random: crng init done
[    5.568677] random: 5 urandom warning(s) missed due to ratelimiting
[    5.574594] input: PC Speaker as /devices/platform/pcspkr/input/input5
[    5.670757] RAPL PMU: API unit is 2^-32 Joules, 3 fixed counters, 163840 ms ovfl timer
[    5.670758] RAPL PMU: hw unit of domain pp0-core 2^-16 Joules
[    5.670759] RAPL PMU: hw unit of domain package 2^-16 Joules
[    5.670760] RAPL PMU: hw unit of domain pp1-gpu 2^-16 Joules
[    5.705335] [drm] Replacing VGA console driver
[    5.705764] Console: switching to colour dummy device 80x25
[    5.724420] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
[    5.724422] [drm] Driver supports precise vblank timestamp query.
[    5.726377] i915 0000:00:02.0: vgaarb: changed VGA decodes: olddecodes=io+mem,decodes=io+mem:owns=io+mem
[    5.772974] [drm] Initialized i915 1.6.0 20180514 for 0000:00:02.0 on minor 0
[    5.773515] ACPI: Video Device [GFX0] (multi-head: yes  rom: no  post: no)
[    5.773696] input: Video Bus as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/LNXVIDEO:00/input/input6
[    5.774116] snd_hda_intel 0000:00:1b.0: bound 0000:00:02.0 (ops i915_audio_component_bind_ops [i915])
[    5.802153] intel_rapl: Found RAPL domain package
[    5.802155] intel_rapl: Found RAPL domain core
[    5.802156] intel_rapl: Found RAPL domain uncore
[    5.822369] snd_hda_codec_realtek hdaudioC0D0: autoconfig for ALC892: line_outs=1 (0x14/0x0/0x0/0x0/0x0) type:line
[    5.822372] snd_hda_codec_realtek hdaudioC0D0:    speaker_outs=1 (0x17/0x0/0x0/0x0/0x0)
[    5.822374] snd_hda_codec_realtek hdaudioC0D0:    hp_outs=1 (0x1b/0x0/0x0/0x0/0x0)
[    5.822376] snd_hda_codec_realtek hdaudioC0D0:    mono: mono_out=0x0
[    5.822377] snd_hda_codec_realtek hdaudioC0D0:    dig-out=0x11/0x0
[    5.822378] snd_hda_codec_realtek hdaudioC0D0:    inputs:
[    5.822381] snd_hda_codec_realtek hdaudioC0D0:      Front Mic=0x19
[    5.822382] snd_hda_codec_realtek hdaudioC0D0:      Rear Mic=0x18
[    5.822384] snd_hda_codec_realtek hdaudioC0D0:      Line=0x1a
[    5.874386] input: HDA Digital PCBeep as /devices/pci0000:00/0000:00:1b.0/sound/card0/input7
[    5.876865] input: HDA Intel PCH Front Mic as /devices/pci0000:00/0000:00:1b.0/sound/card0/input8
[    5.877208] input: HDA Intel PCH Rear Mic as /devices/pci0000:00/0000:00:1b.0/sound/card0/input9
[    5.877549] input: HDA Intel PCH Line as /devices/pci0000:00/0000:00:1b.0/sound/card0/input10
[    5.877683] input: HDA Intel PCH Line Out as /devices/pci0000:00/0000:00:1b.0/sound/card0/input11
[    5.878112] input: HDA Intel PCH Front Headphone as /devices/pci0000:00/0000:00:1b.0/sound/card0/input12
[    5.918549] fbcon: inteldrmfb (fb0) is primary device
[    5.975839] Console: switching to colour frame buffer device 240x67
[    5.997124] i915 0000:00:02.0: fb0: inteldrmfb frame buffer device
[    6.192440] BTRFS info (device sda1): enabling auto defrag
[    6.192444] BTRFS info (device sda1): use zlib compression, level 3
[    6.192446] BTRFS info (device sda1): disk space caching is enabled
[    6.192447] BTRFS info (device sda1): has skinny extents
[    6.234775] md/raid1:mdX: active with 2 out of 2 mirrors
[    6.292465] md/raid1:mdX: active with 2 out of 2 mirrors
[    6.356224] Adding 4194300k swap on /dev/mapper/vg0-swap0.  Priority:-2 extents:1 across:4194300k SSFS
[    7.182631] EXT4-fs (dm-9): mounted filesystem with ordered data mode. Opts: (null)
[    8.038071] IPv6: ADDRCONF(NETDEV_UP): enp0s25: link is not ready
[    8.308212] IPv6: ADDRCONF(NETDEV_UP): enp0s25: link is not ready
[   11.094070] e1000e: enp0s25 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: Rx
[   11.094111] IPv6: ADDRCONF(NETDEV_CHANGE): enp0s25: link becomes ready
[   11.268320] NET: Registered protocol family 15
[   11.348843] Initializing XFRM netlink socket
[   11.699741] nf_conntrack: default automatic helper assignment has been turned off for security reasons and CT-based  firewall rule not found. Use the iptables CT target to attach helpers instead.
[   28.118617] fuse init (API version 7.27)
[ 4839.612385] perf: interrupt took too long (2505 > 2500), lowering kernel.perf_event_max_sample_rate to 79750
[ 8043.454959] perf: interrupt took too long (3135 > 3131), lowering kernel.perf_event_max_sample_rate to 63750
[19930.540646] perf: interrupt took too long (3928 > 3918), lowering kernel.perf_event_max_sample_rate to 50750
[65588.677915] perf: interrupt took too long (4923 > 4910), lowering kernel.perf_event_max_sample_rate to 40500
[77211.909405] INFO: task mdX_raid1:225 blocked for more than 120 seconds.
[77211.909411]       Not tainted 4.18.0-2-amd64 #1 Debian 4.18.10-2
[77211.909413] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[77211.909416] mdX_raid1       D    0   225      2 0x80000000
[77211.909420] Call Trace:
[77211.909431]  ? __schedule+0x2b7/0x880
[77211.909435]  schedule+0x28/0x80
[77211.909446]  md_super_wait+0x6e/0xa0 [md_mod]
[77211.909451]  ? finish_wait+0x80/0x80
[77211.909458]  bitmap_wait_writes+0x93/0xa0 [md_mod]
[77211.909465]  ? bitmap_get_counter+0x40/0xc0 [md_mod]
[77211.909471]  bitmap_daemon_work+0x23b/0x360 [md_mod]
[77211.909478]  md_check_recovery+0x26/0x570 [md_mod]
[77211.909483]  raid1d+0x5c/0x890 [raid1]
[77211.909487]  ? lock_timer_base+0x67/0x80
[77211.909490]  ? try_to_del_timer_sync+0x4d/0x80
[77211.909492]  ? del_timer_sync+0x35/0x40
[77211.909496]  ? schedule_timeout+0x181/0x380
[77211.909502]  ? md_rdev_init+0xb0/0xb0 [md_mod]
[77211.909507]  ? md_thread+0x122/0x160 [md_mod]
[77211.909510]  ? handle_read_error+0x4f0/0x4f0 [raid1]
[77211.909515]  md_thread+0x122/0x160 [md_mod]
[77211.909519]  ? finish_wait+0x80/0x80
[77211.909522]  kthread+0x113/0x130
[77211.909524]  ? kthread_create_worker_on_cpu+0x70/0x70
[77211.909527]  ret_from_fork+0x35/0x40
[77211.909531] INFO: task jbd2/dm-4-8:291 blocked for more than 120 seconds.
[77211.909534]       Not tainted 4.18.0-2-amd64 #1 Debian 4.18.10-2
[77211.909536] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[77211.909538] jbd2/dm-4-8     D    0   291      2 0x80000000
[77211.909541] Call Trace:
[77211.909544]  ? __schedule+0x2b7/0x880
[77211.909547]  schedule+0x28/0x80
[77211.909551]  io_schedule+0x12/0x40
[77211.909556]  wait_on_page_bit_common+0xfd/0x180
[77211.909560]  ? page_cache_tree_insert+0xe0/0xe0
[77211.909564]  __filemap_fdatawait_range+0xd5/0x130
[77211.909568]  ? submit_bio+0x6c/0x140
[77211.909570]  ? submit_bio+0x6c/0x140
[77211.909574]  ? guard_bio_eod+0x2c/0xf0
[77211.909577]  filemap_fdatawait_keep_errors+0x1a/0x40
[77211.909586]  jbd2_journal_commit_transaction+0x702/0x1810 [jbd2]
[77211.909590]  ? __switch_to_asm+0x40/0x70
[77211.909592]  ? __switch_to_asm+0x40/0x70
[77211.909599]  ? kjournald2+0xbd/0x270 [jbd2]
[77211.909604]  kjournald2+0xbd/0x270 [jbd2]
[77211.909608]  ? finish_wait+0x80/0x80
[77211.909613]  ? commit_timeout+0x10/0x10 [jbd2]
[77211.909615]  kthread+0x113/0x130
[77211.909617]  ? kthread_create_worker_on_cpu+0x70/0x70
[77211.909619]  ret_from_fork+0x35/0x40
[77211.909638] INFO: task lightdm-gtk-gre:4843 blocked for more than 120 seconds.
[77211.909640]       Not tainted 4.18.0-2-amd64 #1 Debian 4.18.10-2
[77211.909642] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[77211.909644] lightdm-gtk-gre D    0  4843   4829 0x00000000
[77211.909647] Call Trace:
[77211.909650]  ? __schedule+0x2b7/0x880
[77211.909653]  ? bit_wait+0x50/0x50
[77211.909655]  schedule+0x28/0x80
[77211.909658]  io_schedule+0x12/0x40
[77211.909661]  bit_wait_io+0xd/0x50
[77211.909664]  __wait_on_bit+0x44/0x80
[77211.909667]  out_of_line_wait_on_bit+0x91/0xb0
[77211.909671]  ? init_wait_var_entry+0x40/0x40
[77211.909676]  do_get_write_access+0x261/0x460 [jbd2]
[77211.909682]  jbd2_journal_get_write_access+0x48/0x60 [jbd2]
[77211.909705]  __ext4_journal_get_write_access+0x41/0x70 [ext4]
[77211.909722]  ext4_reserve_inode_write+0x8d/0xb0 [ext4]
[77211.909738]  ? ext4_dirty_inode+0x43/0x60 [ext4]
[77211.909752]  ext4_mark_inode_dirty+0x51/0x1d0 [ext4]
[77211.909757]  ? jbd2__journal_start+0xd7/0x1e0 [jbd2]
[77211.909771]  ext4_dirty_inode+0x43/0x60 [ext4]
[77211.909775]  __mark_inode_dirty+0x112/0x3a0
[77211.909779]  generic_update_time+0x9f/0xd0
[77211.909782]  file_update_time+0xe0/0x130
[77211.909786]  __generic_file_write_iter+0x99/0x1c0
[77211.909800]  ext4_file_write_iter+0x201/0x3e0 [ext4]
[77211.909805]  new_sync_write+0x104/0x160
[77211.909808]  vfs_write+0xad/0x1a0
[77211.909811]  ksys_write+0x52/0xc0
[77211.909815]  do_syscall_64+0x55/0x110
[77211.909819]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[77211.909822] RIP: 0033:0x7fd9977352d7
[77211.909823] Code: Bad RIP value.
[77211.909831] RSP: 002b:00007ffc2fcafb20 EFLAGS: 00000293 ORIG_RAX: 0000000000000001
[77211.909833] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007fd9977352d7
[77211.909835] RDX: 00000000000000ad RSI: 00007ffc2fcafd20 RDI: 0000000000000002
[77211.909836] RBP: 00007ffc2fcafd20 R08: 0000000000000000 R09: 0000000000000000
[77211.909838] R10: 0000000000000000 R11: 0000000000000293 R12: 00000000000000ad
[77211.909839] R13: 00000000000000ad R14: 00007fd9977ff760 R15: 00000000000000ad
[77211.909850] INFO: task kworker/u4:12:6928 blocked for more than 120 seconds.
[77211.909852]       Not tainted 4.18.0-2-amd64 #1 Debian 4.18.10-2
[77211.909854] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[77211.909856] kworker/u4:12   D    0  6928      2 0x80000000
[77211.909861] Workqueue: writeback wb_workfn (flush-253:4)
[77211.909863] Call Trace:
[77211.909867]  ? __schedule+0x2b7/0x880
[77211.909870]  schedule+0x28/0x80
[77211.909877]  md_super_wait+0x6e/0xa0 [md_mod]
[77211.909880]  ? finish_wait+0x80/0x80
[77211.909887]  bitmap_wait_writes+0x93/0xa0 [md_mod]
[77211.909893]  bitmap_unplug+0xb8/0x110 [md_mod]
[77211.909897]  flush_bio_list+0x1c/0xd0 [raid1]
[77211.909901]  raid1_unplug+0xc1/0xd0 [raid1]
[77211.909904]  blk_flush_plug_list+0xdf/0x270
[77211.909908]  blk_finish_plug+0x27/0x40
[77211.909910]  wb_writeback+0x17f/0x300
[77211.909914]  ? wb_workfn+0x18d/0x410
[77211.909916]  wb_workfn+0x18d/0x410
[77211.909921]  process_one_work+0x195/0x370
[77211.909924]  worker_thread+0x30/0x390
[77211.909927]  ? process_one_work+0x370/0x370
[77211.909929]  kthread+0x113/0x130
[77211.909931]  ? kthread_create_worker_on_cpu+0x70/0x70
[77211.909933]  ret_from_fork+0x35/0x40
[77332.740199] INFO: task mdX_raid1:225 blocked for more than 120 seconds.
[77332.740205]       Not tainted 4.18.0-2-amd64 #1 Debian 4.18.10-2
[77332.740207] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[77332.740210] mdX_raid1       D    0   225      2 0x80000000
[77332.740214] Call Trace:
[77332.740227]  ? __schedule+0x2b7/0x880
[77332.740230]  schedule+0x28/0x80
[77332.740242]  md_super_wait+0x6e/0xa0 [md_mod]
[77332.740249]  ? finish_wait+0x80/0x80
[77332.740256]  bitmap_wait_writes+0x93/0xa0 [md_mod]
[77332.740262]  ? bitmap_get_counter+0x40/0xc0 [md_mod]
[77332.740269]  bitmap_daemon_work+0x23b/0x360 [md_mod]
[77332.740275]  md_check_recovery+0x26/0x570 [md_mod]
[77332.740280]  raid1d+0x5c/0x890 [raid1]
[77332.740284]  ? lock_timer_base+0x67/0x80
[77332.740286]  ? try_to_del_timer_sync+0x4d/0x80
[77332.740289]  ? del_timer_sync+0x35/0x40
[77332.740292]  ? schedule_timeout+0x181/0x380
[77332.740298]  ? md_rdev_init+0xb0/0xb0 [md_mod]
[77332.740304]  ? md_thread+0x122/0x160 [md_mod]
[77332.740307]  ? handle_read_error+0x4f0/0x4f0 [raid1]
[77332.740312]  md_thread+0x122/0x160 [md_mod]
[77332.740315]  ? finish_wait+0x80/0x80
[77332.740319]  kthread+0x113/0x130
[77332.740321]  ? kthread_create_worker_on_cpu+0x70/0x70
[77332.740324]  ret_from_fork+0x35/0x40
[77332.740328] INFO: task jbd2/dm-4-8:291 blocked for more than 120 seconds.
[77332.740331]       Not tainted 4.18.0-2-amd64 #1 Debian 4.18.10-2
[77332.740332] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[77332.740334] jbd2/dm-4-8     D    0   291      2 0x80000000
[77332.740337] Call Trace:
[77332.740341]  ? __schedule+0x2b7/0x880
[77332.740344]  schedule+0x28/0x80
[77332.740348]  io_schedule+0x12/0x40
[77332.740352]  wait_on_page_bit_common+0xfd/0x180
[77332.740356]  ? page_cache_tree_insert+0xe0/0xe0
[77332.740360]  __filemap_fdatawait_range+0xd5/0x130
[77332.740364]  ? submit_bio+0x6c/0x140
[77332.740366]  ? submit_bio+0x6c/0x140
[77332.740370]  ? guard_bio_eod+0x2c/0xf0
[77332.740374]  filemap_fdatawait_keep_errors+0x1a/0x40
[77332.740382]  jbd2_journal_commit_transaction+0x702/0x1810 [jbd2]
[77332.740386]  ? __switch_to_asm+0x40/0x70
[77332.740389]  ? __switch_to_asm+0x40/0x70
[77332.740396]  ? kjournald2+0xbd/0x270 [jbd2]
[77332.740401]  kjournald2+0xbd/0x270 [jbd2]
[77332.740404]  ? finish_wait+0x80/0x80
[77332.740410]  ? commit_timeout+0x10/0x10 [jbd2]
[77332.740412]  kthread+0x113/0x130
[77332.740414]  ? kthread_create_worker_on_cpu+0x70/0x70
[77332.740416]  ret_from_fork+0x35/0x40
[77332.740434] INFO: task lightdm-gtk-gre:4843 blocked for more than 120 seconds.
[77332.740437]       Not tainted 4.18.0-2-amd64 #1 Debian 4.18.10-2
[77332.740439] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[77332.740441] lightdm-gtk-gre D    0  4843   4829 0x00000000
[77332.740443] Call Trace:
[77332.740447]  ? __schedule+0x2b7/0x880
[77332.740450]  ? bit_wait+0x50/0x50
[77332.740452]  schedule+0x28/0x80
[77332.740455]  io_schedule+0x12/0x40
[77332.740458]  bit_wait_io+0xd/0x50
[77332.740461]  __wait_on_bit+0x44/0x80
[77332.740464]  out_of_line_wait_on_bit+0x91/0xb0
[77332.740468]  ? init_wait_var_entry+0x40/0x40
[77332.740473]  do_get_write_access+0x261/0x460 [jbd2]
[77332.740479]  jbd2_journal_get_write_access+0x48/0x60 [jbd2]
[77332.740501]  __ext4_journal_get_write_access+0x41/0x70 [ext4]
[77332.740518]  ext4_reserve_inode_write+0x8d/0xb0 [ext4]
[77332.740534]  ? ext4_dirty_inode+0x43/0x60 [ext4]
[77332.740548]  ext4_mark_inode_dirty+0x51/0x1d0 [ext4]
[77332.740553]  ? jbd2__journal_start+0xd7/0x1e0 [jbd2]
[77332.740567]  ext4_dirty_inode+0x43/0x60 [ext4]
[77332.740571]  __mark_inode_dirty+0x112/0x3a0
[77332.740574]  generic_update_time+0x9f/0xd0
[77332.740577]  file_update_time+0xe0/0x130
[77332.740581]  __generic_file_write_iter+0x99/0x1c0
[77332.740595]  ext4_file_write_iter+0x201/0x3e0 [ext4]
[77332.740600]  new_sync_write+0x104/0x160
[77332.740603]  vfs_write+0xad/0x1a0
[77332.740606]  ksys_write+0x52/0xc0
[77332.740610]  do_syscall_64+0x55/0x110
[77332.740614]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[77332.740617] RIP: 0033:0x7fd9977352d7
[77332.740618] Code: Bad RIP value.
[77332.740625] RSP: 002b:00007ffc2fcafb20 EFLAGS: 00000293 ORIG_RAX: 0000000000000001
[77332.740628] RAX: ffffffffffffffda RBX: 0000000000000002 RCX: 00007fd9977352d7
[77332.740630] RDX: 00000000000000ad RSI: 00007ffc2fcafd20 RDI: 0000000000000002
[77332.740631] RBP: 00007ffc2fcafd20 R08: 0000000000000000 R09: 0000000000000000
[77332.740633] R10: 0000000000000000 R11: 0000000000000293 R12: 00000000000000ad
[77332.740634] R13: 00000000000000ad R14: 00007fd9977ff760 R15: 00000000000000ad
[77332.740644] INFO: task kworker/u4:12:6928 blocked for more than 120 seconds.
[77332.740647]       Not tainted 4.18.0-2-amd64 #1 Debian 4.18.10-2
[77332.740649] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[77332.740651] kworker/u4:12   D    0  6928      2 0x80000000
[77332.740656] Workqueue: writeback wb_workfn (flush-253:4)
[77332.740658] Call Trace:
[77332.740662]  ? __schedule+0x2b7/0x880
[77332.740665]  schedule+0x28/0x80
[77332.740671]  md_super_wait+0x6e/0xa0 [md_mod]
[77332.740675]  ? finish_wait+0x80/0x80
[77332.740681]  bitmap_wait_writes+0x93/0xa0 [md_mod]
[77332.740688]  bitmap_unplug+0xb8/0x110 [md_mod]
[77332.740691]  flush_bio_list+0x1c/0xd0 [raid1]
[77332.740695]  raid1_unplug+0xc1/0xd0 [raid1]
[77332.740698]  blk_flush_plug_list+0xdf/0x270
[77332.740702]  blk_finish_plug+0x27/0x40
[77332.740705]  wb_writeback+0x17f/0x300
[77332.740708]  ? wb_workfn+0x18d/0x410
[77332.740711]  wb_workfn+0x18d/0x410
[77332.740715]  process_one_work+0x195/0x370
[77332.740718]  worker_thread+0x30/0x390
[77332.740721]  ? process_one_work+0x370/0x370
[77332.740723]  kthread+0x113/0x130
[77332.740725]  ? kthread_create_worker_on_cpu+0x70/0x70
[77332.740727]  ret_from_fork+0x35/0x40
[77407.548980] systemd[1]: systemd-journald.service: Main process exited, code=killed, status=6/ABRT
[77407.549059] systemd[1]: systemd-journald.service: Failed with result 'watchdog'.
[77407.550194] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart.
[77407.550265] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.
[77407.550381] systemd[1]: Stopped Flush Journal to Persistent Storage.
[77407.550410] systemd[1]: Stopping Flush Journal to Persistent Storage...
[77407.550418] systemd[1]: Stopped Journal Service.
[77407.553581] systemd[1]: Starting Journal Service...
[77407.603326] systemd-journald[6999]: File /var/log/journal/07f7f9cd590a4efb8284abc2d2ec08d0/system.journal corrupted or uncleanly shut down, renaming and replacing.
[77407.619959] systemd[1]: Started Journal Service.
[77683.014728] alg: No test for echainiv(authenc(hmac(sha1),cbc(aes))) (echainiv(authenc(hmac(sha1-generic),cbc(aes-asm))))
[85549.232239] INFO: task systemd:1 blocked for more than 120 seconds.
[85549.232245]       Not tainted 4.18.0-2-amd64 #1 Debian 4.18.10-2
[85549.232247] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[85549.232249] systemd         D    0     1      0 0x00000000
[85549.232253] Call Trace:
[85549.232264]  ? __schedule+0x2b7/0x880
[85549.232267]  schedule+0x28/0x80
[85549.232277]  wait_transaction_locked+0x86/0xc0 [jbd2]
[85549.232284]  ? finish_wait+0x80/0x80
[85549.232288]  add_transaction_credits+0x1b9/0x290 [jbd2]
[85549.232292]  ? current_time+0x4d/0x90
[85549.232297]  start_this_handle+0x102/0x400 [jbd2]
[85549.232301]  ? _cond_resched+0x15/0x40
[85549.232305]  jbd2__journal_start+0xd7/0x1e0 [jbd2]
[85549.232329]  ext4_dirty_inode+0x2d/0x60 [ext4]
[85549.232334]  __mark_inode_dirty+0x112/0x3a0
[85549.232350]  ext4_setattr+0x1db/0x9e0 [ext4]
[85549.232353]  ? current_time+0x4d/0x90
[85549.232356]  notify_change+0x303/0x420
[85549.232360]  utimes_common+0xdd/0x1a0
[85549.232364]  do_utimes+0x128/0x160
[85549.232368]  __x64_sys_utimensat+0x88/0xd0
[85549.232373]  ? do_sys_open+0x140/0x250
[85549.232377]  ? do_syscall_64+0x55/0x110
[85549.232380]  ? __x32_compat_sys_utime+0xb0/0xb0
[85549.232383]  do_syscall_64+0x55/0x110
[85549.232387]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[85549.232390] RIP: 0033:0x7f055c66e18f
[85549.232391] Code: Bad RIP value.
[85549.232398] RSP: 002b:00007ffdf154de88 EFLAGS: 00000206 ORIG_RAX: 0000000000000118
[85549.232401] RAX: ffffffffffffffda RBX: 0000000000000000 RCX: 00007f055c66e18f
[85549.232402] RDX: 00007ffdf154dec0 RSI: 00007ffdf154dea0 RDI: 00000000ffffff9c
[85549.232404] RBP: 0000000000000019 R08: 0000000000000002 R09: 00007ffdf154dbe6
[85549.232405] R10: 0000000000000000 R11: 0000000000000206 R12: 00007ffdf154dea0
[85549.232407] R13: 00007ffdf154dec0 R14: 000579f8d6a3e1de R15: 00000000ffffffff
[85549.232418] INFO: task mdX_raid1:225 blocked for more than 120 seconds.
[85549.232421]       Not tainted 4.18.0-2-amd64 #1 Debian 4.18.10-2
[85549.232423] "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
[85549.232425] mdX_raid1       D    0   225      2 0x80000000
[85549.232427] Call Trace:
[85549.232431]  ? __schedule+0x2b7/0x880
[85549.232434]  schedule+0x28/0x80
[85549.232444]  md_super_wait+0x6e/0xa0 [md_mod]
[85549.232448]  ? finish_wait+0x80/0x80
[85549.232454]  bitmap_wait_writes+0x93/0xa0 [md_mod]
[85549.232457]  ? __switch_to_asm+0x40/0x70
[85549.232464]  bitmap_unplug+0xb8/0x110 [md_mod]
[85549.232468]  flush_bio_list+0x1c/0xd0 [raid1]
[85549.232472]  flush_pending_writes+0x95/0xe0 [raid1]
[85549.232475]  ? mutex_lock+0xe/0x30
[85549.232481]  ? bitmap_daemon_work+0x9a/0x360 [md_mod]
[85549.232483]  ? __switch_to_asm+0x34/0x70
[85549.232487]  ? raid1d+0xa3/0x890 [raid1]
[85549.232489]  raid1d+0xa3/0x890 [raid1]
[85549.232494]  ? try_to_del_timer_sync+0x4d/0x80
[85549.232500]  ? md_rdev_init+0xb0/0xb0 [md_mod]
[85549.232505]  ? md_thread+0x122/0x160 [md_mod]
[85549.232508]  ? handle_read_error+0x4f0/0x4f0 [raid1]
[85549.232513]  md_thread+0x122/0x160 [md_mod]
[85549.232517]  ? finish_wait+0x80/0x80
[85549.232520]  kthread+0x113/0x130
[85549.232522]  ? kthread_create_worker_on_cpu+0x70/0x70
[85549.232525]  ret_from_fork+0x35/0x40

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [linux-lvm] LVM RAID: task mdX_raid1:221 blocked for more than 120 seconds
  2018-11-26 11:31   ` Cesare Leonardi
@ 2018-11-26 11:40     ` Zdenek Kabelac
  2018-11-26 12:43       ` Cesare Leonardi
  0 siblings, 1 reply; 7+ messages in thread
From: Zdenek Kabelac @ 2018-11-26 11:40 UTC (permalink / raw)
  To: Cesare Leonardi, LVM general discussion and development; +Cc: linux-raid

Dne 26. 11. 18 v 12:31 Cesare Leonardi napsal(a):
> Resending, I erroneusly replied only to Zdenek, sorry.
> 
> 
> 
> I can provide details about this, that was filed by me:
> https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=913119
> 
> It's about a desktop PC, with two SSD (Samsung 850 EVO) on which i build RAID1 
> using LVM.
> # pvs
>  � PV�������� VG� Fmt� Attr PSize��� PFree
>  � /dev/sdb3� vg0 lvm2 a--� <250,00g 15,98g
>  � /dev/sdc3� vg0 lvm2 a--� <250,00g 15,98g
> 
> # lvs
>  � LV��� VG� Attr������ LSize�� Pool Origin Data%� Meta%� Move Log Cpy%Sync 
> Convert
>  � home� vg0 rwi-aor--- 200,00g 100,00
>  � root� vg0 rwi-aor---� 30,00g 100,00
>  � swap0 vg0 rwi-aor---�� 4,00g 100,00
> 
> It's a desktop PC using Debian unstable, so it's rebooted quite often due to 
> frequent updates.

So you should probably start first with running latest available kernel - 4.19.

You also should collect 'dmesg' report

> The freezes happens during normal work, without any resizing or any 
> maintenance on LVM going on. Most of the time I noted the freeze while I was 
> using Thunderbird. But eventually they resolve by themself: I wait minutes and 

Aren't you running out-of-memory ?

Install some CPU/MEM monitoring service and watch out for problems
(AFAIK OOM doesn't really work on my machine - and often  FF + Thunderbird 
combo brings it to the state mouse barely moves and CPU spins in kswapd...)

> I've not noticed any corruption due to these freeze but often they are very 
> long and very impacting. The only reliable workaround found was to reboot with:
> scsi_mod.use_blk_mq=0 dm_mod.use_blk_mq=0

I doubt this have anything in common with this.

Regards

Zdenek

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [linux-lvm] LVM RAID: task mdX_raid1:221 blocked for more than 120 seconds
  2018-11-26  8:49 ` Zdenek Kabelac
@ 2018-11-26 11:31   ` Cesare Leonardi
  2018-11-26 11:40     ` Zdenek Kabelac
  0 siblings, 1 reply; 7+ messages in thread
From: Cesare Leonardi @ 2018-11-26 11:31 UTC (permalink / raw)
  To: Zdenek Kabelac, LVM general discussion and development; +Cc: linux-raid

Resending, I erroneusly replied only to Zdenek, sorry.


On 26/11/18 09:49, Zdenek Kabelac wrote:
> It does look like 'freeze' happens during LV� resize of device
> (just wild guess from bug=913138)
> 
> To track down the issue - there would need to be probably some 
> communication with bug reporters - they would need to expose what they 
> were doing plus state
> of dm tables and number of other things.

I can provide details about this, that was filed by me:
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=913119

It's about a desktop PC, with two SSD (Samsung 850 EVO) on which i build 
RAID1 using LVM.
# pvs
   PV         VG  Fmt  Attr PSize    PFree
   /dev/sdb3  vg0 lvm2 a--  <250,00g 15,98g
   /dev/sdc3  vg0 lvm2 a--  <250,00g 15,98g

# lvs
   LV    VG  Attr       LSize   Pool Origin Data%  Meta%  Move Log 
Cpy%Sync Convert
   home  vg0 rwi-aor--- 200,00g 100,00
   root  vg0 rwi-aor---  30,00g 100,00
   swap0 vg0 rwi-aor---   4,00g 100,00

It's a desktop PC using Debian unstable, so it's rebooted quite often 
due to frequent updates.
The freezes happens during normal work, without any resizing or any 
maintenance on LVM going on. Most of the time I noted the freeze while I 
was using Thunderbird. But eventually they resolve by themself: I wait 
minutes and the system suddenly became responsive again. Sometimes I've 
noted freezes but without any notice in dmesg: maybe they resolved 
before some kernel threshold.
But most of the time another freeze will happen soon (it could be 1-2 
hours but also minutes), so a reboot is really necessary.

I've not noticed any corruption due to these freeze but often they are 
very long and very impacting. The only reliable workaround found was to 
reboot with:
scsi_mod.use_blk_mq=0 dm_mod.use_blk_mq=0

Or to reboot with Debian kernel 4.16.16 (linux-image-4.16.0-2-amd) the 
last that work without problem but also the last before Debian 
maintaner's activated SCSI_MQ_DEFAULT and DM_MQ_DEFAULT.

To me the only evidence is that disabling blk-mq the problem doesn't 
happen and so it looks an interaction with blk-mq.
I've read in RHEL8 release notes that it will enable it by default, so I 
wonder if that happened to others. I have a fedora-server 29 VM, 
upgraded from 28, but there, if I recall correctly, SCSI_MQ_DEFAULT and 
DM_MQ_DEFAULT are not set.

> Anyway without way more info such bug report is meaningless.

Please ask, I'll do my best to provide any info you need.

Cesare.

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [linux-lvm] LVM RAID: task mdX_raid1:221 blocked for more than 120 seconds
  2018-11-24 23:30 Cesare Leonardi
  2018-11-26  7:25 ` Jack Wang
@ 2018-11-26  8:49 ` Zdenek Kabelac
  2018-11-26 11:31   ` Cesare Leonardi
  1 sibling, 1 reply; 7+ messages in thread
From: Zdenek Kabelac @ 2018-11-26  8:49 UTC (permalink / raw)
  To: LVM general discussion and development, Cesare Leonardi

Dne 25. 11. 18 v 0:30 Cesare Leonardi napsal(a):
> Since my message did not reach the list, I'm resending, but first I've 
> subscribed myself.
> 
> ------------------
> Hello, I'm writing here to have your opinion and possibly some advice about 
> some Debian bugs related to LVM RAID that are still unresolved:
> https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=913119
> https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=913138
> https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=904822
> 
> Bug #913119 was filed by me, so I can personally provide some more information 
> and do tests.
> 
> Premises related di Debian unstable:
> * Debian's kernel is currently 4.18.20.
> * From kernel 4.17~rc7 Debian enabled SCSI_MQ_DEFAULT and DM_MQ_DEFAULT.
> * Debian's LVM userland is 2.02.176
> 
> The above reports shows blocked I/O with different type of LVM RAID and with 
> #913119 I've succesfully workarounded passing the following kernel parameters:
> scsi_mod.use_blk_mq=0 dm_mod.use_blk_mq=0
> 
> I've read that RHEL will default to enabling SCSI_MQ_DEFAULT and DM_MQ_DEFAULT 
> and will use kernel 4.18. Maybe you have already encountered this bug and it's 
> already resolved. Or there are patches pending.
> 
> What do you think? Should I file a bug in Red Hat bug tracker?
> 


Hi


Traces are completely misleading.

It does look like 'freeze' happens during LV  resize of device
(just wild guess from bug=913138)

To track down the issue - there would need to be probably some communication 
with bug reporters - they would need to expose what they were doing plus state
of dm tables and number of other things.

It's nearly impossible to guess just out of this 'trace' of  sleeping process.

 From traces it seems - raid kernel driver is sleeping - so it could i.e. mean 
some  'dm' target is left in suspended state - possibly due to ?bug? of lvm2 
command that has crashed and left table in the incorrect state??

Anyway without way more info such bug report is meaningless.


Regards


Zdenek

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [linux-lvm] LVM RAID: task mdX_raid1:221 blocked for more than 120 seconds
  2018-11-24 23:30 Cesare Leonardi
@ 2018-11-26  7:25 ` Jack Wang
  2018-11-26  8:49 ` Zdenek Kabelac
  1 sibling, 0 replies; 7+ messages in thread
From: Jack Wang @ 2018-11-26  7:25 UTC (permalink / raw)
  To: LVM general discussion and development, linux-raid

+cc linux-raid

The call trace looks kinds of deadlock in raid
Cesare Leonardi <celeonar@gmail.com> 于2018年11月25日周日 上午12:31写道:
>
> Since my message did not reach the list, I'm resending, but first I've
> subscribed myself.
>
> ------------------
> Hello, I'm writing here to have your opinion and possibly some advice
> about some Debian bugs related to LVM RAID that are still unresolved:
> https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=913119
> https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=913138
> https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=904822
>
> Bug #913119 was filed by me, so I can personally provide some more
> information and do tests.
>
> Premises related di Debian unstable:
> * Debian's kernel is currently 4.18.20.
> * From kernel 4.17~rc7 Debian enabled SCSI_MQ_DEFAULT and DM_MQ_DEFAULT.
> * Debian's LVM userland is 2.02.176
>
> The above reports shows blocked I/O with different type of LVM RAID and
> with #913119 I've succesfully workarounded passing the following kernel
> parameters:
> scsi_mod.use_blk_mq=0 dm_mod.use_blk_mq=0
>
> I've read that RHEL will default to enabling SCSI_MQ_DEFAULT and
> DM_MQ_DEFAULT and will use kernel 4.18. Maybe you have already
> encountered this bug and it's already resolved. Or there are patches
> pending.
>
> What do you think? Should I file a bug in Red Hat bug tracker?
>
> Cesare.
>
> _______________________________________________
> linux-lvm mailing list
> linux-lvm@redhat.com
> https://www.redhat.com/mailman/listinfo/linux-lvm
> read the LVM HOW-TO at http://tldp.org/HOWTO/LVM-HOWTO/

^ permalink raw reply	[flat|nested] 7+ messages in thread

* [linux-lvm] LVM RAID: task mdX_raid1:221 blocked for more than 120 seconds
@ 2018-11-24 23:30 Cesare Leonardi
  2018-11-26  7:25 ` Jack Wang
  2018-11-26  8:49 ` Zdenek Kabelac
  0 siblings, 2 replies; 7+ messages in thread
From: Cesare Leonardi @ 2018-11-24 23:30 UTC (permalink / raw)
  To: linux-lvm

Since my message did not reach the list, I'm resending, but first I've 
subscribed myself.

------------------
Hello, I'm writing here to have your opinion and possibly some advice 
about some Debian bugs related to LVM RAID that are still unresolved:
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=913119
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=913138
https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=904822

Bug #913119 was filed by me, so I can personally provide some more 
information and do tests.

Premises related di Debian unstable:
* Debian's kernel is currently 4.18.20.
* From kernel 4.17~rc7 Debian enabled SCSI_MQ_DEFAULT and DM_MQ_DEFAULT.
* Debian's LVM userland is 2.02.176

The above reports shows blocked I/O with different type of LVM RAID and 
with #913119 I've succesfully workarounded passing the following kernel 
parameters:
scsi_mod.use_blk_mq=0 dm_mod.use_blk_mq=0

I've read that RHEL will default to enabling SCSI_MQ_DEFAULT and 
DM_MQ_DEFAULT and will use kernel 4.18. Maybe you have already 
encountered this bug and it's already resolved. Or there are patches 
pending.

What do you think? Should I file a bug in Red Hat bug tracker?

Cesare.

^ permalink raw reply	[flat|nested] 7+ messages in thread

end of thread, other threads:[~2018-11-26 12:43 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2018-11-24 15:43 [linux-lvm] LVM RAID: task mdX_raid1:221 blocked for more than 120 seconds Cesare Leonardi
2018-11-24 23:30 Cesare Leonardi
2018-11-26  7:25 ` Jack Wang
2018-11-26  8:49 ` Zdenek Kabelac
2018-11-26 11:31   ` Cesare Leonardi
2018-11-26 11:40     ` Zdenek Kabelac
2018-11-26 12:43       ` Cesare Leonardi

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).