All of lore.kernel.org
 help / color / mirror / Atom feed
* Slow memory access when using OpenCL without X11
@ 2019-03-08 19:43 Lauri Ehrenpreis
       [not found] ` <CAGyaPbDo4-mJhCbL1gfjgek_Z54dyREydqZc-SF=cFVQ0URyYA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Lauri Ehrenpreis @ 2019-03-08 19:43 UTC (permalink / raw)
  To: amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW


[-- Attachment #1.1: Type: text/plain, Size: 1381 bytes --]

Hi!

I am using Ryzen 2400G with Gigabyte AMD B450 AORUS board. I have latest
bios, ubuntu 18.04 and latest mainline kernel (5.0.0-050000-generic)
installed. Also I have rocm-dev 2.1.96 but no rock-dkms installed.

I found that when I log in over ssh and try to use OpenCL (doing
clCreateContext is enough) then cpu memory accesses after that will slow
down by 100x.
If I connect HDMI cable and log in to desktop mode then this does not
happen. Also if I don't call clCreateContext then everything works properly.

Attached the test program and kernel log also. Test works like that :
g++ cl_slow_test.cpp -o cl_slow_test -I /opt/rocm/opencl/include/ -L
/opt/rocm/opencl/lib/x86_64/  -lOpenCL
lauri@rv:~$ ./cl_slow_test 0 5
speed 7003.145508 avg 7003.145508 mbytes/s
speed 8427.357422 avg 7715.251465 mbytes/s
speed 9203.049805 avg 8211.184570 mbytes/s
speed 9845.956055 avg 8619.877930 mbytes/s
speed 9882.748047 avg 8872.452148 mbytes/s
lauri@rv:~$ ./cl_slow_test 1 5
got 1 platforms 1 devices
speed 1599.803589 avg 1599.803589 mbytes/s
speed 1665.426392 avg 1632.614990 mbytes/s
speed 146.137253 avg 1137.122437 mbytes/s
speed 121.056877 avg 883.106018 mbytes/s
speed 122.428970 avg 730.970581 mbytes/s

I also tried latest amd-staging kernel
https://github.com/M-Bab/linux-kernel-amdgpu-binaries and it had the same
issue.

Can anyone point me into right direction?

Br,
Lauri

[-- Attachment #1.2: Type: text/html, Size: 2063 bytes --]

[-- Attachment #2: dmesg.txt --]
[-- Type: text/plain, Size: 74641 bytes --]

[    0.000000] Linux version 5.0.0-050000-generic (kernel@gloin) (gcc version 8.2.0 (Ubuntu 8.2.0-21ubuntu1)) #201903032031 SMP Mon Mar 4 01:33:18 UTC 2019
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.0.0-050000-generic root=UUID=c5450568-4da2-4760-b09a-29eddec1e9a3 ro quiet splash vt.handoff=1
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Hygon HygonGenuine
[    0.000000]   Centaur CentaurHauls
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'compacted' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009ebff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009ec00-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000009cfffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000009d00000-0x0000000009ffffff] reserved
[    0.000000] BIOS-e820: [mem 0x000000000a000000-0x000000000a1fffff] usable
[    0.000000] BIOS-e820: [mem 0x000000000a200000-0x000000000a209fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000000a20a000-0x000000000affffff] usable
[    0.000000] BIOS-e820: [mem 0x000000000b000000-0x000000000b01ffff] reserved
[    0.000000] BIOS-e820: [mem 0x000000000b020000-0x000000005b862fff] usable
[    0.000000] BIOS-e820: [mem 0x000000005b863000-0x000000005b98afff] reserved
[    0.000000] BIOS-e820: [mem 0x000000005b98b000-0x000000005bb0bfff] usable
[    0.000000] BIOS-e820: [mem 0x000000005bb0c000-0x000000005bf1cfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000005bf1d000-0x000000005ce60fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000005ce61000-0x000000005effffff] usable
[    0.000000] BIOS-e820: [mem 0x000000005f000000-0x00000000dfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000f8000000-0x00000000fbffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fd100000-0x00000000fdffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fea00000-0x00000000fea0ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000feb80000-0x00000000fec01fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec10000-0x00000000fec10fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec30000-0x00000000fec30fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed00000-0x00000000fed00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed40000-0x00000000fed44fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed80000-0x00000000fed8ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fedc2000-0x00000000fedcffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fedd4000-0x00000000fedd5fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000feefffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000021f33ffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 3.2.1 present.
[    0.000000] DMI: Gigabyte Technology Co., Ltd. B450 I AORUS PRO WIFI/B450 I AORUS PRO WIFI-CF, BIOS F5 01/25/2019
[    0.000000] tsc: Fast TSC calibration failed
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] last_pfn = 0x21f340 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF write-through
[    0.000000]   C0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 000000000000 mask FFFF80000000 write-back
[    0.000000]   1 base 000080000000 mask FFFFC0000000 write-back
[    0.000000]   2 base 0000C0000000 mask FFFFE0000000 write-back
[    0.000000]   3 disabled
[    0.000000]   4 disabled
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000] TOM2: 0000000220000000 aka 8704M
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.000000] e820: update [mem 0xe0000000-0xffffffff] usable ==> reserved
[    0.000000] last_pfn = 0x5f000 max_arch_pfn = 0x400000000
[    0.000000] check: Scanning 1 areas for low memory corruption
[    0.000000] Base memory trampoline at [(____ptrval____)] 98000 size 24576
[    0.000000] Using GB pages for direct mapping
[    0.000000] BRK [0x1edc01000, 0x1edc01fff] PGTABLE
[    0.000000] BRK [0x1edc02000, 0x1edc02fff] PGTABLE
[    0.000000] BRK [0x1edc03000, 0x1edc03fff] PGTABLE
[    0.000000] BRK [0x1edc04000, 0x1edc04fff] PGTABLE
[    0.000000] BRK [0x1edc05000, 0x1edc05fff] PGTABLE
[    0.000000] BRK [0x1edc06000, 0x1edc06fff] PGTABLE
[    0.000000] BRK [0x1edc07000, 0x1edc07fff] PGTABLE
[    0.000000] BRK [0x1edc08000, 0x1edc08fff] PGTABLE
[    0.000000] BRK [0x1edc09000, 0x1edc09fff] PGTABLE
[    0.000000] BRK [0x1edc0a000, 0x1edc0afff] PGTABLE
[    0.000000] BRK [0x1edc0b000, 0x1edc0bfff] PGTABLE
[    0.000000] BRK [0x1edc0c000, 0x1edc0cfff] PGTABLE
[    0.000000] RAMDISK: [mem 0x33665000-0x35b29fff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F05B0 000024 (v02 ALASKA)
[    0.000000] ACPI: XSDT 0x000000005BE9D098 0000B4 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FACP 0x000000005BEA3D90 000114 (v06 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI BIOS Warning (bug): Optional FADT field Pm2ControlBlock has valid Length but zero Address: 0x0000000000000000/0x1 (20181213/tbfadt-624)
[    0.000000] ACPI: DSDT 0x000000005BE9D1E8 006BA2 (v02 ALASKA A M I    01072009 INTL 20120913)
[    0.000000] ACPI: FACS 0x000000005BF06D80 000040
[    0.000000] ACPI: APIC 0x000000005BEA3EA8 0000DE (v03 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FPDT 0x000000005BEA3F88 000044 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FIDT 0x000000005BEA3FD0 00009C (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: SSDT 0x000000005BEA4070 005419 (v02 ALASKA A M I    00000002 MSFT 02000002)
[    0.000000] ACPI: SSDT 0x000000005BEA9490 00119C (v01 ALASKA A M I    00000001 AMD  00000001)
[    0.000000] ACPI: CRAT 0x000000005BEAA630 000810 (v01 ALASKA A M I    00000001 AMD  00000001)
[    0.000000] ACPI: CDIT 0x000000005BEAAE40 000029 (v01 ALASKA A M I    00000001 AMD  00000001)
[    0.000000] ACPI: SSDT 0x000000005BEAAE70 002E6B (v01 ALASKA A M I    00000001 INTL 20120913)
[    0.000000] ACPI: MCFG 0x000000005BEADCE0 00003C (v01 ALASKA A M I    01072009 MSFT 00010013)
[    0.000000] ACPI: HPET 0x000000005BEADD20 000038 (v01 ALASKA A M I    01072009 AMI  00000005)
[    0.000000] ACPI: UEFI 0x000000005BEADD58 000048 (v01 ALASKA A M I    00000000      00000000)
[    0.000000] ACPI: IVRS 0x000000005BEADDA0 0000D0 (v02 ALASKA A M I    00000001 AMD  00000000)
[    0.000000] ACPI: SSDT 0x000000005BEADE70 000C33 (v01 ALASKA A M I    00000001 INTL 20120913)
[    0.000000] ACPI: SSDT 0x000000005BEAEAA8 0010F5 (v01 ALASKA A M I    00000001 INTL 20120913)
[    0.000000] ACPI: SSDT 0x000000005BEAFBA0 001B4E (v01 ALASKA A M I    00000001 INTL 20120913)
[    0.000000] ACPI: SSDT 0x000000005BEB16F0 0000BF (v01 ALASKA A M I    00001000 INTL 20120913)
[    0.000000] ACPI: WSMT 0x000000005BEB17B0 000028 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000021f33ffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x21f315000-0x21f33ffff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000021f33ffff]
[    0.000000]   Device   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009dfff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x0000000009cfffff]
[    0.000000]   node   0: [mem 0x000000000a000000-0x000000000a1fffff]
[    0.000000]   node   0: [mem 0x000000000a20a000-0x000000000affffff]
[    0.000000]   node   0: [mem 0x000000000b020000-0x000000005b862fff]
[    0.000000]   node   0: [mem 0x000000005b98b000-0x000000005bb0bfff]
[    0.000000]   node   0: [mem 0x000000005ce61000-0x000000005effffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x000000021f33ffff]
[    0.000000] Zeroed struct page in unavailable ranges: 10250 pages
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000021f33ffff]
[    0.000000] On node 0 totalpages: 1559350
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 21 pages reserved
[    0.000000]   DMA zone: 3997 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 5922 pages used for memmap
[    0.000000]   DMA32 zone: 378969 pages, LIFO batch:63
[    0.000000]   Normal zone: 18381 pages used for memmap
[    0.000000]   Normal zone: 1176384 pages, LIFO batch:63
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 9, version 33, address 0xfec00000, GSI 0-23
[    0.000000] IOAPIC[1]: apic_id 10, version 33, address 0xfec01000, GSI 24-55
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x10228201 base: 0xfed00000
[    0.000000] smpboot: Allowing 16 CPUs, 8 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009efff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009f000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x09d00000-0x09ffffff]
[    0.000000] PM: Registered nosave memory: [mem 0x0a200000-0x0a209fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0b000000-0x0b01ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x5b863000-0x5b98afff]
[    0.000000] PM: Registered nosave memory: [mem 0x5bb0c000-0x5bf1cfff]
[    0.000000] PM: Registered nosave memory: [mem 0x5bf1d000-0x5ce60fff]
[    0.000000] PM: Registered nosave memory: [mem 0x5f000000-0xdfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xe0000000-0xf7ffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xf8000000-0xfbffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfc000000-0xfd0fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfd100000-0xfdffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfe000000-0xfe9fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfea00000-0xfea0ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfea10000-0xfeb7ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfeb80000-0xfec01fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec02000-0xfec0ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec10000-0xfec10fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec11000-0xfec2ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec30000-0xfec30fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec31000-0xfecfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed00000-0xfed00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed01000-0xfed3ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed40000-0xfed44fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfed7ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed80000-0xfed8ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed90000-0xfedc1fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfedc2000-0xfedcffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfedd0000-0xfedd3fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfedd4000-0xfedd5fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfedd6000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfeefffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfef00000-0xfeffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff]
[    0.000000] [mem 0xe0000000-0xf7ffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.000000] random: get_random_bytes called from start_kernel+0x97/0x516 with crng_init=0
[    0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:16 nr_cpu_ids:16 nr_node_ids:1
[    0.000000] percpu: Embedded 46 pages/cpu @(____ptrval____) s151552 r8192 d28672 u262144
[    0.000000] pcpu-alloc: s151552 r8192 d28672 u262144 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15 
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 1534962
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.0.0-050000-generic root=UUID=c5450568-4da2-4760-b09a-29eddec1e9a3 ro quiet splash vt.handoff=1
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 5999436K/6237400K available (14339K kernel code, 2332K rwdata, 4388K rodata, 2564K init, 5220K bss, 237964K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=16, Nodes=1
[    0.000000] ftrace: allocating 41457 entries in 162 pages
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=16.
[    0.000000]  Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=16
[    0.000000] NR_IRQS: 524544, nr_irqs: 1096, preallocated irqs: 16
[    0.000000] spurious 8259A interrupt: IRQ7.
[    0.000000] Console: colour dummy device 80x25
[    0.000000] printk: console [tty0] enabled
[    0.000000] ACPI: Core revision 20181213
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484873504 ns
[    0.000000] hpet clockevent registered
[    0.000000] APIC: Switch to symmetric I/O mode setup
[    0.004000] Switched APIC routing to physical flat.
[    0.004000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.036000] tsc: Unable to calibrate against PIT
[    0.036000] tsc: using HPET reference calibration
[    0.036000] tsc: Detected 3593.182 MHz processor
[    0.000007] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x33cb2aaecf5, max_idle_ns: 440795376048 ns
[    0.000014] Calibrating delay loop (skipped), value calculated using timer frequency.. 7186.36 BogoMIPS (lpj=14372728)
[    0.000016] pid_max: default: 32768 minimum: 301
[    0.000403] LSM: Security Framework initializing
[    0.000405] Yama: becoming mindful.
[    0.000480] AppArmor: AppArmor initialized
[    0.001885] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[    0.004689] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.004777] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.004798] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.005382] mce: CPU supports 23 MCE banks
[    0.005402] LVT offset 1 assigned for vector 0xf9
[    0.005452] LVT offset 2 assigned for vector 0xf4
[    0.005463] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 512
[    0.005463] Last level dTLB entries: 4KB 1536, 2MB 1536, 4MB 768, 1GB 0
[    0.005465] Spectre V2 : Mitigation: Full AMD retpoline
[    0.005466] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.005472] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    0.005472] Spectre V2 : User space: Vulnerable
[    0.005473] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.005668] Freeing SMP alternatives memory: 36K
[    0.012009] smpboot: CPU0: AMD Ryzen 5 2400G with Radeon Vega Graphics (family: 0x17, model: 0x11, stepping: 0x0)
[    0.012009] Performance Events: Fam17h core perfctr, AMD PMU driver.
[    0.012009] ... version:                0
[    0.012009] ... bit width:              48
[    0.012009] ... generic registers:      6
[    0.012009] ... value mask:             0000ffffffffffff
[    0.012009] ... max period:             00007fffffffffff
[    0.012009] ... fixed-purpose events:   0
[    0.012009] ... event mask:             000000000000003f
[    0.012009] rcu: Hierarchical SRCU implementation.
[    0.012009] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[    0.012009] smp: Bringing up secondary CPUs ...
[    0.012009] x86: Booting SMP configuration:
[    0.012009] .... node  #0, CPUs:        #1  #2  #3  #4  #5  #6  #7
[    0.028046] smp: Brought up 1 node, 8 CPUs
[    0.028046] smpboot: Max logical packages: 2
[    0.028046] smpboot: Total of 8 processors activated (57490.91 BogoMIPS)
[    0.028904] devtmpfs: initialized
[    0.028904] x86/mm: Memory block size: 128MB
[    0.028904] PM: Registering ACPI NVS region [mem 0x0a200000-0x0a209fff] (40960 bytes)
[    0.028904] PM: Registering ACPI NVS region [mem 0x5bb0c000-0x5bf1cfff] (4263936 bytes)
[    0.028904] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.028904] futex hash table entries: 4096 (order: 6, 262144 bytes)
[    0.028904] pinctrl core: initialized pinctrl subsystem
[    0.028904] RTC time: 19:35:06, date: 2019-03-08
[    0.032108] NET: Registered protocol family 16
[    0.032201] audit: initializing netlink subsys (disabled)
[    0.032205] audit: type=2000 audit(1552073706.068:1): state=initialized audit_enabled=0 res=1
[    0.032205] EISA bus registered
[    0.032205] cpuidle: using governor ladder
[    0.032205] cpuidle: using governor menu
[    0.032205] ACPI: bus type PCI registered
[    0.032205] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.032378] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xf8000000-0xfbffffff] (base 0xf8000000)
[    0.032381] PCI: MMCONFIG at [mem 0xf8000000-0xfbffffff] reserved in E820
[    0.032389] PCI: Using configuration type 1 for base access
[    0.032768] mtrr: your CPUs had inconsistent variable MTRR settings
[    0.032769] mtrr: probably your BIOS does not setup all CPUs.
[    0.032769] mtrr: corrected configuration.
[    0.033859] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.033859] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.033859] ACPI: Added _OSI(Module Device)
[    0.033859] ACPI: Added _OSI(Processor Device)
[    0.033859] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.033859] ACPI: Added _OSI(Processor Aggregator Device)
[    0.033859] ACPI: Added _OSI(Linux-Dell-Video)
[    0.033859] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    0.033859] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    0.044702] ACPI: 8 ACPI AML tables successfully acquired and loaded
[    0.046506] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    0.048498] ACPI: Interpreter enabled
[    0.048514] ACPI: (supports S0 S3 S4 S5)
[    0.048515] ACPI: Using IOAPIC for interrupt routing
[    0.048936] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.049225] ACPI: Enabled 2 GPEs in block 00 to 1F
[    0.052229] ACPI: Power Resource [P0ST] (on)
[    0.052266] ACPI: Power Resource [P3ST] (on)
[    0.060797] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.060802] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.061039] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug LTR]
[    0.061265] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    0.061278] acpi PNP0A08:00: [Firmware Info]: MMCONFIG for domain 0000 [bus 00-3f] only partially covers this bridge
[    0.061733] PCI host bridge to bus 0000:00
[    0.061735] pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
[    0.061737] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
[    0.061738] pci_bus 0000:00: root bus resource [io  0x03b0-0x03df window]
[    0.061739] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.061741] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.061742] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000dffff window]
[    0.061743] pci_bus 0000:00: root bus resource [mem 0xe0000000-0xfec2ffff window]
[    0.061753] pci_bus 0000:00: root bus resource [mem 0xfee00000-0xffffffff window]
[    0.061754] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.061764] pci 0000:00:00.0: [1022:15d0] type 00 class 0x060000
[    0.061910] pci 0000:00:00.2: [1022:15d1] type 00 class 0x080600
[    0.062089] pci 0000:00:01.0: [1022:1452] type 00 class 0x060000
[    0.062212] pci 0000:00:01.1: [1022:15d3] type 01 class 0x060400
[    0.062265] pci 0000:00:01.1: enabling Extended Tags
[    0.062326] pci 0000:00:01.1: PME# supported from D0 D3hot D3cold
[    0.062480] pci 0000:00:01.2: [1022:15d3] type 01 class 0x060400
[    0.062533] pci 0000:00:01.2: enabling Extended Tags
[    0.062594] pci 0000:00:01.2: PME# supported from D0 D3hot D3cold
[    0.062749] pci 0000:00:01.3: [1022:15d3] type 01 class 0x060400
[    0.062802] pci 0000:00:01.3: enabling Extended Tags
[    0.062863] pci 0000:00:01.3: PME# supported from D0 D3hot D3cold
[    0.063025] pci 0000:00:08.0: [1022:1452] type 00 class 0x060000
[    0.063143] pci 0000:00:08.1: [1022:15db] type 01 class 0x060400
[    0.063196] pci 0000:00:08.1: enabling Extended Tags
[    0.063251] pci 0000:00:08.1: PME# supported from D0 D3hot D3cold
[    0.063370] pci 0000:00:08.2: [1022:15dc] type 01 class 0x060400
[    0.063422] pci 0000:00:08.2: enabling Extended Tags
[    0.063474] pci 0000:00:08.2: PME# supported from D0 D3hot D3cold
[    0.063626] pci 0000:00:14.0: [1022:790b] type 00 class 0x0c0500
[    0.063811] pci 0000:00:14.3: [1022:790e] type 00 class 0x060100
[    0.064000] pci 0000:00:18.0: [1022:15e8] type 00 class 0x060000
[    0.064067] pci 0000:00:18.1: [1022:15e9] type 00 class 0x060000
[    0.064139] pci 0000:00:18.2: [1022:15ea] type 00 class 0x060000
[    0.064196] pci 0000:00:18.3: [1022:15eb] type 00 class 0x060000
[    0.064252] pci 0000:00:18.4: [1022:15ec] type 00 class 0x060000
[    0.064306] pci 0000:00:18.5: [1022:15ed] type 00 class 0x060000
[    0.064368] pci 0000:00:18.6: [1022:15ee] type 00 class 0x060000
[    0.064425] pci 0000:00:18.7: [1022:15ef] type 00 class 0x060000
[    0.064587] pci 0000:01:00.0: [10ee:7022] type 00 class 0x058000
[    0.064614] pci 0000:01:00.0: reg 0x10: [mem 0xfe900000-0xfe9007ff]
[    0.064741] pci 0000:01:00.0: PME# supported from D0 D1 D2 D3hot
[    0.064828] pci 0000:00:01.1: PCI bridge to [bus 01]
[    0.064835] pci 0000:00:01.1:   bridge window [mem 0xfe900000-0xfe9fffff]
[    0.064921] pci 0000:02:00.0: [1022:43d5] type 00 class 0x0c0330
[    0.064951] pci 0000:02:00.0: reg 0x10: [mem 0xfe6a0000-0xfe6a7fff 64bit]
[    0.065000] pci 0000:02:00.0: enabling Extended Tags
[    0.065057] pci 0000:02:00.0: PME# supported from D3hot D3cold
[    0.065166] pci 0000:02:00.1: [1022:43c8] type 00 class 0x010601
[    0.065229] pci 0000:02:00.1: reg 0x24: [mem 0xfe680000-0xfe69ffff]
[    0.065238] pci 0000:02:00.1: reg 0x30: [mem 0xfe600000-0xfe67ffff pref]
[    0.065246] pci 0000:02:00.1: enabling Extended Tags
[    0.065293] pci 0000:02:00.1: PME# supported from D3hot D3cold
[    0.065376] pci 0000:02:00.2: [1022:43c6] type 01 class 0x060400
[    0.065428] pci 0000:02:00.2: enabling Extended Tags
[    0.065479] pci 0000:02:00.2: PME# supported from D3hot D3cold
[    0.065596] pci 0000:00:01.2: PCI bridge to [bus 02-09]
[    0.065601] pci 0000:00:01.2:   bridge window [io  0xf000-0xffff]
[    0.065604] pci 0000:00:01.2:   bridge window [mem 0xfe400000-0xfe6fffff]
[    0.065720] pci 0000:03:00.0: [1022:43c7] type 01 class 0x060400
[    0.065778] pci 0000:03:00.0: enabling Extended Tags
[    0.065838] pci 0000:03:00.0: PME# supported from D3hot D3cold
[    0.065936] pci 0000:03:01.0: [1022:43c7] type 01 class 0x060400
[    0.065994] pci 0000:03:01.0: enabling Extended Tags
[    0.066054] pci 0000:03:01.0: PME# supported from D3hot D3cold
[    0.066154] pci 0000:03:04.0: [1022:43c7] type 01 class 0x060400
[    0.066211] pci 0000:03:04.0: enabling Extended Tags
[    0.066271] pci 0000:03:04.0: PME# supported from D3hot D3cold
[    0.066377] pci 0000:03:05.0: [1022:43c7] type 01 class 0x060400
[    0.066434] pci 0000:03:05.0: enabling Extended Tags
[    0.066495] pci 0000:03:05.0: PME# supported from D3hot D3cold
[    0.066593] pci 0000:03:06.0: [1022:43c7] type 01 class 0x060400
[    0.066650] pci 0000:03:06.0: enabling Extended Tags
[    0.066710] pci 0000:03:06.0: PME# supported from D3hot D3cold
[    0.066804] pci 0000:03:07.0: [1022:43c7] type 01 class 0x060400
[    0.066861] pci 0000:03:07.0: enabling Extended Tags
[    0.066921] pci 0000:03:07.0: PME# supported from D3hot D3cold
[    0.067045] pci 0000:02:00.2: PCI bridge to [bus 03-09]
[    0.067051] pci 0000:02:00.2:   bridge window [io  0xf000-0xffff]
[    0.067054] pci 0000:02:00.2:   bridge window [mem 0xfe400000-0xfe5fffff]
[    0.067104] pci 0000:03:00.0: PCI bridge to [bus 04]
[    0.067170] pci 0000:03:01.0: PCI bridge to [bus 05]
[    0.067234] pci 0000:03:04.0: PCI bridge to [bus 06]
[    0.067313] pci 0000:07:00.0: [8086:2526] type 00 class 0x028000
[    0.067364] pci 0000:07:00.0: reg 0x10: [mem 0xfe500000-0xfe503fff 64bit]
[    0.067552] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold
[    0.067720] pci 0000:03:05.0: PCI bridge to [bus 07]
[    0.067729] pci 0000:03:05.0:   bridge window [mem 0xfe500000-0xfe5fffff]
[    0.067772] pci 0000:03:06.0: PCI bridge to [bus 08]
[    0.067858] pci 0000:09:00.0: [8086:1539] type 00 class 0x020000
[    0.067908] pci 0000:09:00.0: reg 0x10: [mem 0xfe400000-0xfe41ffff]
[    0.067946] pci 0000:09:00.0: reg 0x18: [io  0xf000-0xf01f]
[    0.067965] pci 0000:09:00.0: reg 0x1c: [mem 0xfe420000-0xfe423fff]
[    0.068156] pci 0000:09:00.0: PME# supported from D0 D3hot D3cold
[    0.068329] pci 0000:03:07.0: PCI bridge to [bus 09]
[    0.068335] pci 0000:03:07.0:   bridge window [io  0xf000-0xffff]
[    0.068338] pci 0000:03:07.0:   bridge window [mem 0xfe400000-0xfe4fffff]
[    0.068440] pci 0000:0a:00.0: [126f:2260] type 00 class 0x010802
[    0.068474] pci 0000:0a:00.0: reg 0x10: [mem 0xfe800000-0xfe803fff 64bit]
[    0.068724] pci 0000:00:01.3: PCI bridge to [bus 0a]
[    0.068731] pci 0000:00:01.3:   bridge window [mem 0xfe800000-0xfe8fffff]
[    0.068838] pci 0000:0b:00.0: [1002:15dd] type 00 class 0x030000
[    0.068884] pci 0000:0b:00.0: reg 0x10: [mem 0xe0000000-0xefffffff 64bit pref]
[    0.068902] pci 0000:0b:00.0: reg 0x18: [mem 0xf0000000-0xf01fffff 64bit pref]
[    0.068914] pci 0000:0b:00.0: reg 0x20: [io  0xe000-0xe0ff]
[    0.068925] pci 0000:0b:00.0: reg 0x24: [mem 0xfe300000-0xfe37ffff]
[    0.068945] pci 0000:0b:00.0: enabling Extended Tags
[    0.069049] pci 0000:0b:00.0: PME# supported from D1 D2 D3hot D3cold
[    0.069184] pci 0000:0b:00.1: [1002:15de] type 00 class 0x040300
[    0.069213] pci 0000:0b:00.1: reg 0x10: [mem 0xfe388000-0xfe38bfff]
[    0.069285] pci 0000:0b:00.1: enabling Extended Tags
[    0.069351] pci 0000:0b:00.1: PME# supported from D1 D2 D3hot D3cold
[    0.069432] pci 0000:0b:00.2: [1022:15df] type 00 class 0x108000
[    0.069482] pci 0000:0b:00.2: reg 0x18: [mem 0xfe200000-0xfe2fffff]
[    0.069514] pci 0000:0b:00.2: reg 0x24: [mem 0xfe38c000-0xfe38dfff]
[    0.069533] pci 0000:0b:00.2: enabling Extended Tags
[    0.069687] pci 0000:0b:00.3: [1022:15e0] type 00 class 0x0c0330
[    0.069722] pci 0000:0b:00.3: reg 0x10: [mem 0xfe100000-0xfe1fffff 64bit]
[    0.069783] pci 0000:0b:00.3: enabling Extended Tags
[    0.069857] pci 0000:0b:00.3: PME# supported from D0 D3hot D3cold
[    0.069952] pci 0000:0b:00.4: [1022:15e1] type 00 class 0x0c0330
[    0.069986] pci 0000:0b:00.4: reg 0x10: [mem 0xfe000000-0xfe0fffff 64bit]
[    0.070047] pci 0000:0b:00.4: enabling Extended Tags
[    0.070120] pci 0000:0b:00.4: PME# supported from D0 D3hot D3cold
[    0.070224] pci 0000:0b:00.6: [1022:15e3] type 00 class 0x040300
[    0.070252] pci 0000:0b:00.6: reg 0x10: [mem 0xfe380000-0xfe387fff]
[    0.070324] pci 0000:0b:00.6: enabling Extended Tags
[    0.070390] pci 0000:0b:00.6: PME# supported from D0 D3hot D3cold
[    0.070539] pci 0000:00:08.1: PCI bridge to [bus 0b]
[    0.070544] pci 0000:00:08.1:   bridge window [io  0xe000-0xefff]
[    0.070547] pci 0000:00:08.1:   bridge window [mem 0xfe000000-0xfe3fffff]
[    0.070552] pci 0000:00:08.1:   bridge window [mem 0xe0000000-0xf01fffff 64bit pref]
[    0.070639] pci 0000:0c:00.0: [1022:7901] type 00 class 0x010601
[    0.070721] pci 0000:0c:00.0: reg 0x24: [mem 0xfe700000-0xfe7007ff]
[    0.070741] pci 0000:0c:00.0: enabling Extended Tags
[    0.070823] pci 0000:0c:00.0: PME# supported from D3hot D3cold
[    0.070942] pci 0000:00:08.2: PCI bridge to [bus 0c]
[    0.070950] pci 0000:00:08.2:   bridge window [mem 0xfe700000-0xfe7fffff]
[    0.071316] ACPI: PCI Interrupt Link [LNKA] (IRQs 4 5 7 10 11 14 15) *0
[    0.071373] ACPI: PCI Interrupt Link [LNKB] (IRQs 4 5 7 10 11 14 15) *0
[    0.071421] ACPI: PCI Interrupt Link [LNKC] (IRQs 4 5 7 10 11 14 15) *0
[    0.071482] ACPI: PCI Interrupt Link [LNKD] (IRQs 4 5 7 10 11 14 15) *0
[    0.071537] ACPI: PCI Interrupt Link [LNKE] (IRQs 4 5 7 10 11 14 15) *0
[    0.071581] ACPI: PCI Interrupt Link [LNKF] (IRQs 4 5 7 10 11 14 15) *0
[    0.071625] ACPI: PCI Interrupt Link [LNKG] (IRQs 4 5 7 10 11 14 15) *0
[    0.071670] ACPI: PCI Interrupt Link [LNKH] (IRQs 4 5 7 10 11 14 15) *0
[    0.072151] pci 0000:0b:00.0: vgaarb: setting as boot VGA device
[    0.072151] pci 0000:0b:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.072151] pci 0000:0b:00.0: vgaarb: bridge control possible
[    0.072151] vgaarb: loaded
[    0.072260] SCSI subsystem initialized
[    0.072274] libata version 3.00 loaded.
[    0.072274] ACPI: bus type USB registered
[    0.072274] usbcore: registered new interface driver usbfs
[    0.072274] usbcore: registered new interface driver hub
[    0.072274] usbcore: registered new device driver usb
[    0.072274] pps_core: LinuxPPS API ver. 1 registered
[    0.072274] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.072274] PTP clock support registered
[    0.072274] EDAC MC: Ver: 3.0.0
[    0.072274] PCI: Using ACPI for IRQ routing
[    0.073710] PCI: pci_cache_line_size set to 64 bytes
[    0.073829] e820: reserve RAM buffer [mem 0x0009ec00-0x0009ffff]
[    0.073830] e820: reserve RAM buffer [mem 0x09d00000-0x0bffffff]
[    0.073831] e820: reserve RAM buffer [mem 0x0a200000-0x0bffffff]
[    0.073832] e820: reserve RAM buffer [mem 0x0b000000-0x0bffffff]
[    0.073833] e820: reserve RAM buffer [mem 0x5b863000-0x5bffffff]
[    0.073834] e820: reserve RAM buffer [mem 0x5bb0c000-0x5bffffff]
[    0.073835] e820: reserve RAM buffer [mem 0x5f000000-0x5fffffff]
[    0.073835] e820: reserve RAM buffer [mem 0x21f340000-0x21fffffff]
[    0.073973] NetLabel: Initializing
[    0.073974] NetLabel:  domain hash size = 128
[    0.073974] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.073986] NetLabel:  unlabeled traffic allowed by default
[    0.076066] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.076068] hpet0: 3 comparators, 32-bit 14.318180 MHz counter
[    0.078115] clocksource: Switched to clocksource tsc-early
[    0.088895] VFS: Disk quotas dquot_6.6.0
[    0.088936] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.089111] AppArmor: AppArmor Filesystem Enabled
[    0.089142] pnp: PnP ACPI init
[    0.089319] system 00:00: [mem 0xf8000000-0xfbffffff] has been reserved
[    0.089324] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.089383] system 00:01: [mem 0x60000000-0xdfffffff window] has been reserved
[    0.089385] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.089496] pnp 00:02: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.089644] system 00:03: [io  0x0a00-0x0a2f] has been reserved
[    0.089645] system 00:03: [io  0x0a30-0x0a3f] has been reserved
[    0.089646] system 00:03: [io  0x0a40-0x0a4f] has been reserved
[    0.089649] system 00:03: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.089878] system 00:04: [io  0x04d0-0x04d1] has been reserved
[    0.089879] system 00:04: [io  0x040b] has been reserved
[    0.089880] system 00:04: [io  0x04d6] has been reserved
[    0.089881] system 00:04: [io  0x0c00-0x0c01] has been reserved
[    0.089882] system 00:04: [io  0x0c14] has been reserved
[    0.089883] system 00:04: [io  0x0c50-0x0c51] has been reserved
[    0.089884] system 00:04: [io  0x0c52] has been reserved
[    0.089885] system 00:04: [io  0x0c6c] has been reserved
[    0.089886] system 00:04: [io  0x0c6f] has been reserved
[    0.089886] system 00:04: [io  0x0cd0-0x0cd1] has been reserved
[    0.089887] system 00:04: [io  0x0cd2-0x0cd3] has been reserved
[    0.089888] system 00:04: [io  0x0cd4-0x0cd5] has been reserved
[    0.089889] system 00:04: [io  0x0cd6-0x0cd7] has been reserved
[    0.089890] system 00:04: [io  0x0cd8-0x0cdf] has been reserved
[    0.089891] system 00:04: [io  0x0800-0x089f] has been reserved
[    0.089892] system 00:04: [io  0x0b00-0x0b0f] has been reserved
[    0.089892] system 00:04: [io  0x0b20-0x0b3f] has been reserved
[    0.089893] system 00:04: [io  0x0900-0x090f] has been reserved
[    0.089894] system 00:04: [io  0x0910-0x091f] has been reserved
[    0.089896] system 00:04: [mem 0xfec00000-0xfec00fff] could not be reserved
[    0.089897] system 00:04: [mem 0xfec01000-0xfec01fff] could not be reserved
[    0.089898] system 00:04: [mem 0xfedc0000-0xfedc0fff] has been reserved
[    0.089899] system 00:04: [mem 0xfee00000-0xfee00fff] has been reserved
[    0.089900] system 00:04: [mem 0xfed80000-0xfed8ffff] could not be reserved
[    0.089901] system 00:04: [mem 0xfec10000-0xfec10fff] has been reserved
[    0.089902] system 00:04: [mem 0xff000000-0xffffffff] has been reserved
[    0.089904] system 00:04: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.090319] pnp: PnP ACPI: found 5 devices
[    0.096205] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.096307] pci 0000:00:01.1: PCI bridge to [bus 01]
[    0.096313] pci 0000:00:01.1:   bridge window [mem 0xfe900000-0xfe9fffff]
[    0.096322] pci 0000:03:00.0: PCI bridge to [bus 04]
[    0.096334] pci 0000:03:01.0: PCI bridge to [bus 05]
[    0.096346] pci 0000:03:04.0: PCI bridge to [bus 06]
[    0.096358] pci 0000:03:05.0: PCI bridge to [bus 07]
[    0.096363] pci 0000:03:05.0:   bridge window [mem 0xfe500000-0xfe5fffff]
[    0.096371] pci 0000:03:06.0: PCI bridge to [bus 08]
[    0.096383] pci 0000:03:07.0: PCI bridge to [bus 09]
[    0.096385] pci 0000:03:07.0:   bridge window [io  0xf000-0xffff]
[    0.096390] pci 0000:03:07.0:   bridge window [mem 0xfe400000-0xfe4fffff]
[    0.096398] pci 0000:02:00.2: PCI bridge to [bus 03-09]
[    0.096400] pci 0000:02:00.2:   bridge window [io  0xf000-0xffff]
[    0.096404] pci 0000:02:00.2:   bridge window [mem 0xfe400000-0xfe5fffff]
[    0.096412] pci 0000:00:01.2: PCI bridge to [bus 02-09]
[    0.096414] pci 0000:00:01.2:   bridge window [io  0xf000-0xffff]
[    0.096418] pci 0000:00:01.2:   bridge window [mem 0xfe400000-0xfe6fffff]
[    0.096426] pci 0000:00:01.3: PCI bridge to [bus 0a]
[    0.096431] pci 0000:00:01.3:   bridge window [mem 0xfe800000-0xfe8fffff]
[    0.096439] pci 0000:00:08.1: PCI bridge to [bus 0b]
[    0.096441] pci 0000:00:08.1:   bridge window [io  0xe000-0xefff]
[    0.096446] pci 0000:00:08.1:   bridge window [mem 0xfe000000-0xfe3fffff]
[    0.096449] pci 0000:00:08.1:   bridge window [mem 0xe0000000-0xf01fffff 64bit pref]
[    0.096455] pci 0000:00:08.2: PCI bridge to [bus 0c]
[    0.096459] pci 0000:00:08.2:   bridge window [mem 0xfe700000-0xfe7fffff]
[    0.096468] pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    0.096469] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    0.096470] pci_bus 0000:00: resource 6 [io  0x03b0-0x03df window]
[    0.096471] pci_bus 0000:00: resource 7 [io  0x0d00-0xffff window]
[    0.096472] pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000bffff window]
[    0.096473] pci_bus 0000:00: resource 9 [mem 0x000c0000-0x000dffff window]
[    0.096474] pci_bus 0000:00: resource 10 [mem 0xe0000000-0xfec2ffff window]
[    0.096475] pci_bus 0000:00: resource 11 [mem 0xfee00000-0xffffffff window]
[    0.096476] pci_bus 0000:01: resource 1 [mem 0xfe900000-0xfe9fffff]
[    0.096477] pci_bus 0000:02: resource 0 [io  0xf000-0xffff]
[    0.096478] pci_bus 0000:02: resource 1 [mem 0xfe400000-0xfe6fffff]
[    0.096478] pci_bus 0000:03: resource 0 [io  0xf000-0xffff]
[    0.096479] pci_bus 0000:03: resource 1 [mem 0xfe400000-0xfe5fffff]
[    0.096480] pci_bus 0000:07: resource 1 [mem 0xfe500000-0xfe5fffff]
[    0.096481] pci_bus 0000:09: resource 0 [io  0xf000-0xffff]
[    0.096482] pci_bus 0000:09: resource 1 [mem 0xfe400000-0xfe4fffff]
[    0.096483] pci_bus 0000:0a: resource 1 [mem 0xfe800000-0xfe8fffff]
[    0.096484] pci_bus 0000:0b: resource 0 [io  0xe000-0xefff]
[    0.096485] pci_bus 0000:0b: resource 1 [mem 0xfe000000-0xfe3fffff]
[    0.096486] pci_bus 0000:0b: resource 2 [mem 0xe0000000-0xf01fffff 64bit pref]
[    0.096487] pci_bus 0000:0c: resource 1 [mem 0xfe700000-0xfe7fffff]
[    0.096686] NET: Registered protocol family 2
[    0.096955] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes)
[    0.096981] TCP established hash table entries: 65536 (order: 7, 524288 bytes)
[    0.097093] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.097233] TCP: Hash tables configured (established 65536 bind 65536)
[    0.097297] UDP hash table entries: 4096 (order: 5, 131072 bytes)
[    0.097320] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)
[    0.097462] NET: Registered protocol family 1
[    0.097466] NET: Registered protocol family 44
[    0.097725] pci 0000:0b:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.097735] pci 0000:0b:00.1: Linked as a consumer to 0000:0b:00.0
[    0.098034] PCI: CLS 64 bytes, default 64
[    0.098076] Unpacking initramfs...
[    0.488774] Freeing initrd memory: 37652K
[    0.488807] AMD-Vi: Unable to write to IOMMU perf counter.
[    0.488969] pci 0000:00:00.2: can't derive routing for PCI INT A
[    0.488970] pci 0000:00:00.2: PCI INT A: not connected
[    0.489449] iommu: Adding device 0000:00:01.0 to group 0
[    0.489665] iommu: Adding device 0000:00:01.1 to group 1
[    0.489882] iommu: Adding device 0000:00:01.2 to group 2
[    0.490081] iommu: Adding device 0000:00:01.3 to group 3
[    0.490307] iommu: Adding device 0000:00:08.0 to group 4
[    0.490509] iommu: Adding device 0000:00:08.1 to group 5
[    0.490535] iommu: Adding device 0000:00:08.2 to group 4
[    0.490748] iommu: Adding device 0000:00:14.0 to group 6
[    0.490771] iommu: Adding device 0000:00:14.3 to group 6
[    0.490992] iommu: Adding device 0000:00:18.0 to group 7
[    0.491015] iommu: Adding device 0000:00:18.1 to group 7
[    0.491036] iommu: Adding device 0000:00:18.2 to group 7
[    0.491059] iommu: Adding device 0000:00:18.3 to group 7
[    0.491081] iommu: Adding device 0000:00:18.4 to group 7
[    0.491102] iommu: Adding device 0000:00:18.5 to group 7
[    0.491124] iommu: Adding device 0000:00:18.6 to group 7
[    0.491145] iommu: Adding device 0000:00:18.7 to group 7
[    0.491356] iommu: Adding device 0000:01:00.0 to group 8
[    0.491579] iommu: Adding device 0000:02:00.0 to group 9
[    0.491616] iommu: Adding device 0000:02:00.1 to group 9
[    0.491650] iommu: Adding device 0000:02:00.2 to group 9
[    0.491673] iommu: Adding device 0000:03:00.0 to group 9
[    0.491703] iommu: Adding device 0000:03:01.0 to group 9
[    0.491725] iommu: Adding device 0000:03:04.0 to group 9
[    0.491747] iommu: Adding device 0000:03:05.0 to group 9
[    0.491780] iommu: Adding device 0000:03:06.0 to group 9
[    0.491802] iommu: Adding device 0000:03:07.0 to group 9
[    0.491829] iommu: Adding device 0000:07:00.0 to group 9
[    0.491857] iommu: Adding device 0000:09:00.0 to group 9
[    0.492062] iommu: Adding device 0000:0a:00.0 to group 10
[    0.492350] iommu: Adding device 0000:0b:00.0 to group 11
[    0.492441] iommu: Using direct mapping for device 0000:0b:00.0
[    0.492543] iommu: Adding device 0000:0b:00.1 to group 12
[    0.492592] iommu: Adding device 0000:0b:00.2 to group 12
[    0.492646] iommu: Adding device 0000:0b:00.3 to group 12
[    0.492695] iommu: Adding device 0000:0b:00.4 to group 12
[    0.492737] iommu: Adding device 0000:0b:00.6 to group 12
[    0.492759] iommu: Adding device 0000:0c:00.0 to group 4
[    0.493055] AMD-Vi: Found IOMMU at 0000:00:00.2 cap 0x40
[    0.493056] AMD-Vi: Extended features (0x4f77ef22294ada):
[    0.493056]  PPR NX GT IA GA PC GA_vAPIC
[    0.493058] AMD-Vi: Interrupt remapping enabled
[    0.493058] AMD-Vi: Virtual APIC enabled
[    0.493248] AMD-Vi: Lazy IO/TLB flushing enabled
[    0.494122] amd_uncore: AMD NB counters detected
[    0.494126] amd_uncore: AMD LLC counters detected
[    0.494425] check: Scanning for low memory corruption every 60 seconds
[    0.496301] Initialise system trusted keyrings
[    0.496356] Key type blacklist registered
[    0.496430] workingset: timestamp_bits=36 max_order=21 bucket_order=0
[    0.498148] zbud: loaded
[    0.498903] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.499306] fuse init (API version 7.28)
[    0.534437] Key type asymmetric registered
[    0.534438] Asymmetric key parser 'x509' registered
[    0.534453] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[    0.534503] io scheduler mq-deadline registered
[    0.535534] pcieport 0000:00:01.1: Signaling PME with IRQ 26
[    0.535640] aer 0000:00:01.1:pcie002: AER enabled with IRQ 26
[    0.535793] pcieport 0000:00:01.2: Signaling PME with IRQ 27
[    0.535893] aer 0000:00:01.2:pcie002: AER enabled with IRQ 27
[    0.536044] pcieport 0000:00:01.3: Signaling PME with IRQ 28
[    0.536130] aer 0000:00:01.3:pcie002: AER enabled with IRQ 28
[    0.536264] pcieport 0000:00:08.1: Signaling PME with IRQ 29
[    0.536514] pcieport 0000:00:08.2: Signaling PME with IRQ 30
[    0.537677] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    0.537753] vesafb: mode is 640x480x32, linelength=2560, pages=0
[    0.537754] vesafb: scrolling: redraw
[    0.537755] vesafb: Truecolor: size=0:8:8:8, shift=0:16:8:0
[    0.537762] vesafb: framebuffer at 0xe0000000, mapped to 0x00000000a3781d9b, using 1216k, total 1216k
[    0.549985] Console: switching to colour frame buffer device 80x30
[    0.557030] fb0: VESA VGA frame buffer device
[    0.557133] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
[    0.557139] ACPI: Power Button [PWRB]
[    0.557174] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1
[    0.557183] ACPI: Power Button [PWRF]
[    0.557218] Monitor-Mwait will be used to enter C-1 state
[    0.558195] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    0.559580] Linux agpgart interface v0.103
[    0.562956] loop: module loaded
[    0.563159] libphy: Fixed MDIO Bus: probed
[    0.563159] tun: Universal TUN/TAP device driver, 1.6
[    0.563185] PPP generic driver version 2.4.2
[    0.563215] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    0.563217] ehci-pci: EHCI PCI platform driver
[    0.563228] ehci-platform: EHCI generic platform driver
[    0.563233] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    0.563242] ohci-pci: OHCI PCI platform driver
[    0.563247] ohci-platform: OHCI generic platform driver
[    0.563250] uhci_hcd: USB Universal Host Controller Interface driver
[    0.563364] xhci_hcd 0000:02:00.0: xHCI Host Controller
[    0.563369] xhci_hcd 0000:02:00.0: new USB bus registered, assigned bus number 1
[    0.618622] xhci_hcd 0000:02:00.0: hcc params 0x0200ef81 hci version 0x110 quirks 0x0000000000000410
[    0.618843] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.00
[    0.618844] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.618845] usb usb1: Product: xHCI Host Controller
[    0.618846] usb usb1: Manufacturer: Linux 5.0.0-050000-generic xhci-hcd
[    0.618847] usb usb1: SerialNumber: 0000:02:00.0
[    0.618955] hub 1-0:1.0: USB hub found
[    0.618970] hub 1-0:1.0: 10 ports detected
[    0.619276] xhci_hcd 0000:02:00.0: xHCI Host Controller
[    0.619278] xhci_hcd 0000:02:00.0: new USB bus registered, assigned bus number 2
[    0.619279] xhci_hcd 0000:02:00.0: Host supports USB 3.10 Enhanced SuperSpeed
[    0.619312] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    0.619323] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.00
[    0.619324] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.619325] usb usb2: Product: xHCI Host Controller
[    0.619326] usb usb2: Manufacturer: Linux 5.0.0-050000-generic xhci-hcd
[    0.619326] usb usb2: SerialNumber: 0000:02:00.0
[    0.619405] hub 2-0:1.0: USB hub found
[    0.619419] hub 2-0:1.0: 4 ports detected
[    0.619499] usb: port power management may be unreliable
[    0.619635] xhci_hcd 0000:0b:00.3: xHCI Host Controller
[    0.619638] xhci_hcd 0000:0b:00.3: new USB bus registered, assigned bus number 3
[    0.619828] xhci_hcd 0000:0b:00.3: hcc params 0x0270ffe5 hci version 0x110 quirks 0x0000000840000410
[    0.620332] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.00
[    0.620333] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.620333] usb usb3: Product: xHCI Host Controller
[    0.620334] usb usb3: Manufacturer: Linux 5.0.0-050000-generic xhci-hcd
[    0.620335] usb usb3: SerialNumber: 0000:0b:00.3
[    0.620415] hub 3-0:1.0: USB hub found
[    0.620427] hub 3-0:1.0: 4 ports detected
[    0.620601] xhci_hcd 0000:0b:00.3: xHCI Host Controller
[    0.620603] xhci_hcd 0000:0b:00.3: new USB bus registered, assigned bus number 4
[    0.620605] xhci_hcd 0000:0b:00.3: Host supports USB 3.10 Enhanced SuperSpeed
[    0.620630] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
[    0.620642] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.00
[    0.620643] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.620644] usb usb4: Product: xHCI Host Controller
[    0.620644] usb usb4: Manufacturer: Linux 5.0.0-050000-generic xhci-hcd
[    0.620645] usb usb4: SerialNumber: 0000:0b:00.3
[    0.620717] hub 4-0:1.0: USB hub found
[    0.620730] hub 4-0:1.0: 4 ports detected
[    0.621090] xhci_hcd 0000:0b:00.4: xHCI Host Controller
[    0.621100] xhci_hcd 0000:0b:00.4: new USB bus registered, assigned bus number 5
[    0.621254] xhci_hcd 0000:0b:00.4: hcc params 0x0260ffe5 hci version 0x110 quirks 0x0000000840000410
[    0.621733] usb usb5: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.00
[    0.621734] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.621735] usb usb5: Product: xHCI Host Controller
[    0.621735] usb usb5: Manufacturer: Linux 5.0.0-050000-generic xhci-hcd
[    0.621736] usb usb5: SerialNumber: 0000:0b:00.4
[    0.621814] hub 5-0:1.0: USB hub found
[    0.621823] hub 5-0:1.0: 1 port detected
[    0.621919] xhci_hcd 0000:0b:00.4: xHCI Host Controller
[    0.621921] xhci_hcd 0000:0b:00.4: new USB bus registered, assigned bus number 6
[    0.621922] xhci_hcd 0000:0b:00.4: Host supports USB 3.10 Enhanced SuperSpeed
[    0.621946] usb usb6: We don't know the algorithms for LPM for this host, disabling LPM.
[    0.621958] usb usb6: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.00
[    0.621959] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.621960] usb usb6: Product: xHCI Host Controller
[    0.621961] usb usb6: Manufacturer: Linux 5.0.0-050000-generic xhci-hcd
[    0.621962] usb usb6: SerialNumber: 0000:0b:00.4
[    0.622033] hub 6-0:1.0: USB hub found
[    0.622042] hub 6-0:1.0: 1 port detected
[    0.622133] i8042: PNP: No PS/2 controller found.
[    0.622184] mousedev: PS/2 mouse device common for all mice
[    0.622302] rtc_cmos 00:02: RTC can wake from S4
[    0.622556] rtc_cmos 00:02: registered as rtc0
[    0.622573] rtc_cmos 00:02: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[    0.622577] i2c /dev entries driver
[    0.622735] device-mapper: uevent: version 1.0.3
[    0.622822] device-mapper: ioctl: 4.39.0-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[    0.622844] platform eisa.0: Probing EISA bus 0
[    0.622853] platform eisa.0: EISA: Cannot allocate resource for mainboard
[    0.622854] platform eisa.0: Cannot allocate resource for EISA slot 1
[    0.622855] platform eisa.0: Cannot allocate resource for EISA slot 2
[    0.622855] platform eisa.0: Cannot allocate resource for EISA slot 3
[    0.622856] platform eisa.0: Cannot allocate resource for EISA slot 4
[    0.622857] platform eisa.0: Cannot allocate resource for EISA slot 5
[    0.622857] platform eisa.0: Cannot allocate resource for EISA slot 6
[    0.622858] platform eisa.0: Cannot allocate resource for EISA slot 7
[    0.622859] platform eisa.0: Cannot allocate resource for EISA slot 8
[    0.622860] platform eisa.0: EISA: Detected 0 cards
[    0.623002] ledtrig-cpu: registered to indicate activity on CPUs
[    0.623366] NET: Registered protocol family 10
[    0.629171] Segment Routing with IPv6
[    0.629184] NET: Registered protocol family 17
[    0.629308] Key type dns_resolver registered
[    0.630061] RAS: Correctable Errors collector initialized.
[    0.630099] microcode: CPU0: patch_level=0x0810100b
[    0.630106] microcode: CPU1: patch_level=0x0810100b
[    0.630113] microcode: CPU2: patch_level=0x0810100b
[    0.630115] microcode: CPU3: patch_level=0x0810100b
[    0.630134] microcode: CPU4: patch_level=0x0810100b
[    0.630141] microcode: CPU5: patch_level=0x0810100b
[    0.630159] microcode: CPU6: patch_level=0x0810100b
[    0.630166] microcode: CPU7: patch_level=0x0810100b
[    0.630198] microcode: Microcode Update Driver: v2.2.
[    0.630219] sched_clock: Marking stable (666186404, -35990672)->(850356491, -220160759)
[    0.630471] registered taskstats version 1
[    0.630479] Loading compiled-in X.509 certificates
[    0.631853] Loaded X.509 cert 'Build time autogenerated kernel key: 46ae78472b5cfc8dfc63f9799e9fd780babcd4f1'
[    0.631886] zswap: loaded using pool lzo/zbud
[    0.635849] Key type big_key registered
[    0.635851] Key type trusted registered
[    0.637734] Key type encrypted registered
[    0.637735] AppArmor: AppArmor sha1 policy hashing enabled
[    0.637739] ima: No TPM chip found, activating TPM-bypass!
[    0.637755] ima: Allocated hash algorithm: sha1
[    0.637760] No architecture policies found
[    0.637775] evm: Initialising EVM extended attributes:
[    0.637776] evm: security.selinux
[    0.637776] evm: security.SMACK64
[    0.637776] evm: security.SMACK64EXEC
[    0.637776] evm: security.SMACK64TRANSMUTE
[    0.637777] evm: security.SMACK64MMAP
[    0.637777] evm: security.apparmor
[    0.637777] evm: security.ima
[    0.637777] evm: security.capability
[    0.637778] evm: HMAC attrs: 0x1
[    0.638508]   Magic number: 11:626:596
[    0.638638] rtc_cmos 00:02: setting system clock to 2019-03-08T19:35:07 UTC (1552073707)
[    0.638778] acpi_cpufreq: overriding BIOS provided _PSD data
[    0.640471] Freeing unused decrypted memory: 2040K
[    0.640907] Freeing unused kernel image memory: 2564K
[    0.661837] Write protecting the kernel read-only data: 22528k
[    0.662464] Freeing unused kernel image memory: 2016K
[    0.662848] Freeing unused kernel image memory: 1756K
[    0.672362] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    0.672367] Run /init as init process
[    0.727902] ACPI: Video Device [VGA] (multi-head: yes  rom: no  post: no)
[    0.728252] acpi device:02: registered as cooling_device8
[    0.728309] input: Video Bus as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:01/LNXVIDEO:00/input/input2
[    0.735704] ahci 0000:02:00.1: version 3.0
[    0.735942] ahci 0000:02:00.1: SSS flag set, parallel bus scan disabled
[    0.735995] ahci 0000:02:00.1: AHCI 0001.0301 32 slots 8 ports 6 Gbps 0x33 impl SATA mode
[    0.735997] ahci 0000:02:00.1: flags: 64bit ncq sntf stag pm led clo only pmp pio slum part sxs deso sadm sds apst 
[    0.737247] scsi host0: ahci
[    0.738555] piix4_smbus 0000:00:14.0: SMBus Host Controller at 0xb00, revision 0
[    0.738557] piix4_smbus 0000:00:14.0: Using register 0x02 for SMBus port selection
[    0.738608] dca service started, version 1.12.1
[    0.742283] scsi host1: ahci
[    0.742752] scsi host2: ahci
[    0.743024] scsi host3: ahci
[    0.743242] scsi host4: ahci
[    0.743521] scsi host5: ahci
[    0.743681] scsi host6: ahci
[    0.743976] scsi host7: ahci
[    0.744058] ata1: SATA max UDMA/133 abar m131072@0xfe680000 port 0xfe680100 irq 61
[    0.744060] ata2: SATA max UDMA/133 abar m131072@0xfe680000 port 0xfe680180 irq 61
[    0.744061] ata3: DUMMY
[    0.744062] ata4: DUMMY
[    0.744064] ata5: SATA max UDMA/133 abar m131072@0xfe680000 port 0xfe680300 irq 61
[    0.744066] ata6: SATA max UDMA/133 abar m131072@0xfe680000 port 0xfe680380 irq 61
[    0.744067] ata7: DUMMY
[    0.744067] ata8: DUMMY
[    0.755232] ahci 0000:0c:00.0: AHCI 0001.0301 32 slots 2 ports 6 Gbps 0x3 impl SATA mode
[    0.755235] ahci 0000:0c:00.0: flags: 64bit ncq sntf ilck pm led clo only pmp fbs pio slum part sxs 
[    0.755238] ahci 0000:0c:00.0: both AHCI_HFLAG_MULTI_MSI flag set and custom irq handler implemented
[    0.755696] scsi host8: ahci
[    0.755871] scsi host9: ahci
[    0.755981] ata9: SATA max UDMA/133 abar m2048@0xfe700000 port 0xfe700100 irq 63
[    0.755985] ata10: SATA max UDMA/133 abar m2048@0xfe700000 port 0xfe700180 irq 64
[    0.762660] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    0.762661] igb: Copyright (c) 2007-2014 Intel Corporation.
[    0.763581] nvme nvme0: pci function 0000:0a:00.0
[    0.796212] pps pps0: new PPS source ptp0
[    0.796214] igb 0000:09:00.0: added PHC on eth0
[    0.796215] igb 0000:09:00.0: Intel(R) Gigabit Ethernet Network Connection
[    0.796217] igb 0000:09:00.0: eth0: (PCIe:2.5Gb/s:Width x1) e0:d5:5e:e1:b1:ec
[    0.796218] igb 0000:09:00.0: eth0: PBA No: FFFFFF-0FF
[    0.796219] igb 0000:09:00.0: Using MSI-X interrupts. 2 rx queue(s), 2 tx queue(s)
[    0.796915] igb 0000:09:00.0 enp9s0: renamed from eth0
[    0.953874] usb 1-2: new full-speed USB device number 2 using xhci_hcd
[    0.953881] usb 3-3: new high-speed USB device number 2 using xhci_hcd
[    0.959980] usb 5-1: new high-speed USB device number 2 using xhci_hcd
[    0.983182] nvme nvme0: 8/0/0 default/read/poll queues
[    0.984890]  nvme0n1: p1 p2 p3 p4 p5
[    1.060624] ata1: SATA link down (SStatus 0 SControl 330)
[    1.071143] ata10: SATA link down (SStatus 0 SControl 300)
[    1.071218] ata9: SATA link down (SStatus 0 SControl 300)
[    1.102290] usb 3-3: New USB device found, idVendor=05e3, idProduct=0608, bcdDevice=32.98
[    1.102292] usb 3-3: New USB device strings: Mfr=0, Product=1, SerialNumber=0
[    1.102294] usb 3-3: Product: USB2.0 Hub
[    1.114741] usb 5-1: New USB device found, idVendor=0403, idProduct=6010, bcdDevice= 7.00
[    1.114744] usb 5-1: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    1.114745] usb 5-1: Product: Digilent Adept USB Device
[    1.114747] usb 5-1: Manufacturer: Digilent
[    1.114748] usb 5-1: SerialNumber: 210203A3CF6A
[    1.166508] hub 3-3:1.0: USB hub found
[    1.166892] hub 3-3:1.0: 4 ports detected
[    1.363688] usb 1-2: New USB device found, idVendor=046d, idProduct=c52b, bcdDevice=12.03
[    1.363690] usb 1-2: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    1.363692] usb 1-2: Product: USB Receiver
[    1.363693] usb 1-2: Manufacturer: Logitech
[    1.372377] ata2: SATA link down (SStatus 0 SControl 330)
[    1.456515] usb 3-3.3: new low-speed USB device number 3 using xhci_hcd
[    1.496085] tsc: Refined TSC clocksource calibration: 3596.372 MHz
[    1.496101] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x33d6f00d8af, max_idle_ns: 440795257601 ns
[    1.496367] clocksource: Switched to clocksource tsc
[    1.508351] usb 1-10: new full-speed USB device number 3 using xhci_hcd
[    1.573687] usb 3-3.3: New USB device found, idVendor=413c, idProduct=2107, bcdDevice= 1.04
[    1.573691] usb 3-3.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    1.573693] usb 3-3.3: Product: Dell USB Entry Keyboard
[    1.573696] usb 3-3.3: Manufacturer: DELL
[    1.618371] hidraw: raw HID events driver (C) Jiri Kosina
[    1.674831] usbcore: registered new interface driver usbhid
[    1.674833] usbhid: USB HID core driver
[    1.677178] input: DELL Dell USB Entry Keyboard as /devices/pci0000:00/0000:00:08.1/0000:0b:00.3/usb3/3-3/3-3.3/3-3.3:1.0/0003:413C:2107.0004/input/input3
[    1.687753] ata5: SATA link down (SStatus 0 SControl 330)
[    1.696057] usb 3-3.4: new high-speed USB device number 4 using xhci_hcd
[    1.736526] hid-generic 0003:413C:2107.0004: input,hidraw0: USB HID v1.11 Keyboard [DELL Dell USB Entry Keyboard] on usb-0000:0b:00.3-3.3/input0
[    1.798293] usb 3-3.4: New USB device found, idVendor=05e3, idProduct=0608, bcdDevice=32.98
[    1.798296] usb 3-3.4: New USB device strings: Mfr=0, Product=1, SerialNumber=0
[    1.798297] usb 3-3.4: Product: USB2.0 Hub
[    1.834851] usb 1-10: New USB device found, idVendor=8087, idProduct=0025, bcdDevice= 0.02
[    1.834854] usb 1-10: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    1.837800] hub 3-3.4:1.0: USB hub found
[    1.838249] hub 3-3.4:1.0: 4 ports detected
[    1.851933] logitech-djreceiver 0003:046D:C52B.0003: hiddev0,hidraw1: USB HID v1.11 Device [Logitech USB Receiver] on usb-0000:02:00.0-2/input2
[    1.974746] input: Logitech Unifying Device. Wireless PID:4013 Mouse as /devices/pci0000:00/0000:00:01.2/0000:02:00.0/usb1/1-2/1-2:1.2/0003:046D:C52B.0003/0003:046D:4013.0005/input/input4
[    1.974894] hid-generic 0003:046D:4013.0005: input,hidraw2: USB HID v1.11 Mouse [Logitech Unifying Device. Wireless PID:4013] on usb-0000:02:00.0-2:1
[    2.000875] ata6: SATA link down (SStatus 0 SControl 330)
[    2.028064] input: Logitech M525 as /devices/pci0000:00/0000:00:01.2/0000:02:00.0/usb1/1-2/1-2:1.2/0003:046D:C52B.0003/0003:046D:4013.0005/input/input8
[    2.028208] logitech-hidpp-device 0003:046D:4013.0005: input,hidraw2: USB HID v1.11 Mouse [Logitech M525] on usb-0000:02:00.0-2:1
[    2.052405] random: fast init done
[    2.068494] EXT4-fs (nvme0n1p5): mounted filesystem with ordered data mode. Opts: (null)
[    2.132049] usb 3-3.4.2: new full-speed USB device number 5 using xhci_hcd
[    2.151611] systemd[1]: systemd 239 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 +IDN -PCRE2 default-hierarchy=hybrid)
[    2.168639] systemd[1]: Detected architecture x86-64.
[    2.176417] systemd[1]: Set hostname to <ravenu>.
[    2.250858] random: systemd: uninitialized urandom read (16 bytes read)
[    2.250914] systemd[1]: Listening on initctl Compatibility Named Pipe.
[    2.250958] random: systemd: uninitialized urandom read (16 bytes read)
[    2.252000] usb 3-3.4.2: New USB device found, idVendor=09fb, idProduct=6001, bcdDevice= 4.00
[    2.252002] usb 3-3.4.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    2.252003] usb 3-3.4.2: Product: USB-Blaster
[    2.252004] usb 3-3.4.2: Manufacturer: Altera
[    2.252006] usb 3-3.4.2: SerialNumber: 91d28408
[    2.252652] systemd[1]: Created slice User and Session Slice.
[    2.252659] random: systemd: uninitialized urandom read (16 bytes read)
[    2.252677] systemd[1]: Reached target Slices.
[    2.252950] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[    2.252975] systemd[1]: Reached target Remote File Systems.
[    2.253013] systemd[1]: Started Forward Password Requests to Wall Directory Watch.
[    2.253068] systemd[1]: Listening on udev Kernel Socket.
[    2.268187] EXT4-fs (nvme0n1p5): re-mounted. Opts: errors=remount-ro
[    2.278331] lp: driver loaded but no devices found
[    2.280597] ppdev: user-space parallel port driver
[    2.328165] Adding 2097148k swap on /swapfile.  Priority:-2 extents:6 across:2260988k SSFS
[    2.377485] systemd-journald[380]: Received request to flush runtime journal from PID 1
[    2.449138] audit: type=1400 audit(1552073709.305:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="libreoffice-senddoc" pid=521 comm="apparmor_parser"
[    2.449142] audit: type=1400 audit(1552073709.305:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="libreoffice-oopslash" pid=519 comm="apparmor_parser"
[    2.449907] audit: type=1400 audit(1552073709.305:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=518 comm="apparmor_parser"
[    2.449910] audit: type=1400 audit(1552073709.305:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=518 comm="apparmor_parser"
[    2.449912] audit: type=1400 audit(1552073709.305:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=518 comm="apparmor_parser"
[    2.451578] audit: type=1400 audit(1552073709.305:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/ippusbxd" pid=527 comm="apparmor_parser"
[    2.452845] audit: type=1400 audit(1552073709.309:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/sbin/dhclient" pid=515 comm="apparmor_parser"
[    2.452848] audit: type=1400 audit(1552073709.309:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=515 comm="apparmor_parser"
[    2.452849] audit: type=1400 audit(1552073709.309:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-helper" pid=515 comm="apparmor_parser"
[    2.501340] usbcore: registered new interface driver usbserial_generic
[    2.501349] usbserial: USB Serial support registered for generic
[    2.501426] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[    2.508081] usbcore: registered new interface driver ftdi_sio
[    2.508142] usbserial: USB Serial support registered for FTDI USB Serial Device
[    2.508193] ftdi_sio 5-1:1.0: FTDI USB Serial Device converter detected
[    2.508288] usb 5-1: Detected FT2232H
[    2.510410] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[    2.517914] usb 5-1: FTDI USB Serial Device converter now attached to ttyUSB0
[    2.517956] ftdi_sio 5-1:1.1: FTDI USB Serial Device converter detected
[    2.517999] usb 5-1: Detected FT2232H
[    2.518627] usb 5-1: FTDI USB Serial Device converter now attached to ttyUSB1
[    2.522854] Bluetooth: Core ver 2.22
[    2.522870] NET: Registered protocol family 31
[    2.522871] Bluetooth: HCI device and connection manager initialized
[    2.522873] Bluetooth: HCI socket layer initialized
[    2.522875] Bluetooth: L2CAP socket layer initialized
[    2.522890] Bluetooth: SCO socket layer initialized
[    2.532338] usbcore: registered new interface driver btusb
[    2.534454] cryptd: max_cpu_qlen set to 1000
[    2.539450] random: crng init done
[    2.539452] random: 7 urandom warning(s) missed due to ratelimiting
[    2.540990] Intel(R) Wireless WiFi driver for Linux
[    2.540992] Copyright(c) 2003- 2015 Intel Corporation
[    2.541944] Bluetooth: hci0: Firmware revision 0.1 build 73 week 26 2018
[    2.548309] AVX2 version of gcm_enc/dec engaged.
[    2.548311] AES CTR mode by8 optimization enabled
[    2.556772] iwlwifi 0000:07:00.0: Direct firmware load for iwlwifi-9260-th-b0-jf-b0-43.ucode failed with error -2
[    2.556787] iwlwifi 0000:07:00.0: Direct firmware load for iwlwifi-9260-th-b0-jf-b0-42.ucode failed with error -2
[    2.556908] iwlwifi 0000:07:00.0: Direct firmware load for iwlwifi-9260-th-b0-jf-b0-41.ucode failed with error -2
[    2.556921] iwlwifi 0000:07:00.0: Direct firmware load for iwlwifi-9260-th-b0-jf-b0-40.ucode failed with error -2
[    2.557035] iwlwifi 0000:07:00.0: Direct firmware load for iwlwifi-9260-th-b0-jf-b0-39.ucode failed with error -2
[    2.564652] iwlwifi 0000:07:00.0: loaded firmware version 38.c0e03d94.0 op_mode iwlmvm
[    2.584543] AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel <jroedel@suse.de>
[    2.599751] iwlwifi 0000:07:00.0: Detected Intel(R) Dual Band Wireless AC 9260, REV=0x324
[    2.636634] snd_hda_intel 0000:0b:00.1: Handle vga_switcheroo audio client
[    2.649026] input: HD-Audio Generic HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:08.1/0000:0b:00.1/sound/card0/input9
[    2.649139] input: HD-Audio Generic HDMI/DP,pcm=7 as /devices/pci0000:00/0000:00:08.1/0000:0b:00.1/sound/card0/input10
[    2.649193] input: HD-Audio Generic HDMI/DP,pcm=8 as /devices/pci0000:00/0000:00:08.1/0000:0b:00.1/sound/card0/input11
[    2.649272] input: HD-Audio Generic HDMI/DP,pcm=9 as /devices/pci0000:00/0000:00:08.1/0000:0b:00.1/sound/card0/input12
[    2.654210] [drm] amdgpu kernel modesetting enabled.
[    2.654290] Parsing CRAT table with 1 nodes
[    2.654302] Creating topology SYSFS entries
[    2.654332] Topology: Add APU node [0x0:0x0]
[    2.654332] Finished initializing topology
[    2.654445] checking generic (e0000000 130000) vs hw (e0000000 10000000)
[    2.654447] fb0: switching to amdgpudrmfb from VESA VGA
[    2.654473] Console: switching to colour dummy device 80x25
[    2.655477] [drm] initializing kernel modesetting (RAVEN 0x1002:0x15DD 0x1458:0xD000 0xC6).
[    2.655518] [drm] register mmio base: 0xFE300000
[    2.655519] [drm] register mmio size: 524288
[    2.655535] [drm] add ip block number 0 <soc15_common>
[    2.655536] [drm] add ip block number 1 <gmc_v9_0>
[    2.655537] [drm] add ip block number 2 <vega10_ih>
[    2.655537] [drm] add ip block number 3 <psp>
[    2.655539] [drm] add ip block number 4 <gfx_v9_0>
[    2.655540] [drm] add ip block number 5 <sdma_v4_0>
[    2.655541] [drm] add ip block number 6 <powerplay>
[    2.655542] [drm] add ip block number 7 <dm>
[    2.655543] [drm] add ip block number 8 <vcn_v1_0>
[    2.656256] [drm] VCN decode is enabled in VM mode
[    2.656257] [drm] VCN encode is enabled in VM mode
[    2.656257] [drm] VCN jpeg decode is enabled in VM mode
[    2.662991] snd_hda_codec_realtek hdaudioC1D0: autoconfig for ALC1220: line_outs=1 (0x14/0x0/0x0/0x0/0x0) type:line
[    2.662994] snd_hda_codec_realtek hdaudioC1D0:    speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[    2.662995] snd_hda_codec_realtek hdaudioC1D0:    hp_outs=1 (0x1b/0x0/0x0/0x0/0x0)
[    2.662996] snd_hda_codec_realtek hdaudioC1D0:    mono: mono_out=0x0
[    2.662997] snd_hda_codec_realtek hdaudioC1D0:    dig-out=0x1e/0x0
[    2.662998] snd_hda_codec_realtek hdaudioC1D0:    inputs:
[    2.663000] snd_hda_codec_realtek hdaudioC1D0:      Front Mic=0x19
[    2.663001] snd_hda_codec_realtek hdaudioC1D0:      Rear Mic=0x18
[    2.663002] snd_hda_codec_realtek hdaudioC1D0:      Line=0x1a
[    2.680481] iwlwifi 0000:07:00.0: base HW address: 34:e1:2d:aa:ce:09
[    2.682889] input: HD-Audio Generic Front Mic as /devices/pci0000:00/0000:00:08.1/0000:0b:00.6/sound/card1/input13
[    2.683038] input: HD-Audio Generic Rear Mic as /devices/pci0000:00/0000:00:08.1/0000:0b:00.6/sound/card1/input14
[    2.683163] input: HD-Audio Generic Line as /devices/pci0000:00/0000:00:08.1/0000:0b:00.6/sound/card1/input15
[    2.683307] input: HD-Audio Generic Line Out as /devices/pci0000:00/0000:00:08.1/0000:0b:00.6/sound/card1/input16
[    2.683396] input: HD-Audio Generic Front Headphone as /devices/pci0000:00/0000:00:08.1/0000:0b:00.6/sound/card1/input17
[    2.684339] [drm] BIOS signature incorrect 0 0
[    2.684405] ATOM BIOS: 113-RAVEN-111
[    2.684466] [drm] vm size is 262144 GB, 4 levels, block size is 9-bit, fragment size is 9-bit
[    2.684482] amdgpu 0000:0b:00.0: VRAM: 2048M 0x000000F400000000 - 0x000000F47FFFFFFF (2048M used)
[    2.684485] amdgpu 0000:0b:00.0: GART: 1024M 0x0000000000000000 - 0x000000003FFFFFFF
[    2.684486] amdgpu 0000:0b:00.0: AGP: 267419648M 0x000000F800000000 - 0x0000FFFFFFFFFFFF
[    2.684493] [drm] Detected VRAM RAM=2048M, BAR=2048M
[    2.684495] [drm] RAM width 128bits DDR4
[    2.684630] [TTM] Zone  kernel: Available graphics memory: 3055710 kiB
[    2.684646] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    2.684647] [TTM] Initializing pool allocator
[    2.684651] [TTM] Initializing DMA pool allocator
[    2.684732] [drm] amdgpu: 2048M of VRAM memory ready
[    2.684734] [drm] amdgpu: 3072M of GTT memory ready.
[    2.684780] [drm] GART: num cpu pages 262144, num gpu pages 262144
[    2.684937] [drm] PCIE GART of 1024M enabled (table at 0x000000F40012C000).
[    2.695945] [drm] use_doorbell being set to: [true]
[    2.698256] [drm] Found VCN firmware Version: 1.73 Family ID: 18
[    2.698267] [drm] PSP loading VCN firmware
[    2.730865] [drm] reserve 0x400000 from 0xf400400000 for PSP TMR SIZE
[    2.742681] kvm: disabled by bios
[    2.747977] MCE: In-kernel MCE decoding enabled.
[    2.750116] EDAC amd64: Node 0: DRAM ECC disabled.
[    2.750118] EDAC amd64: ECC disabled in the BIOS or no ECC capability, module will not load.
                Either enable ECC checking or force module loading by setting 'ecc_enable_override'.
                (Note that use of the override may cause unknown side effects.)
[    2.773107] ieee80211 phy0: Selected rate control algorithm 'iwl-mvm-rs'
[    2.773530] thermal thermal_zone0: failed to read out thermal zone (-61)
[    2.830537] EDAC amd64: Node 0: DRAM ECC disabled.
[    2.830539] EDAC amd64: ECC disabled in the BIOS or no ECC capability, module will not load.
                Either enable ECC checking or force module loading by setting 'ecc_enable_override'.
                (Note that use of the override may cause unknown side effects.)
[    2.832221] iwlwifi 0000:07:00.0 wlp7s0: renamed from wlan0
[    2.923485] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[    2.923487] Bluetooth: BNEP filters: protocol multicast
[    2.923491] Bluetooth: BNEP socket layer initialized
[    2.961028] [drm] DM_PPLIB: values for Invalid clock
[    2.961031] [drm] DM_PPLIB:   400000 in kHz
[    2.961031] [drm] DM_PPLIB:   933000 in kHz
[    2.961032] [drm] DM_PPLIB:   1200000 in kHz
[    2.961032] [drm] DM_PPLIB:   1333000 in kHz
[    2.961033] [drm] DM_PPLIB: values for Invalid clock
[    2.961034] [drm] DM_PPLIB:   300000 in kHz
[    2.961034] [drm] DM_PPLIB:   600000 in kHz
[    2.961035] [drm] DM_PPLIB:   626000 in kHz
[    2.961035] [drm] DM_PPLIB:   654000 in kHz
[    2.961428] [drm:construct [amdgpu]] *ERROR* construct: Invalid Connector ObjectID from Adapter Service for connector index:2! type 0 expected 3
[    3.010867] [drm] Display Core initialized with v3.2.08!
[    3.016157] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
[    3.016160] [drm] Driver supports precise vblank timestamp query.
[    3.043060] [drm] VCN decode and encode initialized successfully(under SPG Mode).
[    3.043833] kfd kfd: Allocated 3969056 bytes on gart
[    3.043894] Topology: Add APU node [0x15dd:0x1002]
[    3.044597] kfd kfd: added device 1002:15dd
[    3.045316] [drm] Cannot find any crtc or sizes
[    3.045485] amdgpu 0000:0b:00.0: ring gfx uses VM inv eng 0 on hub 0
[    3.045487] amdgpu 0000:0b:00.0: ring comp_1.0.0 uses VM inv eng 1 on hub 0
[    3.045489] amdgpu 0000:0b:00.0: ring comp_1.1.0 uses VM inv eng 4 on hub 0
[    3.045491] amdgpu 0000:0b:00.0: ring comp_1.2.0 uses VM inv eng 5 on hub 0
[    3.045492] amdgpu 0000:0b:00.0: ring comp_1.3.0 uses VM inv eng 6 on hub 0
[    3.045494] amdgpu 0000:0b:00.0: ring comp_1.0.1 uses VM inv eng 7 on hub 0
[    3.045495] amdgpu 0000:0b:00.0: ring comp_1.1.1 uses VM inv eng 8 on hub 0
[    3.045498] amdgpu 0000:0b:00.0: ring comp_1.2.1 uses VM inv eng 9 on hub 0
[    3.045499] amdgpu 0000:0b:00.0: ring comp_1.3.1 uses VM inv eng 10 on hub 0
[    3.045501] amdgpu 0000:0b:00.0: ring kiq_2.1.0 uses VM inv eng 11 on hub 0
[    3.045503] amdgpu 0000:0b:00.0: ring sdma0 uses VM inv eng 0 on hub 1
[    3.045535] amdgpu 0000:0b:00.0: ring vcn_dec uses VM inv eng 1 on hub 1
[    3.045547] amdgpu 0000:0b:00.0: ring vcn_enc0 uses VM inv eng 4 on hub 1
[    3.045553] amdgpu 0000:0b:00.0: ring vcn_enc1 uses VM inv eng 5 on hub 1
[    3.045556] amdgpu 0000:0b:00.0: ring vcn_jpeg uses VM inv eng 6 on hub 1
[    3.270492] [drm] Initialized amdgpu 3.27.0 20150101 for 0000:0b:00.0 on minor 0
[    5.820568] igb 0000:09:00.0 enp9s0: igb: enp9s0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
[    5.928262] IPv6: ADDRCONF(NETDEV_CHANGE): enp9s0: link becomes ready
[   98.017927] amdgpu: [powerplay] pp_dpm_switch_power_profile was not implemented.

[-- Attachment #3: cl_slow_test.cpp --]
[-- Type: text/x-c++src, Size: 2200 bytes --]

#include <vector>
#include <string>
#include <chrono>
#include <iostream>

#include <stdio.h>
#include <stdlib.h>
#include <string.h>

#include <CL/cl.h>
#include <stdarg.h>


int main(int argc, const char** argv) {
    int idx = 1;
    int init_ocl = argc > idx? atoi(argv[idx++]) : 1;
    int count = argc > idx? atoi(argv[idx++]) : 30;
    int size = argc > idx? atoi(argv[idx++]) : 10000000;

    cl_context context;
    cl_int      status = 0;

    std::vector<unsigned char> src, dst;
    src.resize(size);
    dst.resize(size);

    if (init_ocl) {
        cl_device_type  typ = CL_DEVICE_TYPE_GPU;

        /* Create context.*/
        const int max_platforms = 5, max_devices=5;
        cl_uint num_platforms = 0, num_devices = 0;
        cl_platform_id platforms[max_platforms];
        cl_device_id devices[max_devices];

        status = clGetPlatformIDs(max_platforms, platforms, &num_platforms);
        if (status || !num_platforms) {
            printf("clGetPlatformIDs failed status: %d platforms: %d\n", status, num_platforms);
            return -1;
        }

        status = clGetDeviceIDs(platforms[0], typ, max_devices, devices, &num_devices);
        if (status || !num_devices) {
            printf("clGetDeviceIDs failed status: %d devices: %d\n", status, num_devices);
            return -1;
        }

        printf("got %d platforms %d devices\n", num_platforms, num_devices);

        context = clCreateContext(NULL, 1, &devices[0],
            NULL, NULL, &status);
        if (status) {
            printf("clCreateContext failed %d\n", status);
            return -1;
        }
    }
    float avg = 0;
    for (int i = 0; i < count; i++) {
        auto start = std::chrono::steady_clock::now();

        memcpy(&dst[0], &src[0], dst.size());

        std::chrono::duration<float> time = std::chrono::steady_clock::now() - start;

        float speed = dst.size()/time.count() / (1024*1024);
        avg = avg * i/(i+1) + speed * 1/(i+1);
        printf("speed %f avg %f mbytes/s\n", speed, avg);
    }

    if (init_ocl) {
        status = clReleaseContext(context);
        if (status)
            printf("clReleaseContext failed status: %d\n", status);
    }
}

[-- Attachment #4: Type: text/plain, Size: 153 bytes --]

_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found] ` <CAGyaPbDo4-mJhCbL1gfjgek_Z54dyREydqZc-SF=cFVQ0URyYA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2019-03-08 20:35   ` Alex Deucher
       [not found]     ` <CADnq5_Mtg5Brvp3Z1dMy+V4oD1DqCQ-WJm4ehSW_dFybLm1Jcw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Alex Deucher @ 2019-03-08 20:35 UTC (permalink / raw)
  To: Lauri Ehrenpreis; +Cc: amd-gfx list

I think you are probably using the CPU for OCL in the remote login
case.  When you log into the desktop, the permissions on the device
nodes get changed dynamically to support accelerated rendering.  You
probably need to change the permissions on the device nodes manually
if you are not logging into the desktop.

Alex

On Fri, Mar 8, 2019 at 2:43 PM Lauri Ehrenpreis <laurioma@gmail.com> wrote:
>
> Hi!
>
> I am using Ryzen 2400G with Gigabyte AMD B450 AORUS board. I have latest bios, ubuntu 18.04 and latest mainline kernel (5.0.0-050000-generic) installed. Also I have rocm-dev 2.1.96 but no rock-dkms installed.
>
> I found that when I log in over ssh and try to use OpenCL (doing clCreateContext is enough) then cpu memory accesses after that will slow down by 100x.
> If I connect HDMI cable and log in to desktop mode then this does not happen. Also if I don't call clCreateContext then everything works properly.
>
> Attached the test program and kernel log also. Test works like that :
> g++ cl_slow_test.cpp -o cl_slow_test -I /opt/rocm/opencl/include/ -L /opt/rocm/opencl/lib/x86_64/  -lOpenCL
> lauri@rv:~$ ./cl_slow_test 0 5
> speed 7003.145508 avg 7003.145508 mbytes/s
> speed 8427.357422 avg 7715.251465 mbytes/s
> speed 9203.049805 avg 8211.184570 mbytes/s
> speed 9845.956055 avg 8619.877930 mbytes/s
> speed 9882.748047 avg 8872.452148 mbytes/s
> lauri@rv:~$ ./cl_slow_test 1 5
> got 1 platforms 1 devices
> speed 1599.803589 avg 1599.803589 mbytes/s
> speed 1665.426392 avg 1632.614990 mbytes/s
> speed 146.137253 avg 1137.122437 mbytes/s
> speed 121.056877 avg 883.106018 mbytes/s
> speed 122.428970 avg 730.970581 mbytes/s
>
> I also tried latest amd-staging kernel https://github.com/M-Bab/linux-kernel-amdgpu-binaries and it had the same issue.
>
> Can anyone point me into right direction?
>
> Br,
> Lauri
> _______________________________________________
> amd-gfx mailing list
> amd-gfx@lists.freedesktop.org
> https://lists.freedesktop.org/mailman/listinfo/amd-gfx
_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]     ` <CADnq5_Mtg5Brvp3Z1dMy+V4oD1DqCQ-WJm4ehSW_dFybLm1Jcw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2019-03-09  6:54       ` Lauri Ehrenpreis
       [not found]         ` <CAGyaPbCxMxG5kbu9RhrB0vSCDQL4zaNzsUqsoWVWmRVw8Mp7Pg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Lauri Ehrenpreis @ 2019-03-09  6:54 UTC (permalink / raw)
  To: amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW


[-- Attachment #1.1: Type: text/plain, Size: 4512 bytes --]

Even if it's using CPU for OCL (I know it's not doing this), why does
memcpy on CPU slow down permanently, if I'm not doing anything with OpenCL
after clCreateContext?

As you see from test program it just does clCreateContext and then a loop
of memcpy-s on CPU.

Also I found out that writing different values to
/sys/class/drm/card0/device/power_dpm_force_performance_level changes my
max memcpy speed on CPU:

echo "low" > /sys/class/drm/card0/device/power_dpm_force_performance_level
./cl_slow_test 1 5
got 1 platforms 1 devices
speed 731.810425 avg 731.810425 mbytes/s
speed 163.425583 avg 447.618011 mbytes/s
speed 123.441612 avg 339.559235 mbytes/s
speed 121.655266 avg 285.083252 mbytes/s
speed 123.806801 avg 252.827972 mbytes/s

echo "high" > /sys/class/drm/card0/device/power_dpm_force_performance_level
./cl_slow_test 1 5
got 1 platforms 1 devices
speed 3742.063721 avg 3742.063721 mbytes/s
speed 836.148987 avg 2289.106445 mbytes/s
speed 189.379166 avg 1589.197266 mbytes/s
speed 189.271393 avg 1239.215820 mbytes/s
speed 188.290451 avg 1029.030762 mbytes/s

echo "profile_standard" >
/sys/class/drm/card0/device/power_dpm_force_performance_level
./cl_slow_test 1 5
got 1 platforms 1 devices
speed 2303.955566 avg 2303.955566 mbytes/s
speed 2298.224121 avg 2301.089844 mbytes/s
speed 2295.585205 avg 2299.254883 mbytes/s
speed 2295.762939 avg 2298.381836 mbytes/s
speed 2288.766602 avg 2296.458740 mbytes/s

 echo "profile_peak" >
/sys/class/drm/card0/device/power_dpm_force_performance_level
./cl_slow_test 1 5
got 1 platforms 1 devices
speed 3710.360352 avg 3710.360352 mbytes/s
speed 3713.660400 avg 3712.010254 mbytes/s
speed 3797.630859 avg 3740.550537 mbytes/s
speed 3708.004883 avg 3732.414062 mbytes/s
speed 3796.403076 avg 3745.211914 mbytes/s

However none of those is close to the memcpy speed I get when I don't do
clCreateContext (my test prog has first arg 0):
./cl_slow_test 0 5
speed 7299.201660 avg 7299.201660 mbytes/s
speed 9298.841797 avg 8299.021484 mbytes/s
speed 9360.181641 avg 8652.742188 mbytes/s
speed 9004.759766 avg 8740.746094 mbytes/s
speed 9414.607422 avg 8875.518555 mbytes/s

Also attached clinfo.txt. It shows that opencl is using GPU so device node
permissions are probably not the issue.

--
Lauri

On Fri, Mar 8, 2019 at 10:35 PM Alex Deucher <alexdeucher-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:

> I think you are probably using the CPU for OCL in the remote login
> case.  When you log into the desktop, the permissions on the device
> nodes get changed dynamically to support accelerated rendering.  You
> probably need to change the permissions on the device nodes manually
> if you are not logging into the desktop.
>
> Alex
>
> On Fri, Mar 8, 2019 at 2:43 PM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
> wrote:
> >
> > Hi!
> >
> > I am using Ryzen 2400G with Gigabyte AMD B450 AORUS board. I have latest
> bios, ubuntu 18.04 and latest mainline kernel (5.0.0-050000-generic)
> installed. Also I have rocm-dev 2.1.96 but no rock-dkms installed.
> >
> > I found that when I log in over ssh and try to use OpenCL (doing
> clCreateContext is enough) then cpu memory accesses after that will slow
> down by 100x.
> > If I connect HDMI cable and log in to desktop mode then this does not
> happen. Also if I don't call clCreateContext then everything works properly.
> >
> > Attached the test program and kernel log also. Test works like that :
> > g++ cl_slow_test.cpp -o cl_slow_test -I /opt/rocm/opencl/include/ -L
> /opt/rocm/opencl/lib/x86_64/  -lOpenCL
> > lauri@rv:~$ ./cl_slow_test 0 5
> > speed 7003.145508 avg 7003.145508 mbytes/s
> > speed 8427.357422 avg 7715.251465 mbytes/s
> > speed 9203.049805 avg 8211.184570 mbytes/s
> > speed 9845.956055 avg 8619.877930 mbytes/s
> > speed 9882.748047 avg 8872.452148 mbytes/s
> > lauri@rv:~$ ./cl_slow_test 1 5
> > got 1 platforms 1 devices
> > speed 1599.803589 avg 1599.803589 mbytes/s
> > speed 1665.426392 avg 1632.614990 mbytes/s
> > speed 146.137253 avg 1137.122437 mbytes/s
> > speed 121.056877 avg 883.106018 mbytes/s
> > speed 122.428970 avg 730.970581 mbytes/s
> >
> > I also tried latest amd-staging kernel
> https://github.com/M-Bab/linux-kernel-amdgpu-binaries and it had the same
> issue.
> >
> > Can anyone point me into right direction?
> >
> > Br,
> > Lauri
> > _______________________________________________
> > amd-gfx mailing list
> > amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
> > https://lists.freedesktop.org/mailman/listinfo/amd-gfx
>

[-- Attachment #1.2: Type: text/html, Size: 6561 bytes --]

[-- Attachment #2: clinfo.txt --]
[-- Type: text/plain, Size: 8779 bytes --]

Number of platforms                               1
  Platform Name                                   AMD Accelerated Parallel Processing
  Platform Vendor                                 Advanced Micro Devices, Inc.
  Platform Version                                OpenCL 2.1 AMD-APP (2814.0)
  Platform Profile                                FULL_PROFILE
  Platform Extensions                             cl_khr_icd cl_amd_event_callback cl_amd_offline_devices 
  Platform Host timer resolution                  1ns
  Platform Extensions function suffix             AMD

  Platform Name                                   AMD Accelerated Parallel Processing
Number of devices                                 1
  Device Name                                     gfx902-xnack
  Device Vendor                                   Advanced Micro Devices, Inc.
  Device Vendor ID                                0x1002
  Device Version                                  OpenCL 1.2 
  Driver Version                                  2814.0 (HSA1.1,LC)
  Device OpenCL C Version                         OpenCL C 2.0 
  Device Type                                     GPU
  Device Board Name (AMD)                         AMD Ryzen 5 2400G with Radeon Vega Graphics
  Device Topology (AMD)                           PCI-E, 0b:00.0
  Device Profile                                  FULL_PROFILE
  Device Available                                Yes
  Compiler Available                              Yes
  Linker Available                                Yes
  Max compute units                               11
  SIMD per compute unit (AMD)                     4
  SIMD width (AMD)                                16
  SIMD instruction width (AMD)                    1
  Max clock frequency                             1250MHz
  Graphics IP (AMD)                               9.2
  Device Partition                                (core)
    Max number of sub-devices                     11
    Supported partition types                     None
  Max work item dimensions                        3
  Max work item sizes                             1024x1024x1024
  Max work group size                             256
  Preferred work group size (AMD)                 256
  Max work group size (AMD)                       1024
  Preferred work group size multiple              64
  Wavefront width (AMD)                           64
  Preferred / native vector sizes                 
    char                                                 4 / 4       
    short                                                2 / 2       
    int                                                  1 / 1       
    long                                                 1 / 1       
    half                                                 1 / 1        (cl_khr_fp16)
    float                                                1 / 1       
    double                                               1 / 1        (cl_khr_fp64)
  Half-precision Floating-point support           (cl_khr_fp16)
    Denormals                                     No
    Infinity and NANs                             No
    Round to nearest                              No
    Round to zero                                 No
    Round to infinity                             No
    IEEE754-2008 fused multiply-add               No
    Support is emulated in software               No
  Single-precision Floating-point support         (core)
    Denormals                                     Yes
    Infinity and NANs                             Yes
    Round to nearest                              Yes
    Round to zero                                 Yes
    Round to infinity                             Yes
    IEEE754-2008 fused multiply-add               Yes
    Support is emulated in software               No
    Correctly-rounded divide and sqrt operations  Yes
  Double-precision Floating-point support         (cl_khr_fp64)
    Denormals                                     Yes
    Infinity and NANs                             Yes
    Round to nearest                              Yes
    Round to zero                                 Yes
    Round to infinity                             Yes
    IEEE754-2008 fused multiply-add               Yes
    Support is emulated in software               No
  Address bits                                    64, Little-Endian
  Global memory size                              3129047040 (2.914GiB)
  Global free memory (AMD)                        3055710 (2.914GiB)
  Global memory channels (AMD)                    2
  Global memory banks per channel (AMD)           4
  Global memory bank width (AMD)                  256 bytes
  Error Correction support                        No
  Max memory allocation                           2659689984 (2.477GiB)
  Unified memory for Host and Device              Yes
  Minimum alignment for any data type             128 bytes
  Alignment of base address                       1024 bits (128 bytes)
  Global Memory cache type                        Read/Write
  Global Memory cache size                        16384 (16KiB)
  Global Memory cache line size                   64 bytes
  Image support                                   Yes
    Max number of samplers per kernel             5597
    Max size for 1D images from buffer            65536 pixels
    Max 1D or 2D image array size                 2048 images
    Max 2D image size                             16384x16384 pixels
    Max 3D image size                             2048x2048x2048 pixels
    Max number of read image args                 128
    Max number of write image args                8
  Local memory type                               Local
  Local memory size                               65536 (64KiB)
  Local memory syze per CU (AMD)                  65536 (64KiB)
  Local memory banks (AMD)                        32
  Max number of constant args                     8
  Max constant buffer size                        2659689984 (2.477GiB)
  Preferred constant buffer size (AMD)            16384 (16KiB)
  Max size of kernel argument                     1024
  Queue properties                                
    Out-of-order execution                        No
    Profiling                                     Yes
  Prefer user sync for interop                    Yes
  Number of P2P devices (AMD)                     0
  P2P devices (AMD)                               
  Profiling timer resolution                      1ns
  Profiling timer offset since Epoch (AMD)        0ns (Thu Jan  1 03:00:00 1970)
  Execution capabilities                          
    Run OpenCL kernels                            Yes
    Run native kernels                            No
    Thread trace supported (AMD)                  No
    Number of async queues (AMD)                  8
    Max real-time compute queues (AMD)            8
    Max real-time compute units (AMD)             11
  printf() buffer size                            4194304 (4MiB)
  Built-in kernels                                
  Device Extensions                               cl_khr_fp64 cl_khr_global_int32_base_atomics cl_khr_global_int32_extended_atomics cl_khr_local_int32_base_atomics cl_khr_local_int32_extended_atomics cl_khr_int64_base_atomics cl_khr_int64_extended_atomics cl_khr_3d_image_writes cl_khr_byte_addressable_store cl_khr_fp16 cl_khr_gl_sharing cl_amd_device_attribute_query cl_amd_media_ops cl_amd_media_ops2 cl_khr_subgroups cl_khr_depth_images cl_amd_copy_buffer_p2p cl_amd_assembly_program 

NULL platform behavior
  clGetPlatformInfo(NULL, CL_PLATFORM_NAME, ...)  No platform
  clGetDeviceIDs(NULL, CL_DEVICE_TYPE_ALL, ...)   No platform
  clCreateContext(NULL, ...) [default]            No platform
  clCreateContext(NULL, ...) [other]              Success [AMD]
  clCreateContextFromType(NULL, CL_DEVICE_TYPE_DEFAULT)  Success (1)
    Platform Name                                 AMD Accelerated Parallel Processing
    Device Name                                   gfx902-xnack
  clCreateContextFromType(NULL, CL_DEVICE_TYPE_CPU)  No devices found in platform
  clCreateContextFromType(NULL, CL_DEVICE_TYPE_GPU)  Success (1)
    Platform Name                                 AMD Accelerated Parallel Processing
    Device Name                                   gfx902-xnack
  clCreateContextFromType(NULL, CL_DEVICE_TYPE_ACCELERATOR)  No devices found in platform
  clCreateContextFromType(NULL, CL_DEVICE_TYPE_CUSTOM)  No devices found in platform
  clCreateContextFromType(NULL, CL_DEVICE_TYPE_ALL)  Success (1)
    Platform Name                                 AMD Accelerated Parallel Processing
    Device Name                                   gfx902-xnack

[-- Attachment #3: Type: text/plain, Size: 153 bytes --]

_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]         ` <CAGyaPbCxMxG5kbu9RhrB0vSCDQL4zaNzsUqsoWVWmRVw8Mp7Pg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2019-03-09 19:22           ` Jan Vesely
  2019-03-10 19:13             ` Lauri Ehrenpreis
  0 siblings, 1 reply; 17+ messages in thread
From: Jan Vesely @ 2019-03-09 19:22 UTC (permalink / raw)
  To: Lauri Ehrenpreis; +Cc: amd-gfx list

On Sat, Mar 9, 2019 at 1:54 AM Lauri Ehrenpreis <laurioma@gmail.com> wrote:
>
> Even if it's using CPU for OCL (I know it's not doing this), why does memcpy on CPU slow down permanently, if I'm not doing anything with OpenCL after clCreateContext?
>
> As you see from test program it just does clCreateContext and then a loop of memcpy-s on CPU.
>
> Also I found out that writing different values to /sys/class/drm/card0/device/power_dpm_force_performance_level changes my max memcpy speed on CPU:
>
> echo "low" > /sys/class/drm/card0/device/power_dpm_force_performance_level
> ./cl_slow_test 1 5
> got 1 platforms 1 devices
> speed 731.810425 avg 731.810425 mbytes/s
> speed 163.425583 avg 447.618011 mbytes/s
> speed 123.441612 avg 339.559235 mbytes/s
> speed 121.655266 avg 285.083252 mbytes/s
> speed 123.806801 avg 252.827972 mbytes/s
>
> echo "high" > /sys/class/drm/card0/device/power_dpm_force_performance_level
> ./cl_slow_test 1 5
> got 1 platforms 1 devices
> speed 3742.063721 avg 3742.063721 mbytes/s
> speed 836.148987 avg 2289.106445 mbytes/s
> speed 189.379166 avg 1589.197266 mbytes/s
> speed 189.271393 avg 1239.215820 mbytes/s
> speed 188.290451 avg 1029.030762 mbytes/s
>
> echo "profile_standard" > /sys/class/drm/card0/device/power_dpm_force_performance_level
> ./cl_slow_test 1 5
> got 1 platforms 1 devices
> speed 2303.955566 avg 2303.955566 mbytes/s
> speed 2298.224121 avg 2301.089844 mbytes/s
> speed 2295.585205 avg 2299.254883 mbytes/s
> speed 2295.762939 avg 2298.381836 mbytes/s
> speed 2288.766602 avg 2296.458740 mbytes/s
>
>  echo "profile_peak" > /sys/class/drm/card0/device/power_dpm_force_performance_level
> ./cl_slow_test 1 5
> got 1 platforms 1 devices
> speed 3710.360352 avg 3710.360352 mbytes/s
> speed 3713.660400 avg 3712.010254 mbytes/s
> speed 3797.630859 avg 3740.550537 mbytes/s
> speed 3708.004883 avg 3732.414062 mbytes/s
> speed 3796.403076 avg 3745.211914 mbytes/s
>
> However none of those is close to the memcpy speed I get when I don't do clCreateContext (my test prog has first arg 0):
> ./cl_slow_test 0 5
> speed 7299.201660 avg 7299.201660 mbytes/s
> speed 9298.841797 avg 8299.021484 mbytes/s
> speed 9360.181641 avg 8652.742188 mbytes/s
> speed 9004.759766 avg 8740.746094 mbytes/s
> speed 9414.607422 avg 8875.518555 mbytes/s
>
> Also attached clinfo.txt. It shows that opencl is using GPU so device node permissions are probably not the issue.

Is it only memory accesses or does overall CPU performance degrade
(including compute - say sysbench) as well?

Jan

> --
> Lauri
>
> On Fri, Mar 8, 2019 at 10:35 PM Alex Deucher <alexdeucher@gmail.com> wrote:
>>
>> I think you are probably using the CPU for OCL in the remote login
>> case.  When you log into the desktop, the permissions on the device
>> nodes get changed dynamically to support accelerated rendering.  You
>> probably need to change the permissions on the device nodes manually
>> if you are not logging into the desktop.
>>
>> Alex
>>
>> On Fri, Mar 8, 2019 at 2:43 PM Lauri Ehrenpreis <laurioma@gmail.com> wrote:
>> >
>> > Hi!
>> >
>> > I am using Ryzen 2400G with Gigabyte AMD B450 AORUS board. I have latest bios, ubuntu 18.04 and latest mainline kernel (5.0.0-050000-generic) installed. Also I have rocm-dev 2.1.96 but no rock-dkms installed.
>> >
>> > I found that when I log in over ssh and try to use OpenCL (doing clCreateContext is enough) then cpu memory accesses after that will slow down by 100x.
>> > If I connect HDMI cable and log in to desktop mode then this does not happen. Also if I don't call clCreateContext then everything works properly.
>> >
>> > Attached the test program and kernel log also. Test works like that :
>> > g++ cl_slow_test.cpp -o cl_slow_test -I /opt/rocm/opencl/include/ -L /opt/rocm/opencl/lib/x86_64/  -lOpenCL
>> > lauri@rv:~$ ./cl_slow_test 0 5
>> > speed 7003.145508 avg 7003.145508 mbytes/s
>> > speed 8427.357422 avg 7715.251465 mbytes/s
>> > speed 9203.049805 avg 8211.184570 mbytes/s
>> > speed 9845.956055 avg 8619.877930 mbytes/s
>> > speed 9882.748047 avg 8872.452148 mbytes/s
>> > lauri@rv:~$ ./cl_slow_test 1 5
>> > got 1 platforms 1 devices
>> > speed 1599.803589 avg 1599.803589 mbytes/s
>> > speed 1665.426392 avg 1632.614990 mbytes/s
>> > speed 146.137253 avg 1137.122437 mbytes/s
>> > speed 121.056877 avg 883.106018 mbytes/s
>> > speed 122.428970 avg 730.970581 mbytes/s
>> >
>> > I also tried latest amd-staging kernel https://github.com/M-Bab/linux-kernel-amdgpu-binaries and it had the same issue.
>> >
>> > Can anyone point me into right direction?
>> >
>> > Br,
>> > Lauri
>> > _______________________________________________
>> > amd-gfx mailing list
>> > amd-gfx@lists.freedesktop.org
>> > https://lists.freedesktop.org/mailman/listinfo/amd-gfx
>
> _______________________________________________
> amd-gfx mailing list
> amd-gfx@lists.freedesktop.org
> https://lists.freedesktop.org/mailman/listinfo/amd-gfx
_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
  2019-03-09 19:22           ` Jan Vesely
@ 2019-03-10 19:13             ` Lauri Ehrenpreis
       [not found]               ` <CAGyaPbDGq5Z+J+c_s99vBjSUttKwsBNv+EMvdjg0aXjY52qT-g-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
       [not found]               ` <CAAzXoRKQnmsQxPqEswAyAxQ7snW+D=L0GC+auiDsVnZQaBeAvQ@mail.gmail.com>
  0 siblings, 2 replies; 17+ messages in thread
From: Lauri Ehrenpreis @ 2019-03-10 19:13 UTC (permalink / raw)
  To: Jan Vesely; +Cc: amd-gfx list


[-- Attachment #1.1: Type: text/plain, Size: 6342 bytes --]

Seems sysbench cpu test does not slow down:
1) run sysbench cpu on idle machine:
 sysbench cpu run
...
General statistics:
    total time:                          10.0033s
    total number of events:              19052
2) start ./cl_slow_test 1 10000 in background
3) run sysbench again
sysbench cpu run
..
General statistics:
    total time:                          10.0036s
    total number of events:              18979

So if did not slow down considerably.

If I do similar test with sysbench memory test I get following results:
1)  run sysbench memory on idle machine:
sysbench memory --memory-block-size=32M --memory-total-size=100G run
...
66432.00 MiB transferred (6638.95 MiB/sec)
2) start ./cl_slow_test 1 10000 in background
3) sysbench memory --memory-block-size=32M --memory-total-size=100G run
...
672.00 MiB transferred (66.40 MiB/sec)

It confirms that memory speed is reduced 100x :(

--
Lauri


On Sat, Mar 9, 2019 at 9:22 PM Jan Vesely <jan.vesely-kgbqMDwikbSVc3sceRu5cw@public.gmane.org> wrote:

> On Sat, Mar 9, 2019 at 1:54 AM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
> wrote:
> >
> > Even if it's using CPU for OCL (I know it's not doing this), why does
> memcpy on CPU slow down permanently, if I'm not doing anything with OpenCL
> after clCreateContext?
> >
> > As you see from test program it just does clCreateContext and then a
> loop of memcpy-s on CPU.
> >
> > Also I found out that writing different values to
> /sys/class/drm/card0/device/power_dpm_force_performance_level changes my
> max memcpy speed on CPU:
> >
> > echo "low" >
> /sys/class/drm/card0/device/power_dpm_force_performance_level
> > ./cl_slow_test 1 5
> > got 1 platforms 1 devices
> > speed 731.810425 avg 731.810425 mbytes/s
> > speed 163.425583 avg 447.618011 mbytes/s
> > speed 123.441612 avg 339.559235 mbytes/s
> > speed 121.655266 avg 285.083252 mbytes/s
> > speed 123.806801 avg 252.827972 mbytes/s
> >
> > echo "high" >
> /sys/class/drm/card0/device/power_dpm_force_performance_level
> > ./cl_slow_test 1 5
> > got 1 platforms 1 devices
> > speed 3742.063721 avg 3742.063721 mbytes/s
> > speed 836.148987 avg 2289.106445 mbytes/s
> > speed 189.379166 avg 1589.197266 mbytes/s
> > speed 189.271393 avg 1239.215820 mbytes/s
> > speed 188.290451 avg 1029.030762 mbytes/s
> >
> > echo "profile_standard" >
> /sys/class/drm/card0/device/power_dpm_force_performance_level
> > ./cl_slow_test 1 5
> > got 1 platforms 1 devices
> > speed 2303.955566 avg 2303.955566 mbytes/s
> > speed 2298.224121 avg 2301.089844 mbytes/s
> > speed 2295.585205 avg 2299.254883 mbytes/s
> > speed 2295.762939 avg 2298.381836 mbytes/s
> > speed 2288.766602 avg 2296.458740 mbytes/s
> >
> >  echo "profile_peak" >
> /sys/class/drm/card0/device/power_dpm_force_performance_level
> > ./cl_slow_test 1 5
> > got 1 platforms 1 devices
> > speed 3710.360352 avg 3710.360352 mbytes/s
> > speed 3713.660400 avg 3712.010254 mbytes/s
> > speed 3797.630859 avg 3740.550537 mbytes/s
> > speed 3708.004883 avg 3732.414062 mbytes/s
> > speed 3796.403076 avg 3745.211914 mbytes/s
> >
> > However none of those is close to the memcpy speed I get when I don't do
> clCreateContext (my test prog has first arg 0):
> > ./cl_slow_test 0 5
> > speed 7299.201660 avg 7299.201660 mbytes/s
> > speed 9298.841797 avg 8299.021484 mbytes/s
> > speed 9360.181641 avg 8652.742188 mbytes/s
> > speed 9004.759766 avg 8740.746094 mbytes/s
> > speed 9414.607422 avg 8875.518555 mbytes/s
> >
> > Also attached clinfo.txt. It shows that opencl is using GPU so device
> node permissions are probably not the issue.
>
> Is it only memory accesses or does overall CPU performance degrade
> (including compute - say sysbench) as well?
>
> Jan
>
> > --
> > Lauri
> >
> > On Fri, Mar 8, 2019 at 10:35 PM Alex Deucher <alexdeucher-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
> wrote:
> >>
> >> I think you are probably using the CPU for OCL in the remote login
> >> case.  When you log into the desktop, the permissions on the device
> >> nodes get changed dynamically to support accelerated rendering.  You
> >> probably need to change the permissions on the device nodes manually
> >> if you are not logging into the desktop.
> >>
> >> Alex
> >>
> >> On Fri, Mar 8, 2019 at 2:43 PM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
> wrote:
> >> >
> >> > Hi!
> >> >
> >> > I am using Ryzen 2400G with Gigabyte AMD B450 AORUS board. I have
> latest bios, ubuntu 18.04 and latest mainline kernel (5.0.0-050000-generic)
> installed. Also I have rocm-dev 2.1.96 but no rock-dkms installed.
> >> >
> >> > I found that when I log in over ssh and try to use OpenCL (doing
> clCreateContext is enough) then cpu memory accesses after that will slow
> down by 100x.
> >> > If I connect HDMI cable and log in to desktop mode then this does not
> happen. Also if I don't call clCreateContext then everything works properly.
> >> >
> >> > Attached the test program and kernel log also. Test works like that :
> >> > g++ cl_slow_test.cpp -o cl_slow_test -I /opt/rocm/opencl/include/ -L
> /opt/rocm/opencl/lib/x86_64/  -lOpenCL
> >> > lauri@rv:~$ ./cl_slow_test 0 5
> >> > speed 7003.145508 avg 7003.145508 mbytes/s
> >> > speed 8427.357422 avg 7715.251465 mbytes/s
> >> > speed 9203.049805 avg 8211.184570 mbytes/s
> >> > speed 9845.956055 avg 8619.877930 mbytes/s
> >> > speed 9882.748047 avg 8872.452148 mbytes/s
> >> > lauri@rv:~$ ./cl_slow_test 1 5
> >> > got 1 platforms 1 devices
> >> > speed 1599.803589 avg 1599.803589 mbytes/s
> >> > speed 1665.426392 avg 1632.614990 mbytes/s
> >> > speed 146.137253 avg 1137.122437 mbytes/s
> >> > speed 121.056877 avg 883.106018 mbytes/s
> >> > speed 122.428970 avg 730.970581 mbytes/s
> >> >
> >> > I also tried latest amd-staging kernel
> https://github.com/M-Bab/linux-kernel-amdgpu-binaries and it had the same
> issue.
> >> >
> >> > Can anyone point me into right direction?
> >> >
> >> > Br,
> >> > Lauri
> >> > _______________________________________________
> >> > amd-gfx mailing list
> >> > amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
> >> > https://lists.freedesktop.org/mailman/listinfo/amd-gfx
> >
> > _______________________________________________
> > amd-gfx mailing list
> > amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
> > https://lists.freedesktop.org/mailman/listinfo/amd-gfx
>

[-- Attachment #1.2: Type: text/html, Size: 8916 bytes --]

[-- Attachment #2: Type: text/plain, Size: 153 bytes --]

_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]               ` <CAGyaPbDGq5Z+J+c_s99vBjSUttKwsBNv+EMvdjg0aXjY52qT-g-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2019-03-12 14:02                 ` Lauri Ehrenpreis
  0 siblings, 0 replies; 17+ messages in thread
From: Lauri Ehrenpreis @ 2019-03-12 14:02 UTC (permalink / raw)
  Cc: amd-gfx list


[-- Attachment #1.1: Type: text/plain, Size: 8363 bytes --]

I found that if I have HDMI cable connected and desktop environment
running, I can still reproduce the low memory speed 100% by logging in over
ssh and starting my "cl_slow_test" program. It starts up, does the
clCreateContext and starts doing slow memcpy in loop. Now as soon as I move
the mouse in desktop env, immediatelly the memcpy speed goes normal.

This time I enabled amdgpu logging also in kernel driver this way:

sudo trace-cmd start -e dma_fence -e gpu_scheduler -e amdgpu -v -e
"amdgpu_dm:amdgpu_dc_rreg" -e "amdgpu_dm:amdgpu_dc_wreg" -e
"amdgpu_dm:amdgpu_dc_performance" -e "amdgpu:amdgpu_mm_rreg" -e
"amdgpu:amdgpu_mm_wreg" -e "amdgpu:amdgpu_iv" -e "amdgpu:amdgpu_bo_create"
-e "amdgpu:amdgpu_cs" -e "amdgpu:amdgpu_cs_ioctl" -e
"amdgpu:amdgpu_sched_run_job" -e "amdgpu:amdgpu_vm_grab_id" -e
"amdgpu:amdgpu_vm_bo_map" -e "amdgpu:amdgpu_vm_bo_unmap" -e
"amdgpu:amdgpu_vm_bo_update" -e "amdgpu:amdgpu_vm_bo_cs" -e
"amdgpu:amdgpu_vm_set_ptes" -e "amdgpu:amdgpu_vm_copy_ptes" -e
"amdgpu:amdgpu_vm_flush" -e "amdgpu:amdgpu_pasid_allocated" -e
"amdgpu:amdgpu_pasid_freed" -e "amdgpu:amdgpu_bo_list_set" -e
"amdgpu:amdgpu_cs_bo_status" -e "amdgpu:amdgpu_cs_bo_status" -e
"amdgpu:amdgpu_bo_move" -e "amdgpu:amdgpu_ib_pipe_sync"
cd /sys/kernel/debug/tracing && cat trace_pipe | tee
slow_test_amdgpu_log.txt

Attached the log file. In the log file there are 3 annotations: "CL SLOW
TEST STARTED, MEMORY SPEED SLOW", "MOUSE_MOVED, MEMORY SPEED RESTORES" and
"CL SLOW TEST  CLOSED".

Maybe this helps to understand what magic the mouse moving does to the
system? I am really stuck with this - 100x slowdown is obviously not
acceptable. Maybe there is a way how to work around the issue at least?

--
Lauri

On Sun, Mar 10, 2019 at 9:13 PM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:

> Seems sysbench cpu test does not slow down:
> 1) run sysbench cpu on idle machine:
>  sysbench cpu run
> ...
> General statistics:
>     total time:                          10.0033s
>     total number of events:              19052
> 2) start ./cl_slow_test 1 10000 in background
> 3) run sysbench again
> sysbench cpu run
> ..
> General statistics:
>     total time:                          10.0036s
>     total number of events:              18979
>
> So if did not slow down considerably.
>
> If I do similar test with sysbench memory test I get following results:
> 1)  run sysbench memory on idle machine:
> sysbench memory --memory-block-size=32M --memory-total-size=100G run
> ...
> 66432.00 MiB transferred (6638.95 MiB/sec)
> 2) start ./cl_slow_test 1 10000 in background
> 3) sysbench memory --memory-block-size=32M --memory-total-size=100G run
> ...
> 672.00 MiB transferred (66.40 MiB/sec)
>
> It confirms that memory speed is reduced 100x :(
>
> --
> Lauri
>
>
> On Sat, Mar 9, 2019 at 9:22 PM Jan Vesely <jan.vesely-kgbqMDwikbSVc3sceRu5cw@public.gmane.org> wrote:
>
>> On Sat, Mar 9, 2019 at 1:54 AM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
>> wrote:
>> >
>> > Even if it's using CPU for OCL (I know it's not doing this), why does
>> memcpy on CPU slow down permanently, if I'm not doing anything with OpenCL
>> after clCreateContext?
>> >
>> > As you see from test program it just does clCreateContext and then a
>> loop of memcpy-s on CPU.
>> >
>> > Also I found out that writing different values to
>> /sys/class/drm/card0/device/power_dpm_force_performance_level changes my
>> max memcpy speed on CPU:
>> >
>> > echo "low" >
>> /sys/class/drm/card0/device/power_dpm_force_performance_level
>> > ./cl_slow_test 1 5
>> > got 1 platforms 1 devices
>> > speed 731.810425 avg 731.810425 mbytes/s
>> > speed 163.425583 avg 447.618011 mbytes/s
>> > speed 123.441612 avg 339.559235 mbytes/s
>> > speed 121.655266 avg 285.083252 mbytes/s
>> > speed 123.806801 avg 252.827972 mbytes/s
>> >
>> > echo "high" >
>> /sys/class/drm/card0/device/power_dpm_force_performance_level
>> > ./cl_slow_test 1 5
>> > got 1 platforms 1 devices
>> > speed 3742.063721 avg 3742.063721 mbytes/s
>> > speed 836.148987 avg 2289.106445 mbytes/s
>> > speed 189.379166 avg 1589.197266 mbytes/s
>> > speed 189.271393 avg 1239.215820 mbytes/s
>> > speed 188.290451 avg 1029.030762 mbytes/s
>> >
>> > echo "profile_standard" >
>> /sys/class/drm/card0/device/power_dpm_force_performance_level
>> > ./cl_slow_test 1 5
>> > got 1 platforms 1 devices
>> > speed 2303.955566 avg 2303.955566 mbytes/s
>> > speed 2298.224121 avg 2301.089844 mbytes/s
>> > speed 2295.585205 avg 2299.254883 mbytes/s
>> > speed 2295.762939 avg 2298.381836 mbytes/s
>> > speed 2288.766602 avg 2296.458740 mbytes/s
>> >
>> >  echo "profile_peak" >
>> /sys/class/drm/card0/device/power_dpm_force_performance_level
>> > ./cl_slow_test 1 5
>> > got 1 platforms 1 devices
>> > speed 3710.360352 avg 3710.360352 mbytes/s
>> > speed 3713.660400 avg 3712.010254 mbytes/s
>> > speed 3797.630859 avg 3740.550537 mbytes/s
>> > speed 3708.004883 avg 3732.414062 mbytes/s
>> > speed 3796.403076 avg 3745.211914 mbytes/s
>> >
>> > However none of those is close to the memcpy speed I get when I don't
>> do clCreateContext (my test prog has first arg 0):
>> > ./cl_slow_test 0 5
>> > speed 7299.201660 avg 7299.201660 mbytes/s
>> > speed 9298.841797 avg 8299.021484 mbytes/s
>> > speed 9360.181641 avg 8652.742188 mbytes/s
>> > speed 9004.759766 avg 8740.746094 mbytes/s
>> > speed 9414.607422 avg 8875.518555 mbytes/s
>> >
>> > Also attached clinfo.txt. It shows that opencl is using GPU so device
>> node permissions are probably not the issue.
>>
>> Is it only memory accesses or does overall CPU performance degrade
>> (including compute - say sysbench) as well?
>>
>> Jan
>>
>> > --
>> > Lauri
>> >
>> > On Fri, Mar 8, 2019 at 10:35 PM Alex Deucher <alexdeucher-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
>> wrote:
>> >>
>> >> I think you are probably using the CPU for OCL in the remote login
>> >> case.  When you log into the desktop, the permissions on the device
>> >> nodes get changed dynamically to support accelerated rendering.  You
>> >> probably need to change the permissions on the device nodes manually
>> >> if you are not logging into the desktop.
>> >>
>> >> Alex
>> >>
>> >> On Fri, Mar 8, 2019 at 2:43 PM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
>> wrote:
>> >> >
>> >> > Hi!
>> >> >
>> >> > I am using Ryzen 2400G with Gigabyte AMD B450 AORUS board. I have
>> latest bios, ubuntu 18.04 and latest mainline kernel (5.0.0-050000-generic)
>> installed. Also I have rocm-dev 2.1.96 but no rock-dkms installed.
>> >> >
>> >> > I found that when I log in over ssh and try to use OpenCL (doing
>> clCreateContext is enough) then cpu memory accesses after that will slow
>> down by 100x.
>> >> > If I connect HDMI cable and log in to desktop mode then this does
>> not happen. Also if I don't call clCreateContext then everything works
>> properly.
>> >> >
>> >> > Attached the test program and kernel log also. Test works like that :
>> >> > g++ cl_slow_test.cpp -o cl_slow_test -I /opt/rocm/opencl/include/ -L
>> /opt/rocm/opencl/lib/x86_64/  -lOpenCL
>> >> > lauri@rv:~$ ./cl_slow_test 0 5
>> >> > speed 7003.145508 avg 7003.145508 mbytes/s
>> >> > speed 8427.357422 avg 7715.251465 mbytes/s
>> >> > speed 9203.049805 avg 8211.184570 mbytes/s
>> >> > speed 9845.956055 avg 8619.877930 mbytes/s
>> >> > speed 9882.748047 avg 8872.452148 mbytes/s
>> >> > lauri@rv:~$ ./cl_slow_test 1 5
>> >> > got 1 platforms 1 devices
>> >> > speed 1599.803589 avg 1599.803589 mbytes/s
>> >> > speed 1665.426392 avg 1632.614990 mbytes/s
>> >> > speed 146.137253 avg 1137.122437 mbytes/s
>> >> > speed 121.056877 avg 883.106018 mbytes/s
>> >> > speed 122.428970 avg 730.970581 mbytes/s
>> >> >
>> >> > I also tried latest amd-staging kernel
>> https://github.com/M-Bab/linux-kernel-amdgpu-binaries and it had the
>> same issue.
>> >> >
>> >> > Can anyone point me into right direction?
>> >> >
>> >> > Br,
>> >> > Lauri
>> >> > _______________________________________________
>> >> > amd-gfx mailing list
>> >> > amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
>> >> > https://lists.freedesktop.org/mailman/listinfo/amd-gfx
>> >
>> > _______________________________________________
>> > amd-gfx mailing list
>> > amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
>> > https://lists.freedesktop.org/mailman/listinfo/amd-gfx
>>
>

[-- Attachment #1.2: Type: text/html, Size: 11694 bytes --]

[-- Attachment #2: slow_test_amdgpu_log.txt --]
[-- Type: text/plain, Size: 295187 bytes --]

CL SLOW TEST STARTED, MEMORY SPEED SLOW

    cl_slow_test-3129  [001] ....  5984.254910: dma_fence_init: driver=drm_sched timeline=sdma0 context=528 seqno=1
    cl_slow_test-3129  [001] ....  5984.254919: dma_fence_init: driver=drm_sched timeline=sdma0 context=529 seqno=1
    cl_slow_test-3129  [001] ....  5984.254921: drm_sched_job: entity=000000004614b3e5, id=1500, fence=000000003edc69b4, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5984.254964: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1730
           sdma0-802   [002] ....  5984.254975: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=528 seqno=1
           sdma0-802   [002] d...  5984.254976: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1730
          <idle>-0     [000] d.h.  5984.255026: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1730
          <idle>-0     [000] d.h.  5984.255027: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=529 seqno=1
          <idle>-0     [000] dNh.  5984.255030: drm_sched_process_job: fence=000000003edc69b4 signaled
    cl_slow_test-3129  [001] ....  5984.275543: dma_fence_init: driver=drm_sched timeline=sdma0 context=528 seqno=2
    cl_slow_test-3129  [001] ....  5984.275549: dma_fence_init: driver=drm_sched timeline=sdma0 context=529 seqno=2
    cl_slow_test-3129  [001] ....  5984.275550: drm_sched_job: entity=000000004614b3e5, id=1501, fence=00000000ab4fef38, ring=sdma0, job count:0, hw job count:0
    cl_slow_test-3129  [001] ....  5984.275556: dma_fence_init: driver=amdgpu_amdkfd_fence timeline=cl_slow_test context=530 seqno=22
    cl_slow_test-3129  [001] ....  5984.275561: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=529 seqno=2
           sdma0-802   [002] ....  5984.275589: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1731
           sdma0-802   [002] ....  5984.275597: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=528 seqno=2
           sdma0-802   [002] d...  5984.275598: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1731
          <idle>-0     [000] d.h.  5984.275649: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1731
          <idle>-0     [000] d.h.  5984.275651: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=529 seqno=2
          <idle>-0     [000] dNh.  5984.275657: drm_sched_process_job: fence=00000000ab4fef38 signaled
    cl_slow_test-3129  [001] ....  5984.275662: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=529 seqno=2
    cl_slow_test-3129  [007] ....  5984.283734: dma_fence_init: driver=drm_sched timeline=sdma0 context=531 seqno=1
    cl_slow_test-3129  [007] ....  5984.283744: dma_fence_init: driver=drm_sched timeline=sdma0 context=532 seqno=1
    cl_slow_test-3129  [007] ....  5984.283745: drm_sched_job: entity=00000000c76c000c, id=1502, fence=00000000312d2616, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5984.283784: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1732
           sdma0-802   [002] ....  5984.283787: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=531 seqno=1
           sdma0-802   [002] d...  5984.283788: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1732
          <idle>-0     [000] d.h.  5984.283814: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1732
          <idle>-0     [000] d.h.  5984.283816: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=532 seqno=1
          <idle>-0     [000] dNh.  5984.283818: drm_sched_process_job: fence=00000000312d2616 signaled

MOUSE_MOVED, MEMORY SPEED RESTORES

  gnome-shel:cs0-1207  [000] ....  5988.630902: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2431
  gnome-shel:cs0-1207  [000] ....  5988.631126: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2431
  gnome-shel:cs0-1207  [000] ....  5988.631458: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5988.631683: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2463
  gnome-shel:cs0-1207  [000] ....  5988.631683: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2463
  gnome-shel:cs0-1207  [000] ....  5988.631811: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2431
  gnome-shel:cs0-1207  [000] ....  5988.631812: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2431
  gnome-shel:cs0-1207  [000] ....  5988.631856: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2584
  gnome-shel:cs0-1207  [000] ....  5988.631874: drm_sched_job: entity=000000002109c155, id=2469, fence=0000000072412efa, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.634629: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2617
             gfx-782   [000] ....  5988.634801: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2463
             gfx-782   [000] d...  5988.634811: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2617
          <idle>-0     [000] d.h.  5988.635098: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2617
          <idle>-0     [000] d.h.  5988.635100: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2463
          <idle>-0     [000] dNh.  5988.635104: drm_sched_process_job: fence=0000000072412efa signaled
     gnome-shell-1199  [005] ....  5988.675197: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=683
     gnome-shell-1199  [005] ....  5988.675216: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=683
     gnome-shell-1199  [005] ....  5988.675217: drm_sched_job: entity=00000000e4a2de56, id=1503, fence=00000000d47d774d, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.675236: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1733
           sdma0-802   [002] ....  5988.675248: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=683
           sdma0-802   [002] d...  5988.675249: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1733
     gnome-shell-1199  [005] ....  5988.675249: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=684
     gnome-shell-1199  [005] ....  5988.675250: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=684
     gnome-shell-1199  [005] ....  5988.675250: drm_sched_job: entity=00000000e4a2de56, id=1504, fence=0000000020953a1e, ring=sdma0, job count:0, hw job count:1
           sdma0-802   [002] ....  5988.675253: drm_sched_job_wait_dep: job ring=sdma0, id=1504, depends fence=00000000d47d774d, context=66, seq=683
           sdma0-802   [002] ....  5988.675254: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1734
           sdma0-802   [002] ....  5988.675256: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=684
           sdma0-802   [002] d...  5988.675256: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1734
     gnome-shell-1199  [005] ....  5988.675259: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=685
     gnome-shell-1199  [005] ....  5988.675260: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=685
     gnome-shell-1199  [005] ....  5988.675260: drm_sched_job: entity=00000000e4a2de56, id=1505, fence=000000007fdd7f7a, ring=sdma0, job count:0, hw job count:2
     gnome-shell-1199  [005] ....  5988.675295: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=686
     gnome-shell-1199  [005] ....  5988.675296: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=686
     gnome-shell-1199  [005] ....  5988.675296: drm_sched_job: entity=00000000e4a2de56, id=1506, fence=00000000f91212b2, ring=sdma0, job count:1, hw job count:2
          <idle>-0     [000] d.h.  5988.675311: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1733
          <idle>-0     [000] d.h.  5988.675313: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=683
          <idle>-0     [000] dNh.  5988.675319: drm_sched_process_job: fence=00000000d47d774d signaled
           sdma0-802   [002] ....  5988.675324: drm_sched_job_wait_dep: job ring=sdma0, id=1505, depends fence=0000000020953a1e, context=66, seq=684
           sdma0-802   [002] ....  5988.675326: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1735
          <idle>-0     [000] dNh.  5988.675327: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1734
           sdma0-802   [002] ....  5988.675327: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=685
          <idle>-0     [000] dNh.  5988.675327: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=684
          <idle>-0     [000] dNh.  5988.675328: drm_sched_process_job: fence=0000000020953a1e signaled
           sdma0-802   [002] d...  5988.675329: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1735
           sdma0-802   [002] ....  5988.675329: drm_sched_job_wait_dep: job ring=sdma0, id=1506, depends fence=000000007fdd7f7a, context=66, seq=685
           sdma0-802   [002] ....  5988.675330: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1736
           sdma0-802   [002] ....  5988.675332: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=686
           sdma0-802   [002] d...  5988.675332: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1736
          <idle>-0     [000] d.h.  5988.675354: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1735
          <idle>-0     [000] d.h.  5988.675354: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=685
          <idle>-0     [000] dNh.  5988.675356: drm_sched_process_job: fence=000000007fdd7f7a signaled
          <idle>-0     [000] d.h.  5988.675377: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1736
          <idle>-0     [000] d.h.  5988.675378: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=686
          <idle>-0     [000] dNh.  5988.675379: drm_sched_process_job: fence=00000000f91212b2 signaled
     gnome-shell-1199  [005] ....  5988.675427: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=687
     gnome-shell-1199  [005] ....  5988.675436: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=687
     gnome-shell-1199  [005] ....  5988.675437: drm_sched_job: entity=00000000e4a2de56, id=1507, fence=0000000075157a0e, ring=sdma0, job count:0, hw job count:0
     gnome-shell-1199  [005] ....  5988.675439: amdgpu_vm_bo_mapping: soffs=0800101140, eoffs=0800101160, flags=70
           sdma0-802   [002] ....  5988.675441: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1737
           sdma0-802   [002] ....  5988.675443: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=687
           sdma0-802   [002] d...  5988.675443: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1737
          <idle>-0     [000] d.h.  5988.675470: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1737
          <idle>-0     [000] d.h.  5988.675471: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=687
          <idle>-0     [000] dNh.  5988.675473: drm_sched_process_job: fence=0000000075157a0e signaled
  gnome-shel:cs0-1207  [002] ....  5988.675483: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=134
  gnome-shel:cs0-1207  [002] ....  5988.675489: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=134
  gnome-shel:cs0-1207  [002] ....  5988.675500: dma_fence_init: driver=drm_sched timeline=sdma0 context=129 seqno=166
  gnome-shel:cs0-1207  [002] ....  5988.675503: dma_fence_init: driver=drm_sched timeline=sdma0 context=130 seqno=166
  gnome-shel:cs0-1207  [002] ....  5988.675505: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=130 seqno=134
  gnome-shel:cs0-1207  [002] ....  5988.675506: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=129 seqno=134
  gnome-shel:cs0-1207  [002] ....  5988.675507: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1485
  gnome-shel:cs0-1207  [002] ....  5988.675508: drm_sched_job: entity=00000000df73788d, id=1508, fence=000000001a5f1f2b, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.675560: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1726
           sdma0-802   [002] ....  5988.675567: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1738
           sdma0-802   [002] ....  5988.675570: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1739
           sdma0-802   [002] ....  5988.675576: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=129 seqno=166
           sdma0-802   [002] d...  5988.675576: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1739
     gnome-shell-1199  [005] ....  5988.675595: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=166
          <idle>-0     [000] d.h.  5988.675609: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1738
          <idle>-0     [000] d.h.  5988.675626: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1739
          <idle>-0     [000] d.h.  5988.675628: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=130 seqno=166
          <idle>-0     [000] dNh.  5988.675632: drm_sched_process_job: fence=000000001a5f1f2b signaled
     gnome-shell-1199  [005] ....  5988.675632: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=166
  gnome-shel:cs0-1207  [002] ....  5988.677048: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=135
  gnome-shel:cs0-1207  [002] ....  5988.677058: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=135
  gnome-shel:cs0-1207  [002] ....  5988.677070: dma_fence_init: driver=drm_sched timeline=sdma0 context=129 seqno=167
  gnome-shel:cs0-1207  [002] ....  5988.677071: dma_fence_init: driver=drm_sched timeline=sdma0 context=130 seqno=167
  gnome-shel:cs0-1207  [002] ....  5988.677073: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=130 seqno=135
  gnome-shel:cs0-1207  [002] ....  5988.677073: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=129 seqno=135
  gnome-shel:cs0-1207  [002] ....  5988.677074: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1492
  gnome-shel:cs0-1207  [002] ....  5988.677075: drm_sched_job: entity=00000000df73788d, id=1509, fence=00000000c64e97bb, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.677125: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1740
           sdma0-802   [002] ....  5988.677131: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=129 seqno=167
           sdma0-802   [002] d...  5988.677131: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1740
     gnome-shell-1199  [005] ....  5988.677155: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=167
          <idle>-0     [000] d.h.  5988.677174: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1740
          <idle>-0     [000] d.h.  5988.677177: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=130 seqno=167
     gnome-shell-1199  [005] ....  5988.677183: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=167
          <idle>-0     [000] dNh.  5988.677184: drm_sched_process_job: fence=00000000c64e97bb signaled
  gnome-shel:cs0-1207  [002] ....  5988.678610: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=136
  gnome-shel:cs0-1207  [002] ....  5988.678618: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=136
  gnome-shel:cs0-1207  [002] ....  5988.678626: dma_fence_init: driver=drm_sched timeline=sdma0 context=129 seqno=168
  gnome-shel:cs0-1207  [002] ....  5988.678627: dma_fence_init: driver=drm_sched timeline=sdma0 context=130 seqno=168
  gnome-shel:cs0-1207  [002] ....  5988.678627: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=130 seqno=136
  gnome-shel:cs0-1207  [002] ....  5988.678628: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=129 seqno=136
  gnome-shel:cs0-1207  [002] ....  5988.678629: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1499
  gnome-shel:cs0-1207  [002] ....  5988.678630: drm_sched_job: entity=00000000df73788d, id=1510, fence=0000000028ef1134, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.678668: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1741
           sdma0-802   [002] ....  5988.678674: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=129 seqno=168
           sdma0-802   [002] d...  5988.678675: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1741
     gnome-shell-1199  [005] ....  5988.678691: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=168
          <idle>-0     [000] d.h.  5988.678725: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1741
          <idle>-0     [000] d.h.  5988.678727: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=130 seqno=168
     gnome-shell-1199  [005] ....  5988.678733: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=168
          <idle>-0     [000] dNh.  5988.678733: drm_sched_process_job: fence=0000000028ef1134 signaled
  gnome-shel:cs0-1207  [002] ....  5988.687338: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=137
  gnome-shel:cs0-1207  [002] ....  5988.687349: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=137
  gnome-shel:cs0-1207  [002] ....  5988.687360: dma_fence_init: driver=drm_sched timeline=sdma0 context=129 seqno=169
  gnome-shel:cs0-1207  [002] ....  5988.687363: dma_fence_init: driver=drm_sched timeline=sdma0 context=130 seqno=169
  gnome-shel:cs0-1207  [002] ....  5988.687364: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=130 seqno=137
  gnome-shel:cs0-1207  [002] ....  5988.687365: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=129 seqno=137
  gnome-shel:cs0-1207  [002] ....  5988.687365: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1506
  gnome-shel:cs0-1207  [002] ....  5988.687367: drm_sched_job: entity=00000000df73788d, id=1511, fence=000000008050c4e5, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.687410: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1742
           sdma0-802   [002] ....  5988.687422: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=129 seqno=169
           sdma0-802   [002] d...  5988.687450: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1742
          <idle>-0     [000] d.h.  5988.687470: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1742
          <idle>-0     [000] d.h.  5988.687473: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=130 seqno=169
          <idle>-0     [000] dNh.  5988.687477: drm_sched_process_job: fence=000000008050c4e5 signaled
  gnome-shel:cs0-1207  [002] ....  5988.688133: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=138
  gnome-shel:cs0-1207  [002] ....  5988.688141: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=138
  gnome-shel:cs0-1207  [002] ....  5988.688152: dma_fence_init: driver=drm_sched timeline=sdma0 context=129 seqno=170
  gnome-shel:cs0-1207  [002] ....  5988.688154: dma_fence_init: driver=drm_sched timeline=sdma0 context=130 seqno=170
  gnome-shel:cs0-1207  [002] ....  5988.688156: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=130 seqno=138
  gnome-shel:cs0-1207  [002] ....  5988.688156: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=129 seqno=138
  gnome-shel:cs0-1207  [002] ....  5988.688157: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1513
  gnome-shel:cs0-1207  [002] ....  5988.688158: drm_sched_job: entity=00000000df73788d, id=1512, fence=000000000314baf0, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.688202: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1743
           sdma0-802   [002] ....  5988.688225: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=129 seqno=170
           sdma0-802   [002] d...  5988.688230: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1743
     gnome-shell-1199  [005] ....  5988.688257: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=170
             tee-3128  [000] d.h.  5988.688271: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1743
             tee-3128  [000] d.h.  5988.688273: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=130 seqno=170
     gnome-shell-1199  [005] ....  5988.688280: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=170
             tee-3128  [000] d.h.  5988.688280: drm_sched_process_job: fence=000000000314baf0 signaled
  gnome-shel:cs0-1207  [002] ....  5988.688821: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=139
  gnome-shel:cs0-1207  [002] ....  5988.688830: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=139
  gnome-shel:cs0-1207  [002] ....  5988.688840: dma_fence_init: driver=drm_sched timeline=sdma0 context=129 seqno=171
  gnome-shel:cs0-1207  [002] ....  5988.688843: dma_fence_init: driver=drm_sched timeline=sdma0 context=130 seqno=171
  gnome-shel:cs0-1207  [002] ....  5988.688844: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=130 seqno=139
  gnome-shel:cs0-1207  [002] ....  5988.688845: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=129 seqno=139
  gnome-shel:cs0-1207  [002] ....  5988.688846: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1520
  gnome-shel:cs0-1207  [002] ....  5988.688847: drm_sched_job: entity=00000000df73788d, id=1513, fence=000000003bf59f21, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.688893: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1744
           sdma0-802   [002] ....  5988.688921: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=129 seqno=171
           sdma0-802   [002] d...  5988.688923: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1744
     gnome-shell-1199  [005] ....  5988.688953: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=171
             tee-3128  [000] d.h.  5988.688971: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1744
             tee-3128  [000] d.h.  5988.688973: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=130 seqno=171
     gnome-shell-1199  [005] ....  5988.688978: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=171
             tee-3128  [000] d.h.  5988.688978: drm_sched_process_job: fence=000000003bf59f21 signaled
  gnome-shel:cs0-1207  [002] ....  5988.694133: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=426
  gnome-shel:cs0-1207  [002] ....  5988.694142: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=426
  gnome-shel:cs0-1207  [002] ....  5988.694152: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=458
  gnome-shel:cs0-1207  [002] ....  5988.694153: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=458
  gnome-shel:cs0-1207  [002] ....  5988.694154: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=426
  gnome-shel:cs0-1207  [002] ....  5988.694155: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=426
  gnome-shel:cs0-1207  [002] ....  5988.694157: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1640
  gnome-shel:cs0-1207  [002] ....  5988.694158: drm_sched_job: entity=00000000f6f96e12, id=1514, fence=00000000de11fa0a, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.694203: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1745
           sdma0-802   [002] ....  5988.694214: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=458
           sdma0-802   [002] d...  5988.694234: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1745
             tee-3128  [000] d.h.  5988.694270: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1745
             tee-3128  [000] d.h.  5988.694272: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=458
             tee-3128  [000] d.h.  5988.694277: drm_sched_process_job: fence=00000000de11fa0a signaled
  gnome-shel:cs0-1207  [002] ....  5988.694296: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=427
  gnome-shel:cs0-1207  [002] ....  5988.694298: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=427
  gnome-shel:cs0-1207  [002] ....  5988.694302: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=459
  gnome-shel:cs0-1207  [002] ....  5988.694302: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=459
  gnome-shel:cs0-1207  [002] ....  5988.694303: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=427
  gnome-shel:cs0-1207  [002] ....  5988.694304: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=427
  gnome-shel:cs0-1207  [002] ....  5988.694304: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1642
  gnome-shel:cs0-1207  [002] ....  5988.694305: drm_sched_job: entity=00000000f6f96e12, id=1515, fence=00000000e8bf402a, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.694330: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1746
           sdma0-802   [002] ....  5988.694336: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=459
           sdma0-802   [002] d...  5988.694336: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1746
             tee-3128  [000] d.h.  5988.694369: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1746
             tee-3128  [000] d.h.  5988.694371: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=459
             tee-3128  [000] d.h.  5988.694372: drm_sched_process_job: fence=00000000e8bf402a signaled
  gnome-shel:cs0-1207  [002] ....  5988.694426: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=428
  gnome-shel:cs0-1207  [002] ....  5988.694430: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=428
  gnome-shel:cs0-1207  [002] ....  5988.694435: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=460
  gnome-shel:cs0-1207  [002] ....  5988.694436: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=460
  gnome-shel:cs0-1207  [002] ....  5988.694436: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=428
  gnome-shel:cs0-1207  [002] ....  5988.694437: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=428
  gnome-shel:cs0-1207  [002] ....  5988.694440: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1644
  gnome-shel:cs0-1207  [002] ....  5988.694441: drm_sched_job: entity=00000000f6f96e12, id=1516, fence=0000000085bd277a, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.694458: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1747
           sdma0-802   [002] ....  5988.694463: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=460
           sdma0-802   [002] d...  5988.694464: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1747
             tee-3128  [000] d.h.  5988.694490: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1747
             tee-3128  [000] d.h.  5988.694492: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=460
             tee-3128  [000] d.h.  5988.694493: drm_sched_process_job: fence=0000000085bd277a signaled
     gnome-shell-1199  [005] ....  5988.694780: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=688
     gnome-shell-1199  [005] ....  5988.694786: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=688
     gnome-shell-1199  [005] ....  5988.694786: drm_sched_job: entity=00000000e4a2de56, id=1517, fence=00000000a96fe9e8, ring=sdma0, job count:0, hw job count:0
     gnome-shell-1199  [005] ....  5988.694789: amdgpu_vm_bo_mapping: soffs=08001011a0, eoffs=08001011c0, flags=70
           sdma0-802   [002] ....  5988.694793: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1748
           sdma0-802   [002] ....  5988.694799: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=688
           sdma0-802   [002] d...  5988.694800: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1748
  gnome-shel:cs0-1207  [002] ....  5988.694820: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=140
  gnome-shel:cs0-1207  [002] ....  5988.694825: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=140
  gnome-shel:cs0-1207  [002] ....  5988.694831: dma_fence_init: driver=drm_sched timeline=sdma0 context=129 seqno=172
  gnome-shel:cs0-1207  [002] ....  5988.694832: dma_fence_init: driver=drm_sched timeline=sdma0 context=130 seqno=172
  gnome-shel:cs0-1207  [002] ....  5988.694833: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=130 seqno=140
  gnome-shel:cs0-1207  [002] ....  5988.694834: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=129 seqno=140
  gnome-shel:cs0-1207  [002] ....  5988.694834: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1527
             tee-3128  [000] d.h.  5988.694835: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1748
  gnome-shel:cs0-1207  [002] ....  5988.694835: drm_sched_job: entity=00000000df73788d, id=1518, fence=00000000eddd9a26, ring=sdma0, job count:0, hw job count:1
             tee-3128  [000] d.h.  5988.694836: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=688
             tee-3128  [000] d.h.  5988.694839: drm_sched_process_job: fence=00000000a96fe9e8 signaled
           sdma0-802   [002] ....  5988.694864: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1738
           sdma0-802   [002] ....  5988.694870: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1749
           sdma0-802   [002] ....  5988.694873: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1750
           sdma0-802   [002] ....  5988.694879: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=129 seqno=172
           sdma0-802   [002] d...  5988.694883: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1750
             tee-3128  [000] d.h.  5988.694909: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1749
  gnome-shel:cs0-1207  [002] ....  5988.694922: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2432
             tee-3128  [000] d.h.  5988.694926: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1750
  gnome-shel:cs0-1207  [002] ....  5988.694926: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2432
             tee-3128  [000] d.h.  5988.694928: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=130 seqno=172
             tee-3128  [000] d.h.  5988.694929: drm_sched_process_job: fence=00000000eddd9a26 signaled
  gnome-shel:cs0-1207  [002] .N..  5988.694932: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [002] ....  5988.694939: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2464
  gnome-shel:cs0-1207  [002] ....  5988.694940: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2464
  gnome-shel:cs0-1207  [002] ....  5988.694940: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2432
  gnome-shel:cs0-1207  [002] ....  5988.694941: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2432
  gnome-shel:cs0-1207  [002] ....  5988.694942: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2585
  gnome-shel:cs0-1207  [002] ....  5988.694943: drm_sched_job: entity=000000002109c155, id=2470, fence=00000000c6e59684, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.694957: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2614
             gfx-782   [000] ....  5988.694968: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2618
     gnome-shell-1199  [005] ....  5988.694972: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2464
             gfx-782   [000] ....  5988.694974: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2619
             gfx-782   [000] ....  5988.694983: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2464
             gfx-782   [000] d...  5988.694988: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2619
             tee-3128  [000] d.h.  5988.695005: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2618
          <idle>-0     [000] d.h.  5988.695336: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2619
          <idle>-0     [000] d.h.  5988.695338: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2464
          <idle>-0     [000] dNh.  5988.695343: drm_sched_process_job: fence=00000000c6e59684 signaled
     gnome-shell-1199  [005] ....  5988.695343: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2464
  gnome-shel:cs0-1207  [002] ....  5988.695530: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=429
  gnome-shel:cs0-1207  [002] ....  5988.695536: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=429
  gnome-shel:cs0-1207  [002] ....  5988.695551: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=461
  gnome-shel:cs0-1207  [002] ....  5988.695555: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=461
  gnome-shel:cs0-1207  [002] ....  5988.695557: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=429
  gnome-shel:cs0-1207  [002] ....  5988.695558: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=429
  gnome-shel:cs0-1207  [002] ....  5988.695559: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1647
  gnome-shel:cs0-1207  [002] ....  5988.695560: drm_sched_job: entity=00000000f6f96e12, id=1519, fence=000000000d99184d, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.695608: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1751
           sdma0-802   [002] ....  5988.695614: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=461
           sdma0-802   [002] d...  5988.695616: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1751
             tee-3128  [000] d.h.  5988.695655: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1751
             tee-3128  [000] d.h.  5988.695657: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=461
             tee-3128  [000] d.h.  5988.695660: drm_sched_process_job: fence=000000000d99184d signaled
     gnome-shell-1199  [005] ....  5988.695697: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=689
     gnome-shell-1199  [005] ....  5988.695698: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=689
     gnome-shell-1199  [005] ....  5988.695698: drm_sched_job: entity=00000000e4a2de56, id=1520, fence=0000000003d541cf, ring=sdma0, job count:0, hw job count:0
     gnome-shell-1199  [005] ....  5988.695700: amdgpu_vm_bo_mapping: soffs=08001011c0, eoffs=08001011e0, flags=70
           sdma0-802   [002] ....  5988.695704: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1752
           sdma0-802   [002] ....  5988.695706: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=689
           sdma0-802   [002] d...  5988.695707: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1752
          <idle>-0     [000] d.h.  5988.695735: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1752
          <idle>-0     [000] d.h.  5988.695736: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=689
          <idle>-0     [000] dNh.  5988.695739: drm_sched_process_job: fence=0000000003d541cf signaled
     gnome-shell-1199  [005] ....  5988.696077: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=690
     gnome-shell-1199  [005] ....  5988.696078: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=690
     gnome-shell-1199  [005] ....  5988.696079: drm_sched_job: entity=00000000e4a2de56, id=1521, fence=0000000076f04be1, ring=sdma0, job count:0, hw job count:0
     gnome-shell-1199  [005] ....  5988.696082: amdgpu_vm_bo_mapping: soffs=0800102660, eoffs=08001026a0, flags=70
           sdma0-802   [002] ....  5988.696085: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1753
           sdma0-802   [002] ....  5988.696087: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=690
           sdma0-802   [002] d...  5988.696088: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1753
          <idle>-0     [000] d.h.  5988.696130: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1753
          <idle>-0     [000] d.h.  5988.696131: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=690
          <idle>-0     [000] dNh.  5988.696133: drm_sched_process_job: fence=0000000076f04be1 signaled
  gnome-shel:cs0-1207  [002] ....  5988.696181: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=430
  gnome-shel:cs0-1207  [002] ....  5988.696182: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=430
  gnome-shel:cs0-1207  [002] ....  5988.696190: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=462
  gnome-shel:cs0-1207  [002] ....  5988.696190: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=462
  gnome-shel:cs0-1207  [002] ....  5988.696191: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=430
  gnome-shel:cs0-1207  [002] ....  5988.696191: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=430
  gnome-shel:cs0-1207  [002] ....  5988.696192: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1649
  gnome-shel:cs0-1207  [002] ....  5988.696193: drm_sched_job: entity=00000000f6f96e12, id=1522, fence=0000000011475004, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.696238: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1749
           sdma0-802   [002] ....  5988.696242: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1754
           sdma0-802   [002] ....  5988.696243: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1755
           sdma0-802   [002] ....  5988.696250: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=462
           sdma0-802   [002] d...  5988.696250: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1755
          <idle>-0     [000] d.h.  5988.696280: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1754
          <idle>-0     [000] d.h.  5988.696311: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1755
     gnome-shell-1199  [005] ....  5988.696311: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=691
          <idle>-0     [000] d.h.  5988.696311: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=462
     gnome-shell-1199  [005] ....  5988.696311: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=691
     gnome-shell-1199  [005] ....  5988.696312: drm_sched_job: entity=00000000e4a2de56, id=1523, fence=00000000b68e1cff, ring=sdma0, job count:0, hw job count:0
          <idle>-0     [000] dNh.  5988.696313: drm_sched_process_job: fence=0000000011475004 signaled
     gnome-shell-1199  [005] ....  5988.696313: amdgpu_vm_bo_mapping: soffs=0800104c80, eoffs=0800104ce0, flags=70
           sdma0-802   [002] ....  5988.696316: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1756
           sdma0-802   [002] ....  5988.696319: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=691
           sdma0-802   [002] d...  5988.696319: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1756
  gnome-shel:cs0-1207  [003] ....  5988.696333: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=431
  gnome-shel:cs0-1207  [003] ....  5988.696335: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=431
  gnome-shel:cs0-1207  [003] ....  5988.696340: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=463
  gnome-shel:cs0-1207  [003] ....  5988.696341: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=463
  gnome-shel:cs0-1207  [003] ....  5988.696341: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=431
  gnome-shel:cs0-1207  [003] ....  5988.696342: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=431
  gnome-shel:cs0-1207  [003] ....  5988.696343: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1651
  gnome-shel:cs0-1207  [003] ....  5988.696343: drm_sched_job: entity=00000000f6f96e12, id=1524, fence=00000000a823f191, ring=sdma0, job count:0, hw job count:1
          <idle>-0     [000] d.h.  5988.696347: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1756
          <idle>-0     [000] d.h.  5988.696348: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=691
          <idle>-0     [000] dNh.  5988.696349: drm_sched_process_job: fence=00000000b68e1cff signaled
           sdma0-802   [002] ....  5988.696350: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1754
           sdma0-802   [002] ....  5988.696352: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1757
           sdma0-802   [002] ....  5988.696354: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1758
           sdma0-802   [002] ....  5988.696356: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=463
           sdma0-802   [002] d...  5988.696356: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1758
          <idle>-0     [000] d.h.  5988.696383: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1757
          <idle>-0     [000] d.h.  5988.696429: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1758
          <idle>-0     [000] d.h.  5988.696430: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=463
          <idle>-0     [000] dNh.  5988.696431: drm_sched_process_job: fence=00000000a823f191 signaled
     gnome-shell-1199  [005] ....  5988.696710: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=692
     gnome-shell-1199  [005] ....  5988.696711: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=692
     gnome-shell-1199  [005] ....  5988.696712: drm_sched_job: entity=00000000e4a2de56, id=1525, fence=00000000d9736827, ring=sdma0, job count:0, hw job count:0
     gnome-shell-1199  [005] ....  5988.696715: amdgpu_vm_bo_mapping: soffs=0800104c30, eoffs=0800104c54, flags=70
           sdma0-802   [002] ....  5988.696718: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1759
           sdma0-802   [002] ....  5988.696725: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=692
           sdma0-802   [002] d...  5988.696725: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1759
          <idle>-0     [000] d.h.  5988.696744: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1759
          <idle>-0     [000] d.h.  5988.696745: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=692
          <idle>-0     [000] dNh.  5988.696746: drm_sched_process_job: fence=00000000d9736827 signaled
  gnome-shel:cs0-1207  [003] ....  5988.696749: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=141
  gnome-shel:cs0-1207  [003] ....  5988.696750: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=141
  gnome-shel:cs0-1207  [003] ....  5988.696755: dma_fence_init: driver=drm_sched timeline=sdma0 context=129 seqno=173
  gnome-shel:cs0-1207  [003] ....  5988.696756: dma_fence_init: driver=drm_sched timeline=sdma0 context=130 seqno=173
  gnome-shel:cs0-1207  [003] ....  5988.696756: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=130 seqno=141
  gnome-shel:cs0-1207  [003] ....  5988.696757: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=129 seqno=141
  gnome-shel:cs0-1207  [003] ....  5988.696758: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1536
  gnome-shel:cs0-1207  [003] ....  5988.696758: drm_sched_job: entity=00000000df73788d, id=1526, fence=00000000adbc91ff, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.696765: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1757
           sdma0-802   [002] ....  5988.696768: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1760
           sdma0-802   [002] ....  5988.696769: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1761
           sdma0-802   [002] ....  5988.696772: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=129 seqno=173
           sdma0-802   [002] d...  5988.696773: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1761
          <idle>-0     [000] d.h.  5988.696785: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1760
          <idle>-0     [000] d.h.  5988.696794: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1761
          <idle>-0     [000] d.h.  5988.696795: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=130 seqno=173
          <idle>-0     [000] dNh.  5988.696797: drm_sched_process_job: fence=00000000adbc91ff signaled
  gnome-shel:cs0-1207  [003] ....  5988.696808: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2433
  gnome-shel:cs0-1207  [003] ....  5988.696808: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2433
  gnome-shel:cs0-1207  [003] ....  5988.696811: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2465
  gnome-shel:cs0-1207  [003] ....  5988.696812: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2465
  gnome-shel:cs0-1207  [003] ....  5988.696812: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2433
  gnome-shel:cs0-1207  [003] ....  5988.696813: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2433
  gnome-shel:cs0-1207  [003] ....  5988.696814: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2586
  gnome-shel:cs0-1207  [003] ....  5988.696814: drm_sched_job: entity=000000002109c155, id=2471, fence=000000001a8a0059, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.696825: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2618
             gfx-782   [000] ....  5988.696831: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2620
             gfx-782   [000] ....  5988.696833: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2621
     gnome-shell-1199  [005] ....  5988.696839: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2465
             gfx-782   [000] ....  5988.696842: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2465
             gfx-782   [000] d...  5988.696843: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2621
          <idle>-0     [000] d.h.  5988.696862: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2620
          <idle>-0     [000] d.h.  5988.696959: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2621
          <idle>-0     [000] d.h.  5988.696960: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2465
          <idle>-0     [000] dNh.  5988.696964: drm_sched_process_job: fence=000000001a8a0059 signaled
     gnome-shell-1199  [005] ....  5988.696964: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2465
  gnome-shel:cs0-1207  [003] ....  5988.697976: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=432
  gnome-shel:cs0-1207  [003] ....  5988.697978: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=432
  gnome-shel:cs0-1207  [003] ....  5988.697988: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=464
  gnome-shel:cs0-1207  [003] ....  5988.697988: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=464
  gnome-shel:cs0-1207  [003] ....  5988.697989: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=432
  gnome-shel:cs0-1207  [003] ....  5988.697990: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=432
  gnome-shel:cs0-1207  [003] ....  5988.697991: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1654
  gnome-shel:cs0-1207  [003] ....  5988.697992: drm_sched_job: entity=00000000f6f96e12, id=1527, fence=00000000bbc93a01, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.698008: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1762
           sdma0-802   [002] ....  5988.698021: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=464
           sdma0-802   [002] d...  5988.698021: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1762
          <idle>-0     [000] d.h.  5988.698041: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1762
          <idle>-0     [000] d.h.  5988.698042: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=464
          <idle>-0     [000] dNh.  5988.698044: drm_sched_process_job: fence=00000000bbc93a01 signaled
     gnome-shell-1199  [005] ....  5988.698259: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=693
     gnome-shell-1199  [005] ....  5988.698260: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=693
     gnome-shell-1199  [005] ....  5988.698260: drm_sched_job: entity=00000000e4a2de56, id=1528, fence=0000000086c3cc02, ring=sdma0, job count:0, hw job count:0
     gnome-shell-1199  [005] ....  5988.698264: amdgpu_vm_bo_mapping: soffs=0800104ce0, eoffs=0800104cf5, flags=70
           sdma0-802   [002] ....  5988.698266: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1763
           sdma0-802   [002] ....  5988.698272: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=693
           sdma0-802   [002] d...  5988.698273: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1763
  gnome-shel:cs0-1207  [003] ....  5988.698278: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=433
  gnome-shel:cs0-1207  [003] ....  5988.698278: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=433
  gnome-shel:cs0-1207  [003] ....  5988.698282: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=465
  gnome-shel:cs0-1207  [003] ....  5988.698283: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=465
  gnome-shel:cs0-1207  [003] ....  5988.698283: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=433
  gnome-shel:cs0-1207  [003] ....  5988.698284: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=433
  gnome-shel:cs0-1207  [003] ....  5988.698285: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1656
  gnome-shel:cs0-1207  [003] ....  5988.698285: drm_sched_job: entity=00000000f6f96e12, id=1529, fence=00000000edd5dd48, ring=sdma0, job count:0, hw job count:1
           sdma0-802   [002] ....  5988.698290: drm_sched_job_wait_dep: job ring=sdma0, id=1529, depends fence=0000000086c3cc02, context=66, seq=693
           sdma0-802   [002] ....  5988.698292: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1760
          <idle>-0     [000] d.h.  5988.698294: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1763
          <idle>-0     [000] d.h.  5988.698295: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=693
           sdma0-802   [002] ....  5988.698295: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1764
          <idle>-0     [000] dNh.  5988.698296: drm_sched_process_job: fence=0000000086c3cc02 signaled
           sdma0-802   [002] ....  5988.698297: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1765
           sdma0-802   [002] ....  5988.698299: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=465
           sdma0-802   [002] d...  5988.698300: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1765
          <idle>-0     [000] d.h.  5988.698310: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1764
          <idle>-0     [000] d.h.  5988.698317: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1765
          <idle>-0     [000] d.h.  5988.698318: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=465
          <idle>-0     [000] dNh.  5988.698319: drm_sched_process_job: fence=00000000edd5dd48 signaled
     gnome-shell-1199  [005] ....  5988.698348: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=694
     gnome-shell-1199  [005] ....  5988.698348: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=694
     gnome-shell-1199  [005] ....  5988.698349: drm_sched_job: entity=00000000e4a2de56, id=1530, fence=00000000bb7e82d3, ring=sdma0, job count:0, hw job count:0
     gnome-shell-1199  [005] ....  5988.698350: amdgpu_vm_bo_mapping: soffs=0800104cf5, eoffs=0800104d11, flags=70
           sdma0-802   [002] ....  5988.698354: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1766
  gnome-shel:cs0-1207  [003] ....  5988.698360: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=434
  gnome-shel:cs0-1207  [003] ....  5988.698361: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=434
           sdma0-802   [002] ....  5988.698361: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=694
           sdma0-802   [002] d...  5988.698362: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1766
  gnome-shel:cs0-1207  [003] ....  5988.698365: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=466
  gnome-shel:cs0-1207  [003] ....  5988.698365: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=466
  gnome-shel:cs0-1207  [003] ....  5988.698366: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=434
  gnome-shel:cs0-1207  [003] ....  5988.698367: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=434
  gnome-shel:cs0-1207  [003] ....  5988.698367: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1658
  gnome-shel:cs0-1207  [003] ....  5988.698368: drm_sched_job: entity=00000000f6f96e12, id=1531, fence=00000000be0a40e7, ring=sdma0, job count:0, hw job count:1
           sdma0-802   [002] ....  5988.698372: drm_sched_job_wait_dep: job ring=sdma0, id=1531, depends fence=00000000bb7e82d3, context=66, seq=694
           sdma0-802   [002] ....  5988.698373: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1764
           sdma0-802   [002] ....  5988.698375: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1767
           sdma0-802   [002] ....  5988.698377: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1768
          <idle>-0     [000] d.h.  5988.698379: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1766
           sdma0-802   [002] ....  5988.698379: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=466
          <idle>-0     [000] d.h.  5988.698380: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=694
          <idle>-0     [000] dNh.  5988.698381: drm_sched_process_job: fence=00000000bb7e82d3 signaled
           sdma0-802   [002] d...  5988.698381: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1768
          <idle>-0     [000] d.h.  5988.698396: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1767
          <idle>-0     [000] d.h.  5988.698402: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1768
          <idle>-0     [000] d.h.  5988.698403: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=466
          <idle>-0     [000] dNh.  5988.698404: drm_sched_process_job: fence=00000000be0a40e7 signaled
  gnome-shel:cs0-1207  [003] ....  5988.698612: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=142
  gnome-shel:cs0-1207  [003] ....  5988.698613: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=142
  gnome-shel:cs0-1207  [003] ....  5988.698616: dma_fence_init: driver=drm_sched timeline=sdma0 context=129 seqno=174
  gnome-shel:cs0-1207  [003] ....  5988.698617: dma_fence_init: driver=drm_sched timeline=sdma0 context=130 seqno=174
  gnome-shel:cs0-1207  [003] ....  5988.698618: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=130 seqno=142
  gnome-shel:cs0-1207  [003] ....  5988.698618: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=129 seqno=142
  gnome-shel:cs0-1207  [003] ....  5988.698619: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1544
  gnome-shel:cs0-1207  [003] ....  5988.698619: drm_sched_job: entity=00000000df73788d, id=1532, fence=00000000ec0ca8f9, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.698626: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1769
           sdma0-802   [002] ....  5988.698633: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=129 seqno=174
           sdma0-802   [002] d...  5988.698633: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1769
          <idle>-0     [000] d.h.  5988.698653: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1769
          <idle>-0     [000] d.h.  5988.698653: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=130 seqno=174
          <idle>-0     [000] dNh.  5988.698655: drm_sched_process_job: fence=00000000ec0ca8f9 signaled
  gnome-shel:cs0-1207  [003] ....  5988.698655: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2434
  gnome-shel:cs0-1207  [003] ....  5988.698655: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2434
  gnome-shel:cs0-1207  [003] ....  5988.698658: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2466
  gnome-shel:cs0-1207  [003] ....  5988.698659: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2466
  gnome-shel:cs0-1207  [003] ....  5988.698659: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2434
  gnome-shel:cs0-1207  [003] ....  5988.698660: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2434
  gnome-shel:cs0-1207  [003] ....  5988.698661: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2587
  gnome-shel:cs0-1207  [003] ....  5988.698661: drm_sched_job: entity=000000002109c155, id=2472, fence=00000000ae45f498, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.698667: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2620
             gfx-782   [000] ....  5988.698669: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2622
             gfx-782   [000] ....  5988.698671: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2623
             gfx-782   [000] ....  5988.698675: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2466
             gfx-782   [000] d...  5988.698675: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2623
     gnome-shell-1199  [005] ....  5988.698686: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2466
          <idle>-0     [000] d.h.  5988.698690: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2622
          <idle>-0     [000] d.h.  5988.698756: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2623
          <idle>-0     [000] d.h.  5988.698757: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2466
          <idle>-0     [000] dNh.  5988.698760: drm_sched_process_job: fence=00000000ae45f498 signaled
     gnome-shell-1199  [005] ....  5988.698760: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2466
  gnome-shel:cs0-1207  [003] ....  5988.699179: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=435
  gnome-shel:cs0-1207  [003] ....  5988.699179: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=435
  gnome-shel:cs0-1207  [003] ....  5988.699185: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=467
  gnome-shel:cs0-1207  [003] ....  5988.699185: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=467
  gnome-shel:cs0-1207  [003] ....  5988.699186: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=435
  gnome-shel:cs0-1207  [003] ....  5988.699186: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=435
  gnome-shel:cs0-1207  [003] ....  5988.699187: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1661
  gnome-shel:cs0-1207  [003] ....  5988.699188: drm_sched_job: entity=00000000f6f96e12, id=1533, fence=00000000975e833b, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.699199: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1770
           sdma0-802   [002] ....  5988.699202: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=467
           sdma0-802   [002] d...  5988.699202: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1770
          <idle>-0     [000] d.h.  5988.699222: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1770
          <idle>-0     [000] d.h.  5988.699223: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=467
          <idle>-0     [000] dNh.  5988.699225: drm_sched_process_job: fence=00000000975e833b signaled
  gnome-shel:cs0-1207  [003] ....  5988.699811: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2435
  gnome-shel:cs0-1207  [003] ....  5988.699812: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2435
  gnome-shel:cs0-1207  [003] ....  5988.699820: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [003] ....  5988.699823: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2467
  gnome-shel:cs0-1207  [003] ....  5988.699824: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2467
  gnome-shel:cs0-1207  [003] ....  5988.699825: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2435
  gnome-shel:cs0-1207  [003] ....  5988.699825: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2435
  gnome-shel:cs0-1207  [003] ....  5988.699826: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2588
  gnome-shel:cs0-1207  [003] ....  5988.699827: drm_sched_job: entity=000000002109c155, id=2473, fence=00000000a7d5657a, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.699835: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2624
             gfx-782   [000] ....  5988.699849: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2467
             gfx-782   [000] d...  5988.699849: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2624
   kworker/u32:2-3105  [004] ....  5988.700034: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2467
          <idle>-0     [000] d.h.  5988.703896: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2624
          <idle>-0     [000] d.h.  5988.703898: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2467
          <idle>-0     [000] dNh.  5988.703902: drm_sched_process_job: fence=00000000a7d5657a signaled
   kworker/u32:2-3105  [004] ....  5988.703908: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2467
  gnome-shel:cs0-1207  [003] ....  5988.714384: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2436
  gnome-shel:cs0-1207  [003] ....  5988.714394: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2436
  gnome-shel:cs0-1207  [003] ....  5988.714409: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [003] ....  5988.714416: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2468
  gnome-shel:cs0-1207  [003] ....  5988.714417: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2468
  gnome-shel:cs0-1207  [003] ....  5988.714418: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2436
  gnome-shel:cs0-1207  [003] ....  5988.714419: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2436
  gnome-shel:cs0-1207  [003] ....  5988.714419: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2589
  gnome-shel:cs0-1207  [003] ....  5988.714421: drm_sched_job: entity=000000002109c155, id=2474, fence=00000000ccc1d30f, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.714450: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2625
             gfx-782   [000] ....  5988.714463: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2468
             gfx-782   [000] d...  5988.714464: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2625
   kworker/u32:0-3056  [003] ....  5988.714614: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2468
          <idle>-0     [000] d.h.  5988.718581: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2625
          <idle>-0     [000] d.h.  5988.718586: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2468
          <idle>-0     [000] dNh.  5988.718592: drm_sched_process_job: fence=00000000ccc1d30f signaled
   kworker/u32:0-3056  [003] ....  5988.718598: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2468
  gnome-shel:cs0-1207  [003] ....  5988.730531: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2437
  gnome-shel:cs0-1207  [003] ....  5988.730540: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2437
  gnome-shel:cs0-1207  [003] ....  5988.730553: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [003] ....  5988.730562: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2469
  gnome-shel:cs0-1207  [003] ....  5988.730563: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2469
  gnome-shel:cs0-1207  [003] ....  5988.730565: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2437
  gnome-shel:cs0-1207  [003] ....  5988.730566: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2437
  gnome-shel:cs0-1207  [003] ....  5988.730567: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2590
  gnome-shel:cs0-1207  [003] ....  5988.730569: drm_sched_job: entity=000000002109c155, id=2475, fence=000000005118cecb, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.730601: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2626
             gfx-782   [000] ....  5988.730613: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2469
             gfx-782   [000] d...  5988.730614: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2626
  gnome-shel:cs0-1207  [003] ....  5988.730622: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2296
  gnome-shel:cs0-1207  [003] ....  5988.730623: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2296
  gnome-shel:cs0-1207  [003] ....  5988.730624: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2449
   kworker/u32:0-3056  [003] ....  5988.730778: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2469
          <idle>-0     [000] d.h.  5988.734744: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2626
          <idle>-0     [000] d.h.  5988.734748: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2469
          <idle>-0     [000] dNh.  5988.734755: drm_sched_process_job: fence=000000005118cecb signaled
   kworker/u32:0-3056  [003] ....  5988.734761: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2469
  gnome-shel:cs0-1207  [003] ....  5988.746723: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2438
  gnome-shel:cs0-1207  [003] ....  5988.746734: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2438
  gnome-shel:cs0-1207  [003] ....  5988.746747: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [003] ....  5988.746755: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2470
  gnome-shel:cs0-1207  [003] ....  5988.746756: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2470
  gnome-shel:cs0-1207  [003] ....  5988.746758: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2438
  gnome-shel:cs0-1207  [003] ....  5988.746758: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2438
  gnome-shel:cs0-1207  [003] ....  5988.746760: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2591
  gnome-shel:cs0-1207  [003] ....  5988.746763: drm_sched_job: entity=000000002109c155, id=2476, fence=00000000e6e76907, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.746793: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2627
             gfx-782   [000] ....  5988.746806: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2470
             gfx-782   [000] d...  5988.746807: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2627
   kworker/u32:0-3056  [003] ....  5988.746950: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2470
          <idle>-0     [000] d.h.  5988.750925: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2627
          <idle>-0     [000] d.h.  5988.750928: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2470
          <idle>-0     [000] dNh.  5988.750935: drm_sched_process_job: fence=00000000e6e76907 signaled
   kworker/u32:0-3056  [003] ....  5988.750941: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2470
  gnome-shel:cs0-1207  [003] ....  5988.763423: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=436
  gnome-shel:cs0-1207  [003] ....  5988.763434: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=436
  gnome-shel:cs0-1207  [003] ....  5988.763449: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=468
  gnome-shel:cs0-1207  [003] ....  5988.763452: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=468
  gnome-shel:cs0-1207  [003] ....  5988.763454: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=436
  gnome-shel:cs0-1207  [003] ....  5988.763455: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=436
  gnome-shel:cs0-1207  [003] ....  5988.763456: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1663
  gnome-shel:cs0-1207  [003] ....  5988.763460: drm_sched_job: entity=00000000f6f96e12, id=1534, fence=00000000d6d812e4, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.763546: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1771
           sdma0-802   [002] ....  5988.763555: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=468
           sdma0-802   [002] d...  5988.763556: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1771
             tee-3128  [000] d.h.  5988.763596: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1771
             tee-3128  [000] d.h.  5988.763598: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=468
             tee-3128  [000] d.h.  5988.763603: drm_sched_process_job: fence=00000000d6d812e4 signaled
     gnome-shell-1199  [005] ....  5988.763664: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=695
     gnome-shell-1199  [005] ....  5988.763672: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=695
     gnome-shell-1199  [005] ....  5988.763675: drm_sched_job: entity=00000000e4a2de56, id=1535, fence=00000000c1bdff0b, ring=sdma0, job count:0, hw job count:0
     gnome-shell-1199  [005] ....  5988.763680: amdgpu_vm_bo_mapping: soffs=0800104d20, eoffs=0800104d40, flags=70
           sdma0-802   [002] ....  5988.763702: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1772
           sdma0-802   [002] ....  5988.763705: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=695
           sdma0-802   [002] d...  5988.763705: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1772
  gnome-shel:cs0-1207  [004] ....  5988.763716: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=437
  gnome-shel:cs0-1207  [004] ....  5988.763717: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=437
  gnome-shel:cs0-1207  [004] ....  5988.763725: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=469
  gnome-shel:cs0-1207  [004] ....  5988.763726: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=469
  gnome-shel:cs0-1207  [004] ....  5988.763727: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=437
  gnome-shel:cs0-1207  [004] ....  5988.763728: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=437
  gnome-shel:cs0-1207  [004] ....  5988.763729: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1665
  gnome-shel:cs0-1207  [004] ....  5988.763730: drm_sched_job: entity=00000000f6f96e12, id=1536, fence=00000000d0ff20f4, ring=sdma0, job count:0, hw job count:1
          <idle>-0     [000] d.h.  5988.763738: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1772
          <idle>-0     [000] d.h.  5988.763739: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=695
          <idle>-0     [000] dNh.  5988.763742: drm_sched_process_job: fence=00000000c1bdff0b signaled
           sdma0-802   [002] ....  5988.763786: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1767
           sdma0-802   [002] ....  5988.763792: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1773
           sdma0-802   [002] ....  5988.763793: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1774
           sdma0-802   [002] ....  5988.763796: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=469
           sdma0-802   [002] d...  5988.763796: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1774
          <idle>-0     [000] dNh.  5988.763823: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1773
   kworker/u32:0-3056  [000] d.h.  5988.763842: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1774
   kworker/u32:0-3056  [000] d.h.  5988.763844: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=469
   kworker/u32:0-3056  [000] d.h.  5988.763847: drm_sched_process_job: fence=00000000d0ff20f4 signaled
  gnome-shel:cs0-1207  [004] ....  5988.763933: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=438
  gnome-shel:cs0-1207  [004] ....  5988.763938: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=438
  gnome-shel:cs0-1207  [004] ....  5988.763944: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=470
  gnome-shel:cs0-1207  [004] ....  5988.763945: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=470
  gnome-shel:cs0-1207  [004] ....  5988.763946: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=438
  gnome-shel:cs0-1207  [004] ....  5988.763947: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=438
  gnome-shel:cs0-1207  [004] ....  5988.763948: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1668
  gnome-shel:cs0-1207  [004] ....  5988.763949: drm_sched_job: entity=00000000f6f96e12, id=1537, fence=00000000ef635515, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.764014: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1775
           sdma0-802   [002] ....  5988.764020: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=470
           sdma0-802   [002] d...  5988.764020: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1775
          <idle>-0     [000] d.h.  5988.764066: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1775
          <idle>-0     [000] d.h.  5988.764069: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=470
          <idle>-0     [000] dNh.  5988.764071: drm_sched_process_job: fence=00000000ef635515 signaled
  gnome-shel:cs0-1207  [004] ....  5988.764355: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=143
  gnome-shel:cs0-1207  [004] ....  5988.764363: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=143
  gnome-shel:cs0-1207  [004] ....  5988.764375: dma_fence_init: driver=drm_sched timeline=sdma0 context=129 seqno=175
  gnome-shel:cs0-1207  [004] ....  5988.764377: dma_fence_init: driver=drm_sched timeline=sdma0 context=130 seqno=175
  gnome-shel:cs0-1207  [004] ....  5988.764378: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=130 seqno=143
  gnome-shel:cs0-1207  [004] ....  5988.764379: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=129 seqno=143
  gnome-shel:cs0-1207  [004] ....  5988.764380: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1553
  gnome-shel:cs0-1207  [004] ....  5988.764381: drm_sched_job: entity=00000000df73788d, id=1538, fence=00000000833fda9b, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.764410: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1776
           sdma0-802   [002] ....  5988.764424: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=129 seqno=175
           sdma0-802   [002] d...  5988.764424: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1776
          <idle>-0     [000] d.h.  5988.764467: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1776
  gnome-shel:cs0-1207  [004] ....  5988.764467: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2439
          <idle>-0     [000] d.h.  5988.764468: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=130 seqno=175
          <idle>-0     [000] dNh.  5988.764472: drm_sched_process_job: fence=00000000833fda9b signaled
  gnome-shel:cs0-1207  [004] ....  5988.764472: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2439
  gnome-shel:cs0-1207  [004] ....  5988.764477: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [004] ....  5988.764481: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2471
  gnome-shel:cs0-1207  [004] ....  5988.764482: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2471
  gnome-shel:cs0-1207  [004] ....  5988.764482: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2439
  gnome-shel:cs0-1207  [004] ....  5988.764483: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2439
  gnome-shel:cs0-1207  [004] ....  5988.764484: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2592
  gnome-shel:cs0-1207  [004] ....  5988.764485: drm_sched_job: entity=000000002109c155, id=2477, fence=0000000025e3f77a, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.764502: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2622
             gfx-782   [000] ....  5988.764509: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2628
             gfx-782   [000] ....  5988.764512: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2629
             gfx-782   [000] ....  5988.764522: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2471
             gfx-782   [000] d...  5988.764522: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2629
     gnome-shell-1199  [005] ....  5988.764523: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2471
     kworker/0:1-3047  [000] d.h.  5988.764544: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2628
          <idle>-0     [000] d.h.  5988.764786: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2629
          <idle>-0     [000] d.h.  5988.764788: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2471
          <idle>-0     [000] dNh.  5988.764793: drm_sched_process_job: fence=0000000025e3f77a signaled
     gnome-shell-1199  [005] ....  5988.764793: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2471
  gnome-shel:cs0-1207  [004] ....  5988.765068: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=439
  gnome-shel:cs0-1207  [004] ....  5988.765074: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=439
  gnome-shel:cs0-1207  [004] ....  5988.765081: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=471
  gnome-shel:cs0-1207  [004] ....  5988.765083: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=471
  gnome-shel:cs0-1207  [004] ....  5988.765084: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=439
  gnome-shel:cs0-1207  [004] ....  5988.765085: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=439
  gnome-shel:cs0-1207  [004] ....  5988.765086: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1670
  gnome-shel:cs0-1207  [004] ....  5988.765087: drm_sched_job: entity=00000000f6f96e12, id=1539, fence=00000000f003357c, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.765128: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1777
           sdma0-802   [002] ....  5988.765136: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=471
           sdma0-802   [002] d...  5988.765137: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1777
          <idle>-0     [000] d.h.  5988.765183: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1777
          <idle>-0     [000] d.h.  5988.765185: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=471
          <idle>-0     [000] dNh.  5988.765188: drm_sched_process_job: fence=00000000f003357c signaled
  gnome-shel:cs0-1207  [004] ....  5988.766386: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2440
  gnome-shel:cs0-1207  [004] ....  5988.766397: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2440
  gnome-shel:cs0-1207  [004] ....  5988.766410: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [004] ....  5988.766419: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2472
  gnome-shel:cs0-1207  [004] ....  5988.766419: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2472
  gnome-shel:cs0-1207  [004] ....  5988.766421: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2440
  gnome-shel:cs0-1207  [004] ....  5988.766422: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2440
  gnome-shel:cs0-1207  [004] ....  5988.766423: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2593
  gnome-shel:cs0-1207  [004] ....  5988.766426: drm_sched_job: entity=000000002109c155, id=2478, fence=00000000813ef30e, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.766447: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2630
             gfx-782   [000] ....  5988.766463: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2472
             gfx-782   [000] d...  5988.766464: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2630
   kworker/u32:1-2921  [007] ....  5988.766681: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2472
          <idle>-0     [000] d.h.  5988.770520: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2630
          <idle>-0     [000] d.h.  5988.770524: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2472
          <idle>-0     [000] dNh.  5988.770531: drm_sched_process_job: fence=00000000813ef30e signaled
   kworker/u32:1-2921  [007] ....  5988.770539: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2472
  gnome-shel:cs0-1207  [004] ....  5988.780474: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2441
  gnome-shel:cs0-1207  [004] ....  5988.780483: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2441
  gnome-shel:cs0-1207  [004] ....  5988.780495: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [004] ....  5988.780502: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2473
  gnome-shel:cs0-1207  [004] ....  5988.780503: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2473
  gnome-shel:cs0-1207  [004] ....  5988.780505: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2441
  gnome-shel:cs0-1207  [004] ....  5988.780505: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2441
  gnome-shel:cs0-1207  [004] ....  5988.780507: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2594
  gnome-shel:cs0-1207  [004] ....  5988.780509: drm_sched_job: entity=000000002109c155, id=2479, fence=00000000c449b17a, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.780536: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2631
             gfx-782   [000] ....  5988.780548: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2473
             gfx-782   [000] d...  5988.780549: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2631
   kworker/u32:1-2921  [007] ....  5988.780674: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2473
          <idle>-0     [000] d.h.  5988.784693: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2631
          <idle>-0     [000] d.h.  5988.784697: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2473
          <idle>-0     [000] dNh.  5988.784703: drm_sched_process_job: fence=00000000c449b17a signaled
   kworker/u32:1-2921  [007] ....  5988.784713: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2473
  gnome-shel:cs0-1207  [004] ....  5988.797133: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2442
  gnome-shel:cs0-1207  [004] ....  5988.797144: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2442
  gnome-shel:cs0-1207  [004] ....  5988.797155: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [004] ....  5988.797163: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2474
  gnome-shel:cs0-1207  [004] ....  5988.797164: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2474
  gnome-shel:cs0-1207  [004] ....  5988.797166: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2442
  gnome-shel:cs0-1207  [004] ....  5988.797166: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2442
  gnome-shel:cs0-1207  [004] ....  5988.797168: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2595
  gnome-shel:cs0-1207  [004] ....  5988.797170: drm_sched_job: entity=000000002109c155, id=2480, fence=0000000031a15abc, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.797192: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2632
             gfx-782   [000] ....  5988.797204: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2474
             gfx-782   [000] d...  5988.797205: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2632
          <idle>-0     [000] dNh.  5988.797290: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2632
          <idle>-0     [000] dNh.  5988.797291: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2474
          <idle>-0     [000] dNh.  5988.797295: drm_sched_process_job: fence=0000000031a15abc signaled
  gnome-shel:cs0-1207  [004] ....  5988.813511: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2443
  gnome-shel:cs0-1207  [004] ....  5988.813521: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2443
  gnome-shel:cs0-1207  [004] ....  5988.813533: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [004] ....  5988.813541: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2475
  gnome-shel:cs0-1207  [004] ....  5988.813541: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2475
  gnome-shel:cs0-1207  [004] ....  5988.813543: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2443
  gnome-shel:cs0-1207  [004] ....  5988.813544: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2443
  gnome-shel:cs0-1207  [004] ....  5988.813545: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2596
  gnome-shel:cs0-1207  [004] ....  5988.813547: drm_sched_job: entity=000000002109c155, id=2481, fence=00000000457787c9, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.813572: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2633
             gfx-782   [000] ....  5988.813584: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2475
             gfx-782   [000] d...  5988.813584: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2633
   kworker/u32:2-3105  [000] d.h.  5988.813659: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2633
   kworker/u32:2-3105  [000] d.h.  5988.813660: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2475
   kworker/u32:2-3105  [000] d.h.  5988.813664: drm_sched_process_job: fence=00000000457787c9 signaled
  gnome-shel:cs0-1207  [004] ....  5988.830161: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2444
  gnome-shel:cs0-1207  [004] ....  5988.830172: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2444
  gnome-shel:cs0-1207  [004] ....  5988.830184: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [004] ....  5988.830193: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2476
  gnome-shel:cs0-1207  [004] ....  5988.830193: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2476
  gnome-shel:cs0-1207  [004] ....  5988.830195: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2444
  gnome-shel:cs0-1207  [004] ....  5988.830195: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2444
  gnome-shel:cs0-1207  [004] ....  5988.830197: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2597
  gnome-shel:cs0-1207  [004] ....  5988.830200: drm_sched_job: entity=000000002109c155, id=2482, fence=0000000058c01e8d, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.830224: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2634
             gfx-782   [000] ....  5988.830237: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2476
             gfx-782   [000] d...  5988.830238: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2634
          <idle>-0     [000] d.h.  5988.830317: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2634
          <idle>-0     [000] d.h.  5988.830319: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2476
          <idle>-0     [000] dNh.  5988.830322: drm_sched_process_job: fence=0000000058c01e8d signaled
  gnome-shel:cs0-1207  [004] ....  5988.847140: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2445
  gnome-shel:cs0-1207  [004] ....  5988.847151: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2445
  gnome-shel:cs0-1207  [004] ....  5988.847163: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [004] ....  5988.847171: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2477
  gnome-shel:cs0-1207  [004] ....  5988.847172: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2477
  gnome-shel:cs0-1207  [004] ....  5988.847173: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2445
  gnome-shel:cs0-1207  [004] ....  5988.847174: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2445
  gnome-shel:cs0-1207  [004] ....  5988.847176: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2598
  gnome-shel:cs0-1207  [004] ....  5988.847178: drm_sched_job: entity=000000002109c155, id=2483, fence=000000009ae42da5, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.847206: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2635
             gfx-782   [000] ....  5988.847219: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2477
             gfx-782   [000] d...  5988.847219: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2635
          <idle>-0     [000] d.h.  5988.847294: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2635
          <idle>-0     [000] d.h.  5988.847296: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2477
          <idle>-0     [000] dNh.  5988.847300: drm_sched_process_job: fence=000000009ae42da5 signaled
  gnome-shel:cs0-1207  [004] ....  5988.863515: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2446
  gnome-shel:cs0-1207  [004] ....  5988.863526: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2446
  gnome-shel:cs0-1207  [004] ....  5988.863563: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [004] ....  5988.863571: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2478
  gnome-shel:cs0-1207  [004] ....  5988.863571: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2478
  gnome-shel:cs0-1207  [004] ....  5988.863573: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2446
  gnome-shel:cs0-1207  [004] ....  5988.863573: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2446
  gnome-shel:cs0-1207  [004] ....  5988.863575: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2599
  gnome-shel:cs0-1207  [004] ....  5988.863577: drm_sched_job: entity=000000002109c155, id=2484, fence=00000000d1368795, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.863604: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2636
             gfx-782   [000] ....  5988.863616: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2478
             gfx-782   [000] d...  5988.863617: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2636
            sshd-2308  [000] d.h.  5988.863689: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2636
            sshd-2308  [000] d.h.  5988.863690: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2478
            sshd-2308  [000] d.h.  5988.863693: drm_sched_process_job: fence=00000000d1368795 signaled
  gnome-shel:cs0-1207  [004] ....  5988.880236: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2447
  gnome-shel:cs0-1207  [004] ....  5988.880250: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2447
  gnome-shel:cs0-1207  [004] ....  5988.880262: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [004] ....  5988.880269: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2479
  gnome-shel:cs0-1207  [004] ....  5988.880270: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2479
  gnome-shel:cs0-1207  [004] ....  5988.880272: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2447
  gnome-shel:cs0-1207  [004] ....  5988.880272: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2447
  gnome-shel:cs0-1207  [004] ....  5988.880274: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2600
  gnome-shel:cs0-1207  [004] ....  5988.880277: drm_sched_job: entity=000000002109c155, id=2485, fence=00000000c78ff90e, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.880300: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2637
             gfx-782   [000] ....  5988.880313: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2479
             gfx-782   [000] d...  5988.880314: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2637
          <idle>-0     [000] d.h.  5988.880392: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2637
          <idle>-0     [000] d.h.  5988.880393: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2479
          <idle>-0     [000] dNh.  5988.880398: drm_sched_process_job: fence=00000000c78ff90e signaled
  gnome-shel:cs0-1207  [004] ....  5988.896744: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2448
  gnome-shel:cs0-1207  [004] ....  5988.896755: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2448
  gnome-shel:cs0-1207  [004] ....  5988.896767: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [004] ....  5988.896774: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2480
  gnome-shel:cs0-1207  [004] ....  5988.896775: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2480
  gnome-shel:cs0-1207  [004] ....  5988.896777: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2448
  gnome-shel:cs0-1207  [004] ....  5988.896778: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2448
  gnome-shel:cs0-1207  [004] ....  5988.896779: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2601
  gnome-shel:cs0-1207  [004] ....  5988.896781: drm_sched_job: entity=000000002109c155, id=2486, fence=00000000c1cc9a85, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.896799: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2638
             gfx-782   [000] ....  5988.896817: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2480
             gfx-782   [000] d...  5988.896817: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2638
          <idle>-0     [000] dnh.  5988.896894: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2638
          <idle>-0     [000] dnh.  5988.896895: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2480
          <idle>-0     [000] dnh.  5988.896900: drm_sched_process_job: fence=00000000c1cc9a85 signaled
  gnome-shel:cs0-1207  [004] ....  5988.913037: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=440
  gnome-shel:cs0-1207  [004] ....  5988.913046: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=440
  gnome-shel:cs0-1207  [004] ....  5988.913062: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=472
  gnome-shel:cs0-1207  [004] ....  5988.913064: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=472
  gnome-shel:cs0-1207  [004] ....  5988.913066: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=440
  gnome-shel:cs0-1207  [004] ....  5988.913067: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=440
  gnome-shel:cs0-1207  [004] ....  5988.913069: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1672
  gnome-shel:cs0-1207  [004] ....  5988.913071: drm_sched_job: entity=00000000f6f96e12, id=1540, fence=0000000039a4d706, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.913119: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1778
           sdma0-802   [002] ....  5988.913133: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=472
           sdma0-802   [002] d...  5988.913134: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1778
          <idle>-0     [000] d.h.  5988.913176: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1778
          <idle>-0     [000] d.h.  5988.913179: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=472
          <idle>-0     [000] dNh.  5988.913182: drm_sched_process_job: fence=0000000039a4d706 signaled
  gnome-shel:cs0-1207  [007] ....  5988.913233: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=441
  gnome-shel:cs0-1207  [007] ....  5988.913238: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=441
  gnome-shel:cs0-1207  [007] ....  5988.913243: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=473
  gnome-shel:cs0-1207  [007] ....  5988.913244: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=473
  gnome-shel:cs0-1207  [007] ....  5988.913245: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=441
  gnome-shel:cs0-1207  [007] ....  5988.913245: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=441
  gnome-shel:cs0-1207  [007] ....  5988.913246: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1675
  gnome-shel:cs0-1207  [007] ....  5988.913247: drm_sched_job: entity=00000000f6f96e12, id=1541, fence=000000005d071791, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.913286: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1779
           sdma0-802   [002] ....  5988.913290: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=473
           sdma0-802   [002] d...  5988.913290: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1779
            sshd-1549  [000] d.h.  5988.913318: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1779
            sshd-1549  [000] d.h.  5988.913319: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=473
            sshd-1549  [000] d.h.  5988.913322: drm_sched_process_job: fence=000000005d071791 signaled
  gnome-shel:cs0-1207  [007] ....  5988.913420: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=442
  gnome-shel:cs0-1207  [007] ....  5988.913423: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=442
  gnome-shel:cs0-1207  [007] ....  5988.913426: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=474
  gnome-shel:cs0-1207  [007] ....  5988.913427: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=474
  gnome-shel:cs0-1207  [007] ....  5988.913427: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=442
  gnome-shel:cs0-1207  [007] ....  5988.913428: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=442
  gnome-shel:cs0-1207  [007] ....  5988.913429: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1677
  gnome-shel:cs0-1207  [007] ....  5988.913429: drm_sched_job: entity=00000000f6f96e12, id=1542, fence=00000000365ec567, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.913465: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1780
           sdma0-802   [002] ....  5988.913468: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=474
           sdma0-802   [002] d...  5988.913468: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1780
          <idle>-0     [000] dNh.  5988.913501: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1780
          <idle>-0     [000] dNh.  5988.913503: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=474
          <idle>-0     [000] dNh.  5988.913506: drm_sched_process_job: fence=00000000365ec567 signaled
  gnome-shel:cs0-1207  [007] ....  5988.913813: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=130 seqno=144
  gnome-shel:cs0-1207  [007] ....  5988.913818: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=130 seqno=144
  gnome-shel:cs0-1207  [007] ....  5988.913826: dma_fence_init: driver=drm_sched timeline=sdma0 context=129 seqno=176
  gnome-shel:cs0-1207  [007] ....  5988.913828: dma_fence_init: driver=drm_sched timeline=sdma0 context=130 seqno=176
  gnome-shel:cs0-1207  [007] ....  5988.913828: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=130 seqno=144
  gnome-shel:cs0-1207  [007] ....  5988.913829: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=129 seqno=144
  gnome-shel:cs0-1207  [007] ....  5988.913829: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1561
  gnome-shel:cs0-1207  [007] ....  5988.913830: drm_sched_job: entity=00000000df73788d, id=1543, fence=00000000e4c74803, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.913864: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1781
           sdma0-802   [002] ....  5988.913872: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=129 seqno=176
           sdma0-802   [002] d...  5988.913873: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1781
  gnome-shel:cs0-1207  [007] ....  5988.913902: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2449
  gnome-shel:cs0-1207  [007] ....  5988.913905: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2449
  gnome-shel:cs0-1207  [007] ....  5988.913909: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
            sshd-1549  [000] d.h.  5988.913911: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1781
  gnome-shel:cs0-1207  [007] ....  5988.913911: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2481
  gnome-shel:cs0-1207  [007] ....  5988.913912: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2481
            sshd-1549  [000] d.h.  5988.913912: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=130 seqno=176
  gnome-shel:cs0-1207  [007] ....  5988.913912: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2449
  gnome-shel:cs0-1207  [007] ....  5988.913912: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2449
  gnome-shel:cs0-1207  [007] ....  5988.913913: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2602
  gnome-shel:cs0-1207  [007] ....  5988.913913: drm_sched_job: entity=000000002109c155, id=2487, fence=000000008c8c8d93, ring=gfx, job count:0, hw job count:0
            sshd-1549  [000] dnh.  5988.913917: drm_sched_process_job: fence=00000000e4c74803 signaled
     gnome-shell-1199  [001] ....  5988.913953: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2481
             gfx-782   [000] ....  5988.913956: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2639
             gfx-782   [000] ....  5988.913967: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2481
             gfx-782   [000] d...  5988.913967: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2639
            sshd-1549  [000] d.h.  5988.914054: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2639
            sshd-1549  [000] d.h.  5988.914055: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2481
            sshd-1549  [000] d.h.  5988.914061: drm_sched_process_job: fence=000000008c8c8d93 signaled
     gnome-shell-1199  [005] ....  5988.914063: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2481
  gnome-shel:cs0-1207  [007] ....  5988.914338: dma_fence_wait_start: driver=drm_sched timeline=sdma0 context=78 seqno=443
  gnome-shel:cs0-1207  [007] ....  5988.914342: dma_fence_wait_end: driver=drm_sched timeline=sdma0 context=78 seqno=443
  gnome-shel:cs0-1207  [007] ....  5988.914350: dma_fence_init: driver=drm_sched timeline=sdma0 context=77 seqno=475
  gnome-shel:cs0-1207  [007] ....  5988.914350: dma_fence_init: driver=drm_sched timeline=sdma0 context=78 seqno=475
  gnome-shel:cs0-1207  [007] ....  5988.914351: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=78 seqno=443
  gnome-shel:cs0-1207  [007] ....  5988.914351: dma_fence_destroy: driver=drm_sched timeline=sdma0 context=77 seqno=443
  gnome-shel:cs0-1207  [007] ....  5988.914352: dma_fence_destroy: driver=amdgpu timeline=sdma0 context=11 seqno=1679
  gnome-shel:cs0-1207  [007] ....  5988.914353: drm_sched_job: entity=00000000f6f96e12, id=1544, fence=0000000059d19e08, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5988.914365: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1782
           sdma0-802   [002] ....  5988.914373: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=77 seqno=475
           sdma0-802   [002] d...  5988.914374: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1782
          <idle>-0     [000] d.h.  5988.914421: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1782
          <idle>-0     [000] d.h.  5988.914422: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=78 seqno=475
          <idle>-0     [000] dNh.  5988.914425: drm_sched_process_job: fence=0000000059d19e08 signaled
  gnome-shel:cs0-1207  [007] ....  5988.915545: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2450
  gnome-shel:cs0-1207  [007] ....  5988.915551: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2450
  gnome-shel:cs0-1207  [007] ....  5988.915561: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [007] ....  5988.915565: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2482
  gnome-shel:cs0-1207  [007] ....  5988.915566: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2482
  gnome-shel:cs0-1207  [007] ....  5988.915567: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2450
  gnome-shel:cs0-1207  [007] ....  5988.915567: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2450
  gnome-shel:cs0-1207  [007] ....  5988.915568: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2603
  gnome-shel:cs0-1207  [007] ....  5988.915570: drm_sched_job: entity=000000002109c155, id=2488, fence=00000000ce24e425, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.915588: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2640
             gfx-782   [000] ....  5988.915599: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2482
             gfx-782   [000] d...  5988.915600: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2640
            sshd-1549  [000] d.h.  5988.915689: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2640
            sshd-1549  [000] d.h.  5988.915691: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2482
            sshd-1549  [000] d.h.  5988.915695: drm_sched_process_job: fence=00000000ce24e425 signaled
  gnome-shel:cs0-1207  [007] ....  5988.929904: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2451
  gnome-shel:cs0-1207  [007] ....  5988.929913: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2451
  gnome-shel:cs0-1207  [007] ....  5988.929922: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [007] ....  5988.929929: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2483
  gnome-shel:cs0-1207  [007] ....  5988.929930: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2483
  gnome-shel:cs0-1207  [007] ....  5988.929932: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2451
  gnome-shel:cs0-1207  [007] ....  5988.929932: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2451
  gnome-shel:cs0-1207  [007] ....  5988.929933: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2604
  gnome-shel:cs0-1207  [007] ....  5988.929935: drm_sched_job: entity=000000002109c155, id=2489, fence=00000000575eb0d4, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.929954: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2641
             gfx-782   [000] ....  5988.929971: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2483
             gfx-782   [000] d...  5988.929971: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2641
            sshd-1549  [000] d.h.  5988.930057: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2641
            sshd-1549  [000] d.h.  5988.930058: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2483
            sshd-1549  [000] d.h.  5988.930062: drm_sched_process_job: fence=00000000575eb0d4 signaled
  gnome-shel:cs0-1207  [007] ....  5988.946566: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2452
  gnome-shel:cs0-1207  [007] ....  5988.946574: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2452
  gnome-shel:cs0-1207  [007] ....  5988.946584: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [007] ....  5988.946591: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2484
  gnome-shel:cs0-1207  [007] ....  5988.946592: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2484
  gnome-shel:cs0-1207  [007] ....  5988.946594: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2452
  gnome-shel:cs0-1207  [007] ....  5988.946594: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2452
  gnome-shel:cs0-1207  [007] ....  5988.946595: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2605
  gnome-shel:cs0-1207  [007] ....  5988.946597: drm_sched_job: entity=000000002109c155, id=2490, fence=0000000028dabfd4, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.946624: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2642
             gfx-782   [000] ....  5988.946636: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2484
             gfx-782   [000] d...  5988.946637: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2642
          <idle>-0     [000] d.h.  5988.946725: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2642
          <idle>-0     [000] d.h.  5988.946727: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2484
          <idle>-0     [000] dNh.  5988.946731: drm_sched_process_job: fence=0000000028dabfd4 signaled
  gnome-shel:cs0-1207  [007] ....  5988.963243: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2453
  gnome-shel:cs0-1207  [007] ....  5988.963253: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2453
  gnome-shel:cs0-1207  [007] ....  5988.963264: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [007] ....  5988.963270: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2485
  gnome-shel:cs0-1207  [007] ....  5988.963272: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2485
  gnome-shel:cs0-1207  [007] ....  5988.963274: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2453
  gnome-shel:cs0-1207  [007] ....  5988.963274: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2453
  gnome-shel:cs0-1207  [007] ....  5988.963275: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2606
  gnome-shel:cs0-1207  [007] ....  5988.963277: drm_sched_job: entity=000000002109c155, id=2491, fence=000000003f4683da, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.963297: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2643
             gfx-782   [000] ....  5988.963314: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2485
             gfx-782   [000] d...  5988.963315: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2643
          <idle>-0     [000] d.h.  5988.963401: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2643
          <idle>-0     [000] d.h.  5988.963402: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2485
          <idle>-0     [000] dNh.  5988.963404: drm_sched_process_job: fence=000000003f4683da signaled
  gnome-shel:cs0-1207  [007] ....  5988.980275: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2454
  gnome-shel:cs0-1207  [007] ....  5988.980286: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2454
  gnome-shel:cs0-1207  [007] ....  5988.980295: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [007] ....  5988.980302: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2486
  gnome-shel:cs0-1207  [007] ....  5988.980304: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2486
  gnome-shel:cs0-1207  [007] ....  5988.980305: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2454
  gnome-shel:cs0-1207  [007] ....  5988.980306: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2454
  gnome-shel:cs0-1207  [007] ....  5988.980307: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2607
  gnome-shel:cs0-1207  [007] ....  5988.980310: drm_sched_job: entity=000000002109c155, id=2492, fence=000000002442489b, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.980343: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2644
             gfx-782   [000] ....  5988.980361: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2486
             gfx-782   [000] d...  5988.980362: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2644
            sshd-2308  [000] d.h.  5988.980445: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2644
            sshd-2308  [000] d.h.  5988.980447: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2486
            sshd-2308  [000] d.h.  5988.980450: drm_sched_process_job: fence=000000002442489b signaled
  gnome-shel:cs0-1207  [007] ....  5988.996887: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2455
  gnome-shel:cs0-1207  [007] ....  5988.996900: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2455
  gnome-shel:cs0-1207  [007] ....  5988.996909: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [007] ....  5988.996914: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2487
  gnome-shel:cs0-1207  [007] ....  5988.996916: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2487
  gnome-shel:cs0-1207  [007] ....  5988.996918: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2455
  gnome-shel:cs0-1207  [007] ....  5988.996918: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2455
  gnome-shel:cs0-1207  [007] ....  5988.996919: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2608
  gnome-shel:cs0-1207  [007] ....  5988.996922: drm_sched_job: entity=000000002109c155, id=2493, fence=0000000004fb05de, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5988.996945: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2645
             gfx-782   [000] ....  5988.996957: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2487
             gfx-782   [000] d...  5988.996958: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2645
          <idle>-0     [000] d.h.  5988.997049: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2645
          <idle>-0     [000] d.h.  5988.997050: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2487
          <idle>-0     [000] dNh.  5988.997055: drm_sched_process_job: fence=0000000004fb05de signaled
  gnome-shel:cs0-1207  [007] ....  5989.013485: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2456
  gnome-shel:cs0-1207  [007] ....  5989.013496: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2456
  gnome-shel:cs0-1207  [007] ....  5989.013506: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.013513: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2488
  gnome-shel:cs0-1207  [007] ....  5989.013515: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2488
  gnome-shel:cs0-1207  [007] ....  5989.013516: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2456
  gnome-shel:cs0-1207  [007] ....  5989.013517: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2456
  gnome-shel:cs0-1207  [007] ....  5989.013518: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2609
  gnome-shel:cs0-1207  [007] ....  5989.013520: drm_sched_job: entity=000000002109c155, id=2494, fence=00000000f7fc9658, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.013538: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2646
             gfx-782   [000] ....  5989.013556: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2488
             gfx-782   [000] d...  5989.013556: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2646
          <idle>-0     [000] d.h.  5989.013640: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2646
          <idle>-0     [000] d.h.  5989.013641: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2488
          <idle>-0     [000] dNh.  5989.013643: drm_sched_process_job: fence=00000000f7fc9658 signaled
  gnome-shel:cs0-1207  [007] ....  5989.030155: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2457
  gnome-shel:cs0-1207  [007] ....  5989.030167: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2457
  gnome-shel:cs0-1207  [007] ....  5989.030176: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.030181: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2489
  gnome-shel:cs0-1207  [007] ....  5989.030183: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2489
  gnome-shel:cs0-1207  [007] ....  5989.030185: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2457
  gnome-shel:cs0-1207  [007] ....  5989.030186: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2457
  gnome-shel:cs0-1207  [007] ....  5989.030187: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2610
  gnome-shel:cs0-1207  [007] ....  5989.030189: drm_sched_job: entity=000000002109c155, id=2495, fence=000000001485cd60, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.030211: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2647
             gfx-782   [000] ....  5989.030223: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2489
             gfx-782   [000] d...  5989.030224: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2647
          <idle>-0     [000] d.h.  5989.030309: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2647
          <idle>-0     [000] d.h.  5989.030311: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2489
          <idle>-0     [000] dNh.  5989.030315: drm_sched_process_job: fence=000000001485cd60 signaled
  gnome-shel:cs0-1207  [007] ....  5989.046765: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2458
  gnome-shel:cs0-1207  [007] ....  5989.046776: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2458
  gnome-shel:cs0-1207  [007] ....  5989.046787: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.046793: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2490
  gnome-shel:cs0-1207  [007] ....  5989.046795: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2490
  gnome-shel:cs0-1207  [007] ....  5989.046797: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2458
  gnome-shel:cs0-1207  [007] ....  5989.046797: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2458
  gnome-shel:cs0-1207  [007] ....  5989.046798: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2611
  gnome-shel:cs0-1207  [007] ....  5989.046801: drm_sched_job: entity=000000002109c155, id=2496, fence=00000000ea2981cc, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.046818: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2648
             gfx-782   [000] ....  5989.046835: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2490
             gfx-782   [000] d...  5989.046836: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2648
          <idle>-0     [000] d.h.  5989.046917: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2648
          <idle>-0     [000] d.h.  5989.046919: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2490
          <idle>-0     [000] dNh.  5989.046922: drm_sched_process_job: fence=00000000ea2981cc signaled
  gnome-shel:cs0-1207  [007] ....  5989.063655: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2459
  gnome-shel:cs0-1207  [007] ....  5989.063663: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2459
  gnome-shel:cs0-1207  [007] ....  5989.063672: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.063678: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2491
  gnome-shel:cs0-1207  [007] ....  5989.063678: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2491
  gnome-shel:cs0-1207  [007] ....  5989.063680: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2459
  gnome-shel:cs0-1207  [007] ....  5989.063682: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2459
  gnome-shel:cs0-1207  [007] ....  5989.063683: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2612
  gnome-shel:cs0-1207  [007] ....  5989.063685: drm_sched_job: entity=000000002109c155, id=2497, fence=0000000081ce49b3, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.063704: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2649
             gfx-782   [000] ....  5989.063716: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2491
             gfx-782   [000] d...  5989.063716: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2649
          <idle>-0     [000] d.h.  5989.063803: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2649
          <idle>-0     [000] d.h.  5989.063805: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2491
          <idle>-0     [000] dNh.  5989.063807: drm_sched_process_job: fence=0000000081ce49b3 signaled
  gnome-shel:cs0-1207  [007] ....  5989.080138: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2460
  gnome-shel:cs0-1207  [007] ....  5989.080148: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2460
  gnome-shel:cs0-1207  [007] ....  5989.080157: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.080165: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2492
  gnome-shel:cs0-1207  [007] ....  5989.080167: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2492
  gnome-shel:cs0-1207  [007] ....  5989.080169: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2460
  gnome-shel:cs0-1207  [007] ....  5989.080170: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2460
  gnome-shel:cs0-1207  [007] ....  5989.080171: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2613
  gnome-shel:cs0-1207  [007] ....  5989.080173: drm_sched_job: entity=000000002109c155, id=2498, fence=0000000063c2f9aa, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.080193: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2650
             gfx-782   [000] ....  5989.080206: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2492
             gfx-782   [000] d...  5989.080206: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2650
          <idle>-0     [000] d.h.  5989.080289: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2650
          <idle>-0     [000] d.h.  5989.080290: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2492
          <idle>-0     [000] dNh.  5989.080293: drm_sched_process_job: fence=0000000063c2f9aa signaled
  gnome-shel:cs0-1207  [007] ....  5989.096938: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2461
  gnome-shel:cs0-1207  [007] ....  5989.096948: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2461
  gnome-shel:cs0-1207  [007] ....  5989.096957: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.096962: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2493
  gnome-shel:cs0-1207  [007] ....  5989.096964: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2493
  gnome-shel:cs0-1207  [007] ....  5989.096967: drm_sched_job: entity=000000002109c155, id=2499, fence=0000000018ec3ed0, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.096990: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2651
             gfx-782   [000] ....  5989.097002: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2493
             gfx-782   [000] d...  5989.097003: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2651
            sshd-1549  [000] d.h.  5989.097092: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2651
            sshd-1549  [000] d.h.  5989.097093: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2493
            sshd-1549  [000] d.h.  5989.097097: drm_sched_process_job: fence=0000000018ec3ed0 signaled
  gnome-shel:cs0-1207  [007] ....  5989.113595: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2462
  gnome-shel:cs0-1207  [007] ....  5989.113604: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2462
  gnome-shel:cs0-1207  [007] ....  5989.113612: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.113619: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2494
  gnome-shel:cs0-1207  [007] ....  5989.113620: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2494
  gnome-shel:cs0-1207  [007] ....  5989.113622: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2462
  gnome-shel:cs0-1207  [007] ....  5989.113622: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2462
  gnome-shel:cs0-1207  [007] ....  5989.113623: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2616
  gnome-shel:cs0-1207  [007] ....  5989.113625: drm_sched_job: entity=000000002109c155, id=2500, fence=00000000f121f068, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.113647: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2652
             gfx-782   [000] ....  5989.113659: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2494
             gfx-782   [000] d...  5989.113660: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2652
          <idle>-0     [000] dNh.  5989.113747: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2652
          <idle>-0     [000] dNh.  5989.113749: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2494
          <idle>-0     [000] dNh.  5989.113752: drm_sched_process_job: fence=00000000f121f068 signaled
  gnome-shel:cs0-1207  [007] ....  5989.130125: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2463
  gnome-shel:cs0-1207  [007] ....  5989.130135: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2463
  gnome-shel:cs0-1207  [007] ....  5989.130143: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.130149: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2495
  gnome-shel:cs0-1207  [007] ....  5989.130150: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2495
  gnome-shel:cs0-1207  [007] ....  5989.130151: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2463
  gnome-shel:cs0-1207  [007] ....  5989.130152: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2463
  gnome-shel:cs0-1207  [007] ....  5989.130153: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2617
  gnome-shel:cs0-1207  [007] ....  5989.130155: drm_sched_job: entity=000000002109c155, id=2501, fence=00000000800d94fc, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.130174: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2653
             gfx-782   [000] ....  5989.130190: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2495
             gfx-782   [000] d...  5989.130191: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2653
            sshd-1549  [000] d.h.  5989.130274: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2653
            sshd-1549  [000] d.h.  5989.130276: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2495
            sshd-1549  [000] d.h.  5989.130280: drm_sched_process_job: fence=00000000800d94fc signaled
  gnome-shel:cs0-1207  [007] ....  5989.146792: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2464
  gnome-shel:cs0-1207  [007] ....  5989.146803: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2464
  gnome-shel:cs0-1207  [007] ....  5989.146811: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.146817: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2496
  gnome-shel:cs0-1207  [007] ....  5989.146819: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2496
  gnome-shel:cs0-1207  [007] ....  5989.146820: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2464
  gnome-shel:cs0-1207  [007] ....  5989.146820: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2464
  gnome-shel:cs0-1207  [007] ....  5989.146821: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2619
  gnome-shel:cs0-1207  [007] ....  5989.146823: drm_sched_job: entity=000000002109c155, id=2502, fence=0000000079231e65, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.146844: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2654
             gfx-782   [000] ....  5989.146862: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2496
             gfx-782   [000] d...  5989.146863: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2654
          <idle>-0     [000] d.h.  5989.146951: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2654
          <idle>-0     [000] d.h.  5989.146953: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2496
          <idle>-0     [000] dNh.  5989.146957: drm_sched_process_job: fence=0000000079231e65 signaled
  gnome-shel:cs0-1207  [007] ....  5989.163511: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2465
  gnome-shel:cs0-1207  [007] ....  5989.163518: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2465
  gnome-shel:cs0-1207  [007] ....  5989.163528: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.163534: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2497
  gnome-shel:cs0-1207  [007] ....  5989.163535: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2497
  gnome-shel:cs0-1207  [007] ....  5989.163537: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2465
  gnome-shel:cs0-1207  [007] ....  5989.163537: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2465
  gnome-shel:cs0-1207  [007] ....  5989.163539: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2621
  gnome-shel:cs0-1207  [007] ....  5989.163541: drm_sched_job: entity=000000002109c155, id=2503, fence=00000000504d3d16, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.163611: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2655
             gfx-782   [000] ....  5989.163629: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2497
             gfx-782   [000] d...  5989.163630: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2655
   kworker/u32:3-3033  [004] ....  5989.163682: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2497
             cat-3127  [000] d.h.  5989.163714: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2655
             cat-3127  [000] d.h.  5989.163716: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2497
             cat-3127  [000] d.h.  5989.163725: drm_sched_process_job: fence=00000000504d3d16 signaled
   kworker/u32:3-3033  [001] ....  5989.163730: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2497
  gnome-shel:cs0-1207  [007] ....  5989.180181: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2466
  gnome-shel:cs0-1207  [007] ....  5989.180190: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2466
  gnome-shel:cs0-1207  [007] ....  5989.180201: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.180209: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2498
  gnome-shel:cs0-1207  [007] ....  5989.180210: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2498
  gnome-shel:cs0-1207  [007] ....  5989.180211: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2466
  gnome-shel:cs0-1207  [007] ....  5989.180212: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2466
  gnome-shel:cs0-1207  [007] ....  5989.180213: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2623
  gnome-shel:cs0-1207  [007] ....  5989.180215: drm_sched_job: entity=000000002109c155, id=2504, fence=0000000055d97ad3, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.180275: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2656
             gfx-782   [000] ....  5989.180291: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2498
             gfx-782   [000] d...  5989.180292: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2656
          <idle>-0     [000] d.h.  5989.180378: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2656
          <idle>-0     [000] d.h.  5989.180380: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2498
          <idle>-0     [000] dNh.  5989.180383: drm_sched_process_job: fence=0000000055d97ad3 signaled
  gnome-shel:cs0-1207  [007] ....  5989.196814: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2467
  gnome-shel:cs0-1207  [007] ....  5989.196821: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2467
  gnome-shel:cs0-1207  [007] ....  5989.196832: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.196840: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2499
  gnome-shel:cs0-1207  [007] ....  5989.196840: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2499
  gnome-shel:cs0-1207  [007] ....  5989.196842: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2467
  gnome-shel:cs0-1207  [007] ....  5989.196842: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2467
  gnome-shel:cs0-1207  [007] ....  5989.196844: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2624
  gnome-shel:cs0-1207  [007] ....  5989.196846: drm_sched_job: entity=000000002109c155, id=2505, fence=00000000804b9355, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.196871: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2657
             gfx-782   [000] ....  5989.196883: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2499
             gfx-782   [000] d...  5989.196884: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2657
          <idle>-0     [000] d.h.  5989.196975: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2657
          <idle>-0     [000] d.h.  5989.196976: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2499
          <idle>-0     [000] dNh.  5989.196980: drm_sched_process_job: fence=00000000804b9355 signaled
  gnome-shel:cs0-1207  [007] ....  5989.213426: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2468
  gnome-shel:cs0-1207  [007] ....  5989.213434: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2468
  gnome-shel:cs0-1207  [007] ....  5989.213445: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.213453: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2500
  gnome-shel:cs0-1207  [007] ....  5989.213454: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2500
  gnome-shel:cs0-1207  [007] ....  5989.213456: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2468
  gnome-shel:cs0-1207  [007] ....  5989.213456: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2468
  gnome-shel:cs0-1207  [007] ....  5989.213457: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2625
  gnome-shel:cs0-1207  [007] ....  5989.213459: drm_sched_job: entity=000000002109c155, id=2506, fence=0000000085580e36, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.213483: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2658
             gfx-782   [000] ....  5989.213495: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2500
             gfx-782   [000] d...  5989.213496: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2658
          <idle>-0     [000] d.h.  5989.213584: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2658
          <idle>-0     [000] d.h.  5989.213586: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2500
          <idle>-0     [000] dNh.  5989.213588: drm_sched_process_job: fence=0000000085580e36 signaled
  gnome-shel:cs0-1207  [007] ....  5989.230006: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2469
  gnome-shel:cs0-1207  [007] ....  5989.230016: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2469
  gnome-shel:cs0-1207  [007] ....  5989.230026: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [007] ....  5989.230033: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2501
  gnome-shel:cs0-1207  [007] ....  5989.230033: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2501
  gnome-shel:cs0-1207  [007] ....  5989.230035: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2469
  gnome-shel:cs0-1207  [007] ....  5989.230035: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2469
  gnome-shel:cs0-1207  [007] ....  5989.230037: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2626
  gnome-shel:cs0-1207  [007] ....  5989.230038: drm_sched_job: entity=000000002109c155, id=2507, fence=00000000126ff319, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.230061: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2659
             gfx-782   [000] ....  5989.230073: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2501
             gfx-782   [000] d...  5989.230074: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2659
          <idle>-0     [000] d.h.  5989.230160: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2659
          <idle>-0     [000] d.h.  5989.230161: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2501
          <idle>-0     [000] dNh.  5989.230166: drm_sched_process_job: fence=00000000126ff319 signaled
  gnome-sh:gdrv0-1220  [000] ....  5989.246463: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=696
  gnome-sh:gdrv0-1220  [000] ....  5989.246473: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=696
  gnome-sh:gdrv0-1220  [000] ....  5989.246474: drm_sched_job: entity=00000000e4a2de56, id=1545, fence=000000002b6feaaf, ring=sdma0, job count:0, hw job count:0
  gnome-sh:gdrv0-1220  [000] ....  5989.246482: amdgpu_vm_bo_mapping: soffs=0800000040, eoffs=0800000060, flags=30
           sdma0-802   [002] ....  5989.246494: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1783
           sdma0-802   [002] ....  5989.246509: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=696
           sdma0-802   [002] d...  5989.246510: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1783
  gnome-sh:gdrv0-1220  [000] d.h.  5989.246547: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1783
  gnome-sh:gdrv0-1220  [000] d.h.  5989.246548: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=696
  gnome-sh:gdrv0-1220  [000] d.h.  5989.246553: drm_sched_process_job: fence=000000002b6feaaf signaled
  gnome-shel:cs0-1207  [000] ....  5989.246656: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2470
  gnome-shel:cs0-1207  [000] ....  5989.246662: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2470
  gnome-shel:cs0-1207  [000] ....  5989.246670: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.246674: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2502
  gnome-shel:cs0-1207  [000] ....  5989.246677: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2502
  gnome-shel:cs0-1207  [000] ....  5989.246678: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2470
  gnome-shel:cs0-1207  [000] ....  5989.246679: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2470
  gnome-shel:cs0-1207  [000] ....  5989.246680: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2627
  gnome-shel:cs0-1207  [000] ....  5989.246681: drm_sched_job: entity=000000002109c155, id=2508, fence=000000003b3139ef, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.246738: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2628
             gfx-782   [000] ....  5989.246749: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2660
             gfx-782   [000] ....  5989.246753: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2661
             gfx-782   [000] ....  5989.246762: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2502
             gfx-782   [000] d...  5989.246767: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2661
  gnome-shel:cs0-1207  [000] d.h.  5989.246784: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2660
          <idle>-0     [000] d.h.  5989.246857: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2661
          <idle>-0     [000] d.h.  5989.246858: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2502
          <idle>-0     [000] dNh.  5989.246861: drm_sched_process_job: fence=000000003b3139ef signaled
  gnome-shel:cs0-1207  [000] ....  5989.263339: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2471
  gnome-shel:cs0-1207  [000] ....  5989.263348: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2471
  gnome-shel:cs0-1207  [000] ....  5989.263358: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.263364: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2503
  gnome-shel:cs0-1207  [000] ....  5989.263364: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2503
  gnome-shel:cs0-1207  [000] ....  5989.263366: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2471
  gnome-shel:cs0-1207  [000] ....  5989.263366: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2471
  gnome-shel:cs0-1207  [000] ....  5989.263367: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2629
  gnome-shel:cs0-1207  [000] ....  5989.263369: drm_sched_job: entity=000000002109c155, id=2509, fence=000000001c82563d, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.263431: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2662
             gfx-782   [000] ....  5989.263446: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2503
             gfx-782   [000] d...  5989.263453: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2662
          <idle>-0     [000] d.h.  5989.263530: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2662
          <idle>-0     [000] d.h.  5989.263532: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2503
          <idle>-0     [000] dNh.  5989.263535: drm_sched_process_job: fence=000000001c82563d signaled
  gnome-shel:cs0-1207  [000] ....  5989.279964: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2472
  gnome-shel:cs0-1207  [000] ....  5989.279977: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2472
  gnome-shel:cs0-1207  [000] ....  5989.279990: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.279998: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2504
  gnome-shel:cs0-1207  [000] ....  5989.279998: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2504
  gnome-shel:cs0-1207  [000] ....  5989.280000: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2472
  gnome-shel:cs0-1207  [000] ....  5989.280000: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2472
  gnome-shel:cs0-1207  [000] ....  5989.280002: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2630
  gnome-shel:cs0-1207  [000] ....  5989.280004: drm_sched_job: entity=000000002109c155, id=2510, fence=00000000cffb155d, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.280064: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2663
             gfx-782   [000] ....  5989.280075: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2504
             gfx-782   [000] d...  5989.280092: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2663
          <idle>-0     [000] d.h.  5989.280157: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2663
          <idle>-0     [000] d.h.  5989.280158: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2504
          <idle>-0     [000] dNh.  5989.280163: drm_sched_process_job: fence=00000000cffb155d signaled
  gnome-shel:cs0-1207  [000] ....  5989.296493: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2473
  gnome-shel:cs0-1207  [000] ....  5989.296504: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2473
  gnome-shel:cs0-1207  [000] ....  5989.296517: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.296527: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2505
  gnome-shel:cs0-1207  [000] ....  5989.296527: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2505
  gnome-shel:cs0-1207  [000] ....  5989.296529: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2473
  gnome-shel:cs0-1207  [000] ....  5989.296529: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2473
  gnome-shel:cs0-1207  [000] ....  5989.296531: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2631
  gnome-shel:cs0-1207  [000] ....  5989.296534: drm_sched_job: entity=000000002109c155, id=2511, fence=00000000a8f55c05, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.296605: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2664
             gfx-782   [000] ....  5989.296625: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2505
             gfx-782   [000] d...  5989.296628: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2664
          <idle>-0     [000] d.h.  5989.296704: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2664
          <idle>-0     [000] d.h.  5989.296705: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2505
          <idle>-0     [000] dNh.  5989.296708: drm_sched_process_job: fence=00000000a8f55c05 signaled
  gnome-shel:cs0-1207  [000] ....  5989.313117: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2474
  gnome-shel:cs0-1207  [000] ....  5989.313126: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2474
  gnome-shel:cs0-1207  [000] ....  5989.313137: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.313144: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2506
  gnome-shel:cs0-1207  [000] ....  5989.313145: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2506
  gnome-shel:cs0-1207  [000] ....  5989.313147: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2474
  gnome-shel:cs0-1207  [000] ....  5989.313148: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2474
  gnome-shel:cs0-1207  [000] ....  5989.313150: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2632
  gnome-shel:cs0-1207  [000] ....  5989.313152: drm_sched_job: entity=000000002109c155, id=2512, fence=000000008cf2624c, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.313204: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2665
             gfx-782   [000] ....  5989.313218: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2506
             gfx-782   [000] d...  5989.313234: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2665
          <idle>-0     [000] dnh.  5989.313294: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2665
          <idle>-0     [000] dnh.  5989.313295: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2506
          <idle>-0     [000] dnh.  5989.313299: drm_sched_process_job: fence=000000008cf2624c signaled
  gnome-shel:cs0-1207  [000] ....  5989.329850: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2475
  gnome-shel:cs0-1207  [000] ....  5989.329862: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2475
  gnome-shel:cs0-1207  [000] ....  5989.329873: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.329882: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2507
  gnome-shel:cs0-1207  [000] ....  5989.329883: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2507
  gnome-shel:cs0-1207  [000] ....  5989.329884: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2475
  gnome-shel:cs0-1207  [000] ....  5989.329885: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2475
  gnome-shel:cs0-1207  [000] ....  5989.329887: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2633
  gnome-shel:cs0-1207  [000] ....  5989.329889: drm_sched_job: entity=000000002109c155, id=2513, fence=0000000072412efa, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.329950: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2666
             gfx-782   [000] ....  5989.329965: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2507
             gfx-782   [000] d...  5989.329967: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2666
            sshd-2308  [000] d.h.  5989.330044: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2666
            sshd-2308  [000] d.h.  5989.330046: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2507
            sshd-2308  [000] d.h.  5989.330051: drm_sched_process_job: fence=0000000072412efa signaled
  gnome-shel:cs0-1207  [000] ....  5989.346477: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2476
  gnome-shel:cs0-1207  [000] ....  5989.346489: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2476
  gnome-shel:cs0-1207  [000] ....  5989.346502: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.346512: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2508
  gnome-shel:cs0-1207  [000] ....  5989.346513: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2508
  gnome-shel:cs0-1207  [000] ....  5989.346515: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2476
  gnome-shel:cs0-1207  [000] ....  5989.346515: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2476
  gnome-shel:cs0-1207  [000] ....  5989.346517: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2634
  gnome-shel:cs0-1207  [000] ....  5989.346520: drm_sched_job: entity=000000002109c155, id=2514, fence=000000005aa1b568, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.346599: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2667
             gfx-782   [000] ....  5989.346620: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2508
             gfx-782   [000] d...  5989.346625: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2667
          <idle>-0     [000] d.h.  5989.346696: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2667
          <idle>-0     [000] d.h.  5989.346698: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2508
          <idle>-0     [000] dNh.  5989.346701: drm_sched_process_job: fence=000000005aa1b568 signaled
  gnome-shel:cs0-1207  [000] ....  5989.363490: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2477
  gnome-shel:cs0-1207  [000] ....  5989.363501: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2477
  gnome-shel:cs0-1207  [000] ....  5989.363511: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.363517: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2509
  gnome-shel:cs0-1207  [000] ....  5989.363519: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2509
  gnome-shel:cs0-1207  [000] ....  5989.363521: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2477
  gnome-shel:cs0-1207  [000] ....  5989.363522: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2477
  gnome-shel:cs0-1207  [000] ....  5989.363523: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2635
  gnome-shel:cs0-1207  [000] ....  5989.363525: drm_sched_job: entity=000000002109c155, id=2515, fence=00000000a9efb624, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.363585: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2668
             gfx-782   [000] ....  5989.363601: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2509
             gfx-782   [000] d...  5989.363602: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2668
          <idle>-0     [000] d.h.  5989.363679: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2668
          <idle>-0     [000] d.h.  5989.363681: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2509
          <idle>-0     [000] dNh.  5989.363683: drm_sched_process_job: fence=00000000a9efb624 signaled
  gnome-shel:cs0-1207  [000] ....  5989.379953: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2478
  gnome-shel:cs0-1207  [000] ....  5989.379963: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2478
  gnome-shel:cs0-1207  [000] ....  5989.379974: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.379980: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2510
  gnome-shel:cs0-1207  [000] ....  5989.379982: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2510
  gnome-shel:cs0-1207  [000] ....  5989.379983: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2478
  gnome-shel:cs0-1207  [000] ....  5989.379984: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2478
  gnome-shel:cs0-1207  [000] ....  5989.379986: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2636
  gnome-shel:cs0-1207  [000] ....  5989.379988: drm_sched_job: entity=000000002109c155, id=2516, fence=000000008e8787be, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.380044: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2669
             gfx-782   [000] ....  5989.380060: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2510
             gfx-782   [000] d...  5989.380061: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2669
          <idle>-0     [000] d.h.  5989.380136: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2669
          <idle>-0     [000] d.h.  5989.380137: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2510
          <idle>-0     [000] dNh.  5989.380141: drm_sched_process_job: fence=000000008e8787be signaled
  gnome-shel:cs0-1207  [000] ....  5989.396501: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2479
  gnome-shel:cs0-1207  [000] ....  5989.396511: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2479
  gnome-shel:cs0-1207  [000] ....  5989.396520: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.396525: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2511
  gnome-shel:cs0-1207  [000] ....  5989.396526: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2511
  gnome-shel:cs0-1207  [000] ....  5989.396528: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2479
  gnome-shel:cs0-1207  [000] ....  5989.396531: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2479
  gnome-shel:cs0-1207  [000] ....  5989.396532: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2637
  gnome-shel:cs0-1207  [000] ....  5989.396534: drm_sched_job: entity=000000002109c155, id=2517, fence=0000000039fc5f90, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.396588: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2670
             gfx-782   [000] ....  5989.396604: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2511
             gfx-782   [000] d...  5989.396605: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2670
          <idle>-0     [000] d.h.  5989.396673: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2670
          <idle>-0     [000] d.h.  5989.396674: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2511
          <idle>-0     [000] dNh.  5989.396677: drm_sched_process_job: fence=0000000039fc5f90 signaled
  gnome-shel:cs0-1207  [000] ....  5989.413073: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2480
  gnome-shel:cs0-1207  [000] ....  5989.413092: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2480
  gnome-shel:cs0-1207  [000] ....  5989.413104: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.413112: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2512
  gnome-shel:cs0-1207  [000] ....  5989.413114: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2512
  gnome-shel:cs0-1207  [000] ....  5989.413116: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2480
  gnome-shel:cs0-1207  [000] ....  5989.413117: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2480
  gnome-shel:cs0-1207  [000] ....  5989.413119: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2638
  gnome-shel:cs0-1207  [000] ....  5989.413121: drm_sched_job: entity=000000002109c155, id=2518, fence=000000006a1babfc, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.413183: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2671
             gfx-782   [000] ....  5989.413200: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2512
             gfx-782   [000] d...  5989.413201: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2671
          <idle>-0     [000] d.h.  5989.413280: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2671
          <idle>-0     [000] d.h.  5989.413281: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2512
          <idle>-0     [000] dNh.  5989.413286: drm_sched_process_job: fence=000000006a1babfc signaled
  gnome-shel:cs0-1207  [000] ....  5989.429819: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2481
  gnome-shel:cs0-1207  [000] ....  5989.429831: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2481
  gnome-shel:cs0-1207  [000] ....  5989.429843: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.429850: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2513
  gnome-shel:cs0-1207  [000] ....  5989.429852: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2513
  gnome-shel:cs0-1207  [000] ....  5989.429854: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2481
  gnome-shel:cs0-1207  [000] ....  5989.429854: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2481
  gnome-shel:cs0-1207  [000] ....  5989.429856: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2639
  gnome-shel:cs0-1207  [000] ....  5989.429858: drm_sched_job: entity=000000002109c155, id=2519, fence=000000009d866462, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.429909: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2672
             gfx-782   [000] ....  5989.429925: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2513
             gfx-782   [000] d...  5989.429926: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2672
          <idle>-0     [000] d.h.  5989.429988: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2672
          <idle>-0     [000] d.h.  5989.429990: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2513
          <idle>-0     [000] dNh.  5989.429995: drm_sched_process_job: fence=000000009d866462 signaled
     gnome-shell-1199  [002] ....  5989.446338: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=697
     gnome-shell-1199  [002] ....  5989.446355: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=697
     gnome-shell-1199  [002] ....  5989.446357: drm_sched_job: entity=00000000e4a2de56, id=1546, fence=00000000d9d5d837, ring=sdma0, job count:0, hw job count:0
     gnome-shell-1199  [002] .N..  5989.446369: amdgpu_vm_bo_mapping: soffs=0800000080, eoffs=08000000a0, flags=30
           sdma0-802   [002] ....  5989.446388: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1784
           sdma0-802   [002] ....  5989.446404: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=697
           sdma0-802   [002] d...  5989.446405: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1784
          <idle>-0     [000] d.h.  5989.446447: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1784
          <idle>-0     [000] d.h.  5989.446449: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=697
          <idle>-0     [000] dNh.  5989.446454: drm_sched_process_job: fence=00000000d9d5d837 signaled
  gnome-shel:cs0-1207  [000] ....  5989.446768: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2482
  gnome-shel:cs0-1207  [000] ....  5989.446774: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2482
  gnome-shel:cs0-1207  [000] ....  5989.446782: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.446789: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2514
  gnome-shel:cs0-1207  [000] ....  5989.446790: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2514
  gnome-shel:cs0-1207  [000] ....  5989.446791: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2482
  gnome-shel:cs0-1207  [000] ....  5989.446792: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2482
  gnome-shel:cs0-1207  [000] ....  5989.446793: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2640
  gnome-shel:cs0-1207  [000] ....  5989.446795: drm_sched_job: entity=000000002109c155, id=2520, fence=00000000d0a58968, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.446850: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2660
             gfx-782   [000] ....  5989.446857: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2673
             gfx-782   [000] ....  5989.446859: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2674
             gfx-782   [000] ....  5989.446865: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2514
             gfx-782   [000] d...  5989.446865: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2674
  gnome-shel:cs0-1207  [000] d.h.  5989.446890: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2673
  gnome-shel:cs0-1207  [000] ....  5989.446907: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=698
  gnome-shel:cs0-1207  [000] ....  5989.446909: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=698
  gnome-shel:cs0-1207  [000] ....  5989.446910: drm_sched_job: entity=00000000e4a2de56, id=1547, fence=000000008a65687f, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5989.446922: drm_sched_job_wait_dep: job ring=sdma0, id=1547, depends fence=00000000d0a58968, context=120, seq=2514
  gnome-shel:cs0-1207  [000] d.h.  5989.446943: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2674
  gnome-shel:cs0-1207  [000] d.h.  5989.446945: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2514
  gnome-shel:cs0-1207  [000] d.h.  5989.446953: drm_sched_process_job: fence=00000000d0a58968 signaled
           sdma0-802   [002] ....  5989.446960: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1785
           sdma0-802   [002] ....  5989.446964: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=698
           sdma0-802   [002] d...  5989.446967: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1785
  gnome-shel:cs0-1207  [000] ....  5989.446975: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=699
  gnome-shel:cs0-1207  [000] ....  5989.446976: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=699
  gnome-shel:cs0-1207  [000] ....  5989.446977: drm_sched_job: entity=00000000e4a2de56, id=1548, fence=000000003ef28333, ring=sdma0, job count:0, hw job count:1
           sdma0-802   [002] ....  5989.446981: drm_sched_job_wait_dep: job ring=sdma0, id=1548, depends fence=000000008a65687f, context=66, seq=698
           sdma0-802   [002] ....  5989.446984: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1786
           sdma0-802   [002] ....  5989.446986: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=699
           sdma0-802   [002] d...  5989.446987: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1786
  gnome-shel:cs0-1207  [000] ....  5989.446993: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=700
  gnome-shel:cs0-1207  [000] ....  5989.446993: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=700
  gnome-shel:cs0-1207  [000] ....  5989.446994: drm_sched_job: entity=00000000e4a2de56, id=1549, fence=00000000f80a3381, ring=sdma0, job count:0, hw job count:2
  gnome-shel:cs0-1207  [000] d.h.  5989.447000: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1785
  gnome-shel:cs0-1207  [000] d.h.  5989.447001: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=698
  gnome-shel:cs0-1207  [000] d.h.  5989.447003: drm_sched_process_job: fence=000000008a65687f signaled
           sdma0-802   [002] ....  5989.447008: drm_sched_job_wait_dep: job ring=sdma0, id=1549, depends fence=000000003ef28333, context=66, seq=699
           sdma0-802   [002] ....  5989.447010: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1787
           sdma0-802   [002] ....  5989.447012: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=700
           sdma0-802   [002] d...  5989.447013: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1787
  gnome-shel:cs0-1207  [000] d.h.  5989.447020: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1786
  gnome-shel:cs0-1207  [000] d.h.  5989.447021: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=699
  gnome-shel:cs0-1207  [000] d.h.  5989.447022: drm_sched_process_job: fence=000000003ef28333 signaled
  gnome-shel:cs0-1207  [000] ....  5989.447026: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=701
  gnome-shel:cs0-1207  [000] ....  5989.447026: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=701
  gnome-shel:cs0-1207  [000] ....  5989.447027: drm_sched_job: entity=00000000e4a2de56, id=1550, fence=000000000ceee5d3, ring=sdma0, job count:0, hw job count:1
           sdma0-802   [002] ....  5989.447031: drm_sched_job_wait_dep: job ring=sdma0, id=1550, depends fence=00000000f80a3381, context=66, seq=700
           sdma0-802   [002] ....  5989.447035: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1788
  gnome-shel:cs0-1207  [000] ....  5989.447040: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=702
           sdma0-802   [002] ....  5989.447040: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=701
  gnome-shel:cs0-1207  [000] ....  5989.447040: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=702
  gnome-shel:cs0-1207  [000] ....  5989.447041: drm_sched_job: entity=00000000e4a2de56, id=1551, fence=000000001a29a8a4, ring=sdma0, job count:0, hw job count:2
           sdma0-802   [002] d...  5989.447042: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1788
  gnome-shel:cs0-1207  [000] d.h.  5989.447046: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1787
  gnome-shel:cs0-1207  [000] d.h.  5989.447047: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=700
  gnome-shel:cs0-1207  [000] d.h.  5989.447047: drm_sched_process_job: fence=00000000f80a3381 signaled
           sdma0-802   [002] ....  5989.447053: drm_sched_job_wait_dep: job ring=sdma0, id=1551, depends fence=000000000ceee5d3, context=66, seq=701
           sdma0-802   [002] ....  5989.447055: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1789
           sdma0-802   [002] ....  5989.447057: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=702
           sdma0-802   [002] d...  5989.447058: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1789
  gnome-shel:cs0-1207  [000] ....  5989.447063: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=703
  gnome-shel:cs0-1207  [000] ....  5989.447064: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=703
  gnome-shel:cs0-1207  [000] ....  5989.447064: drm_sched_job: entity=00000000e4a2de56, id=1552, fence=000000007b4f37df, ring=sdma0, job count:0, hw job count:2
  gnome-shel:cs0-1207  [000] d.h.  5989.447085: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1788
  gnome-shel:cs0-1207  [000] d.h.  5989.447086: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=701
  gnome-shel:cs0-1207  [000] d.h.  5989.447087: drm_sched_process_job: fence=000000000ceee5d3 signaled
           sdma0-802   [002] ....  5989.447090: drm_sched_job_wait_dep: job ring=sdma0, id=1552, depends fence=000000001a29a8a4, context=66, seq=702
           sdma0-802   [002] ....  5989.447092: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1790
           sdma0-802   [002] ....  5989.447094: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=703
           sdma0-802   [002] d...  5989.447094: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1790
  gnome-shel:cs0-1207  [000] d.h.  5989.447097: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1789
  gnome-shel:cs0-1207  [000] d.h.  5989.447097: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=702
  gnome-shel:cs0-1207  [000] d.h.  5989.447098: drm_sched_process_job: fence=000000001a29a8a4 signaled
  gnome-shel:cs0-1207  [000] d.h.  5989.447117: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1790
  gnome-shel:cs0-1207  [000] d.h.  5989.447118: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=703
  gnome-shel:cs0-1207  [000] d.h.  5989.447118: drm_sched_process_job: fence=000000007b4f37df signaled
  gnome-shel:cs0-1207  [000] ....  5989.447171: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=704
  gnome-shel:cs0-1207  [000] ....  5989.447171: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=704
  gnome-shel:cs0-1207  [000] ....  5989.447172: drm_sched_job: entity=00000000e4a2de56, id=1553, fence=00000000e7ad5c04, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5989.447177: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1791
           sdma0-802   [002] ....  5989.447184: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=704
           sdma0-802   [002] d...  5989.447185: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1791
  gnome-shel:cs0-1207  [000] ....  5989.447201: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=705
  gnome-shel:cs0-1207  [000] ....  5989.447202: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=705
  gnome-shel:cs0-1207  [000] ....  5989.447202: drm_sched_job: entity=00000000e4a2de56, id=1554, fence=00000000b287ce08, ring=sdma0, job count:0, hw job count:1
           sdma0-802   [002] ....  5989.447206: drm_sched_job_wait_dep: job ring=sdma0, id=1554, depends fence=00000000e7ad5c04, context=66, seq=704
           sdma0-802   [002] ....  5989.447208: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1792
           sdma0-802   [002] ....  5989.447210: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=705
  gnome-shel:cs0-1207  [000] d.h.  5989.447210: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1791
           sdma0-802   [002] d...  5989.447211: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1792
  gnome-shel:cs0-1207  [000] d.h.  5989.447212: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=704
  gnome-shel:cs0-1207  [000] d.h.  5989.447213: drm_sched_process_job: fence=00000000e7ad5c04 signaled
  gnome-shel:cs0-1207  [000] d.h.  5989.447238: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1792
  gnome-shel:cs0-1207  [000] d.h.  5989.447239: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=705
  gnome-shel:cs0-1207  [000] d.h.  5989.447240: drm_sched_process_job: fence=00000000b287ce08 signaled
  gnome-shel:cs0-1207  [000] ....  5989.447252: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=706
  gnome-shel:cs0-1207  [000] ....  5989.447253: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=706
  gnome-shel:cs0-1207  [000] ....  5989.447253: drm_sched_job: entity=00000000e4a2de56, id=1555, fence=000000004b9c8a19, ring=sdma0, job count:0, hw job count:0
           sdma0-802   [002] ....  5989.447259: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1793
           sdma0-802   [002] ....  5989.447261: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=706
           sdma0-802   [002] d...  5989.447262: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1793
  gnome-shel:cs0-1207  [000] ....  5989.447275: dma_fence_init: driver=drm_sched timeline=sdma0 context=65 seqno=707
  gnome-shel:cs0-1207  [000] ....  5989.447275: dma_fence_init: driver=drm_sched timeline=sdma0 context=66 seqno=707
  gnome-shel:cs0-1207  [000] ....  5989.447276: drm_sched_job: entity=00000000e4a2de56, id=1556, fence=00000000d21d3b3c, ring=sdma0, job count:0, hw job count:1
           sdma0-802   [002] ....  5989.447280: drm_sched_job_wait_dep: job ring=sdma0, id=1556, depends fence=000000004b9c8a19, context=66, seq=706
           sdma0-802   [002] ....  5989.447282: dma_fence_init: driver=amdgpu timeline=sdma0 context=11 seqno=1794
           sdma0-802   [002] ....  5989.447285: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=65 seqno=707
           sdma0-802   [002] d...  5989.447285: dma_fence_enable_signal: driver=amdgpu timeline=sdma0 context=11 seqno=1794
  gnome-shel:cs0-1207  [000] d.h.  5989.447289: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1793
  gnome-shel:cs0-1207  [000] d.h.  5989.447290: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=706
  gnome-shel:cs0-1207  [000] d.h.  5989.447290: drm_sched_process_job: fence=000000004b9c8a19 signaled
  gnome-shel:cs0-1207  [000] d.h.  5989.447308: dma_fence_signaled: driver=amdgpu timeline=sdma0 context=11 seqno=1794
  gnome-shel:cs0-1207  [000] d.h.  5989.447309: dma_fence_signaled: driver=drm_sched timeline=sdma0 context=66 seqno=707
  gnome-shel:cs0-1207  [000] d.h.  5989.447309: drm_sched_process_job: fence=00000000d21d3b3c signaled
  gnome-shel:cs0-1207  [000] ....  5989.463216: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2483
  gnome-shel:cs0-1207  [000] ....  5989.463225: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2483
  gnome-shel:cs0-1207  [000] ....  5989.463238: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.463248: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2515
  gnome-shel:cs0-1207  [000] ....  5989.463249: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2515
  gnome-shel:cs0-1207  [000] ....  5989.463251: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2483
  gnome-shel:cs0-1207  [000] ....  5989.463251: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2483
  gnome-shel:cs0-1207  [000] ....  5989.463253: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2641
  gnome-shel:cs0-1207  [000] ....  5989.463256: drm_sched_job: entity=000000002109c155, id=2521, fence=000000006c1ef9f7, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.463323: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2675
             gfx-782   [000] ....  5989.463339: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2515
             gfx-782   [000] d...  5989.463340: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2675
          <idle>-0     [000] d.h.  5989.463410: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2675
          <idle>-0     [000] d.h.  5989.463411: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2515
          <idle>-0     [000] dNh.  5989.463416: drm_sched_process_job: fence=000000006c1ef9f7 signaled
  gnome-shel:cs0-1207  [000] ....  5989.479768: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2484
  gnome-shel:cs0-1207  [000] ....  5989.479781: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2484
  gnome-shel:cs0-1207  [000] ....  5989.479794: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.479804: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2516
  gnome-shel:cs0-1207  [000] ....  5989.479805: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2516
  gnome-shel:cs0-1207  [000] ....  5989.479807: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2484
  gnome-shel:cs0-1207  [000] ....  5989.479807: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2484
  gnome-shel:cs0-1207  [000] ....  5989.479809: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2642
  gnome-shel:cs0-1207  [000] ....  5989.479811: drm_sched_job: entity=000000002109c155, id=2522, fence=0000000037ae2d8c, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.479882: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2676
             gfx-782   [000] ....  5989.479898: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2516
             gfx-782   [000] d...  5989.479899: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2676
          <idle>-0     [000] d.h.  5989.479967: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2676
          <idle>-0     [000] d.h.  5989.479968: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2516
          <idle>-0     [000] dNh.  5989.479972: drm_sched_process_job: fence=0000000037ae2d8c signaled
  gnome-shel:cs0-1207  [000] ....  5989.496544: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2485
  gnome-shel:cs0-1207  [000] ....  5989.496557: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2485
  gnome-shel:cs0-1207  [000] ....  5989.496568: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.496574: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2517
  gnome-shel:cs0-1207  [000] ....  5989.496575: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2517
  gnome-shel:cs0-1207  [000] ....  5989.496576: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2485
  gnome-shel:cs0-1207  [000] ....  5989.496577: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2485
  gnome-shel:cs0-1207  [000] ....  5989.496579: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2643
  gnome-shel:cs0-1207  [000] ....  5989.496581: drm_sched_job: entity=000000002109c155, id=2523, fence=00000000df496ac9, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.496644: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2677
             gfx-782   [000] ....  5989.496656: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2517
             gfx-782   [000] d...  5989.496657: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2677
             tee-3128  [000] d.h.  5989.496728: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2677
             tee-3128  [000] d.h.  5989.496729: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2517
             tee-3128  [000] d.h.  5989.496733: drm_sched_process_job: fence=00000000df496ac9 signaled
  gnome-shel:cs0-1207  [000] ....  5989.513234: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2486
  gnome-shel:cs0-1207  [000] ....  5989.513245: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2486
  gnome-shel:cs0-1207  [000] ....  5989.513256: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5989.513263: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2518
  gnome-shel:cs0-1207  [000] ....  5989.513264: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2518
  gnome-shel:cs0-1207  [000] ....  5989.513265: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2486
  gnome-shel:cs0-1207  [000] ....  5989.513266: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2486
  gnome-shel:cs0-1207  [000] ....  5989.513267: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2644
  gnome-shel:cs0-1207  [000] ....  5989.513270: drm_sched_job: entity=000000002109c155, id=2524, fence=000000007457f753, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5989.513323: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2678
             gfx-782   [000] ....  5989.513341: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2518
             gfx-782   [000] d...  5989.513342: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2678
             tee-3128  [000] d.h.  5989.513414: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2678
             tee-3128  [000] d.h.  5989.513415: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2518
             tee-3128  [000] d.h.  5989.513418: drm_sched_process_job: fence=000000007457f753 signaled

CL SLOW TEST  CLOSED

    cl_slow_test-3137  [004] ....  5993.055903: dma_fence_destroy: driver=amdgpu_amdkfd_fence timeline=cl_slow_test context=530 seqno=22
  gnome-shel:cs0-1207  [000] ....  5994.584069: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2487
  gnome-shel:cs0-1207  [000] ....  5994.584083: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2487
  gnome-shel:cs0-1207  [000] ....  5994.584094: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.584099: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2519
  gnome-shel:cs0-1207  [000] ....  5994.584100: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2519
  gnome-shel:cs0-1207  [000] ....  5994.584101: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2487
  gnome-shel:cs0-1207  [000] ....  5994.584102: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2487
  gnome-shel:cs0-1207  [000] ....  5994.584103: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2645
  gnome-shel:cs0-1207  [000] ....  5994.584105: drm_sched_job: entity=000000002109c155, id=2525, fence=0000000006e20f92, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.584160: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2679
             gfx-782   [000] ....  5994.584178: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2519
             gfx-782   [000] d...  5994.584179: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2679
          <idle>-0     [000] d.h.  5994.584267: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2679
          <idle>-0     [000] d.h.  5994.584268: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2519
          <idle>-0     [000] dNh.  5994.584271: drm_sched_process_job: fence=0000000006e20f92 signaled
  gnome-shel:cs0-1207  [000] ....  5994.600922: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2488
  gnome-shel:cs0-1207  [000] ....  5994.600935: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2488
  gnome-shel:cs0-1207  [000] ....  5994.600945: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.600950: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2520
  gnome-shel:cs0-1207  [000] ....  5994.600950: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2520
  gnome-shel:cs0-1207  [000] ....  5994.600952: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2488
  gnome-shel:cs0-1207  [000] ....  5994.600952: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2488
  gnome-shel:cs0-1207  [000] ....  5994.600954: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2646
  gnome-shel:cs0-1207  [000] ....  5994.600956: drm_sched_job: entity=000000002109c155, id=2526, fence=000000005e47419f, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.600999: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2680
             gfx-782   [000] ....  5994.601017: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2520
             gfx-782   [000] d...  5994.601018: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2680
          <idle>-0     [000] d.h.  5994.601097: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2680
          <idle>-0     [000] d.h.  5994.601099: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2520
          <idle>-0     [000] dNh.  5994.601103: drm_sched_process_job: fence=000000005e47419f signaled
  gnome-shel:cs0-1207  [000] ....  5994.617293: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2489
  gnome-shel:cs0-1207  [000] ....  5994.617306: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2489
  gnome-shel:cs0-1207  [000] ....  5994.617315: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.617320: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2521
  gnome-shel:cs0-1207  [000] ....  5994.617321: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2521
  gnome-shel:cs0-1207  [000] ....  5994.617322: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2489
  gnome-shel:cs0-1207  [000] ....  5994.617323: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2489
  gnome-shel:cs0-1207  [000] ....  5994.617324: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2647
  gnome-shel:cs0-1207  [000] ....  5994.617326: drm_sched_job: entity=000000002109c155, id=2527, fence=00000000026a4270, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.617368: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2681
             gfx-782   [000] ....  5994.617384: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2521
             gfx-782   [000] d...  5994.617385: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2681
          <idle>-0     [000] d.h.  5994.617467: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2681
          <idle>-0     [000] d.h.  5994.617468: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2521
          <idle>-0     [000] dNh.  5994.617472: drm_sched_process_job: fence=00000000026a4270 signaled
  gnome-shel:cs0-1207  [000] ....  5994.633954: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2490
  gnome-shel:cs0-1207  [000] ....  5994.633967: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2490
  gnome-shel:cs0-1207  [000] ....  5994.633976: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.633981: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2522
  gnome-shel:cs0-1207  [000] ....  5994.633982: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2522
  gnome-shel:cs0-1207  [000] ....  5994.633983: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2490
  gnome-shel:cs0-1207  [000] ....  5994.633984: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2490
  gnome-shel:cs0-1207  [000] ....  5994.633985: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2648
  gnome-shel:cs0-1207  [000] ....  5994.633987: drm_sched_job: entity=000000002109c155, id=2528, fence=00000000f8ff0822, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.634033: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2682
             gfx-782   [000] ....  5994.634049: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2522
             gfx-782   [000] d...  5994.634049: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2682
          <idle>-0     [000] d.h.  5994.634138: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2682
          <idle>-0     [000] d.h.  5994.634139: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2522
          <idle>-0     [000] dNh.  5994.634141: drm_sched_process_job: fence=00000000f8ff0822 signaled
  gnome-shel:cs0-1207  [000] ....  5994.650234: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2491
  gnome-shel:cs0-1207  [000] ....  5994.650246: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2491
  gnome-shel:cs0-1207  [000] ....  5994.650255: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.650260: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2523
  gnome-shel:cs0-1207  [000] ....  5994.650260: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2523
  gnome-shel:cs0-1207  [000] ....  5994.650262: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2491
  gnome-shel:cs0-1207  [000] ....  5994.650262: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2491
  gnome-shel:cs0-1207  [000] ....  5994.650264: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2649
  gnome-shel:cs0-1207  [000] ....  5994.650266: drm_sched_job: entity=000000002109c155, id=2529, fence=00000000a06974c3, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.650309: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2683
             gfx-782   [000] ....  5994.650324: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2523
             gfx-782   [000] d...  5994.650325: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2683
          <idle>-0     [000] d.h.  5994.650406: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2683
          <idle>-0     [000] d.h.  5994.650407: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2523
          <idle>-0     [000] dNh.  5994.650410: drm_sched_process_job: fence=00000000a06974c3 signaled
  gnome-shel:cs0-1207  [000] ....  5994.666760: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2492
  gnome-shel:cs0-1207  [000] ....  5994.666774: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2492
  gnome-shel:cs0-1207  [000] ....  5994.666785: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.666791: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2524
  gnome-shel:cs0-1207  [000] ....  5994.666792: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2524
  gnome-shel:cs0-1207  [000] ....  5994.666793: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2492
  gnome-shel:cs0-1207  [000] ....  5994.666794: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2492
  gnome-shel:cs0-1207  [000] ....  5994.666795: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2650
  gnome-shel:cs0-1207  [000] ....  5994.666796: drm_sched_job: entity=000000002109c155, id=2530, fence=00000000d7d9dcee, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.666843: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2684
             gfx-782   [000] ....  5994.666861: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2524
             gfx-782   [000] d...  5994.666862: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2684
          <idle>-0     [000] d.h.  5994.666933: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2684
          <idle>-0     [000] d.h.  5994.666935: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2524
          <idle>-0     [000] dNh.  5994.666939: drm_sched_process_job: fence=00000000d7d9dcee signaled
  gnome-shel:cs0-1207  [000] ....  5994.684246: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2493
  gnome-shel:cs0-1207  [000] ....  5994.684262: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2493
  gnome-shel:cs0-1207  [000] ....  5994.684273: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.684279: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2525
  gnome-shel:cs0-1207  [000] ....  5994.684280: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2525
  gnome-shel:cs0-1207  [000] ....  5994.684281: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2493
  gnome-shel:cs0-1207  [000] ....  5994.684282: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2493
  gnome-shel:cs0-1207  [000] ....  5994.684284: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2651
  gnome-shel:cs0-1207  [000] ....  5994.684286: drm_sched_job: entity=000000002109c155, id=2531, fence=000000008f9070aa, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.684340: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2685
             gfx-782   [000] ....  5994.684357: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2525
             gfx-782   [000] d...  5994.684358: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2685
          <idle>-0     [000] d.h.  5994.684454: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2685
          <idle>-0     [000] d.h.  5994.684455: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2525
          <idle>-0     [000] dNh.  5994.684457: drm_sched_process_job: fence=000000008f9070aa signaled
  gnome-shel:cs0-1207  [000] ....  5994.701066: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2494
  gnome-shel:cs0-1207  [000] ....  5994.701080: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2494
  gnome-shel:cs0-1207  [000] ....  5994.701090: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.701096: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2526
  gnome-shel:cs0-1207  [000] ....  5994.701097: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2526
  gnome-shel:cs0-1207  [000] ....  5994.701099: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2494
  gnome-shel:cs0-1207  [000] ....  5994.701099: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2494
  gnome-shel:cs0-1207  [000] ....  5994.701101: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2652
  gnome-shel:cs0-1207  [000] ....  5994.701104: drm_sched_job: entity=000000002109c155, id=2532, fence=0000000038407f53, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.701178: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2686
             gfx-782   [000] ....  5994.701195: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2526
             gfx-782   [000] d...  5994.701196: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2686
          <idle>-0     [000] d.h.  5994.701269: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2686
          <idle>-0     [000] d.h.  5994.701270: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2526
          <idle>-0     [000] dNh.  5994.701275: drm_sched_process_job: fence=0000000038407f53 signaled
  gnome-shel:cs0-1207  [000] ....  5994.717288: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2495
  gnome-shel:cs0-1207  [000] ....  5994.717303: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2495
  gnome-shel:cs0-1207  [000] ....  5994.717313: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.717321: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2527
  gnome-shel:cs0-1207  [000] ....  5994.717322: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2527
  gnome-shel:cs0-1207  [000] ....  5994.717324: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2495
  gnome-shel:cs0-1207  [000] ....  5994.717324: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2495
  gnome-shel:cs0-1207  [000] ....  5994.717326: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2653
  gnome-shel:cs0-1207  [000] ....  5994.717328: drm_sched_job: entity=000000002109c155, id=2533, fence=00000000b479ff3c, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.717381: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2687
             gfx-782   [000] ....  5994.717399: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2527
             gfx-782   [000] d...  5994.717400: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2687
          <idle>-0     [000] d.h.  5994.717499: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2687
          <idle>-0     [000] d.h.  5994.717502: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2527
          <idle>-0     [000] dNh.  5994.717507: drm_sched_process_job: fence=00000000b479ff3c signaled
  gnome-shel:cs0-1207  [000] ....  5994.733645: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2496
  gnome-shel:cs0-1207  [000] ....  5994.733654: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2496
  gnome-shel:cs0-1207  [000] ....  5994.733662: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.733666: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2528
  gnome-shel:cs0-1207  [000] ....  5994.733667: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2528
  gnome-shel:cs0-1207  [000] ....  5994.733669: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2496
  gnome-shel:cs0-1207  [000] ....  5994.733670: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2496
  gnome-shel:cs0-1207  [000] ....  5994.733671: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2654
  gnome-shel:cs0-1207  [000] ....  5994.733673: drm_sched_job: entity=000000002109c155, id=2534, fence=000000000490b65e, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.733711: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2688
             gfx-782   [000] ....  5994.733728: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2528
             gfx-782   [000] d...  5994.733729: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2688
          <idle>-0     [000] d.h.  5994.733809: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2688
          <idle>-0     [000] d.h.  5994.733810: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2528
          <idle>-0     [000] dNh.  5994.733814: drm_sched_process_job: fence=000000000490b65e signaled
  gnome-shel:cs0-1207  [000] ....  5994.750434: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2497
  gnome-shel:cs0-1207  [000] ....  5994.750444: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2497
  gnome-shel:cs0-1207  [000] ....  5994.750453: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.750458: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2529
  gnome-shel:cs0-1207  [000] ....  5994.750459: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2529
  gnome-shel:cs0-1207  [000] ....  5994.750460: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2497
  gnome-shel:cs0-1207  [000] ....  5994.750461: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2497
  gnome-shel:cs0-1207  [000] ....  5994.750462: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2655
  gnome-shel:cs0-1207  [000] ....  5994.750464: drm_sched_job: entity=000000002109c155, id=2535, fence=00000000306db80a, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.750507: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2689
             gfx-782   [000] ....  5994.750522: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2529
             gfx-782   [000] d...  5994.750523: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2689
          <idle>-0     [000] d.h.  5994.750602: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2689
          <idle>-0     [000] d.h.  5994.750603: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2529
          <idle>-0     [000] dNh.  5994.750608: drm_sched_process_job: fence=00000000306db80a signaled
  gnome-shel:cs0-1207  [000] ....  5994.767081: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2498
  gnome-shel:cs0-1207  [000] ....  5994.767094: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2498
  gnome-shel:cs0-1207  [000] ....  5994.767103: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.767108: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2530
  gnome-shel:cs0-1207  [000] ....  5994.767109: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2530
  gnome-shel:cs0-1207  [000] ....  5994.767110: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2498
  gnome-shel:cs0-1207  [000] ....  5994.767111: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2498
  gnome-shel:cs0-1207  [000] ....  5994.767113: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2656
  gnome-shel:cs0-1207  [000] ....  5994.767114: drm_sched_job: entity=000000002109c155, id=2536, fence=0000000019eb87c7, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.767160: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2690
             gfx-782   [000] ....  5994.767178: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2530
             gfx-782   [000] d...  5994.767179: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2690
          <idle>-0     [000] d.h.  5994.767255: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2690
          <idle>-0     [000] d.h.  5994.767256: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2530
          <idle>-0     [000] dNh.  5994.767258: drm_sched_process_job: fence=0000000019eb87c7 signaled
  gnome-shel:cs0-1207  [000] ....  5994.783920: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2499
  gnome-shel:cs0-1207  [000] ....  5994.783935: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2499
  gnome-shel:cs0-1207  [000] ....  5994.783948: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.783956: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2531
  gnome-shel:cs0-1207  [000] ....  5994.783957: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2531
  gnome-shel:cs0-1207  [000] ....  5994.783959: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2499
  gnome-shel:cs0-1207  [000] ....  5994.783960: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2499
  gnome-shel:cs0-1207  [000] ....  5994.783962: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2657
  gnome-shel:cs0-1207  [000] ....  5994.783965: drm_sched_job: entity=000000002109c155, id=2537, fence=00000000949a64a7, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.784023: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2691
             gfx-782   [000] ....  5994.784040: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2531
             gfx-782   [000] d...  5994.784041: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2691
          <idle>-0     [000] d.h.  5994.784114: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2691
          <idle>-0     [000] d.h.  5994.784116: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2531
          <idle>-0     [000] dNh.  5994.784118: drm_sched_process_job: fence=00000000949a64a7 signaled
  gnome-shel:cs0-1207  [000] ....  5994.800603: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2500
  gnome-shel:cs0-1207  [000] ....  5994.800615: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2500
  gnome-shel:cs0-1207  [000] ....  5994.800626: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.800632: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2532
  gnome-shel:cs0-1207  [000] ....  5994.800633: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2532
  gnome-shel:cs0-1207  [000] ....  5994.800634: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2500
  gnome-shel:cs0-1207  [000] ....  5994.800635: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2500
  gnome-shel:cs0-1207  [000] ....  5994.800636: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2658
  gnome-shel:cs0-1207  [000] ....  5994.800638: drm_sched_job: entity=000000002109c155, id=2538, fence=00000000957b3db7, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.800697: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2692
             gfx-782   [000] ....  5994.800715: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2532
             gfx-782   [000] d...  5994.800716: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2692
          <idle>-0     [000] d.h.  5994.800825: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2692
          <idle>-0     [000] d.h.  5994.800828: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2532
          <idle>-0     [000] dNh.  5994.800835: drm_sched_process_job: fence=00000000957b3db7 signaled
  gnome-shel:cs0-1207  [000] ....  5994.817466: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2501
  gnome-shel:cs0-1207  [000] ....  5994.817477: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2501
  gnome-shel:cs0-1207  [000] ....  5994.817485: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.817491: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2533
  gnome-shel:cs0-1207  [000] ....  5994.817491: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2533
  gnome-shel:cs0-1207  [000] ....  5994.817493: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2501
  gnome-shel:cs0-1207  [000] ....  5994.817494: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2501
  gnome-shel:cs0-1207  [000] ....  5994.817495: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2659
  gnome-shel:cs0-1207  [000] ....  5994.817497: drm_sched_job: entity=000000002109c155, id=2539, fence=00000000dac65926, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.817539: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2693
             gfx-782   [000] ....  5994.817556: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2533
             gfx-782   [000] d...  5994.817557: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2693
          <idle>-0     [000] d.h.  5994.817637: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2693
          <idle>-0     [000] d.h.  5994.817639: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2533
          <idle>-0     [000] dNh.  5994.817643: drm_sched_process_job: fence=00000000dac65926 signaled
  gnome-shel:cs0-1207  [000] ....  5994.833536: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2502
  gnome-shel:cs0-1207  [000] ....  5994.833546: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2502
  gnome-shel:cs0-1207  [000] ....  5994.833554: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.833559: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2534
  gnome-shel:cs0-1207  [000] ....  5994.833559: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2534
  gnome-shel:cs0-1207  [000] ....  5994.833561: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2502
  gnome-shel:cs0-1207  [000] ....  5994.833561: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2502
  gnome-shel:cs0-1207  [000] ....  5994.833563: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2661
  gnome-shel:cs0-1207  [000] ....  5994.833564: drm_sched_job: entity=000000002109c155, id=2540, fence=00000000e0f16cf0, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.833605: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2694
             gfx-782   [000] ....  5994.833620: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2534
             gfx-782   [000] d...  5994.833621: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2694
          <idle>-0     [000] d.h.  5994.833697: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2694
          <idle>-0     [000] d.h.  5994.833699: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2534
          <idle>-0     [000] dNh.  5994.833701: drm_sched_process_job: fence=00000000e0f16cf0 signaled
  gnome-shel:cs0-1207  [000] ....  5994.850336: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2503
  gnome-shel:cs0-1207  [000] ....  5994.850350: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2503
  gnome-shel:cs0-1207  [000] ....  5994.850358: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.850363: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2535
  gnome-shel:cs0-1207  [000] ....  5994.850363: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2535
  gnome-shel:cs0-1207  [000] ....  5994.850365: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2503
  gnome-shel:cs0-1207  [000] ....  5994.850365: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2503
  gnome-shel:cs0-1207  [000] ....  5994.850366: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2662
  gnome-shel:cs0-1207  [000] ....  5994.850368: drm_sched_job: entity=000000002109c155, id=2541, fence=000000002b5605d1, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.850407: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2695
             gfx-782   [000] ....  5994.850424: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2535
             gfx-782   [000] d...  5994.850425: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2695
          <idle>-0     [000] d.h.  5994.850501: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2695
          <idle>-0     [000] d.h.  5994.850502: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2535
          <idle>-0     [000] dNh.  5994.850506: drm_sched_process_job: fence=000000002b5605d1 signaled
  gnome-shel:cs0-1207  [000] ....  5994.867706: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2504
  gnome-shel:cs0-1207  [000] ....  5994.867720: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2504
  gnome-shel:cs0-1207  [000] ....  5994.867731: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.867738: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2536
  gnome-shel:cs0-1207  [000] ....  5994.867738: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2536
  gnome-shel:cs0-1207  [000] ....  5994.867740: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2504
  gnome-shel:cs0-1207  [000] ....  5994.867740: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2504
  gnome-shel:cs0-1207  [000] ....  5994.867742: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2663
  gnome-shel:cs0-1207  [000] ....  5994.867744: drm_sched_job: entity=000000002109c155, id=2542, fence=00000000a91261c1, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.867804: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2696
             gfx-782   [000] ....  5994.867823: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2536
             gfx-782   [000] d...  5994.867824: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2696
          <idle>-0     [000] d.h.  5994.867911: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2696
          <idle>-0     [000] d.h.  5994.867913: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2536
          <idle>-0     [000] dNh.  5994.867916: drm_sched_process_job: fence=00000000a91261c1 signaled
  gnome-shel:cs0-1207  [000] ....  5994.883994: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2505
  gnome-shel:cs0-1207  [000] ....  5994.884007: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2505
  gnome-shel:cs0-1207  [000] ....  5994.884017: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.884023: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2537
  gnome-shel:cs0-1207  [000] ....  5994.884023: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2537
  gnome-shel:cs0-1207  [000] ....  5994.884025: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2505
  gnome-shel:cs0-1207  [000] ....  5994.884025: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2505
  gnome-shel:cs0-1207  [000] ....  5994.884027: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2664
  gnome-shel:cs0-1207  [000] ....  5994.884028: drm_sched_job: entity=000000002109c155, id=2543, fence=000000000e7d2331, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.884079: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2697
             gfx-782   [000] ....  5994.884097: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2537
             gfx-782   [000] d...  5994.884098: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2697
          <idle>-0     [000] d.h.  5994.884660: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2697
          <idle>-0     [000] d.h.  5994.884663: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2537
          <idle>-0     [000] dNh.  5994.884670: drm_sched_process_job: fence=000000000e7d2331 signaled
  gnome-shel:cs0-1207  [000] ....  5994.900671: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2506
  gnome-shel:cs0-1207  [000] ....  5994.900684: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2506
  gnome-shel:cs0-1207  [000] ....  5994.900694: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.900699: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2538
  gnome-shel:cs0-1207  [000] ....  5994.900700: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2538
  gnome-shel:cs0-1207  [000] ....  5994.900702: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2506
  gnome-shel:cs0-1207  [000] ....  5994.900702: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2506
  gnome-shel:cs0-1207  [000] ....  5994.900704: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2665
  gnome-shel:cs0-1207  [000] ....  5994.900705: drm_sched_job: entity=000000002109c155, id=2544, fence=0000000001e0f681, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.900755: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2698
             gfx-782   [000] ....  5994.900773: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2538
             gfx-782   [000] d...  5994.900775: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2698
          <idle>-0     [000] d.h.  5994.900888: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2698
          <idle>-0     [000] d.h.  5994.900891: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2538
          <idle>-0     [000] dNh.  5994.900897: drm_sched_process_job: fence=0000000001e0f681 signaled
  gnome-shel:cs0-1207  [000] ....  5994.917627: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2507
  gnome-shel:cs0-1207  [000] ....  5994.917638: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2507
  gnome-shel:cs0-1207  [000] ....  5994.917646: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.917651: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2539
  gnome-shel:cs0-1207  [000] ....  5994.917652: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2539
  gnome-shel:cs0-1207  [000] ....  5994.917653: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2507
  gnome-shel:cs0-1207  [000] ....  5994.917654: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2507
  gnome-shel:cs0-1207  [000] ....  5994.917655: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2666
  gnome-shel:cs0-1207  [000] ....  5994.917657: drm_sched_job: entity=000000002109c155, id=2545, fence=000000004e8a45e5, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.917699: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2699
             gfx-782   [000] ....  5994.917715: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2539
             gfx-782   [000] d...  5994.917716: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2699
          <idle>-0     [000] d.h.  5994.917801: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2699
          <idle>-0     [000] d.h.  5994.917802: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2539
          <idle>-0     [000] dNh.  5994.917805: drm_sched_process_job: fence=000000004e8a45e5 signaled
  gnome-shel:cs0-1207  [000] ....  5994.933834: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2508
  gnome-shel:cs0-1207  [000] ....  5994.933846: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2508
  gnome-shel:cs0-1207  [000] ....  5994.933854: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.933860: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2540
  gnome-shel:cs0-1207  [000] ....  5994.933860: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2540
  gnome-shel:cs0-1207  [000] ....  5994.933861: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2508
  gnome-shel:cs0-1207  [000] ....  5994.933862: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2508
  gnome-shel:cs0-1207  [000] ....  5994.933863: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2667
  gnome-shel:cs0-1207  [000] ....  5994.933865: drm_sched_job: entity=000000002109c155, id=2546, fence=0000000041fafbe2, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.933909: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2700
             gfx-782   [000] ....  5994.933926: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2540
             gfx-782   [000] d...  5994.933927: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2700
          <idle>-0     [000] d.h.  5994.934012: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2700
          <idle>-0     [000] d.h.  5994.934013: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2540
          <idle>-0     [000] dNh.  5994.934016: drm_sched_process_job: fence=0000000041fafbe2 signaled
  gnome-shel:cs0-1207  [000] ....  5994.950494: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2509
  gnome-shel:cs0-1207  [000] ....  5994.950506: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2509
  gnome-shel:cs0-1207  [000] ....  5994.950515: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.950520: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2541
  gnome-shel:cs0-1207  [000] ....  5994.950521: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2541
  gnome-shel:cs0-1207  [000] ....  5994.950522: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2509
  gnome-shel:cs0-1207  [000] ....  5994.950523: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2509
  gnome-shel:cs0-1207  [000] ....  5994.950525: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2668
  gnome-shel:cs0-1207  [000] ....  5994.950527: drm_sched_job: entity=000000002109c155, id=2547, fence=000000009a495768, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.950569: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2701
             gfx-782   [000] ....  5994.950585: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2541
             gfx-782   [000] d...  5994.950586: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2701
          <idle>-0     [000] d.h.  5994.950671: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2701
          <idle>-0     [000] d.h.  5994.950672: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2541
          <idle>-0     [000] dNh.  5994.950675: drm_sched_process_job: fence=000000009a495768 signaled
  gnome-shel:cs0-1207  [000] ....  5994.967003: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2510
  gnome-shel:cs0-1207  [000] ....  5994.967013: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2510
  gnome-shel:cs0-1207  [000] ....  5994.967021: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.967025: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2542
  gnome-shel:cs0-1207  [000] ....  5994.967026: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2542
  gnome-shel:cs0-1207  [000] ....  5994.967027: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2510
  gnome-shel:cs0-1207  [000] ....  5994.967027: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2510
  gnome-shel:cs0-1207  [000] ....  5994.967029: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2669
  gnome-shel:cs0-1207  [000] ....  5994.967031: drm_sched_job: entity=000000002109c155, id=2548, fence=000000007b04f573, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.967073: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2702
             gfx-782   [000] ....  5994.967088: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2542
             gfx-782   [000] d...  5994.967089: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2702
          <idle>-0     [000] d.h.  5994.967190: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2702
          <idle>-0     [000] d.h.  5994.967191: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2542
          <idle>-0     [000] dNh.  5994.967193: drm_sched_process_job: fence=000000007b04f573 signaled
  gnome-shel:cs0-1207  [000] ....  5994.983972: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2511
  gnome-shel:cs0-1207  [000] ....  5994.983985: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2511
  gnome-shel:cs0-1207  [000] ....  5994.983996: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5994.984002: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2543
  gnome-shel:cs0-1207  [000] ....  5994.984002: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2543
  gnome-shel:cs0-1207  [000] ....  5994.984004: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2511
  gnome-shel:cs0-1207  [000] ....  5994.984005: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2511
  gnome-shel:cs0-1207  [000] ....  5994.984006: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2670
  gnome-shel:cs0-1207  [000] ....  5994.984008: drm_sched_job: entity=000000002109c155, id=2549, fence=00000000d533f11d, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5994.984060: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2703
             gfx-782   [000] ....  5994.984078: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2543
             gfx-782   [000] d...  5994.984079: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2703
          <idle>-0     [000] d.h.  5994.984179: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2703
          <idle>-0     [000] d.h.  5994.984180: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2543
          <idle>-0     [000] dNh.  5994.984183: drm_sched_process_job: fence=00000000d533f11d signaled
  gnome-shel:cs0-1207  [000] ....  5995.000732: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2512
  gnome-shel:cs0-1207  [000] ....  5995.000746: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2512
  gnome-shel:cs0-1207  [000] ....  5995.000756: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.000763: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2544
  gnome-shel:cs0-1207  [000] ....  5995.000763: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2544
  gnome-shel:cs0-1207  [000] ....  5995.000765: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2512
  gnome-shel:cs0-1207  [000] ....  5995.000766: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2512
  gnome-shel:cs0-1207  [000] ....  5995.000767: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2671
  gnome-shel:cs0-1207  [000] ....  5995.000769: drm_sched_job: entity=000000002109c155, id=2550, fence=000000002b6c812d, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.000823: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2704
             gfx-782   [000] ....  5995.000842: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2544
             gfx-782   [000] d...  5995.000843: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2704
          <idle>-0     [000] d.h.  5995.000963: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2704
          <idle>-0     [000] d.h.  5995.000967: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2544
          <idle>-0     [000] dNh.  5995.000972: drm_sched_process_job: fence=000000002b6c812d signaled
  gnome-shel:cs0-1207  [000] ....  5995.016995: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2513
  gnome-shel:cs0-1207  [000] ....  5995.017007: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2513
  gnome-shel:cs0-1207  [000] ....  5995.017015: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.017020: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2545
  gnome-shel:cs0-1207  [000] ....  5995.017020: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2545
  gnome-shel:cs0-1207  [000] ....  5995.017021: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2513
  gnome-shel:cs0-1207  [000] ....  5995.017022: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2513
  gnome-shel:cs0-1207  [000] ....  5995.017023: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2672
  gnome-shel:cs0-1207  [000] ....  5995.017024: drm_sched_job: entity=000000002109c155, id=2551, fence=00000000731574c9, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.017065: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2705
             gfx-782   [000] ....  5995.017082: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2545
             gfx-782   [000] d...  5995.017082: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2705
          <idle>-0     [000] d.h.  5995.017182: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2705
          <idle>-0     [000] d.h.  5995.017184: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2545
          <idle>-0     [000] dNh.  5995.017188: drm_sched_process_job: fence=00000000731574c9 signaled
  gnome-shel:cs0-1207  [000] ....  5995.033835: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2514
  gnome-shel:cs0-1207  [000] ....  5995.033847: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2514
  gnome-shel:cs0-1207  [000] ....  5995.033855: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.033860: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2546
  gnome-shel:cs0-1207  [000] ....  5995.033861: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2546
  gnome-shel:cs0-1207  [000] ....  5995.033862: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2514
  gnome-shel:cs0-1207  [000] ....  5995.033863: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2514
  gnome-shel:cs0-1207  [000] ....  5995.033864: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2674
  gnome-shel:cs0-1207  [000] ....  5995.033865: drm_sched_job: entity=000000002109c155, id=2552, fence=00000000be8d7efd, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.033906: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2706
             gfx-782   [000] ....  5995.033923: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2546
             gfx-782   [000] d...  5995.033924: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2706
          <idle>-0     [000] d.h.  5995.034009: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2706
          <idle>-0     [000] d.h.  5995.034011: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2546
          <idle>-0     [000] dNh.  5995.034015: drm_sched_process_job: fence=00000000be8d7efd signaled
  gnome-shel:cs0-1207  [000] ....  5995.050450: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2515
  gnome-shel:cs0-1207  [000] ....  5995.050464: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2515
  gnome-shel:cs0-1207  [000] ....  5995.050471: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.050476: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2547
  gnome-shel:cs0-1207  [000] ....  5995.050476: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2547
  gnome-shel:cs0-1207  [000] ....  5995.050478: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2515
  gnome-shel:cs0-1207  [000] ....  5995.050478: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2515
  gnome-shel:cs0-1207  [000] ....  5995.050480: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2675
  gnome-shel:cs0-1207  [000] ....  5995.050481: drm_sched_job: entity=000000002109c155, id=2553, fence=00000000e51c7641, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.050518: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2707
             gfx-782   [000] ....  5995.050536: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2547
             gfx-782   [000] d...  5995.050536: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2707
          <idle>-0     [000] d.h.  5995.050621: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2707
          <idle>-0     [000] d.h.  5995.050622: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2547
          <idle>-0     [000] dNh.  5995.050626: drm_sched_process_job: fence=00000000e51c7641 signaled
  gnome-shel:cs0-1207  [000] ....  5995.067504: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2516
  gnome-shel:cs0-1207  [000] ....  5995.067517: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2516
  gnome-shel:cs0-1207  [000] ....  5995.067528: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.067535: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2548
  gnome-shel:cs0-1207  [000] ....  5995.067538: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2548
  gnome-shel:cs0-1207  [000] ....  5995.067539: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2516
  gnome-shel:cs0-1207  [000] ....  5995.067540: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2516
  gnome-shel:cs0-1207  [000] ....  5995.067541: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2676
  gnome-shel:cs0-1207  [000] ....  5995.067544: drm_sched_job: entity=000000002109c155, id=2554, fence=0000000017cd0367, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.067598: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2708
             gfx-782   [000] ....  5995.067615: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2548
             gfx-782   [000] d...  5995.067615: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2708
          <idle>-0     [000] d.h.  5995.067732: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2708
          <idle>-0     [000] d.h.  5995.067736: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2548
          <idle>-0     [000] dNh.  5995.067740: drm_sched_process_job: fence=0000000017cd0367 signaled
  gnome-shel:cs0-1207  [000] ....  5995.083864: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2517
  gnome-shel:cs0-1207  [000] ....  5995.083874: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2517
  gnome-shel:cs0-1207  [000] ....  5995.083885: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.083891: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2549
  gnome-shel:cs0-1207  [000] ....  5995.083892: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2549
  gnome-shel:cs0-1207  [000] ....  5995.083893: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2517
  gnome-shel:cs0-1207  [000] ....  5995.083894: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2517
  gnome-shel:cs0-1207  [000] ....  5995.083895: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2677
  gnome-shel:cs0-1207  [000] ....  5995.083897: drm_sched_job: entity=000000002109c155, id=2555, fence=00000000fafe44ea, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.083944: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2709
             gfx-782   [000] ....  5995.083961: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2549
             gfx-782   [000] d...  5995.083962: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2709
          <idle>-0     [000] d.h.  5995.084074: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2709
          <idle>-0     [000] d.h.  5995.084078: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2549
          <idle>-0     [000] dNh.  5995.084085: drm_sched_process_job: fence=00000000fafe44ea signaled
  gnome-shel:cs0-1207  [000] ....  5995.100070: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2518
  gnome-shel:cs0-1207  [000] ....  5995.100081: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2518
  gnome-shel:cs0-1207  [000] ....  5995.100092: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.100101: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2550
  gnome-shel:cs0-1207  [000] ....  5995.100101: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2550
  gnome-shel:cs0-1207  [000] ....  5995.100103: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2518
  gnome-shel:cs0-1207  [000] ....  5995.100104: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2518
  gnome-shel:cs0-1207  [000] ....  5995.100105: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2678
  gnome-shel:cs0-1207  [000] ....  5995.100107: drm_sched_job: entity=000000002109c155, id=2556, fence=000000006cc33e46, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.100158: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2710
             gfx-782   [000] ....  5995.100176: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2550
             gfx-782   [000] d...  5995.100177: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2710
          <idle>-0     [000] d.h.  5995.100269: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2710
          <idle>-0     [000] d.h.  5995.100271: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2550
          <idle>-0     [000] dNh.  5995.100274: drm_sched_process_job: fence=000000006cc33e46 signaled
  gnome-shel:cs0-1207  [000] ....  5995.117167: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2519
  gnome-shel:cs0-1207  [000] ....  5995.117179: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2519
  gnome-shel:cs0-1207  [000] ....  5995.117187: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.117191: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2551
  gnome-shel:cs0-1207  [000] ....  5995.117192: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2551
  gnome-shel:cs0-1207  [000] ....  5995.117193: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2519
  gnome-shel:cs0-1207  [000] ....  5995.117194: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2519
  gnome-shel:cs0-1207  [000] ....  5995.117195: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2679
  gnome-shel:cs0-1207  [000] ....  5995.117196: drm_sched_job: entity=000000002109c155, id=2557, fence=00000000629152c2, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.117239: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2711
             gfx-782   [000] ....  5995.117254: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2551
             gfx-782   [000] d...  5995.117255: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2711
   kworker/u32:3-3033  [002] ....  5995.117382: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2551
          <idle>-0     [000] d.h.  5995.117415: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2711
          <idle>-0     [000] d.h.  5995.117417: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2551
          <idle>-0     [000] dNh.  5995.117458: drm_sched_process_job: fence=00000000629152c2 signaled
   kworker/u32:3-3033  [002] ....  5995.117464: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2551
  gnome-shel:cs0-1207  [000] ....  5995.134053: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2520
  gnome-shel:cs0-1207  [000] ....  5995.134065: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2520
  gnome-shel:cs0-1207  [000] ....  5995.134073: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.134078: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2552
  gnome-shel:cs0-1207  [000] ....  5995.134079: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2552
  gnome-shel:cs0-1207  [000] ....  5995.134080: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2520
  gnome-shel:cs0-1207  [000] ....  5995.134081: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2520
  gnome-shel:cs0-1207  [000] ....  5995.134083: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2680
  gnome-shel:cs0-1207  [000] ....  5995.134084: drm_sched_job: entity=000000002109c155, id=2558, fence=0000000016a7e4a6, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.134125: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2712
             gfx-782   [000] ....  5995.134141: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2552
             gfx-782   [000] d...  5995.134142: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2712
          <idle>-0     [000] d.h.  5995.134227: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2712
          <idle>-0     [000] d.h.  5995.134227: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2552
          <idle>-0     [000] dNh.  5995.134231: drm_sched_process_job: fence=0000000016a7e4a6 signaled
  gnome-shel:cs0-1207  [000] ....  5995.150436: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2521
  gnome-shel:cs0-1207  [000] ....  5995.150450: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2521
  gnome-shel:cs0-1207  [000] ....  5995.150462: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.150467: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2553
  gnome-shel:cs0-1207  [000] ....  5995.150468: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2553
  gnome-shel:cs0-1207  [000] ....  5995.150469: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2521
  gnome-shel:cs0-1207  [000] ....  5995.150470: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2521
  gnome-shel:cs0-1207  [000] ....  5995.150472: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2681
  gnome-shel:cs0-1207  [000] ....  5995.150473: drm_sched_job: entity=000000002109c155, id=2559, fence=00000000dab0b0c6, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.150522: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2713
             gfx-782   [000] ....  5995.150540: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2553
             gfx-782   [000] d...  5995.150540: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2713
          <idle>-0     [000] d.h.  5995.150633: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2713
          <idle>-0     [000] d.h.  5995.150635: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2553
          <idle>-0     [000] dNh.  5995.150637: drm_sched_process_job: fence=00000000dab0b0c6 signaled
  gnome-shel:cs0-1207  [000] ....  5995.167454: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2522
  gnome-shel:cs0-1207  [000] ....  5995.167468: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2522
  gnome-shel:cs0-1207  [000] ....  5995.167481: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.167488: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2554
  gnome-shel:cs0-1207  [000] ....  5995.167488: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2554
  gnome-shel:cs0-1207  [000] ....  5995.167490: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2522
  gnome-shel:cs0-1207  [000] ....  5995.167491: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2522
  gnome-shel:cs0-1207  [000] ....  5995.167492: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2682
  gnome-shel:cs0-1207  [000] ....  5995.167495: drm_sched_job: entity=000000002109c155, id=2560, fence=00000000ef665aee, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.167549: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2714
             gfx-782   [000] ....  5995.167565: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2554
             gfx-782   [000] d...  5995.167566: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2714
          <idle>-0     [000] d.h.  5995.167711: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2714
          <idle>-0     [000] d.h.  5995.167714: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2554
   kworker/u32:3-3033  [004] ....  5995.167715: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2554
   kworker/u32:3-3033  [004] ....  5995.167717: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2554
          <idle>-0     [000] dNh.  5995.167720: drm_sched_process_job: fence=00000000ef665aee signaled
  gnome-shel:cs0-1207  [000] ....  5995.183713: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2523
  gnome-shel:cs0-1207  [000] ....  5995.183724: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2523
  gnome-shel:cs0-1207  [000] ....  5995.183733: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.183739: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2555
  gnome-shel:cs0-1207  [000] ....  5995.183739: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2555
  gnome-shel:cs0-1207  [000] ....  5995.183741: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2523
  gnome-shel:cs0-1207  [000] ....  5995.183742: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2523
  gnome-shel:cs0-1207  [000] ....  5995.183743: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2683
  gnome-shel:cs0-1207  [000] ....  5995.183744: drm_sched_job: entity=000000002109c155, id=2561, fence=0000000075607af8, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.183793: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2715
             gfx-782   [000] ....  5995.183809: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2555
             gfx-782   [000] d...  5995.183810: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2715
   kworker/u32:3-3033  [004] ....  5995.183961: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2555
          <idle>-0     [000] d.h.  5995.183965: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2715
          <idle>-0     [000] d.h.  5995.183967: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2555
          <idle>-0     [000] dNh.  5995.184014: drm_sched_process_job: fence=0000000075607af8 signaled
   kworker/u32:3-3033  [004] ....  5995.184020: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2555
  gnome-shel:cs0-1207  [000] ....  5995.200541: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2524
  gnome-shel:cs0-1207  [000] ....  5995.200555: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2524
  gnome-shel:cs0-1207  [000] ....  5995.200564: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.200569: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2556
  gnome-shel:cs0-1207  [000] ....  5995.200570: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2556
  gnome-shel:cs0-1207  [000] ....  5995.200571: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2524
  gnome-shel:cs0-1207  [000] ....  5995.200572: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2524
  gnome-shel:cs0-1207  [000] ....  5995.200573: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2684
  gnome-shel:cs0-1207  [000] ....  5995.200574: drm_sched_job: entity=000000002109c155, id=2562, fence=0000000078dafb7a, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.200625: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2716
             gfx-782   [000] ....  5995.200643: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2556
             gfx-782   [000] d...  5995.200644: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2716
          <idle>-0     [000] d.h.  5995.200736: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2716
          <idle>-0     [000] d.h.  5995.200738: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2556
          <idle>-0     [000] dNh.  5995.200741: drm_sched_process_job: fence=0000000078dafb7a signaled
  gnome-shel:cs0-1207  [000] ....  5995.217134: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2525
  gnome-shel:cs0-1207  [000] ....  5995.217145: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2525
  gnome-shel:cs0-1207  [000] ....  5995.217154: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.217159: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2557
  gnome-shel:cs0-1207  [000] ....  5995.217160: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2557
  gnome-shel:cs0-1207  [000] ....  5995.217161: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2525
  gnome-shel:cs0-1207  [000] ....  5995.217162: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2525
  gnome-shel:cs0-1207  [000] ....  5995.217164: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2685
  gnome-shel:cs0-1207  [000] ....  5995.217165: drm_sched_job: entity=000000002109c155, id=2563, fence=000000005ef55117, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.217206: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2717
             gfx-782   [000] ....  5995.217224: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2557
             gfx-782   [000] d...  5995.217225: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2717
          <idle>-0     [000] d.h.  5995.217307: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2717
          <idle>-0     [000] d.h.  5995.217309: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2557
          <idle>-0     [000] dNh.  5995.217312: drm_sched_process_job: fence=000000005ef55117 signaled
  gnome-shel:cs0-1207  [000] ....  5995.233746: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2526
  gnome-shel:cs0-1207  [000] ....  5995.233756: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2526
  gnome-shel:cs0-1207  [000] ....  5995.233765: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.233770: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2558
  gnome-shel:cs0-1207  [000] ....  5995.233771: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2558
  gnome-shel:cs0-1207  [000] ....  5995.233772: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2526
  gnome-shel:cs0-1207  [000] ....  5995.233773: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2526
  gnome-shel:cs0-1207  [000] ....  5995.233775: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2686
  gnome-shel:cs0-1207  [000] ....  5995.233776: drm_sched_job: entity=000000002109c155, id=2564, fence=00000000682d5ed4, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.233817: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2718
             gfx-782   [000] ....  5995.233833: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2558
             gfx-782   [000] d...  5995.233834: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2718
          <idle>-0     [000] d.h.  5995.233914: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2718
          <idle>-0     [000] d.h.  5995.233915: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2558
          <idle>-0     [000] dNh.  5995.233917: drm_sched_process_job: fence=00000000682d5ed4 signaled
  gnome-shel:cs0-1207  [000] ....  5995.250285: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2527
  gnome-shel:cs0-1207  [000] ....  5995.250298: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2527
  gnome-shel:cs0-1207  [000] ....  5995.250306: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.250310: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2559
  gnome-shel:cs0-1207  [000] ....  5995.250311: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2559
  gnome-shel:cs0-1207  [000] ....  5995.250312: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2527
  gnome-shel:cs0-1207  [000] ....  5995.250313: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2527
  gnome-shel:cs0-1207  [000] ....  5995.250314: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2687
  gnome-shel:cs0-1207  [000] ....  5995.250316: drm_sched_job: entity=000000002109c155, id=2565, fence=00000000ec42c904, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.250353: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2719
             gfx-782   [000] ....  5995.250370: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2559
             gfx-782   [000] d...  5995.250371: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2719
          <idle>-0     [000] d.h.  5995.250446: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2719
          <idle>-0     [000] d.h.  5995.250447: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2559
          <idle>-0     [000] dNh.  5995.250451: drm_sched_process_job: fence=00000000ec42c904 signaled
  gnome-shel:cs0-1207  [000] ....  5995.267214: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2528
  gnome-shel:cs0-1207  [000] ....  5995.267227: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2528
  gnome-shel:cs0-1207  [000] ....  5995.267240: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.267248: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2560
  gnome-shel:cs0-1207  [000] ....  5995.267249: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2560
  gnome-shel:cs0-1207  [000] ....  5995.267251: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2528
  gnome-shel:cs0-1207  [000] ....  5995.267252: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2528
  gnome-shel:cs0-1207  [000] ....  5995.267254: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2688
  gnome-shel:cs0-1207  [000] ....  5995.267256: drm_sched_job: entity=000000002109c155, id=2566, fence=000000001a74643f, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.267315: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2720
             gfx-782   [000] ....  5995.267331: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2560
             gfx-782   [000] d...  5995.267331: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2720
          <idle>-0     [000] d.h.  5995.267552: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2720
          <idle>-0     [000] d.h.  5995.267554: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2560
          <idle>-0     [000] dNh.  5995.267560: drm_sched_process_job: fence=000000001a74643f signaled
  gnome-shel:cs0-1207  [000] ....  5995.283738: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2529
  gnome-shel:cs0-1207  [000] ....  5995.283751: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2529
  gnome-shel:cs0-1207  [000] ....  5995.283762: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.283770: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2561
  gnome-shel:cs0-1207  [000] ....  5995.283770: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2561
  gnome-shel:cs0-1207  [000] ....  5995.283772: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2529
  gnome-shel:cs0-1207  [000] ....  5995.283773: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2529
  gnome-shel:cs0-1207  [000] ....  5995.283774: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2689
  gnome-shel:cs0-1207  [000] ....  5995.283776: drm_sched_job: entity=000000002109c155, id=2567, fence=00000000b479ff3c, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.283828: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2721
             gfx-782   [000] ....  5995.283843: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2561
             gfx-782   [000] d...  5995.283844: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2721
          <idle>-0     [000] d.h.  5995.284071: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2721
          <idle>-0     [000] d.h.  5995.284074: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2561
          <idle>-0     [000] dNh.  5995.284080: drm_sched_process_job: fence=00000000b479ff3c signaled
  gnome-shel:cs0-1207  [000] ....  5995.300773: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2530
  gnome-shel:cs0-1207  [000] ....  5995.300784: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2530
  gnome-shel:cs0-1207  [000] ....  5995.300793: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.300799: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2562
  gnome-shel:cs0-1207  [000] ....  5995.300799: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2562
  gnome-shel:cs0-1207  [000] ....  5995.300801: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2530
  gnome-shel:cs0-1207  [000] ....  5995.300801: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2530
  gnome-shel:cs0-1207  [000] ....  5995.300803: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2690
  gnome-shel:cs0-1207  [000] ....  5995.300805: drm_sched_job: entity=000000002109c155, id=2568, fence=000000000490b65e, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.300847: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2722
             gfx-782   [000] ....  5995.300865: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2562
             gfx-782   [000] d...  5995.300866: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2722
          <idle>-0     [000] d.h.  5995.300946: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2722
          <idle>-0     [000] d.h.  5995.300947: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2562
          <idle>-0     [000] dNh.  5995.300952: drm_sched_process_job: fence=000000000490b65e signaled
  gnome-shel:cs0-1207  [000] ....  5995.316828: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2531
  gnome-shel:cs0-1207  [000] ....  5995.316840: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2531
  gnome-shel:cs0-1207  [000] ....  5995.316848: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.316852: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2563
  gnome-shel:cs0-1207  [000] ....  5995.316853: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2563
  gnome-shel:cs0-1207  [000] ....  5995.316854: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2531
  gnome-shel:cs0-1207  [000] ....  5995.316855: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2531
  gnome-shel:cs0-1207  [000] ....  5995.316856: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2691
  gnome-shel:cs0-1207  [000] ....  5995.316857: drm_sched_job: entity=000000002109c155, id=2569, fence=0000000038407f53, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.316895: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2723
             gfx-782   [000] ....  5995.316909: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2563
             gfx-782   [000] d...  5995.316910: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2723
          <idle>-0     [000] d.h.  5995.317001: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2723
          <idle>-0     [000] d.h.  5995.317002: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2563
          <idle>-0     [000] dNh.  5995.317006: drm_sched_process_job: fence=0000000038407f53 signaled
  gnome-shel:cs0-1207  [000] ....  5995.333557: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2532
  gnome-shel:cs0-1207  [000] ....  5995.333569: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2532
  gnome-shel:cs0-1207  [000] ....  5995.333577: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.333581: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2564
  gnome-shel:cs0-1207  [000] ....  5995.333582: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2564
  gnome-shel:cs0-1207  [000] ....  5995.333583: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2532
  gnome-shel:cs0-1207  [000] ....  5995.333584: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2532
  gnome-shel:cs0-1207  [000] ....  5995.333585: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2692
  gnome-shel:cs0-1207  [000] ....  5995.333587: drm_sched_job: entity=000000002109c155, id=2570, fence=000000008f9070aa, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.333627: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2724
             gfx-782   [000] ....  5995.333644: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2564
             gfx-782   [000] d...  5995.333645: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2724
          <idle>-0     [000] d.h.  5995.333716: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2724
          <idle>-0     [000] d.h.  5995.333718: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2564
          <idle>-0     [000] dNh.  5995.333721: drm_sched_process_job: fence=000000008f9070aa signaled
  gnome-shel:cs0-1207  [000] ....  5995.350248: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2533
  gnome-shel:cs0-1207  [000] ....  5995.350265: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2533
  gnome-shel:cs0-1207  [000] ....  5995.350275: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.350281: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2565
  gnome-shel:cs0-1207  [000] ....  5995.350282: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2565
  gnome-shel:cs0-1207  [000] ....  5995.350284: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2533
  gnome-shel:cs0-1207  [000] ....  5995.350284: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2533
  gnome-shel:cs0-1207  [000] ....  5995.350286: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2693
  gnome-shel:cs0-1207  [000] ....  5995.350288: drm_sched_job: entity=000000002109c155, id=2571, fence=00000000d7d9dcee, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.350339: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2725
             gfx-782   [000] ....  5995.350356: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2565
             gfx-782   [000] d...  5995.350357: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2725
          <idle>-0     [000] d.h.  5995.350454: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2725
          <idle>-0     [000] d.h.  5995.350455: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2565
          <idle>-0     [000] dNh.  5995.350459: drm_sched_process_job: fence=00000000d7d9dcee signaled
  gnome-shel:cs0-1207  [000] ....  5995.366746: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2534
  gnome-shel:cs0-1207  [000] ....  5995.366760: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2534
  gnome-shel:cs0-1207  [000] ....  5995.366770: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.366777: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2566
  gnome-shel:cs0-1207  [000] ....  5995.366778: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2566
  gnome-shel:cs0-1207  [000] ....  5995.366779: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2534
  gnome-shel:cs0-1207  [000] ....  5995.366780: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2534
  gnome-shel:cs0-1207  [000] ....  5995.366781: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2694
  gnome-shel:cs0-1207  [000] ....  5995.366783: drm_sched_job: entity=000000002109c155, id=2572, fence=00000000a06974c3, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.366836: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2726
             gfx-782   [000] ....  5995.366854: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2566
             gfx-782   [000] d...  5995.366855: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2726
          <idle>-0     [000] d.h.  5995.366932: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2726
          <idle>-0     [000] d.h.  5995.366933: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2566
          <idle>-0     [000] dNh.  5995.366936: drm_sched_process_job: fence=00000000a06974c3 signaled
  gnome-shel:cs0-1207  [000] ....  5995.383715: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2535
  gnome-shel:cs0-1207  [000] ....  5995.383730: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2535
  gnome-shel:cs0-1207  [000] ....  5995.383741: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.383747: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2567
  gnome-shel:cs0-1207  [000] ....  5995.383747: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2567
  gnome-shel:cs0-1207  [000] ....  5995.383749: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2535
  gnome-shel:cs0-1207  [000] ....  5995.383750: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2535
  gnome-shel:cs0-1207  [000] ....  5995.383751: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2695
  gnome-shel:cs0-1207  [000] ....  5995.383754: drm_sched_job: entity=000000002109c155, id=2573, fence=00000000f8ff0822, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.383813: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2727
             gfx-782   [000] ....  5995.383830: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2567
             gfx-782   [000] d...  5995.383831: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2727
          <idle>-0     [000] d.h.  5995.383920: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2727
          <idle>-0     [000] d.h.  5995.383921: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2567
          <idle>-0     [000] dNh.  5995.383924: drm_sched_process_job: fence=00000000f8ff0822 signaled
  gnome-shel:cs0-1207  [000] ....  5995.400167: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2536
  gnome-shel:cs0-1207  [000] ....  5995.400182: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2536
  gnome-shel:cs0-1207  [000] ....  5995.400191: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.400196: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2568
  gnome-shel:cs0-1207  [000] ....  5995.400197: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2568
  gnome-shel:cs0-1207  [000] ....  5995.400198: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2536
  gnome-shel:cs0-1207  [000] ....  5995.400199: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2536
  gnome-shel:cs0-1207  [000] ....  5995.400201: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2696
  gnome-shel:cs0-1207  [000] ....  5995.400202: drm_sched_job: entity=000000002109c155, id=2574, fence=00000000026a4270, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.400249: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2728
             gfx-782   [000] ....  5995.400267: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2568
             gfx-782   [000] d...  5995.400268: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2728
          <idle>-0     [000] d.h.  5995.400351: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2728
          <idle>-0     [000] d.h.  5995.400353: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2568
          <idle>-0     [000] dNh.  5995.400358: drm_sched_process_job: fence=00000000026a4270 signaled
  gnome-shel:cs0-1207  [000] ....  5995.416086: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2537
  gnome-shel:cs0-1207  [000] ....  5995.416102: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2537
  gnome-shel:cs0-1207  [000] ....  5995.416113: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.416122: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2569
  gnome-shel:cs0-1207  [000] ....  5995.416122: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2569
  gnome-shel:cs0-1207  [000] ....  5995.416124: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2537
  gnome-shel:cs0-1207  [000] ....  5995.416125: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2537
  gnome-shel:cs0-1207  [000] ....  5995.416127: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2697
  gnome-shel:cs0-1207  [000] ....  5995.416129: drm_sched_job: entity=000000002109c155, id=2575, fence=000000005e47419f, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.416179: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2729
             gfx-782   [000] ....  5995.416196: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2569
             gfx-782   [000] d...  5995.416197: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2729
          <idle>-0     [000] d.h.  5995.416281: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2729
          <idle>-0     [000] d.h.  5995.416282: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2569
          <idle>-0     [000] dNh.  5995.416286: drm_sched_process_job: fence=000000005e47419f signaled
  gnome-shel:cs0-1207  [000] ....  5995.433428: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2538
  gnome-shel:cs0-1207  [000] ....  5995.433441: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2538
  gnome-shel:cs0-1207  [000] ....  5995.433450: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.433455: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2570
  gnome-shel:cs0-1207  [000] ....  5995.433455: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2570
  gnome-shel:cs0-1207  [000] ....  5995.433457: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2538
  gnome-shel:cs0-1207  [000] ....  5995.433457: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2538
  gnome-shel:cs0-1207  [000] ....  5995.433459: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2698
  gnome-shel:cs0-1207  [000] ....  5995.433461: drm_sched_job: entity=000000002109c155, id=2576, fence=0000000006e20f92, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.433503: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2730
             gfx-782   [000] ....  5995.433519: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2570
             gfx-782   [000] d...  5995.433520: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2730
          <idle>-0     [000] d.h.  5995.433595: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2730
          <idle>-0     [000] d.h.  5995.433596: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2570
          <idle>-0     [000] dNh.  5995.433599: drm_sched_process_job: fence=0000000006e20f92 signaled
  gnome-shel:cs0-1207  [000] ....  5995.450010: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2539
  gnome-shel:cs0-1207  [000] ....  5995.450022: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2539
  gnome-shel:cs0-1207  [000] ....  5995.450030: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.450034: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2571
  gnome-shel:cs0-1207  [000] ....  5995.450035: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2571
  gnome-shel:cs0-1207  [000] ....  5995.450036: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2539
  gnome-shel:cs0-1207  [000] ....  5995.450036: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2539
  gnome-shel:cs0-1207  [000] ....  5995.450038: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2699
  gnome-shel:cs0-1207  [000] ....  5995.450039: drm_sched_job: entity=000000002109c155, id=2577, fence=000000007457f753, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.450077: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2731
             gfx-782   [000] ....  5995.450094: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2571
             gfx-782   [000] d...  5995.450095: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2731
          <idle>-0     [000] d.h.  5995.450175: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2731
          <idle>-0     [000] d.h.  5995.450176: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2571
          <idle>-0     [000] dNh.  5995.450180: drm_sched_process_job: fence=000000007457f753 signaled
  gnome-shel:cs0-1207  [000] ....  5995.466710: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2540
  gnome-shel:cs0-1207  [000] ....  5995.466721: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2540
  gnome-shel:cs0-1207  [000] ....  5995.466729: amdgpu_vm_bo_mapping: soffs=080010a800, eoffs=080010b700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.466733: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2572
  gnome-shel:cs0-1207  [000] ....  5995.466734: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2572
  gnome-shel:cs0-1207  [000] ....  5995.466735: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2540
  gnome-shel:cs0-1207  [000] ....  5995.466736: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2540
  gnome-shel:cs0-1207  [000] ....  5995.466737: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2700
  gnome-shel:cs0-1207  [000] ....  5995.466738: drm_sched_job: entity=000000002109c155, id=2578, fence=00000000df496ac9, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.466777: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2732
             gfx-782   [000] ....  5995.466795: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2572
             gfx-782   [000] d...  5995.466796: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2732
          <idle>-0     [000] d.h.  5995.466874: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2732
          <idle>-0     [000] d.h.  5995.466875: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2572
          <idle>-0     [000] dNh.  5995.466879: drm_sched_process_job: fence=00000000df496ac9 signaled
  gnome-shel:cs0-1207  [000] ....  5995.482679: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2541
  gnome-shel:cs0-1207  [000] ....  5995.482693: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2541
  gnome-shel:cs0-1207  [000] ....  5995.482704: amdgpu_vm_bo_mapping: soffs=0800109800, eoffs=080010a700, flags=70
  gnome-shel:cs0-1207  [000] ....  5995.482710: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2573
  gnome-shel:cs0-1207  [000] ....  5995.482711: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2573
  gnome-shel:cs0-1207  [000] ....  5995.482713: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2541
  gnome-shel:cs0-1207  [000] ....  5995.482713: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2541
  gnome-shel:cs0-1207  [000] ....  5995.482715: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2701
  gnome-shel:cs0-1207  [000] ....  5995.482717: drm_sched_job: entity=000000002109c155, id=2579, fence=0000000037ae2d8c, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  5995.482773: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2733
             gfx-782   [000] ....  5995.482789: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2573
             gfx-782   [000] d...  5995.482790: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2733
          <idle>-0     [000] d.h.  5995.482863: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2733
          <idle>-0     [000] d.h.  5995.482864: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2573
          <idle>-0     [000] dNh.  5995.482867: drm_sched_process_job: fence=0000000037ae2d8c signaled
  gnome-shel:cs0-1207  [000] ....  6000.580197: dma_fence_wait_start: driver=drm_sched timeline=gfx context=120 seqno=2542
  gnome-shel:cs0-1207  [000] ....  6000.580212: dma_fence_wait_end: driver=drm_sched timeline=gfx context=120 seqno=2542
  gnome-shel:cs0-1207  [000] ....  6000.580221: amdgpu_vm_bo_mapping: soffs=0800100200, eoffs=0800101100, flags=70
  gnome-shel:cs0-1207  [000] ....  6000.580227: dma_fence_init: driver=drm_sched timeline=gfx context=119 seqno=2574
  gnome-shel:cs0-1207  [000] ....  6000.580227: dma_fence_init: driver=drm_sched timeline=gfx context=120 seqno=2574
  gnome-shel:cs0-1207  [000] ....  6000.580229: dma_fence_destroy: driver=drm_sched timeline=gfx context=120 seqno=2542
  gnome-shel:cs0-1207  [000] ....  6000.580229: dma_fence_destroy: driver=drm_sched timeline=gfx context=119 seqno=2542
  gnome-shel:cs0-1207  [000] ....  6000.580231: dma_fence_destroy: driver=amdgpu timeline=gfx context=1 seqno=2702
  gnome-shel:cs0-1207  [000] ....  6000.580233: drm_sched_job: entity=000000002109c155, id=2580, fence=000000006c1ef9f7, ring=gfx, job count:0, hw job count:0
             gfx-782   [000] ....  6000.580280: dma_fence_init: driver=amdgpu timeline=gfx context=1 seqno=2734
             gfx-782   [000] ....  6000.580297: dma_fence_signaled: driver=drm_sched timeline=gfx context=119 seqno=2574
             gfx-782   [000] d...  6000.580298: dma_fence_enable_signal: driver=amdgpu timeline=gfx context=1 seqno=2734
          <idle>-0     [000] d.h.  6000.580370: dma_fence_signaled: driver=amdgpu timeline=gfx context=1 seqno=2734
          <idle>-0     [000] d.h.  6000.580371: dma_fence_signaled: driver=drm_sched timeline=gfx context=120 seqno=2574
          <idle>-0     [000] dNh.  6000.580374: drm_sched_process_job: fence=000000006c1ef9f7 signaled
  

[-- Attachment #3: Type: text/plain, Size: 153 bytes --]

_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]                     ` <CAAzXoRJ7MBis7YYWhYcH_H=1ZPpZpTJFDm+HTD5q0p91bgTxSg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2019-03-12 16:39                       ` Kuehling, Felix
       [not found]                         ` <b26fcd35-9867-f716-cea8-ddf76c599fca-5C7GfCeVMHo@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Kuehling, Felix @ 2019-03-12 16:39 UTC (permalink / raw)
  To: Tom St Denis, Lauri Ehrenpreis, amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW

[adding the list back]

I'd suspect a problem related to memory clock. This is an APU where 
system memory is shared with the CPU, so if the SMU changes memory 
clocks that would affect CPU memory access performance. If the problem 
only occurs when OpenCL is running, then the compute power profile could 
have an effect here.

Laurie, can you monitor the clocks during your tests using rocm-smi?

Regards,
   Felix

On 2019-03-11 1:15 p.m., Tom St Denis wrote:
> Hi Lauri,
>
> I don't have ROCm installed locally (not on that team at AMD) but I 
> can rope in some of the KFD folk and see what they say :-).
>
> (in the mean time I should look into installing the ROCm stack on my 
> Ubuntu disk for experimentation...).
>
> Only other thing that comes to mind is some sort of stutter due to 
> power/clock gating (or gfx off/etc).  But that typically affects the 
> display/gpu side not the CPU side.
>
> Felix:  Any known issues with Raven and ROCm interacting over memory 
> bus performance?
>
> Tom
>
> On Mon, Mar 11, 2019 at 12:56 PM Lauri Ehrenpreis <laurioma@gmail.com 
> <mailto:laurioma@gmail.com>> wrote:
>
>     Hi!
>
>     The 100x memory slowdown is hard to belive indeed. I attached the
>     test program with my first e-mail which depends only on
>     rocm-opencl-dev package. Would you mind compiling it and checking
>     if it slows down memory for you as well?
>
>     steps:
>     1) g++ cl_slow_test.cpp -o cl_slow_test -I
>     /opt/rocm/opencl/include/ -L /opt/rocm/opencl/lib/x86_64/  -lOpenCL
>     2) logout from desktop env and disconnect hdmi/diplayport etc
>     3) log in over ssh
>     4) run the program ./cl_slow_test 1
>
>     For me it reproduced even without step 2 as well but less
>     reliably. moving mouse for example could make the memory speed
>     fast again.
>
>     --
>     Lauri
>
>
>
>     On Mon, Mar 11, 2019 at 6:33 PM Tom St Denis <tstdenis82@gmail.com
>     <mailto:tstdenis82@gmail.com>> wrote:
>
>         Hi Lauri,
>
>         There's really no connection between the two other than they
>         run in the same package.  I too run a 2400G (as my
>         workstation) and I got the same ~6.6GB/sec transfer rate but
>         without a CL app running ...  The only logical reason is your
>         CL app is bottlenecking the APUs memory bus but you claim
>         "simply opening a context is enough" so something else is
>         going on.
>
>         Your last reply though says "with it running in the
>         background" so it's entirely possible the CPU isn't busy but
>         the package memory controller (shared between both the CPU and
>         GPU) is busy.  For instance running xonotic in a 1080p window
>         on my 4K display reduced the memory test to 5.8GB/sec and
>         that's hardly a heavy memory bound GPU app.
>
>         The only other possible connection is the GPU is generating so
>         much heat that it's throttling the package which is also
>         unlikely if you have a proper HSF attached (I use the ones
>         that came in the retail boxes).
>
>         Cheers,
>         Tom
>
_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]                         ` <b26fcd35-9867-f716-cea8-ddf76c599fca-5C7GfCeVMHo@public.gmane.org>
@ 2019-03-12 21:21                           ` Lauri Ehrenpreis
       [not found]                             ` <CAGyaPbA_z0bKC1W8gTdnx4Ot5G-45pC7029pKWrAM0Pj_BU6uw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Lauri Ehrenpreis @ 2019-03-12 21:21 UTC (permalink / raw)
  To: Kuehling, Felix; +Cc: Tom St Denis, amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW


[-- Attachment #1.1: Type: text/plain, Size: 5040 bytes --]

IN the case when memory is slow, the rocm-smi outputs this:
========================        ROCm System Management Interface
========================
================================================================================================
GPU   Temp   AvgPwr   SCLK    MCLK    PCLK           Fan     Perf
PwrCap   SCLK OD   MCLK OD  GPU%
GPU[0] : WARNING: Empty SysFS value: pclk
GPU[0] : WARNING: Unable to read
/sys/class/drm/card0/device/gpu_busy_percent
0     30.0c  N/A      400Mhz  933Mhz  N/A            0%      auto    N/A
  0%        0%       N/A
================================================================================================
========================               End of ROCm SMI Log
========================

normal memory speed case gives following:
========================        ROCm System Management Interface
========================
================================================================================================
GPU   Temp   AvgPwr   SCLK    MCLK    PCLK           Fan     Perf
PwrCap   SCLK OD   MCLK OD  GPU%
GPU[0] : WARNING: Empty SysFS value: pclk
GPU[0] : WARNING: Unable to read
/sys/class/drm/card0/device/gpu_busy_percent
0     35.0c  N/A      400Mhz  1200Mhz N/A            0%      auto    N/A
  0%        0%       N/A
================================================================================================
========================               End of ROCm SMI Log
========================

So there is a difference in MCLK - can this cause such a huge slowdown?

--
Lauri

On Tue, Mar 12, 2019 at 6:39 PM Kuehling, Felix <Felix.Kuehling-5C7GfCeVMHo@public.gmane.org>
wrote:

> [adding the list back]
>
> I'd suspect a problem related to memory clock. This is an APU where
> system memory is shared with the CPU, so if the SMU changes memory
> clocks that would affect CPU memory access performance. If the problem
> only occurs when OpenCL is running, then the compute power profile could
> have an effect here.
>
> Laurie, can you monitor the clocks during your tests using rocm-smi?
>
> Regards,
>    Felix
>
> On 2019-03-11 1:15 p.m., Tom St Denis wrote:
> > Hi Lauri,
> >
> > I don't have ROCm installed locally (not on that team at AMD) but I
> > can rope in some of the KFD folk and see what they say :-).
> >
> > (in the mean time I should look into installing the ROCm stack on my
> > Ubuntu disk for experimentation...).
> >
> > Only other thing that comes to mind is some sort of stutter due to
> > power/clock gating (or gfx off/etc).  But that typically affects the
> > display/gpu side not the CPU side.
> >
> > Felix:  Any known issues with Raven and ROCm interacting over memory
> > bus performance?
> >
> > Tom
> >
> > On Mon, Mar 11, 2019 at 12:56 PM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
> > <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>> wrote:
> >
> >     Hi!
> >
> >     The 100x memory slowdown is hard to belive indeed. I attached the
> >     test program with my first e-mail which depends only on
> >     rocm-opencl-dev package. Would you mind compiling it and checking
> >     if it slows down memory for you as well?
> >
> >     steps:
> >     1) g++ cl_slow_test.cpp -o cl_slow_test -I
> >     /opt/rocm/opencl/include/ -L /opt/rocm/opencl/lib/x86_64/  -lOpenCL
> >     2) logout from desktop env and disconnect hdmi/diplayport etc
> >     3) log in over ssh
> >     4) run the program ./cl_slow_test 1
> >
> >     For me it reproduced even without step 2 as well but less
> >     reliably. moving mouse for example could make the memory speed
> >     fast again.
> >
> >     --
> >     Lauri
> >
> >
> >
> >     On Mon, Mar 11, 2019 at 6:33 PM Tom St Denis <tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
> >     <mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>> wrote:
> >
> >         Hi Lauri,
> >
> >         There's really no connection between the two other than they
> >         run in the same package.  I too run a 2400G (as my
> >         workstation) and I got the same ~6.6GB/sec transfer rate but
> >         without a CL app running ...  The only logical reason is your
> >         CL app is bottlenecking the APUs memory bus but you claim
> >         "simply opening a context is enough" so something else is
> >         going on.
> >
> >         Your last reply though says "with it running in the
> >         background" so it's entirely possible the CPU isn't busy but
> >         the package memory controller (shared between both the CPU and
> >         GPU) is busy.  For instance running xonotic in a 1080p window
> >         on my 4K display reduced the memory test to 5.8GB/sec and
> >         that's hardly a heavy memory bound GPU app.
> >
> >         The only other possible connection is the GPU is generating so
> >         much heat that it's throttling the package which is also
> >         unlikely if you have a proper HSF attached (I use the ones
> >         that came in the retail boxes).
> >
> >         Cheers,
> >         Tom
> >
>

[-- Attachment #1.2: Type: text/html, Size: 6802 bytes --]

[-- Attachment #2: Type: text/plain, Size: 153 bytes --]

_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]                             ` <CAGyaPbA_z0bKC1W8gTdnx4Ot5G-45pC7029pKWrAM0Pj_BU6uw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2019-03-12 21:31                               ` Lauri Ehrenpreis
       [not found]                                 ` <CAGyaPbD3K3pawBS+kBOs_QSm3kB16MFRYZa98FcqHAEX_FanVg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Lauri Ehrenpreis @ 2019-03-12 21:31 UTC (permalink / raw)
  To: Kuehling, Felix; +Cc: Tom St Denis, amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW


[-- Attachment #1.1: Type: text/plain, Size: 6459 bytes --]

However it's not only related to mclk and sclk. I tried this:
rocm-smi  --setsclk 2
rocm-smi  --setmclk 3
rocm-smi
========================        ROCm System Management Interface
========================
================================================================================================
GPU   Temp   AvgPwr   SCLK    MCLK    PCLK           Fan     Perf
PwrCap   SCLK OD   MCLK OD  GPU%
GPU[0] : WARNING: Empty SysFS value: pclk
GPU[0] : WARNING: Unable to read
/sys/class/drm/card0/device/gpu_busy_percent
0     34.0c  N/A      1240Mhz 1333Mhz N/A            0%      manual  N/A
  0%        0%       N/A
================================================================================================
========================               End of ROCm SMI Log
========================

./cl_slow_test 1
got 1 platforms 1 devices
speed 3919.777100 avg 3919.777100 mbytes/s
speed 3809.373291 avg 3864.575195 mbytes/s
speed 585.796814 avg 2771.649170 mbytes/s
speed 188.721848 avg 2125.917236 mbytes/s
speed 188.916367 avg 1738.517090 mbytes/s

So despite forcing max sclk and mclk the memory speed is still slow..

--
Lauri


On Tue, Mar 12, 2019 at 11:21 PM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
wrote:

> IN the case when memory is slow, the rocm-smi outputs this:
> ========================        ROCm System Management Interface
> ========================
>
> ================================================================================================
> GPU   Temp   AvgPwr   SCLK    MCLK    PCLK           Fan     Perf
> PwrCap   SCLK OD   MCLK OD  GPU%
> GPU[0] : WARNING: Empty SysFS value: pclk
> GPU[0] : WARNING: Unable to read
> /sys/class/drm/card0/device/gpu_busy_percent
> 0     30.0c  N/A      400Mhz  933Mhz  N/A            0%      auto    N/A
>     0%        0%       N/A
>
> ================================================================================================
> ========================               End of ROCm SMI Log
> ========================
>
> normal memory speed case gives following:
> ========================        ROCm System Management Interface
> ========================
>
> ================================================================================================
> GPU   Temp   AvgPwr   SCLK    MCLK    PCLK           Fan     Perf
> PwrCap   SCLK OD   MCLK OD  GPU%
> GPU[0] : WARNING: Empty SysFS value: pclk
> GPU[0] : WARNING: Unable to read
> /sys/class/drm/card0/device/gpu_busy_percent
> 0     35.0c  N/A      400Mhz  1200Mhz N/A            0%      auto    N/A
>     0%        0%       N/A
>
> ================================================================================================
> ========================               End of ROCm SMI Log
> ========================
>
> So there is a difference in MCLK - can this cause such a huge slowdown?
>
> --
> Lauri
>
> On Tue, Mar 12, 2019 at 6:39 PM Kuehling, Felix <Felix.Kuehling-5C7GfCeVMHo@public.gmane.org>
> wrote:
>
>> [adding the list back]
>>
>> I'd suspect a problem related to memory clock. This is an APU where
>> system memory is shared with the CPU, so if the SMU changes memory
>> clocks that would affect CPU memory access performance. If the problem
>> only occurs when OpenCL is running, then the compute power profile could
>> have an effect here.
>>
>> Laurie, can you monitor the clocks during your tests using rocm-smi?
>>
>> Regards,
>>    Felix
>>
>> On 2019-03-11 1:15 p.m., Tom St Denis wrote:
>> > Hi Lauri,
>> >
>> > I don't have ROCm installed locally (not on that team at AMD) but I
>> > can rope in some of the KFD folk and see what they say :-).
>> >
>> > (in the mean time I should look into installing the ROCm stack on my
>> > Ubuntu disk for experimentation...).
>> >
>> > Only other thing that comes to mind is some sort of stutter due to
>> > power/clock gating (or gfx off/etc).  But that typically affects the
>> > display/gpu side not the CPU side.
>> >
>> > Felix:  Any known issues with Raven and ROCm interacting over memory
>> > bus performance?
>> >
>> > Tom
>> >
>> > On Mon, Mar 11, 2019 at 12:56 PM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
>> > <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>> wrote:
>> >
>> >     Hi!
>> >
>> >     The 100x memory slowdown is hard to belive indeed. I attached the
>> >     test program with my first e-mail which depends only on
>> >     rocm-opencl-dev package. Would you mind compiling it and checking
>> >     if it slows down memory for you as well?
>> >
>> >     steps:
>> >     1) g++ cl_slow_test.cpp -o cl_slow_test -I
>> >     /opt/rocm/opencl/include/ -L /opt/rocm/opencl/lib/x86_64/  -lOpenCL
>> >     2) logout from desktop env and disconnect hdmi/diplayport etc
>> >     3) log in over ssh
>> >     4) run the program ./cl_slow_test 1
>> >
>> >     For me it reproduced even without step 2 as well but less
>> >     reliably. moving mouse for example could make the memory speed
>> >     fast again.
>> >
>> >     --
>> >     Lauri
>> >
>> >
>> >
>> >     On Mon, Mar 11, 2019 at 6:33 PM Tom St Denis <tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
>> >     <mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>> wrote:
>> >
>> >         Hi Lauri,
>> >
>> >         There's really no connection between the two other than they
>> >         run in the same package.  I too run a 2400G (as my
>> >         workstation) and I got the same ~6.6GB/sec transfer rate but
>> >         without a CL app running ...  The only logical reason is your
>> >         CL app is bottlenecking the APUs memory bus but you claim
>> >         "simply opening a context is enough" so something else is
>> >         going on.
>> >
>> >         Your last reply though says "with it running in the
>> >         background" so it's entirely possible the CPU isn't busy but
>> >         the package memory controller (shared between both the CPU and
>> >         GPU) is busy.  For instance running xonotic in a 1080p window
>> >         on my 4K display reduced the memory test to 5.8GB/sec and
>> >         that's hardly a heavy memory bound GPU app.
>> >
>> >         The only other possible connection is the GPU is generating so
>> >         much heat that it's throttling the package which is also
>> >         unlikely if you have a proper HSF attached (I use the ones
>> >         that came in the retail boxes).
>> >
>> >         Cheers,
>> >         Tom
>> >
>>
>

[-- Attachment #1.2: Type: text/html, Size: 8890 bytes --]

[-- Attachment #2: Type: text/plain, Size: 153 bytes --]

_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]                                 ` <CAGyaPbD3K3pawBS+kBOs_QSm3kB16MFRYZa98FcqHAEX_FanVg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2019-03-12 21:36                                   ` Deucher, Alexander
       [not found]                                     ` <BN6PR12MB180985C2C8051B5BBCF7CDDDF7490-/b2+HYfkarSEx6ez0IUAagdYzm3356FpvxpqHgZTriW3zl9H0oFU5g@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Deucher, Alexander @ 2019-03-12 21:36 UTC (permalink / raw)
  To: Lauri Ehrenpreis, Kuehling, Felix
  Cc: Tom St Denis, amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW


[-- Attachment #1.1: Type: text/plain, Size: 7167 bytes --]

Forcing the sclk and mclk high may impact the CPU frequency since they share TDP.

Alex
________________________________
From: amd-gfx <amd-gfx-bounces-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org> on behalf of Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
Sent: Tuesday, March 12, 2019 5:31 PM
To: Kuehling, Felix
Cc: Tom St Denis; amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
Subject: Re: Slow memory access when using OpenCL without X11

However it's not only related to mclk and sclk. I tried this:
rocm-smi  --setsclk 2
rocm-smi  --setmclk 3
rocm-smi
========================        ROCm System Management Interface        ========================
================================================================================================
GPU   Temp   AvgPwr   SCLK    MCLK    PCLK           Fan     Perf    PwrCap   SCLK OD   MCLK OD  GPU%
GPU[0] : WARNING: Empty SysFS value: pclk
GPU[0] : WARNING: Unable to read /sys/class/drm/card0/device/gpu_busy_percent
0     34.0c  N/A      1240Mhz 1333Mhz N/A            0%      manual  N/A      0%        0%       N/A
================================================================================================
========================               End of ROCm SMI Log              ========================

./cl_slow_test 1
got 1 platforms 1 devices
speed 3919.777100 avg 3919.777100 mbytes/s
speed 3809.373291 avg 3864.575195 mbytes/s
speed 585.796814 avg 2771.649170 mbytes/s
speed 188.721848 avg 2125.917236 mbytes/s
speed 188.916367 avg 1738.517090 mbytes/s

So despite forcing max sclk and mclk the memory speed is still slow..

--
Lauri


On Tue, Mar 12, 2019 at 11:21 PM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org<mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>> wrote:
IN the case when memory is slow, the rocm-smi outputs this:
========================        ROCm System Management Interface        ========================
================================================================================================
GPU   Temp   AvgPwr   SCLK    MCLK    PCLK           Fan     Perf    PwrCap   SCLK OD   MCLK OD  GPU%
GPU[0] : WARNING: Empty SysFS value: pclk
GPU[0] : WARNING: Unable to read /sys/class/drm/card0/device/gpu_busy_percent
0     30.0c  N/A      400Mhz  933Mhz  N/A            0%      auto    N/A      0%        0%       N/A
================================================================================================
========================               End of ROCm SMI Log              ========================

normal memory speed case gives following:
========================        ROCm System Management Interface        ========================
================================================================================================
GPU   Temp   AvgPwr   SCLK    MCLK    PCLK           Fan     Perf    PwrCap   SCLK OD   MCLK OD  GPU%
GPU[0] : WARNING: Empty SysFS value: pclk
GPU[0] : WARNING: Unable to read /sys/class/drm/card0/device/gpu_busy_percent
0     35.0c  N/A      400Mhz  1200Mhz N/A            0%      auto    N/A      0%        0%       N/A
================================================================================================
========================               End of ROCm SMI Log              ========================

So there is a difference in MCLK - can this cause such a huge slowdown?

--
Lauri

On Tue, Mar 12, 2019 at 6:39 PM Kuehling, Felix <Felix.Kuehling-5C7GfCeVMHo@public.gmane.org<mailto:Felix.Kuehling-5C7GfCeVMHo@public.gmane.org>> wrote:
[adding the list back]

I'd suspect a problem related to memory clock. This is an APU where
system memory is shared with the CPU, so if the SMU changes memory
clocks that would affect CPU memory access performance. If the problem
only occurs when OpenCL is running, then the compute power profile could
have an effect here.

Laurie, can you monitor the clocks during your tests using rocm-smi?

Regards,
   Felix

On 2019-03-11 1:15 p.m., Tom St Denis wrote:
> Hi Lauri,
>
> I don't have ROCm installed locally (not on that team at AMD) but I
> can rope in some of the KFD folk and see what they say :-).
>
> (in the mean time I should look into installing the ROCm stack on my
> Ubuntu disk for experimentation...).
>
> Only other thing that comes to mind is some sort of stutter due to
> power/clock gating (or gfx off/etc).  But that typically affects the
> display/gpu side not the CPU side.
>
> Felix:  Any known issues with Raven and ROCm interacting over memory
> bus performance?
>
> Tom
>
> On Mon, Mar 11, 2019 at 12:56 PM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org<mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
> <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org<mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>>> wrote:
>
>     Hi!
>
>     The 100x memory slowdown is hard to belive indeed. I attached the
>     test program with my first e-mail which depends only on
>     rocm-opencl-dev package. Would you mind compiling it and checking
>     if it slows down memory for you as well?
>
>     steps:
>     1) g++ cl_slow_test.cpp -o cl_slow_test -I
>     /opt/rocm/opencl/include/ -L /opt/rocm/opencl/lib/x86_64/  -lOpenCL
>     2) logout from desktop env and disconnect hdmi/diplayport etc
>     3) log in over ssh
>     4) run the program ./cl_slow_test 1
>
>     For me it reproduced even without step 2 as well but less
>     reliably. moving mouse for example could make the memory speed
>     fast again.
>
>     --
>     Lauri
>
>
>
>     On Mon, Mar 11, 2019 at 6:33 PM Tom St Denis <tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org<mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
>     <mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org<mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>>> wrote:
>
>         Hi Lauri,
>
>         There's really no connection between the two other than they
>         run in the same package.  I too run a 2400G (as my
>         workstation) and I got the same ~6.6GB/sec transfer rate but
>         without a CL app running ...  The only logical reason is your
>         CL app is bottlenecking the APUs memory bus but you claim
>         "simply opening a context is enough" so something else is
>         going on.
>
>         Your last reply though says "with it running in the
>         background" so it's entirely possible the CPU isn't busy but
>         the package memory controller (shared between both the CPU and
>         GPU) is busy.  For instance running xonotic in a 1080p window
>         on my 4K display reduced the memory test to 5.8GB/sec and
>         that's hardly a heavy memory bound GPU app.
>
>         The only other possible connection is the GPU is generating so
>         much heat that it's throttling the package which is also
>         unlikely if you have a proper HSF attached (I use the ones
>         that came in the retail boxes).
>
>         Cheers,
>         Tom
>

[-- Attachment #1.2: Type: text/html, Size: 12338 bytes --]

[-- Attachment #2: Type: text/plain, Size: 153 bytes --]

_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]                                     ` <BN6PR12MB180985C2C8051B5BBCF7CDDDF7490-/b2+HYfkarSEx6ez0IUAagdYzm3356FpvxpqHgZTriW3zl9H0oFU5g@public.gmane.org>
@ 2019-03-13 11:28                                       ` Lauri Ehrenpreis
       [not found]                                         ` <CAGyaPbBAxjGGHA6sxzvSqagLVhiHBDmmp3Oz0==SRhUao488ng-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Lauri Ehrenpreis @ 2019-03-13 11:28 UTC (permalink / raw)
  To: Deucher, Alexander
  Cc: Kuehling, Felix, Tom St Denis, amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW


[-- Attachment #1.1: Type: text/plain, Size: 9404 bytes --]

What I observe is that moving the mouse made the memory speed go up and
also it made mclk=1200Mhz in rocm-smi output.
However if I force mclk to 1200Mhz myself then memory speed is still slow.

So rocm-smi output when memory speed went fast due to mouse movement:
rocm-smi
========================        ROCm System Management Interface
========================
================================================================================================
GPU   Temp   AvgPwr   SCLK    MCLK    PCLK           Fan     Perf
PwrCap   SCLK OD   MCLK OD  GPU%
GPU[0] : WARNING: Empty SysFS value: pclk
GPU[0] : WARNING: Unable to read
/sys/class/drm/card0/device/gpu_busy_percent
0     44.0c  N/A      400Mhz  1200Mhz N/A            0%      manual  N/A
  0%        0%       N/A
================================================================================================
========================               End of ROCm SMI Log
========================

And rocm-smi output when I forced memclk=1200MHz myself:
rocm-smi --setmclk 2
rocm-smi
========================        ROCm System Management Interface
========================
================================================================================================
GPU   Temp   AvgPwr   SCLK    MCLK    PCLK           Fan     Perf
PwrCap   SCLK OD   MCLK OD  GPU%
GPU[0] : WARNING: Empty SysFS value: pclk
GPU[0] : WARNING: Unable to read
/sys/class/drm/card0/device/gpu_busy_percent
0     39.0c  N/A      400Mhz  1200Mhz N/A            0%      manual  N/A
  0%        0%       N/A
================================================================================================
========================               End of ROCm SMI Log
========================

So only difference is that temperature shows 44c when memory speed was fast
and 39c when it was slow. But mclk was 1200MHz and sclk was 400MHz in both
cases.
Can it be that rocm-smi just has a bug in reporting and mclk was not
actually 1200MHz when I forced it with rocm-smi --setmclk 2 ?
That would explain the different behaviour..

If so then is there a programmatic way how to really guarantee the high
speed mclk? Basically I want do something similar in my program what
happens if I move
the mouse in desktop env and this way guarantee the normal memory speed
each time the program starts.

--
Lauri


On Tue, Mar 12, 2019 at 11:36 PM Deucher, Alexander <
Alexander.Deucher-5C7GfCeVMHo@public.gmane.org> wrote:

> Forcing the sclk and mclk high may impact the CPU frequency since they
> share TDP.
>
> Alex
> ------------------------------
> *From:* amd-gfx <amd-gfx-bounces-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org> on behalf of
> Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
> *Sent:* Tuesday, March 12, 2019 5:31 PM
> *To:* Kuehling, Felix
> *Cc:* Tom St Denis; amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
> *Subject:* Re: Slow memory access when using OpenCL without X11
>
> However it's not only related to mclk and sclk. I tried this:
> rocm-smi  --setsclk 2
> rocm-smi  --setmclk 3
> rocm-smi
> ========================        ROCm System Management Interface
> ========================
>
> ================================================================================================
> GPU   Temp   AvgPwr   SCLK    MCLK    PCLK           Fan     Perf
> PwrCap   SCLK OD   MCLK OD  GPU%
> GPU[0] : WARNING: Empty SysFS value: pclk
> GPU[0] : WARNING: Unable to read
> /sys/class/drm/card0/device/gpu_busy_percent
> 0     34.0c  N/A      1240Mhz 1333Mhz N/A            0%      manual  N/A
>     0%        0%       N/A
>
> ================================================================================================
> ========================               End of ROCm SMI Log
> ========================
>
> ./cl_slow_test 1
> got 1 platforms 1 devices
> speed 3919.777100 avg 3919.777100 mbytes/s
> speed 3809.373291 avg 3864.575195 mbytes/s
> speed 585.796814 avg 2771.649170 mbytes/s
> speed 188.721848 avg 2125.917236 mbytes/s
> speed 188.916367 avg 1738.517090 mbytes/s
>
> So despite forcing max sclk and mclk the memory speed is still slow..
>
> --
> Lauri
>
>
> On Tue, Mar 12, 2019 at 11:21 PM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
> wrote:
>
> IN the case when memory is slow, the rocm-smi outputs this:
> ========================        ROCm System Management Interface
> ========================
>
> ================================================================================================
> GPU   Temp   AvgPwr   SCLK    MCLK    PCLK           Fan     Perf
> PwrCap   SCLK OD   MCLK OD  GPU%
> GPU[0] : WARNING: Empty SysFS value: pclk
> GPU[0] : WARNING: Unable to read
> /sys/class/drm/card0/device/gpu_busy_percent
> 0     30.0c  N/A      400Mhz  933Mhz  N/A            0%      auto    N/A
>     0%        0%       N/A
>
> ================================================================================================
> ========================               End of ROCm SMI Log
> ========================
>
> normal memory speed case gives following:
> ========================        ROCm System Management Interface
> ========================
>
> ================================================================================================
> GPU   Temp   AvgPwr   SCLK    MCLK    PCLK           Fan     Perf
> PwrCap   SCLK OD   MCLK OD  GPU%
> GPU[0] : WARNING: Empty SysFS value: pclk
> GPU[0] : WARNING: Unable to read
> /sys/class/drm/card0/device/gpu_busy_percent
> 0     35.0c  N/A      400Mhz  1200Mhz N/A            0%      auto    N/A
>     0%        0%       N/A
>
> ================================================================================================
> ========================               End of ROCm SMI Log
> ========================
>
> So there is a difference in MCLK - can this cause such a huge slowdown?
>
> --
> Lauri
>
> On Tue, Mar 12, 2019 at 6:39 PM Kuehling, Felix <Felix.Kuehling-5C7GfCeVMHo@public.gmane.org>
> wrote:
>
> [adding the list back]
>
> I'd suspect a problem related to memory clock. This is an APU where
> system memory is shared with the CPU, so if the SMU changes memory
> clocks that would affect CPU memory access performance. If the problem
> only occurs when OpenCL is running, then the compute power profile could
> have an effect here.
>
> Laurie, can you monitor the clocks during your tests using rocm-smi?
>
> Regards,
>    Felix
>
> On 2019-03-11 1:15 p.m., Tom St Denis wrote:
> > Hi Lauri,
> >
> > I don't have ROCm installed locally (not on that team at AMD) but I
> > can rope in some of the KFD folk and see what they say :-).
> >
> > (in the mean time I should look into installing the ROCm stack on my
> > Ubuntu disk for experimentation...).
> >
> > Only other thing that comes to mind is some sort of stutter due to
> > power/clock gating (or gfx off/etc).  But that typically affects the
> > display/gpu side not the CPU side.
> >
> > Felix:  Any known issues with Raven and ROCm interacting over memory
> > bus performance?
> >
> > Tom
> >
> > On Mon, Mar 11, 2019 at 12:56 PM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
> > <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>> wrote:
> >
> >     Hi!
> >
> >     The 100x memory slowdown is hard to belive indeed. I attached the
> >     test program with my first e-mail which depends only on
> >     rocm-opencl-dev package. Would you mind compiling it and checking
> >     if it slows down memory for you as well?
> >
> >     steps:
> >     1) g++ cl_slow_test.cpp -o cl_slow_test -I
> >     /opt/rocm/opencl/include/ -L /opt/rocm/opencl/lib/x86_64/  -lOpenCL
> >     2) logout from desktop env and disconnect hdmi/diplayport etc
> >     3) log in over ssh
> >     4) run the program ./cl_slow_test 1
> >
> >     For me it reproduced even without step 2 as well but less
> >     reliably. moving mouse for example could make the memory speed
> >     fast again.
> >
> >     --
> >     Lauri
> >
> >
> >
> >     On Mon, Mar 11, 2019 at 6:33 PM Tom St Denis <tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
> >     <mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>> wrote:
> >
> >         Hi Lauri,
> >
> >         There's really no connection between the two other than they
> >         run in the same package.  I too run a 2400G (as my
> >         workstation) and I got the same ~6.6GB/sec transfer rate but
> >         without a CL app running ...  The only logical reason is your
> >         CL app is bottlenecking the APUs memory bus but you claim
> >         "simply opening a context is enough" so something else is
> >         going on.
> >
> >         Your last reply though says "with it running in the
> >         background" so it's entirely possible the CPU isn't busy but
> >         the package memory controller (shared between both the CPU and
> >         GPU) is busy.  For instance running xonotic in a 1080p window
> >         on my 4K display reduced the memory test to 5.8GB/sec and
> >         that's hardly a heavy memory bound GPU app.
> >
> >         The only other possible connection is the GPU is generating so
> >         much heat that it's throttling the package which is also
> >         unlikely if you have a proper HSF attached (I use the ones
> >         that came in the retail boxes).
> >
> >         Cheers,
> >         Tom
> >
>
>

[-- Attachment #1.2: Type: text/html, Size: 14131 bytes --]

[-- Attachment #2: Type: text/plain, Size: 153 bytes --]

_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]                                         ` <CAGyaPbBAxjGGHA6sxzvSqagLVhiHBDmmp3Oz0==SRhUao488ng-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2019-03-13 18:51                                           ` Kuehling, Felix
       [not found]                                             ` <8502a6bb-26b2-bd5e-c073-8e4e4405d3e2-5C7GfCeVMHo@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Kuehling, Felix @ 2019-03-13 18:51 UTC (permalink / raw)
  To: Lauri Ehrenpreis, Deucher, Alexander
  Cc: Tom St Denis, amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW

Hi Lauri,

I still think the SMU is doing something funny, but rocm-smi isn't 
showing enough information to really see what's going on.

On APUs the SMU firmware is embedded in the system BIOS. Unlike discrete 
GPUs, the SMU firmware is not loaded by the driver. You could try 
updating your system BIOS to the latest version available from your main 
board vendor and see if that makes a difference. It may include a newer 
version of the SMU firmware, potentially with a fix.

If that doesn't help, we'd have to reproduce the problem in house to see 
what's happening, which may require the same main board and BIOS version 
you're using. We can ask our SMU firmware team if they've ever 
encountered your type of problem. But I don't want to give you too much 
hope. It's a tricky problem involving HW, firmware and multiple driver 
components in a fairly unusual configuration.

Regards,
   Felix

On 2019-03-13 7:28 a.m., Lauri Ehrenpreis wrote:
> What I observe is that moving the mouse made the memory speed go up 
> and also it made mclk=1200Mhz in rocm-smi output.
> However if I force mclk to 1200Mhz myself then memory speed is still 
> slow.
>
> So rocm-smi output when memory speed went fast due to mouse movement:
> rocm-smi
> ========================        ROCm System Management Interface 
> ========================
> ================================================================================================
> GPU   Temp   AvgPwr   SCLK    MCLK    PCLK      Fan     Perf    
> PwrCap   SCLK OD   MCLK OD GPU%
> GPU[0] : WARNING: Empty SysFS value: pclk
> GPU[0] : WARNING: Unable to read 
> /sys/class/drm/card0/device/gpu_busy_percent
> 0     44.0c  N/A      400Mhz  1200Mhz N/A       0%      manual  N/A    
>   0%        0%  N/A
> ================================================================================================
> ========================               End of ROCm SMI Log            
>   ========================
>
> And rocm-smi output when I forced memclk=1200MHz myself:
> rocm-smi --setmclk 2
> rocm-smi
> ========================        ROCm System Management Interface 
> ========================
> ================================================================================================
> GPU   Temp   AvgPwr   SCLK    MCLK    PCLK      Fan     Perf    
> PwrCap   SCLK OD   MCLK OD GPU%
> GPU[0] : WARNING: Empty SysFS value: pclk
> GPU[0] : WARNING: Unable to read 
> /sys/class/drm/card0/device/gpu_busy_percent
> 0     39.0c  N/A      400Mhz  1200Mhz N/A       0%      manual  N/A    
>   0%        0%  N/A
> ================================================================================================
> ========================               End of ROCm SMI Log            
>   ========================
>
> So only difference is that temperature shows 44c when memory speed was 
> fast and 39c when it was slow. But mclk was 1200MHz and sclk was 
> 400MHz in both cases.
> Can it be that rocm-smi just has a bug in reporting and mclk was not 
> actually 1200MHz when I forced it with rocm-smi --setmclk 2 ?
> That would explain the different behaviour..
>
> If so then is there a programmatic way how to really guarantee the 
> high speed mclk? Basically I want do something similar in my program 
> what happens if I move
> the mouse in desktop env and this way guarantee the normal memory 
> speed each time the program starts.
>
> --
> Lauri
>
>
> On Tue, Mar 12, 2019 at 11:36 PM Deucher, Alexander 
> <Alexander.Deucher@amd.com <mailto:Alexander.Deucher@amd.com>> wrote:
>
>     Forcing the sclk and mclk high may impact the CPU frequency since
>     they share TDP.
>
>     Alex
>     ------------------------------------------------------------------------
>     *From:* amd-gfx <amd-gfx-bounces@lists.freedesktop.org
>     <mailto:amd-gfx-bounces@lists.freedesktop.org>> on behalf of Lauri
>     Ehrenpreis <laurioma@gmail.com <mailto:laurioma@gmail.com>>
>     *Sent:* Tuesday, March 12, 2019 5:31 PM
>     *To:* Kuehling, Felix
>     *Cc:* Tom St Denis; amd-gfx@lists.freedesktop.org
>     <mailto:amd-gfx@lists.freedesktop.org>
>     *Subject:* Re: Slow memory access when using OpenCL without X11
>     However it's not only related to mclk and sclk. I tried this:
>     rocm-smi  --setsclk 2
>     rocm-smi  --setmclk 3
>     rocm-smi
>     ========================        ROCm System Management Interface
>     ========================
>     ================================================================================================
>     GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan     Perf 
>       PwrCap   SCLK OD  MCLK OD  GPU%
>     GPU[0] : WARNING: Empty SysFS value: pclk
>     GPU[0] : WARNING: Unable to read
>     /sys/class/drm/card0/device/gpu_busy_percent
>     0     34.0c  N/A      1240Mhz 1333Mhz N/A           0%     
>     manual  N/A      0% 0%       N/A
>     ================================================================================================
>     ========================               End of ROCm SMI Log
>     ========================
>
>     ./cl_slow_test 1
>     got 1 platforms 1 devices
>     speed 3919.777100 avg 3919.777100 mbytes/s
>     speed 3809.373291 avg 3864.575195 mbytes/s
>     speed 585.796814 avg 2771.649170 mbytes/s
>     speed 188.721848 avg 2125.917236 mbytes/s
>     speed 188.916367 avg 1738.517090 mbytes/s
>
>     So despite forcing max sclk and mclk the memory speed is still slow..
>
>     --
>     Lauri
>
>
>     On Tue, Mar 12, 2019 at 11:21 PM Lauri Ehrenpreis
>     <laurioma@gmail.com <mailto:laurioma@gmail.com>> wrote:
>
>         IN the case when memory is slow, the rocm-smi outputs this:
>         ========================        ROCm System Management
>         Interface ========================
>         ================================================================================================
>         GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan   
>          Perf    PwrCap   SCLK OD  MCLK OD  GPU%
>         GPU[0] : WARNING: Empty SysFS value: pclk
>         GPU[0] : WARNING: Unable to read
>         /sys/class/drm/card0/device/gpu_busy_percent
>         0     30.0c  N/A      400Mhz  933Mhz  N/A           0%     
>         auto    N/A      0% 0%       N/A
>         ================================================================================================
>         ========================               End of ROCm SMI Log
>         ========================
>
>         normal memory speed case gives following:
>         ========================        ROCm System Management
>         Interface ========================
>         ================================================================================================
>         GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan   
>          Perf    PwrCap   SCLK OD  MCLK OD  GPU%
>         GPU[0] : WARNING: Empty SysFS value: pclk
>         GPU[0] : WARNING: Unable to read
>         /sys/class/drm/card0/device/gpu_busy_percent
>         0     35.0c  N/A      400Mhz  1200Mhz N/A           0%     
>         auto    N/A      0% 0%       N/A
>         ================================================================================================
>         ========================               End of ROCm SMI Log
>         ========================
>
>         So there is a difference in MCLK - can this cause such a huge
>         slowdown?
>
>         --
>         Lauri
>
>         On Tue, Mar 12, 2019 at 6:39 PM Kuehling, Felix
>         <Felix.Kuehling@amd.com <mailto:Felix.Kuehling@amd.com>> wrote:
>
>             [adding the list back]
>
>             I'd suspect a problem related to memory clock. This is an
>             APU where
>             system memory is shared with the CPU, so if the SMU
>             changes memory
>             clocks that would affect CPU memory access performance. If
>             the problem
>             only occurs when OpenCL is running, then the compute power
>             profile could
>             have an effect here.
>
>             Laurie, can you monitor the clocks during your tests using
>             rocm-smi?
>
>             Regards,
>                Felix
>
>             On 2019-03-11 1:15 p.m., Tom St Denis wrote:
>             > Hi Lauri,
>             >
>             > I don't have ROCm installed locally (not on that team at
>             AMD) but I
>             > can rope in some of the KFD folk and see what they say :-).
>             >
>             > (in the mean time I should look into installing the ROCm
>             stack on my
>             > Ubuntu disk for experimentation...).
>             >
>             > Only other thing that comes to mind is some sort of
>             stutter due to
>             > power/clock gating (or gfx off/etc).  But that typically
>             affects the
>             > display/gpu side not the CPU side.
>             >
>             > Felix:  Any known issues with Raven and ROCm interacting
>             over memory
>             > bus performance?
>             >
>             > Tom
>             >
>             > On Mon, Mar 11, 2019 at 12:56 PM Lauri Ehrenpreis
>             <laurioma@gmail.com <mailto:laurioma@gmail.com>
>             > <mailto:laurioma@gmail.com <mailto:laurioma@gmail.com>>>
>             wrote:
>             >
>             >     Hi!
>             >
>             >     The 100x memory slowdown is hard to belive indeed. I
>             attached the
>             >     test program with my first e-mail which depends only on
>             >     rocm-opencl-dev package. Would you mind compiling it
>             and checking
>             >     if it slows down memory for you as well?
>             >
>             >     steps:
>             >     1) g++ cl_slow_test.cpp -o cl_slow_test -I
>             >     /opt/rocm/opencl/include/ -L
>             /opt/rocm/opencl/lib/x86_64/  -lOpenCL
>             >     2) logout from desktop env and disconnect
>             hdmi/diplayport etc
>             >     3) log in over ssh
>             >     4) run the program ./cl_slow_test 1
>             >
>             >     For me it reproduced even without step 2 as well but
>             less
>             >     reliably. moving mouse for example could make the
>             memory speed
>             >     fast again.
>             >
>             >     --
>             >     Lauri
>             >
>             >
>             >
>             >     On Mon, Mar 11, 2019 at 6:33 PM Tom St Denis
>             <tstdenis82@gmail.com <mailto:tstdenis82@gmail.com>
>             >     <mailto:tstdenis82@gmail.com
>             <mailto:tstdenis82@gmail.com>>> wrote:
>             >
>             >         Hi Lauri,
>             >
>             >         There's really no connection between the two
>             other than they
>             >         run in the same package.  I too run a 2400G (as my
>             >         workstation) and I got the same ~6.6GB/sec
>             transfer rate but
>             >         without a CL app running ...  The only logical
>             reason is your
>             >         CL app is bottlenecking the APUs memory bus but
>             you claim
>             >         "simply opening a context is enough" so
>             something else is
>             >         going on.
>             >
>             >         Your last reply though says "with it running in the
>             >         background" so it's entirely possible the CPU
>             isn't busy but
>             >         the package memory controller (shared between
>             both the CPU and
>             >         GPU) is busy.  For instance running xonotic in a
>             1080p window
>             >         on my 4K display reduced the memory test to
>             5.8GB/sec and
>             >         that's hardly a heavy memory bound GPU app.
>             >
>             >         The only other possible connection is the GPU is
>             generating so
>             >         much heat that it's throttling the package which
>             is also
>             >         unlikely if you have a proper HSF attached (I
>             use the ones
>             >         that came in the retail boxes).
>             >
>             >         Cheers,
>             >         Tom
>             >
>
_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]                                             ` <8502a6bb-26b2-bd5e-c073-8e4e4405d3e2-5C7GfCeVMHo@public.gmane.org>
@ 2019-03-13 20:15                                               ` Lauri Ehrenpreis
       [not found]                                                 ` <CAGyaPbCTM8YoCuJQdD1JkDiA5FkpnMhLkQcb8Lpr8k0KYwLUWQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Lauri Ehrenpreis @ 2019-03-13 20:15 UTC (permalink / raw)
  To: Kuehling, Felix
  Cc: Deucher, Alexander, Tom St Denis,
	amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW


[-- Attachment #1.1: Type: text/plain, Size: 14449 bytes --]

For reproduction only the tiny cl_slow_test.cpp is needed which is attached
to first e-mail.

System information is following:
CPU: Ryzen5 2400G
Main board: Gigabyte AMD B450 AORUS mini itx:
https://www.gigabyte.com/Motherboard/B450-I-AORUS-PRO-WIFI-rev-10#kf
BIOS: F5 8.47 MB 2019/01/25 (latest)
Kernel: https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.0/  (amd64)
OS: Ubuntu 18.04 LTS
rocm-opencl-dev installation:
wget -qO - http://repo.radeon.com/rocm/apt/debian/rocm.gpg.key | sudo
apt-key add -
echo 'deb [arch=amd64] http://repo.radeon.com/rocm/apt/debian/ xenial main'
| sudo tee /etc/apt/sources.list.d/rocm.list
sudo apt install rocm-opencl-dev

Also exactly the same issue happens with this board:
https://www.gigabyte.com/Motherboard/GA-AB350-Gaming-3-rev-1x#kf

I have MSI and Asrock mini itx boards ready as well, So far didn't get
amdgpu & opencl working there but I'll try again tomorrow..

--
Lauri


On Wed, Mar 13, 2019 at 8:51 PM Kuehling, Felix <Felix.Kuehling-5C7GfCeVMHo@public.gmane.org>
wrote:

> Hi Lauri,
>
> I still think the SMU is doing something funny, but rocm-smi isn't
> showing enough information to really see what's going on.
>
> On APUs the SMU firmware is embedded in the system BIOS. Unlike discrete
> GPUs, the SMU firmware is not loaded by the driver. You could try
> updating your system BIOS to the latest version available from your main
> board vendor and see if that makes a difference. It may include a newer
> version of the SMU firmware, potentially with a fix.
>
> If that doesn't help, we'd have to reproduce the problem in house to see
> what's happening, which may require the same main board and BIOS version
> you're using. We can ask our SMU firmware team if they've ever
> encountered your type of problem. But I don't want to give you too much
> hope. It's a tricky problem involving HW, firmware and multiple driver
> components in a fairly unusual configuration.
>
> Regards,
>    Felix
>
> On 2019-03-13 7:28 a.m., Lauri Ehrenpreis wrote:
> > What I observe is that moving the mouse made the memory speed go up
> > and also it made mclk=1200Mhz in rocm-smi output.
> > However if I force mclk to 1200Mhz myself then memory speed is still
> > slow.
> >
> > So rocm-smi output when memory speed went fast due to mouse movement:
> > rocm-smi
> > ========================        ROCm System Management Interface
> > ========================
> >
> ================================================================================================
> > GPU   Temp   AvgPwr   SCLK    MCLK    PCLK      Fan     Perf
> > PwrCap   SCLK OD   MCLK OD GPU%
> > GPU[0] : WARNING: Empty SysFS value: pclk
> > GPU[0] : WARNING: Unable to read
> > /sys/class/drm/card0/device/gpu_busy_percent
> > 0     44.0c  N/A      400Mhz  1200Mhz N/A       0%      manual  N/A
> >   0%        0%  N/A
> >
> ================================================================================================
> > ========================               End of ROCm SMI Log
> >   ========================
> >
> > And rocm-smi output when I forced memclk=1200MHz myself:
> > rocm-smi --setmclk 2
> > rocm-smi
> > ========================        ROCm System Management Interface
> > ========================
> >
> ================================================================================================
> > GPU   Temp   AvgPwr   SCLK    MCLK    PCLK      Fan     Perf
> > PwrCap   SCLK OD   MCLK OD GPU%
> > GPU[0] : WARNING: Empty SysFS value: pclk
> > GPU[0] : WARNING: Unable to read
> > /sys/class/drm/card0/device/gpu_busy_percent
> > 0     39.0c  N/A      400Mhz  1200Mhz N/A       0%      manual  N/A
> >   0%        0%  N/A
> >
> ================================================================================================
> > ========================               End of ROCm SMI Log
> >   ========================
> >
> > So only difference is that temperature shows 44c when memory speed was
> > fast and 39c when it was slow. But mclk was 1200MHz and sclk was
> > 400MHz in both cases.
> > Can it be that rocm-smi just has a bug in reporting and mclk was not
> > actually 1200MHz when I forced it with rocm-smi --setmclk 2 ?
> > That would explain the different behaviour..
> >
> > If so then is there a programmatic way how to really guarantee the
> > high speed mclk? Basically I want do something similar in my program
> > what happens if I move
> > the mouse in desktop env and this way guarantee the normal memory
> > speed each time the program starts.
> >
> > --
> > Lauri
> >
> >
> > On Tue, Mar 12, 2019 at 11:36 PM Deucher, Alexander
> > <Alexander.Deucher-5C7GfCeVMHo@public.gmane.org <mailto:Alexander.Deucher-5C7GfCeVMHo@public.gmane.org>> wrote:
> >
> >     Forcing the sclk and mclk high may impact the CPU frequency since
> >     they share TDP.
> >
> >     Alex
> >
>  ------------------------------------------------------------------------
> >     *From:* amd-gfx <amd-gfx-bounces-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
> >     <mailto:amd-gfx-bounces-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org>> on behalf of Lauri
> >     Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>>
> >     *Sent:* Tuesday, March 12, 2019 5:31 PM
> >     *To:* Kuehling, Felix
> >     *Cc:* Tom St Denis; amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
> >     <mailto:amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org>
> >     *Subject:* Re: Slow memory access when using OpenCL without X11
> >     However it's not only related to mclk and sclk. I tried this:
> >     rocm-smi  --setsclk 2
> >     rocm-smi  --setmclk 3
> >     rocm-smi
> >     ========================        ROCm System Management Interface
> >     ========================
> >
>  ================================================================================================
> >     GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan     Perf
> >       PwrCap   SCLK OD  MCLK OD  GPU%
> >     GPU[0] : WARNING: Empty SysFS value: pclk
> >     GPU[0] : WARNING: Unable to read
> >     /sys/class/drm/card0/device/gpu_busy_percent
> >     0     34.0c  N/A      1240Mhz 1333Mhz N/A           0%
> >     manual  N/A      0% 0%       N/A
> >
>  ================================================================================================
> >     ========================               End of ROCm SMI Log
> >     ========================
> >
> >     ./cl_slow_test 1
> >     got 1 platforms 1 devices
> >     speed 3919.777100 avg 3919.777100 mbytes/s
> >     speed 3809.373291 avg 3864.575195 mbytes/s
> >     speed 585.796814 avg 2771.649170 mbytes/s
> >     speed 188.721848 avg 2125.917236 mbytes/s
> >     speed 188.916367 avg 1738.517090 mbytes/s
> >
> >     So despite forcing max sclk and mclk the memory speed is still slow..
> >
> >     --
> >     Lauri
> >
> >
> >     On Tue, Mar 12, 2019 at 11:21 PM Lauri Ehrenpreis
> >     <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>> wrote:
> >
> >         IN the case when memory is slow, the rocm-smi outputs this:
> >         ========================        ROCm System Management
> >         Interface ========================
> >
>  ================================================================================================
> >         GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan
> >          Perf    PwrCap   SCLK OD  MCLK OD  GPU%
> >         GPU[0] : WARNING: Empty SysFS value: pclk
> >         GPU[0] : WARNING: Unable to read
> >         /sys/class/drm/card0/device/gpu_busy_percent
> >         0     30.0c  N/A      400Mhz  933Mhz  N/A           0%
> >         auto    N/A      0% 0%       N/A
> >
>  ================================================================================================
> >         ========================               End of ROCm SMI Log
> >         ========================
> >
> >         normal memory speed case gives following:
> >         ========================        ROCm System Management
> >         Interface ========================
> >
>  ================================================================================================
> >         GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan
> >          Perf    PwrCap   SCLK OD  MCLK OD  GPU%
> >         GPU[0] : WARNING: Empty SysFS value: pclk
> >         GPU[0] : WARNING: Unable to read
> >         /sys/class/drm/card0/device/gpu_busy_percent
> >         0     35.0c  N/A      400Mhz  1200Mhz N/A           0%
> >         auto    N/A      0% 0%       N/A
> >
>  ================================================================================================
> >         ========================               End of ROCm SMI Log
> >         ========================
> >
> >         So there is a difference in MCLK - can this cause such a huge
> >         slowdown?
> >
> >         --
> >         Lauri
> >
> >         On Tue, Mar 12, 2019 at 6:39 PM Kuehling, Felix
> >         <Felix.Kuehling-5C7GfCeVMHo@public.gmane.org <mailto:Felix.Kuehling-5C7GfCeVMHo@public.gmane.org>> wrote:
> >
> >             [adding the list back]
> >
> >             I'd suspect a problem related to memory clock. This is an
> >             APU where
> >             system memory is shared with the CPU, so if the SMU
> >             changes memory
> >             clocks that would affect CPU memory access performance. If
> >             the problem
> >             only occurs when OpenCL is running, then the compute power
> >             profile could
> >             have an effect here.
> >
> >             Laurie, can you monitor the clocks during your tests using
> >             rocm-smi?
> >
> >             Regards,
> >                Felix
> >
> >             On 2019-03-11 1:15 p.m., Tom St Denis wrote:
> >             > Hi Lauri,
> >             >
> >             > I don't have ROCm installed locally (not on that team at
> >             AMD) but I
> >             > can rope in some of the KFD folk and see what they say :-).
> >             >
> >             > (in the mean time I should look into installing the ROCm
> >             stack on my
> >             > Ubuntu disk for experimentation...).
> >             >
> >             > Only other thing that comes to mind is some sort of
> >             stutter due to
> >             > power/clock gating (or gfx off/etc).  But that typically
> >             affects the
> >             > display/gpu side not the CPU side.
> >             >
> >             > Felix:  Any known issues with Raven and ROCm interacting
> >             over memory
> >             > bus performance?
> >             >
> >             > Tom
> >             >
> >             > On Mon, Mar 11, 2019 at 12:56 PM Lauri Ehrenpreis
> >             <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
> >             > <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>>>
> >             wrote:
> >             >
> >             >     Hi!
> >             >
> >             >     The 100x memory slowdown is hard to belive indeed. I
> >             attached the
> >             >     test program with my first e-mail which depends only on
> >             >     rocm-opencl-dev package. Would you mind compiling it
> >             and checking
> >             >     if it slows down memory for you as well?
> >             >
> >             >     steps:
> >             >     1) g++ cl_slow_test.cpp -o cl_slow_test -I
> >             >     /opt/rocm/opencl/include/ -L
> >             /opt/rocm/opencl/lib/x86_64/  -lOpenCL
> >             >     2) logout from desktop env and disconnect
> >             hdmi/diplayport etc
> >             >     3) log in over ssh
> >             >     4) run the program ./cl_slow_test 1
> >             >
> >             >     For me it reproduced even without step 2 as well but
> >             less
> >             >     reliably. moving mouse for example could make the
> >             memory speed
> >             >     fast again.
> >             >
> >             >     --
> >             >     Lauri
> >             >
> >             >
> >             >
> >             >     On Mon, Mar 11, 2019 at 6:33 PM Tom St Denis
> >             <tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
> >             >     <mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
> >             <mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>>> wrote:
> >             >
> >             >         Hi Lauri,
> >             >
> >             >         There's really no connection between the two
> >             other than they
> >             >         run in the same package.  I too run a 2400G (as my
> >             >         workstation) and I got the same ~6.6GB/sec
> >             transfer rate but
> >             >         without a CL app running ...  The only logical
> >             reason is your
> >             >         CL app is bottlenecking the APUs memory bus but
> >             you claim
> >             >         "simply opening a context is enough" so
> >             something else is
> >             >         going on.
> >             >
> >             >         Your last reply though says "with it running in the
> >             >         background" so it's entirely possible the CPU
> >             isn't busy but
> >             >         the package memory controller (shared between
> >             both the CPU and
> >             >         GPU) is busy.  For instance running xonotic in a
> >             1080p window
> >             >         on my 4K display reduced the memory test to
> >             5.8GB/sec and
> >             >         that's hardly a heavy memory bound GPU app.
> >             >
> >             >         The only other possible connection is the GPU is
> >             generating so
> >             >         much heat that it's throttling the package which
> >             is also
> >             >         unlikely if you have a proper HSF attached (I
> >             use the ones
> >             >         that came in the retail boxes).
> >             >
> >             >         Cheers,
> >             >         Tom
> >             >
> >
>

[-- Attachment #1.2: Type: text/html, Size: 19904 bytes --]

[-- Attachment #2: Type: text/plain, Size: 153 bytes --]

_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]                                                 ` <CAGyaPbCTM8YoCuJQdD1JkDiA5FkpnMhLkQcb8Lpr8k0KYwLUWQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2019-03-14 13:30                                                   ` Lauri Ehrenpreis
       [not found]                                                     ` <CAGyaPbBwk9CZaMgrrB3edgJLDJq8djfETUBnhkZKg0+rza+Y5Q-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Lauri Ehrenpreis @ 2019-03-14 13:30 UTC (permalink / raw)
  To: Kuehling, Felix
  Cc: Deucher, Alexander, Tom St Denis,
	amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW


[-- Attachment #1.1: Type: text/plain, Size: 15766 bytes --]

I tried also with those 2 boards now:
https://www.asrock.com/MB/AMD/Fatal1ty%20B450%20Gaming-ITXac/index.asp
https://www.msi.com/Motherboard/B450I-GAMING-PLUS-AC

Both are using latest BIOS, ubuntu 18.10, kernel
https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.0.2/

There are some differences in dmesg (asrock has some amdgpu assert in
dmesg) but otherwise results are exactly the same.
In desktop env cl_slow_test works fast, over ssh terminal it doesn't. If i
move mouse then it starts working fast in terminal as well.

So one can't use OpenCL without monitor and desktop env running and this
happens with 2 different chipsets (b350 & b450), latest bios from 3
different vendors, latest kernel and latest rocm. This doesn't look like
edge case with unusual setup to me..

Attached dmesg, dmidecode, and clinfo from both boards.

--
Lauri

On Wed, Mar 13, 2019 at 10:15 PM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
wrote:

> For reproduction only the tiny cl_slow_test.cpp is needed which is
> attached to first e-mail.
>
> System information is following:
> CPU: Ryzen5 2400G
> Main board: Gigabyte AMD B450 AORUS mini itx:
> https://www.gigabyte.com/Motherboard/B450-I-AORUS-PRO-WIFI-rev-10#kf
> BIOS: F5 8.47 MB 2019/01/25 (latest)
> Kernel: https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.0/  (amd64)
> OS: Ubuntu 18.04 LTS
> rocm-opencl-dev installation:
> wget -qO - http://repo.radeon.com/rocm/apt/debian/rocm.gpg.key | sudo
> apt-key add -
> echo 'deb [arch=amd64] http://repo.radeon.com/rocm/apt/debian/ xenial
> main' | sudo tee /etc/apt/sources.list.d/rocm.list
> sudo apt install rocm-opencl-dev
>
> Also exactly the same issue happens with this board:
> https://www.gigabyte.com/Motherboard/GA-AB350-Gaming-3-rev-1x#kf
>
> I have MSI and Asrock mini itx boards ready as well, So far didn't get
> amdgpu & opencl working there but I'll try again tomorrow..
>
> --
> Lauri
>
>
> On Wed, Mar 13, 2019 at 8:51 PM Kuehling, Felix <Felix.Kuehling-5C7GfCeVMHo@public.gmane.org>
> wrote:
>
>> Hi Lauri,
>>
>> I still think the SMU is doing something funny, but rocm-smi isn't
>> showing enough information to really see what's going on.
>>
>> On APUs the SMU firmware is embedded in the system BIOS. Unlike discrete
>> GPUs, the SMU firmware is not loaded by the driver. You could try
>> updating your system BIOS to the latest version available from your main
>> board vendor and see if that makes a difference. It may include a newer
>> version of the SMU firmware, potentially with a fix.
>>
>> If that doesn't help, we'd have to reproduce the problem in house to see
>> what's happening, which may require the same main board and BIOS version
>> you're using. We can ask our SMU firmware team if they've ever
>> encountered your type of problem. But I don't want to give you too much
>> hope. It's a tricky problem involving HW, firmware and multiple driver
>> components in a fairly unusual configuration.
>>
>> Regards,
>>    Felix
>>
>> On 2019-03-13 7:28 a.m., Lauri Ehrenpreis wrote:
>> > What I observe is that moving the mouse made the memory speed go up
>> > and also it made mclk=1200Mhz in rocm-smi output.
>> > However if I force mclk to 1200Mhz myself then memory speed is still
>> > slow.
>> >
>> > So rocm-smi output when memory speed went fast due to mouse movement:
>> > rocm-smi
>> > ========================        ROCm System Management Interface
>> > ========================
>> >
>> ================================================================================================
>> > GPU   Temp   AvgPwr   SCLK    MCLK    PCLK      Fan     Perf
>> > PwrCap   SCLK OD   MCLK OD GPU%
>> > GPU[0] : WARNING: Empty SysFS value: pclk
>> > GPU[0] : WARNING: Unable to read
>> > /sys/class/drm/card0/device/gpu_busy_percent
>> > 0     44.0c  N/A      400Mhz  1200Mhz N/A       0%      manual  N/A
>> >   0%        0%  N/A
>> >
>> ================================================================================================
>> > ========================               End of ROCm SMI Log
>> >   ========================
>> >
>> > And rocm-smi output when I forced memclk=1200MHz myself:
>> > rocm-smi --setmclk 2
>> > rocm-smi
>> > ========================        ROCm System Management Interface
>> > ========================
>> >
>> ================================================================================================
>> > GPU   Temp   AvgPwr   SCLK    MCLK    PCLK      Fan     Perf
>> > PwrCap   SCLK OD   MCLK OD GPU%
>> > GPU[0] : WARNING: Empty SysFS value: pclk
>> > GPU[0] : WARNING: Unable to read
>> > /sys/class/drm/card0/device/gpu_busy_percent
>> > 0     39.0c  N/A      400Mhz  1200Mhz N/A       0%      manual  N/A
>> >   0%        0%  N/A
>> >
>> ================================================================================================
>> > ========================               End of ROCm SMI Log
>> >   ========================
>> >
>> > So only difference is that temperature shows 44c when memory speed was
>> > fast and 39c when it was slow. But mclk was 1200MHz and sclk was
>> > 400MHz in both cases.
>> > Can it be that rocm-smi just has a bug in reporting and mclk was not
>> > actually 1200MHz when I forced it with rocm-smi --setmclk 2 ?
>> > That would explain the different behaviour..
>> >
>> > If so then is there a programmatic way how to really guarantee the
>> > high speed mclk? Basically I want do something similar in my program
>> > what happens if I move
>> > the mouse in desktop env and this way guarantee the normal memory
>> > speed each time the program starts.
>> >
>> > --
>> > Lauri
>> >
>> >
>> > On Tue, Mar 12, 2019 at 11:36 PM Deucher, Alexander
>> > <Alexander.Deucher-5C7GfCeVMHo@public.gmane.org <mailto:Alexander.Deucher-5C7GfCeVMHo@public.gmane.org>> wrote:
>> >
>> >     Forcing the sclk and mclk high may impact the CPU frequency since
>> >     they share TDP.
>> >
>> >     Alex
>> >
>>  ------------------------------------------------------------------------
>> >     *From:* amd-gfx <amd-gfx-bounces-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
>> >     <mailto:amd-gfx-bounces-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org>> on behalf of Lauri
>> >     Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>>
>> >     *Sent:* Tuesday, March 12, 2019 5:31 PM
>> >     *To:* Kuehling, Felix
>> >     *Cc:* Tom St Denis; amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
>> >     <mailto:amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org>
>> >     *Subject:* Re: Slow memory access when using OpenCL without X11
>> >     However it's not only related to mclk and sclk. I tried this:
>> >     rocm-smi  --setsclk 2
>> >     rocm-smi  --setmclk 3
>> >     rocm-smi
>> >     ========================        ROCm System Management Interface
>> >     ========================
>> >
>>  ================================================================================================
>> >     GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan     Perf
>> >       PwrCap   SCLK OD  MCLK OD  GPU%
>> >     GPU[0] : WARNING: Empty SysFS value: pclk
>> >     GPU[0] : WARNING: Unable to read
>> >     /sys/class/drm/card0/device/gpu_busy_percent
>> >     0     34.0c  N/A      1240Mhz 1333Mhz N/A           0%
>> >     manual  N/A      0% 0%       N/A
>> >
>>  ================================================================================================
>> >     ========================               End of ROCm SMI Log
>> >     ========================
>> >
>> >     ./cl_slow_test 1
>> >     got 1 platforms 1 devices
>> >     speed 3919.777100 avg 3919.777100 mbytes/s
>> >     speed 3809.373291 avg 3864.575195 mbytes/s
>> >     speed 585.796814 avg 2771.649170 mbytes/s
>> >     speed 188.721848 avg 2125.917236 mbytes/s
>> >     speed 188.916367 avg 1738.517090 mbytes/s
>> >
>> >     So despite forcing max sclk and mclk the memory speed is still
>> slow..
>> >
>> >     --
>> >     Lauri
>> >
>> >
>> >     On Tue, Mar 12, 2019 at 11:21 PM Lauri Ehrenpreis
>> >     <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>> wrote:
>> >
>> >         IN the case when memory is slow, the rocm-smi outputs this:
>> >         ========================        ROCm System Management
>> >         Interface ========================
>> >
>>  ================================================================================================
>> >         GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan
>> >          Perf    PwrCap   SCLK OD  MCLK OD  GPU%
>> >         GPU[0] : WARNING: Empty SysFS value: pclk
>> >         GPU[0] : WARNING: Unable to read
>> >         /sys/class/drm/card0/device/gpu_busy_percent
>> >         0     30.0c  N/A      400Mhz  933Mhz  N/A           0%
>> >         auto    N/A      0% 0%       N/A
>> >
>>  ================================================================================================
>> >         ========================               End of ROCm SMI Log
>> >         ========================
>> >
>> >         normal memory speed case gives following:
>> >         ========================        ROCm System Management
>> >         Interface ========================
>> >
>>  ================================================================================================
>> >         GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan
>> >          Perf    PwrCap   SCLK OD  MCLK OD  GPU%
>> >         GPU[0] : WARNING: Empty SysFS value: pclk
>> >         GPU[0] : WARNING: Unable to read
>> >         /sys/class/drm/card0/device/gpu_busy_percent
>> >         0     35.0c  N/A      400Mhz  1200Mhz N/A           0%
>> >         auto    N/A      0% 0%       N/A
>> >
>>  ================================================================================================
>> >         ========================               End of ROCm SMI Log
>> >         ========================
>> >
>> >         So there is a difference in MCLK - can this cause such a huge
>> >         slowdown?
>> >
>> >         --
>> >         Lauri
>> >
>> >         On Tue, Mar 12, 2019 at 6:39 PM Kuehling, Felix
>> >         <Felix.Kuehling-5C7GfCeVMHo@public.gmane.org <mailto:Felix.Kuehling-5C7GfCeVMHo@public.gmane.org>> wrote:
>> >
>> >             [adding the list back]
>> >
>> >             I'd suspect a problem related to memory clock. This is an
>> >             APU where
>> >             system memory is shared with the CPU, so if the SMU
>> >             changes memory
>> >             clocks that would affect CPU memory access performance. If
>> >             the problem
>> >             only occurs when OpenCL is running, then the compute power
>> >             profile could
>> >             have an effect here.
>> >
>> >             Laurie, can you monitor the clocks during your tests using
>> >             rocm-smi?
>> >
>> >             Regards,
>> >                Felix
>> >
>> >             On 2019-03-11 1:15 p.m., Tom St Denis wrote:
>> >             > Hi Lauri,
>> >             >
>> >             > I don't have ROCm installed locally (not on that team at
>> >             AMD) but I
>> >             > can rope in some of the KFD folk and see what they say
>> :-).
>> >             >
>> >             > (in the mean time I should look into installing the ROCm
>> >             stack on my
>> >             > Ubuntu disk for experimentation...).
>> >             >
>> >             > Only other thing that comes to mind is some sort of
>> >             stutter due to
>> >             > power/clock gating (or gfx off/etc).  But that typically
>> >             affects the
>> >             > display/gpu side not the CPU side.
>> >             >
>> >             > Felix:  Any known issues with Raven and ROCm interacting
>> >             over memory
>> >             > bus performance?
>> >             >
>> >             > Tom
>> >             >
>> >             > On Mon, Mar 11, 2019 at 12:56 PM Lauri Ehrenpreis
>> >             <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
>> >             > <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>>>
>> >             wrote:
>> >             >
>> >             >     Hi!
>> >             >
>> >             >     The 100x memory slowdown is hard to belive indeed. I
>> >             attached the
>> >             >     test program with my first e-mail which depends only
>> on
>> >             >     rocm-opencl-dev package. Would you mind compiling it
>> >             and checking
>> >             >     if it slows down memory for you as well?
>> >             >
>> >             >     steps:
>> >             >     1) g++ cl_slow_test.cpp -o cl_slow_test -I
>> >             >     /opt/rocm/opencl/include/ -L
>> >             /opt/rocm/opencl/lib/x86_64/  -lOpenCL
>> >             >     2) logout from desktop env and disconnect
>> >             hdmi/diplayport etc
>> >             >     3) log in over ssh
>> >             >     4) run the program ./cl_slow_test 1
>> >             >
>> >             >     For me it reproduced even without step 2 as well but
>> >             less
>> >             >     reliably. moving mouse for example could make the
>> >             memory speed
>> >             >     fast again.
>> >             >
>> >             >     --
>> >             >     Lauri
>> >             >
>> >             >
>> >             >
>> >             >     On Mon, Mar 11, 2019 at 6:33 PM Tom St Denis
>> >             <tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
>> >             >     <mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
>> >             <mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>>> wrote:
>> >             >
>> >             >         Hi Lauri,
>> >             >
>> >             >         There's really no connection between the two
>> >             other than they
>> >             >         run in the same package.  I too run a 2400G (as my
>> >             >         workstation) and I got the same ~6.6GB/sec
>> >             transfer rate but
>> >             >         without a CL app running ...  The only logical
>> >             reason is your
>> >             >         CL app is bottlenecking the APUs memory bus but
>> >             you claim
>> >             >         "simply opening a context is enough" so
>> >             something else is
>> >             >         going on.
>> >             >
>> >             >         Your last reply though says "with it running in
>> the
>> >             >         background" so it's entirely possible the CPU
>> >             isn't busy but
>> >             >         the package memory controller (shared between
>> >             both the CPU and
>> >             >         GPU) is busy.  For instance running xonotic in a
>> >             1080p window
>> >             >         on my 4K display reduced the memory test to
>> >             5.8GB/sec and
>> >             >         that's hardly a heavy memory bound GPU app.
>> >             >
>> >             >         The only other possible connection is the GPU is
>> >             generating so
>> >             >         much heat that it's throttling the package which
>> >             is also
>> >             >         unlikely if you have a proper HSF attached (I
>> >             use the ones
>> >             >         that came in the retail boxes).
>> >             >
>> >             >         Cheers,
>> >             >         Tom
>> >             >
>> >
>>
>

[-- Attachment #1.2: Type: text/html, Size: 21682 bytes --]

[-- Attachment #2: clinfo_MSI_b450.txt --]
[-- Type: text/plain, Size: 4076 bytes --]

Number of platforms:				 1
  Platform Profile:				 FULL_PROFILE
  Platform Version:				 OpenCL 2.1 AMD-APP (2833.0)
  Platform Name:				 AMD Accelerated Parallel Processing
  Platform Vendor:				 Advanced Micro Devices, Inc.
  Platform Extensions:				 cl_khr_icd cl_amd_event_callback cl_amd_offline_devices 


  Platform Name:				 AMD Accelerated Parallel Processing
Number of devices:				 1
  Device Type:					 CL_DEVICE_TYPE_GPU
  Vendor ID:					 1002h
  Board name:					 AMD Ryzen 5 2400G with Radeon Vega Graphics
  Device Topology:				 PCI[ B#56, D#0, F#0 ]
  Max compute units:				 11
  Max work items dimensions:			 3
    Max work items[0]:				 1024
    Max work items[1]:				 1024
    Max work items[2]:				 1024
  Max work group size:				 256
  Preferred vector width char:			 4
  Preferred vector width short:			 2
  Preferred vector width int:			 1
  Preferred vector width long:			 1
  Preferred vector width float:			 1
  Preferred vector width double:		 1
  Native vector width char:			 4
  Native vector width short:			 2
  Native vector width int:			 1
  Native vector width long:			 1
  Native vector width float:			 1
  Native vector width double:			 1
  Max clock frequency:				 1250Mhz
  Address bits:					 64
  Max memory allocation:			 2658647244
  Image support:				 Yes
  Max number of images read arguments:		 128
  Max number of images write arguments:		 8
  Max image 2D width:				 16384
  Max image 2D height:				 16384
  Max image 3D width:				 2048
  Max image 3D height:				 2048
  Max image 3D depth:				 2048
  Max samplers within kernel:			 5597
  Max size of kernel argument:			 1024
  Alignment (bits) of base address:		 1024
  Minimum alignment (bytes) for any datatype:	 128
  Single precision floating point capability
    Denorms:					 Yes
    Quiet NaNs:					 Yes
    Round to nearest even:			 Yes
    Round to zero:				 Yes
    Round to +ve and infinity:			 Yes
    IEEE754-2008 fused multiply-add:		 Yes
  Cache type:					 Read/Write
  Cache line size:				 64
  Cache size:					 16384
  Global memory size:				 3127820288
  Constant buffer size:				 2658647244
  Max number of constant args:			 8
  Local memory type:				 Scratchpad
  Local memory size:				 65536
  Max pipe arguments:				 16
  Max pipe active reservations:			 16
  Max pipe packet size:				 2658647244
  Max global variable size:			 2658647244
  Max global variable preferred total size:	 3127820288
  Max read/write image args:			 64
  Max on device events:				 1024
  Queue on device max size:			 8388608
  Max on device queues:				 1
  Queue on device preferred size:		 262144
  SVM capabilities:				 
    Coarse grain buffer:			 Yes
    Fine grain buffer:				 Yes
    Fine grain system:				 Yes
    Atomics:					 No
  Preferred platform atomic alignment:		 0
  Preferred global atomic alignment:		 0
  Preferred local atomic alignment:		 0
  Kernel Preferred work group size multiple:	 64
  Error correction support:			 0
  Unified memory for Host and Device:		 1
  Profiling timer resolution:			 1
  Device endianess:				 Little
  Available:					 Yes
  Compiler available:				 Yes
  Execution capabilities:				 
    Execute OpenCL kernels:			 Yes
    Execute native function:			 No
  Queue on Host properties:				 
    Out-of-Order:				 No
    Profiling :					 Yes
  Queue on Device properties:				 
    Out-of-Order:				 Yes
    Profiling :					 Yes
  Platform ID:					 0x7fb7483e0f70
  Name:						 gfx902-xnack
  Vendor:					 Advanced Micro Devices, Inc.
  Device OpenCL C version:			 OpenCL C 2.0 
  Driver version:				 2833.0 (HSA1.1,LC)
  Profile:					 FULL_PROFILE
  Version:					 OpenCL 1.2 
  Extensions:					 cl_khr_fp64 cl_khr_global_int32_base_atomics cl_khr_global_int32_extended_atomics cl_khr_local_int32_base_atomics cl_khr_local_int32_extended_atomics cl_khr_int64_base_atomics cl_khr_int64_extended_atomics cl_khr_3d_image_writes cl_khr_byte_addressable_store cl_khr_fp16 cl_khr_gl_sharing cl_amd_device_attribute_query cl_amd_media_ops cl_amd_media_ops2 cl_khr_subgroups cl_khr_depth_images cl_amd_copy_buffer_p2p cl_amd_assembly_program 



[-- Attachment #3: dmesg_MSI_b450.txt --]
[-- Type: text/plain, Size: 70443 bytes --]

[    0.000000] Linux version 5.0.2-050002-generic (kernel@tangerine) (gcc version 8.3.0 (Ubuntu 8.3.0-2ubuntu2)) #201903131832 SMP Wed Mar 13 22:35:19 UTC 2019
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.0.2-050002-generic root=UUID=36c76a6c-ae79-4fae-b999-a31fdd5ece91 ro quiet splash vt.handoff=1
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Hygon HygonGenuine
[    0.000000]   Centaur CentaurHauls
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'compacted' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009ffff] usable
[    0.000000] BIOS-e820: [mem 0x00000000000a0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000009d7ffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000009d80000-0x0000000009ffffff] reserved
[    0.000000] BIOS-e820: [mem 0x000000000a000000-0x000000000a1fffff] usable
[    0.000000] BIOS-e820: [mem 0x000000000a200000-0x000000000a20afff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000000a20b000-0x000000000affffff] usable
[    0.000000] BIOS-e820: [mem 0x000000000b000000-0x000000000b01ffff] reserved
[    0.000000] BIOS-e820: [mem 0x000000000b020000-0x000000005d150fff] usable
[    0.000000] BIOS-e820: [mem 0x000000005d151000-0x000000005d26dfff] reserved
[    0.000000] BIOS-e820: [mem 0x000000005d26e000-0x000000005d3edfff] usable
[    0.000000] BIOS-e820: [mem 0x000000005d3ee000-0x000000005d7fcfff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000005d7fd000-0x000000005e637fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000005e638000-0x000000005e6d9fff] type 20
[    0.000000] BIOS-e820: [mem 0x000000005e6da000-0x000000005effffff] usable
[    0.000000] BIOS-e820: [mem 0x000000005f000000-0x00000000dfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000f8000000-0x00000000fbffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fd000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000021f33ffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] efi: EFI v2.70 by American Megatrends
[    0.000000] efi:  ACPI 2.0=0x5d779000  ACPI=0x5d779000  SMBIOS=0x5e4fe000  MEMATTR=0x5909d698  ESRT=0x5909ef98 
[    0.000000] SMBIOS 2.8 present.
[    0.000000] DMI: Micro-Star International Co., Ltd. MS-7A40/B450I GAMING PLUS AC (MS-7A40), BIOS A.60 03/06/2019
[    0.000000] tsc: Fast TSC calibration failed
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] last_pfn = 0x21f340 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF write-through
[    0.000000]   C0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 000000000000 mask FFFF80000000 write-back
[    0.000000]   1 base 000080000000 mask FFFFC0000000 write-back
[    0.000000]   2 base 0000C0000000 mask FFFFE0000000 write-back
[    0.000000]   3 disabled
[    0.000000]   4 disabled
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000] TOM2: 0000000220000000 aka 8704M
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.000000] e820: update [mem 0xe0000000-0xffffffff] usable ==> reserved
[    0.000000] last_pfn = 0x5f000 max_arch_pfn = 0x400000000
[    0.000000] esrt: Reserving ESRT space from 0x000000005909ef98 to 0x000000005909efd0.
[    0.000000] check: Scanning 1 areas for low memory corruption
[    0.000000] Base memory trampoline at [(____ptrval____)] 93000 size 24576
[    0.000000] Using GB pages for direct mapping
[    0.000000] BRK [0x10a601000, 0x10a601fff] PGTABLE
[    0.000000] BRK [0x10a602000, 0x10a602fff] PGTABLE
[    0.000000] BRK [0x10a603000, 0x10a603fff] PGTABLE
[    0.000000] BRK [0x10a604000, 0x10a604fff] PGTABLE
[    0.000000] BRK [0x10a605000, 0x10a605fff] PGTABLE
[    0.000000] BRK [0x10a606000, 0x10a606fff] PGTABLE
[    0.000000] BRK [0x10a607000, 0x10a607fff] PGTABLE
[    0.000000] BRK [0x10a608000, 0x10a608fff] PGTABLE
[    0.000000] BRK [0x10a609000, 0x10a609fff] PGTABLE
[    0.000000] BRK [0x10a60a000, 0x10a60afff] PGTABLE
[    0.000000] BRK [0x10a60b000, 0x10a60bfff] PGTABLE
[    0.000000] BRK [0x10a60c000, 0x10a60cfff] PGTABLE
[    0.000000] Secure boot could not be determined
[    0.000000] RAMDISK: [mem 0x33667000-0x35b2afff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x000000005D779000 000024 (v02 ALASKA)
[    0.000000] ACPI: XSDT 0x000000005D7790A8 0000CC (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FACP 0x000000005D780470 000114 (v06 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: DSDT 0x000000005D779208 007264 (v02 ALASKA A M I    01072009 INTL 20120913)
[    0.000000] ACPI: FACS 0x000000005D7E5E00 000040
[    0.000000] ACPI: APIC 0x000000005D780588 00015E (v03 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FPDT 0x000000005D7806E8 000044 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FIDT 0x000000005D780730 00009C (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: SSDT 0x000000005D7807D0 000094 (v02 ALASKA CPUSSDT  01072009 AMI  01072009)
[    0.000000] ACPI: SSDT 0x000000005D780868 005419 (v02 AMD    AmdTable 00000002 MSFT 02000002)
[    0.000000] ACPI: SSDT 0x000000005D785C88 00306B (v01 AMD    AMD AOD  00000001 INTL 20120913)
[    0.000000] ACPI: MCFG 0x000000005D788CF8 00003C (v01 ALASKA A M I    01072009 MSFT 00010013)
[    0.000000] ACPI: HPET 0x000000005D788D38 000038 (v01 ALASKA A M I    01072009 AMI  00000005)
[    0.000000] ACPI: UEFI 0x000000005D788D70 000042 (v01 ALASKA A M I    00000002      01000013)
[    0.000000] ACPI: IVRS 0x000000005D788DB8 0000D0 (v02 AMD    AMD IVRS 00000001 AMD  00000000)
[    0.000000] ACPI: SSDT 0x000000005D788E88 00119C (v01 AMD    AMD CPU  00000001 AMD  00000001)
[    0.000000] ACPI: CRAT 0x000000005D78A028 000810 (v01 AMD    AMD CRAT 00000001 AMD  00000001)
[    0.000000] ACPI: CDIT 0x000000005D78A838 000029 (v01 AMD    AMD CDIT 00000001 AMD  00000001)
[    0.000000] ACPI: BGRT 0x000000005D78A868 000038 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: SSDT 0x000000005D78A8A0 000C34 (v01 AMD    AmdTable 00000001 INTL 20120913)
[    0.000000] ACPI: SSDT 0x000000005D78B4D8 0010AC (v01 AMD    AmdTable 00000001 INTL 20120913)
[    0.000000] ACPI: SSDT 0x000000005D78C588 001CE5 (v01 AMD    AmdTable 00000001 INTL 20120913)
[    0.000000] ACPI: SSDT 0x000000005D78E270 0000BF (v01 AMD    AMD PT   00001000 INTL 20120913)
[    0.000000] ACPI: WSMT 0x000000005D78E330 000028 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: SSDT 0x000000005D78E358 0010AF (v01 AMD    AmdTable 00000001 INTL 20120913)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000021f33ffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x21f315000-0x21f33ffff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000021f33ffff]
[    0.000000]   Device   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009ffff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x0000000009d7ffff]
[    0.000000]   node   0: [mem 0x000000000a000000-0x000000000a1fffff]
[    0.000000]   node   0: [mem 0x000000000a20b000-0x000000000affffff]
[    0.000000]   node   0: [mem 0x000000000b020000-0x000000005d150fff]
[    0.000000]   node   0: [mem 0x000000005d26e000-0x000000005d3edfff]
[    0.000000]   node   0: [mem 0x000000005e6da000-0x000000005effffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x000000021f33ffff]
[    0.000000] Zeroed struct page in unavailable ranges: 10005 pages
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000021f33ffff]
[    0.000000] On node 0 totalpages: 1559595
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 35 pages reserved
[    0.000000]   DMA zone: 3999 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 5926 pages used for memmap
[    0.000000]   DMA32 zone: 379212 pages, LIFO batch:63
[    0.000000]   Normal zone: 18381 pages used for memmap
[    0.000000]   Normal zone: 1176384 pages, LIFO batch:63
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 9, version 33, address 0xfec00000, GSI 0-23
[    0.000000] IOAPIC[1]: apic_id 10, version 33, address 0xfec01000, GSI 24-55
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x10228201 base: 0xfed00000
[    0.000000] smpboot: Allowing 32 CPUs, 24 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x09d80000-0x09ffffff]
[    0.000000] PM: Registered nosave memory: [mem 0x0a200000-0x0a20afff]
[    0.000000] PM: Registered nosave memory: [mem 0x0b000000-0x0b01ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x5d151000-0x5d26dfff]
[    0.000000] PM: Registered nosave memory: [mem 0x5d3ee000-0x5d7fcfff]
[    0.000000] PM: Registered nosave memory: [mem 0x5d7fd000-0x5e637fff]
[    0.000000] PM: Registered nosave memory: [mem 0x5e638000-0x5e6d9fff]
[    0.000000] PM: Registered nosave memory: [mem 0x5f000000-0xdfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xe0000000-0xf7ffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xf8000000-0xfbffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfc000000-0xfcffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfd000000-0xffffffff]
[    0.000000] [mem 0xe0000000-0xf7ffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.000000] random: get_random_bytes called from start_kernel+0x97/0x516 with crng_init=0
[    0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:32 nr_cpu_ids:32 nr_node_ids:1
[    0.000000] percpu: Embedded 46 pages/cpu @(____ptrval____) s151552 r8192 d28672 u262144
[    0.000000] pcpu-alloc: s151552 r8192 d28672 u262144 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15 
[    0.000000] pcpu-alloc: [0] 16 17 18 19 20 21 22 23 [0] 24 25 26 27 28 29 30 31 
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 1535189
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.0.2-050002-generic root=UUID=36c76a6c-ae79-4fae-b999-a31fdd5ece91 ro quiet splash vt.handoff=1
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 5921312K/6238380K available (14339K kernel code, 2332K rwdata, 4388K rodata, 2564K init, 5220K bss, 317068K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=32, Nodes=1
[    0.000000] ftrace: allocating 41461 entries in 162 pages
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=32.
[    0.000000] 	Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=32
[    0.000000] NR_IRQS: 524544, nr_irqs: 1224, preallocated irqs: 16
[    0.000000] Console: colour dummy device 80x25
[    0.000000] printk: console [tty0] enabled
[    0.000000] ACPI: Core revision 20181213
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484873504 ns
[    0.000000] hpet clockevent registered
[    0.000000] APIC: Switch to symmetric I/O mode setup
[    0.004000] Switched APIC routing to physical flat.
[    0.008000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.032000] tsc: PIT calibration matches HPET. 1 loops
[    0.032000] tsc: Detected 3599.938 MHz processor
[    0.000007] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x33e41921b99, max_idle_ns: 440795389779 ns
[    0.000012] Calibrating delay loop (skipped), value calculated using timer frequency.. 7199.87 BogoMIPS (lpj=14399752)
[    0.000014] pid_max: default: 32768 minimum: 301
[    0.005226] LSM: Security Framework initializing
[    0.005228] Yama: becoming mindful.
[    0.005363] AppArmor: AppArmor initialized
[    0.006837] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[    0.007442] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
[    0.007530] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.007558] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes)
[    0.008140] mce: CPU supports 23 MCE banks
[    0.008157] LVT offset 1 assigned for vector 0xf9
[    0.008205] LVT offset 2 assigned for vector 0xf4
[    0.008214] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 512
[    0.008215] Last level dTLB entries: 4KB 1536, 2MB 1536, 4MB 768, 1GB 0
[    0.008216] Spectre V2 : Mitigation: Full AMD retpoline
[    0.008216] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.008222] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    0.008223] Spectre V2 : User space: Vulnerable
[    0.008224] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.008391] Freeing SMP alternatives memory: 36K
[    0.016008] smpboot: CPU0: AMD Ryzen 5 2400G with Radeon Vega Graphics (family: 0x17, model: 0x11, stepping: 0x0)
[    0.016008] Performance Events: Fam17h core perfctr, AMD PMU driver.
[    0.016008] ... version:                0
[    0.016008] ... bit width:              48
[    0.016008] ... generic registers:      6
[    0.016008] ... value mask:             0000ffffffffffff
[    0.016008] ... max period:             00007fffffffffff
[    0.016008] ... fixed-purpose events:   0
[    0.016008] ... event mask:             000000000000003f
[    0.016008] rcu: Hierarchical SRCU implementation.
[    0.016008] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[    0.016008] smp: Bringing up secondary CPUs ...
[    0.016008] x86: Booting SMP configuration:
[    0.016008] .... node  #0, CPUs:        #1  #2  #3  #4  #5  #6  #7
[    0.032050] smp: Brought up 1 node, 8 CPUs
[    0.032050] smpboot: Max logical packages: 4
[    0.032050] smpboot: Total of 8 processors activated (57599.00 BogoMIPS)
[    0.032583] devtmpfs: initialized
[    0.032583] x86/mm: Memory block size: 128MB
[    0.032719] PM: Registering ACPI NVS region [mem 0x0a200000-0x0a20afff] (45056 bytes)
[    0.032719] PM: Registering ACPI NVS region [mem 0x5d3ee000-0x5d7fcfff] (4255744 bytes)
[    0.032719] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.032719] futex hash table entries: 8192 (order: 7, 524288 bytes)
[    0.036499] pinctrl core: initialized pinctrl subsystem
[    0.036614] RTC time: 13:08:39, date: 2019-03-14
[    0.037087] NET: Registered protocol family 16
[    0.037170] audit: initializing netlink subsys (disabled)
[    0.037175] audit: type=2000 audit(1552568918.068:1): state=initialized audit_enabled=0 res=1
[    0.037175] EISA bus registered
[    0.037175] cpuidle: using governor ladder
[    0.037175] cpuidle: using governor menu
[    0.037175] ACPI: bus type PCI registered
[    0.037175] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.037175] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xf8000000-0xfbffffff] (base 0xf8000000)
[    0.037175] PCI: MMCONFIG at [mem 0xf8000000-0xfbffffff] reserved in E820
[    0.037175] PCI: Using configuration type 1 for base access
[    0.037388] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.037388] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.040173] ACPI: Added _OSI(Module Device)
[    0.040173] ACPI: Added _OSI(Processor Device)
[    0.040173] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.040173] ACPI: Added _OSI(Processor Aggregator Device)
[    0.040173] ACPI: Added _OSI(Linux-Dell-Video)
[    0.040173] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    0.040173] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    0.049515] ACPI: 10 ACPI AML tables successfully acquired and loaded
[    0.051071] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    0.052965] ACPI: Interpreter enabled
[    0.052979] ACPI: (supports S0 S3 S4 S5)
[    0.052980] ACPI: Using IOAPIC for interrupt routing
[    0.053326] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.053688] ACPI: Enabled 2 GPEs in block 00 to 1F
[    0.062329] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.062334] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.062535] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug LTR]
[    0.062727] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    0.062738] acpi PNP0A08:00: [Firmware Info]: MMCONFIG for domain 0000 [bus 00-3f] only partially covers this bridge
[    0.063106] PCI host bridge to bus 0000:00
[    0.063108] pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
[    0.063109] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
[    0.063110] pci_bus 0000:00: root bus resource [io  0x03b0-0x03df window]
[    0.063111] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.063112] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.063113] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000dffff window]
[    0.063114] pci_bus 0000:00: root bus resource [mem 0xe0000000-0xfec2ffff window]
[    0.063115] pci_bus 0000:00: root bus resource [mem 0xfee00000-0xffffffff window]
[    0.063117] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.063125] pci 0000:00:00.0: [1022:15d0] type 00 class 0x060000
[    0.063256] pci 0000:00:00.2: [1022:15d1] type 00 class 0x080600
[    0.063410] pci 0000:00:01.0: [1022:1452] type 00 class 0x060000
[    0.063528] pci 0000:00:01.2: [1022:15d3] type 01 class 0x060400
[    0.063577] pci 0000:00:01.2: enabling Extended Tags
[    0.063633] pci 0000:00:01.2: PME# supported from D0 D3hot D3cold
[    0.063776] pci 0000:00:08.0: [1022:1452] type 00 class 0x060000
[    0.063886] pci 0000:00:08.1: [1022:15db] type 01 class 0x060400
[    0.063938] pci 0000:00:08.1: enabling Extended Tags
[    0.063991] pci 0000:00:08.1: PME# supported from D0 D3hot D3cold
[    0.064107] pci 0000:00:08.2: [1022:15dc] type 01 class 0x060400
[    0.064159] pci 0000:00:08.2: enabling Extended Tags
[    0.064210] pci 0000:00:08.2: PME# supported from D0 D3hot D3cold
[    0.064345] pci 0000:00:14.0: [1022:790b] type 00 class 0x0c0500
[    0.064531] pci 0000:00:14.3: [1022:790e] type 00 class 0x060100
[    0.064740] pci 0000:00:18.0: [1022:15e8] type 00 class 0x060000
[    0.064797] pci 0000:00:18.1: [1022:15e9] type 00 class 0x060000
[    0.064846] pci 0000:00:18.2: [1022:15ea] type 00 class 0x060000
[    0.064895] pci 0000:00:18.3: [1022:15eb] type 00 class 0x060000
[    0.064945] pci 0000:00:18.4: [1022:15ec] type 00 class 0x060000
[    0.064994] pci 0000:00:18.5: [1022:15ed] type 00 class 0x060000
[    0.065050] pci 0000:00:18.6: [1022:15ee] type 00 class 0x060000
[    0.065106] pci 0000:00:18.7: [1022:15ef] type 00 class 0x060000
[    0.065245] pci 0000:15:00.0: [1022:43d5] type 00 class 0x0c0330
[    0.065274] pci 0000:15:00.0: reg 0x10: [mem 0xfcea0000-0xfcea7fff 64bit]
[    0.065323] pci 0000:15:00.0: enabling Extended Tags
[    0.065381] pci 0000:15:00.0: PME# supported from D3hot D3cold
[    0.065485] pci 0000:15:00.1: [1022:43c8] type 00 class 0x010601
[    0.065547] pci 0000:15:00.1: reg 0x24: [mem 0xfce80000-0xfce9ffff]
[    0.065557] pci 0000:15:00.1: reg 0x30: [mem 0xfce00000-0xfce7ffff pref]
[    0.065564] pci 0000:15:00.1: enabling Extended Tags
[    0.065612] pci 0000:15:00.1: PME# supported from D3hot D3cold
[    0.065688] pci 0000:15:00.2: [1022:43c6] type 01 class 0x060400
[    0.065740] pci 0000:15:00.2: enabling Extended Tags
[    0.065791] pci 0000:15:00.2: PME# supported from D3hot D3cold
[    0.065916] pci 0000:00:01.2: PCI bridge to [bus 15-1e]
[    0.065921] pci 0000:00:01.2:   bridge window [io  0xf000-0xffff]
[    0.065924] pci 0000:00:01.2:   bridge window [mem 0xfcc00000-0xfcefffff]
[    0.066047] pci 0000:16:00.0: [1022:43c7] type 01 class 0x060400
[    0.066104] pci 0000:16:00.0: enabling Extended Tags
[    0.066166] pci 0000:16:00.0: PME# supported from D3hot D3cold
[    0.066264] pci 0000:16:01.0: [1022:43c7] type 01 class 0x060400
[    0.066321] pci 0000:16:01.0: enabling Extended Tags
[    0.066381] pci 0000:16:01.0: PME# supported from D3hot D3cold
[    0.066473] pci 0000:16:04.0: [1022:43c7] type 01 class 0x060400
[    0.066530] pci 0000:16:04.0: enabling Extended Tags
[    0.066590] pci 0000:16:04.0: PME# supported from D3hot D3cold
[    0.066689] pci 0000:16:05.0: [1022:43c7] type 01 class 0x060400
[    0.066746] pci 0000:16:05.0: enabling Extended Tags
[    0.066806] pci 0000:16:05.0: PME# supported from D3hot D3cold
[    0.066913] pci 0000:16:06.0: [1022:43c7] type 01 class 0x060400
[    0.066970] pci 0000:16:06.0: enabling Extended Tags
[    0.067031] pci 0000:16:06.0: PME# supported from D3hot D3cold
[    0.067139] pci 0000:16:07.0: [1022:43c7] type 01 class 0x060400
[    0.067196] pci 0000:16:07.0: enabling Extended Tags
[    0.067257] pci 0000:16:07.0: PME# supported from D3hot D3cold
[    0.067381] pci 0000:15:00.2: PCI bridge to [bus 16-1e]
[    0.067387] pci 0000:15:00.2:   bridge window [io  0xf000-0xffff]
[    0.067390] pci 0000:15:00.2:   bridge window [mem 0xfcc00000-0xfcdfffff]
[    0.067440] pci 0000:16:00.0: PCI bridge to [bus 17]
[    0.067491] pci 0000:16:01.0: PCI bridge to [bus 18]
[    0.067580] pci 0000:1b:00.0: [10ec:8168] type 00 class 0x020000
[    0.067628] pci 0000:1b:00.0: reg 0x10: [io  0xf000-0xf0ff]
[    0.067669] pci 0000:1b:00.0: reg 0x18: [mem 0xfcd04000-0xfcd04fff 64bit]
[    0.067694] pci 0000:1b:00.0: reg 0x20: [mem 0xfcd00000-0xfcd03fff 64bit]
[    0.067843] pci 0000:1b:00.0: supports D1 D2
[    0.067844] pci 0000:1b:00.0: PME# supported from D0 D1 D2 D3hot D3cold
[    0.068059] pci 0000:16:04.0: PCI bridge to [bus 1b]
[    0.068065] pci 0000:16:04.0:   bridge window [io  0xf000-0xffff]
[    0.068068] pci 0000:16:04.0:   bridge window [mem 0xfcd00000-0xfcdfffff]
[    0.068143] pci 0000:1c:00.0: [8086:24fb] type 00 class 0x028000
[    0.068211] pci 0000:1c:00.0: reg 0x10: [mem 0xfcc00000-0xfcc01fff 64bit]
[    0.068439] pci 0000:1c:00.0: PME# supported from D0 D3hot D3cold
[    0.068670] pci 0000:16:05.0: PCI bridge to [bus 1c]
[    0.068678] pci 0000:16:05.0:   bridge window [mem 0xfcc00000-0xfccfffff]
[    0.068738] pci 0000:16:06.0: PCI bridge to [bus 1d]
[    0.068789] pci 0000:16:07.0: PCI bridge to [bus 1e]
[    0.068951] pci 0000:38:00.0: [1002:15dd] type 00 class 0x030000
[    0.068997] pci 0000:38:00.0: reg 0x10: [mem 0xe0000000-0xefffffff 64bit pref]
[    0.069014] pci 0000:38:00.0: reg 0x18: [mem 0xf0000000-0xf01fffff 64bit pref]
[    0.069026] pci 0000:38:00.0: reg 0x20: [io  0xe000-0xe0ff]
[    0.069038] pci 0000:38:00.0: reg 0x24: [mem 0xfcb00000-0xfcb7ffff]
[    0.069058] pci 0000:38:00.0: enabling Extended Tags
[    0.069069] pci 0000:38:00.0: BAR 0: assigned to efifb
[    0.069163] pci 0000:38:00.0: PME# supported from D1 D2 D3hot D3cold
[    0.069298] pci 0000:38:00.1: [1002:15de] type 00 class 0x040300
[    0.069327] pci 0000:38:00.1: reg 0x10: [mem 0xfcb88000-0xfcb8bfff]
[    0.069398] pci 0000:38:00.1: enabling Extended Tags
[    0.069464] pci 0000:38:00.1: PME# supported from D1 D2 D3hot D3cold
[    0.069538] pci 0000:38:00.2: [1022:15df] type 00 class 0x108000
[    0.069587] pci 0000:38:00.2: reg 0x18: [mem 0xfca00000-0xfcafffff]
[    0.069619] pci 0000:38:00.2: reg 0x24: [mem 0xfcb8c000-0xfcb8dfff]
[    0.069639] pci 0000:38:00.2: enabling Extended Tags
[    0.069800] pci 0000:38:00.3: [1022:15e0] type 00 class 0x0c0330
[    0.069834] pci 0000:38:00.3: reg 0x10: [mem 0xfc900000-0xfc9fffff 64bit]
[    0.069895] pci 0000:38:00.3: enabling Extended Tags
[    0.069968] pci 0000:38:00.3: PME# supported from D0 D3hot D3cold
[    0.070061] pci 0000:38:00.4: [1022:15e1] type 00 class 0x0c0330
[    0.070095] pci 0000:38:00.4: reg 0x10: [mem 0xfc800000-0xfc8fffff 64bit]
[    0.070158] pci 0000:38:00.4: enabling Extended Tags
[    0.070231] pci 0000:38:00.4: PME# supported from D0 D3hot D3cold
[    0.070327] pci 0000:38:00.6: [1022:15e3] type 00 class 0x040300
[    0.070356] pci 0000:38:00.6: reg 0x10: [mem 0xfcb80000-0xfcb87fff]
[    0.070427] pci 0000:38:00.6: enabling Extended Tags
[    0.070493] pci 0000:38:00.6: PME# supported from D0 D3hot D3cold
[    0.070639] pci 0000:00:08.1: PCI bridge to [bus 38]
[    0.070645] pci 0000:00:08.1:   bridge window [io  0xe000-0xefff]
[    0.070648] pci 0000:00:08.1:   bridge window [mem 0xfc800000-0xfcbfffff]
[    0.070653] pci 0000:00:08.1:   bridge window [mem 0xe0000000-0xf01fffff 64bit pref]
[    0.070733] pci 0000:39:00.0: [1022:7901] type 00 class 0x010601
[    0.070815] pci 0000:39:00.0: reg 0x24: [mem 0xfcf00000-0xfcf007ff]
[    0.070835] pci 0000:39:00.0: enabling Extended Tags
[    0.070909] pci 0000:39:00.0: PME# supported from D3hot D3cold
[    0.071030] pci 0000:00:08.2: PCI bridge to [bus 39]
[    0.071038] pci 0000:00:08.2:   bridge window [mem 0xfcf00000-0xfcffffff]
[    0.071417] ACPI: PCI Interrupt Link [LNKA] (IRQs 4 5 7 10 11 14 15) *0
[    0.071474] ACPI: PCI Interrupt Link [LNKB] (IRQs 4 5 7 10 11 14 15) *0
[    0.071524] ACPI: PCI Interrupt Link [LNKC] (IRQs 4 5 7 10 11 14 15) *0
[    0.071586] ACPI: PCI Interrupt Link [LNKD] (IRQs 4 5 7 10 11 14 15) *0
[    0.071641] ACPI: PCI Interrupt Link [LNKE] (IRQs 4 5 7 10 11 14 15) *0
[    0.071686] ACPI: PCI Interrupt Link [LNKF] (IRQs 4 5 7 10 11 14 15) *0
[    0.071731] ACPI: PCI Interrupt Link [LNKG] (IRQs 4 5 7 10 11 14 15) *0
[    0.071776] ACPI: PCI Interrupt Link [LNKH] (IRQs 4 5 7 10 11 14 15) *0
[    0.076031] pci 0000:38:00.0: vgaarb: setting as boot VGA device
[    0.076031] pci 0000:38:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.076031] pci 0000:38:00.0: vgaarb: bridge control possible
[    0.076031] vgaarb: loaded
[    0.076284] SCSI subsystem initialized
[    0.076302] libata version 3.00 loaded.
[    0.076302] ACPI: bus type USB registered
[    0.076302] usbcore: registered new interface driver usbfs
[    0.076302] usbcore: registered new interface driver hub
[    0.076302] usbcore: registered new device driver usb
[    0.076302] pps_core: LinuxPPS API ver. 1 registered
[    0.076302] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.076302] PTP clock support registered
[    0.076302] EDAC MC: Ver: 3.0.0
[    0.076302] Registered efivars operations
[    0.096284] PCI: Using ACPI for IRQ routing
[    0.096647] PCI: pci_cache_line_size set to 64 bytes
[    0.096743] Expanded resource Reserved due to conflict with PCI Bus 0000:00
[    0.096744] e820: reserve RAM buffer [mem 0x09d80000-0x0bffffff]
[    0.096745] e820: reserve RAM buffer [mem 0x0a200000-0x0bffffff]
[    0.096746] e820: reserve RAM buffer [mem 0x0b000000-0x0bffffff]
[    0.096747] e820: reserve RAM buffer [mem 0x5d151000-0x5fffffff]
[    0.096747] e820: reserve RAM buffer [mem 0x5d3ee000-0x5fffffff]
[    0.096748] e820: reserve RAM buffer [mem 0x5f000000-0x5fffffff]
[    0.096748] e820: reserve RAM buffer [mem 0x21f340000-0x21fffffff]
[    0.096868] NetLabel: Initializing
[    0.096869] NetLabel:  domain hash size = 128
[    0.096869] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.096878] NetLabel:  unlabeled traffic allowed by default
[    0.100120] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.100123] hpet0: 3 comparators, 32-bit 14.318180 MHz counter
[    0.100123] clocksource: Switched to clocksource tsc-early
[    0.111583] VFS: Disk quotas dquot_6.6.0
[    0.111635] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.111796] AppArmor: AppArmor Filesystem Enabled
[    0.111826] pnp: PnP ACPI init
[    0.112000] system 00:00: [mem 0xf8000000-0xfbffffff] has been reserved
[    0.112004] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.112069] system 00:01: [mem 0x60000000-0xdfffffff window] has been reserved
[    0.112072] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.112189] pnp 00:02: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.112376] system 00:03: [io  0x0a00-0x0a0f] has been reserved
[    0.112377] system 00:03: [io  0x0a10-0x0a1f] has been reserved
[    0.112378] system 00:03: [io  0x0a20-0x0a2f] has been reserved
[    0.112379] system 00:03: [io  0x0a40-0x0a4f] has been reserved
[    0.112382] system 00:03: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.112604] system 00:04: [io  0x04d0-0x04d1] has been reserved
[    0.112605] system 00:04: [io  0x040b] has been reserved
[    0.112606] system 00:04: [io  0x04d6] has been reserved
[    0.112607] system 00:04: [io  0x0c00-0x0c01] has been reserved
[    0.112608] system 00:04: [io  0x0c14] has been reserved
[    0.112609] system 00:04: [io  0x0c50-0x0c51] has been reserved
[    0.112610] system 00:04: [io  0x0c52] has been reserved
[    0.112610] system 00:04: [io  0x0c6c] has been reserved
[    0.112611] system 00:04: [io  0x0c6f] has been reserved
[    0.112612] system 00:04: [io  0x0cd0-0x0cd1] has been reserved
[    0.112613] system 00:04: [io  0x0cd2-0x0cd3] has been reserved
[    0.112614] system 00:04: [io  0x0cd4-0x0cd5] has been reserved
[    0.112615] system 00:04: [io  0x0cd6-0x0cd7] has been reserved
[    0.112616] system 00:04: [io  0x0cd8-0x0cdf] has been reserved
[    0.112616] system 00:04: [io  0x0800-0x089f] has been reserved
[    0.112617] system 00:04: [io  0x0b00-0x0b0f] has been reserved
[    0.112618] system 00:04: [io  0x0b20-0x0b3f] has been reserved
[    0.112619] system 00:04: [io  0x0900-0x090f] has been reserved
[    0.112620] system 00:04: [io  0x0910-0x091f] has been reserved
[    0.112621] system 00:04: [mem 0xfec00000-0xfec00fff] could not be reserved
[    0.112622] system 00:04: [mem 0xfec01000-0xfec01fff] could not be reserved
[    0.112624] system 00:04: [mem 0xfedc0000-0xfedc0fff] has been reserved
[    0.112625] system 00:04: [mem 0xfee00000-0xfee00fff] has been reserved
[    0.112626] system 00:04: [mem 0xfed80000-0xfed8ffff] could not be reserved
[    0.112627] system 00:04: [mem 0xfec10000-0xfec10fff] has been reserved
[    0.112628] system 00:04: [mem 0xff000000-0xffffffff] has been reserved
[    0.112630] system 00:04: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.113086] pnp: PnP ACPI: found 5 devices
[    0.118921] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.119010] pci 0000:16:00.0: PCI bridge to [bus 17]
[    0.119024] pci 0000:16:01.0: PCI bridge to [bus 18]
[    0.119036] pci 0000:16:04.0: PCI bridge to [bus 1b]
[    0.119038] pci 0000:16:04.0:   bridge window [io  0xf000-0xffff]
[    0.119043] pci 0000:16:04.0:   bridge window [mem 0xfcd00000-0xfcdfffff]
[    0.119051] pci 0000:16:05.0: PCI bridge to [bus 1c]
[    0.119056] pci 0000:16:05.0:   bridge window [mem 0xfcc00000-0xfccfffff]
[    0.119064] pci 0000:16:06.0: PCI bridge to [bus 1d]
[    0.119077] pci 0000:16:07.0: PCI bridge to [bus 1e]
[    0.119088] pci 0000:15:00.2: PCI bridge to [bus 16-1e]
[    0.119090] pci 0000:15:00.2:   bridge window [io  0xf000-0xffff]
[    0.119095] pci 0000:15:00.2:   bridge window [mem 0xfcc00000-0xfcdfffff]
[    0.119103] pci 0000:00:01.2: PCI bridge to [bus 15-1e]
[    0.119105] pci 0000:00:01.2:   bridge window [io  0xf000-0xffff]
[    0.119109] pci 0000:00:01.2:   bridge window [mem 0xfcc00000-0xfcefffff]
[    0.119118] pci 0000:00:08.1: PCI bridge to [bus 38]
[    0.119119] pci 0000:00:08.1:   bridge window [io  0xe000-0xefff]
[    0.119124] pci 0000:00:08.1:   bridge window [mem 0xfc800000-0xfcbfffff]
[    0.119127] pci 0000:00:08.1:   bridge window [mem 0xe0000000-0xf01fffff 64bit pref]
[    0.119133] pci 0000:00:08.2: PCI bridge to [bus 39]
[    0.119137] pci 0000:00:08.2:   bridge window [mem 0xfcf00000-0xfcffffff]
[    0.119146] pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    0.119147] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    0.119148] pci_bus 0000:00: resource 6 [io  0x03b0-0x03df window]
[    0.119149] pci_bus 0000:00: resource 7 [io  0x0d00-0xffff window]
[    0.119150] pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000bffff window]
[    0.119151] pci_bus 0000:00: resource 9 [mem 0x000c0000-0x000dffff window]
[    0.119152] pci_bus 0000:00: resource 10 [mem 0xe0000000-0xfec2ffff window]
[    0.119153] pci_bus 0000:00: resource 11 [mem 0xfee00000-0xffffffff window]
[    0.119154] pci_bus 0000:15: resource 0 [io  0xf000-0xffff]
[    0.119154] pci_bus 0000:15: resource 1 [mem 0xfcc00000-0xfcefffff]
[    0.119155] pci_bus 0000:16: resource 0 [io  0xf000-0xffff]
[    0.119156] pci_bus 0000:16: resource 1 [mem 0xfcc00000-0xfcdfffff]
[    0.119157] pci_bus 0000:1b: resource 0 [io  0xf000-0xffff]
[    0.119158] pci_bus 0000:1b: resource 1 [mem 0xfcd00000-0xfcdfffff]
[    0.119159] pci_bus 0000:1c: resource 1 [mem 0xfcc00000-0xfccfffff]
[    0.119160] pci_bus 0000:38: resource 0 [io  0xe000-0xefff]
[    0.119161] pci_bus 0000:38: resource 1 [mem 0xfc800000-0xfcbfffff]
[    0.119161] pci_bus 0000:38: resource 2 [mem 0xe0000000-0xf01fffff 64bit pref]
[    0.119162] pci_bus 0000:39: resource 1 [mem 0xfcf00000-0xfcffffff]
[    0.119369] NET: Registered protocol family 2
[    0.119768] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes)
[    0.119800] TCP established hash table entries: 65536 (order: 7, 524288 bytes)
[    0.119916] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.120040] TCP: Hash tables configured (established 65536 bind 65536)
[    0.120116] UDP hash table entries: 4096 (order: 5, 131072 bytes)
[    0.120136] UDP-Lite hash table entries: 4096 (order: 5, 131072 bytes)
[    0.120350] NET: Registered protocol family 1
[    0.120355] NET: Registered protocol family 44
[    0.120615] pci 0000:38:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.120625] pci 0000:38:00.1: Linked as a consumer to 0000:38:00.0
[    0.120925] PCI: CLS 64 bytes, default 64
[    0.120990] Unpacking initramfs...
[    0.502908] Freeing initrd memory: 37648K
[    0.502941] AMD-Vi: Unable to write to IOMMU perf counter.
[    0.503075] pci 0000:00:00.2: can't derive routing for PCI INT A
[    0.503076] pci 0000:00:00.2: PCI INT A: not connected
[    0.503841] iommu: Adding device 0000:00:01.0 to group 0
[    0.504207] iommu: Adding device 0000:00:01.2 to group 1
[    0.504589] iommu: Adding device 0000:00:08.0 to group 2
[    0.504935] iommu: Adding device 0000:00:08.1 to group 3
[    0.504962] iommu: Adding device 0000:00:08.2 to group 2
[    0.505327] iommu: Adding device 0000:00:14.0 to group 4
[    0.505349] iommu: Adding device 0000:00:14.3 to group 4
[    0.505730] iommu: Adding device 0000:00:18.0 to group 5
[    0.505752] iommu: Adding device 0000:00:18.1 to group 5
[    0.505774] iommu: Adding device 0000:00:18.2 to group 5
[    0.505796] iommu: Adding device 0000:00:18.3 to group 5
[    0.505817] iommu: Adding device 0000:00:18.4 to group 5
[    0.505839] iommu: Adding device 0000:00:18.5 to group 5
[    0.505860] iommu: Adding device 0000:00:18.6 to group 5
[    0.505889] iommu: Adding device 0000:00:18.7 to group 5
[    0.506275] iommu: Adding device 0000:15:00.0 to group 6
[    0.506311] iommu: Adding device 0000:15:00.1 to group 6
[    0.506345] iommu: Adding device 0000:15:00.2 to group 6
[    0.506367] iommu: Adding device 0000:16:00.0 to group 6
[    0.506390] iommu: Adding device 0000:16:01.0 to group 6
[    0.506420] iommu: Adding device 0000:16:04.0 to group 6
[    0.506442] iommu: Adding device 0000:16:05.0 to group 6
[    0.506464] iommu: Adding device 0000:16:06.0 to group 6
[    0.506486] iommu: Adding device 0000:16:07.0 to group 6
[    0.506518] iommu: Adding device 0000:1b:00.0 to group 6
[    0.506551] iommu: Adding device 0000:1c:00.0 to group 6
[    0.506979] iommu: Adding device 0000:38:00.0 to group 7
[    0.507090] iommu: Using direct mapping for device 0000:38:00.0
[    0.507345] iommu: Adding device 0000:38:00.1 to group 8
[    0.507387] iommu: Adding device 0000:38:00.2 to group 8
[    0.507426] iommu: Adding device 0000:38:00.3 to group 8
[    0.507466] iommu: Adding device 0000:38:00.4 to group 8
[    0.507507] iommu: Adding device 0000:38:00.6 to group 8
[    0.507538] iommu: Adding device 0000:39:00.0 to group 2
[    0.507780] AMD-Vi: Found IOMMU at 0000:00:00.2 cap 0x40
[    0.507781] AMD-Vi: Extended features (0x4f77ef22294ada):
[    0.507781]  PPR NX GT IA GA PC GA_vAPIC
[    0.507783] AMD-Vi: Interrupt remapping enabled
[    0.507783] AMD-Vi: Virtual APIC enabled
[    0.507988] AMD-Vi: Lazy IO/TLB flushing enabled
[    0.508868] amd_uncore: AMD NB counters detected
[    0.508896] amd_uncore: AMD LLC counters detected
[    0.509322] check: Scanning for low memory corruption every 60 seconds
[    0.511774] Initialise system trusted keyrings
[    0.511807] Key type blacklist registered
[    0.511875] workingset: timestamp_bits=36 max_order=21 bucket_order=0
[    0.513584] zbud: loaded
[    0.514363] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.514828] fuse init (API version 7.28)
[    0.547581] Key type asymmetric registered
[    0.547583] Asymmetric key parser 'x509' registered
[    0.547595] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[    0.547656] io scheduler mq-deadline registered
[    0.548758] pcieport 0000:00:01.2: Signaling PME with IRQ 26
[    0.548853] aer 0000:00:01.2:pcie002: AER enabled with IRQ 26
[    0.549009] pcieport 0000:00:08.1: Signaling PME with IRQ 27
[    0.549238] pcieport 0000:00:08.2: Signaling PME with IRQ 28
[    0.550465] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    0.550551] efifb: probing for efifb
[    0.550561] efifb: framebuffer at 0xe0000000, using 3072k, total 3072k
[    0.550562] efifb: mode is 1024x768x32, linelength=4096, pages=1
[    0.550563] efifb: scrolling: redraw
[    0.550564] efifb: Truecolor: size=8:8:8:8, shift=24:16:8:0
[    0.552377] Console: switching to colour frame buffer device 128x48
[    0.554062] fb0: EFI VGA frame buffer device
[    0.554197] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
[    0.554204] ACPI: Power Button [PWRB]
[    0.554244] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1
[    0.554262] ACPI: Power Button [PWRF]
[    0.554320] Monitor-Mwait will be used to enter C-1 state
[    0.555510] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    0.576420] serial8250: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A
[    0.577809] Linux agpgart interface v0.103
[    0.582092] loop: module loaded
[    0.582299] libphy: Fixed MDIO Bus: probed
[    0.582300] tun: Universal TUN/TAP device driver, 1.6
[    0.582326] PPP generic driver version 2.4.2
[    0.582371] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    0.582374] ehci-pci: EHCI PCI platform driver
[    0.582383] ehci-platform: EHCI generic platform driver
[    0.582389] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    0.582391] ohci-pci: OHCI PCI platform driver
[    0.582396] ohci-platform: OHCI generic platform driver
[    0.582399] uhci_hcd: USB Universal Host Controller Interface driver
[    0.582523] xhci_hcd 0000:15:00.0: xHCI Host Controller
[    0.582527] xhci_hcd 0000:15:00.0: new USB bus registered, assigned bus number 1
[    0.637851] xhci_hcd 0000:15:00.0: hcc params 0x0200ef81 hci version 0x110 quirks 0x0000000000000410
[    0.638057] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.00
[    0.638058] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.638059] usb usb1: Product: xHCI Host Controller
[    0.638060] usb usb1: Manufacturer: Linux 5.0.2-050002-generic xhci-hcd
[    0.638060] usb usb1: SerialNumber: 0000:15:00.0
[    0.638189] hub 1-0:1.0: USB hub found
[    0.638205] hub 1-0:1.0: 10 ports detected
[    0.638529] xhci_hcd 0000:15:00.0: xHCI Host Controller
[    0.638531] xhci_hcd 0000:15:00.0: new USB bus registered, assigned bus number 2
[    0.638533] xhci_hcd 0000:15:00.0: Host supports USB 3.10 Enhanced SuperSpeed
[    0.638573] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    0.638585] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.00
[    0.638586] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.638586] usb usb2: Product: xHCI Host Controller
[    0.638587] usb usb2: Manufacturer: Linux 5.0.2-050002-generic xhci-hcd
[    0.638588] usb usb2: SerialNumber: 0000:15:00.0
[    0.638666] hub 2-0:1.0: USB hub found
[    0.638674] hub 2-0:1.0: 4 ports detected
[    0.638872] xhci_hcd 0000:38:00.3: xHCI Host Controller
[    0.638874] xhci_hcd 0000:38:00.3: new USB bus registered, assigned bus number 3
[    0.639060] xhci_hcd 0000:38:00.3: hcc params 0x0270ffe5 hci version 0x110 quirks 0x0000000840000410
[    0.639587] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.00
[    0.639588] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.639589] usb usb3: Product: xHCI Host Controller
[    0.639589] usb usb3: Manufacturer: Linux 5.0.2-050002-generic xhci-hcd
[    0.639590] usb usb3: SerialNumber: 0000:38:00.3
[    0.639690] hub 3-0:1.0: USB hub found
[    0.639703] hub 3-0:1.0: 4 ports detected
[    0.639885] xhci_hcd 0000:38:00.3: xHCI Host Controller
[    0.639887] xhci_hcd 0000:38:00.3: new USB bus registered, assigned bus number 4
[    0.639889] xhci_hcd 0000:38:00.3: Host supports USB 3.10 Enhanced SuperSpeed
[    0.639912] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
[    0.639923] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.00
[    0.639924] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.639925] usb usb4: Product: xHCI Host Controller
[    0.639926] usb usb4: Manufacturer: Linux 5.0.2-050002-generic xhci-hcd
[    0.639926] usb usb4: SerialNumber: 0000:38:00.3
[    0.640021] hub 4-0:1.0: USB hub found
[    0.640034] hub 4-0:1.0: 4 ports detected
[    0.640403] xhci_hcd 0000:38:00.4: xHCI Host Controller
[    0.640406] xhci_hcd 0000:38:00.4: new USB bus registered, assigned bus number 5
[    0.640565] xhci_hcd 0000:38:00.4: hcc params 0x0260ffe5 hci version 0x110 quirks 0x0000000840000410
[    0.641038] usb usb5: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.00
[    0.641039] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.641040] usb usb5: Product: xHCI Host Controller
[    0.641041] usb usb5: Manufacturer: Linux 5.0.2-050002-generic xhci-hcd
[    0.641041] usb usb5: SerialNumber: 0000:38:00.4
[    0.641138] hub 5-0:1.0: USB hub found
[    0.641147] hub 5-0:1.0: 1 port detected
[    0.641257] xhci_hcd 0000:38:00.4: xHCI Host Controller
[    0.641259] xhci_hcd 0000:38:00.4: new USB bus registered, assigned bus number 6
[    0.641260] xhci_hcd 0000:38:00.4: Host supports USB 3.10 Enhanced SuperSpeed
[    0.641290] usb usb6: We don't know the algorithms for LPM for this host, disabling LPM.
[    0.641302] usb usb6: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.00
[    0.641302] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.641303] usb usb6: Product: xHCI Host Controller
[    0.641304] usb usb6: Manufacturer: Linux 5.0.2-050002-generic xhci-hcd
[    0.641305] usb usb6: SerialNumber: 0000:38:00.4
[    0.641400] hub 6-0:1.0: USB hub found
[    0.641409] hub 6-0:1.0: 1 port detected
[    0.641488] i8042: PNP: No PS/2 controller found.
[    0.641556] mousedev: PS/2 mouse device common for all mice
[    0.641715] rtc_cmos 00:02: RTC can wake from S4
[    0.641922] rtc_cmos 00:02: registered as rtc0
[    0.641939] rtc_cmos 00:02: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[    0.641942] i2c /dev entries driver
[    0.642112] device-mapper: uevent: version 1.0.3
[    0.642186] device-mapper: ioctl: 4.39.0-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[    0.642208] platform eisa.0: Probing EISA bus 0
[    0.642209] platform eisa.0: EISA: Cannot allocate resource for mainboard
[    0.642210] platform eisa.0: Cannot allocate resource for EISA slot 1
[    0.642210] platform eisa.0: Cannot allocate resource for EISA slot 2
[    0.642211] platform eisa.0: Cannot allocate resource for EISA slot 3
[    0.642212] platform eisa.0: Cannot allocate resource for EISA slot 4
[    0.642213] platform eisa.0: Cannot allocate resource for EISA slot 5
[    0.642214] platform eisa.0: Cannot allocate resource for EISA slot 6
[    0.642214] platform eisa.0: Cannot allocate resource for EISA slot 7
[    0.642215] platform eisa.0: Cannot allocate resource for EISA slot 8
[    0.642216] platform eisa.0: EISA: Detected 0 cards
[    0.642329] ledtrig-cpu: registered to indicate activity on CPUs
[    0.642331] EFI Variables Facility v0.08 2004-May-17
[    0.664222] NET: Registered protocol family 10
[    0.669195] Segment Routing with IPv6
[    0.669214] NET: Registered protocol family 17
[    0.669285] Key type dns_resolver registered
[    0.669896] RAS: Correctable Errors collector initialized.
[    0.669931] microcode: CPU0: patch_level=0x0810100b
[    0.669935] microcode: CPU1: patch_level=0x0810100b
[    0.669941] microcode: CPU2: patch_level=0x0810100b
[    0.669958] microcode: CPU3: patch_level=0x0810100b
[    0.669964] microcode: CPU4: patch_level=0x0810100b
[    0.669966] microcode: CPU5: patch_level=0x0810100b
[    0.669972] microcode: CPU6: patch_level=0x0810100b
[    0.669979] microcode: CPU7: patch_level=0x0810100b
[    0.670008] microcode: Microcode Update Driver: v2.2.
[    0.670029] sched_clock: Marking stable (701996651, -31991520)->(923039606, -253034475)
[    0.670259] registered taskstats version 1
[    0.670267] Loading compiled-in X.509 certificates
[    0.671526] Loaded X.509 cert 'Build time autogenerated kernel key: 901c64038402ee7829aeef909077142a9b34df94'
[    0.671565] zswap: loaded using pool lzo/zbud
[    0.675664] Key type big_key registered
[    0.675666] Key type trusted registered
[    0.677633] Key type encrypted registered
[    0.677634] AppArmor: AppArmor sha1 policy hashing enabled
[    0.677638] ima: No TPM chip found, activating TPM-bypass!
[    0.677654] ima: Allocated hash algorithm: sha1
[    0.677659] No architecture policies found
[    0.677682] evm: Initialising EVM extended attributes:
[    0.677683] evm: security.selinux
[    0.677683] evm: security.SMACK64
[    0.677683] evm: security.SMACK64EXEC
[    0.677684] evm: security.SMACK64TRANSMUTE
[    0.677684] evm: security.SMACK64MMAP
[    0.677685] evm: security.apparmor
[    0.677685] evm: security.ima
[    0.677685] evm: security.capability
[    0.677686] evm: HMAC attrs: 0x1
[    0.678676]   Magic number: 11:475:129
[    0.678682] nvmem cmos_nvram0: hash matches
[    0.678706] event_source kprobe: hash matches
[    0.678747] acpi device:04: hash matches
[    0.678748] acpi PNP0C02:01: hash matches
[    0.678818] rtc_cmos 00:02: setting system clock to 2019-03-14T13:08:40 UTC (1552568920)
[    0.679057] acpi_cpufreq: overriding BIOS provided _PSD data
[    0.680624] Freeing unused decrypted memory: 2040K
[    0.681023] Freeing unused kernel image memory: 2564K
[    0.692896] Write protecting the kernel read-only data: 22528k
[    0.693465] Freeing unused kernel image memory: 2016K
[    0.693827] Freeing unused kernel image memory: 1756K
[    0.703220] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    0.703225] Run /init as init process
[    0.759923] ACPI: Video Device [VGA1] (multi-head: yes  rom: no  post: no)
[    0.760272] acpi device:10: registered as cooling_device8
[    0.760350] input: Video Bus as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0A08:00/device:0f/LNXVIDEO:01/input/input2
[    0.770665] piix4_smbus 0000:00:14.0: SMBus Host Controller at 0xb00, revision 0
[    0.770669] piix4_smbus 0000:00:14.0: Using register 0x02 for SMBus port selection
[    0.771965] ahci 0000:15:00.1: version 3.0
[    0.772237] ahci 0000:15:00.1: SSS flag set, parallel bus scan disabled
[    0.772289] ahci 0000:15:00.1: AHCI 0001.0301 32 slots 8 ports 6 Gbps 0x33 impl SATA mode
[    0.772292] ahci 0000:15:00.1: flags: 64bit ncq sntf stag pm led clo only pmp pio slum part sxs deso sadm sds apst 
[    0.774006] scsi host0: ahci
[    0.776458] scsi host1: ahci
[    0.784900] scsi host2: ahci
[    0.786332] scsi host3: ahci
[    0.786522] scsi host4: ahci
[    0.786673] scsi host5: ahci
[    0.786836] scsi host6: ahci
[    0.786969] scsi host7: ahci
[    0.787051] ata1: SATA max UDMA/133 abar m131072@0xfce80000 port 0xfce80100 irq 59
[    0.787054] ata2: SATA max UDMA/133 abar m131072@0xfce80000 port 0xfce80180 irq 59
[    0.787055] ata3: DUMMY
[    0.787055] ata4: DUMMY
[    0.787057] ata5: SATA max UDMA/133 abar m131072@0xfce80000 port 0xfce80300 irq 59
[    0.787059] ata6: SATA max UDMA/133 abar m131072@0xfce80000 port 0xfce80380 irq 59
[    0.787060] ata7: DUMMY
[    0.787060] ata8: DUMMY
[    0.788513] libphy: r8169: probed
[    0.788847] r8169 0000:1b:00.0 eth0: RTL8168h/8111h, 00:d8:61:0e:dd:4b, XID 541, IRQ 60
[    0.788848] r8169 0000:1b:00.0 eth0: jumbo features [frames: 9200 bytes, tx checksumming: ko]
[    0.795145] r8169 0000:1b:00.0 enp27s0: renamed from eth0
[    0.799941] ahci 0000:39:00.0: AHCI 0001.0301 32 slots 1 ports 6 Gbps 0x1 impl SATA mode
[    0.799944] ahci 0000:39:00.0: flags: 64bit ncq sntf ilck pm led clo only pmp fbs pio slum part 
[    0.800219] scsi host8: ahci
[    0.800315] ata9: SATA max UDMA/133 abar m2048@0xfcf00000 port 0xfcf00100 irq 62
[    0.974366] usb 3-2: new high-speed USB device number 2 using xhci_hcd
[    0.978364] usb 1-8: new full-speed USB device number 2 using xhci_hcd
[    1.100817] ata1: SATA link down (SStatus 0 SControl 330)
[    1.121907] usb 3-2: New USB device found, idVendor=05e3, idProduct=0608, bcdDevice=32.98
[    1.121909] usb 3-2: New USB device strings: Mfr=0, Product=1, SerialNumber=0
[    1.121911] usb 3-2: Product: USB2.0 Hub
[    1.184893] hub 3-2:1.0: USB hub found
[    1.185274] hub 3-2:1.0: 4 ports detected
[    1.276380] ata9: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    1.277535] ata9.00: ATA-9: TS128GMTS800S, Q0926B, max UDMA/133
[    1.277539] ata9.00: 250069680 sectors, multi 16: LBA48 NCQ (depth 32), AA
[    1.278047] ata9.00: configured for UDMA/133
[    1.301775] usb 1-8: New USB device found, idVendor=8087, idProduct=0aa7, bcdDevice= 0.01
[    1.301779] usb 1-8: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    1.413070] ata2: SATA link down (SStatus 0 SControl 330)
[    1.476362] usb 3-2.3: new low-speed USB device number 3 using xhci_hcd
[    1.532382] tsc: Refined TSC clocksource calibration: 3599.981 MHz
[    1.532406] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x33e441e3f8f, max_idle_ns: 440795359143 ns
[    1.532448] clocksource: Switched to clocksource tsc
[    1.594099] usb 3-2.3: New USB device found, idVendor=413c, idProduct=2107, bcdDevice= 1.04
[    1.594101] usb 3-2.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    1.594103] usb 3-2.3: Product: Dell USB Entry Keyboard
[    1.594104] usb 3-2.3: Manufacturer: DELL
[    1.636494] hidraw: raw HID events driver (C) Jiri Kosina
[    1.643159] usbcore: registered new interface driver usbhid
[    1.643160] usbhid: USB HID core driver
[    1.644525] input: DELL Dell USB Entry Keyboard as /devices/pci0000:00/0000:00:08.1/0000:38:00.3/usb3/3-2/3-2.3/3-2.3:1.0/0003:413C:2107.0001/input/input3
[    1.704704] hid-generic 0003:413C:2107.0001: input,hidraw0: USB HID v1.11 Keyboard [DELL Dell USB Entry Keyboard] on usb-0000:38:00.3-2.3/input0
[    1.712062] usb 3-2.4: new high-speed USB device number 4 using xhci_hcd
[    1.728647] ata5: SATA link down (SStatus 0 SControl 330)
[    1.814287] usb 3-2.4: New USB device found, idVendor=05e3, idProduct=0608, bcdDevice=32.98
[    1.814290] usb 3-2.4: New USB device strings: Mfr=0, Product=1, SerialNumber=0
[    1.814292] usb 3-2.4: Product: USB2.0 Hub
[    1.856880] hub 3-2.4:1.0: USB hub found
[    1.857257] hub 3-2.4:1.0: 4 ports detected
[    2.041281] ata6: SATA link down (SStatus 0 SControl 330)
[    2.041775] scsi 8:0:0:0: Direct-Access     ATA      TS128GMTS800S    6B   PQ: 0 ANSI: 5
[    2.042137] sd 8:0:0:0: Attached scsi generic sg0 type 0
[    2.042208] sd 8:0:0:0: [sda] 250069680 512-byte logical blocks: (128 GB/119 GiB)
[    2.042234] sd 8:0:0:0: [sda] Write Protect is off
[    2.042238] sd 8:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    2.042277] sd 8:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.044483]  sda: sda1 sda2
[    2.045013] sd 8:0:0:0: [sda] Attached SCSI disk
[    2.114729] EXT4-fs (sda2): mounted filesystem with ordered data mode. Opts: (null)
[    2.126843] random: fast init done
[    2.152027] usb 3-2.4.2: new full-speed USB device number 5 using xhci_hcd
[    2.280022] usb 3-2.4.2: New USB device found, idVendor=09fb, idProduct=6001, bcdDevice= 4.00
[    2.280024] usb 3-2.4.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    2.280025] usb 3-2.4.2: Product: USB-Blaster
[    2.280026] usb 3-2.4.2: Manufacturer: Altera
[    2.280026] usb 3-2.4.2: SerialNumber: 91d28408
[    2.280703] systemd[1]: systemd 239 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 +IDN -PCRE2 default-hierarchy=hybrid)
[    2.300259] systemd[1]: Detected architecture x86-64.
[    2.306849] systemd[1]: Set hostname to <ubuntu-MS-7A40>.
[    2.368033] usb 3-2.4.3: new full-speed USB device number 6 using xhci_hcd
[    2.423303] random: systemd: uninitialized urandom read (16 bytes read)
[    2.423375] systemd[1]: Listening on Syslog Socket.
[    2.423420] random: systemd: uninitialized urandom read (16 bytes read)
[    2.425187] systemd[1]: Created slice system-systemd\x2dfsck.slice.
[    2.425201] random: systemd: uninitialized urandom read (16 bytes read)
[    2.425269] systemd[1]: Listening on Journal Socket.
[    2.425331] systemd[1]: Listening on Journal Socket (/dev/log).
[    2.425424] systemd[1]: Listening on Journal Audit Socket.
[    2.425965] systemd[1]: Mounting Huge Pages File System...
[    2.426007] systemd[1]: Reached target User and Group Name Lookups.
[    2.449457] EXT4-fs (sda2): re-mounted. Opts: errors=remount-ro
[    2.451450] lp: driver loaded but no devices found
[    2.454623] ppdev: user-space parallel port driver
[    2.492018] usb 3-2.4.3: New USB device found, idVendor=045e, idProduct=07a5, bcdDevice= 7.97
[    2.492020] usb 3-2.4.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    2.492022] usb 3-2.4.3: Product: Microsoft® 2.4GHz Transceiver v9.0
[    2.492022] usb 3-2.4.3: Manufacturer: Microsoft
[    2.501458] systemd-journald[376]: Received request to flush runtime journal from PID 1
[    2.513445] Adding 2097148k swap on /swapfile.  Priority:-2 extents:6 across:2260988k SSFS
[    2.600295] input: Microsoft Microsoft® 2.4GHz Transceiver v9.0 as /devices/pci0000:00/0000:00:08.1/0000:38:00.3/usb3/3-2/3-2.4/3-2.4.3/3-2.4.3:1.0/0003:045E:07A5.0002/input/input4
[    2.664444] hid-generic 0003:045E:07A5.0002: input,hidraw1: USB HID v1.11 Keyboard [Microsoft Microsoft® 2.4GHz Transceiver v9.0] on usb-0000:38:00.3-2.4.3/input0
[    2.680097] input: Microsoft Microsoft® 2.4GHz Transceiver v9.0 Mouse as /devices/pci0000:00/0000:00:08.1/0000:38:00.3/usb3/3-2/3-2.4/3-2.4.3/3-2.4.3:1.1/0003:045E:07A5.0003/input/input5
[    2.680563] input: Microsoft Microsoft® 2.4GHz Transceiver v9.0 Consumer Control as /devices/pci0000:00/0000:00:08.1/0000:38:00.3/usb3/3-2/3-2.4/3-2.4.3/3-2.4.3:1.1/0003:045E:07A5.0003/input/input6
[    2.680644] hid-generic 0003:045E:07A5.0003: input,hidraw2: USB HID v1.11 Mouse [Microsoft Microsoft® 2.4GHz Transceiver v9.0] on usb-0000:38:00.3-2.4.3/input1
[    2.689721] input: Microsoft Microsoft® 2.4GHz Transceiver v9.0 Consumer Control as /devices/pci0000:00/0000:00:08.1/0000:38:00.3/usb3/3-2/3-2.4/3-2.4.3/3-2.4.3:1.2/0003:045E:07A5.0004/input/input7
[    2.694786] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[    2.695097] Bluetooth: Core ver 2.22
[    2.695115] NET: Registered protocol family 31
[    2.695115] Bluetooth: HCI device and connection manager initialized
[    2.695124] Bluetooth: HCI socket layer initialized
[    2.695127] Bluetooth: L2CAP socket layer initialized
[    2.695130] Bluetooth: SCO socket layer initialized
[    2.697230] cryptd: max_cpu_qlen set to 1000
[    2.701854] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[    2.704384] usbcore: registered new interface driver btusb
[    2.712853] AVX2 version of gcm_enc/dec engaged.
[    2.712855] AES CTR mode by8 optimization enabled
[    2.721336] Bluetooth: hci0: read Intel version: 370810225019140f00
[    2.722137] Bluetooth: hci0: Intel Bluetooth firmware file: intel/ibt-hw-37.8.10-fw-22.50.19.14.f.bseq
[    2.739665] Intel(R) Wireless WiFi driver for Linux
[    2.739666] Copyright(c) 2003- 2015 Intel Corporation
[    2.739750] iwlwifi 0000:1c:00.0: enabling device (0000 -> 0002)
[    2.743862] iwlwifi 0000:1c:00.0: loaded firmware version 29.1044073957.0 op_mode iwlmvm
[    2.749047] input: Microsoft Microsoft® 2.4GHz Transceiver v9.0 System Control as /devices/pci0000:00/0000:00:08.1/0000:38:00.3/usb3/3-2/3-2.4/3-2.4.3/3-2.4.3:1.2/0003:045E:07A5.0004/input/input8
[    2.749215] hid-generic 0003:045E:07A5.0004: input,hidraw3: USB HID v1.11 Device [Microsoft Microsoft® 2.4GHz Transceiver v9.0] on usb-0000:38:00.3-2.4.3/input2
[    2.782370] iwlwifi 0000:1c:00.0: Detected Intel(R) Dual Band Wireless AC 3168, REV=0x220
[    2.799848] iwlwifi 0000:1c:00.0: base HW address: 48:a4:72:bc:1f:79
[    2.829937] AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel <jroedel@suse.de>
[    2.840697] ieee80211 phy0: Selected rate control algorithm 'iwl-mvm-rs'
[    2.841060] thermal thermal_zone0: failed to read out thermal zone (-61)
[    2.843478] iwlwifi 0000:1c:00.0 wlp28s0: renamed from wlan0
[    2.872299] kvm: disabled by bios
[    2.875288] snd_hda_intel 0000:38:00.1: Handle vga_switcheroo audio client
[    2.875289] MCE: In-kernel MCE decoding enabled.
[    2.877529] EDAC amd64: Node 0: DRAM ECC disabled.
[    2.877530] EDAC amd64: ECC disabled in the BIOS or no ECC capability, module will not load.
                Either enable ECC checking or force module loading by setting 'ecc_enable_override'.
                (Note that use of the override may cause unknown side effects.)
[    2.884948] input: HD-Audio Generic HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:08.1/0000:38:00.1/sound/card0/input9
[    2.885015] input: HD-Audio Generic HDMI/DP,pcm=7 as /devices/pci0000:00/0000:00:08.1/0000:38:00.1/sound/card0/input10
[    2.896905] [drm] amdgpu kernel modesetting enabled.
[    2.896992] Parsing CRAT table with 1 nodes
[    2.896996] Creating topology SYSFS entries
[    2.897045] Topology: Add APU node [0x0:0x0]
[    2.897045] Finished initializing topology
[    2.897139] checking generic (e0000000 300000) vs hw (e0000000 10000000)
[    2.897140] fb0: switching to amdgpudrmfb from EFI VGA
[    2.897257] Console: switching to colour dummy device 80x25
[    2.897503] snd_hda_codec_realtek hdaudioC1D0: autoconfig for ALC887-VD: line_outs=1 (0x14/0x0/0x0/0x0/0x0) type:line
[    2.897506] snd_hda_codec_realtek hdaudioC1D0:    speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[    2.897508] snd_hda_codec_realtek hdaudioC1D0:    hp_outs=1 (0x1b/0x0/0x0/0x0/0x0)
[    2.897509] snd_hda_codec_realtek hdaudioC1D0:    mono: mono_out=0x0
[    2.897510] snd_hda_codec_realtek hdaudioC1D0:    inputs:
[    2.897512] snd_hda_codec_realtek hdaudioC1D0:      Front Mic=0x19
[    2.897513] snd_hda_codec_realtek hdaudioC1D0:      Rear Mic=0x18
[    2.897515] snd_hda_codec_realtek hdaudioC1D0:      Line=0x1a
[    2.897577] [drm] initializing kernel modesetting (RAVEN 0x1002:0x15DD 0x1462:0x7A40 0xC6).
[    2.897593] [drm] register mmio base: 0xFCB00000
[    2.897593] [drm] register mmio size: 524288
[    2.897622] [drm] add ip block number 0 <soc15_common>
[    2.897623] [drm] add ip block number 1 <gmc_v9_0>
[    2.897623] [drm] add ip block number 2 <vega10_ih>
[    2.897624] [drm] add ip block number 3 <psp>
[    2.897625] [drm] add ip block number 4 <gfx_v9_0>
[    2.897626] [drm] add ip block number 5 <sdma_v4_0>
[    2.897626] [drm] add ip block number 6 <powerplay>
[    2.897627] [drm] add ip block number 7 <dm>
[    2.897628] [drm] add ip block number 8 <vcn_v1_0>
[    2.899813] [drm] VCN decode is enabled in VM mode
[    2.899815] [drm] VCN encode is enabled in VM mode
[    2.899815] [drm] VCN jpeg decode is enabled in VM mode
[    2.913010] input: HD-Audio Generic Front Mic as /devices/pci0000:00/0000:00:08.1/0000:38:00.6/sound/card1/input11
[    2.913071] input: HD-Audio Generic Rear Mic as /devices/pci0000:00/0000:00:08.1/0000:38:00.6/sound/card1/input12
[    2.913116] input: HD-Audio Generic Line as /devices/pci0000:00/0000:00:08.1/0000:38:00.6/sound/card1/input13
[    2.913175] input: HD-Audio Generic Line Out as /devices/pci0000:00/0000:00:08.1/0000:38:00.6/sound/card1/input14
[    2.913232] input: HD-Audio Generic Front Headphone as /devices/pci0000:00/0000:00:08.1/0000:38:00.6/sound/card1/input15
[    2.922337] [drm] BIOS signature incorrect 0 0
[    2.922383] ATOM BIOS: 113-RAVEN-113
[    2.922425] [drm] vm size is 262144 GB, 4 levels, block size is 9-bit, fragment size is 9-bit
[    2.922434] amdgpu 0000:38:00.0: VRAM: 2048M 0x000000F400000000 - 0x000000F47FFFFFFF (2048M used)
[    2.922436] amdgpu 0000:38:00.0: GART: 1024M 0x0000000000000000 - 0x000000003FFFFFFF
[    2.922437] amdgpu 0000:38:00.0: AGP: 267419648M 0x000000F800000000 - 0x0000FFFFFFFFFFFF
[    2.922442] [drm] Detected VRAM RAM=2048M, BAR=2048M
[    2.922443] [drm] RAM width 128bits DDR4
[    2.922516] [TTM] Zone  kernel: Available graphics memory: 3054512 kiB
[    2.922517] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    2.922518] [TTM] Initializing pool allocator
[    2.922521] [TTM] Initializing DMA pool allocator
[    2.922586] [drm] amdgpu: 2048M of VRAM memory ready
[    2.922587] [drm] amdgpu: 3072M of GTT memory ready.
[    2.922612] [drm] GART: num cpu pages 262144, num gpu pages 262144
[    2.922779] [drm] PCIE GART of 1024M enabled (table at 0x000000F400300000).
[    2.929055] [drm] use_doorbell being set to: [true]
[    2.930880] [drm] Found VCN firmware Version: 1.73 Family ID: 18
[    2.930884] [drm] PSP loading VCN firmware
[    2.952031] [drm] reserve 0x400000 from 0xf400600000 for PSP TMR SIZE
[    2.997834] random: crng init done
[    2.997837] random: 7 urandom warning(s) missed due to ratelimiting
[    3.001005] EDAC amd64: Node 0: DRAM ECC disabled.
[    3.001007] EDAC amd64: ECC disabled in the BIOS or no ECC capability, module will not load.
                Either enable ECC checking or force module loading by setting 'ecc_enable_override'.
                (Note that use of the override may cause unknown side effects.)
[    3.133697] audit: type=1400 audit(1552568922.949:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/ippusbxd" pid=786 comm="apparmor_parser"
[    3.133825] audit: type=1400 audit(1552568922.949:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=782 comm="apparmor_parser"
[    3.133828] audit: type=1400 audit(1552568922.949:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=782 comm="apparmor_parser"
[    3.133830] audit: type=1400 audit(1552568922.949:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=782 comm="apparmor_parser"
[    3.134786] audit: type=1400 audit(1552568922.949:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine" pid=783 comm="apparmor_parser"
[    3.134791] audit: type=1400 audit(1552568922.949:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine//mount-namespace-capture-helper" pid=783 comm="apparmor_parser"
[    3.134793] audit: type=1400 audit(1552568922.949:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/cups-browsed" pid=784 comm="apparmor_parser"
[    3.137027] audit: type=1400 audit(1552568922.953:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/sbin/tcpdump" pid=788 comm="apparmor_parser"
[    3.137833] audit: type=1400 audit(1552568922.953:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/sbin/dhclient" pid=779 comm="apparmor_parser"
[    3.139494] [drm] DM_PPLIB: values for Invalid clock
[    3.139496] [drm] DM_PPLIB:	 400000 in kHz
[    3.139496] [drm] DM_PPLIB:	 933000 in kHz
[    3.139497] [drm] DM_PPLIB:	 1067000 in kHz
[    3.139497] [drm] DM_PPLIB:	 1200000 in kHz
[    3.139498] [drm] DM_PPLIB: values for Invalid clock
[    3.139499] [drm] DM_PPLIB:	 300000 in kHz
[    3.139499] [drm] DM_PPLIB:	 600000 in kHz
[    3.139500] [drm] DM_PPLIB:	 626000 in kHz
[    3.139500] [drm] DM_PPLIB:	 654000 in kHz
[    3.139801] [drm:construct [amdgpu]] *ERROR* construct: Invalid Connector ObjectID from Adapter Service for connector index:2! type 0 expected 3
[    3.220347] [drm] Display Core initialized with v3.2.08!
[    3.253175] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
[    3.253177] [drm] Driver supports precise vblank timestamp query.
[    3.267039] [drm] VCN decode and encode initialized successfully(under SPG Mode).
[    3.267854] kfd kfd: Allocated 3969056 bytes on gart
[    3.267875] Topology: Add APU node [0x15dd:0x1002]
[    3.268261] kfd kfd: added device 1002:15dd
[    3.270351] [drm] fb mappable at 0x60A00000
[    3.270353] [drm] vram apper at 0x60000000
[    3.270353] [drm] size 14745600
[    3.270354] [drm] fb depth is 24
[    3.270354] [drm]    pitch is 10240
[    3.270438] fbcon: amdgpudrmfb (fb0) is primary device
[    3.310436] Console: switching to colour frame buffer device 320x90
[    3.320360] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[    3.320361] Bluetooth: BNEP filters: protocol multicast
[    3.320364] Bluetooth: BNEP socket layer initialized
[    3.336761] amdgpu 0000:38:00.0: fb0: amdgpudrmfb frame buffer device
[    3.368264] amdgpu 0000:38:00.0: ring gfx uses VM inv eng 0 on hub 0
[    3.368266] amdgpu 0000:38:00.0: ring comp_1.0.0 uses VM inv eng 1 on hub 0
[    3.368268] amdgpu 0000:38:00.0: ring comp_1.1.0 uses VM inv eng 4 on hub 0
[    3.368269] amdgpu 0000:38:00.0: ring comp_1.2.0 uses VM inv eng 5 on hub 0
[    3.368271] amdgpu 0000:38:00.0: ring comp_1.3.0 uses VM inv eng 6 on hub 0
[    3.368272] amdgpu 0000:38:00.0: ring comp_1.0.1 uses VM inv eng 7 on hub 0
[    3.368274] amdgpu 0000:38:00.0: ring comp_1.1.1 uses VM inv eng 8 on hub 0
[    3.368275] amdgpu 0000:38:00.0: ring comp_1.2.1 uses VM inv eng 9 on hub 0
[    3.368277] amdgpu 0000:38:00.0: ring comp_1.3.1 uses VM inv eng 10 on hub 0
[    3.368278] amdgpu 0000:38:00.0: ring kiq_2.1.0 uses VM inv eng 11 on hub 0
[    3.368286] amdgpu 0000:38:00.0: ring sdma0 uses VM inv eng 0 on hub 1
[    3.368306] amdgpu 0000:38:00.0: ring vcn_dec uses VM inv eng 1 on hub 1
[    3.368314] amdgpu 0000:38:00.0: ring vcn_enc0 uses VM inv eng 4 on hub 1
[    3.368321] amdgpu 0000:38:00.0: ring vcn_enc1 uses VM inv eng 5 on hub 1
[    3.368327] amdgpu 0000:38:00.0: ring vcn_jpeg uses VM inv eng 6 on hub 1
[    3.416068] [drm] Initialized amdgpu 3.27.0 20150101 for 0000:38:00.0 on minor 0
[    3.479643] Generic PHY r8169-1b00:00: attached PHY driver [Generic PHY] (mii_bus:phy_addr=r8169-1b00:00, irq=IGNORE)
[    3.587033] r8169 0000:1b:00.0 enp27s0: Link is Down
[    4.280701] Bluetooth: hci0: Intel firmware patch completed and activated
[    7.440392] r8169 0000:1b:00.0 enp27s0: Link is Up - 1Gbps/Full - flow control rx/tx
[    7.440405] IPv6: ADDRCONF(NETDEV_CHANGE): enp27s0: link becomes ready
[   13.957115] Bluetooth: RFCOMM TTY layer initialized
[   13.957121] Bluetooth: RFCOMM socket layer initialized
[   13.957130] Bluetooth: RFCOMM ver 1.11
[   14.839649] rfkill: input handler disabled
[  129.514574] amdgpu: [powerplay] pp_dpm_switch_power_profile was not implemented.
[  146.212767] amdgpu: [powerplay] pp_dpm_switch_power_profile was not implemented.

[-- Attachment #4: dmidecode_MSI_b450.txt --]
[-- Type: text/plain, Size: 16495 bytes --]

# dmidecode 3.1
Getting SMBIOS data from sysfs.
SMBIOS 2.8 present.
55 structures occupying 2269 bytes.
Table at 0x000E6CF0.

Handle 0x0000, DMI type 0, 26 bytes
BIOS Information
	Vendor: American Megatrends Inc.
	Version: A.60
	Release Date: 03/06/2019
	Address: 0xF0000
	Runtime Size: 64 kB
	ROM Size: 16 MB
	Characteristics:
		PCI is supported
		BIOS is upgradeable
		BIOS shadowing is allowed
		Boot from CD is supported
		Selectable boot is supported
		BIOS ROM is socketed
		EDD is supported
		5.25"/1.2 MB floppy services are supported (int 13h)
		3.5"/720 kB floppy services are supported (int 13h)
		3.5"/2.88 MB floppy services are supported (int 13h)
		Print screen service is supported (int 5h)
		8042 keyboard services are supported (int 9h)
		Serial services are supported (int 14h)
		Printer services are supported (int 17h)
		ACPI is supported
		USB legacy is supported
		BIOS boot specification is supported
		Targeted content distribution is supported
		UEFI is supported
	BIOS Revision: 5.14

Handle 0x0001, DMI type 1, 27 bytes
System Information
	Manufacturer: Micro-Star International Co., Ltd.
	Product Name: MS-7A40
	Version: 2.0
	Serial Number: To be filled by O.E.M.
	UUID: 00000000-0000-0000-0000-00D8610EDD4B
	Wake-up Type: Power Switch
	SKU Number: To be filled by O.E.M.
	Family: To be filled by O.E.M.

Handle 0x0002, DMI type 2, 15 bytes
Base Board Information
	Manufacturer: Micro-Star International Co., Ltd.
	Product Name: B450I GAMING PLUS AC (MS-7A40)
	Version: 2.0
	Serial Number: IA16015546
	Asset Tag: To be filled by O.E.M.
	Features:
		Board is a hosting board
		Board is replaceable
	Location In Chassis: To be filled by O.E.M.
	Chassis Handle: 0x0003
	Type: Motherboard
	Contained Object Handles: 0

Handle 0x0003, DMI type 3, 22 bytes
Chassis Information
	Manufacturer: Micro-Star International Co., Ltd.
	Type: Desktop
	Lock: Not Present
	Version: 2.0
	Serial Number: To be filled by O.E.M.
	Asset Tag: To be filled by O.E.M.
	Boot-up State: Safe
	Power Supply State: Safe
	Thermal State: Safe
	Security Status: None
	OEM Information: 0x00000000
	Height: Unspecified
	Number Of Power Cords: 1
	Contained Elements: 0
	SKU Number: To be filled by O.E.M.

Handle 0x0004, DMI type 9, 17 bytes
System Slot Information
	Designation: J6B2
	Type: x16 PCI Express
	Current Usage: In Use
	Length: Long
	ID: 0
	Characteristics:
		3.3 V is provided
		Opening is shared
		PME signal is supported
	Bus Address: 0000:00:01.0

Handle 0x0005, DMI type 9, 17 bytes
System Slot Information
	Designation: J6B1
	Type: x1 PCI Express
	Current Usage: In Use
	Length: Short
	ID: 1
	Characteristics:
		3.3 V is provided
		Opening is shared
		PME signal is supported
	Bus Address: 0000:00:1c.3

Handle 0x0006, DMI type 9, 17 bytes
System Slot Information
	Designation: J6D1
	Type: x1 PCI Express
	Current Usage: In Use
	Length: Short
	ID: 2
	Characteristics:
		3.3 V is provided
		Opening is shared
		PME signal is supported
	Bus Address: 0000:00:1c.4

Handle 0x0007, DMI type 9, 17 bytes
System Slot Information
	Designation: J7B1
	Type: x1 PCI Express
	Current Usage: In Use
	Length: Short
	ID: 3
	Characteristics:
		3.3 V is provided
		Opening is shared
		PME signal is supported
	Bus Address: 0000:00:1c.5

Handle 0x0008, DMI type 9, 17 bytes
System Slot Information
	Designation: J8B4
	Type: x1 PCI Express
	Current Usage: In Use
	Length: Short
	ID: 4
	Characteristics:
		3.3 V is provided
		Opening is shared
		PME signal is supported
	Bus Address: 0000:00:1c.6

Handle 0x0009, DMI type 9, 17 bytes
System Slot Information
	Designation: J8D1
	Type: x1 PCI Express
	Current Usage: In Use
	Length: Short
	ID: 5
	Characteristics:
		3.3 V is provided
		Opening is shared
		PME signal is supported
	Bus Address: 0000:00:1c.7

Handle 0x000A, DMI type 9, 17 bytes
System Slot Information
	Designation: J8B3
	Type: 32-bit PCI
	Current Usage: In Use
	Length: Short
	ID: 6
	Characteristics:
		3.3 V is provided
		Opening is shared
		PME signal is supported
	Bus Address: 0000:00:1e.0

Handle 0x000B, DMI type 11, 5 bytes
OEM Strings
	String 1: To be filled by O.E.M.

Handle 0x000C, DMI type 12, 5 bytes
System Configuration Options
	Option 1: To be filled by O.E.M.

Handle 0x000D, DMI type 32, 20 bytes
System Boot Information
	Status: No errors detected

Handle 0x000E, DMI type 18, 23 bytes
32-bit Memory Error Information
	Type: OK
	Granularity: Unknown
	Operation: Unknown
	Vendor Syndrome: Unknown
	Memory Array Address: Unknown
	Device Address: Unknown
	Resolution: Unknown

Handle 0x000F, DMI type 16, 23 bytes
Physical Memory Array
	Location: System Board Or Motherboard
	Use: System Memory
	Error Correction Type: None
	Maximum Capacity: 256 GB
	Error Information Handle: 0x000E
	Number Of Devices: 2

Handle 0x0010, DMI type 19, 31 bytes
Memory Array Mapped Address
	Starting Address: 0x00000000000
	Ending Address: 0x001FFFFFFFF
	Range Size: 8 GB
	Physical Array Handle: 0x000F
	Partition Width: 2

Handle 0x0011, DMI type 7, 19 bytes
Cache Information
	Socket Designation: L1 - Cache
	Configuration: Enabled, Not Socketed, Level 1
	Operational Mode: Write Back
	Location: Internal
	Installed Size: 384 kB
	Maximum Size: 384 kB
	Supported SRAM Types:
		Pipeline Burst
	Installed SRAM Type: Pipeline Burst
	Speed: 1 ns
	Error Correction Type: Multi-bit ECC
	System Type: Unified
	Associativity: 8-way Set-associative

Handle 0x0012, DMI type 7, 19 bytes
Cache Information
	Socket Designation: L2 - Cache
	Configuration: Enabled, Not Socketed, Level 2
	Operational Mode: Write Back
	Location: Internal
	Installed Size: 2048 kB
	Maximum Size: 2048 kB
	Supported SRAM Types:
		Pipeline Burst
	Installed SRAM Type: Pipeline Burst
	Speed: 1 ns
	Error Correction Type: Multi-bit ECC
	System Type: Unified
	Associativity: 8-way Set-associative

Handle 0x0013, DMI type 7, 19 bytes
Cache Information
	Socket Designation: L3 - Cache
	Configuration: Enabled, Not Socketed, Level 3
	Operational Mode: Write Back
	Location: Internal
	Installed Size: 4096 kB
	Maximum Size: 4096 kB
	Supported SRAM Types:
		Pipeline Burst
	Installed SRAM Type: Pipeline Burst
	Speed: 1 ns
	Error Correction Type: Multi-bit ECC
	System Type: Unified
	Associativity: 16-way Set-associative

Handle 0x0014, DMI type 4, 48 bytes
Processor Information
	Socket Designation: AM4
	Type: Central Processor
	Family: Zen
	Manufacturer: Advanced Micro Devices, Inc.
	ID: 10 0F 81 00 FF FB 8B 17
	Signature: Family 23, Model 17, Stepping 0
	Flags:
		FPU (Floating-point unit on-chip)
		VME (Virtual mode extension)
		DE (Debugging extension)
		PSE (Page size extension)
		TSC (Time stamp counter)
		MSR (Model specific registers)
		PAE (Physical address extension)
		MCE (Machine check exception)
		CX8 (CMPXCHG8 instruction supported)
		APIC (On-chip APIC hardware supported)
		SEP (Fast system call)
		MTRR (Memory type range registers)
		PGE (Page global enable)
		MCA (Machine check architecture)
		CMOV (Conditional move instruction supported)
		PAT (Page attribute table)
		PSE-36 (36-bit page size extension)
		CLFSH (CLFLUSH instruction supported)
		MMX (MMX technology supported)
		FXSR (FXSAVE and FXSTOR instructions supported)
		SSE (Streaming SIMD extensions)
		SSE2 (Streaming SIMD extensions 2)
		HTT (Multi-threading)
	Version: AMD Ryzen 5 2400G with Radeon Vega Graphics    
	Voltage: 1.5 V
	External Clock: 100 MHz
	Max Speed: 3900 MHz
	Current Speed: 3600 MHz
	Status: Populated, Enabled
	Upgrade: Socket AM4
	L1 Cache Handle: 0x0011
	L2 Cache Handle: 0x0012
	L3 Cache Handle: 0x0013
	Serial Number: Unknown
	Asset Tag: Unknown
	Part Number: Unknown
	Core Count: 4
	Core Enabled: 4
	Thread Count: 8
	Characteristics:
		64-bit capable
		Multi-Core
		Hardware Thread
		Execute Protection
		Enhanced Virtualization
		Power/Performance Control

Handle 0x0015, DMI type 18, 23 bytes
32-bit Memory Error Information
	Type: OK
	Granularity: Unknown
	Operation: Unknown
	Vendor Syndrome: Unknown
	Memory Array Address: Unknown
	Device Address: Unknown
	Resolution: Unknown

Handle 0x0016, DMI type 17, 40 bytes
Memory Device
	Array Handle: 0x000F
	Error Information Handle: 0x0015
	Total Width: 64 bits
	Data Width: 64 bits
	Size: 4096 MB
	Form Factor: DIMM
	Set: None
	Locator: DIMM 0
	Bank Locator: P0 CHANNEL A
	Type: DDR4
	Type Detail: Synchronous Unbuffered (Unregistered)
	Speed: 2400 MT/s
	Manufacturer: Unknown
	Serial Number: 1D56DA8C
	Asset Tag: Not Specified
	Part Number: CT4G4DFS824A.C8FBD2 
	Rank: 1
	Configured Clock Speed: 1200 MT/s
	Minimum Voltage: 1.2 V
	Maximum Voltage: 1.2 V
	Configured Voltage: 1.2 V

Handle 0x0017, DMI type 20, 35 bytes
Memory Device Mapped Address
	Starting Address: 0x00000000000
	Ending Address: 0x001FFFFFFFF
	Range Size: 8 GB
	Physical Device Handle: 0x0016
	Memory Array Mapped Address Handle: 0x0010
	Partition Row Position: Unknown
	Interleave Position: Unknown
	Interleaved Data Depth: Unknown

Handle 0x0018, DMI type 18, 23 bytes
32-bit Memory Error Information
	Type: OK
	Granularity: Unknown
	Operation: Unknown
	Vendor Syndrome: Unknown
	Memory Array Address: Unknown
	Device Address: Unknown
	Resolution: Unknown

Handle 0x0019, DMI type 17, 40 bytes
Memory Device
	Array Handle: 0x000F
	Error Information Handle: 0x0018
	Total Width: 64 bits
	Data Width: 64 bits
	Size: 4096 MB
	Form Factor: DIMM
	Set: None
	Locator: DIMM 0
	Bank Locator: P0 CHANNEL B
	Type: DDR4
	Type Detail: Synchronous Unbuffered (Unregistered)
	Speed: 2400 MT/s
	Manufacturer: Unknown
	Serial Number: 1D56DCA6
	Asset Tag: Not Specified
	Part Number: CT4G4DFS824A.C8FBD2 
	Rank: 1
	Configured Clock Speed: 1200 MT/s
	Minimum Voltage: 1.2 V
	Maximum Voltage: 1.2 V
	Configured Voltage: 1.2 V

Handle 0x001A, DMI type 20, 35 bytes
Memory Device Mapped Address
	Starting Address: 0x00000000000
	Ending Address: 0x001FFFFFFFF
	Range Size: 8 GB
	Physical Device Handle: 0x0019
	Memory Array Mapped Address Handle: 0x0010
	Partition Row Position: Unknown
	Interleave Position: Unknown
	Interleaved Data Depth: Unknown

Handle 0x001B, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1500
	Internal Connector Type: None
	External Reference Designator: USB 3.0
	External Connector Type: Access Bus (USB)
	Port Type: USB

Handle 0x001C, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1501
	Internal Connector Type: None
	External Reference Designator: USB 3.0
	External Connector Type: Access Bus (USB)
	Port Type: USB

Handle 0x001D, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1502
	Internal Connector Type: None
	External Reference Designator: USB-C
	External Connector Type: Access Bus (USB)
	Port Type: USB

Handle 0x001E, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1503
	Internal Connector Type: None
	External Reference Designator: USB 3.0
	External Connector Type: Access Bus (USB)
	Port Type: USB

Handle 0x001F, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1504
	Internal Connector Type: None
	External Reference Designator: USB 3.1
	External Connector Type: Access Bus (USB)
	Port Type: USB

Handle 0x0020, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1503
	Internal Connector Type: None
	External Reference Designator: Network
	External Connector Type: RJ-45
	Port Type: Network Port

Handle 0x0021, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1704
	Internal Connector Type: SAS/SATA Plug Receptacle
	External Reference Designator: Sata Express
	External Connector Type: None
	Port Type: SATA

Handle 0x0022, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1705
	Internal Connector Type: SAS/SATA Plug Receptacle
	External Reference Designator: Sata Express
	External Connector Type: None
	Port Type: SATA

Handle 0x0023, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1701
	Internal Connector Type: SAS/SATA Plug Receptacle
	External Reference Designator: iSATA
	External Connector Type: None
	Port Type: SATA

Handle 0x0024, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1702
	Internal Connector Type: SAS/SATA Plug Receptacle
	External Reference Designator: iSATA
	External Connector Type: None
	Port Type: SATA

Handle 0x0025, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1703
	Internal Connector Type: SAS/SATA Plug Receptacle
	External Reference Designator: iSATA
	External Connector Type: None
	Port Type: SATA

Handle 0x0026, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1706
	Internal Connector Type: SAS/SATA Plug Receptacle
	External Reference Designator: iSATA
	External Connector Type: None
	Port Type: SATA

Handle 0x0027, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1100
	Internal Connector Type: None
	External Reference Designator: HDMI
	External Connector Type: None
	Port Type: Video Port

Handle 0x0028, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1101
	Internal Connector Type: None
	External Reference Designator: HDMI
	External Connector Type: None
	Port Type: Video Port

Handle 0x0029, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1102
	Internal Connector Type: None
	External Reference Designator: DP
	External Connector Type: None
	Port Type: Video Port

Handle 0x002A, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J2100
	Internal Connector Type: None
	External Reference Designator: Front Audio
	External Connector Type: Mini Jack (headphones)
	Port Type: Audio Port

Handle 0x002B, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J2101
	Internal Connector Type: None
	External Reference Designator: Audio Jack
	External Connector Type: Mini Jack (headphones)
	Port Type: Audio Port

Handle 0x002C, DMI type 8, 9 bytes
Port Connector Information
	Internal Reference Designator: J1700
	Internal Connector Type: SAS/SATA Plug Receptacle
	External Reference Designator: Sata Express
	External Connector Type: None
	Port Type: SATA

Handle 0x002D, DMI type 9, 17 bytes
System Slot Information
	Designation: J10
	Type: x8 PCI Express x16
	Current Usage: Available
	Length: Short
	ID: 48
	Characteristics:
		3.3 V is provided
		PME signal is supported
	Bus Address: 0000:00:1f.7

Handle 0x002E, DMI type 9, 17 bytes
System Slot Information
	Designation: J3600 Pcie x8 slot
	Type: x8 PCI Express x8
	Current Usage: Other
	Length: Short
	ID: 32
	Characteristics:
		3.3 V is provided
		PME signal is supported
	Bus Address: 0000:00:1f.7

Handle 0x002F, DMI type 9, 17 bytes
System Slot Information
	Designation: J3707 Pcie x4 slot
	Type: x4 PCI Express x4
	Current Usage: Other
	Length: Short
	ID: 33
	Characteristics:
		3.3 V is provided
		PME signal is supported
	Bus Address: 0000:00:1f.7

Handle 0x0030, DMI type 9, 17 bytes
System Slot Information
	Designation: J3700 PCIE x4 slot from Promontory
	Type: x4 PCI Express x4
	Current Usage: In Use
	Length: Short
	ID: 20
	Characteristics:
		3.3 V is provided
		PME signal is supported
	Bus Address: 0000:16:04.0

Handle 0x0031, DMI type 9, 17 bytes
System Slot Information
	Designation: J3702 PCIE x1 slot from Promontory
	Type: x1 PCI Express x1
	Current Usage: In Use
	Length: Short
	ID: 19
	Characteristics:
		3.3 V is provided
		PME signal is supported
	Bus Address: 0000:15:00.2

Handle 0x0032, DMI type 9, 17 bytes
System Slot Information
	Designation: J3703 PCIE x1 slot from Promontory
	Type: x1 PCI Express x1
	Current Usage: In Use
	Length: Short
	ID: 18
	Characteristics:
		3.3 V is provided
		PME signal is supported
	Bus Address: 0000:15:00.2

Handle 0x0033, DMI type 9, 17 bytes
System Slot Information
	Designation: J3701 M.2 WLAN/BT slot
	Type: x1 PCI Express x1
	Current Usage: Available
	Length: Short
	ID: 17
	Characteristics:
		3.3 V is provided
		PME signal is supported
	Bus Address: 0000:00:1f.7

Handle 0x0034, DMI type 41, 11 bytes
Onboard Device
	Reference Designation: Broadcom 5762
	Type: Ethernet
	Status: Enabled
	Type Instance: 1
	Bus Address: 0000:16:00.0

Handle 0x0035, DMI type 143, 16 bytes
OEM-specific Type
	Header and Data:
		8F 10 35 00 00 01 02 03 04 05 06 07 08 09 0A 0B
	Strings:
		VBIOS-0000
		RAID-14.8.0.1042
		PXEL1-v2.1.1.5
		AMI-AptioV
		GSES-5/1
		RavenPI-RAVEN_PI_VERSION
		N/A
		N/A
		N/A
		N/A
		N/A
		N/A

Handle 0x0036, DMI type 127, 4 bytes
End Of Table


[-- Attachment #5: clinfo_ASROCK_b450.txt --]
[-- Type: text/plain, Size: 4077 bytes --]

Number of platforms:				 1
  Platform Profile:				 FULL_PROFILE
  Platform Version:				 OpenCL 2.1 AMD-APP (2833.0)
  Platform Name:				 AMD Accelerated Parallel Processing
  Platform Vendor:				 Advanced Micro Devices, Inc.
  Platform Extensions:				 cl_khr_icd cl_amd_event_callback cl_amd_offline_devices 


  Platform Name:				 AMD Accelerated Parallel Processing
Number of devices:				 1
  Device Type:					 CL_DEVICE_TYPE_GPU
  Vendor ID:					 1002h
  Board name:					 AMD Ryzen 5 2400GE with Radeon Vega Graphics
  Device Topology:				 PCI[ B#56, D#0, F#0 ]
  Max compute units:				 11
  Max work items dimensions:			 3
    Max work items[0]:				 1024
    Max work items[1]:				 1024
    Max work items[2]:				 1024
  Max work group size:				 256
  Preferred vector width char:			 4
  Preferred vector width short:			 2
  Preferred vector width int:			 1
  Preferred vector width long:			 1
  Preferred vector width float:			 1
  Preferred vector width double:		 1
  Native vector width char:			 4
  Native vector width short:			 2
  Native vector width int:			 1
  Native vector width long:			 1
  Native vector width float:			 1
  Native vector width double:			 1
  Max clock frequency:				 1250Mhz
  Address bits:					 64
  Max memory allocation:			 6245617868
  Image support:				 Yes
  Max number of images read arguments:		 128
  Max number of images write arguments:		 8
  Max image 2D width:				 16384
  Max image 2D height:				 16384
  Max image 3D width:				 2048
  Max image 3D height:				 2048
  Max image 3D depth:				 2048
  Max samplers within kernel:			 5597
  Max size of kernel argument:			 1024
  Alignment (bits) of base address:		 1024
  Minimum alignment (bytes) for any datatype:	 128
  Single precision floating point capability
    Denorms:					 Yes
    Quiet NaNs:					 Yes
    Round to nearest even:			 Yes
    Round to zero:				 Yes
    Round to +ve and infinity:			 Yes
    IEEE754-2008 fused multiply-add:		 Yes
  Cache type:					 Read/Write
  Cache line size:				 64
  Cache size:					 16384
  Global memory size:				 7347785728
  Constant buffer size:				 6245617868
  Max number of constant args:			 8
  Local memory type:				 Scratchpad
  Local memory size:				 65536
  Max pipe arguments:				 16
  Max pipe active reservations:			 16
  Max pipe packet size:				 1950650572
  Max global variable size:			 6245617868
  Max global variable preferred total size:	 7347785728
  Max read/write image args:			 64
  Max on device events:				 1024
  Queue on device max size:			 8388608
  Max on device queues:				 1
  Queue on device preferred size:		 262144
  SVM capabilities:				 
    Coarse grain buffer:			 Yes
    Fine grain buffer:				 Yes
    Fine grain system:				 Yes
    Atomics:					 No
  Preferred platform atomic alignment:		 0
  Preferred global atomic alignment:		 0
  Preferred local atomic alignment:		 0
  Kernel Preferred work group size multiple:	 64
  Error correction support:			 0
  Unified memory for Host and Device:		 1
  Profiling timer resolution:			 1
  Device endianess:				 Little
  Available:					 Yes
  Compiler available:				 Yes
  Execution capabilities:				 
    Execute OpenCL kernels:			 Yes
    Execute native function:			 No
  Queue on Host properties:				 
    Out-of-Order:				 No
    Profiling :					 Yes
  Queue on Device properties:				 
    Out-of-Order:				 Yes
    Profiling :					 Yes
  Platform ID:					 0x7f37f3e33f70
  Name:						 gfx902-xnack
  Vendor:					 Advanced Micro Devices, Inc.
  Device OpenCL C version:			 OpenCL C 2.0 
  Driver version:				 2833.0 (HSA1.1,LC)
  Profile:					 FULL_PROFILE
  Version:					 OpenCL 1.2 
  Extensions:					 cl_khr_fp64 cl_khr_global_int32_base_atomics cl_khr_global_int32_extended_atomics cl_khr_local_int32_base_atomics cl_khr_local_int32_extended_atomics cl_khr_int64_base_atomics cl_khr_int64_extended_atomics cl_khr_3d_image_writes cl_khr_byte_addressable_store cl_khr_fp16 cl_khr_gl_sharing cl_amd_device_attribute_query cl_amd_media_ops cl_amd_media_ops2 cl_khr_subgroups cl_khr_depth_images cl_amd_copy_buffer_p2p cl_amd_assembly_program 



[-- Attachment #6: dmidecode_ASROCK_b450.txt --]
[-- Type: text/plain, Size: 8744 bytes --]

# dmidecode 3.1
Getting SMBIOS data from sysfs.
SMBIOS 3.0.0 present.
Table at 0x000E94F0.

Handle 0x0000, DMI type 0, 24 bytes
BIOS Information
	Vendor: American Megatrends Inc.
	Version: P1.70
	Release Date: 12/17/2018
	Address: 0xF0000
	Runtime Size: 64 kB
	ROM Size: 16 MB
	Characteristics:
		PCI is supported
		BIOS is upgradeable
		BIOS shadowing is allowed
		Boot from CD is supported
		Selectable boot is supported
		BIOS ROM is socketed
		EDD is supported
		5.25"/1.2 MB floppy services are supported (int 13h)
		3.5"/720 kB floppy services are supported (int 13h)
		3.5"/2.88 MB floppy services are supported (int 13h)
		Print screen service is supported (int 5h)
		8042 keyboard services are supported (int 9h)
		Serial services are supported (int 14h)
		Printer services are supported (int 17h)
		ACPI is supported
		USB legacy is supported
		BIOS boot specification is supported
		Targeted content distribution is supported
		UEFI is supported
	BIOS Revision: 5.13

Handle 0x0001, DMI type 1, 27 bytes
System Information
	Manufacturer: To Be Filled By O.E.M.
	Product Name: To Be Filled By O.E.M.
	Version: To Be Filled By O.E.M.
	Serial Number: To Be Filled By O.E.M.
	UUID: 03000200-0400-0500-0006-000700080009
	Wake-up Type: Power Switch
	SKU Number: To Be Filled By O.E.M.
	Family: To Be Filled By O.E.M.

Handle 0x0002, DMI type 2, 15 bytes
Base Board Information
	Manufacturer: ASRock
	Product Name: B450 Gaming-ITX/ac
	Version:                       
	Serial Number: M80-B8019100746
	Asset Tag:                       
	Features:
		Board is a hosting board
		Board is replaceable
	Location In Chassis:                       
	Chassis Handle: 0x0003
	Type: Motherboard
	Contained Object Handles: 0

Handle 0x0003, DMI type 3, 22 bytes
Chassis Information
	Manufacturer: To Be Filled By O.E.M.
	Type: Desktop
	Lock: Not Present
	Version: To Be Filled By O.E.M.
	Serial Number: To Be Filled By O.E.M.
	Asset Tag: To Be Filled By O.E.M.
	Boot-up State: Safe
	Power Supply State: Safe
	Thermal State: Safe
	Security Status: None
	OEM Information: 0x00000000
	Height: Unspecified
	Number Of Power Cords: 1
	Contained Elements: 0
	SKU Number: To be filled by O.E.M.

Handle 0x0004, DMI type 9, 17 bytes
System Slot Information
	Designation: PCIE1
	Type: x16 PCI Express
	Current Usage: Available
	Length: Long
	ID: 17
	Characteristics:
		3.3 V is provided
		Opening is shared
		PME signal is supported
	Bus Address: 0000:ff:00.0

Handle 0x0005, DMI type 9, 17 bytes
System Slot Information
	Designation: PCIE2_M2_1
	Type: x4 PCI Express
	Current Usage: Available
	Length: Short
	ID: 18
	Characteristics:
		3.3 V is provided
		Opening is shared
		PME signal is supported
	Bus Address: 0000:ff:00.0

Handle 0x0006, DMI type 11, 5 bytes
OEM Strings
	String 1: To Be Filled By O.E.M.

Handle 0x0007, DMI type 32, 20 bytes
System Boot Information
	Status: No errors detected

Handle 0x0008, DMI type 40, 14 bytes
Additional Information 1
	Referenced Handle: 0x00a1
	Referenced Offset: 0x01
	String: MORDOR
	Value: 0x00000000

Handle 0x0009, DMI type 18, 23 bytes
32-bit Memory Error Information
	Type: OK
	Granularity: Unknown
	Operation: Unknown
	Vendor Syndrome: Unknown
	Memory Array Address: Unknown
	Device Address: Unknown
	Resolution: Unknown

Handle 0x000A, DMI type 16, 23 bytes
Physical Memory Array
	Location: System Board Or Motherboard
	Use: System Memory
	Error Correction Type: None
	Maximum Capacity: 256 GB
	Error Information Handle: 0x0009
	Number Of Devices: 2

Handle 0x000B, DMI type 19, 31 bytes
Memory Array Mapped Address
	Starting Address: 0x00000000000
	Ending Address: 0x003FFFFFFFF
	Range Size: 16 GB
	Physical Array Handle: 0x000A
	Partition Width: 2

Handle 0x000C, DMI type 7, 19 bytes
Cache Information
	Socket Designation: L1 - Cache
	Configuration: Enabled, Not Socketed, Level 1
	Operational Mode: Write Back
	Location: Internal
	Installed Size: 384 kB
	Maximum Size: 384 kB
	Supported SRAM Types:
		Pipeline Burst
	Installed SRAM Type: Pipeline Burst
	Speed: 1 ns
	Error Correction Type: Multi-bit ECC
	System Type: Unified
	Associativity: 8-way Set-associative

Handle 0x000D, DMI type 7, 19 bytes
Cache Information
	Socket Designation: L2 - Cache
	Configuration: Enabled, Not Socketed, Level 2
	Operational Mode: Write Back
	Location: Internal
	Installed Size: 2048 kB
	Maximum Size: 2048 kB
	Supported SRAM Types:
		Pipeline Burst
	Installed SRAM Type: Pipeline Burst
	Speed: 1 ns
	Error Correction Type: Multi-bit ECC
	System Type: Unified
	Associativity: 8-way Set-associative

Handle 0x000E, DMI type 7, 19 bytes
Cache Information
	Socket Designation: L3 - Cache
	Configuration: Enabled, Not Socketed, Level 3
	Operational Mode: Write Back
	Location: Internal
	Installed Size: 4096 kB
	Maximum Size: 4096 kB
	Supported SRAM Types:
		Pipeline Burst
	Installed SRAM Type: Pipeline Burst
	Speed: 1 ns
	Error Correction Type: Multi-bit ECC
	System Type: Unified
	Associativity: 16-way Set-associative

Handle 0x000F, DMI type 4, 48 bytes
Processor Information
	Socket Designation: AM4
	Type: Central Processor
	Family: Zen
	Manufacturer: Advanced Micro Devices, Inc.
	ID: 10 0F 81 00 FF FB 8B 17
	Signature: Family 23, Model 17, Stepping 0
	Flags:
		FPU (Floating-point unit on-chip)
		VME (Virtual mode extension)
		DE (Debugging extension)
		PSE (Page size extension)
		TSC (Time stamp counter)
		MSR (Model specific registers)
		PAE (Physical address extension)
		MCE (Machine check exception)
		CX8 (CMPXCHG8 instruction supported)
		APIC (On-chip APIC hardware supported)
		SEP (Fast system call)
		MTRR (Memory type range registers)
		PGE (Page global enable)
		MCA (Machine check architecture)
		CMOV (Conditional move instruction supported)
		PAT (Page attribute table)
		PSE-36 (36-bit page size extension)
		CLFSH (CLFLUSH instruction supported)
		MMX (MMX technology supported)
		FXSR (FXSAVE and FXSTOR instructions supported)
		SSE (Streaming SIMD extensions)
		SSE2 (Streaming SIMD extensions 2)
		HTT (Multi-threading)
	Version: AMD Ryzen 5 2400GE with Radeon Vega Graphics   
	Voltage: 1.4 V
	External Clock: 100 MHz
	Max Speed: 3800 MHz
	Current Speed: 3200 MHz
	Status: Populated, Enabled
	Upgrade: Socket AM4
	L1 Cache Handle: 0x000C
	L2 Cache Handle: 0x000D
	L3 Cache Handle: 0x000E
	Serial Number: Unknown
	Asset Tag: Unknown
	Part Number: Unknown
	Core Count: 4
	Core Enabled: 4
	Thread Count: 8
	Characteristics:
		64-bit capable
		Multi-Core
		Hardware Thread
		Execute Protection
		Enhanced Virtualization
		Power/Performance Control

Handle 0x0010, DMI type 18, 23 bytes
32-bit Memory Error Information
	Type: OK
	Granularity: Unknown
	Operation: Unknown
	Vendor Syndrome: Unknown
	Memory Array Address: Unknown
	Device Address: Unknown
	Resolution: Unknown

Handle 0x0011, DMI type 17, 40 bytes
Memory Device
	Array Handle: 0x000A
	Error Information Handle: 0x0010
	Total Width: 64 bits
	Data Width: 64 bits
	Size: 8192 MB
	Form Factor: DIMM
	Set: None
	Locator: DIMM 0
	Bank Locator: P0 CHANNEL A
	Type: DDR4
	Type Detail: Synchronous Unbuffered (Unregistered)
	Speed: 2134 MT/s
	Manufacturer: Unknown
	Serial Number: 00000000
	Asset Tag: Not Specified
	Part Number: F4-3200C16-8GVGB
	Rank: 1
	Configured Clock Speed: 1067 MT/s
	Minimum Voltage: 1.2 V
	Maximum Voltage: 1.2 V
	Configured Voltage: 1.2 V

Handle 0x0012, DMI type 20, 35 bytes
Memory Device Mapped Address
	Starting Address: 0x00000000000
	Ending Address: 0x003FFFFFFFF
	Range Size: 16 GB
	Physical Device Handle: 0x0011
	Memory Array Mapped Address Handle: 0x000B
	Partition Row Position: Unknown
	Interleave Position: Unknown
	Interleaved Data Depth: Unknown

Handle 0x0013, DMI type 18, 23 bytes
32-bit Memory Error Information
	Type: OK
	Granularity: Unknown
	Operation: Unknown
	Vendor Syndrome: Unknown
	Memory Array Address: Unknown
	Device Address: Unknown
	Resolution: Unknown

Handle 0x0014, DMI type 17, 40 bytes
Memory Device
	Array Handle: 0x000A
	Error Information Handle: 0x0013
	Total Width: 64 bits
	Data Width: 64 bits
	Size: 8192 MB
	Form Factor: DIMM
	Set: None
	Locator: DIMM 0
	Bank Locator: P0 CHANNEL B
	Type: DDR4
	Type Detail: Synchronous Unbuffered (Unregistered)
	Speed: 2134 MT/s
	Manufacturer: Unknown
	Serial Number: 00000000
	Asset Tag: Not Specified
	Part Number: F4-3200C16-8GVGB
	Rank: 1
	Configured Clock Speed: 1067 MT/s
	Minimum Voltage: 1.2 V
	Maximum Voltage: 1.2 V
	Configured Voltage: 1.2 V

Handle 0x0015, DMI type 20, 35 bytes
Memory Device Mapped Address
	Starting Address: 0x00000000000
	Ending Address: 0x003FFFFFFFF
	Range Size: 16 GB
	Physical Device Handle: 0x0014
	Memory Array Mapped Address Handle: 0x000B
	Partition Row Position: Unknown
	Interleave Position: Unknown
	Interleaved Data Depth: Unknown

Handle 0x0016, DMI type 127, 4 bytes
End Of Table


[-- Attachment #7: dmesg_ASROCK_b450.txt --]
[-- Type: text/plain, Size: 126457 bytes --]

[    0.000000] Linux version 5.0.2-050002-generic (kernel@tangerine) (gcc version 8.3.0 (Ubuntu 8.3.0-2ubuntu2)) #201903131832 SMP Wed Mar 13 22:35:19 UTC 2019
[    0.000000] Command line: BOOT_IMAGE=/boot/vmlinuz-5.0.2-050002-generic root=UUID=a9686227-8773-4e01-96b9-8eacbc37ceef ro quiet splash vt.handoff=1
[    0.000000] KERNEL supported cpus:
[    0.000000]   Intel GenuineIntel
[    0.000000]   AMD AuthenticAMD
[    0.000000]   Hygon HygonGenuine
[    0.000000]   Centaur CentaurHauls
[    0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers'
[    0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers'
[    0.000000] x86/fpu: xstate_offset[2]:  576, xstate_sizes[2]:  256
[    0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'compacted' format.
[    0.000000] BIOS-provided physical RAM map:
[    0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000009d3ff] usable
[    0.000000] BIOS-e820: [mem 0x000000000009d400-0x000000000009ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000009cfffff] usable
[    0.000000] BIOS-e820: [mem 0x0000000009d00000-0x0000000009ffffff] reserved
[    0.000000] BIOS-e820: [mem 0x000000000a000000-0x000000000a1fffff] usable
[    0.000000] BIOS-e820: [mem 0x000000000a200000-0x000000000a209fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000000a20a000-0x000000000affffff] usable
[    0.000000] BIOS-e820: [mem 0x000000000b000000-0x000000000b01ffff] reserved
[    0.000000] BIOS-e820: [mem 0x000000000b020000-0x000000005aa88fff] usable
[    0.000000] BIOS-e820: [mem 0x000000005aa89000-0x000000005bf60fff] reserved
[    0.000000] BIOS-e820: [mem 0x000000005bf61000-0x000000005c049fff] usable
[    0.000000] BIOS-e820: [mem 0x000000005c04a000-0x000000005c420fff] ACPI NVS
[    0.000000] BIOS-e820: [mem 0x000000005c421000-0x000000005d14ffff] reserved
[    0.000000] BIOS-e820: [mem 0x000000005d150000-0x000000005effffff] usable
[    0.000000] BIOS-e820: [mem 0x000000005f000000-0x00000000dfffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000f8000000-0x00000000fbffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fd100000-0x00000000fdffffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fea00000-0x00000000fea0ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000feb80000-0x00000000fec01fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec10000-0x00000000fec10fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fec30000-0x00000000fec30fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed00000-0x00000000fed00fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed40000-0x00000000fed44fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fed80000-0x00000000fed8ffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fedc2000-0x00000000fedcffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fedd4000-0x00000000fedd5fff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000fee00000-0x00000000feefffff] reserved
[    0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved
[    0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000041f33ffff] usable
[    0.000000] NX (Execute Disable) protection: active
[    0.000000] SMBIOS 3.0.0 present.
[    0.000000] DMI: To Be Filled By O.E.M. To Be Filled By O.E.M./B450 Gaming-ITX/ac, BIOS P1.70 12/17/2018
[    0.000000] tsc: Fast TSC calibration failed
[    0.000000] e820: update [mem 0x00000000-0x00000fff] usable ==> reserved
[    0.000000] e820: remove [mem 0x000a0000-0x000fffff] usable
[    0.000000] last_pfn = 0x41f340 max_arch_pfn = 0x400000000
[    0.000000] MTRR default type: uncachable
[    0.000000] MTRR fixed ranges enabled:
[    0.000000]   00000-9FFFF write-back
[    0.000000]   A0000-BFFFF write-through
[    0.000000]   C0000-FFFFF write-protect
[    0.000000] MTRR variable ranges enabled:
[    0.000000]   0 base 000000000000 mask FFFF80000000 write-back
[    0.000000]   1 base 000080000000 mask FFFFC0000000 write-back
[    0.000000]   2 base 0000C0000000 mask FFFFE0000000 write-back
[    0.000000]   3 disabled
[    0.000000]   4 disabled
[    0.000000]   5 disabled
[    0.000000]   6 disabled
[    0.000000]   7 disabled
[    0.000000] TOM2: 0000000420000000 aka 16896M
[    0.000000] x86/PAT: Configuration [0-7]: WB  WC  UC- UC  WB  WP  UC- WT  
[    0.000000] e820: update [mem 0xe0000000-0xffffffff] usable ==> reserved
[    0.000000] last_pfn = 0x5f000 max_arch_pfn = 0x400000000
[    0.000000] check: Scanning 1 areas for low memory corruption
[    0.000000] Base memory trampoline at [(____ptrval____)] 97000 size 24576
[    0.000000] Using GB pages for direct mapping
[    0.000000] BRK [0x205a01000, 0x205a01fff] PGTABLE
[    0.000000] BRK [0x205a02000, 0x205a02fff] PGTABLE
[    0.000000] BRK [0x205a03000, 0x205a03fff] PGTABLE
[    0.000000] BRK [0x205a04000, 0x205a04fff] PGTABLE
[    0.000000] BRK [0x205a05000, 0x205a05fff] PGTABLE
[    0.000000] BRK [0x205a06000, 0x205a06fff] PGTABLE
[    0.000000] BRK [0x205a07000, 0x205a07fff] PGTABLE
[    0.000000] BRK [0x205a08000, 0x205a08fff] PGTABLE
[    0.000000] BRK [0x205a09000, 0x205a09fff] PGTABLE
[    0.000000] BRK [0x205a0a000, 0x205a0afff] PGTABLE
[    0.000000] BRK [0x205a0b000, 0x205a0bfff] PGTABLE
[    0.000000] BRK [0x205a0c000, 0x205a0cfff] PGTABLE
[    0.000000] RAMDISK: [mem 0x3366b000-0x35b2cfff]
[    0.000000] ACPI: Early table checksum verification disabled
[    0.000000] ACPI: RSDP 0x00000000000F05B0 000024 (v02 ALASKA)
[    0.000000] ACPI: XSDT 0x000000005C04A0A0 0000BC (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FACP 0x000000005C050980 000114 (v06 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI BIOS Warning (bug): Optional FADT field Pm2ControlBlock has valid Length but zero Address: 0x0000000000000000/0x1 (20181213/tbfadt-624)
[    0.000000] ACPI: DSDT 0x000000005C04A1F0 00678D (v02 ALASKA A M I    01072009 INTL 20120913)
[    0.000000] ACPI: FACS 0x000000005C40AD80 000040
[    0.000000] ACPI: APIC 0x000000005C050A98 0000DE (v03 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FPDT 0x000000005C050B78 000044 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: FIDT 0x000000005C050BC0 00009C (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: SSDT 0x000000005C050C60 005419 (v02 AMD    AmdTable 00000002 MSFT 02000002)
[    0.000000] ACPI: SSDT 0x000000005C056080 0007DC (v01 AMD    AMD CPU  00000001 AMD  00000001)
[    0.000000] ACPI: CRAT 0x000000005C056860 000810 (v01 AMD    AMD CRAT 00000001 AMD  00000001)
[    0.000000] ACPI: CDIT 0x000000005C057070 000029 (v01 AMD    AMD CDIT 00000001 AMD  00000001)
[    0.000000] ACPI: SSDT 0x000000005C0570A0 002CDC (v01 AMD    AMD AOD  00000001 INTL 20120913)
[    0.000000] ACPI: MCFG 0x000000005C059D80 00003C (v01 ALASKA A M I    01072009 MSFT 00010013)
[    0.000000] ACPI: AAFT 0x000000005C059DC0 000278 (v01 ALASKA OEMAAFT  01072009 MSFT 00000097)
[    0.000000] ACPI: HPET 0x000000005C05A038 000038 (v01 ALASKA A M I    01072009 AMI  00000005)
[    0.000000] ACPI: UEFI 0x000000005C05A070 000048 (v01                 00000000      00000000)
[    0.000000] ACPI: IVRS 0x000000005C05A0B8 0000D0 (v02 AMD    AMD IVRS 00000001 AMD  00000000)
[    0.000000] ACPI: SSDT 0x000000005C05A188 000C33 (v01 AMD    AmdTable 00000001 INTL 20120913)
[    0.000000] ACPI: SSDT 0x000000005C05ADC0 0010F5 (v01 AMD    AmdTable 00000001 INTL 20120913)
[    0.000000] ACPI: SSDT 0x000000005C05BEB8 001B4E (v01 AMD    AmdTable 00000001 INTL 20120913)
[    0.000000] ACPI: SSDT 0x000000005C05DA08 0000BF (v01 AMD    AMD PT   00001000 INTL 20120913)
[    0.000000] ACPI: WSMT 0x000000005C05DAC8 000028 (v01 ALASKA A M I    01072009 AMI  00010013)
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] No NUMA configuration found
[    0.000000] Faking a node at [mem 0x0000000000000000-0x000000041f33ffff]
[    0.000000] NODE_DATA(0) allocated [mem 0x41f315000-0x41f33ffff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000000001000-0x0000000000ffffff]
[    0.000000]   DMA32    [mem 0x0000000001000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x000000041f33ffff]
[    0.000000]   Device   empty
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000001000-0x000000000009cfff]
[    0.000000]   node   0: [mem 0x0000000000100000-0x0000000009cfffff]
[    0.000000]   node   0: [mem 0x000000000a000000-0x000000000a1fffff]
[    0.000000]   node   0: [mem 0x000000000a20a000-0x000000000affffff]
[    0.000000]   node   0: [mem 0x000000000b020000-0x000000005aa88fff]
[    0.000000]   node   0: [mem 0x000000005bf61000-0x000000005c049fff]
[    0.000000]   node   0: [mem 0x000000005d150000-0x000000005effffff]
[    0.000000]   node   0: [mem 0x0000000100000000-0x000000041f33ffff]
[    0.000000] Zeroed struct page in unavailable ranges: 14700 pages
[    0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000041f33ffff]
[    0.000000] On node 0 totalpages: 3652052
[    0.000000]   DMA zone: 64 pages used for memmap
[    0.000000]   DMA zone: 21 pages reserved
[    0.000000]   DMA zone: 3996 pages, LIFO batch:0
[    0.000000]   DMA32 zone: 5852 pages used for memmap
[    0.000000]   DMA32 zone: 374520 pages, LIFO batch:63
[    0.000000]   Normal zone: 51149 pages used for memmap
[    0.000000]   Normal zone: 3273536 pages, LIFO batch:63
[    0.000000] ACPI: PM-Timer IO Port: 0x808
[    0.000000] ACPI: Local APIC address 0xfee00000
[    0.000000] ACPI: LAPIC_NMI (acpi_id[0xff] high edge lint[0x1])
[    0.000000] IOAPIC[0]: apic_id 5, version 33, address 0xfec00000, GSI 0-23
[    0.000000] IOAPIC[1]: apic_id 6, version 33, address 0xfec01000, GSI 24-55
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
[    0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 low level)
[    0.000000] ACPI: IRQ0 used by override.
[    0.000000] ACPI: IRQ9 used by override.
[    0.000000] Using ACPI (MADT) for SMP configuration information
[    0.000000] ACPI: HPET id: 0x10228201 base: 0xfed00000
[    0.000000] smpboot: Allowing 16 CPUs, 12 hotplug CPUs
[    0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009d000-0x0009dfff]
[    0.000000] PM: Registered nosave memory: [mem 0x0009e000-0x0009ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000a0000-0x000dffff]
[    0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff]
[    0.000000] PM: Registered nosave memory: [mem 0x09d00000-0x09ffffff]
[    0.000000] PM: Registered nosave memory: [mem 0x0a200000-0x0a209fff]
[    0.000000] PM: Registered nosave memory: [mem 0x0b000000-0x0b01ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x5aa89000-0x5bf60fff]
[    0.000000] PM: Registered nosave memory: [mem 0x5c04a000-0x5c420fff]
[    0.000000] PM: Registered nosave memory: [mem 0x5c421000-0x5d14ffff]
[    0.000000] PM: Registered nosave memory: [mem 0x5f000000-0xdfffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xe0000000-0xf7ffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xf8000000-0xfbffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfc000000-0xfd0fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfd100000-0xfdffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfe000000-0xfe9fffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfea00000-0xfea0ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfea10000-0xfeb7ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfeb80000-0xfec01fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec02000-0xfec0ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec10000-0xfec10fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec11000-0xfec2ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec30000-0xfec30fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfec31000-0xfecfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed00000-0xfed00fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed01000-0xfed3ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed40000-0xfed44fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfed7ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed80000-0xfed8ffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfed90000-0xfedc1fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfedc2000-0xfedcffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfedd0000-0xfedd3fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfedd4000-0xfedd5fff]
[    0.000000] PM: Registered nosave memory: [mem 0xfedd6000-0xfedfffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfee00000-0xfeefffff]
[    0.000000] PM: Registered nosave memory: [mem 0xfef00000-0xfeffffff]
[    0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff]
[    0.000000] [mem 0xe0000000-0xf7ffffff] available for PCI devices
[    0.000000] Booting paravirtualized kernel on bare hardware
[    0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645519600211568 ns
[    0.000000] random: get_random_bytes called from start_kernel+0x97/0x516 with crng_init=0
[    0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:16 nr_cpu_ids:16 nr_node_ids:1
[    0.000000] percpu: Embedded 46 pages/cpu @(____ptrval____) s151552 r8192 d28672 u262144
[    0.000000] pcpu-alloc: s151552 r8192 d28672 u262144 alloc=1*2097152
[    0.000000] pcpu-alloc: [0] 00 01 02 03 04 05 06 07 [0] 08 09 10 11 12 13 14 15 
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 3594966
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: BOOT_IMAGE=/boot/vmlinuz-5.0.2-050002-generic root=UUID=a9686227-8773-4e01-96b9-8eacbc37ceef ro quiet splash vt.handoff=1
[    0.000000] Calgary: detecting Calgary via BIOS EBDA area
[    0.000000] Calgary: Unable to locate Rio Grande table in EBDA - bailing!
[    0.000000] Memory: 14239172K/14608208K available (14339K kernel code, 2332K rwdata, 4388K rodata, 2564K init, 5220K bss, 369036K reserved, 0K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=16, Nodes=1
[    0.000000] ftrace: allocating 41461 entries in 162 pages
[    0.000000] rcu: Hierarchical RCU implementation.
[    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=16.
[    0.000000] 	Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=16
[    0.000000] NR_IRQS: 524544, nr_irqs: 1096, preallocated irqs: 16
[    0.000000] spurious 8259A interrupt: IRQ7.
[    0.000000] Console: colour dummy device 80x25
[    0.000000] printk: console [tty0] enabled
[    0.000000] ACPI: Core revision 20181213
[    0.000000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484873504 ns
[    0.000000] hpet clockevent registered
[    0.000000] APIC: Switch to symmetric I/O mode setup
[    0.004000] Switched APIC routing to physical flat.
[    0.008000] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1
[    0.040000] tsc: Unable to calibrate against PIT
[    0.040000] tsc: using HPET reference calibration
[    0.040000] tsc: Detected 3193.975 MHz processor
[    0.000007] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x2e0a0e8ee39, max_idle_ns: 440795321048 ns
[    0.000013] Calibrating delay loop (skipped), value calculated using timer frequency.. 6387.95 BogoMIPS (lpj=12775900)
[    0.000015] pid_max: default: 32768 minimum: 301
[    0.000399] LSM: Security Framework initializing
[    0.000400] Yama: becoming mindful.
[    0.000473] AppArmor: AppArmor initialized
[    0.005070] Dentry cache hash table entries: 2097152 (order: 12, 16777216 bytes)
[    0.006310] Inode-cache hash table entries: 1048576 (order: 11, 8388608 bytes)
[    0.006418] Mount-cache hash table entries: 32768 (order: 6, 262144 bytes)
[    0.006454] Mountpoint-cache hash table entries: 32768 (order: 6, 262144 bytes)
[    0.007004] mce: CPU supports 23 MCE banks
[    0.007031] LVT offset 1 assigned for vector 0xf9
[    0.007078] LVT offset 2 assigned for vector 0xf4
[    0.007087] Last level iTLB entries: 4KB 1024, 2MB 1024, 4MB 512
[    0.007088] Last level dTLB entries: 4KB 1536, 2MB 1536, 4MB 768, 1GB 0
[    0.007089] Spectre V2 : Mitigation: Full AMD retpoline
[    0.007089] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch
[    0.007095] Spectre V2 : mitigation: Enabling conditional Indirect Branch Prediction Barrier
[    0.007096] Speculative Store Bypass: Mitigation: Speculative Store Bypass disabled via prctl and seccomp
[    0.007270] Freeing SMP alternatives memory: 36K
[    0.016008] smpboot: CPU0: AMD Ryzen 5 2400GE with Radeon Vega Graphics (family: 0x17, model: 0x11, stepping: 0x0)
[    0.016008] Performance Events: Fam17h core perfctr, AMD PMU driver.
[    0.016008] ... version:                0
[    0.016008] ... bit width:              48
[    0.016008] ... generic registers:      6
[    0.016008] ... value mask:             0000ffffffffffff
[    0.016008] ... max period:             00007fffffffffff
[    0.016008] ... fixed-purpose events:   0
[    0.016008] ... event mask:             000000000000003f
[    0.016008] rcu: Hierarchical SRCU implementation.
[    0.016008] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter.
[    0.016008] smp: Bringing up secondary CPUs ...
[    0.016008] x86: Booting SMP configuration:
[    0.016008] .... node  #0, CPUs:        #1  #2  #3
[    0.022384] smp: Brought up 1 node, 4 CPUs
[    0.022384] smpboot: Max logical packages: 4
[    0.022384] smpboot: Total of 4 processors activated (25551.80 BogoMIPS)
[    0.022384] devtmpfs: initialized
[    0.022384] x86/mm: Memory block size: 128MB
[    0.025066] PM: Registering ACPI NVS region [mem 0x0a200000-0x0a209fff] (40960 bytes)
[    0.025066] PM: Registering ACPI NVS region [mem 0x5c04a000-0x5c420fff] (4026368 bytes)
[    0.025066] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns
[    0.025066] futex hash table entries: 4096 (order: 6, 262144 bytes)
[    0.025066] pinctrl core: initialized pinctrl subsystem
[    0.025066] RTC time: 13:01:59, date: 2019-03-14
[    0.025287] NET: Registered protocol family 16
[    0.025379] audit: initializing netlink subsys (disabled)
[    0.025383] audit: type=2000 audit(1552568519.064:1): state=initialized audit_enabled=0 res=1
[    0.025383] EISA bus registered
[    0.025383] cpuidle: using governor ladder
[    0.025383] cpuidle: using governor menu
[    0.025383] ACPI: bus type PCI registered
[    0.025383] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5
[    0.025383] PCI: MMCONFIG for domain 0000 [bus 00-3f] at [mem 0xf8000000-0xfbffffff] (base 0xf8000000)
[    0.025383] PCI: MMCONFIG at [mem 0xf8000000-0xfbffffff] reserved in E820
[    0.025383] PCI: Using configuration type 1 for base access
[    0.025383] mtrr: your CPUs had inconsistent variable MTRR settings
[    0.025383] mtrr: probably your BIOS does not setup all CPUs.
[    0.025383] mtrr: corrected configuration.
[    0.028538] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    0.028538] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    0.028538] ACPI: Added _OSI(Module Device)
[    0.028538] ACPI: Added _OSI(Processor Device)
[    0.028538] ACPI: Added _OSI(3.0 _SCP Extensions)
[    0.028538] ACPI: Added _OSI(Processor Aggregator Device)
[    0.028538] ACPI: Added _OSI(Linux-Dell-Video)
[    0.028538] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio)
[    0.028538] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics)
[    0.037141] ACPI: 8 ACPI AML tables successfully acquired and loaded
[    0.038605] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored
[    0.040291] ACPI: Interpreter enabled
[    0.040303] ACPI: (supports S0 S4 S5)
[    0.040304] ACPI: Using IOAPIC for interrupt routing
[    0.040598] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug
[    0.040851] ACPI: Enabled 2 GPEs in block 00 to 1F
[    0.043435] ACPI: Power Resource [P0ST] (on)
[    0.043460] ACPI: Power Resource [P3ST] (on)
[    0.049942] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-ff])
[    0.049947] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI]
[    0.050185] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug LTR]
[    0.050412] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME AER PCIeCapability]
[    0.050426] acpi PNP0A08:00: [Firmware Info]: MMCONFIG for domain 0000 [bus 00-3f] only partially covers this bridge
[    0.050878] PCI host bridge to bus 0000:00
[    0.050880] pci_bus 0000:00: root bus resource [io  0x0000-0x03af window]
[    0.050882] pci_bus 0000:00: root bus resource [io  0x03e0-0x0cf7 window]
[    0.050883] pci_bus 0000:00: root bus resource [io  0x03b0-0x03df window]
[    0.050884] pci_bus 0000:00: root bus resource [io  0x0d00-0xffff window]
[    0.050886] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window]
[    0.050887] pci_bus 0000:00: root bus resource [mem 0x000c0000-0x000dffff window]
[    0.050888] pci_bus 0000:00: root bus resource [mem 0xe0000000-0xfec2ffff window]
[    0.050889] pci_bus 0000:00: root bus resource [mem 0xfee00000-0xffffffff window]
[    0.050891] pci_bus 0000:00: root bus resource [bus 00-ff]
[    0.050901] pci 0000:00:00.0: [1022:15d0] type 00 class 0x060000
[    0.051052] pci 0000:00:00.2: [1022:15d1] type 00 class 0x080600
[    0.051230] pci 0000:00:01.0: [1022:1452] type 00 class 0x060000
[    0.051360] pci 0000:00:01.2: [1022:15d3] type 01 class 0x060400
[    0.051412] pci 0000:00:01.2: enabling Extended Tags
[    0.051472] pci 0000:00:01.2: PME# supported from D0 D3hot D3cold
[    0.051622] pci 0000:00:08.0: [1022:1452] type 00 class 0x060000
[    0.051751] pci 0000:00:08.1: [1022:15db] type 01 class 0x060400
[    0.051806] pci 0000:00:08.1: enabling Extended Tags
[    0.051863] pci 0000:00:08.1: PME# supported from D0 D3hot D3cold
[    0.051983] pci 0000:00:08.2: [1022:15dc] type 01 class 0x060400
[    0.052049] pci 0000:00:08.2: enabling Extended Tags
[    0.052104] pci 0000:00:08.2: PME# supported from D0 D3hot D3cold
[    0.052246] pci 0000:00:14.0: [1022:790b] type 00 class 0x0c0500
[    0.052452] pci 0000:00:14.3: [1022:790e] type 00 class 0x060100
[    0.052649] pci 0000:00:18.0: [1022:15e8] type 00 class 0x060000
[    0.052718] pci 0000:00:18.1: [1022:15e9] type 00 class 0x060000
[    0.052794] pci 0000:00:18.2: [1022:15ea] type 00 class 0x060000
[    0.052862] pci 0000:00:18.3: [1022:15eb] type 00 class 0x060000
[    0.052938] pci 0000:00:18.4: [1022:15ec] type 00 class 0x060000
[    0.053006] pci 0000:00:18.5: [1022:15ed] type 00 class 0x060000
[    0.053075] pci 0000:00:18.6: [1022:15ee] type 00 class 0x060000
[    0.053158] pci 0000:00:18.7: [1022:15ef] type 00 class 0x060000
[    0.053329] pci 0000:15:00.0: [1022:43d5] type 00 class 0x0c0330
[    0.053361] pci 0000:15:00.0: reg 0x10: [mem 0xfe8a0000-0xfe8a7fff 64bit]
[    0.053412] pci 0000:15:00.0: enabling Extended Tags
[    0.053474] pci 0000:15:00.0: PME# supported from D3hot D3cold
[    0.053594] pci 0000:15:00.1: [1022:43c8] type 00 class 0x010601
[    0.053660] pci 0000:15:00.1: reg 0x24: [mem 0xfe880000-0xfe89ffff]
[    0.053670] pci 0000:15:00.1: reg 0x30: [mem 0xfe800000-0xfe87ffff pref]
[    0.053678] pci 0000:15:00.1: enabling Extended Tags
[    0.053729] pci 0000:15:00.1: PME# supported from D3hot D3cold
[    0.053820] pci 0000:15:00.2: [1022:43c6] type 01 class 0x060400
[    0.053875] pci 0000:15:00.2: enabling Extended Tags
[    0.053930] pci 0000:15:00.2: PME# supported from D3hot D3cold
[    0.054065] pci 0000:00:01.2: PCI bridge to [bus 15-25]
[    0.054071] pci 0000:00:01.2:   bridge window [io  0xf000-0xffff]
[    0.054074] pci 0000:00:01.2:   bridge window [mem 0xfe600000-0xfe8fffff]
[    0.054206] pci 0000:1d:00.0: [1022:43c7] type 01 class 0x060400
[    0.054265] pci 0000:1d:00.0: enabling Extended Tags
[    0.054329] pci 0000:1d:00.0: PME# supported from D3hot D3cold
[    0.054429] pci 0000:1d:01.0: [1022:43c7] type 01 class 0x060400
[    0.054487] pci 0000:1d:01.0: enabling Extended Tags
[    0.054550] pci 0000:1d:01.0: PME# supported from D3hot D3cold
[    0.054659] pci 0000:1d:04.0: [1022:43c7] type 01 class 0x060400
[    0.054718] pci 0000:1d:04.0: enabling Extended Tags
[    0.054781] pci 0000:1d:04.0: PME# supported from D3hot D3cold
[    0.054892] pci 0000:1d:05.0: [1022:43c7] type 01 class 0x060400
[    0.054951] pci 0000:1d:05.0: enabling Extended Tags
[    0.055014] pci 0000:1d:05.0: PME# supported from D3hot D3cold
[    0.055131] pci 0000:1d:06.0: [1022:43c7] type 01 class 0x060400
[    0.055189] pci 0000:1d:06.0: enabling Extended Tags
[    0.055253] pci 0000:1d:06.0: PME# supported from D3hot D3cold
[    0.055363] pci 0000:1d:07.0: [1022:43c7] type 01 class 0x060400
[    0.055422] pci 0000:1d:07.0: enabling Extended Tags
[    0.055485] pci 0000:1d:07.0: PME# supported from D3hot D3cold
[    0.055616] pci 0000:15:00.2: PCI bridge to [bus 1d-25]
[    0.055622] pci 0000:15:00.2:   bridge window [io  0xf000-0xffff]
[    0.055626] pci 0000:15:00.2:   bridge window [mem 0xfe600000-0xfe7fffff]
[    0.055670] pci 0000:1d:00.0: PCI bridge to [bus 1e]
[    0.055731] pci 0000:1d:01.0: PCI bridge to [bus 1f]
[    0.055797] pci 0000:1d:04.0: PCI bridge to [bus 22]
[    0.055849] pci 0000:1d:05.0: PCI bridge to [bus 23]
[    0.055939] pci 0000:24:00.0: [8086:24fb] type 00 class 0x028000
[    0.056014] pci 0000:24:00.0: reg 0x10: [mem 0xfe700000-0xfe701fff 64bit]
[    0.056274] pci 0000:24:00.0: PME# supported from D0 D3hot D3cold
[    0.056507] pci 0000:1d:06.0: PCI bridge to [bus 24]
[    0.056516] pci 0000:1d:06.0:   bridge window [mem 0xfe700000-0xfe7fffff]
[    0.056590] pci 0000:25:00.0: [8086:1539] type 00 class 0x020000
[    0.056640] pci 0000:25:00.0: reg 0x10: [mem 0xfe600000-0xfe61ffff]
[    0.056677] pci 0000:25:00.0: reg 0x18: [io  0xf000-0xf01f]
[    0.056696] pci 0000:25:00.0: reg 0x1c: [mem 0xfe620000-0xfe623fff]
[    0.056887] pci 0000:25:00.0: PME# supported from D0 D3hot D3cold
[    0.057064] pci 0000:1d:07.0: PCI bridge to [bus 25]
[    0.057070] pci 0000:1d:07.0:   bridge window [io  0xf000-0xffff]
[    0.057073] pci 0000:1d:07.0:   bridge window [mem 0xfe600000-0xfe6fffff]
[    0.057230] pci 0000:38:00.0: [1002:15dd] type 00 class 0x030000
[    0.057277] pci 0000:38:00.0: reg 0x10: [mem 0xe0000000-0xefffffff 64bit pref]
[    0.057294] pci 0000:38:00.0: reg 0x18: [mem 0xf0000000-0xf01fffff 64bit pref]
[    0.057306] pci 0000:38:00.0: reg 0x20: [io  0xe000-0xe0ff]
[    0.057318] pci 0000:38:00.0: reg 0x24: [mem 0xfe500000-0xfe57ffff]
[    0.057338] pci 0000:38:00.0: enabling Extended Tags
[    0.057442] pci 0000:38:00.0: PME# supported from D1 D2 D3hot D3cold
[    0.057572] pci 0000:38:00.1: [1002:15de] type 00 class 0x040300
[    0.057601] pci 0000:38:00.1: reg 0x10: [mem 0xfe588000-0xfe58bfff]
[    0.057673] pci 0000:38:00.1: enabling Extended Tags
[    0.057739] pci 0000:38:00.1: PME# supported from D1 D2 D3hot D3cold
[    0.057826] pci 0000:38:00.2: [1022:15df] type 00 class 0x108000
[    0.057876] pci 0000:38:00.2: reg 0x18: [mem 0xfe400000-0xfe4fffff]
[    0.057908] pci 0000:38:00.2: reg 0x24: [mem 0xfe58c000-0xfe58dfff]
[    0.057928] pci 0000:38:00.2: enabling Extended Tags
[    0.058107] pci 0000:38:00.3: [1022:15e0] type 00 class 0x0c0330
[    0.058141] pci 0000:38:00.3: reg 0x10: [mem 0xfe300000-0xfe3fffff 64bit]
[    0.058202] pci 0000:38:00.3: enabling Extended Tags
[    0.058276] pci 0000:38:00.3: PME# supported from D0 D3hot D3cold
[    0.058373] pci 0000:38:00.4: [1022:15e1] type 00 class 0x0c0330
[    0.058408] pci 0000:38:00.4: reg 0x10: [mem 0xfe200000-0xfe2fffff 64bit]
[    0.058469] pci 0000:38:00.4: enabling Extended Tags
[    0.058543] pci 0000:38:00.4: PME# supported from D0 D3hot D3cold
[    0.058640] pci 0000:38:00.6: [1022:15e3] type 00 class 0x040300
[    0.058670] pci 0000:38:00.6: reg 0x10: [mem 0xfe580000-0xfe587fff]
[    0.058741] pci 0000:38:00.6: enabling Extended Tags
[    0.058808] pci 0000:38:00.6: PME# supported from D0 D3hot D3cold
[    0.058958] pci 0000:00:08.1: PCI bridge to [bus 38]
[    0.058963] pci 0000:00:08.1:   bridge window [io  0xe000-0xefff]
[    0.058966] pci 0000:00:08.1:   bridge window [mem 0xfe200000-0xfe5fffff]
[    0.058972] pci 0000:00:08.1:   bridge window [mem 0xe0000000-0xf01fffff 64bit pref]
[    0.059053] pci 0000:39:00.0: [1022:7901] type 00 class 0x010601
[    0.059136] pci 0000:39:00.0: reg 0x24: [mem 0xfe900000-0xfe9007ff]
[    0.059155] pci 0000:39:00.0: enabling Extended Tags
[    0.059231] pci 0000:39:00.0: PME# supported from D3hot D3cold
[    0.059353] pci 0000:00:08.2: PCI bridge to [bus 39]
[    0.059361] pci 0000:00:08.2:   bridge window [mem 0xfe900000-0xfe9fffff]
[    0.059735] ACPI: PCI Interrupt Link [LNKA] (IRQs 4 5 7 10 11 14 15) *0
[    0.059801] ACPI: PCI Interrupt Link [LNKB] (IRQs 4 5 7 10 11 14 15) *0
[    0.059851] ACPI: PCI Interrupt Link [LNKC] (IRQs 4 5 7 10 11 14 15) *0
[    0.059913] ACPI: PCI Interrupt Link [LNKD] (IRQs 4 5 7 10 11 14 15) *0
[    0.059969] ACPI: PCI Interrupt Link [LNKE] (IRQs 4 5 7 10 11 14 15) *0
[    0.060021] ACPI: PCI Interrupt Link [LNKF] (IRQs 4 5 7 10 11 14 15) *0
[    0.060069] ACPI: PCI Interrupt Link [LNKG] (IRQs 4 5 7 10 11 14 15) *0
[    0.060114] ACPI: PCI Interrupt Link [LNKH] (IRQs 4 5 7 10 11 14 15) *0
[    0.060603] pci 0000:38:00.0: vgaarb: setting as boot VGA device
[    0.060603] pci 0000:38:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none
[    0.060603] pci 0000:38:00.0: vgaarb: bridge control possible
[    0.060603] vgaarb: loaded
[    0.060603] SCSI subsystem initialized
[    0.060603] libata version 3.00 loaded.
[    0.060603] ACPI: bus type USB registered
[    0.060603] usbcore: registered new interface driver usbfs
[    0.060603] usbcore: registered new interface driver hub
[    0.060603] usbcore: registered new device driver usb
[    0.060603] pps_core: LinuxPPS API ver. 1 registered
[    0.060603] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>
[    0.060603] PTP clock support registered
[    0.060603] EDAC MC: Ver: 3.0.0
[    0.060603] PCI: Using ACPI for IRQ routing
[    0.062787] PCI: pci_cache_line_size set to 64 bytes
[    0.062891] e820: reserve RAM buffer [mem 0x0009d400-0x0009ffff]
[    0.062892] e820: reserve RAM buffer [mem 0x09d00000-0x0bffffff]
[    0.062894] e820: reserve RAM buffer [mem 0x0a200000-0x0bffffff]
[    0.062894] e820: reserve RAM buffer [mem 0x0b000000-0x0bffffff]
[    0.062895] e820: reserve RAM buffer [mem 0x5aa89000-0x5bffffff]
[    0.062896] e820: reserve RAM buffer [mem 0x5c04a000-0x5fffffff]
[    0.062897] e820: reserve RAM buffer [mem 0x5f000000-0x5fffffff]
[    0.062898] e820: reserve RAM buffer [mem 0x41f340000-0x41fffffff]
[    0.064010] NetLabel: Initializing
[    0.064010] NetLabel:  domain hash size = 128
[    0.064010] NetLabel:  protocols = UNLABELED CIPSOv4 CALIPSO
[    0.064010] NetLabel:  unlabeled traffic allowed by default
[    0.064071] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0
[    0.064075] hpet0: 3 comparators, 32-bit 14.318180 MHz counter
[    0.068036] clocksource: Switched to clocksource tsc-early
[    0.081637] VFS: Disk quotas dquot_6.6.0
[    0.081680] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    0.081852] AppArmor: AppArmor Filesystem Enabled
[    0.081875] pnp: PnP ACPI init
[    0.082015] system 00:00: [mem 0xf8000000-0xfbffffff] has been reserved
[    0.082019] system 00:00: Plug and Play ACPI device, IDs PNP0c01 (active)
[    0.082096] system 00:01: [mem 0xfeb80000-0xfebfffff] could not be reserved
[    0.082098] system 00:01: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.082214] pnp 00:02: Plug and Play ACPI device, IDs PNP0b00 (active)
[    0.082395] system 00:03: [io  0x0280-0x028f] has been reserved
[    0.082396] system 00:03: [io  0x0290-0x029f] has been reserved
[    0.082397] system 00:03: [io  0x02a0-0x02af] has been reserved
[    0.082398] system 00:03: [io  0x02b0-0x02bf] has been reserved
[    0.082401] system 00:03: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.082646] system 00:04: [io  0x04d0-0x04d1] has been reserved
[    0.082647] system 00:04: [io  0x040b] has been reserved
[    0.082648] system 00:04: [io  0x04d6] has been reserved
[    0.082649] system 00:04: [io  0x0c00-0x0c01] has been reserved
[    0.082650] system 00:04: [io  0x0c14] has been reserved
[    0.082651] system 00:04: [io  0x0c50-0x0c51] has been reserved
[    0.082652] system 00:04: [io  0x0c52] has been reserved
[    0.082653] system 00:04: [io  0x0c6c] has been reserved
[    0.082654] system 00:04: [io  0x0c6f] has been reserved
[    0.082654] system 00:04: [io  0x0cd0-0x0cd1] has been reserved
[    0.082655] system 00:04: [io  0x0cd2-0x0cd3] has been reserved
[    0.082656] system 00:04: [io  0x0cd4-0x0cd5] has been reserved
[    0.082657] system 00:04: [io  0x0cd6-0x0cd7] has been reserved
[    0.082658] system 00:04: [io  0x0cd8-0x0cdf] has been reserved
[    0.082659] system 00:04: [io  0x0800-0x089f] has been reserved
[    0.082660] system 00:04: [io  0x0b00-0x0b0f] has been reserved
[    0.082661] system 00:04: [io  0x0b20-0x0b3f] has been reserved
[    0.082662] system 00:04: [io  0x0900-0x090f] has been reserved
[    0.082662] system 00:04: [io  0x0910-0x091f] has been reserved
[    0.082664] system 00:04: [mem 0xfec00000-0xfec00fff] could not be reserved
[    0.082665] system 00:04: [mem 0xfec01000-0xfec01fff] could not be reserved
[    0.082666] system 00:04: [mem 0xfedc0000-0xfedc0fff] has been reserved
[    0.082667] system 00:04: [mem 0xfee00000-0xfee00fff] has been reserved
[    0.082668] system 00:04: [mem 0xfed80000-0xfed8ffff] could not be reserved
[    0.082669] system 00:04: [mem 0xfec10000-0xfec10fff] has been reserved
[    0.082670] system 00:04: [mem 0xff000000-0xffffffff] has been reserved
[    0.082672] system 00:04: Plug and Play ACPI device, IDs PNP0c02 (active)
[    0.083095] pnp: PnP ACPI: found 5 devices
[    0.089076] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns
[    0.089164] pci 0000:1d:00.0: PCI bridge to [bus 1e]
[    0.089177] pci 0000:1d:01.0: PCI bridge to [bus 1f]
[    0.089189] pci 0000:1d:04.0: PCI bridge to [bus 22]
[    0.089201] pci 0000:1d:05.0: PCI bridge to [bus 23]
[    0.089213] pci 0000:1d:06.0: PCI bridge to [bus 24]
[    0.089218] pci 0000:1d:06.0:   bridge window [mem 0xfe700000-0xfe7fffff]
[    0.089226] pci 0000:1d:07.0: PCI bridge to [bus 25]
[    0.089228] pci 0000:1d:07.0:   bridge window [io  0xf000-0xffff]
[    0.089233] pci 0000:1d:07.0:   bridge window [mem 0xfe600000-0xfe6fffff]
[    0.089241] pci 0000:15:00.2: PCI bridge to [bus 1d-25]
[    0.089243] pci 0000:15:00.2:   bridge window [io  0xf000-0xffff]
[    0.089248] pci 0000:15:00.2:   bridge window [mem 0xfe600000-0xfe7fffff]
[    0.089256] pci 0000:00:01.2: PCI bridge to [bus 15-25]
[    0.089258] pci 0000:00:01.2:   bridge window [io  0xf000-0xffff]
[    0.089263] pci 0000:00:01.2:   bridge window [mem 0xfe600000-0xfe8fffff]
[    0.089273] pci 0000:00:08.1: PCI bridge to [bus 38]
[    0.089275] pci 0000:00:08.1:   bridge window [io  0xe000-0xefff]
[    0.089279] pci 0000:00:08.1:   bridge window [mem 0xfe200000-0xfe5fffff]
[    0.089282] pci 0000:00:08.1:   bridge window [mem 0xe0000000-0xf01fffff 64bit pref]
[    0.089288] pci 0000:00:08.2: PCI bridge to [bus 39]
[    0.089294] pci 0000:00:08.2:   bridge window [mem 0xfe900000-0xfe9fffff]
[    0.089304] pci_bus 0000:00: resource 4 [io  0x0000-0x03af window]
[    0.089305] pci_bus 0000:00: resource 5 [io  0x03e0-0x0cf7 window]
[    0.089306] pci_bus 0000:00: resource 6 [io  0x03b0-0x03df window]
[    0.089307] pci_bus 0000:00: resource 7 [io  0x0d00-0xffff window]
[    0.089309] pci_bus 0000:00: resource 8 [mem 0x000a0000-0x000bffff window]
[    0.089310] pci_bus 0000:00: resource 9 [mem 0x000c0000-0x000dffff window]
[    0.089311] pci_bus 0000:00: resource 10 [mem 0xe0000000-0xfec2ffff window]
[    0.089312] pci_bus 0000:00: resource 11 [mem 0xfee00000-0xffffffff window]
[    0.089313] pci_bus 0000:15: resource 0 [io  0xf000-0xffff]
[    0.089314] pci_bus 0000:15: resource 1 [mem 0xfe600000-0xfe8fffff]
[    0.089315] pci_bus 0000:1d: resource 0 [io  0xf000-0xffff]
[    0.089316] pci_bus 0000:1d: resource 1 [mem 0xfe600000-0xfe7fffff]
[    0.089317] pci_bus 0000:24: resource 1 [mem 0xfe700000-0xfe7fffff]
[    0.089317] pci_bus 0000:25: resource 0 [io  0xf000-0xffff]
[    0.089318] pci_bus 0000:25: resource 1 [mem 0xfe600000-0xfe6fffff]
[    0.089319] pci_bus 0000:38: resource 0 [io  0xe000-0xefff]
[    0.089320] pci_bus 0000:38: resource 1 [mem 0xfe200000-0xfe5fffff]
[    0.089321] pci_bus 0000:38: resource 2 [mem 0xe0000000-0xf01fffff 64bit pref]
[    0.089322] pci_bus 0000:39: resource 1 [mem 0xfe900000-0xfe9fffff]
[    0.089523] NET: Registered protocol family 2
[    0.089796] tcp_listen_portaddr_hash hash table entries: 8192 (order: 5, 131072 bytes)
[    0.089842] TCP established hash table entries: 131072 (order: 8, 1048576 bytes)
[    0.090038] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
[    0.090161] TCP: Hash tables configured (established 131072 bind 65536)
[    0.090216] UDP hash table entries: 8192 (order: 6, 262144 bytes)
[    0.090256] UDP-Lite hash table entries: 8192 (order: 6, 262144 bytes)
[    0.090484] NET: Registered protocol family 1
[    0.090488] NET: Registered protocol family 44
[    0.090741] pci 0000:38:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff]
[    0.090750] pci 0000:38:00.1: Linked as a consumer to 0000:38:00.0
[    0.091053] PCI: CLS 64 bytes, default 64
[    0.091086] Unpacking initramfs...
[    0.486609] Freeing initrd memory: 37640K
[    0.486639] AMD-Vi: Unable to write to IOMMU perf counter.
[    0.486750] pci 0000:00:00.2: can't derive routing for PCI INT A
[    0.486751] pci 0000:00:00.2: PCI INT A: not connected
[    0.487189] iommu: Adding device 0000:00:01.0 to group 0
[    0.487387] iommu: Adding device 0000:00:01.2 to group 1
[    0.487608] iommu: Adding device 0000:00:08.0 to group 2
[    0.487824] iommu: Adding device 0000:00:08.1 to group 3
[    0.487851] iommu: Adding device 0000:00:08.2 to group 2
[    0.488053] iommu: Adding device 0000:00:14.0 to group 4
[    0.488074] iommu: Adding device 0000:00:14.3 to group 4
[    0.488295] iommu: Adding device 0000:00:18.0 to group 5
[    0.488325] iommu: Adding device 0000:00:18.1 to group 5
[    0.488347] iommu: Adding device 0000:00:18.2 to group 5
[    0.488368] iommu: Adding device 0000:00:18.3 to group 5
[    0.488390] iommu: Adding device 0000:00:18.4 to group 5
[    0.488411] iommu: Adding device 0000:00:18.5 to group 5
[    0.488433] iommu: Adding device 0000:00:18.6 to group 5
[    0.488454] iommu: Adding device 0000:00:18.7 to group 5
[    0.488689] iommu: Adding device 0000:15:00.0 to group 6
[    0.488736] iommu: Adding device 0000:15:00.1 to group 6
[    0.488772] iommu: Adding device 0000:15:00.2 to group 6
[    0.488794] iommu: Adding device 0000:1d:00.0 to group 6
[    0.488816] iommu: Adding device 0000:1d:01.0 to group 6
[    0.488838] iommu: Adding device 0000:1d:04.0 to group 6
[    0.488860] iommu: Adding device 0000:1d:05.0 to group 6
[    0.488889] iommu: Adding device 0000:1d:06.0 to group 6
[    0.488910] iommu: Adding device 0000:1d:07.0 to group 6
[    0.488944] iommu: Adding device 0000:24:00.0 to group 6
[    0.488973] iommu: Adding device 0000:25:00.0 to group 6
[    0.489244] iommu: Adding device 0000:38:00.0 to group 7
[    0.489335] iommu: Using direct mapping for device 0000:38:00.0
[    0.489445] iommu: Adding device 0000:38:00.1 to group 8
[    0.489489] iommu: Adding device 0000:38:00.2 to group 8
[    0.489531] iommu: Adding device 0000:38:00.3 to group 8
[    0.489574] iommu: Adding device 0000:38:00.4 to group 8
[    0.489617] iommu: Adding device 0000:38:00.6 to group 8
[    0.489640] iommu: Adding device 0000:39:00.0 to group 2
[    0.489891] AMD-Vi: Found IOMMU at 0000:00:00.2 cap 0x40
[    0.489892] AMD-Vi: Extended features (0x4f77ef22294ada):
[    0.489893]  PPR NX GT IA GA PC GA_vAPIC
[    0.489894] AMD-Vi: Interrupt remapping enabled
[    0.489895] AMD-Vi: Virtual APIC enabled
[    0.490077] AMD-Vi: Lazy IO/TLB flushing enabled
[    0.491054] amd_uncore: AMD NB counters detected
[    0.491068] amd_uncore: AMD LLC counters detected
[    0.491322] check: Scanning for low memory corruption every 60 seconds
[    0.493500] Initialise system trusted keyrings
[    0.493560] Key type blacklist registered
[    0.493653] workingset: timestamp_bits=36 max_order=22 bucket_order=0
[    0.495488] zbud: loaded
[    0.496346] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.496809] fuse init (API version 7.28)
[    0.533408] Key type asymmetric registered
[    0.533409] Asymmetric key parser 'x509' registered
[    0.533425] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 243)
[    0.533498] io scheduler mq-deadline registered
[    0.534604] pcieport 0000:00:01.2: Signaling PME with IRQ 26
[    0.534714] aer 0000:00:01.2:pcie002: AER enabled with IRQ 26
[    0.534884] pcieport 0000:00:08.1: Signaling PME with IRQ 27
[    0.535132] pcieport 0000:00:08.2: Signaling PME with IRQ 28
[    0.536374] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
[    0.536451] vesafb: mode is 2560x1440x32, linelength=10240, pages=0
[    0.536452] vesafb: scrolling: redraw
[    0.536453] vesafb: Truecolor: size=0:8:8:8, shift=0:16:8:0
[    0.536481] vesafb: framebuffer at 0xe0000000, mapped to 0x00000000417a6934, using 14400k, total 14400k
[    0.625714] Console: switching to colour frame buffer device 320x90
[    0.709729] fb0: VESA VGA frame buffer device
[    0.709906] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0
[    0.709914] ACPI: Power Button [PWRB]
[    0.709967] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1
[    0.709981] ACPI: Power Button [PWRF]
[    0.710036] Monitor-Mwait will be used to enter C-1 state
[    0.710857] Serial: 8250/16550 driver, 32 ports, IRQ sharing enabled
[    0.712606] Linux agpgart interface v0.103
[    0.716255] loop: module loaded
[    0.716537] libphy: Fixed MDIO Bus: probed
[    0.716538] tun: Universal TUN/TAP device driver, 1.6
[    0.716558] PPP generic driver version 2.4.2
[    0.716594] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    0.716597] ehci-pci: EHCI PCI platform driver
[    0.716610] ehci-platform: EHCI generic platform driver
[    0.716624] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    0.716626] ohci-pci: OHCI PCI platform driver
[    0.716633] ohci-platform: OHCI generic platform driver
[    0.716637] uhci_hcd: USB Universal Host Controller Interface driver
[    0.716748] xhci_hcd 0000:15:00.0: xHCI Host Controller
[    0.716753] xhci_hcd 0000:15:00.0: new USB bus registered, assigned bus number 1
[    0.771996] xhci_hcd 0000:15:00.0: hcc params 0x0200ef81 hci version 0x110 quirks 0x0000000000000410
[    0.772221] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.00
[    0.772222] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.772223] usb usb1: Product: xHCI Host Controller
[    0.772224] usb usb1: Manufacturer: Linux 5.0.2-050002-generic xhci-hcd
[    0.772225] usb usb1: SerialNumber: 0000:15:00.0
[    0.772343] hub 1-0:1.0: USB hub found
[    0.772358] hub 1-0:1.0: 10 ports detected
[    0.772680] xhci_hcd 0000:15:00.0: xHCI Host Controller
[    0.772682] xhci_hcd 0000:15:00.0: new USB bus registered, assigned bus number 2
[    0.772684] xhci_hcd 0000:15:00.0: Host supports USB 3.10 Enhanced SuperSpeed
[    0.772717] usb usb2: We don't know the algorithms for LPM for this host, disabling LPM.
[    0.772729] usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.00
[    0.772730] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.772731] usb usb2: Product: xHCI Host Controller
[    0.772732] usb usb2: Manufacturer: Linux 5.0.2-050002-generic xhci-hcd
[    0.772732] usb usb2: SerialNumber: 0000:15:00.0
[    0.772839] hub 2-0:1.0: USB hub found
[    0.772847] hub 2-0:1.0: 4 ports detected
[    0.772935] usb: port power management may be unreliable
[    0.773065] xhci_hcd 0000:38:00.3: xHCI Host Controller
[    0.773067] xhci_hcd 0000:38:00.3: new USB bus registered, assigned bus number 3
[    0.773256] xhci_hcd 0000:38:00.3: hcc params 0x0270ffe5 hci version 0x110 quirks 0x0000000840000410
[    0.773656] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.00
[    0.773657] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.773658] usb usb3: Product: xHCI Host Controller
[    0.773658] usb usb3: Manufacturer: Linux 5.0.2-050002-generic xhci-hcd
[    0.773659] usb usb3: SerialNumber: 0000:38:00.3
[    0.773761] hub 3-0:1.0: USB hub found
[    0.773774] hub 3-0:1.0: 4 ports detected
[    0.773960] xhci_hcd 0000:38:00.3: xHCI Host Controller
[    0.773962] xhci_hcd 0000:38:00.3: new USB bus registered, assigned bus number 4
[    0.773964] xhci_hcd 0000:38:00.3: Host supports USB 3.10 Enhanced SuperSpeed
[    0.773989] usb usb4: We don't know the algorithms for LPM for this host, disabling LPM.
[    0.774002] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.00
[    0.774003] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.774004] usb usb4: Product: xHCI Host Controller
[    0.774005] usb usb4: Manufacturer: Linux 5.0.2-050002-generic xhci-hcd
[    0.774005] usb usb4: SerialNumber: 0000:38:00.3
[    0.774093] hub 4-0:1.0: USB hub found
[    0.774106] hub 4-0:1.0: 4 ports detected
[    0.774464] xhci_hcd 0000:38:00.4: xHCI Host Controller
[    0.774474] xhci_hcd 0000:38:00.4: new USB bus registered, assigned bus number 5
[    0.774627] xhci_hcd 0000:38:00.4: hcc params 0x0260ffe5 hci version 0x110 quirks 0x0000000840000410
[    0.774974] usb usb5: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.00
[    0.774975] usb usb5: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.774976] usb usb5: Product: xHCI Host Controller
[    0.774976] usb usb5: Manufacturer: Linux 5.0.2-050002-generic xhci-hcd
[    0.774977] usb usb5: SerialNumber: 0000:38:00.4
[    0.775074] hub 5-0:1.0: USB hub found
[    0.775084] hub 5-0:1.0: 1 port detected
[    0.775177] xhci_hcd 0000:38:00.4: xHCI Host Controller
[    0.775179] xhci_hcd 0000:38:00.4: new USB bus registered, assigned bus number 6
[    0.775181] xhci_hcd 0000:38:00.4: Host supports USB 3.10 Enhanced SuperSpeed
[    0.775206] usb usb6: We don't know the algorithms for LPM for this host, disabling LPM.
[    0.775218] usb usb6: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.00
[    0.775219] usb usb6: New USB device strings: Mfr=3, Product=2, SerialNumber=1
[    0.775220] usb usb6: Product: xHCI Host Controller
[    0.775220] usb usb6: Manufacturer: Linux 5.0.2-050002-generic xhci-hcd
[    0.775221] usb usb6: SerialNumber: 0000:38:00.4
[    0.775320] hub 6-0:1.0: USB hub found
[    0.775329] hub 6-0:1.0: 1 port detected
[    0.775421] i8042: PNP: No PS/2 controller found.
[    0.775494] mousedev: PS/2 mouse device common for all mice
[    0.775626] rtc_cmos 00:02: RTC can wake from S4
[    0.775838] rtc_cmos 00:02: registered as rtc0
[    0.775847] rtc_cmos 00:02: alarms up to one month, y3k, 114 bytes nvram, hpet irqs
[    0.775858] i2c /dev entries driver
[    0.776008] device-mapper: uevent: version 1.0.3
[    0.776099] device-mapper: ioctl: 4.39.0-ioctl (2018-04-03) initialised: dm-devel@redhat.com
[    0.776112] platform eisa.0: Probing EISA bus 0
[    0.776121] platform eisa.0: EISA: Cannot allocate resource for mainboard
[    0.776122] platform eisa.0: Cannot allocate resource for EISA slot 1
[    0.776122] platform eisa.0: Cannot allocate resource for EISA slot 2
[    0.776123] platform eisa.0: Cannot allocate resource for EISA slot 3
[    0.776124] platform eisa.0: Cannot allocate resource for EISA slot 4
[    0.776125] platform eisa.0: Cannot allocate resource for EISA slot 5
[    0.776126] platform eisa.0: Cannot allocate resource for EISA slot 6
[    0.776126] platform eisa.0: Cannot allocate resource for EISA slot 7
[    0.776127] platform eisa.0: Cannot allocate resource for EISA slot 8
[    0.776128] platform eisa.0: EISA: Detected 0 cards
[    0.776188] ledtrig-cpu: registered to indicate activity on CPUs
[    0.776557] NET: Registered protocol family 10
[    0.781717] Segment Routing with IPv6
[    0.781739] NET: Registered protocol family 17
[    0.781837] Key type dns_resolver registered
[    0.782264] RAS: Correctable Errors collector initialized.
[    0.782309] microcode: CPU0: patch_level=0x0810100b
[    0.782328] microcode: CPU1: patch_level=0x0810100b
[    0.782331] microcode: CPU2: patch_level=0x0810100b
[    0.782339] microcode: CPU3: patch_level=0x0810100b
[    0.782372] microcode: Microcode Update Driver: v2.2.
[    0.782395] sched_clock: Marking stable (822359186, -39991184)->(1004701594, -222333592)
[    0.782609] registered taskstats version 1
[    0.782629] Loading compiled-in X.509 certificates
[    0.784272] Loaded X.509 cert 'Build time autogenerated kernel key: 901c64038402ee7829aeef909077142a9b34df94'
[    0.784296] zswap: loaded using pool lzo/zbud
[    0.789765] Key type big_key registered
[    0.789768] Key type trusted registered
[    0.791935] Key type encrypted registered
[    0.791937] AppArmor: AppArmor sha1 policy hashing enabled
[    0.791941] ima: No TPM chip found, activating TPM-bypass!
[    0.791978] ima: Allocated hash algorithm: sha1
[    0.791983] No architecture policies found
[    0.791990] evm: Initialising EVM extended attributes:
[    0.791990] evm: security.selinux
[    0.791991] evm: security.SMACK64
[    0.791991] evm: security.SMACK64EXEC
[    0.791991] evm: security.SMACK64TRANSMUTE
[    0.791991] evm: security.SMACK64MMAP
[    0.791992] evm: security.apparmor
[    0.791992] evm: security.ima
[    0.791992] evm: security.capability
[    0.791993] evm: HMAC attrs: 0x1
[    0.792645]   Magic number: 11:372:28
[    0.792718] memory memory68: hash matches
[    0.792775] rtc_cmos 00:02: setting system clock to 2019-03-14T13:02:00 UTC (1552568520)
[    0.792903] acpi_cpufreq: overriding BIOS provided _PSD data
[    0.794394] Freeing unused decrypted memory: 2040K
[    0.794748] Freeing unused kernel image memory: 2564K
[    0.815683] Write protecting the kernel read-only data: 22528k
[    0.816445] Freeing unused kernel image memory: 2016K
[    0.816858] Freeing unused kernel image memory: 1756K
[    0.826656] x86/mm: Checked W+X mappings: passed, no W+X pages found.
[    0.826660] Run /init as init process
[    0.894533] piix4_smbus 0000:00:14.0: SMBus Host Controller at 0xb00, revision 0
[    0.894535] piix4_smbus 0000:00:14.0: Using register 0x02 for SMBus port selection
[    0.897503] ahci 0000:15:00.1: version 3.0
[    0.897688] ahci 0000:15:00.1: SSS flag set, parallel bus scan disabled
[    0.897740] ahci 0000:15:00.1: AHCI 0001.0301 32 slots 8 ports 6 Gbps 0x33 impl SATA mode
[    0.897742] ahci 0000:15:00.1: flags: 64bit ncq sntf stag pm led clo only pmp pio slum part sxs deso sadm sds apst 
[    0.898520] scsi host0: ahci
[    0.898728] scsi host1: ahci
[    0.899061] scsi host2: ahci
[    0.900340] scsi host3: ahci
[    0.902766] scsi host4: ahci
[    0.906258] scsi host5: ahci
[    0.906422] scsi host6: ahci
[    0.906649] scsi host7: ahci
[    0.906723] ata1: SATA max UDMA/133 abar m131072@0xfe880000 port 0xfe880100 irq 53
[    0.906726] ata2: SATA max UDMA/133 abar m131072@0xfe880000 port 0xfe880180 irq 53
[    0.906727] ata3: DUMMY
[    0.906727] ata4: DUMMY
[    0.906729] ata5: SATA max UDMA/133 abar m131072@0xfe880000 port 0xfe880300 irq 53
[    0.906731] ata6: SATA max UDMA/133 abar m131072@0xfe880000 port 0xfe880380 irq 53
[    0.906732] ata7: DUMMY
[    0.906732] ata8: DUMMY
[    0.912058] dca service started, version 1.12.1
[    0.915484] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.4.0-k
[    0.915485] igb: Copyright (c) 2007-2014 Intel Corporation.
[    0.920074] ahci 0000:39:00.0: AHCI 0001.0301 32 slots 1 ports 6 Gbps 0x2 impl SATA mode
[    0.920077] ahci 0000:39:00.0: flags: 64bit ncq sntf ilck pm led clo only pmp fbs pio slum part 
[    0.920080] ahci 0000:39:00.0: both AHCI_HFLAG_MULTI_MSI flag set and custom irq handler implemented
[    0.921995] scsi host8: ahci
[    0.922193] scsi host9: ahci
[    0.922261] ata9: DUMMY
[    0.922270] ata10: SATA max UDMA/133 abar m2048@0xfe900000 port 0xfe900180 irq 56
[    0.948346] pps pps0: new PPS source ptp0
[    0.948348] igb 0000:25:00.0: added PHC on eth0
[    0.948349] igb 0000:25:00.0: Intel(R) Gigabit Ethernet Network Connection
[    0.948350] igb 0000:25:00.0: eth0: (PCIe:2.5Gb/s:Width x1) 70:85:c2:a4:ca:54
[    0.948352] igb 0000:25:00.0: eth0: PBA No: FFFFFF-0FF
[    0.948353] igb 0000:25:00.0: Using MSI-X interrupts. 2 rx queue(s), 2 tx queue(s)
[    0.949418] igb 0000:25:00.0 enp37s0: renamed from eth0
[    1.104451] usb 3-2: new high-speed USB device number 2 using xhci_hcd
[    1.172052] usb 1-6: new full-speed USB device number 2 using xhci_hcd
[    1.218217] ata1: SATA link down (SStatus 0 SControl 330)
[    1.254468] usb 3-2: New USB device found, idVendor=05e3, idProduct=0608, bcdDevice=32.98
[    1.254471] usb 3-2: New USB device strings: Mfr=0, Product=1, SerialNumber=0
[    1.254472] usb 3-2: Product: USB2.0 Hub
[    1.319842] hub 3-2:1.0: USB hub found
[    1.320193] hub 3-2:1.0: 4 ports detected
[    1.392388] ata10: SATA link up 6.0 Gbps (SStatus 133 SControl 300)
[    1.392614] ata10.00: ATA-11: Apacer AST280 120GB, APB11PE0, max UDMA/133
[    1.392617] ata10.00: 234441648 sectors, multi 16: LBA48 NCQ (depth 32), AA
[    1.392783] ata10.00: configured for UDMA/133
[    1.492067] tsc: Refined TSC clocksource calibration: 3196.797 MHz
[    1.492081] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x2e147867383, max_idle_ns: 440795309250 ns
[    1.492394] clocksource: Switched to clocksource tsc
[    1.528290] ata2: SATA link down (SStatus 0 SControl 330)
[    1.569142] usb 1-6: New USB device found, idVendor=8087, idProduct=0aa7, bcdDevice= 0.01
[    1.569146] usb 1-6: New USB device strings: Mfr=0, Product=0, SerialNumber=0
[    1.608057] usb 3-2.3: new low-speed USB device number 3 using xhci_hcd
[    1.725848] usb 3-2.3: New USB device found, idVendor=413c, idProduct=2107, bcdDevice= 1.04
[    1.725852] usb 3-2.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    1.725854] usb 3-2.3: Product: Dell USB Entry Keyboard
[    1.725856] usb 3-2.3: Manufacturer: DELL
[    1.770856] hidraw: raw HID events driver (C) Jiri Kosina
[    1.776931] usbcore: registered new interface driver usbhid
[    1.776933] usbhid: USB HID core driver
[    1.778950] input: DELL Dell USB Entry Keyboard as /devices/pci0000:00/0000:00:08.1/0000:38:00.3/usb3/3-2/3-2.3/3-2.3:1.0/0003:413C:2107.0001/input/input2
[    1.836485] hid-generic 0003:413C:2107.0001: input,hidraw0: USB HID v1.11 Keyboard [DELL Dell USB Entry Keyboard] on usb-0000:38:00.3-2.3/input0
[    1.843760] ata5: SATA link down (SStatus 0 SControl 330)
[    1.852394] usb 3-2.4: new high-speed USB device number 4 using xhci_hcd
[    1.953946] usb 3-2.4: New USB device found, idVendor=05e3, idProduct=0608, bcdDevice=32.98
[    1.953948] usb 3-2.4: New USB device strings: Mfr=0, Product=1, SerialNumber=0
[    1.953949] usb 3-2.4: Product: USB2.0 Hub
[    1.991391] hub 3-2.4:1.0: USB hub found
[    1.991757] hub 3-2.4:1.0: 4 ports detected
[    2.157263] ata6: SATA link down (SStatus 0 SControl 330)
[    2.157763] scsi 9:0:0:0: Direct-Access     ATA      Apacer AST280 12 1PE0 PQ: 0 ANSI: 5
[    2.158093] sd 9:0:0:0: Attached scsi generic sg0 type 0
[    2.158112] sd 9:0:0:0: [sda] 234441648 512-byte logical blocks: (120 GB/112 GiB)
[    2.158123] sd 9:0:0:0: [sda] Write Protect is off
[    2.158125] sd 9:0:0:0: [sda] Mode Sense: 00 3a 00 00
[    2.158143] sd 9:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA
[    2.158855]  sda: sda1
[    2.159308] sd 9:0:0:0: [sda] Attached SCSI disk
[    2.212710] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
[    2.223259] random: fast init done
[    2.280270] usb 3-2.4.2: new full-speed USB device number 5 using xhci_hcd
[    2.362048] systemd[1]: systemd 239 running in system mode. (+PAM +AUDIT +SELINUX +IMA +APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD -IDN2 +IDN -PCRE2 default-hierarchy=hybrid)
[    2.384430] systemd[1]: Detected architecture x86-64.
[    2.389811] systemd[1]: Set hostname to <ubuntu-desktop>.
[    2.404326] usb 3-2.4.2: New USB device found, idVendor=09fb, idProduct=6001, bcdDevice= 4.00
[    2.404328] usb 3-2.4.2: New USB device strings: Mfr=1, Product=2, SerialNumber=3
[    2.404329] usb 3-2.4.2: Product: USB-Blaster
[    2.404330] usb 3-2.4.2: Manufacturer: Altera
[    2.404331] usb 3-2.4.2: SerialNumber: 91d28408
[    2.492286] usb 3-2.4.3: new full-speed USB device number 6 using xhci_hcd
[    2.524484] random: systemd: uninitialized urandom read (16 bytes read)
[    2.524560] systemd[1]: Listening on Journal Socket (/dev/log).
[    2.524642] random: systemd: uninitialized urandom read (16 bytes read)
[    2.524682] systemd[1]: Listening on Journal Audit Socket.
[    2.524727] random: systemd: uninitialized urandom read (16 bytes read)
[    2.524972] systemd[1]: Set up automount Arbitrary Executable File Formats File System Automount Point.
[    2.525029] systemd[1]: Listening on fsck to fsckd communication Socket.
[    2.526174] systemd[1]: Created slice User and Session Slice.
[    2.526197] systemd[1]: Reached target User and Group Name Lookups.
[    2.526242] systemd[1]: Listening on initctl Compatibility Named Pipe.
[    2.536086] EXT4-fs (sda1): re-mounted. Opts: errors=remount-ro
[    2.557976] lp: driver loaded but no devices found
[    2.565826] ppdev: user-space parallel port driver
[    2.602728] systemd-journald[344]: Received request to flush runtime journal from PID 1
[    2.611480] Adding 2097148k swap on /swapfile.  Priority:-2 extents:6 across:2260988k SSFS
[    2.612968] usb 3-2.4.3: New USB device found, idVendor=045e, idProduct=07a5, bcdDevice= 7.97
[    2.612970] usb 3-2.4.3: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[    2.612972] usb 3-2.4.3: Product: Microsoft® 2.4GHz Transceiver v9.0
[    2.612973] usb 3-2.4.3: Manufacturer: Microsoft
[    2.734103] input: Microsoft Microsoft® 2.4GHz Transceiver v9.0 as /devices/pci0000:00/0000:00:08.1/0000:38:00.3/usb3/3-2/3-2.4/3-2.4.3/3-2.4.3:1.0/0003:045E:07A5.0002/input/input3
[    2.792110] hid-generic 0003:045E:07A5.0002: input,hidraw1: USB HID v1.11 Keyboard [Microsoft Microsoft® 2.4GHz Transceiver v9.0] on usb-0000:38:00.3-2.4.3/input0
[    2.807869] input: Microsoft Microsoft® 2.4GHz Transceiver v9.0 Mouse as /devices/pci0000:00/0000:00:08.1/0000:38:00.3/usb3/3-2/3-2.4/3-2.4.3/3-2.4.3:1.1/0003:045E:07A5.0003/input/input4
[    2.807970] input: Microsoft Microsoft® 2.4GHz Transceiver v9.0 Consumer Control as /devices/pci0000:00/0000:00:08.1/0000:38:00.3/usb3/3-2/3-2.4/3-2.4.3/3-2.4.3:1.1/0003:045E:07A5.0003/input/input5
[    2.808046] hid-generic 0003:045E:07A5.0003: input,hidraw2: USB HID v1.11 Mouse [Microsoft Microsoft® 2.4GHz Transceiver v9.0] on usb-0000:38:00.3-2.4.3/input1
[    2.814352] audit: type=1400 audit(1552568522.515:2): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/bin/man" pid=466 comm="apparmor_parser"
[    2.814354] audit: type=1400 audit(1552568522.515:3): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_filter" pid=466 comm="apparmor_parser"
[    2.814355] audit: type=1400 audit(1552568522.515:4): apparmor="STATUS" operation="profile_load" profile="unconfined" name="man_groff" pid=466 comm="apparmor_parser"
[    2.817304] input: Microsoft Microsoft® 2.4GHz Transceiver v9.0 Consumer Control as /devices/pci0000:00/0000:00:08.1/0000:38:00.3/usb3/3-2/3-2.4/3-2.4.3/3-2.4.3:1.2/0003:045E:07A5.0004/input/input6
[    2.818892] audit: type=1400 audit(1552568522.519:5): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine" pid=467 comm="apparmor_parser"
[    2.818896] audit: type=1400 audit(1552568522.519:6): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/snapd/snap-confine//mount-namespace-capture-helper" pid=467 comm="apparmor_parser"
[    2.821831] audit: type=1400 audit(1552568522.523:7): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/sbin/dhclient" pid=463 comm="apparmor_parser"
[    2.821834] audit: type=1400 audit(1552568522.523:8): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-client.action" pid=463 comm="apparmor_parser"
[    2.821835] audit: type=1400 audit(1552568522.523:9): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/NetworkManager/nm-dhcp-helper" pid=463 comm="apparmor_parser"
[    2.821836] audit: type=1400 audit(1552568522.523:10): apparmor="STATUS" operation="profile_load" profile="unconfined" name="/usr/lib/connman/scripts/dhclient-script" pid=463 comm="apparmor_parser"
[    2.876200] input: Microsoft Microsoft® 2.4GHz Transceiver v9.0 System Control as /devices/pci0000:00/0000:00:08.1/0000:38:00.3/usb3/3-2/3-2.4/3-2.4.3/3-2.4.3:1.2/0003:045E:07A5.0004/input/input7
[    2.876251] hid-generic 0003:045E:07A5.0004: input,hidraw3: USB HID v1.11 Device [Microsoft Microsoft® 2.4GHz Transceiver v9.0] on usb-0000:38:00.3-2.4.3/input2
[    3.183132] cfg80211: Loading compiled-in X.509 certificates for regulatory database
[    3.191547] Bluetooth: Core ver 2.22
[    3.191559] NET: Registered protocol family 31
[    3.191560] Bluetooth: HCI device and connection manager initialized
[    3.191562] Bluetooth: HCI socket layer initialized
[    3.191563] Bluetooth: L2CAP socket layer initialized
[    3.191565] Bluetooth: SCO socket layer initialized
[    3.196101] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[    3.211750] cryptd: max_cpu_qlen set to 1000
[    3.225094] AMD-Vi: AMD IOMMUv2 driver by Joerg Roedel <jroedel@suse.de>
[    3.233763] Intel(R) Wireless WiFi driver for Linux
[    3.233764] Copyright(c) 2003- 2015 Intel Corporation
[    3.234575] usbcore: registered new interface driver btusb
[    3.251310] Bluetooth: hci0: read Intel version: 370810225019140f1d
[    3.251312] Bluetooth: hci0: Intel device is already patched. patch num: 1d
[    3.259059] AVX2 version of gcm_enc/dec engaged.
[    3.259060] AES CTR mode by8 optimization enabled
[    3.295219] iwlwifi 0000:24:00.0: loaded firmware version 29.1044073957.0 op_mode iwlmvm
[    3.306234] [drm] amdgpu kernel modesetting enabled.
[    3.306298] Parsing CRAT table with 1 nodes
[    3.306308] Creating topology SYSFS entries
[    3.306341] Topology: Add APU node [0x0:0x0]
[    3.306341] Finished initializing topology
[    3.306396] checking generic (e0000000 e10000) vs hw (e0000000 10000000)
[    3.306397] fb0: switching to amdgpudrmfb from VESA VGA
[    3.306431] Console: switching to colour dummy device 80x25
[    3.306724] [drm] initializing kernel modesetting (RAVEN 0x1002:0x15DD 0x1002:0x15DD 0xC9).
[    3.306736] [drm] register mmio base: 0xFE500000
[    3.306736] [drm] register mmio size: 524288
[    3.306747] [drm] add ip block number 0 <soc15_common>
[    3.306748] [drm] add ip block number 1 <gmc_v9_0>
[    3.306749] [drm] add ip block number 2 <vega10_ih>
[    3.306749] [drm] add ip block number 3 <psp>
[    3.306750] [drm] add ip block number 4 <gfx_v9_0>
[    3.306751] [drm] add ip block number 5 <sdma_v4_0>
[    3.306751] [drm] add ip block number 6 <powerplay>
[    3.306752] [drm] add ip block number 7 <dm>
[    3.306753] [drm] add ip block number 8 <vcn_v1_0>
[    3.341759] [drm] VCN decode is enabled in VM mode
[    3.341760] [drm] VCN encode is enabled in VM mode
[    3.341761] [drm] VCN jpeg decode is enabled in VM mode
[    3.356381] iwlwifi 0000:24:00.0: Detected Intel(R) Dual Band Wireless AC 3168, REV=0x220
[    3.365357] [drm] BIOS signature incorrect 0 0
[    3.365385] ATOM BIOS: 113-RAVEN-110
[    3.365410] [drm] vm size is 262144 GB, 4 levels, block size is 9-bit, fragment size is 9-bit
[    3.365418] amdgpu 0000:38:00.0: VRAM: 2048M 0x000000F400000000 - 0x000000F47FFFFFFF (2048M used)
[    3.365419] amdgpu 0000:38:00.0: GART: 1024M 0x0000000000000000 - 0x000000003FFFFFFF
[    3.365420] amdgpu 0000:38:00.0: AGP: 267419648M 0x000000F800000000 - 0x0000FFFFFFFFFFFF
[    3.365424] [drm] Detected VRAM RAM=2048M, BAR=2048M
[    3.365425] [drm] RAM width 128bits DDR4
[    3.368054] [TTM] Zone  kernel: Available graphics memory: 7175572 kiB
[    3.368055] [TTM] Zone   dma32: Available graphics memory: 2097152 kiB
[    3.368056] [TTM] Initializing pool allocator
[    3.368059] [TTM] Initializing DMA pool allocator
[    3.368130] [drm] amdgpu: 2048M of VRAM memory ready
[    3.368131] [drm] amdgpu: 3072M of GTT memory ready.
[    3.368145] [drm] GART: num cpu pages 262144, num gpu pages 262144
[    3.368293] [drm] PCIE GART of 1024M enabled (table at 0x000000F400E10000).
[    3.374055] iwlwifi 0000:24:00.0: base HW address: 3c:6a:a7:4e:30:b8
[    3.389125] snd_hda_intel 0000:38:00.1: Handle vga_switcheroo audio client
[    3.402533] input: HD-Audio Generic HDMI/DP,pcm=3 as /devices/pci0000:00/0000:00:08.1/0000:38:00.1/sound/card0/input8
[    3.402599] input: HD-Audio Generic HDMI/DP,pcm=7 as /devices/pci0000:00/0000:00:08.1/0000:38:00.1/sound/card0/input9
[    3.402650] input: HD-Audio Generic HDMI/DP,pcm=8 as /devices/pci0000:00/0000:00:08.1/0000:38:00.1/sound/card0/input10
[    3.402694] input: HD-Audio Generic HDMI/DP,pcm=9 as /devices/pci0000:00/0000:00:08.1/0000:38:00.1/sound/card0/input11
[    3.430039] snd_hda_codec_realtek hdaudioC1D0: autoconfig for ALC1220: line_outs=3 (0x14/0x15/0x16/0x0/0x0) type:line
[    3.430041] snd_hda_codec_realtek hdaudioC1D0:    speaker_outs=0 (0x0/0x0/0x0/0x0/0x0)
[    3.430042] snd_hda_codec_realtek hdaudioC1D0:    hp_outs=1 (0x1b/0x0/0x0/0x0/0x0)
[    3.430043] snd_hda_codec_realtek hdaudioC1D0:    mono: mono_out=0x0
[    3.430044] snd_hda_codec_realtek hdaudioC1D0:    dig-out=0x1e/0x0
[    3.430045] snd_hda_codec_realtek hdaudioC1D0:    inputs:
[    3.430046] snd_hda_codec_realtek hdaudioC1D0:      Front Mic=0x19
[    3.430047] snd_hda_codec_realtek hdaudioC1D0:      Rear Mic=0x18
[    3.430054] snd_hda_codec_realtek hdaudioC1D0:      Line=0x1a
[    3.433201] ieee80211 phy0: Selected rate control algorithm 'iwl-mvm-rs'
[    3.433518] thermal thermal_zone0: failed to read out thermal zone (-61)
[    3.474754] input: HD-Audio Generic Front Mic as /devices/pci0000:00/0000:00:08.1/0000:38:00.6/sound/card1/input12
[    3.474829] input: HD-Audio Generic Rear Mic as /devices/pci0000:00/0000:00:08.1/0000:38:00.6/sound/card1/input13
[    3.474873] input: HD-Audio Generic Line as /devices/pci0000:00/0000:00:08.1/0000:38:00.6/sound/card1/input14
[    3.474924] input: HD-Audio Generic Line Out Front as /devices/pci0000:00/0000:00:08.1/0000:38:00.6/sound/card1/input15
[    3.474996] input: HD-Audio Generic Line Out Surround as /devices/pci0000:00/0000:00:08.1/0000:38:00.6/sound/card1/input16
[    3.475050] input: HD-Audio Generic Line Out CLFE as /devices/pci0000:00/0000:00:08.1/0000:38:00.6/sound/card1/input17
[    3.475102] input: HD-Audio Generic Front Headphone as /devices/pci0000:00/0000:00:08.1/0000:38:00.6/sound/card1/input18
[    3.492277] [drm] use_doorbell being set to: [true]
[    3.494895] [drm] Found VCN firmware Version: 1.73 Family ID: 18
[    3.494904] [drm] PSP loading VCN firmware
[    3.549581] kvm: Nested Virtualization enabled
[    3.549588] kvm: Nested Paging enabled
[    3.549588] SVM: Virtual VMLOAD VMSAVE supported
[    3.549589] SVM: Virtual GIF supported
[    3.554174] [drm] reserve 0x400000 from 0xf401100000 for PSP TMR SIZE
[    3.568534] MCE: In-kernel MCE decoding enabled.
[    3.584830] EDAC amd64: Node 0: DRAM ECC disabled.
[    3.584831] EDAC amd64: ECC disabled in the BIOS or no ECC capability, module will not load.
                Either enable ECC checking or force module loading by setting 'ecc_enable_override'.
                (Note that use of the override may cause unknown side effects.)
[    3.634294] EDAC amd64: Node 0: DRAM ECC disabled.
[    3.634295] EDAC amd64: ECC disabled in the BIOS or no ECC capability, module will not load.
                Either enable ECC checking or force module loading by setting 'ecc_enable_override'.
                (Note that use of the override may cause unknown side effects.)
[    3.744008] [drm] DM_PPLIB: values for Invalid clock
[    3.744010] [drm] DM_PPLIB:	 0 in kHz
[    3.744010] [drm] DM_PPLIB:	 400000 in kHz
[    3.744011] [drm] DM_PPLIB:	 933000 in kHz
[    3.744011] [drm] DM_PPLIB:	 1067000 in kHz
[    3.744107] WARNING: CPU: 3 PID: 485 at drivers/gpu/drm/amd/amdgpu/../display/dc/calcs/dcn_calcs.c:1380 dcn_bw_update_from_pplib+0x196/0x2c0 [amdgpu]
[    3.744107] Modules linked in: joydev edac_mce_amd kvm_amd ccp kvm irqbypass snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio arc4 snd_hda_codec_hdmi snd_hda_intel snd_hda_codec snd_hda_core crct10dif_pclmul snd_hwdep iwlmvm crc32_pclmul ghash_clmulni_intel snd_pcm snd_seq_dummy mac80211 snd_seq_oss amdgpu(+) snd_seq_midi snd_seq_midi_event snd_rawmidi aesni_intel snd_seq btusb chash iwlwifi aes_x86_64 amd_iommu_v2 btrtl crypto_simd cryptd gpu_sched btbcm btintel glue_helper ttm snd_seq_device input_leds snd_timer bluetooth snd drm_kms_helper cfg80211 wmi_bmof ecdh_generic drm soundcore fb_sys_fops syscopyarea sysfillrect sysimgblt k10temp mac_hid sch_fq_codel parport_pc ppdev lp parport ip_tables x_tables autofs4 hid_generic usbhid hid igb i2c_algo_bit dca ahci libahci i2c_piix4 wmi video gpio_amdpt gpio_generic
[    3.744139] CPU: 3 PID: 485 Comm: systemd-udevd Not tainted 5.0.2-050002-generic #201903131832
[    3.744139] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./B450 Gaming-ITX/ac, BIOS P1.70 12/17/2018
[    3.744202] RIP: 0010:dcn_bw_update_from_pplib+0x196/0x2c0 [amdgpu]
[    3.744203] Code: 84 fd 44 ff ff ff 49 8b 95 78 01 00 00 48 89 85 30 ff ff ff df ad 30 ff ff ff d8 f1 db 42 78 de c9 de ca de f9 d9 5a 4c eb 02 <0f> 0b 48 89 da be 04 00 00 00 4c 89 e7 e8 e8 57 fe ff 84 c0 0f 84
[    3.744204] RSP: 0018:ffffb698c3473680 EFLAGS: 00010246
[    3.744206] RAX: 0000000000000001 RBX: ffffb698c34736e0 RCX: 0000000000000006
[    3.744206] RDX: 0000000000000000 RSI: 0000000000000004 RDI: ffff8fda50ad6440
[    3.744207] RBP: ffffb698c3473750 R08: 0000000000000001 R09: 00000000000003ee
[    3.744208] R10: 0000000000000004 R11: 0000000000000000 R12: ffff8fda47131380
[    3.744208] R13: ffff8fda44f7d800 R14: 0000000000000000 R15: ffff8fda4aac1d80
[    3.744210] FS:  00007f25d44888c0(0000) GS:ffff8fda50ac0000(0000) knlGS:0000000000000000
[    3.744211] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    3.744211] CR2: 0000560844905158 CR3: 0000000408f8c000 CR4: 00000000003406e0
[    3.744212] Call Trace:
[    3.744276]  construct+0x8d7/0xb40 [amdgpu]
[    3.744279]  ? _cond_resched+0x19/0x30
[    3.744282]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.744342]  dcn10_create_resource_pool+0x41/0x60 [amdgpu]
[    3.744398]  dc_create_resource_pool+0x46/0x180 [amdgpu]
[    3.744400]  ? _cond_resched+0x19/0x30
[    3.744402]  ? __kmalloc+0x178/0x220
[    3.744461]  ? dal_gpio_service_create+0x99/0x130 [amdgpu]
[    3.744517]  dc_create+0x233/0x630 [amdgpu]
[    3.744519]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.744579]  dm_hw_init+0xe2/0x150 [amdgpu]
[    3.744641]  amdgpu_device_init.cold.34+0x1067/0x13e3 [amdgpu]
[    3.744688]  amdgpu_driver_load_kms+0x8d/0x360 [amdgpu]
[    3.744699]  drm_dev_register+0x129/0x170 [drm]
[    3.744745]  amdgpu_pci_probe+0xc5/0x120 [amdgpu]
[    3.744748]  local_pci_probe+0x46/0x90
[    3.744749]  pci_device_probe+0x11c/0x1a0
[    3.744753]  really_probe+0xfe/0x3b0
[    3.744754]  driver_probe_device+0xba/0x100
[    3.744755]  __driver_attach+0xe4/0x110
[    3.744757]  ? driver_probe_device+0x100/0x100
[    3.744758]  bus_for_each_dev+0x79/0xc0
[    3.744759]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.744761]  driver_attach+0x1e/0x20
[    3.744762]  bus_add_driver+0x159/0x230
[    3.744763]  ? 0xffffffffc0a8f000
[    3.744765]  driver_register+0x70/0xc0
[    3.744766]  ? 0xffffffffc0a8f000
[    3.744767]  __pci_register_driver+0x57/0x60
[    3.744812]  amdgpu_init+0x81/0x83 [amdgpu]
[    3.744815]  do_one_initcall+0x4a/0x1c4
[    3.744816]  ? _cond_resched+0x19/0x30
[    3.744818]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.744821]  do_init_module+0x60/0x220
[    3.744822]  load_module+0x1708/0x1970
[    3.744825]  __do_sys_finit_module+0xbd/0x120
[    3.744826]  ? __do_sys_finit_module+0xbd/0x120
[    3.744828]  __x64_sys_finit_module+0x1a/0x20
[    3.744830]  do_syscall_64+0x5a/0x110
[    3.744832]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[    3.744833] RIP: 0033:0x7f25d4f0d219
[    3.744834] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 47 fc 0c 00 f7 d8 64 89 01 48
[    3.744834] RSP: 002b:00007fff1bc403b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[    3.744836] RAX: ffffffffffffffda RBX: 000055d50f1b51d0 RCX: 00007f25d4f0d219
[    3.744836] RDX: 0000000000000000 RSI: 00007f25d4df1cad RDI: 0000000000000018
[    3.744837] RBP: 00007f25d4df1cad R08: 0000000000000000 R09: 0000000000000000
[    3.744838] R10: 0000000000000018 R11: 0000000000000246 R12: 0000000000000000
[    3.744838] R13: 000055d50f1a0040 R14: 0000000000020000 R15: 000055d50f1b51d0
[    3.744840] ---[ end trace 0ee3d672ad3507da ]---
[    3.745857] [drm] DM_PPLIB: values for Invalid clock
[    3.745857] [drm] DM_PPLIB:	 300000 in kHz
[    3.745858] [drm] DM_PPLIB:	 600000 in kHz
[    3.745858] [drm] DM_PPLIB:	 626000 in kHz
[    3.745859] [drm] DM_PPLIB:	 654000 in kHz
[    3.788246] [drm] Display Core initialized with v3.2.08!
[    3.794306] Bluetooth: BNEP (Ethernet Emulation) ver 1.3
[    3.794307] Bluetooth: BNEP filters: protocol multicast
[    3.794310] Bluetooth: BNEP socket layer initialized
[    3.811015] iwlwifi 0000:24:00.0 wlp36s0: renamed from wlan0
[    3.817623] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
[    3.817624] [drm] Driver supports precise vblank timestamp query.
[    3.832732] [drm] VCN decode and encode initialized successfully(under SPG Mode).
[    3.833484] kfd kfd: Allocated 3969056 bytes on gart
[    3.833503] Topology: Add APU node [0x15dd:0x1002]
[    3.835553] kfd kfd: added device 1002:15dd
[    3.837864] [drm] fb mappable at 0x61500000
[    3.837865] [drm] vram apper at 0x60000000
[    3.837866] [drm] size 14745600
[    3.837866] [drm] fb depth is 24
[    3.837866] [drm]    pitch is 10240
[    3.837928] fbcon: amdgpudrmfb (fb0) is primary device
[    3.864791] WARNING: CPU: 3 PID: 485 at drivers/gpu/drm/amd/amdgpu/../display/dc/core/dc_link.c:1639 enable_link_hdmi+0x6e0/0xb00 [amdgpu]
[    3.864792] Modules linked in: cmac bnep joydev edac_mce_amd kvm_amd ccp kvm irqbypass snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio arc4 snd_hda_codec_hdmi snd_hda_intel snd_hda_codec snd_hda_core crct10dif_pclmul snd_hwdep iwlmvm crc32_pclmul ghash_clmulni_intel snd_pcm snd_seq_dummy mac80211 snd_seq_oss amdgpu(+) snd_seq_midi snd_seq_midi_event snd_rawmidi aesni_intel snd_seq btusb chash iwlwifi aes_x86_64 amd_iommu_v2 btrtl crypto_simd cryptd gpu_sched btbcm btintel glue_helper ttm snd_seq_device input_leds snd_timer bluetooth snd drm_kms_helper cfg80211 wmi_bmof ecdh_generic drm soundcore fb_sys_fops syscopyarea sysfillrect sysimgblt k10temp mac_hid sch_fq_codel parport_pc ppdev lp parport ip_tables x_tables autofs4 hid_generic usbhid hid igb i2c_algo_bit dca ahci libahci i2c_piix4 wmi video gpio_amdpt gpio_generic
[    3.864822] CPU: 3 PID: 485 Comm: systemd-udevd Tainted: G        W         5.0.2-050002-generic #201903131832
[    3.864822] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./B450 Gaming-ITX/ac, BIOS P1.70 12/17/2018
[    3.864879] RIP: 0010:enable_link_hdmi+0x6e0/0xb00 [amdgpu]
[    3.864881] Code: 44 0f b6 45 c1 44 0f b6 c8 48 c7 c6 b0 20 9d c0 bf 04 00 00 00 88 45 9c e8 3d 1b a3 ff 0f b6 45 9c 44 0f b6 5d 98 84 c0 75 02 <0f> 0b 41 8d 46 f6 3c 02 77 88 41 80 fe 0a 0f 85 c7 01 00 00 44 88
[    3.864882] RSP: 0018:ffffb698c3473168 EFLAGS: 00010246
[    3.864883] RAX: 0000000000000000 RBX: ffffb698c34731ad RCX: 000000000000000a
[    3.864884] RDX: 000000000000005d RSI: ffffffffc09d20b0 RDI: 0000000000000004
[    3.864884] RBP: ffffb698c3473208 R08: 0000000000000013 R09: 0000000000000000
[    3.864885] R10: ffffd8755024bd80 R11: 0000000000000013 R12: ffff8fda46b30188
[    3.864885] R13: 000000000000005d R14: 000000000000000a R15: ffffb698c34731b1
[    3.864887] FS:  00007f25d44888c0(0000) GS:ffff8fda50ac0000(0000) knlGS:0000000000000000
[    3.864887] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    3.864888] CR2: 00007f47a12db7d8 CR3: 0000000408f8c000 CR4: 00000000003406e0
[    3.864889] Call Trace:
[    3.864947]  core_link_enable_stream+0x22b/0x600 [amdgpu]
[    3.865006]  ? opp1_program_fmt+0x2a9/0x720 [amdgpu]
[    3.865061]  dce110_apply_ctx_to_hw+0x457/0x4b0 [amdgpu]
[    3.865117]  dc_commit_state+0x2ce/0x540 [amdgpu]
[    3.865120]  ? ktime_get_raw+0x32/0x90
[    3.865131]  ? drm_calc_timestamping_constants+0x109/0x150 [drm]
[    3.865191]  amdgpu_dm_atomic_commit_tail+0x1e8/0xbe0 [amdgpu]
[    3.865249]  ? dm_plane_helper_prepare_fb+0x1fa/0x310 [amdgpu]
[    3.865256]  commit_tail+0x42/0x70 [drm_kms_helper]
[    3.865261]  drm_atomic_helper_commit+0x113/0x120 [drm_kms_helper]
[    3.865321]  amdgpu_dm_atomic_commit+0x8d/0xa0 [amdgpu]
[    3.865333]  drm_atomic_commit+0x4a/0x50 [drm]
[    3.865338]  restore_fbdev_mode_atomic+0x1bf/0x1d0 [drm_kms_helper]
[    3.865344]  restore_fbdev_mode+0x51/0x160 [drm_kms_helper]
[    3.865346]  ? _cond_resched+0x19/0x30
[    3.865352]  drm_fb_helper_restore_fbdev_mode_unlocked+0x4e/0xa0 [drm_kms_helper]
[    3.865358]  drm_fb_helper_set_par+0x2d/0x50 [drm_kms_helper]
[    3.865361]  fbcon_init+0x456/0x5c0
[    3.865364]  visual_init+0xd5/0x130
[    3.865365]  do_bind_con_driver+0x1e2/0x2d0
[    3.865367]  do_take_over_console+0x129/0x1a0
[    3.865369]  do_fbcon_takeover+0x5c/0xb0
[    3.865370]  fbcon_event_notify+0x5b1/0x725
[    3.865373]  notifier_call_chain+0x4c/0x70
[    3.865374]  blocking_notifier_call_chain+0x43/0x60
[    3.865376]  fb_notifier_call_chain+0x1b/0x20
[    3.865378]  register_framebuffer+0x25c/0x350
[    3.865383]  __drm_fb_helper_initial_config_and_unlock+0x212/0x400 [drm_kms_helper]
[    3.865388]  drm_fb_helper_initial_config+0x35/0x40 [drm_kms_helper]
[    3.865437]  amdgpu_fbdev_init+0xcd/0x100 [amdgpu]
[    3.865498]  amdgpu_device_init.cold.34+0x1161/0x13e3 [amdgpu]
[    3.865545]  amdgpu_driver_load_kms+0x8d/0x360 [amdgpu]
[    3.865555]  drm_dev_register+0x129/0x170 [drm]
[    3.865601]  amdgpu_pci_probe+0xc5/0x120 [amdgpu]
[    3.865604]  local_pci_probe+0x46/0x90
[    3.865605]  pci_device_probe+0x11c/0x1a0
[    3.865608]  really_probe+0xfe/0x3b0
[    3.865609]  driver_probe_device+0xba/0x100
[    3.865610]  __driver_attach+0xe4/0x110
[    3.865612]  ? driver_probe_device+0x100/0x100
[    3.865613]  bus_for_each_dev+0x79/0xc0
[    3.865615]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.865617]  driver_attach+0x1e/0x20
[    3.865618]  bus_add_driver+0x159/0x230
[    3.865619]  ? 0xffffffffc0a8f000
[    3.865620]  driver_register+0x70/0xc0
[    3.865621]  ? 0xffffffffc0a8f000
[    3.865622]  __pci_register_driver+0x57/0x60
[    3.865668]  amdgpu_init+0x81/0x83 [amdgpu]
[    3.865670]  do_one_initcall+0x4a/0x1c4
[    3.865672]  ? _cond_resched+0x19/0x30
[    3.865673]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.865676]  do_init_module+0x60/0x220
[    3.865677]  load_module+0x1708/0x1970
[    3.865680]  __do_sys_finit_module+0xbd/0x120
[    3.865682]  ? __do_sys_finit_module+0xbd/0x120
[    3.865684]  __x64_sys_finit_module+0x1a/0x20
[    3.865685]  do_syscall_64+0x5a/0x110
[    3.865687]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[    3.865688] RIP: 0033:0x7f25d4f0d219
[    3.865689] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 47 fc 0c 00 f7 d8 64 89 01 48
[    3.865689] RSP: 002b:00007fff1bc403b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[    3.865691] RAX: ffffffffffffffda RBX: 000055d50f1b51d0 RCX: 00007f25d4f0d219
[    3.865691] RDX: 0000000000000000 RSI: 00007f25d4df1cad RDI: 0000000000000018
[    3.865692] RBP: 00007f25d4df1cad R08: 0000000000000000 R09: 0000000000000000
[    3.865693] R10: 0000000000000018 R11: 0000000000000246 R12: 0000000000000000
[    3.865693] R13: 000055d50f1a0040 R14: 0000000000020000 R15: 000055d50f1b51d0
[    3.865695] ---[ end trace 0ee3d672ad3507db ]---
[    3.865924] WARNING: CPU: 3 PID: 485 at drivers/gpu/drm/amd/amdgpu/../display/dc/core/dc_link.c:1671 enable_link_hdmi+0x748/0xb00 [amdgpu]
[    3.865924] Modules linked in: cmac bnep joydev edac_mce_amd kvm_amd ccp kvm irqbypass snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio arc4 snd_hda_codec_hdmi snd_hda_intel snd_hda_codec snd_hda_core crct10dif_pclmul snd_hwdep iwlmvm crc32_pclmul ghash_clmulni_intel snd_pcm snd_seq_dummy mac80211 snd_seq_oss amdgpu(+) snd_seq_midi snd_seq_midi_event snd_rawmidi aesni_intel snd_seq btusb chash iwlwifi aes_x86_64 amd_iommu_v2 btrtl crypto_simd cryptd gpu_sched btbcm btintel glue_helper ttm snd_seq_device input_leds snd_timer bluetooth snd drm_kms_helper cfg80211 wmi_bmof ecdh_generic drm soundcore fb_sys_fops syscopyarea sysfillrect sysimgblt k10temp mac_hid sch_fq_codel parport_pc ppdev lp parport ip_tables x_tables autofs4 hid_generic usbhid hid igb i2c_algo_bit dca ahci libahci i2c_piix4 wmi video gpio_amdpt gpio_generic
[    3.865945] CPU: 3 PID: 485 Comm: systemd-udevd Tainted: G        W         5.0.2-050002-generic #201903131832
[    3.865946] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./B450 Gaming-ITX/ac, BIOS P1.70 12/17/2018
[    3.866002] RIP: 0010:enable_link_hdmi+0x748/0xb00 [amdgpu]
[    3.866003] Code: c0 44 89 ea 44 0f b6 45 c1 44 0f b6 c8 48 c7 c6 10 21 9d c0 bf 04 00 00 00 45 89 ce e8 d1 1a a3 ff 45 84 f6 0f 85 2a ff ff ff <0f> 0b e9 23 ff ff ff 44 8b 6d 88 44 8b 55 80 48 8b 9d 78 ff ff ff
[    3.866004] RSP: 0018:ffffb698c3473168 EFLAGS: 00010246
[    3.866005] RAX: 0000000000000000 RBX: ffffb698c34731ad RCX: 000000000000000a
[    3.866005] RDX: 000000000000005d RSI: ffffffffc09d2110 RDI: 0000000000000004
[    3.866006] RBP: ffffb698c3473208 R08: 0000000000000017 R09: 0000000000000000
[    3.866006] R10: ffffd8755024bd80 R11: 0000000000000001 R12: ffff8fda46b30188
[    3.866007] R13: 000000000000005d R14: 0000000000000000 R15: ffffb698c34731b1
[    3.866008] FS:  00007f25d44888c0(0000) GS:ffff8fda50ac0000(0000) knlGS:0000000000000000
[    3.866009] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    3.866010] CR2: 00007f47a12db7d8 CR3: 0000000408f8c000 CR4: 00000000003406e0
[    3.866010] Call Trace:
[    3.866067]  core_link_enable_stream+0x22b/0x600 [amdgpu]
[    3.866125]  ? opp1_program_fmt+0x2a9/0x720 [amdgpu]
[    3.866181]  dce110_apply_ctx_to_hw+0x457/0x4b0 [amdgpu]
[    3.866237]  dc_commit_state+0x2ce/0x540 [amdgpu]
[    3.866239]  ? ktime_get_raw+0x32/0x90
[    3.866249]  ? drm_calc_timestamping_constants+0x109/0x150 [drm]
[    3.866310]  amdgpu_dm_atomic_commit_tail+0x1e8/0xbe0 [amdgpu]
[    3.866369]  ? dm_plane_helper_prepare_fb+0x1fa/0x310 [amdgpu]
[    3.866376]  commit_tail+0x42/0x70 [drm_kms_helper]
[    3.866381]  drm_atomic_helper_commit+0x113/0x120 [drm_kms_helper]
[    3.866440]  amdgpu_dm_atomic_commit+0x8d/0xa0 [amdgpu]
[    3.866451]  drm_atomic_commit+0x4a/0x50 [drm]
[    3.866456]  restore_fbdev_mode_atomic+0x1bf/0x1d0 [drm_kms_helper]
[    3.866462]  restore_fbdev_mode+0x51/0x160 [drm_kms_helper]
[    3.866463]  ? _cond_resched+0x19/0x30
[    3.866468]  drm_fb_helper_restore_fbdev_mode_unlocked+0x4e/0xa0 [drm_kms_helper]
[    3.866473]  drm_fb_helper_set_par+0x2d/0x50 [drm_kms_helper]
[    3.866475]  fbcon_init+0x456/0x5c0
[    3.866477]  visual_init+0xd5/0x130
[    3.866479]  do_bind_con_driver+0x1e2/0x2d0
[    3.866481]  do_take_over_console+0x129/0x1a0
[    3.866482]  do_fbcon_takeover+0x5c/0xb0
[    3.866483]  fbcon_event_notify+0x5b1/0x725
[    3.866485]  notifier_call_chain+0x4c/0x70
[    3.866486]  blocking_notifier_call_chain+0x43/0x60
[    3.866488]  fb_notifier_call_chain+0x1b/0x20
[    3.866490]  register_framebuffer+0x25c/0x350
[    3.866495]  __drm_fb_helper_initial_config_and_unlock+0x212/0x400 [drm_kms_helper]
[    3.866500]  drm_fb_helper_initial_config+0x35/0x40 [drm_kms_helper]
[    3.866548]  amdgpu_fbdev_init+0xcd/0x100 [amdgpu]
[    3.866609]  amdgpu_device_init.cold.34+0x1161/0x13e3 [amdgpu]
[    3.866656]  amdgpu_driver_load_kms+0x8d/0x360 [amdgpu]
[    3.866665]  drm_dev_register+0x129/0x170 [drm]
[    3.866712]  amdgpu_pci_probe+0xc5/0x120 [amdgpu]
[    3.866714]  local_pci_probe+0x46/0x90
[    3.866715]  pci_device_probe+0x11c/0x1a0
[    3.866717]  really_probe+0xfe/0x3b0
[    3.866719]  driver_probe_device+0xba/0x100
[    3.866720]  __driver_attach+0xe4/0x110
[    3.866721]  ? driver_probe_device+0x100/0x100
[    3.866722]  bus_for_each_dev+0x79/0xc0
[    3.866724]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.866725]  driver_attach+0x1e/0x20
[    3.866726]  bus_add_driver+0x159/0x230
[    3.866727]  ? 0xffffffffc0a8f000
[    3.866728]  driver_register+0x70/0xc0
[    3.866729]  ? 0xffffffffc0a8f000
[    3.866730]  __pci_register_driver+0x57/0x60
[    3.866776]  amdgpu_init+0x81/0x83 [amdgpu]
[    3.866778]  do_one_initcall+0x4a/0x1c4
[    3.866779]  ? _cond_resched+0x19/0x30
[    3.866781]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.866783]  do_init_module+0x60/0x220
[    3.866784]  load_module+0x1708/0x1970
[    3.866787]  __do_sys_finit_module+0xbd/0x120
[    3.866788]  ? __do_sys_finit_module+0xbd/0x120
[    3.866790]  __x64_sys_finit_module+0x1a/0x20
[    3.866792]  do_syscall_64+0x5a/0x110
[    3.866793]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[    3.866794] RIP: 0033:0x7f25d4f0d219
[    3.866795] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 47 fc 0c 00 f7 d8 64 89 01 48
[    3.866796] RSP: 002b:00007fff1bc403b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[    3.866797] RAX: ffffffffffffffda RBX: 000055d50f1b51d0 RCX: 00007f25d4f0d219
[    3.866798] RDX: 0000000000000000 RSI: 00007f25d4df1cad RDI: 0000000000000018
[    3.866798] RBP: 00007f25d4df1cad R08: 0000000000000000 R09: 0000000000000000
[    3.866799] R10: 0000000000000018 R11: 0000000000000246 R12: 0000000000000000
[    3.866799] R13: 000055d50f1a0040 R14: 0000000000020000 R15: 000055d50f1b51d0
[    3.866801] ---[ end trace 0ee3d672ad3507dc ]---
[    3.867028] WARNING: CPU: 3 PID: 485 at drivers/gpu/drm/amd/amdgpu/../display/dc/core/dc_link.c:1639 enable_link_hdmi+0x6e0/0xb00 [amdgpu]
[    3.867029] Modules linked in: cmac bnep joydev edac_mce_amd kvm_amd ccp kvm irqbypass snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio arc4 snd_hda_codec_hdmi snd_hda_intel snd_hda_codec snd_hda_core crct10dif_pclmul snd_hwdep iwlmvm crc32_pclmul ghash_clmulni_intel snd_pcm snd_seq_dummy mac80211 snd_seq_oss amdgpu(+) snd_seq_midi snd_seq_midi_event snd_rawmidi aesni_intel snd_seq btusb chash iwlwifi aes_x86_64 amd_iommu_v2 btrtl crypto_simd cryptd gpu_sched btbcm btintel glue_helper ttm snd_seq_device input_leds snd_timer bluetooth snd drm_kms_helper cfg80211 wmi_bmof ecdh_generic drm soundcore fb_sys_fops syscopyarea sysfillrect sysimgblt k10temp mac_hid sch_fq_codel parport_pc ppdev lp parport ip_tables x_tables autofs4 hid_generic usbhid hid igb i2c_algo_bit dca ahci libahci i2c_piix4 wmi video gpio_amdpt gpio_generic
[    3.867048] CPU: 3 PID: 485 Comm: systemd-udevd Tainted: G        W         5.0.2-050002-generic #201903131832
[    3.867049] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./B450 Gaming-ITX/ac, BIOS P1.70 12/17/2018
[    3.867104] RIP: 0010:enable_link_hdmi+0x6e0/0xb00 [amdgpu]
[    3.867105] Code: 44 0f b6 45 c1 44 0f b6 c8 48 c7 c6 b0 20 9d c0 bf 04 00 00 00 88 45 9c e8 3d 1b a3 ff 0f b6 45 9c 44 0f b6 5d 98 84 c0 75 02 <0f> 0b 41 8d 46 f6 3c 02 77 88 41 80 fe 0a 0f 85 c7 01 00 00 44 88
[    3.867105] RSP: 0018:ffffb698c3473168 EFLAGS: 00010246
[    3.867106] RAX: 0000000000000000 RBX: ffffb698c34731af RCX: 000000000000000b
[    3.867107] RDX: 000000000000005d RSI: ffffffffc09d20b0 RDI: 0000000000000004
[    3.867107] RBP: ffffb698c3473208 R08: 00000000000000c8 R09: 0000000000000000
[    3.867108] R10: ffffd8755024bd80 R11: 00000000000000c8 R12: ffff8fda46b30188
[    3.867108] R13: 000000000000005d R14: 000000000000000b R15: ffffb698c34731b1
[    3.867109] FS:  00007f25d44888c0(0000) GS:ffff8fda50ac0000(0000) knlGS:0000000000000000
[    3.867110] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    3.867111] CR2: 00007f47a12db7d8 CR3: 0000000408f8c000 CR4: 00000000003406e0
[    3.867111] Call Trace:
[    3.867166]  core_link_enable_stream+0x22b/0x600 [amdgpu]
[    3.867223]  ? opp1_program_fmt+0x2a9/0x720 [amdgpu]
[    3.867279]  dce110_apply_ctx_to_hw+0x457/0x4b0 [amdgpu]
[    3.867333]  dc_commit_state+0x2ce/0x540 [amdgpu]
[    3.867335]  ? ktime_get_raw+0x32/0x90
[    3.867345]  ? drm_calc_timestamping_constants+0x109/0x150 [drm]
[    3.867404]  amdgpu_dm_atomic_commit_tail+0x1e8/0xbe0 [amdgpu]
[    3.867461]  ? dm_plane_helper_prepare_fb+0x1fa/0x310 [amdgpu]
[    3.867467]  commit_tail+0x42/0x70 [drm_kms_helper]
[    3.867473]  drm_atomic_helper_commit+0x113/0x120 [drm_kms_helper]
[    3.867530]  amdgpu_dm_atomic_commit+0x8d/0xa0 [amdgpu]
[    3.867541]  drm_atomic_commit+0x4a/0x50 [drm]
[    3.867546]  restore_fbdev_mode_atomic+0x1bf/0x1d0 [drm_kms_helper]
[    3.867552]  restore_fbdev_mode+0x51/0x160 [drm_kms_helper]
[    3.867553]  ? _cond_resched+0x19/0x30
[    3.867558]  drm_fb_helper_restore_fbdev_mode_unlocked+0x4e/0xa0 [drm_kms_helper]
[    3.867563]  drm_fb_helper_set_par+0x2d/0x50 [drm_kms_helper]
[    3.867564]  fbcon_init+0x456/0x5c0
[    3.867566]  visual_init+0xd5/0x130
[    3.867568]  do_bind_con_driver+0x1e2/0x2d0
[    3.867569]  do_take_over_console+0x129/0x1a0
[    3.867571]  do_fbcon_takeover+0x5c/0xb0
[    3.867572]  fbcon_event_notify+0x5b1/0x725
[    3.867574]  notifier_call_chain+0x4c/0x70
[    3.867575]  blocking_notifier_call_chain+0x43/0x60
[    3.867576]  fb_notifier_call_chain+0x1b/0x20
[    3.867578]  register_framebuffer+0x25c/0x350
[    3.867583]  __drm_fb_helper_initial_config_and_unlock+0x212/0x400 [drm_kms_helper]
[    3.867588]  drm_fb_helper_initial_config+0x35/0x40 [drm_kms_helper]
[    3.867636]  amdgpu_fbdev_init+0xcd/0x100 [amdgpu]
[    3.867696]  amdgpu_device_init.cold.34+0x1161/0x13e3 [amdgpu]
[    3.867742]  amdgpu_driver_load_kms+0x8d/0x360 [amdgpu]
[    3.867751]  drm_dev_register+0x129/0x170 [drm]
[    3.867797]  amdgpu_pci_probe+0xc5/0x120 [amdgpu]
[    3.867798]  local_pci_probe+0x46/0x90
[    3.867800]  pci_device_probe+0x11c/0x1a0
[    3.867802]  really_probe+0xfe/0x3b0
[    3.867803]  driver_probe_device+0xba/0x100
[    3.867805]  __driver_attach+0xe4/0x110
[    3.867806]  ? driver_probe_device+0x100/0x100
[    3.867807]  bus_for_each_dev+0x79/0xc0
[    3.867808]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.867810]  driver_attach+0x1e/0x20
[    3.867811]  bus_add_driver+0x159/0x230
[    3.867812]  ? 0xffffffffc0a8f000
[    3.867813]  driver_register+0x70/0xc0
[    3.867814]  ? 0xffffffffc0a8f000
[    3.867815]  __pci_register_driver+0x57/0x60
[    3.867860]  amdgpu_init+0x81/0x83 [amdgpu]
[    3.867861]  do_one_initcall+0x4a/0x1c4
[    3.867863]  ? _cond_resched+0x19/0x30
[    3.867864]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.867866]  do_init_module+0x60/0x220
[    3.867867]  load_module+0x1708/0x1970
[    3.867870]  __do_sys_finit_module+0xbd/0x120
[    3.867871]  ? __do_sys_finit_module+0xbd/0x120
[    3.867873]  __x64_sys_finit_module+0x1a/0x20
[    3.867875]  do_syscall_64+0x5a/0x110
[    3.867876]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[    3.867877] RIP: 0033:0x7f25d4f0d219
[    3.867878] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 47 fc 0c 00 f7 d8 64 89 01 48
[    3.867879] RSP: 002b:00007fff1bc403b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[    3.867880] RAX: ffffffffffffffda RBX: 000055d50f1b51d0 RCX: 00007f25d4f0d219
[    3.867881] RDX: 0000000000000000 RSI: 00007f25d4df1cad RDI: 0000000000000018
[    3.867881] RBP: 00007f25d4df1cad R08: 0000000000000000 R09: 0000000000000000
[    3.867882] R10: 0000000000000018 R11: 0000000000000246 R12: 0000000000000000
[    3.867882] R13: 000055d50f1a0040 R14: 0000000000020000 R15: 000055d50f1b51d0
[    3.867884] ---[ end trace 0ee3d672ad3507dd ]---
[    3.868113] WARNING: CPU: 3 PID: 485 at drivers/gpu/drm/amd/amdgpu/../display/dc/core/dc_link.c:1658 enable_link_hdmi+0x8f0/0xb00 [amdgpu]
[    3.868114] Modules linked in: cmac bnep joydev edac_mce_amd kvm_amd ccp kvm irqbypass snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio arc4 snd_hda_codec_hdmi snd_hda_intel snd_hda_codec snd_hda_core crct10dif_pclmul snd_hwdep iwlmvm crc32_pclmul ghash_clmulni_intel snd_pcm snd_seq_dummy mac80211 snd_seq_oss amdgpu(+) snd_seq_midi snd_seq_midi_event snd_rawmidi aesni_intel snd_seq btusb chash iwlwifi aes_x86_64 amd_iommu_v2 btrtl crypto_simd cryptd gpu_sched btbcm btintel glue_helper ttm snd_seq_device input_leds snd_timer bluetooth snd drm_kms_helper cfg80211 wmi_bmof ecdh_generic drm soundcore fb_sys_fops syscopyarea sysfillrect sysimgblt k10temp mac_hid sch_fq_codel parport_pc ppdev lp parport ip_tables x_tables autofs4 hid_generic usbhid hid igb i2c_algo_bit dca ahci libahci i2c_piix4 wmi video gpio_amdpt gpio_generic
[    3.868135] CPU: 3 PID: 485 Comm: systemd-udevd Tainted: G        W         5.0.2-050002-generic #201903131832
[    3.868135] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./B450 Gaming-ITX/ac, BIOS P1.70 12/17/2018
[    3.868190] RIP: 0010:enable_link_hdmi+0x8f0/0xb00 [amdgpu]
[    3.868191] Code: 55 a3 44 89 ee 41 b9 01 00 00 00 b9 01 00 00 00 48 8b 00 48 8b 80 e8 02 00 00 48 8b b8 98 00 00 00 e8 74 ac 00 00 84 c0 75 02 <0f> 0b 44 0f b6 5d a4 e9 fc fd ff ff 0f b6 b5 6f ff ff ff 0f b6 85
[    3.868192] RSP: 0018:ffffb698c3473168 EFLAGS: 00010246
[    3.868192] RAX: 0000000000000000 RBX: ffffb698c34731af RCX: 0000000000000000
[    3.868193] RDX: 000000000002bb4c RSI: ffff8fda50ae7080 RDI: ffff8fda50407900
[    3.868194] RBP: ffffb698c3473208 R08: 0000000000027080 R09: ffffffffc091892c
[    3.868194] R10: ffffd8755021d180 R11: 0000000000000001 R12: ffff8fda46b30188
[    3.868195] R13: 000000000000005d R14: 000000000000000b R15: ffffb698c34731b1
[    3.868196] FS:  00007f25d44888c0(0000) GS:ffff8fda50ac0000(0000) knlGS:0000000000000000
[    3.868196] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    3.868197] CR2: 00007f47a12db7d8 CR3: 0000000408f8c000 CR4: 00000000003406e0
[    3.868198] Call Trace:
[    3.868253]  core_link_enable_stream+0x22b/0x600 [amdgpu]
[    3.868312]  ? opp1_program_fmt+0x2a9/0x720 [amdgpu]
[    3.868369]  dce110_apply_ctx_to_hw+0x457/0x4b0 [amdgpu]
[    3.868425]  dc_commit_state+0x2ce/0x540 [amdgpu]
[    3.868427]  ? ktime_get_raw+0x32/0x90
[    3.868437]  ? drm_calc_timestamping_constants+0x109/0x150 [drm]
[    3.868497]  amdgpu_dm_atomic_commit_tail+0x1e8/0xbe0 [amdgpu]
[    3.868556]  ? dm_plane_helper_prepare_fb+0x1fa/0x310 [amdgpu]
[    3.868562]  commit_tail+0x42/0x70 [drm_kms_helper]
[    3.868568]  drm_atomic_helper_commit+0x113/0x120 [drm_kms_helper]
[    3.868626]  amdgpu_dm_atomic_commit+0x8d/0xa0 [amdgpu]
[    3.868637]  drm_atomic_commit+0x4a/0x50 [drm]
[    3.868643]  restore_fbdev_mode_atomic+0x1bf/0x1d0 [drm_kms_helper]
[    3.868648]  restore_fbdev_mode+0x51/0x160 [drm_kms_helper]
[    3.868650]  ? _cond_resched+0x19/0x30
[    3.868655]  drm_fb_helper_restore_fbdev_mode_unlocked+0x4e/0xa0 [drm_kms_helper]
[    3.868660]  drm_fb_helper_set_par+0x2d/0x50 [drm_kms_helper]
[    3.868662]  fbcon_init+0x456/0x5c0
[    3.868664]  visual_init+0xd5/0x130
[    3.868665]  do_bind_con_driver+0x1e2/0x2d0
[    3.868667]  do_take_over_console+0x129/0x1a0
[    3.868669]  do_fbcon_takeover+0x5c/0xb0
[    3.868670]  fbcon_event_notify+0x5b1/0x725
[    3.868671]  notifier_call_chain+0x4c/0x70
[    3.868673]  blocking_notifier_call_chain+0x43/0x60
[    3.868674]  fb_notifier_call_chain+0x1b/0x20
[    3.868676]  register_framebuffer+0x25c/0x350
[    3.868681]  __drm_fb_helper_initial_config_and_unlock+0x212/0x400 [drm_kms_helper]
[    3.868686]  drm_fb_helper_initial_config+0x35/0x40 [drm_kms_helper]
[    3.868734]  amdgpu_fbdev_init+0xcd/0x100 [amdgpu]
[    3.868795]  amdgpu_device_init.cold.34+0x1161/0x13e3 [amdgpu]
[    3.868842]  amdgpu_driver_load_kms+0x8d/0x360 [amdgpu]
[    3.868852]  drm_dev_register+0x129/0x170 [drm]
[    3.868898]  amdgpu_pci_probe+0xc5/0x120 [amdgpu]
[    3.868900]  local_pci_probe+0x46/0x90
[    3.868901]  pci_device_probe+0x11c/0x1a0
[    3.868903]  really_probe+0xfe/0x3b0
[    3.868905]  driver_probe_device+0xba/0x100
[    3.868906]  __driver_attach+0xe4/0x110
[    3.868907]  ? driver_probe_device+0x100/0x100
[    3.868908]  bus_for_each_dev+0x79/0xc0
[    3.868910]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.868912]  driver_attach+0x1e/0x20
[    3.868913]  bus_add_driver+0x159/0x230
[    3.868914]  ? 0xffffffffc0a8f000
[    3.868915]  driver_register+0x70/0xc0
[    3.868916]  ? 0xffffffffc0a8f000
[    3.868917]  __pci_register_driver+0x57/0x60
[    3.868962]  amdgpu_init+0x81/0x83 [amdgpu]
[    3.868964]  do_one_initcall+0x4a/0x1c4
[    3.868965]  ? _cond_resched+0x19/0x30
[    3.868967]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.868969]  do_init_module+0x60/0x220
[    3.868970]  load_module+0x1708/0x1970
[    3.868973]  __do_sys_finit_module+0xbd/0x120
[    3.868974]  ? __do_sys_finit_module+0xbd/0x120
[    3.868976]  __x64_sys_finit_module+0x1a/0x20
[    3.868977]  do_syscall_64+0x5a/0x110
[    3.868979]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[    3.868980] RIP: 0033:0x7f25d4f0d219
[    3.868981] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 47 fc 0c 00 f7 d8 64 89 01 48
[    3.868982] RSP: 002b:00007fff1bc403b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[    3.868983] RAX: ffffffffffffffda RBX: 000055d50f1b51d0 RCX: 00007f25d4f0d219
[    3.868983] RDX: 0000000000000000 RSI: 00007f25d4df1cad RDI: 0000000000000018
[    3.868984] RBP: 00007f25d4df1cad R08: 0000000000000000 R09: 0000000000000000
[    3.868985] R10: 0000000000000018 R11: 0000000000000246 R12: 0000000000000000
[    3.868985] R13: 000055d50f1a0040 R14: 0000000000020000 R15: 000055d50f1b51d0
[    3.868986] ---[ end trace 0ee3d672ad3507de ]---
[    3.874170] WARNING: CPU: 3 PID: 485 at drivers/gpu/drm/amd/amdgpu/../display/dc/core/dc_link.c:1671 enable_link_hdmi+0x748/0xb00 [amdgpu]
[    3.874172] Modules linked in: cmac bnep joydev edac_mce_amd kvm_amd ccp kvm irqbypass snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio arc4 snd_hda_codec_hdmi snd_hda_intel snd_hda_codec snd_hda_core crct10dif_pclmul snd_hwdep iwlmvm crc32_pclmul ghash_clmulni_intel snd_pcm snd_seq_dummy mac80211 snd_seq_oss amdgpu(+) snd_seq_midi snd_seq_midi_event snd_rawmidi aesni_intel snd_seq btusb chash iwlwifi aes_x86_64 amd_iommu_v2 btrtl crypto_simd cryptd gpu_sched btbcm btintel glue_helper ttm snd_seq_device input_leds snd_timer bluetooth snd drm_kms_helper cfg80211 wmi_bmof ecdh_generic drm soundcore fb_sys_fops syscopyarea sysfillrect sysimgblt k10temp mac_hid sch_fq_codel parport_pc ppdev lp parport ip_tables x_tables autofs4 hid_generic usbhid hid igb i2c_algo_bit dca ahci libahci i2c_piix4 wmi video gpio_amdpt gpio_generic
[    3.874198] CPU: 3 PID: 485 Comm: systemd-udevd Tainted: G        W         5.0.2-050002-generic #201903131832
[    3.874198] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./B450 Gaming-ITX/ac, BIOS P1.70 12/17/2018
[    3.874244] RIP: 0010:enable_link_hdmi+0x748/0xb00 [amdgpu]
[    3.874245] Code: c0 44 89 ea 44 0f b6 45 c1 44 0f b6 c8 48 c7 c6 10 21 9d c0 bf 04 00 00 00 45 89 ce e8 d1 1a a3 ff 45 84 f6 0f 85 2a ff ff ff <0f> 0b e9 23 ff ff ff 44 8b 6d 88 44 8b 55 80 48 8b 9d 78 ff ff ff
[    3.874246] RSP: 0018:ffffb698c3473168 EFLAGS: 00010246
[    3.874247] RAX: 0000000000000000 RBX: ffffb698c34731af RCX: 000000000000000a
[    3.874247] RDX: 000000000000005d RSI: ffffffffc09d2110 RDI: 0000000000000004
[    3.874248] RBP: ffffb698c3473208 R08: 0000000000000017 R09: 0000000000000000
[    3.874248] R10: ffffd8755024bd80 R11: 0000000000000001 R12: ffff8fda46b30188
[    3.874249] R13: 000000000000005d R14: 0000000000000000 R15: ffffb698c34731b1
[    3.874249] FS:  00007f25d44888c0(0000) GS:ffff8fda50ac0000(0000) knlGS:0000000000000000
[    3.874250] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    3.874251] CR2: 00007ff49b58c910 CR3: 0000000408f8c000 CR4: 00000000003406e0
[    3.874251] Call Trace:
[    3.874298]  core_link_enable_stream+0x22b/0x600 [amdgpu]
[    3.874346]  ? opp1_program_fmt+0x2a9/0x720 [amdgpu]
[    3.874391]  dce110_apply_ctx_to_hw+0x457/0x4b0 [amdgpu]
[    3.874436]  dc_commit_state+0x2ce/0x540 [amdgpu]
[    3.874439]  ? ktime_get_raw+0x32/0x90
[    3.874448]  ? drm_calc_timestamping_constants+0x109/0x150 [drm]
[    3.874496]  amdgpu_dm_atomic_commit_tail+0x1e8/0xbe0 [amdgpu]
[    3.874544]  ? dm_plane_helper_prepare_fb+0x1fa/0x310 [amdgpu]
[    3.874549]  commit_tail+0x42/0x70 [drm_kms_helper]
[    3.874554]  drm_atomic_helper_commit+0x113/0x120 [drm_kms_helper]
[    3.874600]  amdgpu_dm_atomic_commit+0x8d/0xa0 [amdgpu]
[    3.874610]  drm_atomic_commit+0x4a/0x50 [drm]
[    3.874614]  restore_fbdev_mode_atomic+0x1bf/0x1d0 [drm_kms_helper]
[    3.874618]  restore_fbdev_mode+0x51/0x160 [drm_kms_helper]
[    3.874620]  ? _cond_resched+0x19/0x30
[    3.874624]  drm_fb_helper_restore_fbdev_mode_unlocked+0x4e/0xa0 [drm_kms_helper]
[    3.874628]  drm_fb_helper_set_par+0x2d/0x50 [drm_kms_helper]
[    3.874631]  fbcon_init+0x456/0x5c0
[    3.874633]  visual_init+0xd5/0x130
[    3.874634]  do_bind_con_driver+0x1e2/0x2d0
[    3.874636]  do_take_over_console+0x129/0x1a0
[    3.874637]  do_fbcon_takeover+0x5c/0xb0
[    3.874638]  fbcon_event_notify+0x5b1/0x725
[    3.874640]  notifier_call_chain+0x4c/0x70
[    3.874641]  blocking_notifier_call_chain+0x43/0x60
[    3.874643]  fb_notifier_call_chain+0x1b/0x20
[    3.874644]  register_framebuffer+0x25c/0x350
[    3.874649]  __drm_fb_helper_initial_config_and_unlock+0x212/0x400 [drm_kms_helper]
[    3.874653]  drm_fb_helper_initial_config+0x35/0x40 [drm_kms_helper]
[    3.874691]  amdgpu_fbdev_init+0xcd/0x100 [amdgpu]
[    3.874740]  amdgpu_device_init.cold.34+0x1161/0x13e3 [amdgpu]
[    3.874778]  amdgpu_driver_load_kms+0x8d/0x360 [amdgpu]
[    3.874786]  drm_dev_register+0x129/0x170 [drm]
[    3.874823]  amdgpu_pci_probe+0xc5/0x120 [amdgpu]
[    3.874825]  local_pci_probe+0x46/0x90
[    3.874826]  pci_device_probe+0x11c/0x1a0
[    3.874829]  really_probe+0xfe/0x3b0
[    3.874830]  driver_probe_device+0xba/0x100
[    3.874831]  __driver_attach+0xe4/0x110
[    3.874832]  ? driver_probe_device+0x100/0x100
[    3.874833]  bus_for_each_dev+0x79/0xc0
[    3.874835]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.874836]  driver_attach+0x1e/0x20
[    3.874837]  bus_add_driver+0x159/0x230
[    3.874838]  ? 0xffffffffc0a8f000
[    3.874839]  driver_register+0x70/0xc0
[    3.874840]  ? 0xffffffffc0a8f000
[    3.874841]  __pci_register_driver+0x57/0x60
[    3.874877]  amdgpu_init+0x81/0x83 [amdgpu]
[    3.874880]  do_one_initcall+0x4a/0x1c4
[    3.874881]  ? _cond_resched+0x19/0x30
[    3.874882]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.874884]  do_init_module+0x60/0x220
[    3.874885]  load_module+0x1708/0x1970
[    3.874887]  __do_sys_finit_module+0xbd/0x120
[    3.874889]  ? __do_sys_finit_module+0xbd/0x120
[    3.874890]  __x64_sys_finit_module+0x1a/0x20
[    3.874891]  do_syscall_64+0x5a/0x110
[    3.874893]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[    3.874893] RIP: 0033:0x7f25d4f0d219
[    3.874895] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 47 fc 0c 00 f7 d8 64 89 01 48
[    3.874896] RSP: 002b:00007fff1bc403b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[    3.874896] RAX: ffffffffffffffda RBX: 000055d50f1b51d0 RCX: 00007f25d4f0d219
[    3.874897] RDX: 0000000000000000 RSI: 00007f25d4df1cad RDI: 0000000000000018
[    3.874897] RBP: 00007f25d4df1cad R08: 0000000000000000 R09: 0000000000000000
[    3.874898] R10: 0000000000000018 R11: 0000000000000246 R12: 0000000000000000
[    3.874898] R13: 000055d50f1a0040 R14: 0000000000020000 R15: 000055d50f1b51d0
[    3.874900] ---[ end trace 0ee3d672ad3507df ]---
[    3.875149] WARNING: CPU: 3 PID: 485 at drivers/gpu/drm/amd/amdgpu/../display/dc/core/dc_link.c:1639 enable_link_hdmi+0x6e0/0xb00 [amdgpu]
[    3.875150] Modules linked in: cmac bnep joydev edac_mce_amd kvm_amd ccp kvm irqbypass snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio arc4 snd_hda_codec_hdmi snd_hda_intel snd_hda_codec snd_hda_core crct10dif_pclmul snd_hwdep iwlmvm crc32_pclmul ghash_clmulni_intel snd_pcm snd_seq_dummy mac80211 snd_seq_oss amdgpu(+) snd_seq_midi snd_seq_midi_event snd_rawmidi aesni_intel snd_seq btusb chash iwlwifi aes_x86_64 amd_iommu_v2 btrtl crypto_simd cryptd gpu_sched btbcm btintel glue_helper ttm snd_seq_device input_leds snd_timer bluetooth snd drm_kms_helper cfg80211 wmi_bmof ecdh_generic drm soundcore fb_sys_fops syscopyarea sysfillrect sysimgblt k10temp mac_hid sch_fq_codel parport_pc ppdev lp parport ip_tables x_tables autofs4 hid_generic usbhid hid igb i2c_algo_bit dca ahci libahci i2c_piix4 wmi video gpio_amdpt gpio_generic
[    3.875169] CPU: 3 PID: 485 Comm: systemd-udevd Tainted: G        W         5.0.2-050002-generic #201903131832
[    3.875169] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./B450 Gaming-ITX/ac, BIOS P1.70 12/17/2018
[    3.875214] RIP: 0010:enable_link_hdmi+0x6e0/0xb00 [amdgpu]
[    3.875215] Code: 44 0f b6 45 c1 44 0f b6 c8 48 c7 c6 b0 20 9d c0 bf 04 00 00 00 88 45 9c e8 3d 1b a3 ff 0f b6 45 9c 44 0f b6 5d 98 84 c0 75 02 <0f> 0b 41 8d 46 f6 3c 02 77 88 41 80 fe 0a 0f 85 c7 01 00 00 44 88
[    3.875215] RSP: 0018:ffffb698c3473168 EFLAGS: 00010246
[    3.875216] RAX: 0000000000000000 RBX: ffffb698c34731b1 RCX: 000000000000000c
[    3.875216] RDX: 000000000000005d RSI: ffffffffc09d20b0 RDI: 0000000000000004
[    3.875217] RBP: ffffb698c3473208 R08: 0000000000000002 R09: 0000000000000000
[    3.875217] R10: ffffd8755024bd80 R11: 0000000000000002 R12: ffff8fda46b30188
[    3.875218] R13: 000000000000005d R14: 000000000000000c R15: ffffb698c34731b1
[    3.875219] FS:  00007f25d44888c0(0000) GS:ffff8fda50ac0000(0000) knlGS:0000000000000000
[    3.875219] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    3.875220] CR2: 00007ff49b58c910 CR3: 0000000408f8c000 CR4: 00000000003406e0
[    3.875220] Call Trace:
[    3.875265]  core_link_enable_stream+0x22b/0x600 [amdgpu]
[    3.875313]  ? opp1_program_fmt+0x2a9/0x720 [amdgpu]
[    3.875358]  dce110_apply_ctx_to_hw+0x457/0x4b0 [amdgpu]
[    3.875403]  dc_commit_state+0x2ce/0x540 [amdgpu]
[    3.875404]  ? ktime_get_raw+0x32/0x90
[    3.875413]  ? drm_calc_timestamping_constants+0x109/0x150 [drm]
[    3.875461]  amdgpu_dm_atomic_commit_tail+0x1e8/0xbe0 [amdgpu]
[    3.875508]  ? dm_plane_helper_prepare_fb+0x1fa/0x310 [amdgpu]
[    3.875513]  commit_tail+0x42/0x70 [drm_kms_helper]
[    3.875517]  drm_atomic_helper_commit+0x113/0x120 [drm_kms_helper]
[    3.875564]  amdgpu_dm_atomic_commit+0x8d/0xa0 [amdgpu]
[    3.875573]  drm_atomic_commit+0x4a/0x50 [drm]
[    3.875577]  restore_fbdev_mode_atomic+0x1bf/0x1d0 [drm_kms_helper]
[    3.875582]  restore_fbdev_mode+0x51/0x160 [drm_kms_helper]
[    3.875583]  ? _cond_resched+0x19/0x30
[    3.875587]  drm_fb_helper_restore_fbdev_mode_unlocked+0x4e/0xa0 [drm_kms_helper]
[    3.875591]  drm_fb_helper_set_par+0x2d/0x50 [drm_kms_helper]
[    3.875592]  fbcon_init+0x456/0x5c0
[    3.875595]  visual_init+0xd5/0x130
[    3.875596]  do_bind_con_driver+0x1e2/0x2d0
[    3.875597]  do_take_over_console+0x129/0x1a0
[    3.875598]  do_fbcon_takeover+0x5c/0xb0
[    3.875599]  fbcon_event_notify+0x5b1/0x725
[    3.875601]  notifier_call_chain+0x4c/0x70
[    3.875602]  blocking_notifier_call_chain+0x43/0x60
[    3.875603]  fb_notifier_call_chain+0x1b/0x20
[    3.875604]  register_framebuffer+0x25c/0x350
[    3.875608]  __drm_fb_helper_initial_config_and_unlock+0x212/0x400 [drm_kms_helper]
[    3.875612]  drm_fb_helper_initial_config+0x35/0x40 [drm_kms_helper]
[    3.875651]  amdgpu_fbdev_init+0xcd/0x100 [amdgpu]
[    3.875700]  amdgpu_device_init.cold.34+0x1161/0x13e3 [amdgpu]
[    3.875738]  amdgpu_driver_load_kms+0x8d/0x360 [amdgpu]
[    3.875746]  drm_dev_register+0x129/0x170 [drm]
[    3.875783]  amdgpu_pci_probe+0xc5/0x120 [amdgpu]
[    3.875785]  local_pci_probe+0x46/0x90
[    3.875786]  pci_device_probe+0x11c/0x1a0
[    3.875788]  really_probe+0xfe/0x3b0
[    3.875789]  driver_probe_device+0xba/0x100
[    3.875790]  __driver_attach+0xe4/0x110
[    3.875791]  ? driver_probe_device+0x100/0x100
[    3.875792]  bus_for_each_dev+0x79/0xc0
[    3.875794]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.875795]  driver_attach+0x1e/0x20
[    3.875797]  bus_add_driver+0x159/0x230
[    3.875798]  ? 0xffffffffc0a8f000
[    3.875799]  driver_register+0x70/0xc0
[    3.875800]  ? 0xffffffffc0a8f000
[    3.875802]  __pci_register_driver+0x57/0x60
[    3.875856]  amdgpu_init+0x81/0x83 [amdgpu]
[    3.875858]  do_one_initcall+0x4a/0x1c4
[    3.875859]  ? _cond_resched+0x19/0x30
[    3.875861]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.875863]  do_init_module+0x60/0x220
[    3.875865]  load_module+0x1708/0x1970
[    3.875868]  __do_sys_finit_module+0xbd/0x120
[    3.875869]  ? __do_sys_finit_module+0xbd/0x120
[    3.875872]  __x64_sys_finit_module+0x1a/0x20
[    3.875873]  do_syscall_64+0x5a/0x110
[    3.875875]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[    3.875876] RIP: 0033:0x7f25d4f0d219
[    3.875877] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 47 fc 0c 00 f7 d8 64 89 01 48
[    3.875878] RSP: 002b:00007fff1bc403b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[    3.875880] RAX: ffffffffffffffda RBX: 000055d50f1b51d0 RCX: 00007f25d4f0d219
[    3.875880] RDX: 0000000000000000 RSI: 00007f25d4df1cad RDI: 0000000000000018
[    3.875881] RBP: 00007f25d4df1cad R08: 0000000000000000 R09: 0000000000000000
[    3.875882] R10: 0000000000000018 R11: 0000000000000246 R12: 0000000000000000
[    3.875882] R13: 000055d50f1a0040 R14: 0000000000020000 R15: 000055d50f1b51d0
[    3.875884] ---[ end trace 0ee3d672ad3507e0 ]---
[    3.878584] WARNING: CPU: 3 PID: 485 at drivers/gpu/drm/amd/amdgpu/../display/dc/core/dc_link.c:1658 enable_link_hdmi+0x8f0/0xb00 [amdgpu]
[    3.878586] Modules linked in: cmac bnep joydev edac_mce_amd kvm_amd ccp kvm irqbypass snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio arc4 snd_hda_codec_hdmi snd_hda_intel snd_hda_codec snd_hda_core crct10dif_pclmul snd_hwdep iwlmvm crc32_pclmul ghash_clmulni_intel snd_pcm snd_seq_dummy mac80211 snd_seq_oss amdgpu(+) snd_seq_midi snd_seq_midi_event snd_rawmidi aesni_intel snd_seq btusb chash iwlwifi aes_x86_64 amd_iommu_v2 btrtl crypto_simd cryptd gpu_sched btbcm btintel glue_helper ttm snd_seq_device input_leds snd_timer bluetooth snd drm_kms_helper cfg80211 wmi_bmof ecdh_generic drm soundcore fb_sys_fops syscopyarea sysfillrect sysimgblt k10temp mac_hid sch_fq_codel parport_pc ppdev lp parport ip_tables x_tables autofs4 hid_generic usbhid hid igb i2c_algo_bit dca ahci libahci i2c_piix4 wmi video gpio_amdpt gpio_generic
[    3.878610] CPU: 3 PID: 485 Comm: systemd-udevd Tainted: G        W         5.0.2-050002-generic #201903131832
[    3.878611] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./B450 Gaming-ITX/ac, BIOS P1.70 12/17/2018
[    3.878656] RIP: 0010:enable_link_hdmi+0x8f0/0xb00 [amdgpu]
[    3.878657] Code: 55 a3 44 89 ee 41 b9 01 00 00 00 b9 01 00 00 00 48 8b 00 48 8b 80 e8 02 00 00 48 8b b8 98 00 00 00 e8 74 ac 00 00 84 c0 75 02 <0f> 0b 44 0f b6 5d a4 e9 fc fd ff ff 0f b6 b5 6f ff ff ff 0f b6 85
[    3.878658] RSP: 0018:ffffb698c3473168 EFLAGS: 00010246
[    3.878658] RAX: 0000000000000000 RBX: ffffb698c34731b1 RCX: 0000000000000000
[    3.878659] RDX: 000000000002bf51 RSI: ffff8fda50ae7080 RDI: ffff8fda50407900
[    3.878659] RBP: ffffb698c3473208 R08: 0000000000027080 R09: ffffffffc091892c
[    3.878660] R10: ffffd8755021d180 R11: 0000000000000001 R12: ffff8fda46b30188
[    3.878660] R13: 000000000000005d R14: 000000000000000c R15: ffffb698c34731b1
[    3.878661] FS:  00007f25d44888c0(0000) GS:ffff8fda50ac0000(0000) knlGS:0000000000000000
[    3.878662] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    3.878662] CR2: 00007f522bf68830 CR3: 0000000408f8c000 CR4: 00000000003406e0
[    3.878663] Call Trace:
[    3.878711]  core_link_enable_stream+0x22b/0x600 [amdgpu]
[    3.878758]  ? opp1_program_fmt+0x2a9/0x720 [amdgpu]
[    3.878804]  dce110_apply_ctx_to_hw+0x457/0x4b0 [amdgpu]
[    3.878849]  dc_commit_state+0x2ce/0x540 [amdgpu]
[    3.878851]  ? ktime_get_raw+0x32/0x90
[    3.878861]  ? drm_calc_timestamping_constants+0x109/0x150 [drm]
[    3.878909]  amdgpu_dm_atomic_commit_tail+0x1e8/0xbe0 [amdgpu]
[    3.878960]  ? dm_plane_helper_prepare_fb+0x1fa/0x310 [amdgpu]
[    3.878966]  commit_tail+0x42/0x70 [drm_kms_helper]
[    3.878970]  drm_atomic_helper_commit+0x113/0x120 [drm_kms_helper]
[    3.879016]  amdgpu_dm_atomic_commit+0x8d/0xa0 [amdgpu]
[    3.879025]  drm_atomic_commit+0x4a/0x50 [drm]
[    3.879029]  restore_fbdev_mode_atomic+0x1bf/0x1d0 [drm_kms_helper]
[    3.879034]  restore_fbdev_mode+0x51/0x160 [drm_kms_helper]
[    3.879036]  ? _cond_resched+0x19/0x30
[    3.879040]  drm_fb_helper_restore_fbdev_mode_unlocked+0x4e/0xa0 [drm_kms_helper]
[    3.879044]  drm_fb_helper_set_par+0x2d/0x50 [drm_kms_helper]
[    3.879047]  fbcon_init+0x456/0x5c0
[    3.879049]  visual_init+0xd5/0x130
[    3.879050]  do_bind_con_driver+0x1e2/0x2d0
[    3.879052]  do_take_over_console+0x129/0x1a0
[    3.879053]  do_fbcon_takeover+0x5c/0xb0
[    3.879054]  fbcon_event_notify+0x5b1/0x725
[    3.879056]  notifier_call_chain+0x4c/0x70
[    3.879057]  blocking_notifier_call_chain+0x43/0x60
[    3.879059]  fb_notifier_call_chain+0x1b/0x20
[    3.879060]  register_framebuffer+0x25c/0x350
[    3.879064]  __drm_fb_helper_initial_config_and_unlock+0x212/0x400 [drm_kms_helper]
[    3.879068]  drm_fb_helper_initial_config+0x35/0x40 [drm_kms_helper]
[    3.879106]  amdgpu_fbdev_init+0xcd/0x100 [amdgpu]
[    3.879155]  amdgpu_device_init.cold.34+0x1161/0x13e3 [amdgpu]
[    3.879192]  amdgpu_driver_load_kms+0x8d/0x360 [amdgpu]
[    3.879200]  drm_dev_register+0x129/0x170 [drm]
[    3.879237]  amdgpu_pci_probe+0xc5/0x120 [amdgpu]
[    3.879239]  local_pci_probe+0x46/0x90
[    3.879240]  pci_device_probe+0x11c/0x1a0
[    3.879242]  really_probe+0xfe/0x3b0
[    3.879243]  driver_probe_device+0xba/0x100
[    3.879244]  __driver_attach+0xe4/0x110
[    3.879245]  ? driver_probe_device+0x100/0x100
[    3.879246]  bus_for_each_dev+0x79/0xc0
[    3.879248]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.879249]  driver_attach+0x1e/0x20
[    3.879250]  bus_add_driver+0x159/0x230
[    3.879251]  ? 0xffffffffc0a8f000
[    3.879252]  driver_register+0x70/0xc0
[    3.879253]  ? 0xffffffffc0a8f000
[    3.879254]  __pci_register_driver+0x57/0x60
[    3.879290]  amdgpu_init+0x81/0x83 [amdgpu]
[    3.879292]  do_one_initcall+0x4a/0x1c4
[    3.879293]  ? _cond_resched+0x19/0x30
[    3.879294]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.879296]  do_init_module+0x60/0x220
[    3.879297]  load_module+0x1708/0x1970
[    3.879299]  __do_sys_finit_module+0xbd/0x120
[    3.879300]  ? __do_sys_finit_module+0xbd/0x120
[    3.879302]  __x64_sys_finit_module+0x1a/0x20
[    3.879303]  do_syscall_64+0x5a/0x110
[    3.879305]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[    3.879306] RIP: 0033:0x7f25d4f0d219
[    3.879307] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 47 fc 0c 00 f7 d8 64 89 01 48
[    3.879307] RSP: 002b:00007fff1bc403b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[    3.879308] RAX: ffffffffffffffda RBX: 000055d50f1b51d0 RCX: 00007f25d4f0d219
[    3.879309] RDX: 0000000000000000 RSI: 00007f25d4df1cad RDI: 0000000000000018
[    3.879309] RBP: 00007f25d4df1cad R08: 0000000000000000 R09: 0000000000000000
[    3.879310] R10: 0000000000000018 R11: 0000000000000246 R12: 0000000000000000
[    3.879310] R13: 000055d50f1a0040 R14: 0000000000020000 R15: 000055d50f1b51d0
[    3.879311] ---[ end trace 0ee3d672ad3507e1 ]---
[    3.879660] WARNING: CPU: 3 PID: 485 at drivers/gpu/drm/amd/amdgpu/../display/dc/core/dc_link.c:1671 enable_link_hdmi+0x748/0xb00 [amdgpu]
[    3.879660] Modules linked in: cmac bnep joydev edac_mce_amd kvm_amd ccp kvm irqbypass snd_hda_codec_realtek snd_hda_codec_generic ledtrig_audio arc4 snd_hda_codec_hdmi snd_hda_intel snd_hda_codec snd_hda_core crct10dif_pclmul snd_hwdep iwlmvm crc32_pclmul ghash_clmulni_intel snd_pcm snd_seq_dummy mac80211 snd_seq_oss amdgpu(+) snd_seq_midi snd_seq_midi_event snd_rawmidi aesni_intel snd_seq btusb chash iwlwifi aes_x86_64 amd_iommu_v2 btrtl crypto_simd cryptd gpu_sched btbcm btintel glue_helper ttm snd_seq_device input_leds snd_timer bluetooth snd drm_kms_helper cfg80211 wmi_bmof ecdh_generic drm soundcore fb_sys_fops syscopyarea sysfillrect sysimgblt k10temp mac_hid sch_fq_codel parport_pc ppdev lp parport ip_tables x_tables autofs4 hid_generic usbhid hid igb i2c_algo_bit dca ahci libahci i2c_piix4 wmi video gpio_amdpt gpio_generic
[    3.879681] CPU: 3 PID: 485 Comm: systemd-udevd Tainted: G        W         5.0.2-050002-generic #201903131832
[    3.879681] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./B450 Gaming-ITX/ac, BIOS P1.70 12/17/2018
[    3.879726] RIP: 0010:enable_link_hdmi+0x748/0xb00 [amdgpu]
[    3.879727] Code: c0 44 89 ea 44 0f b6 45 c1 44 0f b6 c8 48 c7 c6 10 21 9d c0 bf 04 00 00 00 45 89 ce e8 d1 1a a3 ff 45 84 f6 0f 85 2a ff ff ff <0f> 0b e9 23 ff ff ff 44 8b 6d 88 44 8b 55 80 48 8b 9d 78 ff ff ff
[    3.879727] RSP: 0018:ffffb698c3473168 EFLAGS: 00010246
[    3.879728] RAX: 0000000000000000 RBX: ffffb698c34731b1 RCX: 000000000000000a
[    3.879728] RDX: 000000000000005d RSI: ffffffffc09d2110 RDI: 0000000000000004
[    3.879729] RBP: ffffb698c3473208 R08: 0000000000000017 R09: 0000000000000000
[    3.879729] R10: ffffd8755024bd80 R11: 0000000000000001 R12: ffff8fda46b30188
[    3.879730] R13: 000000000000005d R14: 0000000000000000 R15: ffffb698c34731b1
[    3.879730] FS:  00007f25d44888c0(0000) GS:ffff8fda50ac0000(0000) knlGS:0000000000000000
[    3.879731] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[    3.879732] CR2: 00007f522bf68830 CR3: 0000000408f8c000 CR4: 00000000003406e0
[    3.879732] Call Trace:
[    3.879777]  core_link_enable_stream+0x22b/0x600 [amdgpu]
[    3.879823]  ? opp1_program_fmt+0x2a9/0x720 [amdgpu]
[    3.879868]  dce110_apply_ctx_to_hw+0x457/0x4b0 [amdgpu]
[    3.879912]  dc_commit_state+0x2ce/0x540 [amdgpu]
[    3.879914]  ? ktime_get_raw+0x32/0x90
[    3.879923]  ? drm_calc_timestamping_constants+0x109/0x150 [drm]
[    3.879970]  amdgpu_dm_atomic_commit_tail+0x1e8/0xbe0 [amdgpu]
[    3.880017]  ? dm_plane_helper_prepare_fb+0x1fa/0x310 [amdgpu]
[    3.880022]  commit_tail+0x42/0x70 [drm_kms_helper]
[    3.880026]  drm_atomic_helper_commit+0x113/0x120 [drm_kms_helper]
[    3.880072]  amdgpu_dm_atomic_commit+0x8d/0xa0 [amdgpu]
[    3.880081]  drm_atomic_commit+0x4a/0x50 [drm]
[    3.880085]  restore_fbdev_mode_atomic+0x1bf/0x1d0 [drm_kms_helper]
[    3.880090]  restore_fbdev_mode+0x51/0x160 [drm_kms_helper]
[    3.880091]  ? _cond_resched+0x19/0x30
[    3.880095]  drm_fb_helper_restore_fbdev_mode_unlocked+0x4e/0xa0 [drm_kms_helper]
[    3.880099]  drm_fb_helper_set_par+0x2d/0x50 [drm_kms_helper]
[    3.880101]  fbcon_init+0x456/0x5c0
[    3.880103]  visual_init+0xd5/0x130
[    3.880104]  do_bind_con_driver+0x1e2/0x2d0
[    3.880105]  do_take_over_console+0x129/0x1a0
[    3.880107]  do_fbcon_takeover+0x5c/0xb0
[    3.880108]  fbcon_event_notify+0x5b1/0x725
[    3.880109]  notifier_call_chain+0x4c/0x70
[    3.880110]  blocking_notifier_call_chain+0x43/0x60
[    3.880112]  fb_notifier_call_chain+0x1b/0x20
[    3.880113]  register_framebuffer+0x25c/0x350
[    3.880117]  __drm_fb_helper_initial_config_and_unlock+0x212/0x400 [drm_kms_helper]
[    3.880122]  drm_fb_helper_initial_config+0x35/0x40 [drm_kms_helper]
[    3.880160]  amdgpu_fbdev_init+0xcd/0x100 [amdgpu]
[    3.880208]  amdgpu_device_init.cold.34+0x1161/0x13e3 [amdgpu]
[    3.880246]  amdgpu_driver_load_kms+0x8d/0x360 [amdgpu]
[    3.880254]  drm_dev_register+0x129/0x170 [drm]
[    3.880296]  amdgpu_pci_probe+0xc5/0x120 [amdgpu]
[    3.880298]  local_pci_probe+0x46/0x90
[    3.880300]  pci_device_probe+0x11c/0x1a0
[    3.880303]  really_probe+0xfe/0x3b0
[    3.880304]  driver_probe_device+0xba/0x100
[    3.880306]  __driver_attach+0xe4/0x110
[    3.880307]  ? driver_probe_device+0x100/0x100
[    3.880309]  bus_for_each_dev+0x79/0xc0
[    3.880311]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.880313]  driver_attach+0x1e/0x20
[    3.880314]  bus_add_driver+0x159/0x230
[    3.880315]  ? 0xffffffffc0a8f000
[    3.880317]  driver_register+0x70/0xc0
[    3.880317]  ? 0xffffffffc0a8f000
[    3.880319]  __pci_register_driver+0x57/0x60
[    3.880373]  amdgpu_init+0x81/0x83 [amdgpu]
[    3.880376]  do_one_initcall+0x4a/0x1c4
[    3.880377]  ? _cond_resched+0x19/0x30
[    3.880379]  ? kmem_cache_alloc_trace+0x153/0x1d0
[    3.880382]  do_init_module+0x60/0x220
[    3.880383]  load_module+0x1708/0x1970
[    3.880387]  __do_sys_finit_module+0xbd/0x120
[    3.880388]  ? __do_sys_finit_module+0xbd/0x120
[    3.880391]  __x64_sys_finit_module+0x1a/0x20
[    3.880392]  do_syscall_64+0x5a/0x110
[    3.880395]  entry_SYSCALL_64_after_hwframe+0x44/0xa9
[    3.880396] RIP: 0033:0x7f25d4f0d219
[    3.880397] Code: 00 c3 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 44 00 00 48 89 f8 48 89 f7 48 89 d6 48 89 ca 4d 89 c2 4d 89 c8 4c 8b 4c 24 08 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 47 fc 0c 00 f7 d8 64 89 01 48
[    3.880398] RSP: 002b:00007fff1bc403b8 EFLAGS: 00000246 ORIG_RAX: 0000000000000139
[    3.880399] RAX: ffffffffffffffda RBX: 000055d50f1b51d0 RCX: 00007f25d4f0d219
[    3.880400] RDX: 0000000000000000 RSI: 00007f25d4df1cad RDI: 0000000000000018
[    3.880401] RBP: 00007f25d4df1cad R08: 0000000000000000 R09: 0000000000000000
[    3.880401] R10: 0000000000000018 R11: 0000000000000246 R12: 0000000000000000
[    3.880402] R13: 000055d50f1a0040 R14: 0000000000020000 R15: 000055d50f1b51d0
[    3.880404] ---[ end trace 0ee3d672ad3507e2 ]---
[    3.918323] Console: switching to colour frame buffer device 320x90
[    3.937922] amdgpu 0000:38:00.0: fb0: amdgpudrmfb frame buffer device
[    3.964164] amdgpu 0000:38:00.0: ring gfx uses VM inv eng 0 on hub 0
[    3.964166] amdgpu 0000:38:00.0: ring comp_1.0.0 uses VM inv eng 1 on hub 0
[    3.964167] amdgpu 0000:38:00.0: ring comp_1.1.0 uses VM inv eng 4 on hub 0
[    3.964168] amdgpu 0000:38:00.0: ring comp_1.2.0 uses VM inv eng 5 on hub 0
[    3.964170] amdgpu 0000:38:00.0: ring comp_1.3.0 uses VM inv eng 6 on hub 0
[    3.964171] amdgpu 0000:38:00.0: ring comp_1.0.1 uses VM inv eng 7 on hub 0
[    3.964172] amdgpu 0000:38:00.0: ring comp_1.1.1 uses VM inv eng 8 on hub 0
[    3.964173] amdgpu 0000:38:00.0: ring comp_1.2.1 uses VM inv eng 9 on hub 0
[    3.964174] amdgpu 0000:38:00.0: ring comp_1.3.1 uses VM inv eng 10 on hub 0
[    3.964176] amdgpu 0000:38:00.0: ring kiq_2.1.0 uses VM inv eng 11 on hub 0
[    3.964182] amdgpu 0000:38:00.0: ring sdma0 uses VM inv eng 0 on hub 1
[    3.964189] amdgpu 0000:38:00.0: ring vcn_dec uses VM inv eng 1 on hub 1
[    3.964191] amdgpu 0000:38:00.0: ring vcn_enc0 uses VM inv eng 4 on hub 1
[    3.964193] amdgpu 0000:38:00.0: ring vcn_enc1 uses VM inv eng 5 on hub 1
[    3.964200] amdgpu 0000:38:00.0: ring vcn_jpeg uses VM inv eng 6 on hub 1
[    4.010979] [drm] Initialized amdgpu 3.27.0 20150101 for 0000:38:00.0 on minor 0
[    5.426229] random: crng init done
[    5.426232] random: 7 urandom warning(s) missed due to ratelimiting
[    6.608579] igb 0000:25:00.0 enp37s0: igb: enp37s0 NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
[    6.716281] IPv6: ADDRCONF(NETDEV_CHANGE): enp37s0: link becomes ready
[   20.067448] Bluetooth: RFCOMM TTY layer initialized
[   20.067459] Bluetooth: RFCOMM socket layer initialized
[   20.067466] Bluetooth: RFCOMM ver 1.11
[   20.974107] rfkill: input handler disabled

[-- Attachment #8: Type: text/plain, Size: 153 bytes --]

_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]                                                     ` <CAGyaPbBwk9CZaMgrrB3edgJLDJq8djfETUBnhkZKg0+rza+Y5Q-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2019-03-14 15:46                                                       ` Ernst Sjöstrand
       [not found]                                                         ` <CAD=4a=UOz-R3bcFvEgC_8a9N12Mfs_fVvK+od41k7b=Zjoj45Q-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Ernst Sjöstrand @ 2019-03-14 15:46 UTC (permalink / raw)
  To: Lauri Ehrenpreis
  Cc: Deucher, Alexander, Kuehling, Felix, Tom St Denis,
	amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW

Does
echo high > /sys/class/drm/card0/device/power_dpm_force_performance_level
or setting cpu scaling governor to performance affect it at all?

Regards
//Ernst

Den tors 14 mars 2019 kl 14:31 skrev Lauri Ehrenpreis <laurioma@gmail.com>:
>
> I tried also with those 2 boards now:
> https://www.asrock.com/MB/AMD/Fatal1ty%20B450%20Gaming-ITXac/index.asp
> https://www.msi.com/Motherboard/B450I-GAMING-PLUS-AC
>
> Both are using latest BIOS, ubuntu 18.10, kernel https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.0.2/
>
> There are some differences in dmesg (asrock has some amdgpu assert in dmesg) but otherwise results are exactly the same.
> In desktop env cl_slow_test works fast, over ssh terminal it doesn't. If i move mouse then it starts working fast in terminal as well.
>
> So one can't use OpenCL without monitor and desktop env running and this happens with 2 different chipsets (b350 & b450), latest bios from 3 different vendors, latest kernel and latest rocm. This doesn't look like edge case with unusual setup to me..
>
> Attached dmesg, dmidecode, and clinfo from both boards.
>
> --
> Lauri
>
> On Wed, Mar 13, 2019 at 10:15 PM Lauri Ehrenpreis <laurioma@gmail.com> wrote:
>>
>> For reproduction only the tiny cl_slow_test.cpp is needed which is attached to first e-mail.
>>
>> System information is following:
>> CPU: Ryzen5 2400G
>> Main board: Gigabyte AMD B450 AORUS mini itx: https://www.gigabyte.com/Motherboard/B450-I-AORUS-PRO-WIFI-rev-10#kf
>> BIOS: F5 8.47 MB 2019/01/25 (latest)
>> Kernel: https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.0/  (amd64)
>> OS: Ubuntu 18.04 LTS
>> rocm-opencl-dev installation:
>> wget -qO - http://repo.radeon.com/rocm/apt/debian/rocm.gpg.key | sudo apt-key add -
>> echo 'deb [arch=amd64] http://repo.radeon.com/rocm/apt/debian/ xenial main' | sudo tee /etc/apt/sources.list.d/rocm.list
>> sudo apt install rocm-opencl-dev
>>
>> Also exactly the same issue happens with this board: https://www.gigabyte.com/Motherboard/GA-AB350-Gaming-3-rev-1x#kf
>>
>> I have MSI and Asrock mini itx boards ready as well, So far didn't get amdgpu & opencl working there but I'll try again tomorrow..
>>
>> --
>> Lauri
>>
>>
>> On Wed, Mar 13, 2019 at 8:51 PM Kuehling, Felix <Felix.Kuehling@amd.com> wrote:
>>>
>>> Hi Lauri,
>>>
>>> I still think the SMU is doing something funny, but rocm-smi isn't
>>> showing enough information to really see what's going on.
>>>
>>> On APUs the SMU firmware is embedded in the system BIOS. Unlike discrete
>>> GPUs, the SMU firmware is not loaded by the driver. You could try
>>> updating your system BIOS to the latest version available from your main
>>> board vendor and see if that makes a difference. It may include a newer
>>> version of the SMU firmware, potentially with a fix.
>>>
>>> If that doesn't help, we'd have to reproduce the problem in house to see
>>> what's happening, which may require the same main board and BIOS version
>>> you're using. We can ask our SMU firmware team if they've ever
>>> encountered your type of problem. But I don't want to give you too much
>>> hope. It's a tricky problem involving HW, firmware and multiple driver
>>> components in a fairly unusual configuration.
>>>
>>> Regards,
>>>    Felix
>>>
>>> On 2019-03-13 7:28 a.m., Lauri Ehrenpreis wrote:
>>> > What I observe is that moving the mouse made the memory speed go up
>>> > and also it made mclk=1200Mhz in rocm-smi output.
>>> > However if I force mclk to 1200Mhz myself then memory speed is still
>>> > slow.
>>> >
>>> > So rocm-smi output when memory speed went fast due to mouse movement:
>>> > rocm-smi
>>> > ========================        ROCm System Management Interface
>>> > ========================
>>> > ================================================================================================
>>> > GPU   Temp   AvgPwr   SCLK    MCLK    PCLK      Fan     Perf
>>> > PwrCap   SCLK OD   MCLK OD GPU%
>>> > GPU[0] : WARNING: Empty SysFS value: pclk
>>> > GPU[0] : WARNING: Unable to read
>>> > /sys/class/drm/card0/device/gpu_busy_percent
>>> > 0     44.0c  N/A      400Mhz  1200Mhz N/A       0%      manual  N/A
>>> >   0%        0%  N/A
>>> > ================================================================================================
>>> > ========================               End of ROCm SMI Log
>>> >   ========================
>>> >
>>> > And rocm-smi output when I forced memclk=1200MHz myself:
>>> > rocm-smi --setmclk 2
>>> > rocm-smi
>>> > ========================        ROCm System Management Interface
>>> > ========================
>>> > ================================================================================================
>>> > GPU   Temp   AvgPwr   SCLK    MCLK    PCLK      Fan     Perf
>>> > PwrCap   SCLK OD   MCLK OD GPU%
>>> > GPU[0] : WARNING: Empty SysFS value: pclk
>>> > GPU[0] : WARNING: Unable to read
>>> > /sys/class/drm/card0/device/gpu_busy_percent
>>> > 0     39.0c  N/A      400Mhz  1200Mhz N/A       0%      manual  N/A
>>> >   0%        0%  N/A
>>> > ================================================================================================
>>> > ========================               End of ROCm SMI Log
>>> >   ========================
>>> >
>>> > So only difference is that temperature shows 44c when memory speed was
>>> > fast and 39c when it was slow. But mclk was 1200MHz and sclk was
>>> > 400MHz in both cases.
>>> > Can it be that rocm-smi just has a bug in reporting and mclk was not
>>> > actually 1200MHz when I forced it with rocm-smi --setmclk 2 ?
>>> > That would explain the different behaviour..
>>> >
>>> > If so then is there a programmatic way how to really guarantee the
>>> > high speed mclk? Basically I want do something similar in my program
>>> > what happens if I move
>>> > the mouse in desktop env and this way guarantee the normal memory
>>> > speed each time the program starts.
>>> >
>>> > --
>>> > Lauri
>>> >
>>> >
>>> > On Tue, Mar 12, 2019 at 11:36 PM Deucher, Alexander
>>> > <Alexander.Deucher@amd.com <mailto:Alexander.Deucher@amd.com>> wrote:
>>> >
>>> >     Forcing the sclk and mclk high may impact the CPU frequency since
>>> >     they share TDP.
>>> >
>>> >     Alex
>>> >     ------------------------------------------------------------------------
>>> >     *From:* amd-gfx <amd-gfx-bounces@lists.freedesktop.org
>>> >     <mailto:amd-gfx-bounces@lists.freedesktop.org>> on behalf of Lauri
>>> >     Ehrenpreis <laurioma@gmail.com <mailto:laurioma@gmail.com>>
>>> >     *Sent:* Tuesday, March 12, 2019 5:31 PM
>>> >     *To:* Kuehling, Felix
>>> >     *Cc:* Tom St Denis; amd-gfx@lists.freedesktop.org
>>> >     <mailto:amd-gfx@lists.freedesktop.org>
>>> >     *Subject:* Re: Slow memory access when using OpenCL without X11
>>> >     However it's not only related to mclk and sclk. I tried this:
>>> >     rocm-smi  --setsclk 2
>>> >     rocm-smi  --setmclk 3
>>> >     rocm-smi
>>> >     ========================        ROCm System Management Interface
>>> >     ========================
>>> >     ================================================================================================
>>> >     GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan     Perf
>>> >       PwrCap   SCLK OD  MCLK OD  GPU%
>>> >     GPU[0] : WARNING: Empty SysFS value: pclk
>>> >     GPU[0] : WARNING: Unable to read
>>> >     /sys/class/drm/card0/device/gpu_busy_percent
>>> >     0     34.0c  N/A      1240Mhz 1333Mhz N/A           0%
>>> >     manual  N/A      0% 0%       N/A
>>> >     ================================================================================================
>>> >     ========================               End of ROCm SMI Log
>>> >     ========================
>>> >
>>> >     ./cl_slow_test 1
>>> >     got 1 platforms 1 devices
>>> >     speed 3919.777100 avg 3919.777100 mbytes/s
>>> >     speed 3809.373291 avg 3864.575195 mbytes/s
>>> >     speed 585.796814 avg 2771.649170 mbytes/s
>>> >     speed 188.721848 avg 2125.917236 mbytes/s
>>> >     speed 188.916367 avg 1738.517090 mbytes/s
>>> >
>>> >     So despite forcing max sclk and mclk the memory speed is still slow..
>>> >
>>> >     --
>>> >     Lauri
>>> >
>>> >
>>> >     On Tue, Mar 12, 2019 at 11:21 PM Lauri Ehrenpreis
>>> >     <laurioma@gmail.com <mailto:laurioma@gmail.com>> wrote:
>>> >
>>> >         IN the case when memory is slow, the rocm-smi outputs this:
>>> >         ========================        ROCm System Management
>>> >         Interface ========================
>>> >         ================================================================================================
>>> >         GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan
>>> >          Perf    PwrCap   SCLK OD  MCLK OD  GPU%
>>> >         GPU[0] : WARNING: Empty SysFS value: pclk
>>> >         GPU[0] : WARNING: Unable to read
>>> >         /sys/class/drm/card0/device/gpu_busy_percent
>>> >         0     30.0c  N/A      400Mhz  933Mhz  N/A           0%
>>> >         auto    N/A      0% 0%       N/A
>>> >         ================================================================================================
>>> >         ========================               End of ROCm SMI Log
>>> >         ========================
>>> >
>>> >         normal memory speed case gives following:
>>> >         ========================        ROCm System Management
>>> >         Interface ========================
>>> >         ================================================================================================
>>> >         GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan
>>> >          Perf    PwrCap   SCLK OD  MCLK OD  GPU%
>>> >         GPU[0] : WARNING: Empty SysFS value: pclk
>>> >         GPU[0] : WARNING: Unable to read
>>> >         /sys/class/drm/card0/device/gpu_busy_percent
>>> >         0     35.0c  N/A      400Mhz  1200Mhz N/A           0%
>>> >         auto    N/A      0% 0%       N/A
>>> >         ================================================================================================
>>> >         ========================               End of ROCm SMI Log
>>> >         ========================
>>> >
>>> >         So there is a difference in MCLK - can this cause such a huge
>>> >         slowdown?
>>> >
>>> >         --
>>> >         Lauri
>>> >
>>> >         On Tue, Mar 12, 2019 at 6:39 PM Kuehling, Felix
>>> >         <Felix.Kuehling@amd.com <mailto:Felix.Kuehling@amd.com>> wrote:
>>> >
>>> >             [adding the list back]
>>> >
>>> >             I'd suspect a problem related to memory clock. This is an
>>> >             APU where
>>> >             system memory is shared with the CPU, so if the SMU
>>> >             changes memory
>>> >             clocks that would affect CPU memory access performance. If
>>> >             the problem
>>> >             only occurs when OpenCL is running, then the compute power
>>> >             profile could
>>> >             have an effect here.
>>> >
>>> >             Laurie, can you monitor the clocks during your tests using
>>> >             rocm-smi?
>>> >
>>> >             Regards,
>>> >                Felix
>>> >
>>> >             On 2019-03-11 1:15 p.m., Tom St Denis wrote:
>>> >             > Hi Lauri,
>>> >             >
>>> >             > I don't have ROCm installed locally (not on that team at
>>> >             AMD) but I
>>> >             > can rope in some of the KFD folk and see what they say :-).
>>> >             >
>>> >             > (in the mean time I should look into installing the ROCm
>>> >             stack on my
>>> >             > Ubuntu disk for experimentation...).
>>> >             >
>>> >             > Only other thing that comes to mind is some sort of
>>> >             stutter due to
>>> >             > power/clock gating (or gfx off/etc).  But that typically
>>> >             affects the
>>> >             > display/gpu side not the CPU side.
>>> >             >
>>> >             > Felix:  Any known issues with Raven and ROCm interacting
>>> >             over memory
>>> >             > bus performance?
>>> >             >
>>> >             > Tom
>>> >             >
>>> >             > On Mon, Mar 11, 2019 at 12:56 PM Lauri Ehrenpreis
>>> >             <laurioma@gmail.com <mailto:laurioma@gmail.com>
>>> >             > <mailto:laurioma@gmail.com <mailto:laurioma@gmail.com>>>
>>> >             wrote:
>>> >             >
>>> >             >     Hi!
>>> >             >
>>> >             >     The 100x memory slowdown is hard to belive indeed. I
>>> >             attached the
>>> >             >     test program with my first e-mail which depends only on
>>> >             >     rocm-opencl-dev package. Would you mind compiling it
>>> >             and checking
>>> >             >     if it slows down memory for you as well?
>>> >             >
>>> >             >     steps:
>>> >             >     1) g++ cl_slow_test.cpp -o cl_slow_test -I
>>> >             >     /opt/rocm/opencl/include/ -L
>>> >             /opt/rocm/opencl/lib/x86_64/  -lOpenCL
>>> >             >     2) logout from desktop env and disconnect
>>> >             hdmi/diplayport etc
>>> >             >     3) log in over ssh
>>> >             >     4) run the program ./cl_slow_test 1
>>> >             >
>>> >             >     For me it reproduced even without step 2 as well but
>>> >             less
>>> >             >     reliably. moving mouse for example could make the
>>> >             memory speed
>>> >             >     fast again.
>>> >             >
>>> >             >     --
>>> >             >     Lauri
>>> >             >
>>> >             >
>>> >             >
>>> >             >     On Mon, Mar 11, 2019 at 6:33 PM Tom St Denis
>>> >             <tstdenis82@gmail.com <mailto:tstdenis82@gmail.com>
>>> >             >     <mailto:tstdenis82@gmail.com
>>> >             <mailto:tstdenis82@gmail.com>>> wrote:
>>> >             >
>>> >             >         Hi Lauri,
>>> >             >
>>> >             >         There's really no connection between the two
>>> >             other than they
>>> >             >         run in the same package.  I too run a 2400G (as my
>>> >             >         workstation) and I got the same ~6.6GB/sec
>>> >             transfer rate but
>>> >             >         without a CL app running ...  The only logical
>>> >             reason is your
>>> >             >         CL app is bottlenecking the APUs memory bus but
>>> >             you claim
>>> >             >         "simply opening a context is enough" so
>>> >             something else is
>>> >             >         going on.
>>> >             >
>>> >             >         Your last reply though says "with it running in the
>>> >             >         background" so it's entirely possible the CPU
>>> >             isn't busy but
>>> >             >         the package memory controller (shared between
>>> >             both the CPU and
>>> >             >         GPU) is busy.  For instance running xonotic in a
>>> >             1080p window
>>> >             >         on my 4K display reduced the memory test to
>>> >             5.8GB/sec and
>>> >             >         that's hardly a heavy memory bound GPU app.
>>> >             >
>>> >             >         The only other possible connection is the GPU is
>>> >             generating so
>>> >             >         much heat that it's throttling the package which
>>> >             is also
>>> >             >         unlikely if you have a proper HSF attached (I
>>> >             use the ones
>>> >             >         that came in the retail boxes).
>>> >             >
>>> >             >         Cheers,
>>> >             >         Tom
>>> >             >
>>> >
>
> _______________________________________________
> amd-gfx mailing list
> amd-gfx@lists.freedesktop.org
> https://lists.freedesktop.org/mailman/listinfo/amd-gfx
_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]                                                         ` <CAD=4a=UOz-R3bcFvEgC_8a9N12Mfs_fVvK+od41k7b=Zjoj45Q-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2019-03-14 16:41                                                           ` Lauri Ehrenpreis
       [not found]                                                             ` <CAGyaPbCvOijB=pWe3zkMze3aT+Yr86aQYK2OP=P8qpOdCzaORg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 17+ messages in thread
From: Lauri Ehrenpreis @ 2019-03-14 16:41 UTC (permalink / raw)
  To: Ernst Sjöstrand
  Cc: Deucher, Alexander, Kuehling, Felix, Tom St Denis,
	amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW


[-- Attachment #1.1: Type: text/plain, Size: 18643 bytes --]

Yes it affects this a bit but it doesn't get the speed up to "normal"
level. I got best results with "profile_peak" - then the memcpy speed on
CPU is 1/3 of what it is without opencl initialization:

 echo "profile_peak" >
/sys/class/drm/card0/device/power_dpm_force_performance_level
./cl_slow_test 1 5
got 1 platforms 1 devices
speed 3710.360352 avg 3710.360352 mbytes/s
speed 3713.660400 avg 3712.010254 mbytes/s
speed 3797.630859 avg 3740.550537 mbytes/s
speed 3708.004883 avg 3732.414062 mbytes/s
speed 3796.403076 avg 3745.211914 mbytes/s

Without calling clCreateContext:
./cl_slow_test 0 5
speed 7299.201660 avg 7299.201660 mbytes/s
speed 9298.841797 avg 8299.021484 mbytes/s
speed 9360.181641 avg 8652.742188 mbytes/s
speed 9004.759766 avg 8740.746094 mbytes/s
speed 9414.607422 avg 8875.518555 mbytes/s

--
Lauri

On Thu, Mar 14, 2019 at 5:46 PM Ernst Sjöstrand <ernstp-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:

> Does
> echo high > /sys/class/drm/card0/device/power_dpm_force_performance_level
> or setting cpu scaling governor to performance affect it at all?
>
> Regards
> //Ernst
>
> Den tors 14 mars 2019 kl 14:31 skrev Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
> >:
> >
> > I tried also with those 2 boards now:
> > https://www.asrock.com/MB/AMD/Fatal1ty%20B450%20Gaming-ITXac/index.asp
> > https://www.msi.com/Motherboard/B450I-GAMING-PLUS-AC
> >
> > Both are using latest BIOS, ubuntu 18.10, kernel
> https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.0.2/
> >
> > There are some differences in dmesg (asrock has some amdgpu assert in
> dmesg) but otherwise results are exactly the same.
> > In desktop env cl_slow_test works fast, over ssh terminal it doesn't. If
> i move mouse then it starts working fast in terminal as well.
> >
> > So one can't use OpenCL without monitor and desktop env running and this
> happens with 2 different chipsets (b350 & b450), latest bios from 3
> different vendors, latest kernel and latest rocm. This doesn't look like
> edge case with unusual setup to me..
> >
> > Attached dmesg, dmidecode, and clinfo from both boards.
> >
> > --
> > Lauri
> >
> > On Wed, Mar 13, 2019 at 10:15 PM Lauri Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
> wrote:
> >>
> >> For reproduction only the tiny cl_slow_test.cpp is needed which is
> attached to first e-mail.
> >>
> >> System information is following:
> >> CPU: Ryzen5 2400G
> >> Main board: Gigabyte AMD B450 AORUS mini itx:
> https://www.gigabyte.com/Motherboard/B450-I-AORUS-PRO-WIFI-rev-10#kf
> >> BIOS: F5 8.47 MB 2019/01/25 (latest)
> >> Kernel: https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.0/  (amd64)
> >> OS: Ubuntu 18.04 LTS
> >> rocm-opencl-dev installation:
> >> wget -qO - http://repo.radeon.com/rocm/apt/debian/rocm.gpg.key | sudo
> apt-key add -
> >> echo 'deb [arch=amd64] http://repo.radeon.com/rocm/apt/debian/ xenial
> main' | sudo tee /etc/apt/sources.list.d/rocm.list
> >> sudo apt install rocm-opencl-dev
> >>
> >> Also exactly the same issue happens with this board:
> https://www.gigabyte.com/Motherboard/GA-AB350-Gaming-3-rev-1x#kf
> >>
> >> I have MSI and Asrock mini itx boards ready as well, So far didn't get
> amdgpu & opencl working there but I'll try again tomorrow..
> >>
> >> --
> >> Lauri
> >>
> >>
> >> On Wed, Mar 13, 2019 at 8:51 PM Kuehling, Felix <Felix.Kuehling-urvtwAKJhsc@public.gmane.orgm>
> wrote:
> >>>
> >>> Hi Lauri,
> >>>
> >>> I still think the SMU is doing something funny, but rocm-smi isn't
> >>> showing enough information to really see what's going on.
> >>>
> >>> On APUs the SMU firmware is embedded in the system BIOS. Unlike
> discrete
> >>> GPUs, the SMU firmware is not loaded by the driver. You could try
> >>> updating your system BIOS to the latest version available from your
> main
> >>> board vendor and see if that makes a difference. It may include a newer
> >>> version of the SMU firmware, potentially with a fix.
> >>>
> >>> If that doesn't help, we'd have to reproduce the problem in house to
> see
> >>> what's happening, which may require the same main board and BIOS
> version
> >>> you're using. We can ask our SMU firmware team if they've ever
> >>> encountered your type of problem. But I don't want to give you too much
> >>> hope. It's a tricky problem involving HW, firmware and multiple driver
> >>> components in a fairly unusual configuration.
> >>>
> >>> Regards,
> >>>    Felix
> >>>
> >>> On 2019-03-13 7:28 a.m., Lauri Ehrenpreis wrote:
> >>> > What I observe is that moving the mouse made the memory speed go up
> >>> > and also it made mclk=1200Mhz in rocm-smi output.
> >>> > However if I force mclk to 1200Mhz myself then memory speed is still
> >>> > slow.
> >>> >
> >>> > So rocm-smi output when memory speed went fast due to mouse movement:
> >>> > rocm-smi
> >>> > ========================        ROCm System Management Interface
> >>> > ========================
> >>> >
> ================================================================================================
> >>> > GPU   Temp   AvgPwr   SCLK    MCLK    PCLK      Fan     Perf
> >>> > PwrCap   SCLK OD   MCLK OD GPU%
> >>> > GPU[0] : WARNING: Empty SysFS value: pclk
> >>> > GPU[0] : WARNING: Unable to read
> >>> > /sys/class/drm/card0/device/gpu_busy_percent
> >>> > 0     44.0c  N/A      400Mhz  1200Mhz N/A       0%      manual  N/A
> >>> >   0%        0%  N/A
> >>> >
> ================================================================================================
> >>> > ========================               End of ROCm SMI Log
> >>> >   ========================
> >>> >
> >>> > And rocm-smi output when I forced memclk=1200MHz myself:
> >>> > rocm-smi --setmclk 2
> >>> > rocm-smi
> >>> > ========================        ROCm System Management Interface
> >>> > ========================
> >>> >
> ================================================================================================
> >>> > GPU   Temp   AvgPwr   SCLK    MCLK    PCLK      Fan     Perf
> >>> > PwrCap   SCLK OD   MCLK OD GPU%
> >>> > GPU[0] : WARNING: Empty SysFS value: pclk
> >>> > GPU[0] : WARNING: Unable to read
> >>> > /sys/class/drm/card0/device/gpu_busy_percent
> >>> > 0     39.0c  N/A      400Mhz  1200Mhz N/A       0%      manual  N/A
> >>> >   0%        0%  N/A
> >>> >
> ================================================================================================
> >>> > ========================               End of ROCm SMI Log
> >>> >   ========================
> >>> >
> >>> > So only difference is that temperature shows 44c when memory speed
> was
> >>> > fast and 39c when it was slow. But mclk was 1200MHz and sclk was
> >>> > 400MHz in both cases.
> >>> > Can it be that rocm-smi just has a bug in reporting and mclk was not
> >>> > actually 1200MHz when I forced it with rocm-smi --setmclk 2 ?
> >>> > That would explain the different behaviour..
> >>> >
> >>> > If so then is there a programmatic way how to really guarantee the
> >>> > high speed mclk? Basically I want do something similar in my program
> >>> > what happens if I move
> >>> > the mouse in desktop env and this way guarantee the normal memory
> >>> > speed each time the program starts.
> >>> >
> >>> > --
> >>> > Lauri
> >>> >
> >>> >
> >>> > On Tue, Mar 12, 2019 at 11:36 PM Deucher, Alexander
> >>> > <Alexander.Deucher-5C7GfCeVMHo@public.gmane.org <mailto:Alexander.Deucher-5C7GfCeVMHo@public.gmane.org>>
> wrote:
> >>> >
> >>> >     Forcing the sclk and mclk high may impact the CPU frequency since
> >>> >     they share TDP.
> >>> >
> >>> >     Alex
> >>> >
>  ------------------------------------------------------------------------
> >>> >     *From:* amd-gfx <amd-gfx-bounces-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
> >>> >     <mailto:amd-gfx-bounces-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org>> on behalf of
> Lauri
> >>> >     Ehrenpreis <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>>
> >>> >     *Sent:* Tuesday, March 12, 2019 5:31 PM
> >>> >     *To:* Kuehling, Felix
> >>> >     *Cc:* Tom St Denis; amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
> >>> >     <mailto:amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org>
> >>> >     *Subject:* Re: Slow memory access when using OpenCL without X11
> >>> >     However it's not only related to mclk and sclk. I tried this:
> >>> >     rocm-smi  --setsclk 2
> >>> >     rocm-smi  --setmclk 3
> >>> >     rocm-smi
> >>> >     ========================        ROCm System Management Interface
> >>> >     ========================
> >>> >
>  ================================================================================================
> >>> >     GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan     Perf
> >>> >       PwrCap   SCLK OD  MCLK OD  GPU%
> >>> >     GPU[0] : WARNING: Empty SysFS value: pclk
> >>> >     GPU[0] : WARNING: Unable to read
> >>> >     /sys/class/drm/card0/device/gpu_busy_percent
> >>> >     0     34.0c  N/A      1240Mhz 1333Mhz N/A           0%
> >>> >     manual  N/A      0% 0%       N/A
> >>> >
>  ================================================================================================
> >>> >     ========================               End of ROCm SMI Log
> >>> >     ========================
> >>> >
> >>> >     ./cl_slow_test 1
> >>> >     got 1 platforms 1 devices
> >>> >     speed 3919.777100 avg 3919.777100 mbytes/s
> >>> >     speed 3809.373291 avg 3864.575195 mbytes/s
> >>> >     speed 585.796814 avg 2771.649170 mbytes/s
> >>> >     speed 188.721848 avg 2125.917236 mbytes/s
> >>> >     speed 188.916367 avg 1738.517090 mbytes/s
> >>> >
> >>> >     So despite forcing max sclk and mclk the memory speed is still
> slow..
> >>> >
> >>> >     --
> >>> >     Lauri
> >>> >
> >>> >
> >>> >     On Tue, Mar 12, 2019 at 11:21 PM Lauri Ehrenpreis
> >>> >     <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>> wrote:
> >>> >
> >>> >         IN the case when memory is slow, the rocm-smi outputs this:
> >>> >         ========================        ROCm System Management
> >>> >         Interface ========================
> >>> >
>  ================================================================================================
> >>> >         GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan
> >>> >          Perf    PwrCap   SCLK OD  MCLK OD  GPU%
> >>> >         GPU[0] : WARNING: Empty SysFS value: pclk
> >>> >         GPU[0] : WARNING: Unable to read
> >>> >         /sys/class/drm/card0/device/gpu_busy_percent
> >>> >         0     30.0c  N/A      400Mhz  933Mhz  N/A           0%
> >>> >         auto    N/A      0% 0%       N/A
> >>> >
>  ================================================================================================
> >>> >         ========================               End of ROCm SMI Log
> >>> >         ========================
> >>> >
> >>> >         normal memory speed case gives following:
> >>> >         ========================        ROCm System Management
> >>> >         Interface ========================
> >>> >
>  ================================================================================================
> >>> >         GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan
> >>> >          Perf    PwrCap   SCLK OD  MCLK OD  GPU%
> >>> >         GPU[0] : WARNING: Empty SysFS value: pclk
> >>> >         GPU[0] : WARNING: Unable to read
> >>> >         /sys/class/drm/card0/device/gpu_busy_percent
> >>> >         0     35.0c  N/A      400Mhz  1200Mhz N/A           0%
> >>> >         auto    N/A      0% 0%       N/A
> >>> >
>  ================================================================================================
> >>> >         ========================               End of ROCm SMI Log
> >>> >         ========================
> >>> >
> >>> >         So there is a difference in MCLK - can this cause such a huge
> >>> >         slowdown?
> >>> >
> >>> >         --
> >>> >         Lauri
> >>> >
> >>> >         On Tue, Mar 12, 2019 at 6:39 PM Kuehling, Felix
> >>> >         <Felix.Kuehling-5C7GfCeVMHo@public.gmane.org <mailto:Felix.Kuehling-5C7GfCeVMHo@public.gmane.org>>
> wrote:
> >>> >
> >>> >             [adding the list back]
> >>> >
> >>> >             I'd suspect a problem related to memory clock. This is an
> >>> >             APU where
> >>> >             system memory is shared with the CPU, so if the SMU
> >>> >             changes memory
> >>> >             clocks that would affect CPU memory access performance.
> If
> >>> >             the problem
> >>> >             only occurs when OpenCL is running, then the compute
> power
> >>> >             profile could
> >>> >             have an effect here.
> >>> >
> >>> >             Laurie, can you monitor the clocks during your tests
> using
> >>> >             rocm-smi?
> >>> >
> >>> >             Regards,
> >>> >                Felix
> >>> >
> >>> >             On 2019-03-11 1:15 p.m., Tom St Denis wrote:
> >>> >             > Hi Lauri,
> >>> >             >
> >>> >             > I don't have ROCm installed locally (not on that team
> at
> >>> >             AMD) but I
> >>> >             > can rope in some of the KFD folk and see what they say
> :-).
> >>> >             >
> >>> >             > (in the mean time I should look into installing the
> ROCm
> >>> >             stack on my
> >>> >             > Ubuntu disk for experimentation...).
> >>> >             >
> >>> >             > Only other thing that comes to mind is some sort of
> >>> >             stutter due to
> >>> >             > power/clock gating (or gfx off/etc).  But that
> typically
> >>> >             affects the
> >>> >             > display/gpu side not the CPU side.
> >>> >             >
> >>> >             > Felix:  Any known issues with Raven and ROCm
> interacting
> >>> >             over memory
> >>> >             > bus performance?
> >>> >             >
> >>> >             > Tom
> >>> >             >
> >>> >             > On Mon, Mar 11, 2019 at 12:56 PM Lauri Ehrenpreis
> >>> >             <laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
> >>> >             > <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:laurioma-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
> >>>
> >>> >             wrote:
> >>> >             >
> >>> >             >     Hi!
> >>> >             >
> >>> >             >     The 100x memory slowdown is hard to belive indeed.
> I
> >>> >             attached the
> >>> >             >     test program with my first e-mail which depends
> only on
> >>> >             >     rocm-opencl-dev package. Would you mind compiling
> it
> >>> >             and checking
> >>> >             >     if it slows down memory for you as well?
> >>> >             >
> >>> >             >     steps:
> >>> >             >     1) g++ cl_slow_test.cpp -o cl_slow_test -I
> >>> >             >     /opt/rocm/opencl/include/ -L
> >>> >             /opt/rocm/opencl/lib/x86_64/  -lOpenCL
> >>> >             >     2) logout from desktop env and disconnect
> >>> >             hdmi/diplayport etc
> >>> >             >     3) log in over ssh
> >>> >             >     4) run the program ./cl_slow_test 1
> >>> >             >
> >>> >             >     For me it reproduced even without step 2 as well
> but
> >>> >             less
> >>> >             >     reliably. moving mouse for example could make the
> >>> >             memory speed
> >>> >             >     fast again.
> >>> >             >
> >>> >             >     --
> >>> >             >     Lauri
> >>> >             >
> >>> >             >
> >>> >             >
> >>> >             >     On Mon, Mar 11, 2019 at 6:33 PM Tom St Denis
> >>> >             <tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org <mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>
> >>> >             >     <mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org
> >>> >             <mailto:tstdenis82-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org>>> wrote:
> >>> >             >
> >>> >             >         Hi Lauri,
> >>> >             >
> >>> >             >         There's really no connection between the two
> >>> >             other than they
> >>> >             >         run in the same package.  I too run a 2400G
> (as my
> >>> >             >         workstation) and I got the same ~6.6GB/sec
> >>> >             transfer rate but
> >>> >             >         without a CL app running ...  The only logical
> >>> >             reason is your
> >>> >             >         CL app is bottlenecking the APUs memory bus but
> >>> >             you claim
> >>> >             >         "simply opening a context is enough" so
> >>> >             something else is
> >>> >             >         going on.
> >>> >             >
> >>> >             >         Your last reply though says "with it running
> in the
> >>> >             >         background" so it's entirely possible the CPU
> >>> >             isn't busy but
> >>> >             >         the package memory controller (shared between
> >>> >             both the CPU and
> >>> >             >         GPU) is busy.  For instance running xonotic in
> a
> >>> >             1080p window
> >>> >             >         on my 4K display reduced the memory test to
> >>> >             5.8GB/sec and
> >>> >             >         that's hardly a heavy memory bound GPU app.
> >>> >             >
> >>> >             >         The only other possible connection is the GPU
> is
> >>> >             generating so
> >>> >             >         much heat that it's throttling the package
> which
> >>> >             is also
> >>> >             >         unlikely if you have a proper HSF attached (I
> >>> >             use the ones
> >>> >             >         that came in the retail boxes).
> >>> >             >
> >>> >             >         Cheers,
> >>> >             >         Tom
> >>> >             >
> >>> >
> >
> > _______________________________________________
> > amd-gfx mailing list
> > amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
> > https://lists.freedesktop.org/mailman/listinfo/amd-gfx
>

[-- Attachment #1.2: Type: text/html, Size: 28274 bytes --]

[-- Attachment #2: Type: text/plain, Size: 153 bytes --]

_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

* Re: Slow memory access when using OpenCL without X11
       [not found]                                                             ` <CAGyaPbCvOijB=pWe3zkMze3aT+Yr86aQYK2OP=P8qpOdCzaORg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2019-03-15 22:30                                                               ` Kuehling, Felix
  0 siblings, 0 replies; 17+ messages in thread
From: Kuehling, Felix @ 2019-03-15 22:30 UTC (permalink / raw)
  To: Lauri Ehrenpreis, Ernst Sjöstrand, Zhao, Yong
  Cc: Deucher, Alexander, Tom St Denis,
	amd-gfx-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW


[-- Attachment #1.1: Type: text/plain, Size: 18307 bytes --]

Hi Lauri,

Thanks for your persistence. Seeing that this is reproducible on several boards with up-to-date BIOS is really helpful and gives me some confidence that it's more than a weird vendor or board-specific corner case and that we should be able to reproduce it. Yong is going to start looking into this problem.

Regards,
  Felix

On 3/14/2019 12:41 PM, Lauri Ehrenpreis wrote:
Yes it affects this a bit but it doesn't get the speed up to "normal" level. I got best results with "profile_peak" - then the memcpy speed on CPU is 1/3 of what it is without opencl initialization:

 echo "profile_peak" > /sys/class/drm/card0/device/power_dpm_force_performance_level
./cl_slow_test 1 5
got 1 platforms 1 devices
speed 3710.360352 avg 3710.360352 mbytes/s
speed 3713.660400 avg 3712.010254 mbytes/s
speed 3797.630859 avg 3740.550537 mbytes/s
speed 3708.004883 avg 3732.414062 mbytes/s
speed 3796.403076 avg 3745.211914 mbytes/s

Without calling clCreateContext:
./cl_slow_test 0 5
speed 7299.201660 avg 7299.201660 mbytes/s
speed 9298.841797 avg 8299.021484 mbytes/s
speed 9360.181641 avg 8652.742188 mbytes/s
speed 9004.759766 avg 8740.746094 mbytes/s
speed 9414.607422 avg 8875.518555 mbytes/s

--
Lauri

On Thu, Mar 14, 2019 at 5:46 PM Ernst Sjöstrand <ernstp@gmail.com<mailto:ernstp@gmail.com>> wrote:
Does
echo high > /sys/class/drm/card0/device/power_dpm_force_performance_level
or setting cpu scaling governor to performance affect it at all?

Regards
//Ernst

Den tors 14 mars 2019 kl 14:31 skrev Lauri Ehrenpreis <laurioma@gmail.com<mailto:laurioma@gmail.com>>:
>
> I tried also with those 2 boards now:
> https://www.asrock.com/MB/AMD/Fatal1ty%20B450%20Gaming-ITXac/index.asp
> https://www.msi.com/Motherboard/B450I-GAMING-PLUS-AC
>
> Both are using latest BIOS, ubuntu 18.10, kernel https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.0.2/
>
> There are some differences in dmesg (asrock has some amdgpu assert in dmesg) but otherwise results are exactly the same.
> In desktop env cl_slow_test works fast, over ssh terminal it doesn't. If i move mouse then it starts working fast in terminal as well.
>
> So one can't use OpenCL without monitor and desktop env running and this happens with 2 different chipsets (b350 & b450), latest bios from 3 different vendors, latest kernel and latest rocm. This doesn't look like edge case with unusual setup to me..
>
> Attached dmesg, dmidecode, and clinfo from both boards.
>
> --
> Lauri
>
> On Wed, Mar 13, 2019 at 10:15 PM Lauri Ehrenpreis <laurioma@gmail.com<mailto:laurioma@gmail.com>> wrote:
>>
>> For reproduction only the tiny cl_slow_test.cpp is needed which is attached to first e-mail.
>>
>> System information is following:
>> CPU: Ryzen5 2400G
>> Main board: Gigabyte AMD B450 AORUS mini itx: https://www.gigabyte.com/Motherboard/B450-I-AORUS-PRO-WIFI-rev-10#kf
>> BIOS: F5 8.47 MB 2019/01/25 (latest)
>> Kernel: https://kernel.ubuntu.com/~kernel-ppa/mainline/v5.0/  (amd64)
>> OS: Ubuntu 18.04 LTS
>> rocm-opencl-dev installation:
>> wget -qO - http://repo.radeon.com/rocm/apt/debian/rocm.gpg.key | sudo apt-key add -
>> echo 'deb [arch=amd64] http://repo.radeon.com/rocm/apt/debian/ xenial main' | sudo tee /etc/apt/sources.list.d/rocm.list
>> sudo apt install rocm-opencl-dev
>>
>> Also exactly the same issue happens with this board: https://www.gigabyte.com/Motherboard/GA-AB350-Gaming-3-rev-1x#kf
>>
>> I have MSI and Asrock mini itx boards ready as well, So far didn't get amdgpu & opencl working there but I'll try again tomorrow..
>>
>> --
>> Lauri
>>
>>
>> On Wed, Mar 13, 2019 at 8:51 PM Kuehling, Felix <Felix.Kuehling@amd.com<mailto:Felix.Kuehling@amd.com>> wrote:
>>>
>>> Hi Lauri,
>>>
>>> I still think the SMU is doing something funny, but rocm-smi isn't
>>> showing enough information to really see what's going on.
>>>
>>> On APUs the SMU firmware is embedded in the system BIOS. Unlike discrete
>>> GPUs, the SMU firmware is not loaded by the driver. You could try
>>> updating your system BIOS to the latest version available from your main
>>> board vendor and see if that makes a difference. It may include a newer
>>> version of the SMU firmware, potentially with a fix.
>>>
>>> If that doesn't help, we'd have to reproduce the problem in house to see
>>> what's happening, which may require the same main board and BIOS version
>>> you're using. We can ask our SMU firmware team if they've ever
>>> encountered your type of problem. But I don't want to give you too much
>>> hope. It's a tricky problem involving HW, firmware and multiple driver
>>> components in a fairly unusual configuration.
>>>
>>> Regards,
>>>    Felix
>>>
>>> On 2019-03-13 7:28 a.m., Lauri Ehrenpreis wrote:
>>> > What I observe is that moving the mouse made the memory speed go up
>>> > and also it made mclk=1200Mhz in rocm-smi output.
>>> > However if I force mclk to 1200Mhz myself then memory speed is still
>>> > slow.
>>> >
>>> > So rocm-smi output when memory speed went fast due to mouse movement:
>>> > rocm-smi
>>> > ========================        ROCm System Management Interface
>>> > ========================
>>> > ================================================================================================
>>> > GPU   Temp   AvgPwr   SCLK    MCLK    PCLK      Fan     Perf
>>> > PwrCap   SCLK OD   MCLK OD GPU%
>>> > GPU[0] : WARNING: Empty SysFS value: pclk
>>> > GPU[0] : WARNING: Unable to read
>>> > /sys/class/drm/card0/device/gpu_busy_percent
>>> > 0     44.0c  N/A      400Mhz  1200Mhz N/A       0%      manual  N/A
>>> >   0%        0%  N/A
>>> > ================================================================================================
>>> > ========================               End of ROCm SMI Log
>>> >   ========================
>>> >
>>> > And rocm-smi output when I forced memclk=1200MHz myself:
>>> > rocm-smi --setmclk 2
>>> > rocm-smi
>>> > ========================        ROCm System Management Interface
>>> > ========================
>>> > ================================================================================================
>>> > GPU   Temp   AvgPwr   SCLK    MCLK    PCLK      Fan     Perf
>>> > PwrCap   SCLK OD   MCLK OD GPU%
>>> > GPU[0] : WARNING: Empty SysFS value: pclk
>>> > GPU[0] : WARNING: Unable to read
>>> > /sys/class/drm/card0/device/gpu_busy_percent
>>> > 0     39.0c  N/A      400Mhz  1200Mhz N/A       0%      manual  N/A
>>> >   0%        0%  N/A
>>> > ================================================================================================
>>> > ========================               End of ROCm SMI Log
>>> >   ========================
>>> >
>>> > So only difference is that temperature shows 44c when memory speed was
>>> > fast and 39c when it was slow. But mclk was 1200MHz and sclk was
>>> > 400MHz in both cases.
>>> > Can it be that rocm-smi just has a bug in reporting and mclk was not
>>> > actually 1200MHz when I forced it with rocm-smi --setmclk 2 ?
>>> > That would explain the different behaviour..
>>> >
>>> > If so then is there a programmatic way how to really guarantee the
>>> > high speed mclk? Basically I want do something similar in my program
>>> > what happens if I move
>>> > the mouse in desktop env and this way guarantee the normal memory
>>> > speed each time the program starts.
>>> >
>>> > --
>>> > Lauri
>>> >
>>> >
>>> > On Tue, Mar 12, 2019 at 11:36 PM Deucher, Alexander
>>> > <Alexander.Deucher@amd.com<mailto:Alexander.Deucher@amd.com> <mailto:Alexander.Deucher@amd.com<mailto:Alexander.Deucher@amd.com>>> wrote:
>>> >
>>> >     Forcing the sclk and mclk high may impact the CPU frequency since
>>> >     they share TDP.
>>> >
>>> >     Alex
>>> >     ------------------------------------------------------------------------
>>> >     *From:* amd-gfx <amd-gfx-bounces@lists.freedesktop.org<mailto:amd-gfx-bounces@lists.freedesktop.org>
>>> >     <mailto:amd-gfx-bounces@lists.freedesktop.org<mailto:amd-gfx-bounces@lists.freedesktop.org>>> on behalf of Lauri
>>> >     Ehrenpreis <laurioma@gmail.com<mailto:laurioma@gmail.com> <mailto:laurioma@gmail.com<mailto:laurioma@gmail.com>>>
>>> >     *Sent:* Tuesday, March 12, 2019 5:31 PM
>>> >     *To:* Kuehling, Felix
>>> >     *Cc:* Tom St Denis; amd-gfx@lists.freedesktop.org<mailto:amd-gfx@lists.freedesktop.org>
>>> >     <mailto:amd-gfx@lists.freedesktop.org<mailto:amd-gfx@lists.freedesktop.org>>
>>> >     *Subject:* Re: Slow memory access when using OpenCL without X11
>>> >     However it's not only related to mclk and sclk. I tried this:
>>> >     rocm-smi  --setsclk 2
>>> >     rocm-smi  --setmclk 3
>>> >     rocm-smi
>>> >     ========================        ROCm System Management Interface
>>> >     ========================
>>> >     ================================================================================================
>>> >     GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan     Perf
>>> >       PwrCap   SCLK OD  MCLK OD  GPU%
>>> >     GPU[0] : WARNING: Empty SysFS value: pclk
>>> >     GPU[0] : WARNING: Unable to read
>>> >     /sys/class/drm/card0/device/gpu_busy_percent
>>> >     0     34.0c  N/A      1240Mhz 1333Mhz N/A           0%
>>> >     manual  N/A      0% 0%       N/A
>>> >     ================================================================================================
>>> >     ========================               End of ROCm SMI Log
>>> >     ========================
>>> >
>>> >     ./cl_slow_test 1
>>> >     got 1 platforms 1 devices
>>> >     speed 3919.777100 avg 3919.777100 mbytes/s
>>> >     speed 3809.373291 avg 3864.575195 mbytes/s
>>> >     speed 585.796814 avg 2771.649170 mbytes/s
>>> >     speed 188.721848 avg 2125.917236 mbytes/s
>>> >     speed 188.916367 avg 1738.517090 mbytes/s
>>> >
>>> >     So despite forcing max sclk and mclk the memory speed is still slow..
>>> >
>>> >     --
>>> >     Lauri
>>> >
>>> >
>>> >     On Tue, Mar 12, 2019 at 11:21 PM Lauri Ehrenpreis
>>> >     <laurioma@gmail.com<mailto:laurioma@gmail.com> <mailto:laurioma@gmail.com<mailto:laurioma@gmail.com>>> wrote:
>>> >
>>> >         IN the case when memory is slow, the rocm-smi outputs this:
>>> >         ========================        ROCm System Management
>>> >         Interface ========================
>>> >         ================================================================================================
>>> >         GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan
>>> >          Perf    PwrCap   SCLK OD  MCLK OD  GPU%
>>> >         GPU[0] : WARNING: Empty SysFS value: pclk
>>> >         GPU[0] : WARNING: Unable to read
>>> >         /sys/class/drm/card0/device/gpu_busy_percent
>>> >         0     30.0c  N/A      400Mhz  933Mhz  N/A           0%
>>> >         auto    N/A      0% 0%       N/A
>>> >         ================================================================================================
>>> >         ========================               End of ROCm SMI Log
>>> >         ========================
>>> >
>>> >         normal memory speed case gives following:
>>> >         ========================        ROCm System Management
>>> >         Interface ========================
>>> >         ================================================================================================
>>> >         GPU   Temp   AvgPwr   SCLK    MCLK    PCLK          Fan
>>> >          Perf    PwrCap   SCLK OD  MCLK OD  GPU%
>>> >         GPU[0] : WARNING: Empty SysFS value: pclk
>>> >         GPU[0] : WARNING: Unable to read
>>> >         /sys/class/drm/card0/device/gpu_busy_percent
>>> >         0     35.0c  N/A      400Mhz  1200Mhz N/A           0%
>>> >         auto    N/A      0% 0%       N/A
>>> >         ================================================================================================
>>> >         ========================               End of ROCm SMI Log
>>> >         ========================
>>> >
>>> >         So there is a difference in MCLK - can this cause such a huge
>>> >         slowdown?
>>> >
>>> >         --
>>> >         Lauri
>>> >
>>> >         On Tue, Mar 12, 2019 at 6:39 PM Kuehling, Felix
>>> >         <Felix.Kuehling@amd.com<mailto:Felix.Kuehling@amd.com> <mailto:Felix.Kuehling@amd.com<mailto:Felix.Kuehling@amd.com>>> wrote:
>>> >
>>> >             [adding the list back]
>>> >
>>> >             I'd suspect a problem related to memory clock. This is an
>>> >             APU where
>>> >             system memory is shared with the CPU, so if the SMU
>>> >             changes memory
>>> >             clocks that would affect CPU memory access performance. If
>>> >             the problem
>>> >             only occurs when OpenCL is running, then the compute power
>>> >             profile could
>>> >             have an effect here.
>>> >
>>> >             Laurie, can you monitor the clocks during your tests using
>>> >             rocm-smi?
>>> >
>>> >             Regards,
>>> >                Felix
>>> >
>>> >             On 2019-03-11 1:15 p.m., Tom St Denis wrote:
>>> >             > Hi Lauri,
>>> >             >
>>> >             > I don't have ROCm installed locally (not on that team at
>>> >             AMD) but I
>>> >             > can rope in some of the KFD folk and see what they say :-).
>>> >             >
>>> >             > (in the mean time I should look into installing the ROCm
>>> >             stack on my
>>> >             > Ubuntu disk for experimentation...).
>>> >             >
>>> >             > Only other thing that comes to mind is some sort of
>>> >             stutter due to
>>> >             > power/clock gating (or gfx off/etc).  But that typically
>>> >             affects the
>>> >             > display/gpu side not the CPU side.
>>> >             >
>>> >             > Felix:  Any known issues with Raven and ROCm interacting
>>> >             over memory
>>> >             > bus performance?
>>> >             >
>>> >             > Tom
>>> >             >
>>> >             > On Mon, Mar 11, 2019 at 12:56 PM Lauri Ehrenpreis
>>> >             <laurioma@gmail.com<mailto:laurioma@gmail.com> <mailto:laurioma@gmail.com<mailto:laurioma@gmail.com>>
>>> >             > <mailto:laurioma@gmail.com<mailto:laurioma@gmail.com> <mailto:laurioma@gmail.com<mailto:laurioma@gmail.com>>>>
>>> >             wrote:
>>> >             >
>>> >             >     Hi!
>>> >             >
>>> >             >     The 100x memory slowdown is hard to belive indeed. I
>>> >             attached the
>>> >             >     test program with my first e-mail which depends only on
>>> >             >     rocm-opencl-dev package. Would you mind compiling it
>>> >             and checking
>>> >             >     if it slows down memory for you as well?
>>> >             >
>>> >             >     steps:
>>> >             >     1) g++ cl_slow_test.cpp -o cl_slow_test -I
>>> >             >     /opt/rocm/opencl/include/ -L
>>> >             /opt/rocm/opencl/lib/x86_64/  -lOpenCL
>>> >             >     2) logout from desktop env and disconnect
>>> >             hdmi/diplayport etc
>>> >             >     3) log in over ssh
>>> >             >     4) run the program ./cl_slow_test 1
>>> >             >
>>> >             >     For me it reproduced even without step 2 as well but
>>> >             less
>>> >             >     reliably. moving mouse for example could make the
>>> >             memory speed
>>> >             >     fast again.
>>> >             >
>>> >             >     --
>>> >             >     Lauri
>>> >             >
>>> >             >
>>> >             >
>>> >             >     On Mon, Mar 11, 2019 at 6:33 PM Tom St Denis
>>> >             <tstdenis82@gmail.com<mailto:tstdenis82@gmail.com> <mailto:tstdenis82@gmail.com<mailto:tstdenis82@gmail.com>>
>>> >             >     <mailto:tstdenis82@gmail.com<mailto:tstdenis82@gmail.com>
>>> >             <mailto:tstdenis82@gmail.com<mailto:tstdenis82@gmail.com>>>> wrote:
>>> >             >
>>> >             >         Hi Lauri,
>>> >             >
>>> >             >         There's really no connection between the two
>>> >             other than they
>>> >             >         run in the same package.  I too run a 2400G (as my
>>> >             >         workstation) and I got the same ~6.6GB/sec
>>> >             transfer rate but
>>> >             >         without a CL app running ...  The only logical
>>> >             reason is your
>>> >             >         CL app is bottlenecking the APUs memory bus but
>>> >             you claim
>>> >             >         "simply opening a context is enough" so
>>> >             something else is
>>> >             >         going on.
>>> >             >
>>> >             >         Your last reply though says "with it running in the
>>> >             >         background" so it's entirely possible the CPU
>>> >             isn't busy but
>>> >             >         the package memory controller (shared between
>>> >             both the CPU and
>>> >             >         GPU) is busy.  For instance running xonotic in a
>>> >             1080p window
>>> >             >         on my 4K display reduced the memory test to
>>> >             5.8GB/sec and
>>> >             >         that's hardly a heavy memory bound GPU app.
>>> >             >
>>> >             >         The only other possible connection is the GPU is
>>> >             generating so
>>> >             >         much heat that it's throttling the package which
>>> >             is also
>>> >             >         unlikely if you have a proper HSF attached (I
>>> >             use the ones
>>> >             >         that came in the retail boxes).
>>> >             >
>>> >             >         Cheers,
>>> >             >         Tom
>>> >             >
>>> >
>
> _______________________________________________
> amd-gfx mailing list
> amd-gfx@lists.freedesktop.org<mailto:amd-gfx@lists.freedesktop.org>
> https://lists.freedesktop.org/mailman/listinfo/amd-gfx

[-- Attachment #1.2: Type: text/html, Size: 34739 bytes --]

[-- Attachment #2: Type: text/plain, Size: 153 bytes --]

_______________________________________________
amd-gfx mailing list
amd-gfx@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/amd-gfx

^ permalink raw reply	[flat|nested] 17+ messages in thread

end of thread, other threads:[~2019-03-15 22:30 UTC | newest]

Thread overview: 17+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2019-03-08 19:43 Slow memory access when using OpenCL without X11 Lauri Ehrenpreis
     [not found] ` <CAGyaPbDo4-mJhCbL1gfjgek_Z54dyREydqZc-SF=cFVQ0URyYA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-03-08 20:35   ` Alex Deucher
     [not found]     ` <CADnq5_Mtg5Brvp3Z1dMy+V4oD1DqCQ-WJm4ehSW_dFybLm1Jcw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-03-09  6:54       ` Lauri Ehrenpreis
     [not found]         ` <CAGyaPbCxMxG5kbu9RhrB0vSCDQL4zaNzsUqsoWVWmRVw8Mp7Pg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-03-09 19:22           ` Jan Vesely
2019-03-10 19:13             ` Lauri Ehrenpreis
     [not found]               ` <CAGyaPbDGq5Z+J+c_s99vBjSUttKwsBNv+EMvdjg0aXjY52qT-g-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-03-12 14:02                 ` Lauri Ehrenpreis
     [not found]               ` <CAAzXoRKQnmsQxPqEswAyAxQ7snW+D=L0GC+auiDsVnZQaBeAvQ@mail.gmail.com>
     [not found]                 ` <CAGyaPbCNtF_LP3jtKcm9NB=Suw+EKTY941y=QAmODcP=q83zbA@mail.gmail.com>
     [not found]                   ` <CAAzXoRJ7MBis7YYWhYcH_H=1ZPpZpTJFDm+HTD5q0p91bgTxSg@mail.gmail.com>
     [not found]                     ` <CAAzXoRJ7MBis7YYWhYcH_H=1ZPpZpTJFDm+HTD5q0p91bgTxSg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-03-12 16:39                       ` Kuehling, Felix
     [not found]                         ` <b26fcd35-9867-f716-cea8-ddf76c599fca-5C7GfCeVMHo@public.gmane.org>
2019-03-12 21:21                           ` Lauri Ehrenpreis
     [not found]                             ` <CAGyaPbA_z0bKC1W8gTdnx4Ot5G-45pC7029pKWrAM0Pj_BU6uw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-03-12 21:31                               ` Lauri Ehrenpreis
     [not found]                                 ` <CAGyaPbD3K3pawBS+kBOs_QSm3kB16MFRYZa98FcqHAEX_FanVg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-03-12 21:36                                   ` Deucher, Alexander
     [not found]                                     ` <BN6PR12MB180985C2C8051B5BBCF7CDDDF7490-/b2+HYfkarSEx6ez0IUAagdYzm3356FpvxpqHgZTriW3zl9H0oFU5g@public.gmane.org>
2019-03-13 11:28                                       ` Lauri Ehrenpreis
     [not found]                                         ` <CAGyaPbBAxjGGHA6sxzvSqagLVhiHBDmmp3Oz0==SRhUao488ng-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-03-13 18:51                                           ` Kuehling, Felix
     [not found]                                             ` <8502a6bb-26b2-bd5e-c073-8e4e4405d3e2-5C7GfCeVMHo@public.gmane.org>
2019-03-13 20:15                                               ` Lauri Ehrenpreis
     [not found]                                                 ` <CAGyaPbCTM8YoCuJQdD1JkDiA5FkpnMhLkQcb8Lpr8k0KYwLUWQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-03-14 13:30                                                   ` Lauri Ehrenpreis
     [not found]                                                     ` <CAGyaPbBwk9CZaMgrrB3edgJLDJq8djfETUBnhkZKg0+rza+Y5Q-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-03-14 15:46                                                       ` Ernst Sjöstrand
     [not found]                                                         ` <CAD=4a=UOz-R3bcFvEgC_8a9N12Mfs_fVvK+od41k7b=Zjoj45Q-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-03-14 16:41                                                           ` Lauri Ehrenpreis
     [not found]                                                             ` <CAGyaPbCvOijB=pWe3zkMze3aT+Yr86aQYK2OP=P8qpOdCzaORg-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2019-03-15 22:30                                                               ` Kuehling, Felix

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.