All of lore.kernel.org
 help / color / mirror / Atom feed
* GeForce(R) GT 710 1GB PCIE x 1 on arm64
@ 2020-05-06 13:53 Milan Buška
       [not found] ` <CAFCWPP+WKRhhXG3CRfqRztWbFJwUqeeY6tiip4fT9gwtyjKNwQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 14+ messages in thread
From: Milan Buška @ 2020-05-06 13:53 UTC (permalink / raw)
  To: nouveau-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW


[-- Attachment #1.1: Type: text/plain, Size: 808 bytes --]

Hi to all.
I'm experimenting with running a
https://www.zotac.com/us/product/graphics_card/geforce%C2%AE-gt-710-1gb-pcie-x-1
card on an Nvidia Jetson TX2 arm64 device.
Possible?
Linux kernel aarch64 5.6.10.
Because Nvidia did not list drivers for this architecture, I'm
experimenting with a nouveau driver.
The Jetson TX2 has a default driver for the host1x framebuffer for output
from the board via HDMI.
I changed the video kernel parameter to nouveau. Booting the system OK only
there is no output on the monitor.
The device can only be controlled via the serial console.
Can anyone advise me where to start setting up - (if something needs to be
set up)

Greeting

Milan Buška

-- 

Remember, no question is too stupid and no problem too small
       -- We've all been beginners

[-- Attachment #1.2: Type: text/html, Size: 1077 bytes --]

[-- Attachment #2: Type: text/plain, Size: 182 bytes --]

_______________________________________________
Nouveau mailing list
Nouveau-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW@public.gmane.org
https://lists.freedesktop.org/mailman/listinfo/nouveau

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: GeForce(R) GT 710 1GB PCIE x 1 on arm64
       [not found] ` <CAFCWPP+WKRhhXG3CRfqRztWbFJwUqeeY6tiip4fT9gwtyjKNwQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2020-05-06 14:00   ` Ilia Mirkin
       [not found]     ` <CAFCWPP+WmbjM0O2T9ODi-iVU1qGXjpk9V9LeE9PsuT7t+APLQA@mail.gmail.com>
  0 siblings, 1 reply; 14+ messages in thread
From: Ilia Mirkin @ 2020-05-06 14:00 UTC (permalink / raw)
  To: Milan Buška; +Cc: nouveau

In general it should be possible. If you're having issues, please include dmesg.

One issue that has come up is that the PCIe controllers on such boards
have very narrow memory windows, not enough to map certain (required)
BARs of NVIDIA GPUs (or other GPUs, I'd expect). This comes up in
dmesg with PCI-related errors.

Cheers,

  -ilia

On Wed, May 6, 2020 at 9:53 AM Milan Buška <milan.buska@gmail.com> wrote:
>
> Hi to all.
> I'm experimenting with running a https://www.zotac.com/us/product/graphics_card/geforce%C2%AE-gt-710-1gb-pcie-x-1 card on an Nvidia Jetson TX2 arm64 device.
> Possible?
> Linux kernel aarch64 5.6.10.
> Because Nvidia did not list drivers for this architecture, I'm experimenting with a nouveau driver.
> The Jetson TX2 has a default driver for the host1x framebuffer for output from the board via HDMI.
> I changed the video kernel parameter to nouveau. Booting the system OK only there is no output on the monitor.
> The device can only be controlled via the serial console.
> Can anyone advise me where to start setting up - (if something needs to be set up)
>
> Greeting
>
> Milan Buška
>
> --
>
> Remember, no question is too stupid and no problem too small
>        -- We've all been beginners
> _______________________________________________
> Nouveau mailing list
> Nouveau@lists.freedesktop.org
> https://lists.freedesktop.org/mailman/listinfo/nouveau
_______________________________________________
Nouveau mailing list
Nouveau@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/nouveau

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: GeForce(R) GT 710 1GB PCIE x 1 on arm64
       [not found]       ` <CAFCWPP+WmbjM0O2T9ODi-iVU1qGXjpk9V9LeE9PsuT7t+APLQA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2020-05-06 14:26         ` Ilia Mirkin
       [not found]           ` <CAKb7Uvj6nMk2U6MD-iMXEWQzc4ok2xxuq7K3C8ti6mfFDqhuDw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  2020-05-06 14:28         ` Fwd: " Milan Buška
  1 sibling, 1 reply; 14+ messages in thread
From: Ilia Mirkin @ 2020-05-06 14:26 UTC (permalink / raw)
  To: Milan Buška; +Cc: nouveau

[please keep list cc'd in your replies]

On Wed, May 6, 2020 at 10:15 AM Milan Buška <milan.buska@gmail.com> wrote:
> [    0.000000] Linux version 5.6.10-zotac (root@saux) (gcc version 9.3.0 (SAUX Aarch64)) #1 SMP PREEMPT Tue May 5 22:16:40 CEST 2020
> [    0.000000] Machine model: NVIDIA Jetson TX2 Developer Kit

[...]

> [    3.965934] tegra-pcie 10003000.pcie: Adding to iommu group 5
> [    3.966435] tegra-pcie 10003000.pcie: 4x1, 1x1 configuration
> [    3.968057] tegra-pcie 10003000.pcie: probing port 0, using 4 lanes
> [    3.970121] tegra-pcie 10003000.pcie: probing port 1, using 0 lanes
> [    3.972183] tegra-pcie 10003000.pcie: probing port 2, using 1 lanes
> [    5.260316] tegra-pcie 10003000.pcie: link 1 down, ignoring
> [    6.479410] tegra-pcie 10003000.pcie: link 2 down, ignoring
> [    6.479579] tegra-pcie 10003000.pcie: PCI host bridge to bus 0000:00
> [    6.479602] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
> [    6.479627] pci_bus 0000:00: root bus resource [mem 0x50100000-0x57ffffff]
> [    6.479646] pci_bus 0000:00: root bus resource [mem 0x58000000-0x7fffffff pref]
> [    6.479668] pci_bus 0000:00: root bus resource [bus 00-ff]
> [    6.479850] pci 0000:00:01.0: [10de:10e5] type 01 class 0x060400
> [    6.479887] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4 may corrupt adjacent RW1C bits
> [    6.479916] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4 may corrupt adjacent RW1C bits
> [    6.479993] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> [    6.480041] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x52 may corrupt adjacent RW1C bits
> [    6.480118] pci 0000:00:01.0: PME# supported from D0 D1 D2 D3hot D3cold
> [    6.480141] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4c may corrupt adjacent RW1C bits
> [    6.482485] pci 0000:00:01.0: bridge configuration invalid ([bus 00-00]), reconfiguring
> [    6.482521] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> [    6.482576] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> [    6.482607] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> [    6.482635] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x6 may corrupt adjacent RW1C bits
> [    6.482794] pci 0000:01:00.0: [10de:128b] type 00 class 0x030000
> [    6.482931] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x00ffffff]
> [    6.482976] pci 0000:01:00.0: reg 0x14: [mem 0x00000000-0x07ffffff 64bit pref]
> [    6.483022] pci 0000:01:00.0: reg 0x1c: [mem 0x00000000-0x01ffffff 64bit pref]
> [    6.483056] pci 0000:01:00.0: reg 0x24: [io  0x0000-0x007f]
> [    6.483087] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
> [    6.483313] pci 0000:01:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5 GT/s x1 link at 0000:00:01.0 (capable of 32.000 Gb/s with 5 GT/s x8 link)
> [    6.483463] pci 0000:01:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
> [    6.483556] pci 0000:01:00.1: [10de:0e0f] type 00 class 0x040300
> [    6.483648] pci 0000:01:00.1: reg 0x10: [mem 0x00000000-0x00003fff]
> [    6.485344] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
> [    6.485368] pci_bus 0000:00: 1-byte config write to 0000:00:01.0 offset 0x1a may corrupt adjacent RW1C bits
> [    6.485411] pci 0000:00:01.0: BAR 15: assigned [mem 0x58000000-0x63ffffff 64bit pref]
> [    6.485431] pci 0000:00:01.0: BAR 14: assigned [mem 0x50800000-0x51ffffff]
> [    6.485448] pci 0000:00:01.0: BAR 13: assigned [io  0x1000-0x1fff]
> [    6.485471] pci 0000:01:00.0: BAR 1: assigned [mem 0x58000000-0x5fffffff 64bit pref]
> [    6.485510] pci 0000:01:00.0: BAR 3: assigned [mem 0x60000000-0x61ffffff 64bit pref]
> [    6.485547] pci 0000:01:00.0: BAR 0: assigned [mem 0x51000000-0x51ffffff]
> [    6.485569] pci 0000:01:00.0: BAR 6: assigned [mem 0x50800000-0x5087ffff pref]
> [    6.485588] pci 0000:01:00.1: BAR 0: assigned [mem 0x50880000-0x50883fff]
> [    6.485610] pci 0000:01:00.0: BAR 5: assigned [io  0x1000-0x107f]
> [    6.485631] pci 0000:00:01.0: PCI bridge to [bus 01]
> [    6.485648] pci 0000:00:01.0:   bridge window [io  0x1000-0x1fff]
> [    6.485668] pci 0000:00:01.0:   bridge window [mem 0x50800000-0x51ffffff]
> [    6.485691] pci 0000:00:01.0:   bridge window [mem 0x58000000-0x63ffffff 64bit pref]
> [    6.485760] pci 0000:00:01.0: nv_msi_ht_cap_quirk didn't locate host bridge
> [    6.485857] pcieport 0000:00:01.0: Adding to iommu group 5
> [    6.485930] pcieport 0000:00:01.0: enabling device (0000 -> 0003)
> [    6.486051] pcieport 0000:00:01.0: PME: Signaling with IRQ 40
> [    6.486378] pcieport 0000:00:01.0: AER: enabled with IRQ 40
> [    6.486714] pci 0000:01:00.1: D0 power state depends on 0000:01:00.0

Hm, I can't say that I've ever seen that "2-byte config write" errors.
However it does appear to have assigned the BARs correctly, so there's
that.

> [   12.885866] nouveau 0000:01:00.0: Adding to iommu group 5
> [   12.891373] nouveau 0000:01:00.0: enabling device (0000 -> 0003)
> [   12.897619] nouveau 0000:01:00.0: NVIDIA GK208B (b060b0b1)
> [   13.086682] nouveau 0000:01:00.0: bios: version 80.28.a6.00.10
> [   13.288626] nouveau 0000:01:00.0: fb: 1024 MiB DDR3
> [   14.749542] [TTM] Zone  kernel: Available graphics memory: 3986272 KiB
> [   14.756096] [TTM] Zone   dma32: Available graphics memory: 2097152 KiB
> [   14.762626] [TTM] Initializing pool allocator
> [   14.766999] [TTM] Initializing DMA pool allocator
> [   14.771750] nouveau 0000:01:00.0: DRM: VRAM: 1024 MiB
> [   14.776808] nouveau 0000:01:00.0: DRM: GART: 1048576 MiB
> [   14.782147] nouveau 0000:01:00.0: DRM: TMDS table version 2.0
> [   14.787905] nouveau 0000:01:00.0: DRM: DCB version 4.0
> [   14.793053] nouveau 0000:01:00.0: DRM: DCB outp 00: 01000f02 00020030
> [   14.799504] nouveau 0000:01:00.0: DRM: DCB outp 01: 02011f62 00020010
> [   14.805948] nouveau 0000:01:00.0: DRM: DCB outp 02: 02022f10 00000000
> [   14.812393] nouveau 0000:01:00.0: DRM: DCB conn 00: 00001031
> [   14.818056] nouveau 0000:01:00.0: DRM: DCB conn 01: 00002161
> [   14.823724] nouveau 0000:01:00.0: DRM: DCB conn 02: 00000200
> [   14.831977] nouveau 0000:01:00.0: DRM: MM: using COPY for buffer copies
> [   14.841690] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
> [   14.848322] [drm] Driver supports precise vblank timestamp query.
> [   15.136647] nouveau 0000:01:00.0: DRM: allocated 1920x1080 fb: 0x80000, bo 00000000d53241e4
> [   17.146929] nouveau 0000:01:00.0: DRM: core notifier timeout
> [   19.146846] nouveau 0000:01:00.0: DRM: base-0: timeout
> [   19.147554] Console: switching to colour frame buffer device 240x67
> [   19.446311] nouveau 0000:01:00.0: DRM: GPU lockup - switching to software fbcon
> [   19.501043] nouveau 0000:01:00.0: fb0: nouveaudrmfb frame buffer device
> [   19.523471] [drm] Initialized nouveau 1.3.1 20120801 for 0000:01:00.0 on minor 0

So that "core notifier timeout" and subsequent GPU lockup indicate
that something's amiss. Most of the initialization was able to be
completed, including reading EDID from your monitor (hence the
non-default resolution), but we're not seeing values change properly /
missing notifications. I'm actually wondering if we aren't
initializing the GPU because we think it's already initialized. Could
you boot with nouveau.config=NvForcePost=1 and see if that helps?

  -ilia
_______________________________________________
Nouveau mailing list
Nouveau@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/nouveau

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Fwd:  GeForce(R) GT 710 1GB PCIE x 1 on arm64
       [not found]       ` <CAFCWPP+WmbjM0O2T9ODi-iVU1qGXjpk9V9LeE9PsuT7t+APLQA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  2020-05-06 14:26         ` Ilia Mirkin
@ 2020-05-06 14:28         ` Milan Buška
  1 sibling, 0 replies; 14+ messages in thread
From: Milan Buška @ 2020-05-06 14:28 UTC (permalink / raw)
  To: nouveau-PD4FTy7X32lNgt0PjOBp9y5qC8QIuHrW

---------- Forwarded message ---------
Od: Milan Buška <milan.buska@gmail.com>
Date: st 6. 5. 2020 v 16:15
Subject: Re: [Nouveau] GeForce(R) GT 710 1GB PCIE x 1 on arm64
To: Ilia Mirkin <imirkin@alum.mit.edu>


Here is:

# dmesg
[    0.000000] Booting Linux on physical CPU 0x0000000100 [0x411fd073]
[    0.000000] Linux version 5.6.10-zotac (root@saux) (gcc version
9.3.0 (SAUX Aarch64)) #1 SMP PREEMPT Tue May 5 22:16:40 CEST 2020
[    0.000000] Machine model: NVIDIA Jetson TX2 Developer Kit
[    0.000000] earlycon: uart8250 at MMIO32 0x0000000003100000 (options '')
[    0.000000] printk: bootconsole [uart8250] enabled
[    0.000000] efi: Getting EFI parameters from FDT:
[    0.000000] efi: UEFI not found.
[    0.000000] cma: Reserved 32 MiB at 0x00000000fe000000
[    0.000000] NUMA: No NUMA configuration found
[    0.000000] NUMA: Faking a node at [mem
0x0000000080000000-0x00000002771fffff]
[    0.000000] NUMA: NODE_DATA [mem 0x274e1d100-0x274e1efff]
[    0.000000] Zone ranges:
[    0.000000]   DMA      [mem 0x0000000080000000-0x00000000bfffffff]
[    0.000000]   DMA32    [mem 0x00000000c0000000-0x00000000ffffffff]
[    0.000000]   Normal   [mem 0x0000000100000000-0x00000002771fffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000080000000-0x00000000efffffff]
[    0.000000]   node   0: [mem 0x00000000f0200000-0x00000002757fffff]
[    0.000000]   node   0: [mem 0x0000000275e00000-0x0000000275ffffff]
[    0.000000]   node   0: [mem 0x0000000276600000-0x00000002767fffff]
[    0.000000]   node   0: [mem 0x0000000277000000-0x00000002771fffff]
[    0.000000] Initmem setup node 0 [mem 0x0000000080000000-0x00000002771fffff]
[    0.000000] On node 0 totalpages: 2055168
[    0.000000]   DMA zone: 4096 pages used for memmap
[    0.000000]   DMA zone: 0 pages reserved
[    0.000000]   DMA zone: 262144 pages, LIFO batch:63
[    0.000000]   DMA32 zone: 4096 pages used for memmap
[    0.000000]   DMA32 zone: 261632 pages, LIFO batch:63
[    0.000000]   Normal zone: 24008 pages used for memmap
[    0.000000]   Normal zone: 1531392 pages, LIFO batch:63
[    0.000000] psci: probing for conduit method from DT.
[    0.000000] psci: PSCIv1.0 detected in firmware.
[    0.000000] psci: Using standard PSCI v0.2 function IDs
[    0.000000] psci: MIGRATE_INFO_TYPE not supported.
[    0.000000] psci: SMC Calling Convention v1.1
[    0.000000] percpu: Embedded 23 pages/cpu s53272 r8192 d32744 u94208
[    0.000000] pcpu-alloc: s53272 r8192 d32744 u94208 alloc=23*4096
[    0.000000] pcpu-alloc: [0] 0 [0] 1 [0] 2 [0] 3 [0] 4 [0] 5
[    0.000000] Detected PIPT I-cache on CPU0
[    0.000000] CPU features: detected: EL2 vector hardening
[    0.000000] Speculative Store Bypass Disable mitigation not required
[    0.000000] CPU features: detected: ARM erratum 1319367
[    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 2022968
[    0.000000] Policy zone: Normal
[    0.000000] Kernel command line: root=/dev/mmcblk2p1 rw rootwait
rootfstype=ext4 console=ttyS0,115200n8 console=tty0
no_console_suspend=1 earlycon=uart8250,mmio32,0x3100000 video=nouveau
[    0.000000] Dentry cache hash table entries: 1048576 (order: 11,
8388608 bytes, linear)
[    0.000000] Inode-cache hash table entries: 524288 (order: 10,
4194304 bytes, linear)
[    0.000000] mem auto-init: stack:off, heap alloc:off, heap free:off
[    0.000000] software IO TLB: mapped [mem 0xbbfff000-0xbffff000] (64MB)
[    0.000000] Memory: 7934464K/8220672K available (12348K kernel
code, 1968K rwdata, 7104K rodata, 5312K init, 462K bss, 253440K
reserved, 32768K cma-reserved)
[    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=6, Nodes=1
[    0.000000] rcu: Preemptible hierarchical RCU implementation.
[    0.000000] rcu:     RCU event tracing is enabled.
[    0.000000] rcu:     RCU restricting CPUs from NR_CPUS=256 to nr_cpu_ids=6.
[    0.000000]  Tasks RCU enabled.
[    0.000000] rcu: RCU calculated value of scheduler-enlistment delay
is 25 jiffies.
[    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=6
[    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0
[    0.000000] GIC: Using split EOI/Deactivate mode
[    0.000000] random: get_random_bytes called from
start_kernel+0x2a8/0x434 with crng_init=0
[    0.000000] arch_timer: cp15 timer(s) running at 31.25MHz (phys).
[    0.000000] clocksource: arch_sys_counter: mask: 0xffffffffffffff
max_cycles: 0xe6a171046, max_idle_ns: 881590405314 ns
[    0.000002] sched_clock: 56 bits at 31MHz, resolution 32ns, wraps
every 4398046511088ns
[    0.008440] Console: colour dummy device 80x25
[    0.013065] printk: console [tty0] enabled
[    0.017328] printk: bootconsole [uart8250] disabled
[    0.022452] Calibrating delay loop (skipped), value calculated
using timer frequency.. 62.50 BogoMIPS (lpj=125000)
[    0.022464] pid_max: default: 32768 minimum: 301
[    0.022516] LSM: Security Framework initializing
[    0.022575] Mount-cache hash table entries: 16384 (order: 5, 131072
bytes, linear)
[    0.022609] Mountpoint-cache hash table entries: 16384 (order: 5,
131072 bytes, linear)
[    0.054464] rcu: Hierarchical SRCU implementation.
[    0.063372] Tegra Revision: A02 SKU: 220 CPU Process: 0 SoC Process: 0
[    0.063529] EFI services will not be available.
[    0.070490] smp: Bringing up secondary CPUs ...
[    0.103111] CPU features: detected: Kernel page table isolation (KPTI)
[    0.103142] Detected PIPT I-cache on CPU1
[    0.103154] CPU features: SANITY CHECK: Unexpected variation in
SYS_CTR_EL0. Boot CPU: 0x0000008444c004, CPU1: 0x0000009444c004
[    0.103164] CPU features: SANITY CHECK: Unexpected variation in
SYS_ID_AA64DFR0_EL1. Boot CPU: 0x00000010305106, CPU1:
0x00000010305116
[    0.103178] CPU features: SANITY CHECK: Unexpected variation in
SYS_ID_DFR0_EL1. Boot CPU: 0x00000003010066, CPU1: 0x00000003001066
[    0.103191] CPU features: Unsupported CPU feature variation detected.
[    0.103235] CPU1: Booted secondary processor 0x0000000000 [0x4e0f0030]
[    0.134851] Detected PIPT I-cache on CPU2
[    0.134863] CPU features: SANITY CHECK: Unexpected variation in
SYS_CTR_EL0. Boot CPU: 0x0000008444c004, CPU2: 0x0000009444c004
[    0.134872] CPU features: SANITY CHECK: Unexpected variation in
SYS_ID_AA64DFR0_EL1. Boot CPU: 0x00000010305106, CPU2:
0x00000010305116
[    0.134885] CPU features: SANITY CHECK: Unexpected variation in
SYS_ID_DFR0_EL1. Boot CPU: 0x00000003010066, CPU2: 0x00000003001066
[    0.134924] CPU2: Booted secondary processor 0x0000000001 [0x4e0f0030]
[    0.166768] Detected PIPT I-cache on CPU3
[    0.166798] CPU3: Booted secondary processor 0x0000000101 [0x411fd073]
[    0.198807] Detected PIPT I-cache on CPU4
[    0.198827] CPU4: Booted secondary processor 0x0000000102 [0x411fd073]
[    0.230850] Detected PIPT I-cache on CPU5
[    0.230869] CPU5: Booted secondary processor 0x0000000103 [0x411fd073]
[    0.230911] smp: Brought up 1 node, 6 CPUs
[    0.231002] SMP: Total of 6 processors activated.
[    0.231010] CPU features: detected: 32-bit EL0 Support
[    0.231017] CPU features: detected: CRC32 instructions
[    1.067178] CPU: All CPU(s) started at EL2
[    1.067221] alternatives: patching kernel code
[    1.068792] devtmpfs: initialized
[    1.071545] KASLR disabled due to lack of seed
[    1.071769] clocksource: jiffies: mask: 0xffffffff max_cycles:
0xffffffff, max_idle_ns: 7645041785100000 ns
[    1.071787] futex hash table entries: 2048 (order: 5, 131072 bytes, linear)
[    1.072319] pinctrl core: initialized pinctrl subsystem
[    1.073007] thermal_sys: Registered thermal governor 'step_wise'
[    1.073009] thermal_sys: Registered thermal governor 'power_allocator'
[    1.073345] DMI not present or invalid.
[    1.073677] NET: Registered protocol family 16
[    1.074497] DMA: preallocated 256 KiB pool for atomic allocations
[    1.074512] audit: initializing netlink subsys (disabled)
[    1.074605] audit: type=2000 audit(0.244:1): state=initialized
audit_enabled=0 res=1
[    1.075234] cpuidle: using governor menu
[    1.075428] hw-breakpoint: found 6 breakpoint and 4 watchpoint registers.
[    1.075577] ASID allocator initialised with 32768 entries
[    1.076232] Serial: AMBA PL011 UART driver
[    1.087732] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages
[    1.087746] HugeTLB registered 32.0 MiB page size, pre-allocated 0 pages
[    1.087755] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages
[    1.087762] HugeTLB registered 64.0 KiB page size, pre-allocated 0 pages
[    1.089126] cryptd: max_cpu_qlen set to 1000
[    1.091498] ACPI: Interpreter disabled.
[    1.092609] iommu: Default domain type: Translated
[    1.092734] vgaarb: loaded
[    1.092899] SCSI subsystem initialized
[    1.092996] libata version 3.00 loaded.
[    1.093103] usbcore: registered new interface driver usbfs
[    1.093129] usbcore: registered new interface driver hub
[    1.093186] usbcore: registered new device driver usb
[    1.093526] pps_core: LinuxPPS API ver. 1 registered
[    1.093534] pps_core: Software ver. 5.3.6 - Copyright 2005-2007
Rodolfo Giometti <giometti@linux.it>
[    1.093551] PTP clock support registered
[    1.093623] EDAC MC: Ver: 3.0.0
[    1.094308] FPGA manager framework
[    1.094352] Advanced Linux Sound Architecture Driver Initialized.
[    1.094815] clocksource: Switched to clocksource arch_sys_counter
[    1.094939] VFS: Disk quotas dquot_6.6.0
[    1.094981] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
[    1.095094] pnp: PnP ACPI: disabled
[    1.098416] NET: Registered protocol family 2
[    1.098643] tcp_listen_portaddr_hash hash table entries: 4096
(order: 4, 65536 bytes, linear)
[    1.098718] TCP established hash table entries: 65536 (order: 7,
524288 bytes, linear)
[    1.099055] TCP bind hash table entries: 65536 (order: 8, 1048576
bytes, linear)
[    1.099670] TCP: Hash tables configured (established 65536 bind 65536)
[    1.099762] UDP hash table entries: 4096 (order: 5, 131072 bytes, linear)
[    1.099890] UDP-Lite hash table entries: 4096 (order: 5, 131072
bytes, linear)
[    1.100095] NET: Registered protocol family 1
[    1.100351] RPC: Registered named UNIX socket transport module.
[    1.100360] RPC: Registered udp transport module.
[    1.100366] RPC: Registered tcp transport module.
[    1.100372] RPC: Registered tcp NFSv4.1 backchannel transport module.
[    1.100382] PCI: CLS 0 bytes, default 64
[    1.101384] kvm [1]: IPA Size Limit: 40bits
[    1.102945] kvm [1]: Hyp mode initialized successfully
[    1.114296] Initialise system trusted keyrings
[    1.114582] workingset: timestamp_bits=44 max_order=21 bucket_order=0
[    1.124805] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    1.125844] NFS: Registering the id_resolver key type
[    1.125884] Key type id_resolver registered
[    1.125903] Key type id_legacy registered
[    1.125927] nfs4filelayout_init: NFSv4 File Layout Driver Registering...
[    1.126150] 9p: Installing v9fs 9p2000 file system support
[    1.130588] Key type asymmetric registered
[    1.130634] Asymmetric key parser 'x509' registered
[    1.130688] Block layer SCSI generic (bsg) driver version 0.4
loaded (major 245)
[    1.130714] io scheduler mq-deadline registered
[    1.130732] io scheduler kyber registered
[    1.134117] tegra-xusb-padctl 3520000.padctl: failed to read
calibration fuse: -517
[    1.142583] EINJ: ACPI disabled.
[    1.155545] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled
[    1.157706] SuperH (H)SCI(F) driver initialized
[    1.158125] msm_serial: driver initialized
[    1.159812] arm-smmu 12000000.iommu: probing hardware configuration...
[    1.159841] arm-smmu 12000000.iommu: SMMUv2 with:
[    1.159863] arm-smmu 12000000.iommu:         stage 1 translation
[    1.159883] arm-smmu 12000000.iommu:         stage 2 translation
[    1.159903] arm-smmu 12000000.iommu:         nested translation
[    1.159925] arm-smmu 12000000.iommu:         stream matching with
128 register groups
[    1.159976] arm-smmu 12000000.iommu:         64 context banks (0
stage-2 only)
[    1.160003] arm-smmu 12000000.iommu:         Supported page sizes: 0x61311000
[    1.160026] arm-smmu 12000000.iommu:         Stage-1: 48-bit VA -> 48-bit IPA
[    1.160049] arm-smmu 12000000.iommu:         Stage-2: 48-bit IPA -> 48-bit PA
[    1.171037] loop: module loaded
[    1.174752] libphy: Fixed MDIO Bus: probed
[    1.175111] tun: Universal TUN/TAP device driver, 1.6
[    1.175800] thunder_xcv, ver 1.0
[    1.175868] thunder_bgx, ver 1.0
[    1.175924] nicpf, ver 1.0
[    1.176402] hclge is initializing
[    1.176609] hns3: Hisilicon Ethernet Network Driver for Hip08
Family - version
[    1.176643] hns3: Copyright (c) 2017 Huawei Corporation.
[    1.176725] e1000e: Intel(R) PRO/1000 Network Driver - 3.2.6-k
[    1.176752] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.
[    1.176828] igb: Intel(R) Gigabit Ethernet Network Driver - version 5.6.0-k
[    1.176877] igb: Copyright (c) 2007-2014 Intel Corporation.
[    1.176949] igbvf: Intel(R) Gigabit Virtual Function Network Driver
- version 2.4.0-k
[    1.176981] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.
[    1.177238] sky2: driver version 1.30
[    1.177886] VFIO - User Level meta-driver version: 0.3
[    1.179316] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver
[    1.179344] ehci-pci: EHCI PCI platform driver
[    1.179388] ehci-platform: EHCI generic platform driver
[    1.179496] ehci-orion: EHCI orion driver
[    1.179572] ehci-exynos: EHCI Exynos driver
[    1.179641] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver
[    1.179686] ohci-pci: OHCI PCI platform driver
[    1.179732] ohci-platform: OHCI generic platform driver
[    1.179838] ohci-exynos: OHCI Exynos driver
[    1.180268] tegra-xusb 3530000.usb: Adding to iommu group 0
[    1.180604] usbcore: registered new interface driver usb-storage
[    1.181852] mousedev: PS/2 mouse device common for all mice
[    1.183057] i2c /dev entries driver
[    1.186847] sdhci: Secure Digital Host Controller Interface driver
[    1.186879] sdhci: Copyright(c) Pierre Ossman
[    1.187193] Synopsys Designware Multimedia Card Interface Driver
[    1.187829] sdhci-pltfm: SDHCI platform and OF driver helper
[    1.188291] sdhci-tegra 3400000.sdhci: Adding to iommu group 1
[    1.188580] sdhci-tegra 3440000.sdhci: Adding to iommu group 2
[    1.189114] sdhci-tegra 3460000.sdhci: Adding to iommu group 3
[    1.190272] ledtrig-cpu: registered to indicate activity on CPUs
[    1.191435] usbcore: registered new interface driver usbhid
[    1.191466] usbhid: USB HID core driver
[    1.195987] NET: Registered protocol family 17
[    1.196237] 9pnet: Installing 9P2000 support
[    1.196331] Key type dns_resolver registered
[    1.196958] registered taskstats version 1
[    1.197002] Loading compiled-in X.509 certificates
[    1.197365] tegra-bpmp bpmp: Adding to iommu group 4
[    1.197843] tegra-bpmp bpmp: firmware: 69fa4e41a01fc02a4db1adf71922a54c
[    1.200370] max77620 0-003c: PMIC Version OTP:0x45 and ES:0x8
[    1.206359] max77620-sd0: supplied by VDD_5V0_SYS
[    1.206597] VDD_DDR_1V1_PMIC: Bringing 1125000uV into 1100000-1100000uV
[    1.208955] max77620-sd1: supplied by VDD_5V0_SYS
[    1.209990] max77620-sd2: supplied by VDD_5V0_SYS
[    1.211092] max77620-sd3: supplied by VDD_5V0_SYS
[    1.212334] max77620-ldo0: supplied by VDD_5V0_SYS
[    1.212727] max77620-ldo1: supplied by VDD_5V0_SYS
[    1.213790] max77620-ldo2: supplied by VDD_5V0_SYS
[    1.215193] max77620-ldo3: supplied by VDD_5V0_SYS
[    1.216133] max77620-ldo4: supplied by VDD_1V8
[    1.216209] VDD_RTC: Bringing 800000uV into 1000000-1000000uV
[    1.217241] max77620-ldo5: supplied by VDD_5V0_SYS
[    1.217327] VDDIO_SDMMC3_AP: Bringing 1800000uV into 2800000-2800000uV
[    1.218181] max77620-ldo6: supplied by VDD_1V8
[    1.219254] max77620-ldo7: supplied by AVDD_DSI_CSI_1V2
[    1.219334] VDD_HDMI_1V05: Bringing 1000000uV into 1050000-1050000uV
[    1.220272] max77620-ldo8: supplied by AVDD_DSI_CSI_1V2
[    1.220337] VDD_PEX_1V05: Bringing 1000000uV into 1050000-1050000uV
[    2.396019] max77686-rtc max77620-rtc: registered as rtc0
[    2.411115] random: fast init done
[    3.664208] random: crng init done
[    3.959266] VDD_1V8_AP: supplied by VDD_1V8
[    3.962047] tegra-xusb-padctl 3520000.padctl: failed to read
calibration fuse: -517
[    3.965934] tegra-pcie 10003000.pcie: Adding to iommu group 5
[    3.966435] tegra-pcie 10003000.pcie: 4x1, 1x1 configuration
[    3.968057] tegra-pcie 10003000.pcie: probing port 0, using 4 lanes
[    3.970121] tegra-pcie 10003000.pcie: probing port 1, using 0 lanes
[    3.972183] tegra-pcie 10003000.pcie: probing port 2, using 1 lanes
[    5.260316] tegra-pcie 10003000.pcie: link 1 down, ignoring
[    6.479410] tegra-pcie 10003000.pcie: link 2 down, ignoring
[    6.479579] tegra-pcie 10003000.pcie: PCI host bridge to bus 0000:00
[    6.479602] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
[    6.479627] pci_bus 0000:00: root bus resource [mem 0x50100000-0x57ffffff]
[    6.479646] pci_bus 0000:00: root bus resource [mem
0x58000000-0x7fffffff pref]
[    6.479668] pci_bus 0000:00: root bus resource [bus 00-ff]
[    6.479850] pci 0000:00:01.0: [10de:10e5] type 01 class 0x060400
[    6.479887] pci_bus 0000:00: 2-byte config write to 0000:00:01.0
offset 0x4 may corrupt adjacent RW1C bits
[    6.479916] pci_bus 0000:00: 2-byte config write to 0000:00:01.0
offset 0x4 may corrupt adjacent RW1C bits
[    6.479993] pci_bus 0000:00: 2-byte config write to 0000:00:01.0
offset 0x3e may corrupt adjacent RW1C bits
[    6.480041] pci_bus 0000:00: 2-byte config write to 0000:00:01.0
offset 0x52 may corrupt adjacent RW1C bits
[    6.480118] pci 0000:00:01.0: PME# supported from D0 D1 D2 D3hot D3cold
[    6.480141] pci_bus 0000:00: 2-byte config write to 0000:00:01.0
offset 0x4c may corrupt adjacent RW1C bits
[    6.482485] pci 0000:00:01.0: bridge configuration invalid ([bus
00-00]), reconfiguring
[    6.482521] pci_bus 0000:00: 2-byte config write to 0000:00:01.0
offset 0x3e may corrupt adjacent RW1C bits
[    6.482576] pci_bus 0000:00: 2-byte config write to 0000:00:01.0
offset 0x3e may corrupt adjacent RW1C bits
[    6.482607] pci_bus 0000:00: 2-byte config write to 0000:00:01.0
offset 0x3e may corrupt adjacent RW1C bits
[    6.482635] pci_bus 0000:00: 2-byte config write to 0000:00:01.0
offset 0x6 may corrupt adjacent RW1C bits
[    6.482794] pci 0000:01:00.0: [10de:128b] type 00 class 0x030000
[    6.482931] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x00ffffff]
[    6.482976] pci 0000:01:00.0: reg 0x14: [mem 0x00000000-0x07ffffff
64bit pref]
[    6.483022] pci 0000:01:00.0: reg 0x1c: [mem 0x00000000-0x01ffffff
64bit pref]
[    6.483056] pci 0000:01:00.0: reg 0x24: [io  0x0000-0x007f]
[    6.483087] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
[    6.483313] pci 0000:01:00.0: 4.000 Gb/s available PCIe bandwidth,
limited by 5 GT/s x1 link at 0000:00:01.0 (capable of 32.000 Gb/s with
5 GT/s x8 link)
[    6.483463] pci 0000:01:00.0: vgaarb: VGA device added:
decodes=io+mem,owns=none,locks=none
[    6.483556] pci 0000:01:00.1: [10de:0e0f] type 00 class 0x040300
[    6.483648] pci 0000:01:00.1: reg 0x10: [mem 0x00000000-0x00003fff]
[    6.485344] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
[    6.485368] pci_bus 0000:00: 1-byte config write to 0000:00:01.0
offset 0x1a may corrupt adjacent RW1C bits
[    6.485411] pci 0000:00:01.0: BAR 15: assigned [mem
0x58000000-0x63ffffff 64bit pref]
[    6.485431] pci 0000:00:01.0: BAR 14: assigned [mem 0x50800000-0x51ffffff]
[    6.485448] pci 0000:00:01.0: BAR 13: assigned [io  0x1000-0x1fff]
[    6.485471] pci 0000:01:00.0: BAR 1: assigned [mem
0x58000000-0x5fffffff 64bit pref]
[    6.485510] pci 0000:01:00.0: BAR 3: assigned [mem
0x60000000-0x61ffffff 64bit pref]
[    6.485547] pci 0000:01:00.0: BAR 0: assigned [mem 0x51000000-0x51ffffff]
[    6.485569] pci 0000:01:00.0: BAR 6: assigned [mem
0x50800000-0x5087ffff pref]
[    6.485588] pci 0000:01:00.1: BAR 0: assigned [mem 0x50880000-0x50883fff]
[    6.485610] pci 0000:01:00.0: BAR 5: assigned [io  0x1000-0x107f]
[    6.485631] pci 0000:00:01.0: PCI bridge to [bus 01]
[    6.485648] pci 0000:00:01.0:   bridge window [io  0x1000-0x1fff]
[    6.485668] pci 0000:00:01.0:   bridge window [mem 0x50800000-0x51ffffff]
[    6.485691] pci 0000:00:01.0:   bridge window [mem
0x58000000-0x63ffffff 64bit pref]
[    6.485760] pci 0000:00:01.0: nv_msi_ht_cap_quirk didn't locate host bridge
[    6.485857] pcieport 0000:00:01.0: Adding to iommu group 5
[    6.485930] pcieport 0000:00:01.0: enabling device (0000 -> 0003)
[    6.486051] pcieport 0000:00:01.0: PME: Signaling with IRQ 40
[    6.486378] pcieport 0000:00:01.0: AER: enabled with IRQ 40
[    6.486714] pci 0000:01:00.1: D0 power state depends on 0000:01:00.0
[    6.488429] printk: console [ttyS0] disabled
[    6.488494] 3100000.serial: ttyS0 at MMIO 0x3100000 (irq = 23,
base_baud = 25500000) is a Tegra
[    8.274504] printk: console [ttyS0] enabled
[    8.280831] tegra_rtc c2a0000.rtc: registered as rtc1
[    8.285923] tegra_rtc c2a0000.rtc: Tegra internal Real Time Clock
[    8.310453] sdhci-tegra 3400000.sdhci: Got CD GPIO
[    8.315311] sdhci-tegra 3400000.sdhci: Got WP GPIO
[    8.373916] mmc0: SDHCI controller on 3440000.sdhci [3440000.sdhci]
using ADMA 64-bit
[    8.390274] mmc1: CQHCI version 5.10
[    8.421160] mmc1: SDHCI controller on 3460000.sdhci [3460000.sdhci]
using ADMA 64-bit
[    8.429306] SD_CARD_SW_PWR: supplied by VDD_3V3_SYS
[    8.436338] VDD_HDMI_5V0: supplied by VDD_5V0_SYS
[    8.441647] VDD_USB0: supplied by VDD_5V0_SYS
[    8.446328] VDD_USB1: supplied by VDD_5V0_SYS
[    8.452028]  usb3-0: usb3-0 supply vbus not found, using dummy regulator
[    8.465559] tegra-xusb 3530000.usb: Firmware timestamp: 2019-07-08
19:32:42 UTC
[    8.473136] tegra-xusb 3530000.usb: xHCI Host Controller
[    8.478628] tegra-xusb 3530000.usb: new USB bus registered,
assigned bus number 1
[    8.487255] tegra-xusb 3530000.usb: hcc params 0x0184fd25 hci
version 0x100 quirks 0x0000000000010010
[    8.496685] tegra-xusb 3530000.usb: irq 33, io mem 0x03530000
[    8.503386] hub 1-0:1.0: USB hub found
[    8.507405] hub 1-0:1.0: 4 ports detected
[    8.511897] tegra-xusb 3530000.usb: xHCI Host Controller
[    8.517417] tegra-xusb 3530000.usb: new USB bus registered,
assigned bus number 2
[    8.525069] tegra-xusb 3530000.usb: Host supports USB 3.0 SuperSpeed
[    8.531671] usb usb2: We don't know the algorithms for LPM for this
host, disabling LPM.
[    8.541006] hub 2-0:1.0: USB hub found
[    8.545647] hub 2-0:1.0: 3 ports detected
[    8.551861] sdhci-tegra 3400000.sdhci: Got CD GPIO
[    8.556926] sdhci-tegra 3400000.sdhci: Got WP GPIO
[    8.602946] mmc2: SDHCI controller on 3400000.sdhci [3400000.sdhci]
using ADMA 64-bit
[    8.613332] input: gpio-keys as /devices/platform/gpio-keys/input/input0
[    8.650221] mmc1: Command Queue Engine enabled
[    8.654676] max77686-rtc max77620-rtc: setting system clock to
2000-01-02T01:56:45 UTC (946778205)
[    8.663700] mmc1: new HS400 MMC card at address 0001
[    8.669069] mmcblk1: mmc1:0001 032G34 29.1 GiB
[    8.670182] ALSA device list:
[    8.673798] mmcblk1boot0: mmc1:0001 032G34 partition 1 4.00 MiB
[    8.676572]   No soundcards found.
[    8.686655] mmcblk1boot1: mmc1:0001 032G34 partition 2 4.00 MiB
[    8.693651] mmcblk1rpmb: mmc1:0001 032G34 partition 3 4.00 MiB,
chardev (235:0)
[    8.704320]  mmcblk1: p1 p2 p3 p4 p5 p6 p7 p8 p9 p10 p11 p12 p13
p14 p15 p16 p17 p18 p19 p20 p21 p22 p23 p24 p25 p26 p27 p28 p29
[    8.723772] Waiting for root device /dev/mmcblk2p1...
[    8.850853] usb 1-2: new high-speed USB device number 2 using tegra-xusb
[    8.928906] mmc2: new ultra high speed SDR104 SDHC card at address 0001
[    8.935898] mmcblk2: mmc2:0001 SD32G 29.0 GiB
[    8.948924]  mmcblk2: p1 p2
[    9.018797] hub 1-2:1.0: USB hub found
[    9.023150] hub 1-2:1.0: 4 ports detected
[    9.139364] usb 2-1: new SuperSpeed Gen 1 USB device number 2 using
tegra-xusb
[    9.176816] hub 2-1:1.0: USB hub found
[    9.181354] hub 2-1:1.0: 4 ports detected
[    9.300221] EXT4-fs (mmcblk2p1): recovery complete
[    9.308115] EXT4-fs (mmcblk2p1): mounted filesystem with ordered
data mode. Opts: (null)
[    9.314844] usb 1-2.1: new full-speed USB device number 3 using tegra-xusb
[    9.316224] VFS: Mounted root (ext4 filesystem) on device 179:97.
[    9.333279] devtmpfs: mounted
[    9.337465] Freeing unused kernel memory: 5312K
[    9.342075] Run /sbin/init as init process
[    9.346166]   with arguments:
[    9.346167]     /sbin/init
[    9.346168]   with environment:
[    9.346170]     HOME=/
[    9.346171]     TERM=linux
[    9.429475] input: 2.4G Mouse as
/devices/platform/3530000.usb/usb1/1-2/1-2.1/1-2.1:1.0/0003:1EA7:0064.0001/input/input1
[    9.440583] input: 2.4G Mouse as
/devices/platform/3530000.usb/usb1/1-2/1-2.1/1-2.1:1.0/0003:1EA7:0064.0001/input/input2
[    9.451600] hid-generic 0003:1EA7:0064.0001: input: USB HID v1.10
Mouse [2.4G Mouse] on usb-3530000.usb-2.1/input0
[    9.542846] usb 1-2.2: new low-speed USB device number 4 using tegra-xusb
[    9.549748] udevd[218]: starting version 3.2.9
[    9.613608] udevd[219]: starting eudev-3.2.9
[    9.666365] input: USB USB Keyboard as
/devices/platform/3530000.usb/usb1/1-2/1-2.2/1-2.2:1.0/0003:1A2C:2C27.0002/input/input3
[    9.735146] hid-generic 0003:1A2C:2C27.0002: input: USB HID v1.10
Keyboard [USB USB Keyboard] on usb-3530000.usb-2.2/input0
[    9.750489] input: USB USB Keyboard Consumer Control as
/devices/platform/3530000.usb/usb1/1-2/1-2.2/1-2.2:1.1/0003:1A2C:2C27.0003/input/input4
[    9.823088] input: USB USB Keyboard System Control as
/devices/platform/3530000.usb/usb1/1-2/1-2.2/1-2.2:1.1/0003:1A2C:2C27.0003/input/input5
[    9.836014] hid-generic 0003:1A2C:2C27.0003: input: USB HID v1.10
Device [USB USB Keyboard] on usb-3530000.usb-2.2/input1
[    9.898044] tegra-hda 3510000.hda: Adding to iommu group 6
[    9.963273] input: jetson-tx2-hda HDMI/DP,pcm=3 as
/devices/platform/3510000.hda/sound/card0/input6
[    9.973149] input: jetson-tx2-hda HDMI/DP,pcm=7 as
/devices/platform/3510000.hda/sound/card0/input7
[   10.117602] dwc-eth-dwmac 2490000.ethernet: Adding to iommu group 7
[   10.124019] dwc-eth-dwmac 2490000.ethernet: no reset control found
[   10.143356] dwc-eth-dwmac 2490000.ethernet: User ID: 0x10, Synopsys ID: 0x41
[   10.150406] dwc-eth-dwmac 2490000.ethernet:  DWMAC4/5
[   10.155457] dwc-eth-dwmac 2490000.ethernet: DMA HW capability
register supported
[   10.162843] dwc-eth-dwmac 2490000.ethernet: RX Checksum Offload
Engine supported
[   10.170228] dwc-eth-dwmac 2490000.ethernet: TX Checksum insertion supported
[   10.177179] dwc-eth-dwmac 2490000.ethernet: Wake-Up On Lan supported
[   10.183541] dwc-eth-dwmac 2490000.ethernet: TSO supported
[   10.188935] dwc-eth-dwmac 2490000.ethernet: Enable RX Mitigation
via HW Watchdog Timer
[   10.196842] dwc-eth-dwmac 2490000.ethernet: Enabled Flow TC (entries=8)
[   10.203448] dwc-eth-dwmac 2490000.ethernet: TSO feature enabled
[   10.209360] dwc-eth-dwmac 2490000.ethernet: SPH feature enabled
[   10.215271] dwc-eth-dwmac 2490000.ethernet: Using 40 bits DMA width
[   10.221708] libphy: stmmac: probed
[   12.885866] nouveau 0000:01:00.0: Adding to iommu group 5
[   12.891373] nouveau 0000:01:00.0: enabling device (0000 -> 0003)
[   12.897619] nouveau 0000:01:00.0: NVIDIA GK208B (b060b0b1)
[   13.086682] nouveau 0000:01:00.0: bios: version 80.28.a6.00.10
[   13.288626] nouveau 0000:01:00.0: fb: 1024 MiB DDR3
[   14.749542] [TTM] Zone  kernel: Available graphics memory: 3986272 KiB
[   14.756096] [TTM] Zone   dma32: Available graphics memory: 2097152 KiB
[   14.762626] [TTM] Initializing pool allocator
[   14.766999] [TTM] Initializing DMA pool allocator
[   14.771750] nouveau 0000:01:00.0: DRM: VRAM: 1024 MiB
[   14.776808] nouveau 0000:01:00.0: DRM: GART: 1048576 MiB
[   14.782147] nouveau 0000:01:00.0: DRM: TMDS table version 2.0
[   14.787905] nouveau 0000:01:00.0: DRM: DCB version 4.0
[   14.793053] nouveau 0000:01:00.0: DRM: DCB outp 00: 01000f02 00020030
[   14.799504] nouveau 0000:01:00.0: DRM: DCB outp 01: 02011f62 00020010
[   14.805948] nouveau 0000:01:00.0: DRM: DCB outp 02: 02022f10 00000000
[   14.812393] nouveau 0000:01:00.0: DRM: DCB conn 00: 00001031
[   14.818056] nouveau 0000:01:00.0: DRM: DCB conn 01: 00002161
[   14.823724] nouveau 0000:01:00.0: DRM: DCB conn 02: 00000200
[   14.831977] nouveau 0000:01:00.0: DRM: MM: using COPY for buffer copies
[   14.841690] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
[   14.848322] [drm] Driver supports precise vblank timestamp query.
[   15.136647] nouveau 0000:01:00.0: DRM: allocated 1920x1080 fb:
0x80000, bo 00000000d53241e4
[   17.146929] nouveau 0000:01:00.0: DRM: core notifier timeout
[   19.146846] nouveau 0000:01:00.0: DRM: base-0: timeout
[   19.147554] Console: switching to colour frame buffer device 240x67
[   19.446311] nouveau 0000:01:00.0: DRM: GPU lockup - switching to
software fbcon
[   19.501043] nouveau 0000:01:00.0: fb0: nouveaudrmfb frame buffer device
[   19.523471] [drm] Initialized nouveau 1.3.1 20120801 for
0000:01:00.0 on minor 0
[   19.666266] EXT4-fs (mmcblk2p1): re-mounted. Opts: discard
[   19.692357] EXT4-fs (mmcblk2p1): re-mounted. Opts: discard
[   19.742824] Adding 4160488k swap on /dev/mmcblk2p2.  Priority:-2
extents:1 across:4160488k SS
[   19.799112] CPU1: shutdown
[   19.801921] psci: CPU1 killed (polled 0 ms)
[   19.835071] CPU2: shutdown
[   19.837876] psci: CPU2 killed (polled 0 ms)
[   28.550823] 8021q: 802.1Q VLAN Support v1.8
[   28.731099] cfg80211: Loading compiled-in X.509 certificates for
regulatory database
[   28.734427] cfg80211: Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'
[   28.741182] platform regulatory.0: Direct firmware load for
regulatory.db failed with error -2
[   28.741186] platform regulatory.0: Falling back to sysfs fallback
for: regulatory.db
[   28.741659] cfg80211: failed to load regulatory.db
[   28.811574] dwc-eth-dwmac 2490000.ethernet eth0: PHY [stmmac-0:00]
driver [Generic PHY] (irq=POLL)
[   28.813147] dwmac4: Master AXI performs any burst length
[   28.813175] dwc-eth-dwmac 2490000.ethernet eth0: No Safety Features
support found
[   28.813288] dwc-eth-dwmac 2490000.ethernet eth0: IEEE 1588-2008
Advanced Timestamp supported
[   28.813395] dwc-eth-dwmac 2490000.ethernet eth0: registered PTP clock
[   28.813422] dwc-eth-dwmac 2490000.ethernet eth0: configuring for
phy/rgmii link mode
[   28.814189] 8021q: adding VLAN 0 to HW filter on device eth0
[   33.917866] dwc-eth-dwmac 2490000.ethernet eth0: Link is Up -
1Gbps/Full - flow control rx/tx
[   34.063886] NET: Registered protocol family 10
[   34.064952] Segment Routing with IPv6
[   38.682841] VDD_RTC: disabling
[   38.682847] VDDIO_SDMMC3_AP: disabling
[   38.683022] VDD_HDMI_1V05: disabling
[   38.683027] VDD_HDMI_5V0: disabling
[   38.683029] VDD_USB0: disabling

st 6. 5. 2020 v 16:00 odesílatel Ilia Mirkin <imirkin@alum.mit.edu> napsal:
>
> In general it should be possible. If you're having issues, please include dmesg.
>
> One issue that has come up is that the PCIe controllers on such boards
> have very narrow memory windows, not enough to map certain (required)
> BARs of NVIDIA GPUs (or other GPUs, I'd expect). This comes up in
> dmesg with PCI-related errors.
>
> Cheers,
>
>   -ilia
>
> On Wed, May 6, 2020 at 9:53 AM Milan Buška <milan.buska@gmail.com> wrote:
> >
> > Hi to all.
> > I'm experimenting with running a https://www.zotac.com/us/product/graphics_card/geforce%C2%AE-gt-710-1gb-pcie-x-1 card on an Nvidia Jetson TX2 arm64 device.
> > Possible?
> > Linux kernel aarch64 5.6.10.
> > Because Nvidia did not list drivers for this architecture, I'm experimenting with a nouveau driver.
> > The Jetson TX2 has a default driver for the host1x framebuffer for output from the board via HDMI.
> > I changed the video kernel parameter to nouveau. Booting the system OK only there is no output on the monitor.
> > The device can only be controlled via the serial console.
> > Can anyone advise me where to start setting up - (if something needs to be set up)
> >
> > Greeting
> >
> > Milan Buška
> >
> > --
> >
> > Remember, no question is too stupid and no problem too small
> >        -- We've all been beginners
> > _______________________________________________
> > Nouveau mailing list
> > Nouveau@lists.freedesktop.org
> > https://lists.freedesktop.org/mailman/listinfo/nouveau



-- 

Remember, no question is too stupid and no problem too small
       -- We've all been beginners


-- 

Remember, no question is too stupid and no problem too small
       -- We've all been beginners
_______________________________________________
Nouveau mailing list
Nouveau@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/nouveau

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: GeForce(R) GT 710 1GB PCIE x 1 on arm64
       [not found]           ` <CAKb7Uvj6nMk2U6MD-iMXEWQzc4ok2xxuq7K3C8ti6mfFDqhuDw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2020-05-06 14:38             ` Lucas Stach
       [not found]               ` <e681b4315b596dca39bb4a28866d509e23a150c1.camel-8ppwABl0HbeELgA04lAiVw@public.gmane.org>
  0 siblings, 1 reply; 14+ messages in thread
From: Lucas Stach @ 2020-05-06 14:38 UTC (permalink / raw)
  To: Ilia Mirkin, Milan Buška; +Cc: nouveau

Am Mittwoch, den 06.05.2020, 10:26 -0400 schrieb Ilia Mirkin:
> [please keep list cc'd in your replies]
> 
> On Wed, May 6, 2020 at 10:15 AM Milan Buška <milan.buska@gmail.com> wrote:
> > [    0.000000] Linux version 5.6.10-zotac (root@saux) (gcc version 9.3.0 (SAUX Aarch64)) #1 SMP PREEMPT Tue May 5 22:16:40 CEST 2020
> > [    0.000000] Machine model: NVIDIA Jetson TX2 Developer Kit
> 
> [...]
> 
> > [    3.965934] tegra-pcie 10003000.pcie: Adding to iommu group 5
> > [    3.966435] tegra-pcie 10003000.pcie: 4x1, 1x1 configuration
> > [    3.968057] tegra-pcie 10003000.pcie: probing port 0, using 4 lanes
> > [    3.970121] tegra-pcie 10003000.pcie: probing port 1, using 0 lanes
> > [    3.972183] tegra-pcie 10003000.pcie: probing port 2, using 1 lanes
> > [    5.260316] tegra-pcie 10003000.pcie: link 1 down, ignoring
> > [    6.479410] tegra-pcie 10003000.pcie: link 2 down, ignoring
> > [    6.479579] tegra-pcie 10003000.pcie: PCI host bridge to bus 0000:00
> > [    6.479602] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
> > [    6.479627] pci_bus 0000:00: root bus resource [mem 0x50100000-0x57ffffff]
> > [    6.479646] pci_bus 0000:00: root bus resource [mem 0x58000000-0x7fffffff pref]
> > [    6.479668] pci_bus 0000:00: root bus resource [bus 00-ff]
> > [    6.479850] pci 0000:00:01.0: [10de:10e5] type 01 class 0x060400
> > [    6.479887] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4 may corrupt adjacent RW1C bits
> > [    6.479916] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4 may corrupt adjacent RW1C bits
> > [    6.479993] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > [    6.480041] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x52 may corrupt adjacent RW1C bits
> > [    6.480118] pci 0000:00:01.0: PME# supported from D0 D1 D2 D3hot D3cold
> > [    6.480141] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4c may corrupt adjacent RW1C bits
> > [    6.482485] pci 0000:00:01.0: bridge configuration invalid ([bus 00-00]), reconfiguring
> > [    6.482521] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > [    6.482576] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > [    6.482607] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > [    6.482635] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x6 may corrupt adjacent RW1C bits
> > [    6.482794] pci 0000:01:00.0: [10de:128b] type 00 class 0x030000
> > [    6.482931] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x00ffffff]
> > [    6.482976] pci 0000:01:00.0: reg 0x14: [mem 0x00000000-0x07ffffff 64bit pref]
> > [    6.483022] pci 0000:01:00.0: reg 0x1c: [mem 0x00000000-0x01ffffff 64bit pref]
> > [    6.483056] pci 0000:01:00.0: reg 0x24: [io  0x0000-0x007f]
> > [    6.483087] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
> > [    6.483313] pci 0000:01:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5 GT/s x1 link at 0000:00:01.0 (capable of 32.000 Gb/s with 5 GT/s x8 link)
> > [    6.483463] pci 0000:01:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
> > [    6.483556] pci 0000:01:00.1: [10de:0e0f] type 00 class 0x040300
> > [    6.483648] pci 0000:01:00.1: reg 0x10: [mem 0x00000000-0x00003fff]
> > [    6.485344] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
> > [    6.485368] pci_bus 0000:00: 1-byte config write to 0000:00:01.0 offset 0x1a may corrupt adjacent RW1C bits
> > [    6.485411] pci 0000:00:01.0: BAR 15: assigned [mem 0x58000000-0x63ffffff 64bit pref]
> > [    6.485431] pci 0000:00:01.0: BAR 14: assigned [mem 0x50800000-0x51ffffff]
> > [    6.485448] pci 0000:00:01.0: BAR 13: assigned [io  0x1000-0x1fff]
> > [    6.485471] pci 0000:01:00.0: BAR 1: assigned [mem 0x58000000-0x5fffffff 64bit pref]
> > [    6.485510] pci 0000:01:00.0: BAR 3: assigned [mem 0x60000000-0x61ffffff 64bit pref]
> > [    6.485547] pci 0000:01:00.0: BAR 0: assigned [mem 0x51000000-0x51ffffff]
> > [    6.485569] pci 0000:01:00.0: BAR 6: assigned [mem 0x50800000-0x5087ffff pref]
> > [    6.485588] pci 0000:01:00.1: BAR 0: assigned [mem 0x50880000-0x50883fff]
> > [    6.485610] pci 0000:01:00.0: BAR 5: assigned [io  0x1000-0x107f]
> > [    6.485631] pci 0000:00:01.0: PCI bridge to [bus 01]
> > [    6.485648] pci 0000:00:01.0:   bridge window [io  0x1000-0x1fff]
> > [    6.485668] pci 0000:00:01.0:   bridge window [mem 0x50800000-0x51ffffff]
> > [    6.485691] pci 0000:00:01.0:   bridge window [mem 0x58000000-0x63ffffff 64bit pref]
> > [    6.485760] pci 0000:00:01.0: nv_msi_ht_cap_quirk didn't locate host bridge
> > [    6.485857] pcieport 0000:00:01.0: Adding to iommu group 5
> > [    6.485930] pcieport 0000:00:01.0: enabling device (0000 -> 0003)
> > [    6.486051] pcieport 0000:00:01.0: PME: Signaling with IRQ 40
> > [    6.486378] pcieport 0000:00:01.0: AER: enabled with IRQ 40
> > [    6.486714] pci 0000:01:00.1: D0 power state depends on 0000:01:00.0
> 
> Hm, I can't say that I've ever seen that "2-byte config write" errors.
> However it does appear to have assigned the BARs correctly, so there's
> that.
> 
> > [   12.885866] nouveau 0000:01:00.0: Adding to iommu group 5
> > [   12.891373] nouveau 0000:01:00.0: enabling device (0000 -> 0003)
> > [   12.897619] nouveau 0000:01:00.0: NVIDIA GK208B (b060b0b1)
> > [   13.086682] nouveau 0000:01:00.0: bios: version 80.28.a6.00.10
> > [   13.288626] nouveau 0000:01:00.0: fb: 1024 MiB DDR3
> > [   14.749542] [TTM] Zone  kernel: Available graphics memory: 3986272 KiB
> > [   14.756096] [TTM] Zone   dma32: Available graphics memory: 2097152 KiB
> > [   14.762626] [TTM] Initializing pool allocator
> > [   14.766999] [TTM] Initializing DMA pool allocator
> > [   14.771750] nouveau 0000:01:00.0: DRM: VRAM: 1024 MiB
> > [   14.776808] nouveau 0000:01:00.0: DRM: GART: 1048576 MiB
> > [   14.782147] nouveau 0000:01:00.0: DRM: TMDS table version 2.0
> > [   14.787905] nouveau 0000:01:00.0: DRM: DCB version 4.0
> > [   14.793053] nouveau 0000:01:00.0: DRM: DCB outp 00: 01000f02 00020030
> > [   14.799504] nouveau 0000:01:00.0: DRM: DCB outp 01: 02011f62 00020010
> > [   14.805948] nouveau 0000:01:00.0: DRM: DCB outp 02: 02022f10 00000000
> > [   14.812393] nouveau 0000:01:00.0: DRM: DCB conn 00: 00001031
> > [   14.818056] nouveau 0000:01:00.0: DRM: DCB conn 01: 00002161
> > [   14.823724] nouveau 0000:01:00.0: DRM: DCB conn 02: 00000200
> > [   14.831977] nouveau 0000:01:00.0: DRM: MM: using COPY for buffer copies
> > [   14.841690] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
> > [   14.848322] [drm] Driver supports precise vblank timestamp query.
> > [   15.136647] nouveau 0000:01:00.0: DRM: allocated 1920x1080 fb: 0x80000, bo 00000000d53241e4
> > [   17.146929] nouveau 0000:01:00.0: DRM: core notifier timeout
> > [   19.146846] nouveau 0000:01:00.0: DRM: base-0: timeout
> > [   19.147554] Console: switching to colour frame buffer device 240x67
> > [   19.446311] nouveau 0000:01:00.0: DRM: GPU lockup - switching to software fbcon
> > [   19.501043] nouveau 0000:01:00.0: fb0: nouveaudrmfb frame buffer device
> > [   19.523471] [drm] Initialized nouveau 1.3.1 20120801 for 0000:01:00.0 on minor 0
> 
> So that "core notifier timeout" and subsequent GPU lockup indicate
> that something's amiss. Most of the initialization was able to be
> completed, including reading EDID from your monitor (hence the
> non-default resolution), but we're not seeing values change properly /
> missing notifications. I'm actually wondering if we aren't
> initializing the GPU because we think it's already initialized. Could
> you boot with nouveau.config=NvForcePost=1 and see if that helps?

Note that PCIe is non-coherent on most ARM devices (including Tegra TX2
IIRC), so if the notifier BO isn't mapped as uncached memory, you
probably won't see the expected notifier content, as you are reading
stale cache line content.

Regards,
Lucas

_______________________________________________
Nouveau mailing list
Nouveau@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/nouveau

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: GeForce(R) GT 710 1GB PCIE x 1 on arm64
       [not found]               ` <e681b4315b596dca39bb4a28866d509e23a150c1.camel-8ppwABl0HbeELgA04lAiVw@public.gmane.org>
@ 2020-05-06 14:42                 ` Ilia Mirkin
       [not found]                   ` <CAKb7Uvh8dvVTVbu15e2=7qb4dgoVbigrnjkYW6i7z5dsk4g3qQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  2020-05-06 15:34                 ` Milan Buška
  2020-05-08  8:34                 ` Milan Buška
  2 siblings, 1 reply; 14+ messages in thread
From: Ilia Mirkin @ 2020-05-06 14:42 UTC (permalink / raw)
  To: Lucas Stach; +Cc: nouveau

On Wed, May 6, 2020 at 10:39 AM Lucas Stach <dev@lynxeye.de> wrote:
>
> Am Mittwoch, den 06.05.2020, 10:26 -0400 schrieb Ilia Mirkin:
> > [please keep list cc'd in your replies]
> >
> > On Wed, May 6, 2020 at 10:15 AM Milan Buška <milan.buska@gmail.com> wrote:
> > > [    0.000000] Linux version 5.6.10-zotac (root@saux) (gcc version 9.3.0 (SAUX Aarch64)) #1 SMP PREEMPT Tue May 5 22:16:40 CEST 2020
> > > [    0.000000] Machine model: NVIDIA Jetson TX2 Developer Kit
> >
> > [...]
> >
> > > [    3.965934] tegra-pcie 10003000.pcie: Adding to iommu group 5
> > > [    3.966435] tegra-pcie 10003000.pcie: 4x1, 1x1 configuration
> > > [    3.968057] tegra-pcie 10003000.pcie: probing port 0, using 4 lanes
> > > [    3.970121] tegra-pcie 10003000.pcie: probing port 1, using 0 lanes
> > > [    3.972183] tegra-pcie 10003000.pcie: probing port 2, using 1 lanes
> > > [    5.260316] tegra-pcie 10003000.pcie: link 1 down, ignoring
> > > [    6.479410] tegra-pcie 10003000.pcie: link 2 down, ignoring
> > > [    6.479579] tegra-pcie 10003000.pcie: PCI host bridge to bus 0000:00
> > > [    6.479602] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
> > > [    6.479627] pci_bus 0000:00: root bus resource [mem 0x50100000-0x57ffffff]
> > > [    6.479646] pci_bus 0000:00: root bus resource [mem 0x58000000-0x7fffffff pref]
> > > [    6.479668] pci_bus 0000:00: root bus resource [bus 00-ff]
> > > [    6.479850] pci 0000:00:01.0: [10de:10e5] type 01 class 0x060400
> > > [    6.479887] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4 may corrupt adjacent RW1C bits
> > > [    6.479916] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4 may corrupt adjacent RW1C bits
> > > [    6.479993] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > > [    6.480041] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x52 may corrupt adjacent RW1C bits
> > > [    6.480118] pci 0000:00:01.0: PME# supported from D0 D1 D2 D3hot D3cold
> > > [    6.480141] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4c may corrupt adjacent RW1C bits
> > > [    6.482485] pci 0000:00:01.0: bridge configuration invalid ([bus 00-00]), reconfiguring
> > > [    6.482521] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > > [    6.482576] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > > [    6.482607] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > > [    6.482635] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x6 may corrupt adjacent RW1C bits
> > > [    6.482794] pci 0000:01:00.0: [10de:128b] type 00 class 0x030000
> > > [    6.482931] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x00ffffff]
> > > [    6.482976] pci 0000:01:00.0: reg 0x14: [mem 0x00000000-0x07ffffff 64bit pref]
> > > [    6.483022] pci 0000:01:00.0: reg 0x1c: [mem 0x00000000-0x01ffffff 64bit pref]
> > > [    6.483056] pci 0000:01:00.0: reg 0x24: [io  0x0000-0x007f]
> > > [    6.483087] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
> > > [    6.483313] pci 0000:01:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5 GT/s x1 link at 0000:00:01.0 (capable of 32.000 Gb/s with 5 GT/s x8 link)
> > > [    6.483463] pci 0000:01:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
> > > [    6.483556] pci 0000:01:00.1: [10de:0e0f] type 00 class 0x040300
> > > [    6.483648] pci 0000:01:00.1: reg 0x10: [mem 0x00000000-0x00003fff]
> > > [    6.485344] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
> > > [    6.485368] pci_bus 0000:00: 1-byte config write to 0000:00:01.0 offset 0x1a may corrupt adjacent RW1C bits
> > > [    6.485411] pci 0000:00:01.0: BAR 15: assigned [mem 0x58000000-0x63ffffff 64bit pref]
> > > [    6.485431] pci 0000:00:01.0: BAR 14: assigned [mem 0x50800000-0x51ffffff]
> > > [    6.485448] pci 0000:00:01.0: BAR 13: assigned [io  0x1000-0x1fff]
> > > [    6.485471] pci 0000:01:00.0: BAR 1: assigned [mem 0x58000000-0x5fffffff 64bit pref]
> > > [    6.485510] pci 0000:01:00.0: BAR 3: assigned [mem 0x60000000-0x61ffffff 64bit pref]
> > > [    6.485547] pci 0000:01:00.0: BAR 0: assigned [mem 0x51000000-0x51ffffff]
> > > [    6.485569] pci 0000:01:00.0: BAR 6: assigned [mem 0x50800000-0x5087ffff pref]
> > > [    6.485588] pci 0000:01:00.1: BAR 0: assigned [mem 0x50880000-0x50883fff]
> > > [    6.485610] pci 0000:01:00.0: BAR 5: assigned [io  0x1000-0x107f]
> > > [    6.485631] pci 0000:00:01.0: PCI bridge to [bus 01]
> > > [    6.485648] pci 0000:00:01.0:   bridge window [io  0x1000-0x1fff]
> > > [    6.485668] pci 0000:00:01.0:   bridge window [mem 0x50800000-0x51ffffff]
> > > [    6.485691] pci 0000:00:01.0:   bridge window [mem 0x58000000-0x63ffffff 64bit pref]
> > > [    6.485760] pci 0000:00:01.0: nv_msi_ht_cap_quirk didn't locate host bridge
> > > [    6.485857] pcieport 0000:00:01.0: Adding to iommu group 5
> > > [    6.485930] pcieport 0000:00:01.0: enabling device (0000 -> 0003)
> > > [    6.486051] pcieport 0000:00:01.0: PME: Signaling with IRQ 40
> > > [    6.486378] pcieport 0000:00:01.0: AER: enabled with IRQ 40
> > > [    6.486714] pci 0000:01:00.1: D0 power state depends on 0000:01:00.0
> >
> > Hm, I can't say that I've ever seen that "2-byte config write" errors.
> > However it does appear to have assigned the BARs correctly, so there's
> > that.
> >
> > > [   12.885866] nouveau 0000:01:00.0: Adding to iommu group 5
> > > [   12.891373] nouveau 0000:01:00.0: enabling device (0000 -> 0003)
> > > [   12.897619] nouveau 0000:01:00.0: NVIDIA GK208B (b060b0b1)
> > > [   13.086682] nouveau 0000:01:00.0: bios: version 80.28.a6.00.10
> > > [   13.288626] nouveau 0000:01:00.0: fb: 1024 MiB DDR3
> > > [   14.749542] [TTM] Zone  kernel: Available graphics memory: 3986272 KiB
> > > [   14.756096] [TTM] Zone   dma32: Available graphics memory: 2097152 KiB
> > > [   14.762626] [TTM] Initializing pool allocator
> > > [   14.766999] [TTM] Initializing DMA pool allocator
> > > [   14.771750] nouveau 0000:01:00.0: DRM: VRAM: 1024 MiB
> > > [   14.776808] nouveau 0000:01:00.0: DRM: GART: 1048576 MiB
> > > [   14.782147] nouveau 0000:01:00.0: DRM: TMDS table version 2.0
> > > [   14.787905] nouveau 0000:01:00.0: DRM: DCB version 4.0
> > > [   14.793053] nouveau 0000:01:00.0: DRM: DCB outp 00: 01000f02 00020030
> > > [   14.799504] nouveau 0000:01:00.0: DRM: DCB outp 01: 02011f62 00020010
> > > [   14.805948] nouveau 0000:01:00.0: DRM: DCB outp 02: 02022f10 00000000
> > > [   14.812393] nouveau 0000:01:00.0: DRM: DCB conn 00: 00001031
> > > [   14.818056] nouveau 0000:01:00.0: DRM: DCB conn 01: 00002161
> > > [   14.823724] nouveau 0000:01:00.0: DRM: DCB conn 02: 00000200
> > > [   14.831977] nouveau 0000:01:00.0: DRM: MM: using COPY for buffer copies
> > > [   14.841690] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
> > > [   14.848322] [drm] Driver supports precise vblank timestamp query.
> > > [   15.136647] nouveau 0000:01:00.0: DRM: allocated 1920x1080 fb: 0x80000, bo 00000000d53241e4
> > > [   17.146929] nouveau 0000:01:00.0: DRM: core notifier timeout
> > > [   19.146846] nouveau 0000:01:00.0: DRM: base-0: timeout
> > > [   19.147554] Console: switching to colour frame buffer device 240x67
> > > [   19.446311] nouveau 0000:01:00.0: DRM: GPU lockup - switching to software fbcon
> > > [   19.501043] nouveau 0000:01:00.0: fb0: nouveaudrmfb frame buffer device
> > > [   19.523471] [drm] Initialized nouveau 1.3.1 20120801 for 0000:01:00.0 on minor 0
> >
> > So that "core notifier timeout" and subsequent GPU lockup indicate
> > that something's amiss. Most of the initialization was able to be
> > completed, including reading EDID from your monitor (hence the
> > non-default resolution), but we're not seeing values change properly /
> > missing notifications. I'm actually wondering if we aren't
> > initializing the GPU because we think it's already initialized. Could
> > you boot with nouveau.config=NvForcePost=1 and see if that helps?
>
> Note that PCIe is non-coherent on most ARM devices (including Tegra TX2
> IIRC), so if the notifier BO isn't mapped as uncached memory, you
> probably won't see the expected notifier content, as you are reading
> stale cache line content.

I *believe* that as part of getting nouveau working with the Tegra
in-SoC GPU, at least the fence logic was adjusted. However perhaps we
didn't do it for notifier memory... worth checking.

Thanks for the info!

  -ilia
_______________________________________________
Nouveau mailing list
Nouveau@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/nouveau

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: GeForce(R) GT 710 1GB PCIE x 1 on arm64
       [not found]               ` <e681b4315b596dca39bb4a28866d509e23a150c1.camel-8ppwABl0HbeELgA04lAiVw@public.gmane.org>
  2020-05-06 14:42                 ` Ilia Mirkin
@ 2020-05-06 15:34                 ` Milan Buška
  2020-05-08  8:34                 ` Milan Buška
  2 siblings, 0 replies; 14+ messages in thread
From: Milan Buška @ 2020-05-06 15:34 UTC (permalink / raw)
  To: Lucas Stach; +Cc: nouveau

st 6. 5. 2020 v 16:39 odesílatel Lucas Stach <dev@lynxeye.de> napsal:
>
> Am Mittwoch, den 06.05.2020, 10:26 -0400 schrieb Ilia Mirkin:
> > [please keep list cc'd in your replies]
> >
> > On Wed, May 6, 2020 at 10:15 AM Milan Buška <milan.buska@gmail.com> wrote:
> > > [    0.000000] Linux version 5.6.10-zotac (root@saux) (gcc version 9.3.0 (SAUX Aarch64)) #1 SMP PREEMPT Tue May 5 22:16:40 CEST 2020
> > > [    0.000000] Machine model: NVIDIA Jetson TX2 Developer Kit
> >
> > [...]
> >
> > > [    3.965934] tegra-pcie 10003000.pcie: Adding to iommu group 5
> > > [    3.966435] tegra-pcie 10003000.pcie: 4x1, 1x1 configuration
> > > [    3.968057] tegra-pcie 10003000.pcie: probing port 0, using 4 lanes
> > > [    3.970121] tegra-pcie 10003000.pcie: probing port 1, using 0 lanes
> > > [    3.972183] tegra-pcie 10003000.pcie: probing port 2, using 1 lanes
> > > [    5.260316] tegra-pcie 10003000.pcie: link 1 down, ignoring
> > > [    6.479410] tegra-pcie 10003000.pcie: link 2 down, ignoring
> > > [    6.479579] tegra-pcie 10003000.pcie: PCI host bridge to bus 0000:00
> > > [    6.479602] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
> > > [    6.479627] pci_bus 0000:00: root bus resource [mem 0x50100000-0x57ffffff]
> > > [    6.479646] pci_bus 0000:00: root bus resource [mem 0x58000000-0x7fffffff pref]
> > > [    6.479668] pci_bus 0000:00: root bus resource [bus 00-ff]
> > > [    6.479850] pci 0000:00:01.0: [10de:10e5] type 01 class 0x060400
> > > [    6.479887] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4 may corrupt adjacent RW1C bits
> > > [    6.479916] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4 may corrupt adjacent RW1C bits
> > > [    6.479993] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > > [    6.480041] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x52 may corrupt adjacent RW1C bits
> > > [    6.480118] pci 0000:00:01.0: PME# supported from D0 D1 D2 D3hot D3cold
> > > [    6.480141] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4c may corrupt adjacent RW1C bits
> > > [    6.482485] pci 0000:00:01.0: bridge configuration invalid ([bus 00-00]), reconfiguring
> > > [    6.482521] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > > [    6.482576] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > > [    6.482607] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > > [    6.482635] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x6 may corrupt adjacent RW1C bits
> > > [    6.482794] pci 0000:01:00.0: [10de:128b] type 00 class 0x030000
> > > [    6.482931] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x00ffffff]
> > > [    6.482976] pci 0000:01:00.0: reg 0x14: [mem 0x00000000-0x07ffffff 64bit pref]
> > > [    6.483022] pci 0000:01:00.0: reg 0x1c: [mem 0x00000000-0x01ffffff 64bit pref]
> > > [    6.483056] pci 0000:01:00.0: reg 0x24: [io  0x0000-0x007f]
> > > [    6.483087] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
> > > [    6.483313] pci 0000:01:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5 GT/s x1 link at 0000:00:01.0 (capable of 32.000 Gb/s with 5 GT/s x8 link)
> > > [    6.483463] pci 0000:01:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
> > > [    6.483556] pci 0000:01:00.1: [10de:0e0f] type 00 class 0x040300
> > > [    6.483648] pci 0000:01:00.1: reg 0x10: [mem 0x00000000-0x00003fff]
> > > [    6.485344] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
> > > [    6.485368] pci_bus 0000:00: 1-byte config write to 0000:00:01.0 offset 0x1a may corrupt adjacent RW1C bits
> > > [    6.485411] pci 0000:00:01.0: BAR 15: assigned [mem 0x58000000-0x63ffffff 64bit pref]
> > > [    6.485431] pci 0000:00:01.0: BAR 14: assigned [mem 0x50800000-0x51ffffff]
> > > [    6.485448] pci 0000:00:01.0: BAR 13: assigned [io  0x1000-0x1fff]
> > > [    6.485471] pci 0000:01:00.0: BAR 1: assigned [mem 0x58000000-0x5fffffff 64bit pref]
> > > [    6.485510] pci 0000:01:00.0: BAR 3: assigned [mem 0x60000000-0x61ffffff 64bit pref]
> > > [    6.485547] pci 0000:01:00.0: BAR 0: assigned [mem 0x51000000-0x51ffffff]
> > > [    6.485569] pci 0000:01:00.0: BAR 6: assigned [mem 0x50800000-0x5087ffff pref]
> > > [    6.485588] pci 0000:01:00.1: BAR 0: assigned [mem 0x50880000-0x50883fff]
> > > [    6.485610] pci 0000:01:00.0: BAR 5: assigned [io  0x1000-0x107f]
> > > [    6.485631] pci 0000:00:01.0: PCI bridge to [bus 01]
> > > [    6.485648] pci 0000:00:01.0:   bridge window [io  0x1000-0x1fff]
> > > [    6.485668] pci 0000:00:01.0:   bridge window [mem 0x50800000-0x51ffffff]
> > > [    6.485691] pci 0000:00:01.0:   bridge window [mem 0x58000000-0x63ffffff 64bit pref]
> > > [    6.485760] pci 0000:00:01.0: nv_msi_ht_cap_quirk didn't locate host bridge
> > > [    6.485857] pcieport 0000:00:01.0: Adding to iommu group 5
> > > [    6.485930] pcieport 0000:00:01.0: enabling device (0000 -> 0003)
> > > [    6.486051] pcieport 0000:00:01.0: PME: Signaling with IRQ 40
> > > [    6.486378] pcieport 0000:00:01.0: AER: enabled with IRQ 40
> > > [    6.486714] pci 0000:01:00.1: D0 power state depends on 0000:01:00.0
> >
> > Hm, I can't say that I've ever seen that "2-byte config write" errors.
> > However it does appear to have assigned the BARs correctly, so there's
> > that.
> >
> > > [   12.885866] nouveau 0000:01:00.0: Adding to iommu group 5
> > > [   12.891373] nouveau 0000:01:00.0: enabling device (0000 -> 0003)
> > > [   12.897619] nouveau 0000:01:00.0: NVIDIA GK208B (b060b0b1)
> > > [   13.086682] nouveau 0000:01:00.0: bios: version 80.28.a6.00.10
> > > [   13.288626] nouveau 0000:01:00.0: fb: 1024 MiB DDR3
> > > [   14.749542] [TTM] Zone  kernel: Available graphics memory: 3986272 KiB
> > > [   14.756096] [TTM] Zone   dma32: Available graphics memory: 2097152 KiB
> > > [   14.762626] [TTM] Initializing pool allocator
> > > [   14.766999] [TTM] Initializing DMA pool allocator
> > > [   14.771750] nouveau 0000:01:00.0: DRM: VRAM: 1024 MiB
> > > [   14.776808] nouveau 0000:01:00.0: DRM: GART: 1048576 MiB
> > > [   14.782147] nouveau 0000:01:00.0: DRM: TMDS table version 2.0
> > > [   14.787905] nouveau 0000:01:00.0: DRM: DCB version 4.0
> > > [   14.793053] nouveau 0000:01:00.0: DRM: DCB outp 00: 01000f02 00020030
> > > [   14.799504] nouveau 0000:01:00.0: DRM: DCB outp 01: 02011f62 00020010
> > > [   14.805948] nouveau 0000:01:00.0: DRM: DCB outp 02: 02022f10 00000000
> > > [   14.812393] nouveau 0000:01:00.0: DRM: DCB conn 00: 00001031
> > > [   14.818056] nouveau 0000:01:00.0: DRM: DCB conn 01: 00002161
> > > [   14.823724] nouveau 0000:01:00.0: DRM: DCB conn 02: 00000200
> > > [   14.831977] nouveau 0000:01:00.0: DRM: MM: using COPY for buffer copies
> > > [   14.841690] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
> > > [   14.848322] [drm] Driver supports precise vblank timestamp query.
> > > [   15.136647] nouveau 0000:01:00.0: DRM: allocated 1920x1080 fb: 0x80000, bo 00000000d53241e4
> > > [   17.146929] nouveau 0000:01:00.0: DRM: core notifier timeout
> > > [   19.146846] nouveau 0000:01:00.0: DRM: base-0: timeout
> > > [   19.147554] Console: switching to colour frame buffer device 240x67
> > > [   19.446311] nouveau 0000:01:00.0: DRM: GPU lockup - switching to software fbcon
> > > [   19.501043] nouveau 0000:01:00.0: fb0: nouveaudrmfb frame buffer device
> > > [   19.523471] [drm] Initialized nouveau 1.3.1 20120801 for 0000:01:00.0 on minor 0
> >
> > So that "core notifier timeout" and subsequent GPU lockup indicate
> > that something's amiss. Most of the initialization was able to be
> > completed, including reading EDID from your monitor (hence the
> > non-default resolution), but we're not seeing values change properly /
> > missing notifications. I'm actually wondering if we aren't
> > initializing the GPU because we think it's already initialized. Could
> > you boot with nouveau.config=NvForcePost=1 and see if that helps?
>
> Note that PCIe is non-coherent on most ARM devices (including Tegra TX2
> IIRC), so if the notifier BO isn't mapped as uncached memory, you
> probably won't see the expected notifier content, as you are reading
> stale cache line content.
>
> Regards,
> Lucas
>

So further experiments with this card is just a waste of time and
unnecessary work.
_______________________________________________
Nouveau mailing list
Nouveau@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/nouveau

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: GeForce(R) GT 710 1GB PCIE x 1 on arm64
       [not found]                   ` <CAKb7Uvh8dvVTVbu15e2=7qb4dgoVbigrnjkYW6i7z5dsk4g3qQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2020-05-06 15:51                     ` Ilia Mirkin
       [not found]                       ` <20200506211015.GA473@ishi>
  0 siblings, 1 reply; 14+ messages in thread
From: Ilia Mirkin @ 2020-05-06 15:51 UTC (permalink / raw)
  To: Lucas Stach; +Cc: nouveau

On Wed, May 6, 2020 at 10:42 AM Ilia Mirkin <imirkin-FrUbXkNCsVf2fBVCVOL8/A@public.gmane.org> wrote:
> On Wed, May 6, 2020 at 10:39 AM Lucas Stach <dev-8ppwABl0HbeELgA04lAiVw@public.gmane.org> wrote:
> > > > [   17.146929] nouveau 0000:01:00.0: DRM: core notifier timeout
> > > > [   19.146846] nouveau 0000:01:00.0: DRM: base-0: timeout
> > > > [   19.147554] Console: switching to colour frame buffer device 240x67
> > > > [   19.446311] nouveau 0000:01:00.0: DRM: GPU lockup - switching to software fbcon
> > > > [   19.501043] nouveau 0000:01:00.0: fb0: nouveaudrmfb frame buffer device
> > > > [   19.523471] [drm] Initialized nouveau 1.3.1 20120801 for 0000:01:00.0 on minor 0
> > >
> > > So that "core notifier timeout" and subsequent GPU lockup indicate
> > > that something's amiss. Most of the initialization was able to be
> > > completed, including reading EDID from your monitor (hence the
> > > non-default resolution), but we're not seeing values change properly /
> > > missing notifications. I'm actually wondering if we aren't
> > > initializing the GPU because we think it's already initialized. Could
> > > you boot with nouveau.config=NvForcePost=1 and see if that helps?
> >
> > Note that PCIe is non-coherent on most ARM devices (including Tegra TX2
> > IIRC), so if the notifier BO isn't mapped as uncached memory, you
> > probably won't see the expected notifier content, as you are reading
> > stale cache line content.
>
> I *believe* that as part of getting nouveau working with the Tegra
> in-SoC GPU, at least the fence logic was adjusted. However perhaps we
> didn't do it for notifier memory... worth checking.

Hm, looks like we should be passing in TTM_PL_FLAG_UNCACHED for the
notifier, which should cause nouveau_bo to do the right thing (by
setting force_coherent=true in this environment):

ret = nouveau_bo_new(&drm->client, 4096, 0x1000, TTM_PL_FLAG_VRAM,
     0, 0x0000, NULL, NULL, &disp->sync);

Milan - can you try changing that line in

drivers/gpu/drm/nouveau/dispnv50/disp.c::nv50_display_create

to have TTM_PL_FLAG_VRAM | TTM_PL_FLAG_UNCACHED instead for that
nouveau_bo_new call (no need to change the later nouveau_bo_pin call)?

Cheers,

  -ilia

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: GeForce(R) GT 710 1GB PCIE x 1 on arm64
       [not found]                               ` <20200507041147.GA455@ishi>
@ 2020-05-07 13:56                                 ` Ilia Mirkin
  0 siblings, 0 replies; 14+ messages in thread
From: Ilia Mirkin @ 2020-05-07 13:56 UTC (permalink / raw)
  To: Milan Buska; +Cc: nouveau

On Thu, May 7, 2020 at 12:11 AM Milan Buska <milan.buska-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
>
> On 20-05-06 18:53:00, Ilia Mirkin wrote:
> > On Wed, May 6, 2020 at 5:59 PM Milan Buska <milan.buska-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
> > >
> > > On 20-05-06 17:12:44, Ilia Mirkin wrote:
> > > > You need both VRAM *and* UNCACHED. Separate them with a |
> > > >
> > > > On Wed, May 6, 2020 at 5:10 PM Milan Buska <milan.buska-Re5JQEeQqe8AvxtiuMwx3w@public.gmane.org> wrote:
> > > > >
> > > > > On 20-05-06 11:51:35, Ilia Mirkin wrote:
> > > > > > On Wed, May 6, 2020 at 10:42 AM Ilia Mirkin <imirkin-FrUbXkNCsVf2fBVCVOL8/A@public.gmane.org> wrote:
> > > > > > > On Wed, May 6, 2020 at 10:39 AM Lucas Stach <dev-8ppwABl0HbeELgA04lAiVw@public.gmane.org> wrote:
> > > > > > > > > > [   17.146929] nouveau 0000:01:00.0: DRM: core notifier timeout
> > > > > > > > > > [   19.146846] nouveau 0000:01:00.0: DRM: base-0: timeout
> > > > > > > > > > [   19.147554] Console: switching to colour frame buffer device 240x67
> > > > > > > > > > [   19.446311] nouveau 0000:01:00.0: DRM: GPU lockup - switching to software fbcon
> > > > > > > > > > [   19.501043] nouveau 0000:01:00.0: fb0: nouveaudrmfb frame buffer device
> > > > > > > > > > [   19.523471] [drm] Initialized nouveau 1.3.1 20120801 for 0000:01:00.0 on minor 0
> > > > > > > > >
> > > > > > > > > So that "core notifier timeout" and subsequent GPU lockup indicate
> > > > > > > > > that something's amiss. Most of the initialization was able to be
> > > > > > > > > completed, including reading EDID from your monitor (hence the
> > > > > > > > > non-default resolution), but we're not seeing values change properly /
> > > > > > > > > missing notifications. I'm actually wondering if we aren't
> > > > > > > > > initializing the GPU because we think it's already initialized. Could
> > > > > > > > > you boot with nouveau.config=NvForcePost=1 and see if that helps?
> > > > > > > >
> > > > > > > > Note that PCIe is non-coherent on most ARM devices (including Tegra TX2
> > > > > > > > IIRC), so if the notifier BO isn't mapped as uncached memory, you
> > > > > > > > probably won't see the expected notifier content, as you are reading
> > > > > > > > stale cache line content.
> > > > > > >
> > > > > > > I *believe* that as part of getting nouveau working with the Tegra
> > > > > > > in-SoC GPU, at least the fence logic was adjusted. However perhaps we
> > > > > > > didn't do it for notifier memory... worth checking.
> > > > > >
> > > > > > Hm, looks like we should be passing in TTM_PL_FLAG_UNCACHED for the
> > > > > > notifier, which should cause nouveau_bo to do the right thing (by
> > > > > > setting force_coherent=true in this environment):
> > > > > >
> > > > > > ret = nouveau_bo_new(&drm->client, 4096, 0x1000, TTM_PL_FLAG_VRAM,
> > > > > >      0, 0x0000, NULL, NULL, &disp->sync);
> > > > > >
> > > > > > Milan - can you try changing that line in
> > > > > >
> > > > > > drivers/gpu/drm/nouveau/dispnv50/disp.c::nv50_display_create
> > > > > >
> > > > > > to have TTM_PL_FLAG_VRAM | TTM_PL_FLAG_UNCACHED instead for that
> > > > > > nouveau_bo_new call (no need to change the later nouveau_bo_pin call)?
> > > > > >
> > > > > > Cheers,
> > > > > >
> > > > > >   -ilia
> > > > > >
> > > > >
> > > > >         /* small shared memory area we use for notifiers and semaphores */
> > >             ret = nouveau_bo_new(&drm->client, 4096, 0x1000, TTM_PL_FLAG_VRAM | TTM_PL_FLAG_UNCACHED,
> > >
> > > it is OK
> >
> > What do you mean by that? You're testing it, or that fixed it?
> >
> It's the same

Oh well, it was worth a shot. Someone will have to debug what's going on.

  -ilia

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: GeForce(R) GT 710 1GB PCIE x 1 on arm64
       [not found]               ` <e681b4315b596dca39bb4a28866d509e23a150c1.camel-8ppwABl0HbeELgA04lAiVw@public.gmane.org>
  2020-05-06 14:42                 ` Ilia Mirkin
  2020-05-06 15:34                 ` Milan Buška
@ 2020-05-08  8:34                 ` Milan Buška
       [not found]                   ` <CAFCWPPKhbbk=um2pv+ytgd+WVaT+M=-mLXXAR427QgQj=w_q3A-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  2 siblings, 1 reply; 14+ messages in thread
From: Milan Buška @ 2020-05-08  8:34 UTC (permalink / raw)
  To: Lucas Stach; +Cc: nouveau

Good day.
I'm not a programmer, so I don't understand.

Just a question:
What's wrong =>
=> nouveau driver
=> pcie driver
=> graphics card

It will help me save unnecessary lost time.

Greeting

st 6. 5. 2020 v 16:39 odesílatel Lucas Stach <dev@lynxeye.de> napsal:
>
> Am Mittwoch, den 06.05.2020, 10:26 -0400 schrieb Ilia Mirkin:
> > [please keep list cc'd in your replies]
> >
> > On Wed, May 6, 2020 at 10:15 AM Milan Buška <milan.buska@gmail.com> wrote:
> > > [    0.000000] Linux version 5.6.10-zotac (root@saux) (gcc version 9.3.0 (SAUX Aarch64)) #1 SMP PREEMPT Tue May 5 22:16:40 CEST 2020
> > > [    0.000000] Machine model: NVIDIA Jetson TX2 Developer Kit
> >
> > [...]
> >
> > > [    3.965934] tegra-pcie 10003000.pcie: Adding to iommu group 5
> > > [    3.966435] tegra-pcie 10003000.pcie: 4x1, 1x1 configuration
> > > [    3.968057] tegra-pcie 10003000.pcie: probing port 0, using 4 lanes
> > > [    3.970121] tegra-pcie 10003000.pcie: probing port 1, using 0 lanes
> > > [    3.972183] tegra-pcie 10003000.pcie: probing port 2, using 1 lanes
> > > [    5.260316] tegra-pcie 10003000.pcie: link 1 down, ignoring
> > > [    6.479410] tegra-pcie 10003000.pcie: link 2 down, ignoring
> > > [    6.479579] tegra-pcie 10003000.pcie: PCI host bridge to bus 0000:00
> > > [    6.479602] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]
> > > [    6.479627] pci_bus 0000:00: root bus resource [mem 0x50100000-0x57ffffff]
> > > [    6.479646] pci_bus 0000:00: root bus resource [mem 0x58000000-0x7fffffff pref]
> > > [    6.479668] pci_bus 0000:00: root bus resource [bus 00-ff]
> > > [    6.479850] pci 0000:00:01.0: [10de:10e5] type 01 class 0x060400
> > > [    6.479887] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4 may corrupt adjacent RW1C bits
> > > [    6.479916] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4 may corrupt adjacent RW1C bits
> > > [    6.479993] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > > [    6.480041] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x52 may corrupt adjacent RW1C bits
> > > [    6.480118] pci 0000:00:01.0: PME# supported from D0 D1 D2 D3hot D3cold
> > > [    6.480141] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x4c may corrupt adjacent RW1C bits
> > > [    6.482485] pci 0000:00:01.0: bridge configuration invalid ([bus 00-00]), reconfiguring
> > > [    6.482521] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > > [    6.482576] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > > [    6.482607] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x3e may corrupt adjacent RW1C bits
> > > [    6.482635] pci_bus 0000:00: 2-byte config write to 0000:00:01.0 offset 0x6 may corrupt adjacent RW1C bits
> > > [    6.482794] pci 0000:01:00.0: [10de:128b] type 00 class 0x030000
> > > [    6.482931] pci 0000:01:00.0: reg 0x10: [mem 0x00000000-0x00ffffff]
> > > [    6.482976] pci 0000:01:00.0: reg 0x14: [mem 0x00000000-0x07ffffff 64bit pref]
> > > [    6.483022] pci 0000:01:00.0: reg 0x1c: [mem 0x00000000-0x01ffffff 64bit pref]
> > > [    6.483056] pci 0000:01:00.0: reg 0x24: [io  0x0000-0x007f]
> > > [    6.483087] pci 0000:01:00.0: reg 0x30: [mem 0x00000000-0x0007ffff pref]
> > > [    6.483313] pci 0000:01:00.0: 4.000 Gb/s available PCIe bandwidth, limited by 5 GT/s x1 link at 0000:00:01.0 (capable of 32.000 Gb/s with 5 GT/s x8 link)
> > > [    6.483463] pci 0000:01:00.0: vgaarb: VGA device added: decodes=io+mem,owns=none,locks=none
> > > [    6.483556] pci 0000:01:00.1: [10de:0e0f] type 00 class 0x040300
> > > [    6.483648] pci 0000:01:00.1: reg 0x10: [mem 0x00000000-0x00003fff]
> > > [    6.485344] pci_bus 0000:01: busn_res: [bus 01-ff] end is updated to 01
> > > [    6.485368] pci_bus 0000:00: 1-byte config write to 0000:00:01.0 offset 0x1a may corrupt adjacent RW1C bits
> > > [    6.485411] pci 0000:00:01.0: BAR 15: assigned [mem 0x58000000-0x63ffffff 64bit pref]
> > > [    6.485431] pci 0000:00:01.0: BAR 14: assigned [mem 0x50800000-0x51ffffff]
> > > [    6.485448] pci 0000:00:01.0: BAR 13: assigned [io  0x1000-0x1fff]
> > > [    6.485471] pci 0000:01:00.0: BAR 1: assigned [mem 0x58000000-0x5fffffff 64bit pref]
> > > [    6.485510] pci 0000:01:00.0: BAR 3: assigned [mem 0x60000000-0x61ffffff 64bit pref]
> > > [    6.485547] pci 0000:01:00.0: BAR 0: assigned [mem 0x51000000-0x51ffffff]
> > > [    6.485569] pci 0000:01:00.0: BAR 6: assigned [mem 0x50800000-0x5087ffff pref]
> > > [    6.485588] pci 0000:01:00.1: BAR 0: assigned [mem 0x50880000-0x50883fff]
> > > [    6.485610] pci 0000:01:00.0: BAR 5: assigned [io  0x1000-0x107f]
> > > [    6.485631] pci 0000:00:01.0: PCI bridge to [bus 01]
> > > [    6.485648] pci 0000:00:01.0:   bridge window [io  0x1000-0x1fff]
> > > [    6.485668] pci 0000:00:01.0:   bridge window [mem 0x50800000-0x51ffffff]
> > > [    6.485691] pci 0000:00:01.0:   bridge window [mem 0x58000000-0x63ffffff 64bit pref]
> > > [    6.485760] pci 0000:00:01.0: nv_msi_ht_cap_quirk didn't locate host bridge
> > > [    6.485857] pcieport 0000:00:01.0: Adding to iommu group 5
> > > [    6.485930] pcieport 0000:00:01.0: enabling device (0000 -> 0003)
> > > [    6.486051] pcieport 0000:00:01.0: PME: Signaling with IRQ 40
> > > [    6.486378] pcieport 0000:00:01.0: AER: enabled with IRQ 40
> > > [    6.486714] pci 0000:01:00.1: D0 power state depends on 0000:01:00.0
> >
> > Hm, I can't say that I've ever seen that "2-byte config write" errors.
> > However it does appear to have assigned the BARs correctly, so there's
> > that.
> >
> > > [   12.885866] nouveau 0000:01:00.0: Adding to iommu group 5
> > > [   12.891373] nouveau 0000:01:00.0: enabling device (0000 -> 0003)
> > > [   12.897619] nouveau 0000:01:00.0: NVIDIA GK208B (b060b0b1)
> > > [   13.086682] nouveau 0000:01:00.0: bios: version 80.28.a6.00.10
> > > [   13.288626] nouveau 0000:01:00.0: fb: 1024 MiB DDR3
> > > [   14.749542] [TTM] Zone  kernel: Available graphics memory: 3986272 KiB
> > > [   14.756096] [TTM] Zone   dma32: Available graphics memory: 2097152 KiB
> > > [   14.762626] [TTM] Initializing pool allocator
> > > [   14.766999] [TTM] Initializing DMA pool allocator
> > > [   14.771750] nouveau 0000:01:00.0: DRM: VRAM: 1024 MiB
> > > [   14.776808] nouveau 0000:01:00.0: DRM: GART: 1048576 MiB
> > > [   14.782147] nouveau 0000:01:00.0: DRM: TMDS table version 2.0
> > > [   14.787905] nouveau 0000:01:00.0: DRM: DCB version 4.0
> > > [   14.793053] nouveau 0000:01:00.0: DRM: DCB outp 00: 01000f02 00020030
> > > [   14.799504] nouveau 0000:01:00.0: DRM: DCB outp 01: 02011f62 00020010
> > > [   14.805948] nouveau 0000:01:00.0: DRM: DCB outp 02: 02022f10 00000000
> > > [   14.812393] nouveau 0000:01:00.0: DRM: DCB conn 00: 00001031
> > > [   14.818056] nouveau 0000:01:00.0: DRM: DCB conn 01: 00002161
> > > [   14.823724] nouveau 0000:01:00.0: DRM: DCB conn 02: 00000200
> > > [   14.831977] nouveau 0000:01:00.0: DRM: MM: using COPY for buffer copies
> > > [   14.841690] [drm] Supports vblank timestamp caching Rev 2 (21.10.2013).
> > > [   14.848322] [drm] Driver supports precise vblank timestamp query.
> > > [   15.136647] nouveau 0000:01:00.0: DRM: allocated 1920x1080 fb: 0x80000, bo 00000000d53241e4
> > > [   17.146929] nouveau 0000:01:00.0: DRM: core notifier timeout
> > > [   19.146846] nouveau 0000:01:00.0: DRM: base-0: timeout
> > > [   19.147554] Console: switching to colour frame buffer device 240x67
> > > [   19.446311] nouveau 0000:01:00.0: DRM: GPU lockup - switching to software fbcon
> > > [   19.501043] nouveau 0000:01:00.0: fb0: nouveaudrmfb frame buffer device
> > > [   19.523471] [drm] Initialized nouveau 1.3.1 20120801 for 0000:01:00.0 on minor 0
> >
> > So that "core notifier timeout" and subsequent GPU lockup indicate
> > that something's amiss. Most of the initialization was able to be
> > completed, including reading EDID from your monitor (hence the
> > non-default resolution), but we're not seeing values change properly /
> > missing notifications. I'm actually wondering if we aren't
> > initializing the GPU because we think it's already initialized. Could
> > you boot with nouveau.config=NvForcePost=1 and see if that helps?
>
> Note that PCIe is non-coherent on most ARM devices (including Tegra TX2
> IIRC), so if the notifier BO isn't mapped as uncached memory, you
> probably won't see the expected notifier content, as you are reading
> stale cache line content.
>
> Regards,
> Lucas
>


-- 

Remember, no question is too stupid and no problem too small
       -- We've all been beginners
_______________________________________________
Nouveau mailing list
Nouveau@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/nouveau

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: GeForce(R) GT 710 1GB PCIE x 1 on arm64
       [not found]                   ` <CAFCWPPKhbbk=um2pv+ytgd+WVaT+M=-mLXXAR427QgQj=w_q3A-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2020-05-08 13:27                     ` Ilia Mirkin
       [not found]                       ` <CAKb7Uvi7-UCoEb7GJmT2CseMkhrkg4wO5vfk06KhrVWYfAP9WQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 14+ messages in thread
From: Ilia Mirkin @ 2020-05-08 13:27 UTC (permalink / raw)
  To: Milan Buška; +Cc: nouveau

On Fri, May 8, 2020 at 4:34 AM Milan Buška <milan.buska@gmail.com> wrote:
>
> Good day.
> I'm not a programmer, so I don't understand.
>
> Just a question:
> What's wrong =>
> => nouveau driver
> => pcie driver
> => graphics card
>
> It will help me save unnecessary lost time.

Most likely the issue is in nouveau. There's a much smaller likelihood
that the issue is with e.g. the iommu/dma-api implementation.

Cheers,

  -ilia
_______________________________________________
Nouveau mailing list
Nouveau@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/nouveau

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: GeForce(R) GT 710 1GB PCIE x 1 on arm64
       [not found]                       ` <CAKb7Uvi7-UCoEb7GJmT2CseMkhrkg4wO5vfk06KhrVWYfAP9WQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2020-05-08 15:12                         ` Milan Buška
       [not found]                           ` <CAFCWPPJVwVrb5atD+Ny4rOxwPJQCrYeZzXQJN4k6yzJtyR-FEQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 14+ messages in thread
From: Milan Buška @ 2020-05-08 15:12 UTC (permalink / raw)
  To: Ilia Mirkin; +Cc: nouveau

Thanks for the info.
I'll pull it out in a year and try it.

Greeting

pá 8. 5. 2020 v 15:27 odesílatel Ilia Mirkin <imirkin@alum.mit.edu> napsal:
>
> On Fri, May 8, 2020 at 4:34 AM Milan Buška <milan.buska@gmail.com> wrote:
> >
> > Good day.
> > I'm not a programmer, so I don't understand.
> >
> > Just a question:
> > What's wrong =>
> > => nouveau driver
> > => pcie driver
> > => graphics card
> >
> > It will help me save unnecessary lost time.
>
> Most likely the issue is in nouveau. There's a much smaller likelihood
> that the issue is with e.g. the iommu/dma-api implementation.
>
> Cheers,
>
>   -ilia



-- 

Remember, no question is too stupid and no problem too small
       -- We've all been beginners
_______________________________________________
Nouveau mailing list
Nouveau@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/nouveau

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: GeForce(R) GT 710 1GB PCIE x 1 on arm64
       [not found]                           ` <CAFCWPPJVwVrb5atD+Ny4rOxwPJQCrYeZzXQJN4k6yzJtyR-FEQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2020-05-08 15:19                             ` Ilia Mirkin
       [not found]                               ` <CAKb7UvjAkKAHFSd2Dggf2JY5GPeGB_kQTcR1EM3QucP1VvOC0A-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
  0 siblings, 1 reply; 14+ messages in thread
From: Ilia Mirkin @ 2020-05-08 15:19 UTC (permalink / raw)
  To: Milan Buška; +Cc: nouveau

I don't think that logic has changed in over a year, nor do I expect
it will in the future, unless someone comes in and does the work to
figure out what's wrong. If that's not you, then you have to hope
there will be someone else interested in running a desktop GPU on an
arm-based board.

On Fri, May 8, 2020 at 11:13 AM Milan Buška <milan.buska@gmail.com> wrote:
>
> Thanks for the info.
> I'll pull it out in a year and try it.
>
> Greeting
>
> pá 8. 5. 2020 v 15:27 odesílatel Ilia Mirkin <imirkin@alum.mit.edu> napsal:
> >
> > On Fri, May 8, 2020 at 4:34 AM Milan Buška <milan.buska@gmail.com> wrote:
> > >
> > > Good day.
> > > I'm not a programmer, so I don't understand.
> > >
> > > Just a question:
> > > What's wrong =>
> > > => nouveau driver
> > > => pcie driver
> > > => graphics card
> > >
> > > It will help me save unnecessary lost time.
> >
> > Most likely the issue is in nouveau. There's a much smaller likelihood
> > that the issue is with e.g. the iommu/dma-api implementation.
> >
> > Cheers,
> >
> >   -ilia
>
>
>
> --
>
> Remember, no question is too stupid and no problem too small
>        -- We've all been beginners
_______________________________________________
Nouveau mailing list
Nouveau@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/nouveau

^ permalink raw reply	[flat|nested] 14+ messages in thread

* Re: GeForce(R) GT 710 1GB PCIE x 1 on arm64
       [not found]                               ` <CAKb7UvjAkKAHFSd2Dggf2JY5GPeGB_kQTcR1EM3QucP1VvOC0A-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
@ 2020-05-09  5:47                                 ` Milan Buška
  0 siblings, 0 replies; 14+ messages in thread
From: Milan Buška @ 2020-05-09  5:47 UTC (permalink / raw)
  To: Ilia Mirkin; +Cc: nouveau

Maybe there are more of us trying to get our hands
on the desktop just not to talk about it much.
he original driver from nvidia also has its limits,
but when the card is added using PCI, the possibilities
expand considerably.
And we also have to look at the energy aspect.
Overall, this model can reduce energy consumption.

pá 8. 5. 2020 v 17:19 odesílatel Ilia Mirkin <imirkin@alum.mit.edu> napsal:
>
> I don't think that logic has changed in over a year, nor do I expect
> it will in the future, unless someone comes in and does the work to
> figure out what's wrong. If that's not you, then you have to hope
> there will be someone else interested in running a desktop GPU on an
> arm-based board.
>
> On Fri, May 8, 2020 at 11:13 AM Milan Buška <milan.buska@gmail.com> wrote:
> >
> > Thanks for the info.
> > I'll pull it out in a year and try it.
> >
> > Greeting
> >
> > pá 8. 5. 2020 v 15:27 odesílatel Ilia Mirkin <imirkin@alum.mit.edu> napsal:
> > >
> > > On Fri, May 8, 2020 at 4:34 AM Milan Buška <milan.buska@gmail.com> wrote:
> > > >
> > > > Good day.
> > > > I'm not a programmer, so I don't understand.
> > > >
> > > > Just a question:
> > > > What's wrong =>
> > > > => nouveau driver
> > > > => pcie driver
> > > > => graphics card
> > > >
> > > > It will help me save unnecessary lost time.
> > >
> > > Most likely the issue is in nouveau. There's a much smaller likelihood
> > > that the issue is with e.g. the iommu/dma-api implementation.
> > >
> > > Cheers,
> > >
> > >   -ilia
> >
> >
> >
> > --
> >
> > Remember, no question is too stupid and no problem too small
> >        -- We've all been beginners



-- 

Remember, no question is too stupid and no problem too small
       -- We've all been beginners
_______________________________________________
Nouveau mailing list
Nouveau@lists.freedesktop.org
https://lists.freedesktop.org/mailman/listinfo/nouveau

^ permalink raw reply	[flat|nested] 14+ messages in thread

end of thread, other threads:[~2020-05-09  5:47 UTC | newest]

Thread overview: 14+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2020-05-06 13:53 GeForce(R) GT 710 1GB PCIE x 1 on arm64 Milan Buška
     [not found] ` <CAFCWPP+WKRhhXG3CRfqRztWbFJwUqeeY6tiip4fT9gwtyjKNwQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2020-05-06 14:00   ` Ilia Mirkin
     [not found]     ` <CAFCWPP+WmbjM0O2T9ODi-iVU1qGXjpk9V9LeE9PsuT7t+APLQA@mail.gmail.com>
     [not found]       ` <CAFCWPP+WmbjM0O2T9ODi-iVU1qGXjpk9V9LeE9PsuT7t+APLQA-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2020-05-06 14:26         ` Ilia Mirkin
     [not found]           ` <CAKb7Uvj6nMk2U6MD-iMXEWQzc4ok2xxuq7K3C8ti6mfFDqhuDw-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2020-05-06 14:38             ` Lucas Stach
     [not found]               ` <e681b4315b596dca39bb4a28866d509e23a150c1.camel-8ppwABl0HbeELgA04lAiVw@public.gmane.org>
2020-05-06 14:42                 ` Ilia Mirkin
     [not found]                   ` <CAKb7Uvh8dvVTVbu15e2=7qb4dgoVbigrnjkYW6i7z5dsk4g3qQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2020-05-06 15:51                     ` Ilia Mirkin
     [not found]                       ` <20200506211015.GA473@ishi>
     [not found]                         ` <CAKb7Uvi6g5Y3d9tqz4=JFoyQ3hk169konLaW_UVfNGnZ-oisQg@mail.gmail.com>
     [not found]                           ` <20200506215859.GA7599@ishi>
     [not found]                             ` <CAKb7UvioQ5P-vCKPB-aHqbyV58qDvTUeHQeJYnFZkWQfJXgshg@mail.gmail.com>
     [not found]                               ` <20200507041147.GA455@ishi>
2020-05-07 13:56                                 ` Ilia Mirkin
2020-05-06 15:34                 ` Milan Buška
2020-05-08  8:34                 ` Milan Buška
     [not found]                   ` <CAFCWPPKhbbk=um2pv+ytgd+WVaT+M=-mLXXAR427QgQj=w_q3A-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2020-05-08 13:27                     ` Ilia Mirkin
     [not found]                       ` <CAKb7Uvi7-UCoEb7GJmT2CseMkhrkg4wO5vfk06KhrVWYfAP9WQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2020-05-08 15:12                         ` Milan Buška
     [not found]                           ` <CAFCWPPJVwVrb5atD+Ny4rOxwPJQCrYeZzXQJN4k6yzJtyR-FEQ-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2020-05-08 15:19                             ` Ilia Mirkin
     [not found]                               ` <CAKb7UvjAkKAHFSd2Dggf2JY5GPeGB_kQTcR1EM3QucP1VvOC0A-JsoAwUIsXosN+BqQ9rBEUg@public.gmane.org>
2020-05-09  5:47                                 ` Milan Buška
2020-05-06 14:28         ` Fwd: " Milan Buška

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.