All of lore.kernel.org
 help / color / mirror / Atom feed
* EEH error in doing DMA with PEX 8619
@ 2017-04-10 12:22 IanJiang
  2017-04-10 22:24 ` Gavin Shan
  0 siblings, 1 reply; 11+ messages in thread
From: IanJiang @ 2017-04-10 12:22 UTC (permalink / raw)
  To: linuxppc-dev

Hi all!

I am porting PLX driver for PEX 8619 to a power8 machine with CentOS-7.3.
The PEX 8619 is used as an NTB (Non-Transparent Bridge).

First, two DMA buffer are allocated with dma_alloc_coherent() and the
physical address are:
src: 0x 00000000_60600000
dst: 0x 00000000_60800000
Then, a DMA transfer is started and an EEH is reported in dmesg.

This DMA test is OK at an x86_64 platform.

Here are the details. Any suggestion is appreciated! 

[root@localhost ~]# uname -r
3.10.0-514.10.2.el7.ppc64le
[root@localhost ~]# cat /etc/system-release
CentOS Linux release 7.3.1611 (AltArch)
[root@localhost ~]# dmesg --clear
[root@localhost ~]# dmesg -w
[72579.982217] usb 1-1.3: USB disconnect, device number 61
[72581.516186] usb 1-1.3: new low-speed USB device number 62 using xhci_hcd
[72581.643767] usb 1-1.3: New USB device found, idVendor=04ca,
idProduct=0061
[72581.644045] usb 1-1.3: New USB device strings: Mfr=1, Product=2,
SerialNumber                                          =0
[72581.644135] usb 1-1.3: Product: USB Optical Mouse
[72581.644184] usb 1-1.3: Manufacturer: PixArt
[72581.680383] input: PixArt USB Optical Mouse as
/devices/pci0003:00/0003:00:00                                         
.0/0003:01:00.0/0003:02:09.0/0003:0d:00.0/usb1/1-1/1-1.3/1-1.3:1.0/input/input12                                         
46
[72581.680806] hid-generic 0003:04CA:0061.04DF: input,hidraw1: USB HID v1.11
Mou                                          se [PixArt USB Optical Mouse]
on usb-0003:0d:00.0-1.3/input0

[72582.424769] Plx8000_NT:
<====================================================                                         
====>
[72582.425013] Plx8000_NT: PLX 8000_NT driver v7.25 (64-bit)
[72582.425058] Plx8000_NT: Supports Linux kernel
v3.10.0-514.10.2.el7.ppc64le
[72582.425115] Plx8000_NT: Allocated global driver object (c000003c8427cc00)
[72582.425120] Plx8000_NT: Registered driver (MajorID = 247)
[72582.425161] Plx8000_NT:    --------------------
[72582.425167] Plx8000_NT: Probe: 8619 10B5 [D1 01:00.1]
[72582.425180] Plx8000_NT: Probe: -- Unsupported Device --
[72582.425204] Plx8000_NT:    --------------------
[72582.425206] Plx8000_NT: Probe: 8619 10B5 [D1 02:01.0]
[72582.425222] Plx8000_NT: Enabled PCI device
[72582.425233] Plx8000_NT: Created Device (Plx8000_NT-0)
[72582.425235] Plx8000_NT: Start: 8619 10B5 [D1 02:01.0]
[72582.425237] Debug StartDevice 723: Reading PCI header command...
[72582.425385] Debug StartDevice 725: Reading PCI header command... =
0x100146
[72582.425445] Plx8000_NT:    Resource 00
[72582.425447] Plx8000_NT:      Type     : Memory
[72582.425452] Plx8000_NT:      PCI BAR 0: 81000000
[72582.425454] Plx8000_NT:      Phys Addr: 3FE081000000
[72582.425456] Plx8000_NT:      Size     : 20000h (128KB)
[72582.425458] Plx8000_NT:      Property : Non-Prefetchable 32-bit
[72582.425475] Plx8000_NT:      Kernel VA: d000080081480000
[72582.425478] Debug StartDevice 841: Read BAR0[0xd000080081480000] after
map...
[72582.425551] Debug StartDevice 843: Read BAR0[0xd000080081480000] after
map...                                           = 0x861910b5
[72582.425621] Plx8000_NT:    Resource 01
[72582.425622] Plx8000_NT:      Type     : Memory
[72582.425627] Plx8000_NT:      PCI BAR 2: 80000000
[72582.425629] Plx8000_NT:      Phys Addr: 3FE080000000
[72582.425631] Plx8000_NT:      Size     : 400000h (4MB)
[72582.425633] Plx8000_NT:      Property : Non-Prefetchable 32-bit
[72582.425639] Plx8000_NT:      Kernel VA: d000080084000000
[72582.425641] Debug StartDevice 849: Read BAR2[0xd000080084000000] after
map...
[72582.425727] Debug StartDevice 851: Read BAR2[0xd000080084000000] after
map...                                           = 0xf000eef3
[72582.425798] Plx8000_NT:    Resource 02
[72582.425799] Plx8000_NT:      Type     : Memory
[72582.425804] Plx8000_NT:      PCI BAR 3: 80400000
[72582.425806] Plx8000_NT:      Phys Addr: 3FE080400000
[72582.425808] Plx8000_NT:      Size     : 400000h (4MB)
[72582.425809] Plx8000_NT:      Property : Non-Prefetchable 32-bit
[72582.425813] Plx8000_NT:      Kernel VA: d000080084800000
[72582.425815] Plx8000_NT:    Resource 03
[72582.425816] Plx8000_NT:      Type     : Memory
[72582.425821] Plx8000_NT:      PCI BAR 4: 80800000
[72582.425822] Plx8000_NT:      Phys Addr: 3FE080800000
[72582.425824] Plx8000_NT:      Size     : 400000h (4MB)
[72582.425826] Plx8000_NT:      Property : Non-Prefetchable 32-bit
[72582.425830] Plx8000_NT:      Kernel VA: d000080085000000
[72582.425831] Plx8000_NT:    Resource 04
[72582.425832] Plx8000_NT:      Type     : Memory
[72582.425837] Plx8000_NT:      PCI BAR 5: 80C00000
[72582.425839] Plx8000_NT:      Phys Addr: 3FE080C00000
[72582.425841] Plx8000_NT:      Size     : 400000h (4MB)
[72582.425842] Plx8000_NT:      Property : Non-Prefetchable 32-bit
[72582.425846] Plx8000_NT:      Kernel VA: d000080085800000
[72582.425848] Debug StartDevice 862: Reading PCI header command...
[72582.425911] Debug StartDevice 864: Reading PCI header command... =
0x100146
[72582.426048] Plx8000_NT: Device 8619_10B5 = 8619 rev BA
[72582.426051] Plx8000_NT: Device in NT LEGACY mode
[72582.426053] Debug StartDevice 891: Read BAR0[0xd000080081480000] before
PlxDe                                          termineNtPortSide...
[72582.426136] Debug StartDevice 893: Read BAR0[0xd000080081480000] before
PlxDe                                          termineNtPortSide map... =
0x861910b5
[72582.426244] Plx8000_NT: NT port is VIRTUAL-side (NT base=10000h)
[72582.426246] Debug StartDevice 901: Read BAR0[0xd000080081480000] after
PlxDet                                          ermineNtPortSide...
[72582.426330] Debug StartDevice 903: Read BAR0[0xd000080081480000] after
PlxDet                                          ermineNtPortSide map... =
0x861910b5
[72582.426492] Plx8000_NT: MSI enabled, change IRQ 249 --> 499
[72582.426494] Plx8000_NT:    Resource 05
[72582.426496] Plx8000_NT:      Type     : Interrupt (MSI)
[72582.426498] Plx8000_NT:      IRQ      : 499 [1F3h]
[72582.426508] Plx8000_NT:      MSI Addr : 10000000
[72582.426513] Plx8000_NT: _00000000
[72582.426518] Plx8000_NT:      MSI Data : 0001
[72582.426538] Plx8000_NT: Installed ISR for interrupt
[72582.430260] Plx8000_NT:    --------------------
[72582.430266] Plx8000_NT: Probe: 87D0 10B5 [D3 01:00.1]
[72582.430280] Plx8000_NT: Probe: -- Unsupported Device --
[72582.430302] Plx8000_NT:    --------------------
[72582.430305] Plx8000_NT: Probe: 87D0 10B5 [D3 01:00.2]
[72582.430312] Plx8000_NT: Probe: -- Unsupported Device --
[72582.430331] Plx8000_NT:    --------------------
[72582.430334] Plx8000_NT: Probe: 87D0 10B5 [D3 01:00.3]
[72582.430341] Plx8000_NT: Probe: -- Unsupported Device --
[72582.430359] Plx8000_NT:    --------------------
[72582.430362] Plx8000_NT: Probe: 87D0 10B5 [D3 01:00.4]
[72582.430370] Plx8000_NT: Probe: -- Unsupported Device --
[72582.430418] Plx8000_NT: Attempt to allocate physical memory (8KB)
[72582.430434] Plx8000_NT: Allocated physical memory...
[72582.430436] Plx8000_NT:     CPU Phys Addr: 1fcb980000
[72582.430438] Plx8000_NT:     Bus Phys Addr: 605f0000
[72582.430440] Plx8000_NT:     Kernel VA    : c000001fcb980000
[72582.430442] Plx8000_NT:     Size         : 2000h (8KB)
[72582.430444] Plx8000_NT:    --------------------
[72582.430446] Plx8000_NT: Added: 1 device
[72582.430447] Plx8000_NT: ...driver loaded


[72584.344506] Plx8000_DMA:
<===================================================                                         
=====>
[72584.344730] Plx8000_DMA: PLX 8000_DMA driver v7.25 (64-bit)
[72584.344779] Plx8000_DMA: Supports Linux kernel
v3.10.0-514.10.2.el7.ppc64le
[72584.344838] Plx8000_DMA: Allocated global driver object
(c000003c8743e400)
[72584.344901] Plx8000_DMA: Registered driver (MajorID = 246)
[72584.345195] Plx8000_DMA:    --------------------
[72584.345248] Plx8000_DMA: Probe: 8619 10B5 [D1 01:00.1]
[72584.345307] Plx8000_DMA: Enabled PCI device
[72584.345352] PLX 8000 DMA Driver 0001:01:00.1: Using 32-bit DMA via iommu
[72584.345410] Plx8000_DMA: Set DMA bit mask to 48-bits
[72584.345459] Plx8000_DMA: Created Device (Plx8000_DMA-0)
[72584.345507] Plx8000_DMA: Start: 8619 10B5 [D1 01:00.1]
[72584.345555] Plx8000_DMA:    Resource 00
[72584.345591] Plx8000_DMA:      Type     : Memory
[72584.345643] Plx8000_DMA:      PCI BAR 0: 81820000
[72584.345690] Plx8000_DMA:      Phys Addr: 3FE081820000
[72584.345737] Plx8000_DMA:      Size     : 20000h (128KB)
[72584.345785] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
[72584.345850] Plx8000_DMA:      Kernel VA: d0000800814c0000
[72584.345946] Plx8000_DMA: Device 8619_10B5 = 8619 rev BA
[72584.346042] Plx8000_DMA: MSI enabled, change IRQ 249 --> 500
[72584.346101] Plx8000_DMA:    Resource 01
[72584.346137] Plx8000_DMA:      Type     : Interrupt (MSI)
[72584.346201] Plx8000_DMA:      IRQ      : 500 [1F4h]
[72584.346257] Plx8000_DMA:      MSI Addr : 10000000
[72584.346309] Plx8000_DMA: _00000000
[72584.346360] Plx8000_DMA:      MSI Data : 0002
[72584.346421] Plx8000_DMA: Installed ISR for interrupt
[72584.346492] Plx8000_DMA:    --------------------
[72584.346545] Plx8000_DMA: Probe: 87D0 10B5 [D3 01:00.1]
[72584.346716] Plx8000_DMA: Enabled PCI device
[72584.346764] PLX 8000 DMA Driver 0003:01:00.1: Using 32-bit DMA via iommu
[72584.346824] Plx8000_DMA: Set DMA bit mask to 48-bits
[72584.346877] Plx8000_DMA: Created Device (Plx8000_DMA-1)
[72584.346925] Plx8000_DMA: Start: 87D0 10B5 [D3 01:00.1]
[72584.346974] Plx8000_DMA:    Resource 00
[72584.347011] Plx8000_DMA:      Type     : Memory
[72584.347064] Plx8000_DMA:      PCI BAR 0: 83040000
[72584.347113] Plx8000_DMA:      Phys Addr: 3FE883040000
[72584.347162] Plx8000_DMA:      Size     : 2000h (8KB)
[72584.347210] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
[72584.347540] Plx8000_DMA:      Kernel VA: d000080081500000
[72584.347682] Plx8000_DMA: Device 87D0_10B5 = 8725 rev CA
[72584.347978] Plx8000_DMA: MSI enabled, change IRQ 251 --> 272
[72584.348035] Plx8000_DMA:    Resource 01
[72584.348070] Plx8000_DMA:      Type     : Interrupt (MSI)
[72584.348120] Plx8000_DMA:      IRQ      : 272 [110h]
[72584.348178] Plx8000_DMA:      MSI Addr : 10000000
[72584.348233] Plx8000_DMA: _00000000
[72584.348287] Plx8000_DMA:      MSI Data : 0010
[72584.348591] Plx8000_DMA: Installed ISR for interrupt
[72584.348679] Plx8000_DMA:    --------------------
[72584.348729] Plx8000_DMA: Probe: 87D0 10B5 [D3 01:00.2]
[72584.348816] Plx8000_DMA: Enabled PCI device
[72584.348862] PLX 8000 DMA Driver 0003:01:00.2: Using 32-bit DMA via iommu
[72584.348923] Plx8000_DMA: Set DMA bit mask to 48-bits
[72584.348969] Plx8000_DMA: Created Device (Plx8000_DMA-2)
[72584.349020] Plx8000_DMA: Start: 87D0 10B5 [D3 01:00.2]
[72584.349067] Plx8000_DMA:    Resource 00
[72584.349103] Plx8000_DMA:      Type     : Memory
[72584.349157] Plx8000_DMA:      PCI BAR 0: 83042000
[72584.349204] Plx8000_DMA:      Phys Addr: 3FE883042000
[72584.349254] Plx8000_DMA:      Size     : 2000h (8KB)
[72584.349302] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
[72584.349363] Plx8000_DMA:      Kernel VA: d000080081522000
[72584.349506] Plx8000_DMA: Device 87D0_10B5 = 8725 rev CA
[72584.349583] Plx8000_DMA: MSI enabled, change IRQ 251 --> 273
[72584.349644] Plx8000_DMA:    Resource 01
[72584.349678] Plx8000_DMA:      Type     : Interrupt (MSI)
[72584.349727] Plx8000_DMA:      IRQ      : 273 [111h]
[72584.349785] Plx8000_DMA:      MSI Addr : 10000000
[72584.349838] Plx8000_DMA: _00000000
[72584.349889] Plx8000_DMA:      MSI Data : 0011
[72584.349949] Plx8000_DMA: Installed ISR for interrupt
[72584.368388] Plx8000_DMA:    --------------------
[72584.391876] Plx8000_DMA: Probe: 87D0 10B5 [D3 01:00.3]
[72584.425867] Plx8000_DMA: Enabled PCI device
[72584.450961] PLX 8000 DMA Driver 0003:01:00.3: Using 32-bit DMA via iommu
[72584.483472] Plx8000_DMA: Set DMA bit mask to 48-bits
[72584.509006] Plx8000_DMA: Created Device (Plx8000_DMA-3)
[72584.525950] Plx8000_DMA: Start: 87D0 10B5 [D3 01:00.3]
[72584.541772] Plx8000_DMA:    Resource 00
[72584.541812] Plx8000_DMA:      Type     : Memory
[72584.559059] Plx8000_DMA:      PCI BAR 0: 83044000
[72584.575990] Plx8000_DMA:      Phys Addr: 3FE883044000
[72584.624617] Plx8000_DMA:      Size     : 2000h (8KB)
[72584.624664] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
[72584.723477] Plx8000_DMA:      Kernel VA: d000080081544000
[72584.723649] Plx8000_DMA: Device 87D0_10B5 = 8725 rev CA
[72584.763734] Plx8000_DMA: MSI enabled, change IRQ 251 --> 274
[72584.803059] Plx8000_DMA:    Resource 01
[72584.874235] Plx8000_DMA:      Type     : Interrupt (MSI)
[72584.912277] Plx8000_DMA:      IRQ      : 274 [112h]
[72584.963428] Plx8000_DMA:      MSI Addr : 10000000
[72585.026007] Plx8000_DMA: _00000000
[72585.026061] Plx8000_DMA:      MSI Data : 0012
[72585.073093] Plx8000_DMA: Installed ISR for interrupt
[72585.122892] Plx8000_DMA:    --------------------
[72585.144207] Plx8000_DMA: Probe: 87D0 10B5 [D3 01:00.4]
[72585.193044] Plx8000_DMA: Enabled PCI device
[72585.193094] PLX 8000 DMA Driver 0003:01:00.4: Using 32-bit DMA via iommu
[72585.263429] Plx8000_DMA: Set DMA bit mask to 48-bits
[72585.263478] Plx8000_DMA: Created Device (Plx8000_DMA-4)
[72585.294337] Plx8000_DMA: Start: 87D0 10B5 [D3 01:00.4]
[72585.323464] Plx8000_DMA:    Resource 00
[72585.354389] Plx8000_DMA:      Type     : Memory
[72585.392937] Plx8000_DMA:      PCI BAR 0: 83046000
[72585.392987] Plx8000_DMA:      Phys Addr: 3FE883046000
[72585.414362] Plx8000_DMA:      Size     : 2000h (8KB)
[72585.462987] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
[72585.493881] Plx8000_DMA:      Kernel VA: d000080081566000
[72585.543127] Plx8000_DMA: Device 87D0_10B5 = 8725 rev CA
[72585.583609] Plx8000_DMA: MSI enabled, change IRQ 251 --> 275
[72585.683382] Plx8000_DMA:    Resource 01
[72585.718783] Plx8000_DMA:      Type     : Interrupt (MSI)
[72585.775014] Plx8000_DMA:      IRQ      : 275 [113h]
[72585.815631] Plx8000_DMA:      MSI Addr : 10000000
[72585.815686] Plx8000_DMA: _00000000
[72585.893318] Plx8000_DMA:      MSI Data : 0013
[72585.933506] Plx8000_DMA: Installed ISR for interrupt
[72585.974842] Plx8000_DMA: Attempt to allocate physical memory (64KB)
[72586.033768] Plx8000_DMA: Allocated physical memory...
[72586.054260] Plx8000_DMA:     CPU Phys Addr: 1fc0db0000
[72586.102799] Plx8000_DMA:     Bus Phys Addr: 60010000
[72586.102848] Plx8000_DMA:     Kernel VA    : c000001fc0db0000
[72586.125801] Plx8000_DMA:     Size         : 10000h (64KB)
[72586.162839] Plx8000_DMA:    --------------------
[72586.183867] Plx8000_DMA: Added: 5 devices
[72586.222818] Plx8000_DMA: ...driver loaded

[72620.662060] Plx8000_NT:
[72620.662064] Plx8000_NT: Received message ==> OPEN_DEVICE
[72620.662066] Plx8000_NT: Open device (Plx8000_NT-0)...
[72620.662068] Plx8000_NT: ...device opened
[72620.662071] Plx8000_NT:
[72620.662073] Plx8000_NT: Received PLX message ===>
[72620.662074] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72620.662076] Plx8000_NT: ...Completed message
[72620.662078] Plx8000_NT:
[72620.662080] Plx8000_NT: Received PLX message ===>
[72620.662081] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72620.662085] Plx8000_NT: Criteria matched device 8619_10B5 [02:01.0]
[72620.662086] Plx8000_NT: ...Completed message
[72620.662090] Plx8000_NT:
[72620.662091] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72620.662093] Plx8000_NT: Close device (Plx8000_NT-0)...
[72620.662095] Plx8000_NT: ...device closed
[72620.662101] Plx8000_NT:
[72620.662103] Plx8000_NT: Received message ==> OPEN_DEVICE
[72620.662104] Plx8000_NT: Open device (Plx8000_NT-0)...
[72620.662106] Plx8000_NT: ...device opened
[72620.662108] Plx8000_NT:
[72620.662109] Plx8000_NT: Received PLX message ===>
[72620.662111] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72620.662112] Plx8000_NT: ...Completed message
[72620.662118] Plx8000_NT:
[72620.662119] Plx8000_NT: Received PLX message ===>
[72620.662121] Plx8000_NT: PLX_IOCTL_GET_PORT_PROPERTIES
[72620.662164] Plx8000_NT: [D1 02:01.0] P=1 T=0 MPS=512/2048 MRR=128
L=G2x4/G2x8
[72620.662166] Plx8000_NT: ...Completed message
[72620.662168] Plx8000_NT:
[72620.662170] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72620.662171] Plx8000_NT: Close device (Plx8000_NT-0)...
[72620.662173] Plx8000_NT: ...device closed
[72620.662199] Plx8000_NT:
[72620.662201] Plx8000_NT: Received message ==> OPEN_DEVICE
[72620.662203] Plx8000_NT: Open device (Plx8000_NT-0)...
[72620.662204] Plx8000_NT: ...device opened
[72620.662206] Plx8000_NT:
[72620.662208] Plx8000_NT: Received PLX message ===>
[72620.662209] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72620.662210] Plx8000_NT: ...Completed message
[72620.662212] Plx8000_NT:
[72620.662214] Plx8000_NT: Received PLX message ===>
[72620.662215] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72620.662216] Plx8000_NT: Criteria did not match any devices
[72620.662218] Plx8000_NT: ...Completed message
[72620.662220] Plx8000_NT:
[72620.662222] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72620.662223] Plx8000_NT: Close device (Plx8000_NT-0)...
[72620.662225] Plx8000_NT: ...device closed
[72620.662232] Plx8000_DMA:
[72620.662329] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72620.662514] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72620.662563] Plx8000_DMA: ...device opened
[72620.662600] Plx8000_DMA:
[72620.662626] Plx8000_DMA: Received PLX message ===>
[72620.662674] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72620.662901] Plx8000_DMA: ...Completed message
[72620.662959] PLX DMA[Dispatch_IoControl-1053]
[72620.663009] PLX DMA[Dispatch_IoControl-1061]
[72620.663057] Plx8000_DMA:
[72620.663081] Plx8000_DMA: Received PLX message ===>
[72620.663130] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[72620.663193] Plx8000_DMA: Criteria matched device 8619_10B5 [01:00.1]
[72620.663255] Plx8000_DMA: ...Completed message
[72620.663303] PLX DMA[Dispatch_IoControl-1053]
[72620.663351] PLX DMA[Dispatch_IoControl-1061]
[72620.663400] Plx8000_DMA:
[72620.663425] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72620.663474] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72620.663522] Plx8000_DMA: ...device closed
[72620.663561] Plx8000_DMA:
[72620.663588] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72620.663635] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72620.663684] Plx8000_DMA: ...device opened
[72620.663721] Plx8000_DMA:
[72620.663746] Plx8000_DMA: Received PLX message ===>
[72620.663794] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72620.663853] Plx8000_DMA: ...Completed message
[72620.663900] PLX DMA[Dispatch_IoControl-1053]
[72620.663949] PLX DMA[Dispatch_IoControl-1061]
[72620.663997] Plx8000_DMA:
[72620.664024] Plx8000_DMA: Received PLX message ===>
[72620.664071] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
[72620.664162] Plx8000_DMA: [D1 01:00.1] P=0 T=0 MPS=512/2048 MRR=512
L=G2x8/G2x                                          8
[72620.664233] Plx8000_DMA: ...Completed message
[72620.664280] PLX DMA[Dispatch_IoControl-1053]
[72620.664330] PLX DMA[Dispatch_IoControl-1061]
[72620.664381] Plx8000_DMA:
[72620.664406] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72620.664454] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72620.664501] Plx8000_DMA: ...device closed
[72620.664565] Plx8000_NT:
[72620.664567] Plx8000_NT: Received message ==> OPEN_DEVICE
[72620.664568] Plx8000_NT: Open device (Plx8000_NT-0)...
[72620.664570] Plx8000_NT: ...device opened
[72620.664572] Plx8000_NT:
[72620.664573] Plx8000_NT: Received PLX message ===>
[72620.664574] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72620.664576] Plx8000_NT: ...Completed message
[72620.664578] Plx8000_NT:
[72620.664579] Plx8000_NT: Received PLX message ===>
[72620.664580] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72620.664582] Plx8000_NT: Criteria did not match any devices
[72620.664583] Plx8000_NT: ...Completed message
[72620.664586] Plx8000_NT:
[72620.664587] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72620.664589] Plx8000_NT: Close device (Plx8000_NT-0)...
[72620.664590] Plx8000_NT: ...device closed
[72620.664595] Plx8000_DMA:
[72620.664620] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72620.664669] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72620.664716] Plx8000_DMA: ...device opened
[72620.664754] Plx8000_DMA:
[72620.664779] Plx8000_DMA: Received PLX message ===>
[72620.664828] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72620.664886] Plx8000_DMA: ...Completed message
[72620.664934] PLX DMA[Dispatch_IoControl-1053]
[72620.664983] PLX DMA[Dispatch_IoControl-1061]
[72620.665031] Plx8000_DMA:
[72620.665056] Plx8000_DMA: Received PLX message ===>
[72620.665102] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[72620.665164] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.1]
[72620.665223] Plx8000_DMA: ...Completed message
[72620.665272] PLX DMA[Dispatch_IoControl-1053]
[72620.665318] PLX DMA[Dispatch_IoControl-1061]
[72620.665368] Plx8000_DMA:
[72620.665393] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72620.665440] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72620.665489] Plx8000_DMA: ...device closed
[72620.665531] Plx8000_DMA:
[72620.665557] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72620.665605] Plx8000_DMA: Open device (Plx8000_DMA-1)...
[72620.665653] Plx8000_DMA: ...device opened
[72620.665689] Plx8000_DMA:
[72620.665715] Plx8000_DMA: Received PLX message ===>
[72620.665763] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72620.665834] Plx8000_DMA: ...Completed message
[72620.665886] PLX DMA[Dispatch_IoControl-1053]
[72620.665939] PLX DMA[Dispatch_IoControl-1061]
[72620.666105] Plx8000_DMA:
[72620.666140] Plx8000_DMA: Received PLX message ===>
[72620.666187] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
[72620.666301] Plx8000_DMA: [D3 01:00.1] P=0 T=0 MPS=128/2048 MRR=512
L=G3x8/G3x                                          8
[72620.666372] Plx8000_DMA: ...Completed message
[72620.666420] PLX DMA[Dispatch_IoControl-1053]
[72620.666469] PLX DMA[Dispatch_IoControl-1061]
[72620.667012] Plx8000_DMA:
[72620.667046] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72620.667097] Plx8000_DMA: Close device (Plx8000_DMA-1)...
[72620.667145] Plx8000_DMA: ...device closed
[72620.674539] Plx8000_NT:
[72620.674542] Plx8000_NT: Received message ==> OPEN_DEVICE
[72620.674544] Plx8000_NT: Open device (Plx8000_NT-0)...
[72620.674545] Plx8000_NT: ...device opened
[72620.674548] Plx8000_NT:
[72620.674550] Plx8000_NT: Received PLX message ===>
[72620.674551] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72620.674552] Plx8000_NT: ...Completed message
[72620.674555] Plx8000_NT:
[72620.674556] Plx8000_NT: Received PLX message ===>
[72620.674557] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72620.674559] Plx8000_NT: Criteria did not match any devices
[72620.674560] Plx8000_NT: ...Completed message
[72620.674563] Plx8000_NT:
[72620.674564] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72620.674566] Plx8000_NT: Close device (Plx8000_NT-0)...
[72620.674567] Plx8000_NT: ...device closed
[72620.674573] Plx8000_DMA:
[72620.688083] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72620.721345] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72620.721407] Plx8000_DMA: ...device opened
[72620.749338] Plx8000_DMA:
[72620.784093] Plx8000_DMA: Received PLX message ===>
[72620.814563] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72620.814627] Plx8000_DMA: ...Completed message
[72620.850722] PLX DMA[Dispatch_IoControl-1053]
[72620.877291] PLX DMA[Dispatch_IoControl-1061]
[72620.897461] Plx8000_DMA:
[72620.897492] Plx8000_DMA: Received PLX message ===>
[72620.910914] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[72620.925179] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.2]
[72620.938493] Plx8000_DMA: ...Completed message
[72620.951754] PLX DMA[Dispatch_IoControl-1053]
[72620.951805] PLX DMA[Dispatch_IoControl-1061]
[72620.975647] Plx8000_DMA:
[72620.989780] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72621.003227] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72621.023490] Plx8000_DMA: ...device closed
[72621.023542] Plx8000_DMA:
[72621.036780] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72621.050892] Plx8000_DMA: Open device (Plx8000_DMA-2)...
[72621.071011] Plx8000_DMA: ...device opened
[72621.071052] Plx8000_DMA:
[72621.085311] Plx8000_DMA: Received PLX message ===>
[72621.101914] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72621.122340] Plx8000_DMA: ...Completed message
[72621.122389] PLX DMA[Dispatch_IoControl-1053]
[72621.136920] PLX DMA[Dispatch_IoControl-1061]
[72621.156000] Plx8000_DMA:
[72621.156026] Plx8000_DMA: Received PLX message ===>
[72621.170272] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
[72621.187182] Plx8000_DMA: [D3 01:00.2] P=0 T=0 MPS=128/2048 MRR=512
L=G3x8/G3x                                          8
[72621.203441] Plx8000_DMA: ...Completed message
[72621.243534] PLX DMA[Dispatch_IoControl-1053]
[72621.263526] PLX DMA[Dispatch_IoControl-1061]
[72621.263585] Plx8000_DMA:
[72621.295098] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72621.329212] Plx8000_DMA: Close device (Plx8000_DMA-2)...
[72621.365777] Plx8000_DMA: ...device closed
[72621.390445] Plx8000_NT:
[72621.390447] Plx8000_NT: Received message ==> OPEN_DEVICE
[72621.390449] Plx8000_NT: Open device (Plx8000_NT-0)...
[72621.390450] Plx8000_NT: ...device opened
[72621.390452] Plx8000_NT:
[72621.390454] Plx8000_NT: Received PLX message ===>
[72621.390455] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72621.390456] Plx8000_NT: ...Completed message
[72621.390459] Plx8000_NT:
[72621.390460] Plx8000_NT: Received PLX message ===>
[72621.390461] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72621.390463] Plx8000_NT: Criteria did not match any devices
[72621.390464] Plx8000_NT: ...Completed message
[72621.390467] Plx8000_NT:
[72621.390468] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72621.390469] Plx8000_NT: Close device (Plx8000_NT-0)...
[72621.390471] Plx8000_NT: ...device closed
[72621.390476] Plx8000_DMA:
[72621.390501] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72621.404723] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72621.418244] Plx8000_DMA: ...device opened
[72621.418286] Plx8000_DMA:
[72621.440859] Plx8000_DMA: Received PLX message ===>
[72621.454357] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72621.468819] Plx8000_DMA: ...Completed message
[72621.468866] PLX DMA[Dispatch_IoControl-1053]
[72621.491825] PLX DMA[Dispatch_IoControl-1061]
[72621.516713] Plx8000_DMA:
[72621.516737] Plx8000_DMA: Received PLX message ===>
[72621.537072] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[72621.551432] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.3]
[72621.566411] Plx8000_DMA: ...Completed message
[72621.580141] PLX DMA[Dispatch_IoControl-1053]
[72621.594692] PLX DMA[Dispatch_IoControl-1061]
[72621.594740] Plx8000_DMA:
[72621.617798] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72621.648656] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72621.662346] Plx8000_DMA: ...device closed
[72621.662401] Plx8000_DMA:
[72621.682871] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72621.696230] Plx8000_DMA: Open device (Plx8000_DMA-3)...
[72621.710158] Plx8000_DMA: ...device opened
[72621.729888] Plx8000_DMA:
[72621.729914] Plx8000_DMA: Received PLX message ===>
[72621.746422] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72621.764337] Plx8000_DMA: ...Completed message
[72621.764386] PLX DMA[Dispatch_IoControl-1053]
[72621.783654] PLX DMA[Dispatch_IoControl-1061]
[72621.797773] Plx8000_DMA:
[72621.797800] Plx8000_DMA: Received PLX message ===>
[72621.816946] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
[72621.831298] Plx8000_DMA: [D3 01:00.3] P=0 T=0 MPS=128/2048 MRR=512
L=G3x8/G3x                                          8
[72621.838937] Plx8000_DMA: ...Completed message
[72621.859531] PLX DMA[Dispatch_IoControl-1053]
[72621.876356] PLX DMA[Dispatch_IoControl-1061]
[72621.904158] Plx8000_DMA:
[72621.904195] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72621.925981] Plx8000_DMA: Close device (Plx8000_DMA-3)...
[72621.944936] Plx8000_DMA: ...device closed
[72621.989960] Plx8000_NT:
[72621.989964] Plx8000_NT: Received message ==> OPEN_DEVICE
[72621.989966] Plx8000_NT: Open device (Plx8000_NT-0)...
[72621.989968] Plx8000_NT: ...device opened
[72621.989972] Plx8000_NT:
[72621.989973] Plx8000_NT: Received PLX message ===>
[72621.989975] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72621.989976] Plx8000_NT: ...Completed message
[72621.989979] Plx8000_NT:
[72621.989980] Plx8000_NT: Received PLX message ===>
[72621.989982] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72621.989984] Plx8000_NT: Criteria did not match any devices
[72621.989985] Plx8000_NT: ...Completed message
[72621.989988] Plx8000_NT:
[72621.989989] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72621.989991] Plx8000_NT: Close device (Plx8000_NT-0)...
[72621.989993] Plx8000_NT: ...device closed
[72621.989999] Plx8000_DMA:
[72621.990030] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72622.014908] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72622.036527] Plx8000_DMA: ...device opened
[72622.071746] Plx8000_DMA:
[72622.071776] Plx8000_DMA: Received PLX message ===>
[72622.097789] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72622.121519] Plx8000_DMA: ...Completed message
[72622.149769] PLX DMA[Dispatch_IoControl-1053]
[72622.149819] PLX DMA[Dispatch_IoControl-1061]
[72622.185960] Plx8000_DMA:
[72622.204154] Plx8000_DMA: Received PLX message ===>
[72622.204203] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[72622.253643] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.4]
[72622.277435] Plx8000_DMA: ...Completed message
[72622.318961] PLX DMA[Dispatch_IoControl-1053]
[72622.334719] PLX DMA[Dispatch_IoControl-1061]
[72622.354444] Plx8000_DMA:
[72622.354472] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72622.370664] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72622.384686] Plx8000_DMA: ...device closed
[72622.405990] Plx8000_DMA:
[72622.406017] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72622.419743] Plx8000_DMA: Open device (Plx8000_DMA-4)...
[72622.439662] Plx8000_DMA: ...device opened
[72622.460550] Plx8000_DMA:
[72622.460577] Plx8000_DMA: Received PLX message ===>
[72622.474601] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72622.488847] Plx8000_DMA: ...Completed message
[72622.502673] PLX DMA[Dispatch_IoControl-1053]
[72622.502723] PLX DMA[Dispatch_IoControl-1061]
[72622.523509] Plx8000_DMA:
[72622.523535] Plx8000_DMA: Received PLX message ===>
[72622.537498] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
[72622.551921] Plx8000_DMA: [D3 01:00.4] P=0 T=0 MPS=128/2048 MRR=512
L=G3x8/G3x                                          8
[72622.584958] Plx8000_DMA: ...Completed message
[72622.585008] PLX DMA[Dispatch_IoControl-1053]
[72622.606013] PLX DMA[Dispatch_IoControl-1061]
[72622.620766] Plx8000_DMA:
[72622.620792] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72622.641251] Plx8000_DMA: Close device (Plx8000_DMA-4)...
[72622.656250] Plx8000_DMA: ...device closed
[72622.670281] Plx8000_NT:
[72622.670283] Plx8000_NT: Received message ==> OPEN_DEVICE
[72622.670284] Plx8000_NT: Open device (Plx8000_NT-0)...
[72622.670286] Plx8000_NT: ...device opened
[72622.670288] Plx8000_NT:
[72622.670289] Plx8000_NT: Received PLX message ===>
[72622.670290] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72622.670292] Plx8000_NT: ...Completed message
[72622.670294] Plx8000_NT:
[72622.670295] Plx8000_NT: Received PLX message ===>
[72622.670296] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72622.670298] Plx8000_NT: Criteria did not match any devices
[72622.670299] Plx8000_NT: ...Completed message
[72622.670301] Plx8000_NT:
[72622.670303] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72622.670304] Plx8000_NT: Close device (Plx8000_NT-0)...
[72622.670306] Plx8000_NT: ...device closed
[72622.670311] Plx8000_DMA:
[72622.670335] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72622.684743] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72622.711632] Plx8000_DMA: ...device opened
[72622.726153] Plx8000_DMA:
[72622.726179] Plx8000_DMA: Received PLX message ===>
[72622.747092] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72622.761392] Plx8000_DMA: ...Completed message
[72622.776033] PLX DMA[Dispatch_IoControl-1053]
[72622.790132] PLX DMA[Dispatch_IoControl-1061]
[72622.790180] Plx8000_DMA:
[72622.810504] Plx8000_DMA: Received PLX message ===>
[72622.828202] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[72622.841923] Plx8000_DMA: Criteria did not match any devices
[72622.857254] Plx8000_DMA: ...Completed message
[72622.857303] PLX DMA[Dispatch_IoControl-1053]
[72622.878595] PLX DMA[Dispatch_IoControl-1061]
[72622.909283] Plx8000_DMA:
[72622.909311] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72622.923149] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72622.943455] Plx8000_DMA: ...device closed
[72627.408076] Plx8000_NT:
[72627.408079] Plx8000_NT: Received message ==> OPEN_DEVICE
[72627.408081] Plx8000_NT: Open device (Plx8000_NT-0)...
[72627.408083] Plx8000_NT: ...device opened
[72627.408086] Plx8000_NT:
[72627.408087] Plx8000_NT: Received PLX message ===>
[72627.408088] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72627.408090] Plx8000_NT: ...Completed message
[72627.408451] Plx8000_NT:
[72627.408453] Plx8000_NT: Received PLX message ===>
[72627.408454] Plx8000_NT: PLX_IOCTL_PCI_BAR_PROPERTIES
[72627.408456] Plx8000_NT:     PCI BAR 2: 80000000
[72627.408458] Plx8000_NT:     Phys Addr: 3FE080000000
[72627.408460] Plx8000_NT:     Size     : 400000h (4MB)
[72627.408462] Plx8000_NT:     Property : Non-Prefetchable 32-bit
[72627.408464] Plx8000_NT: ...Completed message
[72627.408718] Plx8000_NT:
[72627.408720] Plx8000_NT: Received PLX message ===>
[72627.408721] Plx8000_NT: PLX_IOCTL_PCI_BAR_PROPERTIES
[72627.408723] Plx8000_NT:     PCI BAR 2: 80000000
[72627.408725] Plx8000_NT:     Phys Addr: 3FE080000000
[72627.408727] Plx8000_NT:     Size     : 400000h (4MB)
[72627.408728] Plx8000_NT:     Property : Non-Prefetchable 32-bit
[72627.408730] Plx8000_NT: ...Completed message
[72627.408976] Plx8000_NT:
[72627.408978] Plx8000_NT: Received message ===> MMAP
[72627.408979] Plx8000_NT: Map PCI BAR 2...
[72627.408983] Plx8000_NT: Mapped Phys (3fe080000000) ==> User VA
(3fff784e0000)
[72627.408984] Plx8000_NT: ...Completed message
[72627.409302] Plx8000_NT:
[72627.409321] Plx8000_NT: Received PLX message ===>
[72627.409322] Plx8000_NT: PLX_IOCTL_NT_LUT_ADD
[72627.409331] Plx8000_NT: Req ID (0000) already exists in LUT #0, skipping
upda                                          te
[72627.409333] Plx8000_NT: ...Completed message
[72627.409547] Plx8000_NT:
[72627.409548] Plx8000_NT: Received PLX message ===>
[72627.409550] Plx8000_NT: PLX_IOCTL_PHYSICAL_MEM_ALLOCATE
[72627.409552] Plx8000_NT: Attempt to allocate physical memory (1953KB)
[72627.409980] Plx8000_NT: Allocated physical memory...
[72627.409982] Plx8000_NT:     CPU Phys Addr: 1f9e400000
[72627.409984] Plx8000_NT:     Bus Phys Addr: 60600000
[72627.409985] Plx8000_NT:     Kernel VA    : c000001f9e400000
[72627.409987] Plx8000_NT:     Size         : 1E8480h (1MB)
[72627.409989] Plx8000_NT: ...Completed message
[72627.410061] Plx8000_NT:
[72627.410062] Plx8000_NT: Received message ===> MMAP
[72627.410065] Plx8000_NT: Mapped Phys (1f9e400000) ==> User VA
(3fff782f0000)
[72627.410066] Plx8000_NT: ...Completed message
[72627.410123] Plx8000_NT:
[72627.410124] Plx8000_NT: Received PLX message ===>
[72627.410126] Plx8000_NT: PLX_IOCTL_PHYSICAL_MEM_ALLOCATE
[72627.410128] Plx8000_NT: Attempt to allocate physical memory (1953KB)
[72627.410515] Plx8000_NT: Allocated physical memory...
[72627.410517] Plx8000_NT:     CPU Phys Addr: 1f82c00000
[72627.410519] Plx8000_NT:     Bus Phys Addr: 60800000
[72627.410520] Plx8000_NT:     Kernel VA    : c000001f82c00000
[72627.410522] Plx8000_NT:     Size         : 1E8480h (1MB)
[72627.410524] Plx8000_NT: ...Completed message
[72627.410595] Plx8000_NT:
[72627.410596] Plx8000_NT: Received message ===> MMAP
[72627.410599] Plx8000_NT: Mapped Phys (1f82c00000) ==> User VA
(3fff78100000)
[72627.410600] Plx8000_NT: ...Completed message
[72627.410710] Plx8000_NT:
[72627.410711] Plx8000_NT: Received message ==> OPEN_DEVICE
[72627.410713] Plx8000_NT: Open device (Plx8000_NT-0)...
[72627.410714] Plx8000_NT: ...device opened
[72627.410717] Plx8000_NT:
[72627.410718] Plx8000_NT: Received PLX message ===>
[72627.410720] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72627.410721] Plx8000_NT: ...Completed message
[72627.410723] Plx8000_NT:
[72627.410725] Plx8000_NT: Received PLX message ===>
[72627.410726] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72627.410729] Plx8000_NT: Criteria matched device 8619_10B5 [02:01.0]
[72627.410730] Plx8000_NT: ...Completed message
[72627.410733] Plx8000_NT:
[72627.410734] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72627.410750] Plx8000_NT: Close device (Plx8000_NT-0)...
[72627.410752] Plx8000_NT: ...device closed
[72627.410758] Plx8000_NT:
[72627.410760] Plx8000_NT: Received message ==> OPEN_DEVICE
[72627.410761] Plx8000_NT: Open device (Plx8000_NT-0)...
[72627.410763] Plx8000_NT: ...device opened
[72627.410765] Plx8000_NT:
[72627.410766] Plx8000_NT: Received PLX message ===>
[72627.410767] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72627.410769] Plx8000_NT: ...Completed message
[72627.410771] Plx8000_NT:
[72627.410772] Plx8000_NT: Received PLX message ===>
[72627.410773] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72627.410775] Plx8000_NT: Criteria did not match any devices
[72627.410776] Plx8000_NT: ...Completed message
[72627.410779] Plx8000_NT:
[72627.410780] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72627.410782] Plx8000_NT: Close device (Plx8000_NT-0)...
[72627.410783] Plx8000_NT: ...device closed
[72627.410789] Plx8000_DMA:
[72627.410872] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72627.411088] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72627.411139] Plx8000_DMA: ...device opened
[72627.411175] Plx8000_DMA:
[72627.411197] Plx8000_DMA: Received PLX message ===>
[72627.411244] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72627.411470] Plx8000_DMA: ...Completed message
[72627.411519] PLX DMA[Dispatch_IoControl-1053]
[72627.411565] PLX DMA[Dispatch_IoControl-1061]
[72627.411613] Plx8000_DMA:
[72627.411639] Plx8000_DMA: Received PLX message ===>
[72627.411686] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[72627.411747] Plx8000_DMA: Criteria matched device 8619_10B5 [01:00.1]
[72627.411808] Plx8000_DMA: ...Completed message
[72627.411855] PLX DMA[Dispatch_IoControl-1053]
[72627.411904] PLX DMA[Dispatch_IoControl-1061]
[72627.411953] Plx8000_DMA:
[72627.411978] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72627.412025] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72627.412074] Plx8000_DMA: ...device closed
[72627.412115] Plx8000_DMA:
[72627.412141] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72627.412187] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72627.412235] Plx8000_DMA: ...device opened
[72627.412274] Plx8000_DMA:
[72627.412299] Plx8000_DMA: Received PLX message ===>
[72627.412348] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72627.412408] Plx8000_DMA: ...Completed message
[72627.412457] PLX DMA[Dispatch_IoControl-1053]
[72627.412504] PLX DMA[Dispatch_IoControl-1061]
[72627.412555] Plx8000_DMA:
[72627.412580] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72627.412628] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72627.412676] Plx8000_DMA: ...device closed
[72627.412827] Plx8000_NT:
[72627.412829] Plx8000_NT: Received message ==> OPEN_DEVICE
[72627.412830] Plx8000_NT: Open device (Plx8000_NT-0)...
[72627.412832] Plx8000_NT: ...device opened
[72627.412834] Plx8000_NT:
[72627.412836] Plx8000_NT: Received PLX message ===>
[72627.412837] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72627.412838] Plx8000_NT: ...Completed message
[72627.412840] Plx8000_NT:
[72627.412842] Plx8000_NT: Received PLX message ===>
[72627.412843] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72627.412844] Plx8000_NT: Criteria did not match any devices
[72627.412846] Plx8000_NT: ...Completed message
[72627.412848] Plx8000_NT:
[72627.412850] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72627.412851] Plx8000_NT: Close device (Plx8000_NT-0)...
[72627.412853] Plx8000_NT: ...device closed
[72627.412858] Plx8000_DMA:
[72627.412885] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72627.412933] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72627.412981] Plx8000_DMA: ...device opened
[72627.413036] Plx8000_DMA:
[72627.413063] Plx8000_DMA: Received PLX message ===>
[72627.413110] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72627.413169] Plx8000_DMA: ...Completed message
[72627.413216] PLX DMA[Dispatch_IoControl-1053]
[72627.413265] PLX DMA[Dispatch_IoControl-1061]
[72627.413313] Plx8000_DMA:
[72627.413339] Plx8000_DMA: Received PLX message ===>
[72627.413389] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[72627.413449] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.1]
[72627.413507] Plx8000_DMA: ...Completed message
[72627.413557] PLX DMA[Dispatch_IoControl-1053]
[72627.413606] PLX DMA[Dispatch_IoControl-1061]
[72627.413656] Plx8000_DMA:
[72627.413682] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72627.413731] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72627.413779] Plx8000_DMA: ...device closed
[72627.413820] Plx8000_DMA:
[72627.413847] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72627.413896] Plx8000_DMA: Open device (Plx8000_DMA-1)...
[72627.413943] Plx8000_DMA: ...device opened
[72627.413980] Plx8000_DMA:
[72627.414006] Plx8000_DMA: Received PLX message ===>
[72627.414056] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72627.414115] Plx8000_DMA: ...Completed message
[72627.414162] PLX DMA[Dispatch_IoControl-1053]
[72627.414209] PLX DMA[Dispatch_IoControl-1061]
[72627.414260] Plx8000_DMA:
[72627.414285] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72627.414333] Plx8000_DMA: Close device (Plx8000_DMA-1)...
[72627.414382] Plx8000_DMA: ...device closed
[72627.414531] Plx8000_NT:
[72627.414532] Plx8000_NT: Received message ==> OPEN_DEVICE
[72627.414534] Plx8000_NT: Open device (Plx8000_NT-0)...
[72627.414535] Plx8000_NT: ...device opened
[72627.414538] Plx8000_NT:
[72627.414539] Plx8000_NT: Received PLX message ===>
[72627.414541] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72627.414542] Plx8000_NT: ...Completed message
[72627.414544] Plx8000_NT:
[72627.414545] Plx8000_NT: Received PLX message ===>
[72627.414547] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72627.414548] Plx8000_NT: Criteria did not match any devices
[72627.414549] Plx8000_NT: ...Completed message
[72627.414552] Plx8000_NT:
[72627.414553] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72627.414555] Plx8000_NT: Close device (Plx8000_NT-0)...
[72627.414556] Plx8000_NT: ...device closed
[72627.414562] Plx8000_DMA:
[72627.414591] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72627.414638] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72627.414686] Plx8000_DMA: ...device opened
[72627.414743] Plx8000_DMA:
[72627.414770] Plx8000_DMA: Received PLX message ===>
[72627.414817] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72627.414876] Plx8000_DMA: ...Completed message
[72627.414922] PLX DMA[Dispatch_IoControl-1053]
[72627.414971] PLX DMA[Dispatch_IoControl-1061]
[72627.415020] Plx8000_DMA:
[72627.415045] Plx8000_DMA: Received PLX message ===>
[72627.415092] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[72627.415153] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.2]
[72627.415210] Plx8000_DMA: ...Completed message
[72627.415260] PLX DMA[Dispatch_IoControl-1053]
[72627.425396] PLX DMA[Dispatch_IoControl-1061]
[72627.443065] Plx8000_DMA:
[72627.443140] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72627.459743] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72627.480544] Plx8000_DMA: ...device closed
[72627.494674] Plx8000_DMA:
[72627.494701] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72627.514411] Plx8000_DMA: Open device (Plx8000_DMA-2)...
[72627.528663] Plx8000_DMA: ...device opened
[72627.548088] Plx8000_DMA:
[72627.548114] Plx8000_DMA: Received PLX message ===>
[72627.562186] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72627.579330] Plx8000_DMA: ...Completed message
[72627.593548] PLX DMA[Dispatch_IoControl-1053]
[72627.593597] PLX DMA[Dispatch_IoControl-1061]
[72627.607342] Plx8000_DMA:
[72627.628356] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72627.643389] Plx8000_DMA: Close device (Plx8000_DMA-2)...
[72627.657247] Plx8000_DMA: ...device closed
[72627.657324] Plx8000_NT:
[72627.657326] Plx8000_NT: Received message ==> OPEN_DEVICE
[72627.657328] Plx8000_NT: Open device (Plx8000_NT-0)...
[72627.657330] Plx8000_NT: ...device opened
[72627.657333] Plx8000_NT:
[72627.657335] Plx8000_NT: Received PLX message ===>
[72627.657336] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72627.657338] Plx8000_NT: ...Completed message
[72627.657340] Plx8000_NT:
[72627.657342] Plx8000_NT: Received PLX message ===>
[72627.657343] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72627.657345] Plx8000_NT: Criteria did not match any devices
[72627.657346] Plx8000_NT: ...Completed message
[72627.657349] Plx8000_NT:
[72627.657350] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72627.657352] Plx8000_NT: Close device (Plx8000_NT-0)...
[72627.657354] Plx8000_NT: ...device closed
[72627.657360] Plx8000_DMA:
[72627.678335] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72627.691888] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72627.692097] Plx8000_DMA: ...device opened
[72627.709734] Plx8000_DMA:
[72627.729733] Plx8000_DMA: Received PLX message ===>
[72627.729781] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72627.743681] Plx8000_DMA: ...Completed message
[72627.757186] PLX DMA[Dispatch_IoControl-1053]
[72627.777240] PLX DMA[Dispatch_IoControl-1061]
[72627.790949] Plx8000_DMA:
[72627.790974] Plx8000_DMA: Received PLX message ===>
[72627.811068] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[72627.825371] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.3]
[72627.842688] Plx8000_DMA: ...Completed message
[72627.863570] PLX DMA[Dispatch_IoControl-1053]
[72627.877589] PLX DMA[Dispatch_IoControl-1061]
[72627.877654] Plx8000_DMA:
[72627.891372] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72627.891421] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72627.911378] Plx8000_DMA: ...device closed
[72627.925443] Plx8000_DMA:
[72627.938921] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72627.952821] Plx8000_DMA: Open device (Plx8000_DMA-3)...
[72627.975843] Plx8000_DMA: ...device opened
[72627.975882] Plx8000_DMA:
[72627.989561] Plx8000_DMA: Received PLX message ===>
[72628.009828] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72628.009889] Plx8000_DMA: ...Completed message
[72628.017190] PLX DMA[Dispatch_IoControl-1053]
[72628.037556] PLX DMA[Dispatch_IoControl-1061]
[72628.051055] Plx8000_DMA:
[72628.051087] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72628.071215] Plx8000_DMA: Close device (Plx8000_DMA-3)...
[72628.098488] Plx8000_DMA: ...device closed
[72628.121423] Plx8000_NT:
[72628.121426] Plx8000_NT: Received message ==> OPEN_DEVICE
[72628.121428] Plx8000_NT: Open device (Plx8000_NT-0)...
[72628.121430] Plx8000_NT: ...device opened
[72628.121433] Plx8000_NT:
[72628.121434] Plx8000_NT: Received PLX message ===>
[72628.121436] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72628.121437] Plx8000_NT: ...Completed message
[72628.121440] Plx8000_NT:
[72628.121441] Plx8000_NT: Received PLX message ===>
[72628.121442] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72628.121444] Plx8000_NT: Criteria did not match any devices
[72628.121446] Plx8000_NT: ...Completed message
[72628.121448] Plx8000_NT:
[72628.121450] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72628.121451] Plx8000_NT: Close device (Plx8000_NT-0)...
[72628.121453] Plx8000_NT: ...device closed
[72628.121459] Plx8000_DMA:
[72628.121488] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72628.164427] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72628.186055] Plx8000_DMA: ...device opened
[72628.204907] Plx8000_DMA:
[72628.204933] Plx8000_DMA: Received PLX message ===>
[72628.252421] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72628.333628] Plx8000_DMA: ...Completed message
[72628.363179] PLX DMA[Dispatch_IoControl-1053]
[72628.363229] PLX DMA[Dispatch_IoControl-1061]
[72628.382823] Plx8000_DMA:
[72628.382849] Plx8000_DMA: Received PLX message ===>
[72628.411911] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[72628.443037] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.4]
[72628.456385] Plx8000_DMA: ...Completed message
[72628.479320] PLX DMA[Dispatch_IoControl-1053]
[72628.493960] PLX DMA[Dispatch_IoControl-1061]
[72628.511248] Plx8000_DMA:
[72628.511276] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72628.530758] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72628.544767] Plx8000_DMA: ...device closed
[72628.573961] Plx8000_DMA:
[72628.573985] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72628.593642] Plx8000_DMA: Open device (Plx8000_DMA-4)...
[72628.606800] Plx8000_DMA: ...device opened
[72628.626478] Plx8000_DMA:
[72628.626504] Plx8000_DMA: Received PLX message ===>
[72628.643708] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72628.657250] Plx8000_DMA: ...Completed message
[72628.670464] PLX DMA[Dispatch_IoControl-1053]
[72628.670512] PLX DMA[Dispatch_IoControl-1061]
[72628.684991] Plx8000_DMA:
[72628.704238] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72628.718952] Plx8000_DMA: Close device (Plx8000_DMA-4)...
[72628.718999] Plx8000_DMA: ...device closed
[72628.732600] Plx8000_NT:
[72628.732602] Plx8000_NT: Received message ==> OPEN_DEVICE
[72628.732604] Plx8000_NT: Open device (Plx8000_NT-0)...
[72628.732606] Plx8000_NT: ...device opened
[72628.732608] Plx8000_NT:
[72628.732610] Plx8000_NT: Received PLX message ===>
[72628.732611] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[72628.732612] Plx8000_NT: ...Completed message
[72628.732614] Plx8000_NT:
[72628.732616] Plx8000_NT: Received PLX message ===>
[72628.732617] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[72628.732619] Plx8000_NT: Criteria did not match any devices
[72628.732620] Plx8000_NT: ...Completed message
[72628.732623] Plx8000_NT:
[72628.732624] Plx8000_NT: Received message ==> CLOSE_DEVICE
[72628.732625] Plx8000_NT: Close device (Plx8000_NT-0)...
[72628.732627] Plx8000_NT: ...device closed
[72628.732633] Plx8000_DMA:
[72628.753385] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72628.767529] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72628.784787] Plx8000_DMA: ...device opened
[72628.784828] Plx8000_DMA:
[72628.805494] Plx8000_DMA: Received PLX message ===>
[72628.805543] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72628.819629] Plx8000_DMA: ...Completed message
[72628.834282] PLX DMA[Dispatch_IoControl-1053]
[72628.853921] PLX DMA[Dispatch_IoControl-1061]
[72628.868788] Plx8000_DMA:
[72628.868816] Plx8000_DMA: Received PLX message ===>
[72628.888760] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[72628.903254] Plx8000_DMA: Criteria did not match any devices
[72628.920438] Plx8000_DMA: ...Completed message
[72628.941554] PLX DMA[Dispatch_IoControl-1053]
[72628.941601] PLX DMA[Dispatch_IoControl-1061]
[72628.956697] Plx8000_DMA:
[72628.956725] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72628.970183] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72628.991254] Plx8000_DMA: ...device closed
[72630.231810] Plx8000_DMA:
[72630.231839] Plx8000_DMA: Received message ==> OPEN_DEVICE
[72630.231889] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[72630.231938] Plx8000_DMA: ...device opened
[72630.231976] Plx8000_DMA:
[72630.232001] Plx8000_DMA: Received PLX message ===>
[72630.232048] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[72630.232119] Plx8000_DMA: ...Completed message
[72630.232168] PLX DMA[Dispatch_IoControl-1053]
[72630.232219] PLX DMA[Dispatch_IoControl-1061]
[72630.232380] Plx8000_NT:
[72630.232382] Plx8000_NT: Received PLX message ===>
[72630.232383] Plx8000_NT: PLX_IOCTL_NT_LUT_ADD
[72630.232392] Plx8000_NT: Req ID (0101) already exists in LUT #1, skipping
upda                                          te
[72630.232393] Plx8000_NT: ...Completed message
[72634.737738] Plx8000_DMA:
[72634.737844] Plx8000_DMA: Received PLX message ===>
[72634.738020] Plx8000_DMA: PLX_IOCTL_DMA_CHANNEL_OPEN
[72634.738084] Plx8000_DMA: Opened DMA channel 0
[72634.738132] Plx8000_DMA: ...Completed message
[72634.738179] PLX DMA[Dispatch_IoControl-1053]
[72634.738394] PLX DMA[Dispatch_IoControl-1061]
[72634.738547] Plx8000_DMA:
[72634.738574] Plx8000_DMA: Received PLX message ===>
[72634.738621] Plx8000_DMA: PLX_IOCTL_DMA_GET_PROPERTIES
[72634.738682] Plx8000_DMA: ...Completed message
[72634.738731] PLX DMA[Dispatch_IoControl-1053]
[72634.738778] PLX DMA[Dispatch_IoControl-1061]
[72634.738904] Plx8000_DMA:
[72634.738931] Plx8000_DMA: Received PLX message ===>
[72634.738978] Plx8000_DMA: PLX_IOCTL_DMA_SET_PROPERTIES
[72634.739044] Plx8000_DMA: ...Completed message
[72634.739092] PLX DMA[Dispatch_IoControl-1053]
[72634.739158] PLX DMA[Dispatch_IoControl-1061]
[72634.739270] Plx8000_DMA:
[72634.739298] Plx8000_DMA: Received PLX message ===>
[72634.739348] Plx8000_DMA: PLX_IOCTL_NOTIFICATION_REGISTER_FOR
[72634.739421] Plx8000_DMA: Registered interrupt wait object
(c000003c84638880)
[72634.739511] Plx8000_DMA: ...Completed message
[72634.739561] PLX DMA[Dispatch_IoControl-1053]
[72634.739611] PLX DMA[Dispatch_IoControl-1061]
[72634.739824] Plx8000_DMA:
[72634.739851] Plx8000_DMA: Received PLX message ===>
[72634.739910] Plx8000_DMA: PLX_IOCTL_DMA_TRANSFER_BLOCK
[72634.739984] PLX DMA[PlxDmaTransferBlock-2479]
[72634.740034] PLX DMA[PlxDmaTransferBlock-2488]
[72634.740093] PLX DMA[PlxDmaTransferBlock-2495]
[72634.740143] Plx8000_DMA: Ch 0 - DMA 00000000_60600000 -->
00000000_60800000 (                                          65536 bytes)
[72634.740215] PLX DMA[PlxDmaTransferBlock-2503]
[72634.740262] PLX DMA[PlxDmaTransferBlock-2511]
[72634.740313] PLX DMA[PlxDmaTransferBlock-2516]
[72634.740360] PLX DMA[PlxDmaTransferBlock-2521]
[72634.740408] PLX DMA[PlxDmaTransferBlock-2532]
[72634.740457] PLX DMA[PlxDmaTransferBlock-2535]
[72634.740507] PLX DMA[PlxDmaTransferBlock-2539]
[72634.740555] PLX DMA[PlxDmaTransferBlock-2550]
[72634.740606] PLX DMA[PlxDmaTransferBlock-2557]
[72634.740654] PLX DMA[PlxDmaTransferBlock-2562]
[72634.740702] Plx8000_DMA: Start DMA transfer...
[72634.740747] PLX DMA[PlxDmaTransferBlock-2565]
[72634.740795] PLX DMA[PlxDmaTransferBlock-2569]
[72634.740840] EEH: Frozen PE#1 on PHB#1 detected
[72634.740845] EEH: PE location: Slot4, PHB location: N/A
[72634.741951] EEH: This PCI device has failed 1 times in the last hour
[72634.741952] EEH: Notify device drivers to shutdown
[72634.741960] EEH: Collect temporary log
[72634.742033] EEH: of node=0001:01:00:0
[72634.742036] EEH: PCI device/vendor: 861910b5
[72634.742038] EEH: PCI cmd/status register: 00100547
[72634.742040] EEH: Bridge secondary status: 0000
[72634.742042] EEH: Bridge control: 0002
[72634.742043] EEH: PCI-E capabilities and status follow:
[72634.742052] EEH: PCI-E 00: 0052a410 00008004 00000046 0000cc82
[72634.742060] EEH: PCI-E 10: 00820000 00000000 00000000 00000000
[72634.742060] EEH: PCI-E 20: 00000000
[72634.742061] EEH: PCI-E AER capability register set follows:
[72634.742070] EEH: PCI-E AER 00: 13810001 00000000 00000000 00062030
[72634.742077] EEH: PCI-E AER 10: 00000000 00002000 000000ff 00000000
[72634.742084] EEH: PCI-E AER 20: 00000000 00000000 00000000 00000000
[72634.742086] EEH: PCI-E AER 30: 00000000 0e0e0e0e
[72634.742087] EEH: of node=0001:01:00:1
[72634.742089] EEH: PCI device/vendor: 861910b5
[72634.742091] EEH: PCI cmd/status register: 10100546
[72634.742092] EEH: PCI-E capabilities and status follow:
[72634.742100] EEH: PCI-E 00: 0002a410 00008fe4 0020204e 0000cc82
[72634.742107] EEH: PCI-E 10: 00820000 00000000 00000000 00000000
[72634.742108] EEH: PCI-E 20: 00000000
[72634.742109] EEH: PCI-E AER capability register set follows:
[72634.742117] EEH: PCI-E AER 00: 1f410001 00000000 00000000 00062030
[72634.742124] EEH: PCI-E AER 10: 00000000 00002000 000001ff 00000000
[72634.742131] EEH: PCI-E AER 20: 00000000 00000000 00000000 00000000
[72634.742133] EEH: PCI-E AER 30: 00000000 00000000
[72634.742134] EEH: of node=0001:02:01:0
[72634.742136] EEH: PCI device/vendor: 861910b5
[72634.742138] EEH: PCI cmd/status register: 00100546
[72634.742138] EEH: PCI-E capabilities and status follow:
[72634.742147] EEH: PCI-E 00: 0002a410 00008fc4 0000004e 0100cc82
[72634.742154] EEH: PCI-E 10: 00420000 00000000 00000000 00000000
[72634.742155] EEH: PCI-E 20: 00000000
[72634.742155] EEH: PCI-E AER capability register set follows:
[72634.742164] EEH: PCI-E AER 00: 14810001 00000000 00000000 00062030
[72634.742170] EEH: PCI-E AER 10: 00000000 00002000 000001ff 00000000
[72634.742177] EEH: PCI-E AER 20: 00000000 00000000 00000000 00000000
[72634.742179] EEH: PCI-E AER 30: 00000000 00000000
[72634.742181] PHB3 PHB#1 Diag-data (Version: 1)
[72634.742182] brdgCtl:     00000002
[72634.742183] RootSts:     0002004f 00400000 f0820008 00100147 00002800
[72634.742184] RootErrSts:  00000000 00008000 00000000
[72634.742185] PhbSts:      0000001c00000000 0000001c00000000
[72634.742186] Lem:         0000000004000000 42498e327f502eae
0000000000000000
[72634.742189] InAErr:      0000000000004000 0000000000004000
8000000060600001 8                                          400000000000001
[72634.742190] PE[  1] A/B: 8200302500000000 8000000060600000
[72634.742191] EEH: Enable I/O for affected devices
[72634.742206] EEH: Notify device drivers to resume I/O
[72634.742207] EEH: Enabled DMA for affected devices
[72634.742217] EEH: Notify device driver to resume
[72635.074164] Plx8000_DMA: ...Completed message
[72635.117262] PLX DMA[Dispatch_IoControl-1053]
[72635.130943] PLX DMA[Dispatch_IoControl-1061]
[72635.131023] Plx8000_DMA:
[72635.145274] Plx8000_DMA: Received PLX message ===>
[72635.164247] Plx8000_DMA: PLX_IOCTL_NOTIFICATION_WAIT
[72635.180391] Plx8000_DMA: Waiting for Interrupt wait object
(c000003c84638880)                                           to wake-up
[72638.205655] Plx8000_DMA: Timeout waiting for interrupt
[72638.205851] Plx8000_DMA: ...Completed message
[72638.205949] PLX DMA[Dispatch_IoControl-1053]
[72638.205997] PLX DMA[Dispatch_IoControl-1061]
[72638.206083] Plx8000_DMA:
[72638.206108] Plx8000_DMA: Received PLX message ===>
[72638.206322] Plx8000_DMA: PLX_IOCTL_NOTIFICATION_CANCEL
[72638.206381] Plx8000_DMA: Removing interrupt wait object
(c000003c84638880)...
[72638.206456] Plx8000_DMA: ...Completed message
[72638.206506] PLX DMA[Dispatch_IoControl-1053]
[72638.206555] PLX DMA[Dispatch_IoControl-1061]
[72638.206617] Plx8000_DMA:
[72638.206643] Plx8000_DMA: Received PLX message ===>
[72638.206693] Plx8000_DMA: PLX_IOCTL_DMA_CHANNEL_CLOSE
[72638.206753] Plx8000_DMA: Closing DMA channel 0...
[72638.206801] Plx8000_DMA: ...Completed message
[72638.206849] PLX DMA[Dispatch_IoControl-1053]
[72638.206900] PLX DMA[Dispatch_IoControl-1061]
[72638.206962] Plx8000_DMA:
[72638.206988] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[72638.207038] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[72638.207087] Plx8000_DMA: ...device closed
[72638.352005] usb 1-1.3: USB disconnect, device number 62
[72639.885645] usb 1-1.3: new low-speed USB device number 63 using xhci_hcd
[72640.013182] usb 1-1.3: New USB device found, idVendor=04ca,
idProduct=0061
[72640.013455] usb 1-1.3: New USB device strings: Mfr=1, Product=2,
SerialNumber                                          =0
[72640.013529] usb 1-1.3: Product: USB Optical Mouse
[72640.013579] usb 1-1.3: Manufacturer: PixArt
[72640.018497] input: PixArt USB Optical Mouse as
/devices/pci0003:00/0003:00:00                                         
.0/0003:01:00.0/0003:02:09.0/0003:0d:00.0/usb1/1-1/1-1.3/1-1.3:1.0/input/input12                                         
47
[72640.018877] hid-generic 0003:04CA:0061.04E0: input,hidraw1: USB HID v1.11
Mou                                          se [PixArt USB Optical Mouse]
on usb-0003:0d:00.0-1.3/input0
[72641.324398] Plx8000_NT:
[72641.324403] Plx8000_NT: Received PLX message ===>
[72641.324404] Plx8000_NT: PLX_IOCTL_PHYSICAL_MEM_FREE
[72641.324467] Plx8000_NT: Released physical memory at 1f9e400000h (1MB)
[72641.324469] Plx8000_NT: ...Completed message
[72641.324487] Plx8000_NT:
[72641.324488] Plx8000_NT: Received PLX message ===>
[72641.324490] Plx8000_NT: PLX_IOCTL_PHYSICAL_MEM_FREE
[72641.324549] Plx8000_NT: Released physical memory at 1f82c00000h (1MB)
[72641.324551] Plx8000_NT: ...Completed message




--
View this message in context: http://linuxppc.10917.n7.nabble.com/EEH-error-in-doing-DMA-with-PEX-8619-tp121121.html
Sent from the linuxppc-dev mailing list archive at Nabble.com.

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: EEH error in doing DMA with PEX 8619
  2017-04-10 12:22 EEH error in doing DMA with PEX 8619 IanJiang
@ 2017-04-10 22:24 ` Gavin Shan
  2017-04-11  2:04   ` IanJiang
  0 siblings, 1 reply; 11+ messages in thread
From: Gavin Shan @ 2017-04-10 22:24 UTC (permalink / raw)
  To: IanJiang; +Cc: linuxppc-dev

On Mon, Apr 10, 2017 at 05:22:33AM -0700, IanJiang wrote:
>Hi all!
>
>I am porting PLX driver for PEX 8619 to a power8 machine with CentOS-7.3.
>The PEX 8619 is used as an NTB (Non-Transparent Bridge).
>
>First, two DMA buffer are allocated with dma_alloc_coherent() and the
>physical address are:
>src: 0x 00000000_60600000
>dst: 0x 00000000_60800000
>Then, a DMA transfer is started and an EEH is reported in dmesg.
>
>This DMA test is OK at an x86_64 platform.
>
>Here are the details. Any suggestion is appreciated! 

.../...

>[72634.742182] brdgCtl:     00000002
>[72634.742183] RootSts:     0002004f 00400000 f0820008 00100147 00002800
>[72634.742184] RootErrSts:  00000000 00008000 00000000
>[72634.742185] PhbSts:      0000001c00000000 0000001c00000000
>[72634.742186] Lem:         0000000004000000 42498e327f502eae
>0000000000000000
>[72634.742189] InAErr:      0000000000004000 0000000000004000
>8000000060600001 8                                          400000000000001
>[72634.742190] PE[  1] A/B: 8200302500000000 8000000060600000

Please check if memory physical address (instead of DMA address) is used
in the driver. The EEH error is caused by DMA address 0x60600000 and it's
not having a corresponding TCE entry.

Thanks,
Gavin

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: EEH error in doing DMA with PEX 8619
  2017-04-10 22:24 ` Gavin Shan
@ 2017-04-11  2:04   ` IanJiang
  2017-04-11  2:15     ` Benjamin Herrenschmidt
  0 siblings, 1 reply; 11+ messages in thread
From: IanJiang @ 2017-04-11  2:04 UTC (permalink / raw)
  To: linuxppc-dev

Thanks for your replay.

I fixed my test according your suggestion. The CPU physical addresses (0x
1f9e400000 and 0x 1f82c00000) converted with virt_to_phys() are used ,
instead of DMA addresses, or BUS physical addresses (0x 60a00000 and 0x
60c00000). However, EEH still reports error.

Memory info.
==========

[130508.050783] Plx8000_NT: Received PLX message ===> 
[130508.050784] Plx8000_NT: PLX_IOCTL_PHYSICAL_MEM_ALLOCATE
[130508.050785] Plx8000_NT: Attempt to allocate physical memory (1953KB)
[130508.051165] Plx8000_NT: Allocated physical memory...
[130508.051167] Plx8000_NT:     CPU Phys Addr: 1f9e400000
[130508.051168] Plx8000_NT:     Bus Phys Addr: 60a00000
[130508.051170] Plx8000_NT:     Kernel VA    : c000001f9e400000
[130508.051171] Plx8000_NT:     Size         : 1E8480h (1MB)
[130508.051173] Plx8000_NT: ...Completed message
[130508.051184] Plx8000_NT: 
[130508.051185] Plx8000_NT: Received message ===> MMAP
[130508.051187] Plx8000_NT: Mapped Phys (1f9e400000) ==> User VA
(3fff83ad0000)
[130508.051189] Plx8000_NT: ...Completed message
[130508.051196] Plx8000_NT: 
[130508.051198] Plx8000_NT: Received PLX message ===> 
[130508.051199] Plx8000_NT: PLX_IOCTL_PHYSICAL_MEM_ALLOCATE
[130508.051200] Plx8000_NT: Attempt to allocate physical memory (1953KB)
[130508.051562] Plx8000_NT: Allocated physical memory...
[130508.051564] Plx8000_NT:     CPU Phys Addr: 1f82c00000
[130508.051565] Plx8000_NT:     Bus Phys Addr: 60c00000
[130508.051566] Plx8000_NT:     Kernel VA    : c000001f82c00000
[130508.051568] Plx8000_NT:     Size         : 1E8480h (1MB)
[130508.051569] Plx8000_NT: ...Completed message
[130508.051580] Plx8000_NT: 
[130508.051581] Plx8000_NT: Received message ===> MMAP
[130508.051583] Plx8000_NT: Mapped Phys (1f82c00000) ==> User VA
(3fff838e0000)
[130508.051585] Plx8000_NT: ...Completed message
[130508.051600] Plx8000_NT: 

EEH info.
========

[130515.365924] Plx8000_DMA: Received PLX message ===> 
[130515.365972] Plx8000_DMA: PLX_IOCTL_DMA_TRANSFER_BLOCK
[130515.366033] PLX DMA[PlxDmaTransferBlock-2479]
[130515.366084] PLX DMA[PlxDmaTransferBlock-2488]
[130515.366131] PLX DMA[PlxDmaTransferBlock-2495]
[130515.366181] Plx8000_DMA: Ch 0 - DMA 0000001F_9E400000 -->
0000001F_82C00000 (65536 bytes)
[130515.366250] PLX DMA[PlxDmaTransferBlock-2503]
[130515.366296] PLX DMA[PlxDmaTransferBlock-2511]
[130515.366343] PLX DMA[PlxDmaTransferBlock-2516]
[130515.366392] PLX DMA[PlxDmaTransferBlock-2521]
[130515.366440] PLX DMA[PlxDmaTransferBlock-2532]
[130515.366487] PLX DMA[PlxDmaTransferBlock-2535]
[130515.366537] PLX DMA[PlxDmaTransferBlock-2539]
[130515.366584] PLX DMA[PlxDmaTransferBlock-2550]
[130515.366632] PLX DMA[PlxDmaTransferBlock-2557]
[130515.366681] PLX DMA[PlxDmaTransferBlock-2562]
[130515.366728] Plx8000_DMA: Start DMA transfer...
[130515.366775] PLX DMA[PlxDmaTransferBlock-2565]
[130515.366826] PLX DMA[PlxDmaTransferBlock-2569]
[130515.366868] EEH: Frozen PE#1 on PHB#1 detected
[130515.366872] EEH: PE location: Slot4, PHB location: N/A
[130515.367997] EEH: This PCI device has failed 1 times in the last hour
[130515.367997] EEH: Notify device drivers to shutdown
[130515.368006] EEH: Collect temporary log
[130515.368072] EEH: of node=0001:01:00:0
[130515.368075] EEH: PCI device/vendor: 861910b5
[130515.368077] EEH: PCI cmd/status register: 00100547
[130515.368079] EEH: Bridge secondary status: 0000
[130515.368081] EEH: Bridge control: 0002
[130515.368081] EEH: PCI-E capabilities and status follow:
[130515.368091] EEH: PCI-E 00: 0052a410 00008004 00000046 0000cc82 
[130515.368098] EEH: PCI-E 10: 00820000 00000000 00000000 00000000 
[130515.368099] EEH: PCI-E 20: 00000000 
[130515.368100] EEH: PCI-E AER capability register set follows:
[130515.368109] EEH: PCI-E AER 00: 13810001 00000000 00000000 00062030 
[130515.368116] EEH: PCI-E AER 10: 00000000 00002000 000000ff 00000000 
[130515.368122] EEH: PCI-E AER 20: 00000000 00000000 00000000 00000000 
[130515.368125] EEH: PCI-E AER 30: 00000000 0e0e0e0e 
[130515.368127] EEH: of node=0001:01:00:1
[130515.368294] Plx8000_DMA: ...Completed message
[130515.368295] PLX DMA[Dispatch_IoControl-1053]
[130515.368295] PLX DMA[Dispatch_IoControl-1061]
[130515.368297] Plx8000_DMA: 
[130515.368298] Plx8000_DMA: Received PLX message ===> 
[130515.368298] Plx8000_DMA: PLX_IOCTL_NOTIFICATION_WAIT
[130515.368299] Plx8000_DMA: Waiting for Interrupt wait object
(c000003c0705f880) to wake-up
[130515.369283] EEH: PCI device/vendor: 861910b5
[130515.369336] EEH: PCI cmd/status register: 10100546
[130515.369384] EEH: PCI-E capabilities and status follow:
[130515.369440] EEH: PCI-E 00: 0002a410 00008fe4 0020204e 0000cc82 
[130515.369506] EEH: PCI-E 10: 00820000 00000000 00000000 00000000 
[130515.369564] EEH: PCI-E 20: 00000000 
[130515.393162] EEH: PCI-E AER capability register set follows:
[130515.420590] EEH: PCI-E AER 00: 1f410001 00000000 00000000 00062030 
[130515.441475] EEH: PCI-E AER 10: 00000000 00002000 000001ff 00000000 
[130515.454700] EEH: PCI-E AER 20: 00000000 00000000 00000000 00000000 
[130515.469331] EEH: PCI-E AER 30: 00000000 00000000 
[130515.488728] EEH: of node=0001:02:01:0
[130515.502865] EEH: PCI device/vendor: 861910b5
[130515.516637] EEH: PCI cmd/status register: 00100546
[130515.536602] EEH: PCI-E capabilities and status follow:
[130515.536659] EEH: PCI-E 00: 0002a410 00008fc4 0000004e 0100cc82 
[130515.552999] EEH: PCI-E 10: 00420000 00000000 00000000 00000000 
[130515.569904] EEH: PCI-E 20: 00000000 
[130515.594771] EEH: PCI-E AER capability register set follows:
[130515.623612] EEH: PCI-E AER 00: 14810001 00000000 00000000 00062030 
[130515.646365] EEH: PCI-E AER 10: 00000000 00002000 000001ff 00000000 
[130515.675020] EEH: PCI-E AER 20: 00000000 00000000 00000000 00000000 
[130515.722944] EEH: PCI-E AER 30: 00000000 00000000 
[130515.722994] PHB3 PHB#1 Diag-data (Version: 1)
[130515.777673] brdgCtl:     00000002
[130515.837348] RootSts:     0002004f 00400000 f0820008 00100147 00002800
[130515.862070] RootErrSts:  00000000 00008000 00000000
[130515.910110] PhbSts:      0000001c00000000 0000001c00000000
[130515.927288] Lem:         0000000008000000 42498e327f502eae
0000000000000000
[130515.954319] InAErr:      0000000100000000 0000000100000000
0e0c010100000800 0000001f9e400000
[130515.987234] PE[  1] A/B: 8200802401010000 8000001f9e400000
[130516.000681] EEH: Enable I/O for affected devices
[130516.008885] EEH: Notify device drivers to resume I/O
[130516.028718] EEH: Enabled DMA for affected devices
[130516.059665] EEH: Notify device driver to resume
[130518.366890] Plx8000_DMA: Timeout waiting for interrupt
[130518.367090] Plx8000_DMA: ...Completed message




--
View this message in context: http://linuxppc.10917.n7.nabble.com/EEH-error-in-doing-DMA-with-PEX-8619-tp121121p121154.html
Sent from the linuxppc-dev mailing list archive at Nabble.com.

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: EEH error in doing DMA with PEX 8619
  2017-04-11  2:04   ` IanJiang
@ 2017-04-11  2:15     ` Benjamin Herrenschmidt
  2017-04-11  4:42       ` Gavin Shan
  0 siblings, 1 reply; 11+ messages in thread
From: Benjamin Herrenschmidt @ 2017-04-11  2:15 UTC (permalink / raw)
  To: IanJiang, linuxppc-dev

On Mon, 2017-04-10 at 19:04 -0700, IanJiang wrote:
> Thanks for your replay.
> 
> I fixed my test according your suggestion. The CPU physical addresses (0x
> 1f9e400000 and 0x 1f82c00000) converted with virt_to_phys() are used ,
> instead of DMA addresses, or BUS physical addresses (0x 60a00000 and 0x
> 60c00000). However, EEH still reports error.

That's incorrect. The system has an IOMMU, only addressed properly
mapped/translated by the IOMMU can be used for DMA. That is addresses
returned by things like dma_map_single/sg, dma_alloc_coherent, etc...

You also need to ensure you configure a proper dma mask.

Using virt_to_phys() is NEVER correct on *any* architecture.

Cheers,
Ben.

> Memory info.
> ==========
> 
> [130508.050783] Plx8000_NT: Received PLX message ===> 
> [130508.050784] Plx8000_NT: PLX_IOCTL_PHYSICAL_MEM_ALLOCATE
> [130508.050785] Plx8000_NT: Attempt to allocate physical memory (1953KB)
> [130508.051165] Plx8000_NT: Allocated physical memory...
> [130508.051167] Plx8000_NT:     CPU Phys Addr: 1f9e400000
> [130508.051168] Plx8000_NT:     Bus Phys Addr: 60a00000
> [130508.051170] Plx8000_NT:     Kernel VA    : c000001f9e400000
> [130508.051171] Plx8000_NT:     Size         : 1E8480h (1MB)
> [130508.051173] Plx8000_NT: ...Completed message
> [130508.051184] Plx8000_NT: 
> [130508.051185] Plx8000_NT: Received message ===> MMAP
> [130508.051187] Plx8000_NT: Mapped Phys (1f9e400000) ==> User VA
> (3fff83ad0000)
> [130508.051189] Plx8000_NT: ...Completed message
> [130508.051196] Plx8000_NT: 
> [130508.051198] Plx8000_NT: Received PLX message ===> 
> [130508.051199] Plx8000_NT: PLX_IOCTL_PHYSICAL_MEM_ALLOCATE
> [130508.051200] Plx8000_NT: Attempt to allocate physical memory (1953KB)
> [130508.051562] Plx8000_NT: Allocated physical memory...
> [130508.051564] Plx8000_NT:     CPU Phys Addr: 1f82c00000
> [130508.051565] Plx8000_NT:     Bus Phys Addr: 60c00000
> [130508.051566] Plx8000_NT:     Kernel VA    : c000001f82c00000
> [130508.051568] Plx8000_NT:     Size         : 1E8480h (1MB)
> [130508.051569] Plx8000_NT: ...Completed message
> [130508.051580] Plx8000_NT: 
> [130508.051581] Plx8000_NT: Received message ===> MMAP
> [130508.051583] Plx8000_NT: Mapped Phys (1f82c00000) ==> User VA
> (3fff838e0000)
> [130508.051585] Plx8000_NT: ...Completed message
> [130508.051600] Plx8000_NT: 
> 
> EEH info.
> ========
> 
> [130515.365924] Plx8000_DMA: Received PLX message ===> 
> [130515.365972] Plx8000_DMA: PLX_IOCTL_DMA_TRANSFER_BLOCK
> [130515.366033] PLX DMA[PlxDmaTransferBlock-2479]
> [130515.366084] PLX DMA[PlxDmaTransferBlock-2488]
> [130515.366131] PLX DMA[PlxDmaTransferBlock-2495]
> [130515.366181] Plx8000_DMA: Ch 0 - DMA 0000001F_9E400000 -->
> 0000001F_82C00000 (65536 bytes)
> [130515.366250] PLX DMA[PlxDmaTransferBlock-2503]
> [130515.366296] PLX DMA[PlxDmaTransferBlock-2511]
> [130515.366343] PLX DMA[PlxDmaTransferBlock-2516]
> [130515.366392] PLX DMA[PlxDmaTransferBlock-2521]
> [130515.366440] PLX DMA[PlxDmaTransferBlock-2532]
> [130515.366487] PLX DMA[PlxDmaTransferBlock-2535]
> [130515.366537] PLX DMA[PlxDmaTransferBlock-2539]
> [130515.366584] PLX DMA[PlxDmaTransferBlock-2550]
> [130515.366632] PLX DMA[PlxDmaTransferBlock-2557]
> [130515.366681] PLX DMA[PlxDmaTransferBlock-2562]
> [130515.366728] Plx8000_DMA: Start DMA transfer...
> [130515.366775] PLX DMA[PlxDmaTransferBlock-2565]
> [130515.366826] PLX DMA[PlxDmaTransferBlock-2569]
> [130515.366868] EEH: Frozen PE#1 on PHB#1 detected
> [130515.366872] EEH: PE location: Slot4, PHB location: N/A
> [130515.367997] EEH: This PCI device has failed 1 times in the last hour
> [130515.367997] EEH: Notify device drivers to shutdown
> [130515.368006] EEH: Collect temporary log
> [130515.368072] EEH: of node=0001:01:00:0
> [130515.368075] EEH: PCI device/vendor: 861910b5
> [130515.368077] EEH: PCI cmd/status register: 00100547
> [130515.368079] EEH: Bridge secondary status: 0000
> [130515.368081] EEH: Bridge control: 0002
> [130515.368081] EEH: PCI-E capabilities and status follow:
> [130515.368091] EEH: PCI-E 00: 0052a410 00008004 00000046 0000cc82 
> [130515.368098] EEH: PCI-E 10: 00820000 00000000 00000000 00000000 
> [130515.368099] EEH: PCI-E 20: 00000000 
> [130515.368100] EEH: PCI-E AER capability register set follows:
> [130515.368109] EEH: PCI-E AER 00: 13810001 00000000 00000000 00062030 
> [130515.368116] EEH: PCI-E AER 10: 00000000 00002000 000000ff 00000000 
> [130515.368122] EEH: PCI-E AER 20: 00000000 00000000 00000000 00000000 
> [130515.368125] EEH: PCI-E AER 30: 00000000 0e0e0e0e 
> [130515.368127] EEH: of node=0001:01:00:1
> [130515.368294] Plx8000_DMA: ...Completed message
> [130515.368295] PLX DMA[Dispatch_IoControl-1053]
> [130515.368295] PLX DMA[Dispatch_IoControl-1061]
> [130515.368297] Plx8000_DMA: 
> [130515.368298] Plx8000_DMA: Received PLX message ===> 
> [130515.368298] Plx8000_DMA: PLX_IOCTL_NOTIFICATION_WAIT
> [130515.368299] Plx8000_DMA: Waiting for Interrupt wait object
> (c000003c0705f880) to wake-up
> [130515.369283] EEH: PCI device/vendor: 861910b5
> [130515.369336] EEH: PCI cmd/status register: 10100546
> [130515.369384] EEH: PCI-E capabilities and status follow:
> [130515.369440] EEH: PCI-E 00: 0002a410 00008fe4 0020204e 0000cc82 
> [130515.369506] EEH: PCI-E 10: 00820000 00000000 00000000 00000000 
> [130515.369564] EEH: PCI-E 20: 00000000 
> [130515.393162] EEH: PCI-E AER capability register set follows:
> [130515.420590] EEH: PCI-E AER 00: 1f410001 00000000 00000000 00062030 
> [130515.441475] EEH: PCI-E AER 10: 00000000 00002000 000001ff 00000000 
> [130515.454700] EEH: PCI-E AER 20: 00000000 00000000 00000000 00000000 
> [130515.469331] EEH: PCI-E AER 30: 00000000 00000000 
> [130515.488728] EEH: of node=0001:02:01:0
> [130515.502865] EEH: PCI device/vendor: 861910b5
> [130515.516637] EEH: PCI cmd/status register: 00100546
> [130515.536602] EEH: PCI-E capabilities and status follow:
> [130515.536659] EEH: PCI-E 00: 0002a410 00008fc4 0000004e 0100cc82 
> [130515.552999] EEH: PCI-E 10: 00420000 00000000 00000000 00000000 
> [130515.569904] EEH: PCI-E 20: 00000000 
> [130515.594771] EEH: PCI-E AER capability register set follows:
> [130515.623612] EEH: PCI-E AER 00: 14810001 00000000 00000000 00062030 
> [130515.646365] EEH: PCI-E AER 10: 00000000 00002000 000001ff 00000000 
> [130515.675020] EEH: PCI-E AER 20: 00000000 00000000 00000000 00000000 
> [130515.722944] EEH: PCI-E AER 30: 00000000 00000000 
> [130515.722994] PHB3 PHB#1 Diag-data (Version: 1)
> [130515.777673] brdgCtl:     00000002
> [130515.837348] RootSts:     0002004f 00400000 f0820008 00100147 00002800
> [130515.862070] RootErrSts:  00000000 00008000 00000000
> [130515.910110] PhbSts:      0000001c00000000 0000001c00000000
> [130515.927288] Lem:         0000000008000000 42498e327f502eae
> 0000000000000000
> [130515.954319] InAErr:      0000000100000000 0000000100000000
> 0e0c010100000800 0000001f9e400000
> [130515.987234] PE[  1] A/B: 8200802401010000 8000001f9e400000
> [130516.000681] EEH: Enable I/O for affected devices
> [130516.008885] EEH: Notify device drivers to resume I/O
> [130516.028718] EEH: Enabled DMA for affected devices
> [130516.059665] EEH: Notify device driver to resume
> [130518.366890] Plx8000_DMA: Timeout waiting for interrupt
> [130518.367090] Plx8000_DMA: ...Completed message
> 
> 
> 
> 
> --
> View this message in context: http://linuxppc.10917.n7.nabble.com/EEH-error-in-doing-DMA-with-PEX-8619-tp121121p121154.html
> Sent from the linuxppc-dev mailing list archive at Nabble.com.

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: EEH error in doing DMA with PEX 8619
  2017-04-11  2:15     ` Benjamin Herrenschmidt
@ 2017-04-11  4:42       ` Gavin Shan
  2017-04-11  9:26         ` IanJiang
  0 siblings, 1 reply; 11+ messages in thread
From: Gavin Shan @ 2017-04-11  4:42 UTC (permalink / raw)
  To: Benjamin Herrenschmidt; +Cc: IanJiang, linuxppc-dev

On Tue, Apr 11, 2017 at 12:15:10PM +1000, Benjamin Herrenschmidt wrote:
>On Mon, 2017-04-10 at 19:04 -0700, IanJiang wrote:
>> Thanks for your replay.
>> 
>> I fixed my test according your suggestion. The CPU physical addresses (0x
>> 1f9e400000 and 0x 1f82c00000) converted with virt_to_phys() are used ,
>> instead of DMA addresses, or BUS physical addresses (0x 60a00000 and 0x
>> 60c00000). However, EEH still reports error.
>
>That's incorrect. The system has an IOMMU, only addressed properly
>mapped/translated by the IOMMU can be used for DMA. That is addresses
>returned by things like dma_map_single/sg, dma_alloc_coherent, etc...
>
>You also need to ensure you configure a proper dma mask.
>
>Using virt_to_phys() is NEVER correct on *any* architecture.
>

Ben is correct that PCI device needs to use DMA address instead of
memory address. I was suggesting to ensure that in the driver's code
and was misunderstood. It seems the driver has used the DMA address,
which is correct. But it seems the TCE entry for the DMA address isn't
built correctly. Could you please share the kernel log with original
driver code? I am not sure if I can find somethere there, but worthy
to check.

Thanks,
Gavin

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: EEH error in doing DMA with PEX 8619
  2017-04-11  4:42       ` Gavin Shan
@ 2017-04-11  9:26         ` IanJiang
  2017-04-11  9:35           ` Benjamin Herrenschmidt
  0 siblings, 1 reply; 11+ messages in thread
From: IanJiang @ 2017-04-11  9:26 UTC (permalink / raw)
  To: linuxppc-dev

I did another test:
- Call dma_set_mask_and_coherent(&pPciDev->dev, DMA_BIT_MASK(32)) in probe;
- Use DMA address or BUS address in DMA
But EHH error remains.

All sources are based on PLX SDK 7.25.
Note: Sample test is in user space. It allocates memory and starts DMA
through PLX API.
The original sample NT_DmaTest does DMA between BARx and Host memory.
I change this for simple: Allocate two host memory buffers and try to do DMA
between them.

Device probe
===========
(Driver/Source.Plx8000_DMA/Driver.c)

int
AddDevice(
    DRIVER_OBJECT  *pDriverObject,
    struct pci_dev *pPciDev
    )
{
    U8                channel;
    int               status;
    U32               RegValue;
    DEVICE_OBJECT    *fdo;
    DEVICE_OBJECT    *pDevice;
    DEVICE_EXTENSION *pdx;


    // Allocate memory for the device object
    fdo =
        kmalloc(
            sizeof(DEVICE_OBJECT),
            GFP_KERNEL
            );

    if (fdo == NULL)
    {
        ErrorPrintf(("ERROR - memory allocation for device object
failed\n"));
        return (-ENOMEM);
    }

    // Initialize device object
    RtlZeroMemory( fdo, sizeof(DEVICE_OBJECT) );

    fdo->DriverObject    = pDriverObject;         // Save parent driver
object
    fdo->DeviceExtension = &(fdo->DeviceInfo);

    // Enable the device
    if (pci_enable_device( pPciDev ) == 0)
    {
        DebugPrintf(("Enabled PCI device\n"));
    }
    else
    {
        ErrorPrintf(("WARNING - PCI device enable failed\n"));
    }

#if 1
    /* New added: Set DMA mask as suggestied on linuxppc */
{
    int err;
    printk("Debug %s: dma_set_mask_and_coherent()...\n", __func__);
    err = dma_set_mask_and_coherent(&pPciDev->dev, DMA_BIT_MASK(32));
    if (err != 0) {
        printk("Error %s: Failed dma_set_mask_and_coherent(). ret = %d\n",
__func__, err);
        return err;
    }

}
#endif
    // Enable bus mastering
    pci_set_master( pPciDev );

    //
    // Initialize the device extension
    //

    pdx = fdo->DeviceExtension;

    // Clear device extension
    RtlZeroMemory( pdx, sizeof(DEVICE_EXTENSION) );

    // Store parent device object
    pdx->pDeviceObject = fdo;

    // Save the OS-supplied PCI object
    pdx->pPciDevice = pPciDev;

    // Set initial device device state
    pdx->State = PLX_STATE_STOPPED;

    // Set initial power state
    pdx->PowerState = PowerDeviceD0;

    // Store device location information
    pdx->Key.domain       = pci_domain_nr(pPciDev->bus);
    pdx->Key.bus          = pPciDev->bus->number;
    pdx->Key.slot         = PCI_SLOT(pPciDev->devfn);
    pdx->Key.function     = PCI_FUNC(pPciDev->devfn);
    pdx->Key.DeviceId     = pPciDev->device;
    pdx->Key.VendorId     = pPciDev->vendor;
    pdx->Key.SubVendorId  = pPciDev->subsystem_vendor;
    pdx->Key.SubDeviceId  = pPciDev->subsystem_device;
    pdx->Key.DeviceNumber = pDriverObject->DeviceCount;

    // Set API access mode
    pdx->Key.ApiMode = PLX_API_MODE_PCI;

    // Update Revision ID
    PLX_PCI_REG_READ( pdx, PCI_REG_CLASS_REV, &RegValue );
    pdx->Key.Revision = (U8)(RegValue & 0xFF);

    // Set device mode
    pdx->Key.DeviceMode = PLX_CHIP_MODE_STANDARD;

    // Set PLX-specific port type
    pdx->Key.PlxPortType = PLX_SPEC_PORT_DMA;

    // Build device name
    sprintf(
        pdx->LinkName,
        PLX_DRIVER_NAME "-%d",
        pDriverObject->DeviceCount
        );

    // Initialize work queue for ISR DPC queueing
    PLX_INIT_WORK(
        &(pdx->Task_DpcForIsr),
        DpcForIsr,                // DPC routine
        &(pdx->Task_DpcForIsr)    // DPC parameter (pre-2.6.20 only)
        );

    // Initialize ISR spinlock
    spin_lock_init( &(pdx->Lock_Isr) );

    // Initialize interrupt wait list
    INIT_LIST_HEAD( &(pdx->List_WaitObjects) );
    spin_lock_init( &(pdx->Lock_WaitObjectsList) );

    // Initialize physical memories list
    INIT_LIST_HEAD( &(pdx->List_PhysicalMem) );
    spin_lock_init( &(pdx->Lock_PhysicalMemList) );

    // Set the DMA mask
    if (Plx_dma_set_mask( pdx, PLX_DMA_BIT_MASK(48) ) == 0)
    {
        DebugPrintf(("Set DMA bit mask to 48-bits\n"));
    }
    else
    {
        DebugPrintf(("ERROR - Unable to set DMA mask to 48-bits, revert to
32-bit\n"));
        Plx_dma_set_mask( pdx, PLX_DMA_BIT_MASK(32) );
    }

    // Set buffer allocation mask
    if (Plx_dma_set_coherent_mask( pdx, PLX_DMA_BIT_MASK(32) ) != 0)
    {
        ErrorPrintf(("WARNING - Set DMA coherent mask failed\n"));
    }

    // Initialize DMA spinlocks
    for (channel = 0; channel < MAX_DMA_CHANNELS; channel++)
    {
        spin_lock_init( &(pdx->Lock_Dma[channel]) );
    }

    //
    // Add to driver device list
    //

    // Acquire Device List lock
    spin_lock( &(pDriverObject->Lock_DeviceList) );

    // Get device list head
    pDevice = pDriverObject->DeviceObject;

    if (pDevice == NULL)
    {
        // Add device as first in list
        pDriverObject->DeviceObject = fdo;
    }
    else
    {
        // Go to end of list
        while (pDevice->NextDevice != NULL)
        {
            pDevice = pDevice->NextDevice;
        }

        // Add device to end of list
        pDevice->NextDevice = fdo;
    }

    // Increment device count
    pDriverObject->DeviceCount++;

    // Release Device List lock
    spin_unlock( &(pDriverObject->Lock_DeviceList) );

    DebugPrintf(("Created Device (%s)\n", pdx->LinkName));

    // Start the device
    status = StartDevice( fdo );
    if (status != 0)
    {
        RemoveDevice( fdo );
        return status;
    }

    return 0;
}


Memory allocate
============
(Driver/Source.Plx8000_DMA/SuppFunc.c)

/*******************************************************************************
 *
 * Function   :  Plx_dma_buffer_alloc
 *
 * Description:  Allocates physically contiguous non-paged memory
 *
 * Note       :  The function allocates a contiguous block of system memory
and
 *               marks it as reserved. Marking the memory as reserved is
required
 *               in case the memory is later mapped to user virtual space.
 *

******************************************************************************/
VOID*
Plx_dma_buffer_alloc(
    DEVICE_EXTENSION    *pdx,
    PLX_PHYS_MEM_OBJECT *pMemObject
    )
{
    dma_addr_t   BusAddress;
    PLX_UINT_PTR virt_addr;


    // Verify size
    if (pMemObject->Size == 0)
    {
        ErrorPrintf(("ERROR: Unable to allocate buffer, requested size =
0\n"));
        RtlZeroMemory( pMemObject, sizeof(PLX_PHYS_MEM_OBJECT) );
        return NULL;
    }

    /*********************************************************
     * Attempt to allocate contiguous memory
     *
     * Additional flags are specified as follows:
     *
     * __GFP_NOWARN : Prevents the kernel from dumping warnings
     *                about a failed allocation attempt.  The
     *                PLX driver already handles failures.
     *
     * __GFP_REPEAT : Not enabled by default, but may be added
     *                manually.  It asks the kernel to "try a
     *                little harder" in the allocation effort.
     ********************************************************/
    pMemObject->pKernelVa =
        Plx_dma_alloc_coherent(
            pdx,
            pMemObject->Size,
            &BusAddress,
            GFP_KERNEL | __GFP_NOWARN
            );

    if (pMemObject->pKernelVa == NULL)
    {
        return NULL;
    }

    // Store the bus address
    pMemObject->BusPhysical = (U64)BusAddress;

    // Tag all pages as reserved
    for (virt_addr = (PLX_UINT_PTR)pMemObject->pKernelVa;
         virt_addr < ((PLX_UINT_PTR)pMemObject->pKernelVa +
pMemObject->Size);
         virt_addr += PAGE_SIZE)
    {
        SetPageReserved(
            virt_to_page( PLX_INT_TO_PTR(virt_addr) )
            );
    }

    // Get CPU physical address of buffer
    pMemObject->CpuPhysical =
        virt_to_phys(
            pMemObject->pKernelVa
            );

    // Clear the buffer
    RtlZeroMemory(
        pMemObject->pKernelVa,
        pMemObject->Size
        );

    DebugPrintf(("Allocated physical memory...\n"));

    DebugPrintf((
        "    CPU Phys Addr: %08llx\n",
        pMemObject->CpuPhysical
        ));

    DebugPrintf((
        "    Bus Phys Addr: %08llx\n",
        pMemObject->BusPhysical
        ));

    DebugPrintf((
        "    Kernel VA    : %p\n",
        pMemObject->pKernelVa
        ));

    DebugPrintf((
        "    Size         : %Xh (%d%s)\n",
        pMemObject->Size,
        (pMemObject->Size > (1 << 30)) ? (pMemObject->Size >> 30) :
          (pMemObject->Size > (1 << 20)) ? (pMemObject->Size >> 20) :
          (pMemObject->Size > (1 << 10)) ? (pMemObject->Size >> 10) :
          pMemObject->Size,
        (pMemObject->Size > (1 << 30)) ? "GB" :
          (pMemObject->Size > (1 << 20)) ? "MB" :
          (pMemObject->Size > (1 << 10)) ? "KB" : "B"
        ));

    // Return the kernel virtual address of the allocated block
    return pMemObject->pKernelVa;
}


DMA transfer
==========
(Driver/Source.Plx8000_DMA/ApiFunc.c)

/******************************************************************************
 *
 * Function   :  PlxDmaTransferBlock
 *
 * Description:  Performs DMA block transfer
 *

******************************************************************************/
PLX_STATUS
PlxDmaTransferBlock(
    DEVICE_EXTENSION *pdx,
    U8                channel,
    PLX_DMA_PARAMS   *pParams,
    VOID             *pOwner
    )
{
    U16        OffsetDmaBase;
    U32        RegValue;
    PLX_STATUS status;

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    // Verify DMA channel is available
    status =
        PlxDmaStatus(
            pdx,
            channel,
            pOwner
            );

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    if (status != PLX_STATUS_COMPLETE)
    {
        DebugPrintf(("ERROR - DMA unavailable or in-progress\n"));
        return status;
    }

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    DebugPrintf((
        "Ch %d - DMA %08X_%08X --> %08X_%08X (%d bytes)\n",
        channel, PLX_64_HIGH_32(pParams->AddrSource),
PLX_64_LOW_32(pParams->AddrSource),
        PLX_64_HIGH_32(pParams->AddrDest), PLX_64_LOW_32(pParams->AddrDest),
        pParams->ByteCount
        ));

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    // Set the channel's base register offset (200h, 300h, etc)
    OffsetDmaBase = 0x200 + (channel * 0x100);

    spin_lock(
        &(pdx->Lock_Dma[channel])
        );

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    // Write Source Address
    PLX_DMA_REG_WRITE( pdx, OffsetDmaBase + 0x0,
PLX_64_LOW_32(pParams->AddrSource) );
    PLX_DMA_REG_WRITE( pdx, OffsetDmaBase + 0x4,
PLX_64_HIGH_32(pParams->AddrSource) );

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    // Write Destination Address
    PLX_DMA_REG_WRITE( pdx, OffsetDmaBase + 0x8,
PLX_64_LOW_32(pParams->AddrDest) );
    PLX_DMA_REG_WRITE( pdx, OffsetDmaBase + 0xC,
PLX_64_HIGH_32(pParams->AddrDest) );

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    // Set Transfer Count & address & interrupt options
    RegValue =
        (1                       << 31) |   // Valid bit
        (pParams->bConstAddrSrc  << 29) |   // Keep source address constant
        (pParams->bConstAddrDest << 28) |   // Keep destination address
constant
        (pParams->ByteCount      <<  0);    // Byte count
    if (pParams->bIgnoreBlockInt == 0)
    {
        RegValue |= (1 << 30);
    }
    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    PLX_DMA_REG_WRITE( pdx, OffsetDmaBase + 0x10, RegValue );

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    // Get DMA control/status
    RegValue = PLX_DMA_REG_READ( pdx, OffsetDmaBase + 0x38 );

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    // Set DMA to block mode
    if (pdx->Key.PlxFamily == PLX_FAMILY_SIRIUS)
    {
        RegValue &= ~(1 << 4);
    }
    else
    {
        RegValue &= ~(3 << 5);
    }

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    // Make sure descriptor write-back ([2]) is disabled
    RegValue &= ~(1 << 2);

    // Clear any active status bits ([31,12:8])
    RegValue |= ((1 << 31) | (0x1F << 8));

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    spin_unlock(
        &(pdx->Lock_Dma[channel])
        );

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    DebugPrintf(("Start DMA transfer...\n"));

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    // Start DMA ([3])
    PLX_DMA_REG_WRITE( pdx, OffsetDmaBase + 0x38, RegValue | (1 << 3) );

    printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
    return PLX_STATUS_OK;
}

Latest dmesg with EEH error
======================
[156541.460091] Plx8000_NT:
<========================================================>
[156541.460316] Plx8000_NT: PLX 8000_NT driver v7.25 (64-bit)
[156541.460365] Plx8000_NT: Supports Linux kernel
v3.10.0-514.10.2.el7.ppc64le
[156541.460428] Plx8000_NT: Allocated global driver object
(c000003c841f0200)
[156541.460432] Plx8000_NT: Registered driver (MajorID = 247)
[156541.460463] Plx8000_NT:    --------------------
[156541.460469] Plx8000_NT: Probe: 8619 10B5 [D1 01:00.1]
[156541.460482] Plx8000_NT: Probe: -- Unsupported Device --
[156541.460506] Plx8000_NT:    --------------------
[156541.460509] Plx8000_NT: Probe: 8619 10B5 [D1 02:01.0]
[156541.460518] Plx8000_NT: Enabled PCI device
[156541.460527] Plx8000_NT: Created Device (Plx8000_NT-0)
[156541.460530] Plx8000_NT: Start: 8619 10B5 [D1 02:01.0]
[156541.460532] Debug StartDevice 723: Reading PCI header command...
[156541.460720] Debug StartDevice 725: Reading PCI header command... =
0x100146
[156541.460790] Plx8000_NT:    Resource 00
[156541.460792] Plx8000_NT:      Type     : Memory
[156541.460798] Plx8000_NT:      PCI BAR 0: 81000000
[156541.460799] Plx8000_NT:      Phys Addr: 3FE081000000
[156541.460802] Plx8000_NT:      Size     : 20000h (128KB)
[156541.460804] Plx8000_NT:      Property : Non-Prefetchable 32-bit
[156541.460819] Plx8000_NT:      Kernel VA: d000080081480000
[156541.460822] Debug StartDevice 841: Read BAR0[0xd000080081480000] after
map...
[156541.460895] Debug StartDevice 843: Read BAR0[0xd000080081480000] after
map... = 0x861910b5
[156541.460966] Plx8000_NT:    Resource 01
[156541.460967] Plx8000_NT:      Type     : Memory
[156541.460973] Plx8000_NT:      PCI BAR 2: 80000000
[156541.460974] Plx8000_NT:      Phys Addr: 3FE080000000
[156541.460976] Plx8000_NT:      Size     : 400000h (4MB)
[156541.460978] Plx8000_NT:      Property : Non-Prefetchable 32-bit
[156541.460983] Plx8000_NT:      Kernel VA: d000080084000000
[156541.460985] Debug StartDevice 849: Read BAR2[0xd000080084000000] after
map...
[156541.461073] Debug StartDevice 851: Read BAR2[0xd000080084000000] after
map... = 0xf000eef3
[156541.461146] Plx8000_NT:    Resource 02
[156541.461147] Plx8000_NT:      Type     : Memory
[156541.461152] Plx8000_NT:      PCI BAR 3: 80400000
[156541.461154] Plx8000_NT:      Phys Addr: 3FE080400000
[156541.461156] Plx8000_NT:      Size     : 400000h (4MB)
[156541.461157] Plx8000_NT:      Property : Non-Prefetchable 32-bit
[156541.461162] Plx8000_NT:      Kernel VA: d000080084800000
[156541.461163] Plx8000_NT:    Resource 03
[156541.461165] Plx8000_NT:      Type     : Memory
[156541.461170] Plx8000_NT:      PCI BAR 4: 80800000
[156541.461171] Plx8000_NT:      Phys Addr: 3FE080800000
[156541.461173] Plx8000_NT:      Size     : 400000h (4MB)
[156541.461175] Plx8000_NT:      Property : Non-Prefetchable 32-bit
[156541.461179] Plx8000_NT:      Kernel VA: d000080085000000
[156541.461180] Plx8000_NT:    Resource 04
[156541.461182] Plx8000_NT:      Type     : Memory
[156541.461187] Plx8000_NT:      PCI BAR 5: 80C00000
[156541.461188] Plx8000_NT:      Phys Addr: 3FE080C00000
[156541.461190] Plx8000_NT:      Size     : 400000h (4MB)
[156541.461192] Plx8000_NT:      Property : Non-Prefetchable 32-bit
[156541.461196] Plx8000_NT:      Kernel VA: d000080085800000
[156541.461198] Debug StartDevice 862: Reading PCI header command...
[156541.461261] Debug StartDevice 864: Reading PCI header command... =
0x100146
[156541.461409] Plx8000_NT: Device 8619_10B5 = 8619 rev BA
[156541.461412] Plx8000_NT: Device in NT LEGACY mode
[156541.461414] Debug StartDevice 891: Read BAR0[0xd000080081480000] before
PlxDetermineNtPortSide...
[156541.461497] Debug StartDevice 893: Read BAR0[0xd000080081480000] before
PlxDetermineNtPortSide map... = 0x861910b5
[156541.461595] Plx8000_NT: NT port is VIRTUAL-side (NT base=10000h)
[156541.461597] Debug StartDevice 901: Read BAR0[0xd000080081480000] after
PlxDetermineNtPortSide...
[156541.461684] Debug StartDevice 903: Read BAR0[0xd000080081480000] after
PlxDetermineNtPortSide map... = 0x861910b5
[156541.461834] Plx8000_NT: MSI enabled, change IRQ 249 --> 499
[156541.461836] Plx8000_NT:    Resource 05
[156541.461838] Plx8000_NT:      Type     : Interrupt (MSI)
[156541.461840] Plx8000_NT:      IRQ      : 499 [1F3h]
[156541.461850] Plx8000_NT:      MSI Addr : 10000000
[156541.461855] Plx8000_NT: _00000000
[156541.461860] Plx8000_NT:      MSI Data : 0001
[156541.461878] Plx8000_NT: Installed ISR for interrupt
[156541.461895] Plx8000_NT:    --------------------
[156541.461899] Plx8000_NT: Probe: 87D0 10B5 [D3 01:00.1]
[156541.461909] Plx8000_NT: Probe: -- Unsupported Device --
[156541.461916] Plx8000_NT:    --------------------
[156541.461918] Plx8000_NT: Probe: 87D0 10B5 [D3 01:00.2]
[156541.461925] Plx8000_NT: Probe: -- Unsupported Device --
[156541.461931] Plx8000_NT:    --------------------
[156541.461933] Plx8000_NT: Probe: 87D0 10B5 [D3 01:00.3]
[156541.461940] Plx8000_NT: Probe: -- Unsupported Device --
[156541.461946] Plx8000_NT:    --------------------
[156541.461948] Plx8000_NT: Probe: 87D0 10B5 [D3 01:00.4]
[156541.461956] Plx8000_NT: Probe: -- Unsupported Device --
[156541.461984] Plx8000_NT: Attempt to allocate physical memory (8KB)
[156541.461999] Plx8000_NT: Allocated physical memory...
[156541.462001] Plx8000_NT:     CPU Phys Addr: 1f87000000
[156541.462002] Plx8000_NT:     Bus Phys Addr: 60df0000
[156541.462004] Plx8000_NT:     Kernel VA    : c000001f87000000
[156541.462006] Plx8000_NT:     Size         : 2000h (8KB)
[156541.462008] Plx8000_NT:    --------------------
[156541.462009] Plx8000_NT: Added: 1 device
[156541.462011] Plx8000_NT: ...driver loaded


[156542.961942] Plx8000_DMA:
<========================================================>
[156542.962168] Plx8000_DMA: PLX 8000_DMA driver v7.25 (64-bit)
[156542.962227] Plx8000_DMA: Supports Linux kernel
v3.10.0-514.10.2.el7.ppc64le
[156542.962301] Plx8000_DMA: Allocated global driver object
(c000003c834af800)
[156542.962543] Plx8000_DMA: Registered driver (MajorID = 246)
[156542.962616] Plx8000_DMA:    --------------------
[156542.962668] Plx8000_DMA: Probe: 8619 10B5 [D1 01:00.1]
[156542.962724] Plx8000_DMA: Enabled PCI device
[156542.962772] Debug AddDevice: dma_set_mask_and_coherent()...
[156542.962836] PLX 8000 DMA Driver 0001:01:00.1: Using 32-bit DMA via iommu
[156542.962901] PLX 8000 DMA Driver 0001:01:00.1: Using 32-bit DMA via iommu
[156542.962959] Plx8000_DMA: Set DMA bit mask to 48-bits
[156542.963006] Plx8000_DMA: Created Device (Plx8000_DMA-0)
[156542.963054] Plx8000_DMA: Start: 8619 10B5 [D1 01:00.1]
[156542.963102] Plx8000_DMA:    Resource 00
[156542.963138] Plx8000_DMA:      Type     : Memory
[156542.963189] Plx8000_DMA:      PCI BAR 0: 81820000
[156542.963236] Plx8000_DMA:      Phys Addr: 3FE081820000
[156542.963284] Plx8000_DMA:      Size     : 20000h (128KB)
[156542.963332] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
[156542.963395] Plx8000_DMA:      Kernel VA: d0000800814c0000
[156542.963489] Plx8000_DMA: Device 8619_10B5 = 8619 rev BA
[156542.963583] Plx8000_DMA: MSI enabled, change IRQ 249 --> 500
[156542.963642] Plx8000_DMA:    Resource 01
[156542.963679] Plx8000_DMA:      Type     : Interrupt (MSI)
[156542.963727] Plx8000_DMA:      IRQ      : 500 [1F4h]
[156542.963782] Plx8000_DMA:      MSI Addr : 10000000
[156542.963832] Plx8000_DMA: _00000000
[156542.963882] Plx8000_DMA:      MSI Data : 0002
[156542.963941] Plx8000_DMA: Installed ISR for interrupt
[156542.964013] Plx8000_DMA:    --------------------
[156542.964070] Plx8000_DMA: Probe: 87D0 10B5 [D3 01:00.1]
[156542.964142] Plx8000_DMA: Enabled PCI device
[156542.964191] Debug AddDevice: dma_set_mask_and_coherent()...
[156542.964255] PLX 8000 DMA Driver 0003:01:00.1: Using 32-bit DMA via iommu
[156542.964324] PLX 8000 DMA Driver 0003:01:00.1: Using 32-bit DMA via iommu
[156542.964385] Plx8000_DMA: Set DMA bit mask to 48-bits
[156542.964432] Plx8000_DMA: Created Device (Plx8000_DMA-1)
[156542.964482] Plx8000_DMA: Start: 87D0 10B5 [D3 01:00.1]
[156542.964528] Plx8000_DMA:    Resource 00
[156542.964564] Plx8000_DMA:      Type     : Memory
[156542.964617] Plx8000_DMA:      PCI BAR 0: 83040000
[156542.964666] Plx8000_DMA:      Phys Addr: 3FE883040000
[156542.964716] Plx8000_DMA:      Size     : 2000h (8KB)
[156542.964766] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
[156542.964857] Plx8000_DMA:      Kernel VA: d000080081500000
[156542.964996] Plx8000_DMA: Device 87D0_10B5 = 8725 rev CA
[156542.965096] Plx8000_DMA: MSI enabled, change IRQ 251 --> 272
[156542.965157] Plx8000_DMA:    Resource 01
[156542.965193] Plx8000_DMA:      Type     : Interrupt (MSI)
[156542.965239] Plx8000_DMA:      IRQ      : 272 [110h]
[156542.965296] Plx8000_DMA:      MSI Addr : 10000000
[156542.965349] Plx8000_DMA: _00000000
[156542.965403] Plx8000_DMA:      MSI Data : 0010
[156542.965481] Plx8000_DMA: Installed ISR for interrupt
[156542.965537] Plx8000_DMA:    --------------------
[156542.965587] Plx8000_DMA: Probe: 87D0 10B5 [D3 01:00.2]
[156542.965642] Plx8000_DMA: Enabled PCI device
[156542.965726] Debug AddDevice: dma_set_mask_and_coherent()...
[156542.965790] PLX 8000 DMA Driver 0003:01:00.2: Using 32-bit DMA via iommu
[156542.965884] PLX 8000 DMA Driver 0003:01:00.2: Using 32-bit DMA via iommu
[156542.965948] Plx8000_DMA: Set DMA bit mask to 48-bits
[156542.966026] Plx8000_DMA: Created Device (Plx8000_DMA-2)
[156542.966077] Plx8000_DMA: Start: 87D0 10B5 [D3 01:00.2]
[156542.966153] Plx8000_DMA:    Resource 00
[156542.966190] Plx8000_DMA:      Type     : Memory
[156542.966245] Plx8000_DMA:      PCI BAR 0: 83042000
[156542.966329] Plx8000_DMA:      Phys Addr: 3FE883042000
[156542.966395] Plx8000_DMA:      Size     : 2000h (8KB)
[156542.966466] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
[156542.966531] Plx8000_DMA:      Kernel VA: d000080081522000
[156542.986063] Plx8000_DMA: Device 87D0_10B5 = 8725 rev CA
[156543.012909] Plx8000_DMA: MSI enabled, change IRQ 251 --> 273
[156543.033885] Plx8000_DMA:    Resource 01
[156543.051045] Plx8000_DMA:      Type     : Interrupt (MSI)
[156543.058139] Plx8000_DMA:      IRQ      : 273 [111h]
[156543.081938] Plx8000_DMA:      MSI Addr : 10000000
[156543.151285] Plx8000_DMA: _00000000
[156543.151340] Plx8000_DMA:      MSI Data : 0011
[156543.175049] Plx8000_DMA: Installed ISR for interrupt
[156543.199076] Plx8000_DMA:    --------------------
[156543.228325] Plx8000_DMA: Probe: 87D0 10B5 [D3 01:00.3]
[156543.266237] Plx8000_DMA: Enabled PCI device
[156543.266287] Debug AddDevice: dma_set_mask_and_coherent()...
[156543.284766] PLX 8000 DMA Driver 0003:01:00.3: Using 32-bit DMA via iommu
[156543.302570] PLX 8000 DMA Driver 0003:01:00.3: Using 32-bit DMA via iommu
[156543.338986] Plx8000_DMA: Set DMA bit mask to 48-bits
[156543.356741] Plx8000_DMA: Created Device (Plx8000_DMA-3)
[156543.385337] Plx8000_DMA: Start: 87D0 10B5 [D3 01:00.3]
[156543.385384] Plx8000_DMA:    Resource 00
[156543.401548] Plx8000_DMA:      Type     : Memory
[156543.416851] Plx8000_DMA:      PCI BAR 0: 83044000
[156543.432384] Plx8000_DMA:      Phys Addr: 3FE883044000
[156543.447424] Plx8000_DMA:      Size     : 2000h (8KB)
[156543.462876] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
[156543.502837] Plx8000_DMA:      Kernel VA: d000080081544000
[156543.522190] Plx8000_DMA: Device 87D0_10B5 = 8725 rev CA
[156543.536863] Plx8000_DMA: MSI enabled, change IRQ 251 --> 274
[156543.536923] Plx8000_DMA:    Resource 01
[156543.558229] Plx8000_DMA:      Type     : Interrupt (MSI)
[156543.579107] Plx8000_DMA:      IRQ      : 274 [112h]
[156543.593668] Plx8000_DMA:      MSI Addr : 10000000
[156543.607511] Plx8000_DMA: _00000000
[156543.622554] Plx8000_DMA:      MSI Data : 0012
[156543.622630] Plx8000_DMA: Installed ISR for interrupt
[156543.645996] Plx8000_DMA:    --------------------
[156543.659853] Plx8000_DMA: Probe: 87D0 10B5 [D3 01:00.4]
[156543.667360] Plx8000_DMA: Enabled PCI device
[156543.681660] Debug AddDevice: dma_set_mask_and_coherent()...
[156543.695406] PLX 8000 DMA Driver 0003:01:00.4: Using 32-bit DMA via iommu
[156543.709749] PLX 8000 DMA Driver 0003:01:00.4: Using 32-bit DMA via iommu
[156543.723734] Plx8000_DMA: Set DMA bit mask to 48-bits
[156543.744728] Plx8000_DMA: Created Device (Plx8000_DMA-4)
[156543.758804] Plx8000_DMA: Start: 87D0 10B5 [D3 01:00.4]
[156543.773284] Plx8000_DMA:    Resource 00
[156543.773322] Plx8000_DMA:      Type     : Memory
[156543.791508] Plx8000_DMA:      PCI BAR 0: 83046000
[156543.805245] Plx8000_DMA:      Phys Addr: 3FE883046000
[156543.819215] Plx8000_DMA:      Size     : 2000h (8KB)
[156543.833571] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
[156543.847515] Plx8000_DMA:      Kernel VA: d000080081566000
[156543.886524] Plx8000_DMA: Device 87D0_10B5 = 8725 rev CA
[156543.906770] Plx8000_DMA: MSI enabled, change IRQ 251 --> 275
[156543.924546] Plx8000_DMA:    Resource 01
[156543.938587] Plx8000_DMA:      Type     : Interrupt (MSI)
[156543.938637] Plx8000_DMA:      IRQ      : 275 [113h]
[156543.959460] Plx8000_DMA:      MSI Addr : 10000000
[156543.974286] Plx8000_DMA: _00000000
[156543.989775] Plx8000_DMA:      MSI Data : 0013
[156544.005015] Plx8000_DMA: Installed ISR for interrupt
[156544.018303] Plx8000_DMA: Attempt to allocate physical memory (64KB)
[156544.040309] Plx8000_DMA: Allocated physical memory...
[156544.069896] Plx8000_DMA:     CPU Phys Addr: 1fc3dd0000
[156544.136502] Plx8000_DMA:     Bus Phys Addr: 60030000
[156544.136551] Plx8000_DMA:     Kernel VA    : c000001fc3dd0000
[156544.183572] Plx8000_DMA:     Size         : 10000h (64KB)
[156544.222978] Plx8000_DMA:    --------------------
[156544.253033] Plx8000_DMA: Added: 5 devices
[156544.296043] Plx8000_DMA: ...driver loaded

[156562.531757] Plx8000_NT: 
[156562.531762] Plx8000_NT: Received message ==> OPEN_DEVICE
[156562.531764] Plx8000_NT: Open device (Plx8000_NT-0)...
[156562.531766] Plx8000_NT: ...device opened
[156562.531769] Plx8000_NT: 
[156562.531771] Plx8000_NT: Received PLX message ===> 
[156562.531772] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156562.531774] Plx8000_NT: ...Completed message
[156562.531776] Plx8000_NT: 
[156562.531777] Plx8000_NT: Received PLX message ===> 
[156562.531779] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156562.531782] Plx8000_NT: Criteria matched device 8619_10B5 [02:01.0]
[156562.531783] Plx8000_NT: ...Completed message
[156562.531787] Plx8000_NT: 
[156562.531788] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156562.531790] Plx8000_NT: Close device (Plx8000_NT-0)...
[156562.531792] Plx8000_NT: ...device closed
[156562.531798] Plx8000_NT: 
[156562.531799] Plx8000_NT: Received message ==> OPEN_DEVICE
[156562.531801] Plx8000_NT: Open device (Plx8000_NT-0)...
[156562.531802] Plx8000_NT: ...device opened
[156562.531805] Plx8000_NT: 
[156562.531806] Plx8000_NT: Received PLX message ===> 
[156562.531807] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156562.531809] Plx8000_NT: ...Completed message
[156562.531814] Plx8000_NT: 
[156562.531815] Plx8000_NT: Received PLX message ===> 
[156562.531816] Plx8000_NT: PLX_IOCTL_GET_PORT_PROPERTIES
[156562.531861] Plx8000_NT: [D1 02:01.0] P=1 T=0 MPS=512/2048 MRR=128
L=G2x4/G2x8
[156562.531863] Plx8000_NT: ...Completed message
[156562.531866] Plx8000_NT: 
[156562.531867] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156562.531869] Plx8000_NT: Close device (Plx8000_NT-0)...
[156562.531870] Plx8000_NT: ...device closed
[156562.531898] Plx8000_NT: 
[156562.531899] Plx8000_NT: Received message ==> OPEN_DEVICE
[156562.531901] Plx8000_NT: Open device (Plx8000_NT-0)...
[156562.531902] Plx8000_NT: ...device opened
[156562.531905] Plx8000_NT: 
[156562.531906] Plx8000_NT: Received PLX message ===> 
[156562.531907] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156562.531909] Plx8000_NT: ...Completed message
[156562.531911] Plx8000_NT: 
[156562.531912] Plx8000_NT: Received PLX message ===> 
[156562.531913] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156562.531915] Plx8000_NT: Criteria did not match any devices
[156562.531916] Plx8000_NT: ...Completed message
[156562.531919] Plx8000_NT: 
[156562.531920] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156562.531922] Plx8000_NT: Close device (Plx8000_NT-0)...
[156562.531923] Plx8000_NT: ...device closed
[156562.531930] Plx8000_DMA: 
[156562.532042] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156562.532211] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156562.532256] Plx8000_DMA: ...device opened
[156562.532294] Plx8000_DMA: 
[156562.532320] Plx8000_DMA: Received PLX message ===> 
[156562.532409] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156562.532592] Plx8000_DMA: ...Completed message
[156562.532641] PLX DMA[Dispatch_IoControl-1053]
[156562.532688] PLX DMA[Dispatch_IoControl-1061]
[156562.532736] Plx8000_DMA: 
[156562.532762] Plx8000_DMA: Received PLX message ===> 
[156562.532809] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[156562.532871] Plx8000_DMA: Criteria matched device 8619_10B5 [01:00.1]
[156562.532932] Plx8000_DMA: ...Completed message
[156562.532979] PLX DMA[Dispatch_IoControl-1053]
[156562.533027] PLX DMA[Dispatch_IoControl-1061]
[156562.533077] Plx8000_DMA: 
[156562.533102] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156562.533151] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156562.533199] Plx8000_DMA: ...device closed
[156562.533239] Plx8000_DMA: 
[156562.533263] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156562.533313] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156562.533362] Plx8000_DMA: ...device opened
[156562.533399] Plx8000_DMA: 
[156562.533425] Plx8000_DMA: Received PLX message ===> 
[156562.533473] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156562.533532] Plx8000_DMA: ...Completed message
[156562.533581] PLX DMA[Dispatch_IoControl-1053]
[156562.533628] PLX DMA[Dispatch_IoControl-1061]
[156562.533677] Plx8000_DMA: 
[156562.533701] Plx8000_DMA: Received PLX message ===> 
[156562.533746] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
[156562.533838] Plx8000_DMA: [D1 01:00.1] P=0 T=0 MPS=512/2048 MRR=512
L=G2x8/G2x8
[156562.533910] Plx8000_DMA: ...Completed message
[156562.533956] PLX DMA[Dispatch_IoControl-1053]
[156562.534002] PLX DMA[Dispatch_IoControl-1061]
[156562.534050] Plx8000_DMA: 
[156562.534075] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156562.534122] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156562.534169] Plx8000_DMA: ...device closed
[156562.534233] Plx8000_NT: 
[156562.534235] Plx8000_NT: Received message ==> OPEN_DEVICE
[156562.534236] Plx8000_NT: Open device (Plx8000_NT-0)...
[156562.534238] Plx8000_NT: ...device opened
[156562.534240] Plx8000_NT: 
[156562.534242] Plx8000_NT: Received PLX message ===> 
[156562.534243] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156562.534244] Plx8000_NT: ...Completed message
[156562.534246] Plx8000_NT: 
[156562.534247] Plx8000_NT: Received PLX message ===> 
[156562.534249] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156562.534250] Plx8000_NT: Criteria did not match any devices
[156562.534251] Plx8000_NT: ...Completed message
[156562.534254] Plx8000_NT: 
[156562.534255] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156562.534257] Plx8000_NT: Close device (Plx8000_NT-0)...
[156562.534258] Plx8000_NT: ...device closed
[156562.534263] Plx8000_DMA: 
[156562.534287] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156562.534335] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156562.534383] Plx8000_DMA: ...device opened
[156562.534421] Plx8000_DMA: 
[156562.534446] Plx8000_DMA: Received PLX message ===> 
[156562.534495] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156562.534553] Plx8000_DMA: ...Completed message
[156562.534600] PLX DMA[Dispatch_IoControl-1053]
[156562.534649] PLX DMA[Dispatch_IoControl-1061]
[156562.534697] Plx8000_DMA: 
[156562.534721] Plx8000_DMA: Received PLX message ===> 
[156562.534769] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[156562.534829] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.1]
[156562.534889] Plx8000_DMA: ...Completed message
[156562.534937] PLX DMA[Dispatch_IoControl-1053]
[156562.534986] PLX DMA[Dispatch_IoControl-1061]
[156562.535036] Plx8000_DMA: 
[156562.535060] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156562.535106] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156562.535155] Plx8000_DMA: ...device closed
[156562.535194] Plx8000_DMA: 
[156562.535221] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156562.535269] Plx8000_DMA: Open device (Plx8000_DMA-1)...
[156562.535331] Plx8000_DMA: ...device opened
[156562.535378] Plx8000_DMA: 
[156562.535404] Plx8000_DMA: Received PLX message ===> 
[156562.535452] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156562.535511] Plx8000_DMA: ...Completed message
[156562.535560] PLX DMA[Dispatch_IoControl-1053]
[156562.535650] PLX DMA[Dispatch_IoControl-1061]
[156562.535705] Plx8000_DMA: 
[156562.535730] Plx8000_DMA: Received PLX message ===> 
[156562.535801] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
[156562.535928] Plx8000_DMA: [D3 01:00.1] P=0 T=0 MPS=128/2048 MRR=512
L=G3x8/G3x8
[156562.536001] Plx8000_DMA: ...Completed message
[156562.536077] PLX DMA[Dispatch_IoControl-1053]
[156562.536147] PLX DMA[Dispatch_IoControl-1061]
[156562.536218] Plx8000_DMA: 
[156562.536243] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156562.536302] Plx8000_DMA: Close device (Plx8000_DMA-1)...
[156562.546438] Plx8000_DMA: ...device closed
[156562.570813] Plx8000_NT: 
[156562.570815] Plx8000_NT: Received message ==> OPEN_DEVICE
[156562.570817] Plx8000_NT: Open device (Plx8000_NT-0)...
[156562.570818] Plx8000_NT: ...device opened
[156562.570821] Plx8000_NT: 
[156562.570822] Plx8000_NT: Received PLX message ===> 
[156562.570823] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156562.570825] Plx8000_NT: ...Completed message
[156562.570827] Plx8000_NT: 
[156562.570828] Plx8000_NT: Received PLX message ===> 
[156562.570829] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156562.570831] Plx8000_NT: Criteria did not match any devices
[156562.570832] Plx8000_NT: ...Completed message
[156562.570835] Plx8000_NT: 
[156562.570836] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156562.570838] Plx8000_NT: Close device (Plx8000_NT-0)...
[156562.570839] Plx8000_NT: ...device closed
[156562.570844] Plx8000_DMA: 
[156562.570872] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156562.584646] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156562.608579] Plx8000_DMA: ...device opened
[156562.622863] Plx8000_DMA: 
[156562.622889] Plx8000_DMA: Received PLX message ===> 
[156562.635962] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156562.656582] Plx8000_DMA: ...Completed message
[156562.669725] PLX DMA[Dispatch_IoControl-1053]
[156562.669775] PLX DMA[Dispatch_IoControl-1061]
[156562.690495] Plx8000_DMA: 
[156562.716736] Plx8000_DMA: Received PLX message ===> 
[156562.716786] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[156562.729952] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.2]
[156562.747900] Plx8000_DMA: ...Completed message
[156562.761509] PLX DMA[Dispatch_IoControl-1053]
[156562.781887] PLX DMA[Dispatch_IoControl-1061]
[156562.795281] Plx8000_DMA: 
[156562.795310] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156562.809295] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156562.828996] Plx8000_DMA: ...device closed
[156562.843210] Plx8000_DMA: 
[156562.843236] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156562.856779] Plx8000_DMA: Open device (Plx8000_DMA-2)...
[156562.880503] Plx8000_DMA: ...device opened
[156562.894602] Plx8000_DMA: 
[156562.894626] Plx8000_DMA: Received PLX message ===> 
[156562.908203] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156562.922109] Plx8000_DMA: ...Completed message
[156562.945318] PLX DMA[Dispatch_IoControl-1053]
[156562.959849] PLX DMA[Dispatch_IoControl-1061]
[156562.959898] Plx8000_DMA: 
[156562.973546] Plx8000_DMA: Received PLX message ===> 
[156562.987656] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
[156563.002661] Plx8000_DMA: [D3 01:00.2] P=0 T=0 MPS=128/2048 MRR=512
L=G3x8/G3x8
[156563.026654] Plx8000_DMA: ...Completed message
[156563.040343] PLX DMA[Dispatch_IoControl-1053]
[156563.040389] PLX DMA[Dispatch_IoControl-1061]
[156563.054462] Plx8000_DMA: 
[156563.069658] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156563.090858] Plx8000_DMA: Close device (Plx8000_DMA-2)...
[156563.105070] Plx8000_DMA: ...device closed
[156563.105135] Plx8000_NT: 
[156563.105136] Plx8000_NT: Received message ==> OPEN_DEVICE
[156563.105137] Plx8000_NT: Open device (Plx8000_NT-0)...
[156563.105139] Plx8000_NT: ...device opened
[156563.105141] Plx8000_NT: 
[156563.105142] Plx8000_NT: Received PLX message ===> 
[156563.105143] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156563.105144] Plx8000_NT: ...Completed message
[156563.105145] Plx8000_NT: 
[156563.105146] Plx8000_NT: Received PLX message ===> 
[156563.105147] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156563.105148] Plx8000_NT: Criteria did not match any devices
[156563.105150] Plx8000_NT: ...Completed message
[156563.105152] Plx8000_NT: 
[156563.105153] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156563.105154] Plx8000_NT: Close device (Plx8000_NT-0)...
[156563.105155] Plx8000_NT: ...device closed
[156563.105159] Plx8000_DMA: 
[156563.118343] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156563.138958] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156563.156417] Plx8000_DMA: ...device opened
[156563.156454] Plx8000_DMA: 
[156563.170984] Plx8000_DMA: Received PLX message ===> 
[156563.191831] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156563.205911] Plx8000_DMA: ...Completed message
[156563.205956] PLX DMA[Dispatch_IoControl-1053]
[156563.225683] PLX DMA[Dispatch_IoControl-1061]
[156563.239309] Plx8000_DMA: 
[156563.239332] Plx8000_DMA: Received PLX message ===> 
[156563.253748] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[156563.267644] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.3]
[156563.288620] Plx8000_DMA: ...Completed message
[156563.342195] PLX DMA[Dispatch_IoControl-1053]
[156563.361609] PLX DMA[Dispatch_IoControl-1061]
[156563.361667] Plx8000_DMA: 
[156563.385195] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156563.413351] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156563.442696] Plx8000_DMA: ...device closed
[156563.463349] Plx8000_DMA: 
[156563.463383] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156563.482592] Plx8000_DMA: Open device (Plx8000_DMA-3)...
[156563.522918] Plx8000_DMA: ...device opened
[156563.552722] Plx8000_DMA: 
[156563.552751] Plx8000_DMA: Received PLX message ===> 
[156563.571726] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156563.602616] Plx8000_DMA: ...Completed message
[156563.625686] PLX DMA[Dispatch_IoControl-1053]
[156563.625735] PLX DMA[Dispatch_IoControl-1061]
[156563.653003] Plx8000_DMA: 
[156563.682700] Plx8000_DMA: Received PLX message ===> 
[156563.682748] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
[156563.698771] Plx8000_DMA: [D3 01:00.3] P=0 T=0 MPS=128/2048 MRR=512
L=G3x8/G3x8
[156563.753133] Plx8000_DMA: ...Completed message
[156563.773272] PLX DMA[Dispatch_IoControl-1053]
[156563.773321] PLX DMA[Dispatch_IoControl-1061]
[156563.787388] Plx8000_DMA: 
[156563.787415] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156563.801760] Plx8000_DMA: Close device (Plx8000_DMA-3)...
[156563.815276] Plx8000_DMA: ...device closed
[156563.839004] Plx8000_NT: 
[156563.839006] Plx8000_NT: Received message ==> OPEN_DEVICE
[156563.839008] Plx8000_NT: Open device (Plx8000_NT-0)...
[156563.839010] Plx8000_NT: ...device opened
[156563.839012] Plx8000_NT: 
[156563.839014] Plx8000_NT: Received PLX message ===> 
[156563.839015] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156563.839017] Plx8000_NT: ...Completed message
[156563.839019] Plx8000_NT: 
[156563.839020] Plx8000_NT: Received PLX message ===> 
[156563.839022] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156563.839023] Plx8000_NT: Criteria did not match any devices
[156563.839025] Plx8000_NT: ...Completed message
[156563.839027] Plx8000_NT: 
[156563.839029] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156563.839030] Plx8000_NT: Close device (Plx8000_NT-0)...
[156563.839032] Plx8000_NT: ...device closed
[156563.839038] Plx8000_DMA: 
[156563.853847] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156563.867182] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156563.867230] Plx8000_DMA: ...device opened
[156563.887836] Plx8000_DMA: 
[156563.901487] Plx8000_DMA: Received PLX message ===> 
[156563.931748] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156563.931806] Plx8000_DMA: ...Completed message
[156563.945807] PLX DMA[Dispatch_IoControl-1053]
[156563.969968] PLX DMA[Dispatch_IoControl-1061]
[156563.985037] Plx8000_DMA: 
[156563.985063] Plx8000_DMA: Received PLX message ===> 
[156563.998669] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[156564.013716] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.4]
[156564.036795] Plx8000_DMA: ...Completed message
[156564.051283] PLX DMA[Dispatch_IoControl-1053]
[156564.067066] PLX DMA[Dispatch_IoControl-1061]
[156564.067120] Plx8000_DMA: 
[156564.081454] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156564.106002] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156564.120673] Plx8000_DMA: ...device closed
[156564.120717] Plx8000_DMA: 
[156564.135396] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156564.155769] Plx8000_DMA: Open device (Plx8000_DMA-4)...
[156564.169952] Plx8000_DMA: ...device opened
[156564.170075] Plx8000_DMA: 
[156564.184096] Plx8000_DMA: Received PLX message ===> 
[156564.218424] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156564.241590] Plx8000_DMA: ...Completed message
[156564.241637] PLX DMA[Dispatch_IoControl-1053]
[156564.267168] PLX DMA[Dispatch_IoControl-1061]
[156564.284546] Plx8000_DMA: 
[156564.299010] Plx8000_DMA: Received PLX message ===> 
[156564.299054] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
[156564.342078] Plx8000_DMA: [D3 01:00.4] P=0 T=0 MPS=128/2048 MRR=512
L=G3x8/G3x8
[156564.381570] Plx8000_DMA: ...Completed message
[156564.381615] PLX DMA[Dispatch_IoControl-1053]
[156564.413790] PLX DMA[Dispatch_IoControl-1061]
[156564.434488] Plx8000_DMA: 
[156564.434512] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156564.456071] Plx8000_DMA: Close device (Plx8000_DMA-4)...
[156564.481577] Plx8000_DMA: ...device closed
[156564.496407] Plx8000_NT: 
[156564.496409] Plx8000_NT: Received message ==> OPEN_DEVICE
[156564.496410] Plx8000_NT: Open device (Plx8000_NT-0)...
[156564.496411] Plx8000_NT: ...device opened
[156564.496413] Plx8000_NT: 
[156564.496415] Plx8000_NT: Received PLX message ===> 
[156564.496415] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156564.496416] Plx8000_NT: ...Completed message
[156564.496418] Plx8000_NT: 
[156564.496419] Plx8000_NT: Received PLX message ===> 
[156564.496420] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156564.496421] Plx8000_NT: Criteria did not match any devices
[156564.496422] Plx8000_NT: ...Completed message
[156564.496425] Plx8000_NT: 
[156564.496426] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156564.496427] Plx8000_NT: Close device (Plx8000_NT-0)...
[156564.496428] Plx8000_NT: ...device closed
[156564.496432] Plx8000_DMA: 
[156564.496456] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156564.514010] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156564.535514] Plx8000_DMA: ...device opened
[156564.549372] Plx8000_DMA: 
[156564.564439] Plx8000_DMA: Received PLX message ===> 
[156564.564487] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156564.578562] Plx8000_DMA: ...Completed message
[156564.599768] PLX DMA[Dispatch_IoControl-1053]
[156564.614704] PLX DMA[Dispatch_IoControl-1061]
[156564.614754] Plx8000_DMA: 
[156564.628538] Plx8000_DMA: Received PLX message ===> 
[156564.646209] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[156564.660652] Plx8000_DMA: Criteria did not match any devices
[156564.682553] Plx8000_DMA: ...Completed message
[156564.696647] PLX DMA[Dispatch_IoControl-1053]
[156564.696696] PLX DMA[Dispatch_IoControl-1061]
[156564.710744] Plx8000_DMA: 
[156564.732090] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156564.751953] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156564.752004] Plx8000_DMA: ...device closed
[156568.052329] Plx8000_NT: 
[156568.052331] Plx8000_NT: Received message ==> OPEN_DEVICE
[156568.052333] Plx8000_NT: Open device (Plx8000_NT-0)...
[156568.052335] Plx8000_NT: ...device opened
[156568.052338] Plx8000_NT: 
[156568.052339] Plx8000_NT: Received PLX message ===> 
[156568.052341] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156568.052342] Plx8000_NT: ...Completed message
[156568.052447] Plx8000_NT: 
[156568.052449] Plx8000_NT: Received PLX message ===> 
[156568.052450] Plx8000_NT: PLX_IOCTL_PCI_BAR_PROPERTIES
[156568.052452] Plx8000_NT:     PCI BAR 2: 80000000
[156568.052454] Plx8000_NT:     Phys Addr: 3FE080000000
[156568.052456] Plx8000_NT:     Size     : 400000h (4MB)
[156568.052458] Plx8000_NT:     Property : Non-Prefetchable 32-bit
[156568.052460] Plx8000_NT: ...Completed message
[156568.052507] Plx8000_NT: 
[156568.052509] Plx8000_NT: Received PLX message ===> 
[156568.052510] Plx8000_NT: PLX_IOCTL_PCI_BAR_PROPERTIES
[156568.052512] Plx8000_NT:     PCI BAR 2: 80000000
[156568.052513] Plx8000_NT:     Phys Addr: 3FE080000000
[156568.052515] Plx8000_NT:     Size     : 400000h (4MB)
[156568.052517] Plx8000_NT:     Property : Non-Prefetchable 32-bit
[156568.052518] Plx8000_NT: ...Completed message
[156568.052556] Plx8000_NT: 
[156568.052558] Plx8000_NT: Received message ===> MMAP
[156568.052559] Plx8000_NT: Map PCI BAR 2...
[156568.052563] Plx8000_NT: Mapped Phys (3fe080000000) ==> User VA
(3fff79040000)
[156568.052564] Plx8000_NT: ...Completed message
[156568.052623] Plx8000_NT: 
[156568.052625] Plx8000_NT: Received PLX message ===> 
[156568.052626] Plx8000_NT: PLX_IOCTL_NT_LUT_ADD
[156568.052635] Plx8000_NT: Req ID (0000) already exists in LUT #0, skipping
update
[156568.052636] Plx8000_NT: ...Completed message
[156568.052673] Plx8000_NT: 
[156568.052675] Plx8000_NT: Received PLX message ===> 
[156568.052676] Plx8000_NT: PLX_IOCTL_PHYSICAL_MEM_ALLOCATE
[156568.052678] Plx8000_NT: Attempt to allocate physical memory (1953KB)
[156568.053069] Plx8000_NT: Allocated physical memory...
[156568.053071] Plx8000_NT:     CPU Phys Addr: 1f9e400000
[156568.053073] Plx8000_NT:     Bus Phys Addr: 60e00000
[156568.053075] Plx8000_NT:     Kernel VA    : c000001f9e400000
[156568.053077] Plx8000_NT:     Size         : 1E8480h (1MB)
[156568.053078] Plx8000_NT: ...Completed message
[156568.053099] Plx8000_NT: 
[156568.053100] Plx8000_NT: Received message ===> MMAP
[156568.053103] Plx8000_NT: Mapped Phys (1f9e400000) ==> User VA
(3fff78e50000)
[156568.053105] Plx8000_NT: ...Completed message
[156568.053119] Plx8000_NT: 
[156568.053120] Plx8000_NT: Received PLX message ===> 
[156568.053121] Plx8000_NT: PLX_IOCTL_PHYSICAL_MEM_ALLOCATE
[156568.053123] Plx8000_NT: Attempt to allocate physical memory (1953KB)
[156568.053511] Plx8000_NT: Allocated physical memory...
[156568.053513] Plx8000_NT:     CPU Phys Addr: 1f82c00000
[156568.053515] Plx8000_NT:     Bus Phys Addr: 61000000
[156568.053516] Plx8000_NT:     Kernel VA    : c000001f82c00000
[156568.053518] Plx8000_NT:     Size         : 1E8480h (1MB)
[156568.053520] Plx8000_NT: ...Completed message
[156568.053540] Plx8000_NT: 
[156568.053541] Plx8000_NT: Received message ===> MMAP
[156568.053544] Plx8000_NT: Mapped Phys (1f82c00000) ==> User VA
(3fff78c60000)
[156568.053545] Plx8000_NT: ...Completed message
[156568.053576] Plx8000_NT: 
[156568.053577] Plx8000_NT: Received message ==> OPEN_DEVICE
[156568.053579] Plx8000_NT: Open device (Plx8000_NT-0)...
[156568.053580] Plx8000_NT: ...device opened
[156568.053583] Plx8000_NT: 
[156568.053584] Plx8000_NT: Received PLX message ===> 
[156568.053585] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156568.053587] Plx8000_NT: ...Completed message
[156568.053589] Plx8000_NT: 
[156568.053590] Plx8000_NT: Received PLX message ===> 
[156568.053591] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156568.053594] Plx8000_NT: Criteria matched device 8619_10B5 [02:01.0]
[156568.053595] Plx8000_NT: ...Completed message
[156568.053598] Plx8000_NT: 
[156568.053600] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156568.053601] Plx8000_NT: Close device (Plx8000_NT-0)...
[156568.053603] Plx8000_NT: ...device closed
[156568.053608] Plx8000_NT: 
[156568.053610] Plx8000_NT: Received message ==> OPEN_DEVICE
[156568.053611] Plx8000_NT: Open device (Plx8000_NT-0)...
[156568.053613] Plx8000_NT: ...device opened
[156568.053615] Plx8000_NT: 
[156568.053616] Plx8000_NT: Received PLX message ===> 
[156568.053618] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156568.053619] Plx8000_NT: ...Completed message
[156568.053621] Plx8000_NT: 
[156568.053622] Plx8000_NT: Received PLX message ===> 
[156568.053623] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156568.053625] Plx8000_NT: Criteria did not match any devices
[156568.053626] Plx8000_NT: ...Completed message
[156568.053629] Plx8000_NT: 
[156568.053630] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156568.053632] Plx8000_NT: Close device (Plx8000_NT-0)...
[156568.053633] Plx8000_NT: ...device closed
[156568.053638] Plx8000_DMA: 
[156568.053730] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156568.053921] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156568.053968] Plx8000_DMA: ...device opened
[156568.054007] Plx8000_DMA: 
[156568.054033] Plx8000_DMA: Received PLX message ===> 
[156568.054081] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156568.054306] Plx8000_DMA: ...Completed message
[156568.054356] PLX DMA[Dispatch_IoControl-1053]
[156568.054404] PLX DMA[Dispatch_IoControl-1061]
[156568.054451] Plx8000_DMA: 
[156568.054476] Plx8000_DMA: Received PLX message ===> 
[156568.054524] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[156568.054583] Plx8000_DMA: Criteria matched device 8619_10B5 [01:00.1]
[156568.054643] Plx8000_DMA: ...Completed message
[156568.054691] PLX DMA[Dispatch_IoControl-1053]
[156568.054739] PLX DMA[Dispatch_IoControl-1061]
[156568.054786] Plx8000_DMA: 
[156568.054810] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156568.054858] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156568.054904] Plx8000_DMA: ...device closed
[156568.054945] Plx8000_DMA: 
[156568.054971] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156568.055018] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156568.055066] Plx8000_DMA: ...device opened
[156568.055104] Plx8000_DMA: 
[156568.055130] Plx8000_DMA: Received PLX message ===> 
[156568.055180] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156568.055239] Plx8000_DMA: ...Completed message
[156568.055312] PLX DMA[Dispatch_IoControl-1053]
[156568.055364] PLX DMA[Dispatch_IoControl-1061]
[156568.055422] Plx8000_DMA: 
[156568.055446] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156568.055497] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156568.055546] Plx8000_DMA: ...device closed
[156568.055606] Plx8000_NT: 
[156568.055608] Plx8000_NT: Received message ==> OPEN_DEVICE
[156568.055610] Plx8000_NT: Open device (Plx8000_NT-0)...
[156568.055611] Plx8000_NT: ...device opened
[156568.055613] Plx8000_NT: 
[156568.055615] Plx8000_NT: Received PLX message ===> 
[156568.055616] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156568.055617] Plx8000_NT: ...Completed message
[156568.055619] Plx8000_NT: 
[156568.055621] Plx8000_NT: Received PLX message ===> 
[156568.055622] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156568.055623] Plx8000_NT: Criteria did not match any devices
[156568.055624] Plx8000_NT: ...Completed message
[156568.055627] Plx8000_NT: 
[156568.055630] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156568.055634] Plx8000_NT: Close device (Plx8000_NT-0)...
[156568.055636] Plx8000_NT: ...device closed
[156568.055641] Plx8000_DMA: 
[156568.055667] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156568.055717] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156568.055766] Plx8000_DMA: ...device opened
[156568.055804] Plx8000_DMA: 
[156568.055828] Plx8000_DMA: Received PLX message ===> 
[156568.055875] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156568.055936] Plx8000_DMA: ...Completed message
[156568.055985] PLX DMA[Dispatch_IoControl-1053]
[156568.056036] PLX DMA[Dispatch_IoControl-1061]
[156568.056086] Plx8000_DMA: 
[156568.056111] Plx8000_DMA: Received PLX message ===> 
[156568.056160] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[156568.056222] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.1]
[156568.056282] Plx8000_DMA: ...Completed message
[156568.056332] PLX DMA[Dispatch_IoControl-1053]
[156568.056382] PLX DMA[Dispatch_IoControl-1061]
[156568.056430] Plx8000_DMA: 
[156568.056455] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156568.056504] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156568.056554] Plx8000_DMA: ...device closed
[156568.056595] Plx8000_DMA: 
[156568.056621] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156568.056669] Plx8000_DMA: Open device (Plx8000_DMA-1)...
[156568.056716] Plx8000_DMA: ...device opened
[156568.056755] Plx8000_DMA: 
[156568.056781] Plx8000_DMA: Received PLX message ===> 
[156568.056828] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156568.056887] Plx8000_DMA: ...Completed message
[156568.056935] PLX DMA[Dispatch_IoControl-1053]
[156568.056982] PLX DMA[Dispatch_IoControl-1061]
[156568.057036] Plx8000_DMA: 
[156568.057061] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156568.057110] Plx8000_DMA: Close device (Plx8000_DMA-1)...
[156568.057158] Plx8000_DMA: ...device closed
[156568.057233] Plx8000_NT: 
[156568.057235] Plx8000_NT: Received message ==> OPEN_DEVICE
[156568.057236] Plx8000_NT: Open device (Plx8000_NT-0)...
[156568.057238] Plx8000_NT: ...device opened
[156568.057240] Plx8000_NT: 
[156568.057241] Plx8000_NT: Received PLX message ===> 
[156568.057243] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156568.057246] Plx8000_NT: ...Completed message
[156568.057251] Plx8000_NT: 
[156568.057253] Plx8000_NT: Received PLX message ===> 
[156568.057254] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156568.057257] Plx8000_NT: Criteria did not match any devices
[156568.057258] Plx8000_NT: ...Completed message
[156568.057261] Plx8000_NT: 
[156568.057262] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156568.057264] Plx8000_NT: Close device (Plx8000_NT-0)...
[156568.057265] Plx8000_NT: ...device closed
[156568.057270] Plx8000_DMA: 
[156568.057297] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156568.057344] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156568.057394] Plx8000_DMA: ...device opened
[156568.057432] Plx8000_DMA: 
[156568.057458] Plx8000_DMA: Received PLX message ===> 
[156568.057506] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156568.057565] Plx8000_DMA: ...Completed message
[156568.057614] PLX DMA[Dispatch_IoControl-1053]
[156568.057661] PLX DMA[Dispatch_IoControl-1061]
[156568.057712] Plx8000_DMA: 
[156568.057736] Plx8000_DMA: Received PLX message ===> 
[156568.057785] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[156568.057846] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.2]
[156568.071390] Plx8000_DMA: ...Completed message
[156568.071442] PLX DMA[Dispatch_IoControl-1053]
[156568.084861] PLX DMA[Dispatch_IoControl-1061]
[156568.108956] Plx8000_DMA: 
[156568.108982] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156568.123073] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156568.137299] Plx8000_DMA: ...device closed
[156568.157187] Plx8000_DMA: 
[156568.157212] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156568.171567] Plx8000_DMA: Open device (Plx8000_DMA-2)...
[156568.192333] Plx8000_DMA: ...device opened
[156568.205962] Plx8000_DMA: 
[156568.222240] Plx8000_DMA: Received PLX message ===> 
[156568.222290] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156568.237977] Plx8000_DMA: ...Completed message
[156568.252826] PLX DMA[Dispatch_IoControl-1053]
[156568.272657] PLX DMA[Dispatch_IoControl-1061]
[156568.272716] Plx8000_DMA: 
[156568.287136] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156568.301621] Plx8000_DMA: Close device (Plx8000_DMA-2)...
[156568.336957] Plx8000_DMA: ...device closed
[156568.391165] Plx8000_NT: 
[156568.391167] Plx8000_NT: Received message ==> OPEN_DEVICE
[156568.391169] Plx8000_NT: Open device (Plx8000_NT-0)...
[156568.391170] Plx8000_NT: ...device opened
[156568.391172] Plx8000_NT: 
[156568.391173] Plx8000_NT: Received PLX message ===> 
[156568.391174] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156568.391176] Plx8000_NT: ...Completed message
[156568.391178] Plx8000_NT: 
[156568.391179] Plx8000_NT: Received PLX message ===> 
[156568.391180] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156568.391182] Plx8000_NT: Criteria did not match any devices
[156568.391183] Plx8000_NT: ...Completed message
[156568.391185] Plx8000_NT: 
[156568.391186] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156568.391188] Plx8000_NT: Close device (Plx8000_NT-0)...
[156568.391189] Plx8000_NT: ...device closed
[156568.391194] Plx8000_DMA: 
[156568.391220] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156568.411367] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156568.432257] Plx8000_DMA: ...device opened
[156568.484646] Plx8000_DMA: 
[156568.484672] Plx8000_DMA: Received PLX message ===> 
[156568.508696] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156568.529863] Plx8000_DMA: ...Completed message
[156568.557840] PLX DMA[Dispatch_IoControl-1053]
[156568.557887] PLX DMA[Dispatch_IoControl-1061]
[156568.592037] Plx8000_DMA: 
[156568.624958] Plx8000_DMA: Received PLX message ===> 
[156568.642587] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[156568.642647] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.3]
[156568.712452] Plx8000_DMA: ...Completed message
[156568.712500] PLX DMA[Dispatch_IoControl-1053]
[156568.739829] PLX DMA[Dispatch_IoControl-1061]
[156568.775573] Plx8000_DMA: 
[156568.775596] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156568.793855] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156568.823125] Plx8000_DMA: ...device closed
[156568.837261] Plx8000_DMA: 
[156568.837284] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156568.850823] Plx8000_DMA: Open device (Plx8000_DMA-3)...
[156568.870811] Plx8000_DMA: ...device opened
[156568.883983] Plx8000_DMA: 
[156568.897485] Plx8000_DMA: Received PLX message ===> 
[156568.897527] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156568.913771] Plx8000_DMA: ...Completed message
[156568.927886] PLX DMA[Dispatch_IoControl-1053]
[156568.947136] PLX DMA[Dispatch_IoControl-1061]
[156568.961367] Plx8000_DMA: 
[156568.961391] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156568.974749] Plx8000_DMA: Close device (Plx8000_DMA-3)...
[156568.989049] Plx8000_DMA: ...device closed
[156569.008972] Plx8000_NT: 
[156569.008974] Plx8000_NT: Received message ==> OPEN_DEVICE
[156569.008975] Plx8000_NT: Open device (Plx8000_NT-0)...
[156569.008976] Plx8000_NT: ...device opened
[156569.008978] Plx8000_NT: 
[156569.008979] Plx8000_NT: Received PLX message ===> 
[156569.008979] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156569.008980] Plx8000_NT: ...Completed message
[156569.008982] Plx8000_NT: 
[156569.008983] Plx8000_NT: Received PLX message ===> 
[156569.008984] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156569.008985] Plx8000_NT: Criteria did not match any devices
[156569.008986] Plx8000_NT: ...Completed message
[156569.008988] Plx8000_NT: 
[156569.008989] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156569.008990] Plx8000_NT: Close device (Plx8000_NT-0)...
[156569.008991] Plx8000_NT: ...device closed
[156569.008995] Plx8000_DMA: 
[156569.009018] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156569.022988] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156569.038588] Plx8000_DMA: ...device opened
[156569.064580] Plx8000_DMA: 
[156569.064603] Plx8000_DMA: Received PLX message ===> 
[156569.078977] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156569.092497] Plx8000_DMA: ...Completed message
[156569.112340] PLX DMA[Dispatch_IoControl-1053]
[156569.125860] PLX DMA[Dispatch_IoControl-1061]
[156569.125906] Plx8000_DMA: 
[156569.139408] Plx8000_DMA: Received PLX message ===> 
[156569.139453] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[156569.153404] Plx8000_DMA: Criteria matched device 87D0_10B5 [01:00.4]
[156569.173730] Plx8000_DMA: ...Completed message
[156569.192216] PLX DMA[Dispatch_IoControl-1053]
[156569.205416] PLX DMA[Dispatch_IoControl-1061]
[156569.225320] Plx8000_DMA: 
[156569.225343] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156569.239133] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156569.259248] Plx8000_DMA: ...device closed
[156569.272774] Plx8000_DMA: 
[156569.272796] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156569.286763] Plx8000_DMA: Open device (Plx8000_DMA-4)...
[156569.323763] Plx8000_DMA: ...device opened
[156569.350921] Plx8000_DMA: 
[156569.350943] Plx8000_DMA: Received PLX message ===> 
[156569.391522] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156569.411420] Plx8000_DMA: ...Completed message
[156569.432018] PLX DMA[Dispatch_IoControl-1053]
[156569.461219] PLX DMA[Dispatch_IoControl-1061]
[156569.488454] Plx8000_DMA: 
[156569.488475] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156569.507184] Plx8000_DMA: Close device (Plx8000_DMA-4)...
[156569.521552] Plx8000_DMA: ...device closed
[156569.521606] Plx8000_NT: 
[156569.521607] Plx8000_NT: Received message ==> OPEN_DEVICE
[156569.521608] Plx8000_NT: Open device (Plx8000_NT-0)...
[156569.521609] Plx8000_NT: ...device opened
[156569.521610] Plx8000_NT: 
[156569.521611] Plx8000_NT: Received PLX message ===> 
[156569.521612] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
[156569.521613] Plx8000_NT: ...Completed message
[156569.521614] Plx8000_NT: 
[156569.521615] Plx8000_NT: Received PLX message ===> 
[156569.521615] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
[156569.521616] Plx8000_NT: Criteria did not match any devices
[156569.521617] Plx8000_NT: ...Completed message
[156569.521619] Plx8000_NT: 
[156569.521619] Plx8000_NT: Received message ==> CLOSE_DEVICE
[156569.521620] Plx8000_NT: Close device (Plx8000_NT-0)...
[156569.521621] Plx8000_NT: ...device closed
[156569.521624] Plx8000_DMA: 
[156569.541221] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156569.555596] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156569.569411] Plx8000_DMA: ...device opened
[156569.591053] Plx8000_DMA: 
[156569.591075] Plx8000_DMA: Received PLX message ===> 
[156569.608531] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156569.622776] Plx8000_DMA: ...Completed message
[156569.643340] PLX DMA[Dispatch_IoControl-1053]
[156569.643381] PLX DMA[Dispatch_IoControl-1061]
[156569.661435] Plx8000_DMA: 
[156569.697493] Plx8000_DMA: Received PLX message ===> 
[156569.697533] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
[156569.712283] Plx8000_DMA: Criteria did not match any devices
[156569.726097] Plx8000_DMA: ...Completed message
[156569.743793] PLX DMA[Dispatch_IoControl-1053]
[156569.757271] PLX DMA[Dispatch_IoControl-1061]
[156569.778014] Plx8000_DMA: 
[156569.778035] Plx8000_DMA: Received message ==> CLOSE_DEVICE
[156569.792130] Plx8000_DMA: Close device (Plx8000_DMA-0)...
[156569.812514] Plx8000_DMA: ...device closed
^[[B[156595.458146] Plx8000_DMA: 
[156595.458253] Plx8000_DMA: Received message ==> OPEN_DEVICE
[156595.458430] Plx8000_DMA: Open device (Plx8000_DMA-0)...
[156595.458478] Plx8000_DMA: ...device opened
[156595.458514] Plx8000_DMA: 
[156595.458539] Plx8000_DMA: Received PLX message ===> 
[156595.458588] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
[156595.458818] Plx8000_DMA: ...Completed message
[156595.458868] PLX DMA[Dispatch_IoControl-1053]
[156595.458918] PLX DMA[Dispatch_IoControl-1061]
[156595.458977] Plx8000_NT: 
[156595.458978] Plx8000_NT: Received PLX message ===> 
[156595.458980] Plx8000_NT: PLX_IOCTL_NT_LUT_ADD
[156595.458988] Plx8000_NT: Req ID (0101) already exists in LUT #1, skipping
update
[156595.458990] Plx8000_NT: ...Completed message
[156598.640885] Plx8000_DMA: 
[156598.640992] Plx8000_DMA: Received PLX message ===> 
[156598.641163] Plx8000_DMA: PLX_IOCTL_DMA_CHANNEL_OPEN
[156598.641226] Plx8000_DMA: Opened DMA channel 0
[156598.641273] Plx8000_DMA: ...Completed message
[156598.641320] PLX DMA[Dispatch_IoControl-1053]
[156598.641369] PLX DMA[Dispatch_IoControl-1061]
[156598.641499] Plx8000_DMA: 
[156598.641608] Plx8000_DMA: Received PLX message ===> 
[156598.641655] Plx8000_DMA: PLX_IOCTL_DMA_GET_PROPERTIES
[156598.641718] Plx8000_DMA: ...Completed message
[156598.641769] PLX DMA[Dispatch_IoControl-1053]
[156598.641818] PLX DMA[Dispatch_IoControl-1061]
[156598.641870] Plx8000_DMA: 
[156598.641895] Plx8000_DMA: Received PLX message ===> 
[156598.641943] Plx8000_DMA: PLX_IOCTL_DMA_SET_PROPERTIES
[156598.642008] Plx8000_DMA: ...Completed message
[156598.642057] PLX DMA[Dispatch_IoControl-1053]
[156598.642106] PLX DMA[Dispatch_IoControl-1061]
[156598.642160] Plx8000_DMA: 
[156598.642185] Plx8000_DMA: Received PLX message ===> 
[156598.642234] Plx8000_DMA: PLX_IOCTL_NOTIFICATION_REGISTER_FOR
[156598.642308] Plx8000_DMA: Registered interrupt wait object
(c000003bb93fd440)
[156598.642378] Plx8000_DMA: ...Completed message
[156598.642426] PLX DMA[Dispatch_IoControl-1053]
[156598.642475] PLX DMA[Dispatch_IoControl-1061]
[156598.642542] Plx8000_DMA: 
[156598.642568] Plx8000_DMA: Received PLX message ===> 
[156598.642615] Plx8000_DMA: PLX_IOCTL_DMA_TRANSFER_BLOCK
[156598.642675] PLX DMA[PlxDmaTransferBlock-2479]
[156598.642724] PLX DMA[PlxDmaTransferBlock-2488]
[156598.642774] PLX DMA[PlxDmaTransferBlock-2495]
[156598.642823] Plx8000_DMA: Ch 0 - DMA 00000000_60E00000 -->
00000000_61000000 (65536 bytes)
[156598.642897] PLX DMA[PlxDmaTransferBlock-2503]
[156598.642945] PLX DMA[PlxDmaTransferBlock-2511]
[156598.642996] PLX DMA[PlxDmaTransferBlock-2516]
[156598.643045] PLX DMA[PlxDmaTransferBlock-2521]
[156598.643094] PLX DMA[PlxDmaTransferBlock-2532]
[156598.643141] PLX DMA[PlxDmaTransferBlock-2535]
[156598.643191] PLX DMA[PlxDmaTransferBlock-2539]
[156598.643239] PLX DMA[PlxDmaTransferBlock-2550]
[156598.643288] PLX DMA[PlxDmaTransferBlock-2557]
[156598.643335] PLX DMA[PlxDmaTransferBlock-2562]
[156598.643383] Plx8000_DMA: Start DMA transfer...
[156598.643432] PLX DMA[PlxDmaTransferBlock-2565]
[156598.643481] PLX DMA[PlxDmaTransferBlock-2569]
[156598.643525] EEH: Frozen PE#1 on PHB#1 detected
[156598.643529] EEH: PE location: Slot4, PHB location: N/A
[156598.644631] EEH: This PCI device has failed 1 times in the last hour
[156598.644632] EEH: Notify device drivers to shutdown
[156598.644638] EEH: Collect temporary log
[156598.644710] EEH: of node=0001:01:00:0
[156598.644713] EEH: PCI device/vendor: 861910b5
[156598.644715] EEH: PCI cmd/status register: 00100547
[156598.644717] EEH: Bridge secondary status: 0000
[156598.644719] EEH: Bridge control: 0002
[156598.644720] EEH: PCI-E capabilities and status follow:
[156598.644729] EEH: PCI-E 00: 0052a410 00008004 00000046 0000cc82 
[156598.644736] EEH: PCI-E 10: 00820000 00000000 00000000 00000000 
[156598.644737] EEH: PCI-E 20: 00000000 
[156598.644738] EEH: PCI-E AER capability register set follows:
[156598.644746] EEH: PCI-E AER 00: 13810001 00000000 00000000 00062030 
[156598.644753] EEH: PCI-E AER 10: 00000000 00002000 000000ff 00000000 
[156598.644760] EEH: PCI-E AER 20: 00000000 00000000 00000000 00000000 
[156598.644762] EEH: PCI-E AER 30: 00000000 0e0e0e0e 
[156598.644764] EEH: of node=0001:01:00:1
[156598.644766] EEH: PCI device/vendor: 861910b5
[156598.644767] EEH: PCI cmd/status register: 10100546
[156598.644768] EEH: PCI-E capabilities and status follow:
[156598.644777] EEH: PCI-E 00: 0002a410 00008fe4 0020204e 0000cc82 
[156598.644784] EEH: PCI-E 10: 00820000 00000000 00000000 00000000 
[156598.644785] EEH: PCI-E 20: 00000000 
[156598.644785] EEH: PCI-E AER capability register set follows:
[156598.644793] EEH: PCI-E AER 00: 1f410001 00000000 00000000 00062030 
[156598.644800] EEH: PCI-E AER 10: 00000000 00002000 000001ff 00000000 
[156598.644807] EEH: PCI-E AER 20: 00000000 00000000 00000000 00000000 
[156598.644809] EEH: PCI-E AER 30: 00000000 00000000 
[156598.644810] EEH: of node=0001:02:01:0
[156598.644812] EEH: PCI device/vendor: 861910b5
[156598.644814] EEH: PCI cmd/status register: 00100546
[156598.644814] EEH: PCI-E capabilities and status follow:
[156598.644823] EEH: PCI-E 00: 0002a410 00008fc4 0000004e 0100cc82 
[156598.644830] EEH: PCI-E 10: 00420000 00000000 00000000 00000000 
[156598.644831] EEH: PCI-E 20: 00000000 
[156598.644831] EEH: PCI-E AER capability register set follows:
[156598.644840] EEH: PCI-E AER 00: 14810001 00000000 00000000 00062030 
[156598.644847] EEH: PCI-E AER 10: 00000000 00002000 000001ff 00000000 
[156598.644853] EEH: PCI-E AER 20: 00000000 00000000 00000000 00000000 
[156598.644856] EEH: PCI-E AER 30: 00000000 00000000 
[156598.644857] PHB3 PHB#1 Diag-data (Version: 1)
[156598.644858] brdgCtl:     00000002
[156598.644860] RootSts:     0002004f 00400000 f0820008 00100147 00002800
[156598.644861] RootErrSts:  00000000 00008000 00000000
[156598.644862] PhbSts:      0000001c00000000 0000001c00000000
[156598.644863] Lem:         0000000004000000 42498e327f502eae
0000000000000000
[156598.644865] InAErr:      0000000000004000 0000000000004000
8000000060e00001 8400000000000001
[156598.644866] PE[  1] A/B: 8200302500000000 8000000060e00000
[156598.644869] EEH: Enable I/O for affected devices
[156598.644884] EEH: Notify device drivers to resume I/O
[156598.644886] EEH: Enabled DMA for affected devices
[156598.644898] EEH: Notify device driver to resume
[156599.227910] Plx8000_DMA: ...Completed message
[156599.241749] PLX DMA[Dispatch_IoControl-1053]
[156599.241802] PLX DMA[Dispatch_IoControl-1061]





--
View this message in context: http://linuxppc.10917.n7.nabble.com/EEH-error-in-doing-DMA-with-PEX-8619-tp121121p121181.html
Sent from the linuxppc-dev mailing list archive at Nabble.com.

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: EEH error in doing DMA with PEX 8619
  2017-04-11  9:26         ` IanJiang
@ 2017-04-11  9:35           ` Benjamin Herrenschmidt
  2017-04-12  1:39             ` IanJiang
  2017-04-12  8:42             ` IanJiang
  0 siblings, 2 replies; 11+ messages in thread
From: Benjamin Herrenschmidt @ 2017-04-11  9:35 UTC (permalink / raw)
  To: IanJiang, linuxppc-dev

On Tue, 2017-04-11 at 02:26 -0700, IanJiang wrote:
> I did another test:
> - Call dma_set_mask_and_coherent(&pPciDev->dev, DMA_BIT_MASK(32)) in
> probe;
> - Use DMA address or BUS address in DMA
> But EHH error remains.

We need to dig out the details of the EEH error. It will tell us
more precisely what is happening.

Note also that if your device can do 64-bit addresses, you should use
a 64-bit mask, it will result in more efficient transfers. However, we
should first investigate the problem with 32-bit because it seems to
indicate that you might be DMA'ing beyond your buffer.

Another possibility would be if the requests from the PLX have a
different initiator ID on the bus than the device you are setting up
the DMA for.

> All sources are based on PLX SDK 7.25.
> Note: Sample test is in user space. It allocates memory and starts
> DMA
> through PLX API.
> The original sample NT_DmaTest does DMA between BARx and Host memory.
> I change this for simple: Allocate two host memory buffers and try to
> do DMA
> between them.
> 
> Device probe
> ===========
> (Driver/Source.Plx8000_DMA/Driver.c)
> 
> int
> AddDevice(
>     DRIVER_OBJECT  *pDriverObject,
>     struct pci_dev *pPciDev
>     )
> {
>     U8                channel;
>     int               status;
>     U32               RegValue;
>     DEVICE_OBJECT    *fdo;
>     DEVICE_OBJECT    *pDevice;
>     DEVICE_EXTENSION *pdx;
> 
> 
>     // Allocate memory for the device object
>     fdo =
>         kmalloc(
>             sizeof(DEVICE_OBJECT),
>             GFP_KERNEL
>             );
> 
>     if (fdo == NULL)
>     {
>         ErrorPrintf(("ERROR - memory allocation for device object
> failed\n"));
>         return (-ENOMEM);
>     }
> 
>     // Initialize device object
>     RtlZeroMemory( fdo, sizeof(DEVICE_OBJECT) );
> 
>     fdo->DriverObject    = pDriverObject;         // Save parent
> driver
> object
>     fdo->DeviceExtension = &(fdo->DeviceInfo);
> 
>     // Enable the device
>     if (pci_enable_device( pPciDev ) == 0)
>     {
>         DebugPrintf(("Enabled PCI device\n"));
>     }
>     else
>     {
>         ErrorPrintf(("WARNING - PCI device enable failed\n"));
>     }
> 
> #if 1
>     /* New added: Set DMA mask as suggestied on linuxppc */
> {
>     int err;
>     printk("Debug %s: dma_set_mask_and_coherent()...\n", __func__);
>     err = dma_set_mask_and_coherent(&pPciDev->dev, DMA_BIT_MASK(32));
>     if (err != 0) {
>         printk("Error %s: Failed dma_set_mask_and_coherent(). ret =
> %d\n",
> __func__, err);
>         return err;
>     }
> 
> }
> #endif
>     // Enable bus mastering
>     pci_set_master( pPciDev );
> 
>     //
>     // Initialize the device extension
>     //
> 
>     pdx = fdo->DeviceExtension;
> 
>     // Clear device extension
>     RtlZeroMemory( pdx, sizeof(DEVICE_EXTENSION) );
> 
>     // Store parent device object
>     pdx->pDeviceObject = fdo;
> 
>     // Save the OS-supplied PCI object
>     pdx->pPciDevice = pPciDev;
> 
>     // Set initial device device state
>     pdx->State = PLX_STATE_STOPPED;
> 
>     // Set initial power state
>     pdx->PowerState = PowerDeviceD0;
> 
>     // Store device location information
>     pdx->Key.domain       = pci_domain_nr(pPciDev->bus);
>     pdx->Key.bus          = pPciDev->bus->number;
>     pdx->Key.slot         = PCI_SLOT(pPciDev->devfn);
>     pdx->Key.function     = PCI_FUNC(pPciDev->devfn);
>     pdx->Key.DeviceId     = pPciDev->device;
>     pdx->Key.VendorId     = pPciDev->vendor;
>     pdx->Key.SubVendorId  = pPciDev->subsystem_vendor;
>     pdx->Key.SubDeviceId  = pPciDev->subsystem_device;
>     pdx->Key.DeviceNumber = pDriverObject->DeviceCount;
> 
>     // Set API access mode
>     pdx->Key.ApiMode = PLX_API_MODE_PCI;
> 
>     // Update Revision ID
>     PLX_PCI_REG_READ( pdx, PCI_REG_CLASS_REV, &RegValue );
>     pdx->Key.Revision = (U8)(RegValue & 0xFF);
> 
>     // Set device mode
>     pdx->Key.DeviceMode = PLX_CHIP_MODE_STANDARD;
> 
>     // Set PLX-specific port type
>     pdx->Key.PlxPortType = PLX_SPEC_PORT_DMA;
> 
>     // Build device name
>     sprintf(
>         pdx->LinkName,
>         PLX_DRIVER_NAME "-%d",
>         pDriverObject->DeviceCount
>         );
> 
>     // Initialize work queue for ISR DPC queueing
>     PLX_INIT_WORK(
>         &(pdx->Task_DpcForIsr),
>         DpcForIsr,                // DPC routine
>         &(pdx->Task_DpcForIsr)    // DPC parameter (pre-2.6.20 only)
>         );
> 
>     // Initialize ISR spinlock
>     spin_lock_init( &(pdx->Lock_Isr) );
> 
>     // Initialize interrupt wait list
>     INIT_LIST_HEAD( &(pdx->List_WaitObjects) );
>     spin_lock_init( &(pdx->Lock_WaitObjectsList) );
> 
>     // Initialize physical memories list
>     INIT_LIST_HEAD( &(pdx->List_PhysicalMem) );
>     spin_lock_init( &(pdx->Lock_PhysicalMemList) );
> 
>     // Set the DMA mask
>     if (Plx_dma_set_mask( pdx, PLX_DMA_BIT_MASK(48) ) == 0)
>     {
>         DebugPrintf(("Set DMA bit mask to 48-bits\n"));
>     }
>     else
>     {
>         DebugPrintf(("ERROR - Unable to set DMA mask to 48-bits,
> revert to
> 32-bit\n"));
>         Plx_dma_set_mask( pdx, PLX_DMA_BIT_MASK(32) );
>     }
> 
>     // Set buffer allocation mask
>     if (Plx_dma_set_coherent_mask( pdx, PLX_DMA_BIT_MASK(32) ) != 0)
>     {
>         ErrorPrintf(("WARNING - Set DMA coherent mask failed\n"));
>     }
> 
>     // Initialize DMA spinlocks
>     for (channel = 0; channel < MAX_DMA_CHANNELS; channel++)
>     {
>         spin_lock_init( &(pdx->Lock_Dma[channel]) );
>     }
> 
>     //
>     // Add to driver device list
>     //
> 
>     // Acquire Device List lock
>     spin_lock( &(pDriverObject->Lock_DeviceList) );
> 
>     // Get device list head
>     pDevice = pDriverObject->DeviceObject;
> 
>     if (pDevice == NULL)
>     {
>         // Add device as first in list
>         pDriverObject->DeviceObject = fdo;
>     }
>     else
>     {
>         // Go to end of list
>         while (pDevice->NextDevice != NULL)
>         {
>             pDevice = pDevice->NextDevice;
>         }
> 
>         // Add device to end of list
>         pDevice->NextDevice = fdo;
>     }
> 
>     // Increment device count
>     pDriverObject->DeviceCount++;
> 
>     // Release Device List lock
>     spin_unlock( &(pDriverObject->Lock_DeviceList) );
> 
>     DebugPrintf(("Created Device (%s)\n", pdx->LinkName));
> 
>     // Start the device
>     status = StartDevice( fdo );
>     if (status != 0)
>     {
>         RemoveDevice( fdo );
>         return status;
>     }
> 
>     return 0;
> }
> 
> 
> Memory allocate
> ============
> (Driver/Source.Plx8000_DMA/SuppFunc.c)
> 
> /********************************************************************
> ***********
>  *
>  * Function   :  Plx_dma_buffer_alloc
>  *
>  * Description:  Allocates physically contiguous non-paged memory
>  *
>  * Note       :  The function allocates a contiguous block of system
> memory
> and
>  *               marks it as reserved. Marking the memory as reserved
> is
> required
>  *               in case the memory is later mapped to user virtual
> space.
>  *
> 
> *********************************************************************
> *********/
> VOID*
> Plx_dma_buffer_alloc(
>     DEVICE_EXTENSION    *pdx,
>     PLX_PHYS_MEM_OBJECT *pMemObject
>     )
> {
>     dma_addr_t   BusAddress;
>     PLX_UINT_PTR virt_addr;
> 
> 
>     // Verify size
>     if (pMemObject->Size == 0)
>     {
>         ErrorPrintf(("ERROR: Unable to allocate buffer, requested
> size =
> 0\n"));
>         RtlZeroMemory( pMemObject, sizeof(PLX_PHYS_MEM_OBJECT) );
>         return NULL;
>     }
> 
>     /*********************************************************
>      * Attempt to allocate contiguous memory
>      *
>      * Additional flags are specified as follows:
>      *
>      * __GFP_NOWARN : Prevents the kernel from dumping warnings
>      *                about a failed allocation attempt.  The
>      *                PLX driver already handles failures.
>      *
>      * __GFP_REPEAT : Not enabled by default, but may be added
>      *                manually.  It asks the kernel to "try a
>      *                little harder" in the allocation effort.
>      ********************************************************/
>     pMemObject->pKernelVa =
>         Plx_dma_alloc_coherent(
>             pdx,
>             pMemObject->Size,
>             &BusAddress,
>             GFP_KERNEL | __GFP_NOWARN
>             );
> 
>     if (pMemObject->pKernelVa == NULL)
>     {
>         return NULL;
>     }
> 
>     // Store the bus address
>     pMemObject->BusPhysical = (U64)BusAddress;
> 
>     // Tag all pages as reserved
>     for (virt_addr = (PLX_UINT_PTR)pMemObject->pKernelVa;
>          virt_addr < ((PLX_UINT_PTR)pMemObject->pKernelVa +
> pMemObject->Size);
>          virt_addr += PAGE_SIZE)
>     {
>         SetPageReserved(
>             virt_to_page( PLX_INT_TO_PTR(virt_addr) )
>             );
>     }
> 
>     // Get CPU physical address of buffer
>     pMemObject->CpuPhysical =
>         virt_to_phys(
>             pMemObject->pKernelVa
>             );
> 
>     // Clear the buffer
>     RtlZeroMemory(
>         pMemObject->pKernelVa,
>         pMemObject->Size
>         );
> 
>     DebugPrintf(("Allocated physical memory...\n"));
> 
>     DebugPrintf((
>         "    CPU Phys Addr: %08llx\n",
>         pMemObject->CpuPhysical
>         ));
> 
>     DebugPrintf((
>         "    Bus Phys Addr: %08llx\n",
>         pMemObject->BusPhysical
>         ));
> 
>     DebugPrintf((
>         "    Kernel VA    : %p\n",
>         pMemObject->pKernelVa
>         ));
> 
>     DebugPrintf((
>         "    Size         : %Xh (%d%s)\n",
>         pMemObject->Size,
>         (pMemObject->Size > (1 << 30)) ? (pMemObject->Size >> 30) :
>           (pMemObject->Size > (1 << 20)) ? (pMemObject->Size >> 20) :
>           (pMemObject->Size > (1 << 10)) ? (pMemObject->Size >> 10) :
>           pMemObject->Size,
>         (pMemObject->Size > (1 << 30)) ? "GB" :
>           (pMemObject->Size > (1 << 20)) ? "MB" :
>           (pMemObject->Size > (1 << 10)) ? "KB" : "B"
>         ));
> 
>     // Return the kernel virtual address of the allocated block
>     return pMemObject->pKernelVa;
> }
> 
> 
> DMA transfer
> ==========
> (Driver/Source.Plx8000_DMA/ApiFunc.c)
> 
> /********************************************************************
> **********
>  *
>  * Function   :  PlxDmaTransferBlock
>  *
>  * Description:  Performs DMA block transfer
>  *
> 
> *********************************************************************
> *********/
> PLX_STATUS
> PlxDmaTransferBlock(
>     DEVICE_EXTENSION *pdx,
>     U8                channel,
>     PLX_DMA_PARAMS   *pParams,
>     VOID             *pOwner
>     )
> {
>     U16        OffsetDmaBase;
>     U32        RegValue;
>     PLX_STATUS status;
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     // Verify DMA channel is available
>     status =
>         PlxDmaStatus(
>             pdx,
>             channel,
>             pOwner
>             );
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     if (status != PLX_STATUS_COMPLETE)
>     {
>         DebugPrintf(("ERROR - DMA unavailable or in-progress\n"));
>         return status;
>     }
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     DebugPrintf((
>         "Ch %d - DMA %08X_%08X --> %08X_%08X (%d bytes)\n",
>         channel, PLX_64_HIGH_32(pParams->AddrSource),
> PLX_64_LOW_32(pParams->AddrSource),
>         PLX_64_HIGH_32(pParams->AddrDest), PLX_64_LOW_32(pParams-
> >AddrDest),
>         pParams->ByteCount
>         ));
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     // Set the channel's base register offset (200h, 300h, etc)
>     OffsetDmaBase = 0x200 + (channel * 0x100);
> 
>     spin_lock(
>         &(pdx->Lock_Dma[channel])
>         );
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     // Write Source Address
>     PLX_DMA_REG_WRITE( pdx, OffsetDmaBase + 0x0,
> PLX_64_LOW_32(pParams->AddrSource) );
>     PLX_DMA_REG_WRITE( pdx, OffsetDmaBase + 0x4,
> PLX_64_HIGH_32(pParams->AddrSource) );
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     // Write Destination Address
>     PLX_DMA_REG_WRITE( pdx, OffsetDmaBase + 0x8,
> PLX_64_LOW_32(pParams->AddrDest) );
>     PLX_DMA_REG_WRITE( pdx, OffsetDmaBase + 0xC,
> PLX_64_HIGH_32(pParams->AddrDest) );
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     // Set Transfer Count & address & interrupt options
>     RegValue =
>         (1                       << 31) |   // Valid bit
>         (pParams->bConstAddrSrc  << 29) |   // Keep source address
> constant
>         (pParams->bConstAddrDest << 28) |   // Keep destination
> address
> constant
>         (pParams->ByteCount      <<  0);    // Byte count
>     if (pParams->bIgnoreBlockInt == 0)
>     {
>         RegValue |= (1 << 30);
>     }
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     PLX_DMA_REG_WRITE( pdx, OffsetDmaBase + 0x10, RegValue );
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     // Get DMA control/status
>     RegValue = PLX_DMA_REG_READ( pdx, OffsetDmaBase + 0x38 );
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     // Set DMA to block mode
>     if (pdx->Key.PlxFamily == PLX_FAMILY_SIRIUS)
>     {
>         RegValue &= ~(1 << 4);
>     }
>     else
>     {
>         RegValue &= ~(3 << 5);
>     }
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     // Make sure descriptor write-back ([2]) is disabled
>     RegValue &= ~(1 << 2);
> 
>     // Clear any active status bits ([31,12:8])
>     RegValue |= ((1 << 31) | (0x1F << 8));
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     spin_unlock(
>         &(pdx->Lock_Dma[channel])
>         );
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     DebugPrintf(("Start DMA transfer...\n"));
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     // Start DMA ([3])
>     PLX_DMA_REG_WRITE( pdx, OffsetDmaBase + 0x38, RegValue | (1 << 3)
> );
> 
>     printk("PLX DMA[%s-%d]\n", __func__, __LINE__);
>     return PLX_STATUS_OK;
> }
> 
> Latest dmesg with EEH error
> ======================
> [156541.460091] Plx8000_NT:
> <========================================================>
> [156541.460316] Plx8000_NT: PLX 8000_NT driver v7.25 (64-bit)
> [156541.460365] Plx8000_NT: Supports Linux kernel
> v3.10.0-514.10.2.el7.ppc64le
> [156541.460428] Plx8000_NT: Allocated global driver object
> (c000003c841f0200)
> [156541.460432] Plx8000_NT: Registered driver (MajorID = 247)
> [156541.460463] Plx8000_NT:    --------------------
> [156541.460469] Plx8000_NT: Probe: 8619 10B5 [D1 01:00.1]
> [156541.460482] Plx8000_NT: Probe: -- Unsupported Device --
> [156541.460506] Plx8000_NT:    --------------------
> [156541.460509] Plx8000_NT: Probe: 8619 10B5 [D1 02:01.0]
> [156541.460518] Plx8000_NT: Enabled PCI device
> [156541.460527] Plx8000_NT: Created Device (Plx8000_NT-0)
> [156541.460530] Plx8000_NT: Start: 8619 10B5 [D1 02:01.0]
> [156541.460532] Debug StartDevice 723: Reading PCI header command...
> [156541.460720] Debug StartDevice 725: Reading PCI header command...
> =
> 0x100146
> [156541.460790] Plx8000_NT:    Resource 00
> [156541.460792] Plx8000_NT:      Type     : Memory
> [156541.460798] Plx8000_NT:      PCI BAR 0: 81000000
> [156541.460799] Plx8000_NT:      Phys Addr: 3FE081000000
> [156541.460802] Plx8000_NT:      Size     : 20000h (128KB)
> [156541.460804] Plx8000_NT:      Property : Non-Prefetchable 32-bit
> [156541.460819] Plx8000_NT:      Kernel VA: d000080081480000
> [156541.460822] Debug StartDevice 841: Read BAR0[0xd000080081480000]
> after
> map...
> [156541.460895] Debug StartDevice 843: Read BAR0[0xd000080081480000]
> after
> map... = 0x861910b5
> [156541.460966] Plx8000_NT:    Resource 01
> [156541.460967] Plx8000_NT:      Type     : Memory
> [156541.460973] Plx8000_NT:      PCI BAR 2: 80000000
> [156541.460974] Plx8000_NT:      Phys Addr: 3FE080000000
> [156541.460976] Plx8000_NT:      Size     : 400000h (4MB)
> [156541.460978] Plx8000_NT:      Property : Non-Prefetchable 32-bit
> [156541.460983] Plx8000_NT:      Kernel VA: d000080084000000
> [156541.460985] Debug StartDevice 849: Read BAR2[0xd000080084000000]
> after
> map...
> [156541.461073] Debug StartDevice 851: Read BAR2[0xd000080084000000]
> after
> map... = 0xf000eef3
> [156541.461146] Plx8000_NT:    Resource 02
> [156541.461147] Plx8000_NT:      Type     : Memory
> [156541.461152] Plx8000_NT:      PCI BAR 3: 80400000
> [156541.461154] Plx8000_NT:      Phys Addr: 3FE080400000
> [156541.461156] Plx8000_NT:      Size     : 400000h (4MB)
> [156541.461157] Plx8000_NT:      Property : Non-Prefetchable 32-bit
> [156541.461162] Plx8000_NT:      Kernel VA: d000080084800000
> [156541.461163] Plx8000_NT:    Resource 03
> [156541.461165] Plx8000_NT:      Type     : Memory
> [156541.461170] Plx8000_NT:      PCI BAR 4: 80800000
> [156541.461171] Plx8000_NT:      Phys Addr: 3FE080800000
> [156541.461173] Plx8000_NT:      Size     : 400000h (4MB)
> [156541.461175] Plx8000_NT:      Property : Non-Prefetchable 32-bit
> [156541.461179] Plx8000_NT:      Kernel VA: d000080085000000
> [156541.461180] Plx8000_NT:    Resource 04
> [156541.461182] Plx8000_NT:      Type     : Memory
> [156541.461187] Plx8000_NT:      PCI BAR 5: 80C00000
> [156541.461188] Plx8000_NT:      Phys Addr: 3FE080C00000
> [156541.461190] Plx8000_NT:      Size     : 400000h (4MB)
> [156541.461192] Plx8000_NT:      Property : Non-Prefetchable 32-bit
> [156541.461196] Plx8000_NT:      Kernel VA: d000080085800000
> [156541.461198] Debug StartDevice 862: Reading PCI header command...
> [156541.461261] Debug StartDevice 864: Reading PCI header command...
> =
> 0x100146
> [156541.461409] Plx8000_NT: Device 8619_10B5 = 8619 rev BA
> [156541.461412] Plx8000_NT: Device in NT LEGACY mode
> [156541.461414] Debug StartDevice 891: Read BAR0[0xd000080081480000]
> before
> PlxDetermineNtPortSide...
> [156541.461497] Debug StartDevice 893: Read BAR0[0xd000080081480000]
> before
> PlxDetermineNtPortSide map... = 0x861910b5
> [156541.461595] Plx8000_NT: NT port is VIRTUAL-side (NT base=10000h)
> [156541.461597] Debug StartDevice 901: Read BAR0[0xd000080081480000]
> after
> PlxDetermineNtPortSide...
> [156541.461684] Debug StartDevice 903: Read BAR0[0xd000080081480000]
> after
> PlxDetermineNtPortSide map... = 0x861910b5
> [156541.461834] Plx8000_NT: MSI enabled, change IRQ 249 --> 499
> [156541.461836] Plx8000_NT:    Resource 05
> [156541.461838] Plx8000_NT:      Type     : Interrupt (MSI)
> [156541.461840] Plx8000_NT:      IRQ      : 499 [1F3h]
> [156541.461850] Plx8000_NT:      MSI Addr : 10000000
> [156541.461855] Plx8000_NT: _00000000
> [156541.461860] Plx8000_NT:      MSI Data : 0001
> [156541.461878] Plx8000_NT: Installed ISR for interrupt
> [156541.461895] Plx8000_NT:    --------------------
> [156541.461899] Plx8000_NT: Probe: 87D0 10B5 [D3 01:00.1]
> [156541.461909] Plx8000_NT: Probe: -- Unsupported Device --
> [156541.461916] Plx8000_NT:    --------------------
> [156541.461918] Plx8000_NT: Probe: 87D0 10B5 [D3 01:00.2]
> [156541.461925] Plx8000_NT: Probe: -- Unsupported Device --
> [156541.461931] Plx8000_NT:    --------------------
> [156541.461933] Plx8000_NT: Probe: 87D0 10B5 [D3 01:00.3]
> [156541.461940] Plx8000_NT: Probe: -- Unsupported Device --
> [156541.461946] Plx8000_NT:    --------------------
> [156541.461948] Plx8000_NT: Probe: 87D0 10B5 [D3 01:00.4]
> [156541.461956] Plx8000_NT: Probe: -- Unsupported Device --
> [156541.461984] Plx8000_NT: Attempt to allocate physical memory (8KB)
> [156541.461999] Plx8000_NT: Allocated physical memory...
> [156541.462001] Plx8000_NT:     CPU Phys Addr: 1f87000000
> [156541.462002] Plx8000_NT:     Bus Phys Addr: 60df0000
> [156541.462004] Plx8000_NT:     Kernel VA    : c000001f87000000
> [156541.462006] Plx8000_NT:     Size         : 2000h (8KB)
> [156541.462008] Plx8000_NT:    --------------------
> [156541.462009] Plx8000_NT: Added: 1 device
> [156541.462011] Plx8000_NT: ...driver loaded
> 
> 
> [156542.961942] Plx8000_DMA:
> <========================================================>
> [156542.962168] Plx8000_DMA: PLX 8000_DMA driver v7.25 (64-bit)
> [156542.962227] Plx8000_DMA: Supports Linux kernel
> v3.10.0-514.10.2.el7.ppc64le
> [156542.962301] Plx8000_DMA: Allocated global driver object
> (c000003c834af800)
> [156542.962543] Plx8000_DMA: Registered driver (MajorID = 246)
> [156542.962616] Plx8000_DMA:    --------------------
> [156542.962668] Plx8000_DMA: Probe: 8619 10B5 [D1 01:00.1]
> [156542.962724] Plx8000_DMA: Enabled PCI device
> [156542.962772] Debug AddDevice: dma_set_mask_and_coherent()...
> [156542.962836] PLX 8000 DMA Driver 0001:01:00.1: Using 32-bit DMA
> via iommu
> [156542.962901] PLX 8000 DMA Driver 0001:01:00.1: Using 32-bit DMA
> via iommu
> [156542.962959] Plx8000_DMA: Set DMA bit mask to 48-bits
> [156542.963006] Plx8000_DMA: Created Device (Plx8000_DMA-0)
> [156542.963054] Plx8000_DMA: Start: 8619 10B5 [D1 01:00.1]
> [156542.963102] Plx8000_DMA:    Resource 00
> [156542.963138] Plx8000_DMA:      Type     : Memory
> [156542.963189] Plx8000_DMA:      PCI BAR 0: 81820000
> [156542.963236] Plx8000_DMA:      Phys Addr: 3FE081820000
> [156542.963284] Plx8000_DMA:      Size     : 20000h (128KB)
> [156542.963332] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
> [156542.963395] Plx8000_DMA:      Kernel VA: d0000800814c0000
> [156542.963489] Plx8000_DMA: Device 8619_10B5 = 8619 rev BA
> [156542.963583] Plx8000_DMA: MSI enabled, change IRQ 249 --> 500
> [156542.963642] Plx8000_DMA:    Resource 01
> [156542.963679] Plx8000_DMA:      Type     : Interrupt (MSI)
> [156542.963727] Plx8000_DMA:      IRQ      : 500 [1F4h]
> [156542.963782] Plx8000_DMA:      MSI Addr : 10000000
> [156542.963832] Plx8000_DMA: _00000000
> [156542.963882] Plx8000_DMA:      MSI Data : 0002
> [156542.963941] Plx8000_DMA: Installed ISR for interrupt
> [156542.964013] Plx8000_DMA:    --------------------
> [156542.964070] Plx8000_DMA: Probe: 87D0 10B5 [D3 01:00.1]
> [156542.964142] Plx8000_DMA: Enabled PCI device
> [156542.964191] Debug AddDevice: dma_set_mask_and_coherent()...
> [156542.964255] PLX 8000 DMA Driver 0003:01:00.1: Using 32-bit DMA
> via iommu
> [156542.964324] PLX 8000 DMA Driver 0003:01:00.1: Using 32-bit DMA
> via iommu
> [156542.964385] Plx8000_DMA: Set DMA bit mask to 48-bits
> [156542.964432] Plx8000_DMA: Created Device (Plx8000_DMA-1)
> [156542.964482] Plx8000_DMA: Start: 87D0 10B5 [D3 01:00.1]
> [156542.964528] Plx8000_DMA:    Resource 00
> [156542.964564] Plx8000_DMA:      Type     : Memory
> [156542.964617] Plx8000_DMA:      PCI BAR 0: 83040000
> [156542.964666] Plx8000_DMA:      Phys Addr: 3FE883040000
> [156542.964716] Plx8000_DMA:      Size     : 2000h (8KB)
> [156542.964766] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
> [156542.964857] Plx8000_DMA:      Kernel VA: d000080081500000
> [156542.964996] Plx8000_DMA: Device 87D0_10B5 = 8725 rev CA
> [156542.965096] Plx8000_DMA: MSI enabled, change IRQ 251 --> 272
> [156542.965157] Plx8000_DMA:    Resource 01
> [156542.965193] Plx8000_DMA:      Type     : Interrupt (MSI)
> [156542.965239] Plx8000_DMA:      IRQ      : 272 [110h]
> [156542.965296] Plx8000_DMA:      MSI Addr : 10000000
> [156542.965349] Plx8000_DMA: _00000000
> [156542.965403] Plx8000_DMA:      MSI Data : 0010
> [156542.965481] Plx8000_DMA: Installed ISR for interrupt
> [156542.965537] Plx8000_DMA:    --------------------
> [156542.965587] Plx8000_DMA: Probe: 87D0 10B5 [D3 01:00.2]
> [156542.965642] Plx8000_DMA: Enabled PCI device
> [156542.965726] Debug AddDevice: dma_set_mask_and_coherent()...
> [156542.965790] PLX 8000 DMA Driver 0003:01:00.2: Using 32-bit DMA
> via iommu
> [156542.965884] PLX 8000 DMA Driver 0003:01:00.2: Using 32-bit DMA
> via iommu
> [156542.965948] Plx8000_DMA: Set DMA bit mask to 48-bits
> [156542.966026] Plx8000_DMA: Created Device (Plx8000_DMA-2)
> [156542.966077] Plx8000_DMA: Start: 87D0 10B5 [D3 01:00.2]
> [156542.966153] Plx8000_DMA:    Resource 00
> [156542.966190] Plx8000_DMA:      Type     : Memory
> [156542.966245] Plx8000_DMA:      PCI BAR 0: 83042000
> [156542.966329] Plx8000_DMA:      Phys Addr: 3FE883042000
> [156542.966395] Plx8000_DMA:      Size     : 2000h (8KB)
> [156542.966466] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
> [156542.966531] Plx8000_DMA:      Kernel VA: d000080081522000
> [156542.986063] Plx8000_DMA: Device 87D0_10B5 = 8725 rev CA
> [156543.012909] Plx8000_DMA: MSI enabled, change IRQ 251 --> 273
> [156543.033885] Plx8000_DMA:    Resource 01
> [156543.051045] Plx8000_DMA:      Type     : Interrupt (MSI)
> [156543.058139] Plx8000_DMA:      IRQ      : 273 [111h]
> [156543.081938] Plx8000_DMA:      MSI Addr : 10000000
> [156543.151285] Plx8000_DMA: _00000000
> [156543.151340] Plx8000_DMA:      MSI Data : 0011
> [156543.175049] Plx8000_DMA: Installed ISR for interrupt
> [156543.199076] Plx8000_DMA:    --------------------
> [156543.228325] Plx8000_DMA: Probe: 87D0 10B5 [D3 01:00.3]
> [156543.266237] Plx8000_DMA: Enabled PCI device
> [156543.266287] Debug AddDevice: dma_set_mask_and_coherent()...
> [156543.284766] PLX 8000 DMA Driver 0003:01:00.3: Using 32-bit DMA
> via iommu
> [156543.302570] PLX 8000 DMA Driver 0003:01:00.3: Using 32-bit DMA
> via iommu
> [156543.338986] Plx8000_DMA: Set DMA bit mask to 48-bits
> [156543.356741] Plx8000_DMA: Created Device (Plx8000_DMA-3)
> [156543.385337] Plx8000_DMA: Start: 87D0 10B5 [D3 01:00.3]
> [156543.385384] Plx8000_DMA:    Resource 00
> [156543.401548] Plx8000_DMA:      Type     : Memory
> [156543.416851] Plx8000_DMA:      PCI BAR 0: 83044000
> [156543.432384] Plx8000_DMA:      Phys Addr: 3FE883044000
> [156543.447424] Plx8000_DMA:      Size     : 2000h (8KB)
> [156543.462876] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
> [156543.502837] Plx8000_DMA:      Kernel VA: d000080081544000
> [156543.522190] Plx8000_DMA: Device 87D0_10B5 = 8725 rev CA
> [156543.536863] Plx8000_DMA: MSI enabled, change IRQ 251 --> 274
> [156543.536923] Plx8000_DMA:    Resource 01
> [156543.558229] Plx8000_DMA:      Type     : Interrupt (MSI)
> [156543.579107] Plx8000_DMA:      IRQ      : 274 [112h]
> [156543.593668] Plx8000_DMA:      MSI Addr : 10000000
> [156543.607511] Plx8000_DMA: _00000000
> [156543.622554] Plx8000_DMA:      MSI Data : 0012
> [156543.622630] Plx8000_DMA: Installed ISR for interrupt
> [156543.645996] Plx8000_DMA:    --------------------
> [156543.659853] Plx8000_DMA: Probe: 87D0 10B5 [D3 01:00.4]
> [156543.667360] Plx8000_DMA: Enabled PCI device
> [156543.681660] Debug AddDevice: dma_set_mask_and_coherent()...
> [156543.695406] PLX 8000 DMA Driver 0003:01:00.4: Using 32-bit DMA
> via iommu
> [156543.709749] PLX 8000 DMA Driver 0003:01:00.4: Using 32-bit DMA
> via iommu
> [156543.723734] Plx8000_DMA: Set DMA bit mask to 48-bits
> [156543.744728] Plx8000_DMA: Created Device (Plx8000_DMA-4)
> [156543.758804] Plx8000_DMA: Start: 87D0 10B5 [D3 01:00.4]
> [156543.773284] Plx8000_DMA:    Resource 00
> [156543.773322] Plx8000_DMA:      Type     : Memory
> [156543.791508] Plx8000_DMA:      PCI BAR 0: 83046000
> [156543.805245] Plx8000_DMA:      Phys Addr: 3FE883046000
> [156543.819215] Plx8000_DMA:      Size     : 2000h (8KB)
> [156543.833571] Plx8000_DMA:      Property : Non-Prefetchable 32-bit
> [156543.847515] Plx8000_DMA:      Kernel VA: d000080081566000
> [156543.886524] Plx8000_DMA: Device 87D0_10B5 = 8725 rev CA
> [156543.906770] Plx8000_DMA: MSI enabled, change IRQ 251 --> 275
> [156543.924546] Plx8000_DMA:    Resource 01
> [156543.938587] Plx8000_DMA:      Type     : Interrupt (MSI)
> [156543.938637] Plx8000_DMA:      IRQ      : 275 [113h]
> [156543.959460] Plx8000_DMA:      MSI Addr : 10000000
> [156543.974286] Plx8000_DMA: _00000000
> [156543.989775] Plx8000_DMA:      MSI Data : 0013
> [156544.005015] Plx8000_DMA: Installed ISR for interrupt
> [156544.018303] Plx8000_DMA: Attempt to allocate physical memory
> (64KB)
> [156544.040309] Plx8000_DMA: Allocated physical memory...
> [156544.069896] Plx8000_DMA:     CPU Phys Addr: 1fc3dd0000
> [156544.136502] Plx8000_DMA:     Bus Phys Addr: 60030000
> [156544.136551] Plx8000_DMA:     Kernel VA    : c000001fc3dd0000
> [156544.183572] Plx8000_DMA:     Size         : 10000h (64KB)
> [156544.222978] Plx8000_DMA:    --------------------
> [156544.253033] Plx8000_DMA: Added: 5 devices
> [156544.296043] Plx8000_DMA: ...driver loaded
> 
> [156562.531757] Plx8000_NT: 
> [156562.531762] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156562.531764] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156562.531766] Plx8000_NT: ...device opened
> [156562.531769] Plx8000_NT: 
> [156562.531771] Plx8000_NT: Received PLX message ===> 
> [156562.531772] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156562.531774] Plx8000_NT: ...Completed message
> [156562.531776] Plx8000_NT: 
> [156562.531777] Plx8000_NT: Received PLX message ===> 
> [156562.531779] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156562.531782] Plx8000_NT: Criteria matched device 8619_10B5
> [02:01.0]
> [156562.531783] Plx8000_NT: ...Completed message
> [156562.531787] Plx8000_NT: 
> [156562.531788] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156562.531790] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156562.531792] Plx8000_NT: ...device closed
> [156562.531798] Plx8000_NT: 
> [156562.531799] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156562.531801] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156562.531802] Plx8000_NT: ...device opened
> [156562.531805] Plx8000_NT: 
> [156562.531806] Plx8000_NT: Received PLX message ===> 
> [156562.531807] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156562.531809] Plx8000_NT: ...Completed message
> [156562.531814] Plx8000_NT: 
> [156562.531815] Plx8000_NT: Received PLX message ===> 
> [156562.531816] Plx8000_NT: PLX_IOCTL_GET_PORT_PROPERTIES
> [156562.531861] Plx8000_NT: [D1 02:01.0] P=1 T=0 MPS=512/2048 MRR=128
> L=G2x4/G2x8
> [156562.531863] Plx8000_NT: ...Completed message
> [156562.531866] Plx8000_NT: 
> [156562.531867] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156562.531869] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156562.531870] Plx8000_NT: ...device closed
> [156562.531898] Plx8000_NT: 
> [156562.531899] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156562.531901] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156562.531902] Plx8000_NT: ...device opened
> [156562.531905] Plx8000_NT: 
> [156562.531906] Plx8000_NT: Received PLX message ===> 
> [156562.531907] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156562.531909] Plx8000_NT: ...Completed message
> [156562.531911] Plx8000_NT: 
> [156562.531912] Plx8000_NT: Received PLX message ===> 
> [156562.531913] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156562.531915] Plx8000_NT: Criteria did not match any devices
> [156562.531916] Plx8000_NT: ...Completed message
> [156562.531919] Plx8000_NT: 
> [156562.531920] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156562.531922] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156562.531923] Plx8000_NT: ...device closed
> [156562.531930] Plx8000_DMA: 
> [156562.532042] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156562.532211] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156562.532256] Plx8000_DMA: ...device opened
> [156562.532294] Plx8000_DMA: 
> [156562.532320] Plx8000_DMA: Received PLX message ===> 
> [156562.532409] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156562.532592] Plx8000_DMA: ...Completed message
> [156562.532641] PLX DMA[Dispatch_IoControl-1053]
> [156562.532688] PLX DMA[Dispatch_IoControl-1061]
> [156562.532736] Plx8000_DMA: 
> [156562.532762] Plx8000_DMA: Received PLX message ===> 
> [156562.532809] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
> [156562.532871] Plx8000_DMA: Criteria matched device 8619_10B5
> [01:00.1]
> [156562.532932] Plx8000_DMA: ...Completed message
> [156562.532979] PLX DMA[Dispatch_IoControl-1053]
> [156562.533027] PLX DMA[Dispatch_IoControl-1061]
> [156562.533077] Plx8000_DMA: 
> [156562.533102] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156562.533151] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156562.533199] Plx8000_DMA: ...device closed
> [156562.533239] Plx8000_DMA: 
> [156562.533263] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156562.533313] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156562.533362] Plx8000_DMA: ...device opened
> [156562.533399] Plx8000_DMA: 
> [156562.533425] Plx8000_DMA: Received PLX message ===> 
> [156562.533473] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156562.533532] Plx8000_DMA: ...Completed message
> [156562.533581] PLX DMA[Dispatch_IoControl-1053]
> [156562.533628] PLX DMA[Dispatch_IoControl-1061]
> [156562.533677] Plx8000_DMA: 
> [156562.533701] Plx8000_DMA: Received PLX message ===> 
> [156562.533746] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
> [156562.533838] Plx8000_DMA: [D1 01:00.1] P=0 T=0 MPS=512/2048
> MRR=512
> L=G2x8/G2x8
> [156562.533910] Plx8000_DMA: ...Completed message
> [156562.533956] PLX DMA[Dispatch_IoControl-1053]
> [156562.534002] PLX DMA[Dispatch_IoControl-1061]
> [156562.534050] Plx8000_DMA: 
> [156562.534075] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156562.534122] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156562.534169] Plx8000_DMA: ...device closed
> [156562.534233] Plx8000_NT: 
> [156562.534235] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156562.534236] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156562.534238] Plx8000_NT: ...device opened
> [156562.534240] Plx8000_NT: 
> [156562.534242] Plx8000_NT: Received PLX message ===> 
> [156562.534243] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156562.534244] Plx8000_NT: ...Completed message
> [156562.534246] Plx8000_NT: 
> [156562.534247] Plx8000_NT: Received PLX message ===> 
> [156562.534249] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156562.534250] Plx8000_NT: Criteria did not match any devices
> [156562.534251] Plx8000_NT: ...Completed message
> [156562.534254] Plx8000_NT: 
> [156562.534255] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156562.534257] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156562.534258] Plx8000_NT: ...device closed
> [156562.534263] Plx8000_DMA: 
> [156562.534287] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156562.534335] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156562.534383] Plx8000_DMA: ...device opened
> [156562.534421] Plx8000_DMA: 
> [156562.534446] Plx8000_DMA: Received PLX message ===> 
> [156562.534495] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156562.534553] Plx8000_DMA: ...Completed message
> [156562.534600] PLX DMA[Dispatch_IoControl-1053]
> [156562.534649] PLX DMA[Dispatch_IoControl-1061]
> [156562.534697] Plx8000_DMA: 
> [156562.534721] Plx8000_DMA: Received PLX message ===> 
> [156562.534769] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
> [156562.534829] Plx8000_DMA: Criteria matched device 87D0_10B5
> [01:00.1]
> [156562.534889] Plx8000_DMA: ...Completed message
> [156562.534937] PLX DMA[Dispatch_IoControl-1053]
> [156562.534986] PLX DMA[Dispatch_IoControl-1061]
> [156562.535036] Plx8000_DMA: 
> [156562.535060] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156562.535106] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156562.535155] Plx8000_DMA: ...device closed
> [156562.535194] Plx8000_DMA: 
> [156562.535221] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156562.535269] Plx8000_DMA: Open device (Plx8000_DMA-1)...
> [156562.535331] Plx8000_DMA: ...device opened
> [156562.535378] Plx8000_DMA: 
> [156562.535404] Plx8000_DMA: Received PLX message ===> 
> [156562.535452] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156562.535511] Plx8000_DMA: ...Completed message
> [156562.535560] PLX DMA[Dispatch_IoControl-1053]
> [156562.535650] PLX DMA[Dispatch_IoControl-1061]
> [156562.535705] Plx8000_DMA: 
> [156562.535730] Plx8000_DMA: Received PLX message ===> 
> [156562.535801] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
> [156562.535928] Plx8000_DMA: [D3 01:00.1] P=0 T=0 MPS=128/2048
> MRR=512
> L=G3x8/G3x8
> [156562.536001] Plx8000_DMA: ...Completed message
> [156562.536077] PLX DMA[Dispatch_IoControl-1053]
> [156562.536147] PLX DMA[Dispatch_IoControl-1061]
> [156562.536218] Plx8000_DMA: 
> [156562.536243] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156562.536302] Plx8000_DMA: Close device (Plx8000_DMA-1)...
> [156562.546438] Plx8000_DMA: ...device closed
> [156562.570813] Plx8000_NT: 
> [156562.570815] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156562.570817] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156562.570818] Plx8000_NT: ...device opened
> [156562.570821] Plx8000_NT: 
> [156562.570822] Plx8000_NT: Received PLX message ===> 
> [156562.570823] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156562.570825] Plx8000_NT: ...Completed message
> [156562.570827] Plx8000_NT: 
> [156562.570828] Plx8000_NT: Received PLX message ===> 
> [156562.570829] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156562.570831] Plx8000_NT: Criteria did not match any devices
> [156562.570832] Plx8000_NT: ...Completed message
> [156562.570835] Plx8000_NT: 
> [156562.570836] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156562.570838] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156562.570839] Plx8000_NT: ...device closed
> [156562.570844] Plx8000_DMA: 
> [156562.570872] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156562.584646] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156562.608579] Plx8000_DMA: ...device opened
> [156562.622863] Plx8000_DMA: 
> [156562.622889] Plx8000_DMA: Received PLX message ===> 
> [156562.635962] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156562.656582] Plx8000_DMA: ...Completed message
> [156562.669725] PLX DMA[Dispatch_IoControl-1053]
> [156562.669775] PLX DMA[Dispatch_IoControl-1061]
> [156562.690495] Plx8000_DMA: 
> [156562.716736] Plx8000_DMA: Received PLX message ===> 
> [156562.716786] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
> [156562.729952] Plx8000_DMA: Criteria matched device 87D0_10B5
> [01:00.2]
> [156562.747900] Plx8000_DMA: ...Completed message
> [156562.761509] PLX DMA[Dispatch_IoControl-1053]
> [156562.781887] PLX DMA[Dispatch_IoControl-1061]
> [156562.795281] Plx8000_DMA: 
> [156562.795310] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156562.809295] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156562.828996] Plx8000_DMA: ...device closed
> [156562.843210] Plx8000_DMA: 
> [156562.843236] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156562.856779] Plx8000_DMA: Open device (Plx8000_DMA-2)...
> [156562.880503] Plx8000_DMA: ...device opened
> [156562.894602] Plx8000_DMA: 
> [156562.894626] Plx8000_DMA: Received PLX message ===> 
> [156562.908203] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156562.922109] Plx8000_DMA: ...Completed message
> [156562.945318] PLX DMA[Dispatch_IoControl-1053]
> [156562.959849] PLX DMA[Dispatch_IoControl-1061]
> [156562.959898] Plx8000_DMA: 
> [156562.973546] Plx8000_DMA: Received PLX message ===> 
> [156562.987656] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
> [156563.002661] Plx8000_DMA: [D3 01:00.2] P=0 T=0 MPS=128/2048
> MRR=512
> L=G3x8/G3x8
> [156563.026654] Plx8000_DMA: ...Completed message
> [156563.040343] PLX DMA[Dispatch_IoControl-1053]
> [156563.040389] PLX DMA[Dispatch_IoControl-1061]
> [156563.054462] Plx8000_DMA: 
> [156563.069658] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156563.090858] Plx8000_DMA: Close device (Plx8000_DMA-2)...
> [156563.105070] Plx8000_DMA: ...device closed
> [156563.105135] Plx8000_NT: 
> [156563.105136] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156563.105137] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156563.105139] Plx8000_NT: ...device opened
> [156563.105141] Plx8000_NT: 
> [156563.105142] Plx8000_NT: Received PLX message ===> 
> [156563.105143] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156563.105144] Plx8000_NT: ...Completed message
> [156563.105145] Plx8000_NT: 
> [156563.105146] Plx8000_NT: Received PLX message ===> 
> [156563.105147] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156563.105148] Plx8000_NT: Criteria did not match any devices
> [156563.105150] Plx8000_NT: ...Completed message
> [156563.105152] Plx8000_NT: 
> [156563.105153] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156563.105154] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156563.105155] Plx8000_NT: ...device closed
> [156563.105159] Plx8000_DMA: 
> [156563.118343] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156563.138958] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156563.156417] Plx8000_DMA: ...device opened
> [156563.156454] Plx8000_DMA: 
> [156563.170984] Plx8000_DMA: Received PLX message ===> 
> [156563.191831] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156563.205911] Plx8000_DMA: ...Completed message
> [156563.205956] PLX DMA[Dispatch_IoControl-1053]
> [156563.225683] PLX DMA[Dispatch_IoControl-1061]
> [156563.239309] Plx8000_DMA: 
> [156563.239332] Plx8000_DMA: Received PLX message ===> 
> [156563.253748] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
> [156563.267644] Plx8000_DMA: Criteria matched device 87D0_10B5
> [01:00.3]
> [156563.288620] Plx8000_DMA: ...Completed message
> [156563.342195] PLX DMA[Dispatch_IoControl-1053]
> [156563.361609] PLX DMA[Dispatch_IoControl-1061]
> [156563.361667] Plx8000_DMA: 
> [156563.385195] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156563.413351] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156563.442696] Plx8000_DMA: ...device closed
> [156563.463349] Plx8000_DMA: 
> [156563.463383] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156563.482592] Plx8000_DMA: Open device (Plx8000_DMA-3)...
> [156563.522918] Plx8000_DMA: ...device opened
> [156563.552722] Plx8000_DMA: 
> [156563.552751] Plx8000_DMA: Received PLX message ===> 
> [156563.571726] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156563.602616] Plx8000_DMA: ...Completed message
> [156563.625686] PLX DMA[Dispatch_IoControl-1053]
> [156563.625735] PLX DMA[Dispatch_IoControl-1061]
> [156563.653003] Plx8000_DMA: 
> [156563.682700] Plx8000_DMA: Received PLX message ===> 
> [156563.682748] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
> [156563.698771] Plx8000_DMA: [D3 01:00.3] P=0 T=0 MPS=128/2048
> MRR=512
> L=G3x8/G3x8
> [156563.753133] Plx8000_DMA: ...Completed message
> [156563.773272] PLX DMA[Dispatch_IoControl-1053]
> [156563.773321] PLX DMA[Dispatch_IoControl-1061]
> [156563.787388] Plx8000_DMA: 
> [156563.787415] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156563.801760] Plx8000_DMA: Close device (Plx8000_DMA-3)...
> [156563.815276] Plx8000_DMA: ...device closed
> [156563.839004] Plx8000_NT: 
> [156563.839006] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156563.839008] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156563.839010] Plx8000_NT: ...device opened
> [156563.839012] Plx8000_NT: 
> [156563.839014] Plx8000_NT: Received PLX message ===> 
> [156563.839015] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156563.839017] Plx8000_NT: ...Completed message
> [156563.839019] Plx8000_NT: 
> [156563.839020] Plx8000_NT: Received PLX message ===> 
> [156563.839022] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156563.839023] Plx8000_NT: Criteria did not match any devices
> [156563.839025] Plx8000_NT: ...Completed message
> [156563.839027] Plx8000_NT: 
> [156563.839029] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156563.839030] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156563.839032] Plx8000_NT: ...device closed
> [156563.839038] Plx8000_DMA: 
> [156563.853847] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156563.867182] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156563.867230] Plx8000_DMA: ...device opened
> [156563.887836] Plx8000_DMA: 
> [156563.901487] Plx8000_DMA: Received PLX message ===> 
> [156563.931748] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156563.931806] Plx8000_DMA: ...Completed message
> [156563.945807] PLX DMA[Dispatch_IoControl-1053]
> [156563.969968] PLX DMA[Dispatch_IoControl-1061]
> [156563.985037] Plx8000_DMA: 
> [156563.985063] Plx8000_DMA: Received PLX message ===> 
> [156563.998669] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
> [156564.013716] Plx8000_DMA: Criteria matched device 87D0_10B5
> [01:00.4]
> [156564.036795] Plx8000_DMA: ...Completed message
> [156564.051283] PLX DMA[Dispatch_IoControl-1053]
> [156564.067066] PLX DMA[Dispatch_IoControl-1061]
> [156564.067120] Plx8000_DMA: 
> [156564.081454] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156564.106002] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156564.120673] Plx8000_DMA: ...device closed
> [156564.120717] Plx8000_DMA: 
> [156564.135396] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156564.155769] Plx8000_DMA: Open device (Plx8000_DMA-4)...
> [156564.169952] Plx8000_DMA: ...device opened
> [156564.170075] Plx8000_DMA: 
> [156564.184096] Plx8000_DMA: Received PLX message ===> 
> [156564.218424] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156564.241590] Plx8000_DMA: ...Completed message
> [156564.241637] PLX DMA[Dispatch_IoControl-1053]
> [156564.267168] PLX DMA[Dispatch_IoControl-1061]
> [156564.284546] Plx8000_DMA: 
> [156564.299010] Plx8000_DMA: Received PLX message ===> 
> [156564.299054] Plx8000_DMA: PLX_IOCTL_GET_PORT_PROPERTIES
> [156564.342078] Plx8000_DMA: [D3 01:00.4] P=0 T=0 MPS=128/2048
> MRR=512
> L=G3x8/G3x8
> [156564.381570] Plx8000_DMA: ...Completed message
> [156564.381615] PLX DMA[Dispatch_IoControl-1053]
> [156564.413790] PLX DMA[Dispatch_IoControl-1061]
> [156564.434488] Plx8000_DMA: 
> [156564.434512] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156564.456071] Plx8000_DMA: Close device (Plx8000_DMA-4)...
> [156564.481577] Plx8000_DMA: ...device closed
> [156564.496407] Plx8000_NT: 
> [156564.496409] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156564.496410] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156564.496411] Plx8000_NT: ...device opened
> [156564.496413] Plx8000_NT: 
> [156564.496415] Plx8000_NT: Received PLX message ===> 
> [156564.496415] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156564.496416] Plx8000_NT: ...Completed message
> [156564.496418] Plx8000_NT: 
> [156564.496419] Plx8000_NT: Received PLX message ===> 
> [156564.496420] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156564.496421] Plx8000_NT: Criteria did not match any devices
> [156564.496422] Plx8000_NT: ...Completed message
> [156564.496425] Plx8000_NT: 
> [156564.496426] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156564.496427] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156564.496428] Plx8000_NT: ...device closed
> [156564.496432] Plx8000_DMA: 
> [156564.496456] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156564.514010] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156564.535514] Plx8000_DMA: ...device opened
> [156564.549372] Plx8000_DMA: 
> [156564.564439] Plx8000_DMA: Received PLX message ===> 
> [156564.564487] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156564.578562] Plx8000_DMA: ...Completed message
> [156564.599768] PLX DMA[Dispatch_IoControl-1053]
> [156564.614704] PLX DMA[Dispatch_IoControl-1061]
> [156564.614754] Plx8000_DMA: 
> [156564.628538] Plx8000_DMA: Received PLX message ===> 
> [156564.646209] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
> [156564.660652] Plx8000_DMA: Criteria did not match any devices
> [156564.682553] Plx8000_DMA: ...Completed message
> [156564.696647] PLX DMA[Dispatch_IoControl-1053]
> [156564.696696] PLX DMA[Dispatch_IoControl-1061]
> [156564.710744] Plx8000_DMA: 
> [156564.732090] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156564.751953] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156564.752004] Plx8000_DMA: ...device closed
> [156568.052329] Plx8000_NT: 
> [156568.052331] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156568.052333] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156568.052335] Plx8000_NT: ...device opened
> [156568.052338] Plx8000_NT: 
> [156568.052339] Plx8000_NT: Received PLX message ===> 
> [156568.052341] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156568.052342] Plx8000_NT: ...Completed message
> [156568.052447] Plx8000_NT: 
> [156568.052449] Plx8000_NT: Received PLX message ===> 
> [156568.052450] Plx8000_NT: PLX_IOCTL_PCI_BAR_PROPERTIES
> [156568.052452] Plx8000_NT:     PCI BAR 2: 80000000
> [156568.052454] Plx8000_NT:     Phys Addr: 3FE080000000
> [156568.052456] Plx8000_NT:     Size     : 400000h (4MB)
> [156568.052458] Plx8000_NT:     Property : Non-Prefetchable 32-bit
> [156568.052460] Plx8000_NT: ...Completed message
> [156568.052507] Plx8000_NT: 
> [156568.052509] Plx8000_NT: Received PLX message ===> 
> [156568.052510] Plx8000_NT: PLX_IOCTL_PCI_BAR_PROPERTIES
> [156568.052512] Plx8000_NT:     PCI BAR 2: 80000000
> [156568.052513] Plx8000_NT:     Phys Addr: 3FE080000000
> [156568.052515] Plx8000_NT:     Size     : 400000h (4MB)
> [156568.052517] Plx8000_NT:     Property : Non-Prefetchable 32-bit
> [156568.052518] Plx8000_NT: ...Completed message
> [156568.052556] Plx8000_NT: 
> [156568.052558] Plx8000_NT: Received message ===> MMAP
> [156568.052559] Plx8000_NT: Map PCI BAR 2...
> [156568.052563] Plx8000_NT: Mapped Phys (3fe080000000) ==> User VA
> (3fff79040000)
> [156568.052564] Plx8000_NT: ...Completed message
> [156568.052623] Plx8000_NT: 
> [156568.052625] Plx8000_NT: Received PLX message ===> 
> [156568.052626] Plx8000_NT: PLX_IOCTL_NT_LUT_ADD
> [156568.052635] Plx8000_NT: Req ID (0000) already exists in LUT #0,
> skipping
> update
> [156568.052636] Plx8000_NT: ...Completed message
> [156568.052673] Plx8000_NT: 
> [156568.052675] Plx8000_NT: Received PLX message ===> 
> [156568.052676] Plx8000_NT: PLX_IOCTL_PHYSICAL_MEM_ALLOCATE
> [156568.052678] Plx8000_NT: Attempt to allocate physical memory
> (1953KB)
> [156568.053069] Plx8000_NT: Allocated physical memory...
> [156568.053071] Plx8000_NT:     CPU Phys Addr: 1f9e400000
> [156568.053073] Plx8000_NT:     Bus Phys Addr: 60e00000
> [156568.053075] Plx8000_NT:     Kernel VA    : c000001f9e400000
> [156568.053077] Plx8000_NT:     Size         : 1E8480h (1MB)
> [156568.053078] Plx8000_NT: ...Completed message
> [156568.053099] Plx8000_NT: 
> [156568.053100] Plx8000_NT: Received message ===> MMAP
> [156568.053103] Plx8000_NT: Mapped Phys (1f9e400000) ==> User VA
> (3fff78e50000)
> [156568.053105] Plx8000_NT: ...Completed message
> [156568.053119] Plx8000_NT: 
> [156568.053120] Plx8000_NT: Received PLX message ===> 
> [156568.053121] Plx8000_NT: PLX_IOCTL_PHYSICAL_MEM_ALLOCATE
> [156568.053123] Plx8000_NT: Attempt to allocate physical memory
> (1953KB)
> [156568.053511] Plx8000_NT: Allocated physical memory...
> [156568.053513] Plx8000_NT:     CPU Phys Addr: 1f82c00000
> [156568.053515] Plx8000_NT:     Bus Phys Addr: 61000000
> [156568.053516] Plx8000_NT:     Kernel VA    : c000001f82c00000
> [156568.053518] Plx8000_NT:     Size         : 1E8480h (1MB)
> [156568.053520] Plx8000_NT: ...Completed message
> [156568.053540] Plx8000_NT: 
> [156568.053541] Plx8000_NT: Received message ===> MMAP
> [156568.053544] Plx8000_NT: Mapped Phys (1f82c00000) ==> User VA
> (3fff78c60000)
> [156568.053545] Plx8000_NT: ...Completed message
> [156568.053576] Plx8000_NT: 
> [156568.053577] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156568.053579] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156568.053580] Plx8000_NT: ...device opened
> [156568.053583] Plx8000_NT: 
> [156568.053584] Plx8000_NT: Received PLX message ===> 
> [156568.053585] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156568.053587] Plx8000_NT: ...Completed message
> [156568.053589] Plx8000_NT: 
> [156568.053590] Plx8000_NT: Received PLX message ===> 
> [156568.053591] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156568.053594] Plx8000_NT: Criteria matched device 8619_10B5
> [02:01.0]
> [156568.053595] Plx8000_NT: ...Completed message
> [156568.053598] Plx8000_NT: 
> [156568.053600] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156568.053601] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156568.053603] Plx8000_NT: ...device closed
> [156568.053608] Plx8000_NT: 
> [156568.053610] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156568.053611] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156568.053613] Plx8000_NT: ...device opened
> [156568.053615] Plx8000_NT: 
> [156568.053616] Plx8000_NT: Received PLX message ===> 
> [156568.053618] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156568.053619] Plx8000_NT: ...Completed message
> [156568.053621] Plx8000_NT: 
> [156568.053622] Plx8000_NT: Received PLX message ===> 
> [156568.053623] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156568.053625] Plx8000_NT: Criteria did not match any devices
> [156568.053626] Plx8000_NT: ...Completed message
> [156568.053629] Plx8000_NT: 
> [156568.053630] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156568.053632] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156568.053633] Plx8000_NT: ...device closed
> [156568.053638] Plx8000_DMA: 
> [156568.053730] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156568.053921] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156568.053968] Plx8000_DMA: ...device opened
> [156568.054007] Plx8000_DMA: 
> [156568.054033] Plx8000_DMA: Received PLX message ===> 
> [156568.054081] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156568.054306] Plx8000_DMA: ...Completed message
> [156568.054356] PLX DMA[Dispatch_IoControl-1053]
> [156568.054404] PLX DMA[Dispatch_IoControl-1061]
> [156568.054451] Plx8000_DMA: 
> [156568.054476] Plx8000_DMA: Received PLX message ===> 
> [156568.054524] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
> [156568.054583] Plx8000_DMA: Criteria matched device 8619_10B5
> [01:00.1]
> [156568.054643] Plx8000_DMA: ...Completed message
> [156568.054691] PLX DMA[Dispatch_IoControl-1053]
> [156568.054739] PLX DMA[Dispatch_IoControl-1061]
> [156568.054786] Plx8000_DMA: 
> [156568.054810] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156568.054858] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156568.054904] Plx8000_DMA: ...device closed
> [156568.054945] Plx8000_DMA: 
> [156568.054971] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156568.055018] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156568.055066] Plx8000_DMA: ...device opened
> [156568.055104] Plx8000_DMA: 
> [156568.055130] Plx8000_DMA: Received PLX message ===> 
> [156568.055180] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156568.055239] Plx8000_DMA: ...Completed message
> [156568.055312] PLX DMA[Dispatch_IoControl-1053]
> [156568.055364] PLX DMA[Dispatch_IoControl-1061]
> [156568.055422] Plx8000_DMA: 
> [156568.055446] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156568.055497] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156568.055546] Plx8000_DMA: ...device closed
> [156568.055606] Plx8000_NT: 
> [156568.055608] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156568.055610] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156568.055611] Plx8000_NT: ...device opened
> [156568.055613] Plx8000_NT: 
> [156568.055615] Plx8000_NT: Received PLX message ===> 
> [156568.055616] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156568.055617] Plx8000_NT: ...Completed message
> [156568.055619] Plx8000_NT: 
> [156568.055621] Plx8000_NT: Received PLX message ===> 
> [156568.055622] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156568.055623] Plx8000_NT: Criteria did not match any devices
> [156568.055624] Plx8000_NT: ...Completed message
> [156568.055627] Plx8000_NT: 
> [156568.055630] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156568.055634] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156568.055636] Plx8000_NT: ...device closed
> [156568.055641] Plx8000_DMA: 
> [156568.055667] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156568.055717] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156568.055766] Plx8000_DMA: ...device opened
> [156568.055804] Plx8000_DMA: 
> [156568.055828] Plx8000_DMA: Received PLX message ===> 
> [156568.055875] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156568.055936] Plx8000_DMA: ...Completed message
> [156568.055985] PLX DMA[Dispatch_IoControl-1053]
> [156568.056036] PLX DMA[Dispatch_IoControl-1061]
> [156568.056086] Plx8000_DMA: 
> [156568.056111] Plx8000_DMA: Received PLX message ===> 
> [156568.056160] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
> [156568.056222] Plx8000_DMA: Criteria matched device 87D0_10B5
> [01:00.1]
> [156568.056282] Plx8000_DMA: ...Completed message
> [156568.056332] PLX DMA[Dispatch_IoControl-1053]
> [156568.056382] PLX DMA[Dispatch_IoControl-1061]
> [156568.056430] Plx8000_DMA: 
> [156568.056455] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156568.056504] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156568.056554] Plx8000_DMA: ...device closed
> [156568.056595] Plx8000_DMA: 
> [156568.056621] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156568.056669] Plx8000_DMA: Open device (Plx8000_DMA-1)...
> [156568.056716] Plx8000_DMA: ...device opened
> [156568.056755] Plx8000_DMA: 
> [156568.056781] Plx8000_DMA: Received PLX message ===> 
> [156568.056828] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156568.056887] Plx8000_DMA: ...Completed message
> [156568.056935] PLX DMA[Dispatch_IoControl-1053]
> [156568.056982] PLX DMA[Dispatch_IoControl-1061]
> [156568.057036] Plx8000_DMA: 
> [156568.057061] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156568.057110] Plx8000_DMA: Close device (Plx8000_DMA-1)...
> [156568.057158] Plx8000_DMA: ...device closed
> [156568.057233] Plx8000_NT: 
> [156568.057235] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156568.057236] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156568.057238] Plx8000_NT: ...device opened
> [156568.057240] Plx8000_NT: 
> [156568.057241] Plx8000_NT: Received PLX message ===> 
> [156568.057243] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156568.057246] Plx8000_NT: ...Completed message
> [156568.057251] Plx8000_NT: 
> [156568.057253] Plx8000_NT: Received PLX message ===> 
> [156568.057254] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156568.057257] Plx8000_NT: Criteria did not match any devices
> [156568.057258] Plx8000_NT: ...Completed message
> [156568.057261] Plx8000_NT: 
> [156568.057262] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156568.057264] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156568.057265] Plx8000_NT: ...device closed
> [156568.057270] Plx8000_DMA: 
> [156568.057297] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156568.057344] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156568.057394] Plx8000_DMA: ...device opened
> [156568.057432] Plx8000_DMA: 
> [156568.057458] Plx8000_DMA: Received PLX message ===> 
> [156568.057506] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156568.057565] Plx8000_DMA: ...Completed message
> [156568.057614] PLX DMA[Dispatch_IoControl-1053]
> [156568.057661] PLX DMA[Dispatch_IoControl-1061]
> [156568.057712] Plx8000_DMA: 
> [156568.057736] Plx8000_DMA: Received PLX message ===> 
> [156568.057785] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
> [156568.057846] Plx8000_DMA: Criteria matched device 87D0_10B5
> [01:00.2]
> [156568.071390] Plx8000_DMA: ...Completed message
> [156568.071442] PLX DMA[Dispatch_IoControl-1053]
> [156568.084861] PLX DMA[Dispatch_IoControl-1061]
> [156568.108956] Plx8000_DMA: 
> [156568.108982] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156568.123073] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156568.137299] Plx8000_DMA: ...device closed
> [156568.157187] Plx8000_DMA: 
> [156568.157212] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156568.171567] Plx8000_DMA: Open device (Plx8000_DMA-2)...
> [156568.192333] Plx8000_DMA: ...device opened
> [156568.205962] Plx8000_DMA: 
> [156568.222240] Plx8000_DMA: Received PLX message ===> 
> [156568.222290] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156568.237977] Plx8000_DMA: ...Completed message
> [156568.252826] PLX DMA[Dispatch_IoControl-1053]
> [156568.272657] PLX DMA[Dispatch_IoControl-1061]
> [156568.272716] Plx8000_DMA: 
> [156568.287136] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156568.301621] Plx8000_DMA: Close device (Plx8000_DMA-2)...
> [156568.336957] Plx8000_DMA: ...device closed
> [156568.391165] Plx8000_NT: 
> [156568.391167] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156568.391169] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156568.391170] Plx8000_NT: ...device opened
> [156568.391172] Plx8000_NT: 
> [156568.391173] Plx8000_NT: Received PLX message ===> 
> [156568.391174] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156568.391176] Plx8000_NT: ...Completed message
> [156568.391178] Plx8000_NT: 
> [156568.391179] Plx8000_NT: Received PLX message ===> 
> [156568.391180] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156568.391182] Plx8000_NT: Criteria did not match any devices
> [156568.391183] Plx8000_NT: ...Completed message
> [156568.391185] Plx8000_NT: 
> [156568.391186] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156568.391188] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156568.391189] Plx8000_NT: ...device closed
> [156568.391194] Plx8000_DMA: 
> [156568.391220] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156568.411367] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156568.432257] Plx8000_DMA: ...device opened
> [156568.484646] Plx8000_DMA: 
> [156568.484672] Plx8000_DMA: Received PLX message ===> 
> [156568.508696] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156568.529863] Plx8000_DMA: ...Completed message
> [156568.557840] PLX DMA[Dispatch_IoControl-1053]
> [156568.557887] PLX DMA[Dispatch_IoControl-1061]
> [156568.592037] Plx8000_DMA: 
> [156568.624958] Plx8000_DMA: Received PLX message ===> 
> [156568.642587] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
> [156568.642647] Plx8000_DMA: Criteria matched device 87D0_10B5
> [01:00.3]
> [156568.712452] Plx8000_DMA: ...Completed message
> [156568.712500] PLX DMA[Dispatch_IoControl-1053]
> [156568.739829] PLX DMA[Dispatch_IoControl-1061]
> [156568.775573] Plx8000_DMA: 
> [156568.775596] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156568.793855] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156568.823125] Plx8000_DMA: ...device closed
> [156568.837261] Plx8000_DMA: 
> [156568.837284] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156568.850823] Plx8000_DMA: Open device (Plx8000_DMA-3)...
> [156568.870811] Plx8000_DMA: ...device opened
> [156568.883983] Plx8000_DMA: 
> [156568.897485] Plx8000_DMA: Received PLX message ===> 
> [156568.897527] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156568.913771] Plx8000_DMA: ...Completed message
> [156568.927886] PLX DMA[Dispatch_IoControl-1053]
> [156568.947136] PLX DMA[Dispatch_IoControl-1061]
> [156568.961367] Plx8000_DMA: 
> [156568.961391] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156568.974749] Plx8000_DMA: Close device (Plx8000_DMA-3)...
> [156568.989049] Plx8000_DMA: ...device closed
> [156569.008972] Plx8000_NT: 
> [156569.008974] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156569.008975] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156569.008976] Plx8000_NT: ...device opened
> [156569.008978] Plx8000_NT: 
> [156569.008979] Plx8000_NT: Received PLX message ===> 
> [156569.008979] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156569.008980] Plx8000_NT: ...Completed message
> [156569.008982] Plx8000_NT: 
> [156569.008983] Plx8000_NT: Received PLX message ===> 
> [156569.008984] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156569.008985] Plx8000_NT: Criteria did not match any devices
> [156569.008986] Plx8000_NT: ...Completed message
> [156569.008988] Plx8000_NT: 
> [156569.008989] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156569.008990] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156569.008991] Plx8000_NT: ...device closed
> [156569.008995] Plx8000_DMA: 
> [156569.009018] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156569.022988] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156569.038588] Plx8000_DMA: ...device opened
> [156569.064580] Plx8000_DMA: 
> [156569.064603] Plx8000_DMA: Received PLX message ===> 
> [156569.078977] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156569.092497] Plx8000_DMA: ...Completed message
> [156569.112340] PLX DMA[Dispatch_IoControl-1053]
> [156569.125860] PLX DMA[Dispatch_IoControl-1061]
> [156569.125906] Plx8000_DMA: 
> [156569.139408] Plx8000_DMA: Received PLX message ===> 
> [156569.139453] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
> [156569.153404] Plx8000_DMA: Criteria matched device 87D0_10B5
> [01:00.4]
> [156569.173730] Plx8000_DMA: ...Completed message
> [156569.192216] PLX DMA[Dispatch_IoControl-1053]
> [156569.205416] PLX DMA[Dispatch_IoControl-1061]
> [156569.225320] Plx8000_DMA: 
> [156569.225343] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156569.239133] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156569.259248] Plx8000_DMA: ...device closed
> [156569.272774] Plx8000_DMA: 
> [156569.272796] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156569.286763] Plx8000_DMA: Open device (Plx8000_DMA-4)...
> [156569.323763] Plx8000_DMA: ...device opened
> [156569.350921] Plx8000_DMA: 
> [156569.350943] Plx8000_DMA: Received PLX message ===> 
> [156569.391522] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156569.411420] Plx8000_DMA: ...Completed message
> [156569.432018] PLX DMA[Dispatch_IoControl-1053]
> [156569.461219] PLX DMA[Dispatch_IoControl-1061]
> [156569.488454] Plx8000_DMA: 
> [156569.488475] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156569.507184] Plx8000_DMA: Close device (Plx8000_DMA-4)...
> [156569.521552] Plx8000_DMA: ...device closed
> [156569.521606] Plx8000_NT: 
> [156569.521607] Plx8000_NT: Received message ==> OPEN_DEVICE
> [156569.521608] Plx8000_NT: Open device (Plx8000_NT-0)...
> [156569.521609] Plx8000_NT: ...device opened
> [156569.521610] Plx8000_NT: 
> [156569.521611] Plx8000_NT: Received PLX message ===> 
> [156569.521612] Plx8000_NT: PLX_IOCTL_DRIVER_VERSION
> [156569.521613] Plx8000_NT: ...Completed message
> [156569.521614] Plx8000_NT: 
> [156569.521615] Plx8000_NT: Received PLX message ===> 
> [156569.521615] Plx8000_NT: PLX_IOCTL_PCI_DEVICE_FIND
> [156569.521616] Plx8000_NT: Criteria did not match any devices
> [156569.521617] Plx8000_NT: ...Completed message
> [156569.521619] Plx8000_NT: 
> [156569.521619] Plx8000_NT: Received message ==> CLOSE_DEVICE
> [156569.521620] Plx8000_NT: Close device (Plx8000_NT-0)...
> [156569.521621] Plx8000_NT: ...device closed
> [156569.521624] Plx8000_DMA: 
> [156569.541221] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156569.555596] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156569.569411] Plx8000_DMA: ...device opened
> [156569.591053] Plx8000_DMA: 
> [156569.591075] Plx8000_DMA: Received PLX message ===> 
> [156569.608531] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156569.622776] Plx8000_DMA: ...Completed message
> [156569.643340] PLX DMA[Dispatch_IoControl-1053]
> [156569.643381] PLX DMA[Dispatch_IoControl-1061]
> [156569.661435] Plx8000_DMA: 
> [156569.697493] Plx8000_DMA: Received PLX message ===> 
> [156569.697533] Plx8000_DMA: PLX_IOCTL_PCI_DEVICE_FIND
> [156569.712283] Plx8000_DMA: Criteria did not match any devices
> [156569.726097] Plx8000_DMA: ...Completed message
> [156569.743793] PLX DMA[Dispatch_IoControl-1053]
> [156569.757271] PLX DMA[Dispatch_IoControl-1061]
> [156569.778014] Plx8000_DMA: 
> [156569.778035] Plx8000_DMA: Received message ==> CLOSE_DEVICE
> [156569.792130] Plx8000_DMA: Close device (Plx8000_DMA-0)...
> [156569.812514] Plx8000_DMA: ...device closed
> ^[[B[156595.458146] Plx8000_DMA: 
> [156595.458253] Plx8000_DMA: Received message ==> OPEN_DEVICE
> [156595.458430] Plx8000_DMA: Open device (Plx8000_DMA-0)...
> [156595.458478] Plx8000_DMA: ...device opened
> [156595.458514] Plx8000_DMA: 
> [156595.458539] Plx8000_DMA: Received PLX message ===> 
> [156595.458588] Plx8000_DMA: PLX_IOCTL_DRIVER_VERSION
> [156595.458818] Plx8000_DMA: ...Completed message
> [156595.458868] PLX DMA[Dispatch_IoControl-1053]
> [156595.458918] PLX DMA[Dispatch_IoControl-1061]
> [156595.458977] Plx8000_NT: 
> [156595.458978] Plx8000_NT: Received PLX message ===> 
> [156595.458980] Plx8000_NT: PLX_IOCTL_NT_LUT_ADD
> [156595.458988] Plx8000_NT: Req ID (0101) already exists in LUT #1,
> skipping
> update
> [156595.458990] Plx8000_NT: ...Completed message
> [156598.640885] Plx8000_DMA: 
> [156598.640992] Plx8000_DMA: Received PLX message ===> 
> [156598.641163] Plx8000_DMA: PLX_IOCTL_DMA_CHANNEL_OPEN
> [156598.641226] Plx8000_DMA: Opened DMA channel 0
> [156598.641273] Plx8000_DMA: ...Completed message
> [156598.641320] PLX DMA[Dispatch_IoControl-1053]
> [156598.641369] PLX DMA[Dispatch_IoControl-1061]
> [156598.641499] Plx8000_DMA: 
> [156598.641608] Plx8000_DMA: Received PLX message ===> 
> [156598.641655] Plx8000_DMA: PLX_IOCTL_DMA_GET_PROPERTIES
> [156598.641718] Plx8000_DMA: ...Completed message
> [156598.641769] PLX DMA[Dispatch_IoControl-1053]
> [156598.641818] PLX DMA[Dispatch_IoControl-1061]
> [156598.641870] Plx8000_DMA: 
> [156598.641895] Plx8000_DMA: Received PLX message ===> 
> [156598.641943] Plx8000_DMA: PLX_IOCTL_DMA_SET_PROPERTIES
> [156598.642008] Plx8000_DMA: ...Completed message
> [156598.642057] PLX DMA[Dispatch_IoControl-1053]
> [156598.642106] PLX DMA[Dispatch_IoControl-1061]
> [156598.642160] Plx8000_DMA: 
> [156598.642185] Plx8000_DMA: Received PLX message ===> 
> [156598.642234] Plx8000_DMA: PLX_IOCTL_NOTIFICATION_REGISTER_FOR
> [156598.642308] Plx8000_DMA: Registered interrupt wait object
> (c000003bb93fd440)
> [156598.642378] Plx8000_DMA: ...Completed message
> [156598.642426] PLX DMA[Dispatch_IoControl-1053]
> [156598.642475] PLX DMA[Dispatch_IoControl-1061]
> [156598.642542] Plx8000_DMA: 
> [156598.642568] Plx8000_DMA: Received PLX message ===> 
> [156598.642615] Plx8000_DMA: PLX_IOCTL_DMA_TRANSFER_BLOCK
> [156598.642675] PLX DMA[PlxDmaTransferBlock-2479]
> [156598.642724] PLX DMA[PlxDmaTransferBlock-2488]
> [156598.642774] PLX DMA[PlxDmaTransferBlock-2495]
> [156598.642823] Plx8000_DMA: Ch 0 - DMA 00000000_60E00000 -->
> 00000000_61000000 (65536 bytes)
> [156598.642897] PLX DMA[PlxDmaTransferBlock-2503]
> [156598.642945] PLX DMA[PlxDmaTransferBlock-2511]
> [156598.642996] PLX DMA[PlxDmaTransferBlock-2516]
> [156598.643045] PLX DMA[PlxDmaTransferBlock-2521]
> [156598.643094] PLX DMA[PlxDmaTransferBlock-2532]
> [156598.643141] PLX DMA[PlxDmaTransferBlock-2535]
> [156598.643191] PLX DMA[PlxDmaTransferBlock-2539]
> [156598.643239] PLX DMA[PlxDmaTransferBlock-2550]
> [156598.643288] PLX DMA[PlxDmaTransferBlock-2557]
> [156598.643335] PLX DMA[PlxDmaTransferBlock-2562]
> [156598.643383] Plx8000_DMA: Start DMA transfer...
> [156598.643432] PLX DMA[PlxDmaTransferBlock-2565]
> [156598.643481] PLX DMA[PlxDmaTransferBlock-2569]
> [156598.643525] EEH: Frozen PE#1 on PHB#1 detected
> [156598.643529] EEH: PE location: Slot4, PHB location: N/A
> [156598.644631] EEH: This PCI device has failed 1 times in the last
> hour
> [156598.644632] EEH: Notify device drivers to shutdown
> [156598.644638] EEH: Collect temporary log
> [156598.644710] EEH: of node=0001:01:00:0
> [156598.644713] EEH: PCI device/vendor: 861910b5
> [156598.644715] EEH: PCI cmd/status register: 00100547
> [156598.644717] EEH: Bridge secondary status: 0000
> [156598.644719] EEH: Bridge control: 0002
> [156598.644720] EEH: PCI-E capabilities and status follow:
> [156598.644729] EEH: PCI-E 00: 0052a410 00008004 00000046 0000cc82 
> [156598.644736] EEH: PCI-E 10: 00820000 00000000 00000000 00000000 
> [156598.644737] EEH: PCI-E 20: 00000000 
> [156598.644738] EEH: PCI-E AER capability register set follows:
> [156598.644746] EEH: PCI-E AER 00: 13810001 00000000 00000000
> 00062030 
> [156598.644753] EEH: PCI-E AER 10: 00000000 00002000 000000ff
> 00000000 
> [156598.644760] EEH: PCI-E AER 20: 00000000 00000000 00000000
> 00000000 
> [156598.644762] EEH: PCI-E AER 30: 00000000 0e0e0e0e 
> [156598.644764] EEH: of node=0001:01:00:1
> [156598.644766] EEH: PCI device/vendor: 861910b5
> [156598.644767] EEH: PCI cmd/status register: 10100546
> [156598.644768] EEH: PCI-E capabilities and status follow:
> [156598.644777] EEH: PCI-E 00: 0002a410 00008fe4 0020204e 0000cc82 
> [156598.644784] EEH: PCI-E 10: 00820000 00000000 00000000 00000000 
> [156598.644785] EEH: PCI-E 20: 00000000 
> [156598.644785] EEH: PCI-E AER capability register set follows:
> [156598.644793] EEH: PCI-E AER 00: 1f410001 00000000 00000000
> 00062030 
> [156598.644800] EEH: PCI-E AER 10: 00000000 00002000 000001ff
> 00000000 
> [156598.644807] EEH: PCI-E AER 20: 00000000 00000000 00000000
> 00000000 
> [156598.644809] EEH: PCI-E AER 30: 00000000 00000000 
> [156598.644810] EEH: of node=0001:02:01:0
> [156598.644812] EEH: PCI device/vendor: 861910b5
> [156598.644814] EEH: PCI cmd/status register: 00100546
> [156598.644814] EEH: PCI-E capabilities and status follow:
> [156598.644823] EEH: PCI-E 00: 0002a410 00008fc4 0000004e 0100cc82 
> [156598.644830] EEH: PCI-E 10: 00420000 00000000 00000000 00000000 
> [156598.644831] EEH: PCI-E 20: 00000000 
> [156598.644831] EEH: PCI-E AER capability register set follows:
> [156598.644840] EEH: PCI-E AER 00: 14810001 00000000 00000000
> 00062030 
> [156598.644847] EEH: PCI-E AER 10: 00000000 00002000 000001ff
> 00000000 
> [156598.644853] EEH: PCI-E AER 20: 00000000 00000000 00000000
> 00000000 
> [156598.644856] EEH: PCI-E AER 30: 00000000 00000000 
> [156598.644857] PHB3 PHB#1 Diag-data (Version: 1)
> [156598.644858] brdgCtl:     00000002
> [156598.644860] RootSts:     0002004f 00400000 f0820008 00100147
> 00002800
> [156598.644861] RootErrSts:  00000000 00008000 00000000
> [156598.644862] PhbSts:      0000001c00000000 0000001c00000000
> [156598.644863] Lem:         0000000004000000 42498e327f502eae
> 0000000000000000
> [156598.644865] InAErr:      0000000000004000 0000000000004000
> 8000000060e00001 8400000000000001
> [156598.644866] PE[  1] A/B: 8200302500000000 8000000060e00000
> [156598.644869] EEH: Enable I/O for affected devices
> [156598.644884] EEH: Notify device drivers to resume I/O
> [156598.644886] EEH: Enabled DMA for affected devices
> [156598.644898] EEH: Notify device driver to resume
> [156599.227910] Plx8000_DMA: ...Completed message
> [156599.241749] PLX DMA[Dispatch_IoControl-1053]
> [156599.241802] PLX DMA[Dispatch_IoControl-1061]
> 
> 
> 
> 
> 
> --
> View this message in context: http://linuxppc.10917.n7.nabble.com/EEH
> -error-in-doing-DMA-with-PEX-8619-tp121121p121181.html
> Sent from the linuxppc-dev mailing list archive at Nabble.com.

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: EEH error in doing DMA with PEX 8619
  2017-04-11  9:35           ` Benjamin Herrenschmidt
@ 2017-04-12  1:39             ` IanJiang
  2017-04-12  1:50               ` Benjamin Herrenschmidt
  2017-04-12  8:42             ` IanJiang
  1 sibling, 1 reply; 11+ messages in thread
From: IanJiang @ 2017-04-12  1:39 UTC (permalink / raw)
  To: linuxppc-dev

On Tue, Apr 11, 2017 at 5:37 PM, Benjamin Herrenschmidt [via linuxppc]
<ml-node+s10917n121182h95@n7.nabble.com> wrote:

> Another possibility would be if the requests from the PLX have a 
> different initiator ID on the bus than the device you are setting up 
> the DMA for. 

Is there a way to check out the initiator ID in the driver? I'd like to make
sure of this.



--
View this message in context: http://linuxppc.10917.n7.nabble.com/EEH-error-in-doing-DMA-with-PEX-8619-tp121121p121224.html
Sent from the linuxppc-dev mailing list archive at Nabble.com.

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: EEH error in doing DMA with PEX 8619
  2017-04-12  1:39             ` IanJiang
@ 2017-04-12  1:50               ` Benjamin Herrenschmidt
  0 siblings, 0 replies; 11+ messages in thread
From: Benjamin Herrenschmidt @ 2017-04-12  1:50 UTC (permalink / raw)
  To: IanJiang, linuxppc-dev

On Tue, 2017-04-11 at 18:39 -0700, IanJiang wrote:
> On Tue, Apr 11, 2017 at 5:37 PM, Benjamin Herrenschmidt [via
> linuxppc]
> <ml-node+s10917n121182h95@n7.nabble.com> wrote:
> 
> > Another possibility would be if the requests from the PLX have a 
> > different initiator ID on the bus than the device you are setting
> > up 
> > the DMA for. 
> 
> Is there a way to check out the initiator ID in the driver? I'd like
> to make sure of this.

If you are running bare metal (ie, not under any hypervisor, aka
"powernv" platform), the EEH error log will contain a register dump. If
you paste that to us, we might be able to decode it, it will tell us
more data about the cause of the failure, including possibly the
initiator of the failing transaction.

The initiator ID (aka RID, aka bus/device/fn) of the DMA packets must
match the ones of the struct pci_dev you are using to establish the
mapping.

Cheers,
Ben.

> 
> --
> View this message in context: http://linuxppc.10917.n7.nabble.com/EEH
> -error-in-doing-DMA-with-PEX-8619-tp121121p121224.html
> Sent from the linuxppc-dev mailing list archive at Nabble.com.

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: EEH error in doing DMA with PEX 8619
  2017-04-11  9:35           ` Benjamin Herrenschmidt
  2017-04-12  1:39             ` IanJiang
@ 2017-04-12  8:42             ` IanJiang
  2017-04-12 13:53               ` Benjamin Herrenschmidt
  1 sibling, 1 reply; 11+ messages in thread
From: IanJiang @ 2017-04-12  8:42 UTC (permalink / raw)
  To: linuxppc-dev

[-- Attachment #1: Type: text/plain, Size: 2994 bytes --]

On Tue, Apr 11, 2017 at 5:37 PM, Benjamin Herrenschmidt [via linuxppc]
<ml-node+s10917n121182h95@n7.nabble.com> wrote:
>
> Another possibility would be if the requests from the PLX have a
> different initiator ID on the bus than the device you are setting up
> the DMA for.
>

Here is the problem, I think.
There are three PEX 8619 devices given in lspci, and there are
supported by two different modules:

[root@localhost PlxSdk]# lspci -nnn | grep 8619
0001:01:00.0 PCI bridge [0604]: PLX Technology, Inc. PEX 8619 16-lane,
16-Port PCI Express Gen 2 (5.0 GT/s) Switch with DMA [10b5:8619] (rev
ba)
0001:01:00.1 System peripheral [0880]: PLX Technology, Inc. PEX 8619
16-lane, 16-Port PCI Express Gen 2 (5.0 GT/s) Switch with DMA
[10b5:8619] (rev ba)
0001:02:01.0 Bridge [0680]: PLX Technology, Inc. PEX 8619 16-lane,
16-Port PCI Express Gen 2 (5.0 GT/s) Switch with DMA [10b5:8619] (rev
ba)

[root@localhost PlxSdk]# lsmod | grep 8000
Plx8000_DMA            69021  0
Plx8000_NT             73848  0


[root@localhost ~]# dmesg | grep Probe
[ 1875.493576] Plx8000_NT: Probe: 8619 10B5 [D1 01:00.1]
[ 1875.493584] Plx8000_NT: Probe: -- Unsupported Device --
...
[ 1875.493867] Plx8000_NT: Probe: 8619 10B5 [D1 02:01.0]
[ 1876.973489] Plx8000_DMA: Probe: 8619 10B5 [D1 01:00.1]

In my test, DMA buffers are allocated with  (bus 2, device 1, function
0) in module Plx8000_NT, but DMA is issued by (bus 1 device 0 function
1) in module Plx8000_DMA. And error of (bus 1 device 0 function 1) is
reported by EEH.


[ 1908.426579] Plx8000_DMA: Ch 0 - DMA 00000000_60600000 -->
00000000_60800000 (65536 bytes)

[root@localhost ~]# dmesg | grep Bus\ Phy
[ 1875.495524] Plx8000_NT:     Bus Phys Addr: 605f0000
[ 1878.096744] Plx8000_DMA:     Bus Phys Addr: 60010000
[ 1892.745698] Plx8000_NT:     Bus Phys Addr: 60600000
[ 1892.746348] Plx8000_NT:     Bus Phys Addr: 60800000


[root@localhost ~]# dmesg | grep bus
[ 1875.495463] Debug Plx_dma_buffer_alloc: bus 2, device 1, function 0
[ 1876.973699] Debug AddDevice: Device bus 1 device 0 function 1
[ 1876.975155] Debug AddDevice: Device bus 1 device 0 function 1
[ 1876.976641] Debug AddDevice: Device bus 1 device 0 function 2
[ 1877.360606] Debug AddDevice: Device bus 1 device 0 function 3
[ 1877.763869] Debug AddDevice: Device bus 1 device 0 function 4
[ 1878.069865] Debug Plx_dma_buffer_alloc: bus 1, device 0, function 1
[ 1892.745446] Debug Plx_dma_buffer_alloc: bus 2, device 1, function 0
[ 1892.746109] Debug Plx_dma_buffer_alloc: bus 2, device 1, function 0
[ 1908.426649] Debug PlxDmaTransferBlock: DMA device bus 1 device 0 function 1
[ 1908.428483] Debug plx_err_detected: Device bus 1 device 0 function 1
[ 1917.490481] Debug plx_slot_reset: Device bus 1 device 0 function 1
[ 1917.490625] Debug plx_resume: Device bus 1 device 0 function 1




--
View this message in context: http://linuxppc.10917.n7.nabble.com/EEH-error-in-doing-DMA-with-PEX-8619-tp121121p121259.html
Sent from the linuxppc-dev mailing list archive at Nabble.com.

[-- Attachment #2: Type: text/html, Size: 3702 bytes --]

^ permalink raw reply	[flat|nested] 11+ messages in thread

* Re: EEH error in doing DMA with PEX 8619
  2017-04-12  8:42             ` IanJiang
@ 2017-04-12 13:53               ` Benjamin Herrenschmidt
  0 siblings, 0 replies; 11+ messages in thread
From: Benjamin Herrenschmidt @ 2017-04-12 13:53 UTC (permalink / raw)
  To: IanJiang, linuxppc-dev

On Wed, 2017-04-12 at 01:42 -0700, IanJiang wrote:
> 
> In my test, DMA buffers are allocated with  (bus 2, device 1, function 
> 0) in module Plx8000_NT, but DMA is issued by (bus 1 device 0 function 
> 1) in module Plx8000_DMA. And error of (bus 1 device 0 function 1) is 
> reported by EEH. 

This is going to break on other systems too. If you enable strict iommu
on x86 for example.

You need to ensure that DMA are allocated for the same requester ID
that will be performing the transactions.

Cheers,
Ben.

^ permalink raw reply	[flat|nested] 11+ messages in thread

end of thread, other threads:[~2017-04-12 13:53 UTC | newest]

Thread overview: 11+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2017-04-10 12:22 EEH error in doing DMA with PEX 8619 IanJiang
2017-04-10 22:24 ` Gavin Shan
2017-04-11  2:04   ` IanJiang
2017-04-11  2:15     ` Benjamin Herrenschmidt
2017-04-11  4:42       ` Gavin Shan
2017-04-11  9:26         ` IanJiang
2017-04-11  9:35           ` Benjamin Herrenschmidt
2017-04-12  1:39             ` IanJiang
2017-04-12  1:50               ` Benjamin Herrenschmidt
2017-04-12  8:42             ` IanJiang
2017-04-12 13:53               ` Benjamin Herrenschmidt

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.