All of lore.kernel.org
 help / color / mirror / Atom feed
* Problem: 82574L device (e1000e driver): Reset adapter unexpectedly / transmit queue 0 timed out
@ 2014-07-21  3:00 Andrew Cooks
  2014-07-21 15:22 ` [linux-nics] " Fujinaka, Todd
  0 siblings, 1 reply; 7+ messages in thread
From: Andrew Cooks @ 2014-07-21  3:00 UTC (permalink / raw)
  To: netdev
  Cc: Bruce Allan, Linux NICS, e1000-devel, Dmitry Lifshitz, Igor Grinberg

Hi

The 82574L device, using the e1000e driver, is unstable on the
fit-MultiLAN (aka CompuLab MultiLAN)[1] that I'm using and I need some
help to understand what's causing it.

The fit-MultiLAN has four 82574L devices[2]. On two different
occasions I've seen a (different) device drop into an unusable state,
while the rest of the 82574L devices continue to function normally.
I'm not sure how to describe the state exactly, but it's as if the
adapter can no longer detect a link and disconnecting/reconnecting the
cable doesn't recover it.

I don't think there is any transition to/from a lower power state
involved, because this happens while the device is in use (shunting
packets), but I'm not sure how to rule it out either.

I can get the device working again without a power cycle, by doing the
following (though I admit I'm not sure whether each of these is really
needed):
# echo 1 > /sys/bus/pci/devices/0000\:01\:00.0/remove
# echo 1 > /sys/bus/pci/rescan
# echo 1 > /sys/bus/pci/drivers_autoprobe
# echo 1 > /sys/bus/pci/devices/0000\:01\:00.0/reset

This problem occurs with versions 3.15.0 and 3.16.0-rc5. I haven't
tested older versions in the current configuration.

Hopefully the information below will help pin it down.

Kernel log:
[18439.527157] ------------[ cut here ]------------
[18439.527177] WARNING: CPU: 0 PID: 0 at net/sched/sch_generic.c:264
dev_watchdog+0x266/0x270()
[18439.527182] NETDEV WATCHDOG: eth2 (e1000e): transmit queue 0 timed out
[18439.527185] Modules linked in: sch_cbq sch_netem nf_conntrack_ipv4
nf_defrag_ipv4 xt_conntrack nf_conntrack xt_LOG xt_comment xt_tcpudp
iptable_filter ip_tables x_tables nfnetlink_queue nfnetlink_log
nfnetlink arc4 rtl8723ae rtl_pci rtlwifi mac80211 cfg80211
rtl8723_common microcode sp5100_tco k10temp i2c_piix4 video
hid_generic usbhid hid r8169 mii firmware_class ohci_pci ohci_hcd
[18439.527231] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-rc5 #2
[18439.527235] Hardware name: CompuLab fit-PC3i/SBC fit-PC3i, BIOS
SBCFP3I_2.1.0.333_1 X64 11/26/2013
[18439.527238]  0000000000000009 ffff88014ec03db0 ffffffff8164c94d
ffff88014ec03df8
[18439.527244]  ffff88014ec03de8 ffffffff810479dd 0000000000000000
ffff880091aec000
[18439.527249]  0000000000000001 0000000000000000 ffff880091aec000
ffff88014ec03e48
[18439.527254] Call Trace:
[18439.527258]  <IRQ>  [<ffffffff8164c94d>] dump_stack+0x45/0x56
[18439.527271]  [<ffffffff810479dd>] warn_slowpath_common+0x7d/0xa0
[18439.527277]  [<ffffffff81047a4c>] warn_slowpath_fmt+0x4c/0x50
[18439.527283]  [<ffffffff8156c276>] dev_watchdog+0x266/0x270
[18439.527288]  [<ffffffff8156c010>] ? dev_graft_qdisc+0x80/0x80
[18439.527294]  [<ffffffff81053c86>] call_timer_fn+0x36/0x100
[18439.527298]  [<ffffffff8156c010>] ? dev_graft_qdisc+0x80/0x80
[18439.527303]  [<ffffffff81053f4c>] run_timer_softirq+0x1fc/0x2e0
[18439.527309]  [<ffffffff8104c97d>] __do_softirq+0xed/0x2d0
[18439.527315]  [<ffffffff8104cdcd>] irq_exit+0xcd/0xe0
[18439.527320]  [<ffffffff81655695>] smp_apic_timer_interrupt+0x45/0x60
[18439.527325]  [<ffffffff81653cfa>] apic_timer_interrupt+0x6a/0x70
[18439.527328]  <EOI>  [<ffffffff8100cb9c>] ? default_idle+0x1c/0xb0
[18439.527339]  [<ffffffff810aab93>] ? rcu_eqs_enter+0x63/0x90
[18439.527344]  [<ffffffff8100d44f>] arch_cpu_idle+0xf/0x20
[18439.527350]  [<ffffffff8108da15>] cpu_startup_entry+0x355/0x420
[18439.527355]  [<ffffffff8164ecdd>] ? __schedule+0x30d/0x780
[18439.527361]  [<ffffffff8163fb77>] rest_init+0x77/0x80
[18439.527367]  [<ffffffff81cf9fd4>] start_kernel+0x435/0x442
[18439.527372]  [<ffffffff81cf99a6>] ? set_init_arg+0x53/0x53
[18439.527378]  [<ffffffff81cf95ad>] x86_64_start_reservations+0x2a/0x2c
[18439.527383]  [<ffffffff81cf96a0>] x86_64_start_kernel+0xf1/0xf4
[18439.527386] ---[ end trace e1cdd13e14fbe306 ]---
[18439.527405] e1000e 0000:01:00.0 eth2: Reset adapter unexpectedly
[18439.548497] br_v401: port 1(eth2_v401) entered disabled state
[18439.548616] br_v402: port 1(eth2_v402) entered disabled state
[18439.548703] br_v403: port 1(eth2_v403) entered disabled state
[18439.548776] br_v404: port 1(eth2_v404) entered disabled state
[18439.548849] br_v405: port 1(eth2_v405) entered disabled state
[18439.548929] br_v406: port 1(eth2_v406) entered disabled state
[18439.548997] br_v407: port 1(eth2_v407) entered disabled state
[18439.549067] br_v487: port 1(eth2_v487) entered disabled state
[18439.549144] br_v600: port 1(eth2_v600) entered disabled state
[18439.549216] br_v602: port 1(eth2_v602) entered disabled state
[18439.549284] br_v603: port 1(eth2_v603) entered disabled state
[18439.549362] br_v1010: port 1(eth2_v1010) entered disabled state
[18439.767733] e1000e 0000:01:00.0 eth2: Timesync Tx Control register
not set as expected


# lspci -vvnnk:
01:00.0 Ethernet controller [0200]: Intel Corporation 82574L Gigabit
Network Connection [8086:10d3]
        Subsystem: Intel Corporation Device [8086:0000]
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop-
ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR- INTx-
        Interrupt: pin A routed to IRQ 16
        Region 0: [virtual] Memory at c1900000 (32-bit,
non-prefetchable) [size=128K]
        Region 1: [virtual] Memory at c1800000 (32-bit,
non-prefetchable) [size=1M]
        Region 2: I/O ports at 7000 [size=32]
        Region 3: [virtual] Memory at c1920000 (32-bit,
non-prefetchable) [size=16K]
        [virtual] Expansion ROM at c1940000 [disabled] [size=256K]
        Capabilities: [c8] Power Management version 2
                Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
        Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
                Address: 0000000000000000  Data: 0000
        Capabilities: [e0] Express (v1) Endpoint, MSI 00
                DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s
<512ns, L1 <64us
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal-
Unsupported-
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr+ UncorrErr+ FatalErr- UnsuppReq+
AuxPwr+ TransPend-
                LnkCap: Port #1, Speed 2.5GT/s, Width x1, ASPM L0s L1,
Latency L0 <128ns, L1 <64us
                        ClockPM- Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train-
SlotClk+ DLActive- BWMgmt- ABWMgmt-
        Capabilities: [a0] MSI-X: Enable- Count=5 Masked-
                Vector table: BAR=3 offset=00000000
                PBA: BAR=3 offset=00002000
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt-
UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt-
UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt-
UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr+ BadTLP+ BadDLLP+ Rollover- Timeout- NonFatalErr+
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 14, GenCap- CGenEn- ChkCap- ChkEn-
        Capabilities: [140 v1] Device Serial Number 00-01-c0-ff-ff-12-8a-64
        Kernel driver in use: e1000e


# ethtool eth2
Settings for eth2:
Supported ports: [ TP ]
Supported link modes:   10baseT/Half 10baseT/Full
                       100baseT/Half 100baseT/Full
                       1000baseT/Full
Supported pause frame use: No
Supports auto-negotiation: Yes
Advertised link modes:  10baseT/Half 10baseT/Full
                       100baseT/Half 100baseT/Full
                       1000baseT/Full
Advertised pause frame use: No
Advertised auto-negotiation: Yes
Speed: Unknown!
Duplex: Unknown! (255)
Port: Twisted Pair
PHYAD: 1
Transceiver: internal
Auto-negotiation: on
MDI-X: Unknown (auto)
Supports Wake-on: pumbg
Wake-on: g
Current message level: 0x00000007 (7)
      drv probe link
Link detected: no


# ethtool -d eth2
MAC Registers
-------------
0x00000: CTRL (Device control register)  0xFFFFFFFF
      Endian mode (buffers):             big
      Link reset:                        reset
      Set link up:                       1
      Invert Loss-Of-Signal:             yes
      Receive flow control:              enabled
      Transmit flow control:             enabled
      VLAN mode:                         enabled
      Auto speed detect:                 enabled
      Speed select:                      not used
      Force speed:                       yes
      Force duplex:                      yes
0x00008: STATUS (Device status register) 0xFFFFFFFF
      Duplex:                            full
      Link up:                           link config
      TBI mode:                          enabled
      Link speed:                        not used
      Bus type:                          PCI-X
      Bus speed:                         133MHz
      Bus width:                         64-bit
0x00100: RCTL (Receive control register) 0xFFFFFFFF
      Receiver:                          enabled
      Store bad packets:                 enabled
      Unicast promiscuous:               enabled
      Multicast promiscuous:             enabled
      Long packet:                       enabled
      Descriptor minimum threshold size: reserved
      Broadcast accept mode:             accept
      VLAN filter:                       enabled
      Canonical form indicator:          enabled
      Discard pause frames:              ignored
      Pass MAC control frames:           pass
      Receive buffer size:               4096
0x02808: RDLEN (Receive desc length)     0xFFFFFFFF
0x02810: RDH   (Receive desc head)       0xFFFFFFFF
0x02818: RDT   (Receive desc tail)       0xFFFFFFFF
0x02820: RDTR  (Receive delay timer)     0xFFFFFFFF
0x00400: TCTL (Transmit ctrl register)   0xFFFFFFFF
      Transmitter:                       enabled
      Pad short packets:                 enabled
      Software XOFF Transmission:        enabled
      Re-transmit on late collision:     enabled
0x03808: TDLEN (Transmit desc length)    0xFFFFFFFF
0x03810: TDH   (Transmit desc head)      0xFFFFFFFF
0x03818: TDT   (Transmit desc tail)      0xFFFFFFFF
0x03820: TIDV  (Transmit delay timer)    0xFFFFFFFF
PHY type:                                unknown


# ethtool -t eth2

The test result is FAIL
The test extra info:
Register test  (offline) 40
Eeprom test    (offline) 2
Interrupt test (offline) 4
Loopback test  (offline) 0
Link test   (on/offline) 0

References:
1. http://www.fit-pc.com/web/solutions/multilan/
2. http://fit-pc.com/download/face-modules/documents/face-modules-hw-specifications.pdf
(FM-XTDE4U2/4 FACE Module, p36)

Any suggestions of help to pin down the problem would be much appreciated.

Thanks.

a.

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [linux-nics] Problem: 82574L device (e1000e driver): Reset adapter unexpectedly / transmit queue 0 timed out
  2014-07-21  3:00 Problem: 82574L device (e1000e driver): Reset adapter unexpectedly / transmit queue 0 timed out Andrew Cooks
@ 2014-07-21 15:22 ` Fujinaka, Todd
  2014-07-22  1:58   ` Andrew Cooks
  0 siblings, 1 reply; 7+ messages in thread
From: Fujinaka, Todd @ 2014-07-21 15:22 UTC (permalink / raw)
  To: Andrew Cooks, netdev
  Cc: Dmitry Lifshitz, e1000-devel, Grinberg, Igor, Linux NICS

Need more -v's in the lspci. Also, what is the OS, kernel version, and driver version?

Todd Fujinaka
Software Application Engineer
Networking Division (ND)
Intel Corporation
todd.fujinaka@intel.com
(503) 712-4565

-----Original Message-----
From: linux-nics-bounces@isotope.jf.intel.com [mailto:linux-nics-bounces@isotope.jf.intel.com] On Behalf Of Andrew Cooks
Sent: Sunday, July 20, 2014 8:01 PM
To: netdev
Cc: Dmitry Lifshitz; Linux NICS; Igor@isotope.jf.intel.com; e1000-devel@lists.sf.net; Grinberg
Subject: [linux-nics] Problem: 82574L device (e1000e driver): Reset adapter unexpectedly / transmit queue 0 timed out

Hi

The 82574L device, using the e1000e driver, is unstable on the fit-MultiLAN (aka CompuLab MultiLAN)[1] that I'm using and I need some help to understand what's causing it.

The fit-MultiLAN has four 82574L devices[2]. On two different occasions I've seen a (different) device drop into an unusable state, while the rest of the 82574L devices continue to function normally.
I'm not sure how to describe the state exactly, but it's as if the adapter can no longer detect a link and disconnecting/reconnecting the cable doesn't recover it.

I don't think there is any transition to/from a lower power state involved, because this happens while the device is in use (shunting packets), but I'm not sure how to rule it out either.

I can get the device working again without a power cycle, by doing the following (though I admit I'm not sure whether each of these is really
needed):
# echo 1 > /sys/bus/pci/devices/0000\:01\:00.0/remove
# echo 1 > /sys/bus/pci/rescan
# echo 1 > /sys/bus/pci/drivers_autoprobe # echo 1 > /sys/bus/pci/devices/0000\:01\:00.0/reset

This problem occurs with versions 3.15.0 and 3.16.0-rc5. I haven't tested older versions in the current configuration.

Hopefully the information below will help pin it down.

Kernel log:
[18439.527157] ------------[ cut here ]------------ [18439.527177] WARNING: CPU: 0 PID: 0 at net/sched/sch_generic.c:264
dev_watchdog+0x266/0x270()
[18439.527182] NETDEV WATCHDOG: eth2 (e1000e): transmit queue 0 timed out [18439.527185] Modules linked in: sch_cbq sch_netem nf_conntrack_ipv4
nf_defrag_ipv4 xt_conntrack nf_conntrack xt_LOG xt_comment xt_tcpudp iptable_filter ip_tables x_tables nfnetlink_queue nfnetlink_log nfnetlink arc4 rtl8723ae rtl_pci rtlwifi mac80211 cfg80211 rtl8723_common microcode sp5100_tco k10temp i2c_piix4 video hid_generic usbhid hid r8169 mii firmware_class ohci_pci ohci_hcd [18439.527231] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-rc5 #2 [18439.527235] Hardware name: CompuLab fit-PC3i/SBC fit-PC3i, BIOS
SBCFP3I_2.1.0.333_1 X64 11/26/2013
[18439.527238]  0000000000000009 ffff88014ec03db0 ffffffff8164c94d
ffff88014ec03df8
[18439.527244]  ffff88014ec03de8 ffffffff810479dd 0000000000000000
ffff880091aec000
[18439.527249]  0000000000000001 0000000000000000 ffff880091aec000
ffff88014ec03e48
[18439.527254] Call Trace:
[18439.527258]  <IRQ>  [<ffffffff8164c94d>] dump_stack+0x45/0x56 [18439.527271]  [<ffffffff810479dd>] warn_slowpath_common+0x7d/0xa0 [18439.527277]  [<ffffffff81047a4c>] warn_slowpath_fmt+0x4c/0x50 [18439.527283]  [<ffffffff8156c276>] dev_watchdog+0x266/0x270 [18439.527288]  [<ffffffff8156c010>] ? dev_graft_qdisc+0x80/0x80 [18439.527294]  [<ffffffff81053c86>] call_timer_fn+0x36/0x100 [18439.527298]  [<ffffffff8156c010>] ? dev_graft_qdisc+0x80/0x80 [18439.527303]  [<ffffffff81053f4c>] run_timer_softirq+0x1fc/0x2e0 [18439.527309]  [<ffffffff8104c97d>] __do_softirq+0xed/0x2d0 [18439.527315]  [<ffffffff8104cdcd>] irq_exit+0xcd/0xe0 [18439.527320]  [<ffffffff81655695>] smp_apic_timer_interrupt+0x45/0x60
[18439.527325]  [<ffffffff81653cfa>] apic_timer_interrupt+0x6a/0x70 [18439.527328]  <EOI>  [<ffffffff8100cb9c>] ? default_idle+0x1c/0xb0 [18439.527339]  [<ffffffff810aab93>] ? rcu_eqs_enter+0x63/0x90 [18439.527344]  [<ffffffff8100d44f>] arch_cpu_idle+0xf/0x20 [18439.527350]  [<ffffffff8108da15>] cpu_startup_entry+0x355/0x420 [18439.527355]  [<ffffffff8164ecdd>] ? __schedule+0x30d/0x780 [18439.527361]  [<ffffffff8163fb77>] rest_init+0x77/0x80 [18439.527367]  [<ffffffff81cf9fd4>] start_kernel+0x435/0x442 [18439.527372]  [<ffffffff81cf99a6>] ? set_init_arg+0x53/0x53 [18439.527378]  [<ffffffff81cf95ad>] x86_64_start_reservations+0x2a/0x2c
[18439.527383]  [<ffffffff81cf96a0>] x86_64_start_kernel+0xf1/0xf4 [18439.527386] ---[ end trace e1cdd13e14fbe306 ]--- [18439.527405] e1000e 0000:01:00.0 eth2: Reset adapter unexpectedly [18439.548497] br_v401: port 1(eth2_v401) entered disabled state [18439.548616] br_v402: port 1(eth2_v402) entered disabled state [18439.548703] br_v403: port 1(eth2_v403) entered disabled state [18439.548776] br_v404: port 1(eth2_v404) entered disabled state [18439.548849] br_v405: port 1(eth2_v405) entered disabled state [18439.548929] br_v406: port 1(eth2_v406) entered disabled state [18439.548997] br_v407: port 1(eth2_v407) entered disabled state [18439.549067] br_v487: port 1(eth2_v487) entered disabled state [18439.549144] br_v600: port 1(eth2_v600) entered disabled state [18439.549216] br_v602: port
  1(eth2_v602) entered disabled state [18439.549284] br_v603: port 1(eth2_v603) entered disabled state [18439.549362] br_v1010: port 1(eth2_v1010) entered disabled state [18439.767733] e1000e 0000:01:00.0 eth2: Timesync Tx Control register not set as expected


# lspci -vvnnk:
01:00.0 Ethernet controller [0200]: Intel Corporation 82574L Gigabit Network Connection [8086:10d3]
        Subsystem: Intel Corporation Device [8086:0000]
        Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop-
ParErr- Stepping- SERR- FastB2B- DisINTx-
        Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort-
<TAbort- <MAbort- >SERR- <PERR- INTx-
        Interrupt: pin A routed to IRQ 16
        Region 0: [virtual] Memory at c1900000 (32-bit,
non-prefetchable) [size=128K]
        Region 1: [virtual] Memory at c1800000 (32-bit,
non-prefetchable) [size=1M]
        Region 2: I/O ports at 7000 [size=32]
        Region 3: [virtual] Memory at c1920000 (32-bit,
non-prefetchable) [size=16K]
        [virtual] Expansion ROM at c1940000 [disabled] [size=256K]
        Capabilities: [c8] Power Management version 2
                Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA
PME(D0+,D1-,D2-,D3hot+,D3cold+)
                Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
        Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
                Address: 0000000000000000  Data: 0000
        Capabilities: [e0] Express (v1) Endpoint, MSI 00
                DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
                        ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
                DevCtl: Report errors: Correctable- Non-Fatal- Fatal-
Unsupported-
                        RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
                        MaxPayload 128 bytes, MaxReadReq 512 bytes
                DevSta: CorrErr+ UncorrErr+ FatalErr- UnsuppReq+
AuxPwr+ TransPend-
                LnkCap: Port #1, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <128ns, L1 <64us
                        ClockPM- Surprise- LLActRep- BwNot-
                LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
                        ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
                LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train-
SlotClk+ DLActive- BWMgmt- ABWMgmt-
        Capabilities: [a0] MSI-X: Enable- Count=5 Masked-
                Vector table: BAR=3 offset=00000000
                PBA: BAR=3 offset=00002000
        Capabilities: [100 v1] Advanced Error Reporting
                UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt-
UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
                UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt-
UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
                UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt-
UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
                CESta:  RxErr+ BadTLP+ BadDLLP+ Rollover- Timeout- NonFatalErr+
                CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
                AERCap: First Error Pointer: 14, GenCap- CGenEn- ChkCap- ChkEn-
        Capabilities: [140 v1] Device Serial Number 00-01-c0-ff-ff-12-8a-64
        Kernel driver in use: e1000e


# ethtool eth2
Settings for eth2:
Supported ports: [ TP ]
Supported link modes:   10baseT/Half 10baseT/Full
                       100baseT/Half 100baseT/Full
                       1000baseT/Full
Supported pause frame use: No
Supports auto-negotiation: Yes
Advertised link modes:  10baseT/Half 10baseT/Full
                       100baseT/Half 100baseT/Full
                       1000baseT/Full
Advertised pause frame use: No
Advertised auto-negotiation: Yes
Speed: Unknown!
Duplex: Unknown! (255)
Port: Twisted Pair
PHYAD: 1
Transceiver: internal
Auto-negotiation: on
MDI-X: Unknown (auto)
Supports Wake-on: pumbg
Wake-on: g
Current message level: 0x00000007 (7)
      drv probe link
Link detected: no


# ethtool -d eth2
MAC Registers
-------------
0x00000: CTRL (Device control register)  0xFFFFFFFF
      Endian mode (buffers):             big
      Link reset:                        reset
      Set link up:                       1
      Invert Loss-Of-Signal:             yes
      Receive flow control:              enabled
      Transmit flow control:             enabled
      VLAN mode:                         enabled
      Auto speed detect:                 enabled
      Speed select:                      not used
      Force speed:                       yes
      Force duplex:                      yes
0x00008: STATUS (Device status register) 0xFFFFFFFF
      Duplex:                            full
      Link up:                           link config
      TBI mode:                          enabled
      Link speed:                        not used
      Bus type:                          PCI-X
      Bus speed:                         133MHz
      Bus width:                         64-bit
0x00100: RCTL (Receive control register) 0xFFFFFFFF
      Receiver:                          enabled
      Store bad packets:                 enabled
      Unicast promiscuous:               enabled
      Multicast promiscuous:             enabled
      Long packet:                       enabled
      Descriptor minimum threshold size: reserved
      Broadcast accept mode:             accept
      VLAN filter:                       enabled
      Canonical form indicator:          enabled
      Discard pause frames:              ignored
      Pass MAC control frames:           pass
      Receive buffer size:               4096
0x02808: RDLEN (Receive desc length)     0xFFFFFFFF
0x02810: RDH   (Receive desc head)       0xFFFFFFFF
0x02818: RDT   (Receive desc tail)       0xFFFFFFFF
0x02820: RDTR  (Receive delay timer)     0xFFFFFFFF
0x00400: TCTL (Transmit ctrl register)   0xFFFFFFFF
      Transmitter:                       enabled
      Pad short packets:                 enabled
      Software XOFF Transmission:        enabled
      Re-transmit on late collision:     enabled
0x03808: TDLEN (Transmit desc length)    0xFFFFFFFF
0x03810: TDH   (Transmit desc head)      0xFFFFFFFF
0x03818: TDT   (Transmit desc tail)      0xFFFFFFFF
0x03820: TIDV  (Transmit delay timer)    0xFFFFFFFF
PHY type:                                unknown


# ethtool -t eth2

The test result is FAIL
The test extra info:
Register test  (offline) 40
Eeprom test    (offline) 2
Interrupt test (offline) 4
Loopback test  (offline) 0
Link test   (on/offline) 0

References:
1. http://www.fit-pc.com/web/solutions/multilan/
2. http://fit-pc.com/download/face-modules/documents/face-modules-hw-specifications.pdf
(FM-XTDE4U2/4 FACE Module, p36)

Any suggestions of help to pin down the problem would be much appreciated.

Thanks.

a.
_______________________________________________
Linux-nics mailing list
Linux-nics@intel.com

------------------------------------------------------------------------------
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel&#174; Ethernet, visit http://communities.intel.com/community/wired

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [linux-nics] Problem: 82574L device (e1000e driver): Reset adapter unexpectedly / transmit queue 0 timed out
  2014-07-21 15:22 ` [linux-nics] " Fujinaka, Todd
@ 2014-07-22  1:58   ` Andrew Cooks
  2014-07-22  2:05     ` Andrew Cooks
  0 siblings, 1 reply; 7+ messages in thread
From: Andrew Cooks @ 2014-07-22  1:58 UTC (permalink / raw)
  To: Fujinaka, Todd
  Cc: netdev, Dmitry Lifshitz, Linux NICS, Igor, e1000-devel, Grinberg

Hi

I think the common mailing list etiquette is to reply below, so I've
moved the reply and mine follows below.

On Mon, Jul 21, 2014 at 11:22 PM, Fujinaka, Todd
<todd.fujinaka@intel.com> wrote:
>> -----Original Message-----
>> From: linux-nics-bounces@isotope.jf.intel.com [mailto:linux-nics-bounces@isotope.jf.intel.com] On Behalf Of Andrew Cooks
>> Sent: Sunday, July 20, 2014 8:01 PM
>> To: netdev
>> Cc: Dmitry Lifshitz; Linux NICS; Igor@isotope.jf.intel.com; e1000-devel@lists.sf.net; Grinberg
>> Subject: [linux-nics] Problem: 82574L device (e1000e driver): Reset adapter unexpectedly / transmit queue 0 timed out
>>
>> Hi
>>
>> The 82574L device, using the e1000e driver, is unstable on the fit-MultiLAN (aka CompuLab MultiLAN)[1] that I'm using and I need some help to understand what's causing it.
>>
>> The fit-MultiLAN has four 82574L devices[2]. On two different occasions I've seen a (different) device drop into an unusable state, while the rest of the 82574L devices continue to function normally.
>> I'm not sure how to describe the state exactly, but it's as if the adapter can no longer detect a link and disconnecting/reconnecting the cable doesn't recover it.
>>
>> I don't think there is any transition to/from a lower power state involved, because this happens while the device is in use (shunting packets), but I'm not sure how to rule it out either.
>>
>> I can get the device working again without a power cycle, by doing the following (though I admit I'm not sure whether each of these is really needed):
>> # echo 1 > /sys/bus/pci/devices/0000\:01\:00.0/remove
>> # echo 1 > /sys/bus/pci/rescan
>> # echo 1 > /sys/bus/pci/drivers_autoprobe # echo 1 > /sys/bus/pci/devices/0000\:01\:00.0/reset
>>
>> This problem occurs with versions 3.15.0 and 3.16.0-rc5. I haven't tested older versions in the current configuration.
>>
>> Hopefully the information below will help pin it down.
>>
>> Kernel log:
>> [18439.527157] ------------[ cut here ]------------ [18439.527177] WARNING: CPU: 0 PID: 0 at net/sched/sch_generic.c:264 dev_watchdog+0x266/0x270()
>> [18439.527182] NETDEV WATCHDOG: eth2 (e1000e): transmit queue 0 timed out
>> [18439.527185] Modules linked in: sch_cbq sch_netem nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack xt_LOG xt_comment xt_tcpudp iptable_filter ip_tables x_tables nfnetlink_queue nfnetlink_log nfnetlink arc4 rtl8723ae rtl_pci rtlwifi mac80211 cfg80211 rtl8723_common microcode sp5100_tco k10temp i2c_piix4 video hid_generic usbhid hid r8169 mii firmware_class ohci_pci ohci_hcd
>> [18439.527231] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-rc5 #2
>> [18439.527235] Hardware name: CompuLab fit-PC3i/SBC fit-PC3i, BIOS SBCFP3I_2.1.0.333_1 X64 11/26/2013
>> [18439.527238]  0000000000000009 ffff88014ec03db0 ffffffff8164c94d ffff88014ec03df8
>> [18439.527244]  ffff88014ec03de8 ffffffff810479dd 0000000000000000 ffff880091aec000
>> [18439.527249]  0000000000000001 0000000000000000 ffff880091aec000 ffff88014ec03e48
>> [18439.527254] Call Trace:
>> [18439.527258]  <IRQ>  [<ffffffff8164c94d>] dump_stack+0x45/0x56
>> [18439.527271]  [<ffffffff810479dd>] warn_slowpath_common+0x7d/0xa0
>> [18439.527277]  [<ffffffff81047a4c>] warn_slowpath_fmt+0x4c/0x50
>> [18439.527283]  [<ffffffff8156c276>] dev_watchdog+0x266/0x270
>> [18439.527288]  [<ffffffff8156c010>] ? dev_graft_qdisc+0x80/0x80
>> [18439.527294]  [<ffffffff81053c86>] call_timer_fn+0x36/0x100
>> [18439.527298]  [<ffffffff8156c010>] ? dev_graft_qdisc+0x80/0x80
>> [18439.527303]  [<ffffffff81053f4c>] run_timer_softirq+0x1fc/0x2e0
>> [18439.527309]  [<ffffffff8104c97d>] __do_softirq+0xed/0x2d0
>> [18439.527315]  [<ffffffff8104cdcd>] irq_exit+0xcd/0xe0
>> [18439.527320]  [<ffffffff81655695>] smp_apic_timer_interrupt+0x45/0x60
>> [18439.527325]  [<ffffffff81653cfa>] apic_timer_interrupt+0x6a/0x70
>> [18439.527328]  <EOI>  [<ffffffff8100cb9c>] ? default_idle+0x1c/0xb0
>> [18439.527339]  [<ffffffff810aab93>] ? rcu_eqs_enter+0x63/0x90
>> [18439.527344]  [<ffffffff8100d44f>] arch_cpu_idle+0xf/0x20
>> [18439.527350]  [<ffffffff8108da15>] cpu_startup_entry+0x355/0x420
>> [18439.527355]  [<ffffffff8164ecdd>] ? __schedule+0x30d/0x780
>> [18439.527361]  [<ffffffff8163fb77>] rest_init+0x77/0x80
>> [18439.527367]  [<ffffffff81cf9fd4>] start_kernel+0x435/0x442
>> [18439.527372]  [<ffffffff81cf99a6>] ? set_init_arg+0x53/0x53
>> [18439.527378]  [<ffffffff81cf95ad>] x86_64_start_reservations+0x2a/0x2c
>> [18439.527383]  [<ffffffff81cf96a0>] x86_64_start_kernel+0xf1/0xf4
>> [18439.527386] ---[ end trace e1cdd13e14fbe306 ]---
>> [18439.527405] e1000e 0000:01:00.0 eth2: Reset adapter unexpectedly
>> [18439.548497] br_v401: port 1(eth2_v401) entered disabled state
>> [18439.548616] br_v402: port 1(eth2_v402) entered disabled state
>> [18439.548703] br_v403: port 1(eth2_v403) entered disabled state
>> [18439.548776] br_v404: port 1(eth2_v404) entered disabled state
>> [18439.548849] br_v405: port 1(eth2_v405) entered disabled state
>> [18439.548929] br_v406: port 1(eth2_v406) entered disabled state
>> [18439.548997] br_v407: port 1(eth2_v407) entered disabled state
>> [18439.549067] br_v487: port 1(eth2_v487) entered disabled state
>> [18439.549144] br_v600: port 1(eth2_v600) entered disabled state
>> [18439.549216] br_v602: port 1(eth2_v602) entered disabled state
>> [18439.549284] br_v603: port 1(eth2_v603) entered disabled state
>> [18439.549362] br_v1010: port 1(eth2_v1010) entered disabled state
>> [18439.767733] e1000e 0000:01:00.0 eth2: Timesync Tx Control register not set as expected
>>
>>
>> # lspci -vvnnk:
>> 01:00.0 Ethernet controller [0200]: Intel Corporation 82574L Gigabit Network Connection [8086:10d3]
>>         Subsystem: Intel Corporation Device [8086:0000]
>>         Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
>>         Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
>>         Interrupt: pin A routed to IRQ 16
>>         Region 0: [virtual] Memory at c1900000 (32-bit, non-prefetchable) [size=128K]
>>         Region 1: [virtual] Memory at c1800000 (32-bit, non-prefetchable) [size=1M]
>>         Region 2: I/O ports at 7000 [size=32]
>>         Region 3: [virtual] Memory at c1920000 (32-bit, non-prefetchable) [size=16K]
>>         [virtual] Expansion ROM at c1940000 [disabled] [size=256K]
>>         Capabilities: [c8] Power Management version 2
>>                 Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
>>                 Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
>>         Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
>>                 Address: 0000000000000000  Data: 0000
>>         Capabilities: [e0] Express (v1) Endpoint, MSI 00
>>                 DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
>>                         ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
>>                 DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
>>                         RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
>>                         MaxPayload 128 bytes, MaxReadReq 512 bytes
>>                 DevSta: CorrErr+ UncorrErr+ FatalErr- UnsuppReq+ AuxPwr+ TransPend-
>>                 LnkCap: Port #1, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <128ns, L1 <64us
>>                         ClockPM- Surprise- LLActRep- BwNot-
>>                 LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
>>                         ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
>>                 LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
>>         Capabilities: [a0] MSI-X: Enable- Count=5 Masked-
>>                 Vector table: BAR=3 offset=00000000
>>                 PBA: BAR=3 offset=00002000
>>         Capabilities: [100 v1] Advanced Error Reporting
>>                 UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
>>                 UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
>>                 UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
>>                 CESta:  RxErr+ BadTLP+ BadDLLP+ Rollover- Timeout- NonFatalErr+
>>                 CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>>                 AERCap: First Error Pointer: 14, GenCap- CGenEn- ChkCap- ChkEn-
>>         Capabilities: [140 v1] Device Serial Number 00-01-c0-ff-ff-12-8a-64
>>         Kernel driver in use: e1000e
>>
>>
>> # ethtool eth2
>> Settings for eth2:
>> Supported ports: [ TP ]
>> Supported link modes:   10baseT/Half 10baseT/Full
>>                        100baseT/Half 100baseT/Full
>>                        1000baseT/Full
>> Supported pause frame use: No
>> Supports auto-negotiation: Yes
>> Advertised link modes:  10baseT/Half 10baseT/Full
>>                        100baseT/Half 100baseT/Full
>>                        1000baseT/Full
>> Advertised pause frame use: No
>> Advertised auto-negotiation: Yes
>> Speed: Unknown!
>> Duplex: Unknown! (255)
>> Port: Twisted Pair
>> PHYAD: 1
>> Transceiver: internal
>> Auto-negotiation: on
>> MDI-X: Unknown (auto)
>> Supports Wake-on: pumbg
>> Wake-on: g
>> Current message level: 0x00000007 (7)
>>       drv probe link
>> Link detected: no
>>
>>
>> # ethtool -d eth2
>> MAC Registers
>> -------------
>> 0x00000: CTRL (Device control register)  0xFFFFFFFF
>>       Endian mode (buffers):             big
>>       Link reset:                        reset
>>       Set link up:                       1
>>       Invert Loss-Of-Signal:             yes
>>       Receive flow control:              enabled
>>       Transmit flow control:             enabled
>>       VLAN mode:                         enabled
>>       Auto speed detect:                 enabled
>>       Speed select:                      not used
>>       Force speed:                       yes
>>       Force duplex:                      yes
>> 0x00008: STATUS (Device status register) 0xFFFFFFFF
>>       Duplex:                            full
>>       Link up:                           link config
>>       TBI mode:                          enabled
>>       Link speed:                        not used
>>       Bus type:                          PCI-X
>>       Bus speed:                         133MHz
>>       Bus width:                         64-bit
>> 0x00100: RCTL (Receive control register) 0xFFFFFFFF
>>       Receiver:                          enabled
>>       Store bad packets:                 enabled
>>       Unicast promiscuous:               enabled
>>       Multicast promiscuous:             enabled
>>       Long packet:                       enabled
>>       Descriptor minimum threshold size: reserved
>>       Broadcast accept mode:             accept
>>       VLAN filter:                       enabled
>>       Canonical form indicator:          enabled
>>       Discard pause frames:              ignored
>>       Pass MAC control frames:           pass
>>       Receive buffer size:               4096
>> 0x02808: RDLEN (Receive desc length)     0xFFFFFFFF
>> 0x02810: RDH   (Receive desc head)       0xFFFFFFFF
>> 0x02818: RDT   (Receive desc tail)       0xFFFFFFFF
>> 0x02820: RDTR  (Receive delay timer)     0xFFFFFFFF
>> 0x00400: TCTL (Transmit ctrl register)   0xFFFFFFFF
>>       Transmitter:                       enabled
>>       Pad short packets:                 enabled
>>       Software XOFF Transmission:        enabled
>>       Re-transmit on late collision:     enabled
>> 0x03808: TDLEN (Transmit desc length)    0xFFFFFFFF
>> 0x03810: TDH   (Transmit desc head)      0xFFFFFFFF
>> 0x03818: TDT   (Transmit desc tail)      0xFFFFFFFF
>> 0x03820: TIDV  (Transmit delay timer)    0xFFFFFFFF
>> PHY type:                                unknown
>>
>>
>> # ethtool -t eth2
>>
>> The test result is FAIL
>> The test extra info:
>> Register test  (offline) 40
>> Eeprom test    (offline) 2
>> Interrupt test (offline) 4
>> Loopback test  (offline) 0
>> Link test   (on/offline) 0
>>
>> References:
>> 1. http://www.fit-pc.com/web/solutions/multilan/
>> 2. http://fit-pc.com/download/face-modules/documents/face-modules-hw-specifications.pdf (FM-XTDE4U2/4 FACE Module, p36)
>>
>> Any suggestions of help to pin down the problem would be much appreciated.
>>
>> Thanks.
>>
>
> Need more -v's in the lspci. Also, what is the OS, kernel version, and driver version?
>
> Todd Fujinaka
> Software Application Engineer
> Networking Division (ND)
> Intel Corporation
> todd.fujinaka@intel.com
> (503) 712-4565
>


Thanks for the response, Todd.

Adding more -v's to lspci doesn't change the output for this device.

This is on Linux Mint 16, without NetworkManager. Are there any
particular packages that you think might be relevant?

The kernel versions I've tested are 3.15.0 and 3.16.0-rc5 from
kernel.org. Was that ambiguous in my previous message?

Driver version:
# ethtool -i eth2
driver: e1000e
version: 2.3.2-k
firmware-version: 2.1-3
bus-info: 0000:01:00.0
supports-statistics: yes
supports-test: yes
supports-eeprom-access: yes
supports-register-dump: yes
supports-priv-flags: no

Thanks,

a.

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [linux-nics] Problem: 82574L device (e1000e driver): Reset adapter unexpectedly / transmit queue 0 timed out
  2014-07-22  1:58   ` Andrew Cooks
@ 2014-07-22  2:05     ` Andrew Cooks
  2014-07-22 15:25       ` [E1000-devel] " Alexander Duyck
  0 siblings, 1 reply; 7+ messages in thread
From: Andrew Cooks @ 2014-07-22  2:05 UTC (permalink / raw)
  To: Fujinaka, Todd
  Cc: Dmitry Lifshitz, netdev, e1000-devel, Igor Grinberg, Linux NICS

Resending to fix the broken CC list. Sorry about that.

On Tue, Jul 22, 2014 at 9:58 AM, Andrew Cooks <acooks@gmail.com> wrote:
> Hi
>
> I think the common mailing list etiquette is to reply below, so I've
> moved the reply and mine follows below.
>
> On Mon, Jul 21, 2014 at 11:22 PM, Fujinaka, Todd
> <todd.fujinaka@intel.com> wrote:
>>> -----Original Message-----
>>> From: linux-nics-bounces@isotope.jf.intel.com [mailto:linux-nics-bounces@isotope.jf.intel.com] On Behalf Of Andrew Cooks
>>> Sent: Sunday, July 20, 2014 8:01 PM
>>> To: netdev
>>> Cc: Dmitry Lifshitz; Linux NICS; Igor@isotope.jf.intel.com; e1000-devel@lists.sf.net; Grinberg
>>> Subject: [linux-nics] Problem: 82574L device (e1000e driver): Reset adapter unexpectedly / transmit queue 0 timed out
>>>
>>> Hi
>>>
>>> The 82574L device, using the e1000e driver, is unstable on the fit-MultiLAN (aka CompuLab MultiLAN)[1] that I'm using and I need some help to understand what's causing it.
>>>
>>> The fit-MultiLAN has four 82574L devices[2]. On two different occasions I've seen a (different) device drop into an unusable state, while the rest of the 82574L devices continue to function normally.
>>> I'm not sure how to describe the state exactly, but it's as if the adapter can no longer detect a link and disconnecting/reconnecting the cable doesn't recover it.
>>>
>>> I don't think there is any transition to/from a lower power state involved, because this happens while the device is in use (shunting packets), but I'm not sure how to rule it out either.
>>>
>>> I can get the device working again without a power cycle, by doing the following (though I admit I'm not sure whether each of these is really needed):
>>> # echo 1 > /sys/bus/pci/devices/0000\:01\:00.0/remove
>>> # echo 1 > /sys/bus/pci/rescan
>>> # echo 1 > /sys/bus/pci/drivers_autoprobe # echo 1 > /sys/bus/pci/devices/0000\:01\:00.0/reset
>>>
>>> This problem occurs with versions 3.15.0 and 3.16.0-rc5. I haven't tested older versions in the current configuration.
>>>
>>> Hopefully the information below will help pin it down.
>>>
>>> Kernel log:
>>> [18439.527157] ------------[ cut here ]------------ [18439.527177] WARNING: CPU: 0 PID: 0 at net/sched/sch_generic.c:264 dev_watchdog+0x266/0x270()
>>> [18439.527182] NETDEV WATCHDOG: eth2 (e1000e): transmit queue 0 timed out
>>> [18439.527185] Modules linked in: sch_cbq sch_netem nf_conntrack_ipv4 nf_defrag_ipv4 xt_conntrack nf_conntrack xt_LOG xt_comment xt_tcpudp iptable_filter ip_tables x_tables nfnetlink_queue nfnetlink_log nfnetlink arc4 rtl8723ae rtl_pci rtlwifi mac80211 cfg80211 rtl8723_common microcode sp5100_tco k10temp i2c_piix4 video hid_generic usbhid hid r8169 mii firmware_class ohci_pci ohci_hcd
>>> [18439.527231] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.16.0-rc5 #2
>>> [18439.527235] Hardware name: CompuLab fit-PC3i/SBC fit-PC3i, BIOS SBCFP3I_2.1.0.333_1 X64 11/26/2013
>>> [18439.527238]  0000000000000009 ffff88014ec03db0 ffffffff8164c94d ffff88014ec03df8
>>> [18439.527244]  ffff88014ec03de8 ffffffff810479dd 0000000000000000 ffff880091aec000
>>> [18439.527249]  0000000000000001 0000000000000000 ffff880091aec000 ffff88014ec03e48
>>> [18439.527254] Call Trace:
>>> [18439.527258]  <IRQ>  [<ffffffff8164c94d>] dump_stack+0x45/0x56
>>> [18439.527271]  [<ffffffff810479dd>] warn_slowpath_common+0x7d/0xa0
>>> [18439.527277]  [<ffffffff81047a4c>] warn_slowpath_fmt+0x4c/0x50
>>> [18439.527283]  [<ffffffff8156c276>] dev_watchdog+0x266/0x270
>>> [18439.527288]  [<ffffffff8156c010>] ? dev_graft_qdisc+0x80/0x80
>>> [18439.527294]  [<ffffffff81053c86>] call_timer_fn+0x36/0x100
>>> [18439.527298]  [<ffffffff8156c010>] ? dev_graft_qdisc+0x80/0x80
>>> [18439.527303]  [<ffffffff81053f4c>] run_timer_softirq+0x1fc/0x2e0
>>> [18439.527309]  [<ffffffff8104c97d>] __do_softirq+0xed/0x2d0
>>> [18439.527315]  [<ffffffff8104cdcd>] irq_exit+0xcd/0xe0
>>> [18439.527320]  [<ffffffff81655695>] smp_apic_timer_interrupt+0x45/0x60
>>> [18439.527325]  [<ffffffff81653cfa>] apic_timer_interrupt+0x6a/0x70
>>> [18439.527328]  <EOI>  [<ffffffff8100cb9c>] ? default_idle+0x1c/0xb0
>>> [18439.527339]  [<ffffffff810aab93>] ? rcu_eqs_enter+0x63/0x90
>>> [18439.527344]  [<ffffffff8100d44f>] arch_cpu_idle+0xf/0x20
>>> [18439.527350]  [<ffffffff8108da15>] cpu_startup_entry+0x355/0x420
>>> [18439.527355]  [<ffffffff8164ecdd>] ? __schedule+0x30d/0x780
>>> [18439.527361]  [<ffffffff8163fb77>] rest_init+0x77/0x80
>>> [18439.527367]  [<ffffffff81cf9fd4>] start_kernel+0x435/0x442
>>> [18439.527372]  [<ffffffff81cf99a6>] ? set_init_arg+0x53/0x53
>>> [18439.527378]  [<ffffffff81cf95ad>] x86_64_start_reservations+0x2a/0x2c
>>> [18439.527383]  [<ffffffff81cf96a0>] x86_64_start_kernel+0xf1/0xf4
>>> [18439.527386] ---[ end trace e1cdd13e14fbe306 ]---
>>> [18439.527405] e1000e 0000:01:00.0 eth2: Reset adapter unexpectedly
>>> [18439.548497] br_v401: port 1(eth2_v401) entered disabled state
>>> [18439.548616] br_v402: port 1(eth2_v402) entered disabled state
>>> [18439.548703] br_v403: port 1(eth2_v403) entered disabled state
>>> [18439.548776] br_v404: port 1(eth2_v404) entered disabled state
>>> [18439.548849] br_v405: port 1(eth2_v405) entered disabled state
>>> [18439.548929] br_v406: port 1(eth2_v406) entered disabled state
>>> [18439.548997] br_v407: port 1(eth2_v407) entered disabled state
>>> [18439.549067] br_v487: port 1(eth2_v487) entered disabled state
>>> [18439.549144] br_v600: port 1(eth2_v600) entered disabled state
>>> [18439.549216] br_v602: port 1(eth2_v602) entered disabled state
>>> [18439.549284] br_v603: port 1(eth2_v603) entered disabled state
>>> [18439.549362] br_v1010: port 1(eth2_v1010) entered disabled state
>>> [18439.767733] e1000e 0000:01:00.0 eth2: Timesync Tx Control register not set as expected
>>>
>>>
>>> # lspci -vvnnk:
>>> 01:00.0 Ethernet controller [0200]: Intel Corporation 82574L Gigabit Network Connection [8086:10d3]
>>>         Subsystem: Intel Corporation Device [8086:0000]
>>>         Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
>>>         Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
>>>         Interrupt: pin A routed to IRQ 16
>>>         Region 0: [virtual] Memory at c1900000 (32-bit, non-prefetchable) [size=128K]
>>>         Region 1: [virtual] Memory at c1800000 (32-bit, non-prefetchable) [size=1M]
>>>         Region 2: I/O ports at 7000 [size=32]
>>>         Region 3: [virtual] Memory at c1920000 (32-bit, non-prefetchable) [size=16K]
>>>         [virtual] Expansion ROM at c1940000 [disabled] [size=256K]
>>>         Capabilities: [c8] Power Management version 2
>>>                 Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
>>>                 Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
>>>         Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
>>>                 Address: 0000000000000000  Data: 0000
>>>         Capabilities: [e0] Express (v1) Endpoint, MSI 00
>>>                 DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
>>>                         ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
>>>                 DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
>>>                         RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
>>>                         MaxPayload 128 bytes, MaxReadReq 512 bytes
>>>                 DevSta: CorrErr+ UncorrErr+ FatalErr- UnsuppReq+ AuxPwr+ TransPend-
>>>                 LnkCap: Port #1, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <128ns, L1 <64us
>>>                         ClockPM- Surprise- LLActRep- BwNot-
>>>                 LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
>>>                         ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
>>>                 LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
>>>         Capabilities: [a0] MSI-X: Enable- Count=5 Masked-
>>>                 Vector table: BAR=3 offset=00000000
>>>                 PBA: BAR=3 offset=00002000
>>>         Capabilities: [100 v1] Advanced Error Reporting
>>>                 UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
>>>                 UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
>>>                 UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
>>>                 CESta:  RxErr+ BadTLP+ BadDLLP+ Rollover- Timeout- NonFatalErr+
>>>                 CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>>>                 AERCap: First Error Pointer: 14, GenCap- CGenEn- ChkCap- ChkEn-
>>>         Capabilities: [140 v1] Device Serial Number 00-01-c0-ff-ff-12-8a-64
>>>         Kernel driver in use: e1000e
>>>
>>>
>>> # ethtool eth2
>>> Settings for eth2:
>>> Supported ports: [ TP ]
>>> Supported link modes:   10baseT/Half 10baseT/Full
>>>                        100baseT/Half 100baseT/Full
>>>                        1000baseT/Full
>>> Supported pause frame use: No
>>> Supports auto-negotiation: Yes
>>> Advertised link modes:  10baseT/Half 10baseT/Full
>>>                        100baseT/Half 100baseT/Full
>>>                        1000baseT/Full
>>> Advertised pause frame use: No
>>> Advertised auto-negotiation: Yes
>>> Speed: Unknown!
>>> Duplex: Unknown! (255)
>>> Port: Twisted Pair
>>> PHYAD: 1
>>> Transceiver: internal
>>> Auto-negotiation: on
>>> MDI-X: Unknown (auto)
>>> Supports Wake-on: pumbg
>>> Wake-on: g
>>> Current message level: 0x00000007 (7)
>>>       drv probe link
>>> Link detected: no
>>>
>>>
>>> # ethtool -d eth2
>>> MAC Registers
>>> -------------
>>> 0x00000: CTRL (Device control register)  0xFFFFFFFF
>>>       Endian mode (buffers):             big
>>>       Link reset:                        reset
>>>       Set link up:                       1
>>>       Invert Loss-Of-Signal:             yes
>>>       Receive flow control:              enabled
>>>       Transmit flow control:             enabled
>>>       VLAN mode:                         enabled
>>>       Auto speed detect:                 enabled
>>>       Speed select:                      not used
>>>       Force speed:                       yes
>>>       Force duplex:                      yes
>>> 0x00008: STATUS (Device status register) 0xFFFFFFFF
>>>       Duplex:                            full
>>>       Link up:                           link config
>>>       TBI mode:                          enabled
>>>       Link speed:                        not used
>>>       Bus type:                          PCI-X
>>>       Bus speed:                         133MHz
>>>       Bus width:                         64-bit
>>> 0x00100: RCTL (Receive control register) 0xFFFFFFFF
>>>       Receiver:                          enabled
>>>       Store bad packets:                 enabled
>>>       Unicast promiscuous:               enabled
>>>       Multicast promiscuous:             enabled
>>>       Long packet:                       enabled
>>>       Descriptor minimum threshold size: reserved
>>>       Broadcast accept mode:             accept
>>>       VLAN filter:                       enabled
>>>       Canonical form indicator:          enabled
>>>       Discard pause frames:              ignored
>>>       Pass MAC control frames:           pass
>>>       Receive buffer size:               4096
>>> 0x02808: RDLEN (Receive desc length)     0xFFFFFFFF
>>> 0x02810: RDH   (Receive desc head)       0xFFFFFFFF
>>> 0x02818: RDT   (Receive desc tail)       0xFFFFFFFF
>>> 0x02820: RDTR  (Receive delay timer)     0xFFFFFFFF
>>> 0x00400: TCTL (Transmit ctrl register)   0xFFFFFFFF
>>>       Transmitter:                       enabled
>>>       Pad short packets:                 enabled
>>>       Software XOFF Transmission:        enabled
>>>       Re-transmit on late collision:     enabled
>>> 0x03808: TDLEN (Transmit desc length)    0xFFFFFFFF
>>> 0x03810: TDH   (Transmit desc head)      0xFFFFFFFF
>>> 0x03818: TDT   (Transmit desc tail)      0xFFFFFFFF
>>> 0x03820: TIDV  (Transmit delay timer)    0xFFFFFFFF
>>> PHY type:                                unknown
>>>
>>>
>>> # ethtool -t eth2
>>>
>>> The test result is FAIL
>>> The test extra info:
>>> Register test  (offline) 40
>>> Eeprom test    (offline) 2
>>> Interrupt test (offline) 4
>>> Loopback test  (offline) 0
>>> Link test   (on/offline) 0
>>>
>>> References:
>>> 1. http://www.fit-pc.com/web/solutions/multilan/
>>> 2. http://fit-pc.com/download/face-modules/documents/face-modules-hw-specifications.pdf (FM-XTDE4U2/4 FACE Module, p36)
>>>
>>> Any suggestions of help to pin down the problem would be much appreciated.
>>>
>>> Thanks.
>>>
>>
>> Need more -v's in the lspci. Also, what is the OS, kernel version, and driver version?
>>
>> Todd Fujinaka
>> Software Application Engineer
>> Networking Division (ND)
>> Intel Corporation
>> todd.fujinaka@intel.com
>> (503) 712-4565
>>
>
>
> Thanks for the response, Todd.
>
> Adding more -v's to lspci doesn't change the output for this device.
>
> This is on Linux Mint 16, without NetworkManager. Are there any
> particular packages that you think might be relevant?
>
> The kernel versions I've tested are 3.15.0 and 3.16.0-rc5 from
> kernel.org. Was that ambiguous in my previous message?
>
> Driver version:
> # ethtool -i eth2
> driver: e1000e
> version: 2.3.2-k
> firmware-version: 2.1-3
> bus-info: 0000:01:00.0
> supports-statistics: yes
> supports-test: yes
> supports-eeprom-access: yes
> supports-register-dump: yes
> supports-priv-flags: no
>
> Thanks,
>
> a.

------------------------------------------------------------------------------
Want fast and easy access to all the code in your enterprise? Index and
search up to 200,000 lines of code with a free copy of Black Duck
Code Sight - the same software that powers the world's largest code
search on Ohloh, the Black Duck Open Hub! Try it now.
http://p.sf.net/sfu/bds
_______________________________________________
E1000-devel mailing list
E1000-devel@lists.sourceforge.net
https://lists.sourceforge.net/lists/listinfo/e1000-devel
To learn more about Intel&#174; Ethernet, visit http://communities.intel.com/community/wired

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [E1000-devel] [linux-nics] Problem: 82574L device (e1000e driver): Reset adapter unexpectedly / transmit queue 0 timed out
  2014-07-22  2:05     ` Andrew Cooks
@ 2014-07-22 15:25       ` Alexander Duyck
  2014-07-23  4:59         ` Andrew Cooks
  0 siblings, 1 reply; 7+ messages in thread
From: Alexander Duyck @ 2014-07-22 15:25 UTC (permalink / raw)
  To: Andrew Cooks, Fujinaka, Todd
  Cc: Dmitry Lifshitz, netdev, e1000-devel, Igor Grinberg, Linux NICS

>>>> # lspci -vvnnk:
>>>> 01:00.0 Ethernet controller [0200]: Intel Corporation 82574L Gigabit Network Connection [8086:10d3]
>>>>         Subsystem: Intel Corporation Device [8086:0000]
>>>>         Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
>>>>         Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
>>>>         Interrupt: pin A routed to IRQ 16
>>>>         Region 0: [virtual] Memory at c1900000 (32-bit, non-prefetchable) [size=128K]
>>>>         Region 1: [virtual] Memory at c1800000 (32-bit, non-prefetchable) [size=1M]
>>>>         Region 2: I/O ports at 7000 [size=32]
>>>>         Region 3: [virtual] Memory at c1920000 (32-bit, non-prefetchable) [size=16K]
>>>>         [virtual] Expansion ROM at c1940000 [disabled] [size=256K]
>>>>         Capabilities: [c8] Power Management version 2
>>>>                 Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
>>>>                 Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
>>>>         Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
>>>>                 Address: 0000000000000000  Data: 0000
>>>>         Capabilities: [e0] Express (v1) Endpoint, MSI 00
>>>>                 DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
>>>>                         ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
>>>>                 DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
>>>>                         RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
>>>>                         MaxPayload 128 bytes, MaxReadReq 512 bytes
>>>>                 DevSta: CorrErr+ UncorrErr+ FatalErr- UnsuppReq+ AuxPwr+ TransPend-
>>>>                 LnkCap: Port #1, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <128ns, L1 <64us
>>>>                         ClockPM- Surprise- LLActRep- BwNot-
>>>>                 LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
>>>>                         ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
>>>>                 LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
>>>>         Capabilities: [a0] MSI-X: Enable- Count=5 Masked-
>>>>                 Vector table: BAR=3 offset=00000000
>>>>                 PBA: BAR=3 offset=00002000
>>>>         Capabilities: [100 v1] Advanced Error Reporting
>>>>                 UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
>>>>                 UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
>>>>                 UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
>>>>                 CESta:  RxErr+ BadTLP+ BadDLLP+ Rollover- Timeout- NonFatalErr+
>>>>                 CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>>>>                 AERCap: First Error Pointer: 14, GenCap- CGenEn- ChkCap- ChkEn-
>>>>         Capabilities: [140 v1] Device Serial Number 00-01-c0-ff-ff-12-8a-64
>>>>         Kernel driver in use: e1000e
>>>>
>>>>

It looks like something bad happened on the PCIe bus based on the RxErr,
BadTLP, BadDLLP, and NonFatalERR indicators all being set.  This could
be an indication of a possible problem with the PCIe link on the system.

>>>> # ethtool -d eth2
>>>> MAC Registers
>>>> -------------
>>>> 0x00000: CTRL (Device control register)  0xFFFFFFFF
>>>>       Endian mode (buffers):             big
>>>>       Link reset:                        reset
>>>>       Set link up:                       1
>>>>       Invert Loss-Of-Signal:             yes
>>>>       Receive flow control:              enabled
>>>>       Transmit flow control:             enabled
>>>>       VLAN mode:                         enabled
>>>>       Auto speed detect:                 enabled
>>>>       Speed select:                      not used
>>>>       Force speed:                       yes
>>>>       Force duplex:                      yes
>>>> 0x00008: STATUS (Device status register) 0xFFFFFFFF
>>>>       Duplex:                            full
>>>>       Link up:                           link config
>>>>       TBI mode:                          enabled
>>>>       Link speed:                        not used
>>>>       Bus type:                          PCI-X
>>>>       Bus speed:                         133MHz
>>>>       Bus width:                         64-bit
>>>> 0x00100: RCTL (Receive control register) 0xFFFFFFFF
>>>>       Receiver:                          enabled
>>>>       Store bad packets:                 enabled
>>>>       Unicast promiscuous:               enabled
>>>>       Multicast promiscuous:             enabled
>>>>       Long packet:                       enabled
>>>>       Descriptor minimum threshold size: reserved
>>>>       Broadcast accept mode:             accept
>>>>       VLAN filter:                       enabled
>>>>       Canonical form indicator:          enabled
>>>>       Discard pause frames:              ignored
>>>>       Pass MAC control frames:           pass
>>>>       Receive buffer size:               4096
>>>> 0x02808: RDLEN (Receive desc length)     0xFFFFFFFF
>>>> 0x02810: RDH   (Receive desc head)       0xFFFFFFFF
>>>> 0x02818: RDT   (Receive desc tail)       0xFFFFFFFF
>>>> 0x02820: RDTR  (Receive delay timer)     0xFFFFFFFF
>>>> 0x00400: TCTL (Transmit ctrl register)   0xFFFFFFFF
>>>>       Transmitter:                       enabled
>>>>       Pad short packets:                 enabled
>>>>       Software XOFF Transmission:        enabled
>>>>       Re-transmit on late collision:     enabled
>>>> 0x03808: TDLEN (Transmit desc length)    0xFFFFFFFF
>>>> 0x03810: TDH   (Transmit desc head)      0xFFFFFFFF
>>>> 0x03818: TDT   (Transmit desc tail)      0xFFFFFFFF
>>>> 0x03820: TIDV  (Transmit delay timer)    0xFFFFFFFF
>>>> PHY type:                                unknown
>>>>
>>>>

The device doesn't appear to be responding to MMIO reads based on the
fact that all of the registers are returning all 1's.

You should be able to recover from this error by issuing a PCIe device
reset request via the sysfs interface (echo 1 >
/sys/bus/pci/devices/0000\:01\:00.0/reset).  However that only resolves
the issue after it has occurred.

One thing that would probably be useful would be to provide an "lspci
-vvv" for the entire system.  That would at least give us an idea of the
PCIe hierarchy and could help to tell us if the problem is something in
the local PCIe hierarchy for the device, or if the problem is closer to
the root complex.

Thanks,

Alex

^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [E1000-devel] [linux-nics] Problem: 82574L device (e1000e driver): Reset adapter unexpectedly / transmit queue 0 timed out
  2014-07-22 15:25       ` [E1000-devel] " Alexander Duyck
@ 2014-07-23  4:59         ` Andrew Cooks
  2014-07-23 16:04           ` Alexander Duyck
  0 siblings, 1 reply; 7+ messages in thread
From: Andrew Cooks @ 2014-07-23  4:59 UTC (permalink / raw)
  To: Alexander Duyck
  Cc: Fujinaka, Todd, Dmitry Lifshitz, netdev, e1000-devel,
	Igor Grinberg, Linux NICS

[-- Attachment #1: Type: text/plain, Size: 10346 bytes --]

On Tue, Jul 22, 2014 at 11:25 PM, Alexander Duyck
<alexander.h.duyck@intel.com> wrote:
>>>>> # lspci -vvnnk:
>>>>> 01:00.0 Ethernet controller [0200]: Intel Corporation 82574L Gigabit Network Connection [8086:10d3]
>>>>>         Subsystem: Intel Corporation Device [8086:0000]
>>>>>         Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
>>>>>         Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
>>>>>         Interrupt: pin A routed to IRQ 16
>>>>>         Region 0: [virtual] Memory at c1900000 (32-bit, non-prefetchable) [size=128K]
>>>>>         Region 1: [virtual] Memory at c1800000 (32-bit, non-prefetchable) [size=1M]
>>>>>         Region 2: I/O ports at 7000 [size=32]
>>>>>         Region 3: [virtual] Memory at c1920000 (32-bit, non-prefetchable) [size=16K]
>>>>>         [virtual] Expansion ROM at c1940000 [disabled] [size=256K]
>>>>>         Capabilities: [c8] Power Management version 2
>>>>>                 Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
>>>>>                 Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
>>>>>         Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
>>>>>                 Address: 0000000000000000  Data: 0000
>>>>>         Capabilities: [e0] Express (v1) Endpoint, MSI 00
>>>>>                 DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
>>>>>                         ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
>>>>>                 DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
>>>>>                         RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
>>>>>                         MaxPayload 128 bytes, MaxReadReq 512 bytes
>>>>>                 DevSta: CorrErr+ UncorrErr+ FatalErr- UnsuppReq+ AuxPwr+ TransPend-
>>>>>                 LnkCap: Port #1, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <128ns, L1 <64us
>>>>>                         ClockPM- Surprise- LLActRep- BwNot-
>>>>>                 LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
>>>>>                         ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
>>>>>                 LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
>>>>>         Capabilities: [a0] MSI-X: Enable- Count=5 Masked-
>>>>>                 Vector table: BAR=3 offset=00000000
>>>>>                 PBA: BAR=3 offset=00002000
>>>>>         Capabilities: [100 v1] Advanced Error Reporting
>>>>>                 UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
>>>>>                 UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
>>>>>                 UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
>>>>>                 CESta:  RxErr+ BadTLP+ BadDLLP+ Rollover- Timeout- NonFatalErr+
>>>>>                 CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>>>>>                 AERCap: First Error Pointer: 14, GenCap- CGenEn- ChkCap- ChkEn-
>>>>>         Capabilities: [140 v1] Device Serial Number 00-01-c0-ff-ff-12-8a-64
>>>>>         Kernel driver in use: e1000e
>>>>>
>>>>>
>
> It looks like something bad happened on the PCIe bus based on the RxErr,
> BadTLP, BadDLLP, and NonFatalERR indicators all being set.  This could
> be an indication of a possible problem with the PCIe link on the system.

Thanks very much for explaining this. Is it correct to think that this
is likely to be a hardware problem?

>
>>>>> # ethtool -d eth2
>>>>> MAC Registers
>>>>> -------------
>>>>> 0x00000: CTRL (Device control register)  0xFFFFFFFF
>>>>>       Endian mode (buffers):             big
>>>>>       Link reset:                        reset
>>>>>       Set link up:                       1
>>>>>       Invert Loss-Of-Signal:             yes
>>>>>       Receive flow control:              enabled
>>>>>       Transmit flow control:             enabled
>>>>>       VLAN mode:                         enabled
>>>>>       Auto speed detect:                 enabled
>>>>>       Speed select:                      not used
>>>>>       Force speed:                       yes
>>>>>       Force duplex:                      yes
>>>>> 0x00008: STATUS (Device status register) 0xFFFFFFFF
>>>>>       Duplex:                            full
>>>>>       Link up:                           link config
>>>>>       TBI mode:                          enabled
>>>>>       Link speed:                        not used
>>>>>       Bus type:                          PCI-X
>>>>>       Bus speed:                         133MHz
>>>>>       Bus width:                         64-bit
>>>>> 0x00100: RCTL (Receive control register) 0xFFFFFFFF
>>>>>       Receiver:                          enabled
>>>>>       Store bad packets:                 enabled
>>>>>       Unicast promiscuous:               enabled
>>>>>       Multicast promiscuous:             enabled
>>>>>       Long packet:                       enabled
>>>>>       Descriptor minimum threshold size: reserved
>>>>>       Broadcast accept mode:             accept
>>>>>       VLAN filter:                       enabled
>>>>>       Canonical form indicator:          enabled
>>>>>       Discard pause frames:              ignored
>>>>>       Pass MAC control frames:           pass
>>>>>       Receive buffer size:               4096
>>>>> 0x02808: RDLEN (Receive desc length)     0xFFFFFFFF
>>>>> 0x02810: RDH   (Receive desc head)       0xFFFFFFFF
>>>>> 0x02818: RDT   (Receive desc tail)       0xFFFFFFFF
>>>>> 0x02820: RDTR  (Receive delay timer)     0xFFFFFFFF
>>>>> 0x00400: TCTL (Transmit ctrl register)   0xFFFFFFFF
>>>>>       Transmitter:                       enabled
>>>>>       Pad short packets:                 enabled
>>>>>       Software XOFF Transmission:        enabled
>>>>>       Re-transmit on late collision:     enabled
>>>>> 0x03808: TDLEN (Transmit desc length)    0xFFFFFFFF
>>>>> 0x03810: TDH   (Transmit desc head)      0xFFFFFFFF
>>>>> 0x03818: TDT   (Transmit desc tail)      0xFFFFFFFF
>>>>> 0x03820: TIDV  (Transmit delay timer)    0xFFFFFFFF
>>>>> PHY type:                                unknown
>>>>>
>>>>>
>
> The device doesn't appear to be responding to MMIO reads based on the
> fact that all of the registers are returning all 1's.

Yes, this was the output of ethtool when the device became
non-functional. I wasn't sure whether it would be useful.

> You should be able to recover from this error by issuing a PCIe device
> reset request via the sysfs interface (echo 1 >
> /sys/bus/pci/devices/0000\:01\:00.0/reset).  However that only resolves
> the issue after it has occurred.

Thanks.

> One thing that would probably be useful would be to provide an "lspci
> -vvv" for the entire system.  That would at least give us an idea of the
> PCIe hierarchy and could help to tell us if the problem is something in
> the local PCIe hierarchy for the device, or if the problem is closer to
> the root complex.

I've attached the complete lspci output, because it's quite large to
include inline. I hope that's ok. It shows some interesting
differences between device 01:00.0 (the one that error'ed) and the
other 82574L devices.

# lspci -tvvvnn
-[0000:00]-+-00.0  Advanced Micro Devices, Inc. [AMD] Family 14h
Processor Root Complex [1022:1510]
           +-01.0  Advanced Micro Devices, Inc. [AMD/ATI] Wrestler
[Radeon HD 6320] [1002:9806]
           +-01.1  Advanced Micro Devices, Inc. [AMD/ATI] Wrestler
HDMI Audio [1002:1314]
           +-04.0-[01]----00.0  Intel Corporation 82574L Gigabit
Network Connection [8086:10d3]
           +-05.0-[02]----00.0  Intel Corporation 82574L Gigabit
Network Connection [8086:10d3]
           +-06.0-[03]----00.0  Intel Corporation 82574L Gigabit
Network Connection [8086:10d3]
           +-07.0-[04]----00.0  Intel Corporation 82574L Gigabit
Network Connection [8086:10d3]
           +-11.0  Advanced Micro Devices, Inc. [AMD/ATI]
SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] [1002:4391]
           +-12.0  Advanced Micro Devices, Inc. [AMD/ATI]
SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
           +-12.2  Advanced Micro Devices, Inc. [AMD/ATI]
SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
           +-13.0  Advanced Micro Devices, Inc. [AMD/ATI]
SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
           +-13.2  Advanced Micro Devices, Inc. [AMD/ATI]
SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
           +-14.0  Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus
Controller [1002:4385]
           +-14.3  Advanced Micro Devices, Inc. [AMD/ATI]
SB7x0/SB8x0/SB9x0 LPC host controller [1002:439d]
           +-14.4-[05]--
           +-14.5  Advanced Micro Devices, Inc. [AMD/ATI]
SB7x0/SB8x0/SB9x0 USB OHCI2 Controller [1002:4399]
           +-15.0-[06-07]----00.0  Realtek Semiconductor Co., Ltd.
RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168]
           +-15.1-[08]----00.0  Realtek Semiconductor Co., Ltd.
RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168]
           +-15.2-[09]----00.0  Realtek Semiconductor Co., Ltd.
RTL8723AE PCIe Wireless Network Adapter [10ec:8723]
           +-16.0  Advanced Micro Devices, Inc. [AMD/ATI]
SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
           +-16.2  Advanced Micro Devices, Inc. [AMD/ATI]
SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
           +-18.0  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
Processor Function 0 [1022:1700]
           +-18.1  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
Processor Function 1 [1022:1701]
           +-18.2  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
Processor Function 2 [1022:1702]
           +-18.3  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
Processor Function 3 [1022:1703]
           +-18.4  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
Processor Function 4 [1022:1704]
           +-18.5  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
Processor Function 6 [1022:1718]
           +-18.6  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
Processor Function 5 [1022:1716]
           \-18.7  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
Processor Function 7 [1022:1719]


Thanks!

a.

[-- Attachment #2: lspci.txt --]
[-- Type: text/plain, Size: 55772 bytes --]

00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 14h Processor Root Complex [1022:1510]
	Subsystem: Advanced Micro Devices, Inc. [AMD] Family 14h Processor Root Complex [1022:1510]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64

00:01.0 VGA compatible controller [0300]: Advanced Micro Devices, Inc. [AMD/ATI] Wrestler [Radeon HD 6320] [1002:9806] (prog-if 00 [VGA controller])
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Wrestler [Radeon HD 6320] [1002:9806]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Interrupt: pin A routed to IRQ 11
	Region 0: Memory at b0000000 (32-bit, prefetchable) [size=256M]
	Region 1: I/O ports at 8000 [size=256]
	Region 2: Memory at c1a00000 (32-bit, non-prefetchable) [size=256K]
	Expansion ROM at <unassigned> [disabled]
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <4us, L1 unlimited
			ExtTag+ RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>

00:01.1 Audio device [0403]: Advanced Micro Devices, Inc. [AMD/ATI] Wrestler HDMI Audio [1002:1314]
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Wrestler HDMI Audio [1002:1314]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Interrupt: pin B routed to IRQ 11
	Region 0: Memory at c1a40000 (32-bit, non-prefetchable) [size=16K]
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Express (v2) Root Complex Integrated Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <4us, L1 unlimited
			ExtTag+ RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed unknown, Width x0, ASPM unknown, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; Disabled- Retrain- CommClk-
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed unknown, Width x0, TrErr- Train- SlotClk- DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis-
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>

00:04.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Family 14h Processor Root Port [1022:1512] (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Bus: primary=00, secondary=01, subordinate=01, sec-latency=0
	I/O behind bridge: 00007000-00007fff
	Memory behind bridge: c1800000-c19fffff
	Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Express (v2) Root Port (Slot+), MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag+ RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #1, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep+ BwNot+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt-
		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
			Slot #4, PowerLimit 75.000W; Interlock- NoCompl+
		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
			Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
			Changed: MRL- PresDet+ LinkState+
		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ ARIFwd-
		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis+, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
		Address: 00000000fee0300c  Data: 4171
	Capabilities: [b0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device [1022:1234]
	Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Kernel driver in use: pcieport

00:05.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Family 14h Processor Root Port [1022:1513] (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Bus: primary=00, secondary=02, subordinate=02, sec-latency=0
	I/O behind bridge: 00006000-00006fff
	Memory behind bridge: c1600000-c17fffff
	Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Express (v2) Root Port (Slot+), MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag+ RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #2, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep+ BwNot+
		LnkCtl:	ASPM L0s L1 Enabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt-
		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
			Slot #5, PowerLimit 75.000W; Interlock- NoCompl+
		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
			Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
			Changed: MRL- PresDet+ LinkState+
		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ ARIFwd-
		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis+, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
		Address: 00000000fee0300c  Data: 4181
	Capabilities: [b0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device [1022:1234]
	Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Kernel driver in use: pcieport

00:06.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Family 14h Processor Root Port [1022:1514] (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Bus: primary=00, secondary=03, subordinate=03, sec-latency=0
	I/O behind bridge: 00005000-00005fff
	Memory behind bridge: c1400000-c15fffff
	Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Express (v2) Root Port (Slot+), MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag+ RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #3, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep+ BwNot+
		LnkCtl:	ASPM L0s L1 Enabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt-
		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
			Slot #6, PowerLimit 75.000W; Interlock- NoCompl+
		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
			Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
			Changed: MRL- PresDet+ LinkState+
		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ ARIFwd-
		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis+, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
		Address: 00000000fee0300c  Data: 4191
	Capabilities: [b0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device [1022:1234]
	Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Kernel driver in use: pcieport

00:07.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD] Family 14h Processor Root Port [1022:1515] (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Bus: primary=00, secondary=04, subordinate=04, sec-latency=0
	I/O behind bridge: 00004000-00004fff
	Memory behind bridge: c1200000-c13fffff
	Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Express (v2) Root Port (Slot+), MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag+ RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #4, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep+ BwNot+
		LnkCtl:	ASPM L0s L1 Enabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt- ABWMgmt-
		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug- Surprise-
			Slot #7, PowerLimit 75.000W; Interlock- NoCompl+
		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
			Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
			Changed: MRL- PresDet+ LinkState+
		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ ARIFwd-
		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis+, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
		Address: 00000000fee0300c  Data: 41b1
	Capabilities: [b0] Subsystem: Advanced Micro Devices, Inc. [AMD] Device [1022:1234]
	Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Kernel driver in use: pcieport

00:11.0 SATA controller [0106]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] [1002:4391] (rev 40) (prog-if 01 [AHCI 1.0])
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] [1002:4391]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64
	Interrupt: pin A routed to IRQ 19
	Region 0: I/O ports at 8118 [size=8]
	Region 1: I/O ports at 8124 [size=4]
	Region 2: I/O ports at 8110 [size=8]
	Region 3: I/O ports at 8120 [size=4]
	Region 4: I/O ports at 8100 [size=16]
	Region 5: Memory at c1a48000 (32-bit, non-prefetchable) [size=1K]
	Capabilities: [70] SATA HBA v1.0 InCfgSpace
	Capabilities: [a4] PCI Advanced Features
		AFCap: TP+ FLR+
		AFCtrl: FLR-
		AFStatus: TP-
	Kernel driver in use: ahci

00:12.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397] (prog-if 10 [OHCI])
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64, Cache Line Size: 32 bytes
	Interrupt: pin A routed to IRQ 18
	Region 0: Memory at c1a47000 (32-bit, non-prefetchable) [size=4K]
	Kernel driver in use: ohci-pci

00:12.2 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396] (prog-if 20 [EHCI])
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64, Cache Line Size: 32 bytes
	Interrupt: pin B routed to IRQ 17
	Region 0: Memory at c1a48600 (32-bit, non-prefetchable) [size=256]
	Capabilities: [c0] Power Management version 2
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
		Bridge: PM- B3+
	Capabilities: [e4] Debug port: BAR=1 offset=00e0
	Kernel driver in use: ehci-pci

00:13.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397] (prog-if 10 [OHCI])
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64, Cache Line Size: 32 bytes
	Interrupt: pin A routed to IRQ 18
	Region 0: Memory at c1a46000 (32-bit, non-prefetchable) [size=4K]
	Kernel driver in use: ohci-pci

00:13.2 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396] (prog-if 20 [EHCI])
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64, Cache Line Size: 32 bytes
	Interrupt: pin B routed to IRQ 17
	Region 0: Memory at c1a48500 (32-bit, non-prefetchable) [size=256]
	Capabilities: [c0] Power Management version 2
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
		Bridge: PM- B3+
	Capabilities: [e4] Debug port: BAR=1 offset=00e0
	Kernel driver in use: ehci-pci

00:14.0 SMBus [0c05]: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus Controller [1002:4385] (rev 42)
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap- 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

00:14.3 ISA bridge [0601]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 LPC host controller [1002:439d] (rev 40)
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 LPC host controller [1002:439d]
	Control: I/O+ Mem+ BusMaster+ SpecCycle+ MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz+ UDF- FastB2B- ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0

00:14.4 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 PCI to PCI Bridge [1002:4384] (rev 40) (prog-if 01 [Subtractive decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64
	Bus: primary=00, secondary=05, subordinate=05, sec-latency=64
	I/O behind bridge: 0000f000-00000fff
	Memory behind bridge: fff00000-000fffff
	Prefetchable memory behind bridge: fff00000-000fffff
	Secondary status: 66MHz- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-

00:14.5 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI2 Controller [1002:4399] (prog-if 10 [OHCI])
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI2 Controller [1002:4399]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64, Cache Line Size: 32 bytes
	Interrupt: pin C routed to IRQ 18
	Region 0: Memory at c1a45000 (32-bit, non-prefetchable) [size=4K]
	Kernel driver in use: ohci-pci

00:15.0 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 PCI to PCI bridge (PCIE port 0) [1002:43a0] (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Bus: primary=00, secondary=06, subordinate=07, sec-latency=0
	I/O behind bridge: 00003000-00003fff
	Memory behind bridge: c0a00000-c11fffff
	Prefetchable memory behind bridge: 00000000c0000000-00000000c07fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort+ <SERR- <PERR-
	BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Express (v2) Root Port (Slot+), MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag+ RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #0, Speed 5GT/s, Width x1, ASPM L0s L1, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep+ BwNot+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
		SltCap:	AttnBtn- PwrCtrl- MRL- AttnInd- PwrInd- HotPlug+ Surprise-
			Slot #0, PowerLimit 0.000W; Interlock- NoCompl+
		SltCtl:	Enable: AttnBtn- PwrFlt- MRL- PresDet- CmdCplt- HPIrq- LinkChg-
			Control: AttnInd Unknown, PwrInd Unknown, Power- Interlock-
		SltSta:	Status: AttnBtn- PowerFlt- MRL- CmdCplt- PresDet+ Interlock-
			Changed: MRL- PresDet+ LinkState+
		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ ARIFwd-
		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
		Address: 00000000fee0300c  Data: 41c1
	Capabilities: [b0] Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:0000]
	Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Kernel driver in use: pcieport

00:15.1 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 PCI to PCI bridge (PCIE port 1) [1002:43a1] (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Bus: primary=00, secondary=08, subordinate=08, sec-latency=0
	I/O behind bridge: 00002000-00002fff
	Memory behind bridge: fff00000-000fffff
	Prefetchable memory behind bridge: 00000000c0800000-00000000c08fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Express (v2) Root Port (Slot-), MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag+ RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #1, Speed 5GT/s, Width x1, ASPM L0s L1, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep+ BwNot+
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ ARIFwd-
		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -3.5dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
		Address: 00000000fee0300c  Data: 41d1
	Capabilities: [b0] Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:0000]
	Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Kernel driver in use: pcieport

00:15.2 PCI bridge [0604]: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI bridge (PCIE port 2) [1002:43a2] (prog-if 00 [Normal decode])
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Bus: primary=00, secondary=09, subordinate=09, sec-latency=0
	I/O behind bridge: 00001000-00001fff
	Memory behind bridge: c0900000-c09fffff
	Prefetchable memory behind bridge: 00000000fff00000-00000000000fffff
	Secondary status: 66MHz- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- <SERR- <PERR-
	BridgeCtl: Parity- SERR- NoISA- VGA- MAbort- >Reset- FastB2B-
		PriDiscTmr- SecDiscTmr- DiscTmrStat- DiscTmrSERREn-
	Capabilities: [50] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0-,D1-,D2-,D3hot-,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [58] Express (v2) Root Port (Slot-), MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <64ns, L1 <1us
			ExtTag+ RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 128 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr- TransPend-
		LnkCap:	Port #2, Speed 5GT/s, Width x1, ASPM L0s L1, Latency L0 <64ns, L1 <1us
			ClockPM- Surprise- LLActRep+ BwNot+
		LnkCtl:	ASPM L0s L1 Enabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive+ BWMgmt+ ABWMgmt-
		RootCtl: ErrCorrectable- ErrNon-Fatal- ErrFatal- PMEIntEna+ CRSVisible-
		RootCap: CRSVisible-
		RootSta: PME ReqID 0000, PMEStatus- PMEPending-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+ ARIFwd-
		DevCtl2: Completion Timeout: 65ms to 210ms, TimeoutDis- ARIFwd-
		LnkCtl2: Target Link Speed: 5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -3.5dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -3.5dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [a0] MSI: Enable+ Count=1/1 Maskable- 64bit+
		Address: 00000000fee0300c  Data: 41e1
	Capabilities: [b0] Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] Device [1002:0000]
	Capabilities: [b8] HyperTransport: MSI Mapping Enable+ Fixed+
	Capabilities: [100 v1] Vendor Specific Information: ID=0001 Rev=1 Len=010 <?>
	Kernel driver in use: pcieport

00:16.0 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397] (prog-if 10 [OHCI])
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64, Cache Line Size: 32 bytes
	Interrupt: pin A routed to IRQ 18
	Region 0: Memory at c1a44000 (32-bit, non-prefetchable) [size=4K]
	Kernel driver in use: ohci-pci

00:16.2 USB controller [0c03]: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396] (prog-if 20 [EHCI])
	Subsystem: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV+ VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz+ UDF- FastB2B+ ParErr- DEVSEL=medium >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 64, Cache Line Size: 32 bytes
	Interrupt: pin B routed to IRQ 17
	Region 0: Memory at c1a48400 (32-bit, non-prefetchable) [size=256]
	Capabilities: [c0] Power Management version 2
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=0mA PME(D0+,D1+,D2+,D3hot+,D3cold-)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=0 PME-
		Bridge: PM- B3+
	Capabilities: [e4] Debug port: BAR=1 offset=00e0
	Kernel driver in use: ehci-pci

00:18.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 12h/14h Processor Function 0 [1022:1700] (rev 43)
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

00:18.1 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 12h/14h Processor Function 1 [1022:1701]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

00:18.2 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 12h/14h Processor Function 2 [1022:1702]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

00:18.3 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 12h/14h Processor Function 3 [1022:1703]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Capabilities: [f0] Secure device <?>
	Kernel driver in use: k10temp

00:18.4 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 12h/14h Processor Function 4 [1022:1704]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

00:18.5 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 12h/14h Processor Function 6 [1022:1718]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

00:18.6 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 12h/14h Processor Function 5 [1022:1716]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

00:18.7 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Family 12h/14h Processor Function 7 [1022:1719]
	Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-

01:00.0 Ethernet controller [0200]: Intel Corporation 82574L Gigabit Network Connection [8086:10d3]
	Subsystem: Intel Corporation Device [8086:0000]
	Control: I/O- Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 16
	Region 0: Memory at c1940000 (32-bit, non-prefetchable) [size=128K]
	Region 1: Memory at c1800000 (32-bit, non-prefetchable) [size=1M]
	Region 2: I/O ports at 7000 [disabled] [size=32]
	Region 3: Memory at c1960000 (32-bit, non-prefetchable) [size=16K]
	[virtual] Expansion ROM at c1900000 [disabled] [size=256K]
	Capabilities: [c8] Power Management version 2
		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
	Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [e0] Express (v1) Endpoint, MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr+ UncorrErr+ FatalErr- UnsuppReq+ AuxPwr+ TransPend-
		LnkCap:	Port #1, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <128ns, L1 <64us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
	Capabilities: [a0] MSI-X: Enable+ Count=5 Masked-
		Vector table: BAR=3 offset=00000000
		PBA: BAR=3 offset=00002000
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr+ BadTLP+ BadDLLP+ Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 14, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [140 v1] Device Serial Number 00-01-c0-ff-ff-12-8a-64
	Kernel driver in use: e1000e

02:00.0 Ethernet controller [0200]: Intel Corporation 82574L Gigabit Network Connection [8086:10d3]
	Subsystem: Intel Corporation Device [8086:0000]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 17
	Region 0: Memory at c1700000 (32-bit, non-prefetchable) [size=128K]
	Region 1: Memory at c1600000 (32-bit, non-prefetchable) [size=1M]
	Region 2: I/O ports at 6000 [size=32]
	Region 3: Memory at c1720000 (32-bit, non-prefetchable) [size=16K]
	Expansion ROM at c1740000 [disabled] [size=256K]
	Capabilities: [c8] Power Management version 2
		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
	Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [e0] Express (v1) Endpoint, MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
		LnkCap:	Port #2, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <128ns, L1 <64us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM L0s L1 Enabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
	Capabilities: [a0] MSI-X: Enable+ Count=5 Masked-
		Vector table: BAR=3 offset=00000000
		PBA: BAR=3 offset=00002000
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr+ BadTLP+ BadDLLP- Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [140 v1] Device Serial Number 00-01-c0-ff-ff-12-8a-65
	Kernel driver in use: e1000e

03:00.0 Ethernet controller [0200]: Intel Corporation 82574L Gigabit Network Connection [8086:10d3]
	Subsystem: Intel Corporation Device [8086:0000]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 18
	Region 0: Memory at c1500000 (32-bit, non-prefetchable) [size=128K]
	Region 1: Memory at c1400000 (32-bit, non-prefetchable) [size=1M]
	Region 2: I/O ports at 5000 [size=32]
	Region 3: Memory at c1520000 (32-bit, non-prefetchable) [size=16K]
	Expansion ROM at c1540000 [disabled] [size=256K]
	Capabilities: [c8] Power Management version 2
		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
	Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [e0] Express (v1) Endpoint, MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
		LnkCap:	Port #3, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <128ns, L1 <64us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM L0s L1 Enabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
	Capabilities: [a0] MSI-X: Enable+ Count=5 Masked-
		Vector table: BAR=3 offset=00000000
		PBA: BAR=3 offset=00002000
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [140 v1] Device Serial Number 00-01-c0-ff-ff-12-8a-66
	Kernel driver in use: e1000e

04:00.0 Ethernet controller [0200]: Intel Corporation 82574L Gigabit Network Connection [8086:10d3]
	Subsystem: Intel Corporation Device [8086:0000]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 64 bytes
	Interrupt: pin A routed to IRQ 19
	Region 0: Memory at c1300000 (32-bit, non-prefetchable) [size=128K]
	Region 1: Memory at c1200000 (32-bit, non-prefetchable) [size=1M]
	Region 2: I/O ports at 4000 [size=32]
	Region 3: Memory at c1320000 (32-bit, non-prefetchable) [size=16K]
	Expansion ROM at c1340000 [disabled] [size=256K]
	Capabilities: [c8] Power Management version 2
		Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
		Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
	Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [e0] Express (v1) Endpoint, MSI 00
		DevCap:	MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable+ Non-Fatal+ Fatal+ Unsupported+
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
		LnkCap:	Port #4, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <128ns, L1 <64us
			ClockPM- Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM L0s L1 Enabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
	Capabilities: [a0] MSI-X: Enable+ Count=5 Masked-
		Vector table: BAR=3 offset=00000000
		PBA: BAR=3 offset=00002000
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr+ BadTLP+ BadDLLP- Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap- CGenEn- ChkCap- ChkEn-
	Capabilities: [140 v1] Device Serial Number 00-01-c0-ff-ff-12-8a-67
	Kernel driver in use: e1000e

06:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 07)
	Subsystem: Realtek Semiconductor Co., Ltd. RTL8111/8168 PCI Express Gigabit Ethernet controller [10ec:8168]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Interrupt: pin A routed to IRQ 59
	Region 0: I/O ports at 3000 [size=256]
	Region 2: Memory at c0004000 (64-bit, prefetchable) [size=4K]
	Region 4: Memory at c0000000 (64-bit, prefetchable) [size=16K]
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
		Address: 00000000fee0200c  Data: 4123
	Capabilities: [70] Express (v2) Endpoint, MSI 01
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 4096 bytes
		DevSta:	CorrErr+ UncorrErr- FatalErr- UnsuppReq+ AuxPwr+ TransPend-
		LnkCap:	Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 unlimited, L1 <64us
			ClockPM+ Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [b0] MSI-X: Enable- Count=4 Masked-
		Vector table: BAR=4 offset=00000000
		PBA: BAR=4 offset=00000800
	Capabilities: [d0] Vital Product Data
		No end tag found
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
	Capabilities: [140 v1] Virtual Channel
		Caps:	LPEVC=0 RefClk=100ns PATEntryBits=1
		Arb:	Fixed- WRR32- WRR64- WRR128-
		Ctrl:	ArbSelect=Fixed
		Status:	InProgress-
		VC0:	Caps:	PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
			Arb:	Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
			Ctrl:	Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
			Status:	NegoPending- InProgress-
	Capabilities: [160 v1] Device Serial Number 01-00-00-00-68-4c-e0-00
	Kernel driver in use: r8169

08:00.0 Ethernet controller [0200]: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168] (rev 07)
	Subsystem: Realtek Semiconductor Co., Ltd. RTL8111/8168 PCI Express Gigabit Ethernet controller [10ec:8168]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx+
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Interrupt: pin A routed to IRQ 60
	Region 0: I/O ports at 2000 [size=256]
	Region 2: Memory at c0804000 (64-bit, prefetchable) [size=4K]
	Region 4: Memory at c0800000 (64-bit, prefetchable) [size=16K]
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [50] MSI: Enable+ Count=1/1 Maskable- 64bit+
		Address: 00000000fee0300c  Data: 4143
	Capabilities: [70] Express (v2) Endpoint, MSI 01
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 4096 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
		LnkCap:	Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 unlimited, L1 <64us
			ClockPM+ Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Range ABCD, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis-
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [b0] MSI-X: Enable- Count=4 Masked-
		Vector table: BAR=4 offset=00000000
		PBA: BAR=4 offset=00000800
	Capabilities: [d0] Vital Product Data
		No end tag found
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 00, GenCap+ CGenEn- ChkCap+ ChkEn-
	Capabilities: [140 v1] Virtual Channel
		Caps:	LPEVC=0 RefClk=100ns PATEntryBits=1
		Arb:	Fixed- WRR32- WRR64- WRR128-
		Ctrl:	ArbSelect=Fixed
		Status:	InProgress-
		VC0:	Caps:	PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
			Arb:	Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
			Ctrl:	Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
			Status:	NegoPending- InProgress-
	Capabilities: [160 v1] Device Serial Number 01-00-00-00-68-4c-e0-00
	Kernel driver in use: r8169

09:00.0 Network controller [0280]: Realtek Semiconductor Co., Ltd. RTL8723AE PCIe Wireless Network Adapter [10ec:8723]
	Subsystem: Realtek Semiconductor Co., Ltd. Device [10ec:0733]
	Control: I/O+ Mem+ BusMaster+ SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
	Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
	Latency: 0, Cache Line Size: 32 bytes
	Interrupt: pin A routed to IRQ 18
	Region 0: I/O ports at 1000 [size=256]
	Region 2: Memory at c0900000 (64-bit, non-prefetchable) [size=16K]
	Capabilities: [40] Power Management version 3
		Flags: PMEClk- DSI- D1+ D2+ AuxCurrent=375mA PME(D0+,D1+,D2+,D3hot+,D3cold+)
		Status: D0 NoSoftRst+ PME-Enable- DSel=0 DScale=0 PME-
	Capabilities: [50] MSI: Enable- Count=1/1 Maskable- 64bit+
		Address: 0000000000000000  Data: 0000
	Capabilities: [70] Express (v2) Endpoint, MSI 00
		DevCap:	MaxPayload 128 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
			ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
		DevCtl:	Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
			RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop-
			MaxPayload 128 bytes, MaxReadReq 512 bytes
		DevSta:	CorrErr- UncorrErr- FatalErr- UnsuppReq- AuxPwr+ TransPend-
		LnkCap:	Port #0, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <512ns, L1 <64us
			ClockPM+ Surprise- LLActRep- BwNot-
		LnkCtl:	ASPM L0s L1 Enabled; RCB 64 bytes Disabled- Retrain- CommClk+
			ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
		LnkSta:	Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
		DevCap2: Completion Timeout: Not Supported, TimeoutDis+
		DevCtl2: Completion Timeout: 50us to 50ms, TimeoutDis+
		LnkCtl2: Target Link Speed: 2.5GT/s, EnterCompliance- SpeedDis-, Selectable De-emphasis: -6dB
			 Transmit Margin: Normal Operating Range, EnterModifiedCompliance- ComplianceSOS-
			 Compliance De-emphasis: -6dB
		LnkSta2: Current De-emphasis Level: -6dB, EqualizationComplete-, EqualizationPhase1-
			 EqualizationPhase2-, EqualizationPhase3-, LinkEqualizationRequest-
	Capabilities: [100 v1] Advanced Error Reporting
		UESta:	DLP- SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UEMsk:	DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
		UESvrt:	DLP+ SDES+ TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
		CESta:	RxErr+ BadTLP- BadDLLP- Rollover- Timeout+ NonFatalErr-
		CEMsk:	RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
		AERCap:	First Error Pointer: 0d, GenCap+ CGenEn- ChkCap+ ChkEn-
	Capabilities: [140 v1] Virtual Channel
		Caps:	LPEVC=0 RefClk=100ns PATEntryBits=1
		Arb:	Fixed- WRR32- WRR64- WRR128-
		Ctrl:	ArbSelect=Fixed
		Status:	InProgress-
		VC0:	Caps:	PATOffset=00 MaxTimeSlots=1 RejSnoopTrans-
			Arb:	Fixed- WRR32- WRR64- WRR128- TWRR128- WRR256-
			Ctrl:	Enable+ ID=0 ArbSelect=Fixed TC/VC=ff
			Status:	NegoPending- InProgress-
	Capabilities: [160 v1] Device Serial Number 01-23-87-fe-ff-4c-e0-00
	Kernel driver in use: rtl8723ae


^ permalink raw reply	[flat|nested] 7+ messages in thread

* Re: [E1000-devel] [linux-nics] Problem: 82574L device (e1000e driver): Reset adapter unexpectedly / transmit queue 0 timed out
  2014-07-23  4:59         ` Andrew Cooks
@ 2014-07-23 16:04           ` Alexander Duyck
  0 siblings, 0 replies; 7+ messages in thread
From: Alexander Duyck @ 2014-07-23 16:04 UTC (permalink / raw)
  To: Andrew Cooks
  Cc: Fujinaka, Todd, Dmitry Lifshitz, netdev, e1000-devel,
	Igor Grinberg, Linux NICS

On 07/22/2014 09:59 PM, Andrew Cooks wrote:
> On Tue, Jul 22, 2014 at 11:25 PM, Alexander Duyck
> <alexander.h.duyck@intel.com> wrote:
>>>>>> # lspci -vvnnk:
>>>>>> 01:00.0 Ethernet controller [0200]: Intel Corporation 82574L Gigabit Network Connection [8086:10d3]
>>>>>>         Subsystem: Intel Corporation Device [8086:0000]
>>>>>>         Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx-
>>>>>>         Status: Cap+ 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx-
>>>>>>         Interrupt: pin A routed to IRQ 16
>>>>>>         Region 0: [virtual] Memory at c1900000 (32-bit, non-prefetchable) [size=128K]
>>>>>>         Region 1: [virtual] Memory at c1800000 (32-bit, non-prefetchable) [size=1M]
>>>>>>         Region 2: I/O ports at 7000 [size=32]
>>>>>>         Region 3: [virtual] Memory at c1920000 (32-bit, non-prefetchable) [size=16K]
>>>>>>         [virtual] Expansion ROM at c1940000 [disabled] [size=256K]
>>>>>>         Capabilities: [c8] Power Management version 2
>>>>>>                 Flags: PMEClk- DSI+ D1- D2- AuxCurrent=0mA PME(D0+,D1-,D2-,D3hot+,D3cold+)
>>>>>>                 Status: D0 NoSoftRst- PME-Enable- DSel=0 DScale=1 PME-
>>>>>>         Capabilities: [d0] MSI: Enable- Count=1/1 Maskable- 64bit+
>>>>>>                 Address: 0000000000000000  Data: 0000
>>>>>>         Capabilities: [e0] Express (v1) Endpoint, MSI 00
>>>>>>                 DevCap: MaxPayload 256 bytes, PhantFunc 0, Latency L0s <512ns, L1 <64us
>>>>>>                         ExtTag- AttnBtn- AttnInd- PwrInd- RBE+ FLReset-
>>>>>>                 DevCtl: Report errors: Correctable- Non-Fatal- Fatal- Unsupported-
>>>>>>                         RlxdOrd+ ExtTag- PhantFunc- AuxPwr- NoSnoop+
>>>>>>                         MaxPayload 128 bytes, MaxReadReq 512 bytes
>>>>>>                 DevSta: CorrErr+ UncorrErr+ FatalErr- UnsuppReq+ AuxPwr+ TransPend-
>>>>>>                 LnkCap: Port #1, Speed 2.5GT/s, Width x1, ASPM L0s L1, Latency L0 <128ns, L1 <64us
>>>>>>                         ClockPM- Surprise- LLActRep- BwNot-
>>>>>>                 LnkCtl: ASPM Disabled; RCB 64 bytes Disabled- Retrain- CommClk-
>>>>>>                         ExtSynch- ClockPM- AutWidDis- BWInt- AutBWInt-
>>>>>>                 LnkSta: Speed 2.5GT/s, Width x1, TrErr- Train- SlotClk+ DLActive- BWMgmt- ABWMgmt-
>>>>>>         Capabilities: [a0] MSI-X: Enable- Count=5 Masked-
>>>>>>                 Vector table: BAR=3 offset=00000000
>>>>>>                 PBA: BAR=3 offset=00002000
>>>>>>         Capabilities: [100 v1] Advanced Error Reporting
>>>>>>                 UESta:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq+ ACSViol-
>>>>>>                 UEMsk:  DLP- SDES- TLP- FCP- CmpltTO- CmpltAbrt- UnxCmplt- RxOF- MalfTLP- ECRC- UnsupReq- ACSViol-
>>>>>>                 UESvrt: DLP+ SDES- TLP- FCP+ CmpltTO- CmpltAbrt- UnxCmplt- RxOF+ MalfTLP+ ECRC- UnsupReq- ACSViol-
>>>>>>                 CESta:  RxErr+ BadTLP+ BadDLLP+ Rollover- Timeout- NonFatalErr+
>>>>>>                 CEMsk:  RxErr- BadTLP- BadDLLP- Rollover- Timeout- NonFatalErr+
>>>>>>                 AERCap: First Error Pointer: 14, GenCap- CGenEn- ChkCap- ChkEn-
>>>>>>         Capabilities: [140 v1] Device Serial Number 00-01-c0-ff-ff-12-8a-64
>>>>>>         Kernel driver in use: e1000e
>>>>>>
>>>>>>
>>
>> It looks like something bad happened on the PCIe bus based on the RxErr,
>> BadTLP, BadDLLP, and NonFatalERR indicators all being set.  This could
>> be an indication of a possible problem with the PCIe link on the system.
> 
> Thanks very much for explaining this. Is it correct to think that this
> is likely to be a hardware problem?
> 

Yes, that is kind of what I am thinking.  The problem may be in the
wiring between the root complex and the part.  Correctable errors
usually indicate that the link between the PCIe devices may be failing.

Do you know if you have any features such as runtime power management
enabled?  If so you might try disabling it as one possible issue could
be that transitioning the link between DO and D3 and back to D0 is
eventually failing and causing this issue.

>> One thing that would probably be useful would be to provide an "lspci
>> -vvv" for the entire system.  That would at least give us an idea of the
>> PCIe hierarchy and could help to tell us if the problem is something in
>> the local PCIe hierarchy for the device, or if the problem is closer to
>> the root complex.
> 
> I've attached the complete lspci output, because it's quite large to
> include inline. I hope that's ok. It shows some interesting
> differences between device 01:00.0 (the one that error'ed) and the
> other 82574L devices.
> 
> # lspci -tvvvnn
> -[0000:00]-+-00.0  Advanced Micro Devices, Inc. [AMD] Family 14h
> Processor Root Complex [1022:1510]
>            +-01.0  Advanced Micro Devices, Inc. [AMD/ATI] Wrestler
> [Radeon HD 6320] [1002:9806]
>            +-01.1  Advanced Micro Devices, Inc. [AMD/ATI] Wrestler
> HDMI Audio [1002:1314]
>            +-04.0-[01]----00.0  Intel Corporation 82574L Gigabit
> Network Connection [8086:10d3]
>            +-05.0-[02]----00.0  Intel Corporation 82574L Gigabit
> Network Connection [8086:10d3]
>            +-06.0-[03]----00.0  Intel Corporation 82574L Gigabit
> Network Connection [8086:10d3]
>            +-07.0-[04]----00.0  Intel Corporation 82574L Gigabit
> Network Connection [8086:10d3]
>            +-11.0  Advanced Micro Devices, Inc. [AMD/ATI]
> SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] [1002:4391]
>            +-12.0  Advanced Micro Devices, Inc. [AMD/ATI]
> SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
>            +-12.2  Advanced Micro Devices, Inc. [AMD/ATI]
> SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
>            +-13.0  Advanced Micro Devices, Inc. [AMD/ATI]
> SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
>            +-13.2  Advanced Micro Devices, Inc. [AMD/ATI]
> SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
>            +-14.0  Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus
> Controller [1002:4385]
>            +-14.3  Advanced Micro Devices, Inc. [AMD/ATI]
> SB7x0/SB8x0/SB9x0 LPC host controller [1002:439d]
>            +-14.4-[05]--
>            +-14.5  Advanced Micro Devices, Inc. [AMD/ATI]
> SB7x0/SB8x0/SB9x0 USB OHCI2 Controller [1002:4399]
>            +-15.0-[06-07]----00.0  Realtek Semiconductor Co., Ltd.
> RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168]
>            +-15.1-[08]----00.0  Realtek Semiconductor Co., Ltd.
> RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller [10ec:8168]
>            +-15.2-[09]----00.0  Realtek Semiconductor Co., Ltd.
> RTL8723AE PCIe Wireless Network Adapter [10ec:8723]
>            +-16.0  Advanced Micro Devices, Inc. [AMD/ATI]
> SB7x0/SB8x0/SB9x0 USB OHCI0 Controller [1002:4397]
>            +-16.2  Advanced Micro Devices, Inc. [AMD/ATI]
> SB7x0/SB8x0/SB9x0 USB EHCI Controller [1002:4396]
>            +-18.0  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
> Processor Function 0 [1022:1700]
>            +-18.1  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
> Processor Function 1 [1022:1701]
>            +-18.2  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
> Processor Function 2 [1022:1702]
>            +-18.3  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
> Processor Function 3 [1022:1703]
>            +-18.4  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
> Processor Function 4 [1022:1704]
>            +-18.5  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
> Processor Function 6 [1022:1718]
>            +-18.6  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
> Processor Function 5 [1022:1716]
>            \-18.7  Advanced Micro Devices, Inc. [AMD] Family 12h/14h
> Processor Function 7 [1022:1719]
> 
> 
> Thanks!
> 
> a.
> 


I'll look this over, though nothing jumps out immediately at me as
something that is wrong.  Do you have all 4 ports in use or only a few
of them?  One thing you might try is testing various ports and if you
see the issue on one specific port it might just be a fault in the
wiring between the root complex and that port, or possibly the silicon
on either end.

Thanks,

Alex

^ permalink raw reply	[flat|nested] 7+ messages in thread

end of thread, other threads:[~2014-07-23 16:04 UTC | newest]

Thread overview: 7+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2014-07-21  3:00 Problem: 82574L device (e1000e driver): Reset adapter unexpectedly / transmit queue 0 timed out Andrew Cooks
2014-07-21 15:22 ` [linux-nics] " Fujinaka, Todd
2014-07-22  1:58   ` Andrew Cooks
2014-07-22  2:05     ` Andrew Cooks
2014-07-22 15:25       ` [E1000-devel] " Alexander Duyck
2014-07-23  4:59         ` Andrew Cooks
2014-07-23 16:04           ` Alexander Duyck

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.