* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-09-11 20:39 ` Martin Blumenstingl
0 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-09-11 20:39 UTC (permalink / raw)
To: netdev, linux-amlogic; +Cc: Giuseppe Cavallaro, Alexandre Torgue, Johnson Leung
[-- Attachment #1: Type: text/plain, Size: 2831 bytes --]
Hello,
I have a device with a Meson GXBB SoC with an stmmac IP block.
Gbit ethernet on my device is provided by a Realtek RTL8211F RGMII PHY.
Similar issues were reported in #linux-amlogic by a user with an
Odroid C2 board (= similar hardware).
The symptoms are:
Receiving data is plenty fast (I can max out my internet connection
easily, and with iperf3 I get ~900Mbit/s).
Transmitting data from the device is unfortunately very slow, traffic
sometimes even stalls completely.
I have attached the iperf results and the output of
/sys/kernel/debug/stmmaceth/eth0/descriptors_status.
Below you can find the ifconfig, netstat and stmmac dma_cap info
(*after* I ran all tests).
The "involved parties" are:
- Meson GXBB specific network configuration registers (I have have
double-checked them with the reference drivers: everything seems fine
here)
- stmmac: it seems that nobody else has reported these kind of issues
so far, however I'd still like to hear where I should enable some
debugging bits to rule out any stmmac bug
- RTL8211F PHY driver: unfortunately there are no public datasheets
available so this is hard to debug. but I'm guessing that TX delay
could cause similar issues, so this may be the cause as well.
Thanks for any input in advance!
Regards,
Martin
[root@alarm ~]# ifconfig eth0
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 192.168.1.235 netmask 255.255.255.0 broadcast 192.168.1.255
ether e2:aa:53:fc:f5:c5 txqueuelen 1000 (Ethernet)
RX packets 1967602 bytes 2968750265 (2.7 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 101875 bytes 8548285 (8.1 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
device interrupt 18
[root@alarm ~]# netstat -i
Kernel Interface table
Iface MTU RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR Flg
eth0 1500 1967801 0 0 0 101934 0 0 0 BMRU
[root@alarm ~]# cat /sys/kernel/debug/stmmaceth/eth0/dma_cap
==============================
DMA HW features
==============================
10/100 Mbps Y
1000 Mbps Y
Half duple Y
Hash Filter: Y
Multiple MAC address registers: Y
PCS (TBI/SGMII/RTBI PHY interfatces): N
SMA (MDIO) Interface: Y
PMT Remote wake up: Y
PMT Magic Frame: Y
RMON module: Y
IEEE 1588-2002 Time Stamp: N
IEEE 1588-2008 Advanced Time Stamp:N
802.3az - Energy-Efficient Ethernet (EEE) Y
AV features: N
Checksum Offload in TX: Y
IP Checksum Offload (type1) in RX: N
IP Checksum Offload (type2) in RX: Y
RXFIFO > 2048bytes: Y
Number of Additional RX channel: 0
Number of Additional TX channel: 0
Enhanced descriptors: N
[-- Attachment #2: iperf-results.txt --]
[-- Type: text/plain, Size: 5073 bytes --]
UDP test (iperf3):
[root@alarm ~]# iperf3 --client 192.168.1.100 -u
Connecting to host 192.168.1.100, port 5201
[ 4] local 192.168.1.235 port 38931 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth Total Datagrams
[ 4] 0.00-1.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 1.00-2.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 2.00-3.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 3.00-4.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 4.00-5.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 5.00-6.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 6.00-7.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 7.00-8.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 8.00-9.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 9.00-10.00 sec 128 KBytes 1.05 Mbits/sec 16
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Jitter Lost/Total Datagrams
[ 4] 0.00-10.00 sec 1.25 MBytes 1.05 Mbits/sec 12526562.925 ms 113/159 (71%)
[ 4] Sent 159 datagrams
iperf Done.
[root@alarm ~]# iperf3 --client 192.168.1.100 -u -R
Connecting to host 192.168.1.100, port 5201
Reverse mode, remote host 192.168.1.100 is sending
[ 4] local 192.168.1.235 port 45128 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth Jitter Lost/Total Datagrams
[ 4] 0.00-1.00 sec 136 KBytes 1.11 Mbits/sec 81407591.898 ms 0/17 (0%)
[ 4] 1.00-2.00 sec 128 KBytes 1.05 Mbits/sec 28987137.507 ms 0/16 (0%)
[ 4] 2.00-3.00 sec 128 KBytes 1.05 Mbits/sec 10321569.793 ms 0/16 (0%)
[ 4] 3.00-4.00 sec 128 KBytes 1.05 Mbits/sec 3675244.000 ms 0/16 (0%)
[ 4] 4.00-5.00 sec 128 KBytes 1.05 Mbits/sec 1308659.322 ms 0/16 (0%)
[ 4] 5.00-6.00 sec 128 KBytes 1.05 Mbits/sec 465979.740 ms 0/16 (0%)
[ 4] 6.00-7.00 sec 128 KBytes 1.05 Mbits/sec 165923.341 ms 0/16 (0%)
[ 4] 7.00-8.00 sec 128 KBytes 1.05 Mbits/sec 59081.019 ms 0/16 (0%)
[ 4] 8.00-9.00 sec 128 KBytes 1.05 Mbits/sec 21037.233 ms 0/16 (0%)
[ 4] 9.00-10.00 sec 128 KBytes 1.05 Mbits/sec 7490.825 ms 0/16 (0%)
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Jitter Lost/Total Datagrams
[ 4] 0.00-10.00 sec 1.26 MBytes 1.06 Mbits/sec 7490.825 ms 0/161 (0%)
[ 4] Sent 161 datagrams
iperf Done.
[root@alarm ~]#
TCP test (iperf3):
[root@alarm ~]# iperf3 --client 192.168.1.100
Connecting to host 192.168.1.100, port 5201
[ 4] local 192.168.1.235 port 47508 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 115 KBytes 937 Kbits/sec 8 1.41 KBytes
[ 4] 1.00-2.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 2.00-3.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 3.00-4.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 4.00-5.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 5.00-6.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 6.00-7.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 7.00-8.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 8.00-9.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 9.00-10.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 115 KBytes 93.8 Kbits/sec 11 sender
[ 4] 0.00-10.00 sec 7.07 KBytes 5.79 Kbits/sec receiver
iperf Done.
[root@alarm ~]# iperf3 --client 192.168.1.100 -R
Connecting to host 192.168.1.100, port 5201
Reverse mode, remote host 192.168.1.100 is sending
[ 4] local 192.168.1.235 port 47512 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 84.9 MBytes 712 Mbits/sec
[ 4] 1.00-2.00 sec 106 MBytes 891 Mbits/sec
[ 4] 2.00-3.00 sec 107 MBytes 894 Mbits/sec
[ 4] 3.00-4.00 sec 93.5 MBytes 784 Mbits/sec
[ 4] 4.00-5.00 sec 98.6 MBytes 827 Mbits/sec
[ 4] 5.00-6.00 sec 80.5 MBytes 675 Mbits/sec
[ 4] 6.00-7.00 sec 107 MBytes 894 Mbits/sec
[ 4] 7.00-8.00 sec 106 MBytes 886 Mbits/sec
[ 4] 8.00-9.00 sec 107 MBytes 894 Mbits/sec
[ 4] 9.00-10.00 sec 106 MBytes 893 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 997 MBytes 836 Mbits/sec 1569 sender
[ 4] 0.00-10.00 sec 996 MBytes 835 Mbits/sec receiver
iperf Done.
[root@alarm ~]#
[-- Attachment #3: stmmac-descsriptor_status.txt --]
[-- Type: text/plain, Size: 48977 bytes --]
RX descriptor ring:
0 [0x23b2000]: 0x85e60320 0x803fffff 0x7378e702 0x0
1 [0x23b2000]: 0x85e60320 0x803fffff 0x7378de82 0x0
2 [0x23b2000]: 0x85e60320 0x803fffff 0x7378d602 0x0
3 [0x23b2000]: 0x85e60320 0x803fffff 0x7378cd82 0x0
4 [0x23b2000]: 0x85e60320 0x803fffff 0x7378c502 0x0
5 [0x23b2000]: 0x85e60320 0x803fffff 0x7378bc82 0x0
6 [0x23b2000]: 0x85e60320 0x803fffff 0x7378b402 0x0
7 [0x23b2000]: 0x85e60320 0x803fffff 0x7378ab82 0x0
8 [0x23b2000]: 0x85e60320 0x803fffff 0x7378a302 0x0
9 [0x23b2000]: 0x85e60320 0x803fffff 0x73789a82 0x0
10 [0x23b2000]: 0x85e60320 0x803fffff 0x73789202 0x0
11 [0x23b2000]: 0x85e60320 0x803fffff 0x73788982 0x0
12 [0x23b2000]: 0x85e60320 0x803fffff 0x73788102 0x0
13 [0x23b2000]: 0x85e60320 0x803fffff 0x721df802 0x0
14 [0x23b2000]: 0x85e60320 0x803fffff 0x721def82 0x0
15 [0x23b2000]: 0x85e60320 0x803fffff 0x721de702 0x0
16 [0x23b2000]: 0x85e60320 0x803fffff 0x721dde82 0x0
17 [0x23b2000]: 0x85e60320 0x803fffff 0x721dd602 0x0
18 [0x23b2000]: 0x85e60320 0x803fffff 0x721dcd82 0x0
19 [0x23b2000]: 0x85e60320 0x803fffff 0x721dc502 0x0
20 [0x23b2000]: 0x85e60320 0x803fffff 0x721dbc82 0x0
21 [0x23b2000]: 0x85e60320 0x803fffff 0x721db402 0x0
22 [0x23b2000]: 0x85e60320 0x803fffff 0x721dab82 0x0
23 [0x23b2000]: 0x85e60320 0x803fffff 0x721da302 0x0
24 [0x23b2000]: 0x85e60320 0x803fffff 0x721d9a82 0x0
25 [0x23b2000]: 0x85e60320 0x803fffff 0x721d9202 0x0
26 [0x23b2000]: 0x85e60320 0x803fffff 0x721d8982 0x0
27 [0x23b2000]: 0x85e60320 0x803fffff 0x721d8102 0x0
28 [0x23b2000]: 0x85e60320 0x803fffff 0x735b7802 0x0
29 [0x23b2000]: 0x85e60320 0x803fffff 0x735b6f82 0x0
30 [0x23b2000]: 0x85e60320 0x803fffff 0x735b6702 0x0
31 [0x23b2000]: 0x85e60320 0x803fffff 0x735b5e82 0x0
32 [0x23b2000]: 0x85e60320 0x803fffff 0x735b5602 0x0
33 [0x23b2000]: 0x85e60320 0x803fffff 0x735b4d82 0x0
34 [0x23b2000]: 0x85e60320 0x803fffff 0x735b4502 0x0
35 [0x23b2000]: 0x85e60320 0x803fffff 0x735b3c82 0x0
36 [0x23b2000]: 0x85e60320 0x803fffff 0x735b3402 0x0
37 [0x23b2000]: 0x85e60320 0x803fffff 0x735b2b82 0x0
38 [0x23b2000]: 0x85e60320 0x803fffff 0x735b2302 0x0
39 [0x23b2000]: 0x85e60320 0x803fffff 0x735b1a82 0x0
40 [0x23b2000]: 0x85e60320 0x803fffff 0x735b1202 0x0
41 [0x23b2000]: 0x85e60320 0x803fffff 0x735b0982 0x0
42 [0x23b2000]: 0x85e60320 0x803fffff 0x735b0102 0x0
43 [0x23b2000]: 0x85e60320 0x803fffff 0x737e7802 0x0
44 [0x23b2000]: 0x85e60320 0x803fffff 0x737e6f82 0x0
45 [0x23b2000]: 0x85e60320 0x803fffff 0x737e6702 0x0
46 [0x23b2000]: 0x85e60320 0x803fffff 0x737e5e82 0x0
47 [0x23b2000]: 0x85e60320 0x803fffff 0x737e5602 0x0
48 [0x23b2000]: 0x85e60320 0x803fffff 0x737e4d82 0x0
49 [0x23b2000]: 0x85e60320 0x803fffff 0x737e4502 0x0
50 [0x23b2000]: 0x85e60320 0x803fffff 0x737e3c82 0x0
51 [0x23b2000]: 0x85e60320 0x803fffff 0x737e3402 0x0
52 [0x23b2000]: 0x85e60320 0x803fffff 0x737e2b82 0x0
53 [0x23b2000]: 0x85e60320 0x803fffff 0x737e2302 0x0
54 [0x23b2000]: 0x85e60320 0x803fffff 0x737e1a82 0x0
55 [0x23b2000]: 0x85e60320 0x803fffff 0x737e1202 0x0
56 [0x23b2000]: 0x85e60320 0x803fffff 0x737e0982 0x0
57 [0x23b2000]: 0x85e60320 0x803fffff 0x737e0102 0x0
58 [0x23b2000]: 0x85e60320 0x803fffff 0x7086f802 0x0
59 [0x23b2000]: 0x85e60320 0x803fffff 0x7086ef82 0x0
60 [0x23b2000]: 0x85e60320 0x803fffff 0x7086e702 0x0
61 [0x23b2000]: 0x85e60320 0x803fffff 0x7086de82 0x0
62 [0x23b2000]: 0x85e60320 0x803fffff 0x7086d602 0x0
63 [0x23b2000]: 0x85e60320 0x803fffff 0x7086cd82 0x0
64 [0x23b2000]: 0x85e60320 0x803fffff 0x7086c502 0x0
65 [0x23b2000]: 0x85e60320 0x803fffff 0x7086bc82 0x0
66 [0x23b2000]: 0x85e60320 0x803fffff 0x7086b402 0x0
67 [0x23b2000]: 0x85e60320 0x803fffff 0x7086ab82 0x0
68 [0x23b2000]: 0x85e60320 0x803fffff 0x7086a302 0x0
69 [0x23b2000]: 0x85e60320 0x803fffff 0x70869a82 0x0
70 [0x23b2000]: 0x85e60320 0x803fffff 0x70869202 0x0
71 [0x23b2000]: 0x85e60320 0x803fffff 0x70868982 0x0
72 [0x23b2000]: 0x85e60320 0x803fffff 0x70868102 0x0
73 [0x23b2000]: 0x85e60320 0x803fffff 0x7200f802 0x0
74 [0x23b2000]: 0x85e60320 0x803fffff 0x7200ef82 0x0
75 [0x23b2000]: 0x85e60320 0x803fffff 0x7200e702 0x0
76 [0x23b2000]: 0x85e60320 0x803fffff 0x7200de82 0x0
77 [0x23b2000]: 0x85e60320 0x803fffff 0x7200d602 0x0
78 [0x23b2000]: 0x85e60320 0x803fffff 0x7200cd82 0x0
79 [0x23b2000]: 0x85e60320 0x803fffff 0x7200c502 0x0
80 [0x23b2000]: 0x85e60320 0x803fffff 0x7200bc82 0x0
81 [0x23b2000]: 0x85e60320 0x803fffff 0x7200b402 0x0
82 [0x23b2000]: 0x85e60320 0x803fffff 0x7200ab82 0x0
83 [0x23b2000]: 0x85e60320 0x803fffff 0x7200a302 0x0
84 [0x23b2000]: 0x85e60320 0x803fffff 0x72009a82 0x0
85 [0x23b2000]: 0x85e60320 0x803fffff 0x72009202 0x0
86 [0x23b2000]: 0x85e60320 0x803fffff 0x72008982 0x0
87 [0x23b2000]: 0x85e60320 0x803fffff 0x72008102 0x0
88 [0x23b2000]: 0x85e60320 0x803fffff 0x721e7802 0x0
89 [0x23b2000]: 0x85e60320 0x803fffff 0x721e6f82 0x0
90 [0x23b2000]: 0x85e60320 0x803fffff 0x721e6702 0x0
91 [0x23b2000]: 0x85e60320 0x803fffff 0x721e5e82 0x0
92 [0x23b2000]: 0x85e60320 0x803fffff 0x721e5602 0x0
93 [0x23b2000]: 0x85e60320 0x803fffff 0x721e4d82 0x0
94 [0x23b2000]: 0x85e60320 0x803fffff 0x721e4502 0x0
95 [0x23b2000]: 0x85e60320 0x803fffff 0x721e3c82 0x0
96 [0x23b2000]: 0x85e60320 0x803fffff 0x721e3402 0x0
97 [0x23b2000]: 0x85e60320 0x803fffff 0x721e2b82 0x0
98 [0x23b2000]: 0x85e60320 0x803fffff 0x721e2302 0x0
99 [0x23b2000]: 0x85e60320 0x803fffff 0x721e1a82 0x0
100 [0x23b2000]: 0x85e60320 0x803fffff 0x721e1202 0x0
101 [0x23b2000]: 0x85e60320 0x803fffff 0x721e0982 0x0
102 [0x23b2000]: 0x85e60320 0x803fffff 0x721e0102 0x0
103 [0x23b2000]: 0x85e60320 0x803fffff 0x73687802 0x0
104 [0x23b2000]: 0x85e60320 0x803fffff 0x73686f82 0x0
105 [0x23b2000]: 0x85e60320 0x803fffff 0x73686702 0x0
106 [0x23b2000]: 0x85e60320 0x803fffff 0x73685e82 0x0
107 [0x23b2000]: 0x85e60320 0x803fffff 0x73685602 0x0
108 [0x23b2000]: 0x85e60320 0x803fffff 0x73684d82 0x0
109 [0x23b2000]: 0x85e60320 0x803fffff 0x73684502 0x0
110 [0x23b2000]: 0x85e60320 0x803fffff 0x73683c82 0x0
111 [0x23b2000]: 0x85e60320 0x803fffff 0x73683402 0x0
112 [0x23b2000]: 0x85e60320 0x803fffff 0x73682b82 0x0
113 [0x23b2000]: 0x85e60320 0x803fffff 0x73682302 0x0
114 [0x23b2000]: 0x85e60320 0x803fffff 0x73681a82 0x0
115 [0x23b2000]: 0x85e60320 0x803fffff 0x73681202 0x0
116 [0x23b2000]: 0x85e60320 0x803fffff 0x73680982 0x0
117 [0x23b2000]: 0x85e60320 0x803fffff 0x73680102 0x0
118 [0x23b2000]: 0x85e60320 0x803fffff 0x7205f802 0x0
119 [0x23b2000]: 0x85e60320 0x803fffff 0x7205ef82 0x0
120 [0x23b2000]: 0x85e60320 0x803fffff 0x7205e702 0x0
121 [0x23b2000]: 0x85e60320 0x803fffff 0x7205de82 0x0
122 [0x23b2000]: 0x85e60320 0x803fffff 0x7205d602 0x0
123 [0x23b2000]: 0x85e60320 0x803fffff 0x7205cd82 0x0
124 [0x23b2000]: 0x85e60320 0x803fffff 0x7205c502 0x0
125 [0x23b2000]: 0x85e60320 0x803fffff 0x7205bc82 0x0
126 [0x23b2000]: 0x85e60320 0x803fffff 0x7205b402 0x0
127 [0x23b2000]: 0x85e60320 0x803fffff 0x7205ab82 0x0
128 [0x23b2000]: 0x85e60320 0x803fffff 0x7205a302 0x0
129 [0x23b2000]: 0x85e60320 0x803fffff 0x72059a82 0x0
130 [0x23b2000]: 0x85e60320 0x803fffff 0x72059202 0x0
131 [0x23b2000]: 0x85e60320 0x803fffff 0x72058982 0x0
132 [0x23b2000]: 0x85e60320 0x803fffff 0x72058102 0x0
133 [0x23b2000]: 0x85e60320 0x803fffff 0x72167802 0x0
134 [0x23b2000]: 0x85e60320 0x803fffff 0x72166f82 0x0
135 [0x23b2000]: 0x85e60320 0x803fffff 0x72166702 0x0
136 [0x23b2000]: 0x85e60320 0x803fffff 0x72165e82 0x0
137 [0x23b2000]: 0x85e60320 0x803fffff 0x72165602 0x0
138 [0x23b2000]: 0x85e60320 0x803fffff 0x72164d82 0x0
139 [0x23b2000]: 0x85e60320 0x803fffff 0x72164502 0x0
140 [0x23b2000]: 0x85e60320 0x803fffff 0x72163c82 0x0
141 [0x23b2000]: 0x85e60320 0x803fffff 0x72163402 0x0
142 [0x23b2000]: 0x85e60320 0x803fffff 0x72162b82 0x0
143 [0x23b2000]: 0x85e60320 0x803fffff 0x72162302 0x0
144 [0x23b2000]: 0x85e60320 0x803fffff 0x72161a82 0x0
145 [0x23b2000]: 0x85e60320 0x803fffff 0x72161202 0x0
146 [0x23b2000]: 0x85e60320 0x803fffff 0x72160982 0x0
147 [0x23b2000]: 0x85e60320 0x803fffff 0x72160102 0x0
148 [0x23b2000]: 0x85e60320 0x803fffff 0x737ef802 0x0
149 [0x23b2000]: 0x85e60320 0x803fffff 0x737eef82 0x0
150 [0x23b2000]: 0x85e60320 0x803fffff 0x737ee702 0x0
151 [0x23b2000]: 0x85e60320 0x803fffff 0x737ede82 0x0
152 [0x23b2000]: 0x85e60320 0x803fffff 0x737ed602 0x0
153 [0x23b2000]: 0x85e60320 0x803fffff 0x737ecd82 0x0
154 [0x23b2000]: 0x85e60320 0x803fffff 0x737ec502 0x0
155 [0x23b2000]: 0x85e60320 0x803fffff 0x737ebc82 0x0
156 [0x23b2000]: 0x85e60320 0x803fffff 0x737eb402 0x0
157 [0x23b2000]: 0x85e60320 0x803fffff 0x737eab82 0x0
158 [0x23b2000]: 0x85e60320 0x803fffff 0x737ea302 0x0
159 [0x23b2000]: 0x85e60320 0x803fffff 0x737e9a82 0x0
160 [0x23b2000]: 0x85e60320 0x803fffff 0x737e9202 0x0
161 [0x23b2000]: 0x85e60320 0x803fffff 0x737e8982 0x0
162 [0x23b2000]: 0x85e60320 0x803fffff 0x737e8102 0x0
163 [0x23b2000]: 0x85e60320 0x803fffff 0x735bf802 0x0
164 [0x23b2000]: 0x85e60320 0x803fffff 0x735bef82 0x0
165 [0x23b2000]: 0x85e60320 0x803fffff 0x735be702 0x0
166 [0x23b2000]: 0x85e60320 0x803fffff 0x735bde82 0x0
167 [0x23b2000]: 0x85e60320 0x803fffff 0x735bd602 0x0
168 [0x23b2000]: 0x85e60320 0x803fffff 0x735bcd82 0x0
169 [0x23b2000]: 0x85e60320 0x803fffff 0x735bc502 0x0
170 [0x23b2000]: 0x85e60320 0x803fffff 0x735bbc82 0x0
171 [0x23b2000]: 0x85e60320 0x803fffff 0x735bb402 0x0
172 [0x23b2000]: 0x85e60320 0x803fffff 0x735bab82 0x0
173 [0x23b2000]: 0x85e60320 0x803fffff 0x735ba302 0x0
174 [0x23b2000]: 0x85e60320 0x803fffff 0x735b9a82 0x0
175 [0x23b2000]: 0x85e60320 0x803fffff 0x735b9202 0x0
176 [0x23b2000]: 0x85e60320 0x803fffff 0x735b8982 0x0
177 [0x23b2000]: 0x85e60320 0x803fffff 0x735b8102 0x0
178 [0x23b2000]: 0x85e60320 0x803fffff 0x73697802 0x0
179 [0x23b2000]: 0x85e60320 0x803fffff 0x73696f82 0x0
180 [0x23b2000]: 0x85e60320 0x803fffff 0x73696702 0x0
181 [0x23b2000]: 0x85e60320 0x803fffff 0x73695e82 0x0
182 [0x23b2000]: 0x85e60320 0x803fffff 0x73695602 0x0
183 [0x23b2000]: 0x85e60320 0x803fffff 0x73694d82 0x0
184 [0x23b2000]: 0x85e60320 0x803fffff 0x73694502 0x0
185 [0x23b2000]: 0x85e60320 0x803fffff 0x73693c82 0x0
186 [0x23b2000]: 0x85e60320 0x803fffff 0x73693402 0x0
187 [0x23b2000]: 0x85e60320 0x803fffff 0x73692b82 0x0
188 [0x23b2000]: 0x85e60320 0x803fffff 0x73692302 0x0
189 [0x23b2000]: 0x85e60320 0x803fffff 0x73691a82 0x0
190 [0x23b2000]: 0x85e60320 0x803fffff 0x73691202 0x0
191 [0x23b2000]: 0x85e60320 0x803fffff 0x73690982 0x0
192 [0x23b2000]: 0x85e60320 0x803fffff 0x73690102 0x0
193 [0x23b2000]: 0x85e60320 0x803fffff 0x7081f802 0x0
194 [0x23b2000]: 0x85e60320 0x803fffff 0x7081ef82 0x0
195 [0x23b2000]: 0x85e60320 0x803fffff 0x7081e702 0x0
196 [0x23b2000]: 0x85e60320 0x803fffff 0x7081de82 0x0
197 [0x23b2000]: 0x85e60320 0x803fffff 0x7081d602 0x0
198 [0x23b2000]: 0x85e60320 0x803fffff 0x7081cd82 0x0
199 [0x23b2000]: 0x85e60320 0x803fffff 0x7081c502 0x0
200 [0x23b2000]: 0x85e60320 0x803fffff 0x7081bc82 0x0
201 [0x23b2000]: 0x85e60320 0x803fffff 0x7081b402 0x0
202 [0x23b2000]: 0x85e60320 0x803fffff 0x7081ab82 0x0
203 [0x23b2000]: 0x85e60320 0x803fffff 0x7081a302 0x0
204 [0x23b2000]: 0x85e60320 0x803fffff 0x70819a82 0x0
205 [0x23b2000]: 0x85e60320 0x803fffff 0x70819202 0x0
206 [0x23b2000]: 0x85e60320 0x803fffff 0x70818982 0x0
207 [0x23b2000]: 0x85e60320 0x803fffff 0x70818102 0x0
208 [0x23b2000]: 0x85e60320 0x803fffff 0x73607802 0x0
209 [0x23b2000]: 0x85e60320 0x803fffff 0x73606f82 0x0
210 [0x23b2000]: 0x85e60320 0x803fffff 0x73606702 0x0
211 [0x23b2000]: 0x85e60320 0x803fffff 0x73605e82 0x0
212 [0x23b2000]: 0x85e60320 0x803fffff 0x73605602 0x0
213 [0x23b2000]: 0x85e60320 0x803fffff 0x73604d82 0x0
214 [0x23b2000]: 0x85e60320 0x803fffff 0x73604502 0x0
215 [0x23b2000]: 0x85e60320 0x803fffff 0x73603c82 0x0
216 [0x23b2000]: 0x85e60320 0x803fffff 0x73603402 0x0
217 [0x23b2000]: 0x85e60320 0x803fffff 0x73602b82 0x0
218 [0x23b2000]: 0x85e60320 0x803fffff 0x73602302 0x0
219 [0x23b2000]: 0x85e60320 0x803fffff 0x73601a82 0x0
220 [0x23b2000]: 0x85e60320 0x803fffff 0x73601202 0x0
221 [0x23b2000]: 0x85e60320 0x803fffff 0x73600982 0x0
222 [0x23b2000]: 0x85e60320 0x803fffff 0x73600102 0x0
223 [0x23b2000]: 0x85e60320 0x803fffff 0x735f7802 0x0
224 [0x23b2000]: 0x85e60320 0x803fffff 0x735f6f82 0x0
225 [0x23b2000]: 0x85e60320 0x803fffff 0x735f6702 0x0
226 [0x23b2000]: 0x85e60320 0x803fffff 0x735f5e82 0x0
227 [0x23b2000]: 0x85e60320 0x803fffff 0x735f5602 0x0
228 [0x23b2000]: 0x85e60320 0x803fffff 0x735f4d82 0x0
229 [0x23b2000]: 0x85e60320 0x803fffff 0x735f4502 0x0
230 [0x23b2000]: 0x85e60320 0x803fffff 0x735f3c82 0x0
231 [0x23b2000]: 0x85e60320 0x803fffff 0x735f3402 0x0
232 [0x23b2000]: 0x85e60320 0x803fffff 0x735f2b82 0x0
233 [0x23b2000]: 0x85e60320 0x803fffff 0x735f2302 0x0
234 [0x23b2000]: 0x85e60320 0x803fffff 0x735f1a82 0x0
235 [0x23b2000]: 0x85e60320 0x803fffff 0x735f1202 0x0
236 [0x23b2000]: 0x85e60320 0x803fffff 0x735f0982 0x0
237 [0x23b2000]: 0x85e60320 0x803fffff 0x735f0102 0x0
238 [0x23b2000]: 0x85e60320 0x803fffff 0x7369f802 0x0
239 [0x23b2000]: 0x85e60320 0x803fffff 0x7369ef82 0x0
240 [0x23b2000]: 0x85e60320 0x803fffff 0x7369e702 0x0
241 [0x23b2000]: 0x85e60320 0x803fffff 0x7369de82 0x0
242 [0x23b2000]: 0x85e60320 0x803fffff 0x7369d602 0x0
243 [0x23b2000]: 0x85e60320 0x803fffff 0x7369cd82 0x0
244 [0x23b2000]: 0x85e60320 0x803fffff 0x7369c502 0x0
245 [0x23b2000]: 0x85e60320 0x803fffff 0x7369bc82 0x0
246 [0x23b2000]: 0x85e60320 0x803fffff 0x7369b402 0x0
247 [0x23b2000]: 0x85e60320 0x803fffff 0x7369ab82 0x0
248 [0x23b2000]: 0x85e60320 0x803fffff 0x7369a302 0x0
249 [0x23b2000]: 0x85e60320 0x803fffff 0x73699a82 0x0
250 [0x23b2000]: 0x85e60320 0x803fffff 0x73699202 0x0
251 [0x23b2000]: 0x85e60320 0x803fffff 0x73698982 0x0
252 [0x23b2000]: 0x85e60320 0x803fffff 0x73698102 0x0
253 [0x23b2000]: 0x85e60320 0x803fffff 0x7360f802 0x0
254 [0x23b2000]: 0x85e60320 0x803fffff 0x7360ef82 0x0
255 [0x23b2000]: 0x85e60320 0x803fffff 0x7360e702 0x0
256 [0x23b2000]: 0x85e60320 0x803fffff 0x7360de82 0x0
257 [0x23b2000]: 0x85e60320 0x803fffff 0x7360d602 0x0
258 [0x23b2000]: 0x85e60320 0x803fffff 0x7360cd82 0x0
259 [0x23b2000]: 0x85e60320 0x803fffff 0x7360c502 0x0
260 [0x23b2000]: 0x85e60320 0x803fffff 0x7360bc82 0x0
261 [0x23b2000]: 0x85e60320 0x803fffff 0x7360b402 0x0
262 [0x23b2000]: 0x85e60320 0x803fffff 0x7360ab82 0x0
263 [0x23b2000]: 0x85e60320 0x803fffff 0x7360a302 0x0
264 [0x23b2000]: 0x85e60320 0x803fffff 0x73609a82 0x0
265 [0x23b2000]: 0x85e60320 0x803fffff 0x73609202 0x0
266 [0x23b2000]: 0x85e60320 0x803fffff 0x73608982 0x0
267 [0x23b2000]: 0x85e60320 0x803fffff 0x73608102 0x0
268 [0x23b2000]: 0x85e60320 0x803fffff 0x735ff802 0x0
269 [0x23b2000]: 0x85e60320 0x803fffff 0x735fef82 0x0
270 [0x23b2000]: 0x85e60320 0x803fffff 0x735fe702 0x0
271 [0x23b2000]: 0x85e60320 0x803fffff 0x735fde82 0x0
272 [0x23b2000]: 0x85e60320 0x803fffff 0x735fd602 0x0
273 [0x23b2000]: 0x85e60320 0x803fffff 0x735fcd82 0x0
274 [0x23b2000]: 0x85e60320 0x803fffff 0x735fc502 0x0
275 [0x23b2000]: 0x85e60320 0x803fffff 0x735fbc82 0x0
276 [0x23b2000]: 0x85e60320 0x803fffff 0x735fb402 0x0
277 [0x23b2000]: 0x85e60320 0x803fffff 0x735fab82 0x0
278 [0x23b2000]: 0x85e60320 0x803fffff 0x735fa302 0x0
279 [0x23b2000]: 0x85e60320 0x803fffff 0x735f9a82 0x0
280 [0x23b2000]: 0x85e60320 0x803fffff 0x735f9202 0x0
281 [0x23b2000]: 0x85e60320 0x803fffff 0x735f8982 0x0
282 [0x23b2000]: 0x85e60320 0x803fffff 0x735f8102 0x0
283 [0x23b2000]: 0x85e60320 0x803fffff 0x737f7802 0x0
284 [0x23b2000]: 0x85e60320 0x803fffff 0x737f6f82 0x0
285 [0x23b2000]: 0x85e60320 0x803fffff 0x737f6702 0x0
286 [0x23b2000]: 0x85e60320 0x803fffff 0x737f5e82 0x0
287 [0x23b2000]: 0x85e60320 0x803fffff 0x737f5602 0x0
288 [0x23b2000]: 0x85e60320 0x803fffff 0x737f4d82 0x0
289 [0x23b2000]: 0x85e60320 0x803fffff 0x737f4502 0x0
290 [0x23b2000]: 0x85e60320 0x803fffff 0x737f3c82 0x0
291 [0x23b2000]: 0x85e60320 0x803fffff 0x737f3402 0x0
292 [0x23b2000]: 0x85e60320 0x803fffff 0x737f2b82 0x0
293 [0x23b2000]: 0x85e60320 0x803fffff 0x737f2302 0x0
294 [0x23b2000]: 0x85e60320 0x803fffff 0x737f1a82 0x0
295 [0x23b2000]: 0x85e60320 0x803fffff 0x737f1202 0x0
296 [0x23b2000]: 0x85e60320 0x803fffff 0x737f0982 0x0
297 [0x23b2000]: 0x85e60320 0x803fffff 0x737f0102 0x0
298 [0x23b2000]: 0x85e60320 0x803fffff 0x735e7802 0x0
299 [0x23b2000]: 0x85e60320 0x803fffff 0x735e6f82 0x0
300 [0x23b2000]: 0x85e60320 0x803fffff 0x735e6702 0x0
301 [0x23b2000]: 0x85e60320 0x803fffff 0x735e5e82 0x0
302 [0x23b2000]: 0x85e60320 0x803fffff 0x735e5602 0x0
303 [0x23b2000]: 0x85e60320 0x803fffff 0x735e4d82 0x0
304 [0x23b2000]: 0x85e60320 0x803fffff 0x735e4502 0x0
305 [0x23b2000]: 0x85e60320 0x803fffff 0x735e3c82 0x0
306 [0x23b2000]: 0x85e60320 0x803fffff 0x735e3402 0x0
307 [0x23b2000]: 0x85e60320 0x803fffff 0x735e2b82 0x0
308 [0x23b2000]: 0x85e60320 0x803fffff 0x735e2302 0x0
309 [0x23b2000]: 0x85e60320 0x803fffff 0x735e1a82 0x0
310 [0x23b2000]: 0x85e60320 0x803fffff 0x735e1202 0x0
311 [0x23b2000]: 0x85e60320 0x803fffff 0x735e0982 0x0
312 [0x23b2000]: 0x85e60320 0x803fffff 0x735e0102 0x0
313 [0x23b2000]: 0x85e60320 0x803fffff 0x735ef802 0x0
314 [0x23b2000]: 0x85e60320 0x803fffff 0x735eef82 0x0
315 [0x23b2000]: 0x85e60320 0x803fffff 0x735ee702 0x0
316 [0x23b2000]: 0x85e60320 0x803fffff 0x735ede82 0x0
317 [0x23b2000]: 0x85e60320 0x803fffff 0x735ed602 0x0
318 [0x23b2000]: 0x85e60320 0x803fffff 0x735ecd82 0x0
319 [0x23b2000]: 0x85e60320 0x803fffff 0x735ec502 0x0
320 [0x23b2000]: 0x85e60320 0x803fffff 0x735ebc82 0x0
321 [0x23b2000]: 0x85e60320 0x803fffff 0x735eb402 0x0
322 [0x23b2000]: 0x85e60320 0x803fffff 0x735eab82 0x0
323 [0x23b2000]: 0x85e60320 0x803fffff 0x735ea302 0x0
324 [0x23b2000]: 0x85e60320 0x803fffff 0x735e9a82 0x0
325 [0x23b2000]: 0x85e60320 0x803fffff 0x735e9202 0x0
326 [0x23b2000]: 0x85e60320 0x803fffff 0x735e8982 0x0
327 [0x23b2000]: 0x85e60320 0x803fffff 0x735e8102 0x0
328 [0x23b2000]: 0x85e60320 0x803fffff 0x708d7802 0x0
329 [0x23b2000]: 0x85e60320 0x803fffff 0x708d6f82 0x0
330 [0x23b2000]: 0x85e60320 0x803fffff 0x708d6702 0x0
331 [0x23b2000]: 0x85e60320 0x803fffff 0x708d5e82 0x0
332 [0x23b2000]: 0x85e60320 0x803fffff 0x708d5602 0x0
333 [0x23b2000]: 0x85e60320 0x803fffff 0x708d4d82 0x0
334 [0x23b2000]: 0x85e60320 0x803fffff 0x708d4502 0x0
335 [0x23b2000]: 0x85e60320 0x803fffff 0x708d3c82 0x0
336 [0x23b2000]: 0x85e60320 0x803fffff 0x708d3402 0x0
337 [0x23b2000]: 0x85e60320 0x803fffff 0x708d2b82 0x0
338 [0x23b2000]: 0x85e60320 0x803fffff 0x708d2302 0x0
339 [0x23b2000]: 0x85e60320 0x803fffff 0x708d1a82 0x0
340 [0x23b2000]: 0x85e60320 0x803fffff 0x708d1202 0x0
341 [0x23b2000]: 0x85e60320 0x803fffff 0x708d0982 0x0
342 [0x23b2000]: 0x85e60320 0x803fffff 0x708d0102 0x0
343 [0x23b2000]: 0x85e60320 0x803fffff 0x72127802 0x0
344 [0x23b2000]: 0x85e60320 0x803fffff 0x72126f82 0x0
345 [0x23b2000]: 0x85e60320 0x803fffff 0x72126702 0x0
346 [0x23b2000]: 0x85e60320 0x803fffff 0x72125e82 0x0
347 [0x23b2000]: 0x85e60320 0x803fffff 0x72125602 0x0
348 [0x23b2000]: 0x85e60320 0x803fffff 0x72124d82 0x0
349 [0x23b2000]: 0x85e60320 0x803fffff 0x72124502 0x0
350 [0x23b2000]: 0x85e60320 0x803fffff 0x72123c82 0x0
351 [0x23b2000]: 0x85e60320 0x803fffff 0x72123402 0x0
352 [0x23b2000]: 0x85e60320 0x803fffff 0x72122b82 0x0
353 [0x23b2000]: 0x85e60320 0x803fffff 0x72122302 0x0
354 [0x23b2000]: 0x85e60320 0x803fffff 0x72121a82 0x0
355 [0x23b2000]: 0x85e60320 0x803fffff 0x72121202 0x0
356 [0x23b2000]: 0x85e60320 0x803fffff 0x72120982 0x0
357 [0x23b2000]: 0x85e60320 0x803fffff 0x72120102 0x0
358 [0x23b2000]: 0x85e60320 0x803fffff 0x720c7802 0x0
359 [0x23b2000]: 0x85e60320 0x803fffff 0x720c6f82 0x0
360 [0x23b2000]: 0x85e60320 0x803fffff 0x720c6702 0x0
361 [0x23b2000]: 0x85e60320 0x803fffff 0x720c5e82 0x0
362 [0x23b2000]: 0x85e60320 0x803fffff 0x720c5602 0x0
363 [0x23b2000]: 0x85e60320 0x803fffff 0x720c4d82 0x0
364 [0x23b2000]: 0x85e60320 0x803fffff 0x720c4502 0x0
365 [0x23b2000]: 0x85e60320 0x803fffff 0x720c3c82 0x0
366 [0x23b2000]: 0x85e60320 0x803fffff 0x720c3402 0x0
367 [0x23b2000]: 0x85e60320 0x803fffff 0x720c2b82 0x0
368 [0x23b2000]: 0x85e60320 0x803fffff 0x720c2302 0x0
369 [0x23b2000]: 0x85e60320 0x803fffff 0x720c1a82 0x0
370 [0x23b2000]: 0x85e60320 0x803fffff 0x720c1202 0x0
371 [0x23b2000]: 0x85e60320 0x803fffff 0x720c0982 0x0
372 [0x23b2000]: 0x85e60320 0x803fffff 0x720c0102 0x0
373 [0x23b2000]: 0x85e60320 0x803fffff 0x7379f802 0x0
374 [0x23b2000]: 0x85e60320 0x803fffff 0x7379ef82 0x0
375 [0x23b2000]: 0x85e60320 0x803fffff 0x7379e702 0x0
376 [0x23b2000]: 0x85e60320 0x803fffff 0x7379de82 0x0
377 [0x23b2000]: 0x85e60320 0x803fffff 0x7379d602 0x0
378 [0x23b2000]: 0x85e60320 0x803fffff 0x7379cd82 0x0
379 [0x23b2000]: 0x85e60320 0x803fffff 0x7379c502 0x0
380 [0x23b2000]: 0x85e60320 0x803fffff 0x7379bc82 0x0
381 [0x23b2000]: 0x85e60320 0x803fffff 0x7379b402 0x0
382 [0x23b2000]: 0x85e60320 0x803fffff 0x7379ab82 0x0
383 [0x23b2000]: 0x85e60320 0x803fffff 0x7379a302 0x0
384 [0x23b2000]: 0x85e60320 0x803fffff 0x73799a82 0x0
385 [0x23b2000]: 0x85e60320 0x803fffff 0x73799202 0x0
386 [0x23b2000]: 0x85e60320 0x803fffff 0x73798982 0x0
387 [0x23b2000]: 0x85e60320 0x803fffff 0x73798102 0x0
388 [0x23b2000]: 0x85e60320 0x803fffff 0x72107802 0x0
389 [0x23b2000]: 0x85e60320 0x803fffff 0x72106f82 0x0
390 [0x23b2000]: 0x85e60320 0x803fffff 0x72106702 0x0
391 [0x23b2000]: 0x85e60320 0x803fffff 0x72105e82 0x0
392 [0x23b2000]: 0x85e60320 0x803fffff 0x72105602 0x0
393 [0x23b2000]: 0x85e60320 0x803fffff 0x72104d82 0x0
394 [0x23b2000]: 0x85e60320 0x803fffff 0x72104502 0x0
395 [0x23b2000]: 0x85e60320 0x803fffff 0x72103c82 0x0
396 [0x23b2000]: 0x85e60320 0x803fffff 0x72103402 0x0
397 [0x23b2000]: 0x85e60320 0x803fffff 0x72102b82 0x0
398 [0x23b2000]: 0x85e60320 0x803fffff 0x72102302 0x0
399 [0x23b2000]: 0x85e60320 0x803fffff 0x72101a82 0x0
400 [0x23b2000]: 0x85e60320 0x803fffff 0x72101202 0x0
401 [0x23b2000]: 0x85e60320 0x803fffff 0x72100982 0x0
402 [0x23b2000]: 0x85e60320 0x803fffff 0x72100102 0x0
403 [0x23b2000]: 0x85e60320 0x803fffff 0x73557802 0x0
404 [0x23b2000]: 0x85e60320 0x803fffff 0x73556f82 0x0
405 [0x23b2000]: 0x85e60320 0x803fffff 0x73556702 0x0
406 [0x23b2000]: 0x85e60320 0x803fffff 0x73555e82 0x0
407 [0x23b2000]: 0x85e60320 0x803fffff 0x73555602 0x0
408 [0x23b2000]: 0x85e60320 0x803fffff 0x73554d82 0x0
409 [0x23b2000]: 0x85e60320 0x803fffff 0x73554502 0x0
410 [0x23b2000]: 0x85e60320 0x803fffff 0x73553c82 0x0
411 [0x23b2000]: 0x85e60320 0x803fffff 0x73553402 0x0
412 [0x23b2000]: 0x85e60320 0x803fffff 0x73552b82 0x0
413 [0x23b2000]: 0x85e60320 0x803fffff 0x73552302 0x0
414 [0x23b2000]: 0x85e60320 0x803fffff 0x73551a82 0x0
415 [0x23b2000]: 0x85e60320 0x803fffff 0x73551202 0x0
416 [0x23b2000]: 0x85e60320 0x803fffff 0x73550982 0x0
417 [0x23b2000]: 0x85e60320 0x803fffff 0x73550102 0x0
418 [0x23b2000]: 0x85e60320 0x803fffff 0x73797802 0x0
419 [0x23b2000]: 0x85e60320 0x803fffff 0x73796f82 0x0
420 [0x23b2000]: 0x85e60320 0x803fffff 0x73796702 0x0
421 [0x23b2000]: 0x85e60320 0x803fffff 0x73795e82 0x0
422 [0x23b2000]: 0x85e60320 0x803fffff 0x73795602 0x0
423 [0x23b2000]: 0x85e60320 0x803fffff 0x73794d82 0x0
424 [0x23b2000]: 0x85e60320 0x803fffff 0x73794502 0x0
425 [0x23b2000]: 0x85e60320 0x803fffff 0x73793c82 0x0
426 [0x23b2000]: 0x85e60320 0x803fffff 0x73793402 0x0
427 [0x23b2000]: 0x85e60320 0x803fffff 0x73792b82 0x0
428 [0x23b2000]: 0x85e60320 0x803fffff 0x73792302 0x0
429 [0x23b2000]: 0x85e60320 0x803fffff 0x73791a82 0x0
430 [0x23b2000]: 0x85e60320 0x803fffff 0x73791202 0x0
431 [0x23b2000]: 0x85e60320 0x803fffff 0x73790982 0x0
432 [0x23b2000]: 0x85e60320 0x803fffff 0x73790102 0x0
433 [0x23b2000]: 0x85e60320 0x803fffff 0x73517802 0x0
434 [0x23b2000]: 0x85e60320 0x803fffff 0x73516f82 0x0
435 [0x23b2000]: 0x85e60320 0x803fffff 0x73516702 0x0
436 [0x23b2000]: 0x85e60320 0x803fffff 0x73515e82 0x0
437 [0x23b2000]: 0x85e60320 0x803fffff 0x73515602 0x0
438 [0x23b2000]: 0x85e60320 0x803fffff 0x73514d82 0x0
439 [0x23b2000]: 0x85e60320 0x803fffff 0x73514502 0x0
440 [0x23b2000]: 0x85e60320 0x803fffff 0x73513c82 0x0
441 [0x23b2000]: 0x85e60320 0x803fffff 0x73513402 0x0
442 [0x23b2000]: 0x85e60320 0x803fffff 0x73512b82 0x0
443 [0x23b2000]: 0x85e60320 0x803fffff 0x73512302 0x0
444 [0x23b2000]: 0x85e60320 0x803fffff 0x73511a82 0x0
445 [0x23b2000]: 0x85e60320 0x803fffff 0x73511202 0x0
446 [0x23b2000]: 0x85e60320 0x803fffff 0x73510982 0x0
447 [0x23b2000]: 0x85e60320 0x803fffff 0x73510102 0x0
448 [0x23b2000]: 0x85e60320 0x803fffff 0x708df802 0x0
449 [0x23b2000]: 0x85e60320 0x803fffff 0x708def82 0x0
450 [0x23b2000]: 0x85e60320 0x803fffff 0x708de702 0x0
451 [0x23b2000]: 0x85e60320 0x803fffff 0x708dde82 0x0
452 [0x23b2000]: 0x85e60320 0x803fffff 0x708dd602 0x0
453 [0x23b2000]: 0x85e60320 0x803fffff 0x708dcd82 0x0
454 [0x23b2000]: 0x85e60320 0x803fffff 0x708dc502 0x0
455 [0x23b2000]: 0x85e60320 0x803fffff 0x708dbc82 0x0
456 [0x23b2000]: 0x85e60320 0x803fffff 0x708db402 0x0
457 [0x23b2000]: 0x85e60320 0x803fffff 0x708dab82 0x0
458 [0x23b2000]: 0x85e60320 0x803fffff 0x708da302 0x0
459 [0x23b2000]: 0x85e60320 0x803fffff 0x708d9a82 0x0
460 [0x23b2000]: 0x85e60320 0x803fffff 0x708d9202 0x0
461 [0x23b2000]: 0x85e60320 0x803fffff 0x708d8982 0x0
462 [0x23b2000]: 0x85e60320 0x803fffff 0x708d8102 0x0
463 [0x23b2000]: 0x85e60320 0x803fffff 0x720e7802 0x0
464 [0x23b2000]: 0x85e60320 0x803fffff 0x720e6f82 0x0
465 [0x23b2000]: 0x85e60320 0x803fffff 0x720e6702 0x0
466 [0x23b2000]: 0x85e60320 0x803fffff 0x720e5e82 0x0
467 [0x23b2000]: 0x85e60320 0x803fffff 0x720e5602 0x0
468 [0x23b2000]: 0x85e60320 0x803fffff 0x720e4d82 0x0
469 [0x23b2000]: 0x85e60320 0x803fffff 0x720e4502 0x0
470 [0x23b2000]: 0x85e60320 0x803fffff 0x720e3c82 0x0
471 [0x23b2000]: 0x85e60320 0x803fffff 0x720e3402 0x0
472 [0x23b2000]: 0x85e60320 0x803fffff 0x720e2b82 0x0
473 [0x23b2000]: 0x85e60320 0x803fffff 0x720e2302 0x0
474 [0x23b2000]: 0x85e60320 0x803fffff 0x720e1a82 0x0
475 [0x23b2000]: 0x85e60320 0x803fffff 0x720e1202 0x0
476 [0x23b2000]: 0x85e60320 0x803fffff 0x720e0982 0x0
477 [0x23b2000]: 0x85e60320 0x803fffff 0x720e0102 0x0
478 [0x23b2000]: 0x85e60320 0x803fffff 0x7375f802 0x0
479 [0x23b2000]: 0x85e60320 0x803fffff 0x7375ef82 0x0
480 [0x23b2000]: 0x85e60320 0x803fffff 0x7375e702 0x0
481 [0x23b2000]: 0x85e60320 0x803fffff 0x7375de82 0x0
482 [0x23b2000]: 0x85e60320 0x803fffff 0x7375d602 0x0
483 [0x23b2000]: 0x85e60320 0x803fffff 0x7375cd82 0x0
484 [0x23b2000]: 0x85e60320 0x803fffff 0x7375c502 0x0
485 [0x23b2000]: 0x85e60320 0x803fffff 0x7375bc82 0x0
486 [0x23b2000]: 0x85e60320 0x803fffff 0x7375b402 0x0
487 [0x23b2000]: 0x83cd0320 0x803fffff 0x7375ab82 0x0
488 [0x23b2000]: 0x80460320 0x803fffff 0x70863402 0x0
489 [0x23b2000]: 0x80400381 0x803fffff 0x70862b82 0x0
490 [0x23b2000]: 0x80400381 0x803fffff 0x70862302 0x0
491 [0x23b2000]: 0x80400381 0x803fffff 0x70861a82 0x0
492 [0x23b2000]: 0x80400381 0x803fffff 0x70861202 0x0
493 [0x23b2000]: 0x80400381 0x803fffff 0x70860982 0x0
494 [0x23b2000]: 0x80400381 0x803fffff 0x70860102 0x0
495 [0x23b2000]: 0x80400381 0x803fffff 0x73617802 0x0
496 [0x23b2000]: 0x80400381 0x803fffff 0x73616f82 0x0
497 [0x23b2000]: 0x80400381 0x803fffff 0x73616702 0x0
498 [0x23b2000]: 0x80400301 0x803fffff 0x73615e82 0x0
499 [0x23b2000]: 0x80400381 0x803fffff 0x73615602 0x0
500 [0x23b2000]: 0x80400381 0x803fffff 0x73614d82 0x0
501 [0x23b2000]: 0x80400381 0x803fffff 0x73614502 0x0
502 [0x23b2000]: 0x80400381 0x803fffff 0x73613c82 0x0
503 [0x23b2000]: 0x80400381 0x803fffff 0x73613402 0x0
504 [0x23b2000]: 0x80400381 0x803fffff 0x73612b82 0x0
505 [0x23b2000]: 0x80400381 0x803fffff 0x73612302 0x0
506 [0x23b2000]: 0x80400381 0x803fffff 0x73611a82 0x0
507 [0x23b2000]: 0x80400381 0x803fffff 0x73611202 0x0
508 [0x23b2000]: 0x80400381 0x803fffff 0x73610982 0x0
509 [0x23b2000]: 0x80400381 0x803fffff 0x73610102 0x0
510 [0x23b2000]: 0x80400381 0x803fffff 0x7378f802 0x0
511 [0x23b2000]: 0x85e60320 0x823fffff 0x7378ef82 0x0
TX descriptor ring:
0 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
1 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
2 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
3 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
4 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
5 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
6 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
7 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
8 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
9 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
10 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
11 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
12 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
13 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
14 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
15 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
16 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
17 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
18 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
19 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
20 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
21 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
22 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
23 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
24 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
25 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
26 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
27 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
28 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
29 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
30 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
31 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
32 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
33 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
34 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
35 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
36 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
37 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
38 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
39 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
40 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
41 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
42 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
43 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
44 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
45 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
46 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
47 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
48 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
49 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
50 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
51 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
52 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
53 [0x23b5000]: 0x0 0x0 0x7390789e 0x0
54 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
55 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
56 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
57 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
58 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
59 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
60 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
61 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
62 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
63 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
64 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
65 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
66 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
67 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
68 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
69 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
70 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
71 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
72 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
73 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
74 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
75 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
76 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
77 [0x23b5000]: 0x0 0x0 0x72016202 0x0
78 [0x23b5000]: 0x0 0x0 0x72016202 0x0
79 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
80 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
81 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
82 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
83 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
84 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
85 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
86 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
87 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
88 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
89 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
90 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
91 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
92 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
93 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
94 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
95 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
96 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
97 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
98 [0x23b5000]: 0x0 0x0 0x73906c9e 0x0
99 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
100 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
101 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
102 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
103 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
104 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
105 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
106 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
107 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
108 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
109 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
110 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
111 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
112 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
113 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
114 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
115 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
116 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
117 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
118 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
119 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
120 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
121 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
122 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
123 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
124 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
125 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
126 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
127 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
128 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
129 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
130 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
131 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
132 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
133 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
134 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
135 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
136 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
137 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
138 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
139 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
140 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
141 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
142 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
143 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
144 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
145 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
146 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
147 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
148 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
149 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
150 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
151 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
152 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
153 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
154 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
155 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
156 [0x23b5000]: 0x0 0x0 0x7390709e 0x0
157 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
158 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
159 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
160 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
161 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
162 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
163 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
164 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
165 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
166 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
167 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
168 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
169 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
170 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
171 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
172 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
173 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
174 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
175 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
176 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
177 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
178 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
179 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
180 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
181 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
182 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
183 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
184 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
185 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
186 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
187 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
188 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
189 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
190 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
191 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
192 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
193 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
194 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
195 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
196 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
197 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
198 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
199 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
200 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
201 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
202 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
203 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
204 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
205 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
206 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
207 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
208 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
209 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
210 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
211 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
212 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
213 [0x23b5000]: 0x0 0x0 0x7390789e 0x0
214 [0x23b5000]: 0x0 0x0 0x7390709e 0x0
215 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
216 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
217 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
218 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
219 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
220 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
221 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
222 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
223 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
224 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
225 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
226 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
227 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
228 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
229 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
230 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
231 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
232 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
233 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
234 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
235 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
236 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
237 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
238 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
239 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
240 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
241 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
242 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
243 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
244 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
245 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
246 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
247 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
248 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
249 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
250 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
251 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
252 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
253 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
254 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
255 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
256 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
257 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
258 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
259 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
260 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
261 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
262 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
263 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
264 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
265 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
266 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
267 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
268 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
269 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
270 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
271 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
272 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
273 [0x23b5000]: 0x0 0x0 0x73906c9e 0x0
274 [0x23b5000]: 0x0 0x0 0x73905c9e 0x0
275 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
276 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
277 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
278 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
279 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
280 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
281 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
282 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
283 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
284 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
285 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
286 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
287 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
288 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
289 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
290 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
291 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
292 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
293 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
294 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
295 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
296 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
297 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
298 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
299 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
300 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
301 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
302 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
303 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
304 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
305 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
306 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
307 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
308 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
309 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
310 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
311 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
312 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
313 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
314 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
315 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
316 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
317 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
318 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
319 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
320 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
321 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
322 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
323 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
324 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
325 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
326 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
327 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
328 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
329 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
330 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
331 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
332 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
333 [0x23b5000]: 0x0 0x0 0x73907c9e 0x0
334 [0x23b5000]: 0x0 0x0 0x73905c9e 0x0
335 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
336 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
337 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
338 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
339 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
340 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
341 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
342 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
343 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
344 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
345 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
346 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
347 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
348 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
349 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
350 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
351 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
352 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
353 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
354 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
355 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
356 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
357 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
358 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
359 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
360 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
361 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
362 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
363 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
364 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
365 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
366 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
367 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
368 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
369 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
370 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
371 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
372 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
373 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
374 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
375 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
376 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
377 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
378 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
379 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
380 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
381 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
382 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
383 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
384 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
385 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
386 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
387 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
388 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
389 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
390 [0x23b5000]: 0x0 0x0 0x73906c9e 0x0
391 [0x23b5000]: 0x0 0x0 0x7390709e 0x0
392 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
393 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
394 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
395 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
396 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
397 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
398 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
399 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
400 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
401 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
402 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
403 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
404 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
405 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
406 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
407 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
408 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
409 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
410 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
411 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
412 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
413 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
414 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
415 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
416 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
417 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
418 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
419 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
420 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
421 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
422 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
423 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
424 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
425 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
426 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
427 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
428 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
429 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
430 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
431 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
432 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
433 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
434 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
435 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
436 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
437 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
438 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
439 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
440 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
441 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
442 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
443 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
444 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
445 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
446 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
447 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
448 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
449 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
450 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
451 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
452 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
453 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
454 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
455 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
456 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
457 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
458 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
459 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
460 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
461 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
462 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
463 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
464 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
465 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
466 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
467 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
468 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
469 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
470 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
471 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
472 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
473 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
474 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
475 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
476 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
477 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
478 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
479 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
480 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
481 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
482 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
483 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
484 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
485 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
486 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
487 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
488 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
489 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
490 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
491 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
492 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
493 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
494 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
495 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
496 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
497 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
498 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
499 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
500 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
501 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
502 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
503 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
504 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
505 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
506 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
507 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
508 [0x23b5000]: 0x0 0x0 0x7390789e 0x0
509 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
510 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
511 [0x23b5000]: 0x0 0x2000000 0x721acc9e 0x0
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-09-11 20:39 ` Martin Blumenstingl
0 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-09-11 20:39 UTC (permalink / raw)
To: linus-amlogic
Hello,
I have a device with a Meson GXBB SoC with an stmmac IP block.
Gbit ethernet on my device is provided by a Realtek RTL8211F RGMII PHY.
Similar issues were reported in #linux-amlogic by a user with an
Odroid C2 board (= similar hardware).
The symptoms are:
Receiving data is plenty fast (I can max out my internet connection
easily, and with iperf3 I get ~900Mbit/s).
Transmitting data from the device is unfortunately very slow, traffic
sometimes even stalls completely.
I have attached the iperf results and the output of
/sys/kernel/debug/stmmaceth/eth0/descriptors_status.
Below you can find the ifconfig, netstat and stmmac dma_cap info
(*after* I ran all tests).
The "involved parties" are:
- Meson GXBB specific network configuration registers (I have have
double-checked them with the reference drivers: everything seems fine
here)
- stmmac: it seems that nobody else has reported these kind of issues
so far, however I'd still like to hear where I should enable some
debugging bits to rule out any stmmac bug
- RTL8211F PHY driver: unfortunately there are no public datasheets
available so this is hard to debug. but I'm guessing that TX delay
could cause similar issues, so this may be the cause as well.
Thanks for any input in advance!
Regards,
Martin
[root at alarm ~]# ifconfig eth0
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
inet 192.168.1.235 netmask 255.255.255.0 broadcast 192.168.1.255
ether e2:aa:53:fc:f5:c5 txqueuelen 1000 (Ethernet)
RX packets 1967602 bytes 2968750265 (2.7 GiB)
RX errors 0 dropped 0 overruns 0 frame 0
TX packets 101875 bytes 8548285 (8.1 MiB)
TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
device interrupt 18
[root at alarm ~]# netstat -i
Kernel Interface table
Iface MTU RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR Flg
eth0 1500 1967801 0 0 0 101934 0 0 0 BMRU
[root at alarm ~]# cat /sys/kernel/debug/stmmaceth/eth0/dma_cap
==============================
DMA HW features
==============================
10/100 Mbps Y
1000 Mbps Y
Half duple Y
Hash Filter: Y
Multiple MAC address registers: Y
PCS (TBI/SGMII/RTBI PHY interfatces): N
SMA (MDIO) Interface: Y
PMT Remote wake up: Y
PMT Magic Frame: Y
RMON module: Y
IEEE 1588-2002 Time Stamp: N
IEEE 1588-2008 Advanced Time Stamp:N
802.3az - Energy-Efficient Ethernet (EEE) Y
AV features: N
Checksum Offload in TX: Y
IP Checksum Offload (type1) in RX: N
IP Checksum Offload (type2) in RX: Y
RXFIFO > 2048bytes: Y
Number of Additional RX channel: 0
Number of Additional TX channel: 0
Enhanced descriptors: N
-------------- next part --------------
UDP test (iperf3):
[root at alarm ~]# iperf3 --client 192.168.1.100 -u
Connecting to host 192.168.1.100, port 5201
[ 4] local 192.168.1.235 port 38931 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth Total Datagrams
[ 4] 0.00-1.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 1.00-2.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 2.00-3.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 3.00-4.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 4.00-5.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 5.00-6.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 6.00-7.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 7.00-8.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 8.00-9.00 sec 128 KBytes 1.05 Mbits/sec 16
[ 4] 9.00-10.00 sec 128 KBytes 1.05 Mbits/sec 16
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Jitter Lost/Total Datagrams
[ 4] 0.00-10.00 sec 1.25 MBytes 1.05 Mbits/sec 12526562.925 ms 113/159 (71%)
[ 4] Sent 159 datagrams
iperf Done.
[root at alarm ~]# iperf3 --client 192.168.1.100 -u -R
Connecting to host 192.168.1.100, port 5201
Reverse mode, remote host 192.168.1.100 is sending
[ 4] local 192.168.1.235 port 45128 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth Jitter Lost/Total Datagrams
[ 4] 0.00-1.00 sec 136 KBytes 1.11 Mbits/sec 81407591.898 ms 0/17 (0%)
[ 4] 1.00-2.00 sec 128 KBytes 1.05 Mbits/sec 28987137.507 ms 0/16 (0%)
[ 4] 2.00-3.00 sec 128 KBytes 1.05 Mbits/sec 10321569.793 ms 0/16 (0%)
[ 4] 3.00-4.00 sec 128 KBytes 1.05 Mbits/sec 3675244.000 ms 0/16 (0%)
[ 4] 4.00-5.00 sec 128 KBytes 1.05 Mbits/sec 1308659.322 ms 0/16 (0%)
[ 4] 5.00-6.00 sec 128 KBytes 1.05 Mbits/sec 465979.740 ms 0/16 (0%)
[ 4] 6.00-7.00 sec 128 KBytes 1.05 Mbits/sec 165923.341 ms 0/16 (0%)
[ 4] 7.00-8.00 sec 128 KBytes 1.05 Mbits/sec 59081.019 ms 0/16 (0%)
[ 4] 8.00-9.00 sec 128 KBytes 1.05 Mbits/sec 21037.233 ms 0/16 (0%)
[ 4] 9.00-10.00 sec 128 KBytes 1.05 Mbits/sec 7490.825 ms 0/16 (0%)
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Jitter Lost/Total Datagrams
[ 4] 0.00-10.00 sec 1.26 MBytes 1.06 Mbits/sec 7490.825 ms 0/161 (0%)
[ 4] Sent 161 datagrams
iperf Done.
[root at alarm ~]#
TCP test (iperf3):
[root at alarm ~]# iperf3 --client 192.168.1.100
Connecting to host 192.168.1.100, port 5201
[ 4] local 192.168.1.235 port 47508 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 115 KBytes 937 Kbits/sec 8 1.41 KBytes
[ 4] 1.00-2.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 2.00-3.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 3.00-4.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 4.00-5.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 5.00-6.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 6.00-7.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 7.00-8.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 8.00-9.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 9.00-10.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 115 KBytes 93.8 Kbits/sec 11 sender
[ 4] 0.00-10.00 sec 7.07 KBytes 5.79 Kbits/sec receiver
iperf Done.
[root at alarm ~]# iperf3 --client 192.168.1.100 -R
Connecting to host 192.168.1.100, port 5201
Reverse mode, remote host 192.168.1.100 is sending
[ 4] local 192.168.1.235 port 47512 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 84.9 MBytes 712 Mbits/sec
[ 4] 1.00-2.00 sec 106 MBytes 891 Mbits/sec
[ 4] 2.00-3.00 sec 107 MBytes 894 Mbits/sec
[ 4] 3.00-4.00 sec 93.5 MBytes 784 Mbits/sec
[ 4] 4.00-5.00 sec 98.6 MBytes 827 Mbits/sec
[ 4] 5.00-6.00 sec 80.5 MBytes 675 Mbits/sec
[ 4] 6.00-7.00 sec 107 MBytes 894 Mbits/sec
[ 4] 7.00-8.00 sec 106 MBytes 886 Mbits/sec
[ 4] 8.00-9.00 sec 107 MBytes 894 Mbits/sec
[ 4] 9.00-10.00 sec 106 MBytes 893 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 997 MBytes 836 Mbits/sec 1569 sender
[ 4] 0.00-10.00 sec 996 MBytes 835 Mbits/sec receiver
iperf Done.
[root at alarm ~]#
-------------- next part --------------
RX descriptor ring:
0 [0x23b2000]: 0x85e60320 0x803fffff 0x7378e702 0x0
1 [0x23b2000]: 0x85e60320 0x803fffff 0x7378de82 0x0
2 [0x23b2000]: 0x85e60320 0x803fffff 0x7378d602 0x0
3 [0x23b2000]: 0x85e60320 0x803fffff 0x7378cd82 0x0
4 [0x23b2000]: 0x85e60320 0x803fffff 0x7378c502 0x0
5 [0x23b2000]: 0x85e60320 0x803fffff 0x7378bc82 0x0
6 [0x23b2000]: 0x85e60320 0x803fffff 0x7378b402 0x0
7 [0x23b2000]: 0x85e60320 0x803fffff 0x7378ab82 0x0
8 [0x23b2000]: 0x85e60320 0x803fffff 0x7378a302 0x0
9 [0x23b2000]: 0x85e60320 0x803fffff 0x73789a82 0x0
10 [0x23b2000]: 0x85e60320 0x803fffff 0x73789202 0x0
11 [0x23b2000]: 0x85e60320 0x803fffff 0x73788982 0x0
12 [0x23b2000]: 0x85e60320 0x803fffff 0x73788102 0x0
13 [0x23b2000]: 0x85e60320 0x803fffff 0x721df802 0x0
14 [0x23b2000]: 0x85e60320 0x803fffff 0x721def82 0x0
15 [0x23b2000]: 0x85e60320 0x803fffff 0x721de702 0x0
16 [0x23b2000]: 0x85e60320 0x803fffff 0x721dde82 0x0
17 [0x23b2000]: 0x85e60320 0x803fffff 0x721dd602 0x0
18 [0x23b2000]: 0x85e60320 0x803fffff 0x721dcd82 0x0
19 [0x23b2000]: 0x85e60320 0x803fffff 0x721dc502 0x0
20 [0x23b2000]: 0x85e60320 0x803fffff 0x721dbc82 0x0
21 [0x23b2000]: 0x85e60320 0x803fffff 0x721db402 0x0
22 [0x23b2000]: 0x85e60320 0x803fffff 0x721dab82 0x0
23 [0x23b2000]: 0x85e60320 0x803fffff 0x721da302 0x0
24 [0x23b2000]: 0x85e60320 0x803fffff 0x721d9a82 0x0
25 [0x23b2000]: 0x85e60320 0x803fffff 0x721d9202 0x0
26 [0x23b2000]: 0x85e60320 0x803fffff 0x721d8982 0x0
27 [0x23b2000]: 0x85e60320 0x803fffff 0x721d8102 0x0
28 [0x23b2000]: 0x85e60320 0x803fffff 0x735b7802 0x0
29 [0x23b2000]: 0x85e60320 0x803fffff 0x735b6f82 0x0
30 [0x23b2000]: 0x85e60320 0x803fffff 0x735b6702 0x0
31 [0x23b2000]: 0x85e60320 0x803fffff 0x735b5e82 0x0
32 [0x23b2000]: 0x85e60320 0x803fffff 0x735b5602 0x0
33 [0x23b2000]: 0x85e60320 0x803fffff 0x735b4d82 0x0
34 [0x23b2000]: 0x85e60320 0x803fffff 0x735b4502 0x0
35 [0x23b2000]: 0x85e60320 0x803fffff 0x735b3c82 0x0
36 [0x23b2000]: 0x85e60320 0x803fffff 0x735b3402 0x0
37 [0x23b2000]: 0x85e60320 0x803fffff 0x735b2b82 0x0
38 [0x23b2000]: 0x85e60320 0x803fffff 0x735b2302 0x0
39 [0x23b2000]: 0x85e60320 0x803fffff 0x735b1a82 0x0
40 [0x23b2000]: 0x85e60320 0x803fffff 0x735b1202 0x0
41 [0x23b2000]: 0x85e60320 0x803fffff 0x735b0982 0x0
42 [0x23b2000]: 0x85e60320 0x803fffff 0x735b0102 0x0
43 [0x23b2000]: 0x85e60320 0x803fffff 0x737e7802 0x0
44 [0x23b2000]: 0x85e60320 0x803fffff 0x737e6f82 0x0
45 [0x23b2000]: 0x85e60320 0x803fffff 0x737e6702 0x0
46 [0x23b2000]: 0x85e60320 0x803fffff 0x737e5e82 0x0
47 [0x23b2000]: 0x85e60320 0x803fffff 0x737e5602 0x0
48 [0x23b2000]: 0x85e60320 0x803fffff 0x737e4d82 0x0
49 [0x23b2000]: 0x85e60320 0x803fffff 0x737e4502 0x0
50 [0x23b2000]: 0x85e60320 0x803fffff 0x737e3c82 0x0
51 [0x23b2000]: 0x85e60320 0x803fffff 0x737e3402 0x0
52 [0x23b2000]: 0x85e60320 0x803fffff 0x737e2b82 0x0
53 [0x23b2000]: 0x85e60320 0x803fffff 0x737e2302 0x0
54 [0x23b2000]: 0x85e60320 0x803fffff 0x737e1a82 0x0
55 [0x23b2000]: 0x85e60320 0x803fffff 0x737e1202 0x0
56 [0x23b2000]: 0x85e60320 0x803fffff 0x737e0982 0x0
57 [0x23b2000]: 0x85e60320 0x803fffff 0x737e0102 0x0
58 [0x23b2000]: 0x85e60320 0x803fffff 0x7086f802 0x0
59 [0x23b2000]: 0x85e60320 0x803fffff 0x7086ef82 0x0
60 [0x23b2000]: 0x85e60320 0x803fffff 0x7086e702 0x0
61 [0x23b2000]: 0x85e60320 0x803fffff 0x7086de82 0x0
62 [0x23b2000]: 0x85e60320 0x803fffff 0x7086d602 0x0
63 [0x23b2000]: 0x85e60320 0x803fffff 0x7086cd82 0x0
64 [0x23b2000]: 0x85e60320 0x803fffff 0x7086c502 0x0
65 [0x23b2000]: 0x85e60320 0x803fffff 0x7086bc82 0x0
66 [0x23b2000]: 0x85e60320 0x803fffff 0x7086b402 0x0
67 [0x23b2000]: 0x85e60320 0x803fffff 0x7086ab82 0x0
68 [0x23b2000]: 0x85e60320 0x803fffff 0x7086a302 0x0
69 [0x23b2000]: 0x85e60320 0x803fffff 0x70869a82 0x0
70 [0x23b2000]: 0x85e60320 0x803fffff 0x70869202 0x0
71 [0x23b2000]: 0x85e60320 0x803fffff 0x70868982 0x0
72 [0x23b2000]: 0x85e60320 0x803fffff 0x70868102 0x0
73 [0x23b2000]: 0x85e60320 0x803fffff 0x7200f802 0x0
74 [0x23b2000]: 0x85e60320 0x803fffff 0x7200ef82 0x0
75 [0x23b2000]: 0x85e60320 0x803fffff 0x7200e702 0x0
76 [0x23b2000]: 0x85e60320 0x803fffff 0x7200de82 0x0
77 [0x23b2000]: 0x85e60320 0x803fffff 0x7200d602 0x0
78 [0x23b2000]: 0x85e60320 0x803fffff 0x7200cd82 0x0
79 [0x23b2000]: 0x85e60320 0x803fffff 0x7200c502 0x0
80 [0x23b2000]: 0x85e60320 0x803fffff 0x7200bc82 0x0
81 [0x23b2000]: 0x85e60320 0x803fffff 0x7200b402 0x0
82 [0x23b2000]: 0x85e60320 0x803fffff 0x7200ab82 0x0
83 [0x23b2000]: 0x85e60320 0x803fffff 0x7200a302 0x0
84 [0x23b2000]: 0x85e60320 0x803fffff 0x72009a82 0x0
85 [0x23b2000]: 0x85e60320 0x803fffff 0x72009202 0x0
86 [0x23b2000]: 0x85e60320 0x803fffff 0x72008982 0x0
87 [0x23b2000]: 0x85e60320 0x803fffff 0x72008102 0x0
88 [0x23b2000]: 0x85e60320 0x803fffff 0x721e7802 0x0
89 [0x23b2000]: 0x85e60320 0x803fffff 0x721e6f82 0x0
90 [0x23b2000]: 0x85e60320 0x803fffff 0x721e6702 0x0
91 [0x23b2000]: 0x85e60320 0x803fffff 0x721e5e82 0x0
92 [0x23b2000]: 0x85e60320 0x803fffff 0x721e5602 0x0
93 [0x23b2000]: 0x85e60320 0x803fffff 0x721e4d82 0x0
94 [0x23b2000]: 0x85e60320 0x803fffff 0x721e4502 0x0
95 [0x23b2000]: 0x85e60320 0x803fffff 0x721e3c82 0x0
96 [0x23b2000]: 0x85e60320 0x803fffff 0x721e3402 0x0
97 [0x23b2000]: 0x85e60320 0x803fffff 0x721e2b82 0x0
98 [0x23b2000]: 0x85e60320 0x803fffff 0x721e2302 0x0
99 [0x23b2000]: 0x85e60320 0x803fffff 0x721e1a82 0x0
100 [0x23b2000]: 0x85e60320 0x803fffff 0x721e1202 0x0
101 [0x23b2000]: 0x85e60320 0x803fffff 0x721e0982 0x0
102 [0x23b2000]: 0x85e60320 0x803fffff 0x721e0102 0x0
103 [0x23b2000]: 0x85e60320 0x803fffff 0x73687802 0x0
104 [0x23b2000]: 0x85e60320 0x803fffff 0x73686f82 0x0
105 [0x23b2000]: 0x85e60320 0x803fffff 0x73686702 0x0
106 [0x23b2000]: 0x85e60320 0x803fffff 0x73685e82 0x0
107 [0x23b2000]: 0x85e60320 0x803fffff 0x73685602 0x0
108 [0x23b2000]: 0x85e60320 0x803fffff 0x73684d82 0x0
109 [0x23b2000]: 0x85e60320 0x803fffff 0x73684502 0x0
110 [0x23b2000]: 0x85e60320 0x803fffff 0x73683c82 0x0
111 [0x23b2000]: 0x85e60320 0x803fffff 0x73683402 0x0
112 [0x23b2000]: 0x85e60320 0x803fffff 0x73682b82 0x0
113 [0x23b2000]: 0x85e60320 0x803fffff 0x73682302 0x0
114 [0x23b2000]: 0x85e60320 0x803fffff 0x73681a82 0x0
115 [0x23b2000]: 0x85e60320 0x803fffff 0x73681202 0x0
116 [0x23b2000]: 0x85e60320 0x803fffff 0x73680982 0x0
117 [0x23b2000]: 0x85e60320 0x803fffff 0x73680102 0x0
118 [0x23b2000]: 0x85e60320 0x803fffff 0x7205f802 0x0
119 [0x23b2000]: 0x85e60320 0x803fffff 0x7205ef82 0x0
120 [0x23b2000]: 0x85e60320 0x803fffff 0x7205e702 0x0
121 [0x23b2000]: 0x85e60320 0x803fffff 0x7205de82 0x0
122 [0x23b2000]: 0x85e60320 0x803fffff 0x7205d602 0x0
123 [0x23b2000]: 0x85e60320 0x803fffff 0x7205cd82 0x0
124 [0x23b2000]: 0x85e60320 0x803fffff 0x7205c502 0x0
125 [0x23b2000]: 0x85e60320 0x803fffff 0x7205bc82 0x0
126 [0x23b2000]: 0x85e60320 0x803fffff 0x7205b402 0x0
127 [0x23b2000]: 0x85e60320 0x803fffff 0x7205ab82 0x0
128 [0x23b2000]: 0x85e60320 0x803fffff 0x7205a302 0x0
129 [0x23b2000]: 0x85e60320 0x803fffff 0x72059a82 0x0
130 [0x23b2000]: 0x85e60320 0x803fffff 0x72059202 0x0
131 [0x23b2000]: 0x85e60320 0x803fffff 0x72058982 0x0
132 [0x23b2000]: 0x85e60320 0x803fffff 0x72058102 0x0
133 [0x23b2000]: 0x85e60320 0x803fffff 0x72167802 0x0
134 [0x23b2000]: 0x85e60320 0x803fffff 0x72166f82 0x0
135 [0x23b2000]: 0x85e60320 0x803fffff 0x72166702 0x0
136 [0x23b2000]: 0x85e60320 0x803fffff 0x72165e82 0x0
137 [0x23b2000]: 0x85e60320 0x803fffff 0x72165602 0x0
138 [0x23b2000]: 0x85e60320 0x803fffff 0x72164d82 0x0
139 [0x23b2000]: 0x85e60320 0x803fffff 0x72164502 0x0
140 [0x23b2000]: 0x85e60320 0x803fffff 0x72163c82 0x0
141 [0x23b2000]: 0x85e60320 0x803fffff 0x72163402 0x0
142 [0x23b2000]: 0x85e60320 0x803fffff 0x72162b82 0x0
143 [0x23b2000]: 0x85e60320 0x803fffff 0x72162302 0x0
144 [0x23b2000]: 0x85e60320 0x803fffff 0x72161a82 0x0
145 [0x23b2000]: 0x85e60320 0x803fffff 0x72161202 0x0
146 [0x23b2000]: 0x85e60320 0x803fffff 0x72160982 0x0
147 [0x23b2000]: 0x85e60320 0x803fffff 0x72160102 0x0
148 [0x23b2000]: 0x85e60320 0x803fffff 0x737ef802 0x0
149 [0x23b2000]: 0x85e60320 0x803fffff 0x737eef82 0x0
150 [0x23b2000]: 0x85e60320 0x803fffff 0x737ee702 0x0
151 [0x23b2000]: 0x85e60320 0x803fffff 0x737ede82 0x0
152 [0x23b2000]: 0x85e60320 0x803fffff 0x737ed602 0x0
153 [0x23b2000]: 0x85e60320 0x803fffff 0x737ecd82 0x0
154 [0x23b2000]: 0x85e60320 0x803fffff 0x737ec502 0x0
155 [0x23b2000]: 0x85e60320 0x803fffff 0x737ebc82 0x0
156 [0x23b2000]: 0x85e60320 0x803fffff 0x737eb402 0x0
157 [0x23b2000]: 0x85e60320 0x803fffff 0x737eab82 0x0
158 [0x23b2000]: 0x85e60320 0x803fffff 0x737ea302 0x0
159 [0x23b2000]: 0x85e60320 0x803fffff 0x737e9a82 0x0
160 [0x23b2000]: 0x85e60320 0x803fffff 0x737e9202 0x0
161 [0x23b2000]: 0x85e60320 0x803fffff 0x737e8982 0x0
162 [0x23b2000]: 0x85e60320 0x803fffff 0x737e8102 0x0
163 [0x23b2000]: 0x85e60320 0x803fffff 0x735bf802 0x0
164 [0x23b2000]: 0x85e60320 0x803fffff 0x735bef82 0x0
165 [0x23b2000]: 0x85e60320 0x803fffff 0x735be702 0x0
166 [0x23b2000]: 0x85e60320 0x803fffff 0x735bde82 0x0
167 [0x23b2000]: 0x85e60320 0x803fffff 0x735bd602 0x0
168 [0x23b2000]: 0x85e60320 0x803fffff 0x735bcd82 0x0
169 [0x23b2000]: 0x85e60320 0x803fffff 0x735bc502 0x0
170 [0x23b2000]: 0x85e60320 0x803fffff 0x735bbc82 0x0
171 [0x23b2000]: 0x85e60320 0x803fffff 0x735bb402 0x0
172 [0x23b2000]: 0x85e60320 0x803fffff 0x735bab82 0x0
173 [0x23b2000]: 0x85e60320 0x803fffff 0x735ba302 0x0
174 [0x23b2000]: 0x85e60320 0x803fffff 0x735b9a82 0x0
175 [0x23b2000]: 0x85e60320 0x803fffff 0x735b9202 0x0
176 [0x23b2000]: 0x85e60320 0x803fffff 0x735b8982 0x0
177 [0x23b2000]: 0x85e60320 0x803fffff 0x735b8102 0x0
178 [0x23b2000]: 0x85e60320 0x803fffff 0x73697802 0x0
179 [0x23b2000]: 0x85e60320 0x803fffff 0x73696f82 0x0
180 [0x23b2000]: 0x85e60320 0x803fffff 0x73696702 0x0
181 [0x23b2000]: 0x85e60320 0x803fffff 0x73695e82 0x0
182 [0x23b2000]: 0x85e60320 0x803fffff 0x73695602 0x0
183 [0x23b2000]: 0x85e60320 0x803fffff 0x73694d82 0x0
184 [0x23b2000]: 0x85e60320 0x803fffff 0x73694502 0x0
185 [0x23b2000]: 0x85e60320 0x803fffff 0x73693c82 0x0
186 [0x23b2000]: 0x85e60320 0x803fffff 0x73693402 0x0
187 [0x23b2000]: 0x85e60320 0x803fffff 0x73692b82 0x0
188 [0x23b2000]: 0x85e60320 0x803fffff 0x73692302 0x0
189 [0x23b2000]: 0x85e60320 0x803fffff 0x73691a82 0x0
190 [0x23b2000]: 0x85e60320 0x803fffff 0x73691202 0x0
191 [0x23b2000]: 0x85e60320 0x803fffff 0x73690982 0x0
192 [0x23b2000]: 0x85e60320 0x803fffff 0x73690102 0x0
193 [0x23b2000]: 0x85e60320 0x803fffff 0x7081f802 0x0
194 [0x23b2000]: 0x85e60320 0x803fffff 0x7081ef82 0x0
195 [0x23b2000]: 0x85e60320 0x803fffff 0x7081e702 0x0
196 [0x23b2000]: 0x85e60320 0x803fffff 0x7081de82 0x0
197 [0x23b2000]: 0x85e60320 0x803fffff 0x7081d602 0x0
198 [0x23b2000]: 0x85e60320 0x803fffff 0x7081cd82 0x0
199 [0x23b2000]: 0x85e60320 0x803fffff 0x7081c502 0x0
200 [0x23b2000]: 0x85e60320 0x803fffff 0x7081bc82 0x0
201 [0x23b2000]: 0x85e60320 0x803fffff 0x7081b402 0x0
202 [0x23b2000]: 0x85e60320 0x803fffff 0x7081ab82 0x0
203 [0x23b2000]: 0x85e60320 0x803fffff 0x7081a302 0x0
204 [0x23b2000]: 0x85e60320 0x803fffff 0x70819a82 0x0
205 [0x23b2000]: 0x85e60320 0x803fffff 0x70819202 0x0
206 [0x23b2000]: 0x85e60320 0x803fffff 0x70818982 0x0
207 [0x23b2000]: 0x85e60320 0x803fffff 0x70818102 0x0
208 [0x23b2000]: 0x85e60320 0x803fffff 0x73607802 0x0
209 [0x23b2000]: 0x85e60320 0x803fffff 0x73606f82 0x0
210 [0x23b2000]: 0x85e60320 0x803fffff 0x73606702 0x0
211 [0x23b2000]: 0x85e60320 0x803fffff 0x73605e82 0x0
212 [0x23b2000]: 0x85e60320 0x803fffff 0x73605602 0x0
213 [0x23b2000]: 0x85e60320 0x803fffff 0x73604d82 0x0
214 [0x23b2000]: 0x85e60320 0x803fffff 0x73604502 0x0
215 [0x23b2000]: 0x85e60320 0x803fffff 0x73603c82 0x0
216 [0x23b2000]: 0x85e60320 0x803fffff 0x73603402 0x0
217 [0x23b2000]: 0x85e60320 0x803fffff 0x73602b82 0x0
218 [0x23b2000]: 0x85e60320 0x803fffff 0x73602302 0x0
219 [0x23b2000]: 0x85e60320 0x803fffff 0x73601a82 0x0
220 [0x23b2000]: 0x85e60320 0x803fffff 0x73601202 0x0
221 [0x23b2000]: 0x85e60320 0x803fffff 0x73600982 0x0
222 [0x23b2000]: 0x85e60320 0x803fffff 0x73600102 0x0
223 [0x23b2000]: 0x85e60320 0x803fffff 0x735f7802 0x0
224 [0x23b2000]: 0x85e60320 0x803fffff 0x735f6f82 0x0
225 [0x23b2000]: 0x85e60320 0x803fffff 0x735f6702 0x0
226 [0x23b2000]: 0x85e60320 0x803fffff 0x735f5e82 0x0
227 [0x23b2000]: 0x85e60320 0x803fffff 0x735f5602 0x0
228 [0x23b2000]: 0x85e60320 0x803fffff 0x735f4d82 0x0
229 [0x23b2000]: 0x85e60320 0x803fffff 0x735f4502 0x0
230 [0x23b2000]: 0x85e60320 0x803fffff 0x735f3c82 0x0
231 [0x23b2000]: 0x85e60320 0x803fffff 0x735f3402 0x0
232 [0x23b2000]: 0x85e60320 0x803fffff 0x735f2b82 0x0
233 [0x23b2000]: 0x85e60320 0x803fffff 0x735f2302 0x0
234 [0x23b2000]: 0x85e60320 0x803fffff 0x735f1a82 0x0
235 [0x23b2000]: 0x85e60320 0x803fffff 0x735f1202 0x0
236 [0x23b2000]: 0x85e60320 0x803fffff 0x735f0982 0x0
237 [0x23b2000]: 0x85e60320 0x803fffff 0x735f0102 0x0
238 [0x23b2000]: 0x85e60320 0x803fffff 0x7369f802 0x0
239 [0x23b2000]: 0x85e60320 0x803fffff 0x7369ef82 0x0
240 [0x23b2000]: 0x85e60320 0x803fffff 0x7369e702 0x0
241 [0x23b2000]: 0x85e60320 0x803fffff 0x7369de82 0x0
242 [0x23b2000]: 0x85e60320 0x803fffff 0x7369d602 0x0
243 [0x23b2000]: 0x85e60320 0x803fffff 0x7369cd82 0x0
244 [0x23b2000]: 0x85e60320 0x803fffff 0x7369c502 0x0
245 [0x23b2000]: 0x85e60320 0x803fffff 0x7369bc82 0x0
246 [0x23b2000]: 0x85e60320 0x803fffff 0x7369b402 0x0
247 [0x23b2000]: 0x85e60320 0x803fffff 0x7369ab82 0x0
248 [0x23b2000]: 0x85e60320 0x803fffff 0x7369a302 0x0
249 [0x23b2000]: 0x85e60320 0x803fffff 0x73699a82 0x0
250 [0x23b2000]: 0x85e60320 0x803fffff 0x73699202 0x0
251 [0x23b2000]: 0x85e60320 0x803fffff 0x73698982 0x0
252 [0x23b2000]: 0x85e60320 0x803fffff 0x73698102 0x0
253 [0x23b2000]: 0x85e60320 0x803fffff 0x7360f802 0x0
254 [0x23b2000]: 0x85e60320 0x803fffff 0x7360ef82 0x0
255 [0x23b2000]: 0x85e60320 0x803fffff 0x7360e702 0x0
256 [0x23b2000]: 0x85e60320 0x803fffff 0x7360de82 0x0
257 [0x23b2000]: 0x85e60320 0x803fffff 0x7360d602 0x0
258 [0x23b2000]: 0x85e60320 0x803fffff 0x7360cd82 0x0
259 [0x23b2000]: 0x85e60320 0x803fffff 0x7360c502 0x0
260 [0x23b2000]: 0x85e60320 0x803fffff 0x7360bc82 0x0
261 [0x23b2000]: 0x85e60320 0x803fffff 0x7360b402 0x0
262 [0x23b2000]: 0x85e60320 0x803fffff 0x7360ab82 0x0
263 [0x23b2000]: 0x85e60320 0x803fffff 0x7360a302 0x0
264 [0x23b2000]: 0x85e60320 0x803fffff 0x73609a82 0x0
265 [0x23b2000]: 0x85e60320 0x803fffff 0x73609202 0x0
266 [0x23b2000]: 0x85e60320 0x803fffff 0x73608982 0x0
267 [0x23b2000]: 0x85e60320 0x803fffff 0x73608102 0x0
268 [0x23b2000]: 0x85e60320 0x803fffff 0x735ff802 0x0
269 [0x23b2000]: 0x85e60320 0x803fffff 0x735fef82 0x0
270 [0x23b2000]: 0x85e60320 0x803fffff 0x735fe702 0x0
271 [0x23b2000]: 0x85e60320 0x803fffff 0x735fde82 0x0
272 [0x23b2000]: 0x85e60320 0x803fffff 0x735fd602 0x0
273 [0x23b2000]: 0x85e60320 0x803fffff 0x735fcd82 0x0
274 [0x23b2000]: 0x85e60320 0x803fffff 0x735fc502 0x0
275 [0x23b2000]: 0x85e60320 0x803fffff 0x735fbc82 0x0
276 [0x23b2000]: 0x85e60320 0x803fffff 0x735fb402 0x0
277 [0x23b2000]: 0x85e60320 0x803fffff 0x735fab82 0x0
278 [0x23b2000]: 0x85e60320 0x803fffff 0x735fa302 0x0
279 [0x23b2000]: 0x85e60320 0x803fffff 0x735f9a82 0x0
280 [0x23b2000]: 0x85e60320 0x803fffff 0x735f9202 0x0
281 [0x23b2000]: 0x85e60320 0x803fffff 0x735f8982 0x0
282 [0x23b2000]: 0x85e60320 0x803fffff 0x735f8102 0x0
283 [0x23b2000]: 0x85e60320 0x803fffff 0x737f7802 0x0
284 [0x23b2000]: 0x85e60320 0x803fffff 0x737f6f82 0x0
285 [0x23b2000]: 0x85e60320 0x803fffff 0x737f6702 0x0
286 [0x23b2000]: 0x85e60320 0x803fffff 0x737f5e82 0x0
287 [0x23b2000]: 0x85e60320 0x803fffff 0x737f5602 0x0
288 [0x23b2000]: 0x85e60320 0x803fffff 0x737f4d82 0x0
289 [0x23b2000]: 0x85e60320 0x803fffff 0x737f4502 0x0
290 [0x23b2000]: 0x85e60320 0x803fffff 0x737f3c82 0x0
291 [0x23b2000]: 0x85e60320 0x803fffff 0x737f3402 0x0
292 [0x23b2000]: 0x85e60320 0x803fffff 0x737f2b82 0x0
293 [0x23b2000]: 0x85e60320 0x803fffff 0x737f2302 0x0
294 [0x23b2000]: 0x85e60320 0x803fffff 0x737f1a82 0x0
295 [0x23b2000]: 0x85e60320 0x803fffff 0x737f1202 0x0
296 [0x23b2000]: 0x85e60320 0x803fffff 0x737f0982 0x0
297 [0x23b2000]: 0x85e60320 0x803fffff 0x737f0102 0x0
298 [0x23b2000]: 0x85e60320 0x803fffff 0x735e7802 0x0
299 [0x23b2000]: 0x85e60320 0x803fffff 0x735e6f82 0x0
300 [0x23b2000]: 0x85e60320 0x803fffff 0x735e6702 0x0
301 [0x23b2000]: 0x85e60320 0x803fffff 0x735e5e82 0x0
302 [0x23b2000]: 0x85e60320 0x803fffff 0x735e5602 0x0
303 [0x23b2000]: 0x85e60320 0x803fffff 0x735e4d82 0x0
304 [0x23b2000]: 0x85e60320 0x803fffff 0x735e4502 0x0
305 [0x23b2000]: 0x85e60320 0x803fffff 0x735e3c82 0x0
306 [0x23b2000]: 0x85e60320 0x803fffff 0x735e3402 0x0
307 [0x23b2000]: 0x85e60320 0x803fffff 0x735e2b82 0x0
308 [0x23b2000]: 0x85e60320 0x803fffff 0x735e2302 0x0
309 [0x23b2000]: 0x85e60320 0x803fffff 0x735e1a82 0x0
310 [0x23b2000]: 0x85e60320 0x803fffff 0x735e1202 0x0
311 [0x23b2000]: 0x85e60320 0x803fffff 0x735e0982 0x0
312 [0x23b2000]: 0x85e60320 0x803fffff 0x735e0102 0x0
313 [0x23b2000]: 0x85e60320 0x803fffff 0x735ef802 0x0
314 [0x23b2000]: 0x85e60320 0x803fffff 0x735eef82 0x0
315 [0x23b2000]: 0x85e60320 0x803fffff 0x735ee702 0x0
316 [0x23b2000]: 0x85e60320 0x803fffff 0x735ede82 0x0
317 [0x23b2000]: 0x85e60320 0x803fffff 0x735ed602 0x0
318 [0x23b2000]: 0x85e60320 0x803fffff 0x735ecd82 0x0
319 [0x23b2000]: 0x85e60320 0x803fffff 0x735ec502 0x0
320 [0x23b2000]: 0x85e60320 0x803fffff 0x735ebc82 0x0
321 [0x23b2000]: 0x85e60320 0x803fffff 0x735eb402 0x0
322 [0x23b2000]: 0x85e60320 0x803fffff 0x735eab82 0x0
323 [0x23b2000]: 0x85e60320 0x803fffff 0x735ea302 0x0
324 [0x23b2000]: 0x85e60320 0x803fffff 0x735e9a82 0x0
325 [0x23b2000]: 0x85e60320 0x803fffff 0x735e9202 0x0
326 [0x23b2000]: 0x85e60320 0x803fffff 0x735e8982 0x0
327 [0x23b2000]: 0x85e60320 0x803fffff 0x735e8102 0x0
328 [0x23b2000]: 0x85e60320 0x803fffff 0x708d7802 0x0
329 [0x23b2000]: 0x85e60320 0x803fffff 0x708d6f82 0x0
330 [0x23b2000]: 0x85e60320 0x803fffff 0x708d6702 0x0
331 [0x23b2000]: 0x85e60320 0x803fffff 0x708d5e82 0x0
332 [0x23b2000]: 0x85e60320 0x803fffff 0x708d5602 0x0
333 [0x23b2000]: 0x85e60320 0x803fffff 0x708d4d82 0x0
334 [0x23b2000]: 0x85e60320 0x803fffff 0x708d4502 0x0
335 [0x23b2000]: 0x85e60320 0x803fffff 0x708d3c82 0x0
336 [0x23b2000]: 0x85e60320 0x803fffff 0x708d3402 0x0
337 [0x23b2000]: 0x85e60320 0x803fffff 0x708d2b82 0x0
338 [0x23b2000]: 0x85e60320 0x803fffff 0x708d2302 0x0
339 [0x23b2000]: 0x85e60320 0x803fffff 0x708d1a82 0x0
340 [0x23b2000]: 0x85e60320 0x803fffff 0x708d1202 0x0
341 [0x23b2000]: 0x85e60320 0x803fffff 0x708d0982 0x0
342 [0x23b2000]: 0x85e60320 0x803fffff 0x708d0102 0x0
343 [0x23b2000]: 0x85e60320 0x803fffff 0x72127802 0x0
344 [0x23b2000]: 0x85e60320 0x803fffff 0x72126f82 0x0
345 [0x23b2000]: 0x85e60320 0x803fffff 0x72126702 0x0
346 [0x23b2000]: 0x85e60320 0x803fffff 0x72125e82 0x0
347 [0x23b2000]: 0x85e60320 0x803fffff 0x72125602 0x0
348 [0x23b2000]: 0x85e60320 0x803fffff 0x72124d82 0x0
349 [0x23b2000]: 0x85e60320 0x803fffff 0x72124502 0x0
350 [0x23b2000]: 0x85e60320 0x803fffff 0x72123c82 0x0
351 [0x23b2000]: 0x85e60320 0x803fffff 0x72123402 0x0
352 [0x23b2000]: 0x85e60320 0x803fffff 0x72122b82 0x0
353 [0x23b2000]: 0x85e60320 0x803fffff 0x72122302 0x0
354 [0x23b2000]: 0x85e60320 0x803fffff 0x72121a82 0x0
355 [0x23b2000]: 0x85e60320 0x803fffff 0x72121202 0x0
356 [0x23b2000]: 0x85e60320 0x803fffff 0x72120982 0x0
357 [0x23b2000]: 0x85e60320 0x803fffff 0x72120102 0x0
358 [0x23b2000]: 0x85e60320 0x803fffff 0x720c7802 0x0
359 [0x23b2000]: 0x85e60320 0x803fffff 0x720c6f82 0x0
360 [0x23b2000]: 0x85e60320 0x803fffff 0x720c6702 0x0
361 [0x23b2000]: 0x85e60320 0x803fffff 0x720c5e82 0x0
362 [0x23b2000]: 0x85e60320 0x803fffff 0x720c5602 0x0
363 [0x23b2000]: 0x85e60320 0x803fffff 0x720c4d82 0x0
364 [0x23b2000]: 0x85e60320 0x803fffff 0x720c4502 0x0
365 [0x23b2000]: 0x85e60320 0x803fffff 0x720c3c82 0x0
366 [0x23b2000]: 0x85e60320 0x803fffff 0x720c3402 0x0
367 [0x23b2000]: 0x85e60320 0x803fffff 0x720c2b82 0x0
368 [0x23b2000]: 0x85e60320 0x803fffff 0x720c2302 0x0
369 [0x23b2000]: 0x85e60320 0x803fffff 0x720c1a82 0x0
370 [0x23b2000]: 0x85e60320 0x803fffff 0x720c1202 0x0
371 [0x23b2000]: 0x85e60320 0x803fffff 0x720c0982 0x0
372 [0x23b2000]: 0x85e60320 0x803fffff 0x720c0102 0x0
373 [0x23b2000]: 0x85e60320 0x803fffff 0x7379f802 0x0
374 [0x23b2000]: 0x85e60320 0x803fffff 0x7379ef82 0x0
375 [0x23b2000]: 0x85e60320 0x803fffff 0x7379e702 0x0
376 [0x23b2000]: 0x85e60320 0x803fffff 0x7379de82 0x0
377 [0x23b2000]: 0x85e60320 0x803fffff 0x7379d602 0x0
378 [0x23b2000]: 0x85e60320 0x803fffff 0x7379cd82 0x0
379 [0x23b2000]: 0x85e60320 0x803fffff 0x7379c502 0x0
380 [0x23b2000]: 0x85e60320 0x803fffff 0x7379bc82 0x0
381 [0x23b2000]: 0x85e60320 0x803fffff 0x7379b402 0x0
382 [0x23b2000]: 0x85e60320 0x803fffff 0x7379ab82 0x0
383 [0x23b2000]: 0x85e60320 0x803fffff 0x7379a302 0x0
384 [0x23b2000]: 0x85e60320 0x803fffff 0x73799a82 0x0
385 [0x23b2000]: 0x85e60320 0x803fffff 0x73799202 0x0
386 [0x23b2000]: 0x85e60320 0x803fffff 0x73798982 0x0
387 [0x23b2000]: 0x85e60320 0x803fffff 0x73798102 0x0
388 [0x23b2000]: 0x85e60320 0x803fffff 0x72107802 0x0
389 [0x23b2000]: 0x85e60320 0x803fffff 0x72106f82 0x0
390 [0x23b2000]: 0x85e60320 0x803fffff 0x72106702 0x0
391 [0x23b2000]: 0x85e60320 0x803fffff 0x72105e82 0x0
392 [0x23b2000]: 0x85e60320 0x803fffff 0x72105602 0x0
393 [0x23b2000]: 0x85e60320 0x803fffff 0x72104d82 0x0
394 [0x23b2000]: 0x85e60320 0x803fffff 0x72104502 0x0
395 [0x23b2000]: 0x85e60320 0x803fffff 0x72103c82 0x0
396 [0x23b2000]: 0x85e60320 0x803fffff 0x72103402 0x0
397 [0x23b2000]: 0x85e60320 0x803fffff 0x72102b82 0x0
398 [0x23b2000]: 0x85e60320 0x803fffff 0x72102302 0x0
399 [0x23b2000]: 0x85e60320 0x803fffff 0x72101a82 0x0
400 [0x23b2000]: 0x85e60320 0x803fffff 0x72101202 0x0
401 [0x23b2000]: 0x85e60320 0x803fffff 0x72100982 0x0
402 [0x23b2000]: 0x85e60320 0x803fffff 0x72100102 0x0
403 [0x23b2000]: 0x85e60320 0x803fffff 0x73557802 0x0
404 [0x23b2000]: 0x85e60320 0x803fffff 0x73556f82 0x0
405 [0x23b2000]: 0x85e60320 0x803fffff 0x73556702 0x0
406 [0x23b2000]: 0x85e60320 0x803fffff 0x73555e82 0x0
407 [0x23b2000]: 0x85e60320 0x803fffff 0x73555602 0x0
408 [0x23b2000]: 0x85e60320 0x803fffff 0x73554d82 0x0
409 [0x23b2000]: 0x85e60320 0x803fffff 0x73554502 0x0
410 [0x23b2000]: 0x85e60320 0x803fffff 0x73553c82 0x0
411 [0x23b2000]: 0x85e60320 0x803fffff 0x73553402 0x0
412 [0x23b2000]: 0x85e60320 0x803fffff 0x73552b82 0x0
413 [0x23b2000]: 0x85e60320 0x803fffff 0x73552302 0x0
414 [0x23b2000]: 0x85e60320 0x803fffff 0x73551a82 0x0
415 [0x23b2000]: 0x85e60320 0x803fffff 0x73551202 0x0
416 [0x23b2000]: 0x85e60320 0x803fffff 0x73550982 0x0
417 [0x23b2000]: 0x85e60320 0x803fffff 0x73550102 0x0
418 [0x23b2000]: 0x85e60320 0x803fffff 0x73797802 0x0
419 [0x23b2000]: 0x85e60320 0x803fffff 0x73796f82 0x0
420 [0x23b2000]: 0x85e60320 0x803fffff 0x73796702 0x0
421 [0x23b2000]: 0x85e60320 0x803fffff 0x73795e82 0x0
422 [0x23b2000]: 0x85e60320 0x803fffff 0x73795602 0x0
423 [0x23b2000]: 0x85e60320 0x803fffff 0x73794d82 0x0
424 [0x23b2000]: 0x85e60320 0x803fffff 0x73794502 0x0
425 [0x23b2000]: 0x85e60320 0x803fffff 0x73793c82 0x0
426 [0x23b2000]: 0x85e60320 0x803fffff 0x73793402 0x0
427 [0x23b2000]: 0x85e60320 0x803fffff 0x73792b82 0x0
428 [0x23b2000]: 0x85e60320 0x803fffff 0x73792302 0x0
429 [0x23b2000]: 0x85e60320 0x803fffff 0x73791a82 0x0
430 [0x23b2000]: 0x85e60320 0x803fffff 0x73791202 0x0
431 [0x23b2000]: 0x85e60320 0x803fffff 0x73790982 0x0
432 [0x23b2000]: 0x85e60320 0x803fffff 0x73790102 0x0
433 [0x23b2000]: 0x85e60320 0x803fffff 0x73517802 0x0
434 [0x23b2000]: 0x85e60320 0x803fffff 0x73516f82 0x0
435 [0x23b2000]: 0x85e60320 0x803fffff 0x73516702 0x0
436 [0x23b2000]: 0x85e60320 0x803fffff 0x73515e82 0x0
437 [0x23b2000]: 0x85e60320 0x803fffff 0x73515602 0x0
438 [0x23b2000]: 0x85e60320 0x803fffff 0x73514d82 0x0
439 [0x23b2000]: 0x85e60320 0x803fffff 0x73514502 0x0
440 [0x23b2000]: 0x85e60320 0x803fffff 0x73513c82 0x0
441 [0x23b2000]: 0x85e60320 0x803fffff 0x73513402 0x0
442 [0x23b2000]: 0x85e60320 0x803fffff 0x73512b82 0x0
443 [0x23b2000]: 0x85e60320 0x803fffff 0x73512302 0x0
444 [0x23b2000]: 0x85e60320 0x803fffff 0x73511a82 0x0
445 [0x23b2000]: 0x85e60320 0x803fffff 0x73511202 0x0
446 [0x23b2000]: 0x85e60320 0x803fffff 0x73510982 0x0
447 [0x23b2000]: 0x85e60320 0x803fffff 0x73510102 0x0
448 [0x23b2000]: 0x85e60320 0x803fffff 0x708df802 0x0
449 [0x23b2000]: 0x85e60320 0x803fffff 0x708def82 0x0
450 [0x23b2000]: 0x85e60320 0x803fffff 0x708de702 0x0
451 [0x23b2000]: 0x85e60320 0x803fffff 0x708dde82 0x0
452 [0x23b2000]: 0x85e60320 0x803fffff 0x708dd602 0x0
453 [0x23b2000]: 0x85e60320 0x803fffff 0x708dcd82 0x0
454 [0x23b2000]: 0x85e60320 0x803fffff 0x708dc502 0x0
455 [0x23b2000]: 0x85e60320 0x803fffff 0x708dbc82 0x0
456 [0x23b2000]: 0x85e60320 0x803fffff 0x708db402 0x0
457 [0x23b2000]: 0x85e60320 0x803fffff 0x708dab82 0x0
458 [0x23b2000]: 0x85e60320 0x803fffff 0x708da302 0x0
459 [0x23b2000]: 0x85e60320 0x803fffff 0x708d9a82 0x0
460 [0x23b2000]: 0x85e60320 0x803fffff 0x708d9202 0x0
461 [0x23b2000]: 0x85e60320 0x803fffff 0x708d8982 0x0
462 [0x23b2000]: 0x85e60320 0x803fffff 0x708d8102 0x0
463 [0x23b2000]: 0x85e60320 0x803fffff 0x720e7802 0x0
464 [0x23b2000]: 0x85e60320 0x803fffff 0x720e6f82 0x0
465 [0x23b2000]: 0x85e60320 0x803fffff 0x720e6702 0x0
466 [0x23b2000]: 0x85e60320 0x803fffff 0x720e5e82 0x0
467 [0x23b2000]: 0x85e60320 0x803fffff 0x720e5602 0x0
468 [0x23b2000]: 0x85e60320 0x803fffff 0x720e4d82 0x0
469 [0x23b2000]: 0x85e60320 0x803fffff 0x720e4502 0x0
470 [0x23b2000]: 0x85e60320 0x803fffff 0x720e3c82 0x0
471 [0x23b2000]: 0x85e60320 0x803fffff 0x720e3402 0x0
472 [0x23b2000]: 0x85e60320 0x803fffff 0x720e2b82 0x0
473 [0x23b2000]: 0x85e60320 0x803fffff 0x720e2302 0x0
474 [0x23b2000]: 0x85e60320 0x803fffff 0x720e1a82 0x0
475 [0x23b2000]: 0x85e60320 0x803fffff 0x720e1202 0x0
476 [0x23b2000]: 0x85e60320 0x803fffff 0x720e0982 0x0
477 [0x23b2000]: 0x85e60320 0x803fffff 0x720e0102 0x0
478 [0x23b2000]: 0x85e60320 0x803fffff 0x7375f802 0x0
479 [0x23b2000]: 0x85e60320 0x803fffff 0x7375ef82 0x0
480 [0x23b2000]: 0x85e60320 0x803fffff 0x7375e702 0x0
481 [0x23b2000]: 0x85e60320 0x803fffff 0x7375de82 0x0
482 [0x23b2000]: 0x85e60320 0x803fffff 0x7375d602 0x0
483 [0x23b2000]: 0x85e60320 0x803fffff 0x7375cd82 0x0
484 [0x23b2000]: 0x85e60320 0x803fffff 0x7375c502 0x0
485 [0x23b2000]: 0x85e60320 0x803fffff 0x7375bc82 0x0
486 [0x23b2000]: 0x85e60320 0x803fffff 0x7375b402 0x0
487 [0x23b2000]: 0x83cd0320 0x803fffff 0x7375ab82 0x0
488 [0x23b2000]: 0x80460320 0x803fffff 0x70863402 0x0
489 [0x23b2000]: 0x80400381 0x803fffff 0x70862b82 0x0
490 [0x23b2000]: 0x80400381 0x803fffff 0x70862302 0x0
491 [0x23b2000]: 0x80400381 0x803fffff 0x70861a82 0x0
492 [0x23b2000]: 0x80400381 0x803fffff 0x70861202 0x0
493 [0x23b2000]: 0x80400381 0x803fffff 0x70860982 0x0
494 [0x23b2000]: 0x80400381 0x803fffff 0x70860102 0x0
495 [0x23b2000]: 0x80400381 0x803fffff 0x73617802 0x0
496 [0x23b2000]: 0x80400381 0x803fffff 0x73616f82 0x0
497 [0x23b2000]: 0x80400381 0x803fffff 0x73616702 0x0
498 [0x23b2000]: 0x80400301 0x803fffff 0x73615e82 0x0
499 [0x23b2000]: 0x80400381 0x803fffff 0x73615602 0x0
500 [0x23b2000]: 0x80400381 0x803fffff 0x73614d82 0x0
501 [0x23b2000]: 0x80400381 0x803fffff 0x73614502 0x0
502 [0x23b2000]: 0x80400381 0x803fffff 0x73613c82 0x0
503 [0x23b2000]: 0x80400381 0x803fffff 0x73613402 0x0
504 [0x23b2000]: 0x80400381 0x803fffff 0x73612b82 0x0
505 [0x23b2000]: 0x80400381 0x803fffff 0x73612302 0x0
506 [0x23b2000]: 0x80400381 0x803fffff 0x73611a82 0x0
507 [0x23b2000]: 0x80400381 0x803fffff 0x73611202 0x0
508 [0x23b2000]: 0x80400381 0x803fffff 0x73610982 0x0
509 [0x23b2000]: 0x80400381 0x803fffff 0x73610102 0x0
510 [0x23b2000]: 0x80400381 0x803fffff 0x7378f802 0x0
511 [0x23b2000]: 0x85e60320 0x823fffff 0x7378ef82 0x0
TX descriptor ring:
0 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
1 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
2 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
3 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
4 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
5 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
6 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
7 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
8 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
9 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
10 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
11 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
12 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
13 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
14 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
15 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
16 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
17 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
18 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
19 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
20 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
21 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
22 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
23 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
24 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
25 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
26 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
27 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
28 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
29 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
30 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
31 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
32 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
33 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
34 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
35 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
36 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
37 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
38 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
39 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
40 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
41 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
42 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
43 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
44 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
45 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
46 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
47 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
48 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
49 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
50 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
51 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
52 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
53 [0x23b5000]: 0x0 0x0 0x7390789e 0x0
54 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
55 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
56 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
57 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
58 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
59 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
60 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
61 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
62 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
63 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
64 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
65 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
66 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
67 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
68 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
69 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
70 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
71 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
72 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
73 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
74 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
75 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
76 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
77 [0x23b5000]: 0x0 0x0 0x72016202 0x0
78 [0x23b5000]: 0x0 0x0 0x72016202 0x0
79 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
80 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
81 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
82 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
83 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
84 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
85 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
86 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
87 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
88 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
89 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
90 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
91 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
92 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
93 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
94 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
95 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
96 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
97 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
98 [0x23b5000]: 0x0 0x0 0x73906c9e 0x0
99 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
100 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
101 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
102 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
103 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
104 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
105 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
106 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
107 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
108 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
109 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
110 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
111 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
112 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
113 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
114 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
115 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
116 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
117 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
118 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
119 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
120 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
121 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
122 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
123 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
124 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
125 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
126 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
127 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
128 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
129 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
130 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
131 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
132 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
133 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
134 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
135 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
136 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
137 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
138 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
139 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
140 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
141 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
142 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
143 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
144 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
145 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
146 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
147 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
148 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
149 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
150 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
151 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
152 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
153 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
154 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
155 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
156 [0x23b5000]: 0x0 0x0 0x7390709e 0x0
157 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
158 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
159 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
160 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
161 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
162 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
163 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
164 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
165 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
166 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
167 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
168 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
169 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
170 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
171 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
172 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
173 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
174 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
175 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
176 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
177 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
178 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
179 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
180 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
181 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
182 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
183 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
184 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
185 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
186 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
187 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
188 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
189 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
190 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
191 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
192 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
193 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
194 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
195 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
196 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
197 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
198 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
199 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
200 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
201 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
202 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
203 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
204 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
205 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
206 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
207 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
208 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
209 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
210 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
211 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
212 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
213 [0x23b5000]: 0x0 0x0 0x7390789e 0x0
214 [0x23b5000]: 0x0 0x0 0x7390709e 0x0
215 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
216 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
217 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
218 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
219 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
220 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
221 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
222 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
223 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
224 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
225 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
226 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
227 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
228 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
229 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
230 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
231 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
232 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
233 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
234 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
235 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
236 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
237 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
238 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
239 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
240 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
241 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
242 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
243 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
244 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
245 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
246 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
247 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
248 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
249 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
250 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
251 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
252 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
253 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
254 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
255 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
256 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
257 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
258 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
259 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
260 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
261 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
262 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
263 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
264 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
265 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
266 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
267 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
268 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
269 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
270 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
271 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
272 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
273 [0x23b5000]: 0x0 0x0 0x73906c9e 0x0
274 [0x23b5000]: 0x0 0x0 0x73905c9e 0x0
275 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
276 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
277 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
278 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
279 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
280 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
281 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
282 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
283 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
284 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
285 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
286 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
287 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
288 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
289 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
290 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
291 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
292 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
293 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
294 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
295 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
296 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
297 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
298 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
299 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
300 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
301 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
302 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
303 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
304 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
305 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
306 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
307 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
308 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
309 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
310 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
311 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
312 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
313 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
314 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
315 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
316 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
317 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
318 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
319 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
320 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
321 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
322 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
323 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
324 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
325 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
326 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
327 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
328 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
329 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
330 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
331 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
332 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
333 [0x23b5000]: 0x0 0x0 0x73907c9e 0x0
334 [0x23b5000]: 0x0 0x0 0x73905c9e 0x0
335 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
336 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
337 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
338 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
339 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
340 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
341 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
342 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
343 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
344 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
345 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
346 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
347 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
348 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
349 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
350 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
351 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
352 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
353 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
354 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
355 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
356 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
357 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
358 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
359 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
360 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
361 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
362 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
363 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
364 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
365 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
366 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
367 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
368 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
369 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
370 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
371 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
372 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
373 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
374 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
375 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
376 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
377 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
378 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
379 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
380 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
381 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
382 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
383 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
384 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
385 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
386 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
387 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
388 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
389 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
390 [0x23b5000]: 0x0 0x0 0x73906c9e 0x0
391 [0x23b5000]: 0x0 0x0 0x7390709e 0x0
392 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
393 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
394 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
395 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
396 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
397 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
398 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
399 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
400 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
401 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
402 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
403 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
404 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
405 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
406 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
407 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
408 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
409 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
410 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
411 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
412 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
413 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
414 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
415 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
416 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
417 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
418 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
419 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
420 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
421 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
422 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
423 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
424 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
425 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
426 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
427 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
428 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
429 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
430 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
431 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
432 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
433 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
434 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
435 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
436 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
437 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
438 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
439 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
440 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
441 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
442 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
443 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
444 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
445 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
446 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
447 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
448 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
449 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
450 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
451 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
452 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
453 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
454 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
455 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
456 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
457 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
458 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
459 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
460 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
461 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
462 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
463 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
464 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
465 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
466 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
467 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
468 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
469 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
470 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
471 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
472 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
473 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
474 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
475 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
476 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
477 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
478 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
479 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
480 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
481 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
482 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
483 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
484 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
485 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
486 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
487 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
488 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
489 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
490 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
491 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
492 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
493 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
494 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
495 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
496 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
497 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
498 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
499 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
500 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
501 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
502 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
503 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
504 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
505 [0x23b5000]: 0x0 0x0 0x721ad49e 0x0
506 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
507 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
508 [0x23b5000]: 0x0 0x0 0x7390789e 0x0
509 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
510 [0x23b5000]: 0x0 0x0 0x721acc9e 0x0
511 [0x23b5000]: 0x0 0x2000000 0x721acc9e 0x0
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-09-11 20:39 ` Martin Blumenstingl
@ 2016-09-12 16:37 ` Alexandre Torgue
-1 siblings, 0 replies; 56+ messages in thread
From: Alexandre Torgue @ 2016-09-12 16:37 UTC (permalink / raw)
To: Martin Blumenstingl, netdev, linux-amlogic
Cc: Giuseppe Cavallaro, Johnson Leung
Hi Martin,
On 09/11/2016 10:39 PM, Martin Blumenstingl wrote:
> Hello,
>
> I have a device with a Meson GXBB SoC with an stmmac IP block.
Which Synopsys IP version do you use ?
> Gbit ethernet on my device is provided by a Realtek RTL8211F RGMII PHY.
> Similar issues were reported in #linux-amlogic by a user with an
> Odroid C2 board (= similar hardware).
>
> The symptoms are:
> Receiving data is plenty fast (I can max out my internet connection
> easily, and with iperf3 I get ~900Mbit/s).
> Transmitting data from the device is unfortunately very slow, traffic
> sometimes even stalls completely.
>
> I have attached the iperf results and the output of
> /sys/kernel/debug/stmmaceth/eth0/descriptors_status.
> Below you can find the ifconfig, netstat and stmmac dma_cap info
> (*after* I ran all tests).
>
> The "involved parties" are:
> - Meson GXBB specific network configuration registers (I have have
> double-checked them with the reference drivers: everything seems fine
> here)
> - stmmac: it seems that nobody else has reported these kind of issues
> so far, however I'd still like to hear where I should enable some
> debugging bits to rule out any stmmac bug
On my side, I just tested on the same "kind" of system:
-SYNOPSYS GMAC 3.7
-RTL8211EG as PHY
With I perf, I reach:
-RX: 932 Mbps
-TX: 820Mbps
Can you check ethtool -S eth0 (most precisely "MMC"counter and errors) ?
Which kernel version do you use ?
Regards
Alex
> - RTL8211F PHY driver: unfortunately there are no public datasheets
> available so this is hard to debug. but I'm guessing that TX delay
> could cause similar issues, so this may be the cause as well.
>
>
> Thanks for any input in advance!
> Regards,
> Martin
>
>
> [root@alarm ~]# ifconfig eth0
> eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
> inet 192.168.1.235 netmask 255.255.255.0 broadcast 192.168.1.255
> ether e2:aa:53:fc:f5:c5 txqueuelen 1000 (Ethernet)
> RX packets 1967602 bytes 2968750265 (2.7 GiB)
> RX errors 0 dropped 0 overruns 0 frame 0
> TX packets 101875 bytes 8548285 (8.1 MiB)
> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
> device interrupt 18
>
> [root@alarm ~]# netstat -i
> Kernel Interface table
> Iface MTU RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR Flg
> eth0 1500 1967801 0 0 0 101934 0 0 0 BMRU
>
> [root@alarm ~]# cat /sys/kernel/debug/stmmaceth/eth0/dma_cap
> ==============================
> DMA HW features
> ==============================
> 10/100 Mbps Y
> 1000 Mbps Y
> Half duple Y
> Hash Filter: Y
> Multiple MAC address registers: Y
> PCS (TBI/SGMII/RTBI PHY interfatces): N
> SMA (MDIO) Interface: Y
> PMT Remote wake up: Y
> PMT Magic Frame: Y
> RMON module: Y
> IEEE 1588-2002 Time Stamp: N
> IEEE 1588-2008 Advanced Time Stamp:N
> 802.3az - Energy-Efficient Ethernet (EEE) Y
> AV features: N
> Checksum Offload in TX: Y
> IP Checksum Offload (type1) in RX: N
> IP Checksum Offload (type2) in RX: Y
> RXFIFO > 2048bytes: Y
> Number of Additional RX channel: 0
> Number of Additional TX channel: 0
> Enhanced descriptors: N
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-09-12 16:37 ` Alexandre Torgue
0 siblings, 0 replies; 56+ messages in thread
From: Alexandre Torgue @ 2016-09-12 16:37 UTC (permalink / raw)
To: linus-amlogic
Hi Martin,
On 09/11/2016 10:39 PM, Martin Blumenstingl wrote:
> Hello,
>
> I have a device with a Meson GXBB SoC with an stmmac IP block.
Which Synopsys IP version do you use ?
> Gbit ethernet on my device is provided by a Realtek RTL8211F RGMII PHY.
> Similar issues were reported in #linux-amlogic by a user with an
> Odroid C2 board (= similar hardware).
>
> The symptoms are:
> Receiving data is plenty fast (I can max out my internet connection
> easily, and with iperf3 I get ~900Mbit/s).
> Transmitting data from the device is unfortunately very slow, traffic
> sometimes even stalls completely.
>
> I have attached the iperf results and the output of
> /sys/kernel/debug/stmmaceth/eth0/descriptors_status.
> Below you can find the ifconfig, netstat and stmmac dma_cap info
> (*after* I ran all tests).
>
> The "involved parties" are:
> - Meson GXBB specific network configuration registers (I have have
> double-checked them with the reference drivers: everything seems fine
> here)
> - stmmac: it seems that nobody else has reported these kind of issues
> so far, however I'd still like to hear where I should enable some
> debugging bits to rule out any stmmac bug
On my side, I just tested on the same "kind" of system:
-SYNOPSYS GMAC 3.7
-RTL8211EG as PHY
With I perf, I reach:
-RX: 932 Mbps
-TX: 820Mbps
Can you check ethtool -S eth0 (most precisely "MMC"counter and errors) ?
Which kernel version do you use ?
Regards
Alex
> - RTL8211F PHY driver: unfortunately there are no public datasheets
> available so this is hard to debug. but I'm guessing that TX delay
> could cause similar issues, so this may be the cause as well.
>
>
> Thanks for any input in advance!
> Regards,
> Martin
>
>
> [root at alarm ~]# ifconfig eth0
> eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
> inet 192.168.1.235 netmask 255.255.255.0 broadcast 192.168.1.255
> ether e2:aa:53:fc:f5:c5 txqueuelen 1000 (Ethernet)
> RX packets 1967602 bytes 2968750265 (2.7 GiB)
> RX errors 0 dropped 0 overruns 0 frame 0
> TX packets 101875 bytes 8548285 (8.1 MiB)
> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
> device interrupt 18
>
> [root at alarm ~]# netstat -i
> Kernel Interface table
> Iface MTU RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR Flg
> eth0 1500 1967801 0 0 0 101934 0 0 0 BMRU
>
> [root at alarm ~]# cat /sys/kernel/debug/stmmaceth/eth0/dma_cap
> ==============================
> DMA HW features
> ==============================
> 10/100 Mbps Y
> 1000 Mbps Y
> Half duple Y
> Hash Filter: Y
> Multiple MAC address registers: Y
> PCS (TBI/SGMII/RTBI PHY interfatces): N
> SMA (MDIO) Interface: Y
> PMT Remote wake up: Y
> PMT Magic Frame: Y
> RMON module: Y
> IEEE 1588-2002 Time Stamp: N
> IEEE 1588-2008 Advanced Time Stamp:N
> 802.3az - Energy-Efficient Ethernet (EEE) Y
> AV features: N
> Checksum Offload in TX: Y
> IP Checksum Offload (type1) in RX: N
> IP Checksum Offload (type2) in RX: Y
> RXFIFO > 2048bytes: Y
> Number of Additional RX channel: 0
> Number of Additional TX channel: 0
> Enhanced descriptors: N
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-09-12 16:37 ` Alexandre Torgue
@ 2016-09-12 21:26 ` Martin Blumenstingl
-1 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-09-12 21:26 UTC (permalink / raw)
To: Alexandre Torgue; +Cc: netdev, linux-amlogic, Giuseppe Cavallaro, Johnson Leung
Hi Alexandre,
On Mon, Sep 12, 2016 at 6:37 PM, Alexandre Torgue
<alexandre.torgue@st.com> wrote:
> Which Synopsys IP version do you use ?
found this in a dmesg log:
[ 1.504784] stmmac - user ID: 0x11, Synopsys ID: 0x37
[ 1.509785] Ring mode enabled
[ 1.512796] DMA HW capability register supported
[ 1.517286] Normal descriptors
[ 1.520565] RX Checksum Offload Engine supported
[ 1.525219] COE Type 2
[ 1.527638] TX Checksum insertion supported
[ 1.531862] Wake-Up On Lan supported
[ 1.535483] Enable RX Mitigation via HW Watchdog Timer
[ 1.543851] libphy: stmmac: probed
[ 1.544025] eth0: PHY ID 001cc916 at 0 IRQ POLL (stmmac-0:00) active
[ 1.550321] eth0: PHY ID 001cc916 at 7 IRQ POLL (stmmac-0:07)
>> Gbit ethernet on my device is provided by a Realtek RTL8211F RGMII PHY.
>> Similar issues were reported in #linux-amlogic by a user with an
>> Odroid C2 board (= similar hardware).
>>
>> The symptoms are:
>> Receiving data is plenty fast (I can max out my internet connection
>> easily, and with iperf3 I get ~900Mbit/s).
>> Transmitting data from the device is unfortunately very slow, traffic
>> sometimes even stalls completely.
>>
>> I have attached the iperf results and the output of
>> /sys/kernel/debug/stmmaceth/eth0/descriptors_status.
>> Below you can find the ifconfig, netstat and stmmac dma_cap info
>> (*after* I ran all tests).
>>
>> The "involved parties" are:
>> - Meson GXBB specific network configuration registers (I have have
>> double-checked them with the reference drivers: everything seems fine
>> here)
>> - stmmac: it seems that nobody else has reported these kind of issues
>> so far, however I'd still like to hear where I should enable some
>> debugging bits to rule out any stmmac bug
>
>
> On my side, I just tested on the same "kind" of system:
> -SYNOPSYS GMAC 3.7
> -RTL8211EG as PHY
>
> With I perf, I reach:
> -RX: 932 Mbps
> -TX: 820Mbps
>
> Can you check ethtool -S eth0 (most precisely "MMC"counter and errors) ?
> Which kernel version do you use ?
I am using a 4.8.0-rc4 kernel, based on Kevin's "integration" branch: [0]
Unfortunately I don't have access to my device in the next few days,
but I'll keep you updated once I have the ethtool output.
Thanks for your time
Regards,
Martin
[0] https://git.kernel.org/cgit/linux/kernel/git/khilman/linux-amlogic.git/log/?h=v4.8/integ
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-09-12 21:26 ` Martin Blumenstingl
0 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-09-12 21:26 UTC (permalink / raw)
To: linus-amlogic
Hi Alexandre,
On Mon, Sep 12, 2016 at 6:37 PM, Alexandre Torgue
<alexandre.torgue@st.com> wrote:
> Which Synopsys IP version do you use ?
found this in a dmesg log:
[ 1.504784] stmmac - user ID: 0x11, Synopsys ID: 0x37
[ 1.509785] Ring mode enabled
[ 1.512796] DMA HW capability register supported
[ 1.517286] Normal descriptors
[ 1.520565] RX Checksum Offload Engine supported
[ 1.525219] COE Type 2
[ 1.527638] TX Checksum insertion supported
[ 1.531862] Wake-Up On Lan supported
[ 1.535483] Enable RX Mitigation via HW Watchdog Timer
[ 1.543851] libphy: stmmac: probed
[ 1.544025] eth0: PHY ID 001cc916 at 0 IRQ POLL (stmmac-0:00) active
[ 1.550321] eth0: PHY ID 001cc916 at 7 IRQ POLL (stmmac-0:07)
>> Gbit ethernet on my device is provided by a Realtek RTL8211F RGMII PHY.
>> Similar issues were reported in #linux-amlogic by a user with an
>> Odroid C2 board (= similar hardware).
>>
>> The symptoms are:
>> Receiving data is plenty fast (I can max out my internet connection
>> easily, and with iperf3 I get ~900Mbit/s).
>> Transmitting data from the device is unfortunately very slow, traffic
>> sometimes even stalls completely.
>>
>> I have attached the iperf results and the output of
>> /sys/kernel/debug/stmmaceth/eth0/descriptors_status.
>> Below you can find the ifconfig, netstat and stmmac dma_cap info
>> (*after* I ran all tests).
>>
>> The "involved parties" are:
>> - Meson GXBB specific network configuration registers (I have have
>> double-checked them with the reference drivers: everything seems fine
>> here)
>> - stmmac: it seems that nobody else has reported these kind of issues
>> so far, however I'd still like to hear where I should enable some
>> debugging bits to rule out any stmmac bug
>
>
> On my side, I just tested on the same "kind" of system:
> -SYNOPSYS GMAC 3.7
> -RTL8211EG as PHY
>
> With I perf, I reach:
> -RX: 932 Mbps
> -TX: 820Mbps
>
> Can you check ethtool -S eth0 (most precisely "MMC"counter and errors) ?
> Which kernel version do you use ?
I am using a 4.8.0-rc4 kernel, based on Kevin's "integration" branch: [0]
Unfortunately I don't have access to my device in the next few days,
but I'll keep you updated once I have the ethtool output.
Thanks for your time
Regards,
Martin
[0] https://git.kernel.org/cgit/linux/kernel/git/khilman/linux-amlogic.git/log/?h=v4.8/integ
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
[not found] ` <216F2694-1C1D-44DA-AC15-57ED15C24BBE@bluematt.me>
@ 2016-09-12 21:29 ` Martin Blumenstingl
0 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-09-12 21:29 UTC (permalink / raw)
To: Matt Corallo; +Cc: netdev, linux-amlogic, Giuseppe Cavallaro, Alexandre Torgue
Hi Matt,
On Sun, Sep 11, 2016 at 10:57 PM, Matt Corallo <linux@bluematt.me> wrote:
> The general advice is to force it into 100M mode then it seems to work fine.
> There is some issue with the driver seemingly not fully supporting 1G (at
> least on Odroid C2) which needs to be worked out.
thanks for the hint - by "forcing 100M mode" you mean "ethtool –s eth0
speed 100 duplex full"?
Do you know more about this issue (or do you just know the
workaround)? It'd be interesting to know which "driver" does not
support Gbit speeds (as there are three drivers involved: realtek PHY
driver, stmmac and Meson stmmac glue driver
Regards,
Martin
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-09-12 21:29 ` Martin Blumenstingl
0 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-09-12 21:29 UTC (permalink / raw)
To: linus-amlogic
Hi Matt,
On Sun, Sep 11, 2016 at 10:57 PM, Matt Corallo <linux@bluematt.me> wrote:
> The general advice is to force it into 100M mode then it seems to work fine.
> There is some issue with the driver seemingly not fully supporting 1G (at
> least on Odroid C2) which needs to be worked out.
thanks for the hint - by "forcing 100M mode" you mean "ethtool ?s eth0
speed 100 duplex full"?
Do you know more about this issue (or do you just know the
workaround)? It'd be interesting to know which "driver" does not
support Gbit speeds (as there are three drivers involved: realtek PHY
driver, stmmac and Meson stmmac glue driver
Regards,
Martin
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-09-11 20:39 ` Martin Blumenstingl
@ 2016-09-14 15:30 ` Giuseppe CAVALLARO
-1 siblings, 0 replies; 56+ messages in thread
From: Giuseppe CAVALLARO @ 2016-09-14 15:30 UTC (permalink / raw)
To: Martin Blumenstingl, netdev, linux-amlogic
Cc: Alexandre Torgue, Johnson Leung
Hello Martin
On 9/11/2016 10:39 PM, Martin Blumenstingl wrote:
> Hello,
>
> I have a device with a Meson GXBB SoC with an stmmac IP block.
> Gbit ethernet on my device is provided by a Realtek RTL8211F RGMII PHY.
> Similar issues were reported in #linux-amlogic by a user with an
> Odroid C2 board (= similar hardware).
>
> The symptoms are:
> Receiving data is plenty fast (I can max out my internet connection
> easily, and with iperf3 I get ~900Mbit/s).
> Transmitting data from the device is unfortunately very slow, traffic
> sometimes even stalls completely.
>
> I have attached the iperf results and the output of
> /sys/kernel/debug/stmmaceth/eth0/descriptors_status.
> Below you can find the ifconfig, netstat and stmmac dma_cap info
> (*after* I ran all tests).
>
> The "involved parties" are:
> - Meson GXBB specific network configuration registers (I have have
> double-checked them with the reference drivers: everything seems fine
> here)
> - stmmac: it seems that nobody else has reported these kind of issues
> so far, however I'd still like to hear where I should enable some
> debugging bits to rule out any stmmac bug
hmm I can also think that some configuration could impact!
For example, you could try disabling the scatter-gather or tx-cum
via ethtool and seeing if there is some benefit; so we could image
some problem on your HW or SYNP MAC integration for checksumming
on tx side.
Also you could check the AXI tuning and PBL value. To be honest
(thinking about your problem) I can actually suspect some related
problem on bus setup. So I suggest you to play with these value
(better if you ask for having values from HW validation on your side).
Otherwise the stmmac uses a default that cannot be good for your
platform. For example, sometime I have seen that PBL is better if
reduced to 8 instead of 32 and w/o 4xPBL...
> - RTL8211F PHY driver: unfortunately there are no public datasheets
> available so this is hard to debug. but I'm guessing that TX delay
> could cause similar issues, so this may be the cause as well.
as rule of thumb, I can only suggest you to see the RXDLY and TXDLY
and if you have (or need!) the resistor on PCB to have the 2ns of
extra delay. This can impact on RGMII case (1G).
Indeed, if this is true, I should expect some problem also when ping.
> Thanks for any input in advance!
welcome,
as Alex asked, pls provide us the output from ethtool -S eth0
Regards
Peppe
> Regards,
> Martin
>
>
> [root@alarm ~]# ifconfig eth0
> eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
> inet 192.168.1.235 netmask 255.255.255.0 broadcast 192.168.1.255
> ether e2:aa:53:fc:f5:c5 txqueuelen 1000 (Ethernet)
> RX packets 1967602 bytes 2968750265 (2.7 GiB)
> RX errors 0 dropped 0 overruns 0 frame 0
> TX packets 101875 bytes 8548285 (8.1 MiB)
> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
> device interrupt 18
>
> [root@alarm ~]# netstat -i
> Kernel Interface table
> Iface MTU RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR Flg
> eth0 1500 1967801 0 0 0 101934 0 0 0 BMRU
>
> [root@alarm ~]# cat /sys/kernel/debug/stmmaceth/eth0/dma_cap
> ==============================
> DMA HW features
> ==============================
> 10/100 Mbps Y
> 1000 Mbps Y
> Half duple Y
> Hash Filter: Y
> Multiple MAC address registers: Y
> PCS (TBI/SGMII/RTBI PHY interfatces): N
> SMA (MDIO) Interface: Y
> PMT Remote wake up: Y
> PMT Magic Frame: Y
> RMON module: Y
> IEEE 1588-2002 Time Stamp: N
> IEEE 1588-2008 Advanced Time Stamp:N
> 802.3az - Energy-Efficient Ethernet (EEE) Y
> AV features: N
> Checksum Offload in TX: Y
> IP Checksum Offload (type1) in RX: N
> IP Checksum Offload (type2) in RX: Y
> RXFIFO > 2048bytes: Y
> Number of Additional RX channel: 0
> Number of Additional TX channel: 0
> Enhanced descriptors: N
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-09-14 15:30 ` Giuseppe CAVALLARO
0 siblings, 0 replies; 56+ messages in thread
From: Giuseppe CAVALLARO @ 2016-09-14 15:30 UTC (permalink / raw)
To: linus-amlogic
Hello Martin
On 9/11/2016 10:39 PM, Martin Blumenstingl wrote:
> Hello,
>
> I have a device with a Meson GXBB SoC with an stmmac IP block.
> Gbit ethernet on my device is provided by a Realtek RTL8211F RGMII PHY.
> Similar issues were reported in #linux-amlogic by a user with an
> Odroid C2 board (= similar hardware).
>
> The symptoms are:
> Receiving data is plenty fast (I can max out my internet connection
> easily, and with iperf3 I get ~900Mbit/s).
> Transmitting data from the device is unfortunately very slow, traffic
> sometimes even stalls completely.
>
> I have attached the iperf results and the output of
> /sys/kernel/debug/stmmaceth/eth0/descriptors_status.
> Below you can find the ifconfig, netstat and stmmac dma_cap info
> (*after* I ran all tests).
>
> The "involved parties" are:
> - Meson GXBB specific network configuration registers (I have have
> double-checked them with the reference drivers: everything seems fine
> here)
> - stmmac: it seems that nobody else has reported these kind of issues
> so far, however I'd still like to hear where I should enable some
> debugging bits to rule out any stmmac bug
hmm I can also think that some configuration could impact!
For example, you could try disabling the scatter-gather or tx-cum
via ethtool and seeing if there is some benefit; so we could image
some problem on your HW or SYNP MAC integration for checksumming
on tx side.
Also you could check the AXI tuning and PBL value. To be honest
(thinking about your problem) I can actually suspect some related
problem on bus setup. So I suggest you to play with these value
(better if you ask for having values from HW validation on your side).
Otherwise the stmmac uses a default that cannot be good for your
platform. For example, sometime I have seen that PBL is better if
reduced to 8 instead of 32 and w/o 4xPBL...
> - RTL8211F PHY driver: unfortunately there are no public datasheets
> available so this is hard to debug. but I'm guessing that TX delay
> could cause similar issues, so this may be the cause as well.
as rule of thumb, I can only suggest you to see the RXDLY and TXDLY
and if you have (or need!) the resistor on PCB to have the 2ns of
extra delay. This can impact on RGMII case (1G).
Indeed, if this is true, I should expect some problem also when ping.
> Thanks for any input in advance!
welcome,
as Alex asked, pls provide us the output from ethtool -S eth0
Regards
Peppe
> Regards,
> Martin
>
>
> [root at alarm ~]# ifconfig eth0
> eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST> mtu 1500
> inet 192.168.1.235 netmask 255.255.255.0 broadcast 192.168.1.255
> ether e2:aa:53:fc:f5:c5 txqueuelen 1000 (Ethernet)
> RX packets 1967602 bytes 2968750265 (2.7 GiB)
> RX errors 0 dropped 0 overruns 0 frame 0
> TX packets 101875 bytes 8548285 (8.1 MiB)
> TX errors 0 dropped 0 overruns 0 carrier 0 collisions 0
> device interrupt 18
>
> [root at alarm ~]# netstat -i
> Kernel Interface table
> Iface MTU RX-OK RX-ERR RX-DRP RX-OVR TX-OK TX-ERR TX-DRP TX-OVR Flg
> eth0 1500 1967801 0 0 0 101934 0 0 0 BMRU
>
> [root at alarm ~]# cat /sys/kernel/debug/stmmaceth/eth0/dma_cap
> ==============================
> DMA HW features
> ==============================
> 10/100 Mbps Y
> 1000 Mbps Y
> Half duple Y
> Hash Filter: Y
> Multiple MAC address registers: Y
> PCS (TBI/SGMII/RTBI PHY interfatces): N
> SMA (MDIO) Interface: Y
> PMT Remote wake up: Y
> PMT Magic Frame: Y
> RMON module: Y
> IEEE 1588-2002 Time Stamp: N
> IEEE 1588-2008 Advanced Time Stamp:N
> 802.3az - Energy-Efficient Ethernet (EEE) Y
> AV features: N
> Checksum Offload in TX: Y
> IP Checksum Offload (type1) in RX: N
> IP Checksum Offload (type2) in RX: Y
> RXFIFO > 2048bytes: Y
> Number of Additional RX channel: 0
> Number of Additional TX channel: 0
> Enhanced descriptors: N
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-09-12 21:26 ` Martin Blumenstingl
@ 2016-09-17 21:23 ` André Roth
-1 siblings, 0 replies; 56+ messages in thread
From: André Roth @ 2016-09-17 21:23 UTC (permalink / raw)
To: Martin Blumenstingl
Cc: Alexandre Torgue, Johnson Leung, netdev, Giuseppe Cavallaro,
linux-amlogic
[-- Attachment #1: Type: text/plain, Size: 3257 bytes --]
Hi all,
I have an odroid c2 board which shows this issue. No data is
transmitted or received after a moment of intense tx traffic. Copying a
1GB file per scp from the board triggers it repeatedly.
The board has a stmmac - user ID: 0x11, Synopsys ID: 0x37.
When switching the network to 100Mb/s the copying does
not seam to trigger the issue.
I've attached the ethtool statistics before and after the problem.
Thanks for your help,
André
> Hi Alexandre,
>
> On Mon, Sep 12, 2016 at 6:37 PM, Alexandre Torgue
> <alexandre.torgue@st.com> wrote:
> > Which Synopsys IP version do you use ?
> found this in a dmesg log:
> [ 1.504784] stmmac - user ID: 0x11, Synopsys ID: 0x37
> [ 1.509785] Ring mode enabled
> [ 1.512796] DMA HW capability register supported
> [ 1.517286] Normal descriptors
> [ 1.520565] RX Checksum Offload Engine supported
> [ 1.525219] COE Type 2
> [ 1.527638] TX Checksum insertion supported
> [ 1.531862] Wake-Up On Lan supported
> [ 1.535483] Enable RX Mitigation via HW Watchdog Timer
> [ 1.543851] libphy: stmmac: probed
> [ 1.544025] eth0: PHY ID 001cc916 at 0 IRQ POLL (stmmac-0:00)
> active [ 1.550321] eth0: PHY ID 001cc916 at 7 IRQ POLL
> (stmmac-0:07)
>
> >> Gbit ethernet on my device is provided by a Realtek RTL8211F RGMII
> >> PHY. Similar issues were reported in #linux-amlogic by a user with
> >> an Odroid C2 board (= similar hardware).
> >>
> >> The symptoms are:
> >> Receiving data is plenty fast (I can max out my internet connection
> >> easily, and with iperf3 I get ~900Mbit/s).
> >> Transmitting data from the device is unfortunately very slow,
> >> traffic sometimes even stalls completely.
> >>
> >> I have attached the iperf results and the output of
> >> /sys/kernel/debug/stmmaceth/eth0/descriptors_status.
> >> Below you can find the ifconfig, netstat and stmmac dma_cap info
> >> (*after* I ran all tests).
> >>
> >> The "involved parties" are:
> >> - Meson GXBB specific network configuration registers (I have have
> >> double-checked them with the reference drivers: everything seems
> >> fine here)
> >> - stmmac: it seems that nobody else has reported these kind of
> >> issues so far, however I'd still like to hear where I should
> >> enable some debugging bits to rule out any stmmac bug
> >
> >
> > On my side, I just tested on the same "kind" of system:
> > -SYNOPSYS GMAC 3.7
> > -RTL8211EG as PHY
> >
> > With I perf, I reach:
> > -RX: 932 Mbps
> > -TX: 820Mbps
> >
> > Can you check ethtool -S eth0 (most precisely "MMC"counter and
> > errors) ? Which kernel version do you use ?
> I am using a 4.8.0-rc4 kernel, based on Kevin's "integration" branch:
> [0] Unfortunately I don't have access to my device in the next few
> days, but I'll keep you updated once I have the ethtool output.
>
>
> Thanks for your time
> Regards,
> Martin
>
>
> [0]
> https://git.kernel.org/cgit/linux/kernel/git/khilman/linux-amlogic.git/log/?h=v4.8/integ
>
> _______________________________________________
> linux-amlogic mailing list
> linux-amlogic@lists.infradead.org
> http://lists.infradead.org/mailman/listinfo/linux-amlogic
>
[-- Attachment #2: ethstats.after --]
[-- Type: application/octet-stream, Size: 5155 bytes --]
NIC statistics:
mmc_tx_octetcount_gb: 0
mmc_tx_framecount_gb: 0
mmc_tx_broadcastframe_g: 0
mmc_tx_multicastframe_g: 0
mmc_tx_64_octets_gb: 0
mmc_tx_65_to_127_octets_gb: 0
mmc_tx_128_to_255_octets_gb: 0
mmc_tx_256_to_511_octets_gb: 0
mmc_tx_512_to_1023_octets_gb: 0
mmc_tx_1024_to_max_octets_gb: 0
mmc_tx_unicast_gb: 0
mmc_tx_multicast_gb: 0
mmc_tx_broadcast_gb: 0
mmc_tx_underflow_error: 0
mmc_tx_singlecol_g: 0
mmc_tx_multicol_g: 0
mmc_tx_deferred: 0
mmc_tx_latecol: 0
mmc_tx_exesscol: 0
mmc_tx_carrier_error: 0
mmc_tx_octetcount_g: 0
mmc_tx_framecount_g: 0
mmc_tx_excessdef: 0
mmc_tx_pause_frame: 0
mmc_tx_vlan_frame_g: 0
mmc_rx_framecount_gb: 31723
mmc_rx_octetcount_gb: 2360579
mmc_rx_octetcount_g: 2360579
mmc_rx_broadcastframe_g: 0
mmc_rx_multicastframe_g: 0
mmc_rx_crc_error: 0
mmc_rx_align_error: 0
mmc_rx_run_error: 0
mmc_rx_jabber_error: 0
mmc_rx_undersize_g: 0
mmc_rx_oversize_g: 0
mmc_rx_64_octets_gb: 4
mmc_rx_65_to_127_octets_gb: 31700
mmc_rx_128_to_255_octets_gb: 11
mmc_rx_256_to_511_octets_gb: 2
mmc_rx_512_to_1023_octets_gb: 5
mmc_rx_1024_to_max_octets_gb: 1
mmc_rx_unicast_g: 31723
mmc_rx_length_error: 0
mmc_rx_autofrangetype: 0
mmc_rx_pause_frames: 0
mmc_rx_fifo_overflow: 0
mmc_rx_vlan_frames_gb: 0
mmc_rx_watchdog_error: 0
mmc_rx_ipc_intr_mask: 2147385342
mmc_rx_ipc_intr: 0
mmc_rx_ipv4_gd: 31719
mmc_rx_ipv4_hderr: 0
mmc_rx_ipv4_nopay: 0
mmc_rx_ipv4_frag: 0
mmc_rx_ipv4_udsbl: 0
mmc_rx_ipv4_gd_octets: 1789381
mmc_rx_ipv4_hderr_octets: 0
mmc_rx_ipv4_nopay_octets: 0
mmc_rx_ipv4_frag_octets: 0
mmc_rx_ipv4_udsbl_octets: 0
mmc_rx_ipv6_gd_octets: 0
mmc_rx_ipv6_hderr_octets: 0
mmc_rx_ipv6_nopay_octets: 0
mmc_rx_ipv6_gd: 0
mmc_rx_ipv6_hderr: 0
mmc_rx_ipv6_nopay: 0
mmc_rx_udp_gd: 27
mmc_rx_udp_err: 0
mmc_rx_tcp_gd: 31692
mmc_rx_tcp_err: 0
mmc_rx_icmp_gd: 0
mmc_rx_icmp_err: 0
mmc_rx_udp_gd_octets: 3856
mmc_rx_udp_err_octets: 0
mmc_rx_tcp_gd_octets: 1151145
mmc_rx_tcp_err_octets: 0
mmc_rx_icmp_gd_octets: 0
mmc_rx_icmp_err_octets: 0
tx_underflow: 0
tx_carrier: 0
tx_losscarrier: 0
vlan_tag: 0
tx_deferred: 0
tx_vlan: 0
tx_jabber: 0
tx_frame_flushed: 0
tx_payload_error: 0
tx_ip_header_error: 0
rx_desc: 0
sa_filter_fail: 0
overflow_error: 0
ipc_csum_error: 0
rx_collision: 0
rx_crc: 0
dribbling_bit: 0
rx_length: 0
rx_mii: 0
rx_multicast: 0
rx_gmac_overflow: 0
rx_watchdog: 0
da_rx_filter_fail: 0
sa_rx_filter_fail: 0
rx_missed_cntr: 0
rx_overflow_cntr: 0
rx_vlan: 0
tx_undeflow_irq: 0
tx_process_stopped_irq: 0
tx_jabber_irq: 0
rx_overflow_irq: 0
rx_buf_unav_irq: 0
rx_process_stopped_irq: 0
rx_watchdog_irq: 0
tx_early_irq: 0
fatal_bus_error_irq: 0
rx_early_irq: 2931
threshold: 1
tx_pkt_n: 307436
rx_pkt_n: 31706
normal_irq_n: 24352
rx_normal_irq_n: 15239
napi_poll: 24346
tx_normal_irq_n: 9161
tx_clean: 24463
tx_set_ic_bit: 9366
irq_receive_pmt_irq_n: 0
mmc_tx_irq_n: 0
mmc_rx_irq_n: 0
mmc_rx_csum_offload_irq_n: 0
irq_tx_path_in_lpi_mode_n: 12723
irq_tx_path_exit_lpi_mode_n: 12722
irq_rx_path_in_lpi_mode_n: 0
irq_rx_path_exit_lpi_mode_n: 0
phy_eee_wakeup_error_n: 0
ip_hdr_err: 0
ip_payload_err: 0
ip_csum_bypassed: 0
ipv4_pkt_rcvd: 0
ipv6_pkt_rcvd: 0
rx_msg_type_ext_no_ptp: 0
rx_msg_type_sync: 0
rx_msg_type_follow_up: 0
rx_msg_type_delay_req: 0
rx_msg_type_delay_resp: 0
rx_msg_type_pdelay_req: 0
rx_msg_type_pdelay_resp: 0
rx_msg_type_pdelay_follow_up: 0
ptp_frame_type: 0
ptp_ver: 0
timestamp_dropped: 0
av_pkt_rcvd: 0
av_tagged_pkt_rcvd: 0
vlan_tag_priority_val: 0
l3_filter_match: 0
l4_filter_match: 0
l3_l4_filter_no_match: 0
irq_pcs_ane_n: 0
irq_pcs_link_n: 0
irq_rgmii_n: 1
mtl_tx_status_fifo_full: 0
mtl_tx_fifo_not_empty: 0
mmtl_fifo_ctrl: 0
mtl_tx_fifo_read_ctrl_write: 0
mtl_tx_fifo_read_ctrl_wait: 0
mtl_tx_fifo_read_ctrl_read: 0
mtl_tx_fifo_read_ctrl_idle: 0
mac_tx_in_pause: 0
mac_tx_frame_ctrl_xfer: 0
mac_tx_frame_ctrl_idle: 0
mac_tx_frame_ctrl_wait: 0
mac_tx_frame_ctrl_pause: 0
mac_gmii_tx_proto_engine: 0
mtl_rx_fifo_fill_level_full: 0
mtl_rx_fifo_fill_above_thresh: 0
mtl_rx_fifo_fill_below_thresh: 0
mtl_rx_fifo_fill_level_empty: 0
mtl_rx_fifo_read_ctrl_flush: 0
mtl_rx_fifo_read_ctrl_read_data: 0
mtl_rx_fifo_read_ctrl_status: 0
mtl_rx_fifo_read_ctrl_idle: 0
mtl_rx_fifo_ctrl_active: 0
mac_rx_frame_ctrl_fifo: 0
mac_gmii_rx_proto_engine: 0
tx_tso_frames: 0
tx_tso_nfrags: 0
[-- Attachment #3: ethstats.before --]
[-- Type: application/octet-stream, Size: 5093 bytes --]
NIC statistics:
mmc_tx_octetcount_gb: 0
mmc_tx_framecount_gb: 0
mmc_tx_broadcastframe_g: 0
mmc_tx_multicastframe_g: 0
mmc_tx_64_octets_gb: 0
mmc_tx_65_to_127_octets_gb: 0
mmc_tx_128_to_255_octets_gb: 0
mmc_tx_256_to_511_octets_gb: 0
mmc_tx_512_to_1023_octets_gb: 0
mmc_tx_1024_to_max_octets_gb: 0
mmc_tx_unicast_gb: 0
mmc_tx_multicast_gb: 0
mmc_tx_broadcast_gb: 0
mmc_tx_underflow_error: 0
mmc_tx_singlecol_g: 0
mmc_tx_multicol_g: 0
mmc_tx_deferred: 0
mmc_tx_latecol: 0
mmc_tx_exesscol: 0
mmc_tx_carrier_error: 0
mmc_tx_octetcount_g: 0
mmc_tx_framecount_g: 0
mmc_tx_excessdef: 0
mmc_tx_pause_frame: 0
mmc_tx_vlan_frame_g: 0
mmc_rx_framecount_gb: 30
mmc_rx_octetcount_gb: 5049
mmc_rx_octetcount_g: 5049
mmc_rx_broadcastframe_g: 0
mmc_rx_multicastframe_g: 0
mmc_rx_crc_error: 0
mmc_rx_align_error: 0
mmc_rx_run_error: 0
mmc_rx_jabber_error: 0
mmc_rx_undersize_g: 0
mmc_rx_oversize_g: 0
mmc_rx_64_octets_gb: 4
mmc_rx_65_to_127_octets_gb: 13
mmc_rx_128_to_255_octets_gb: 8
mmc_rx_256_to_511_octets_gb: 1
mmc_rx_512_to_1023_octets_gb: 4
mmc_rx_1024_to_max_octets_gb: 0
mmc_rx_unicast_g: 30
mmc_rx_length_error: 0
mmc_rx_autofrangetype: 0
mmc_rx_pause_frames: 0
mmc_rx_fifo_overflow: 0
mmc_rx_vlan_frames_gb: 0
mmc_rx_watchdog_error: 0
mmc_rx_ipc_intr_mask: 1073692671
mmc_rx_ipc_intr: 0
mmc_rx_ipv4_gd: 26
mmc_rx_ipv4_hderr: 0
mmc_rx_ipv4_nopay: 0
mmc_rx_ipv4_frag: 0
mmc_rx_ipv4_udsbl: 0
mmc_rx_ipv4_gd_octets: 4325
mmc_rx_ipv4_hderr_octets: 0
mmc_rx_ipv4_nopay_octets: 0
mmc_rx_ipv4_frag_octets: 0
mmc_rx_ipv4_udsbl_octets: 0
mmc_rx_ipv6_gd_octets: 0
mmc_rx_ipv6_hderr_octets: 0
mmc_rx_ipv6_nopay_octets: 0
mmc_rx_ipv6_gd: 0
mmc_rx_ipv6_hderr: 0
mmc_rx_ipv6_nopay: 0
mmc_rx_udp_gd: 26
mmc_rx_udp_err: 0
mmc_rx_tcp_gd: 0
mmc_rx_tcp_err: 0
mmc_rx_icmp_gd: 0
mmc_rx_icmp_err: 0
mmc_rx_udp_gd_octets: 3805
mmc_rx_udp_err_octets: 0
mmc_rx_tcp_gd_octets: 0
mmc_rx_tcp_err_octets: 0
mmc_rx_icmp_gd_octets: 0
mmc_rx_icmp_err_octets: 0
tx_underflow: 0
tx_carrier: 0
tx_losscarrier: 0
vlan_tag: 0
tx_deferred: 0
tx_vlan: 0
tx_jabber: 0
tx_frame_flushed: 0
tx_payload_error: 0
tx_ip_header_error: 0
rx_desc: 0
sa_filter_fail: 0
overflow_error: 0
ipc_csum_error: 0
rx_collision: 0
rx_crc: 0
dribbling_bit: 0
rx_length: 0
rx_mii: 0
rx_multicast: 0
rx_gmac_overflow: 0
rx_watchdog: 0
da_rx_filter_fail: 0
sa_rx_filter_fail: 0
rx_missed_cntr: 0
rx_overflow_cntr: 0
rx_vlan: 0
tx_undeflow_irq: 0
tx_process_stopped_irq: 0
tx_jabber_irq: 0
rx_overflow_irq: 0
rx_buf_unav_irq: 0
rx_process_stopped_irq: 0
rx_watchdog_irq: 0
tx_early_irq: 0
fatal_bus_error_irq: 0
rx_early_irq: 0
threshold: 1
tx_pkt_n: 162
rx_pkt_n: 30
normal_irq_n: 31
rx_normal_irq_n: 29
napi_poll: 31
tx_normal_irq_n: 2
tx_clean: 138
tx_set_ic_bit: 2
irq_receive_pmt_irq_n: 0
mmc_tx_irq_n: 0
mmc_rx_irq_n: 0
mmc_rx_csum_offload_irq_n: 0
irq_tx_path_in_lpi_mode_n: 124
irq_tx_path_exit_lpi_mode_n: 123
irq_rx_path_in_lpi_mode_n: 0
irq_rx_path_exit_lpi_mode_n: 0
phy_eee_wakeup_error_n: 0
ip_hdr_err: 0
ip_payload_err: 0
ip_csum_bypassed: 0
ipv4_pkt_rcvd: 0
ipv6_pkt_rcvd: 0
rx_msg_type_ext_no_ptp: 0
rx_msg_type_sync: 0
rx_msg_type_follow_up: 0
rx_msg_type_delay_req: 0
rx_msg_type_delay_resp: 0
rx_msg_type_pdelay_req: 0
rx_msg_type_pdelay_resp: 0
rx_msg_type_pdelay_follow_up: 0
ptp_frame_type: 0
ptp_ver: 0
timestamp_dropped: 0
av_pkt_rcvd: 0
av_tagged_pkt_rcvd: 0
vlan_tag_priority_val: 0
l3_filter_match: 0
l4_filter_match: 0
l3_l4_filter_no_match: 0
irq_pcs_ane_n: 0
irq_pcs_link_n: 0
irq_rgmii_n: 1
mtl_tx_status_fifo_full: 0
mtl_tx_fifo_not_empty: 0
mmtl_fifo_ctrl: 0
mtl_tx_fifo_read_ctrl_write: 0
mtl_tx_fifo_read_ctrl_wait: 0
mtl_tx_fifo_read_ctrl_read: 0
mtl_tx_fifo_read_ctrl_idle: 0
mac_tx_in_pause: 0
mac_tx_frame_ctrl_xfer: 0
mac_tx_frame_ctrl_idle: 0
mac_tx_frame_ctrl_wait: 0
mac_tx_frame_ctrl_pause: 0
mac_gmii_tx_proto_engine: 0
mtl_rx_fifo_fill_level_full: 0
mtl_rx_fifo_fill_above_thresh: 0
mtl_rx_fifo_fill_below_thresh: 0
mtl_rx_fifo_fill_level_empty: 0
mtl_rx_fifo_read_ctrl_flush: 0
mtl_rx_fifo_read_ctrl_read_data: 0
mtl_rx_fifo_read_ctrl_status: 0
mtl_rx_fifo_read_ctrl_idle: 0
mtl_rx_fifo_ctrl_active: 0
mac_rx_frame_ctrl_fifo: 0
mac_gmii_rx_proto_engine: 0
tx_tso_frames: 0
tx_tso_nfrags: 0
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-09-17 21:23 ` André Roth
0 siblings, 0 replies; 56+ messages in thread
From: André Roth @ 2016-09-17 21:23 UTC (permalink / raw)
To: linus-amlogic
Hi all,
I have an odroid c2 board which shows this issue. No data is
transmitted or received after a moment of intense tx traffic. Copying a
1GB file per scp from the board triggers it repeatedly.
The board has a stmmac - user ID: 0x11, Synopsys ID: 0x37.
When switching the network to 100Mb/s the copying does
not seam to trigger the issue.
I've attached the ethtool statistics before and after the problem.
Thanks for your help,
Andr?
> Hi Alexandre,
>
> On Mon, Sep 12, 2016 at 6:37 PM, Alexandre Torgue
> <alexandre.torgue@st.com> wrote:
> > Which Synopsys IP version do you use ?
> found this in a dmesg log:
> [ 1.504784] stmmac - user ID: 0x11, Synopsys ID: 0x37
> [ 1.509785] Ring mode enabled
> [ 1.512796] DMA HW capability register supported
> [ 1.517286] Normal descriptors
> [ 1.520565] RX Checksum Offload Engine supported
> [ 1.525219] COE Type 2
> [ 1.527638] TX Checksum insertion supported
> [ 1.531862] Wake-Up On Lan supported
> [ 1.535483] Enable RX Mitigation via HW Watchdog Timer
> [ 1.543851] libphy: stmmac: probed
> [ 1.544025] eth0: PHY ID 001cc916 at 0 IRQ POLL (stmmac-0:00)
> active [ 1.550321] eth0: PHY ID 001cc916 at 7 IRQ POLL
> (stmmac-0:07)
>
> >> Gbit ethernet on my device is provided by a Realtek RTL8211F RGMII
> >> PHY. Similar issues were reported in #linux-amlogic by a user with
> >> an Odroid C2 board (= similar hardware).
> >>
> >> The symptoms are:
> >> Receiving data is plenty fast (I can max out my internet connection
> >> easily, and with iperf3 I get ~900Mbit/s).
> >> Transmitting data from the device is unfortunately very slow,
> >> traffic sometimes even stalls completely.
> >>
> >> I have attached the iperf results and the output of
> >> /sys/kernel/debug/stmmaceth/eth0/descriptors_status.
> >> Below you can find the ifconfig, netstat and stmmac dma_cap info
> >> (*after* I ran all tests).
> >>
> >> The "involved parties" are:
> >> - Meson GXBB specific network configuration registers (I have have
> >> double-checked them with the reference drivers: everything seems
> >> fine here)
> >> - stmmac: it seems that nobody else has reported these kind of
> >> issues so far, however I'd still like to hear where I should
> >> enable some debugging bits to rule out any stmmac bug
> >
> >
> > On my side, I just tested on the same "kind" of system:
> > -SYNOPSYS GMAC 3.7
> > -RTL8211EG as PHY
> >
> > With I perf, I reach:
> > -RX: 932 Mbps
> > -TX: 820Mbps
> >
> > Can you check ethtool -S eth0 (most precisely "MMC"counter and
> > errors) ? Which kernel version do you use ?
> I am using a 4.8.0-rc4 kernel, based on Kevin's "integration" branch:
> [0] Unfortunately I don't have access to my device in the next few
> days, but I'll keep you updated once I have the ethtool output.
>
>
> Thanks for your time
> Regards,
> Martin
>
>
> [0]
> https://git.kernel.org/cgit/linux/kernel/git/khilman/linux-amlogic.git/log/?h=v4.8/integ
>
> _______________________________________________
> linux-amlogic mailing list
> linux-amlogic at lists.infradead.org
> http://lists.infradead.org/mailman/listinfo/linux-amlogic
>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ethstats.after
Type: application/octet-stream
Size: 5155 bytes
Desc: not available
URL: <http://lists.infradead.org/pipermail/linux-amlogic/attachments/20160917/710c5535/attachment.obj>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: ethstats.before
Type: application/octet-stream
Size: 5093 bytes
Desc: not available
URL: <http://lists.infradead.org/pipermail/linux-amlogic/attachments/20160917/710c5535/attachment-0001.obj>
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-09-14 15:30 ` Giuseppe CAVALLARO
@ 2016-09-18 20:42 ` André Roth
-1 siblings, 0 replies; 56+ messages in thread
From: André Roth @ 2016-09-18 20:42 UTC (permalink / raw)
To: Giuseppe CAVALLARO
Cc: Martin Blumenstingl, netdev, linux-amlogic, Alexandre Torgue
Hello,
> For example, you could try disabling the scatter-gather or tx-cum
> via ethtool and seeing if there is some benefit; so we could image
> some problem on your HW or SYNP MAC integration for checksumming
> on tx side.
disabling the following:
ethtool -K eth0 sg off
or:
ethtool -K eth0 tx off
does not prevent the network communication going down..
> Also you could check the AXI tuning and PBL value. To be honest
> (thinking about your problem) I can actually suspect some related
> problem on bus setup. So I suggest you to play with these value
> (better if you ask for having values from HW validation on your side).
> Otherwise the stmmac uses a default that cannot be good for your
> platform. For example, sometime I have seen that PBL is better if
> reduced to 8 instead of 32 and w/o 4xPBL...
how can I set those values ?
thanks for your time,
andre
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-09-18 20:42 ` André Roth
0 siblings, 0 replies; 56+ messages in thread
From: André Roth @ 2016-09-18 20:42 UTC (permalink / raw)
To: linus-amlogic
Hello,
> For example, you could try disabling the scatter-gather or tx-cum
> via ethtool and seeing if there is some benefit; so we could image
> some problem on your HW or SYNP MAC integration for checksumming
> on tx side.
disabling the following:
ethtool -K eth0 sg off
or:
ethtool -K eth0 tx off
does not prevent the network communication going down..
> Also you could check the AXI tuning and PBL value. To be honest
> (thinking about your problem) I can actually suspect some related
> problem on bus setup. So I suggest you to play with these value
> (better if you ask for having values from HW validation on your side).
> Otherwise the stmmac uses a default that cannot be good for your
> platform. For example, sometime I have seen that PBL is better if
> reduced to 8 instead of 32 and w/o 4xPBL...
how can I set those values ?
thanks for your time,
andre
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-09-18 20:42 ` André Roth
@ 2016-09-19 5:38 ` Giuseppe CAVALLARO
-1 siblings, 0 replies; 56+ messages in thread
From: Giuseppe CAVALLARO @ 2016-09-19 5:38 UTC (permalink / raw)
To: André Roth
Cc: Martin Blumenstingl, netdev, linux-amlogic, Alexandre Torgue
Hello André
On 9/18/2016 10:42 PM, André Roth wrote:
>
> Hello,
>
>> For example, you could try disabling the scatter-gather or tx-cum
>> via ethtool and seeing if there is some benefit; so we could image
>> some problem on your HW or SYNP MAC integration for checksumming
>> on tx side.
>
> disabling the following:
> ethtool -K eth0 sg off
> or:
> ethtool -K eth0 tx off
> does not prevent the network communication going down..
>
>> Also you could check the AXI tuning and PBL value. To be honest
>> (thinking about your problem) I can actually suspect some related
>> problem on bus setup. So I suggest you to play with these value
>> (better if you ask for having values from HW validation on your side).
>> Otherwise the stmmac uses a default that cannot be good for your
>> platform. For example, sometime I have seen that PBL is better if
>> reduced to 8 instead of 32 and w/o 4xPBL...
>
> how can I set those values ?
>
> thanks for your time,
welcome
take a look at Documentation/devicetree/bindings/net/stmmac.txt
peppe
>
> andre
>
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-09-19 5:38 ` Giuseppe CAVALLARO
0 siblings, 0 replies; 56+ messages in thread
From: Giuseppe CAVALLARO @ 2016-09-19 5:38 UTC (permalink / raw)
To: linus-amlogic
Hello Andr?
On 9/18/2016 10:42 PM, Andr? Roth wrote:
>
> Hello,
>
>> For example, you could try disabling the scatter-gather or tx-cum
>> via ethtool and seeing if there is some benefit; so we could image
>> some problem on your HW or SYNP MAC integration for checksumming
>> on tx side.
>
> disabling the following:
> ethtool -K eth0 sg off
> or:
> ethtool -K eth0 tx off
> does not prevent the network communication going down..
>
>> Also you could check the AXI tuning and PBL value. To be honest
>> (thinking about your problem) I can actually suspect some related
>> problem on bus setup. So I suggest you to play with these value
>> (better if you ask for having values from HW validation on your side).
>> Otherwise the stmmac uses a default that cannot be good for your
>> platform. For example, sometime I have seen that PBL is better if
>> reduced to 8 instead of 32 and w/o 4xPBL...
>
> how can I set those values ?
>
> thanks for your time,
welcome
take a look at Documentation/devicetree/bindings/net/stmmac.txt
peppe
>
> andre
>
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-09-17 21:23 ` André Roth
@ 2016-09-26 6:17 ` Giuseppe CAVALLARO
-1 siblings, 0 replies; 56+ messages in thread
From: Giuseppe CAVALLARO @ 2016-09-26 6:17 UTC (permalink / raw)
To: André Roth, Martin Blumenstingl
Cc: Alexandre Torgue, Johnson Leung, netdev, linux-amlogic
Hello André
On 9/17/2016 11:23 PM, André Roth wrote:
>
> Hi all,
>
> I have an odroid c2 board which shows this issue. No data is
> transmitted or received after a moment of intense tx traffic. Copying a
> 1GB file per scp from the board triggers it repeatedly.
>
> The board has a stmmac - user ID: 0x11, Synopsys ID: 0x37.
>
> When switching the network to 100Mb/s the copying does
> not seam to trigger the issue.
>
> I've attached the ethtool statistics before and after the problem.
at first glance, it enters in EEE mode often in the ethtool.after.
On some platforms we met problems and it was necessary to disable the
feature. Maybe, you can start looking at if this is true on yours.
We will see to provide a clean subset of patches to switch-on/off it.
Peppe
>
> Thanks for your help,
>
> André
>
>
>
>> Hi Alexandre,
>>
>> On Mon, Sep 12, 2016 at 6:37 PM, Alexandre Torgue
>> <alexandre.torgue@st.com> wrote:
>>> Which Synopsys IP version do you use ?
>> found this in a dmesg log:
>> [ 1.504784] stmmac - user ID: 0x11, Synopsys ID: 0x37
>> [ 1.509785] Ring mode enabled
>> [ 1.512796] DMA HW capability register supported
>> [ 1.517286] Normal descriptors
>> [ 1.520565] RX Checksum Offload Engine supported
>> [ 1.525219] COE Type 2
>> [ 1.527638] TX Checksum insertion supported
>> [ 1.531862] Wake-Up On Lan supported
>> [ 1.535483] Enable RX Mitigation via HW Watchdog Timer
>> [ 1.543851] libphy: stmmac: probed
>> [ 1.544025] eth0: PHY ID 001cc916 at 0 IRQ POLL (stmmac-0:00)
>> active [ 1.550321] eth0: PHY ID 001cc916 at 7 IRQ POLL
>> (stmmac-0:07)
>>
>>>> Gbit ethernet on my device is provided by a Realtek RTL8211F RGMII
>>>> PHY. Similar issues were reported in #linux-amlogic by a user with
>>>> an Odroid C2 board (= similar hardware).
>>>>
>>>> The symptoms are:
>>>> Receiving data is plenty fast (I can max out my internet connection
>>>> easily, and with iperf3 I get ~900Mbit/s).
>>>> Transmitting data from the device is unfortunately very slow,
>>>> traffic sometimes even stalls completely.
>>>>
>>>> I have attached the iperf results and the output of
>>>> /sys/kernel/debug/stmmaceth/eth0/descriptors_status.
>>>> Below you can find the ifconfig, netstat and stmmac dma_cap info
>>>> (*after* I ran all tests).
>>>>
>>>> The "involved parties" are:
>>>> - Meson GXBB specific network configuration registers (I have have
>>>> double-checked them with the reference drivers: everything seems
>>>> fine here)
>>>> - stmmac: it seems that nobody else has reported these kind of
>>>> issues so far, however I'd still like to hear where I should
>>>> enable some debugging bits to rule out any stmmac bug
>>>
>>>
>>> On my side, I just tested on the same "kind" of system:
>>> -SYNOPSYS GMAC 3.7
>>> -RTL8211EG as PHY
>>>
>>> With I perf, I reach:
>>> -RX: 932 Mbps
>>> -TX: 820Mbps
>>>
>>> Can you check ethtool -S eth0 (most precisely "MMC"counter and
>>> errors) ? Which kernel version do you use ?
>> I am using a 4.8.0-rc4 kernel, based on Kevin's "integration" branch:
>> [0] Unfortunately I don't have access to my device in the next few
>> days, but I'll keep you updated once I have the ethtool output.
>>
>>
>> Thanks for your time
>> Regards,
>> Martin
>>
>>
>> [0]
>> https://git.kernel.org/cgit/linux/kernel/git/khilman/linux-amlogic.git/log/?h=v4.8/integ
>>
>> _______________________________________________
>> linux-amlogic mailing list
>> linux-amlogic@lists.infradead.org
>> http://lists.infradead.org/mailman/listinfo/linux-amlogic
>>
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-09-26 6:17 ` Giuseppe CAVALLARO
0 siblings, 0 replies; 56+ messages in thread
From: Giuseppe CAVALLARO @ 2016-09-26 6:17 UTC (permalink / raw)
To: linus-amlogic
Hello Andr?
On 9/17/2016 11:23 PM, Andr? Roth wrote:
>
> Hi all,
>
> I have an odroid c2 board which shows this issue. No data is
> transmitted or received after a moment of intense tx traffic. Copying a
> 1GB file per scp from the board triggers it repeatedly.
>
> The board has a stmmac - user ID: 0x11, Synopsys ID: 0x37.
>
> When switching the network to 100Mb/s the copying does
> not seam to trigger the issue.
>
> I've attached the ethtool statistics before and after the problem.
at first glance, it enters in EEE mode often in the ethtool.after.
On some platforms we met problems and it was necessary to disable the
feature. Maybe, you can start looking at if this is true on yours.
We will see to provide a clean subset of patches to switch-on/off it.
Peppe
>
> Thanks for your help,
>
> Andr?
>
>
>
>> Hi Alexandre,
>>
>> On Mon, Sep 12, 2016 at 6:37 PM, Alexandre Torgue
>> <alexandre.torgue@st.com> wrote:
>>> Which Synopsys IP version do you use ?
>> found this in a dmesg log:
>> [ 1.504784] stmmac - user ID: 0x11, Synopsys ID: 0x37
>> [ 1.509785] Ring mode enabled
>> [ 1.512796] DMA HW capability register supported
>> [ 1.517286] Normal descriptors
>> [ 1.520565] RX Checksum Offload Engine supported
>> [ 1.525219] COE Type 2
>> [ 1.527638] TX Checksum insertion supported
>> [ 1.531862] Wake-Up On Lan supported
>> [ 1.535483] Enable RX Mitigation via HW Watchdog Timer
>> [ 1.543851] libphy: stmmac: probed
>> [ 1.544025] eth0: PHY ID 001cc916 at 0 IRQ POLL (stmmac-0:00)
>> active [ 1.550321] eth0: PHY ID 001cc916 at 7 IRQ POLL
>> (stmmac-0:07)
>>
>>>> Gbit ethernet on my device is provided by a Realtek RTL8211F RGMII
>>>> PHY. Similar issues were reported in #linux-amlogic by a user with
>>>> an Odroid C2 board (= similar hardware).
>>>>
>>>> The symptoms are:
>>>> Receiving data is plenty fast (I can max out my internet connection
>>>> easily, and with iperf3 I get ~900Mbit/s).
>>>> Transmitting data from the device is unfortunately very slow,
>>>> traffic sometimes even stalls completely.
>>>>
>>>> I have attached the iperf results and the output of
>>>> /sys/kernel/debug/stmmaceth/eth0/descriptors_status.
>>>> Below you can find the ifconfig, netstat and stmmac dma_cap info
>>>> (*after* I ran all tests).
>>>>
>>>> The "involved parties" are:
>>>> - Meson GXBB specific network configuration registers (I have have
>>>> double-checked them with the reference drivers: everything seems
>>>> fine here)
>>>> - stmmac: it seems that nobody else has reported these kind of
>>>> issues so far, however I'd still like to hear where I should
>>>> enable some debugging bits to rule out any stmmac bug
>>>
>>>
>>> On my side, I just tested on the same "kind" of system:
>>> -SYNOPSYS GMAC 3.7
>>> -RTL8211EG as PHY
>>>
>>> With I perf, I reach:
>>> -RX: 932 Mbps
>>> -TX: 820Mbps
>>>
>>> Can you check ethtool -S eth0 (most precisely "MMC"counter and
>>> errors) ? Which kernel version do you use ?
>> I am using a 4.8.0-rc4 kernel, based on Kevin's "integration" branch:
>> [0] Unfortunately I don't have access to my device in the next few
>> days, but I'll keep you updated once I have the ethtool output.
>>
>>
>> Thanks for your time
>> Regards,
>> Martin
>>
>>
>> [0]
>> https://git.kernel.org/cgit/linux/kernel/git/khilman/linux-amlogic.git/log/?h=v4.8/integ
>>
>> _______________________________________________
>> linux-amlogic mailing list
>> linux-amlogic at lists.infradead.org
>> http://lists.infradead.org/mailman/listinfo/linux-amlogic
>>
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-09-26 6:17 ` Giuseppe CAVALLARO
@ 2016-10-01 15:58 ` Martin Blumenstingl
-1 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-10-01 15:58 UTC (permalink / raw)
To: Giuseppe CAVALLARO
Cc: André Roth, Alexandre Torgue, Johnson Leung, netdev, linux-amlogic
[-- Attachment #1: Type: text/plain, Size: 1386 bytes --]
Hello Peppe,
On Mon, Sep 26, 2016 at 8:17 AM, Giuseppe CAVALLARO
<peppe.cavallaro@st.com> wrote:
> Hello André
>
> On 9/17/2016 11:23 PM, André Roth wrote:
>>
>>
>> Hi all,
>>
>> I have an odroid c2 board which shows this issue. No data is
>> transmitted or received after a moment of intense tx traffic. Copying a
>> 1GB file per scp from the board triggers it repeatedly.
>>
>> The board has a stmmac - user ID: 0x11, Synopsys ID: 0x37.
>>
>> When switching the network to 100Mb/s the copying does
>> not seam to trigger the issue.
>>
>> I've attached the ethtool statistics before and after the problem.
>
>
> at first glance, it enters in EEE mode often in the ethtool.after.
> On some platforms we met problems and it was necessary to disable the
> feature. Maybe, you can start looking at if this is true on yours.
> We will see to provide a clean subset of patches to switch-on/off it.
I did some hacking in the stmmac driver to disable the LPI stuff (see
the attachment)
Unfortunately this did not fix the problem.
I did not issue any ethtool commands not shown in the logs.
Also I did not have time to change the AXI tuning / PBL value yet - so
those are also untouched.
I will keep testing, but unfortunately my device is starting to fall
apart (I sometimes have DDR initialization issues and u-boot fails to
come up, oh dear...).
[-- Attachment #2: ethstats-with-stmmac-LPI-disabled.txt --]
[-- Type: text/plain, Size: 17966 bytes --]
# ethtool -S eth0
NIC statistics:
mmc_tx_octetcount_gb: 0
mmc_tx_framecount_gb: 0
mmc_tx_broadcastframe_g: 0
mmc_tx_multicastframe_g: 0
mmc_tx_64_octets_gb: 0
mmc_tx_65_to_127_octets_gb: 0
mmc_tx_128_to_255_octets_gb: 0
mmc_tx_256_to_511_octets_gb: 0
mmc_tx_512_to_1023_octets_gb: 0
mmc_tx_1024_to_max_octets_gb: 0
mmc_tx_unicast_gb: 0
mmc_tx_multicast_gb: 0
mmc_tx_broadcast_gb: 0
mmc_tx_underflow_error: 0
mmc_tx_singlecol_g: 0
mmc_tx_multicol_g: 0
mmc_tx_deferred: 0
mmc_tx_latecol: 0
mmc_tx_exesscol: 0
mmc_tx_carrier_error: 0
mmc_tx_octetcount_g: 0
mmc_tx_framecount_g: 0
mmc_tx_excessdef: 0
mmc_tx_pause_frame: 0
mmc_tx_vlan_frame_g: 0
mmc_rx_framecount_gb: 94
mmc_rx_octetcount_gb: 89097
mmc_rx_octetcount_g: 89097
mmc_rx_broadcastframe_g: 29
mmc_rx_multicastframe_g: 1
mmc_rx_crc_error: 0
mmc_rx_align_error: 0
mmc_rx_run_error: 0
mmc_rx_jabber_error: 0
mmc_rx_undersize_g: 0
mmc_rx_oversize_g: 0
mmc_rx_64_octets_gb: 29
mmc_rx_65_to_127_octets_gb: 4
mmc_rx_128_to_255_octets_gb: 0
mmc_rx_256_to_511_octets_gb: 4
mmc_rx_512_to_1023_octets_gb: 1
mmc_rx_1024_to_max_octets_gb: 56
mmc_rx_unicast_g: 64
mmc_rx_length_error: 0
mmc_rx_autofrangetype: 0
mmc_rx_pause_frames: 0
mmc_rx_fifo_overflow: 0
mmc_rx_vlan_frames_gb: 0
mmc_rx_watchdog_error: 0
mmc_rx_ipc_intr_mask: 1073692671
mmc_rx_ipc_intr: 0
mmc_rx_ipv4_gd: 65
mmc_rx_ipv4_hderr: 0
mmc_rx_ipv4_nopay: 1
mmc_rx_ipv4_frag: 0
mmc_rx_ipv4_udsbl: 0
mmc_rx_ipv4_gd_octets: 86071
mmc_rx_ipv4_hderr_octets: 0
mmc_rx_ipv4_nopay_octets: 46
mmc_rx_ipv4_frag_octets: 0
mmc_rx_ipv4_udsbl_octets: 0
mmc_rx_ipv6_gd_octets: 0
mmc_rx_ipv6_hderr_octets: 0
mmc_rx_ipv6_nopay_octets: 0
mmc_rx_ipv6_gd: 0
mmc_rx_ipv6_hderr: 0
mmc_rx_ipv6_nopay: 0
mmc_rx_udp_gd: 4
mmc_rx_udp_err: 0
mmc_rx_tcp_gd: 61
mmc_rx_tcp_err: 0
mmc_rx_icmp_gd: 0
mmc_rx_icmp_err: 0
mmc_rx_udp_gd_octets: 997
mmc_rx_udp_err_octets: 0
mmc_rx_tcp_gd_octets: 83774
mmc_rx_tcp_err_octets: 0
mmc_rx_icmp_gd_octets: 0
mmc_rx_icmp_err_octets: 0
tx_underflow: 0
tx_carrier: 0
tx_losscarrier: 0
vlan_tag: 0
tx_deferred: 0
tx_vlan: 0
tx_jabber: 0
tx_frame_flushed: 0
tx_payload_error: 0
tx_ip_header_error: 0
rx_desc: 0
sa_filter_fail: 0
overflow_error: 0
ipc_csum_error: 0
rx_collision: 0
rx_crc: 0
dribbling_bit: 0
rx_length: 0
rx_mii: 0
rx_multicast: 0
rx_gmac_overflow: 0
rx_watchdog: 0
da_rx_filter_fail: 0
sa_rx_filter_fail: 0
rx_missed_cntr: 0
rx_overflow_cntr: 0
rx_vlan: 0
tx_undeflow_irq: 0
tx_process_stopped_irq: 0
tx_jabber_irq: 0
rx_overflow_irq: 0
rx_buf_unav_irq: 0
rx_process_stopped_irq: 0
rx_watchdog_irq: 0
tx_early_irq: 0
fatal_bus_error_irq: 0
rx_early_irq: 0
threshold: 1
tx_pkt_n: 30
rx_pkt_n: 94
normal_irq_n: 36
rx_normal_irq_n: 36
napi_poll: 36
tx_normal_irq_n: 0
tx_clean: 46
tx_set_ic_bit: 0
irq_receive_pmt_irq_n: 0
mmc_tx_irq_n: 0
mmc_rx_irq_n: 0
mmc_rx_csum_offload_irq_n: 0
irq_tx_path_in_lpi_mode_n: 0
irq_tx_path_exit_lpi_mode_n: 0
irq_rx_path_in_lpi_mode_n: 0
irq_rx_path_exit_lpi_mode_n: 0
phy_eee_wakeup_error_n: 0
ip_hdr_err: 0
ip_payload_err: 0
ip_csum_bypassed: 0
ipv4_pkt_rcvd: 0
ipv6_pkt_rcvd: 0
rx_msg_type_ext_no_ptp: 0
rx_msg_type_sync: 0
rx_msg_type_follow_up: 0
rx_msg_type_delay_req: 0
rx_msg_type_delay_resp: 0
rx_msg_type_pdelay_req: 0
rx_msg_type_pdelay_resp: 0
rx_msg_type_pdelay_follow_up: 0
ptp_frame_type: 0
ptp_ver: 0
timestamp_dropped: 0
av_pkt_rcvd: 0
av_tagged_pkt_rcvd: 0
vlan_tag_priority_val: 0
l3_filter_match: 0
l4_filter_match: 0
l3_l4_filter_no_match: 0
irq_pcs_ane_n: 0
irq_pcs_link_n: 0
irq_rgmii_n: 1
mtl_tx_status_fifo_full: 0
mtl_tx_fifo_not_empty: 0
mmtl_fifo_ctrl: 0
mtl_tx_fifo_read_ctrl_write: 0
mtl_tx_fifo_read_ctrl_wait: 0
mtl_tx_fifo_read_ctrl_read: 0
mtl_tx_fifo_read_ctrl_idle: 0
mac_tx_in_pause: 0
mac_tx_frame_ctrl_xfer: 0
mac_tx_frame_ctrl_idle: 0
mac_tx_frame_ctrl_wait: 0
mac_tx_frame_ctrl_pause: 0
mac_gmii_tx_proto_engine: 0
mtl_rx_fifo_fill_level_full: 0
mtl_rx_fifo_fill_above_thresh: 0
mtl_rx_fifo_fill_below_thresh: 0
mtl_rx_fifo_fill_level_empty: 0
mtl_rx_fifo_read_ctrl_flush: 0
mtl_rx_fifo_read_ctrl_read_data: 0
mtl_rx_fifo_read_ctrl_status: 0
mtl_rx_fifo_read_ctrl_idle: 0
mtl_rx_fifo_ctrl_active: 0
mac_rx_frame_ctrl_fifo: 0
mac_gmii_rx_proto_engine: 0
tx_tso_frames: 0
tx_tso_nfrags: 0
# iperf3 --client 192.168.1.100
Connecting to host 192.168.1.100, port 5201
[ 4] local 192.168.1.248 port 36472 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 100 KBytes 822 Kbits/sec 10 1.41 KBytes
[ 4] 1.00-2.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 2.00-3.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 3.00-4.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 4.00-5.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 5.00-6.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 6.00-7.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 7.00-8.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 8.00-9.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 9.00-10.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 100 KBytes 82.2 Kbits/sec 13 sender
[ 4] 0.00-10.00 sec 2.83 KBytes 2.32 Kbits/sec receiver
iperf Done.
# ethtool -S eth0
NIC statistics:
mmc_tx_octetcount_gb: 0
mmc_tx_framecount_gb: 0
mmc_tx_broadcastframe_g: 0
mmc_tx_multicastframe_g: 0
mmc_tx_64_octets_gb: 0
mmc_tx_65_to_127_octets_gb: 0
mmc_tx_128_to_255_octets_gb: 0
mmc_tx_256_to_511_octets_gb: 0
mmc_tx_512_to_1023_octets_gb: 0
mmc_tx_1024_to_max_octets_gb: 0
mmc_tx_unicast_gb: 0
mmc_tx_multicast_gb: 0
mmc_tx_broadcast_gb: 0
mmc_tx_underflow_error: 0
mmc_tx_singlecol_g: 0
mmc_tx_multicol_g: 0
mmc_tx_deferred: 0
mmc_tx_latecol: 0
mmc_tx_exesscol: 0
mmc_tx_carrier_error: 0
mmc_tx_octetcount_g: 0
mmc_tx_framecount_g: 0
mmc_tx_excessdef: 0
mmc_tx_pause_frame: 0
mmc_tx_vlan_frame_g: 0
mmc_rx_framecount_gb: 120
mmc_rx_octetcount_gb: 91176
mmc_rx_octetcount_g: 91176
mmc_rx_broadcastframe_g: 32
mmc_rx_multicastframe_g: 1
mmc_rx_crc_error: 0
mmc_rx_align_error: 0
mmc_rx_run_error: 0
mmc_rx_jabber_error: 0
mmc_rx_undersize_g: 0
mmc_rx_oversize_g: 0
mmc_rx_64_octets_gb: 33
mmc_rx_65_to_127_octets_gb: 25
mmc_rx_128_to_255_octets_gb: 0
mmc_rx_256_to_511_octets_gb: 5
mmc_rx_512_to_1023_octets_gb: 1
mmc_rx_1024_to_max_octets_gb: 56
mmc_rx_unicast_g: 87
mmc_rx_length_error: 0
mmc_rx_autofrangetype: 0
mmc_rx_pause_frames: 0
mmc_rx_fifo_overflow: 0
mmc_rx_vlan_frames_gb: 0
mmc_rx_watchdog_error: 0
mmc_rx_ipc_intr_mask: 2147385342
mmc_rx_ipc_intr: 0
mmc_rx_ipv4_gd: 87
mmc_rx_ipv4_hderr: 0
mmc_rx_ipv4_nopay: 1
mmc_rx_ipv4_frag: 0
mmc_rx_ipv4_udsbl: 0
mmc_rx_ipv4_gd_octets: 87498
mmc_rx_ipv4_hderr_octets: 0
mmc_rx_ipv4_nopay_octets: 46
mmc_rx_ipv4_frag_octets: 0
mmc_rx_ipv4_udsbl_octets: 0
mmc_rx_ipv6_gd_octets: 0
mmc_rx_ipv6_hderr_octets: 0
mmc_rx_ipv6_nopay_octets: 0
mmc_rx_ipv6_gd: 0
mmc_rx_ipv6_hderr: 0
mmc_rx_ipv6_nopay: 0
mmc_rx_udp_gd: 4
mmc_rx_udp_err: 0
mmc_rx_tcp_gd: 83
mmc_rx_tcp_err: 0
mmc_rx_icmp_gd: 0
mmc_rx_icmp_err: 0
mmc_rx_udp_gd_octets: 997
mmc_rx_udp_err_octets: 0
mmc_rx_tcp_gd_octets: 84761
mmc_rx_tcp_err_octets: 0
mmc_rx_icmp_gd_octets: 0
mmc_rx_icmp_err_octets: 0
tx_underflow: 0
tx_carrier: 0
tx_losscarrier: 0
vlan_tag: 0
tx_deferred: 0
tx_vlan: 0
tx_jabber: 0
tx_frame_flushed: 0
tx_payload_error: 0
tx_ip_header_error: 0
rx_desc: 0
sa_filter_fail: 0
overflow_error: 0
ipc_csum_error: 0
rx_collision: 0
rx_crc: 0
dribbling_bit: 0
rx_length: 0
rx_mii: 0
rx_multicast: 0
rx_gmac_overflow: 0
rx_watchdog: 0
da_rx_filter_fail: 0
sa_rx_filter_fail: 0
rx_missed_cntr: 0
rx_overflow_cntr: 0
rx_vlan: 0
tx_undeflow_irq: 0
tx_process_stopped_irq: 0
tx_jabber_irq: 0
rx_overflow_irq: 0
rx_buf_unav_irq: 0
rx_process_stopped_irq: 0
rx_watchdog_irq: 0
tx_early_irq: 0
fatal_bus_error_irq: 0
rx_early_irq: 0
threshold: 1
tx_pkt_n: 80
rx_pkt_n: 120
normal_irq_n: 56
rx_normal_irq_n: 55
napi_poll: 56
tx_normal_irq_n: 1
tx_clean: 79
tx_set_ic_bit: 1
irq_receive_pmt_irq_n: 0
mmc_tx_irq_n: 0
mmc_rx_irq_n: 0
mmc_rx_csum_offload_irq_n: 0
irq_tx_path_in_lpi_mode_n: 0
irq_tx_path_exit_lpi_mode_n: 0
irq_rx_path_in_lpi_mode_n: 0
irq_rx_path_exit_lpi_mode_n: 0
phy_eee_wakeup_error_n: 0
ip_hdr_err: 0
ip_payload_err: 0
ip_csum_bypassed: 0
ipv4_pkt_rcvd: 0
ipv6_pkt_rcvd: 0
rx_msg_type_ext_no_ptp: 0
rx_msg_type_sync: 0
rx_msg_type_follow_up: 0
rx_msg_type_delay_req: 0
rx_msg_type_delay_resp: 0
rx_msg_type_pdelay_req: 0
rx_msg_type_pdelay_resp: 0
rx_msg_type_pdelay_follow_up: 0
ptp_frame_type: 0
ptp_ver: 0
timestamp_dropped: 0
av_pkt_rcvd: 0
av_tagged_pkt_rcvd: 0
vlan_tag_priority_val: 0
l3_filter_match: 0
l4_filter_match: 0
l3_l4_filter_no_match: 0
irq_pcs_ane_n: 0
irq_pcs_link_n: 0
irq_rgmii_n: 1
mtl_tx_status_fifo_full: 0
mtl_tx_fifo_not_empty: 0
mmtl_fifo_ctrl: 0
mtl_tx_fifo_read_ctrl_write: 0
mtl_tx_fifo_read_ctrl_wait: 0
mtl_tx_fifo_read_ctrl_read: 0
mtl_tx_fifo_read_ctrl_idle: 0
mac_tx_in_pause: 0
mac_tx_frame_ctrl_xfer: 0
mac_tx_frame_ctrl_idle: 0
mac_tx_frame_ctrl_wait: 0
mac_tx_frame_ctrl_pause: 0
mac_gmii_tx_proto_engine: 0
mtl_rx_fifo_fill_level_full: 0
mtl_rx_fifo_fill_above_thresh: 0
mtl_rx_fifo_fill_below_thresh: 0
mtl_rx_fifo_fill_level_empty: 0
mtl_rx_fifo_read_ctrl_flush: 0
mtl_rx_fifo_read_ctrl_read_data: 0
mtl_rx_fifo_read_ctrl_status: 0
mtl_rx_fifo_read_ctrl_idle: 0
mtl_rx_fifo_ctrl_active: 0
mac_rx_frame_ctrl_fifo: 0
mac_gmii_rx_proto_engine: 0
tx_tso_frames: 0
tx_tso_nfrags: 0
# iperf3 --client 192.168.1.100 -R
Connecting to host 192.168.1.100, port 5201
Reverse mode, remote host 192.168.1.100 is sending
[ 4] local 192.168.1.248 port 36476 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 111 MBytes 929 Mbits/sec
[ 4] 1.00-2.00 sec 111 MBytes 934 Mbits/sec
[ 4] 2.00-3.00 sec 111 MBytes 934 Mbits/sec
[ 4] 3.00-4.00 sec 111 MBytes 934 Mbits/sec
[ 4] 4.00-5.00 sec 111 MBytes 935 Mbits/sec
[ 4] 5.00-6.00 sec 111 MBytes 934 Mbits/sec
[ 4] 6.00-7.00 sec 111 MBytes 934 Mbits/sec
[ 4] 7.00-8.00 sec 111 MBytes 934 Mbits/sec
[ 4] 8.00-9.00 sec 111 MBytes 934 Mbits/sec
[ 4] 9.00-10.00 sec 111 MBytes 934 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 1.09 GBytes 936 Mbits/sec 0 sender
[ 4] 0.00-10.00 sec 1.09 GBytes 934 Mbits/sec receiver
iperf Done.
# ethtool -S eth0
NIC statistics:
mmc_tx_octetcount_gb: 0
mmc_tx_framecount_gb: 0
mmc_tx_broadcastframe_g: 0
mmc_tx_multicastframe_g: 0
mmc_tx_64_octets_gb: 0
mmc_tx_65_to_127_octets_gb: 0
mmc_tx_128_to_255_octets_gb: 0
mmc_tx_256_to_511_octets_gb: 0
mmc_tx_512_to_1023_octets_gb: 0
mmc_tx_1024_to_max_octets_gb: 0
mmc_tx_unicast_gb: 0
mmc_tx_multicast_gb: 0
mmc_tx_broadcast_gb: 0
mmc_tx_underflow_error: 0
mmc_tx_singlecol_g: 0
mmc_tx_multicol_g: 0
mmc_tx_deferred: 0
mmc_tx_latecol: 0
mmc_tx_exesscol: 0
mmc_tx_carrier_error: 0
mmc_tx_octetcount_g: 0
mmc_tx_framecount_g: 0
mmc_tx_excessdef: 0
mmc_tx_pause_frame: 0
mmc_tx_vlan_frame_g: 0
mmc_rx_framecount_gb: 807320
mmc_rx_octetcount_gb: 1225389106
mmc_rx_octetcount_g: 1225389106
mmc_rx_broadcastframe_g: 38
mmc_rx_multicastframe_g: 1
mmc_rx_crc_error: 0
mmc_rx_align_error: 0
mmc_rx_run_error: 0
mmc_rx_jabber_error: 0
mmc_rx_undersize_g: 0
mmc_rx_oversize_g: 0
mmc_rx_64_octets_gb: 39
mmc_rx_65_to_127_octets_gb: 40
mmc_rx_128_to_255_octets_gb: 0
mmc_rx_256_to_511_octets_gb: 6
mmc_rx_512_to_1023_octets_gb: 1
mmc_rx_1024_to_max_octets_gb: 807234
mmc_rx_unicast_g: 807281
mmc_rx_length_error: 0
mmc_rx_autofrangetype: 0
mmc_rx_pause_frames: 0
mmc_rx_fifo_overflow: 0
mmc_rx_vlan_frames_gb: 0
mmc_rx_watchdog_error: 0
mmc_rx_ipc_intr_mask: 3221078013
mmc_rx_ipc_intr: 0
mmc_rx_ipv4_gd: 807281
mmc_rx_ipv4_hderr: 0
mmc_rx_ipv4_nopay: 1
mmc_rx_ipv4_frag: 0
mmc_rx_ipv4_udsbl: 0
mmc_rx_ipv4_gd_octets: 1210855552
mmc_rx_ipv4_hderr_octets: 0
mmc_rx_ipv4_nopay_octets: 46
mmc_rx_ipv4_frag_octets: 0
mmc_rx_ipv4_udsbl_octets: 0
mmc_rx_ipv6_gd_octets: 0
mmc_rx_ipv6_hderr_octets: 0
mmc_rx_ipv6_nopay_octets: 0
mmc_rx_ipv6_gd: 0
mmc_rx_ipv6_hderr: 0
mmc_rx_ipv6_nopay: 0
mmc_rx_udp_gd: 4
mmc_rx_udp_err: 0
mmc_rx_tcp_gd: 807277
mmc_rx_tcp_err: 0
mmc_rx_icmp_gd: 0
mmc_rx_icmp_err: 0
mmc_rx_udp_gd_octets: 997
mmc_rx_udp_err_octets: 0
mmc_rx_tcp_gd_octets: 1194708935
mmc_rx_tcp_err_octets: 0
mmc_rx_icmp_gd_octets: 0
mmc_rx_icmp_err_octets: 0
tx_underflow: 0
tx_carrier: 0
tx_losscarrier: 0
vlan_tag: 0
tx_deferred: 0
tx_vlan: 0
tx_jabber: 0
tx_frame_flushed: 0
tx_payload_error: 0
tx_ip_header_error: 0
rx_desc: 0
sa_filter_fail: 0
overflow_error: 0
ipc_csum_error: 0
rx_collision: 0
rx_crc: 0
dribbling_bit: 0
rx_length: 0
rx_mii: 0
rx_multicast: 0
rx_gmac_overflow: 0
rx_watchdog: 0
da_rx_filter_fail: 0
sa_rx_filter_fail: 0
rx_missed_cntr: 0
rx_overflow_cntr: 0
rx_vlan: 0
tx_undeflow_irq: 0
tx_process_stopped_irq: 0
tx_jabber_irq: 0
rx_overflow_irq: 0
rx_buf_unav_irq: 0
rx_process_stopped_irq: 0
rx_watchdog_irq: 0
tx_early_irq: 0
fatal_bus_error_irq: 0
rx_early_irq: 456
threshold: 1
tx_pkt_n: 29240
rx_pkt_n: 807320
normal_irq_n: 25764
rx_normal_irq_n: 25307
napi_poll: 25764
tx_normal_irq_n: 457
tx_clean: 25790
tx_set_ic_bit: 457
irq_receive_pmt_irq_n: 0
mmc_tx_irq_n: 0
mmc_rx_irq_n: 0
mmc_rx_csum_offload_irq_n: 0
irq_tx_path_in_lpi_mode_n: 0
irq_tx_path_exit_lpi_mode_n: 0
irq_rx_path_in_lpi_mode_n: 0
irq_rx_path_exit_lpi_mode_n: 0
phy_eee_wakeup_error_n: 0
ip_hdr_err: 0
ip_payload_err: 0
ip_csum_bypassed: 0
ipv4_pkt_rcvd: 0
ipv6_pkt_rcvd: 0
rx_msg_type_ext_no_ptp: 0
rx_msg_type_sync: 0
rx_msg_type_follow_up: 0
rx_msg_type_delay_req: 0
rx_msg_type_delay_resp: 0
rx_msg_type_pdelay_req: 0
rx_msg_type_pdelay_resp: 0
rx_msg_type_pdelay_follow_up: 0
ptp_frame_type: 0
ptp_ver: 0
timestamp_dropped: 0
av_pkt_rcvd: 0
av_tagged_pkt_rcvd: 0
vlan_tag_priority_val: 0
l3_filter_match: 0
l4_filter_match: 0
l3_l4_filter_no_match: 0
irq_pcs_ane_n: 0
irq_pcs_link_n: 0
irq_rgmii_n: 1
mtl_tx_status_fifo_full: 0
mtl_tx_fifo_not_empty: 0
mmtl_fifo_ctrl: 0
mtl_tx_fifo_read_ctrl_write: 0
mtl_tx_fifo_read_ctrl_wait: 0
mtl_tx_fifo_read_ctrl_read: 0
mtl_tx_fifo_read_ctrl_idle: 0
mac_tx_in_pause: 0
mac_tx_frame_ctrl_xfer: 0
mac_tx_frame_ctrl_idle: 0
mac_tx_frame_ctrl_wait: 0
mac_tx_frame_ctrl_pause: 0
mac_gmii_tx_proto_engine: 0
mtl_rx_fifo_fill_level_full: 0
mtl_rx_fifo_fill_above_thresh: 0
mtl_rx_fifo_fill_below_thresh: 0
mtl_rx_fifo_fill_level_empty: 0
mtl_rx_fifo_read_ctrl_flush: 0
mtl_rx_fifo_read_ctrl_read_data: 0
mtl_rx_fifo_read_ctrl_status: 0
mtl_rx_fifo_read_ctrl_idle: 0
mtl_rx_fifo_ctrl_active: 0
mac_rx_frame_ctrl_fifo: 0
mac_gmii_rx_proto_engine: 0
tx_tso_frames: 0
tx_tso_nfrags: 0
#
[-- Attachment #3: stmmac-hack-disable-LPI.patch --]
[-- Type: text/x-patch, Size: 2072 bytes --]
diff --git a/drivers/net/ethernet/stmicro/stmmac/dwmac1000_core.c b/drivers/net/ethernet/stmicro/stmmac/dwmac1000_core.c
index cbefe9e..b474a64 100644
--- a/drivers/net/ethernet/stmicro/stmmac/dwmac1000_core.c
+++ b/drivers/net/ethernet/stmicro/stmmac/dwmac1000_core.c
@@ -345,6 +345,7 @@ static int dwmac1000_irq_status(struct mac_device_info *hw,
static void dwmac1000_set_eee_mode(struct mac_device_info *hw)
{
+#if 0
void __iomem *ioaddr = hw->pcsr;
u32 value;
@@ -355,6 +356,7 @@ static void dwmac1000_set_eee_mode(struct mac_device_info *hw)
value = readl(ioaddr + LPI_CTRL_STATUS);
value |= LPI_CTRL_STATUS_LPIEN | LPI_CTRL_STATUS_LPITXA;
writel(value, ioaddr + LPI_CTRL_STATUS);
+#endif
}
static void dwmac1000_reset_eee_mode(struct mac_device_info *hw)
diff --git a/drivers/net/ethernet/stmicro/stmmac/dwmac1000_dma.c b/drivers/net/ethernet/stmicro/stmmac/dwmac1000_dma.c
index 99074695..b7d3034 100644
--- a/drivers/net/ethernet/stmicro/stmmac/dwmac1000_dma.c
+++ b/drivers/net/ethernet/stmicro/stmmac/dwmac1000_dma.c
@@ -42,7 +42,7 @@ static void dwmac1000_dma_axi(void __iomem *ioaddr, struct stmmac_axi *axi)
value |= DMA_AXI_EN_LPI;
if (axi->axi_xit_frm)
value |= DMA_AXI_LPI_XIT_FRM;
-
+value &= DMA_AXI_EN_LPI;
value |= (axi->axi_wr_osr_lmt & DMA_AXI_WR_OSR_LMT_MASK) <<
DMA_AXI_WR_OSR_LMT_SHIFT;
diff --git a/drivers/net/ethernet/stmicro/stmmac/stmmac_main.c b/drivers/net/ethernet/stmicro/stmmac/stmmac_main.c
index 4c8c60a..f477ec0 100644
--- a/drivers/net/ethernet/stmicro/stmmac/stmmac_main.c
+++ b/drivers/net/ethernet/stmicro/stmmac/stmmac_main.c
@@ -312,6 +312,7 @@ bool stmmac_eee_init(struct stmmac_priv *priv)
spin_unlock_irqrestore(&priv->lock, flags);
goto out;
}
+#if 0
/* Activate the EEE and start timers */
spin_lock_irqsave(&priv->lock, flags);
if (!priv->eee_active) {
@@ -333,6 +334,7 @@ bool stmmac_eee_init(struct stmmac_priv *priv)
spin_unlock_irqrestore(&priv->lock, flags);
pr_debug("stmmac: Energy-Efficient Ethernet initialized\n");
+#endif
}
out:
return ret;
^ permalink raw reply related [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-10-01 15:58 ` Martin Blumenstingl
0 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-10-01 15:58 UTC (permalink / raw)
To: linus-amlogic
Hello Peppe,
On Mon, Sep 26, 2016 at 8:17 AM, Giuseppe CAVALLARO
<peppe.cavallaro@st.com> wrote:
> Hello Andr?
>
> On 9/17/2016 11:23 PM, Andr? Roth wrote:
>>
>>
>> Hi all,
>>
>> I have an odroid c2 board which shows this issue. No data is
>> transmitted or received after a moment of intense tx traffic. Copying a
>> 1GB file per scp from the board triggers it repeatedly.
>>
>> The board has a stmmac - user ID: 0x11, Synopsys ID: 0x37.
>>
>> When switching the network to 100Mb/s the copying does
>> not seam to trigger the issue.
>>
>> I've attached the ethtool statistics before and after the problem.
>
>
> at first glance, it enters in EEE mode often in the ethtool.after.
> On some platforms we met problems and it was necessary to disable the
> feature. Maybe, you can start looking at if this is true on yours.
> We will see to provide a clean subset of patches to switch-on/off it.
I did some hacking in the stmmac driver to disable the LPI stuff (see
the attachment)
Unfortunately this did not fix the problem.
I did not issue any ethtool commands not shown in the logs.
Also I did not have time to change the AXI tuning / PBL value yet - so
those are also untouched.
I will keep testing, but unfortunately my device is starting to fall
apart (I sometimes have DDR initialization issues and u-boot fails to
come up, oh dear...).
-------------- next part --------------
# ethtool -S eth0
NIC statistics:
mmc_tx_octetcount_gb: 0
mmc_tx_framecount_gb: 0
mmc_tx_broadcastframe_g: 0
mmc_tx_multicastframe_g: 0
mmc_tx_64_octets_gb: 0
mmc_tx_65_to_127_octets_gb: 0
mmc_tx_128_to_255_octets_gb: 0
mmc_tx_256_to_511_octets_gb: 0
mmc_tx_512_to_1023_octets_gb: 0
mmc_tx_1024_to_max_octets_gb: 0
mmc_tx_unicast_gb: 0
mmc_tx_multicast_gb: 0
mmc_tx_broadcast_gb: 0
mmc_tx_underflow_error: 0
mmc_tx_singlecol_g: 0
mmc_tx_multicol_g: 0
mmc_tx_deferred: 0
mmc_tx_latecol: 0
mmc_tx_exesscol: 0
mmc_tx_carrier_error: 0
mmc_tx_octetcount_g: 0
mmc_tx_framecount_g: 0
mmc_tx_excessdef: 0
mmc_tx_pause_frame: 0
mmc_tx_vlan_frame_g: 0
mmc_rx_framecount_gb: 94
mmc_rx_octetcount_gb: 89097
mmc_rx_octetcount_g: 89097
mmc_rx_broadcastframe_g: 29
mmc_rx_multicastframe_g: 1
mmc_rx_crc_error: 0
mmc_rx_align_error: 0
mmc_rx_run_error: 0
mmc_rx_jabber_error: 0
mmc_rx_undersize_g: 0
mmc_rx_oversize_g: 0
mmc_rx_64_octets_gb: 29
mmc_rx_65_to_127_octets_gb: 4
mmc_rx_128_to_255_octets_gb: 0
mmc_rx_256_to_511_octets_gb: 4
mmc_rx_512_to_1023_octets_gb: 1
mmc_rx_1024_to_max_octets_gb: 56
mmc_rx_unicast_g: 64
mmc_rx_length_error: 0
mmc_rx_autofrangetype: 0
mmc_rx_pause_frames: 0
mmc_rx_fifo_overflow: 0
mmc_rx_vlan_frames_gb: 0
mmc_rx_watchdog_error: 0
mmc_rx_ipc_intr_mask: 1073692671
mmc_rx_ipc_intr: 0
mmc_rx_ipv4_gd: 65
mmc_rx_ipv4_hderr: 0
mmc_rx_ipv4_nopay: 1
mmc_rx_ipv4_frag: 0
mmc_rx_ipv4_udsbl: 0
mmc_rx_ipv4_gd_octets: 86071
mmc_rx_ipv4_hderr_octets: 0
mmc_rx_ipv4_nopay_octets: 46
mmc_rx_ipv4_frag_octets: 0
mmc_rx_ipv4_udsbl_octets: 0
mmc_rx_ipv6_gd_octets: 0
mmc_rx_ipv6_hderr_octets: 0
mmc_rx_ipv6_nopay_octets: 0
mmc_rx_ipv6_gd: 0
mmc_rx_ipv6_hderr: 0
mmc_rx_ipv6_nopay: 0
mmc_rx_udp_gd: 4
mmc_rx_udp_err: 0
mmc_rx_tcp_gd: 61
mmc_rx_tcp_err: 0
mmc_rx_icmp_gd: 0
mmc_rx_icmp_err: 0
mmc_rx_udp_gd_octets: 997
mmc_rx_udp_err_octets: 0
mmc_rx_tcp_gd_octets: 83774
mmc_rx_tcp_err_octets: 0
mmc_rx_icmp_gd_octets: 0
mmc_rx_icmp_err_octets: 0
tx_underflow: 0
tx_carrier: 0
tx_losscarrier: 0
vlan_tag: 0
tx_deferred: 0
tx_vlan: 0
tx_jabber: 0
tx_frame_flushed: 0
tx_payload_error: 0
tx_ip_header_error: 0
rx_desc: 0
sa_filter_fail: 0
overflow_error: 0
ipc_csum_error: 0
rx_collision: 0
rx_crc: 0
dribbling_bit: 0
rx_length: 0
rx_mii: 0
rx_multicast: 0
rx_gmac_overflow: 0
rx_watchdog: 0
da_rx_filter_fail: 0
sa_rx_filter_fail: 0
rx_missed_cntr: 0
rx_overflow_cntr: 0
rx_vlan: 0
tx_undeflow_irq: 0
tx_process_stopped_irq: 0
tx_jabber_irq: 0
rx_overflow_irq: 0
rx_buf_unav_irq: 0
rx_process_stopped_irq: 0
rx_watchdog_irq: 0
tx_early_irq: 0
fatal_bus_error_irq: 0
rx_early_irq: 0
threshold: 1
tx_pkt_n: 30
rx_pkt_n: 94
normal_irq_n: 36
rx_normal_irq_n: 36
napi_poll: 36
tx_normal_irq_n: 0
tx_clean: 46
tx_set_ic_bit: 0
irq_receive_pmt_irq_n: 0
mmc_tx_irq_n: 0
mmc_rx_irq_n: 0
mmc_rx_csum_offload_irq_n: 0
irq_tx_path_in_lpi_mode_n: 0
irq_tx_path_exit_lpi_mode_n: 0
irq_rx_path_in_lpi_mode_n: 0
irq_rx_path_exit_lpi_mode_n: 0
phy_eee_wakeup_error_n: 0
ip_hdr_err: 0
ip_payload_err: 0
ip_csum_bypassed: 0
ipv4_pkt_rcvd: 0
ipv6_pkt_rcvd: 0
rx_msg_type_ext_no_ptp: 0
rx_msg_type_sync: 0
rx_msg_type_follow_up: 0
rx_msg_type_delay_req: 0
rx_msg_type_delay_resp: 0
rx_msg_type_pdelay_req: 0
rx_msg_type_pdelay_resp: 0
rx_msg_type_pdelay_follow_up: 0
ptp_frame_type: 0
ptp_ver: 0
timestamp_dropped: 0
av_pkt_rcvd: 0
av_tagged_pkt_rcvd: 0
vlan_tag_priority_val: 0
l3_filter_match: 0
l4_filter_match: 0
l3_l4_filter_no_match: 0
irq_pcs_ane_n: 0
irq_pcs_link_n: 0
irq_rgmii_n: 1
mtl_tx_status_fifo_full: 0
mtl_tx_fifo_not_empty: 0
mmtl_fifo_ctrl: 0
mtl_tx_fifo_read_ctrl_write: 0
mtl_tx_fifo_read_ctrl_wait: 0
mtl_tx_fifo_read_ctrl_read: 0
mtl_tx_fifo_read_ctrl_idle: 0
mac_tx_in_pause: 0
mac_tx_frame_ctrl_xfer: 0
mac_tx_frame_ctrl_idle: 0
mac_tx_frame_ctrl_wait: 0
mac_tx_frame_ctrl_pause: 0
mac_gmii_tx_proto_engine: 0
mtl_rx_fifo_fill_level_full: 0
mtl_rx_fifo_fill_above_thresh: 0
mtl_rx_fifo_fill_below_thresh: 0
mtl_rx_fifo_fill_level_empty: 0
mtl_rx_fifo_read_ctrl_flush: 0
mtl_rx_fifo_read_ctrl_read_data: 0
mtl_rx_fifo_read_ctrl_status: 0
mtl_rx_fifo_read_ctrl_idle: 0
mtl_rx_fifo_ctrl_active: 0
mac_rx_frame_ctrl_fifo: 0
mac_gmii_rx_proto_engine: 0
tx_tso_frames: 0
tx_tso_nfrags: 0
# iperf3 --client 192.168.1.100
Connecting to host 192.168.1.100, port 5201
[ 4] local 192.168.1.248 port 36472 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 100 KBytes 822 Kbits/sec 10 1.41 KBytes
[ 4] 1.00-2.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 2.00-3.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 3.00-4.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 4.00-5.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 5.00-6.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 6.00-7.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 7.00-8.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 8.00-9.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 9.00-10.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 100 KBytes 82.2 Kbits/sec 13 sender
[ 4] 0.00-10.00 sec 2.83 KBytes 2.32 Kbits/sec receiver
iperf Done.
# ethtool -S eth0
NIC statistics:
mmc_tx_octetcount_gb: 0
mmc_tx_framecount_gb: 0
mmc_tx_broadcastframe_g: 0
mmc_tx_multicastframe_g: 0
mmc_tx_64_octets_gb: 0
mmc_tx_65_to_127_octets_gb: 0
mmc_tx_128_to_255_octets_gb: 0
mmc_tx_256_to_511_octets_gb: 0
mmc_tx_512_to_1023_octets_gb: 0
mmc_tx_1024_to_max_octets_gb: 0
mmc_tx_unicast_gb: 0
mmc_tx_multicast_gb: 0
mmc_tx_broadcast_gb: 0
mmc_tx_underflow_error: 0
mmc_tx_singlecol_g: 0
mmc_tx_multicol_g: 0
mmc_tx_deferred: 0
mmc_tx_latecol: 0
mmc_tx_exesscol: 0
mmc_tx_carrier_error: 0
mmc_tx_octetcount_g: 0
mmc_tx_framecount_g: 0
mmc_tx_excessdef: 0
mmc_tx_pause_frame: 0
mmc_tx_vlan_frame_g: 0
mmc_rx_framecount_gb: 120
mmc_rx_octetcount_gb: 91176
mmc_rx_octetcount_g: 91176
mmc_rx_broadcastframe_g: 32
mmc_rx_multicastframe_g: 1
mmc_rx_crc_error: 0
mmc_rx_align_error: 0
mmc_rx_run_error: 0
mmc_rx_jabber_error: 0
mmc_rx_undersize_g: 0
mmc_rx_oversize_g: 0
mmc_rx_64_octets_gb: 33
mmc_rx_65_to_127_octets_gb: 25
mmc_rx_128_to_255_octets_gb: 0
mmc_rx_256_to_511_octets_gb: 5
mmc_rx_512_to_1023_octets_gb: 1
mmc_rx_1024_to_max_octets_gb: 56
mmc_rx_unicast_g: 87
mmc_rx_length_error: 0
mmc_rx_autofrangetype: 0
mmc_rx_pause_frames: 0
mmc_rx_fifo_overflow: 0
mmc_rx_vlan_frames_gb: 0
mmc_rx_watchdog_error: 0
mmc_rx_ipc_intr_mask: 2147385342
mmc_rx_ipc_intr: 0
mmc_rx_ipv4_gd: 87
mmc_rx_ipv4_hderr: 0
mmc_rx_ipv4_nopay: 1
mmc_rx_ipv4_frag: 0
mmc_rx_ipv4_udsbl: 0
mmc_rx_ipv4_gd_octets: 87498
mmc_rx_ipv4_hderr_octets: 0
mmc_rx_ipv4_nopay_octets: 46
mmc_rx_ipv4_frag_octets: 0
mmc_rx_ipv4_udsbl_octets: 0
mmc_rx_ipv6_gd_octets: 0
mmc_rx_ipv6_hderr_octets: 0
mmc_rx_ipv6_nopay_octets: 0
mmc_rx_ipv6_gd: 0
mmc_rx_ipv6_hderr: 0
mmc_rx_ipv6_nopay: 0
mmc_rx_udp_gd: 4
mmc_rx_udp_err: 0
mmc_rx_tcp_gd: 83
mmc_rx_tcp_err: 0
mmc_rx_icmp_gd: 0
mmc_rx_icmp_err: 0
mmc_rx_udp_gd_octets: 997
mmc_rx_udp_err_octets: 0
mmc_rx_tcp_gd_octets: 84761
mmc_rx_tcp_err_octets: 0
mmc_rx_icmp_gd_octets: 0
mmc_rx_icmp_err_octets: 0
tx_underflow: 0
tx_carrier: 0
tx_losscarrier: 0
vlan_tag: 0
tx_deferred: 0
tx_vlan: 0
tx_jabber: 0
tx_frame_flushed: 0
tx_payload_error: 0
tx_ip_header_error: 0
rx_desc: 0
sa_filter_fail: 0
overflow_error: 0
ipc_csum_error: 0
rx_collision: 0
rx_crc: 0
dribbling_bit: 0
rx_length: 0
rx_mii: 0
rx_multicast: 0
rx_gmac_overflow: 0
rx_watchdog: 0
da_rx_filter_fail: 0
sa_rx_filter_fail: 0
rx_missed_cntr: 0
rx_overflow_cntr: 0
rx_vlan: 0
tx_undeflow_irq: 0
tx_process_stopped_irq: 0
tx_jabber_irq: 0
rx_overflow_irq: 0
rx_buf_unav_irq: 0
rx_process_stopped_irq: 0
rx_watchdog_irq: 0
tx_early_irq: 0
fatal_bus_error_irq: 0
rx_early_irq: 0
threshold: 1
tx_pkt_n: 80
rx_pkt_n: 120
normal_irq_n: 56
rx_normal_irq_n: 55
napi_poll: 56
tx_normal_irq_n: 1
tx_clean: 79
tx_set_ic_bit: 1
irq_receive_pmt_irq_n: 0
mmc_tx_irq_n: 0
mmc_rx_irq_n: 0
mmc_rx_csum_offload_irq_n: 0
irq_tx_path_in_lpi_mode_n: 0
irq_tx_path_exit_lpi_mode_n: 0
irq_rx_path_in_lpi_mode_n: 0
irq_rx_path_exit_lpi_mode_n: 0
phy_eee_wakeup_error_n: 0
ip_hdr_err: 0
ip_payload_err: 0
ip_csum_bypassed: 0
ipv4_pkt_rcvd: 0
ipv6_pkt_rcvd: 0
rx_msg_type_ext_no_ptp: 0
rx_msg_type_sync: 0
rx_msg_type_follow_up: 0
rx_msg_type_delay_req: 0
rx_msg_type_delay_resp: 0
rx_msg_type_pdelay_req: 0
rx_msg_type_pdelay_resp: 0
rx_msg_type_pdelay_follow_up: 0
ptp_frame_type: 0
ptp_ver: 0
timestamp_dropped: 0
av_pkt_rcvd: 0
av_tagged_pkt_rcvd: 0
vlan_tag_priority_val: 0
l3_filter_match: 0
l4_filter_match: 0
l3_l4_filter_no_match: 0
irq_pcs_ane_n: 0
irq_pcs_link_n: 0
irq_rgmii_n: 1
mtl_tx_status_fifo_full: 0
mtl_tx_fifo_not_empty: 0
mmtl_fifo_ctrl: 0
mtl_tx_fifo_read_ctrl_write: 0
mtl_tx_fifo_read_ctrl_wait: 0
mtl_tx_fifo_read_ctrl_read: 0
mtl_tx_fifo_read_ctrl_idle: 0
mac_tx_in_pause: 0
mac_tx_frame_ctrl_xfer: 0
mac_tx_frame_ctrl_idle: 0
mac_tx_frame_ctrl_wait: 0
mac_tx_frame_ctrl_pause: 0
mac_gmii_tx_proto_engine: 0
mtl_rx_fifo_fill_level_full: 0
mtl_rx_fifo_fill_above_thresh: 0
mtl_rx_fifo_fill_below_thresh: 0
mtl_rx_fifo_fill_level_empty: 0
mtl_rx_fifo_read_ctrl_flush: 0
mtl_rx_fifo_read_ctrl_read_data: 0
mtl_rx_fifo_read_ctrl_status: 0
mtl_rx_fifo_read_ctrl_idle: 0
mtl_rx_fifo_ctrl_active: 0
mac_rx_frame_ctrl_fifo: 0
mac_gmii_rx_proto_engine: 0
tx_tso_frames: 0
tx_tso_nfrags: 0
# iperf3 --client 192.168.1.100 -R
Connecting to host 192.168.1.100, port 5201
Reverse mode, remote host 192.168.1.100 is sending
[ 4] local 192.168.1.248 port 36476 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 111 MBytes 929 Mbits/sec
[ 4] 1.00-2.00 sec 111 MBytes 934 Mbits/sec
[ 4] 2.00-3.00 sec 111 MBytes 934 Mbits/sec
[ 4] 3.00-4.00 sec 111 MBytes 934 Mbits/sec
[ 4] 4.00-5.00 sec 111 MBytes 935 Mbits/sec
[ 4] 5.00-6.00 sec 111 MBytes 934 Mbits/sec
[ 4] 6.00-7.00 sec 111 MBytes 934 Mbits/sec
[ 4] 7.00-8.00 sec 111 MBytes 934 Mbits/sec
[ 4] 8.00-9.00 sec 111 MBytes 934 Mbits/sec
[ 4] 9.00-10.00 sec 111 MBytes 934 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 1.09 GBytes 936 Mbits/sec 0 sender
[ 4] 0.00-10.00 sec 1.09 GBytes 934 Mbits/sec receiver
iperf Done.
# ethtool -S eth0
NIC statistics:
mmc_tx_octetcount_gb: 0
mmc_tx_framecount_gb: 0
mmc_tx_broadcastframe_g: 0
mmc_tx_multicastframe_g: 0
mmc_tx_64_octets_gb: 0
mmc_tx_65_to_127_octets_gb: 0
mmc_tx_128_to_255_octets_gb: 0
mmc_tx_256_to_511_octets_gb: 0
mmc_tx_512_to_1023_octets_gb: 0
mmc_tx_1024_to_max_octets_gb: 0
mmc_tx_unicast_gb: 0
mmc_tx_multicast_gb: 0
mmc_tx_broadcast_gb: 0
mmc_tx_underflow_error: 0
mmc_tx_singlecol_g: 0
mmc_tx_multicol_g: 0
mmc_tx_deferred: 0
mmc_tx_latecol: 0
mmc_tx_exesscol: 0
mmc_tx_carrier_error: 0
mmc_tx_octetcount_g: 0
mmc_tx_framecount_g: 0
mmc_tx_excessdef: 0
mmc_tx_pause_frame: 0
mmc_tx_vlan_frame_g: 0
mmc_rx_framecount_gb: 807320
mmc_rx_octetcount_gb: 1225389106
mmc_rx_octetcount_g: 1225389106
mmc_rx_broadcastframe_g: 38
mmc_rx_multicastframe_g: 1
mmc_rx_crc_error: 0
mmc_rx_align_error: 0
mmc_rx_run_error: 0
mmc_rx_jabber_error: 0
mmc_rx_undersize_g: 0
mmc_rx_oversize_g: 0
mmc_rx_64_octets_gb: 39
mmc_rx_65_to_127_octets_gb: 40
mmc_rx_128_to_255_octets_gb: 0
mmc_rx_256_to_511_octets_gb: 6
mmc_rx_512_to_1023_octets_gb: 1
mmc_rx_1024_to_max_octets_gb: 807234
mmc_rx_unicast_g: 807281
mmc_rx_length_error: 0
mmc_rx_autofrangetype: 0
mmc_rx_pause_frames: 0
mmc_rx_fifo_overflow: 0
mmc_rx_vlan_frames_gb: 0
mmc_rx_watchdog_error: 0
mmc_rx_ipc_intr_mask: 3221078013
mmc_rx_ipc_intr: 0
mmc_rx_ipv4_gd: 807281
mmc_rx_ipv4_hderr: 0
mmc_rx_ipv4_nopay: 1
mmc_rx_ipv4_frag: 0
mmc_rx_ipv4_udsbl: 0
mmc_rx_ipv4_gd_octets: 1210855552
mmc_rx_ipv4_hderr_octets: 0
mmc_rx_ipv4_nopay_octets: 46
mmc_rx_ipv4_frag_octets: 0
mmc_rx_ipv4_udsbl_octets: 0
mmc_rx_ipv6_gd_octets: 0
mmc_rx_ipv6_hderr_octets: 0
mmc_rx_ipv6_nopay_octets: 0
mmc_rx_ipv6_gd: 0
mmc_rx_ipv6_hderr: 0
mmc_rx_ipv6_nopay: 0
mmc_rx_udp_gd: 4
mmc_rx_udp_err: 0
mmc_rx_tcp_gd: 807277
mmc_rx_tcp_err: 0
mmc_rx_icmp_gd: 0
mmc_rx_icmp_err: 0
mmc_rx_udp_gd_octets: 997
mmc_rx_udp_err_octets: 0
mmc_rx_tcp_gd_octets: 1194708935
mmc_rx_tcp_err_octets: 0
mmc_rx_icmp_gd_octets: 0
mmc_rx_icmp_err_octets: 0
tx_underflow: 0
tx_carrier: 0
tx_losscarrier: 0
vlan_tag: 0
tx_deferred: 0
tx_vlan: 0
tx_jabber: 0
tx_frame_flushed: 0
tx_payload_error: 0
tx_ip_header_error: 0
rx_desc: 0
sa_filter_fail: 0
overflow_error: 0
ipc_csum_error: 0
rx_collision: 0
rx_crc: 0
dribbling_bit: 0
rx_length: 0
rx_mii: 0
rx_multicast: 0
rx_gmac_overflow: 0
rx_watchdog: 0
da_rx_filter_fail: 0
sa_rx_filter_fail: 0
rx_missed_cntr: 0
rx_overflow_cntr: 0
rx_vlan: 0
tx_undeflow_irq: 0
tx_process_stopped_irq: 0
tx_jabber_irq: 0
rx_overflow_irq: 0
rx_buf_unav_irq: 0
rx_process_stopped_irq: 0
rx_watchdog_irq: 0
tx_early_irq: 0
fatal_bus_error_irq: 0
rx_early_irq: 456
threshold: 1
tx_pkt_n: 29240
rx_pkt_n: 807320
normal_irq_n: 25764
rx_normal_irq_n: 25307
napi_poll: 25764
tx_normal_irq_n: 457
tx_clean: 25790
tx_set_ic_bit: 457
irq_receive_pmt_irq_n: 0
mmc_tx_irq_n: 0
mmc_rx_irq_n: 0
mmc_rx_csum_offload_irq_n: 0
irq_tx_path_in_lpi_mode_n: 0
irq_tx_path_exit_lpi_mode_n: 0
irq_rx_path_in_lpi_mode_n: 0
irq_rx_path_exit_lpi_mode_n: 0
phy_eee_wakeup_error_n: 0
ip_hdr_err: 0
ip_payload_err: 0
ip_csum_bypassed: 0
ipv4_pkt_rcvd: 0
ipv6_pkt_rcvd: 0
rx_msg_type_ext_no_ptp: 0
rx_msg_type_sync: 0
rx_msg_type_follow_up: 0
rx_msg_type_delay_req: 0
rx_msg_type_delay_resp: 0
rx_msg_type_pdelay_req: 0
rx_msg_type_pdelay_resp: 0
rx_msg_type_pdelay_follow_up: 0
ptp_frame_type: 0
ptp_ver: 0
timestamp_dropped: 0
av_pkt_rcvd: 0
av_tagged_pkt_rcvd: 0
vlan_tag_priority_val: 0
l3_filter_match: 0
l4_filter_match: 0
l3_l4_filter_no_match: 0
irq_pcs_ane_n: 0
irq_pcs_link_n: 0
irq_rgmii_n: 1
mtl_tx_status_fifo_full: 0
mtl_tx_fifo_not_empty: 0
mmtl_fifo_ctrl: 0
mtl_tx_fifo_read_ctrl_write: 0
mtl_tx_fifo_read_ctrl_wait: 0
mtl_tx_fifo_read_ctrl_read: 0
mtl_tx_fifo_read_ctrl_idle: 0
mac_tx_in_pause: 0
mac_tx_frame_ctrl_xfer: 0
mac_tx_frame_ctrl_idle: 0
mac_tx_frame_ctrl_wait: 0
mac_tx_frame_ctrl_pause: 0
mac_gmii_tx_proto_engine: 0
mtl_rx_fifo_fill_level_full: 0
mtl_rx_fifo_fill_above_thresh: 0
mtl_rx_fifo_fill_below_thresh: 0
mtl_rx_fifo_fill_level_empty: 0
mtl_rx_fifo_read_ctrl_flush: 0
mtl_rx_fifo_read_ctrl_read_data: 0
mtl_rx_fifo_read_ctrl_status: 0
mtl_rx_fifo_read_ctrl_idle: 0
mtl_rx_fifo_ctrl_active: 0
mac_rx_frame_ctrl_fifo: 0
mac_gmii_rx_proto_engine: 0
tx_tso_frames: 0
tx_tso_nfrags: 0
#
-------------- next part --------------
A non-text attachment was scrubbed...
Name: stmmac-hack-disable-LPI.patch
Type: text/x-patch
Size: 2072 bytes
Desc: not available
URL: <http://lists.infradead.org/pipermail/linux-amlogic/attachments/20161001/f7914e10/attachment.bin>
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-09-14 15:30 ` Giuseppe CAVALLARO
@ 2016-10-01 20:15 ` Martin Blumenstingl
-1 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-10-01 20:15 UTC (permalink / raw)
To: Giuseppe CAVALLARO; +Cc: netdev, linux-amlogic, Alexandre Torgue, Johnson Leung
On Wed, Sep 14, 2016 at 5:30 PM, Giuseppe CAVALLARO
<peppe.cavallaro@st.com> wrote:
> Also you could check the AXI tuning and PBL value. To be honest
> (thinking about your problem) I can actually suspect some related
> problem on bus setup. So I suggest you to play with these value
> (better if you ask for having values from HW validation on your side).
> Otherwise the stmmac uses a default that cannot be good for your
> platform. For example, sometime I have seen that PBL is better if
> reduced to 8 instead of 32 and w/o 4xPBL...
unfortunately the original kernel/firmware shipped with my device
seems to be also affected by that TX bug, so comparing with the
"stock" values does not work for me.
Additionally I should mention that this is an end-consumer device, so
I cannot simply ask the HW guys for the correct values.
I dumped the following registers (which I thought might be related to
this issue) on the original kernel (0xc9410000 is the location of the
stmmac IP block):
for REG in 0x00000018 0x00000030 0x0000003c 0x00001000 0x00001018
0x00001028; do printf "%x 1\n" $((REG + 0xc9410000)) >
/sys/kernel/debug/aml_reg/dump; cat /sys/kernel/debug/aml_reg/dump;
done
on my device this results in:
[0xc9410018] = 0x2000000
[0xc9410030] = 0x0
[0xc941003c] = 0x0
[0xc9411000] = 0x1100802
[0xc9411018] = 0x2202006
[0xc9411028] = 0x0
maybe someone else could try the command from above on his device
(running the original Amlogic kernel).
please also state if ethernet is working properly on the original
kernel (and preferably which device/board this is).
Regards,
Martin
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-10-01 20:15 ` Martin Blumenstingl
0 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-10-01 20:15 UTC (permalink / raw)
To: linus-amlogic
On Wed, Sep 14, 2016 at 5:30 PM, Giuseppe CAVALLARO
<peppe.cavallaro@st.com> wrote:
> Also you could check the AXI tuning and PBL value. To be honest
> (thinking about your problem) I can actually suspect some related
> problem on bus setup. So I suggest you to play with these value
> (better if you ask for having values from HW validation on your side).
> Otherwise the stmmac uses a default that cannot be good for your
> platform. For example, sometime I have seen that PBL is better if
> reduced to 8 instead of 32 and w/o 4xPBL...
unfortunately the original kernel/firmware shipped with my device
seems to be also affected by that TX bug, so comparing with the
"stock" values does not work for me.
Additionally I should mention that this is an end-consumer device, so
I cannot simply ask the HW guys for the correct values.
I dumped the following registers (which I thought might be related to
this issue) on the original kernel (0xc9410000 is the location of the
stmmac IP block):
for REG in 0x00000018 0x00000030 0x0000003c 0x00001000 0x00001018
0x00001028; do printf "%x 1\n" $((REG + 0xc9410000)) >
/sys/kernel/debug/aml_reg/dump; cat /sys/kernel/debug/aml_reg/dump;
done
on my device this results in:
[0xc9410018] = 0x2000000
[0xc9410030] = 0x0
[0xc941003c] = 0x0
[0xc9411000] = 0x1100802
[0xc9411018] = 0x2202006
[0xc9411028] = 0x0
maybe someone else could try the command from above on his device
(running the original Amlogic kernel).
please also state if ethernet is working properly on the original
kernel (and preferably which device/board this is).
Regards,
Martin
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-09-14 15:30 ` Giuseppe CAVALLARO
@ 2016-10-01 20:26 ` Martin Blumenstingl
-1 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-10-01 20:26 UTC (permalink / raw)
To: Giuseppe CAVALLARO; +Cc: netdev, linux-amlogic, Alexandre Torgue
On Wed, Sep 14, 2016 at 5:30 PM, Giuseppe CAVALLARO
<peppe.cavallaro@st.com> wrote:
> as rule of thumb, I can only suggest you to see the RXDLY and TXDLY
> and if you have (or need!) the resistor on PCB to have the 2ns of
> extra delay. This can impact on RGMII case (1G).
> Indeed, if this is true, I should expect some problem also when ping.
I did a simple ping-test:
device to computer:
50 packets transmitted, 50 received, 0% packet loss, time 50170ms
rtt min/avg/max/mdev = 0.457/0.659/0.779/0.083 ms
computer to device:
50 packets transmitted, 50 received, 0% packet loss, time 49001ms
rtt min/avg/max/mdev = 0.483/0.629/1.356/0.114 ms
both running simultaneously, device to computer:
51 packets transmitted, 50 received, 1% packet loss, time 51182ms
rtt min/avg/max/mdev = 0.459/0.648/0.729/0.082 ms
both running simultaneously, computer to device:
50 packets transmitted, 38 received, 24% packet loss, time 48997ms
rtt min/avg/max/mdev = 0.482/0.594/0.640/0.053 ms
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-10-01 20:26 ` Martin Blumenstingl
0 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-10-01 20:26 UTC (permalink / raw)
To: linus-amlogic
On Wed, Sep 14, 2016 at 5:30 PM, Giuseppe CAVALLARO
<peppe.cavallaro@st.com> wrote:
> as rule of thumb, I can only suggest you to see the RXDLY and TXDLY
> and if you have (or need!) the resistor on PCB to have the 2ns of
> extra delay. This can impact on RGMII case (1G).
> Indeed, if this is true, I should expect some problem also when ping.
I did a simple ping-test:
device to computer:
50 packets transmitted, 50 received, 0% packet loss, time 50170ms
rtt min/avg/max/mdev = 0.457/0.659/0.779/0.083 ms
computer to device:
50 packets transmitted, 50 received, 0% packet loss, time 49001ms
rtt min/avg/max/mdev = 0.483/0.629/1.356/0.114 ms
both running simultaneously, device to computer:
51 packets transmitted, 50 received, 1% packet loss, time 51182ms
rtt min/avg/max/mdev = 0.459/0.648/0.729/0.082 ms
both running simultaneously, computer to device:
50 packets transmitted, 38 received, 24% packet loss, time 48997ms
rtt min/avg/max/mdev = 0.482/0.594/0.640/0.053 ms
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-10-01 20:15 ` Martin Blumenstingl
@ 2016-10-01 20:40 ` Martin Blumenstingl
-1 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-10-01 20:40 UTC (permalink / raw)
To: Giuseppe CAVALLARO; +Cc: netdev, linux-amlogic, Alexandre Torgue, Johnson Leung
[-- Attachment #1: Type: text/plain, Size: 1038 bytes --]
On Sat, Oct 1, 2016 at 10:15 PM, Martin Blumenstingl
<martin.blumenstingl@googlemail.com> wrote:
> On Wed, Sep 14, 2016 at 5:30 PM, Giuseppe CAVALLARO
> <peppe.cavallaro@st.com> wrote:
>> Also you could check the AXI tuning and PBL value. To be honest
>> (thinking about your problem) I can actually suspect some related
>> problem on bus setup. So I suggest you to play with these value
>> (better if you ask for having values from HW validation on your side).
>> Otherwise the stmmac uses a default that cannot be good for your
>> platform. For example, sometime I have seen that PBL is better if
>> reduced to 8 instead of 32 and w/o 4xPBL...
> unfortunately the original kernel/firmware shipped with my device
> seems to be also affected by that TX bug, so comparing with the
> "stock" values does not work for me.
I tried the following changes:
- snps,pbl = <4>; in .dts
- snps,pbl = <2>; in .dts
- snps,pbl = <8>; in .dts and disabled DMA_BUS_MODE_MAXPBL (= 4xPBL) in stmmac
None of these seem to have any impact on the TX problem
[-- Attachment #2: meson-stmmac-pbl.patch --]
[-- Type: text/x-patch, Size: 1012 bytes --]
diff --git a/arch/arm64/boot/dts/amlogic/meson-gxbb.dtsi b/arch/arm64/boot/dts/amlogic/meson-gxbb.dtsi
index 2e89ec4..7deab7a 100644
--- a/arch/arm64/boot/dts/amlogic/meson-gxbb.dtsi
+++ b/arch/arm64/boot/dts/amlogic/meson-gxbb.dtsi
@@ -698,6 +698,7 @@
<&clkc CLKID_MPLL2>;
clock-names = "stmmaceth", "clkin0", "clkin1";
phy-mode = "rgmii";
+ snps,pbl = <8>;
status = "disabled";
};
};
diff --git a/drivers/net/ethernet/stmicro/stmmac/dwmac1000_dma.c b/drivers/net/ethernet/stmicro/stmmac/dwmac1000_dma.c
index 99074695..fffb407 100644
--- a/drivers/net/ethernet/stmicro/stmmac/dwmac1000_dma.c
+++ b/drivers/net/ethernet/stmicro/stmmac/dwmac1000_dma.c
@@ -97,7 +97,7 @@ static void dwmac1000_dma_init(void __iomem *ioaddr, int pbl, int fb, int mb,
* so only the bits: 13-8 are programmed with the PBL passed from the
* platform.
*/
- value |= DMA_BUS_MODE_MAXPBL;
+ value &= ~DMA_BUS_MODE_MAXPBL;
value &= ~DMA_BUS_MODE_PBL_MASK;
value |= (pbl << DMA_BUS_MODE_PBL_SHIFT);
^ permalink raw reply related [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-10-01 20:40 ` Martin Blumenstingl
0 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-10-01 20:40 UTC (permalink / raw)
To: linus-amlogic
On Sat, Oct 1, 2016 at 10:15 PM, Martin Blumenstingl
<martin.blumenstingl@googlemail.com> wrote:
> On Wed, Sep 14, 2016 at 5:30 PM, Giuseppe CAVALLARO
> <peppe.cavallaro@st.com> wrote:
>> Also you could check the AXI tuning and PBL value. To be honest
>> (thinking about your problem) I can actually suspect some related
>> problem on bus setup. So I suggest you to play with these value
>> (better if you ask for having values from HW validation on your side).
>> Otherwise the stmmac uses a default that cannot be good for your
>> platform. For example, sometime I have seen that PBL is better if
>> reduced to 8 instead of 32 and w/o 4xPBL...
> unfortunately the original kernel/firmware shipped with my device
> seems to be also affected by that TX bug, so comparing with the
> "stock" values does not work for me.
I tried the following changes:
- snps,pbl = <4>; in .dts
- snps,pbl = <2>; in .dts
- snps,pbl = <8>; in .dts and disabled DMA_BUS_MODE_MAXPBL (= 4xPBL) in stmmac
None of these seem to have any impact on the TX problem
-------------- next part --------------
A non-text attachment was scrubbed...
Name: meson-stmmac-pbl.patch
Type: text/x-patch
Size: 1012 bytes
Desc: not available
URL: <http://lists.infradead.org/pipermail/linux-amlogic/attachments/20161001/8e44374c/attachment.bin>
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-10-01 20:15 ` Martin Blumenstingl
@ 2016-10-31 10:25 ` André Roth
-1 siblings, 0 replies; 56+ messages in thread
From: André Roth @ 2016-10-31 10:25 UTC (permalink / raw)
To: Martin Blumenstingl
Cc: Giuseppe CAVALLARO, Johnson Leung, netdev, Alexandre Torgue,
linux-amlogic
Hi all,
> on my device this results in:
> [0xc9410018] = 0x2000000
> [0xc9410030] = 0x0
> [0xc941003c] = 0x0
> [0xc9411000] = 0x1100802
> [0xc9411018] = 0x2202006
> [0xc9411028] = 0x0
>
> maybe someone else could try the command from above on his device
> (running the original Amlogic kernel).
those registers have the same value on an original image from
hardkernel:
Linux odroid64 3.14.65-65 #1 SMP PREEMPT Sat May 28
02:50:51 BRT 2016 aarch64 aarch64 aarch64 GNU/Linux
> please also state if ethernet is working properly on the original
> kernel (and preferably which device/board this is).
yes, the ethernet works flawless in 100 and 1000 Mbit/s on the 3.14
kernel.
I can now confirm that both 100 and 1000 Mbit/s do not work properly
on the 4.8/integ branch. the network connection is interrupted after
some outbound traffic. it can be recovered by running a ifdown/ifup
which restarts dhclient, which I think is able to somehow reset the
interface.
Anything I can help to debug the issue further ?
Regards,
André
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-10-31 10:25 ` André Roth
0 siblings, 0 replies; 56+ messages in thread
From: André Roth @ 2016-10-31 10:25 UTC (permalink / raw)
To: linus-amlogic
Hi all,
> on my device this results in:
> [0xc9410018] = 0x2000000
> [0xc9410030] = 0x0
> [0xc941003c] = 0x0
> [0xc9411000] = 0x1100802
> [0xc9411018] = 0x2202006
> [0xc9411028] = 0x0
>
> maybe someone else could try the command from above on his device
> (running the original Amlogic kernel).
those registers have the same value on an original image from
hardkernel:
Linux odroid64 3.14.65-65 #1 SMP PREEMPT Sat May 28
02:50:51 BRT 2016 aarch64 aarch64 aarch64 GNU/Linux
> please also state if ethernet is working properly on the original
> kernel (and preferably which device/board this is).
yes, the ethernet works flawless in 100 and 1000 Mbit/s on the 3.14
kernel.
I can now confirm that both 100 and 1000 Mbit/s do not work properly
on the 4.8/integ branch. the network connection is interrupted after
some outbound traffic. it can be recovered by running a ifdown/ifup
which restarts dhclient, which I think is able to somehow reset the
interface.
Anything I can help to debug the issue further ?
Regards,
Andr?
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-10-01 15:58 ` Martin Blumenstingl
@ 2016-11-03 16:36 ` Jerome Brunet
-1 siblings, 0 replies; 56+ messages in thread
From: Jerome Brunet @ 2016-11-03 16:36 UTC (permalink / raw)
To: Martin Blumenstingl, Giuseppe CAVALLARO
Cc: Johnson Leung, netdev, André Roth, Alexandre Torgue, linux-amlogic
[-- Attachment #1: Type: text/plain, Size: 5446 bytes --]
On Sat, 2016-10-01 at 17:58 +0200, Martin Blumenstingl wrote:
> Hello Peppe,
>
> On Mon, Sep 26, 2016 at 8:17 AM, Giuseppe CAVALLARO
> <peppe.cavallaro@st.com> wrote:
> >
> > Hello André
> >
> > On 9/17/2016 11:23 PM, André Roth wrote:
> > >
> > >
> > >
> > > Hi all,
> > >
> > > I have an odroid c2 board which shows this issue. No data is
> > > transmitted or received after a moment of intense tx traffic.
> > > Copying a
> > > 1GB file per scp from the board triggers it repeatedly.
> > >
> > > The board has a stmmac - user ID: 0x11, Synopsys ID: 0x37.
> > >
> > > When switching the network to 100Mb/s the copying does
> > > not seam to trigger the issue.
> > >
> > > I've attached the ethtool statistics before and after the
> > > problem.
> >
> >
> > at first glance, it enters in EEE mode often in the ethtool.after.
> > On some platforms we met problems and it was necessary to disable
> > the
> > feature. Maybe, you can start looking at if this is true on yours.
> > We will see to provide a clean subset of patches to switch-on/off
> > it.
> I did some hacking in the stmmac driver to disable the LPI stuff (see
> the attachment)
>
> Unfortunately this did not fix the problem.
>
> I did not issue any ethtool commands not shown in the logs.
> Also I did not have time to change the AXI tuning / PBL value yet -
> so
> those are also untouched.
>
> I will keep testing, but unfortunately my device is starting to fall
> apart (I sometimes have DDR initialization issues and u-boot fails to
> come up, oh dear...).
Hi all,
I did several tests on this issue with amlogic's S905 SoC (Synopsys MAC
- user ID: 0x11, Synopsys ID: 0x37.)
With the OdroidC2 (PHY Realtek RTL8211F), EEE is on by default.
Just before launching iperf3, here are the ethtool stats regarding LPI:
irq_tx_path_in_lpi_mode_n: 6
irq_tx_path_exit_lpi_mode_n: 5
irq_rx_path_in_lpi_mode_n: 76
irq_rx_path_exit_lpi_mode_n: 75
phy_eee_wakeup_error_n: 0
Sending data with iperf usually works for little while (between 0 and
10s)
# iperf3 -c 192.168.1.170 -p12345
Connecting to host 192.168.1.170, port 12345
local 192.168.1.30 port 54450 connected to 192.168.1.170 port 12345
Interval Transfer Bandwidth Retr Cwnd
0.00-1.00 sec 112 MBytes 938 Mbits/sec 0 409 KBytes
1.00-2.00 sec 112 MBytes 940 Mbits/sec 0 426 KBytes
2.00-3.00 sec 112 MBytes 939 Mbits/sec 0 426 KBytes
3.00-4.00 sec 112 MBytes 940 Mbits/sec 0 426 KBytes
4.00-5.00 sec 112 MBytes 940 Mbits/sec 0 426 KBytes
5.00-6.00 sec 112 MBytes 939 Mbits/sec 0 426 KBytes
6.00-7.00 sec 9.26 MBytes 77.6 Mbits/sec 2 1.41 KBytes
7.00-8.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
8.00-9.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
^C10.00-13.58 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
Interval Transfer Bandwidth Retr
0.00-13.58 sec 681 MBytes 421 Mbits/sec 4 sender
0.00-13.58 sec 0.00 Bytes 0.00 bits/sec receiver
iperf3: interrupt - the client has terminated
iperf3 does not exit ant the link seems completely broken. We cannot
send or receive until the interface is brought down then up again.
Here are the LPI related stats after the test:
irq_tx_path_in_lpi_mode_n: 48
irq_tx_path_exit_lpi_mode_n: 48
irq_rx_path_in_lpi_mode_n: 325
irq_rx_path_exit_lpi_mode_n: 325
phy_eee_wakeup_error_n: 0
Like Martin, I tried playing around with eee in stmmac, but I could not
improve the situation. Then I tried disabling EEE advertisement on the
PHY (patch attached). With this patch, iperf3 runs nicely for me.
This is what the folks of FreeBSD have done for the Same MAC/PHY
combination [0]
On the P200 Board (PHY Micrel KSZ9031), EEE is off by default. There is
no problem on this board right now. I tried to force the activation of
EEE on this board and ended up in the same situation as the OdroidC2
(link broken). The stats were a bit different though:
irq_tx_path_in_lpi_mode_n: 28
irq_tx_path_exit_lpi_mode_n: 28
irq_rx_path_in_lpi_mode_n: 408
irq_rx_path_exit_lpi_mode_n: 408
phy_eee_wakeup_error_n: 5440
To everybody having similar issue with their OdroidC2, could you try
the attached patch and let us know if it changes anything for you ?
Peppe, Alexandre,
What is your view on this ? I'm not sure that removing EEE
advertisement is the right way to address the problem ?
Could it be an issue stmmac ?
If there is any other information / test which would help understand
the issue, please let me know.
Cheers
Jerome
[0] : https://github.com/freebsd/freebsd-base-graphics/commit/1f49e276c
3801545dc0a337792a5f07e6ad39c84
> _______________________________________________
> linux-amlogic mailing list
> linux-amlogic@lists.infradead.org
> http://lists.infradead.org/mailman/listinfo/linux-amlogic
[-- Attachment #2: realtek8211f-disable-eee-1000.patch --]
[-- Type: text/x-patch, Size: 2912 bytes --]
diff --git a/arch/arm64/boot/dts/amlogic/meson-gxbb-odroidc2.dts b/arch/arm64/boot/dts/amlogic/meson-gxbb-odroidc2.dts
index a45d1013c225..3cbeec63a439 100644
--- a/arch/arm64/boot/dts/amlogic/meson-gxbb-odroidc2.dts
+++ b/arch/arm64/boot/dts/amlogic/meson-gxbb-odroidc2.dts
@@ -127,3 +127,18 @@
&usb1 {
status = "okay";
};
+
+ðmac {
+ phy-handle = <ð_phy0>;
+
+ mdio {
+ compatible = "snps,dwmac-mdio";
+ #address-cells = <1>;
+ #size-cells = <0>;
+
+ eth_phy0: ethernet-phy@0 {
+ reg = <0>;
+ realtek,disable-eee-1000t;
+ };
+ };
+};
diff --git a/drivers/net/phy/realtek.c b/drivers/net/phy/realtek.c
index aadd6e9f54ad..30e20ba10f45 100644
--- a/drivers/net/phy/realtek.c
+++ b/drivers/net/phy/realtek.c
@@ -15,6 +15,12 @@
*/
#include <linux/phy.h>
#include <linux/module.h>
+#include <linux/of.h>
+
+struct rtl8211f_phy_priv {
+ bool eee_1000_disable;
+ bool eee_100_disable;
+};
#define RTL821x_PHYSR 0x11
#define RTL821x_PHYSR_DUPLEX 0x2000
@@ -93,6 +99,25 @@ static int rtl8211f_config_intr(struct phy_device *phydev)
return err;
}
+static void rtl8211f_force_eee(struct phy_device *phydev)
+{
+ struct rtl8211f_phy_priv *priv = phydev->priv;
+ u16 val;
+
+ if (priv->eee_1000_disable || priv->eee_100_disable) {
+ val = phy_read_mmd_indirect(phydev, MDIO_AN_EEE_ADV,
+ MDIO_MMD_AN);
+
+ if (priv->eee_1000_disable)
+ val &= ~MDIO_AN_EEE_ADV_1000T;
+ if (priv->eee_100_disable)
+ val &= ~MDIO_AN_EEE_ADV_100TX;
+
+ phy_write_mmd_indirect(phydev, MDIO_AN_EEE_ADV,
+ MDIO_MMD_AN, val);
+ }
+}
+
static int rtl8211f_config_init(struct phy_device *phydev)
{
int ret;
@@ -102,6 +127,8 @@ static int rtl8211f_config_init(struct phy_device *phydev)
if (ret < 0)
return ret;
+ rtl8211f_force_eee(phydev);
+
if (phydev->interface == PHY_INTERFACE_MODE_RGMII) {
/* enable TXDLY */
phy_write(phydev, RTL8211F_PAGE_SELECT, 0xd08);
@@ -115,6 +142,26 @@ static int rtl8211f_config_init(struct phy_device *phydev)
return 0;
}
+static int rtl8211f_phy_probe(struct phy_device *phydev)
+{
+ struct device *dev = &phydev->mdio.dev;
+ struct device_node *of_node = dev->of_node;
+ struct rtl8211f_phy_priv *priv;
+
+ priv = devm_kzalloc(dev, sizeof(*priv), GFP_KERNEL);
+ if (!priv)
+ return -ENOMEM;
+
+ if (of_property_read_bool(of_node, "realtek,disable-eee-1000t"))
+ priv->eee_1000_disable= true;
+ if (of_property_read_bool(of_node, "realtek,disable-eee-100t"))
+ priv->eee_100_disable= true;
+
+ phydev->priv = priv;
+
+ return 0;
+}
+
static struct phy_driver realtek_drvs[] = {
{
.phy_id = 0x00008201,
@@ -164,6 +211,7 @@ static struct phy_driver realtek_drvs[] = {
.phy_id_mask = 0x001fffff,
.features = PHY_GBIT_FEATURES,
.flags = PHY_HAS_INTERRUPT,
+ .probe = &rtl8211f_phy_probe,
.config_aneg = &genphy_config_aneg,
.config_init = &rtl8211f_config_init,
.read_status = &genphy_read_status,
^ permalink raw reply related [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-03 16:36 ` Jerome Brunet
0 siblings, 0 replies; 56+ messages in thread
From: Jerome Brunet @ 2016-11-03 16:36 UTC (permalink / raw)
To: linus-amlogic
On Sat, 2016-10-01 at 17:58 +0200, Martin Blumenstingl wrote:
> Hello Peppe,
>
> On Mon, Sep 26, 2016 at 8:17 AM, Giuseppe CAVALLARO
> <peppe.cavallaro@st.com> wrote:
> >
> > Hello Andr?
> >
> > On 9/17/2016 11:23 PM, Andr? Roth wrote:
> > >
> > >
> > >
> > > Hi all,
> > >
> > > I have an odroid c2 board which shows this issue. No data is
> > > transmitted or received after a moment of intense tx traffic.
> > > Copying a
> > > 1GB file per scp from the board triggers it repeatedly.
> > >
> > > The board has a stmmac - user ID: 0x11, Synopsys ID: 0x37.
> > >
> > > When switching the network to 100Mb/s the copying does
> > > not seam to trigger the issue.
> > >
> > > I've attached the ethtool statistics before and after the
> > > problem.
> >
> >
> > at first glance, it enters in EEE mode often in the ethtool.after.
> > On some platforms we met problems and it was necessary to disable
> > the
> > feature. Maybe, you can start looking at if this is true on yours.
> > We will see to provide a clean subset of patches to switch-on/off
> > it.
> I did some hacking in the stmmac driver to disable the LPI stuff (see
> the attachment)
>
> Unfortunately this did not fix the problem.
>
> I did not issue any ethtool commands not shown in the logs.
> Also I did not have time to change the AXI tuning / PBL value yet -
> so
> those are also untouched.
>
> I will keep testing, but unfortunately my device is starting to fall
> apart (I sometimes have DDR initialization issues and u-boot fails to
> come up, oh dear...).
Hi all,
I did several tests on this issue with amlogic's S905 SoC (Synopsys MAC
- user ID: 0x11, Synopsys ID: 0x37.)?
With the OdroidC2 (PHY Realtek RTL8211F), EEE is on by default.
Just before launching iperf3, here are the ethtool stats regarding LPI:
? ? ?irq_tx_path_in_lpi_mode_n: 6
?????irq_tx_path_exit_lpi_mode_n: 5
?????irq_rx_path_in_lpi_mode_n: 76
?????irq_rx_path_exit_lpi_mode_n: 75
?????phy_eee_wakeup_error_n: 0
Sending data with iperf usually works for little while (between 0 and
10s)
# iperf3 -c 192.168.1.170 -p12345
Connecting to host 192.168.1.170, port 12345
local 192.168.1.30 port 54450 connected to 192.168.1.170 port 12345
Interval???????????Transfer?????Bandwidth???????Retr??Cwnd
0.00-1.00???sec???112 MBytes???938 Mbits/sec????0????409 KBytes???????
1.00-2.00???sec???112 MBytes???940 Mbits/sec????0????426 KBytes ? ? ??
2.00-3.00???sec???112 MBytes???939 Mbits/sec????0????426 KBytes???????
3.00-4.00???sec???112 MBytes???940 Mbits/sec????0????426 KBytes???????
4.00-5.00???sec???112 MBytes???940 Mbits/sec????0????426 KBytes???????
5.00-6.00???sec???112 MBytes???939 Mbits/sec????0????426 KBytes???????
6.00-7.00???sec??9.26 MBytes??77.6 Mbits/sec????2???1.41 KBytes???????
7.00-8.00???sec??0.00 Bytes??0.00 bits/sec????1???1.41 KBytes???????
8.00-9.00???sec??0.00 Bytes??0.00 bits/sec????0???1.41 KBytes???????
^C10.00-13.58??sec??0.00 Bytes??0.00 bits/sec????1???1.41 KBytes???????
- - - - - - - - - - - - - - - - - - - - - - - - -
Interval???????????Transfer?????Bandwidth???????Retr
0.00-13.58??sec???681 MBytes???421 Mbits/sec????4?????????????sender
0.00-13.58??sec??0.00 Bytes??0.00 bits/sec??????????????????receiver
iperf3: interrupt - the client has terminated
iperf3 does not exit ant the link seems completely broken. We cannot
send or receive until the interface is brought down then up again.
Here are the LPI related stats after the test:
? ? ?irq_tx_path_in_lpi_mode_n: 48
?????irq_tx_path_exit_lpi_mode_n: 48
?????irq_rx_path_in_lpi_mode_n: 325
?????irq_rx_path_exit_lpi_mode_n: 325
?????phy_eee_wakeup_error_n: 0
Like Martin, I tried playing around with eee in stmmac, but I could not
improve the situation. Then I tried disabling EEE advertisement on the
PHY (patch attached). With this patch, iperf3 runs nicely for me.
This is what the folks of FreeBSD have done for the Same MAC/PHY
combination [0]
On the P200 Board (PHY Micrel KSZ9031), EEE is off by default. There is
no problem on this board right now. I tried to force the activation of
EEE on this board and ended up in the same situation as the OdroidC2
(link broken). The stats were a bit different though:
? ? ?irq_tx_path_in_lpi_mode_n: 28
?????irq_tx_path_exit_lpi_mode_n: 28
?????irq_rx_path_in_lpi_mode_n: 408
?????irq_rx_path_exit_lpi_mode_n: 408
?????phy_eee_wakeup_error_n: 5440
To everybody having similar issue with their OdroidC2, could you try
the attached patch and let us know if it changes anything for you ?
Peppe, Alexandre,
What is your view on this ? I'm not sure that removing EEE
advertisement is the right way to address the problem ?
Could it be an issue stmmac ?
If there is any other information / test which would help understand
the issue, please let me know.
Cheers
Jerome
[0] :?https://github.com/freebsd/freebsd-base-graphics/commit/1f49e276c
3801545dc0a337792a5f07e6ad39c84
?
> _______________________________________________
> linux-amlogic mailing list
> linux-amlogic at lists.infradead.org
> http://lists.infradead.org/mailman/listinfo/linux-amlogic
-------------- next part --------------
A non-text attachment was scrubbed...
Name: realtek8211f-disable-eee-1000.patch
Type: text/x-patch
Size: 2912 bytes
Desc: not available
URL: <http://lists.infradead.org/pipermail/linux-amlogic/attachments/20161103/27c2f20a/attachment.bin>
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-10-31 10:25 ` André Roth
@ 2016-11-03 16:57 ` Jerome Brunet
-1 siblings, 0 replies; 56+ messages in thread
From: Jerome Brunet @ 2016-11-03 16:57 UTC (permalink / raw)
To: André Roth, Martin Blumenstingl
Cc: Johnson Leung, Giuseppe CAVALLARO, linux-amlogic,
Alexandre Torgue, netdev
On Mon, 2016-10-31 at 11:25 +0100, André Roth wrote:
> Hi all,
>
> >
> > on my device this results in:
> > [0xc9410018] = 0x2000000
> > [0xc9410030] = 0x0
> > [0xc941003c] = 0x0
> > [0xc9411000] = 0x1100802
> > [0xc9411018] = 0x2202006
> > [0xc9411028] = 0x0
> >
> > maybe someone else could try the command from above on his device
> > (running the original Amlogic kernel).
>
> those registers have the same value on an original image from
> hardkernel:
>
> Linux odroid64 3.14.65-65 #1 SMP PREEMPT Sat May 28
> 02:50:51 BRT 2016 aarch64 aarch64 aarch64 GNU/Linux
>
> >
> > please also state if ethernet is working properly on the original
> > kernel (and preferably which device/board this is).
>
> yes, the ethernet works flawless in 100 and 1000 Mbit/s on the 3.14
> kernel.
Andre, the 3.14 kernel you are talking, is it this one ? :
https://github.com/hardkernel/linux/tree/odroidc2-3.14.y
Because in drivers/net/phy/realtek.c, they disable EEE, but
also 1000Base-T Full Duplex advertisement ?
+ /* disable 1000m adv*/
+ val = phy_read(phydev, 0x9);
+ phy_write(phydev, 0x9, val&(~(1<<9)));
If this is the kernel you are running, you should not be able to have
ethernet at 1000MB/s ? Or is it in half duplex mode ?
>
> I can now confirm that both 100 and 1000 Mbit/s do not work properly
> on the 4.8/integ branch. the network connection is interrupted after
> some outbound traffic. it can be recovered by running a ifdown/ifup
> which restarts dhclient, which I think is able to somehow reset the
> interface.
>
> Anything I can help to debug the issue further ?
>
> Regards,
>
> André
>
>
>
> _______________________________________________
> linux-amlogic mailing list
> linux-amlogic@lists.infradead.org
> http://lists.infradead.org/mailman/listinfo/linux-amlogic
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-03 16:57 ` Jerome Brunet
0 siblings, 0 replies; 56+ messages in thread
From: Jerome Brunet @ 2016-11-03 16:57 UTC (permalink / raw)
To: linus-amlogic
On Mon, 2016-10-31 at 11:25 +0100, Andr? Roth wrote:
> Hi all,
> ?
> >
> > on my device this results in:
> > [0xc9410018] = 0x2000000
> > [0xc9410030] = 0x0
> > [0xc941003c] = 0x0
> > [0xc9411000] = 0x1100802
> > [0xc9411018] = 0x2202006
> > [0xc9411028] = 0x0
> >
> > maybe someone else could try the command from above on his device
> > (running the original Amlogic kernel).
>
> those registers have the same value on an original image from
> hardkernel:?
>
> Linux odroid64 3.14.65-65 #1 SMP PREEMPT Sat May 28
> 02:50:51 BRT 2016 aarch64 aarch64 aarch64 GNU/Linux
>
> >
> > please also state if ethernet is working properly on the original
> > kernel (and preferably which device/board this is).
>
> yes, the ethernet works flawless in 100 and 1000 Mbit/s on the 3.14
> kernel.
Andre, the 3.14 kernel you are talking, is it this one ? :?
https://github.com/hardkernel/linux/tree/odroidc2-3.14.y
Because in drivers/net/phy/realtek.c, they disable EEE, but
also?1000Base-T Full Duplex advertisement ?
+ /* disable 1000m adv*/
+ val = phy_read(phydev, 0x9);
+ phy_write(phydev, 0x9, val&(~(1<<9)));
If this is the kernel you are running, you should not be able to have
ethernet@1000MB/s ? Or is it in half duplex mode ?
>
> I can now confirm that both 100 and 1000 Mbit/s do not work properly
> on the 4.8/integ branch. the network connection is interrupted after
> some outbound traffic. it can be recovered by running a ifdown/ifup
> which restarts dhclient, which I think is able to somehow reset the
> interface.?
>
> Anything I can help to debug the issue further ?
>
> Regards,
>
> ?Andr?
> ?
>
>
> _______________________________________________
> linux-amlogic mailing list
> linux-amlogic at lists.infradead.org
> http://lists.infradead.org/mailman/listinfo/linux-amlogic
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-11-03 16:36 ` Jerome Brunet
@ 2016-11-05 12:20 ` Martin Blumenstingl
-1 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-11-05 12:20 UTC (permalink / raw)
To: Jerome Brunet
Cc: Giuseppe CAVALLARO, Johnson Leung, netdev, André Roth,
Alexandre Torgue, linux-amlogic, ganbold, yongari
On Thu, Nov 3, 2016 at 5:36 PM, Jerome Brunet <jbrunet@baylibre.com> wrote:
> Hi all,
>
> I did several tests on this issue with amlogic's S905 SoC (Synopsys MAC
> - user ID: 0x11, Synopsys ID: 0x37.)
>
> With the OdroidC2 (PHY Realtek RTL8211F), EEE is on by default.
> Just before launching iperf3, here are the ethtool stats regarding LPI:
> irq_tx_path_in_lpi_mode_n: 6
> irq_tx_path_exit_lpi_mode_n: 5
> irq_rx_path_in_lpi_mode_n: 76
> irq_rx_path_exit_lpi_mode_n: 75
> phy_eee_wakeup_error_n: 0
>
> Sending data with iperf usually works for little while (between 0 and
> 10s)
>
> # iperf3 -c 192.168.1.170 -p12345
> Connecting to host 192.168.1.170, port 12345
> local 192.168.1.30 port 54450 connected to 192.168.1.170 port 12345
> Interval Transfer Bandwidth Retr Cwnd
> 0.00-1.00 sec 112 MBytes 938 Mbits/sec 0 409 KBytes
> 1.00-2.00 sec 112 MBytes 940 Mbits/sec 0 426 KBytes
> 2.00-3.00 sec 112 MBytes 939 Mbits/sec 0 426 KBytes
> 3.00-4.00 sec 112 MBytes 940 Mbits/sec 0 426 KBytes
> 4.00-5.00 sec 112 MBytes 940 Mbits/sec 0 426 KBytes
> 5.00-6.00 sec 112 MBytes 939 Mbits/sec 0 426 KBytes
> 6.00-7.00 sec 9.26 MBytes 77.6 Mbits/sec 2 1.41 KBytes
> 7.00-8.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
> 8.00-9.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
> ^C10.00-13.58 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
> - - - - - - - - - - - - - - - - - - - - - - - - -
> Interval Transfer Bandwidth Retr
> 0.00-13.58 sec 681 MBytes 421 Mbits/sec 4 sender
> 0.00-13.58 sec 0.00 Bytes 0.00 bits/sec receiver
> iperf3: interrupt - the client has terminated
>
> iperf3 does not exit ant the link seems completely broken. We cannot
> send or receive until the interface is brought down then up again.
>
> Here are the LPI related stats after the test:
> irq_tx_path_in_lpi_mode_n: 48
> irq_tx_path_exit_lpi_mode_n: 48
> irq_rx_path_in_lpi_mode_n: 325
> irq_rx_path_exit_lpi_mode_n: 325
> phy_eee_wakeup_error_n: 0
>
> Like Martin, I tried playing around with eee in stmmac, but I could not
> improve the situation. Then I tried disabling EEE advertisement on the
> PHY (patch attached). With this patch, iperf3 runs nicely for me.
>
> This is what the folks of FreeBSD have done for the Same MAC/PHY
> combination [0]
>
> On the P200 Board (PHY Micrel KSZ9031), EEE is off by default. There is
> no problem on this board right now. I tried to force the activation of
> EEE on this board and ended up in the same situation as the OdroidC2
> (link broken). The stats were a bit different though:
> irq_tx_path_in_lpi_mode_n: 28
> irq_tx_path_exit_lpi_mode_n: 28
> irq_rx_path_in_lpi_mode_n: 408
> irq_rx_path_exit_lpi_mode_n: 408
> phy_eee_wakeup_error_n: 5440
>
> To everybody having similar issue with their OdroidC2, could you try
> the attached patch and let us know if it changes anything for you ?
I have tried this on my Vega S95 Meta clone - the patch can be found
here if anyone cares: [0].
Unfortunately this does not improve the situation for me:
# iperf3 --client 192.168.1.100
Connecting to host 192.168.1.100, port 5201
[ 4] local 192.168.1.198 port 50720 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 178 KBytes 1.46 Mbits/sec 13 1.41 KBytes
[ 4] 1.00-2.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 2.00-3.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 3.00-4.00 sec 5.66 KBytes 46.3 Kbits/sec 4 1.41 KBytes
[ 4] 4.00-5.00 sec 63.6 KBytes 521 Kbits/sec 2 1.41 KBytes
[ 4] 5.00-6.00 sec 0.00 Bytes 0.00 bits/sec 4 1.41 KBytes
[ 4] 6.00-7.00 sec 0.00 Bytes 0.00 bits/sec 2 1.41 KBytes
[ 4] 7.00-8.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 8.00-9.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 9.00-10.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 247 KBytes 203 Kbits/sec 29 sender
[ 4] 0.00-10.00 sec 90.5 KBytes 74.1 Kbits/sec receiver
iperf Done.
# iperf3 --client 192.168.1.100 -R
Connecting to host 192.168.1.100, port 5201
Reverse mode, remote host 192.168.1.100 is sending
[ 4] local 192.168.1.198 port 50724 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 111 MBytes 930 Mbits/sec
[ 4] 1.00-2.00 sec 111 MBytes 935 Mbits/sec
[ 4] 2.00-3.00 sec 111 MBytes 934 Mbits/sec
[ 4] 3.00-4.00 sec 111 MBytes 934 Mbits/sec
[ 4] 4.00-5.00 sec 111 MBytes 934 Mbits/sec
[ 4] 5.00-6.00 sec 111 MBytes 935 Mbits/sec
[ 4] 6.00-7.00 sec 111 MBytes 935 Mbits/sec
[ 4] 7.00-8.00 sec 111 MBytes 934 Mbits/sec
[ 4] 8.00-9.00 sec 111 MBytes 934 Mbits/sec
[ 4] 9.00-10.00 sec 111 MBytes 934 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 1.09 GBytes 936 Mbits/sec 0 sender
[ 4] 0.00-10.00 sec 1.09 GBytes 934 Mbits/sec receiver
iperf Done.
#
However, if I remove the realtek,disable-eee-* properties and use
max-speed = <100>; instead ethernet is working fine (but limited to
100Mbit/s obviously).
> Peppe, Alexandre,
> What is your view on this ? I'm not sure that removing EEE
> advertisement is the right way to address the problem ?
> Could it be an issue stmmac ?
> If there is any other information / test which would help understand
> the issue, please let me know.
I CC'ed the two FreeBSD developers to who added the corresponding
FreeBSD code. Maybe they could also explain why that change was
needed.
Peppe's and Alexandre's feedback will hopefully also lead to
improvements in the FreeBSD driver.
[0] https://paste.kde.org/p9lwilneh
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-05 12:20 ` Martin Blumenstingl
0 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-11-05 12:20 UTC (permalink / raw)
To: linus-amlogic
On Thu, Nov 3, 2016 at 5:36 PM, Jerome Brunet <jbrunet@baylibre.com> wrote:
> Hi all,
>
> I did several tests on this issue with amlogic's S905 SoC (Synopsys MAC
> - user ID: 0x11, Synopsys ID: 0x37.)
>
> With the OdroidC2 (PHY Realtek RTL8211F), EEE is on by default.
> Just before launching iperf3, here are the ethtool stats regarding LPI:
> irq_tx_path_in_lpi_mode_n: 6
> irq_tx_path_exit_lpi_mode_n: 5
> irq_rx_path_in_lpi_mode_n: 76
> irq_rx_path_exit_lpi_mode_n: 75
> phy_eee_wakeup_error_n: 0
>
> Sending data with iperf usually works for little while (between 0 and
> 10s)
>
> # iperf3 -c 192.168.1.170 -p12345
> Connecting to host 192.168.1.170, port 12345
> local 192.168.1.30 port 54450 connected to 192.168.1.170 port 12345
> Interval Transfer Bandwidth Retr Cwnd
> 0.00-1.00 sec 112 MBytes 938 Mbits/sec 0 409 KBytes
> 1.00-2.00 sec 112 MBytes 940 Mbits/sec 0 426 KBytes
> 2.00-3.00 sec 112 MBytes 939 Mbits/sec 0 426 KBytes
> 3.00-4.00 sec 112 MBytes 940 Mbits/sec 0 426 KBytes
> 4.00-5.00 sec 112 MBytes 940 Mbits/sec 0 426 KBytes
> 5.00-6.00 sec 112 MBytes 939 Mbits/sec 0 426 KBytes
> 6.00-7.00 sec 9.26 MBytes 77.6 Mbits/sec 2 1.41 KBytes
> 7.00-8.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
> 8.00-9.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
> ^C10.00-13.58 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
> - - - - - - - - - - - - - - - - - - - - - - - - -
> Interval Transfer Bandwidth Retr
> 0.00-13.58 sec 681 MBytes 421 Mbits/sec 4 sender
> 0.00-13.58 sec 0.00 Bytes 0.00 bits/sec receiver
> iperf3: interrupt - the client has terminated
>
> iperf3 does not exit ant the link seems completely broken. We cannot
> send or receive until the interface is brought down then up again.
>
> Here are the LPI related stats after the test:
> irq_tx_path_in_lpi_mode_n: 48
> irq_tx_path_exit_lpi_mode_n: 48
> irq_rx_path_in_lpi_mode_n: 325
> irq_rx_path_exit_lpi_mode_n: 325
> phy_eee_wakeup_error_n: 0
>
> Like Martin, I tried playing around with eee in stmmac, but I could not
> improve the situation. Then I tried disabling EEE advertisement on the
> PHY (patch attached). With this patch, iperf3 runs nicely for me.
>
> This is what the folks of FreeBSD have done for the Same MAC/PHY
> combination [0]
>
> On the P200 Board (PHY Micrel KSZ9031), EEE is off by default. There is
> no problem on this board right now. I tried to force the activation of
> EEE on this board and ended up in the same situation as the OdroidC2
> (link broken). The stats were a bit different though:
> irq_tx_path_in_lpi_mode_n: 28
> irq_tx_path_exit_lpi_mode_n: 28
> irq_rx_path_in_lpi_mode_n: 408
> irq_rx_path_exit_lpi_mode_n: 408
> phy_eee_wakeup_error_n: 5440
>
> To everybody having similar issue with their OdroidC2, could you try
> the attached patch and let us know if it changes anything for you ?
I have tried this on my Vega S95 Meta clone - the patch can be found
here if anyone cares: [0].
Unfortunately this does not improve the situation for me:
# iperf3 --client 192.168.1.100
Connecting to host 192.168.1.100, port 5201
[ 4] local 192.168.1.198 port 50720 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth Retr Cwnd
[ 4] 0.00-1.00 sec 178 KBytes 1.46 Mbits/sec 13 1.41 KBytes
[ 4] 1.00-2.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 2.00-3.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 3.00-4.00 sec 5.66 KBytes 46.3 Kbits/sec 4 1.41 KBytes
[ 4] 4.00-5.00 sec 63.6 KBytes 521 Kbits/sec 2 1.41 KBytes
[ 4] 5.00-6.00 sec 0.00 Bytes 0.00 bits/sec 4 1.41 KBytes
[ 4] 6.00-7.00 sec 0.00 Bytes 0.00 bits/sec 2 1.41 KBytes
[ 4] 7.00-8.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
[ 4] 8.00-9.00 sec 0.00 Bytes 0.00 bits/sec 0 1.41 KBytes
[ 4] 9.00-10.00 sec 0.00 Bytes 0.00 bits/sec 1 1.41 KBytes
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 247 KBytes 203 Kbits/sec 29 sender
[ 4] 0.00-10.00 sec 90.5 KBytes 74.1 Kbits/sec receiver
iperf Done.
# iperf3 --client 192.168.1.100 -R
Connecting to host 192.168.1.100, port 5201
Reverse mode, remote host 192.168.1.100 is sending
[ 4] local 192.168.1.198 port 50724 connected to 192.168.1.100 port 5201
[ ID] Interval Transfer Bandwidth
[ 4] 0.00-1.00 sec 111 MBytes 930 Mbits/sec
[ 4] 1.00-2.00 sec 111 MBytes 935 Mbits/sec
[ 4] 2.00-3.00 sec 111 MBytes 934 Mbits/sec
[ 4] 3.00-4.00 sec 111 MBytes 934 Mbits/sec
[ 4] 4.00-5.00 sec 111 MBytes 934 Mbits/sec
[ 4] 5.00-6.00 sec 111 MBytes 935 Mbits/sec
[ 4] 6.00-7.00 sec 111 MBytes 935 Mbits/sec
[ 4] 7.00-8.00 sec 111 MBytes 934 Mbits/sec
[ 4] 8.00-9.00 sec 111 MBytes 934 Mbits/sec
[ 4] 9.00-10.00 sec 111 MBytes 934 Mbits/sec
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval Transfer Bandwidth Retr
[ 4] 0.00-10.00 sec 1.09 GBytes 936 Mbits/sec 0 sender
[ 4] 0.00-10.00 sec 1.09 GBytes 934 Mbits/sec receiver
iperf Done.
#
However, if I remove the realtek,disable-eee-* properties and use
max-speed = <100>; instead ethernet is working fine (but limited to
100Mbit/s obviously).
> Peppe, Alexandre,
> What is your view on this ? I'm not sure that removing EEE
> advertisement is the right way to address the problem ?
> Could it be an issue stmmac ?
> If there is any other information / test which would help understand
> the issue, please let me know.
I CC'ed the two FreeBSD developers to who added the corresponding
FreeBSD code. Maybe they could also explain why that change was
needed.
Peppe's and Alexandre's feedback will hopefully also lead to
improvements in the FreeBSD driver.
[0] https://paste.kde.org/p9lwilneh
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-11-03 16:57 ` Jerome Brunet
@ 2016-11-07 10:59 ` Giuseppe CAVALLARO
-1 siblings, 0 replies; 56+ messages in thread
From: Giuseppe CAVALLARO @ 2016-11-07 10:59 UTC (permalink / raw)
To: Jerome Brunet, André Roth, Martin Blumenstingl, Alexandre Torgue
Cc: Johnson Leung, linux-amlogic, netdev
Hi Jerome
We met, on some platform, problems that, in a glance,
look similar to yours and those were related to EEE and
LPI interrupts.
We had a subset of patches to disable EEE but, indeed,
if you disable from PHY, the STMMAC will never act
the protocol. We can provide you these patches... I will
ask Alex to decide how to proceed.
There is a issue on lpi timer and I have another patch to
share but I am not sure this can help.
In sum, if EEE is a suspected problem we can share and review
some patches.
In the meantime, I will read again the thread just to see if
there is something I am missing.
Regards
Peppe
On 11/3/2016 5:57 PM, Jerome Brunet wrote:
> On Mon, 2016-10-31 at 11:25 +0100, André Roth wrote:
>> Hi all,
>>
>>>
>>> on my device this results in:
>>> [0xc9410018] = 0x2000000
>>> [0xc9410030] = 0x0
>>> [0xc941003c] = 0x0
>>> [0xc9411000] = 0x1100802
>>> [0xc9411018] = 0x2202006
>>> [0xc9411028] = 0x0
>>>
>>> maybe someone else could try the command from above on his device
>>> (running the original Amlogic kernel).
>>
>> those registers have the same value on an original image from
>> hardkernel:
>>
>> Linux odroid64 3.14.65-65 #1 SMP PREEMPT Sat May 28
>> 02:50:51 BRT 2016 aarch64 aarch64 aarch64 GNU/Linux
>>
>>>
>>> please also state if ethernet is working properly on the original
>>> kernel (and preferably which device/board this is).
>>
>> yes, the ethernet works flawless in 100 and 1000 Mbit/s on the 3.14
>> kernel.
>
> Andre, the 3.14 kernel you are talking, is it this one ? :
> https://github.com/hardkernel/linux/tree/odroidc2-3.14.y
>
> Because in drivers/net/phy/realtek.c, they disable EEE, but
> also 1000Base-T Full Duplex advertisement ?
>
> + /* disable 1000m adv*/
> + val = phy_read(phydev, 0x9);
> + phy_write(phydev, 0x9, val&(~(1<<9)));
>
> If this is the kernel you are running, you should not be able to have
> ethernet at 1000MB/s ? Or is it in half duplex mode ?
>
>>
>> I can now confirm that both 100 and 1000 Mbit/s do not work properly
>> on the 4.8/integ branch. the network connection is interrupted after
>> some outbound traffic. it can be recovered by running a ifdown/ifup
>> which restarts dhclient, which I think is able to somehow reset the
>> interface.
>>
>> Anything I can help to debug the issue further ?
>>
>> Regards,
>>
>> André
>>
>>
>>
>> _______________________________________________
>> linux-amlogic mailing list
>> linux-amlogic@lists.infradead.org
>> http://lists.infradead.org/mailman/listinfo/linux-amlogic
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-07 10:59 ` Giuseppe CAVALLARO
0 siblings, 0 replies; 56+ messages in thread
From: Giuseppe CAVALLARO @ 2016-11-07 10:59 UTC (permalink / raw)
To: linus-amlogic
Hi Jerome
We met, on some platform, problems that, in a glance,
look similar to yours and those were related to EEE and
LPI interrupts.
We had a subset of patches to disable EEE but, indeed,
if you disable from PHY, the STMMAC will never act
the protocol. We can provide you these patches... I will
ask Alex to decide how to proceed.
There is a issue on lpi timer and I have another patch to
share but I am not sure this can help.
In sum, if EEE is a suspected problem we can share and review
some patches.
In the meantime, I will read again the thread just to see if
there is something I am missing.
Regards
Peppe
On 11/3/2016 5:57 PM, Jerome Brunet wrote:
> On Mon, 2016-10-31 at 11:25 +0100, Andr? Roth wrote:
>> Hi all,
>>
>>>
>>> on my device this results in:
>>> [0xc9410018] = 0x2000000
>>> [0xc9410030] = 0x0
>>> [0xc941003c] = 0x0
>>> [0xc9411000] = 0x1100802
>>> [0xc9411018] = 0x2202006
>>> [0xc9411028] = 0x0
>>>
>>> maybe someone else could try the command from above on his device
>>> (running the original Amlogic kernel).
>>
>> those registers have the same value on an original image from
>> hardkernel:
>>
>> Linux odroid64 3.14.65-65 #1 SMP PREEMPT Sat May 28
>> 02:50:51 BRT 2016 aarch64 aarch64 aarch64 GNU/Linux
>>
>>>
>>> please also state if ethernet is working properly on the original
>>> kernel (and preferably which device/board this is).
>>
>> yes, the ethernet works flawless in 100 and 1000 Mbit/s on the 3.14
>> kernel.
>
> Andre, the 3.14 kernel you are talking, is it this one ? :
> https://github.com/hardkernel/linux/tree/odroidc2-3.14.y
>
> Because in drivers/net/phy/realtek.c, they disable EEE, but
> also 1000Base-T Full Duplex advertisement ?
>
> + /* disable 1000m adv*/
> + val = phy_read(phydev, 0x9);
> + phy_write(phydev, 0x9, val&(~(1<<9)));
>
> If this is the kernel you are running, you should not be able to have
> ethernet at 1000MB/s ? Or is it in half duplex mode ?
>
>>
>> I can now confirm that both 100 and 1000 Mbit/s do not work properly
>> on the 4.8/integ branch. the network connection is interrupted after
>> some outbound traffic. it can be recovered by running a ifdown/ifup
>> which restarts dhclient, which I think is able to somehow reset the
>> interface.
>>
>> Anything I can help to debug the issue further ?
>>
>> Regards,
>>
>> Andr?
>>
>>
>>
>> _______________________________________________
>> linux-amlogic mailing list
>> linux-amlogic at lists.infradead.org
>> http://lists.infradead.org/mailman/listinfo/linux-amlogic
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-11-07 10:59 ` Giuseppe CAVALLARO
@ 2016-11-07 17:37 ` Martin Blumenstingl
-1 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-11-07 17:37 UTC (permalink / raw)
To: Giuseppe CAVALLARO
Cc: Jerome Brunet, André Roth, Alexandre Torgue, Johnson Leung,
linux-amlogic, netdev, afaerber
Hi Peppe,
On Mon, Nov 7, 2016 at 11:59 AM, Giuseppe CAVALLARO
<peppe.cavallaro@st.com> wrote:
> In the meantime, I will read again the thread just to see if
> there is something I am missing.
if you are re-reading this thread: please note that there are two
devices in discussion here!
Both are using the Amlogic S905 (GXBB) SoC and both are experiencing
the same issue (Gbit TX issues, RX with Gbit speeds and RX/TX with
100Mbit speed are NOT affected):
- Odroid-C2 (used by Jerome and André Roth)
- Tronsmart Vega S95 Meta (my device)
The (Gbit TX) problem seems to be gone on the Odroid-C2 with Jerome's
patch which disables EEE in drivers/net/phy/realtek.c (at least in his
tests, I don't have that device so I can't verify).
The same problem still appears on my Tronsmart Vega S95 Meta even with
the patched PHY driver.
Unfortunately I don't have a second device to rule out that my
Tronsmart Vega S95 Meta could be broken (not unlikely, I get DDR
errors from time to time in u-boot). Maybe Andreas Faerber can test
ethernet with and without Jerome's patch on one of his Tronsmart
devices.
Regards,
Martin
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-07 17:37 ` Martin Blumenstingl
0 siblings, 0 replies; 56+ messages in thread
From: Martin Blumenstingl @ 2016-11-07 17:37 UTC (permalink / raw)
To: linus-amlogic
Hi Peppe,
On Mon, Nov 7, 2016 at 11:59 AM, Giuseppe CAVALLARO
<peppe.cavallaro@st.com> wrote:
> In the meantime, I will read again the thread just to see if
> there is something I am missing.
if you are re-reading this thread: please note that there are two
devices in discussion here!
Both are using the Amlogic S905 (GXBB) SoC and both are experiencing
the same issue (Gbit TX issues, RX with Gbit speeds and RX/TX with
100Mbit speed are NOT affected):
- Odroid-C2 (used by Jerome and Andr? Roth)
- Tronsmart Vega S95 Meta (my device)
The (Gbit TX) problem seems to be gone on the Odroid-C2 with Jerome's
patch which disables EEE in drivers/net/phy/realtek.c (at least in his
tests, I don't have that device so I can't verify).
The same problem still appears on my Tronsmart Vega S95 Meta even with
the patched PHY driver.
Unfortunately I don't have a second device to rule out that my
Tronsmart Vega S95 Meta could be broken (not unlikely, I get DDR
errors from time to time in u-boot). Maybe Andreas Faerber can test
ethernet with and without Jerome's patch on one of his Tronsmart
devices.
Regards,
Martin
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-11-03 16:57 ` Jerome Brunet
@ 2016-11-13 19:13 ` André Roth
-1 siblings, 0 replies; 56+ messages in thread
From: André Roth @ 2016-11-13 19:13 UTC (permalink / raw)
To: Jerome Brunet
Cc: Martin Blumenstingl, Johnson Leung, Giuseppe CAVALLARO,
linux-amlogic, Alexandre Torgue, netdev
> Andre, the 3.14 kernel you are talking, is it this one ? :
> https://github.com/hardkernel/linux/tree/odroidc2-3.14.y
yes
> Because in drivers/net/phy/realtek.c, they disable EEE, but
> also 1000Base-T Full Duplex advertisement ?
>
> + /* disable 1000m adv*/
> + val = phy_read(phydev, 0x9);
> + phy_write(phydev, 0x9, val&(~(1<<9)));
>
> If this is the kernel you are running, you should not be able to have
> ethernet at 1000MB/s ? Or is it in half duplex mode ?
ethtool shows 1000Mb/s Full-Duplex and the bandwith is around 300Mb/s
(as measured by scp). kernel version: 3.14.65-73
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-13 19:13 ` André Roth
0 siblings, 0 replies; 56+ messages in thread
From: André Roth @ 2016-11-13 19:13 UTC (permalink / raw)
To: linus-amlogic
> Andre, the 3.14 kernel you are talking, is it this one ? :?
> https://github.com/hardkernel/linux/tree/odroidc2-3.14.y
yes
> Because in drivers/net/phy/realtek.c, they disable EEE, but
> also?1000Base-T Full Duplex advertisement ?
>
> + /* disable 1000m adv*/
> + val = phy_read(phydev, 0x9);
> + phy_write(phydev, 0x9, val&(~(1<<9)));
>
> If this is the kernel you are running, you should not be able to have
> ethernet at 1000MB/s ? Or is it in half duplex mode ?
ethtool shows 1000Mb/s Full-Duplex and the bandwith is around 300Mb/s
(as measured by scp). kernel version: 3.14.65-73
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-11-03 16:36 ` Jerome Brunet
@ 2016-11-13 19:20 ` André Roth
-1 siblings, 0 replies; 56+ messages in thread
From: André Roth @ 2016-11-13 19:20 UTC (permalink / raw)
To: Jerome Brunet
Cc: Martin Blumenstingl, Giuseppe CAVALLARO, Johnson Leung, netdev,
Alexandre Torgue, linux-amlogic
Hi all,
> To everybody having similar issue with their OdroidC2, could you try
> the attached patch and let us know if it changes anything for you ?
I can confirm that this patch removes the problem, I have now constant
~300Mb/s in both directions without any issue ! :)
I used the v4.10/integ branch, which shows the problem without applying
this patch.
Thanks for your work,
André
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-13 19:20 ` André Roth
0 siblings, 0 replies; 56+ messages in thread
From: André Roth @ 2016-11-13 19:20 UTC (permalink / raw)
To: linus-amlogic
Hi all,
> To everybody having similar issue with their OdroidC2, could you try
> the attached patch and let us know if it changes anything for you ?
I can confirm that this patch removes the problem, I have now constant
~300Mb/s in both directions without any issue ! :)
I used the v4.10/integ branch, which shows the problem without applying
this patch.
Thanks for your work,
Andr?
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-11-07 17:37 ` Martin Blumenstingl
@ 2016-11-14 7:47 ` Giuseppe CAVALLARO
-1 siblings, 0 replies; 56+ messages in thread
From: Giuseppe CAVALLARO @ 2016-11-14 7:47 UTC (permalink / raw)
To: Martin Blumenstingl
Cc: Jerome Brunet, André Roth, Alexandre Torgue, Johnson Leung,
linux-amlogic, netdev, afaerber
Hello Martin
On 11/7/2016 6:37 PM, Martin Blumenstingl wrote:
> Hi Peppe,
>
> On Mon, Nov 7, 2016 at 11:59 AM, Giuseppe CAVALLARO
> <peppe.cavallaro@st.com> wrote:
>> In the meantime, I will read again the thread just to see if
>> there is something I am missing.
> if you are re-reading this thread: please note that there are two
> devices in discussion here!
many thx for the sum :-)
> Both are using the Amlogic S905 (GXBB) SoC and both are experiencing
> the same issue (Gbit TX issues, RX with Gbit speeds and RX/TX with
> 100Mbit speed are NOT affected):
> - Odroid-C2 (used by Jerome and André Roth)
> - Tronsmart Vega S95 Meta (my device)
>
> The (Gbit TX) problem seems to be gone on the Odroid-C2 with Jerome's
> patch which disables EEE in drivers/net/phy/realtek.c (at least in his
> tests, I don't have that device so I can't verify).
> The same problem still appears on my Tronsmart Vega S95 Meta even with
> the patched PHY driver.
just an doubt, maybe useful, in the past, on GiGa setup I saw similar
problems and it was due to retiming so maybe 2ns could be necessary
(or better granularity via PAD logic if available).
Regards
Peppe
> Unfortunately I don't have a second device to rule out that my
> Tronsmart Vega S95 Meta could be broken (not unlikely, I get DDR
> errors from time to time in u-boot). Maybe Andreas Faerber can test
> ethernet with and without Jerome's patch on one of his Tronsmart
> devices.
>
>
> Regards,
> Martin
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-14 7:47 ` Giuseppe CAVALLARO
0 siblings, 0 replies; 56+ messages in thread
From: Giuseppe CAVALLARO @ 2016-11-14 7:47 UTC (permalink / raw)
To: linus-amlogic
Hello Martin
On 11/7/2016 6:37 PM, Martin Blumenstingl wrote:
> Hi Peppe,
>
> On Mon, Nov 7, 2016 at 11:59 AM, Giuseppe CAVALLARO
> <peppe.cavallaro@st.com> wrote:
>> In the meantime, I will read again the thread just to see if
>> there is something I am missing.
> if you are re-reading this thread: please note that there are two
> devices in discussion here!
many thx for the sum :-)
> Both are using the Amlogic S905 (GXBB) SoC and both are experiencing
> the same issue (Gbit TX issues, RX with Gbit speeds and RX/TX with
> 100Mbit speed are NOT affected):
> - Odroid-C2 (used by Jerome and Andr? Roth)
> - Tronsmart Vega S95 Meta (my device)
>
> The (Gbit TX) problem seems to be gone on the Odroid-C2 with Jerome's
> patch which disables EEE in drivers/net/phy/realtek.c (at least in his
> tests, I don't have that device so I can't verify).
> The same problem still appears on my Tronsmart Vega S95 Meta even with
> the patched PHY driver.
just an doubt, maybe useful, in the past, on GiGa setup I saw similar
problems and it was due to retiming so maybe 2ns could be necessary
(or better granularity via PAD logic if available).
Regards
Peppe
> Unfortunately I don't have a second device to rule out that my
> Tronsmart Vega S95 Meta could be broken (not unlikely, I get DDR
> errors from time to time in u-boot). Maybe Andreas Faerber can test
> ethernet with and without Jerome's patch on one of his Tronsmart
> devices.
>
>
> Regards,
> Martin
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-11-13 19:13 ` André Roth
@ 2016-11-14 10:49 ` Jerome Brunet
-1 siblings, 0 replies; 56+ messages in thread
From: Jerome Brunet @ 2016-11-14 10:49 UTC (permalink / raw)
To: André Roth
Cc: Martin Blumenstingl, Johnson Leung, Giuseppe CAVALLARO,
linux-amlogic, Alexandre Torgue, netdev
On Sun, 2016-11-13 at 20:13 +0100, André Roth wrote:
> >
> > Andre, the 3.14 kernel you are talking, is it this one ? :
> > https://github.com/hardkernel/linux/tree/odroidc2-3.14.y
>
> yes
>
> >
> > Because in drivers/net/phy/realtek.c, they disable EEE, but
> > also 1000Base-T Full Duplex advertisement ?
> >
> > + /* disable 1000m adv*/
> > + val = phy_read(phydev, 0x9);
> > + phy_write(phydev, 0x9, val&(~(1<<9)));
> >
> > If this is the kernel you are running, you should not be able to
> > have
> > ethernet at 1000MB/s ? Or is it in half duplex mode ?
>
> ethtool shows 1000Mb/s Full-Duplex and the bandwith is around 300Mb/s
> (as measured by scp). kernel version: 3.14.65-73
Andre,
I checked again the kernel at https://github.com/hardkernel/linux/tree/
odroidc2-3.14.y. The version you mention (3.14.65-73) seems to be:
sha1: c75d5f4d1516cdd86d90a9d1c565bb0ed9251036
tag: jenkins-deb s905 kernel-73
In this particular version, both realtek drivers:
- drivers/net/phy/realtek.c
- drivers/amlogic/ethernet/phy/am_realtek.c
have the hack to disable 1000M advertisement. I don't understand how it
possible for you to have 1000Base-T Full Duplex with this, maybe I'm
missing something here ?
If you did compile the kernel yourself, could you check the 2 file
mentioned above ? Just to be sure there was no patch applied at the
last minute, which would not show up in the git history of hardkernel ?
Thx
Jerome
>
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-14 10:49 ` Jerome Brunet
0 siblings, 0 replies; 56+ messages in thread
From: Jerome Brunet @ 2016-11-14 10:49 UTC (permalink / raw)
To: linus-amlogic
On Sun, 2016-11-13 at 20:13 +0100, Andr? Roth wrote:
> >
> > Andre, the 3.14 kernel you are talking, is it this one ? :?
> > https://github.com/hardkernel/linux/tree/odroidc2-3.14.y
>
> yes
> ?
> >
> > Because in drivers/net/phy/realtek.c, they disable EEE, but
> > also?1000Base-T Full Duplex advertisement ?
> >
> > + /* disable 1000m adv*/
> > + val = phy_read(phydev, 0x9);
> > + phy_write(phydev, 0x9, val&(~(1<<9)));
> >
> > If this is the kernel you are running, you should not be able to
> > have
> > ethernet at 1000MB/s ? Or is it in half duplex mode ?
>
> ethtool shows 1000Mb/s Full-Duplex and the bandwith is around 300Mb/s
> (as measured by scp). kernel version: 3.14.65-73
Andre,
I checked again the kernel at?https://github.com/hardkernel/linux/tree/
odroidc2-3.14.y. The version you mention (3.14.65-73) seems to be:
sha1:?c75d5f4d1516cdd86d90a9d1c565bb0ed9251036
tag: jenkins-deb s905 kernel-73
In this particular version, both realtek drivers:
- drivers/net/phy/realtek.c
- drivers/amlogic/ethernet/phy/am_realtek.c
have the hack to disable 1000M advertisement. I don't understand how it
possible for you to have 1000Base-T Full Duplex with this, maybe I'm
missing something here ?
If you did compile the kernel yourself, could you check the 2 file
mentioned above ? Just to be sure there was no patch applied at the
last minute, which would not show up in the git history of hardkernel ?
Thx
Jerome
>
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-11-14 7:47 ` Giuseppe CAVALLARO
@ 2016-11-14 11:02 ` Jerome Brunet
-1 siblings, 0 replies; 56+ messages in thread
From: Jerome Brunet @ 2016-11-14 11:02 UTC (permalink / raw)
To: Giuseppe CAVALLARO, Martin Blumenstingl
Cc: André Roth, Alexandre Torgue, Johnson Leung, linux-amlogic,
netdev, afaerber
On Mon, 2016-11-14 at 08:47 +0100, Giuseppe CAVALLARO wrote:
> Hello Martin
>
> On 11/7/2016 6:37 PM, Martin Blumenstingl wrote:
> >
> > Hi Peppe,
> >
> > On Mon, Nov 7, 2016 at 11:59 AM, Giuseppe CAVALLARO
> > <peppe.cavallaro@st.com> wrote:
> > >
> > > In the meantime, I will read again the thread just to see if
> > > there is something I am missing.
> > if you are re-reading this thread: please note that there are two
> > devices in discussion here!
>
> many thx for the sum :-)
>
> >
> > Both are using the Amlogic S905 (GXBB) SoC and both are
> > experiencing
> > the same issue (Gbit TX issues, RX with Gbit speeds and RX/TX with
> > 100Mbit speed are NOT affected):
> > - Odroid-C2 (used by Jerome and André Roth)
> > - Tronsmart Vega S95 Meta (my device)
> >
> > The (Gbit TX) problem seems to be gone on the Odroid-C2 with
> > Jerome's
> > patch which disables EEE in drivers/net/phy/realtek.c (at least in
> > his
> > tests, I don't have that device so I can't verify).
> > The same problem still appears on my Tronsmart Vega S95 Meta even
> > with
> > the patched PHY driver.
>
> just an doubt, maybe useful, in the past, on GiGa setup I saw similar
> problems and it was due to retiming so maybe 2ns could be necessary
> (or better granularity via PAD logic if available).
>
> Regards
> Peppe
Peppe, Martin,
With Andre's feedback, I think we can confirm that disabling EEE solve
the problem for the OdroidC2 design.
We do have the same results as Martin on MXQ-Pro based designs. For
these particular boards, disabling EEE does not seems to enough to get
a stable Tx path in 1000Base-T.
I will submit the patch for the Odroidc2 later today.
For the Vega, you should probably check the Tx delay as Peppe suggests.
To do these tests, It would probably be better to disable EEE as well.
Do you want me to include this change for the vega in the patch ?
Cheers
Jerome
>
> >
> > Unfortunately I don't have a second device to rule out that my
> > Tronsmart Vega S95 Meta could be broken (not unlikely, I get DDR
> > errors from time to time in u-boot). Maybe Andreas Faerber can test
> > ethernet with and without Jerome's patch on one of his Tronsmart
> > devices.
> >
> >
> > Regards,
> > Martin
> >
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-14 11:02 ` Jerome Brunet
0 siblings, 0 replies; 56+ messages in thread
From: Jerome Brunet @ 2016-11-14 11:02 UTC (permalink / raw)
To: linus-amlogic
On Mon, 2016-11-14 at 08:47 +0100, Giuseppe CAVALLARO wrote:
> Hello Martin
>
> On 11/7/2016 6:37 PM, Martin Blumenstingl wrote:
> >
> > Hi Peppe,
> >
> > On Mon, Nov 7, 2016 at 11:59 AM, Giuseppe CAVALLARO
> > <peppe.cavallaro@st.com> wrote:
> > >
> > > In the meantime, I will read again the thread just to see if
> > > there is something I am missing.
> > if you are re-reading this thread: please note that there are two
> > devices in discussion here!
>
> many thx for the sum :-)
>
> >
> > Both are using the Amlogic S905 (GXBB) SoC and both are
> > experiencing
> > the same issue (Gbit TX issues, RX with Gbit speeds and RX/TX with
> > 100Mbit speed are NOT affected):
> > - Odroid-C2 (used by Jerome and Andr? Roth)
> > - Tronsmart Vega S95 Meta (my device)
> >
> > The (Gbit TX) problem seems to be gone on the Odroid-C2 with
> > Jerome's
> > patch which disables EEE in drivers/net/phy/realtek.c (at least in
> > his
> > tests, I don't have that device so I can't verify).
> > The same problem still appears on my Tronsmart Vega S95 Meta even
> > with
> > the patched PHY driver.
>
> just an doubt, maybe useful, in the past, on GiGa setup I saw similar
> problems and it was due to retiming so maybe 2ns could be necessary
> (or better granularity via PAD logic if available).
>
> Regards
> Peppe
Peppe, Martin,
With Andre's feedback, I think we can confirm that disabling EEE solve
the problem for the OdroidC2 design.
We do have the same results as Martin on MXQ-Pro based designs. For
these particular boards, disabling EEE does not seems to enough to get
a stable Tx path in 1000Base-T.
I will submit the patch for the Odroidc2 later today.
For the Vega, you should probably check the Tx delay as Peppe suggests.
To do these tests, It would probably be better to disable EEE as well.
Do you want me to include this change for the vega in the patch ?
Cheers
Jerome?
>
> >
> > Unfortunately I don't have a second device to rule out that my
> > Tronsmart Vega S95 Meta could be broken (not unlikely, I get DDR
> > errors from time to time in u-boot). Maybe Andreas Faerber can test
> > ethernet with and without Jerome's patch on one of his Tronsmart
> > devices.
> >
> >
> > Regards,
> > Martin
> >
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-11-07 17:37 ` Martin Blumenstingl
@ 2016-11-14 15:00 ` Andreas Färber
-1 siblings, 0 replies; 56+ messages in thread
From: Andreas Färber @ 2016-11-14 15:00 UTC (permalink / raw)
To: Martin Blumenstingl
Cc: Giuseppe CAVALLARO, Alexandre Torgue, netdev, André Roth,
Johnson Leung, linux-amlogic, Jerome Brunet
Hi,
Am 07.11.2016 um 18:37 schrieb Martin Blumenstingl:
> The same problem still appears on my Tronsmart Vega S95 Meta even with
> the patched PHY driver.
>
> Unfortunately I don't have a second device to rule out that my
> Tronsmart Vega S95 Meta could be broken (not unlikely, I get DDR
> errors from time to time in u-boot). Maybe Andreas Faerber can test
> ethernet with and without Jerome's patch on one of his Tronsmart
> devices.
So far I only ran into the stall issue on my Odroid-C2, not on my Vega
S95 Telos, both on v4.10/integ branch with a rebased MMC patch of yours
on top.
I'm assuming you mean realtek8211f-disable-eee-1000.patch from Nov 3.
Regards,
Andreas
--
SUSE Linux GmbH, Maxfeldstr. 5, 90409 Nürnberg, Germany
GF: Felix Imendörffer, Jane Smithard, Graham Norton
HRB 21284 (AG Nürnberg)
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-14 15:00 ` Andreas Färber
0 siblings, 0 replies; 56+ messages in thread
From: Andreas Färber @ 2016-11-14 15:00 UTC (permalink / raw)
To: linus-amlogic
Hi,
Am 07.11.2016 um 18:37 schrieb Martin Blumenstingl:
> The same problem still appears on my Tronsmart Vega S95 Meta even with
> the patched PHY driver.
>
> Unfortunately I don't have a second device to rule out that my
> Tronsmart Vega S95 Meta could be broken (not unlikely, I get DDR
> errors from time to time in u-boot). Maybe Andreas Faerber can test
> ethernet with and without Jerome's patch on one of his Tronsmart
> devices.
So far I only ran into the stall issue on my Odroid-C2, not on my Vega
S95 Telos, both on v4.10/integ branch with a rebased MMC patch of yours
on top.
I'm assuming you mean realtek8211f-disable-eee-1000.patch from Nov 3.
Regards,
Andreas
--
SUSE Linux GmbH, Maxfeldstr. 5, 90409 N?rnberg, Germany
GF: Felix Imend?rffer, Jane Smithard, Graham Norton
HRB 21284 (AG N?rnberg)
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-11-14 15:00 ` Andreas Färber
@ 2016-11-15 11:27 ` Jerome Brunet
-1 siblings, 0 replies; 56+ messages in thread
From: Jerome Brunet @ 2016-11-15 11:27 UTC (permalink / raw)
To: Andreas Färber, Martin Blumenstingl
Cc: Giuseppe CAVALLARO, Alexandre Torgue, netdev, André Roth,
Johnson Leung, linux-amlogic
On Mon, 2016-11-14 at 16:00 +0100, Andreas Färber wrote:
> Hi,
>
> Am 07.11.2016 um 18:37 schrieb Martin Blumenstingl:
> >
> > The same problem still appears on my Tronsmart Vega S95 Meta even
> > with
> > the patched PHY driver.
> >
> > Unfortunately I don't have a second device to rule out that my
> > Tronsmart Vega S95 Meta could be broken (not unlikely, I get DDR
> > errors from time to time in u-boot). Maybe Andreas Faerber can test
> > ethernet with and without Jerome's patch on one of his Tronsmart
> > devices.
>
> So far I only ran into the stall issue on my Odroid-C2, not on my
> Vega
> S95 Telos, both on v4.10/integ branch with a rebased MMC patch of
> yours
> on top.
The status of vega/mxq boards seems a bit confused.
This is the status I have so far:
These designs are not affected by the EEE issue. The patch mentioned
has no effect on these boards.
Some boards run fine at GBit speed (like yours) , some have terrible Tx
throughput (like mine and Martin's one). However, unlike on the
odroidc2, the link is not broken after the test, it is not necessary to
ifdown/ifup the interface to do another test.
I'm wondering if the vega/mxq designs all use the rtl8211f phy ?
>
> I'm assuming you mean realtek8211f-disable-eee-1000.patch from Nov 3.
>
Indeed. I won't submit anything for the vega since it has no effect.
> Regards,
> Andreas
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-15 11:27 ` Jerome Brunet
0 siblings, 0 replies; 56+ messages in thread
From: Jerome Brunet @ 2016-11-15 11:27 UTC (permalink / raw)
To: linus-amlogic
On Mon, 2016-11-14 at 16:00 +0100, Andreas F?rber wrote:
> Hi,
>
> Am 07.11.2016 um 18:37 schrieb Martin Blumenstingl:
> >
> > The same problem still appears on my Tronsmart Vega S95 Meta even
> > with
> > the patched PHY driver.
> >
> > Unfortunately I don't have a second device to rule out that my
> > Tronsmart Vega S95 Meta could be broken (not unlikely, I get DDR
> > errors from time to time in u-boot). Maybe Andreas Faerber can test
> > ethernet with and without Jerome's patch on one of his Tronsmart
> > devices.
>
> So far I only ran into the stall issue on my Odroid-C2, not on my
> Vega
> S95 Telos, both on v4.10/integ branch with a rebased MMC patch of
> yours
> on top.
The status of vega/mxq boards seems a bit confused.
This is the status I have so far:
These designs are not affected by the EEE issue. The patch mentioned
has no effect on these boards.
Some boards run fine at GBit speed (like yours) , some have terrible Tx
throughput (like mine and Martin's one). However, unlike on the
odroidc2, the link is not broken after the test, it is not necessary to
ifdown/ifup the interface to do another test.
I'm wondering if the vega/mxq designs all use the rtl8211f phy ?
>
> I'm assuming you mean realtek8211f-disable-eee-1000.patch from Nov 3.
>
Indeed. I won't submit anything for the vega since it has no effect.
> Regards,
> Andreas
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-11-14 10:49 ` Jerome Brunet
@ 2016-11-17 18:44 ` André Roth
-1 siblings, 0 replies; 56+ messages in thread
From: André Roth @ 2016-11-17 18:44 UTC (permalink / raw)
To: Jerome Brunet
Cc: Martin Blumenstingl, Johnson Leung, Giuseppe CAVALLARO,
linux-amlogic, Alexandre Torgue, netdev
Hi all,
> I checked again the kernel
> at https://github.com/hardkernel/linux/tree/ odroidc2-3.14.y. The
> version you mention (3.14.65-73) seems to be:
> sha1: c75d5f4d1516cdd86d90a9d1c565bb0ed9251036 tag: jenkins-deb s905
> kernel-73
I downloaded the prebuilt image from hardkernel, I did not build the
kernel myself. but hardkernel has an earlier release of the same kernel
version, which works fine too. I assume they would have committed the
change in the newer version..
> In this particular version, both realtek drivers:
> - drivers/net/phy/realtek.c
> - drivers/amlogic/ethernet/phy/am_realtek.c
>
> have the hack to disable 1000M advertisement. I don't understand how
> it possible for you to have 1000Base-T Full Duplex with this, maybe
> I'm missing something here ?
that's what I don't understand as well...
the patched kernel shows the following:
$ uname -a
Linux T-06 4.9.0-rc4+ #21 SMP PREEMPT Sun Nov 13 12:07:19 UTC 2016
$ sudo ethtool eth0
Settings for eth0:
Supported ports: [ TP MII ]
Supported link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Supported pause frame use: No
Supports auto-negotiation: Yes
Advertised link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Advertised pause frame use: No
Advertised auto-negotiation: Yes
Link partner advertised link modes: 10baseT/Half 10baseT/Full
100baseT/Half
100baseT/Full 1000baseT/Half 1000baseT/Full
Link partner advertised pause frame use: Symmetric Receive-only
Link partner advertised auto-negotiation: Yes
Speed: 1000Mb/s
Duplex: Full
Port: MII
PHYAD: 0
Transceiver: external
Auto-negotiation: on
Supports Wake-on: ug
Wake-on: d
Current message level: 0x0000003f (63)
drv probe link timer ifdown ifup
Link detected: yes
$ sudo ethtool --show-eee eth0
EEE Settings for eth0:
EEE status: disabled
Tx LPI: disabled
Supported EEE link modes: 100baseT/Full
1000baseT/Full
Advertised EEE link modes: 100baseT/Full
Link partner advertised EEE link modes: 100baseT/Full
1000baseT/Full
can it be that "EEE link modes" and the "normal" link modes are two
different things ?
> If you did compile the kernel yourself, could you check the 2 file
> mentioned above ? Just to be sure there was no patch applied at the
> last minute, which would not show up in the git history of
> hardkernel ?
I cannot check this easily at the moment..
Regards,
André
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-17 18:44 ` André Roth
0 siblings, 0 replies; 56+ messages in thread
From: André Roth @ 2016-11-17 18:44 UTC (permalink / raw)
To: linus-amlogic
Hi all,
> I checked again the kernel
> at?https://github.com/hardkernel/linux/tree/ odroidc2-3.14.y. The
> version you mention (3.14.65-73) seems to be:
> sha1:?c75d5f4d1516cdd86d90a9d1c565bb0ed9251036 tag: jenkins-deb s905
> kernel-73
I downloaded the prebuilt image from hardkernel, I did not build the
kernel myself. but hardkernel has an earlier release of the same kernel
version, which works fine too. I assume they would have committed the
change in the newer version..
> In this particular version, both realtek drivers:
> - drivers/net/phy/realtek.c
> - drivers/amlogic/ethernet/phy/am_realtek.c
>
> have the hack to disable 1000M advertisement. I don't understand how
> it possible for you to have 1000Base-T Full Duplex with this, maybe
> I'm missing something here ?
that's what I don't understand as well...
the patched kernel shows the following:
$ uname -a
Linux T-06 4.9.0-rc4+ #21 SMP PREEMPT Sun Nov 13 12:07:19 UTC 2016
$ sudo ethtool eth0
Settings for eth0:
Supported ports: [ TP MII ]
Supported link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Supported pause frame use: No
Supports auto-negotiation: Yes
Advertised link modes: 10baseT/Half 10baseT/Full
100baseT/Half 100baseT/Full
1000baseT/Full
Advertised pause frame use: No
Advertised auto-negotiation: Yes
Link partner advertised link modes: 10baseT/Half 10baseT/Full
100baseT/Half
100baseT/Full 1000baseT/Half 1000baseT/Full
Link partner advertised pause frame use: Symmetric Receive-only
Link partner advertised auto-negotiation: Yes
Speed: 1000Mb/s
Duplex: Full
Port: MII
PHYAD: 0
Transceiver: external
Auto-negotiation: on
Supports Wake-on: ug
Wake-on: d
Current message level: 0x0000003f (63)
drv probe link timer ifdown ifup
Link detected: yes
$ sudo ethtool --show-eee eth0
EEE Settings for eth0:
EEE status: disabled
Tx LPI: disabled
Supported EEE link modes: 100baseT/Full
1000baseT/Full
Advertised EEE link modes: 100baseT/Full
Link partner advertised EEE link modes: 100baseT/Full
1000baseT/Full
can it be that "EEE link modes" and the "normal" link modes are two
different things ?
> If you did compile the kernel yourself, could you check the 2 file
> mentioned above ? Just to be sure there was no patch applied at the
> last minute, which would not show up in the git history of
> hardkernel ?
I cannot check this easily at the moment..
Regards,
Andr?
^ permalink raw reply [flat|nested] 56+ messages in thread
* Re: stmmac/RTL8211F/Meson GXBB: TX throughput problems
2016-11-17 18:44 ` André Roth
@ 2016-11-17 21:47 ` Jerome Brunet
-1 siblings, 0 replies; 56+ messages in thread
From: Jerome Brunet @ 2016-11-17 21:47 UTC (permalink / raw)
To: André Roth
Cc: Martin Blumenstingl, Johnson Leung, Giuseppe CAVALLARO,
linux-amlogic, Alexandre Torgue, netdev
On Thu, 2016-11-17 at 19:44 +0100, André Roth wrote:
> Hi all,
>
> >
> > I checked again the kernel
> > at https://github.com/hardkernel/linux/tree/ odroidc2-3.14.y. The
> > version you mention (3.14.65-73) seems to be:
> > sha1: c75d5f4d1516cdd86d90a9d1c565bb0ed9251036 tag: jenkins-deb
> > s905
> > kernel-73
>
> I downloaded the prebuilt image from hardkernel, I did not build the
> kernel myself. but hardkernel has an earlier release of the same
> kernel
> version, which works fine too. I assume they would have committed the
> change in the newer version..
>
> >
> > In this particular version, both realtek drivers:
> > - drivers/net/phy/realtek.c
> > - drivers/amlogic/ethernet/phy/am_realtek.c
> >
> > have the hack to disable 1000M advertisement. I don't understand
> > how
> > it possible for you to have 1000Base-T Full Duplex with this, maybe
> > I'm missing something here ?
>
> that's what I don't understand as well...
>
> the patched kernel shows the following:
>
> $ uname -a
> Linux T-06 4.9.0-rc4+ #21 SMP PREEMPT Sun Nov 13 12:07:19 UTC 2016
>
> $ sudo ethtool eth0
> Settings for eth0:
> Supported ports: [ TP MII ]
> Supported link modes: 10baseT/Half 10baseT/Full
> 100baseT/Half 100baseT/Full
> 1000baseT/Full
> Supported pause frame use: No
> Supports auto-negotiation: Yes
> Advertised link modes: 10baseT/Half 10baseT/Full
> 100baseT/Half 100baseT/Full
> 1000baseT/Full
> Advertised pause frame use: No
> Advertised auto-negotiation: Yes
> Link partner advertised link modes: 10baseT/Half
> 10baseT/Full
> 100baseT/Half
> 100baseT/Full 1000baseT/Half 1000baseT/Full
> Link partner advertised pause frame use: Symmetric Receive-
> only
> Link partner advertised auto-negotiation: Yes
> Speed: 1000Mb/s
> Duplex: Full
> Port: MII
> PHYAD: 0
> Transceiver: external
> Auto-negotiation: on
> Supports Wake-on: ug
> Wake-on: d
> Current message level: 0x0000003f (63)
> drv probe link timer ifdown ifup
> Link detected: yes
>
> $ sudo ethtool --show-eee eth0
> EEE Settings for eth0:
> EEE status: disabled
> Tx LPI: disabled
> Supported EEE link modes: 100baseT/Full
> 1000baseT/Full
> Advertised EEE link modes: 100baseT/Full
> Link partner advertised EEE link modes: 100baseT/Full
> 1000baseT/Full
>
> can it be that "EEE link modes" and the "normal" link modes are two
> different things ?
Exactly, They are.
Hardkernel code disable both.
With hardkernel's kernel, you should not have 1000baseT/Full in
"Advertised link modes" and you would have nothing reported in
"Advertised EEE link modes"
>
> >
> > If you did compile the kernel yourself, could you check the 2 file
> > mentioned above ? Just to be sure there was no patch applied at the
> > last minute, which would not show up in the git history of
> > hardkernel ?
>
> I cannot check this easily at the moment..
>
> Regards,
>
> André
>
^ permalink raw reply [flat|nested] 56+ messages in thread
* stmmac/RTL8211F/Meson GXBB: TX throughput problems
@ 2016-11-17 21:47 ` Jerome Brunet
0 siblings, 0 replies; 56+ messages in thread
From: Jerome Brunet @ 2016-11-17 21:47 UTC (permalink / raw)
To: linus-amlogic
On Thu, 2016-11-17 at 19:44 +0100, Andr? Roth wrote:
> Hi all,
>
> >
> > I checked again the kernel
> > at?https://github.com/hardkernel/linux/tree/ odroidc2-3.14.y. The
> > version you mention (3.14.65-73) seems to be:
> > sha1:?c75d5f4d1516cdd86d90a9d1c565bb0ed9251036 tag: jenkins-deb
> > s905
> > kernel-73
>
> I downloaded the prebuilt image from hardkernel, I did not build the
> kernel myself. but hardkernel has an earlier release of the same
> kernel
> version, which works fine too. I assume they would have committed the
> change in the newer version..
> ?
> >
> > In this particular version, both realtek drivers:
> > - drivers/net/phy/realtek.c
> > - drivers/amlogic/ethernet/phy/am_realtek.c
> >
> > have the hack to disable 1000M advertisement. I don't understand
> > how
> > it possible for you to have 1000Base-T Full Duplex with this, maybe
> > I'm missing something here ?
>
> that's what I don't understand as well...
>
> the patched kernel shows the following:
>
> $ uname -a
> Linux T-06 4.9.0-rc4+ #21 SMP PREEMPT Sun Nov 13 12:07:19 UTC 2016
>
> $ sudo ethtool eth0
> Settings for eth0:
> ????????Supported ports: [ TP MII ]
> ????????Supported link modes:???10baseT/Half 10baseT/Full?
> ????????????????????????????????100baseT/Half 100baseT/Full?
> ????????????????????????????????1000baseT/Full?
> ????????Supported pause frame use: No
> ????????Supports auto-negotiation: Yes
> ????????Advertised link modes:??10baseT/Half 10baseT/Full?
> ????????????????????????????????100baseT/Half 100baseT/Full?
> ????????????????????????????????1000baseT/Full?
> ????????Advertised pause frame use: No
> ????????Advertised auto-negotiation: Yes
> ????????Link partner advertised link modes:??10baseT/Half
> 10baseT/Full?
> ?????????????????????????????????????????????100baseT/Half
> 100baseT/Full 1000baseT/Half 1000baseT/Full?
> ????????Link partner advertised pause frame use: Symmetric Receive-
> only
> ????????Link partner advertised auto-negotiation: Yes
> ????????Speed: 1000Mb/s
> ????????Duplex: Full
> ????????Port: MII
> ????????PHYAD: 0
> ????????Transceiver: external
> ????????Auto-negotiation: on
> ????????Supports Wake-on: ug
> ????????Wake-on: d
> ????????Current message level: 0x0000003f (63)
> ???????????????????????????????drv probe link timer ifdown ifup
> ????????Link detected: yes
>
> $ sudo ethtool --show-eee eth0
> EEE Settings for eth0:
> ????????EEE status: disabled
> ????????Tx LPI: disabled
> ????????Supported EEE link modes:??100baseT/Full?
> ???????????????????????????????????1000baseT/Full?
> ????????Advertised EEE link modes:??100baseT/Full?
> ????????Link partner advertised EEE link modes:??100baseT/Full?
> ?????????????????????????????????????????????????1000baseT/Full?
>
> can it be that "EEE link modes" and the "normal" link modes are two
> different things ??
Exactly, They are.
Hardkernel code disable both.
With hardkernel's kernel, you should not have?1000baseT/Full in
"Advertised link modes" and you would have nothing reported in
"Advertised EEE link modes"
>
> >
> > If you did compile the kernel yourself, could you check the 2 file
> > mentioned above ? Just to be sure there was no patch applied at the
> > last minute, which would not show up in the git history of
> > hardkernel ?
>
> I cannot check this easily at the moment..
>
> Regards,
>
> ?Andr?
>
^ permalink raw reply [flat|nested] 56+ messages in thread
end of thread, other threads:[~2016-11-17 21:47 UTC | newest]
Thread overview: 56+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2016-09-11 20:39 stmmac/RTL8211F/Meson GXBB: TX throughput problems Martin Blumenstingl
2016-09-11 20:39 ` Martin Blumenstingl
2016-09-12 16:37 ` Alexandre Torgue
2016-09-12 16:37 ` Alexandre Torgue
2016-09-12 21:26 ` Martin Blumenstingl
2016-09-12 21:26 ` Martin Blumenstingl
2016-09-17 21:23 ` André Roth
2016-09-17 21:23 ` André Roth
2016-09-26 6:17 ` Giuseppe CAVALLARO
2016-09-26 6:17 ` Giuseppe CAVALLARO
2016-10-01 15:58 ` Martin Blumenstingl
2016-10-01 15:58 ` Martin Blumenstingl
2016-11-03 16:36 ` Jerome Brunet
2016-11-03 16:36 ` Jerome Brunet
2016-11-05 12:20 ` Martin Blumenstingl
2016-11-05 12:20 ` Martin Blumenstingl
2016-11-13 19:20 ` André Roth
2016-11-13 19:20 ` André Roth
[not found] ` <216F2694-1C1D-44DA-AC15-57ED15C24BBE@bluematt.me>
2016-09-12 21:29 ` Martin Blumenstingl
2016-09-12 21:29 ` Martin Blumenstingl
2016-09-14 15:30 ` Giuseppe CAVALLARO
2016-09-14 15:30 ` Giuseppe CAVALLARO
2016-09-18 20:42 ` André Roth
2016-09-18 20:42 ` André Roth
2016-09-19 5:38 ` Giuseppe CAVALLARO
2016-09-19 5:38 ` Giuseppe CAVALLARO
2016-10-01 20:15 ` Martin Blumenstingl
2016-10-01 20:15 ` Martin Blumenstingl
2016-10-01 20:40 ` Martin Blumenstingl
2016-10-01 20:40 ` Martin Blumenstingl
2016-10-31 10:25 ` André Roth
2016-10-31 10:25 ` André Roth
2016-11-03 16:57 ` Jerome Brunet
2016-11-03 16:57 ` Jerome Brunet
2016-11-07 10:59 ` Giuseppe CAVALLARO
2016-11-07 10:59 ` Giuseppe CAVALLARO
2016-11-07 17:37 ` Martin Blumenstingl
2016-11-07 17:37 ` Martin Blumenstingl
2016-11-14 7:47 ` Giuseppe CAVALLARO
2016-11-14 7:47 ` Giuseppe CAVALLARO
2016-11-14 11:02 ` Jerome Brunet
2016-11-14 11:02 ` Jerome Brunet
2016-11-14 15:00 ` Andreas Färber
2016-11-14 15:00 ` Andreas Färber
2016-11-15 11:27 ` Jerome Brunet
2016-11-15 11:27 ` Jerome Brunet
2016-11-13 19:13 ` André Roth
2016-11-13 19:13 ` André Roth
2016-11-14 10:49 ` Jerome Brunet
2016-11-14 10:49 ` Jerome Brunet
2016-11-17 18:44 ` André Roth
2016-11-17 18:44 ` André Roth
2016-11-17 21:47 ` Jerome Brunet
2016-11-17 21:47 ` Jerome Brunet
2016-10-01 20:26 ` Martin Blumenstingl
2016-10-01 20:26 ` Martin Blumenstingl
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.