All of lore.kernel.org
 help / color / mirror / Atom feed
* [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
@ 2016-07-27  5:55 jens
  2016-07-27  8:38 ` Jason A. Donenfeld
  0 siblings, 1 reply; 20+ messages in thread
From: jens @ 2016-07-27  5:55 UTC (permalink / raw)
  To: wireguard

[-- Attachment #1: Type: text/plain, Size: 44079 bytes --]

last night we tested Wireguard with LEDE on a fairly weak mashine - TP
Link 841N v11.1 with 4MB flash, 32MB ram, and 650 MHz cpu.
we choose this router model because we have some hundred of them
deployed in our free wifi for the public networks around our city. (as
mentioned before Freifunk Freiburg https://freiburg.freifunk.net ) We
were interestet in Performance and what we (maybe) can do with wireguard

we described it in detail here
https://forum.freifunk.net/t/lede-test-wireguard-und-blanko-durchsatz-tp841nv11-1-und-bug/13163

brief summary - sharing of experiences
netifd crashed via iperf3 test from   laptop - 841Nv11 - 841Nv11 - laptop
iperf was running on laptops, wireguard as tunnel between 841Nv11
Routers, all connected via cable.

without wireguard, so plain routing we got 93 MBs (for refference)
and with Wireguard so far 15.5 MBs

there are clearly some heavy problems with netifd from LEDE/Openwrt ...
we simply ran in heavy load (2.6++) and out of memory

here some notes and dmesg output:

###############
# plain routing through 2 841v11.1

root@K:/home/k/wiki/wg-lede# iperf3 -c 192.168.2.23 -p 4000 -t 20
Connecting to host 192.168.2.23, port 4000
[  4] local 192.168.1.23 port 37940 connected to 192.168.2.23 port 4000
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  11.6 MBytes  96.9 Mbits/sec    0    127
KBytes       
[  4]   1.00-2.00   sec  11.4 MBytes  95.4 Mbits/sec    0    205
KBytes       
[  4]   2.00-3.00   sec  11.2 MBytes  93.8 Mbits/sec    1    165
KBytes       
[  4]   3.00-4.00   sec  11.1 MBytes  93.3 Mbits/sec    0    187
KBytes       
[  4]   4.00-5.00   sec  11.2 MBytes  94.4 Mbits/sec    0    187
KBytes       
[  4]   5.00-6.00   sec  11.2 MBytes  94.4 Mbits/sec    0    187
KBytes       
[  4]   6.00-7.00   sec  11.2 MBytes  93.8 Mbits/sec    0    187
KBytes       
[  4]   7.00-8.00   sec  11.1 MBytes  93.3 Mbits/sec    0    187
KBytes       
[  4]   8.00-9.00   sec  11.1 MBytes  93.3 Mbits/sec    2    146
KBytes       
[  4]   9.00-10.00  sec  11.2 MBytes  94.4 Mbits/sec    0    150
KBytes       
[  4]  10.00-11.00  sec  11.2 MBytes  93.8 Mbits/sec    0    150
KBytes       
[  4]  11.00-12.00  sec  11.1 MBytes  93.3 Mbits/sec    0    161
KBytes       
[  4]  12.00-13.00  sec  11.2 MBytes  93.8 Mbits/sec    0    167
KBytes       
[  4]  13.00-14.00  sec  11.2 MBytes  93.8 Mbits/sec    0    168
KBytes       
[  4]  14.00-15.00  sec  11.1 MBytes  93.3 Mbits/sec    0    173
KBytes       
[  4]  15.00-16.00  sec  11.1 MBytes  93.3 Mbits/sec    0    181
KBytes       
[  4]  16.00-17.00  sec  11.1 MBytes  93.3 Mbits/sec    2    120
KBytes       
[  4]  17.00-18.00  sec  11.2 MBytes  93.8 Mbits/sec    0    139
KBytes       
[  4]  18.00-19.00  sec  11.1 MBytes  92.8 Mbits/sec    1    151
KBytes       
[  4]  19.00-20.00  sec  11.2 MBytes  93.8 Mbits/sec    0    160
KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-20.00  sec   224 MBytes  93.9 Mbits/sec    6             sender
[  4]   0.00-20.00  sec   223 MBytes  93.7 Mbits/sec                 
receiver
iperf Done.

# on lede router
CPU:   0% usr   6% sys   0% nic  42% idle   0% io   0% irq  51% sirq
CPU:   0% usr   6% sys   0% nic  38% idle   0% io   0% irq  53% sirq

##############
# Testergebnis durch wireguard 

# iperf3 -c 192.168.2.23 -p 4000 -t 20
Connecting to host 192.168.2.23, port 4000
[  4] local 192.168.1.23 port 38526 connected to 192.168.2.23 port 4000
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec  2.02 MBytes  17.0 Mbits/sec   70   8.03
KBytes       
[  4]   1.00-2.00   sec  1.79 MBytes  15.0 Mbits/sec   95   6.69
KBytes       
[  4]   2.00-3.00   sec  1.75 MBytes  14.7 Mbits/sec   82   6.69
KBytes       
[  4]   3.00-4.00   sec  1.82 MBytes  15.3 Mbits/sec   95   4.02
KBytes       
[  4]   4.00-5.00   sec  1.89 MBytes  15.9 Mbits/sec   84   8.03
KBytes       
[  4]   5.00-6.00   sec  1.86 MBytes  15.6 Mbits/sec   85   8.03
KBytes       
[  4]   6.00-7.00   sec  1.84 MBytes  15.4 Mbits/sec   86   6.69
KBytes       
[  4]   7.00-8.00   sec  1.82 MBytes  15.2 Mbits/sec   89   6.69
KBytes       
[  4]   8.00-9.00   sec  1.87 MBytes  15.7 Mbits/sec   86   6.69
KBytes       
[  4]   9.00-10.00  sec  1.94 MBytes  16.3 Mbits/sec   90   8.03
KBytes       
[  4]  10.00-11.00  sec  1.85 MBytes  15.5 Mbits/sec   79   8.03
KBytes       
[  4]  11.00-12.00  sec  1.84 MBytes  15.4 Mbits/sec   82   8.03
KBytes       
[  4]  12.00-13.00  sec  1.85 MBytes  15.5 Mbits/sec   84   6.69
KBytes       
[  4]  13.00-14.00  sec  1.87 MBytes  15.7 Mbits/sec   71   8.03
KBytes       
[  4]  14.00-15.00  sec  1.84 MBytes  15.5 Mbits/sec   75   6.69
KBytes       
[  4]  15.00-16.00  sec  1.78 MBytes  14.9 Mbits/sec   80   5.36
KBytes       
[  4]  16.00-17.00  sec  1.77 MBytes  14.9 Mbits/sec   89   8.03
KBytes       
[  4]  17.00-18.00  sec  1.85 MBytes  15.5 Mbits/sec   83   6.69
KBytes       
[  4]  18.00-19.00  sec  1.85 MBytes  15.5 Mbits/sec   86   5.36
KBytes       
[  4]  19.00-20.00  sec  1.80 MBytes  15.1 Mbits/sec   87   5.36
KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-20.00  sec  36.9 MBytes  15.5 Mbits/sec  1678            
sender
[  4]   0.00-20.00  sec  36.8 MBytes  15.5 Mbits/sec                 
receiver



[  5] local 192.168.2.23 port 4000 connected to 192.168.1.23 port 40859
[ ID] Interval           Transfer     Bandwidth       Jitter   
Lost/Total Datagrams
[  5]   0.00-1.00   sec  2.95 MBytes  24.7 Mbits/sec  1.482 ms  749/1126
(67%)  
[  5]   1.00-2.00   sec  2.23 MBytes  18.7 Mbits/sec  2.896 ms  682/967
(71%)  
[  5]   2.00-3.00   sec  0.00 Bytes  0.00 bits/sec  2.896 ms  0/0 (-nan%)  
[  5]   3.00-4.00   sec   256 KBytes  2.10 Mbits/sec  22.290 ms  100/132
(76%)  
[  5]   4.00-5.00   sec  3.70 MBytes  31.1 Mbits/sec  3.353 ms 
4220/4694 (90%)  
[  5]   5.00-6.00   sec  3.85 MBytes  32.3 Mbits/sec  1.387 ms  929/1422
(65%)  
[  5]   6.00-7.00   sec  4.63 MBytes  38.9 Mbits/sec  1.969 ms  860/1453
(59%)  
[  5]   7.00-8.00   sec  4.66 MBytes  39.1 Mbits/sec  2.556 ms  882/1479
(60%)  
[  5]   8.00-9.00   sec  4.66 MBytes  39.1 Mbits/sec  1.423 ms  838/1434
(58%)  
[  5]   9.00-10.00  sec  4.56 MBytes  38.3 Mbits/sec  1.557 ms  872/1456
(60%)  
[  5]  10.00-10.18  sec   904 KBytes  40.9 Mbits/sec  1.431 ms  172/285
(60%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter   
Lost/Total Datagrams
[  5]   0.00-10.18  sec  0.00 Bytes  0.00 bits/sec  1.431 ms 
10304/14448 (71%)  


Accepted connection from 192.168.1.23, port 38608
[  5] local 192.168.2.23 port 4000 connected to 192.168.1.23 port 43867
[ ID] Interval           Transfer     Bandwidth       Jitter   
Lost/Total Datagrams
[  5]   0.00-1.00   sec  2.62 MBytes  22.0 Mbits/sec  3.046 ms  792/1128
(70%)  
[  5]   1.00-2.00   sec  3.68 MBytes  30.9 Mbits/sec  2.537 ms 
1008/1479 (68%)  
[  5]   2.00-3.00   sec  2.19 MBytes  18.3 Mbits/sec  3.395 ms  698/978
(71%)  
[  5]   3.00-4.00   sec  0.00 Bytes  0.00 bits/sec  3.395 ms  0/0 (-nan%)  
[  5]   4.00-5.00   sec  0.00 Bytes  0.00 bits/sec  3.395 ms  0/0 (-nan%)  
[  5]   5.00-6.00   sec  2.89 MBytes  24.3 Mbits/sec  2.331 ms 
4314/4684 (92%)  
[  5]   6.00-7.00   sec  1.27 MBytes  10.7 Mbits/sec  4.137 ms  556/719
(77%)  
[  5]   7.00-8.00   sec  0.00 Bytes  0.00 bits/sec  4.137 ms  0/0 (-nan%)  
[  5]   8.00-9.00   sec   128 KBytes  1.05 Mbits/sec  5.360 ms 
3788/3804 (1e+02%)  
[  5]   9.00-10.00  sec   944 KBytes  7.73 Mbits/sec  3.892 ms  323/441
(73%)  
[  5]  10.00-11.00  sec  0.00 Bytes  0.00 bits/sec  3.892 ms  0/0 (-nan%)  
[  5]  11.00-12.00  sec  0.00 Bytes  0.00 bits/sec  3.892 ms  0/0 (-nan%)  
[  5]  12.00-13.00  sec  1.18 MBytes  9.91 Mbits/sec  4.089 ms 
5256/5407 (97%)  
[  5]  13.00-14.00  sec  1.45 MBytes  12.2 Mbits/sec  1.968 ms  357/543
(66%)  
[  5]  14.00-15.00  sec  0.00 Bytes  0.00 bits/sec  1.968 ms  0/0 (-nan%)  
[  5]  15.00-16.00  sec  1.66 MBytes  14.0 Mbits/sec  3.791 ms 
3088/3301 (94%)  
[  5]  16.00-17.00  sec  0.00 Bytes  0.00 bits/sec  3.791 ms  0/0 (-nan%)  
[  5]  17.00-18.00  sec   224 KBytes  1.84 Mbits/sec  22.987 ms 
2942/2970 (99%)  
[  5]  18.00-19.00  sec   224 KBytes  1.83 Mbits/sec  28.886 ms  906/934
(97%)  
[  5]  19.00-20.00  sec   248 KBytes  2.03 Mbits/sec  23.137 ms 
1432/1463 (98%)  
[  5]  20.00-20.06  sec  0.00 Bytes  0.00 bits/sec  23.137 ms  0/0 (-nan%)  
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter   
Lost/Total Datagrams
[  5]   0.00-20.06  sec  0.00 Bytes  0.00 bits/sec  23.137 ms 
25460/27851 (91%)  


###### router fuzzle BUG - DMESG
[ 4316.816332] netifd invoked oom-killer: gfp_mask=0x24201ca, order=0,
oom_score_adj=0
[ 4316.824906] CPU: 0 PID: 1198 Comm: netifd Not tainted 4.4.15 #2
[ 4316.831604] Stack : 803dc764 00000000 00000001 80430000 80c7db80
80426f63 803bde3c 000004ae
[ 4316.831604]           80493798 8086fd1c 00000000 00000005 00001b2f
800a68c8 00000006 80493bd8
[ 4316.831604]           00000000 00000000 803c18ac 8086fbbc 80496542
800a4894 c0000000 00000000
[ 4316.831604]           00000001 801f1100 00000000 00000000 00000000
00000000 00000000 00000000
[ 4316.831604]           00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4316.831604]           ...
[ 4316.870920] Call Trace:
[ 4316.873478] [<80071ac8>] show_stack+0x50/0x84
[ 4316.877981] [<800d2e84>] dump_header.isra.4+0x48/0x130
[ 4316.883879] [<800d3258>] oom_kill_process+0x98/0x440
[ 4316.889016] [<800d3978>] out_of_memory+0x2f4/0x330
[ 4316.894582] [<800d7234>] __alloc_pages_nodemask+0x67c/0x6e8
[ 4316.900975] [<800d2278>] filemap_fault+0x254/0x454
[ 4316.905956] [<800ecba4>] __do_fault+0x3c/0xa8
[ 4316.911081] [<800efdd0>] handle_mm_fault+0x4e0/0xb78
[ 4316.916239] [<800766e0>] __do_page_fault+0x134/0x474
[ 4316.921972] [<80060820>] ret_from_exception+0x0/0x10
[ 4316.927097] 
[ 4316.928638] Mem-Info:
[ 4316.931586] active_anon:232 inactive_anon:6 isolated_anon:0
[ 4316.931586]  active_file:76 inactive_file:94 isolated_file:0
[ 4316.931586]  unevictable:0 dirty:0 writeback:0 unstable:0
[ 4316.931586]  slab_reclaimable:130 slab_unreclaimable:1325
[ 4316.931586]  mapped:2 shmem:18 pagetables:41 bounce:0
[ 4316.931586]  free:165 free_pcp:0 free_cma:0
[ 4316.965566] Normal free:656kB min:660kB low:824kB high:988kB
active_anon:928kB inactive_anon:24kB active_file:304kB
inactive_file:376kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:32768kB managed:27836kB mlocked:0kB dirty:0kB
writeback:0kB mapped:8kB shmem:72kB slab_reclaimable:520kB
slab_unreclaimable:5300kB kernel_stack:296kB pagetables:164kB
unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4317.010087] lowmem_reserve[]: 0 0
[ 4317.013547] Normal: 4*4kB (UE) 46*8kB (UME) 17*16kB (U) 0*32kB 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 656kB
[ 4317.026214] 188 total pagecache pages
[ 4317.030587] 0 pages in swap cache
[ 4317.034020] Swap cache stats: add 0, delete 0, find 0/0
[ 4317.039410] Free swap  = 0kB
[ 4317.042976] Total swap = 0kB
[ 4317.045952] 8192 pages RAM
[ 4317.048747] 0 pages HighMem/MovableOnly
[ 4317.053301] 1233 pages reserved
[ 4317.056553] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds
swapents oom_score_adj name
[ 4317.065964] [  447]     0   447      294       15       3      
0        0             0 ubusd
[ 4317.075470] [  448]     0   448      223       10       4      
0        0             0 askfirst
[ 4317.085221] [  628]     0   628      306       35       5      
0        0             0 logd
[ 4317.094627] [  690]     0   690      337       23       3      
0        0             0 odhcpd
[ 4317.104209] [  723]     0   723      264       10       3      
0        0             0 dropbear
[ 4317.113960] [  821]     0   821      294       10       3      
0        0             0 ntpd
[ 4317.123373] [ 1198]     0  1198      408       34       4      
0        0             0 netifd
[ 4317.132944] [ 1305]   453  1305      262       18       3      
0        0             0 dnsmasq
[ 4317.142632] [ 1487]     0  1487      281       25       3      
0        0             0 dropbear
[ 4317.152400] [ 1488]     0  1488      295       10       3      
0        0             0 ash
[ 4317.161714] [ 1570]     0  1570      229       11       3      
0        0             0 odhcp6c
[ 4317.171385] Out of memory: Kill process 628 (logd) score 5 or
sacrifice child
[ 4317.178772] Killed process 628 (logd) total-vm:1224kB,
anon-rss:136kB, file-rss:4kB
[ 4318.256759] netifd invoked oom-killer: gfp_mask=0x24201ca, order=0,
oom_score_adj=0
[ 4318.280049] CPU: 0 PID: 1198 Comm: netifd Not tainted 4.4.15 #2
[ 4318.286179] Stack : 803dc764 00000000 00000001 80430000 80c7db80
80426f63 803bde3c 000004ae
[ 4318.286179]           80493798 8086fd1c 00000000 00000005 00001b2f
800a68c8 00000006 803c6710
[ 4318.286179]           00000000 00000000 803c18ac 8086fbbc 80496542
800a4894 804265d0 00000000
[ 4318.286179]           00000001 801f1100 00000000 00000000 00000000
00000000 00000000 00000000
[ 4318.286179]           00000000 00000000 00000000
[ 4318.470646] netifd: page allocation failure: order:0, mode:0x2080120
[ 4318.470661] CPU: 0 PID: 1198 Comm: netifd Not tainted 4.4.15 #2
[ 4318.470665] Stack : 803dc764 00000000 00000001 80430000 80c7db80
80426f63 803bde3c 000004ae
[ 4318.470685]           80493798 81823c20 00000060 00000000 80000000
800a68c8 00000006 00000000
[ 4318.470705]           00000000 00000000 803c18ac 8086f67c 80496542
800a4894 80f2d000 00000000
[ 4318.470725]           00000001 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4318.470743]           00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4318.470760]           ...
[ 4318.470766] Call Trace:
[ 4318.470791] [<80071ac8>] show_stack+0x50/0x84
[ 4318.470813] [<800d4ce0>] warn_alloc_failed+0xe8/0x10c
[ 4318.470827] [<800d7148>] __alloc_pages_nodemask+0x590/0x6e8
[ 4318.470837] [<800d7420>] __alloc_page_frag+0x74/0x174
[ 4318.470850] [<80232250>] ag71xx_fill_rx_buf+0x60/0xf0
[ 4318.470860] [<80233178>] ag71xx_poll+0x3d4/0x5bc
[ 4318.470900] [<802684b8>] net_rx_action+0x110/0x2c4
[ 4318.470921] [<80083b28>] __do_softirq+0x164/0x290
[ 4318.470958] [<8006a698>] plat_irq_dispatch+0xbc/0xf4
[ 4318.470963] 
[ 4318.470965] Mem-Info:
[ 4318.470991] active_anon:198 inactive_anon:6 isolated_anon:0
[ 4318.470991]  active_file:126 inactive_file:204 isolated_file:0
[ 4318.470991]  unevictable:0 dirty:0 writeback:0 unstable:0
[ 4318.470991]  slab_reclaimable:130 slab_unreclaimable:1345
[ 4318.470991]  mapped:2 shmem:18 pagetables:36 bounce:0
[ 4318.470991]  free:63 free_pcp:0 free_cma:0
[ 4318.471032] Normal free:252kB min:660kB low:824kB high:988kB
active_anon:792kB inactive_anon:24kB active_file:504kB
inactive_file:816kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:32768kB managed:27836kB mlocked:0kB dirty:0kB
writeback:0kB mapped:8kB shmem:72kB slab_reclaimable:520kB
slab_unreclaimable:5380kB kernel_stack:296kB pagetables:144kB
unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4318.471034] lowmem_reserve[]: 0 0
[ 4318.471041] Normal: 3*4kB (ME) 26*8kB (UME) 2*16kB (U) 0*32kB 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 252kB
[ 4318.471083] 348 total pagecache pages
[ 4318.471094] 0 pages in swap cache
[ 4318.471100] Swap cache stats: add 0, delete 0, find 0/0
[ 4318.471102] Free swap  = 0kB
[ 4318.471105] Total swap = 0kB
[ 4318.471108] 8192 pages RAM
[ 4318.471111] 0 pages HighMem/MovableOnly
[ 4318.471113] 1233 pages reserved
[ 4318.486975] eth0: out of memory
[ 4318.628211] netifd: page allocation failure: order:0, mode:0x2080120
[ 4318.628224] CPU: 0 PID: 1198 Comm: netifd Not tainted 4.4.15 #2
[ 4318.628229] Stack : 803dc764 00000000 00000001 80430000 80c7db80
80426f63 803bde3c 000004ae
[ 4318.628250]           80493798 81823c20 00000060 00000000 80000000
800a68c8 00000006 00000000
[ 4318.628269]           00000000 00000000 803c18ac 8086f67c 80496542
800a4894 80f2d000 00000000
[ 4318.628290]           00000001 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4318.628308]           00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4318.628325]           ...
[ 4318.628331] Call Trace:
[ 4318.628357] [<80071ac8>] show_stack+0x50/0x84
[ 4318.628378] [<800d4ce0>] warn_alloc_failed+0xe8/0x10c
[ 4318.628392] [<800d7148>] __alloc_pages_nodemask+0x590/0x6e8
[ 4318.628402] [<800d7420>] __alloc_page_frag+0x74/0x174
[ 4318.628414] [<80232250>] ag71xx_fill_rx_buf+0x60/0xf0
[ 4318.628424] [<80233178>] ag71xx_poll+0x3d4/0x5bc
[ 4318.628461] [<802684b8>] net_rx_action+0x110/0x2c4
[ 4318.628484] [<80083b28>] __do_softirq+0x164/0x290
[ 4318.628521] [<8006a698>] plat_irq_dispatch+0xbc/0xf4
[ 4318.628525] 
[ 4318.628527] Mem-Info:
[ 4318.628552] active_anon:198 inactive_anon:6 isolated_anon:0
[ 4318.628552]  active_file:126 inactive_file:204 isolated_file:0
[ 4318.628552]  unevictable:0 dirty:0 writeback:0 unstable:0
[ 4318.628552]  slab_reclaimable:130 slab_unreclaimable:1345
[ 4318.628552]  mapped:2 shmem:18 pagetables:36 bounce:0
[ 4318.628552]  free:63 free_pcp:0 free_cma:0
[ 4318.628593] Normal free:252kB min:660kB low:824kB high:988kB
active_anon:792kB inactive_anon:24kB active_file:504kB
inactive_file:816kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:32768kB managed:27836kB mlocked:0kB dirty:0kB
writeback:0kB mapped:8kB shmem:72kB slab_reclaimable:520kB
slab_unreclaimable:5380kB kernel_stack:296kB pagetables:144kB
unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4318.628595] lowmem_reserve[]: 0 0
[ 4318.628603] Normal: 3*4kB (ME) 26*8kB (UME) 2*16kB (U) 0*32kB 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 252kB
[ 4318.628645] 348 total pagecache pages
[ 4318.628653] 0 pages in swap cache
[ 4318.628659] Swap cache stats: add 0, delete 0, find 0/0
[ 4318.628662] Free swap  = 0kB
[ 4318.628664] Total swap = 0kB
[ 4318.628667] 8192 pages RAM
[ 4318.628670] 0 pages HighMem/MovableOnly
[ 4318.628672] 1233 pages reserved
[ 4318.638804] eth0: out of memory
[ 4318.750599] netifd: page allocation failure: order:0, mode:0x2080120
[ 4318.750612] CPU: 0 PID: 1198 Comm: netifd Not tainted 4.4.15 #2
[ 4318.750618] Stack : 803dc764 00000000 00000001 80430000 80c7db80
80426f63 803bde3c 000004ae
[ 4318.750639]           80493798 81823c20 00000060 00000000 80000000
800a68c8 00000006 00000000
[ 4318.750658]           00000000 00000000 803c18ac 8086f67c 80496542
800a4894 80f2d000 00000000
[ 4318.750678]           00000001 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4318.750696]           00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4318.750714]           ...
[ 4318.750720] Call Trace:
[ 4318.750746] [<80071ac8>] show_stack+0x50/0x84
[ 4318.750767] [<800d4ce0>] warn_alloc_failed+0xe8/0x10c
[ 4318.750781] [<800d7148>] __alloc_pages_nodemask+0x590/0x6e8
[ 4318.750791] [<800d7420>] __alloc_page_frag+0x74/0x174
[ 4318.750803] [<80232250>] ag71xx_fill_rx_buf+0x60/0xf0
[ 4318.750813] [<80233178>] ag71xx_poll+0x3d4/0x5bc
[ 4318.750851] [<802684b8>] net_rx_action+0x110/0x2c4
[ 4318.750875] [<80083b28>] __do_softirq+0x164/0x290
[ 4318.750909] [<8006a698>] plat_irq_dispatch+0xbc/0xf4
[ 4318.750913] 
[ 4318.750916] Mem-Info:
[ 4318.750941] active_anon:198 inactive_anon:6 isolated_anon:0
[ 4318.750941]  active_file:126 inactive_file:204 isolated_file:0
[ 4318.750941]  unevictable:0 dirty:0 writeback:0 unstable:0
[ 4318.750941]  slab_reclaimable:130 slab_unreclaimable:1344
[ 4318.750941]  mapped:2 shmem:18 pagetables:36 bounce:0
[ 4318.750941]  free:63 free_pcp:0 free_cma:0
[ 4318.750982] Normal free:252kB min:660kB low:824kB high:988kB
active_anon:792kB inactive_anon:24kB active_file:504kB
inactive_file:816kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:32768kB managed:27836kB mlocked:0kB dirty:0kB
writeback:0kB mapped:8kB shmem:72kB slab_reclaimable:520kB
slab_unreclaimable:5376kB kernel_stack:296kB pagetables:144kB
unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4318.750984] lowmem_reserve[]: 0 0
[ 4318.750992] Normal: 3*4kB (ME) 26*8kB (UME) 2*16kB (U) 0*32kB 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 252kB
[ 4318.751034] 348 total pagecache pages
[ 4318.751044] 0 pages in swap cache
[ 4318.751050] Swap cache stats: add 0, delete 0, find 0/0
[ 4318.751053] Free swap  = 0kB
[ 4318.751055] Total swap = 0kB
[ 4318.751058] 8192 pages RAM
[ 4318.751061] 0 pages HighMem/MovableOnly
[ 4318.751063] 1233 pages reserved
[ 4318.766484] eth0: out of memory
[ 4318.931172] netifd: page allocation failure: order:0, mode:0x2080120
[ 4318.931184] CPU: 0 PID: 1198 Comm: netifd Not tainted 4.4.15 #2
[ 4318.931189] Stack : 803dc764 00000000 00000001 80430000 80c7db80
80426f63 803bde3c 000004ae
[ 4318.931211]           80493798 81823c20 00000060 00000000 80000000
800a68c8 00000006 00000000
[ 4318.931231]           00000000 00000000 803c18ac 8086f67c 80496542
800a4894 80f2d000 00000000
[ 4318.931250]           00000001 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4318.931268]           00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4318.931286]           ...
[ 4318.931292] Call Trace:
[ 4318.931317] [<80071ac8>] show_stack+0x50/0x84
[ 4318.931338] [<800d4ce0>] warn_alloc_failed+0xe8/0x10c
[ 4318.931352] [<800d7148>] __alloc_pages_nodemask+0x590/0x6e8
[ 4318.931362] [<800d7420>] __alloc_page_frag+0x74/0x174
[ 4318.931373] [<80232250>] ag71xx_fill_rx_buf+0x60/0xf0
[ 4318.931383] [<80233178>] ag71xx_poll+0x3d4/0x5bc
[ 4318.931421] [<802684b8>] net_rx_action+0x110/0x2c4
[ 4318.931445] [<80083b28>] __do_softirq+0x164/0x290
[ 4318.931480] [<8006a698>] plat_irq_dispatch+0xbc/0xf4
[ 4318.931484] 
[ 4318.931486] Mem-Info:
[ 4318.931511] active_anon:198 inactive_anon:6 isolated_anon:0
[ 4318.931511]  active_file:126 inactive_file:204 isolated_file:0
[ 4318.931511]  unevictable:0 dirty:0 writeback:0 unstable:0
[ 4318.931511]  slab_reclaimable:130 slab_unreclaimable:1345
[ 4318.931511]  mapped:2 shmem:18 pagetables:36 bounce:0
[ 4318.931511]  free:63 free_pcp:0 free_cma:0
[ 4318.931553] Normal free:252kB min:660kB low:824kB high:988kB
active_anon:792kB inactive_anon:24kB active_file:504kB
inactive_file:816kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:32768kB managed:27836kB mlocked:0kB dirty:0kB
writeback:0kB mapped:8kB shmem:72kB slab_reclaimable:520kB
slab_unreclaimable:5380kB kernel_stack:296kB pagetables:144kB
unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4318.931555] lowmem_reserve[]: 0 0
[ 4318.931562] Normal: 3*4kB (ME) 26*8kB (UME) 2*16kB (U) 0*32kB 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 252kB
[ 4318.931603] 348 total pagecache pages
[ 4318.931613] 0 pages in swap cache
[ 4318.931618] Swap cache stats: add 0, delete 0, find 0/0
[ 4318.931621] Free swap  = 0kB
[ 4318.931624] Total swap = 0kB
[ 4318.931626] 8192 pages RAM
[ 4318.931629] 0 pages HighMem/MovableOnly
[ 4318.931631] 1233 pages reserved
[ 4318.945413] eth0: out of memory
[ 4319.062308] netifd: page allocation failure: order:0, mode:0x2080120
[ 4319.062322] CPU: 0 PID: 1198 Comm: netifd Not tainted 4.4.15 #2
[ 4319.062327] Stack : 803dc764 00000000 00000001 80430000 80c7db80
80426f63 803bde3c 000004ae
[ 4319.062348]           80493798 81823c20 00000060 00000000 80000000
800a68c8 00000006 8091a000
[ 4319.062368]           00000000 00000000 803c18ac 8086f67c 80496542
800a4894 00000000 00000000
[ 4319.062388]           00000001 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4319.062405]           00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4319.062423]           ...
[ 4319.062429] Call Trace:
[ 4319.062454] [<80071ac8>] show_stack+0x50/0x84
[ 4319.062476] [<800d4ce0>] warn_alloc_failed+0xe8/0x10c
[ 4319.062489] [<800d7148>] __alloc_pages_nodemask+0x590/0x6e8
[ 4319.062499] [<800d7420>] __alloc_page_frag+0x74/0x174
[ 4319.062511] [<80232250>] ag71xx_fill_rx_buf+0x60/0xf0
[ 4319.062521] [<80233178>] ag71xx_poll+0x3d4/0x5bc
[ 4319.062559] [<802684b8>] net_rx_action+0x110/0x2c4
[ 4319.062584] [<80083b28>] __do_softirq+0x164/0x290
[ 4319.062621] [<8006a698>] plat_irq_dispatch+0xbc/0xf4
[ 4319.062624] 
[ 4319.062627] Mem-Info:
[ 4319.062653] active_anon:198 inactive_anon:6 isolated_anon:0
[ 4319.062653]  active_file:126 inactive_file:204 isolated_file:0
[ 4319.062653]  unevictable:0 dirty:0 writeback:0 unstable:0
[ 4319.062653]  slab_reclaimable:130 slab_unreclaimable:1345
[ 4319.062653]  mapped:2 shmem:18 pagetables:36 bounce:0
[ 4319.062653]  free:63 free_pcp:0 free_cma:0
[ 4319.062694] Normal free:252kB min:660kB low:824kB high:988kB
active_anon:792kB inactive_anon:24kB active_file:504kB
inactive_file:816kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:32768kB managed:27836kB mlocked:0kB dirty:0kB
writeback:0kB mapped:8kB shmem:72kB slab_reclaimable:520kB
slab_unreclaimable:5380kB kernel_stack:296kB pagetables:144kB
unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4319.062696] lowmem_reserve[]: 0 0
[ 4319.062703] Normal: 3*4kB (ME) 26*8kB (UME) 2*16kB (U) 0*32kB 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 252kB
[ 4319.062745] 348 total pagecache pages
[ 4319.062755] 0 pages in swap cache
[ 4319.062761] Swap cache stats: add 0, delete 0, find 0/0
[ 4319.062764] Free swap  = 0kB
[ 4319.062766] Total swap = 0kB
[ 4319.062769] 8192 pages RAM
[ 4319.062772] 0 pages HighMem/MovableOnly
[ 4319.062774] 1233 pages reserved
[ 4319.077033] eth0: out of memory
[ 4319.210833] netifd: page allocation failure: order:0, mode:0x2080120
[ 4319.210850] CPU: 0 PID: 1198 Comm: netifd Not tainted 4.4.15 #2
[ 4319.210855] Stack : 803dc764 00000000 00000001 80430000 80c7db80
80426f63 803bde3c 000004ae
[ 4319.210875]           80493798 81823c20 00000060 00000000 80000000
800a68c8 00000006 00000000
[ 4319.210895]           00000000 00000000 803c18ac 8086f67c 80496542
800a4894 80f2d000 00000000
[ 4319.210915]           00000001 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4319.210933]           00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4319.210951]           ...
[ 4319.210957] Call Trace:
[ 4319.210984] [<80071ac8>] show_stack+0x50/0x84
[ 4319.211006] [<800d4ce0>] warn_alloc_failed+0xe8/0x10c
[ 4319.211019] [<800d7148>] __alloc_pages_nodemask+0x590/0x6e8
[ 4319.211030] [<800d7420>] __alloc_page_frag+0x74/0x174
[ 4319.211042] [<80232250>] ag71xx_fill_rx_buf+0x60/0xf0
[ 4319.211051] [<80233178>] ag71xx_poll+0x3d4/0x5bc
[ 4319.211088] [<802684b8>] net_rx_action+0x110/0x2c4
[ 4319.211110] [<80083b28>] __do_softirq+0x164/0x290
[ 4319.211147] [<8006a698>] plat_irq_dispatch+0xbc/0xf4
[ 4319.211151] 
[ 4319.211153] Mem-Info:
[ 4319.211179] active_anon:198 inactive_anon:6 isolated_anon:0
[ 4319.211179]  active_file:126 inactive_file:204 isolated_file:0
[ 4319.211179]  unevictable:0 dirty:0 writeback:0 unstable:0
[ 4319.211179]  slab_reclaimable:130 slab_unreclaimable:1344
[ 4319.211179]  mapped:2 shmem:18 pagetables:36 bounce:0
[ 4319.211179]  free:63 free_pcp:0 free_cma:0
[ 4319.211220] Normal free:252kB min:660kB low:824kB high:988kB
active_anon:792kB inactive_anon:24kB active_file:504kB
inactive_file:816kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:32768kB managed:27836kB mlocked:0kB dirty:0kB
writeback:0kB mapped:8kB shmem:72kB slab_reclaimable:520kB
slab_unreclaimable:5376kB kernel_stack:296kB pagetables:144kB
unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4319.211222] lowmem_reserve[]: 0 0
[ 4319.211230] Normal: 3*4kB (ME) 26*8kB (UME) 2*16kB (U) 0*32kB 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 252kB
[ 4319.211272] 348 total pagecache pages
[ 4319.211284] 0 pages in swap cache
[ 4319.211289] Swap cache stats: add 0, delete 0, find 0/0
[ 4319.211292] Free swap  = 0kB
[ 4319.211295] Total swap = 0kB
[ 4319.211297] 8192 pages RAM
[ 4319.211300] 0 pages HighMem/MovableOnly
[ 4319.211303] 1233 pages reserved
[ 4319.224661] eth0: out of memory
[ 4319.342076] netifd: page allocation failure: order:0, mode:0x2080120
[ 4319.342090] CPU: 0 PID: 1198 Comm: netifd Not tainted 4.4.15 #2
[ 4319.342095] Stack : 803dc764 00000000 00000001 80430000 80c7db80
80426f63 803bde3c 000004ae
[ 4319.342117]           80493798 81823c20 00000060 00000000 80000000
800a68c8 00000006 8026a3ac
[ 4319.342136]           00000000 00000000 803c18ac 8086f67c 80496542
800a4894 80f2d000 00000000
[ 4319.342156]           00000001 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4319.342174]           00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4319.342193]           ...
[ 4319.342199] Call Trace:
[ 4319.342222] [<80071ac8>] show_stack+0x50/0x84
[ 4319.342242] [<800d4ce0>] warn_alloc_failed+0xe8/0x10c
[ 4319.342256] [<800d7148>] __alloc_pages_nodemask+0x590/0x6e8
[ 4319.342266] [<800d7420>] __alloc_page_frag+0x74/0x174
[ 4319.342278] [<80232250>] ag71xx_fill_rx_buf+0x60/0xf0
[ 4319.342288] [<80233178>] ag71xx_poll+0x3d4/0x5bc
[ 4319.342325] [<802684b8>] net_rx_action+0x110/0x2c4
[ 4319.342349] [<80083b28>] __do_softirq+0x164/0x290
[ 4319.342383] [<8006a698>] plat_irq_dispatch+0xbc/0xf4
[ 4319.342387] 
[ 4319.342390] Mem-Info:
[ 4319.342415] active_anon:198 inactive_anon:6 isolated_anon:0
[ 4319.342415]  active_file:126 inactive_file:204 isolated_file:0
[ 4319.342415]  unevictable:0 dirty:0 writeback:0 unstable:0
[ 4319.342415]  slab_reclaimable:130 slab_unreclaimable:1345
[ 4319.342415]  mapped:2 shmem:18 pagetables:36 bounce:0
[ 4319.342415]  free:63 free_pcp:0 free_cma:0
[ 4319.342457] Normal free:252kB min:660kB low:824kB high:988kB
active_anon:792kB inactive_anon:24kB active_file:504kB
inactive_file:816kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:32768kB managed:27836kB mlocked:0kB dirty:0kB
writeback:0kB mapped:8kB shmem:72kB slab_reclaimable:520kB
slab_unreclaimable:5380kB kernel_stack:296kB pagetables:144kB
unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4319.342460] lowmem_reserve[]: 0 0
[ 4319.342467] Normal: 3*4kB (ME) 26*8kB (UME) 2*16kB (U) 0*32kB 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 252kB
[ 4319.342509] 348 total pagecache pages
[ 4319.342520] 0 pages in swap cache
[ 4319.342525] Swap cache stats: add 0, delete 0, find 0/0
[ 4319.342528] Free swap  = 0kB
[ 4319.342530] Total swap = 0kB
[ 4319.342533] 8192 pages RAM
[ 4319.342536] 0 pages HighMem/MovableOnly
[ 4319.342538] 1233 pages reserved
[ 4319.357925] eth0: out of memory
[ 4319.470335] netifd: page allocation failure: order:0, mode:0x2080120
[ 4319.470348] CPU: 0 PID: 1198 Comm: netifd Not tainted 4.4.15 #2
[ 4319.470353] Stack : 803dc764 00000000 00000001 80430000 80c7db80
80426f63 803bde3c 000004ae
[ 4319.470375]           80493798 81823c20 00000060 00000000 80000000
800a68c8 00000006 00000000
[ 4319.470395]           00000000 00000000 803c18ac 8086f67c 80496542
800a4894 80f2d000 00000000
[ 4319.470414]           00000001 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4319.470432]           00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4319.470450]           ...
[ 4319.470456] Call Trace:
[ 4319.470482] [<80071ac8>] show_stack+0x50/0x84
[ 4319.470504] [<800d4ce0>] warn_alloc_failed+0xe8/0x10c
[ 4319.470518] [<800d7148>] __alloc_pages_nodemask+0x590/0x6e8
[ 4319.470528] [<800d7420>] __alloc_page_frag+0x74/0x174
[ 4319.470539] [<80232250>] ag71xx_fill_rx_buf+0x60/0xf0
[ 4319.470549] [<80233178>] ag71xx_poll+0x3d4/0x5bc
[ 4319.470587] [<802684b8>] net_rx_action+0x110/0x2c4
[ 4319.470611] [<80083b28>] __do_softirq+0x164/0x290
[ 4319.470649] [<8006a698>] plat_irq_dispatch+0xbc/0xf4
[ 4319.470653] 
[ 4319.470655] Mem-Info:
[ 4319.470681] active_anon:198 inactive_anon:6 isolated_anon:0
[ 4319.470681]  active_file:126 inactive_file:204 isolated_file:0
[ 4319.470681]  unevictable:0 dirty:0 writeback:0 unstable:0
[ 4319.470681]  slab_reclaimable:130 slab_unreclaimable:1345
[ 4319.470681]  mapped:2 shmem:18 pagetables:36 bounce:0
[ 4319.470681]  free:63 free_pcp:0 free_cma:0
[ 4319.470722] Normal free:252kB min:660kB low:824kB high:988kB
active_anon:792kB inactive_anon:24kB active_file:504kB
inactive_file:816kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:32768kB managed:27836kB mlocked:0kB dirty:0kB
writeback:0kB mapped:8kB shmem:72kB slab_reclaimable:520kB
slab_unreclaimable:5380kB kernel_stack:296kB pagetables:144kB
unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4319.470724] lowmem_reserve[]: 0 0
[ 4319.470731] Normal: 3*4kB (ME) 26*8kB (UME) 2*16kB (U) 0*32kB 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 252kB
[ 4319.470773] 348 total pagecache pages
[ 4319.470783] 0 pages in swap cache
[ 4319.470788] Swap cache stats: add 0, delete 0, find 0/0
[ 4319.470791] Free swap  = 0kB
[ 4319.470794] Total swap = 0kB
[ 4319.470797] 8192 pages RAM
[ 4319.470799] 0 pages HighMem/MovableOnly
[ 4319.470802] 1233 pages reserved
[ 4319.486164] eth0: out of memory
[ 4319.601313] netifd: page allocation failure: order:0, mode:0x2080120
[ 4319.601325] CPU: 0 PID: 1198 Comm: netifd Not tainted 4.4.15 #2
[ 4319.601330] Stack : 803dc764 00000000 00000001 80430000 80c7db80
80426f63 803bde3c 000004ae
[ 4319.601351]           80493798 81823c20 00000060 00000000 80000000
800a68c8 00000006 00000000
[ 4319.601371]           00000000 00000000 803c18ac 8086f67c 80496542
800a4894 80f2d000 00000000
[ 4319.601391]           00000001 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4319.601409]           00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4319.601426]           ...
[ 4319.601432] Call Trace:
[ 4319.601457] [<80071ac8>] show_stack+0x50/0x84
[ 4319.601477] [<800d4ce0>] warn_alloc_failed+0xe8/0x10c
[ 4319.601491] [<800d7148>] __alloc_pages_nodemask+0x590/0x6e8
[ 4319.601501] [<800d7420>] __alloc_page_frag+0x74/0x174
[ 4319.601512] [<80232250>] ag71xx_fill_rx_buf+0x60/0xf0
[ 4319.601522] [<80233178>] ag71xx_poll+0x3d4/0x5bc
[ 4319.601560] [<802684b8>] net_rx_action+0x110/0x2c4
[ 4319.601584] [<80083b28>] __do_softirq+0x164/0x290
[ 4319.601621] [<8006a698>] plat_irq_dispatch+0xbc/0xf4
[ 4319.601624] 
[ 4319.601626] Mem-Info:
[ 4319.601652] active_anon:198 inactive_anon:6 isolated_anon:0
[ 4319.601652]  active_file:126 inactive_file:204 isolated_file:0
[ 4319.601652]  unevictable:0 dirty:0 writeback:0 unstable:0
[ 4319.601652]  slab_reclaimable:130 slab_unreclaimable:1345
[ 4319.601652]  mapped:2 shmem:18 pagetables:36 bounce:0
[ 4319.601652]  free:63 free_pcp:0 free_cma:0
[ 4319.601694] Normal free:252kB min:660kB low:824kB high:988kB
active_anon:792kB inactive_anon:24kB active_file:504kB
inactive_file:816kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:32768kB managed:27836kB mlocked:0kB dirty:0kB
writeback:0kB mapped:8kB shmem:72kB slab_reclaimable:520kB
slab_unreclaimable:5380kB kernel_stack:296kB pagetables:144kB
unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4319.601696] lowmem_reserve[]: 0 0
[ 4319.601703] Normal: 3*4kB (ME) 26*8kB (UME) 2*16kB (U) 0*32kB 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 252kB
[ 4319.601745] 348 total pagecache pages
[ 4319.601755] 0 pages in swap cache
[ 4319.601761] Swap cache stats: add 0, delete 0, find 0/0
[ 4319.601763] Free swap  = 0kB
[ 4319.601766] Total swap = 0kB
[ 4319.601769] 8192 pages RAM
[ 4319.601771] 0 pages HighMem/MovableOnly
[ 4319.601774] 1233 pages reserved
[ 4319.616039] eth0: out of memory
[ 4319.730100] netifd: page allocation failure: order:0, mode:0x2080120
[ 4319.730112] CPU: 0 PID: 1198 Comm: netifd Not tainted 4.4.15 #2
[ 4319.730117] Stack : 803dc764 00000000 00000001 80430000 80c7db80
80426f63 803bde3c 000004ae
[ 4319.730138]           80493798 81823c20 00000060 00000000 80000000
800a68c8 00000006 00000000
[ 4319.730158]           00000000 00000000 803c18ac 8086f67c 80496542
800a4894 80f2d000 00000000
[ 4319.730178]           00000001 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4319.730196]           00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 4319.730213]           ...
[ 4319.730219] Call Trace:
[ 4319.730243] [<80071ac8>] show_stack+0x50/0x84
[ 4319.730264] [<800d4ce0>] warn_alloc_failed+0xe8/0x10c
[ 4319.730277] [<800d7148>] __alloc_pages_nodemask+0x590/0x6e8
[ 4319.730287] [<800d7420>] __alloc_page_frag+0x74/0x174
[ 4319.730298] [<80232250>] ag71xx_fill_rx_buf+0x60/0xf0
[ 4319.730308] [<80233178>] ag71xx_poll+0x3d4/0x5bc
[ 4319.730345] [<802684b8>] net_rx_action+0x110/0x2c4
[ 4319.730367] [<80083b28>] __do_softirq+0x164/0x290
[ 4319.730400] [<8006a698>] plat_irq_dispatch+0xbc/0xf4
[ 4319.730404] 
[ 4319.730406] Mem-Info:
[ 4319.730432] active_anon:198 inactive_anon:6 isolated_anon:0
[ 4319.730432]  active_file:126 inactive_file:204 isolated_file:0
[ 4319.730432]  unevictable:0 dirty:0 writeback:0 unstable:0
[ 4319.730432]  slab_reclaimable:130 slab_unreclaimable:1345
[ 4319.730432]  mapped:2 shmem:18 pagetables:36 bounce:0
[ 4319.730432]  free:63 free_pcp:0 free_cma:0
[ 4319.730473] Normal free:252kB min:660kB low:824kB high:988kB
active_anon:792kB inactive_anon:24kB active_file:504kB
inactive_file:816kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:32768kB managed:27836kB mlocked:0kB dirty:0kB
writeback:0kB mapped:8kB shmem:72kB slab_reclaimable:520kB
slab_unreclaimable:5380kB kernel_stack:296kB pagetables:144kB
unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4319.730475] lowmem_reserve[]: 0 0
[ 4319.730482] Normal: 3*4kB (ME) 26*8kB (UME) 2*16kB (U) 0*32kB 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 252kB
[ 4319.730523] 348 total pagecache pages
[ 4319.730533] 0 pages in swap cache
[ 4319.730538] Swap cache stats: add 0, delete 0, find 0/0
[ 4319.730541] Free swap  = 0kB
[ 4319.730544] Total swap = 0kB
[ 4319.730547] 8192 pages RAM
[ 4319.730549] 0 pages HighMem/MovableOnly
[ 4319.730552] 1233 pages reserved
[ 4319.738720] eth0: out of memory
[ 4319.866870] eth0: out of memory
[ 4319.987229] eth0: out of memory
[ 4320.117724] eth0: out of memory
[ 4320.255572] eth0: out of memory
[ 4320.378457] eth0: out of memory
[ 4320.512492] eth0: out of memory
[ 4320.648874] eth0: out of memory
[ 4320.774328] eth0: out of memory
[ 4320.906054] eth0: out of memory
[ 4321.013589] eth0: out of memory
[ 4321.093267]  00000000 00000000 00000000 00000000 00000000
[ 4321.095619]           ...
[ 4321.099805] Call Trace:
[ 4321.102364] [<80071ac8>] show_stack+0x50/0x84
[ 4321.106868] [<800d2e84>] dump_header.isra.4+0x48/0x130
[ 4321.112186] [<800d3258>] oom_kill_process+0x98/0x440
[ 4321.117319] [<800d3978>] out_of_memory+0x2f4/0x330
[ 4321.122283] [<800d7234>] __alloc_pages_nodemask+0x67c/0x6e8
[ 4321.128071] [<800d2278>] filemap_fault+0x254/0x454
[ 4321.133065] eth0: out of memory
[ 4321.136336] [<800ecba4>] __do_fault+0x3c/0xa8
[ 4321.140854] [<800efdd0>] handle_mm_fault+0x4e0/0xb78
[ 4321.145993] [<800766e0>] __do_page_fault+0x134/0x474
[ 4321.151135] [<80060820>] ret_from_exception+0x0/0x10
[ 4321.156260] 
[ 4321.157793] Mem-Info:
[ 4321.160173] active_anon:198 inactive_anon:6 isolated_anon:0
[ 4321.160173]  active_file:126 inactive_file:204 isolated_file:0
[ 4321.160173]  unevictable:0 dirty:0 writeback:0 unstable:0
[ 4321.160173]  slab_reclaimable:130 slab_unreclaimable:1344
[ 4321.160173]  mapped:2 shmem:18 pagetables:36 bounce:0
[ 4321.160173]  free:63 free_pcp:0 free_cma:0
[ 4321.192528] Normal free:252kB min:660kB low:824kB high:988kB
active_anon:792kB inactive_anon:24kB active_file:504kB
inactive_file:816kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:32768kB managed:27836kB mlocked:0kB dirty:0kB
writeback:0kB mapped:8kB shmem:72kB slab_reclaimable:520kB
slab_unreclaimable:5376kB kernel_stack:296kB pagetables:144kB
unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 4321.236373] lowmem_reserve[]: 0 0
[ 4321.239828] Normal: 3*4kB (ME) 26*8kB (UME) 2*16kB (U) 0*32kB 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 
[ 4321.250184] eth0: out of memory
[ 4321.253424] 0*4096kB = 252kB
[ 4321.256586] 348 total pagecache pages
[ 4321.260382] 0 pages in swap cache
[ 4321.263801] Swap cache stats: add 0, delete 0, find 0/0
[ 4321.269193] Free swap  = 0kB
[ 4321.272334] eth1: out of memory
[ 4321.275592] Total swap = 0kB
[ 4321.278566] 8192 pages RAM
[ 4321.281402] 0 pages HighMem/MovableOnly
[ 4321.285356] 1233 pages reserved
[ 4321.288602] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds
swapents oom_score_adj name
[ 4321.297432] [  447]     0   447      294       15       3      
0        0             0 ubusd
[ 4321.306342] [  448]     0   448      223       10       4      
0        0             0 askfirst
[ 4321.315518] [  690]     0   690      337       23       3      
0        0             0 odhcpd
[ 4321.324513] [  723]     0   723      264       10       3      
0        0             0 dropbear
[ 4321.333689] [  821]     0   821      294       10       3      
0        0             0 ntpd
[ 4321.342504] [ 1198]     0  1198      408       34       4      
0        0             0 netifd
[ 4321.351500] [ 1305]   453  1305      262       18       3      
0        0             0 dnsmasq
[ 4321.360586] [ 1487]     0  1487      281       25       3      
0        0             0 dropbear
[ 4321.369751] [ 1488]     0  1488      295       10       3      
0        0             0 ash
[ 4321.378477] eth0: out of memory
[ 4321.381741] [ 1570]     0  1570      229       11       3      
0        0             0 odhcp6c
[ 4321.390819] eth1: out of memory
[ 4321.394064] Out of memory: Kill process 1198 (netifd) score 5 or
sacrifice child
[ 4321.401728] Killed process 1570 (odhcp6c) total-vm:916kB,
anon-rss:40kB, file-rss:4kB
[ 4321.511954] eth0: out of memory
[ 4321.644535] eth0: out of memory
[ 4321.900446] eth0: out of memory
[ 4329.109362] eth1: link down
[ 4330.397212] eth1: link up (100Mbps/Full duplex)



-- 
make the world nicer, please use PGP encryption


[-- Attachment #2: Type: text/html, Size: 140021 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-07-27  5:55 [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash jens
@ 2016-07-27  8:38 ` Jason A. Donenfeld
  2016-07-27 10:13   ` Jens Viisauksena
  0 siblings, 1 reply; 20+ messages in thread
From: Jason A. Donenfeld @ 2016-07-27  8:38 UTC (permalink / raw)
  To: jens, Baptiste Jonglez; +Cc: WireGuard mailing list

Hi Jens,

Youch! That's pretty horrible. Is 15mb/s worse than what you get with tincd?

A while ago Baptiste (attached) was working on a MIPS optimized
implementation of ChaPoly. Baptiste -- what ever happened with that?
Perhaps it's time we revive that project?

About the crash -- it appears that I need to optimize WireGuard for
low memory situations. I'll get started on this.

Thanks for the feedback. I'll see what I can do to fix things.

Jason

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-07-27  8:38 ` Jason A. Donenfeld
@ 2016-07-27 10:13   ` Jens Viisauksena
  2016-07-27 10:14     ` Jason A. Donenfeld
  0 siblings, 1 reply; 20+ messages in thread
From: Jens Viisauksena @ 2016-07-27 10:13 UTC (permalink / raw)
  To: Jason A. Donenfeld, Baptiste Jonglez; +Cc: WireGuard mailing list

[-- Attachment #1: Type: text/plain, Size: 1445 bytes --]

the mentioned tincd...

We ran other tests on our backbone vms. There we build plain l2tpv3/batv15 on top and we got heavy promising results. 
In short: plain we got there 980mbs, with wireguard some 700 and l2tpV3/batv15 on top 500mbs.

we will report that soon as working alternative to tincd, while tincd only interconnet our backbone. 
the small routers run fastd into the backbone. 
That was Indeed this test about, if this could be an alternative or extension for the small nicely working userspace fastd - and curiosity.

On that mentioned backbone tests we have a huge drop in performance when packets where fragmented, everything goes down to stable 50mbs, and raise to stable 500 if unfragmented. we have to solve this mystery before we will come forward, or if we cannot solve this, we may report as is.

On July 27, 2016 10:38:04 AM GMT+02:00, "Jason A. Donenfeld" <Jason@zx2c4.com> wrote:
>Hi Jens,
>
>Youch! That's pretty horrible. Is 15mb/s worse than what you get with
>tincd?
>
>A while ago Baptiste (attached) was working on a MIPS optimized
>implementation of ChaPoly. Baptiste -- what ever happened with that?
>Perhaps it's time we revive that project?
>
>About the crash -- it appears that I need to optimize WireGuard for
>low memory situations. I'll get started on this.
>
>Thanks for the feedback. I'll see what I can do to fix things.
>
>Jason

-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity.

[-- Attachment #2: Type: text/html, Size: 1804 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-07-27 10:13   ` Jens Viisauksena
@ 2016-07-27 10:14     ` Jason A. Donenfeld
  2016-07-27 10:26       ` Jens Viisauksena
  0 siblings, 1 reply; 20+ messages in thread
From: Jason A. Donenfeld @ 2016-07-27 10:14 UTC (permalink / raw)
  To: Jens Viisauksena; +Cc: WireGuard mailing list

On Wed, Jul 27, 2016 at 12:10 PM, Jens Viisauksena <jens@viisauksena.de> wrote:
> the small routers run fastd into the backbone.

Is the performance of wireguard better or worse than fastd?
Theoretically wireguard should be much faster, so if it isn't already
so in practice, I'd like to optimize a bit.

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-07-27 10:14     ` Jason A. Donenfeld
@ 2016-07-27 10:26       ` Jens Viisauksena
  2016-07-27 11:05         ` Jason A. Donenfeld
  0 siblings, 1 reply; 20+ messages in thread
From: Jens Viisauksena @ 2016-07-27 10:26 UTC (permalink / raw)
  To: Jason A. Donenfeld; +Cc: WireGuard mailing list

[-- Attachment #1: Type: text/plain, Size: 1010 bytes --]

It should however not lead to netifd outofmemory, load of 2.6 and the oomkiller berserking around at all... even if  its not directly wg fault.

Yesterday there was no time to test fastd in such a setting,
Similar test show 5 to 15mbs depending on used crypto in the past.
But there we test laptop - 841v9(550mhz?) - broadbanduplink - backboneserver

If we are motivated, we check fastd in the next days against different cypher algos in exact the same setting, to have a realy good base for comparing software on this fairly week devices

On July 27, 2016 12:14:12 PM GMT+02:00, "Jason A. Donenfeld" <Jason@zx2c4.com> wrote:
>On Wed, Jul 27, 2016 at 12:10 PM, Jens Viisauksena
><jens@viisauksena.de> wrote:
>> the small routers run fastd into the backbone.
>
>Is the performance of wireguard better or worse than fastd?
>Theoretically wireguard should be much faster, so if it isn't already
>so in practice, I'd like to optimize a bit.

-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity.

[-- Attachment #2: Type: text/html, Size: 1461 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-07-27 10:26       ` Jens Viisauksena
@ 2016-07-27 11:05         ` Jason A. Donenfeld
  2016-07-27 15:02           ` Michael Gerlach
  2016-08-02 23:39           ` jens
  0 siblings, 2 replies; 20+ messages in thread
From: Jason A. Donenfeld @ 2016-07-27 11:05 UTC (permalink / raw)
  To: Jens Viisauksena; +Cc: WireGuard mailing list

On Wed, Jul 27, 2016 at 12:26 PM, Jens Viisauksena <jens@viisauksena.de> wrote:
> It should however not lead to netifd outofmemory, load of 2.6 and the
> oomkiller berserking around at all... even if its not directly wg fault.

One thing to try would be removing these lines from src/socket.c:

socket.c
386:    sk_clear_memalloc(sock);
394:    sk_set_memalloc(sock->sk);

I'd be interested to learn if that fixes things.

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-07-27 11:05         ` Jason A. Donenfeld
@ 2016-07-27 15:02           ` Michael Gerlach
  2016-07-28 11:48             ` Jason A. Donenfeld
  2016-08-02 23:39           ` jens
  1 sibling, 1 reply; 20+ messages in thread
From: Michael Gerlach @ 2016-07-27 15:02 UTC (permalink / raw)
  To: wireguard

[-- Attachment #1: Type: text/plain, Size: 1131 bytes --]


Hey Jason!


It was too late for me yesterday night so i wasn't able to write something on
this. 

I know we have to reproduce this once again - i was not prepared to face
something like this so we had no tools installed to check memsuage. 

Let us run this test well-prepared again and we may come up with more
details.. 


best regrads,


n3ph



On Wed, Jul 27, 2016 at 01:05:18PM +0200, Jason A. Donenfeld wrote:
> On Wed, Jul 27, 2016 at 12:26 PM, Jens Viisauksena <jens@viisauksena.de> wrote:
> > It should however not lead to netifd outofmemory, load of 2.6 and the
> > oomkiller berserking around at all... even if its not directly wg fault.
> 
> One thing to try would be removing these lines from src/socket.c:
> 
> socket.c
> 386:    sk_clear_memalloc(sock);
> 394:    sk_set_memalloc(sock->sk);
> 
> I'd be interested to learn if that fixes things.
> _______________________________________________
> WireGuard mailing list
> WireGuard@lists.zx2c4.com
> http://lists.zx2c4.com/mailman/listinfo/wireguard

-- 
Please use PGP - https://en.wikipedia.org/wiki/Pretty_Good_Privacy


[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 473 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-07-27 15:02           ` Michael Gerlach
@ 2016-07-28 11:48             ` Jason A. Donenfeld
  2016-07-28 19:16               ` Michael Gerlach
  2016-07-29 11:08               ` Michael Gerlach
  0 siblings, 2 replies; 20+ messages in thread
From: Jason A. Donenfeld @ 2016-07-28 11:48 UTC (permalink / raw)
  To: Michael Gerlach; +Cc: WireGuard mailing list

Hey,

Do you guys have a good way of running your setup inside Qemu? I'd
like to debug this issue a bit...

Jason

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-07-28 11:48             ` Jason A. Donenfeld
@ 2016-07-28 19:16               ` Michael Gerlach
  2016-07-29 11:08               ` Michael Gerlach
  1 sibling, 0 replies; 20+ messages in thread
From: Michael Gerlach @ 2016-07-28 19:16 UTC (permalink / raw)
  To: Jason A. Donenfeld; +Cc: WireGuard mailing list

[-- Attachment #1: Type: text/plain, Size: 558 bytes --]

Hey Jason!

I didn't run openwrt ar71xx targets in qemu yet.. ATM i am recompiling
my qemu to be able to run mips on it, but i don't know if this will work
anyway.. 

I will have a look at it and come back if i have something to work with.

best regards,


n3ph



On Thu, Jul 28, 2016 at 01:48:39PM +0200, Jason A. Donenfeld wrote:
> Hey,
> 
> Do you guys have a good way of running your setup inside Qemu? I'd
> like to debug this issue a bit...
> 
> Jason

-- 
Please use PGP - https://en.wikipedia.org/wiki/Pretty_Good_Privacy


[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 473 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-07-28 11:48             ` Jason A. Donenfeld
  2016-07-28 19:16               ` Michael Gerlach
@ 2016-07-29 11:08               ` Michael Gerlach
  2016-07-29 12:56                 ` Jason A. Donenfeld
  1 sibling, 1 reply; 20+ messages in thread
From: Michael Gerlach @ 2016-07-29 11:08 UTC (permalink / raw)
  To: Jason A. Donenfeld; +Cc: WireGuard mailing list

[-- Attachment #1: Type: text/plain, Size: 833 bytes --]


Hi Jason!

I figured out how to run openwrt on qemu.. It seems it is just possible
to run the malta target on mipsel - discribed here:
http://aleph0.info/software/lisp-forth-openwrt/openwrt-on-qemu.html

I tried ar71xx but had no luck to get things work.. 

So i just got the images from
https://downloads.lede-project.org/snapshots/targets/malta/le/

and execute qemu by

qemu-system-mipsel -kernel lede-malta-le-vmlinux-initramfs.elf
-nographic -m 256 -append "console=ttyS0"

Hope thats helps.. 



best regards,

n3ph




On Thu, Jul 28, 2016 at 01:48:39PM +0200, Jason A. Donenfeld wrote:
> Hey,
> 
> Do you guys have a good way of running your setup inside Qemu? I'd
> like to debug this issue a bit...
> 
> Jason

-- 
Please use PGP - https://en.wikipedia.org/wiki/Pretty_Good_Privacy


[-- Attachment #2: Digital signature --]
[-- Type: application/pgp-signature, Size: 473 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-07-29 11:08               ` Michael Gerlach
@ 2016-07-29 12:56                 ` Jason A. Donenfeld
  0 siblings, 0 replies; 20+ messages in thread
From: Jason A. Donenfeld @ 2016-07-29 12:56 UTC (permalink / raw)
  To: Michael Gerlach; +Cc: WireGuard mailing list

Woah!

root@lede:/# opkg install kmod-wireguard wireguard-tools
Installing kmod-wireguard (4.4.15+0.0.20160722-1) to root...
Downloading http://downloads.lede-project.org/snapshots/targets/malta/le/packages/kmod-wireguard_4.4.15+0.0.20160722-1_mipsel_24kc.ipk.
Installing kmod-udptunnel4 (4.4.15-1) to root...
Downloading http://downloads.lede-project.org/snapshots/targets/malta/le/packages/kmod-udptunnel4_4.4.15-1_mipsel_24kc.ipk.
Installing kmod-udptunnel6 (4.4.15-1) to root...
Downloading http://downloads.lede-project.org/snapshots/targets/malta/le/packages/kmod-udptunnel6_4.4.15-1_mipsel_24kc.ipk.
Installing kmod-ipt-hashlimit (4.4.15-1) to root...
Downloading http://downloads.lede-project.org/snapshots/targets/malta/le/packages/kmod-ipt-hashlimit_4.4.15-1_mipsel_24kc.ipk.
Installing wireguard-tools (0.0.20160722-1) to root...
Downloading http://downloads.lede-project.org/snapshots/packages/mipsel_24kc/packages/wireguard-tools_0.0.20160722-1_mipsel_24kc.ipk.
Installing libmnl (1.0.3-2) to root...
Downloading http://downloads.lede-project.org/snapshots/packages/mipsel_24kc/base/libmnl_1.0.3-2_mipsel_24kc.ipk.
Configuring libmnl.
Configuring kmod-udptunnel4.
Configuring kmod-udptunnel6.
Configuring kmod-ipt-hashlimit.
Configuring kmod-wireguard.
[  110.183892] wireguard: WireGuard loaded. See www.wireguard.io for
information.
[  110.185217] wireguard: (C) Copyright 2015-2016 Jason A. Donenfeld
<Jason@zx2c4.com>. All Rights Reserved.
Configuring wireguard-tools.

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-07-27 11:05         ` Jason A. Donenfeld
  2016-07-27 15:02           ` Michael Gerlach
@ 2016-08-02 23:39           ` jens
  2016-08-03  1:14             ` Jason A. Donenfeld
  2016-08-03  6:48             ` René van Dorst
  1 sibling, 2 replies; 20+ messages in thread
From: jens @ 2016-08-02 23:39 UTC (permalink / raw)
  To: Jason A. Donenfeld; +Cc: WireGuard mailing list

On 27.07.2016 13:05, Jason A. Donenfeld wrote:

> On Wed, Jul 27, 2016 at 12:26 PM, Jens Viisauksena <jens@viisauksena.de=
> wrote:
>> It should however not lead to netifd outofmemory, load of 2.6 and the
>> oomkiller berserking around at all... even if its not directly wg faul=
t.
> One thing to try would be removing these lines from src/socket.c:
>
> socket.c
> 386:    sk_clear_memalloc(sock);
> 394:    sk_set_memalloc(sock->sk);
>
> I'd be interested to learn if that fixes things.

sorry if you waited for answers ..
we redo the testing with latest kernel
[    0.000000] Linux version 4.4.15 (fuzzle@builder) (gcc version 5.4.0
(LEDE GCC 5.4.0 r1119) ) #3 Thu Jul 28 01:05:08 UTC 2016
build from latest trunk by ourselve, before we use default packages and
lede like this
[    0.000000] Linux version 4.4.15 (buildbot@builds) (gcc version 5.4.0
(LEDE GCC 5.4.0 r1114) ) #2 Tue Jul 26 17:57:45 UTC 2016

and with wireguard source from 27.7. also including your suggestions.

still the same

more detailed  :

we got out of memory and big cpuload when testing iperf with udp
packets, (we forget to notice that before in our first testings which
mode killed all the memory)
and from the heavy load and low memory lede/openwrt shut down stuff and
things broke apart
(Reminder, Lede/Openwrt on TP link 841 v11 with 650 Mhz CPU and 32Mb Ram)=


with tcp traffic we got this time stable 16 Mbit, which sounds like a
reasonable limit for this kind of small cpu without any optimzation.
Also cpu load was lower.

we wonder how to use more sophisticated tools on our testsetup with 2
real tplink routers connected + behind each one laptop to measure
throughput with iperf3. this maybe is not possible at all without
getting serial console access

2 lessons learned: 1. problem arises with upd traffic and result quickly
in out of memory (with transmission peak at the beginning higher than
the 15 mbit with tcp packets))  2. tcp is stable with 15-16 Mbit
some more thoughts: all this could maybe slightly increased by code
optimization, slightly different cipher, maybe encrypting is harder than
decrypting, which means download will be faster - while encryption is
happen on big servers in Net

to compare again with fastd - this are the numbers we could get fastd
through the cpu/wire (we didnt did that testing in this special setup,
maybe some time soon - at least i am curious)





### just the dmesg before crashing
[    0.000000] MyLoader: sysp=3D9fb7db5d, boardp=3Dd56f3f67, parts=3Dbfae=
9f0c
[    0.000000] bootconsole [early0] enabled
[    0.000000] CPU0 revision is: 00019374 (MIPS 24Kc)
[    0.000000] SoC: Qualcomm Atheros QCA9533 ver 2 rev 0
[    0.000000] Determined physical RAM map:
[    0.000000]  memory: 02000000 @ 00000000 (usable)
[    0.000000] Initrd not found or empty - disabling initrd
[    0.000000] No valid device tree found, continuing without
[    0.000000] Zone ranges:
[    0.000000]   Normal   [mem 0x0000000000000000-0x0000000001ffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x0000000001ffffff]
[    0.000000] Initmem setup node 0 [mem
0x0000000000000000-0x0000000001ffffff]
[    0.000000] On node 0 totalpages: 8192
[    0.000000] free_area_init_node: node 0, pgdat 804003d0, node_mem_map
81000000
[    0.000000]   Normal zone: 64 pages used for memmap
[    0.000000]   Normal zone: 0 pages reserved
[    0.000000]   Normal zone: 8192 pages, LIFO batch:0
[    0.000000] Primary instruction cache 64kB, VIPT, 4-way, linesize 32
bytes.
[    0.000000] Primary data cache 32kB, 4-way, VIPT, cache aliases,
linesize 32 bytes
[    0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=3D1*32768
[    0.000000] pcpu-alloc: [0] 0
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.=20
Total pages: 8128
[    0.000000] Kernel command line:  board=3DTL-WR841N-v11=20
console=3DttyS0,115200 rootfstype=3Dsquashfs,jffs2 noinitrd
[    0.000000] PID hash table entries: 128 (order: -3, 512 bytes)
[    0.000000] Dentry cache hash table entries: 4096 (order: 2, 16384 byt=
es)
[    0.000000] Inode-cache hash table entries: 2048 (order: 1, 8192 bytes=
)
[    0.000000] Writing ErrCtl register=3D00000000
[    0.000000] Readback ErrCtl register=3D00000000
[    0.000000] Memory: 27740K/32768K available (2933K kernel code, 151K
rwdata, 744K rodata, 260K init, 200K bss, 5028K reserved, 0K cma-reserved=
)
[    0.000000] SLUB: HWalign=3D32, Order=3D0-3, MinObjects=3D0, CPUs=3D1,=
 Nodes=3D1
[    0.000000] NR_IRQS:51
[    0.000000] Clocks: CPU:650.000MHz, DDR:393.066MHz, AHB:216.666MHz,
Ref:25.000MHz
[    0.000000] clocksource: MIPS: mask: 0xffffffff max_cycles:
0xffffffff, max_idle_ns: 5880801374 ns
[    0.000009] sched_clock: 32 bits at 325MHz, resolution 3ns, wraps
every 6607641598ns
[    0.008234] Calibrating delay loop... 432.53 BogoMIPS (lpj=3D2162688)
[    0.071106] pid_max: default: 32768 minimum: 301
[    0.076110] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes=
)
[    0.083096] Mountpoint-cache hash table entries: 1024 (order: 0, 4096
bytes)
[    0.093471] clocksource: jiffies: mask: 0xffffffff max_cycles:
0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.104645] NET: Registered protocol family 16
[    0.110870] MIPS: machine is TP-LINK TL-WR841N/ND v11
[    0.568855] clocksource: Switched to clocksource MIPS
[    0.575559] NET: Registered protocol family 2
[    0.581064] TCP established hash table entries: 1024 (order: 0, 4096
bytes)
[    0.588427] TCP bind hash table entries: 1024 (order: 0, 4096 bytes)
[    0.595202] TCP: Hash tables configured (established 1024 bind 1024)
[    0.602025] UDP hash table entries: 256 (order: 0, 4096 bytes)
[    0.608200] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes)
[    0.615203] NET: Registered protocol family 1
[    0.619896] PCI: CLS 0 bytes, default 32
[    0.620920] futex hash table entries: 256 (order: -1, 3072 bytes)
[    0.644082] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.650332] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME)
(CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
[    0.663484] io scheduler noop registered
[    0.667635] io scheduler deadline registered (default)
[    0.673325] Serial: 8250/16550 driver, 1 ports, IRQ sharing disabled
[    0.680545] console [ttyS0] disabled
[    0.704475] serial8250.0: ttyS0 at MMIO 0x18020000 (irq =3D 11,
base_baud =3D 1562500) is a 16550A
[    0.713586] console [ttyS0] enabled
[    0.721147] bootconsole [early0] disabled
[    0.732999] m25p80 spi0.0: found gd25q32, expected m25p80
[    0.738601] m25p80 spi0.0: gd25q32 (4096 Kbytes)
[    0.744708] 5 tp-link partitions found on MTD device spi0.0
[    0.750531] Creating 5 MTD partitions on "spi0.0":
[    0.755489] 0x000000000000-0x000000020000 : "u-boot"
[    0.762184] 0x000000020000-0x000000162710 : "kernel"
[    0.769118] 0x000000162710-0x0000003f0000 : "rootfs"
[    0.775937] mtd: device 2 (rootfs) set to be root filesystem
[    0.781932] 1 squashfs-split partitions found on MTD device rootfs
[    0.788320] 0x000000340000-0x0000003f0000 : "rootfs_data"
[    0.795617] 0x0000003f0000-0x000000400000 : "art"
[    0.802259] 0x000000020000-0x0000003f0000 : "firmware"
[    0.829961] libphy: ag71xx_mdio: probed
[    1.421422] ag71xx-mdio.1: Found an AR934X built-in switch
[    1.464748] eth0: Atheros AG71xx at 0xba000000, irq 5, mode:GMII
[    2.061807] ag71xx ag71xx.0: connected to PHY at ag71xx-mdio.1:04
[uid=3D004dd042, driver=3DGeneric PHY]
[    2.072011] eth1: Atheros AG71xx at 0xb9000000, irq 4, mode:MII
[    2.080973] NET: Registered protocol family 10
[    2.090540] NET: Registered protocol family 17
[    2.095219] bridge: automatic filtering via arp/ip/ip6tables has been
deprecated. Update your scripts to load br_netfilter if you need this.
[    2.108444] 8021q: 802.1Q VLAN Support v1.8
[    2.121115] VFS: Mounted root (squashfs filesystem) readonly on
device 31:2.
[    2.130267] Freeing unused kernel memory: 260K (8041f000 - 80460000)
[    3.221171] init: Console is alive
[    3.224937] init: - watchdog -
[    4.185893] init: - preinit -
[    4.817211] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
[    4.844857] random: procd urandom read with 7 bits of entropy availabl=
e
[    6.910299] eth0: link up (1000Mbps/Full duplex)
[    6.916280] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
[    8.090413] jffs2_scan_eraseblock(): End of filesystem marker found
at 0x10000
[    8.097897] jffs2_build_filesystem(): unlocking the mtd device... done=
=2E
[    8.104748] jffs2_build_filesystem(): erasing all blocks after the
end marker... done.
[   10.739288] jffs2: notice: (349) jffs2_build_xattr_subsystem:
complete building xattr subsystem, 0 of xdatum (0 unchecked, 0 orphan)
and 0 of xref (0 dead, 0 orphan) found.
[   10.756968] mount_root: overlay filesystem has not been fully
initialized yet
[   10.768400] mount_root: switching to jffs2 overlay
[   10.999300] urandom-seed: Seed file not found (/etc/urandom.seed)
[   11.109948] eth0: link down
[   11.125253] procd: - early -
[   11.128356] procd: - watchdog -
[   11.738352] procd: - ubus -
[   11.793781] procd: - init -
[   12.094265] tun: Universal TUN/TAP device driver, 1.6
[   12.099567] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
[   12.120149] wireguard: WireGuard loaded. See www.wireguard.io for
information.
[   12.127621] wireguard: (C) Copyright 2015-2016 Jason A. Donenfeld
<Jason@zx2c4.com>. All Rights Reserved.
[   12.140039] ip6_tables: (C) 2000-2006 Netfilter Core Team
[   12.160019] Loading modules backported from Linux version
wt-2016-06-20-0-gbc17424
[   12.167850] Backport generated by backports.git
backports-20160216-7-g5735958
[   12.178703] ip_tables: (C) 2000-2006 Netfilter Core Team
[   12.195189] nf_conntrack version 0.5.0 (437 buckets, 1748 max)
[   12.244145] xt_time: kernel timezone is -0000
[   12.314522] PPP generic driver version 2.4.2
[   12.321763] NET: Registered protocol family 24
[   12.376518] ath: EEPROM regdomain: 0x0
[   12.376545] ath: EEPROM indicates default country code should be used
[   12.376554] ath: doing EEPROM country->regdmn map search
[   12.376576] ath: country maps to regdmn code: 0x3a
[   12.376587] ath: Country alpha2 being used: US
[   12.376595] ath: Regpair used: 0x3a
[   12.388362] ieee80211 phy0: Selected rate control algorithm 'minstrel_=
ht'
[   12.392478] ieee80211 phy0: Atheros AR9531 Rev:2 mem=3D0xb8100000, irq=
=3D47
[   20.576096] device eth0 entered promiscuous mode
[   20.599684] IPv6: ADDRCONF(NETDEV_UP): br-lan: link is not ready
[   20.645872] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
[   22.270331] eth0: link up (1000Mbps/Full duplex)
[   22.275169] br-lan: port 1(eth0) entered forwarding state
[   22.280839] br-lan: port 1(eth0) entered forwarding state
[   22.322565] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
[   23.352464] eth1: link up (100Mbps/Full duplex)
[   23.357197] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
[   24.278939] br-lan: port 1(eth0) entered forwarding state
[   77.338893] random: nonblocking pool is initialized
[ 2545.780086] eth0: link down
[ 2545.783413] br-lan: port 1(eth0) entered disabled state
[ 2547.280148] eth0: link up (1000Mbps/Full duplex)
[ 2547.284988] br-lan: port 1(eth0) entered forwarding state
[ 2547.290680] br-lan: port 1(eth0) entered forwarding state
[ 2549.288710] br-lan: port 1(eth0) entered forwarding state
[ 2751.342810] netifd invoked oom-killer: gfp_mask=3D0x24201ca, order=3D0=
,
oom_score_adj=3D0
[ 2751.351333] CPU: 0 PID: 695 Comm: netifd Not tainted 4.4.15 #3
[ 2751.357358] Stack : 803ba2c4 00000000 00000001 80410000 8197ea80
80400d63 8039b9e4 000002b7
[ 2751.357358]       80463798 80febd1c 00000000 00000006 00001b58
800a6820 00000006 ffffffff
[ 2751.357358]       00000000 00000000 8039f45c 80febbbc 80466542
800a47ec 804003d0 00000000
[ 2751.357358]       00000001 801ef300 00000000 00000000 00000000
00000000 00000000 00000000
[ 2751.357358]       00000000 00000000 00000000 00000000 00000000
00000000 00000000 00000000
[ 2751.357358]       ...
[ 2751.396800] Call Trace:
[ 2751.399910] [<80071a20>] show_stack+0x50/0x84
[ 2751.404425] [<800d2ddc>] dump_header.isra.4+0x48/0x130
[ 2751.410546] [<800d31b0>] oom_kill_process+0x98/0x440
[ 2751.415683] [<800d38d0>] out_of_memory+0x2f4/0x330
[ 2751.421212] [<800d718c>] __alloc_pages_nodemask+0x67c/0x6e8
[ 2751.427014] [<800d21d0>] filemap_fault+0x254/0x454
[ 2751.432560] [<800ecafc>] __do_fault+0x3c/0xa8
[ 2751.437076] [<800efd28>] handle_mm_fault+0x4e0/0xb78
[ 2751.442797] [<80076638>] __do_page_fault+0x134/0x474
[ 2751.447940] [<80060820>] ret_from_exception+0x0/0x10
[ 2751.453625]
[ 2751.455172] Mem-Info:
[ 2751.457542] active_anon:246 inactive_anon:4 isolated_anon:0
[ 2751.457542]  active_file:51 inactive_file:80 isolated_file:0
[ 2751.457542]  unevictable:0 dirty:0 writeback:0 unstable:0
[ 2751.457542]  slab_reclaimable:120 slab_unreclaimable:1272
[ 2751.457542]  mapped:10 shmem:36 pagetables:39 bounce:0
[ 2751.457542]  free:164 free_pcp:0 free_cma:0
[ 2751.490694] Normal free:660kB min:664kB low:828kB high:996kB
active_anon:984kB inactive_anon:16kB active_file:204kB
inactive_file:320kB unevictable:0kB isolated(anon):0kB
isolated(file):0kB present:32768kB managed:28000kB mlocked:0kB dirty:0kB
writeback:0kB mapped:40kB shmem:144kB slab_reclaimable:480kB
slab_unreclaimable:5088kB kernel_stack:304kB pagetables:156kB
unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
[ 2751.535274] lowmem_reserve[]: 0 0
[ 2751.539269] Normal: 3*4kB (U) 41*8kB (UM) 20*16kB (U) 0*32kB 0*64kB
0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB =3D 660kB
[ 2751.551718] 167 total pagecache pages
[ 2751.555511] 0 pages in swap cache
[ 2751.559484] Swap cache stats: add 0, delete 0, find 0/0
[ 2751.564887] Free swap  =3D 0kB
[ 2751.567862] Total swap =3D 0kB
[ 2751.571632] 8192 pages RAM
[ 2751.574438] 0 pages HighMem/MovableOnly
[ 2751.578399] 1192 pages reserved
[ 2751.582198] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds
swapents oom_score_adj name
[ 2751.591592] [  395]     0   395      294       15       3     =20
0        0             0 ubusd
[ 2751.601044] [  396]     0   396      223       10       3     =20
0        0             0 askfirst
[ 2751.610769] [  659]     0   659      306       35       3     =20
0        0             0 logd
[ 2751.620386] [  695]     0   695      408       40       4     =20
0        0             0 netifd
[ 2751.629944] [  722]     0   722      320       21       3     =20
0        0             0 odhcpd
[ 2751.639492] [  754]     0   754      264       10       3     =20
0        0             0 dropbear
[ 2751.648664] [  856]     0   856      294       15       3     =20
0        0             0 ntpd
[ 2751.658041] [  915]   453   915      262       18       4     =20
0        0             0 dnsmasq
[ 2751.667679] [ 1003]     0  1003      229       11       3     =20
0        0             0 odhcp6c
[ 2751.677561] [ 1051]     0  1051      281       25       3     =20
0        0             0 dropbear
[ 2751.687291] [ 1052]     0  1052      295       11       3     =20
0        0             0 ash
[ 2751.696563] Out of memory: Kill process 695 (netifd) score 6 or
sacrifice child
[ 2751.704694] Killed process 1003 (odhcp6c) total-vm:916kB,
anon-rss:40kB, file-rss:4kB
root@lede:/tmp# Connection to 192.168.1.1 closed.

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-08-02 23:39           ` jens
@ 2016-08-03  1:14             ` Jason A. Donenfeld
  2016-08-03  6:48             ` René van Dorst
  1 sibling, 0 replies; 20+ messages in thread
From: Jason A. Donenfeld @ 2016-08-03  1:14 UTC (permalink / raw)
  To: jens; +Cc: WireGuard mailing list

Hi Jens,

Thanks for the feedback.

On Wed, Aug 3, 2016 at 1:39 AM, jens <jens@viisauksena.de> wrote:
> and with wireguard source from 27.7. also including your suggestions.

Okay, so I interpret this as you saying "I removed the sk_set_memalloc
line, but that didn't fix the problem."

Next test: remove the line "sock->sk->sk_sndbuf = INT_MAX;" Does that
then fix the problem?

I'll continue to investigate this too.

Jason

On Wed, Aug 3, 2016 at 1:39 AM, jens <jens@viisauksena.de> wrote:
> On 27.07.2016 13:05, Jason A. Donenfeld wrote:
>
>> On Wed, Jul 27, 2016 at 12:26 PM, Jens Viisauksena <jens@viisauksena.de> wrote:
>>> It should however not lead to netifd outofmemory, load of 2.6 and the
>>> oomkiller berserking around at all... even if its not directly wg fault.
>> One thing to try would be removing these lines from src/socket.c:
>>
>> socket.c
>> 386:    sk_clear_memalloc(sock);
>> 394:    sk_set_memalloc(sock->sk);
>>
>> I'd be interested to learn if that fixes things.
>
> sorry if you waited for answers ..
> we redo the testing with latest kernel
> [    0.000000] Linux version 4.4.15 (fuzzle@builder) (gcc version 5.4.0
> (LEDE GCC 5.4.0 r1119) ) #3 Thu Jul 28 01:05:08 UTC 2016
> build from latest trunk by ourselve, before we use default packages and
> lede like this
> [    0.000000] Linux version 4.4.15 (buildbot@builds) (gcc version 5.4.0
> (LEDE GCC 5.4.0 r1114) ) #2 Tue Jul 26 17:57:45 UTC 2016
>
> and with wireguard source from 27.7. also including your suggestions.
>
> still the same
>
> more detailed  :
>
> we got out of memory and big cpuload when testing iperf with udp
> packets, (we forget to notice that before in our first testings which
> mode killed all the memory)
> and from the heavy load and low memory lede/openwrt shut down stuff and
> things broke apart
> (Reminder, Lede/Openwrt on TP link 841 v11 with 650 Mhz CPU and 32Mb Ram)
>
> with tcp traffic we got this time stable 16 Mbit, which sounds like a
> reasonable limit for this kind of small cpu without any optimzation.
> Also cpu load was lower.
>
> we wonder how to use more sophisticated tools on our testsetup with 2
> real tplink routers connected + behind each one laptop to measure
> throughput with iperf3. this maybe is not possible at all without
> getting serial console access
>
> 2 lessons learned: 1. problem arises with upd traffic and result quickly
> in out of memory (with transmission peak at the beginning higher than
> the 15 mbit with tcp packets))  2. tcp is stable with 15-16 Mbit
> some more thoughts: all this could maybe slightly increased by code
> optimization, slightly different cipher, maybe encrypting is harder than
> decrypting, which means download will be faster - while encryption is
> happen on big servers in Net
>
> to compare again with fastd - this are the numbers we could get fastd
> through the cpu/wire (we didnt did that testing in this special setup,
> maybe some time soon - at least i am curious)
>
>
>
>
>
> ### just the dmesg before crashing
> [    0.000000] MyLoader: sysp=9fb7db5d, boardp=d56f3f67, parts=bfae9f0c
> [    0.000000] bootconsole [early0] enabled
> [    0.000000] CPU0 revision is: 00019374 (MIPS 24Kc)
> [    0.000000] SoC: Qualcomm Atheros QCA9533 ver 2 rev 0
> [    0.000000] Determined physical RAM map:
> [    0.000000]  memory: 02000000 @ 00000000 (usable)
> [    0.000000] Initrd not found or empty - disabling initrd
> [    0.000000] No valid device tree found, continuing without
> [    0.000000] Zone ranges:
> [    0.000000]   Normal   [mem 0x0000000000000000-0x0000000001ffffff]
> [    0.000000] Movable zone start for each node
> [    0.000000] Early memory node ranges
> [    0.000000]   node   0: [mem 0x0000000000000000-0x0000000001ffffff]
> [    0.000000] Initmem setup node 0 [mem
> 0x0000000000000000-0x0000000001ffffff]
> [    0.000000] On node 0 totalpages: 8192
> [    0.000000] free_area_init_node: node 0, pgdat 804003d0, node_mem_map
> 81000000
> [    0.000000]   Normal zone: 64 pages used for memmap
> [    0.000000]   Normal zone: 0 pages reserved
> [    0.000000]   Normal zone: 8192 pages, LIFO batch:0
> [    0.000000] Primary instruction cache 64kB, VIPT, 4-way, linesize 32
> bytes.
> [    0.000000] Primary data cache 32kB, 4-way, VIPT, cache aliases,
> linesize 32 bytes
> [    0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
> [    0.000000] pcpu-alloc: [0] 0
> [    0.000000] Built 1 zonelists in Zone order, mobility grouping on.
> Total pages: 8128
> [    0.000000] Kernel command line:  board=TL-WR841N-v11
> console=ttyS0,115200 rootfstype=squashfs,jffs2 noinitrd
> [    0.000000] PID hash table entries: 128 (order: -3, 512 bytes)
> [    0.000000] Dentry cache hash table entries: 4096 (order: 2, 16384 bytes)
> [    0.000000] Inode-cache hash table entries: 2048 (order: 1, 8192 bytes)
> [    0.000000] Writing ErrCtl register=00000000
> [    0.000000] Readback ErrCtl register=00000000
> [    0.000000] Memory: 27740K/32768K available (2933K kernel code, 151K
> rwdata, 744K rodata, 260K init, 200K bss, 5028K reserved, 0K cma-reserved)
> [    0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
> [    0.000000] NR_IRQS:51
> [    0.000000] Clocks: CPU:650.000MHz, DDR:393.066MHz, AHB:216.666MHz,
> Ref:25.000MHz
> [    0.000000] clocksource: MIPS: mask: 0xffffffff max_cycles:
> 0xffffffff, max_idle_ns: 5880801374 ns
> [    0.000009] sched_clock: 32 bits at 325MHz, resolution 3ns, wraps
> every 6607641598ns
> [    0.008234] Calibrating delay loop... 432.53 BogoMIPS (lpj=2162688)
> [    0.071106] pid_max: default: 32768 minimum: 301
> [    0.076110] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
> [    0.083096] Mountpoint-cache hash table entries: 1024 (order: 0, 4096
> bytes)
> [    0.093471] clocksource: jiffies: mask: 0xffffffff max_cycles:
> 0xffffffff, max_idle_ns: 19112604462750000 ns
> [    0.104645] NET: Registered protocol family 16
> [    0.110870] MIPS: machine is TP-LINK TL-WR841N/ND v11
> [    0.568855] clocksource: Switched to clocksource MIPS
> [    0.575559] NET: Registered protocol family 2
> [    0.581064] TCP established hash table entries: 1024 (order: 0, 4096
> bytes)
> [    0.588427] TCP bind hash table entries: 1024 (order: 0, 4096 bytes)
> [    0.595202] TCP: Hash tables configured (established 1024 bind 1024)
> [    0.602025] UDP hash table entries: 256 (order: 0, 4096 bytes)
> [    0.608200] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes)
> [    0.615203] NET: Registered protocol family 1
> [    0.619896] PCI: CLS 0 bytes, default 32
> [    0.620920] futex hash table entries: 256 (order: -1, 3072 bytes)
> [    0.644082] squashfs: version 4.0 (2009/01/31) Phillip Lougher
> [    0.650332] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME)
> (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
> [    0.663484] io scheduler noop registered
> [    0.667635] io scheduler deadline registered (default)
> [    0.673325] Serial: 8250/16550 driver, 1 ports, IRQ sharing disabled
> [    0.680545] console [ttyS0] disabled
> [    0.704475] serial8250.0: ttyS0 at MMIO 0x18020000 (irq = 11,
> base_baud = 1562500) is a 16550A
> [    0.713586] console [ttyS0] enabled
> [    0.721147] bootconsole [early0] disabled
> [    0.732999] m25p80 spi0.0: found gd25q32, expected m25p80
> [    0.738601] m25p80 spi0.0: gd25q32 (4096 Kbytes)
> [    0.744708] 5 tp-link partitions found on MTD device spi0.0
> [    0.750531] Creating 5 MTD partitions on "spi0.0":
> [    0.755489] 0x000000000000-0x000000020000 : "u-boot"
> [    0.762184] 0x000000020000-0x000000162710 : "kernel"
> [    0.769118] 0x000000162710-0x0000003f0000 : "rootfs"
> [    0.775937] mtd: device 2 (rootfs) set to be root filesystem
> [    0.781932] 1 squashfs-split partitions found on MTD device rootfs
> [    0.788320] 0x000000340000-0x0000003f0000 : "rootfs_data"
> [    0.795617] 0x0000003f0000-0x000000400000 : "art"
> [    0.802259] 0x000000020000-0x0000003f0000 : "firmware"
> [    0.829961] libphy: ag71xx_mdio: probed
> [    1.421422] ag71xx-mdio.1: Found an AR934X built-in switch
> [    1.464748] eth0: Atheros AG71xx at 0xba000000, irq 5, mode:GMII
> [    2.061807] ag71xx ag71xx.0: connected to PHY at ag71xx-mdio.1:04
> [uid=004dd042, driver=Generic PHY]
> [    2.072011] eth1: Atheros AG71xx at 0xb9000000, irq 4, mode:MII
> [    2.080973] NET: Registered protocol family 10
> [    2.090540] NET: Registered protocol family 17
> [    2.095219] bridge: automatic filtering via arp/ip/ip6tables has been
> deprecated. Update your scripts to load br_netfilter if you need this.
> [    2.108444] 8021q: 802.1Q VLAN Support v1.8
> [    2.121115] VFS: Mounted root (squashfs filesystem) readonly on
> device 31:2.
> [    2.130267] Freeing unused kernel memory: 260K (8041f000 - 80460000)
> [    3.221171] init: Console is alive
> [    3.224937] init: - watchdog -
> [    4.185893] init: - preinit -
> [    4.817211] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
> [    4.844857] random: procd urandom read with 7 bits of entropy available
> [    6.910299] eth0: link up (1000Mbps/Full duplex)
> [    6.916280] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
> [    8.090413] jffs2_scan_eraseblock(): End of filesystem marker found
> at 0x10000
> [    8.097897] jffs2_build_filesystem(): unlocking the mtd device... done.
> [    8.104748] jffs2_build_filesystem(): erasing all blocks after the
> end marker... done.
> [   10.739288] jffs2: notice: (349) jffs2_build_xattr_subsystem:
> complete building xattr subsystem, 0 of xdatum (0 unchecked, 0 orphan)
> and 0 of xref (0 dead, 0 orphan) found.
> [   10.756968] mount_root: overlay filesystem has not been fully
> initialized yet
> [   10.768400] mount_root: switching to jffs2 overlay
> [   10.999300] urandom-seed: Seed file not found (/etc/urandom.seed)
> [   11.109948] eth0: link down
> [   11.125253] procd: - early -
> [   11.128356] procd: - watchdog -
> [   11.738352] procd: - ubus -
> [   11.793781] procd: - init -
> [   12.094265] tun: Universal TUN/TAP device driver, 1.6
> [   12.099567] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
> [   12.120149] wireguard: WireGuard loaded. See www.wireguard.io for
> information.
> [   12.127621] wireguard: (C) Copyright 2015-2016 Jason A. Donenfeld
> <Jason@zx2c4.com>. All Rights Reserved.
> [   12.140039] ip6_tables: (C) 2000-2006 Netfilter Core Team
> [   12.160019] Loading modules backported from Linux version
> wt-2016-06-20-0-gbc17424
> [   12.167850] Backport generated by backports.git
> backports-20160216-7-g5735958
> [   12.178703] ip_tables: (C) 2000-2006 Netfilter Core Team
> [   12.195189] nf_conntrack version 0.5.0 (437 buckets, 1748 max)
> [   12.244145] xt_time: kernel timezone is -0000
> [   12.314522] PPP generic driver version 2.4.2
> [   12.321763] NET: Registered protocol family 24
> [   12.376518] ath: EEPROM regdomain: 0x0
> [   12.376545] ath: EEPROM indicates default country code should be used
> [   12.376554] ath: doing EEPROM country->regdmn map search
> [   12.376576] ath: country maps to regdmn code: 0x3a
> [   12.376587] ath: Country alpha2 being used: US
> [   12.376595] ath: Regpair used: 0x3a
> [   12.388362] ieee80211 phy0: Selected rate control algorithm 'minstrel_ht'
> [   12.392478] ieee80211 phy0: Atheros AR9531 Rev:2 mem=0xb8100000, irq=47
> [   20.576096] device eth0 entered promiscuous mode
> [   20.599684] IPv6: ADDRCONF(NETDEV_UP): br-lan: link is not ready
> [   20.645872] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
> [   22.270331] eth0: link up (1000Mbps/Full duplex)
> [   22.275169] br-lan: port 1(eth0) entered forwarding state
> [   22.280839] br-lan: port 1(eth0) entered forwarding state
> [   22.322565] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
> [   23.352464] eth1: link up (100Mbps/Full duplex)
> [   23.357197] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
> [   24.278939] br-lan: port 1(eth0) entered forwarding state
> [   77.338893] random: nonblocking pool is initialized
> [ 2545.780086] eth0: link down
> [ 2545.783413] br-lan: port 1(eth0) entered disabled state
> [ 2547.280148] eth0: link up (1000Mbps/Full duplex)
> [ 2547.284988] br-lan: port 1(eth0) entered forwarding state
> [ 2547.290680] br-lan: port 1(eth0) entered forwarding state
> [ 2549.288710] br-lan: port 1(eth0) entered forwarding state
> [ 2751.342810] netifd invoked oom-killer: gfp_mask=0x24201ca, order=0,
> oom_score_adj=0
> [ 2751.351333] CPU: 0 PID: 695 Comm: netifd Not tainted 4.4.15 #3
> [ 2751.357358] Stack : 803ba2c4 00000000 00000001 80410000 8197ea80
> 80400d63 8039b9e4 000002b7
> [ 2751.357358]       80463798 80febd1c 00000000 00000006 00001b58
> 800a6820 00000006 ffffffff
> [ 2751.357358]       00000000 00000000 8039f45c 80febbbc 80466542
> 800a47ec 804003d0 00000000
> [ 2751.357358]       00000001 801ef300 00000000 00000000 00000000
> 00000000 00000000 00000000
> [ 2751.357358]       00000000 00000000 00000000 00000000 00000000
> 00000000 00000000 00000000
> [ 2751.357358]       ...
> [ 2751.396800] Call Trace:
> [ 2751.399910] [<80071a20>] show_stack+0x50/0x84
> [ 2751.404425] [<800d2ddc>] dump_header.isra.4+0x48/0x130
> [ 2751.410546] [<800d31b0>] oom_kill_process+0x98/0x440
> [ 2751.415683] [<800d38d0>] out_of_memory+0x2f4/0x330
> [ 2751.421212] [<800d718c>] __alloc_pages_nodemask+0x67c/0x6e8
> [ 2751.427014] [<800d21d0>] filemap_fault+0x254/0x454
> [ 2751.432560] [<800ecafc>] __do_fault+0x3c/0xa8
> [ 2751.437076] [<800efd28>] handle_mm_fault+0x4e0/0xb78
> [ 2751.442797] [<80076638>] __do_page_fault+0x134/0x474
> [ 2751.447940] [<80060820>] ret_from_exception+0x0/0x10
> [ 2751.453625]
> [ 2751.455172] Mem-Info:
> [ 2751.457542] active_anon:246 inactive_anon:4 isolated_anon:0
> [ 2751.457542]  active_file:51 inactive_file:80 isolated_file:0
> [ 2751.457542]  unevictable:0 dirty:0 writeback:0 unstable:0
> [ 2751.457542]  slab_reclaimable:120 slab_unreclaimable:1272
> [ 2751.457542]  mapped:10 shmem:36 pagetables:39 bounce:0
> [ 2751.457542]  free:164 free_pcp:0 free_cma:0
> [ 2751.490694] Normal free:660kB min:664kB low:828kB high:996kB
> active_anon:984kB inactive_anon:16kB active_file:204kB
> inactive_file:320kB unevictable:0kB isolated(anon):0kB
> isolated(file):0kB present:32768kB managed:28000kB mlocked:0kB dirty:0kB
> writeback:0kB mapped:40kB shmem:144kB slab_reclaimable:480kB
> slab_unreclaimable:5088kB kernel_stack:304kB pagetables:156kB
> unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
> writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
> [ 2751.535274] lowmem_reserve[]: 0 0
> [ 2751.539269] Normal: 3*4kB (U) 41*8kB (UM) 20*16kB (U) 0*32kB 0*64kB
> 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 660kB
> [ 2751.551718] 167 total pagecache pages
> [ 2751.555511] 0 pages in swap cache
> [ 2751.559484] Swap cache stats: add 0, delete 0, find 0/0
> [ 2751.564887] Free swap  = 0kB
> [ 2751.567862] Total swap = 0kB
> [ 2751.571632] 8192 pages RAM
> [ 2751.574438] 0 pages HighMem/MovableOnly
> [ 2751.578399] 1192 pages reserved
> [ 2751.582198] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds
> swapents oom_score_adj name
> [ 2751.591592] [  395]     0   395      294       15       3
> 0        0             0 ubusd
> [ 2751.601044] [  396]     0   396      223       10       3
> 0        0             0 askfirst
> [ 2751.610769] [  659]     0   659      306       35       3
> 0        0             0 logd
> [ 2751.620386] [  695]     0   695      408       40       4
> 0        0             0 netifd
> [ 2751.629944] [  722]     0   722      320       21       3
> 0        0             0 odhcpd
> [ 2751.639492] [  754]     0   754      264       10       3
> 0        0             0 dropbear
> [ 2751.648664] [  856]     0   856      294       15       3
> 0        0             0 ntpd
> [ 2751.658041] [  915]   453   915      262       18       4
> 0        0             0 dnsmasq
> [ 2751.667679] [ 1003]     0  1003      229       11       3
> 0        0             0 odhcp6c
> [ 2751.677561] [ 1051]     0  1051      281       25       3
> 0        0             0 dropbear
> [ 2751.687291] [ 1052]     0  1052      295       11       3
> 0        0             0 ash
> [ 2751.696563] Out of memory: Kill process 695 (netifd) score 6 or
> sacrifice child
> [ 2751.704694] Killed process 1003 (odhcp6c) total-vm:916kB,
> anon-rss:40kB, file-rss:4kB
> root@lede:/tmp# Connection to 192.168.1.1 closed.
>



-- 
Jason A. Donenfeld
Deep Space Explorer
fr: +33 6 51 90 82 66
us: +1 513 476 1200
www.jasondonenfeld.com
www.zx2c4.com
zx2c4.com/keys/AB9942E6D4A4CFC3412620A749FC7012A5DE03AE.asc

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-08-02 23:39           ` jens
  2016-08-03  1:14             ` Jason A. Donenfeld
@ 2016-08-03  6:48             ` René van Dorst
  2016-08-03 16:14               ` jens
  1 sibling, 1 reply; 20+ messages in thread
From: René van Dorst @ 2016-08-03  6:48 UTC (permalink / raw)
  To: wireguard

Hi Jens,

I would like to share my results on a MIPS cpu.

I also tested wireguard on a router. TP-Link WR1043ND v1.08 with a  
Atheros AR9132 400MHz cpu.
Running LEDE 28-july-2016, wireguard & iperf3 via packagemanager.
For my test I run wireguard and iperf3 on the same device on both sides.
Other side is a AMD A6-5400 with debian unstable running inside KVM.
Both connected to a gigabit switch.

My results iperf:
- Plain ~100MBits
- WG ~24Mbits (TCP test)

Greats,

René van Dorst.

Quoting jens <jens@viisauksena.de>:

> On 27.07.2016 13:05, Jason A. Donenfeld wrote:
>
>> On Wed, Jul 27, 2016 at 12:26 PM, Jens Viisauksena  
>> <jens@viisauksena.de> wrote:
>>> It should however not lead to netifd outofmemory, load of 2.6 and the
>>> oomkiller berserking around at all... even if its not directly wg fault.
>> One thing to try would be removing these lines from src/socket.c:
>>
>> socket.c
>> 386:    sk_clear_memalloc(sock);
>> 394:    sk_set_memalloc(sock->sk);
>>
>> I'd be interested to learn if that fixes things.
>
> sorry if you waited for answers ..
> we redo the testing with latest kernel
> [    0.000000] Linux version 4.4.15 (fuzzle@builder) (gcc version 5.4.0
> (LEDE GCC 5.4.0 r1119) ) #3 Thu Jul 28 01:05:08 UTC 2016
> build from latest trunk by ourselve, before we use default packages and
> lede like this
> [    0.000000] Linux version 4.4.15 (buildbot@builds) (gcc version 5.4.0
> (LEDE GCC 5.4.0 r1114) ) #2 Tue Jul 26 17:57:45 UTC 2016
>
> and with wireguard source from 27.7. also including your suggestions.
>
> still the same
>
> more detailed  :
>
> we got out of memory and big cpuload when testing iperf with udp
> packets, (we forget to notice that before in our first testings which
> mode killed all the memory)
> and from the heavy load and low memory lede/openwrt shut down stuff and
> things broke apart
> (Reminder, Lede/Openwrt on TP link 841 v11 with 650 Mhz CPU and 32Mb Ram)
>
> with tcp traffic we got this time stable 16 Mbit, which sounds like a
> reasonable limit for this kind of small cpu without any optimzation.
> Also cpu load was lower.
>
> we wonder how to use more sophisticated tools on our testsetup with 2
> real tplink routers connected + behind each one laptop to measure
> throughput with iperf3. this maybe is not possible at all without
> getting serial console access
>
> 2 lessons learned: 1. problem arises with upd traffic and result quickly
> in out of memory (with transmission peak at the beginning higher than
> the 15 mbit with tcp packets))  2. tcp is stable with 15-16 Mbit
> some more thoughts: all this could maybe slightly increased by code
> optimization, slightly different cipher, maybe encrypting is harder than
> decrypting, which means download will be faster - while encryption is
> happen on big servers in Net
>
> to compare again with fastd - this are the numbers we could get fastd
> through the cpu/wire (we didnt did that testing in this special setup,
> maybe some time soon - at least i am curious)
>
>
>
>
>
> ### just the dmesg before crashing
> [    0.000000] MyLoader: sysp=9fb7db5d, boardp=d56f3f67, parts=bfae9f0c
> [    0.000000] bootconsole [early0] enabled
> [    0.000000] CPU0 revision is: 00019374 (MIPS 24Kc)
> [    0.000000] SoC: Qualcomm Atheros QCA9533 ver 2 rev 0
> [    0.000000] Determined physical RAM map:
> [    0.000000]  memory: 02000000 @ 00000000 (usable)
> [    0.000000] Initrd not found or empty - disabling initrd
> [    0.000000] No valid device tree found, continuing without
> [    0.000000] Zone ranges:
> [    0.000000]   Normal   [mem 0x0000000000000000-0x0000000001ffffff]
> [    0.000000] Movable zone start for each node
> [    0.000000] Early memory node ranges
> [    0.000000]   node   0: [mem 0x0000000000000000-0x0000000001ffffff]
> [    0.000000] Initmem setup node 0 [mem
> 0x0000000000000000-0x0000000001ffffff]
> [    0.000000] On node 0 totalpages: 8192
> [    0.000000] free_area_init_node: node 0, pgdat 804003d0, node_mem_map
> 81000000
> [    0.000000]   Normal zone: 64 pages used for memmap
> [    0.000000]   Normal zone: 0 pages reserved
> [    0.000000]   Normal zone: 8192 pages, LIFO batch:0
> [    0.000000] Primary instruction cache 64kB, VIPT, 4-way, linesize 32
> bytes.
> [    0.000000] Primary data cache 32kB, 4-way, VIPT, cache aliases,
> linesize 32 bytes
> [    0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
> [    0.000000] pcpu-alloc: [0] 0
> [    0.000000] Built 1 zonelists in Zone order, mobility grouping on.
> Total pages: 8128
> [    0.000000] Kernel command line:  board=TL-WR841N-v11
> console=ttyS0,115200 rootfstype=squashfs,jffs2 noinitrd
> [    0.000000] PID hash table entries: 128 (order: -3, 512 bytes)
> [    0.000000] Dentry cache hash table entries: 4096 (order: 2, 16384 bytes)
> [    0.000000] Inode-cache hash table entries: 2048 (order: 1, 8192 bytes)
> [    0.000000] Writing ErrCtl register=00000000
> [    0.000000] Readback ErrCtl register=00000000
> [    0.000000] Memory: 27740K/32768K available (2933K kernel code, 151K
> rwdata, 744K rodata, 260K init, 200K bss, 5028K reserved, 0K cma-reserved)
> [    0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
> [    0.000000] NR_IRQS:51
> [    0.000000] Clocks: CPU:650.000MHz, DDR:393.066MHz, AHB:216.666MHz,
> Ref:25.000MHz
> [    0.000000] clocksource: MIPS: mask: 0xffffffff max_cycles:
> 0xffffffff, max_idle_ns: 5880801374 ns
> [    0.000009] sched_clock: 32 bits at 325MHz, resolution 3ns, wraps
> every 6607641598ns
> [    0.008234] Calibrating delay loop... 432.53 BogoMIPS (lpj=2162688)
> [    0.071106] pid_max: default: 32768 minimum: 301
> [    0.076110] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
> [    0.083096] Mountpoint-cache hash table entries: 1024 (order: 0, 4096
> bytes)
> [    0.093471] clocksource: jiffies: mask: 0xffffffff max_cycles:
> 0xffffffff, max_idle_ns: 19112604462750000 ns
> [    0.104645] NET: Registered protocol family 16
> [    0.110870] MIPS: machine is TP-LINK TL-WR841N/ND v11
> [    0.568855] clocksource: Switched to clocksource MIPS
> [    0.575559] NET: Registered protocol family 2
> [    0.581064] TCP established hash table entries: 1024 (order: 0, 4096
> bytes)
> [    0.588427] TCP bind hash table entries: 1024 (order: 0, 4096 bytes)
> [    0.595202] TCP: Hash tables configured (established 1024 bind 1024)
> [    0.602025] UDP hash table entries: 256 (order: 0, 4096 bytes)
> [    0.608200] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes)
> [    0.615203] NET: Registered protocol family 1
> [    0.619896] PCI: CLS 0 bytes, default 32
> [    0.620920] futex hash table entries: 256 (order: -1, 3072 bytes)
> [    0.644082] squashfs: version 4.0 (2009/01/31) Phillip Lougher
> [    0.650332] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME)
> (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
> [    0.663484] io scheduler noop registered
> [    0.667635] io scheduler deadline registered (default)
> [    0.673325] Serial: 8250/16550 driver, 1 ports, IRQ sharing disabled
> [    0.680545] console [ttyS0] disabled
> [    0.704475] serial8250.0: ttyS0 at MMIO 0x18020000 (irq = 11,
> base_baud = 1562500) is a 16550A
> [    0.713586] console [ttyS0] enabled
> [    0.721147] bootconsole [early0] disabled
> [    0.732999] m25p80 spi0.0: found gd25q32, expected m25p80
> [    0.738601] m25p80 spi0.0: gd25q32 (4096 Kbytes)
> [    0.744708] 5 tp-link partitions found on MTD device spi0.0
> [    0.750531] Creating 5 MTD partitions on "spi0.0":
> [    0.755489] 0x000000000000-0x000000020000 : "u-boot"
> [    0.762184] 0x000000020000-0x000000162710 : "kernel"
> [    0.769118] 0x000000162710-0x0000003f0000 : "rootfs"
> [    0.775937] mtd: device 2 (rootfs) set to be root filesystem
> [    0.781932] 1 squashfs-split partitions found on MTD device rootfs
> [    0.788320] 0x000000340000-0x0000003f0000 : "rootfs_data"
> [    0.795617] 0x0000003f0000-0x000000400000 : "art"
> [    0.802259] 0x000000020000-0x0000003f0000 : "firmware"
> [    0.829961] libphy: ag71xx_mdio: probed
> [    1.421422] ag71xx-mdio.1: Found an AR934X built-in switch
> [    1.464748] eth0: Atheros AG71xx at 0xba000000, irq 5, mode:GMII
> [    2.061807] ag71xx ag71xx.0: connected to PHY at ag71xx-mdio.1:04
> [uid=004dd042, driver=Generic PHY]
> [    2.072011] eth1: Atheros AG71xx at 0xb9000000, irq 4, mode:MII
> [    2.080973] NET: Registered protocol family 10
> [    2.090540] NET: Registered protocol family 17
> [    2.095219] bridge: automatic filtering via arp/ip/ip6tables has been
> deprecated. Update your scripts to load br_netfilter if you need this.
> [    2.108444] 8021q: 802.1Q VLAN Support v1.8
> [    2.121115] VFS: Mounted root (squashfs filesystem) readonly on
> device 31:2.
> [    2.130267] Freeing unused kernel memory: 260K (8041f000 - 80460000)
> [    3.221171] init: Console is alive
> [    3.224937] init: - watchdog -
> [    4.185893] init: - preinit -
> [    4.817211] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
> [    4.844857] random: procd urandom read with 7 bits of entropy available
> [    6.910299] eth0: link up (1000Mbps/Full duplex)
> [    6.916280] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
> [    8.090413] jffs2_scan_eraseblock(): End of filesystem marker found
> at 0x10000
> [    8.097897] jffs2_build_filesystem(): unlocking the mtd device... done.
> [    8.104748] jffs2_build_filesystem(): erasing all blocks after the
> end marker... done.
> [   10.739288] jffs2: notice: (349) jffs2_build_xattr_subsystem:
> complete building xattr subsystem, 0 of xdatum (0 unchecked, 0 orphan)
> and 0 of xref (0 dead, 0 orphan) found.
> [   10.756968] mount_root: overlay filesystem has not been fully
> initialized yet
> [   10.768400] mount_root: switching to jffs2 overlay
> [   10.999300] urandom-seed: Seed file not found (/etc/urandom.seed)
> [   11.109948] eth0: link down
> [   11.125253] procd: - early -
> [   11.128356] procd: - watchdog -
> [   11.738352] procd: - ubus -
> [   11.793781] procd: - init -
> [   12.094265] tun: Universal TUN/TAP device driver, 1.6
> [   12.099567] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
> [   12.120149] wireguard: WireGuard loaded. See www.wireguard.io for
> information.
> [   12.127621] wireguard: (C) Copyright 2015-2016 Jason A. Donenfeld
> <Jason@zx2c4.com>. All Rights Reserved.
> [   12.140039] ip6_tables: (C) 2000-2006 Netfilter Core Team
> [   12.160019] Loading modules backported from Linux version
> wt-2016-06-20-0-gbc17424
> [   12.167850] Backport generated by backports.git
> backports-20160216-7-g5735958
> [   12.178703] ip_tables: (C) 2000-2006 Netfilter Core Team
> [   12.195189] nf_conntrack version 0.5.0 (437 buckets, 1748 max)
> [   12.244145] xt_time: kernel timezone is -0000
> [   12.314522] PPP generic driver version 2.4.2
> [   12.321763] NET: Registered protocol family 24
> [   12.376518] ath: EEPROM regdomain: 0x0
> [   12.376545] ath: EEPROM indicates default country code should be used
> [   12.376554] ath: doing EEPROM country->regdmn map search
> [   12.376576] ath: country maps to regdmn code: 0x3a
> [   12.376587] ath: Country alpha2 being used: US
> [   12.376595] ath: Regpair used: 0x3a
> [   12.388362] ieee80211 phy0: Selected rate control algorithm 'minstrel_ht'
> [   12.392478] ieee80211 phy0: Atheros AR9531 Rev:2 mem=0xb8100000, irq=47
> [   20.576096] device eth0 entered promiscuous mode
> [   20.599684] IPv6: ADDRCONF(NETDEV_UP): br-lan: link is not ready
> [   20.645872] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
> [   22.270331] eth0: link up (1000Mbps/Full duplex)
> [   22.275169] br-lan: port 1(eth0) entered forwarding state
> [   22.280839] br-lan: port 1(eth0) entered forwarding state
> [   22.322565] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
> [   23.352464] eth1: link up (100Mbps/Full duplex)
> [   23.357197] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
> [   24.278939] br-lan: port 1(eth0) entered forwarding state
> [   77.338893] random: nonblocking pool is initialized
> [ 2545.780086] eth0: link down
> [ 2545.783413] br-lan: port 1(eth0) entered disabled state
> [ 2547.280148] eth0: link up (1000Mbps/Full duplex)
> [ 2547.284988] br-lan: port 1(eth0) entered forwarding state
> [ 2547.290680] br-lan: port 1(eth0) entered forwarding state
> [ 2549.288710] br-lan: port 1(eth0) entered forwarding state
> [ 2751.342810] netifd invoked oom-killer: gfp_mask=0x24201ca, order=0,
> oom_score_adj=0
> [ 2751.351333] CPU: 0 PID: 695 Comm: netifd Not tainted 4.4.15 #3
> [ 2751.357358] Stack : 803ba2c4 00000000 00000001 80410000 8197ea80
> 80400d63 8039b9e4 000002b7
> [ 2751.357358]       80463798 80febd1c 00000000 00000006 00001b58
> 800a6820 00000006 ffffffff
> [ 2751.357358]       00000000 00000000 8039f45c 80febbbc 80466542
> 800a47ec 804003d0 00000000
> [ 2751.357358]       00000001 801ef300 00000000 00000000 00000000
> 00000000 00000000 00000000
> [ 2751.357358]       00000000 00000000 00000000 00000000 00000000
> 00000000 00000000 00000000
> [ 2751.357358]       ...
> [ 2751.396800] Call Trace:
> [ 2751.399910] [<80071a20>] show_stack+0x50/0x84
> [ 2751.404425] [<800d2ddc>] dump_header.isra.4+0x48/0x130
> [ 2751.410546] [<800d31b0>] oom_kill_process+0x98/0x440
> [ 2751.415683] [<800d38d0>] out_of_memory+0x2f4/0x330
> [ 2751.421212] [<800d718c>] __alloc_pages_nodemask+0x67c/0x6e8
> [ 2751.427014] [<800d21d0>] filemap_fault+0x254/0x454
> [ 2751.432560] [<800ecafc>] __do_fault+0x3c/0xa8
> [ 2751.437076] [<800efd28>] handle_mm_fault+0x4e0/0xb78
> [ 2751.442797] [<80076638>] __do_page_fault+0x134/0x474
> [ 2751.447940] [<80060820>] ret_from_exception+0x0/0x10
> [ 2751.453625]
> [ 2751.455172] Mem-Info:
> [ 2751.457542] active_anon:246 inactive_anon:4 isolated_anon:0
> [ 2751.457542]  active_file:51 inactive_file:80 isolated_file:0
> [ 2751.457542]  unevictable:0 dirty:0 writeback:0 unstable:0
> [ 2751.457542]  slab_reclaimable:120 slab_unreclaimable:1272
> [ 2751.457542]  mapped:10 shmem:36 pagetables:39 bounce:0
> [ 2751.457542]  free:164 free_pcp:0 free_cma:0
> [ 2751.490694] Normal free:660kB min:664kB low:828kB high:996kB
> active_anon:984kB inactive_anon:16kB active_file:204kB
> inactive_file:320kB unevictable:0kB isolated(anon):0kB
> isolated(file):0kB present:32768kB managed:28000kB mlocked:0kB dirty:0kB
> writeback:0kB mapped:40kB shmem:144kB slab_reclaimable:480kB
> slab_unreclaimable:5088kB kernel_stack:304kB pagetables:156kB
> unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
> writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
> [ 2751.535274] lowmem_reserve[]: 0 0
> [ 2751.539269] Normal: 3*4kB (U) 41*8kB (UM) 20*16kB (U) 0*32kB 0*64kB
> 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 660kB
> [ 2751.551718] 167 total pagecache pages
> [ 2751.555511] 0 pages in swap cache
> [ 2751.559484] Swap cache stats: add 0, delete 0, find 0/0
> [ 2751.564887] Free swap  = 0kB
> [ 2751.567862] Total swap = 0kB
> [ 2751.571632] 8192 pages RAM
> [ 2751.574438] 0 pages HighMem/MovableOnly
> [ 2751.578399] 1192 pages reserved
> [ 2751.582198] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds
> swapents oom_score_adj name
> [ 2751.591592] [  395]     0   395      294       15       3
> 0        0             0 ubusd
> [ 2751.601044] [  396]     0   396      223       10       3
> 0        0             0 askfirst
> [ 2751.610769] [  659]     0   659      306       35       3
> 0        0             0 logd
> [ 2751.620386] [  695]     0   695      408       40       4
> 0        0             0 netifd
> [ 2751.629944] [  722]     0   722      320       21       3
> 0        0             0 odhcpd
> [ 2751.639492] [  754]     0   754      264       10       3
> 0        0             0 dropbear
> [ 2751.648664] [  856]     0   856      294       15       3
> 0        0             0 ntpd
> [ 2751.658041] [  915]   453   915      262       18       4
> 0        0             0 dnsmasq
> [ 2751.667679] [ 1003]     0  1003      229       11       3
> 0        0             0 odhcp6c
> [ 2751.677561] [ 1051]     0  1051      281       25       3
> 0        0             0 dropbear
> [ 2751.687291] [ 1052]     0  1052      295       11       3
> 0        0             0 ash
> [ 2751.696563] Out of memory: Kill process 695 (netifd) score 6 or
> sacrifice child
> [ 2751.704694] Killed process 1003 (odhcp6c) total-vm:916kB,
> anon-rss:40kB, file-rss:4kB
> root@lede:/tmp# Connection to 192.168.1.1 closed.
>
> _______________________________________________
> WireGuard mailing list
> WireGuard@lists.zx2c4.com
> http://lists.zx2c4.com/mailman/listinfo/wireguard

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-08-03  6:48             ` René van Dorst
@ 2016-08-03 16:14               ` jens
  2016-08-03 20:10                 ` René van Dorst
  0 siblings, 1 reply; 20+ messages in thread
From: jens @ 2016-08-03 16:14 UTC (permalink / raw)
  To: wireguard

[-- Attachment #1: Type: text/plain, Size: 18419 bytes --]

On 03.08.2016 08:48, René van Dorst wrote:
> ...
> I also tested wireguard on a router. TP-Link WR1043ND v1.08 with a
> Atheros AR9132 400MHz cpu.
> Running LEDE 28-july-2016, wireguard & iperf3 via packagemanager. 

so you do not observe crashing of the router like we do with the tp-link
wr841Nv11 -

do you also test iperf with udp packets , around 200 Mbit or so ?
acording to openwrt wiki say that 1043v1.xx runs even slower cpu , but
have 8Mb of flash

TL-WR1043ND 	v1-v1.11 	Atheros AR9132 	400 	8 	32 	Atheros AR9100
(integrated) 	b/g/n 	5 	1x 2.0 	Yes

as far as i understand is the lan also on the wifi chip, so this differs
.. 
for the 841v11 it should be QCA9533-AL3A running with 560 MHz with 32 MB
Ram Zentel A3S56D40GTP-50L. switch QCA9533-BL3A built-in

https://wiki.openwrt.org/toh/TP-Link/tl-wr841nd
https://wiki.openwrt.org/toh/TP-Link/tl-wr1043nd

sidenode tplink name convention (to prevent confusion): mainly important
is running number like 1043 or 841 and the hardware revision like v11,
the N or ND are only antenna related, the .123 are factory firmware
revision of the specific hardware revision - which is more important for
us here


On 03.08.2016 08:48, René van Dorst wrote:
> Hi Jens,
>
> I would like to share my results on a MIPS cpu.
>
> I also tested wireguard on a router. TP-Link WR1043ND v1.08 with a
> Atheros AR9132 400MHz cpu.
> Running LEDE 28-july-2016, wireguard & iperf3 via packagemanager.
> For my test I run wireguard and iperf3 on the same device on both sides.
> Other side is a AMD A6-5400 with debian unstable running inside KVM.
> Both connected to a gigabit switch.
>
> My results iperf:
> - Plain ~100MBits
> - WG ~24Mbits (TCP test)
>
> Greats,
>
> René van Dorst.
>
> Quoting jens <jens@viisauksena.de>:
>
>> On 27.07.2016 13:05, Jason A. Donenfeld wrote:
>>
>>> On Wed, Jul 27, 2016 at 12:26 PM, Jens Viisauksena
>>> <jens@viisauksena.de> wrote:
>>>> It should however not lead to netifd outofmemory, load of 2.6 and the
>>>> oomkiller berserking around at all... even if its not directly wg
>>>> fault.
>>> One thing to try would be removing these lines from src/socket.c:
>>>
>>> socket.c
>>> 386:    sk_clear_memalloc(sock);
>>> 394:    sk_set_memalloc(sock->sk);
>>>
>>> I'd be interested to learn if that fixes things.
>>
>> sorry if you waited for answers ..
>> we redo the testing with latest kernel
>> [    0.000000] Linux version 4.4.15 (fuzzle@builder) (gcc version 5.4.0
>> (LEDE GCC 5.4.0 r1119) ) #3 Thu Jul 28 01:05:08 UTC 2016
>> build from latest trunk by ourselve, before we use default packages and
>> lede like this
>> [    0.000000] Linux version 4.4.15 (buildbot@builds) (gcc version 5.4.0
>> (LEDE GCC 5.4.0 r1114) ) #2 Tue Jul 26 17:57:45 UTC 2016
>>
>> and with wireguard source from 27.7. also including your suggestions.
>>
>> still the same
>>
>> more detailed  :
>>
>> we got out of memory and big cpuload when testing iperf with udp
>> packets, (we forget to notice that before in our first testings which
>> mode killed all the memory)
>> and from the heavy load and low memory lede/openwrt shut down stuff and
>> things broke apart
>> (Reminder, Lede/Openwrt on TP link 841 v11 with 650 Mhz CPU and 32Mb
>> Ram)
>>
>> with tcp traffic we got this time stable 16 Mbit, which sounds like a
>> reasonable limit for this kind of small cpu without any optimzation.
>> Also cpu load was lower.
>>
>> we wonder how to use more sophisticated tools on our testsetup with 2
>> real tplink routers connected + behind each one laptop to measure
>> throughput with iperf3. this maybe is not possible at all without
>> getting serial console access
>>
>> 2 lessons learned: 1. problem arises with upd traffic and result quickly
>> in out of memory (with transmission peak at the beginning higher than
>> the 15 mbit with tcp packets))  2. tcp is stable with 15-16 Mbit
>> some more thoughts: all this could maybe slightly increased by code
>> optimization, slightly different cipher, maybe encrypting is harder than
>> decrypting, which means download will be faster - while encryption is
>> happen on big servers in Net
>>
>> to compare again with fastd - this are the numbers we could get fastd
>> through the cpu/wire (we didnt did that testing in this special setup,
>> maybe some time soon - at least i am curious)
>>
>>
>>
>>
>>
>> ### just the dmesg before crashing
>> [    0.000000] MyLoader: sysp=9fb7db5d, boardp=d56f3f67, parts=bfae9f0c
>> [    0.000000] bootconsole [early0] enabled
>> [    0.000000] CPU0 revision is: 00019374 (MIPS 24Kc)
>> [    0.000000] SoC: Qualcomm Atheros QCA9533 ver 2 rev 0
>> [    0.000000] Determined physical RAM map:
>> [    0.000000]  memory: 02000000 @ 00000000 (usable)
>> [    0.000000] Initrd not found or empty - disabling initrd
>> [    0.000000] No valid device tree found, continuing without
>> [    0.000000] Zone ranges:
>> [    0.000000]   Normal   [mem 0x0000000000000000-0x0000000001ffffff]
>> [    0.000000] Movable zone start for each node
>> [    0.000000] Early memory node ranges
>> [    0.000000]   node   0: [mem 0x0000000000000000-0x0000000001ffffff]
>> [    0.000000] Initmem setup node 0 [mem
>> 0x0000000000000000-0x0000000001ffffff]
>> [    0.000000] On node 0 totalpages: 8192
>> [    0.000000] free_area_init_node: node 0, pgdat 804003d0, node_mem_map
>> 81000000
>> [    0.000000]   Normal zone: 64 pages used for memmap
>> [    0.000000]   Normal zone: 0 pages reserved
>> [    0.000000]   Normal zone: 8192 pages, LIFO batch:0
>> [    0.000000] Primary instruction cache 64kB, VIPT, 4-way, linesize 32
>> bytes.
>> [    0.000000] Primary data cache 32kB, 4-way, VIPT, cache aliases,
>> linesize 32 bytes
>> [    0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
>> [    0.000000] pcpu-alloc: [0] 0
>> [    0.000000] Built 1 zonelists in Zone order, mobility grouping on.
>> Total pages: 8128
>> [    0.000000] Kernel command line:  board=TL-WR841N-v11
>> console=ttyS0,115200 rootfstype=squashfs,jffs2 noinitrd
>> [    0.000000] PID hash table entries: 128 (order: -3, 512 bytes)
>> [    0.000000] Dentry cache hash table entries: 4096 (order: 2, 16384
>> bytes)
>> [    0.000000] Inode-cache hash table entries: 2048 (order: 1, 8192
>> bytes)
>> [    0.000000] Writing ErrCtl register=00000000
>> [    0.000000] Readback ErrCtl register=00000000
>> [    0.000000] Memory: 27740K/32768K available (2933K kernel code, 151K
>> rwdata, 744K rodata, 260K init, 200K bss, 5028K reserved, 0K
>> cma-reserved)
>> [    0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1,
>> Nodes=1
>> [    0.000000] NR_IRQS:51
>> [    0.000000] Clocks: CPU:650.000MHz, DDR:393.066MHz, AHB:216.666MHz,
>> Ref:25.000MHz
>> [    0.000000] clocksource: MIPS: mask: 0xffffffff max_cycles:
>> 0xffffffff, max_idle_ns: 5880801374 ns
>> [    0.000009] sched_clock: 32 bits at 325MHz, resolution 3ns, wraps
>> every 6607641598ns
>> [    0.008234] Calibrating delay loop... 432.53 BogoMIPS (lpj=2162688)
>> [    0.071106] pid_max: default: 32768 minimum: 301
>> [    0.076110] Mount-cache hash table entries: 1024 (order: 0, 4096
>> bytes)
>> [    0.083096] Mountpoint-cache hash table entries: 1024 (order: 0, 4096
>> bytes)
>> [    0.093471] clocksource: jiffies: mask: 0xffffffff max_cycles:
>> 0xffffffff, max_idle_ns: 19112604462750000 ns
>> [    0.104645] NET: Registered protocol family 16
>> [    0.110870] MIPS: machine is TP-LINK TL-WR841N/ND v11
>> [    0.568855] clocksource: Switched to clocksource MIPS
>> [    0.575559] NET: Registered protocol family 2
>> [    0.581064] TCP established hash table entries: 1024 (order: 0, 4096
>> bytes)
>> [    0.588427] TCP bind hash table entries: 1024 (order: 0, 4096 bytes)
>> [    0.595202] TCP: Hash tables configured (established 1024 bind 1024)
>> [    0.602025] UDP hash table entries: 256 (order: 0, 4096 bytes)
>> [    0.608200] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes)
>> [    0.615203] NET: Registered protocol family 1
>> [    0.619896] PCI: CLS 0 bytes, default 32
>> [    0.620920] futex hash table entries: 256 (order: -1, 3072 bytes)
>> [    0.644082] squashfs: version 4.0 (2009/01/31) Phillip Lougher
>> [    0.650332] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME)
>> (CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
>> [    0.663484] io scheduler noop registered
>> [    0.667635] io scheduler deadline registered (default)
>> [    0.673325] Serial: 8250/16550 driver, 1 ports, IRQ sharing disabled
>> [    0.680545] console [ttyS0] disabled
>> [    0.704475] serial8250.0: ttyS0 at MMIO 0x18020000 (irq = 11,
>> base_baud = 1562500) is a 16550A
>> [    0.713586] console [ttyS0] enabled
>> [    0.721147] bootconsole [early0] disabled
>> [    0.732999] m25p80 spi0.0: found gd25q32, expected m25p80
>> [    0.738601] m25p80 spi0.0: gd25q32 (4096 Kbytes)
>> [    0.744708] 5 tp-link partitions found on MTD device spi0.0
>> [    0.750531] Creating 5 MTD partitions on "spi0.0":
>> [    0.755489] 0x000000000000-0x000000020000 : "u-boot"
>> [    0.762184] 0x000000020000-0x000000162710 : "kernel"
>> [    0.769118] 0x000000162710-0x0000003f0000 : "rootfs"
>> [    0.775937] mtd: device 2 (rootfs) set to be root filesystem
>> [    0.781932] 1 squashfs-split partitions found on MTD device rootfs
>> [    0.788320] 0x000000340000-0x0000003f0000 : "rootfs_data"
>> [    0.795617] 0x0000003f0000-0x000000400000 : "art"
>> [    0.802259] 0x000000020000-0x0000003f0000 : "firmware"
>> [    0.829961] libphy: ag71xx_mdio: probed
>> [    1.421422] ag71xx-mdio.1: Found an AR934X built-in switch
>> [    1.464748] eth0: Atheros AG71xx at 0xba000000, irq 5, mode:GMII
>> [    2.061807] ag71xx ag71xx.0: connected to PHY at ag71xx-mdio.1:04
>> [uid=004dd042, driver=Generic PHY]
>> [    2.072011] eth1: Atheros AG71xx at 0xb9000000, irq 4, mode:MII
>> [    2.080973] NET: Registered protocol family 10
>> [    2.090540] NET: Registered protocol family 17
>> [    2.095219] bridge: automatic filtering via arp/ip/ip6tables has been
>> deprecated. Update your scripts to load br_netfilter if you need this.
>> [    2.108444] 8021q: 802.1Q VLAN Support v1.8
>> [    2.121115] VFS: Mounted root (squashfs filesystem) readonly on
>> device 31:2.
>> [    2.130267] Freeing unused kernel memory: 260K (8041f000 - 80460000)
>> [    3.221171] init: Console is alive
>> [    3.224937] init: - watchdog -
>> [    4.185893] init: - preinit -
>> [    4.817211] IPv6: ADDRCONF(NETDEV_UP): eth0: link is not ready
>> [    4.844857] random: procd urandom read with 7 bits of entropy
>> available
>> [    6.910299] eth0: link up (1000Mbps/Full duplex)
>> [    6.916280] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
>> [    8.090413] jffs2_scan_eraseblock(): End of filesystem marker found
>> at 0x10000
>> [    8.097897] jffs2_build_filesystem(): unlocking the mtd device...
>> done.
>> [    8.104748] jffs2_build_filesystem(): erasing all blocks after the
>> end marker... done.
>> [   10.739288] jffs2: notice: (349) jffs2_build_xattr_subsystem:
>> complete building xattr subsystem, 0 of xdatum (0 unchecked, 0 orphan)
>> and 0 of xref (0 dead, 0 orphan) found.
>> [   10.756968] mount_root: overlay filesystem has not been fully
>> initialized yet
>> [   10.768400] mount_root: switching to jffs2 overlay
>> [   10.999300] urandom-seed: Seed file not found (/etc/urandom.seed)
>> [   11.109948] eth0: link down
>> [   11.125253] procd: - early -
>> [   11.128356] procd: - watchdog -
>> [   11.738352] procd: - ubus -
>> [   11.793781] procd: - init -
>> [   12.094265] tun: Universal TUN/TAP device driver, 1.6
>> [   12.099567] tun: (C) 1999-2004 Max Krasnyansky <maxk@qualcomm.com>
>> [   12.120149] wireguard: WireGuard loaded. See www.wireguard.io for
>> information.
>> [   12.127621] wireguard: (C) Copyright 2015-2016 Jason A. Donenfeld
>> <Jason@zx2c4.com>. All Rights Reserved.
>> [   12.140039] ip6_tables: (C) 2000-2006 Netfilter Core Team
>> [   12.160019] Loading modules backported from Linux version
>> wt-2016-06-20-0-gbc17424
>> [   12.167850] Backport generated by backports.git
>> backports-20160216-7-g5735958
>> [   12.178703] ip_tables: (C) 2000-2006 Netfilter Core Team
>> [   12.195189] nf_conntrack version 0.5.0 (437 buckets, 1748 max)
>> [   12.244145] xt_time: kernel timezone is -0000
>> [   12.314522] PPP generic driver version 2.4.2
>> [   12.321763] NET: Registered protocol family 24
>> [   12.376518] ath: EEPROM regdomain: 0x0
>> [   12.376545] ath: EEPROM indicates default country code should be used
>> [   12.376554] ath: doing EEPROM country->regdmn map search
>> [   12.376576] ath: country maps to regdmn code: 0x3a
>> [   12.376587] ath: Country alpha2 being used: US
>> [   12.376595] ath: Regpair used: 0x3a
>> [   12.388362] ieee80211 phy0: Selected rate control algorithm
>> 'minstrel_ht'
>> [   12.392478] ieee80211 phy0: Atheros AR9531 Rev:2 mem=0xb8100000,
>> irq=47
>> [   20.576096] device eth0 entered promiscuous mode
>> [   20.599684] IPv6: ADDRCONF(NETDEV_UP): br-lan: link is not ready
>> [   20.645872] IPv6: ADDRCONF(NETDEV_UP): eth1: link is not ready
>> [   22.270331] eth0: link up (1000Mbps/Full duplex)
>> [   22.275169] br-lan: port 1(eth0) entered forwarding state
>> [   22.280839] br-lan: port 1(eth0) entered forwarding state
>> [   22.322565] IPv6: ADDRCONF(NETDEV_CHANGE): br-lan: link becomes ready
>> [   23.352464] eth1: link up (100Mbps/Full duplex)
>> [   23.357197] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
>> [   24.278939] br-lan: port 1(eth0) entered forwarding state
>> [   77.338893] random: nonblocking pool is initialized
>> [ 2545.780086] eth0: link down
>> [ 2545.783413] br-lan: port 1(eth0) entered disabled state
>> [ 2547.280148] eth0: link up (1000Mbps/Full duplex)
>> [ 2547.284988] br-lan: port 1(eth0) entered forwarding state
>> [ 2547.290680] br-lan: port 1(eth0) entered forwarding state
>> [ 2549.288710] br-lan: port 1(eth0) entered forwarding state
>> [ 2751.342810] netifd invoked oom-killer: gfp_mask=0x24201ca, order=0,
>> oom_score_adj=0
>> [ 2751.351333] CPU: 0 PID: 695 Comm: netifd Not tainted 4.4.15 #3
>> [ 2751.357358] Stack : 803ba2c4 00000000 00000001 80410000 8197ea80
>> 80400d63 8039b9e4 000002b7
>> [ 2751.357358]       80463798 80febd1c 00000000 00000006 00001b58
>> 800a6820 00000006 ffffffff
>> [ 2751.357358]       00000000 00000000 8039f45c 80febbbc 80466542
>> 800a47ec 804003d0 00000000
>> [ 2751.357358]       00000001 801ef300 00000000 00000000 00000000
>> 00000000 00000000 00000000
>> [ 2751.357358]       00000000 00000000 00000000 00000000 00000000
>> 00000000 00000000 00000000
>> [ 2751.357358]       ...
>> [ 2751.396800] Call Trace:
>> [ 2751.399910] [<80071a20>] show_stack+0x50/0x84
>> [ 2751.404425] [<800d2ddc>] dump_header.isra.4+0x48/0x130
>> [ 2751.410546] [<800d31b0>] oom_kill_process+0x98/0x440
>> [ 2751.415683] [<800d38d0>] out_of_memory+0x2f4/0x330
>> [ 2751.421212] [<800d718c>] __alloc_pages_nodemask+0x67c/0x6e8
>> [ 2751.427014] [<800d21d0>] filemap_fault+0x254/0x454
>> [ 2751.432560] [<800ecafc>] __do_fault+0x3c/0xa8
>> [ 2751.437076] [<800efd28>] handle_mm_fault+0x4e0/0xb78
>> [ 2751.442797] [<80076638>] __do_page_fault+0x134/0x474
>> [ 2751.447940] [<80060820>] ret_from_exception+0x0/0x10
>> [ 2751.453625]
>> [ 2751.455172] Mem-Info:
>> [ 2751.457542] active_anon:246 inactive_anon:4 isolated_anon:0
>> [ 2751.457542]  active_file:51 inactive_file:80 isolated_file:0
>> [ 2751.457542]  unevictable:0 dirty:0 writeback:0 unstable:0
>> [ 2751.457542]  slab_reclaimable:120 slab_unreclaimable:1272
>> [ 2751.457542]  mapped:10 shmem:36 pagetables:39 bounce:0
>> [ 2751.457542]  free:164 free_pcp:0 free_cma:0
>> [ 2751.490694] Normal free:660kB min:664kB low:828kB high:996kB
>> active_anon:984kB inactive_anon:16kB active_file:204kB
>> inactive_file:320kB unevictable:0kB isolated(anon):0kB
>> isolated(file):0kB present:32768kB managed:28000kB mlocked:0kB dirty:0kB
>> writeback:0kB mapped:40kB shmem:144kB slab_reclaimable:480kB
>> slab_unreclaimable:5088kB kernel_stack:304kB pagetables:156kB
>> unstable:0kB bounce:0kB free_pcp:0kB local_pcp:0kB free_cma:0kB
>> writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
>> [ 2751.535274] lowmem_reserve[]: 0 0
>> [ 2751.539269] Normal: 3*4kB (U) 41*8kB (UM) 20*16kB (U) 0*32kB 0*64kB
>> 0*128kB 0*256kB 0*512kB 0*1024kB 0*2048kB 0*4096kB = 660kB
>> [ 2751.551718] 167 total pagecache pages
>> [ 2751.555511] 0 pages in swap cache
>> [ 2751.559484] Swap cache stats: add 0, delete 0, find 0/0
>> [ 2751.564887] Free swap  = 0kB
>> [ 2751.567862] Total swap = 0kB
>> [ 2751.571632] 8192 pages RAM
>> [ 2751.574438] 0 pages HighMem/MovableOnly
>> [ 2751.578399] 1192 pages reserved
>> [ 2751.582198] [ pid ]   uid  tgid total_vm      rss nr_ptes nr_pmds
>> swapents oom_score_adj name
>> [ 2751.591592] [  395]     0   395      294       15       3
>> 0        0             0 ubusd
>> [ 2751.601044] [  396]     0   396      223       10       3
>> 0        0             0 askfirst
>> [ 2751.610769] [  659]     0   659      306       35       3
>> 0        0             0 logd
>> [ 2751.620386] [  695]     0   695      408       40       4
>> 0        0             0 netifd
>> [ 2751.629944] [  722]     0   722      320       21       3
>> 0        0             0 odhcpd
>> [ 2751.639492] [  754]     0   754      264       10       3
>> 0        0             0 dropbear
>> [ 2751.648664] [  856]     0   856      294       15       3
>> 0        0             0 ntpd
>> [ 2751.658041] [  915]   453   915      262       18       4
>> 0        0             0 dnsmasq
>> [ 2751.667679] [ 1003]     0  1003      229       11       3
>> 0        0             0 odhcp6c
>> [ 2751.677561] [ 1051]     0  1051      281       25       3
>> 0        0             0 dropbear
>> [ 2751.687291] [ 1052]     0  1052      295       11       3
>> 0        0             0 ash
>> [ 2751.696563] Out of memory: Kill process 695 (netifd) score 6 or
>> sacrifice child
>> [ 2751.704694] Killed process 1003 (odhcp6c) total-vm:916kB,
>> anon-rss:40kB, file-rss:4kB
>> root@lede:/tmp# Connection to 192.168.1.1 closed.
>>
>> _______________________________________________
>> WireGuard mailing list
>> WireGuard@lists.zx2c4.com
>> http://lists.zx2c4.com/mailman/listinfo/wireguard
>
>
>
> _______________________________________________
> WireGuard mailing list
> WireGuard@lists.zx2c4.com
> http://lists.zx2c4.com/mailman/listinfo/wireguard

-- 
make the world nicer, please use PGP encryption


[-- Attachment #2: Type: text/html, Size: 28765 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-08-03 16:14               ` jens
@ 2016-08-03 20:10                 ` René van Dorst
       [not found]                   ` <923cdc92-aa01-758a-5741-99a3f6009dc5@viisauksena.de>
  0 siblings, 1 reply; 20+ messages in thread
From: René van Dorst @ 2016-08-03 20:10 UTC (permalink / raw)
  To: wireguard

[-- Attachment #1: Plaintext Message --]
[-- Type: text/plain, Size: 15952 bytes --]

  Hi Jens,

I see I made a typo about hardware version. It is v1.8 not v1.08.
LEDE version is Reboot (HEAD, r1178) of 29-july-2016.

I ran a 2 hour test for you and it did not crash. May be not long enough?
Results after around 2 hour testing udp iperf3 over wireguard

TOP output: UDP over Wireguard while running
Mem: 22900K used, 4912K free, 632K shrd, 1704K buff, 7096K cached
CPU:   1% usr  97% sys   0% nic   0% idle   0% io   0% irq   0% sirq
Load average: 1.04 1.03 1.00 2/43 3392
  PID  PPID USER     STAT   VSZ %VSZ %CPU COMMAND
 1747  1741 root     R     2800  10%  98% iperf3 -c 10.0.0.1 -u -b 1G -t 7200
  107     2 root     SW       0   0%   1% [kworker/0:1]
 3391  3385 root     R     1180   4%   0% top

UDP over WG
root@lede:~# iperf3 -c 10.0.0.1 -u -b 1G -t 7200
[  4] 7189.00-7190.00 sec  3.06 MBytes  25.7 Mbits/sec  392
[  4] 7190.00-7191.00 sec  3.07 MBytes  25.7 Mbits/sec  393
[  4] 7191.00-7192.00 sec  3.07 MBytes  25.7 Mbits/sec  393
[  4] 7192.00-7193.00 sec  3.06 MBytes  25.7 Mbits/sec  392
[  4] 7193.00-7194.00 sec  3.07 MBytes  25.7 Mbits/sec  393
[  4] 7194.00-7195.00 sec  3.07 MBytes  25.7 Mbits/sec  393
[  4] 7195.00-7196.00 sec  3.07 MBytes  25.7 Mbits/sec  393
[  4] 7196.00-7197.00 sec  3.06 MBytes  25.7 Mbits/sec  392
[  4] 7197.00-7198.00 sec  3.07 MBytes  25.7 Mbits/sec  393
[  4] 7198.00-7199.00 sec  3.07 MBytes  25.7 Mbits/sec  393
[  4] 7199.00-7200.00 sec  3.07 MBytes  25.7 Mbits/sec  393
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Jitter     
Lost/Total Datagrams
[  4]   0.00-7200.00 sec  21.5 GBytes  25.6 Mbits/sec  0.047 ms   
6/2814938 (0.00021%)
[  4] Sent 2814938 datagrams

UDP, plain
root@lede:~# iperf3 -c 192.168.2.222 -u -b 1G -t 7200
Connecting to host 192.168.2.222, port 5201
[  4] local 192.168.2.5 port 48815 connected to 192.168.2.222 port 5201
[ ID] Interval           Transfer     Bandwidth       Total Datagrams
[  4]   0.00-1.00   sec  28.2 MBytes   236 Mbits/sec  3605
[  4]   1.00-2.00   sec  28.0 MBytes   235 Mbits/sec  3582
[  4]   2.00-3.00   sec  28.2 MBytes   237 Mbits/sec  3609
[  4]   3.00-4.00   sec  28.2 MBytes   237 Mbits/sec  3614
[  4]   4.00-5.00   sec  28.1 MBytes   236 Mbits/sec  3598
[  4]   5.00-6.00   sec  28.2 MBytes   236 Mbits/sec  3609
[  4]   6.00-7.00   sec  27.9 MBytes   234 Mbits/sec  3577
[  4]   7.00-8.00   sec  28.2 MBytes   237 Mbits/sec  3609
[  4]   8.00-9.00   sec  28.1 MBytes   236 Mbits/sec  3597
[  4]   9.00-10.00  sec  28.2 MBytes   236 Mbits/sec  3608
[  4]  10.00-11.00  sec  28.1 MBytes   236 Mbits/sec  3593
[  4]  11.00-12.00  sec  28.1 MBytes   235 Mbits/sec  3594

TCP, plain
root@lede:/tmp# iperf3 -c 192.168.2.222
Connecting to host 192.168.2.222, port 5201
[  4] local 192.168.2.7 port 34732 connected to 192.168.2.222 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.02   sec  14.3 MBytes   117 Mbits/sec    2    132 KBytes
[  4]   1.02-2.08   sec  13.8 MBytes   109 Mbits/sec    0    132 KBytes
[  4]   2.08-3.04   sec  12.5 MBytes   109 Mbits/sec    0    132 KBytes
[  4]   3.04-4.00   sec  12.5 MBytes   110 Mbits/sec    1    132 KBytes
[  4]   4.00-5.09   sec  13.8 MBytes   106 Mbits/sec    0    132 KBytes
[  4]   5.09-6.05   sec  12.5 MBytes   109 Mbits/sec    0    132 KBytes
[  4]   6.05-7.01   sec  12.5 MBytes   109 Mbits/sec    0    132 KBytes
[  4]   7.01-8.07   sec  13.8 MBytes   109 Mbits/sec    1    132 KBytes
[  4]   8.07-9.03   sec  12.5 MBytes   109 Mbits/sec    0    132 KBytes
[  4]   9.03-10.12  sec  13.8 MBytes   106 Mbits/sec    0    132 KBytes

TCP over WG
iperf3 -c 10.0.0.1
Connecting to host 10.0.0.1, port 5201
[  4] local 10.0.0.2 port 46832 connected to 10.0.0.1 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.37   sec  3.75 MBytes  22.9 Mbits/sec    0    134 KBytes
[  4]   1.37-2.27   sec  2.50 MBytes  23.4 Mbits/sec    0    134 KBytes
[  4]   2.27-3.17   sec  2.50 MBytes  23.4 Mbits/sec    0    134 KBytes
[  4]   3.17-4.06   sec  2.50 MBytes  23.4 Mbits/sec    0    134 KBytes
[  4]   4.06-5.40   sec  3.75 MBytes  23.6 Mbits/sec    0    141 KBytes
[  4]   5.40-6.28   sec  2.50 MBytes  23.6 Mbits/sec    0    141 KBytes
[  4]   6.28-7.17   sec  2.50 MBytes  23.7 Mbits/sec    0    141 KBytes
[  4]   7.17-8.06   sec  2.50 MBytes  23.7 Mbits/sec    0    141 KBytes
[  4]   8.06-9.38   sec  3.75 MBytes  23.7 Mbits/sec    0    141 KBytes
[  4]   9.38-10.27  sec  2.50 MBytes  23.7 Mbits/sec    0    141 KBytes

DMESG:
root@lede:~# dmesg
[    0.000000] Linux version 4.4.15 (buildbot@builds) (gcc version  
5.4.0 (LEDE GCC 5.4.0 r1178) ) #1 Fri Jul 29 22:27:49 UTC 2016
[    0.000000] MyLoader: sysp=b2822a22, boardp=aaa2a238, parts=aabaa2aa
[    0.000000] bootconsole [early0] enabled
[    0.000000] CPU0 revision is: 00019374 (MIPS 24Kc)
[    0.000000] SoC: Atheros AR9132 rev 2
[    0.000000] Determined physical RAM map:
[    0.000000]  memory: 02000000 @ 00000000 (usable)
[    0.000000] Initrd not found or empty - disabling initrd
[    0.000000] No valid device tree found, continuing without
[    0.000000] Zone ranges:
[    0.000000]   Normal   [mem 0x0000000000000000-0x0000000001ffffff]
[    0.000000] Movable zone start for each node
[    0.000000] Early memory node ranges
[    0.000000]   node   0: [mem 0x0000000000000000-0x0000000001ffffff]
[    0.000000] Initmem setup node 0 [mem  
0x0000000000000000-0x0000000001ffffff]
[    0.000000] On node 0 totalpages: 8192
[    0.000000] free_area_init_node: node 0, pgdat 8042c5d0,  
node_mem_map 81000000
[    0.000000]   Normal zone: 64 pages used for memmap
[    0.000000]   Normal zone: 0 pages reserved
[    0.000000]   Normal zone: 8192 pages, LIFO batch:0
[    0.000000] Primary instruction cache 64kB, VIPT, 4-way, linesize 32 bytes.
[    0.000000] Primary data cache 32kB, 4-way, VIPT, cache aliases,  
linesize 32 bytes
[    0.000000] pcpu-alloc: s0 r0 d32768 u32768 alloc=1*32768
[    0.000000] pcpu-alloc: [0] 0
[    0.000000] Built 1 zonelists in Zone order, mobility grouping on.   
Total pages: 8128
[    0.000000] Kernel command line: board=TL-WR1043ND   
console=ttyS0,115200 rootfstype=squashfs,jffs2 noinitrd
[    0.000000] PID hash table entries: 128 (order: -3, 512 bytes)
[    0.000000] Dentry cache hash table entries: 4096 (order: 2, 16384 bytes)
[    0.000000] Inode-cache hash table entries: 2048 (order: 1, 8192 bytes)
[    0.000000] Writing ErrCtl register=00000000
[    0.000000] Readback ErrCtl register=00000000
[    0.000000] Memory: 27544K/32768K available (3076K kernel code,  
163K rwdata, 772K rodata, 268K init, 205K bss, 5224K reserved, 0K  
cma-reserved)
[    0.000000] SLUB: HWalign=32, Order=0-3, MinObjects=0, CPUs=1, Nodes=1
[    0.000000] NR_IRQS:51
[    0.000000] Clocks: CPU:400.000MHz, DDR:400.000MHz, AHB:200.000MHz,  
Ref:5.000MHz
[    0.000000] clocksource: MIPS: mask: 0xffffffff max_cycles:  
0xffffffff, max_idle_ns: 9556302233 ns
[    0.000013] sched_clock: 32 bits at 200MHz, resolution 5ns, wraps  
every 10737418237ns
[    0.007882] Calibrating delay loop... 265.42 BogoMIPS (lpj=1327104)
[    0.090589] pid_max: default: 32768 minimum: 301
[    0.095359] Mount-cache hash table entries: 1024 (order: 0, 4096 bytes)
[    0.101977] Mountpoint-cache hash table entries: 1024 (order: 0,  
4096 bytes)
[    0.112308] clocksource: jiffies: mask: 0xffffffff max_cycles:  
0xffffffff, max_idle_ns: 19112604462750000 ns
[    0.123737] NET: Registered protocol family 16
[    0.129993] MIPS: machine is TP-LINK TL-WR1043ND
[    0.420183] clocksource: Switched to clocksource MIPS
[    0.426903] NET: Registered protocol family 2
[    0.432523] TCP established hash table entries: 1024 (order: 0, 4096 bytes)
[    0.439500] TCP bind hash table entries: 1024 (order: 0, 4096 bytes)
[    0.445920] TCP: Hash tables configured (established 1024 bind 1024)
[    0.452413] UDP hash table entries: 256 (order: 0, 4096 bytes)
[    0.458259] UDP-Lite hash table entries: 256 (order: 0, 4096 bytes)
[    0.464876] NET: Registered protocol family 1
[    0.469297] PCI: CLS 0 bytes, default 32
[    0.470638] futex hash table entries: 256 (order: -1, 3072 bytes)
[    0.476848] Crashlog allocated RAM at address 0x1f00000
[    0.504001] squashfs: version 4.0 (2009/01/31) Phillip Lougher
[    0.509833] jffs2: version 2.2 (NAND) (SUMMARY) (LZMA) (RTIME)  
(CMODE_PRIORITY) (c) 2001-2006 Red Hat, Inc.
[    0.522683] io scheduler noop registered
[    0.526609] io scheduler deadline registered (default)
[    0.532145] Serial: 8250/16550 driver, 16 ports, IRQ sharing enabled
[    0.542462] console [ttyS0] disabled
[    0.566070] serial8250.0: ttyS0 at MMIO 0x18020000 (irq = 11,  
base_baud = 12500000) is a 16550A
[    0.574774] console [ttyS0] enabled
[    0.581793] bootconsole [early0] disabled
[    0.596153] m25p80 spi0.0: found s25sl064p, expected m25p80
[    0.601854] m25p80 spi0.0: s25sl064p (8192 Kbytes)
[    0.607965] 5 tp-link partitions found on MTD device spi0.0
[    0.613633] Creating 5 MTD partitions on "spi0.0":
[    0.618465] 0x000000000000-0x000000020000 : "u-boot"
[    0.625295] 0x000000020000-0x000000172068 : "kernel"
[    0.632372] 0x000000172068-0x0000007f0000 : "rootfs"
[    0.639339] mtd: device 2 (rootfs) set to be root filesystem
[    0.645169] 1 squashfs-split partitions found on MTD device rootfs
[    0.651419] 0x000000350000-0x0000007f0000 : "rootfs_data"
[    0.658913] 0x0000007f0000-0x000000800000 : "art"
[    0.665756] 0x000000020000-0x0000007f0000 : "firmware"
[    0.674784] Realtek RTL8366RB ethernet switch driver version 0.2.4
[    0.790207] rtl8366rb rtl8366rb: using GPIO pins 18 (SDA) and 19 (SCK)
[    0.796934] rtl8366rb rtl8366rb: RTL5937 ver. 3 chip found
[    1.011341] libphy: rtl8366rb: probed
[    1.332238] eth0: Atheros AG71xx at 0xb9000000, irq 4, mode:RGMII
[    1.341465] NET: Registered protocol family 10
[    1.350976] NET: Registered protocol family 17
[    1.355555] bridge: automatic filtering via arp/ip/ip6tables has  
been deprecated. Update your scripts to load br_netfilter if you need  
this.
[    1.368356] Bridge firewalling registered
[    1.372578] 8021q: 802.1Q VLAN Support v1.8
[    1.378869] hctosys: unable to open rtc device (rtc0)
[    1.391003] VFS: Mounted root (squashfs filesystem) readonly on  
device 31:2.
[    1.399744] Freeing unused kernel memory: 268K (8044d000 - 80490000)
[    2.877793] init: Console is alive
[    2.881562] init: - watchdog -
[    4.201262] init: - preinit -
[    4.941373] ar71xx: pll_reg 0xb8050014: 0x1a000000
[    4.941412] eth0: link up (1000Mbps/Full duplex)
[    4.971517] random: procd urandom read with 8 bits of entropy available
[    8.155982] jffs2: notice: (368) jffs2_build_xattr_subsystem:  
complete building xattr subsystem, 0 of xdatum (0 unchecked, 0 orphan)  
and 0 of xref (0 dead, 0 orphan) found.
[    8.174917] mount_root: switching to jffs2 overlay
[    8.196628] urandom-seed: Seeding with /etc/urandom.seed
[    8.474797] eth0: link down
[    8.492080] procd: - early -
[    8.495110] procd: - watchdog -
[    9.077170] procd: - ubus -
[    9.134480] procd: - init -
[    9.821676] wireguard: WireGuard loaded. See www.wireguard.io for  
information.
[    9.828955] wireguard: (C) Copyright 2015-2016 Jason A. Donenfeld  
<Jason@zx2c4.com>. All Rights Reserved.
[    9.842593] ip6_tables: (C) 2000-2006 Netfilter Core Team
[    9.868011] Loading modules backported from Linux version  
wt-2016-06-20-0-gbc17424
[    9.875704] Backport generated by backports.git  
backports-20160216-7-g5735958
[    9.886894] ip_tables: (C) 2000-2006 Netfilter Core Team
[    9.904908] nf_conntrack version 0.5.0 (434 buckets, 1736 max)
[    9.957814] xt_time: kernel timezone is -0000
[   10.034798] PPP generic driver version 2.4.2
[   10.042280] NET: Registered protocol family 24
[   10.138100] ath: EEPROM regdomain: 0x0
[   10.138128] ath: EEPROM indicates default country code should be used
[   10.138142] ath: doing EEPROM country->regdmn map search
[   10.138166] ath: country maps to regdmn code: 0x3a
[   10.138182] ath: Country alpha2 being used: US
[   10.138195] ath: Regpair used: 0x3a
[   10.179744] ieee80211 phy0: Selected rate control algorithm 'minstrel_ht'
[   10.183754] ieee80211 phy0: Atheros AR9100 MAC/BB Rev:7 AR2133 RF  
Rev:a2 mem=0xb80c0000, irq=2
[   19.824140] ar71xx: pll_reg 0xb8050014: 0x1a000000
[   19.824898] eth0: link up (1000Mbps/Full duplex)
[   19.846332] device eth0.1 entered promiscuous mode
[   19.851233] device eth0 entered promiscuous mode
[   19.867997] br-lan: port 1(eth0.1) entered forwarding state
[   19.873723] br-lan: port 1(eth0.1) entered forwarding state
[   21.870241] br-lan: port 1(eth0.1) entered forwarding state
[   76.210298] random: nonblocking pool is initialized
[  238.115582] br-lan: port 1(eth0.1) entered disabled state
[  238.271197] device eth0.1 left promiscuous mode
[  238.275779] device eth0 left promiscuous mode
[  238.280314] br-lan: port 1(eth0.1) entered disabled state
[  238.301614] IPv6: ADDRCONF(NETDEV_UP): eth0.1: link is not ready
[  238.745386] eth0: link down
[  243.024555] ar71xx: pll_reg 0xb8050014: 0x1a000000
[  243.024616] eth0: link up (1000Mbps/Full duplex)
[  243.046511] device eth0.1 entered promiscuous mode
[  243.051419] device eth0 entered promiscuous mode
[  243.067847] br-lan: port 1(eth0.1) entered forwarding state
[  243.073573] br-lan: port 1(eth0.1) entered forwarding state
[  245.070617] br-lan: port 1(eth0.1) entered forwarding state

This router is a spare router and only used for the vacations to share  
wifi connection.
I would like to use Wireguard to secure my trafic.

Greats,

René van Dorst.
 

> On 03.08.2016 08:48, René van Dorst wrote:
>
>> ...
>> I also tested wireguard on a router. TP-Link WR1043ND v1.08 with a  
>> Atheros AR9132 400MHz cpu.
>> Running LEDE 28-july-2016, wireguard & iperf3 via packagemanager.
>
>   so you do not observe crashing of the router like we do with the  
> tp-link wr841Nv11 -
>
>   do you also test iperf with udp packets , around 200 Mbit or so ?
> acording to openwrt wiki say that 1043v1.xx runs even slower cpu ,  
> but have 8Mb of flash
>
>
>   TL-WR1043ND 	     v1-v1.11 	     Atheros AR9132 	     400 	     8  
> 	     32 	     Atheros AR9100 (integrated) 	     b/g/n 	     5 	      
> 1x 2.0 	     Yes
>
>   as far as i understand is the lan also on the wifi chip, so this  
> differs .. 
> for the 841v11 it should be QCA9533-AL3A running with 560 MHz with  
> 32 MB Ram Zentel A3S56D40GTP-50L. switch QCA9533-BL3A built-in
>
>   https://wiki.openwrt.org/toh/TP-Link/tl-wr841nd
> https://wiki.openwrt.org/toh/TP-Link/tl-wr1043nd
> sidenode tplink name convention (to prevent confusion): mainly  
> important is running number like 1043 or 841 and the hardware  
> revision like v11, the N or ND are only antenna related, the .123  
> are factory firmware revision of the specific hardware revision -  
> which is more important for us here
>
>  

[-- Attachment #2: HTML Message --]
[-- Type: text/html, Size: 21939 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
       [not found]                   ` <923cdc92-aa01-758a-5741-99a3f6009dc5@viisauksena.de>
@ 2016-08-04  8:15                     ` Jason A. Donenfeld
  2016-08-04 11:34                       ` jens
  0 siblings, 1 reply; 20+ messages in thread
From: Jason A. Donenfeld @ 2016-08-04  8:15 UTC (permalink / raw)
  To: jens; +Cc: WireGuard mailing list

[-- Attachment #1: Type: text/plain, Size: 662 bytes --]

Hello Jens,

Your prior communications have not been clear to me, and recently somebody
took the mailing list off the CC. In order to steer this conversation back
on a useful track, please check all that apply:

[  ] I have tried removing "sk_clear_memalloc(sock);" and
"sk_set_memalloc(sock->sk);"
from socket.c, and the problem still continued.
[  ] I have tried removing "sock->sk->sk_sndbuf = INT_MAX;" from socket.c,
and the problem still continued.
[  ] I do not know how or am unable to make changes to the source code,
recompile, and test these changes.
[  ] I have an extra device that I can mail to Jason so that he can debug
the issue.

Thanks,
Jason

[-- Attachment #2: Type: text/html, Size: 1181 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-08-04  8:15                     ` Jason A. Donenfeld
@ 2016-08-04 11:34                       ` jens
  2016-08-10  1:37                         ` jens
  0 siblings, 1 reply; 20+ messages in thread
From: jens @ 2016-08-04 11:34 UTC (permalink / raw)
  To: Jason A. Donenfeld; +Cc: WireGuard mailing list

[-- Attachment #1: Type: text/plain, Size: 1420 bytes --]

On 04.08.2016 10:15, Jason A. Donenfeld wrote:
> Your prior communications have not been clear to me, and recently
> somebody took the mailing list off the CC. In order to steer this
> conversation back on a useful track, please check all that apply:
>
> [ X  ] I have tried removing "sk_clear_memalloc(sock);" and
> "sk_set_memalloc(sock->sk);" from socket.c, and the problem still
> continued.
> [  ] I have tried removing "sock->sk->sk_sndbuf = INT_MAX;" from
> socket.c, and the problem still continued.
> [ X ] I do not know how or am unable to make changes to the source
> code, recompile, and test these changes.
> [ X ] I have an extra device that I can mail to Jason so that he can
> debug the issue.
* for the extra device we may pay new ones , since you easily get them
for 15 euro per part (the TP link 841N)
* buildchain for crosscompiling is ready now, but unfortunately we test
it in our local hack space when there is free time, (n3ph and me) could
be in the next days ..

by the way : the setup from Rene is different: see this same thread -
message from 11h today from Rene.
(mainly he run iperf on one routerdevice direct, and only connect to wg
outside, where we build a uniqe wireguard bridge between two similar
routerdevices and no iperf had to be done (and regulated) on this
devices ... just storms of packets)

-- 
make the world nicer, please use PGP encryption


[-- Attachment #2: Type: text/html, Size: 2288 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-08-04 11:34                       ` jens
@ 2016-08-10  1:37                         ` jens
  2016-08-15 23:05                           ` jens
  0 siblings, 1 reply; 20+ messages in thread
From: jens @ 2016-08-10  1:37 UTC (permalink / raw)
  To: Jason A. Donenfeld; +Cc: WireGuard mailing list

[-- Attachment #1: Type: text/plain, Size: 1471 bytes --]

On 04.08.2016 13:34, jens wrote:
> [ X  ] I have tried removing "sk_clear_memalloc(sock);" and
> "sk_set_memalloc(sock->sk);" from socket.c, and the problem still
> continued.
> [  ] I have tried removing "sock->sk->sk_sndbuf = INT_MAX;" from
> socket.c, and the problem still continued.

we just want to inform you that we want to run some more tests in the
next days, including your suggestions and compare all with fastd (which
we also test), and everything also on a different router - we write to
the list as soon we have some results on this.

Testsetup will stay the same: (see first post for details)
laptop (iperf3) > tp841v11 <- WireGuard -> tp841v11 < laptop (iperf3)

we will test
    fastd,
    default lede Wireguard(20160630),
    latest wireguard(20160808),
    latest wireguard without memalloc(step1) ,
    latest wireguard without sndbuf = INT_MAX (step2)

we will also compare the setup to a similar router : TPLink cpe210 ,
with 64MB ram and 8 mb flash with similar cpu (maybe not with all tests
so far)

the ready to use builded packages (Firmware and ipk) are already laying
here http://openfreiburg.de/freifunk/firmware/
if some want to play around with them.

if there are any suggestions and ideas we could/should add, we are happy
to hear from you
(its all about hunting the out of memory issue on heavy udp traffic
through wireguard tunnel)

greetz

-- 
make the world nicer, please use PGP encryption


[-- Attachment #2: Type: text/html, Size: 2382 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

* Re: [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash
  2016-08-10  1:37                         ` jens
@ 2016-08-15 23:05                           ` jens
  0 siblings, 0 replies; 20+ messages in thread
From: jens @ 2016-08-15 23:05 UTC (permalink / raw)
  To: Jason A. Donenfeld; +Cc: WireGuard mailing list

[-- Attachment #1: Type: text/plain, Size: 1068 bytes --]

by building i ran in the same error described here ..

[LEDE-DEV] kmod-udptunnel{4, 6} packages are empty (Was: Kernel symbol
dependencies and KCONFIG usage for kernel packages)
<https://www.mail-archive.com/search?l=lede-dev@lists.infradead.org&q=subject:%22Re%5C%3A+%5C%5BLEDE%5C-DEV%5C%5D+kmod%5C-udptunnel%5C%7B4%2C+6%5C%7D+packages+are+empty+%5C%28Was%5C%3A+Kernel+symbol+dependencies+and+KCONFIG+usage+for+kernel+packages%5C%29%22&o=newest>

udptunnel4 and 6 are build malicously , so i cant do any of the tests
actually ..

i try this patch
https://git.lede-project.org/?p=lede/hauke/staging.git;a=commitdiff;h=195413a223fb1d6f91927a2c5a8780c7b1829f76
as suggested in
https://www.mail-archive.com/search?l=lede-dev@lists.infradead.org&q=subject:%22%5C%5BLEDE%5C-DEV%5C%5D+Kernel+symbol+dependencies+and+KCONFIG+usage+for+kernel%09packages%22&o=newest

sorry for that .. but all buildings from my side before to test you
suggestions were faulty , so i have to solve this before - which again
takes some time

-- 
make the world nicer, please use PGP encryption


[-- Attachment #2: Type: text/html, Size: 1944 bytes --]

^ permalink raw reply	[flat|nested] 20+ messages in thread

end of thread, other threads:[~2016-08-15 23:04 UTC | newest]

Thread overview: 20+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2016-07-27  5:55 [WireGuard] LEDE / OpenWrt test - on TP-Link841Nv11 - 15MBs and crash jens
2016-07-27  8:38 ` Jason A. Donenfeld
2016-07-27 10:13   ` Jens Viisauksena
2016-07-27 10:14     ` Jason A. Donenfeld
2016-07-27 10:26       ` Jens Viisauksena
2016-07-27 11:05         ` Jason A. Donenfeld
2016-07-27 15:02           ` Michael Gerlach
2016-07-28 11:48             ` Jason A. Donenfeld
2016-07-28 19:16               ` Michael Gerlach
2016-07-29 11:08               ` Michael Gerlach
2016-07-29 12:56                 ` Jason A. Donenfeld
2016-08-02 23:39           ` jens
2016-08-03  1:14             ` Jason A. Donenfeld
2016-08-03  6:48             ` René van Dorst
2016-08-03 16:14               ` jens
2016-08-03 20:10                 ` René van Dorst
     [not found]                   ` <923cdc92-aa01-758a-5741-99a3f6009dc5@viisauksena.de>
2016-08-04  8:15                     ` Jason A. Donenfeld
2016-08-04 11:34                       ` jens
2016-08-10  1:37                         ` jens
2016-08-15 23:05                           ` jens

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.