[Bug reporting] kernel panic during handle the dst unreach icmp msg.

netdev.vger.kernel.org archive mirror
 help / color / mirror / Atom feed

* [Bug reporting] kernel panic during handle the dst unreach icmp msg.
       [not found] <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p1>
@ 2019-02-14  7:46 ` 배석진
  2019-02-14 17:15   ` Eric Dumazet
       [not found]   ` <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p2>
  0 siblings, 2 replies; 8+ messages in thread
From: 배석진 @ 2019-02-14  7:46 UTC (permalink / raw)
  To: netdev; +Cc: 배석진, 박종언

Dear all,


https://www.mail-archive.com/netdev@vger.kernel.org/msg256527.html

as we concerned before at above mail thread,
we faced a problem cased by not removed socket.

(from now, 'the socket' means the socket alloced at 0xFFFFFFC0051E5E00)

#1. the socket is state in TIME_WAIT1. maybe it's process closed the socket.
    below is memory dump information with Trace32.

  (struct sock *)0xFFFFFFC0051E5E00 = 0xFFFFFFC0051E5E00 = end+0x3FF9E4CE00 -> (
    __sk_common = (
       ...
       skc_rcv_saddr = 0x0200A8C0,   ==> 192.168.0.2
       ...
       skc_state = 4,                ==> TIME_WAIT1
       ...
       skc_flags = 0x4301,           ==> SOCK_DEAD(0x01) set


#2. user changed WIFI AP to another one, so previous netdevice deleted and destroied it's sockets.

[60392.948657][4:            netd] 02-13 00:39:32.095  5249  5323 I NetdDestroyed 30 sockets on 192.168.0.2 in 2.7 ms
[60392.948705][4:            netd] 02-13 00:39:32.095  5249  5323 D Netdnotify() code: 614, msg: Address removed 192.168.0.2/24 wlan0 128 0

  --> the socket will be exist for a while.
      because of 'sock_diag_destory() -> tcp_abort()' can not call tcp_done() for the socket.
      but clearing the socket's sk_write_queue by calling tcp_write_queue_purge(sk).


#3. icmp msg(dst unreach) came for sent packet by the socket.
    to retransmit them, lookup sk and fint it. (because the socket still exist)
    but it's sk_write_queue was already cleared so has no skb to send.
    and make the kernel bug.

<4>[60392.948306] I[1:    ksoftirqd/1:   19] ------------[ cut here ]------------
<0>[60392.948334] I[1:    ksoftirqd/1:   19] kernel BUG at net/ipv4/tcp_ipv4.c:519!
<2>[60392.948344] I[1:    ksoftirqd/1:   19] sec_debug_set_extra_info_fault = BUG / 0xffffff80090351d0
<0>[60392.948386] I[1:    ksoftirqd/1:   19] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP
...
<4>[60392.950676] I[1:    ksoftirqd/1:   19] PC is at tcp_v4_err+0x4b0/0x4bc
<4>[60392.950684] I[1:    ksoftirqd/1:   19] LR is at tcp_v4_err+0x3ac/0x4bc


370 void tcp_v4_err(struct sk_buff *icmp_skb, u32 info)
371 {
        ...
516		icsk->icsk_rto = inet_csk_rto_backoff(icsk, TCP_RTO_MAX);
517
518		skb = tcp_write_queue_head(sk);
519		BUG_ON(!skb);
520
521		tcp_mstamp_refresh(tp);


we know that the line 519 removed on latest state. instead this will be shown to kernel panic.
how about below change? do not retransmit packets when socket was already closed.

best regards,



From: soukjin bae <soukjin.bae@samsung.com>
Date: Wen, 14 Jan 2019 14:26:35 +0900
Subject: net: Don't retransmit packets when socket was already closed
 
Signed-off-by: soukjin bae <soukjin.bae@samsung.com>
Signed-off-by: jongeon park <jongeon.park@samsung.com>
---
 net/ipv4/tcp_ipv4 | 4 ++++
 1 file changed, 4 insertions(+)

diff --git a/net/ipv4/tcp_ipv4 b/net/ipv4/tcp_ipv4
index fe4daf6..654bd19 100755
--- a/net/ipv4/tcp_ipv4
+++ b/net/ipv4/tcp_ipv4

@@ -442,6 +465,10 @@ void tcp_v4_err(struct sk_buff *icmp_skb, u32 info)
 		err = EPROTO;
 		break;
 	case ICMP_DEST_UNREACH:
+		/* Don't retransmit packets when socket was already closed */
+		if (sock_flag(sk, SOCK_DEAD))
+			goto out;
+
 		if (code > NR_ICMP_UNREACH)
 			goto out;

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: [Bug reporting] kernel panic during handle the dst unreach icmp msg.
  2019-02-14  7:46 ` [Bug reporting] kernel panic during handle the dst unreach icmp msg 배석진
@ 2019-02-14 17:15   ` Eric Dumazet
       [not found]   ` <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p2>
  1 sibling, 0 replies; 8+ messages in thread
From: Eric Dumazet @ 2019-02-14 17:15 UTC (permalink / raw)
  To: soukjin.bae, netdev
  Cc: 박종언, Steffen Klassert, Herbert Xu



On 02/13/2019 11:46 PM, 배석진 wrote:
> Dear all,
> 
> 
> https://www.mail-archive.com/netdev@vger.kernel.org/msg256527.html
> 
> as we concerned before at above mail thread,
> we faced a problem cased by not removed socket.
> 
> (from now, 'the socket' means the socket alloced at 0xFFFFFFC0051E5E00)
> 
> #1. the socket is state in TIME_WAIT1. maybe it's process closed the socket.
>     below is memory dump information with Trace32.
> 
>   (struct sock *)0xFFFFFFC0051E5E00 = 0xFFFFFFC0051E5E00 = end+0x3FF9E4CE00 -> (
>     __sk_common = (
>        ...
>        skc_rcv_saddr = 0x0200A8C0,   ==> 192.168.0.2
>        ...
>        skc_state = 4,                ==> TIME_WAIT1
>        ...
>        skc_flags = 0x4301,           ==> SOCK_DEAD(0x01) set
> 
> 
> #2. user changed WIFI AP to another one, so previous netdevice deleted and destroied it's sockets.
> 
> [60392.948657][4:            netd] 02-13 00:39:32.095  5249  5323 I NetdDestroyed 30 sockets on 192.168.0.2 in 2.7 ms
> [60392.948705][4:            netd] 02-13 00:39:32.095  5249  5323 D Netdnotify() code: 614, msg: Address removed 192.168.0.2/24 wlan0 128 0
> 
>   --> the socket will be exist for a while.
>       because of 'sock_diag_destory() -> tcp_abort()' can not call tcp_done() for the socket.
>       but clearing the socket's sk_write_queue by calling tcp_write_queue_purge(sk).
> 
> 
> #3. icmp msg(dst unreach) came for sent packet by the socket.
>     to retransmit them, lookup sk and fint it. (because the socket still exist)
>     but it's sk_write_queue was already cleared so has no skb to send.
>     and make the kernel bug.
> 
> <4>[60392.948306] I[1:    ksoftirqd/1:   19] ------------[ cut here ]------------
> <0>[60392.948334] I[1:    ksoftirqd/1:   19] kernel BUG at net/ipv4/tcp_ipv4.c:519!
> <2>[60392.948344] I[1:    ksoftirqd/1:   19] sec_debug_set_extra_info_fault = BUG / 0xffffff80090351d0
> <0>[60392.948386] I[1:    ksoftirqd/1:   19] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP
> ...
> <4>[60392.950676] I[1:    ksoftirqd/1:   19] PC is at tcp_v4_err+0x4b0/0x4bc
> <4>[60392.950684] I[1:    ksoftirqd/1:   19] LR is at tcp_v4_err+0x3ac/0x4bc
> 
> 
> 370 void tcp_v4_err(struct sk_buff *icmp_skb, u32 info)
> 371 {
>         ...
> 516		icsk->icsk_rto = inet_csk_rto_backoff(icsk, TCP_RTO_MAX);
> 517
> 518		skb = tcp_write_queue_head(sk);
> 519		BUG_ON(!skb);
> 520
> 521		tcp_mstamp_refresh(tp);
> 
> 
> we know that the line 519 removed on latest state. instead this will be shown to kernel panic.
> how about below change? do not retransmit packets when socket was already closed.
> 
> best regards,
> 
> 
> 
> From: soukjin bae <soukjin.bae@samsung.com>
> Date: Wen, 14 Jan 2019 14:26:35 +0900
> Subject: net: Don't retransmit packets when socket was already closed
>  
> Signed-off-by: soukjin bae <soukjin.bae@samsung.com>
> Signed-off-by: jongeon park <jongeon.park@samsung.com>
> ---
>  net/ipv4/tcp_ipv4 | 4 ++++
>  1 file changed, 4 insertions(+)
> 
> diff --git a/net/ipv4/tcp_ipv4 b/net/ipv4/tcp_ipv4
> index fe4daf6..654bd19 100755
> --- a/net/ipv4/tcp_ipv4
> +++ b/net/ipv4/tcp_ipv4
> 
> @@ -442,6 +465,10 @@ void tcp_v4_err(struct sk_buff *icmp_skb, u32 info)
>  		err = EPROTO;
>  		break;
>  	case ICMP_DEST_UNREACH:
> +		/* Don't retransmit packets when socket was already closed */
> +		if (sock_flag(sk, SOCK_DEAD))
> +			goto out;
> +
>  		if (code > NR_ICMP_UNREACH)
>  			goto out;
> 

I do not believe this patch is needed.

You probably hit another more serious bug, but since you do not post the full stack trace
it is hard to help.

Are you using vti tunnel ?

I just got a syzbot report that might give us a clue :

(I suspect commit 61220ab349485d911083d0b7990ccd3db6c63297 vti6: Enable namespace changing
was wrong, since vti tunnels have t->net assigned to a struct net without holding a reference)

So we end up freeing a struct net (and associated resources) too soon.


BUG: KASAN: slab-out-of-bounds in atomic_read include/asm-generic/atomic-instrumented.h:21 [inline]
BUG: KASAN: slab-out-of-bounds in queued_spin_trylock include/asm-generic/qspinlock.h:69 [inline]
BUG: KASAN: slab-out-of-bounds in do_raw_spin_trylock+0x6a/0x180 kernel/locking/spinlock_debug.c:119
Read of size 4 at addr ffff888066405d9c by task syz-executor.4/10575

CPU: 0 PID: 10575 Comm: syz-executor.4 Not tainted 5.0.0-rc6+ #70
Hardware name: Google Google Compute Engine/Google Compute Engine, BIOS Google 01/01/2011
Call Trace:
 __dump_stack lib/dump_stack.c:77 [inline]
 dump_stack+0x172/0x1f0 lib/dump_stack.c:113
 print_address_description.cold+0x7c/0x20d mm/kasan/report.c:187
 kasan_report.cold+0x1b/0x40 mm/kasan/report.c:317
 check_memory_region_inline mm/kasan/generic.c:185 [inline]
 check_memory_region+0x123/0x190 mm/kasan/generic.c:191
 kasan_check_read+0x11/0x20 mm/kasan/common.c:100
 atomic_read include/asm-generic/atomic-instrumented.h:21 [inline]
 queued_spin_trylock include/asm-generic/qspinlock.h:69 [inline]
 do_raw_spin_trylock+0x6a/0x180 kernel/locking/spinlock_debug.c:119
 __raw_spin_trylock include/linux/spinlock_api_smp.h:89 [inline]
 _raw_spin_trylock+0x1c/0x80 kernel/locking/spinlock.c:128
 spin_trylock include/linux/spinlock.h:339 [inline]
 icmp_xmit_lock net/ipv4/icmp.c:219 [inline]
 icmp_send+0x54c/0x1400 net/ipv4/icmp.c:665
 ipv4_link_failure+0x2c/0x210 net/ipv4/route.c:1187
 dst_link_failure include/net/dst.h:427 [inline]
 vti6_xmit net/ipv6/ip6_vti.c:514 [inline]
 vti6_tnl_xmit+0x10db/0x1c6e net/ipv6/ip6_vti.c:553
 __netdev_start_xmit include/linux/netdevice.h:4385 [inline]
 netdev_start_xmit include/linux/netdevice.h:4394 [inline]
 xmit_one net/core/dev.c:3278 [inline]
 dev_hard_start_xmit+0x1b2/0x980 net/core/dev.c:3294
 __dev_queue_xmit+0x26e5/0x2fe0 net/core/dev.c:3864
 dev_queue_xmit+0x18/0x20 net/core/dev.c:3897
 neigh_direct_output+0x16/0x20 net/core/neighbour.c:1516
 neigh_output include/net/neighbour.h:508 [inline]
 ip_finish_output2+0x949/0x1740 net/ipv4/ip_output.c:229
 ip_finish_output+0x73c/0xd50 net/ipv4/ip_output.c:317
 NF_HOOK_COND include/linux/netfilter.h:278 [inline]
 ip_output+0x21f/0x670 net/ipv4/ip_output.c:405
 dst_output include/net/dst.h:444 [inline]
 ip_local_out+0xc4/0x1b0 net/ipv4/ip_output.c:124
 __ip_queue_xmit+0x86f/0x1bf0 net/ipv4/ip_output.c:505
 ip_queue_xmit+0x5a/0x70 include/net/ip.h:198
 __tcp_transmit_skb+0x1a5f/0x3680 net/ipv4/tcp_output.c:1160
 tcp_transmit_skb net/ipv4/tcp_output.c:1176 [inline]
 tcp_write_xmit+0xe89/0x5160 net/ipv4/tcp_output.c:2401
 __tcp_push_pending_frames+0xb4/0x350 net/ipv4/tcp_output.c:2577
 tcp_send_fin+0x149/0xbb0 net/ipv4/tcp_output.c:3122
 tcp_close+0xddf/0x10c0 net/ipv4/tcp.c:2405
 inet_release+0x105/0x1f0 net/ipv4/af_inet.c:428
 __sock_release+0xd3/0x250 net/socket.c:579
 sock_close+0x1b/0x30 net/socket.c:1139
 __fput+0x2df/0x8d0 fs/file_table.c:278
 ____fput+0x16/0x20 fs/file_table.c:309
 task_work_run+0x14a/0x1c0 kernel/task_work.c:113
 tracehook_notify_resume include/linux/tracehook.h:188 [inline]
 exit_to_usermode_loop+0x273/0x2c0 arch/x86/entry/common.c:166
 prepare_exit_to_usermode arch/x86/entry/common.c:197 [inline]
 syscall_return_slowpath arch/x86/entry/common.c:268 [inline]
 do_syscall_32_irqs_on arch/x86/entry/common.c:341 [inline]
 do_fast_syscall_32+0xa9d/0xc98 arch/x86/entry/common.c:397
 entry_SYSENTER_compat+0x70/0x7f arch/x86/entry/entry_64_compat.S:139
RIP: 0023:0xf7fe8869
Code: 85 d2 74 02 89 0a 5b 5d c3 8b 04 24 c3 8b 14 24 c3 8b 3c 24 c3 90 90 90 90 90 90 90 90 90 90 90 90 51 52 55 89 e5 0f 34 cd 80 <5d> 5a 59 c3 90 90 90 90 eb 0d 90 90 90 90 90 90 90 90 90 90 90 90
RSP: 002b:000000000845fdac EFLAGS: 00000216 ORIG_RAX: 0000000000000006
RAX: 0000000000000000 RBX: 0000000000000004 RCX: 0000000000000000
RDX: 0000000000000005 RSI: 0000000000000000 RDI: 0000000000000000
RBP: 0000000000000000 R08: 0000000000000000 R09: 0000000000000000
R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000

Allocated by task 9609:
 save_stack+0x45/0xd0 mm/kasan/common.c:73
 set_track mm/kasan/common.c:85 [inline]
 __kasan_kmalloc mm/kasan/common.c:496 [inline]
 __kasan_kmalloc.constprop.0+0xcf/0xe0 mm/kasan/common.c:469
 kasan_kmalloc mm/kasan/common.c:504 [inline]
 kasan_slab_alloc+0xf/0x20 mm/kasan/common.c:411
 kmem_cache_alloc_node+0x144/0x710 mm/slab.c:3633
 alloc_task_struct_node kernel/fork.c:158 [inline]
 dup_task_struct kernel/fork.c:845 [inline]
 copy_process.part.0+0x1d08/0x79a0 kernel/fork.c:1753
 copy_process kernel/fork.c:1710 [inline]
 _do_fork+0x257/0xfe0 kernel/fork.c:2227
 __do_compat_sys_x86_clone arch/x86/ia32/sys_ia32.c:240 [inline]
 __se_compat_sys_x86_clone arch/x86/ia32/sys_ia32.c:236 [inline]
 __ia32_compat_sys_x86_clone+0xbc/0x140 arch/x86/ia32/sys_ia32.c:236
 do_syscall_32_irqs_on arch/x86/entry/common.c:326 [inline]
 do_int80_syscall_32+0x14d/0x670 arch/x86/entry/common.c:349
 entry_INT80_compat+0x76/0x80 arch/x86/entry/entry_64_compat.S:413

Freed by task 9627:
 save_stack+0x45/0xd0 mm/kasan/common.c:73
 set_track mm/kasan/common.c:85 [inline]
 __kasan_slab_free+0x102/0x150 mm/kasan/common.c:458
 kasan_slab_free+0xe/0x10 mm/kasan/common.c:466
 __cache_free mm/slab.c:3487 [inline]
 kmem_cache_free+0x86/0x260 mm/slab.c:3749
 free_task_struct kernel/fork.c:163 [inline]
 free_task+0xdd/0x120 kernel/fork.c:458
 __put_task_struct+0x20a/0x4e0 kernel/fork.c:731
 put_task_struct include/linux/sched/task.h:98 [inline]
 delayed_put_task_struct+0x1fd/0x350 kernel/exit.c:181
 __rcu_reclaim kernel/rcu/rcu.h:240 [inline]
 rcu_do_batch kernel/rcu/tree.c:2452 [inline]
 invoke_rcu_callbacks kernel/rcu/tree.c:2773 [inline]
 rcu_process_callbacks+0x928/0x1390 kernel/rcu/tree.c:2754
 __do_softirq+0x266/0x95a kernel/softirq.c:292

The buggy address belongs to the object at ffff888066404540
 which belongs to the cache task_struct(81:syz5) of size 6080
The buggy address is located 156 bytes to the right of
 6080-byte region [ffff888066404540, ffff888066405d00)
The buggy address belongs to the page:
page:ffffea0001990100 count:1 mapcount:0 mapping:ffff888092e85080 index:0x0 compound_mapcount: 0
flags: 0x1fffc0000010200(slab|head)
raw: 01fffc0000010200 ffffea00026efe08 ffffea0002554f08 ffff888092e85080
raw: 0000000000000000 ffff888066404540 0000000100000001 ffff8880602fe480
page dumped because: kasan: bad access detected
page->mem_cgroup:ffff8880602fe480

Memory state around the buggy address:
 ffff888066405c80: fb fb fb fb fb fb fb fb fb fb fb fb fb fb fb fb
 ffff888066405d00: fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc
>ffff888066405d80: fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc
                            ^
 ffff888066405e00: fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc
 ffff888066405e80: fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc fc

^ permalink raw reply	[flat|nested] 8+ messages in thread

* RE:(2) [Bug reporting] kernel panic during handle the dst unreach icmp msg.
       [not found]   ` <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p2>
@ 2019-02-14 23:54     ` 배석진
  2019-02-15  1:08       ` (2) " Eric Dumazet
       [not found]       ` <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p6>
  0 siblings, 2 replies; 8+ messages in thread
From: 배석진 @ 2019-02-14 23:54 UTC (permalink / raw)
  To: Eric Dumazet, 배석진, netdev
  Cc: 박종언, Steffen Klassert, Herbert Xu

> I do not believe this patch is needed.
>  
> You probably hit another more serious bug, but since you do not post the full stack trace
> it is hard to help.
>  
> Are you using vti tunnel ?

there's no working logs of vpn/vti/tun on platform or kernel history.
and callstack has no functions about that.
it looks like simple ipv4 usage.

attaching full dump info.
no additional bug or warning on entire kernel history.
anything about tun or kasan even onther.

thanks.


<4>[60392.948306] I[1:    ksoftirqd/1:   19] ------------[ cut here ]------------
<0>[60392.948334] I[1:    ksoftirqd/1:   19] kernel BUG at net/ipv4/tcp_ipv4.c:519!
<2>[60392.948344] I[1:    ksoftirqd/1:   19] sec_debug_set_extra_info_fault = BUG / 0xffffff80090351d0
<0>[60392.948386] I[1:    ksoftirqd/1:   19] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP
<4>[60392.948395] I[1:    ksoftirqd/1:   19] Modules linked in:
<0>[60392.948408] I[1:    ksoftirqd/1:   19] debug-snapshot: core register saved(CPU:1)
<0>[60392.948416] I[1:    ksoftirqd/1:   19] DISR_EL1: 0000000000000000
<0>[60392.948425] I[1:    ksoftirqd/1:   19] DISR_EL1 valid_bit(31) is NOT set (0x0)
<0>[60392.948433] I[1:    ksoftirqd/1:   19] CPU : ERXSTATUS_EL1: 0000000000000000, ERXADDR_EL1: 0000000000000000, ERXMISC0_EL1: 0000000000000000
<0>[60392.948441] I[1:    ksoftirqd/1:   19] ERXSTATUS_EL1 valid_bit(30) is NOT set (0x0)
<0>[60392.948449] I[1:    ksoftirqd/1:   19] DSU : ERXSTATUS_EL1: 0000000000000000, ERXADDR_EL1: 0000000000000000, ERXMISC0_EL1: 0000000000000000
<0>[60392.948457] I[1:    ksoftirqd/1:   19] ERXSTATUS_EL1 valid_bit(30) is NOT set (0x0)
<0>[60392.948464] I[1:    ksoftirqd/1:   19] debug-snapshot: context saved(CPU:1)
<0>[60392.950562] I[1:    ksoftirqd/1:   19] ============ CPU Error Log Info after Cache flush ================
<0>[60392.950579] I[1:    ksoftirqd/1:   19] DISR_EL1: 0000000000000000
<0>[60392.950588] I[1:    ksoftirqd/1:   19] DISR_EL1 valid_bit(31) is NOT set (0x0)
<0>[60392.950596] I[1:    ksoftirqd/1:   19] CPU : ERXSTATUS_EL1: 0000000000000000, ERXADDR_EL1: 0000000000000000, ERXMISC0_EL1: 0000000000000000
<0>[60392.950604] I[1:    ksoftirqd/1:   19] ERXSTATUS_EL1 valid_bit(30) is NOT set (0x0)
<0>[60392.950611] I[1:    ksoftirqd/1:   19] DSU : ERXSTATUS_EL1: 0000000000000000, ERXADDR_EL1: 0000000000000000, ERXMISC0_EL1: 0000000000000000
<0>[60392.950619] I[1:    ksoftirqd/1:   19] ERXSTATUS_EL1 valid_bit(30) is NOT set (0x0)
<6>[60392.950631] I[1:    ksoftirqd/1:   19] debug-snapshot: item - log_kevents is disabled
<6>[60392.950638] I[1:    ksoftirqd/1:   19] TIF_FOREIGN_FPSTATE: 0, FP/SIMD depth 0, cpu: 0
<4>[60392.950648] I[1:    ksoftirqd/1:   19] CPU: 1 PID: 19 Comm: ksoftirqd/1 Tainted: G        W       4.14.85-15389299 #1
<4>[60392.950655] I[1:    ksoftirqd/1:   19] Hardware name: Samsung BEYOND2LTE KOR SINGLE 26 board based on EXYNOS9820 (DT)
<4>[60392.950664] I[1:    ksoftirqd/1:   19] task: ffffffc8f0c8c400 task.stack: ffffff800b958000
<4>[60392.950676] I[1:    ksoftirqd/1:   19] PC is at tcp_v4_err+0x4b0/0x4bc
<4>[60392.950684] I[1:    ksoftirqd/1:   19] LR is at tcp_v4_err+0x3ac/0x4bc
<4>[60392.950692] I[1:    ksoftirqd/1:   19] pc : [<ffffff80090351d0>] lr : [<ffffff80090350cc>] pstate: 60c00145
<4>[60392.950698] I[1:    ksoftirqd/1:   19] sp : ffffff800b95b940
<4>[60392.950705] I[1:    ksoftirqd/1:   19] x29: ffffff800b95b990 x28: ffffffc82fe10c2c 
<4>[60392.950714] I[1:    ksoftirqd/1:   19] x27: 0000000000000003 x26: 0000000000000001 
<4>[60392.950723] I[1:    ksoftirqd/1:   19] x25: ffffffc0051e5e00 x24: ffffff800aaebc80 
<4>[60392.950732] I[1:    ksoftirqd/1:   19] x23: ffffffc0051e5f58 x22: 0000000000000000 
<4>[60392.950741] I[1:    ksoftirqd/1:   19] x21: 0000000000000071 x20: ffffffc0051e5e88 
<4>[60392.950750] I[1:    ksoftirqd/1:   19] x19: ffffffc0051e5e00 x18: 0000000000000001 
<4>[60392.950760] I[1:    ksoftirqd/1:   19] x17: 0000000000000400 x16: 0000000000000000 
<4>[60392.950769] I[1:    ksoftirqd/1:   19] x15: ffffffffffffffff x14: 0000000000000000 
<4>[60392.950778] I[1:    ksoftirqd/1:   19] x13: 0000000000000002 x12: 0000000000000000 
<4>[60392.950787] I[1:    ksoftirqd/1:   19] x11: ffffffc0051e5f58 x10: 0000000000007530 
<4>[60392.950796] I[1:    ksoftirqd/1:   19] x9 : 0000000000000020 x8 : 0000000000000200 
<4>[60392.950806] I[1:    ksoftirqd/1:   19] x7 : 0000000000000000 x6 : 0000000000000010 
<4>[60392.950815] I[1:    ksoftirqd/1:   19] x5 : 000000000000808c x4 : 000000000000bb01 
<4>[60392.950825] I[1:    ksoftirqd/1:   19] x3 : 00000000831fd9ac x2 : 000000000000808c 
<4>[60392.950834] I[1:    ksoftirqd/1:   19] x1 : 000000000200a8c0 x0 : 0000000000000040 
<4>[60392.950844] I[1:    ksoftirqd/1:   19] 
<4>[60392.950844] I[1:    ksoftirqd/1:   19] PC: 0xffffff80090350d0:
<4>[60392.950855] I[1:    ksoftirqd/1:   19] 50d0 : 92407C08 14000009 AA1303E0 97FFFE97 17FFFFD0 F940CB08 D538D089 9108E108
<4>[60392.950872] I[1:    ksoftirqd/1:   19] 50f0 : 17FFFF78 52801F48 12001D29 F940AE77 9AC92108 D344FD09 528EA60A 9105626B
<4>[60392.950888] I[1:    ksoftirqd/1:   19] 5110 : F11D4D3F 9A8A3108 EB0B02FF B9072268 54000580 B4000577 97C9A4D3 D29EF9EA
<4>[60392.950903] I[1:    ksoftirqd/1:   19] 5130 : F2BC6A6A F9444A68 F2D374AA D343FC09 F2E4188A 9BCA7D29 D344FD29 EB08013F
<4>[60392.950919] I[1:    ksoftirqd/1:   19] 5150 : 54000069 AA0903E8 F9044A69 B94022E9 B9472277 4B090100 97C94F99 CB0002E8
<4>[60392.950934] I[1:    ksoftirqd/1:   19] 5170 : 7100051F 5400022B 320003EA B000A74B 391D4A6A 93407D08 F945416A D344FD0B
<4>[60392.950951] I[1:    ksoftirqd/1:   19] 5190 : 528EA609 F11D4D7F 9A893108 8B080142 911A4261 AA1303E0 F9034662 97FCBBB7
<4>[60392.950967] I[1:    ksoftirqd/1:   19] 51b0 : AA1603E8 17FFFF86 F9455668 AA1303E0 F9402D08 94063788 AA1603E8 17FFFF80
<4>[60392.950982] I[1:    ksoftirqd/1:   19] 51d0 : D4210000 14000000 00BE7BAD F81C0FF7 A90157F6 A9024FF4 A9037BFD 9100C3FD
<4>[60392.950997] I[1:    ksoftirqd/1:   19] 51f0 : AA0003F6 B940AAC8 F9407AC9 7941BECA B9409AD7 2A2803E8 2A0203F4 2A0103F5
<4>[60392.951012] I[1:    ksoftirqd/1:   19] 5210 : 721B051F 8B0A0133 54000201 321F07E3 2A1503E0 2A1403E1 2A1703E2 2A1F03E4
<4>[60392.951028] I[1:    ksoftirqd/1:   19] 5230 : 97D8189D 13804008 0B000108 53107D08 79002268 7941BEC8 321C03E9 790166C9
<4>[60392.951043] I[1:    ksoftirqd/1:   19] 5250 : 790162C8 14000012 79401A68 B940B2C2 AA1303E0 53027D08 121E0D01 97D8177A
<4>[60392.951058] I[1:    ksoftirqd/1:   19] 5270 : 2A0003E4 321F07E3 2A1503E0 2A1403E1 2A1703E2 97D81888 13804008 0B000108
<4>[60392.951073] I[1:    ksoftirqd/1:   19] 5290 : 12800009 4A484128 79002268 A9437BFD A9424FF4 A94157F6 F84407F7 D65F03C0
<4>[60392.951089] I[1:    ksoftirqd/1:   19] 52b0 : 00BE7BAD A9BF7BFD 910003FD B9458008 B9400002 AA0103E0 2A0803E1 97FFFFC4
<4>[60392.951105] I[1:    ksoftirqd/1:   19] 
<4>[60392.951105] I[1:    ksoftirqd/1:   19] LR: 0xffffff8009034fcc:
<4>[60392.951116] I[1:    ksoftirqd/1:   19] 4fcc : 39404A69 121F1929 7100093F 540001A1 B4000068 F9407508 B4000148 B9408F28
<4>[60392.951131] I[1:    ksoftirqd/1:   19] 4fec : 35000188 F942A668 AA1303E0 B9022E75 940637FA AA1303E0 97FFAE89 14000006
<4>[60392.951147] I[1:    ksoftirqd/1:   19] 500c : B9408F28 35000068 39568268 37000208 B9023275 AA1403E0 94061649 91020260
<4>[60392.951162] I[1:    ksoftirqd/1:   19] 502c : 97D6FDEE 36000060 AA1303E0 97FCB533 A9457BFD A9444FF4 A94357F6 A9425FF8
<4>[60392.951177] I[1:    ksoftirqd/1:   19] 504c : A94167FA A8C66FFC D65F03C0 F942A668 AA1303E0 B9022E75 940637E0 17FFFFEE
<4>[60392.951193] I[1:    ksoftirqd/1:   19] 506c : D00030CB D37DF34A 9114816B B86A6975 7100075F 54FFFA68 B9400129 6B0902FF
<4>[60392.951208] I[1:    ksoftirqd/1:   19] 508c : 54FFFA01 395D4669 34FFF9C9 B5FFF9A8 395D4E69 34FFF969 B9408F2A 35FFF92A
<4>[60392.951223] I[1:    ksoftirqd/1:   19] 50ac : AA0803F6 B9489A68 51000529 391D4E69 340001C8 B948A669 0B480D20 97C94FC1
<4>[60392.951238] I[1:    ksoftirqd/1:   19] 50cc : 395D4E69 92407C08 14000009 AA1303E0 97FFFE97 17FFFFD0 F940CB08 D538D089
<4>[60392.951254] I[1:    ksoftirqd/1:   19] 50ec : 9108E108 17FFFF78 52801F48 12001D29 F940AE77 9AC92108 D344FD09 528EA60A
<4>[60392.951269] I[1:    ksoftirqd/1:   19] 510c : 9105626B F11D4D3F 9A8A3108 EB0B02FF B9072268 54000580 B4000577 97C9A4D3
<4>[60392.951283] I[1:    ksoftirqd/1:   19] 512c : D29EF9EA F2BC6A6A F9444A68 F2D374AA D343FC09 F2E4188A 9BCA7D29 D344FD29
<4>[60392.951299] I[1:    ksoftirqd/1:   19] 514c : EB08013F 54000069 AA0903E8 F9044A69 B94022E9 B9472277 4B090100 97C94F99
<4>[60392.951314] I[1:    ksoftirqd/1:   19] 516c : CB0002E8 7100051F 5400022B 320003EA B000A74B 391D4A6A 93407D08 F945416A
<4>[60392.951328] I[1:    ksoftirqd/1:   19] 518c : D344FD0B 528EA609 F11D4D7F 9A893108 8B080142 911A4261 AA1303E0 F9034662
<4>[60392.951344] I[1:    ksoftirqd/1:   19] 51ac : 97FCBBB7 AA1603E8 17FFFF86 F9455668 AA1303E0 F9402D08 94063788 AA1603E8
<4>[60392.951358] I[1:    ksoftirqd/1:   19] 
<4>[60392.951358] I[1:    ksoftirqd/1:   19] SP: 0xffffff800b95b840:
<4>[60392.951369] I[1:    ksoftirqd/1:   19] b840 : 0B95BA88 FFFFFF80 00002752 00000000 0B95B9A0 FFFFFF80 00000001 00000000
<4>[60392.951384] I[1:    ksoftirqd/1:   19] b860 : 00000001 00000000 051E5E00 FFFFFFC0 0B95B8E0 FFFFFF80 09001E50 FFFFFF80
<4>[60392.951398] I[1:    ksoftirqd/1:   19] b880 : 0B95B8E0 FFFFFF80 EE595D00 B254C55C EF89B000 FFFFFFC8 EE595D00 B254C55C
<4>[60392.951412] I[1:    ksoftirqd/1:   19] b8a0 : 2FE10C24 FFFFFFC8 36B80010 FFFFFFC0 0B2D8880 FFFFFF80 0AAEBC80 FFFFFF80
<4>[60392.951426] I[1:    ksoftirqd/1:   19] b8c0 : 00000010 00000000 00000000 00000000 0B95B930 FFFFFF80 09015704 FFFFFF80
<4>[60392.951440] I[1:    ksoftirqd/1:   19] b8e0 : 00000003 00000000 0906F3D0 FFFFFF80 00000001 00000000 EF89B000 FFFFFFC8
<4>[60392.951454] I[1:    ksoftirqd/1:   19] b900 : 0AAEBC80 FFFFFF80 2FE10C24 FFFFFFC8 00000000 00000000 00000000 FFFFFFC8
<4>[60392.951468] I[1:    ksoftirqd/1:   19] b920 : 00780078 FFFFFFC8 EE595D00 B254C55C 0B95B990 FFFFFF80 09034E40 FFFFFF80
<4>[60392.951482] I[1:    ksoftirqd/1:   19] b940 : 0A5386B0 FFFFFF80 0A540FD0 FFFFFF80 EF89B0A0 FFFFFFC8 EF89B000 FFFFFFC8
<4>[60392.951496] I[1:    ksoftirqd/1:   19] b960 : 00000008 00000000 2FE10C24 FFFFFFC8 00000000 00000000 00000006 00000000
<4>[60392.951511] I[1:    ksoftirqd/1:   19] b980 : 00000000 00000000 1EEBFB80 FFFFFFC8 0B95B9C0 FFFFFF80 0904A990 FFFFFF80
<4>[60392.951526] I[1:    ksoftirqd/1:   19] b9a0 : 0AAEBC80 FFFFFF80 36B82128 FFFFFFC0 2FE10C2C FFFFFFC8 1EEBFB80 FFFFFFC8
<4>[60392.951541] I[1:    ksoftirqd/1:   19] b9c0 : 0B95BA00 FFFFFF80 0904A6D0 FFFFFF80 1EEBFC18 FFFFFFC8 EE595D00 B254C55C
<4>[60392.951556] I[1:    ksoftirqd/1:   19] b9e0 : 0A540578 FFFFFF80 12995900 FFFFFFC0 0AAEBC80 FFFFFF80 1EEBFB80 FFFFFFC8
<4>[60392.951570] I[1:    ksoftirqd/1:   19] ba00 : 0B95BA40 FFFFFF80 0904A3AC FFFFFF80 00000008 00000000 1EEBFC18 FFFFFFC8
<4>[60392.951586] I[1:    ksoftirqd/1:   19] ba20 : 0A540578 FFFFFF80 0964F9E8 FFFFFF80 0AAEBC80 FFFFFF80 1EEBFB80 FFFFFFC8
<4>[60392.951605] I[1:    ksoftirqd/1:   19] 
<4>[60392.951605] I[1:    ksoftirqd/1:   19] X7: 0xffffffffffffff00:
<4>[60392.951616] I[1:    ksoftirqd/1:   19] ff00 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951637] I[1:    ksoftirqd/1:   19] ff20 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951655] I[1:    ksoftirqd/1:   19] ff40 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951671] I[1:    ksoftirqd/1:   19] ff60 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951696] I[1:    ksoftirqd/1:   19] ff80 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951713] I[1:    ksoftirqd/1:   19] ffa0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951730] I[1:    ksoftirqd/1:   19] ffc0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951747] I[1:    ksoftirqd/1:   19] ffe0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951764] I[1:    ksoftirqd/1:   19] 0000 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951780] I[1:    ksoftirqd/1:   19] 0020 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951797] I[1:    ksoftirqd/1:   19] 0040 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951814] I[1:    ksoftirqd/1:   19] 0060 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951831] I[1:    ksoftirqd/1:   19] 0080 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951849] I[1:    ksoftirqd/1:   19] 00a0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951867] I[1:    ksoftirqd/1:   19] 00c0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951884] I[1:    ksoftirqd/1:   19] 00e0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.951902] I[1:    ksoftirqd/1:   19] 
<4>[60392.951902] I[1:    ksoftirqd/1:   19] X11: 0xffffffc0051e5e58:
<4>[60392.951914] I[1:    ksoftirqd/1:   19] 5e58 : 00017031 00000000 00004301 00000000 0000FD75 00000000 EE63F5D0 FFFFFFC8
<4>[60392.951930] I[1:    ksoftirqd/1:   19] 5e78 : FFFFFFFF 00000004 00000003 00000000 00790078 00000000 00000000 00000000
<4>[60392.951945] I[1:    ksoftirqd/1:   19] 5e98 : 051E5E98 FFFFFFC0 051E5E98 FFFFFFC0 00000000 00000001 051E5EB0 FFFFFFC0
<4>[60392.951961] I[1:    ksoftirqd/1:   19] 5eb8 : 051E5EB0 FFFFFFC0 00000000 00000000 051E5EC8 FFFFFFC0 051E5EC8 FFFFFFC0
<4>[60392.951975] I[1:    ksoftirqd/1:   19] 5ed8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.951990] I[1:    ksoftirqd/1:   19] 5ef8 : 00000000 00000000 00000000 00123900 00000000 00000000 00000000 00000000
<4>[60392.952005] I[1:    ksoftirqd/1:   19] 5f18 : 00000000 00000000 00000000 00000000 42FCE000 FFFFFFC8 00000000 00000000
<4>[60392.952020] I[1:    ksoftirqd/1:   19] 5f38 : 00000000 00100000 00000000 00000001 00000000 00000000 00000000 00000000
<4>[60392.952035] I[1:    ksoftirqd/1:   19] 5f58 : 051E5F58 FFFFFFC0 051E5F58 FFFFFFC0 00000000 00000000 FFFFFFFF 00000000
<4>[60392.952050] I[1:    ksoftirqd/1:   19] 5f78 : 00000000 00000000 FFFFFFFF 7FFFFFFF 00000000 00000000 00000000 00000000
<4>[60392.952065] I[1:    ksoftirqd/1:   19] 5f98 : 00000000 00000000 090343B0 FFFFFF80 051E5E00 FFFFFFC0 00000001 FFFFFFFF
<4>[60392.952079] I[1:    ksoftirqd/1:   19] 5fb8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 000C026F
<4>[60392.952094] I[1:    ksoftirqd/1:   19] 5fd8 : 0007C913 FFFFFFFF 00000000 00000000 00000000 00000000 00006000 00000000
<4>[60392.952109] I[1:    ksoftirqd/1:   19] 5ff8 : 00000000 00000000 00000001 00000000 014000C0 43A820B3 00010600 00000001
<4>[60392.952124] I[1:    ksoftirqd/1:   19] 6018 : 00000000 00000000 0AAF9E10 FFFFFF80 00000000 00000000 00000071 00000000
<4>[60392.952139] I[1:    ksoftirqd/1:   19] 6038 : 00000000 00002752 00000000 00000000 00000000 00000000 FFFFFFFF 7FFFFFFF
<4>[60392.952155] I[1:    ksoftirqd/1:   19] 
<4>[60392.952155] I[1:    ksoftirqd/1:   19] X12: 0xffffffffffffff00:
<4>[60392.952166] I[1:    ksoftirqd/1:   19] ff00 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952183] I[1:    ksoftirqd/1:   19] ff20 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952199] I[1:    ksoftirqd/1:   19] ff40 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952216] I[1:    ksoftirqd/1:   19] ff60 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952232] I[1:    ksoftirqd/1:   19] ff80 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952249] I[1:    ksoftirqd/1:   19] ffa0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952266] I[1:    ksoftirqd/1:   19] ffc0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952283] I[1:    ksoftirqd/1:   19] ffe0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952300] I[1:    ksoftirqd/1:   19] 0000 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952317] I[1:    ksoftirqd/1:   19] 0020 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952333] I[1:    ksoftirqd/1:   19] 0040 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952350] I[1:    ksoftirqd/1:   19] 0060 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952366] I[1:    ksoftirqd/1:   19] 0080 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952383] I[1:    ksoftirqd/1:   19] 00a0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952401] I[1:    ksoftirqd/1:   19] 00c0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952417] I[1:    ksoftirqd/1:   19] 00e0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952436] I[1:    ksoftirqd/1:   19] 
<4>[60392.952436] I[1:    ksoftirqd/1:   19] X14: 0xffffffffffffff00:
<4>[60392.952447] I[1:    ksoftirqd/1:   19] ff00 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952467] I[1:    ksoftirqd/1:   19] ff20 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952483] I[1:    ksoftirqd/1:   19] ff40 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952499] I[1:    ksoftirqd/1:   19] ff60 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952516] I[1:    ksoftirqd/1:   19] ff80 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952532] I[1:    ksoftirqd/1:   19] ffa0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952548] I[1:    ksoftirqd/1:   19] ffc0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952563] I[1:    ksoftirqd/1:   19] ffe0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952580] I[1:    ksoftirqd/1:   19] 0000 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952596] I[1:    ksoftirqd/1:   19] 0020 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952612] I[1:    ksoftirqd/1:   19] 0040 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952628] I[1:    ksoftirqd/1:   19] 0060 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952645] I[1:    ksoftirqd/1:   19] 0080 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952661] I[1:    ksoftirqd/1:   19] 00a0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952677] I[1:    ksoftirqd/1:   19] 00c0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952693] I[1:    ksoftirqd/1:   19] 00e0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952710] I[1:    ksoftirqd/1:   19] 
<4>[60392.952710] I[1:    ksoftirqd/1:   19] X15: 0xfffffffffffffeff:
<4>[60392.952721] I[1:    ksoftirqd/1:   19] fefc : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952737] I[1:    ksoftirqd/1:   19] ff1c : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952753] I[1:    ksoftirqd/1:   19] ff3c : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952768] I[1:    ksoftirqd/1:   19] ff5c : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952784] I[1:    ksoftirqd/1:   19] ff7c : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952799] I[1:    ksoftirqd/1:   19] ff9c : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952815] I[1:    ksoftirqd/1:   19] ffbc : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952830] I[1:    ksoftirqd/1:   19] ffdc : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952846] I[1:    ksoftirqd/1:   19] fffc : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952861] I[1:    ksoftirqd/1:   19] 001c : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952877] I[1:    ksoftirqd/1:   19] 003c : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952893] I[1:    ksoftirqd/1:   19] 005c : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952910] I[1:    ksoftirqd/1:   19] 007c : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952926] I[1:    ksoftirqd/1:   19] 009c : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952944] I[1:    ksoftirqd/1:   19] 00bc : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952960] I[1:    ksoftirqd/1:   19] 00dc : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952976] I[1:    ksoftirqd/1:   19] 00fc : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.952993] I[1:    ksoftirqd/1:   19] 
<4>[60392.952993] I[1:    ksoftirqd/1:   19] X16: 0xffffffffffffff00:
<4>[60392.953004] I[1:    ksoftirqd/1:   19] ff00 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953020] I[1:    ksoftirqd/1:   19] ff20 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953036] I[1:    ksoftirqd/1:   19] ff40 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953052] I[1:    ksoftirqd/1:   19] ff60 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953068] I[1:    ksoftirqd/1:   19] ff80 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953084] I[1:    ksoftirqd/1:   19] ffa0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953099] I[1:    ksoftirqd/1:   19] ffc0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953115] I[1:    ksoftirqd/1:   19] ffe0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953130] I[1:    ksoftirqd/1:   19] 0000 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953146] I[1:    ksoftirqd/1:   19] 0020 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953162] I[1:    ksoftirqd/1:   19] 0040 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953178] I[1:    ksoftirqd/1:   19] 0060 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953194] I[1:    ksoftirqd/1:   19] 0080 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953210] I[1:    ksoftirqd/1:   19] 00a0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953226] I[1:    ksoftirqd/1:   19] 00c0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953242] I[1:    ksoftirqd/1:   19] 00e0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953259] I[1:    ksoftirqd/1:   19] 
<4>[60392.953259] I[1:    ksoftirqd/1:   19] X19: 0xffffffc0051e5d00:
<4>[60392.953270] I[1:    ksoftirqd/1:   19] 5d00 : 00000000 00000000 00000000 00000000 E745D5E7 496DFBF1 00000000 00000000
<4>[60392.953285] I[1:    ksoftirqd/1:   19] 5d20 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.953300] I[1:    ksoftirqd/1:   19] 5d40 : 00000000 00000000 00000000 00000000 00000000 00000000 FFFF0000 0200A8C0
<4>[60392.953314] I[1:    ksoftirqd/1:   19] 5d60 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.953328] I[1:    ksoftirqd/1:   19] 5d80 : 00000000 00000000 0081FF80 00000000 00000000 00080000 00000000 00000000
<4>[60392.953342] I[1:    ksoftirqd/1:   19] 5da0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.953356] I[1:    ksoftirqd/1:   19] 5dc0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.953370] I[1:    ksoftirqd/1:   19] 5de0 : 00000000 00000000 051E0BC0 FFFFFFC0 00000085 00000000 3C0ADD53 FCA9C68D
<4>[60392.953384] I[1:    ksoftirqd/1:   19] 5e00 : 831FD9AC 0200A8C0 EEE47EBA 808CBB01 4004000A 00000000 00000000 00000000
<4>[60392.953398] I[1:    ksoftirqd/1:   19] 5e20 : BC8B82B8 FFFFFFC8 0AAF9E10 FFFFFF80 0AAEBC80 FFFFFF80 00000000 00000000
<4>[60392.953412] I[1:    ksoftirqd/1:   19] 5e40 : FFFF0000 831FD9AC 00000000 00000000 FFFF0000 0200A8C0 00017031 00000000
<4>[60392.953427] I[1:    ksoftirqd/1:   19] 5e60 : 00004301 00000000 0000FD75 00000000 EE63F5D0 FFFFFFC8 FFFFFFFF 00000004
<4>[60392.953441] I[1:    ksoftirqd/1:   19] 5e80 : 00000003 00000000 00790078 00000000 00000000 00000000 051E5E98 FFFFFFC0
<4>[60392.953455] I[1:    ksoftirqd/1:   19] 5ea0 : 051E5E98 FFFFFFC0 00000000 00000001 051E5EB0 FFFFFFC0 051E5EB0 FFFFFFC0
<4>[60392.953469] I[1:    ksoftirqd/1:   19] 5ec0 : 00000000 00000000 051E5EC8 FFFFFFC0 051E5EC8 FFFFFFC0 00000000 00000000
<4>[60392.953483] I[1:    ksoftirqd/1:   19] 5ee0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.953498] I[1:    ksoftirqd/1:   19] 
<4>[60392.953498] I[1:    ksoftirqd/1:   19] X20: 0xffffffc0051e5d88:
<4>[60392.953509] I[1:    ksoftirqd/1:   19] 5d88 : 0081FF80 00000000 00000000 00080000 00000000 00000000 00000000 00000000
<4>[60392.953523] I[1:    ksoftirqd/1:   19] 5da8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.953537] I[1:    ksoftirqd/1:   19] 5dc8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.953551] I[1:    ksoftirqd/1:   19] 5de8 : 051E0BC0 FFFFFFC0 00000085 00000000 3C0ADD53 FCA9C68D 831FD9AC 0200A8C0
<4>[60392.953565] I[1:    ksoftirqd/1:   19] 5e08 : EEE47EBA 808CBB01 4004000A 00000000 00000000 00000000 BC8B82B8 FFFFFFC8
<4>[60392.953580] I[1:    ksoftirqd/1:   19] 5e28 : 0AAF9E10 FFFFFF80 0AAEBC80 FFFFFF80 00000000 00000000 FFFF0000 831FD9AC
<4>[60392.953594] I[1:    ksoftirqd/1:   19] 5e48 : 00000000 00000000 FFFF0000 0200A8C0 00017031 00000000 00004301 00000000
<4>[60392.953608] I[1:    ksoftirqd/1:   19] 5e68 : 0000FD75 00000000 EE63F5D0 FFFFFFC8 FFFFFFFF 00000004 00000003 00000000
<4>[60392.953622] I[1:    ksoftirqd/1:   19] 5e88 : 00790078 00000000 00000000 00000000 051E5E98 FFFFFFC0 051E5E98 FFFFFFC0
<4>[60392.953636] I[1:    ksoftirqd/1:   19] 5ea8 : 00000000 00000001 051E5EB0 FFFFFFC0 051E5EB0 FFFFFFC0 00000000 00000000
<4>[60392.953650] I[1:    ksoftirqd/1:   19] 5ec8 : 051E5EC8 FFFFFFC0 051E5EC8 FFFFFFC0 00000000 00000000 00000000 00000000
<4>[60392.953664] I[1:    ksoftirqd/1:   19] 5ee8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00123900
<4>[60392.953678] I[1:    ksoftirqd/1:   19] 5f08 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.953692] I[1:    ksoftirqd/1:   19] 5f28 : 42FCE000 FFFFFFC8 00000000 00000000 00000000 00100000 00000000 00000001
<4>[60392.953706] I[1:    ksoftirqd/1:   19] 5f48 : 00000000 00000000 00000000 00000000 051E5F58 FFFFFFC0 051E5F58 FFFFFFC0
<4>[60392.953720] I[1:    ksoftirqd/1:   19] 5f68 : 00000000 00000000 FFFFFFFF 00000000 00000000 00000000 FFFFFFFF 7FFFFFFF
<4>[60392.953736] I[1:    ksoftirqd/1:   19] 
<4>[60392.953736] I[1:    ksoftirqd/1:   19] X22: 0xffffffffffffff00:
<4>[60392.953747] I[1:    ksoftirqd/1:   19] ff00 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953764] I[1:    ksoftirqd/1:   19] ff20 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953779] I[1:    ksoftirqd/1:   19] ff40 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953795] I[1:    ksoftirqd/1:   19] ff60 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953813] I[1:    ksoftirqd/1:   19] ff80 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953830] I[1:    ksoftirqd/1:   19] ffa0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953846] I[1:    ksoftirqd/1:   19] ffc0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953862] I[1:    ksoftirqd/1:   19] ffe0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953877] I[1:    ksoftirqd/1:   19] 0000 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953893] I[1:    ksoftirqd/1:   19] 0020 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953909] I[1:    ksoftirqd/1:   19] 0040 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953925] I[1:    ksoftirqd/1:   19] 0060 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953941] I[1:    ksoftirqd/1:   19] 0080 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953957] I[1:    ksoftirqd/1:   19] 00a0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953973] I[1:    ksoftirqd/1:   19] 00c0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.953989] I[1:    ksoftirqd/1:   19] 00e0 : ******** ******** ******** ******** ******** ******** ******** ********
<4>[60392.954007] I[1:    ksoftirqd/1:   19] 
<4>[60392.954007] I[1:    ksoftirqd/1:   19] X23: 0xffffffc0051e5e58:
<4>[60392.954019] I[1:    ksoftirqd/1:   19] 5e58 : 00017031 00000000 00004301 00000000 0000FD75 00000000 EE63F5D0 FFFFFFC8
<4>[60392.954034] I[1:    ksoftirqd/1:   19] 5e78 : FFFFFFFF 00000004 00000003 00000000 00790078 00000000 00000000 00000000
<4>[60392.954048] I[1:    ksoftirqd/1:   19] 5e98 : 051E5E98 FFFFFFC0 051E5E98 FFFFFFC0 00000000 00000001 051E5EB0 FFFFFFC0
<4>[60392.954062] I[1:    ksoftirqd/1:   19] 5eb8 : 051E5EB0 FFFFFFC0 00000000 00000000 051E5EC8 FFFFFFC0 051E5EC8 FFFFFFC0
<4>[60392.954077] I[1:    ksoftirqd/1:   19] 5ed8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954091] I[1:    ksoftirqd/1:   19] 5ef8 : 00000000 00000000 00000000 00123900 00000000 00000000 00000000 00000000
<4>[60392.954105] I[1:    ksoftirqd/1:   19] 5f18 : 00000000 00000000 00000000 00000000 42FCE000 FFFFFFC8 00000000 00000000
<4>[60392.954119] I[1:    ksoftirqd/1:   19] 5f38 : 00000000 00100000 00000000 00000001 00000000 00000000 00000000 00000000
<4>[60392.954135] I[1:    ksoftirqd/1:   19] 5f58 : 051E5F58 FFFFFFC0 051E5F58 FFFFFFC0 00000000 00000000 FFFFFFFF 00000000
<4>[60392.954149] I[1:    ksoftirqd/1:   19] 5f78 : 00000000 00000000 FFFFFFFF 7FFFFFFF 00000000 00000000 00000000 00000000
<4>[60392.954163] I[1:    ksoftirqd/1:   19] 5f98 : 00000000 00000000 090343B0 FFFFFF80 051E5E00 FFFFFFC0 00000001 FFFFFFFF
<4>[60392.954178] I[1:    ksoftirqd/1:   19] 5fb8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 000C026F
<4>[60392.954192] I[1:    ksoftirqd/1:   19] 5fd8 : 0007C913 FFFFFFFF 00000000 00000000 00000000 00000000 00006000 00000000
<4>[60392.954206] I[1:    ksoftirqd/1:   19] 5ff8 : 00000000 00000000 00000001 00000000 014000C0 43A820B3 00010600 00000001
<4>[60392.954220] I[1:    ksoftirqd/1:   19] 6018 : 00000000 00000000 0AAF9E10 FFFFFF80 00000000 00000000 00000071 00000000
<4>[60392.954234] I[1:    ksoftirqd/1:   19] 6038 : 00000000 00002752 00000000 00000000 00000000 00000000 FFFFFFFF 7FFFFFFF
<4>[60392.954249] I[1:    ksoftirqd/1:   19] 
<4>[60392.954249] I[1:    ksoftirqd/1:   19] X24: 0xffffff800aaebb80:
<4>[60392.954261] I[1:    ksoftirqd/1:   19] bb80 : 0AAEEB88 FFFFFF80 0AB08710 FFFFFF80 08F65024 FFFFFF80 08F65060 FFFFFF80
<4>[60392.954275] I[1:    ksoftirqd/1:   19] bba0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954289] I[1:    ksoftirqd/1:   19] bbc0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954303] I[1:    ksoftirqd/1:   19] bbe0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954318] I[1:    ksoftirqd/1:   19] bc00 : 00000000 00000000 00000000 00000000 0AAEBC10 FFFFFF80 0AAEBC10 FFFFFF80
<4>[60392.954333] I[1:    ksoftirqd/1:   19] bc20 : 0AAEBC98 FFFFFF80 0AAEBC98 FFFFFF80 00000000 00000000 00000000 00000000
<4>[60392.954347] I[1:    ksoftirqd/1:   19] bc40 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954361] I[1:    ksoftirqd/1:   19] bc60 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954376] I[1:    ksoftirqd/1:   19] bc80 : 00000002 000004F2 00020002 00000000 000174E6 00000000 0AAEBC20 FFFFFF80
<4>[60392.954391] I[1:    ksoftirqd/1:   19] bca0 : 0AAEBC20 FFFFFF80 00000000 00000000 00000000 00000000 0B61BC48 FFFFFF80
<4>[60392.954405] I[1:    ksoftirqd/1:   19] bcc0 : 0B61BC48 FFFFFF80 0A550D80 FFFFFF80 00000000 00000000 9DB59DB5 00000000
<4>[60392.954419] I[1:    ksoftirqd/1:   19] bce0 : 0C000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954433] I[1:    ksoftirqd/1:   19] bd00 : 09644DB0 FFFFFF80 F0000091 00000000 EF839800 FFFFFFC8 EF839900 FFFFFFC8
<4>[60392.954447] I[1:    ksoftirqd/1:   19] bd20 : 0919AB44 FFFFFF80 0A580018 FFFFFF80 00000000 00000001 00000002 00000000
<4>[60392.954461] I[1:    ksoftirqd/1:   19] bd40 : 00000000 00000000 0A580018 FFFFFF80 0AB08478 FFFFFF80 0AAEBD20 FFFFFF80
<4>[60392.954475] I[1:    ksoftirqd/1:   19] bd60 : 00000000 00000000 00000000 00000000 00000000 00000000 EF896858 FFFFFFC8
<4>[60392.954490] I[1:    ksoftirqd/1:   19] 
<4>[60392.954490] I[1:    ksoftirqd/1:   19] X25: 0xffffffc0051e5d00:
<4>[60392.954501] I[1:    ksoftirqd/1:   19] 5d00 : 00000000 00000000 00000000 00000000 E745D5E7 496DFBF1 00000000 00000000
<4>[60392.954516] I[1:    ksoftirqd/1:   19] 5d20 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954530] I[1:    ksoftirqd/1:   19] 5d40 : 00000000 00000000 00000000 00000000 00000000 00000000 FFFF0000 0200A8C0
<4>[60392.954544] I[1:    ksoftirqd/1:   19] 5d60 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954562] I[1:    ksoftirqd/1:   19] 5d80 : 00000000 00000000 0081FF80 00000000 00000000 00080000 00000000 00000000
<4>[60392.954579] I[1:    ksoftirqd/1:   19] 5da0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954593] I[1:    ksoftirqd/1:   19] 5dc0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954607] I[1:    ksoftirqd/1:   19] 5de0 : 00000000 00000000 051E0BC0 FFFFFFC0 00000085 00000000 3C0ADD53 FCA9C68D
<4>[60392.954622] I[1:    ksoftirqd/1:   19] 5e00 : 831FD9AC 0200A8C0 EEE47EBA 808CBB01 4004000A 00000000 00000000 00000000
<4>[60392.954640] I[1:    ksoftirqd/1:   19] 5e20 : BC8B82B8 FFFFFFC8 0AAF9E10 FFFFFF80 0AAEBC80 FFFFFF80 00000000 00000000
<4>[60392.954673] I[1:    ksoftirqd/1:   19] 5e40 : FFFF0000 831FD9AC 00000000 00000000 FFFF0000 0200A8C0 00017031 00000000
<4>[60392.954687] I[1:    ksoftirqd/1:   19] 5e60 : 00004301 00000000 0000FD75 00000000 EE63F5D0 FFFFFFC8 FFFFFFFF 00000004
<4>[60392.954702] I[1:    ksoftirqd/1:   19] 5e80 : 00000003 00000000 00790078 00000000 00000000 00000000 051E5E98 FFFFFFC0
<4>[60392.954716] I[1:    ksoftirqd/1:   19] 5ea0 : 051E5E98 FFFFFFC0 00000000 00000001 051E5EB0 FFFFFFC0 051E5EB0 FFFFFFC0
<4>[60392.954730] I[1:    ksoftirqd/1:   19] 5ec0 : 00000000 00000000 051E5EC8 FFFFFFC0 051E5EC8 FFFFFFC0 00000000 00000000
<4>[60392.954745] I[1:    ksoftirqd/1:   19] 5ee0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954761] I[1:    ksoftirqd/1:   19] 
<4>[60392.954761] I[1:    ksoftirqd/1:   19] X28: 0xffffffc82fe10b2c:
<4>[60392.954772] I[1:    ksoftirqd/1:   19] 0b2c : 05F02FA5 F6F39767 535F5E0E 0CC4A1B3 04B50A41 DE8744AE 00000040 00000020
<4>[60392.954787] I[1:    ksoftirqd/1:   19] 0b4c : 00000000 00000002 00000000 DB9D6F18 FFFFFFC8 00000000 00000000 00000000
<4>[60392.954801] I[1:    ksoftirqd/1:   19] 0b6c : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954815] I[1:    ksoftirqd/1:   19] 0b8c : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954830] I[1:    ksoftirqd/1:   19] 0bac : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954844] I[1:    ksoftirqd/1:   19] 0bcc : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954858] I[1:    ksoftirqd/1:   19] 0bec : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
<4>[60392.954872] I[1:    ksoftirqd/1:   19] 0c0c : 00080000 5000C045 000036D4 62240140 0200A8C0 0200A8C0 ABB50103 00000000
<4>[60392.954886] I[1:    ksoftirqd/1:   19] 0c2c : 34000045 004023E3 99CA0640 0200A8C0 831FD9AC BB018C80 AE46FB9F 537870A5
<4>[60392.954900] I[1:    ksoftirqd/1:   19] 0c4c : 48031180 00002D8D 0A080101 F2556142 DBE9DC24 736D692E 76726573 00656369
<4>[60392.954914] I[1:    ksoftirqd/1:   19] 0c6c : 00390100 00000000 4E000000 554C4C55 00644C4C 00000000 00000000 00000000
<4>[60392.954928] I[1:    ksoftirqd/1:   19] 0c8c : 00000000 00000000 00000000 00000000 00000000 00000000 00000001 00000000
<4>[60392.954942] I[1:    ksoftirqd/1:   19] 0cac : 00000000 00000000 00000000 00000000 00000000 00000001 00000000 00000000
<4>[60392.954956] I[1:    ksoftirqd/1:   19] 0ccc : 00000000 00000000 00000000 00000000 00000000 00100000 00000001 2FE10CF8
<4>[60392.954970] I[1:    ksoftirqd/1:   19] 0cec : FFFFFFC8 00000000 00000000 001B4880 FFFFFFBF 00001000 00000000 00000000
<4>[60392.954984] I[1:    ksoftirqd/1:   19] 0d0c : 00000002 00000001 00000001 00000000 00000000 00000001 00000001 00000000
<4>[60392.954999] I[1:    ksoftirqd/1:   19] 
<4>[60392.954999] I[1:    ksoftirqd/1:   19] X29: 0xffffff800b95b890:
<4>[60392.955010] I[1:    ksoftirqd/1:   19] b890 : EF89B000 FFFFFFC8 EE595D00 B254C55C 2FE10C24 FFFFFFC8 36B80010 FFFFFFC0
<4>[60392.955025] I[1:    ksoftirqd/1:   19] b8b0 : 0B2D8880 FFFFFF80 0AAEBC80 FFFFFF80 00000010 00000000 00000000 00000000
<4>[60392.955039] I[1:    ksoftirqd/1:   19] b8d0 : 0B95B930 FFFFFF80 09015704 FFFFFF80 00000003 00000000 0906F3D0 FFFFFF80
<4>[60392.955053] I[1:    ksoftirqd/1:   19] b8f0 : 00000001 00000000 EF89B000 FFFFFFC8 0AAEBC80 FFFFFF80 2FE10C24 FFFFFFC8
<4>[60392.955067] I[1:    ksoftirqd/1:   19] b910 : 00000000 00000000 00000000 FFFFFFC8 00780078 FFFFFFC8 EE595D00 B254C55C
<4>[60392.955081] I[1:    ksoftirqd/1:   19] b930 : 0B95B990 FFFFFF80 09034E40 FFFFFF80 0A5386B0 FFFFFF80 0A540FD0 FFFFFF80
<4>[60392.955096] I[1:    ksoftirqd/1:   19] b950 : EF89B0A0 FFFFFFC8 EF89B000 FFFFFFC8 00000008 00000000 2FE10C24 FFFFFFC8
<4>[60392.955110] I[1:    ksoftirqd/1:   19] b970 : 00000000 00000000 00000006 00000000 00000000 00000000 1EEBFB80 FFFFFFC8
<4>[60392.955124] I[1:    ksoftirqd/1:   19] b990 : 0B95B9C0 FFFFFF80 0904A990 FFFFFF80 0AAEBC80 FFFFFF80 36B82128 FFFFFFC0
<4>[60392.955138] I[1:    ksoftirqd/1:   19] b9b0 : 2FE10C2C FFFFFFC8 1EEBFB80 FFFFFFC8 0B95BA00 FFFFFF80 0904A6D0 FFFFFF80
<4>[60392.955152] I[1:    ksoftirqd/1:   19] b9d0 : 1EEBFC18 FFFFFFC8 EE595D00 B254C55C 0A540578 FFFFFF80 12995900 FFFFFFC0
<4>[60392.955167] I[1:    ksoftirqd/1:   19] b9f0 : 0AAEBC80 FFFFFF80 1EEBFB80 FFFFFFC8 0B95BA40 FFFFFF80 0904A3AC FFFFFF80
<4>[60392.955181] I[1:    ksoftirqd/1:   19] ba10 : 00000008 00000000 1EEBFC18 FFFFFFC8 0A540578 FFFFFF80 0964F9E8 FFFFFF80
<4>[60392.955195] I[1:    ksoftirqd/1:   19] ba30 : 0AAEBC80 FFFFFF80 1EEBFB80 FFFFFFC8 0B95BA70 FFFFFF80 0900B104 FFFFFF80
<4>[60392.955209] I[1:    ksoftirqd/1:   19] ba50 : 2FE10C10 FFFFFFC8 00000001 00000000 0AAEBC80 FFFFFF80 1EEBFB80 FFFFFFC8
<4>[60392.955223] I[1:    ksoftirqd/1:   19] ba70 : 0B95BAE0 FFFFFF80 0900AFD4 FFFFFF80 00000004 00000000 00000001 00000002
<4>[60392.955238] I[1:    ksoftirqd/1:   19] 
<0>[60392.955246] I[1:    ksoftirqd/1:   19] Process ksoftirqd/1 (pid: 19, stack limit = 0xffffff800b958000)
<0>[60392.955253] I[1:    ksoftirqd/1:   19] Call trace:
<4>[60392.955263] I[1:    ksoftirqd/1:   19] Exception stack(0xffffff800b95b700 to 0xffffff800b95b840)
<4>[60392.955272] I[1:    ksoftirqd/1:   19] b700: 0000000000000040 000000000200a8c0 000000000000808c 00000000831fd9ac
<4>[60392.955281] I[1:    ksoftirqd/1:   19] b720: 000000000000bb01 000000000000808c 0000000000000010 0000000000000000
<4>[60392.955290] I[1:    ksoftirqd/1:   19] b740: 0000000000000200 0000000000000020 0000000000007530 ffffffc0051e5f58
<4>[60392.955298] I[1:    ksoftirqd/1:   19] b760: 0000000000000000 0000000000000002 0000000000000000 ffffffffffffffff
<4>[60392.955306] I[1:    ksoftirqd/1:   19] b780: 0000000000000000 0000000000000400 0000000000000001 ffffffc0051e5e00
<4>[60392.955315] I[1:    ksoftirqd/1:   19] b7a0: ffffffc0051e5e88 0000000000000071 0000000000000000 ffffffc0051e5f58
<4>[60392.955323] I[1:    ksoftirqd/1:   19] b7c0: ffffff800aaebc80 ffffffc0051e5e00 0000000000000001 0000000000000003
<4>[60392.955332] I[1:    ksoftirqd/1:   19] b7e0: ffffffc82fe10c2c ffffff800b95b990 ffffff80090350cc ffffff800b95b940
<4>[60392.955341] I[1:    ksoftirqd/1:   19] b800: ffffff80090351d0 0000000060c00145 0000000000000001 b254c55cee595d00
<4>[60392.955349] I[1:    ksoftirqd/1:   19] b820: ffffffffffffffff ffffff800b2d7db8 ffffff800b95b990 ffffff80090351d0
<0>[60392.955362] I[1:    ksoftirqd/1:   19] [<ffffff80090351d0>] tcp_v4_err+0x4b0/0x4bc
<0>[60392.955372] I[1:    ksoftirqd/1:   19] [<ffffff800904a990>] icmp_socket_deliver+0x70/0xc0
<0>[60392.955380] I[1:    ksoftirqd/1:   19] [<ffffff800904a6d0>] icmp_unreach+0x1b4/0x1f0
<0>[60392.955389] I[1:    ksoftirqd/1:   19] [<ffffff800904a3ac>] icmp_rcv+0x310/0x348
<0>[60392.955400] I[1:    ksoftirqd/1:   19] [<ffffff800900b104>] ip_local_deliver_finish+0xf8/0x1f0
<0>[60392.955409] I[1:    ksoftirqd/1:   19] [<ffffff800900afd4>] ip_local_deliver+0xc8/0x100
<0>[60392.955418] I[1:    ksoftirqd/1:   19] [<ffffff800900b790>] ip_rcv_finish+0x218/0x2e4
<0>[60392.955426] I[1:    ksoftirqd/1:   19] [<ffffff800900b4c0>] ip_rcv+0x2c4/0x37c
<0>[60392.955437] I[1:    ksoftirqd/1:   19] [<ffffff8008f84f98>] __netif_receive_skb_core+0x8f0/0xa68
<0>[60392.955446] I[1:    ksoftirqd/1:   19] [<ffffff8008f85960>] process_backlog+0x17c/0x290
<0>[60392.955455] I[1:    ksoftirqd/1:   19] [<ffffff8008f85ef0>] net_rx_action+0x224/0x464
<0>[60392.955465] I[1:    ksoftirqd/1:   19] [<ffffff80081b9564>] __do_softirq+0x200/0x39c
<0>[60392.955475] I[1:    ksoftirqd/1:   19] [<ffffff80081f1f04>] run_ksoftirqd+0x34/0x74
<0>[60392.955485] I[1:    ksoftirqd/1:   19] [<ffffff800821ad7c>] smpboot_thread_fn+0x1d0/0x2f8
<0>[60392.955495] I[1:    ksoftirqd/1:   19] [<ffffff8008215c48>] kthread+0x11c/0x130
<0>[60392.955505] I[1:    ksoftirqd/1:   19] [<ffffff80081bdaa0>] ret_from_fork+0x10/0x1c
<0>[60392.955515] I[1:    ksoftirqd/1:   19] Code: f9402d08 94063788 aa1603e8 17ffff80 (d4210000) 
<4>[60392.955524] I[1:    ksoftirqd/1:   19] ---[ end trace c1d9b9267f6ef3c2 ]---


^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: (2) [Bug reporting] kernel panic during handle the dst unreach icmp msg.
  2019-02-14 23:54     ` 배석진
@ 2019-02-15  1:08       ` Eric Dumazet
  2019-02-15  1:30         ` Eric Dumazet
       [not found]         ` <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p4>
       [not found]       ` <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p6>
  1 sibling, 2 replies; 8+ messages in thread
From: Eric Dumazet @ 2019-02-15  1:08 UTC (permalink / raw)
  To: soukjin.bae, netdev
  Cc: 박종언, Steffen Klassert, Herbert Xu



On 02/14/2019 03:54 PM, 배석진 wrote:
>> I do not believe this patch is needed.
>>  
>> You probably hit another more serious bug, but since you do not post the full stack trace
>> it is hard to help.
>>  
>> Are you using vti tunnel ?
> 
> there's no working logs of vpn/vti/tun on platform or kernel history.
> and callstack has no functions about that.
> it looks like simple ipv4 usage.
> 
> attaching full dump info.
> no additional bug or warning on entire kernel history.
> anything about tun or kasan even onther.
> 
> thanks.
> 
> 
> <4>[60392.948306] I[1:    ksoftirqd/1:   19] ------------[ cut here ]------------
> <0>[60392.948334] I[1:    ksoftirqd/1:   19] kernel BUG at net/ipv4/tcp_ipv4.c:519!

What the code looks like at line 519 of net/ipv4/tcp_ipv4.c ?

This is not a pristine kernel, anything could be wrong, you might have missed some critical backports.


> <2>[60392.948344] I[1:    ksoftirqd/1:   19] sec_debug_set_extra_info_fault = BUG / 0xffffff80090351d0
> <0>[60392.948386] I[1:    ksoftirqd/1:   19] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP
> <4>[60392.948395] I[1:    ksoftirqd/1:   19] Modules linked in:
> <0>[60392.948408] I[1:    ksoftirqd/1:   19] debug-snapshot: core register saved(CPU:1)
> <0>[60392.948416] I[1:    ksoftirqd/1:   19] DISR_EL1: 0000000000000000
> <0>[60392.948425] I[1:    ksoftirqd/1:   19] DISR_EL1 valid_bit(31) is NOT set (0x0)
> <0>[60392.948433] I[1:    ksoftirqd/1:   19] CPU : ERXSTATUS_EL1: 0000000000000000, ERXADDR_EL1: 0000000000000000, ERXMISC0_EL1: 0000000000000000
> <0>[60392.948441] I[1:    ksoftirqd/1:   19] ERXSTATUS_EL1 valid_bit(30) is NOT set (0x0)
> <0>[60392.948449] I[1:    ksoftirqd/1:   19] DSU : ERXSTATUS_EL1: 0000000000000000, ERXADDR_EL1: 0000000000000000, ERXMISC0_EL1: 0000000000000000
> <0>[60392.948457] I[1:    ksoftirqd/1:   19] ERXSTATUS_EL1 valid_bit(30) is NOT set (0x0)
> <0>[60392.948464] I[1:    ksoftirqd/1:   19] debug-snapshot: context saved(CPU:1)
> <0>[60392.950562] I[1:    ksoftirqd/1:   19] ============ CPU Error Log Info after Cache flush ================
> <0>[60392.950579] I[1:    ksoftirqd/1:   19] DISR_EL1: 0000000000000000
> <0>[60392.950588] I[1:    ksoftirqd/1:   19] DISR_EL1 valid_bit(31) is NOT set (0x0)
> <0>[60392.950596] I[1:    ksoftirqd/1:   19] CPU : ERXSTATUS_EL1: 0000000000000000, ERXADDR_EL1: 0000000000000000, ERXMISC0_EL1: 0000000000000000
> <0>[60392.950604] I[1:    ksoftirqd/1:   19] ERXSTATUS_EL1 valid_bit(30) is NOT set (0x0)
> <0>[60392.950611] I[1:    ksoftirqd/1:   19] DSU : ERXSTATUS_EL1: 0000000000000000, ERXADDR_EL1: 0000000000000000, ERXMISC0_EL1: 0000000000000000
> <0>[60392.950619] I[1:    ksoftirqd/1:   19] ERXSTATUS_EL1 valid_bit(30) is NOT set (0x0)
> <6>[60392.950631] I[1:    ksoftirqd/1:   19] debug-snapshot: item - log_kevents is disabled
> <6>[60392.950638] I[1:    ksoftirqd/1:   19] TIF_FOREIGN_FPSTATE: 0, FP/SIMD depth 0, cpu: 0
> <4>[60392.950648] I[1:    ksoftirqd/1:   19] CPU: 1 PID: 19 Comm: ksoftirqd/1 Tainted: G        W       4.14.85-15389299 #1
> <4>[60392.950655] I[1:    ksoftirqd/1:   19] Hardware name: Samsung BEYOND2LTE KOR SINGLE 26 board based on EXYNOS9820 (DT)
> <4>[60392.950664] I[1:    ksoftirqd/1:   19] task: ffffffc8f0c8c400 task.stack: ffffff800b958000
> <4>[60392.950676] I[1:    ksoftirqd/1:   19] PC is at tcp_v4_err+0x4b0/0x4bc
> <4>[60392.950684] I[1:    ksoftirqd/1:   19] LR is at tcp_v4_err+0x3ac/0x4bc
> <4>[60392.950692] I[1:    ksoftirqd/1:   19] pc : [<ffffff80090351d0>] lr : [<ffffff80090350cc>] pstate: 60c00145
> <4>[60392.950698] I[1:    ksoftirqd/1:   19] sp : ffffff800b95b940
> <4>[60392.950705] I[1:    ksoftirqd/1:   19] x29: ffffff800b95b990 x28: ffffffc82fe10c2c 
> <4>[60392.950714] I[1:    ksoftirqd/1:   19] x27: 0000000000000003 x26: 0000000000000001 
> <4>[60392.950723] I[1:    ksoftirqd/1:   19] x25: ffffffc0051e5e00 x24: ffffff800aaebc80 
> <4>[60392.950732] I[1:    ksoftirqd/1:   19] x23: ffffffc0051e5f58 x22: 0000000000000000 
> <4>[60392.950741] I[1:    ksoftirqd/1:   19] x21: 0000000000000071 x20: ffffffc0051e5e88 
> <4>[60392.950750] I[1:    ksoftirqd/1:   19] x19: ffffffc0051e5e00 x18: 0000000000000001 
> <4>[60392.950760] I[1:    ksoftirqd/1:   19] x17: 0000000000000400 x16: 0000000000000000 
> <4>[60392.950769] I[1:    ksoftirqd/1:   19] x15: ffffffffffffffff x14: 0000000000000000 
> <4>[60392.950778] I[1:    ksoftirqd/1:   19] x13: 0000000000000002 x12: 0000000000000000 
> <4>[60392.950787] I[1:    ksoftirqd/1:   19] x11: ffffffc0051e5f58 x10: 0000000000007530 
> <4>[60392.950796] I[1:    ksoftirqd/1:   19] x9 : 0000000000000020 x8 : 0000000000000200 
> <4>[60392.950806] I[1:    ksoftirqd/1:   19] x7 : 0000000000000000 x6 : 0000000000000010 
> <4>[60392.950815] I[1:    ksoftirqd/1:   19] x5 : 000000000000808c x4 : 000000000000bb01 
> <4>[60392.950825] I[1:    ksoftirqd/1:   19] x3 : 00000000831fd9ac x2 : 000000000000808c 
> <4>[60392.950834] I[1:    ksoftirqd/1:   19] x1 : 000000000200a8c0 x0 : 0000000000000040 
> <4>[60392.950844] I[1:    ksoftirqd/1:   19] 
> <4>[60392.950844] I[1:    ksoftirqd/1:   19] PC: 0xffffff80090350d0:
> <4>[60392.950855] I[1:    ksoftirqd/1:   19] 50d0 : 92407C08 14000009 AA1303E0 97FFFE97 17FFFFD0 F940CB08 D538D089 9108E108
> <4>[60392.950872] I[1:    ksoftirqd/1:   19] 50f0 : 17FFFF78 52801F48 12001D29 F940AE77 9AC92108 D344FD09 528EA60A 9105626B
> <4>[60392.950888] I[1:    ksoftirqd/1:   19] 5110 : F11D4D3F 9A8A3108 EB0B02FF B9072268 54000580 B4000577 97C9A4D3 D29EF9EA
> <4>[60392.950903] I[1:    ksoftirqd/1:   19] 5130 : F2BC6A6A F9444A68 F2D374AA D343FC09 F2E4188A 9BCA7D29 D344FD29 EB08013F
> <4>[60392.950919] I[1:    ksoftirqd/1:   19] 5150 : 54000069 AA0903E8 F9044A69 B94022E9 B9472277 4B090100 97C94F99 CB0002E8
> <4>[60392.950934] I[1:    ksoftirqd/1:   19] 5170 : 7100051F 5400022B 320003EA B000A74B 391D4A6A 93407D08 F945416A D344FD0B
> <4>[60392.950951] I[1:    ksoftirqd/1:   19] 5190 : 528EA609 F11D4D7F 9A893108 8B080142 911A4261 AA1303E0 F9034662 97FCBBB7
> <4>[60392.950967] I[1:    ksoftirqd/1:   19] 51b0 : AA1603E8 17FFFF86 F9455668 AA1303E0 F9402D08 94063788 AA1603E8 17FFFF80
> <4>[60392.950982] I[1:    ksoftirqd/1:   19] 51d0 : D4210000 14000000 00BE7BAD F81C0FF7 A90157F6 A9024FF4 A9037BFD 9100C3FD
> <4>[60392.950997] I[1:    ksoftirqd/1:   19] 51f0 : AA0003F6 B940AAC8 F9407AC9 7941BECA B9409AD7 2A2803E8 2A0203F4 2A0103F5
> <4>[60392.951012] I[1:    ksoftirqd/1:   19] 5210 : 721B051F 8B0A0133 54000201 321F07E3 2A1503E0 2A1403E1 2A1703E2 2A1F03E4
> <4>[60392.951028] I[1:    ksoftirqd/1:   19] 5230 : 97D8189D 13804008 0B000108 53107D08 79002268 7941BEC8 321C03E9 790166C9
> <4>[60392.951043] I[1:    ksoftirqd/1:   19] 5250 : 790162C8 14000012 79401A68 B940B2C2 AA1303E0 53027D08 121E0D01 97D8177A
> <4>[60392.951058] I[1:    ksoftirqd/1:   19] 5270 : 2A0003E4 321F07E3 2A1503E0 2A1403E1 2A1703E2 97D81888 13804008 0B000108
> <4>[60392.951073] I[1:    ksoftirqd/1:   19] 5290 : 12800009 4A484128 79002268 A9437BFD A9424FF4 A94157F6 F84407F7 D65F03C0
> <4>[60392.951089] I[1:    ksoftirqd/1:   19] 52b0 : 00BE7BAD A9BF7BFD 910003FD B9458008 B9400002 AA0103E0 2A0803E1 97FFFFC4
> <4>[60392.951105] I[1:    ksoftirqd/1:   19] 
> <4>[60392.951105] I[1:    ksoftirqd/1:   19] LR: 0xffffff8009034fcc:
> <4>[60392.951116] I[1:    ksoftirqd/1:   19] 4fcc : 39404A69 121F1929 7100093F 540001A1 B4000068 F9407508 B4000148 B9408F28
> <4>[60392.951131] I[1:    ksoftirqd/1:   19] 4fec : 35000188 F942A668 AA1303E0 B9022E75 940637FA AA1303E0 97FFAE89 14000006
> <4>[60392.951147] I[1:    ksoftirqd/1:   19] 500c : B9408F28 35000068 39568268 37000208 B9023275 AA1403E0 94061649 91020260
> <4>[60392.951162] I[1:    ksoftirqd/1:   19] 502c : 97D6FDEE 36000060 AA1303E0 97FCB533 A9457BFD A9444FF4 A94357F6 A9425FF8
> <4>[60392.951177] I[1:    ksoftirqd/1:   19] 504c : A94167FA A8C66FFC D65F03C0 F942A668 AA1303E0 B9022E75 940637E0 17FFFFEE
> <4>[60392.951193] I[1:    ksoftirqd/1:   19] 506c : D00030CB D37DF34A 9114816B B86A6975 7100075F 54FFFA68 B9400129 6B0902FF
> <4>[60392.951208] I[1:    ksoftirqd/1:   19] 508c : 54FFFA01 395D4669 34FFF9C9 B5FFF9A8 395D4E69 34FFF969 B9408F2A 35FFF92A
> <4>[60392.951223] I[1:    ksoftirqd/1:   19] 50ac : AA0803F6 B9489A68 51000529 391D4E69 340001C8 B948A669 0B480D20 97C94FC1
> <4>[60392.951238] I[1:    ksoftirqd/1:   19] 50cc : 395D4E69 92407C08 14000009 AA1303E0 97FFFE97 17FFFFD0 F940CB08 D538D089
> <4>[60392.951254] I[1:    ksoftirqd/1:   19] 50ec : 9108E108 17FFFF78 52801F48 12001D29 F940AE77 9AC92108 D344FD09 528EA60A
> <4>[60392.951269] I[1:    ksoftirqd/1:   19] 510c : 9105626B F11D4D3F 9A8A3108 EB0B02FF B9072268 54000580 B4000577 97C9A4D3
> <4>[60392.951283] I[1:    ksoftirqd/1:   19] 512c : D29EF9EA F2BC6A6A F9444A68 F2D374AA D343FC09 F2E4188A 9BCA7D29 D344FD29
> <4>[60392.951299] I[1:    ksoftirqd/1:   19] 514c : EB08013F 54000069 AA0903E8 F9044A69 B94022E9 B9472277 4B090100 97C94F99
> <4>[60392.951314] I[1:    ksoftirqd/1:   19] 516c : CB0002E8 7100051F 5400022B 320003EA B000A74B 391D4A6A 93407D08 F945416A
> <4>[60392.951328] I[1:    ksoftirqd/1:   19] 518c : D344FD0B 528EA609 F11D4D7F 9A893108 8B080142 911A4261 AA1303E0 F9034662
> <4>[60392.951344] I[1:    ksoftirqd/1:   19] 51ac : 97FCBBB7 AA1603E8 17FFFF86 F9455668 AA1303E0 F9402D08 94063788 AA1603E8
> <4>[60392.951358] I[1:    ksoftirqd/1:   19] 
> <4>[60392.951358] I[1:    ksoftirqd/1:   19] SP: 0xffffff800b95b840:
> <4>[60392.951369] I[1:    ksoftirqd/1:   19] b840 : 0B95BA88 FFFFFF80 00002752 00000000 0B95B9A0 FFFFFF80 00000001 00000000
> <4>[60392.951384] I[1:    ksoftirqd/1:   19] b860 : 00000001 00000000 051E5E00 FFFFFFC0 0B95B8E0 FFFFFF80 09001E50 FFFFFF80
> <4>[60392.951398] I[1:    ksoftirqd/1:   19] b880 : 0B95B8E0 FFFFFF80 EE595D00 B254C55C EF89B000 FFFFFFC8 EE595D00 B254C55C
> <4>[60392.951412] I[1:    ksoftirqd/1:   19] b8a0 : 2FE10C24 FFFFFFC8 36B80010 FFFFFFC0 0B2D8880 FFFFFF80 0AAEBC80 FFFFFF80
> <4>[60392.951426] I[1:    ksoftirqd/1:   19] b8c0 : 00000010 00000000 00000000 00000000 0B95B930 FFFFFF80 09015704 FFFFFF80
> <4>[60392.951440] I[1:    ksoftirqd/1:   19] b8e0 : 00000003 00000000 0906F3D0 FFFFFF80 00000001 00000000 EF89B000 FFFFFFC8
> <4>[60392.951454] I[1:    ksoftirqd/1:   19] b900 : 0AAEBC80 FFFFFF80 2FE10C24 FFFFFFC8 00000000 00000000 00000000 FFFFFFC8
> <4>[60392.951468] I[1:    ksoftirqd/1:   19] b920 : 00780078 FFFFFFC8 EE595D00 B254C55C 0B95B990 FFFFFF80 09034E40 FFFFFF80
> <4>[60392.951482] I[1:    ksoftirqd/1:   19] b940 : 0A5386B0 FFFFFF80 0A540FD0 FFFFFF80 EF89B0A0 FFFFFFC8 EF89B000 FFFFFFC8
> <4>[60392.951496] I[1:    ksoftirqd/1:   19] b960 : 00000008 00000000 2FE10C24 FFFFFFC8 00000000 00000000 00000006 00000000
> <4>[60392.951511] I[1:    ksoftirqd/1:   19] b980 : 00000000 00000000 1EEBFB80 FFFFFFC8 0B95B9C0 FFFFFF80 0904A990 FFFFFF80
> <4>[60392.951526] I[1:    ksoftirqd/1:   19] b9a0 : 0AAEBC80 FFFFFF80 36B82128 FFFFFFC0 2FE10C2C FFFFFFC8 1EEBFB80 FFFFFFC8
> <4>[60392.951541] I[1:    ksoftirqd/1:   19] b9c0 : 0B95BA00 FFFFFF80 0904A6D0 FFFFFF80 1EEBFC18 FFFFFFC8 EE595D00 B254C55C
> <4>[60392.951556] I[1:    ksoftirqd/1:   19] b9e0 : 0A540578 FFFFFF80 12995900 FFFFFFC0 0AAEBC80 FFFFFF80 1EEBFB80 FFFFFFC8
> <4>[60392.951570] I[1:    ksoftirqd/1:   19] ba00 : 0B95BA40 FFFFFF80 0904A3AC FFFFFF80 00000008 00000000 1EEBFC18 FFFFFFC8
> <4>[60392.951586] I[1:    ksoftirqd/1:   19] ba20 : 0A540578 FFFFFF80 0964F9E8 FFFFFF80 0AAEBC80 FFFFFF80 1EEBFB80 FFFFFFC8
> <4>[60392.951605] I[1:    ksoftirqd/1:   19] 
> <4>[60392.951605] I[1:    ksoftirqd/1:   19] X7: 0xffffffffffffff00:
> <4>[60392.951616] I[1:    ksoftirqd/1:   19] ff00 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951637] I[1:    ksoftirqd/1:   19] ff20 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951655] I[1:    ksoftirqd/1:   19] ff40 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951671] I[1:    ksoftirqd/1:   19] ff60 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951696] I[1:    ksoftirqd/1:   19] ff80 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951713] I[1:    ksoftirqd/1:   19] ffa0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951730] I[1:    ksoftirqd/1:   19] ffc0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951747] I[1:    ksoftirqd/1:   19] ffe0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951764] I[1:    ksoftirqd/1:   19] 0000 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951780] I[1:    ksoftirqd/1:   19] 0020 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951797] I[1:    ksoftirqd/1:   19] 0040 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951814] I[1:    ksoftirqd/1:   19] 0060 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951831] I[1:    ksoftirqd/1:   19] 0080 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951849] I[1:    ksoftirqd/1:   19] 00a0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951867] I[1:    ksoftirqd/1:   19] 00c0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951884] I[1:    ksoftirqd/1:   19] 00e0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.951902] I[1:    ksoftirqd/1:   19] 
> <4>[60392.951902] I[1:    ksoftirqd/1:   19] X11: 0xffffffc0051e5e58:
> <4>[60392.951914] I[1:    ksoftirqd/1:   19] 5e58 : 00017031 00000000 00004301 00000000 0000FD75 00000000 EE63F5D0 FFFFFFC8
> <4>[60392.951930] I[1:    ksoftirqd/1:   19] 5e78 : FFFFFFFF 00000004 00000003 00000000 00790078 00000000 00000000 00000000
> <4>[60392.951945] I[1:    ksoftirqd/1:   19] 5e98 : 051E5E98 FFFFFFC0 051E5E98 FFFFFFC0 00000000 00000001 051E5EB0 FFFFFFC0
> <4>[60392.951961] I[1:    ksoftirqd/1:   19] 5eb8 : 051E5EB0 FFFFFFC0 00000000 00000000 051E5EC8 FFFFFFC0 051E5EC8 FFFFFFC0
> <4>[60392.951975] I[1:    ksoftirqd/1:   19] 5ed8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.951990] I[1:    ksoftirqd/1:   19] 5ef8 : 00000000 00000000 00000000 00123900 00000000 00000000 00000000 00000000
> <4>[60392.952005] I[1:    ksoftirqd/1:   19] 5f18 : 00000000 00000000 00000000 00000000 42FCE000 FFFFFFC8 00000000 00000000
> <4>[60392.952020] I[1:    ksoftirqd/1:   19] 5f38 : 00000000 00100000 00000000 00000001 00000000 00000000 00000000 00000000
> <4>[60392.952035] I[1:    ksoftirqd/1:   19] 5f58 : 051E5F58 FFFFFFC0 051E5F58 FFFFFFC0 00000000 00000000 FFFFFFFF 00000000
> <4>[60392.952050] I[1:    ksoftirqd/1:   19] 5f78 : 00000000 00000000 FFFFFFFF 7FFFFFFF 00000000 00000000 00000000 00000000
> <4>[60392.952065] I[1:    ksoftirqd/1:   19] 5f98 : 00000000 00000000 090343B0 FFFFFF80 051E5E00 FFFFFFC0 00000001 FFFFFFFF
> <4>[60392.952079] I[1:    ksoftirqd/1:   19] 5fb8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 000C026F
> <4>[60392.952094] I[1:    ksoftirqd/1:   19] 5fd8 : 0007C913 FFFFFFFF 00000000 00000000 00000000 00000000 00006000 00000000
> <4>[60392.952109] I[1:    ksoftirqd/1:   19] 5ff8 : 00000000 00000000 00000001 00000000 014000C0 43A820B3 00010600 00000001
> <4>[60392.952124] I[1:    ksoftirqd/1:   19] 6018 : 00000000 00000000 0AAF9E10 FFFFFF80 00000000 00000000 00000071 00000000
> <4>[60392.952139] I[1:    ksoftirqd/1:   19] 6038 : 00000000 00002752 00000000 00000000 00000000 00000000 FFFFFFFF 7FFFFFFF
> <4>[60392.952155] I[1:    ksoftirqd/1:   19] 
> <4>[60392.952155] I[1:    ksoftirqd/1:   19] X12: 0xffffffffffffff00:
> <4>[60392.952166] I[1:    ksoftirqd/1:   19] ff00 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952183] I[1:    ksoftirqd/1:   19] ff20 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952199] I[1:    ksoftirqd/1:   19] ff40 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952216] I[1:    ksoftirqd/1:   19] ff60 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952232] I[1:    ksoftirqd/1:   19] ff80 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952249] I[1:    ksoftirqd/1:   19] ffa0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952266] I[1:    ksoftirqd/1:   19] ffc0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952283] I[1:    ksoftirqd/1:   19] ffe0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952300] I[1:    ksoftirqd/1:   19] 0000 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952317] I[1:    ksoftirqd/1:   19] 0020 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952333] I[1:    ksoftirqd/1:   19] 0040 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952350] I[1:    ksoftirqd/1:   19] 0060 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952366] I[1:    ksoftirqd/1:   19] 0080 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952383] I[1:    ksoftirqd/1:   19] 00a0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952401] I[1:    ksoftirqd/1:   19] 00c0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952417] I[1:    ksoftirqd/1:   19] 00e0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952436] I[1:    ksoftirqd/1:   19] 
> <4>[60392.952436] I[1:    ksoftirqd/1:   19] X14: 0xffffffffffffff00:
> <4>[60392.952447] I[1:    ksoftirqd/1:   19] ff00 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952467] I[1:    ksoftirqd/1:   19] ff20 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952483] I[1:    ksoftirqd/1:   19] ff40 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952499] I[1:    ksoftirqd/1:   19] ff60 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952516] I[1:    ksoftirqd/1:   19] ff80 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952532] I[1:    ksoftirqd/1:   19] ffa0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952548] I[1:    ksoftirqd/1:   19] ffc0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952563] I[1:    ksoftirqd/1:   19] ffe0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952580] I[1:    ksoftirqd/1:   19] 0000 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952596] I[1:    ksoftirqd/1:   19] 0020 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952612] I[1:    ksoftirqd/1:   19] 0040 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952628] I[1:    ksoftirqd/1:   19] 0060 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952645] I[1:    ksoftirqd/1:   19] 0080 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952661] I[1:    ksoftirqd/1:   19] 00a0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952677] I[1:    ksoftirqd/1:   19] 00c0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952693] I[1:    ksoftirqd/1:   19] 00e0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952710] I[1:    ksoftirqd/1:   19] 
> <4>[60392.952710] I[1:    ksoftirqd/1:   19] X15: 0xfffffffffffffeff:
> <4>[60392.952721] I[1:    ksoftirqd/1:   19] fefc : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952737] I[1:    ksoftirqd/1:   19] ff1c : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952753] I[1:    ksoftirqd/1:   19] ff3c : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952768] I[1:    ksoftirqd/1:   19] ff5c : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952784] I[1:    ksoftirqd/1:   19] ff7c : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952799] I[1:    ksoftirqd/1:   19] ff9c : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952815] I[1:    ksoftirqd/1:   19] ffbc : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952830] I[1:    ksoftirqd/1:   19] ffdc : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952846] I[1:    ksoftirqd/1:   19] fffc : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952861] I[1:    ksoftirqd/1:   19] 001c : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952877] I[1:    ksoftirqd/1:   19] 003c : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952893] I[1:    ksoftirqd/1:   19] 005c : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952910] I[1:    ksoftirqd/1:   19] 007c : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952926] I[1:    ksoftirqd/1:   19] 009c : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952944] I[1:    ksoftirqd/1:   19] 00bc : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952960] I[1:    ksoftirqd/1:   19] 00dc : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952976] I[1:    ksoftirqd/1:   19] 00fc : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.952993] I[1:    ksoftirqd/1:   19] 
> <4>[60392.952993] I[1:    ksoftirqd/1:   19] X16: 0xffffffffffffff00:
> <4>[60392.953004] I[1:    ksoftirqd/1:   19] ff00 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953020] I[1:    ksoftirqd/1:   19] ff20 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953036] I[1:    ksoftirqd/1:   19] ff40 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953052] I[1:    ksoftirqd/1:   19] ff60 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953068] I[1:    ksoftirqd/1:   19] ff80 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953084] I[1:    ksoftirqd/1:   19] ffa0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953099] I[1:    ksoftirqd/1:   19] ffc0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953115] I[1:    ksoftirqd/1:   19] ffe0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953130] I[1:    ksoftirqd/1:   19] 0000 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953146] I[1:    ksoftirqd/1:   19] 0020 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953162] I[1:    ksoftirqd/1:   19] 0040 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953178] I[1:    ksoftirqd/1:   19] 0060 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953194] I[1:    ksoftirqd/1:   19] 0080 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953210] I[1:    ksoftirqd/1:   19] 00a0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953226] I[1:    ksoftirqd/1:   19] 00c0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953242] I[1:    ksoftirqd/1:   19] 00e0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953259] I[1:    ksoftirqd/1:   19] 
> <4>[60392.953259] I[1:    ksoftirqd/1:   19] X19: 0xffffffc0051e5d00:
> <4>[60392.953270] I[1:    ksoftirqd/1:   19] 5d00 : 00000000 00000000 00000000 00000000 E745D5E7 496DFBF1 00000000 00000000
> <4>[60392.953285] I[1:    ksoftirqd/1:   19] 5d20 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.953300] I[1:    ksoftirqd/1:   19] 5d40 : 00000000 00000000 00000000 00000000 00000000 00000000 FFFF0000 0200A8C0
> <4>[60392.953314] I[1:    ksoftirqd/1:   19] 5d60 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.953328] I[1:    ksoftirqd/1:   19] 5d80 : 00000000 00000000 0081FF80 00000000 00000000 00080000 00000000 00000000
> <4>[60392.953342] I[1:    ksoftirqd/1:   19] 5da0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.953356] I[1:    ksoftirqd/1:   19] 5dc0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.953370] I[1:    ksoftirqd/1:   19] 5de0 : 00000000 00000000 051E0BC0 FFFFFFC0 00000085 00000000 3C0ADD53 FCA9C68D
> <4>[60392.953384] I[1:    ksoftirqd/1:   19] 5e00 : 831FD9AC 0200A8C0 EEE47EBA 808CBB01 4004000A 00000000 00000000 00000000
> <4>[60392.953398] I[1:    ksoftirqd/1:   19] 5e20 : BC8B82B8 FFFFFFC8 0AAF9E10 FFFFFF80 0AAEBC80 FFFFFF80 00000000 00000000
> <4>[60392.953412] I[1:    ksoftirqd/1:   19] 5e40 : FFFF0000 831FD9AC 00000000 00000000 FFFF0000 0200A8C0 00017031 00000000
> <4>[60392.953427] I[1:    ksoftirqd/1:   19] 5e60 : 00004301 00000000 0000FD75 00000000 EE63F5D0 FFFFFFC8 FFFFFFFF 00000004
> <4>[60392.953441] I[1:    ksoftirqd/1:   19] 5e80 : 00000003 00000000 00790078 00000000 00000000 00000000 051E5E98 FFFFFFC0
> <4>[60392.953455] I[1:    ksoftirqd/1:   19] 5ea0 : 051E5E98 FFFFFFC0 00000000 00000001 051E5EB0 FFFFFFC0 051E5EB0 FFFFFFC0
> <4>[60392.953469] I[1:    ksoftirqd/1:   19] 5ec0 : 00000000 00000000 051E5EC8 FFFFFFC0 051E5EC8 FFFFFFC0 00000000 00000000
> <4>[60392.953483] I[1:    ksoftirqd/1:   19] 5ee0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.953498] I[1:    ksoftirqd/1:   19] 
> <4>[60392.953498] I[1:    ksoftirqd/1:   19] X20: 0xffffffc0051e5d88:
> <4>[60392.953509] I[1:    ksoftirqd/1:   19] 5d88 : 0081FF80 00000000 00000000 00080000 00000000 00000000 00000000 00000000
> <4>[60392.953523] I[1:    ksoftirqd/1:   19] 5da8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.953537] I[1:    ksoftirqd/1:   19] 5dc8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.953551] I[1:    ksoftirqd/1:   19] 5de8 : 051E0BC0 FFFFFFC0 00000085 00000000 3C0ADD53 FCA9C68D 831FD9AC 0200A8C0
> <4>[60392.953565] I[1:    ksoftirqd/1:   19] 5e08 : EEE47EBA 808CBB01 4004000A 00000000 00000000 00000000 BC8B82B8 FFFFFFC8
> <4>[60392.953580] I[1:    ksoftirqd/1:   19] 5e28 : 0AAF9E10 FFFFFF80 0AAEBC80 FFFFFF80 00000000 00000000 FFFF0000 831FD9AC
> <4>[60392.953594] I[1:    ksoftirqd/1:   19] 5e48 : 00000000 00000000 FFFF0000 0200A8C0 00017031 00000000 00004301 00000000
> <4>[60392.953608] I[1:    ksoftirqd/1:   19] 5e68 : 0000FD75 00000000 EE63F5D0 FFFFFFC8 FFFFFFFF 00000004 00000003 00000000
> <4>[60392.953622] I[1:    ksoftirqd/1:   19] 5e88 : 00790078 00000000 00000000 00000000 051E5E98 FFFFFFC0 051E5E98 FFFFFFC0
> <4>[60392.953636] I[1:    ksoftirqd/1:   19] 5ea8 : 00000000 00000001 051E5EB0 FFFFFFC0 051E5EB0 FFFFFFC0 00000000 00000000
> <4>[60392.953650] I[1:    ksoftirqd/1:   19] 5ec8 : 051E5EC8 FFFFFFC0 051E5EC8 FFFFFFC0 00000000 00000000 00000000 00000000
> <4>[60392.953664] I[1:    ksoftirqd/1:   19] 5ee8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00123900
> <4>[60392.953678] I[1:    ksoftirqd/1:   19] 5f08 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.953692] I[1:    ksoftirqd/1:   19] 5f28 : 42FCE000 FFFFFFC8 00000000 00000000 00000000 00100000 00000000 00000001
> <4>[60392.953706] I[1:    ksoftirqd/1:   19] 5f48 : 00000000 00000000 00000000 00000000 051E5F58 FFFFFFC0 051E5F58 FFFFFFC0
> <4>[60392.953720] I[1:    ksoftirqd/1:   19] 5f68 : 00000000 00000000 FFFFFFFF 00000000 00000000 00000000 FFFFFFFF 7FFFFFFF
> <4>[60392.953736] I[1:    ksoftirqd/1:   19] 
> <4>[60392.953736] I[1:    ksoftirqd/1:   19] X22: 0xffffffffffffff00:
> <4>[60392.953747] I[1:    ksoftirqd/1:   19] ff00 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953764] I[1:    ksoftirqd/1:   19] ff20 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953779] I[1:    ksoftirqd/1:   19] ff40 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953795] I[1:    ksoftirqd/1:   19] ff60 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953813] I[1:    ksoftirqd/1:   19] ff80 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953830] I[1:    ksoftirqd/1:   19] ffa0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953846] I[1:    ksoftirqd/1:   19] ffc0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953862] I[1:    ksoftirqd/1:   19] ffe0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953877] I[1:    ksoftirqd/1:   19] 0000 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953893] I[1:    ksoftirqd/1:   19] 0020 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953909] I[1:    ksoftirqd/1:   19] 0040 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953925] I[1:    ksoftirqd/1:   19] 0060 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953941] I[1:    ksoftirqd/1:   19] 0080 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953957] I[1:    ksoftirqd/1:   19] 00a0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953973] I[1:    ksoftirqd/1:   19] 00c0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.953989] I[1:    ksoftirqd/1:   19] 00e0 : ******** ******** ******** ******** ******** ******** ******** ********
> <4>[60392.954007] I[1:    ksoftirqd/1:   19] 
> <4>[60392.954007] I[1:    ksoftirqd/1:   19] X23: 0xffffffc0051e5e58:
> <4>[60392.954019] I[1:    ksoftirqd/1:   19] 5e58 : 00017031 00000000 00004301 00000000 0000FD75 00000000 EE63F5D0 FFFFFFC8
> <4>[60392.954034] I[1:    ksoftirqd/1:   19] 5e78 : FFFFFFFF 00000004 00000003 00000000 00790078 00000000 00000000 00000000
> <4>[60392.954048] I[1:    ksoftirqd/1:   19] 5e98 : 051E5E98 FFFFFFC0 051E5E98 FFFFFFC0 00000000 00000001 051E5EB0 FFFFFFC0
> <4>[60392.954062] I[1:    ksoftirqd/1:   19] 5eb8 : 051E5EB0 FFFFFFC0 00000000 00000000 051E5EC8 FFFFFFC0 051E5EC8 FFFFFFC0
> <4>[60392.954077] I[1:    ksoftirqd/1:   19] 5ed8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954091] I[1:    ksoftirqd/1:   19] 5ef8 : 00000000 00000000 00000000 00123900 00000000 00000000 00000000 00000000
> <4>[60392.954105] I[1:    ksoftirqd/1:   19] 5f18 : 00000000 00000000 00000000 00000000 42FCE000 FFFFFFC8 00000000 00000000
> <4>[60392.954119] I[1:    ksoftirqd/1:   19] 5f38 : 00000000 00100000 00000000 00000001 00000000 00000000 00000000 00000000
> <4>[60392.954135] I[1:    ksoftirqd/1:   19] 5f58 : 051E5F58 FFFFFFC0 051E5F58 FFFFFFC0 00000000 00000000 FFFFFFFF 00000000
> <4>[60392.954149] I[1:    ksoftirqd/1:   19] 5f78 : 00000000 00000000 FFFFFFFF 7FFFFFFF 00000000 00000000 00000000 00000000
> <4>[60392.954163] I[1:    ksoftirqd/1:   19] 5f98 : 00000000 00000000 090343B0 FFFFFF80 051E5E00 FFFFFFC0 00000001 FFFFFFFF
> <4>[60392.954178] I[1:    ksoftirqd/1:   19] 5fb8 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 000C026F
> <4>[60392.954192] I[1:    ksoftirqd/1:   19] 5fd8 : 0007C913 FFFFFFFF 00000000 00000000 00000000 00000000 00006000 00000000
> <4>[60392.954206] I[1:    ksoftirqd/1:   19] 5ff8 : 00000000 00000000 00000001 00000000 014000C0 43A820B3 00010600 00000001
> <4>[60392.954220] I[1:    ksoftirqd/1:   19] 6018 : 00000000 00000000 0AAF9E10 FFFFFF80 00000000 00000000 00000071 00000000
> <4>[60392.954234] I[1:    ksoftirqd/1:   19] 6038 : 00000000 00002752 00000000 00000000 00000000 00000000 FFFFFFFF 7FFFFFFF
> <4>[60392.954249] I[1:    ksoftirqd/1:   19] 
> <4>[60392.954249] I[1:    ksoftirqd/1:   19] X24: 0xffffff800aaebb80:
> <4>[60392.954261] I[1:    ksoftirqd/1:   19] bb80 : 0AAEEB88 FFFFFF80 0AB08710 FFFFFF80 08F65024 FFFFFF80 08F65060 FFFFFF80
> <4>[60392.954275] I[1:    ksoftirqd/1:   19] bba0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954289] I[1:    ksoftirqd/1:   19] bbc0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954303] I[1:    ksoftirqd/1:   19] bbe0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954318] I[1:    ksoftirqd/1:   19] bc00 : 00000000 00000000 00000000 00000000 0AAEBC10 FFFFFF80 0AAEBC10 FFFFFF80
> <4>[60392.954333] I[1:    ksoftirqd/1:   19] bc20 : 0AAEBC98 FFFFFF80 0AAEBC98 FFFFFF80 00000000 00000000 00000000 00000000
> <4>[60392.954347] I[1:    ksoftirqd/1:   19] bc40 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954361] I[1:    ksoftirqd/1:   19] bc60 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954376] I[1:    ksoftirqd/1:   19] bc80 : 00000002 000004F2 00020002 00000000 000174E6 00000000 0AAEBC20 FFFFFF80
> <4>[60392.954391] I[1:    ksoftirqd/1:   19] bca0 : 0AAEBC20 FFFFFF80 00000000 00000000 00000000 00000000 0B61BC48 FFFFFF80
> <4>[60392.954405] I[1:    ksoftirqd/1:   19] bcc0 : 0B61BC48 FFFFFF80 0A550D80 FFFFFF80 00000000 00000000 9DB59DB5 00000000
> <4>[60392.954419] I[1:    ksoftirqd/1:   19] bce0 : 0C000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954433] I[1:    ksoftirqd/1:   19] bd00 : 09644DB0 FFFFFF80 F0000091 00000000 EF839800 FFFFFFC8 EF839900 FFFFFFC8
> <4>[60392.954447] I[1:    ksoftirqd/1:   19] bd20 : 0919AB44 FFFFFF80 0A580018 FFFFFF80 00000000 00000001 00000002 00000000
> <4>[60392.954461] I[1:    ksoftirqd/1:   19] bd40 : 00000000 00000000 0A580018 FFFFFF80 0AB08478 FFFFFF80 0AAEBD20 FFFFFF80
> <4>[60392.954475] I[1:    ksoftirqd/1:   19] bd60 : 00000000 00000000 00000000 00000000 00000000 00000000 EF896858 FFFFFFC8
> <4>[60392.954490] I[1:    ksoftirqd/1:   19] 
> <4>[60392.954490] I[1:    ksoftirqd/1:   19] X25: 0xffffffc0051e5d00:
> <4>[60392.954501] I[1:    ksoftirqd/1:   19] 5d00 : 00000000 00000000 00000000 00000000 E745D5E7 496DFBF1 00000000 00000000
> <4>[60392.954516] I[1:    ksoftirqd/1:   19] 5d20 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954530] I[1:    ksoftirqd/1:   19] 5d40 : 00000000 00000000 00000000 00000000 00000000 00000000 FFFF0000 0200A8C0
> <4>[60392.954544] I[1:    ksoftirqd/1:   19] 5d60 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954562] I[1:    ksoftirqd/1:   19] 5d80 : 00000000 00000000 0081FF80 00000000 00000000 00080000 00000000 00000000
> <4>[60392.954579] I[1:    ksoftirqd/1:   19] 5da0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954593] I[1:    ksoftirqd/1:   19] 5dc0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954607] I[1:    ksoftirqd/1:   19] 5de0 : 00000000 00000000 051E0BC0 FFFFFFC0 00000085 00000000 3C0ADD53 FCA9C68D
> <4>[60392.954622] I[1:    ksoftirqd/1:   19] 5e00 : 831FD9AC 0200A8C0 EEE47EBA 808CBB01 4004000A 00000000 00000000 00000000
> <4>[60392.954640] I[1:    ksoftirqd/1:   19] 5e20 : BC8B82B8 FFFFFFC8 0AAF9E10 FFFFFF80 0AAEBC80 FFFFFF80 00000000 00000000
> <4>[60392.954673] I[1:    ksoftirqd/1:   19] 5e40 : FFFF0000 831FD9AC 00000000 00000000 FFFF0000 0200A8C0 00017031 00000000
> <4>[60392.954687] I[1:    ksoftirqd/1:   19] 5e60 : 00004301 00000000 0000FD75 00000000 EE63F5D0 FFFFFFC8 FFFFFFFF 00000004
> <4>[60392.954702] I[1:    ksoftirqd/1:   19] 5e80 : 00000003 00000000 00790078 00000000 00000000 00000000 051E5E98 FFFFFFC0
> <4>[60392.954716] I[1:    ksoftirqd/1:   19] 5ea0 : 051E5E98 FFFFFFC0 00000000 00000001 051E5EB0 FFFFFFC0 051E5EB0 FFFFFFC0
> <4>[60392.954730] I[1:    ksoftirqd/1:   19] 5ec0 : 00000000 00000000 051E5EC8 FFFFFFC0 051E5EC8 FFFFFFC0 00000000 00000000
> <4>[60392.954745] I[1:    ksoftirqd/1:   19] 5ee0 : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954761] I[1:    ksoftirqd/1:   19] 
> <4>[60392.954761] I[1:    ksoftirqd/1:   19] X28: 0xffffffc82fe10b2c:
> <4>[60392.954772] I[1:    ksoftirqd/1:   19] 0b2c : 05F02FA5 F6F39767 535F5E0E 0CC4A1B3 04B50A41 DE8744AE 00000040 00000020
> <4>[60392.954787] I[1:    ksoftirqd/1:   19] 0b4c : 00000000 00000002 00000000 DB9D6F18 FFFFFFC8 00000000 00000000 00000000
> <4>[60392.954801] I[1:    ksoftirqd/1:   19] 0b6c : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954815] I[1:    ksoftirqd/1:   19] 0b8c : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954830] I[1:    ksoftirqd/1:   19] 0bac : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954844] I[1:    ksoftirqd/1:   19] 0bcc : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954858] I[1:    ksoftirqd/1:   19] 0bec : 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
> <4>[60392.954872] I[1:    ksoftirqd/1:   19] 0c0c : 00080000 5000C045 000036D4 62240140 0200A8C0 0200A8C0 ABB50103 00000000
> <4>[60392.954886] I[1:    ksoftirqd/1:   19] 0c2c : 34000045 004023E3 99CA0640 0200A8C0 831FD9AC BB018C80 AE46FB9F 537870A5
> <4>[60392.954900] I[1:    ksoftirqd/1:   19] 0c4c : 48031180 00002D8D 0A080101 F2556142 DBE9DC24 736D692E 76726573 00656369
> <4>[60392.954914] I[1:    ksoftirqd/1:   19] 0c6c : 00390100 00000000 4E000000 554C4C55 00644C4C 00000000 00000000 00000000
> <4>[60392.954928] I[1:    ksoftirqd/1:   19] 0c8c : 00000000 00000000 00000000 00000000 00000000 00000000 00000001 00000000
> <4>[60392.954942] I[1:    ksoftirqd/1:   19] 0cac : 00000000 00000000 00000000 00000000 00000000 00000001 00000000 00000000
> <4>[60392.954956] I[1:    ksoftirqd/1:   19] 0ccc : 00000000 00000000 00000000 00000000 00000000 00100000 00000001 2FE10CF8
> <4>[60392.954970] I[1:    ksoftirqd/1:   19] 0cec : FFFFFFC8 00000000 00000000 001B4880 FFFFFFBF 00001000 00000000 00000000
> <4>[60392.954984] I[1:    ksoftirqd/1:   19] 0d0c : 00000002 00000001 00000001 00000000 00000000 00000001 00000001 00000000
> <4>[60392.954999] I[1:    ksoftirqd/1:   19] 
> <4>[60392.954999] I[1:    ksoftirqd/1:   19] X29: 0xffffff800b95b890:
> <4>[60392.955010] I[1:    ksoftirqd/1:   19] b890 : EF89B000 FFFFFFC8 EE595D00 B254C55C 2FE10C24 FFFFFFC8 36B80010 FFFFFFC0
> <4>[60392.955025] I[1:    ksoftirqd/1:   19] b8b0 : 0B2D8880 FFFFFF80 0AAEBC80 FFFFFF80 00000010 00000000 00000000 00000000
> <4>[60392.955039] I[1:    ksoftirqd/1:   19] b8d0 : 0B95B930 FFFFFF80 09015704 FFFFFF80 00000003 00000000 0906F3D0 FFFFFF80
> <4>[60392.955053] I[1:    ksoftirqd/1:   19] b8f0 : 00000001 00000000 EF89B000 FFFFFFC8 0AAEBC80 FFFFFF80 2FE10C24 FFFFFFC8
> <4>[60392.955067] I[1:    ksoftirqd/1:   19] b910 : 00000000 00000000 00000000 FFFFFFC8 00780078 FFFFFFC8 EE595D00 B254C55C
> <4>[60392.955081] I[1:    ksoftirqd/1:   19] b930 : 0B95B990 FFFFFF80 09034E40 FFFFFF80 0A5386B0 FFFFFF80 0A540FD0 FFFFFF80
> <4>[60392.955096] I[1:    ksoftirqd/1:   19] b950 : EF89B0A0 FFFFFFC8 EF89B000 FFFFFFC8 00000008 00000000 2FE10C24 FFFFFFC8
> <4>[60392.955110] I[1:    ksoftirqd/1:   19] b970 : 00000000 00000000 00000006 00000000 00000000 00000000 1EEBFB80 FFFFFFC8
> <4>[60392.955124] I[1:    ksoftirqd/1:   19] b990 : 0B95B9C0 FFFFFF80 0904A990 FFFFFF80 0AAEBC80 FFFFFF80 36B82128 FFFFFFC0
> <4>[60392.955138] I[1:    ksoftirqd/1:   19] b9b0 : 2FE10C2C FFFFFFC8 1EEBFB80 FFFFFFC8 0B95BA00 FFFFFF80 0904A6D0 FFFFFF80
> <4>[60392.955152] I[1:    ksoftirqd/1:   19] b9d0 : 1EEBFC18 FFFFFFC8 EE595D00 B254C55C 0A540578 FFFFFF80 12995900 FFFFFFC0
> <4>[60392.955167] I[1:    ksoftirqd/1:   19] b9f0 : 0AAEBC80 FFFFFF80 1EEBFB80 FFFFFFC8 0B95BA40 FFFFFF80 0904A3AC FFFFFF80
> <4>[60392.955181] I[1:    ksoftirqd/1:   19] ba10 : 00000008 00000000 1EEBFC18 FFFFFFC8 0A540578 FFFFFF80 0964F9E8 FFFFFF80
> <4>[60392.955195] I[1:    ksoftirqd/1:   19] ba30 : 0AAEBC80 FFFFFF80 1EEBFB80 FFFFFFC8 0B95BA70 FFFFFF80 0900B104 FFFFFF80
> <4>[60392.955209] I[1:    ksoftirqd/1:   19] ba50 : 2FE10C10 FFFFFFC8 00000001 00000000 0AAEBC80 FFFFFF80 1EEBFB80 FFFFFFC8
> <4>[60392.955223] I[1:    ksoftirqd/1:   19] ba70 : 0B95BAE0 FFFFFF80 0900AFD4 FFFFFF80 00000004 00000000 00000001 00000002
> <4>[60392.955238] I[1:    ksoftirqd/1:   19] 
> <0>[60392.955246] I[1:    ksoftirqd/1:   19] Process ksoftirqd/1 (pid: 19, stack limit = 0xffffff800b958000)
> <0>[60392.955253] I[1:    ksoftirqd/1:   19] Call trace:
> <4>[60392.955263] I[1:    ksoftirqd/1:   19] Exception stack(0xffffff800b95b700 to 0xffffff800b95b840)
> <4>[60392.955272] I[1:    ksoftirqd/1:   19] b700: 0000000000000040 000000000200a8c0 000000000000808c 00000000831fd9ac
> <4>[60392.955281] I[1:    ksoftirqd/1:   19] b720: 000000000000bb01 000000000000808c 0000000000000010 0000000000000000
> <4>[60392.955290] I[1:    ksoftirqd/1:   19] b740: 0000000000000200 0000000000000020 0000000000007530 ffffffc0051e5f58
> <4>[60392.955298] I[1:    ksoftirqd/1:   19] b760: 0000000000000000 0000000000000002 0000000000000000 ffffffffffffffff
> <4>[60392.955306] I[1:    ksoftirqd/1:   19] b780: 0000000000000000 0000000000000400 0000000000000001 ffffffc0051e5e00
> <4>[60392.955315] I[1:    ksoftirqd/1:   19] b7a0: ffffffc0051e5e88 0000000000000071 0000000000000000 ffffffc0051e5f58
> <4>[60392.955323] I[1:    ksoftirqd/1:   19] b7c0: ffffff800aaebc80 ffffffc0051e5e00 0000000000000001 0000000000000003
> <4>[60392.955332] I[1:    ksoftirqd/1:   19] b7e0: ffffffc82fe10c2c ffffff800b95b990 ffffff80090350cc ffffff800b95b940
> <4>[60392.955341] I[1:    ksoftirqd/1:   19] b800: ffffff80090351d0 0000000060c00145 0000000000000001 b254c55cee595d00
> <4>[60392.955349] I[1:    ksoftirqd/1:   19] b820: ffffffffffffffff ffffff800b2d7db8 ffffff800b95b990 ffffff80090351d0
> <0>[60392.955362] I[1:    ksoftirqd/1:   19] [<ffffff80090351d0>] tcp_v4_err+0x4b0/0x4bc
> <0>[60392.955372] I[1:    ksoftirqd/1:   19] [<ffffff800904a990>] icmp_socket_deliver+0x70/0xc0
> <0>[60392.955380] I[1:    ksoftirqd/1:   19] [<ffffff800904a6d0>] icmp_unreach+0x1b4/0x1f0
> <0>[60392.955389] I[1:    ksoftirqd/1:   19] [<ffffff800904a3ac>] icmp_rcv+0x310/0x348
> <0>[60392.955400] I[1:    ksoftirqd/1:   19] [<ffffff800900b104>] ip_local_deliver_finish+0xf8/0x1f0
> <0>[60392.955409] I[1:    ksoftirqd/1:   19] [<ffffff800900afd4>] ip_local_deliver+0xc8/0x100
> <0>[60392.955418] I[1:    ksoftirqd/1:   19] [<ffffff800900b790>] ip_rcv_finish+0x218/0x2e4
> <0>[60392.955426] I[1:    ksoftirqd/1:   19] [<ffffff800900b4c0>] ip_rcv+0x2c4/0x37c
> <0>[60392.955437] I[1:    ksoftirqd/1:   19] [<ffffff8008f84f98>] __netif_receive_skb_core+0x8f0/0xa68
> <0>[60392.955446] I[1:    ksoftirqd/1:   19] [<ffffff8008f85960>] process_backlog+0x17c/0x290
> <0>[60392.955455] I[1:    ksoftirqd/1:   19] [<ffffff8008f85ef0>] net_rx_action+0x224/0x464
> <0>[60392.955465] I[1:    ksoftirqd/1:   19] [<ffffff80081b9564>] __do_softirq+0x200/0x39c
> <0>[60392.955475] I[1:    ksoftirqd/1:   19] [<ffffff80081f1f04>] run_ksoftirqd+0x34/0x74
> <0>[60392.955485] I[1:    ksoftirqd/1:   19] [<ffffff800821ad7c>] smpboot_thread_fn+0x1d0/0x2f8
> <0>[60392.955495] I[1:    ksoftirqd/1:   19] [<ffffff8008215c48>] kthread+0x11c/0x130
> <0>[60392.955505] I[1:    ksoftirqd/1:   19] [<ffffff80081bdaa0>] ret_from_fork+0x10/0x1c
> <0>[60392.955515] I[1:    ksoftirqd/1:   19] Code: f9402d08 94063788 aa1603e8 17ffff80 (d4210000) 
> <4>[60392.955524] I[1:    ksoftirqd/1:   19] ---[ end trace c1d9b9267f6ef3c2 ]---
> 

^ permalink raw reply	[flat|nested] 8+ messages in thread

* RE:(2) (2) [Bug reporting] kernel panic during handle the dst unreach icmp msg.
       [not found]       ` <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p6>
@ 2019-02-15  1:30         ` 배석진
  0 siblings, 0 replies; 8+ messages in thread
From: 배석진 @ 2019-02-15  1:30 UTC (permalink / raw)
  To: Eric Dumazet, 배석진, netdev
  Cc: 박종언, Steffen Klassert, Herbert Xu

> > <4>[60392.948306] I[1:    ksoftirqd/1:   19] ------------[ cut here ]------------
> > <0>[60392.948334] I[1:    ksoftirqd/1:   19] kernel BUG at net/ipv4/tcp_ipv4.c:519!
>  
> What the code looks like at line 519 of net/ipv4/tcp_ipv4.c ?
>  
> This is not a pristine kernel, anything could be wrong, you might have missed some critical backports.
>  


I attached that at first mail,
although we added some featre as you said, (about MPTCP)
it looks like clear that the reason for BUG trigger.


> > 370 void tcp_v4_err(struct sk_buff *icmp_skb, u32 info)
> > 371 {
> >         ...
> > 516		icsk->icsk_rto = inet_csk_rto_backoff(icsk, TCP_RTO_MAX);
> > 517
> > 518		skb = tcp_write_queue_head(sk);
> > 519		BUG_ON(!skb);
> > 520
> > 521		tcp_mstamp_refresh(tp);
> > 
> > 
> > we know that the line 519 removed on latest state. instead this will be shown to kernel panic.



^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: (2) [Bug reporting] kernel panic during handle the dst unreach icmp msg.
  2019-02-15  1:08       ` (2) " Eric Dumazet
@ 2019-02-15  1:30         ` Eric Dumazet
       [not found]         ` <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p4>
  1 sibling, 0 replies; 8+ messages in thread
From: Eric Dumazet @ 2019-02-15  1:30 UTC (permalink / raw)
  To: soukjin.bae, netdev; +Cc: 박종언, Yuchung Cheng



On 02/14/2019 05:08 PM, Eric Dumazet wrote:
> 
> 
> On 02/14/2019 03:54 PM, 배석진 wrote:
>>> I do not believe this patch is needed.
>>>  
>>> You probably hit another more serious bug, but since you do not post the full stack trace
>>> it is hard to help.
>>>  
>>> Are you using vti tunnel ?
>>
>> there's no working logs of vpn/vti/tun on platform or kernel history.
>> and callstack has no functions about that.
>> it looks like simple ipv4 usage.
>>
>> attaching full dump info.
>> no additional bug or warning on entire kernel history.
>> anything about tun or kasan even onther.
>>
>> thanks.
>>
>>
>> <4>[60392.948306] I[1:    ksoftirqd/1:   19] ------------[ cut here ]------------
>> <0>[60392.948334] I[1:    ksoftirqd/1:   19] kernel BUG at net/ipv4/tcp_ipv4.c:519!
> 
> What the code looks like at line 519 of net/ipv4/tcp_ipv4.c ?
> 
> This is not a pristine kernel, anything could be wrong, you might have missed some critical backports.

The current code checks if icsk->icsk_backoff is not zero, so it looks like we have to move
some code like this.

It looks a silly bug to have no packet in write/rtx queues, and a non zero icsk_backoff.



diff --git a/net/ipv4/tcp.c b/net/ipv4/tcp.c
index 2079145a3b7c5f498af429c9a8289342e4421fca..cf3c5095c10e8e7e56621beae2f93c93de184489 100644
--- a/net/ipv4/tcp.c
+++ b/net/ipv4/tcp.c
@@ -2528,6 +2528,7 @@ void tcp_write_queue_purge(struct sock *sk)
        sk_mem_reclaim(sk);
        tcp_clear_all_retrans_hints(tcp_sk(sk));
        tcp_sk(sk)->packets_out = 0;
+       inet_csk(sk)->icsk_backoff = 0;
 }
 
 int tcp_disconnect(struct sock *sk, int flags)
@@ -2576,7 +2577,6 @@ int tcp_disconnect(struct sock *sk, int flags)
        tp->write_seq += tp->max_window + 2;
        if (tp->write_seq == 0)
                tp->write_seq = 1;
-       icsk->icsk_backoff = 0;
        tp->snd_cwnd = 2;
        icsk->icsk_probes_out = 0;
        tp->snd_ssthresh = TCP_INFINITE_SSTHRESH;



^ permalink raw reply related	[flat|nested] 8+ messages in thread

* RE:(2) (2) [Bug reporting] kernel panic during handle the dst unreach icmp msg.
       [not found]         ` <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p4>
@ 2019-02-15  1:37           ` 배석진
  2019-02-15  1:41             ` (2) " Eric Dumazet
  0 siblings, 1 reply; 8+ messages in thread
From: 배석진 @ 2019-02-15  1:37 UTC (permalink / raw)
  To: Eric Dumazet, 배석진, netdev
  Cc: 박종언, Yuchung Cheng

> The current code checks if icsk->icsk_backoff is not zero, so it looks like we have to move
> some code like this.
>  
> It looks a silly bug to have no packet in write/rtx queues, and a non zero icsk_backoff.
>  
>  
>  
> diff --git a/net/ipv4/tcp.c b/net/ipv4/tcp.c
> index 2079145a3b7c5f498af429c9a8289342e4421fca..cf3c5095c10e8e7e56621beae2f93c93de184489 100644
> --- a/net/ipv4/tcp.c
> +++ b/net/ipv4/tcp.c
> @@ -2528,6 +2528,7 @@ void tcp_write_queue_purge(struct sock *sk)
>         sk_mem_reclaim(sk);
>         tcp_clear_all_retrans_hints(tcp_sk(sk));
>         tcp_sk(sk)->packets_out = 0;
> +       inet_csk(sk)->icsk_backoff = 0;
>  }
>  
>  int tcp_disconnect(struct sock *sk, int flags)
> @@ -2576,7 +2577,6 @@ int tcp_disconnect(struct sock *sk, int flags)
>         tp->write_seq += tp->max_window + 2;
>         if (tp->write_seq == 0)
>                 tp->write_seq = 1;
> -       icsk->icsk_backoff = 0;
>         tp->snd_cwnd = 2;
>         icsk->icsk_probes_out = 0;
>         tp->snd_ssthresh = TCP_INFINITE_SSTHRESH;
>  
 
yes right, queue problems.
I don't know about icsk_backoff :p
this will be work. thanks!

^ permalink raw reply	[flat|nested] 8+ messages in thread

* Re: (2) (2) [Bug reporting] kernel panic during handle the dst unreach icmp msg.
  2019-02-15  1:37           ` 배석진
@ 2019-02-15  1:41             ` Eric Dumazet
  0 siblings, 0 replies; 8+ messages in thread
From: Eric Dumazet @ 2019-02-15  1:41 UTC (permalink / raw)
  To: soukjin.bae, netdev; +Cc: 박종언, Yuchung Cheng



On 02/14/2019 05:37 PM, 배석진 wrote:
>> The current code checks if icsk->icsk_backoff is not zero, so it looks like we have to move
>> some code like this.
>>  
>> It looks a silly bug to have no packet in write/rtx queues, and a non zero icsk_backoff.
>>  
>>  
>>  
>> diff --git a/net/ipv4/tcp.c b/net/ipv4/tcp.c
>> index 2079145a3b7c5f498af429c9a8289342e4421fca..cf3c5095c10e8e7e56621beae2f93c93de184489 100644
>> --- a/net/ipv4/tcp.c
>> +++ b/net/ipv4/tcp.c
>> @@ -2528,6 +2528,7 @@ void tcp_write_queue_purge(struct sock *sk)
>>         sk_mem_reclaim(sk);
>>         tcp_clear_all_retrans_hints(tcp_sk(sk));
>>         tcp_sk(sk)->packets_out = 0;
>> +       inet_csk(sk)->icsk_backoff = 0;
>>  }
>>  
>>  int tcp_disconnect(struct sock *sk, int flags)
>> @@ -2576,7 +2577,6 @@ int tcp_disconnect(struct sock *sk, int flags)
>>         tp->write_seq += tp->max_window + 2;
>>         if (tp->write_seq == 0)
>>                 tp->write_seq = 1;
>> -       icsk->icsk_backoff = 0;
>>         tp->snd_cwnd = 2;
>>         icsk->icsk_probes_out = 0;
>>         tp->snd_ssthresh = TCP_INFINITE_SSTHRESH;
>>  
>  
> yes right, queue problems.
> I don't know about icsk_backoff :p
> this will be work. thanks!
> 

I am running our packetdrill tests just to be reasonably safe.

^ permalink raw reply	[flat|nested] 8+ messages in thread

end of thread, other threads:[~2019-02-15  1:41 UTC | newest]

Thread overview: 8+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
     [not found] <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p1>
2019-02-14  7:46 ` [Bug reporting] kernel panic during handle the dst unreach icmp msg 배석진
2019-02-14 17:15   ` Eric Dumazet
     [not found]   ` <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p2>
2019-02-14 23:54     ` 배석진
2019-02-15  1:08       ` (2) " Eric Dumazet
2019-02-15  1:30         ` Eric Dumazet
     [not found]         ` <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p4>
2019-02-15  1:37           ` 배석진
2019-02-15  1:41             ` (2) " Eric Dumazet
     [not found]       ` <CGME20190214074641epcms1p1db1c5589f96718a440a166328eec9ebd@epcms1p6>
2019-02-15  1:30         ` 배석진

This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).