From mboxrd@z Thu Jan 1 00:00:00 1970 From: Martin Zaharinov Subject: 4.15.13 kernel panic, ip_rcv_finish, nf_xfrm_me_harder warnings continue to fill dmesg Date: Sun, 9 Dec 2018 10:44:15 +0200 Message-ID: <1C9877CE-F8CF-44EE-AD2F-70C3D9A5A899@gmail.com> Mime-Version: 1.0 (Mac OS X Mail 12.0 \(3445.100.39\)) Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Cc: netdev@vger.kernel.org To: nuclearcat@nuclearcat.com Return-path: Received: from mail-wm1-f68.google.com ([209.85.128.68]:37027 "EHLO mail-wm1-f68.google.com" rhost-flags-OK-OK-OK-OK) by vger.kernel.org with ESMTP id S1726079AbeLIIoV (ORCPT ); Sun, 9 Dec 2018 03:44:21 -0500 Received: by mail-wm1-f68.google.com with SMTP id g67so8198526wmd.2 for ; Sun, 09 Dec 2018 00:44:19 -0800 (PST) Sender: netdev-owner@vger.kernel.org List-ID: Hi Denys Do you find fix for this bug=20 I use latest kernel 4.19.8 and have same problem see down i use pppoe with 1k+ users if i activate shaper with hfsc and imq = machine crash and reboot=20 after stop shaper for test mashine only send in dmesg bug error mesg. This is a Kernel BUG and need to by fix=20 if any need more info or debug i will send you. [93408.910441] WARNING: CPU: 1 PID: 0 at include/net/dst.h:239 = nf_xfrm_me_harder+0xe7/0x130 [nf_nat] [93408.945500] Modules linked in: udp_diag unix_diag af_packet_diag = sch_hfsc iptable_filter xt_IMQ iptable_mangle xt_addrtype xt_nat = ipt_MASQUERADE iptable_nat nf_nat_ipv4 ip_tables bpfilter sch_fq_codel = netconsole r8169 tg3 libphy igb i2c_algo_bit ixgb nf_nat_pptp = nf_nat_proto_gre nf_conntrack_pptp nf_conntrack_proto_gre nf_nat_tftp = nf_conntrack_tftp nf_nat_ftp nf_conntrack_ftp nf_nat nf_conntrack = nf_defrag_ipv4 pppoe pptp gre pppox sha1_mb mcryptd sha1_ssse3 = sha1_generic arc4 ppp_mppe ppp_generic slhc megaraid_sas [last = unloaded: imq] [93409.103093] CPU: 1 PID: 0 Comm: PDS/1 Tainted: G O = 4.19.6 #1 [93409.124009] Hardware name: Supermicro Super Server/X11SSZ-F, BIOS = 2.2b 02/12/2018 [93409.166624] RIP: 0010:nf_xfrm_me_harder+0xe7/0x130 [nf_nat] [93409.188447] Code: 48 8b 5c 24 60 65 48 33 1c 25 28 00 00 00 75 53 48 = 83 c4 68 5b 5d 41 5c c3 85 c0 74 0d 8d 48 01 f0 0f b1 0a 74 86 85 c0 75 = f3 <0f> 0b e9 7b ff ff ff 29 c6 31 d2 b9 20 00 48 00 4c 89 e7 e8 31 27 [93409.254096] RSP: 0018:ffff888454c83ce0 EFLAGS: 00010246 [93409.275791] RAX: 0000000000000000 RBX: ffffffff81e83f40 RCX: = 00000000000098a2 [93409.297628] RDX: 0000000000000000 RSI: ffff88843c229480 RDI: = 0000000000000038 [93409.319099] RBP: 0000000000000000 R08: 0000000000000038 R09: = ffff8883e2811000 [93409.340547] R10: 0000000000000009 R11: 0000000000000000 R12: = ffff8883e68d7a00 [93409.361901] R13: ffff888454c83db8 R14: ffff888454c9f64c R15: = ffff888454c9f650 [93409.383419] FS: 0000000000000000(0000) GS:ffff888454c80000(0000) = knlGS:0000000000000000 [93409.427294] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [93409.449919] CR2: 00007f864054e730 CR3: 0000000001e0a006 CR4: = 00000000001606e0 [93409.472746] DR0: 0000000000000000 DR1: 0000000000000000 DR2: = 0000000000000000 [93409.495480] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: = 0000000000000400 [93409.518035] Call Trace: [93409.539897] [93409.561039] ? nf_nat_ipv4_manip_pkt+0x54/0x100 [nf_nat_ipv4] [93409.582440] nf_nat_ipv4_out+0x78/0x90 [nf_nat_ipv4] [93409.603476] nf_hook_slow+0x36/0xd0 [93409.623865] ip_output+0x9f/0xd0 [93409.643603] ? ip_fragment.constprop.5+0x70/0x70 [93409.663095] ip_forward+0x328/0x440 [93409.681987] ? ip_defrag.cold.3+0x22/0x22 [93409.700405] ip_rcv+0x8a/0xb0 [93409.718201] ? ip_rcv_finish_core.isra.0+0x340/0x340 [93409.735914] __netif_receive_skb_one_core+0x4b/0x70 [93409.753308] process_backlog+0x95/0x130 [93409.770199] net_rx_action+0x122/0x2d0 [93409.786744] __do_softirq+0xba/0x206 [93409.802880] irq_exit+0xae/0xf0 [93409.818424] call_function_single_interrupt+0xf/0x20 [93409.834147] [93409.849337] RIP: 0010:mwait_idle+0x50/0x80 [93409.864491] Code: 0f ba e2 27 72 3a 31 d2 65 48 8b 04 25 40 4c 01 00 = 48 89 d1 0f 01 c8 48 8b 00 48 c1 e8 03 83 e0 01 75 2b 48 89 c1 fb 0f 01 = c9 <65> 8b 05 69 b2 9e 7e 65 48 8b 04 25 40 4c 01 00 f0 80 60 02 df c3 [93409.913067] RSP: 0018:ffffc900000b3ed0 EFLAGS: 00000246 ORIG_RAX: = ffffffffffffff04 [93409.946216] RAX: 0000000000000000 RBX: 0000000000000001 RCX: = 0000000000000000 [93409.963281] RDX: 0000000000000000 RSI: 0000000000000000 RDI: = ffff888454c9ef80 [93409.980003] RBP: ffffffff81e943a0 R08: 0000000000000000 R09: = 000000000001e540 [93409.996513] R10: 0000fefbc9e70705 R11: 0000000000000001 R12: = 0000000000000000 [93410.013011] R13: 0000000000000000 R14: 0000000000000000 R15: = 0000000000000000 [93410.029583] do_idle+0x1c7/0x1e0 [93410.045584] cpu_startup_entry+0x6a/0x70 [93410.061835] start_secondary+0x165/0x190 [93410.077838] secondary_startup_64+0xa4/0xb0 [93410.093605] ---[ end trace 2bdcfd51408010e6 ]--- [93410.109465] dst_release: dst:00000000aa09d44e refcnt:-1 [167366.275640] WARNING: CPU: 1 PID: 0 at include/net/dst.h:239 = nf_xfrm_me_harder+0xe7/0x130 [nf_nat] [167366.309111] Modules linked in: udp_diag unix_diag af_packet_diag = sch_hfsc iptable_filter xt_IMQ iptable_mangle xt_addrtype xt_nat = ipt_MASQUERADE iptable_nat nf_nat_ipv4 ip_tables bpfilter sch_fq_codel = netconsole r8169 tg3 libphy igb i2c_algo_bit ixgb nf_nat_pptp = nf_nat_proto_gre nf_conntrack_pptp nf_conntrack_proto_gre nf_nat_tftp = nf_conntrack_tftp nf_nat_ftp nf_conntrack_ftp nf_nat nf_conntrack = nf_defrag_ipv4 pppoe pptp gre pppox sha1_mb mcryptd sha1_ssse3 = sha1_generic arc4 ppp_mppe ppp_generic slhc megaraid_sas [last = unloaded: imq] [167366.464130] CPU: 1 PID: 0 Comm: PDS/1 Tainted: G W O = 4.19.6 #1 [167366.485631] Hardware name: Supermicro Super Server/X11SSZ-F, BIOS = 2.2b 02/12/2018 [167366.528653] RIP: 0010:nf_xfrm_me_harder+0xe7/0x130 [nf_nat] [167366.550679] Code: 48 8b 5c 24 60 65 48 33 1c 25 28 00 00 00 75 53 48 = 83 c4 68 5b 5d 41 5c c3 85 c0 74 0d 8d 48 01 f0 0f b1 0a 74 86 85 c0 75 = f3 <0f> 0b e9 7b ff ff ff 29 c6 31 d2 b9 20 00 48 00 4c 89 e7 e8 31 27 [167366.616853] RSP: 0018:ffff888454c83ce0 EFLAGS: 00010246 [167366.638487] RAX: 0000000000000000 RBX: ffffffff81e83f40 RCX: = 00000000000078d8 [167366.681541] RDX: 0000000000000000 RSI: ffff88843043dc00 RDI: = 0000000000000034 [167366.726519] RBP: 0000000000000000 R08: 0000000000000034 R09: = ffff88843c0cb800 [167366.773419] R10: 0000000000000001 R11: 00000000a184220c R12: = ffff8884233f9f00 [167366.822018] R13: ffff888454c83db8 R14: ffff888454c9f64c R15: = ffff888454c9f650 [167366.872587] FS: 0000000000000000(0000) GS:ffff888454c80000(0000) = knlGS:0000000000000000 [167366.924358] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [167366.950272] CR2: 00007f05086ba730 CR3: 0000000001e0a005 CR4: = 00000000001606e0 [167367.001147] DR0: 0000000000000000 DR1: 0000000000000000 DR2: = 0000000000000000 [167367.051930] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: = 0000000000000400 [167367.102616] Call Trace: [167367.127176] [167367.150970] ? nf_nat_ipv4_manip_pkt+0x54/0x100 [nf_nat_ipv4] [167367.174995] nf_nat_ipv4_out+0x78/0x90 [nf_nat_ipv4] [167367.198776] nf_hook_slow+0x36/0xd0 [167367.221966] ip_output+0x9f/0xd0 [167367.244707] ? ip_fragment.constprop.5+0x70/0x70 [167367.267413] ip_forward+0x328/0x440 [167367.289531] ? ip_defrag.cold.3+0x22/0x22 [167367.311506] ip_rcv+0x8a/0xb0 [167367.333045] ? ip_rcv_finish_core.isra.0+0x340/0x340 [167367.354669] __netif_receive_skb_one_core+0x4b/0x70 [167367.375857] process_backlog+0x95/0x130 [167367.396512] net_rx_action+0x122/0x2d0 [167367.416657] __do_softirq+0xba/0x206 [167367.436252] irq_exit+0xae/0xf0 [167367.455217] call_function_single_interrupt+0xf/0x20 [167367.474067] [167367.492164] RIP: 0010:mwait_idle+0x50/0x80 [167367.510058] Code: 0f ba e2 27 72 3a 31 d2 65 48 8b 04 25 40 4c 01 00 = 48 89 d1 0f 01 c8 48 8b 00 48 c1 e8 03 83 e0 01 75 2b 48 89 c1 fb 0f 01 = c9 <65> 8b 05 69 b2 9e 7e 65 48 8b 04 25 40 4c 01 00 f0 80 60 02 df c3 [167367.563719] RSP: 0018:ffffc900000b3ed0 EFLAGS: 00000246 ORIG_RAX: = ffffffffffffff04 [167367.599058] RAX: 0000000000000000 RBX: 0000000000000001 RCX: = 0000000000000000 [167367.634529] RDX: 0000000000000000 RSI: 0000000000000000 RDI: = ffff888454c9ef80 [167367.669999] RBP: ffffffff81e943a0 R08: 0000000000000000 R09: = 000000000001e540 [167367.706047] R10: 0001c8c669f1f230 R11: 0000000000000001 R12: = 0000000000000000 [167367.744336] R13: 0000000000000000 R14: 0000000000000000 R15: = 0000000000000000 [167367.783856] do_idle+0x1c7/0x1e0 [167367.803883] cpu_startup_entry+0x6a/0x70 [167367.823888] start_secondary+0x165/0x190 [167367.843764] secondary_startup_64+0xa4/0xb0 [167367.863653] ---[ end trace 2bdcfd51408010e7 ]--- [167367.883692] dst_release: dst:00000000a44e0ec4 refcnt:-1 [252467.564184] WARNING: CPU: 2 PID: 0 at include/net/dst.h:239 = nf_xfrm_me_harder+0xe7/0x130 [nf_nat] [252467.605281] Modules linked in: udp_diag unix_diag af_packet_diag = sch_hfsc iptable_filter xt_IMQ iptable_mangle xt_addrtype xt_nat = ipt_MASQUERADE iptable_nat nf_nat_ipv4 ip_tables bpfilter sch_fq_codel = netconsole r8169 tg3 libphy igb i2c_algo_bit ixgb nf_nat_pptp = nf_nat_proto_gre nf_conntrack_pptp nf_conntrack_proto_gre nf_nat_tftp = nf_conntrack_tftp nf_nat_ftp nf_conntrack_ftp nf_nat nf_conntrack = nf_defrag_ipv4 pppoe pptp gre pppox sha1_mb mcryptd sha1_ssse3 = sha1_generic arc4 ppp_mppe ppp_generic slhc megaraid_sas [last = unloaded: imq] [252467.790545] CPU: 2 PID: 0 Comm: PDS/2 Tainted: G W O = 4.19.6 #1 [252467.815020] Hardware name: Supermicro Super Server/X11SSZ-F, BIOS = 2.2b 02/12/2018 [252467.862847] RIP: 0010:nf_xfrm_me_harder+0xe7/0x130 [nf_nat] [252467.886814] Code: 48 8b 5c 24 60 65 48 33 1c 25 28 00 00 00 75 53 48 = 83 c4 68 5b 5d 41 5c c3 85 c0 74 0d 8d 48 01 f0 0f b1 0a 74 86 85 c0 75 = f3 <0f> 0b e9 7b ff ff ff 29 c6 31 d2 b9 20 00 48 00 4c 89 e7 e8 31 27 [252467.958250] RSP: 0018:ffff888454d03ce0 EFLAGS: 00010246 [252467.981527] RAX: 0000000000000000 RBX: ffffffff81e83f40 RCX: = 00000000000042c0 [252468.027286] RDX: 0000000000000000 RSI: ffff8883d6739e40 RDI: = 000000000000003c [252468.073045] RBP: 0000000000000000 R08: 000000000000003c R09: = ffff8883dd6c0000 [252468.119276] R10: 0000000000000001 R11: 00000000c6267cc9 R12: = ffff8884233f9600 [252468.167556] R13: ffff888454d03db8 R14: ffff888454d1f64c R15: = ffff888454d1f650 [252468.217830] FS: 0000000000000000(0000) GS:ffff888454d00000(0000) = knlGS:0000000000000000 [252468.269423] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [252468.295296] CR2: 00007fe353cc1730 CR3: 0000000001e0a006 CR4: = 00000000001606e0 [252468.346050] DR0: 0000000000000000 DR1: 0000000000000000 DR2: = 0000000000000000 [252468.396711] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: = 0000000000000400 [252468.447279] Call Trace: [252468.471779] [252468.495502] ? nf_nat_ipv4_manip_pkt+0x54/0x100 [nf_nat_ipv4] [252468.519483] nf_nat_ipv4_out+0x78/0x90 [nf_nat_ipv4] [252468.543220] nf_hook_slow+0x36/0xd0 [252468.566376] ip_output+0x9f/0xd0 [252468.589096] ? ip_fragment.constprop.5+0x70/0x70 [252468.611746] ip_forward+0x328/0x440 [252468.633842] ? ip_defrag.cold.3+0x22/0x22 [252468.655784] ip_rcv+0x8a/0xb0 [252468.677304] ? ip_rcv_finish_core.isra.0+0x340/0x340 [252468.698893] __netif_receive_skb_one_core+0x4b/0x70 [252468.720046] process_backlog+0x95/0x130 [252468.740681] net_rx_action+0x122/0x2d0 [252468.760788] __do_softirq+0xba/0x206 [252468.780328] irq_exit+0xae/0xf0 [252468.799242] call_function_single_interrupt+0xf/0x20 [252468.818051] [252468.836129] RIP: 0010:mwait_idle+0x50/0x80 [252468.854017] Code: 0f ba e2 27 72 3a 31 d2 65 48 8b 04 25 40 4c 01 00 = 48 89 d1 0f 01 c8 48 8b 00 48 c1 e8 03 83 e0 01 75 2b 48 89 c1 fb 0f 01 = c9 <65> 8b 05 69 b2 9e 7e 65 48 8b 04 25 40 4c 01 00 f0 80 60 02 df c3 [252468.907657] RSP: 0018:ffffc900000bbed0 EFLAGS: 00000246 ORIG_RAX: = ffffffffffffff04 [252468.942894] RAX: 0000000000000000 RBX: 0000000000000002 RCX: = 0000000000000000 [252468.978260] RDX: 0000000000000000 RSI: 0000000000000002 RDI: = ffff888454d1ef80 [252469.013627] RBP: ffffffff81e943a0 R08: ffff888454d1b960 R09: = 000000000001e540 [252469.049574] R10: 0002b0f8f8728b04 R11: 0000000000000001 R12: = 0000000000000000 [252469.087768] R13: 0000000000000000 R14: 0000000000000000 R15: = 0000000000000000 [252469.127132] do_idle+0x1c7/0x1e0 [252469.147082] cpu_startup_entry+0x6a/0x70 [252469.167010] start_secondary+0x165/0x190 [252469.186819] secondary_startup_64+0xa4/0xb0 [252469.206652] ---[ end trace 2bdcfd51408010e8 ]--- [252469.226646] dst_release: dst:00000000e410838d refcnt:-1 [254737.320656] WARNING: CPU: 0 PID: 0 at include/net/dst.h:239 = nf_xfrm_me_harder+0xe7/0x130 [nf_nat] [254737.361598] Modules linked in: udp_diag unix_diag af_packet_diag = sch_hfsc iptable_filter xt_IMQ iptable_mangle xt_addrtype xt_nat = ipt_MASQUERADE iptable_nat nf_nat_ipv4 ip_tables bpfilter sch_fq_codel = netconsole r8169 tg3 libphy igb i2c_algo_bit ixgb nf_nat_pptp = nf_nat_proto_gre nf_conntrack_pptp nf_conntrack_proto_gre nf_nat_tftp = nf_conntrack_tftp nf_nat_ftp nf_conntrack_ftp nf_nat nf_conntrack = nf_defrag_ipv4 pppoe pptp gre pppox sha1_mb mcryptd sha1_ssse3 = sha1_generic arc4 ppp_mppe ppp_generic slhc megaraid_sas [last = unloaded: imq] [254737.546326] CPU: 0 PID: 0 Comm: PDS/0 Tainted: G W O = 4.19.6 #1 [254737.570734] Hardware name: Supermicro Super Server/X11SSZ-F, BIOS = 2.2b 02/12/2018 [254737.618470] RIP: 0010:nf_xfrm_me_harder+0xe7/0x130 [nf_nat] [254737.642396] Code: 48 8b 5c 24 60 65 48 33 1c 25 28 00 00 00 75 53 48 = 83 c4 68 5b 5d 41 5c c3 85 c0 74 0d 8d 48 01 f0 0f b1 0a 74 86 85 c0 75 = f3 <0f> 0b e9 7b ff ff ff 29 c6 31 d2 b9 20 00 48 00 4c 89 e7 e8 31 27 [254737.713703] RSP: 0018:ffff888454c03cb0 EFLAGS: 00010246 [254737.736957] RAX: 0000000000000000 RBX: ffffffff81e83f40 RCX: = 00000000000078be [254737.782676] RDX: 0000000000000000 RSI: ffff8883e2a560c0 RDI: = 000000000000003c [254737.828402] RBP: 0000000000000000 R08: 000000000000003c R09: = ffff88841f67d800 [254737.874593] R10: 0000000000000001 R11: 0000000000000000 R12: = ffff8883e50e0500 [254737.922847] R13: ffff888454c03d88 R14: ffff888454c1f64c R15: = ffff888454c1f650 [254737.973069] FS: 0000000000000000(0000) GS:ffff888454c00000(0000) = knlGS:0000000000000000 [254738.024670] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [254738.050529] CR2: 00007f76b6670730 CR3: 0000000001e0a006 CR4: = 00000000001606f0 [254738.101269] DR0: 0000000000000000 DR1: 0000000000000000 DR2: = 0000000000000000 [254738.151916] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: = 0000000000000400 [254738.202466] Call Trace: [254738.226958] [254738.250700] ? nf_nat_ipv4_manip_pkt+0x54/0x100 [nf_nat_ipv4] [254738.274685] nf_nat_ipv4_out+0x78/0x90 [nf_nat_ipv4] [254738.298423] nf_hook_slow+0x36/0xd0 [254738.321582] ip_output+0x9f/0xd0 [254738.344317] ? ip_fragment.constprop.5+0x70/0x70 [254738.366982] ip_forward+0x328/0x440 [254738.389094] ? ip_defrag.cold.3+0x22/0x22 [254738.411064] ip_rcv+0x8a/0xb0 [254738.432586] ? ip_rcv_finish_core.isra.0+0x340/0x340 [254738.454192] __netif_receive_skb_one_core+0x4b/0x70 [254738.475360] process_backlog+0x95/0x130 [254738.495997] net_rx_action+0x122/0x2d0 [254738.516104] __do_softirq+0xba/0x206 [254738.535681] irq_exit+0xae/0xf0 [254738.554656] do_IRQ+0x72/0xc0 [254738.572996] common_interrupt+0xf/0xf [254738.590876] [254738.608002] RIP: 0010:mwait_idle+0x50/0x80 [254738.624949] Code: 0f ba e2 27 72 3a 31 d2 65 48 8b 04 25 40 4c 01 00 = 48 89 d1 0f 01 c8 48 8b 00 48 c1 e8 03 83 e0 01 75 2b 48 89 c1 fb 0f 01 = c9 <65> 8b 05 69 b2 9e 7e 65 48 8b 04 25 40 4c 01 00 f0 80 60 02 df c3 [254738.675961] RSP: 0018:ffffffff81e03eb0 EFLAGS: 00000246 ORIG_RAX: = ffffffffffffffd4 [254738.709741] RAX: 0000000000000000 RBX: 0000000000000000 RCX: = 0000000000000000 [254738.743461] RDX: 0000000000000000 RSI: 0000000000000000 RDI: = ffff888454c1ef80 [254738.777184] RBP: ffffffff81e943a0 R08: ffffc90008137948 R09: = 000000000001e540 [254738.812743] R10: 0002b72a62932bc1 R11: 0000000000000001 R12: = 0000000000000000 [254738.849773] R13: 0000000000000000 R14: 0000000000000000 R15: = 0000000000000000 [254738.888446] do_idle+0x1c7/0x1e0 [254738.907950] ? do_idle+0x2/0x1e0 [254738.927221] cpu_startup_entry+0x6a/0x70 [254738.946563] start_kernel+0x3d6/0x3f6 [254738.965869] secondary_startup_64+0xa4/0xb0 [254738.985115] ---[ end trace 2bdcfd51408010e9 ]--- [254739.004456] dst_release: dst:000000008c9d8929 refcnt:-1=