All of lore.kernel.org
 help / color / mirror / Atom feed
* Bug Report kernel 5.19.9 Networking NAT
@ 2022-09-17  8:03 Martin Zaharinov
  2022-09-17 20:34 ` Martin Zaharinov
                   ` (2 more replies)
  0 siblings, 3 replies; 10+ messages in thread
From: Martin Zaharinov @ 2022-09-17  8:03 UTC (permalink / raw)
  To: Eric Dumazet, Eric Dumazet, Florian Westphal, netdev, Greg KH, pablo

HI team

This is NAT server with 2gb/s traffic have 2x 10Gb 82599 in Bonding 

one report if find any solution write me :


[35857.548356] ------------[ cut here ]------------
[35857.548358] WARNING: CPU: 28 PID: 0 at net/core/skbuff.c:728 skb_release_head_state+0x8d/0xa0
[35857.548364] Modules linked in: nft_limit nf_conntrack_netlink  pppoe pppox ppp_generic slhc nft_nat nft_masq nft_chain_nat nf_nat xt_CT nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_compat nf_tables netconsole coretemp bonding i40e xt_NAT(O) acpi_ipmi ipmi_si ipmi_devintf ipmi_msghandler rtc_cmos
[35857.548379] CPU: 28 PID: 0 Comm: swapper/28 Tainted: G        W  O      5.19.9 #1
[35857.548381] Hardware name: Supermicro SYS-5038MR-H8TRF/X10SRD-F, BIOS 3.3 10/28/2020
[35857.548383] RIP: 0010:skb_release_head_state+0x8d/0xa0
[35857.548385] Code: 8b bb d8 00 00 00 5b e9 21 e8 ff ff e8 ec 30 08 00 eb d4 be 03 00 00 00 e8 60 b4 d2 ff eb c8 48 83 e7 fe e8 85 e4 01 00 eb cb <0f> 0b eb 94 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 85 ff
[35857.548387] RSP: 0018:ffffb484406c0d30 EFLAGS: 00010206
[35857.548388] RAX: ffffffffb55b7480 RBX: ffff9f01b19f4800 RCX: 000000000002e288
[35857.548389] RDX: 00000000000f0000 RSI: 0000000000000001 RDI: 0000000000000000
[35857.548390] RBP: ffff9f0146a812d0 R08: 0000000000000000 R09: 00000000000000ed
[35857.548391] R10: 0000000000000001 R11: ffff9f01fdc63710 R12: ffff9f01d6b750e2
[35857.548392] R13: 0000000000000000 R14: 0000000000000000 R15: ffff9f01d6b750ce
[35857.548393] FS:  0000000000000000(0000) GS:ffff9f089fd00000(0000) knlGS:0000000000000000
[35857.548394] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[35857.548395] CR2: 00007f4d25bcb38c CR3: 000000010dd1a005 CR4: 00000000003706e0
[35857.548396] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[35857.548397] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[35857.548398] Call Trace:
[35857.548400]  <IRQ>
[35857.548401]  kfree_skb_reason+0x1c/0x70
[35857.548404]  sk_stream_kill_queues+0x52/0xe0
[35857.548408]  inet_csk_destroy_sock+0x46/0xf0
[35857.548410]  tcp_fin+0xdf/0x150
[35857.548414]  tcp_data_queue+0x374/0x510
[35857.548417]  tcp_rcv_state_process+0x259/0x6f0
[35857.548419]  tcp_v4_do_rcv+0xa9/0x1e0
[35857.548422]  tcp_v4_rcv+0xcb9/0xd60
[35857.548424]  ip_protocol_deliver_rcu+0x1b/0x1a0
[35857.548428]  ip_local_deliver_finish+0x68/0x90
[35857.548431]  ? ip_protocol_deliver_rcu+0x1a0/0x1a0
[35857.548434]  __netif_receive_skb_one_core+0x3f/0x50
[35857.548438]  process_backlog+0x7c/0x110
[35857.548440]  __napi_poll+0x20/0x100
[35857.548443]  net_rx_action+0x26d/0x330
[35857.548446]  __do_softirq+0xaf/0x1d7
[35857.548449]  do_softirq+0x5a/0x80
[35857.548453]  </IRQ>
[35857.548453]  <TASK>
[35857.548454]  flush_smp_call_function_queue+0x3f/0x60
[35857.548459]  do_idle+0xa6/0xc0
[35857.548464]  cpu_startup_entry+0x14/0x20
[35857.548467]  start_secondary+0xd6/0xe0
[35857.548472]  secondary_startup_64_no_verify+0xd3/0xdb
[35857.548475]  </TASK>
[35857.548475] ---[ end trace 0000000000000000 ]—




[35936.566314] ------------[ cut here ]------------
[35936.566315] WARNING: CPU: 8 PID: 0 at kernel/time/timer.c:1425 del_timer_sync+0xce/0xe0
[35936.566324] Modules linked in: nft_limit nf_conntrack_netlink pppoe pppox ppp_generic slhc nft_nat nft_masq nft_chain_nat nf_nat xt_CT nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_compat nf_tables netconsole coretemp bonding i40e xt_NAT(O) acpi_ipmi ipmi_si ipmi_devintf ipmi_msghandler rtc_cmos
[35936.566341] CPU: 8 PID: 0 Comm: swapper/8 Tainted: G        W  O      5.19.9 #1
[35936.566343] Hardware name: Supermicro SYS-5038MR-H8TRF/X10SRD-F, BIOS 3.3 10/28/2020
[35936.566344] RIP: 0010:del_timer_sync+0xce/0xe0
[35936.566349] Code: 8b 34 24 e8 44 71 6e 00 0f ae e8 e9 6c ff ff ff 48 0f b3 4f 28 c6 47 24 01 48 8b 03 48 8b 53 08 48 89 02 48 85 c0 74 87 eb 81 <0f> 0b e9 4b ff ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 53 48 89 fb
[35936.566351] RSP: 0018:ffffb48440350d50 EFLAGS: 00010246
[35936.566353] RAX: 00000000ffffff00 RBX: ffff9f01424beee0 RCX: 0000000000000001
[35936.566355] RDX: ffffffffb685d680 RSI: ffff9f01424bee50 RDI: ffff9f01424beee0
[35936.566357] RBP: ffff9f014bc4a200 R08: 000000000000ca34 R09: ffffb48440350d50
[35936.566358] R10: 0000000000000000 R11: 0000000000000000 R12: ffff9f01be40ea00
[35936.566360] R13: ffff9f01be40ea00 R14: 0000000000001000 R15: 0000000000001000
[35936.566362] FS:  0000000000000000(0000) GS:ffff9f089f800000(0000) knlGS:0000000000000000
[35936.566364] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[35936.566365] CR2: 00007f645362a38c CR3: 00000001d77b0001 CR4: 00000000003706e0
[35936.566366] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[35936.566367] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
[35936.566368] Call Trace:
[35936.566369]  <IRQ>
[35936.566370]  ? inet_ehash_nolisten+0xa/0x60
[35936.566376]  inet_csk_reqsk_queue_drop+0x5a/0x230
[35936.566379]  inet_csk_complete_hashdance+0x23/0x3c0
[35936.566380]  tcp_check_req+0x18f/0x600
[35936.566384]  tcp_v4_rcv+0x99a/0xd60
[35936.566386]  ip_protocol_deliver_rcu+0x1b/0x1a0
[35936.566388]  ip_local_deliver_finish+0x68/0x90
[35936.566391]  ? ip_protocol_deliver_rcu+0x1a0/0x1a0
[35936.566393]  __netif_receive_skb_one_core+0x3f/0x50
[35936.566398]  process_backlog+0x7c/0x110
[35936.566400]  __napi_poll+0x20/0x100
[35936.566403]  net_rx_action+0x26d/0x330
[35936.566405]  __do_softirq+0xaf/0x1d7
[35936.566409]  do_softirq+0x5a/0x80
[35936.566412]  </IRQ>
[35936.566413]  <TASK>
[35936.566413]  flush_smp_call_function_queue+0x3f/0x60
[35936.566418]  do_idle+0xa6/0xc0
[35936.566423]  cpu_startup_entry+0x14/0x20
[35936.566425]  start_secondary+0xd6/0xe0
[35936.566430]  secondary_startup_64_no_verify+0xd3/0xdb
[35936.566433]  </TASK>
[35936.566433] ---[ end trace 0000000000000000 ]---

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Bug Report kernel 5.19.9 Networking NAT
  2022-09-17  8:03 Bug Report kernel 5.19.9 Networking NAT Martin Zaharinov
@ 2022-09-17 20:34 ` Martin Zaharinov
  2022-09-18 10:13 ` Greg KH
  2022-09-20 23:19 ` Jakub Kicinski
  2 siblings, 0 replies; 10+ messages in thread
From: Martin Zaharinov @ 2022-09-17 20:34 UTC (permalink / raw)
  To: Eric Dumazet, Eric Dumazet, Florian Westphal, netdev, Greg KH, pablo

One more update :


[81463.921129] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81466.401421] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81485.314601] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81488.241055] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81490.982605] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81499.225338] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81508.272738] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81526.742498] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81539.072597] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81542.472532] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81544.781057] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81547.931925] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81561.741816] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81561.741816] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81572.312282] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81575.764512] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81575.764512] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81577.486948] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81577.486948] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81580.855781] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81580.958084] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81583.501366] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[81583.501366] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?




> On 17 Sep 2022, at 11:03, Martin Zaharinov <micron10@gmail.com> wrote:
> 
> HI team
> 
> This is NAT server with 2gb/s traffic have 2x 10Gb 82599 in Bonding 
> 
> one report if find any solution write me :
> 
> 
> [35857.548356] ------------[ cut here ]------------
> [35857.548358] WARNING: CPU: 28 PID: 0 at net/core/skbuff.c:728 skb_release_head_state+0x8d/0xa0
> [35857.548364] Modules linked in: nft_limit nf_conntrack_netlink  pppoe pppox ppp_generic slhc nft_nat nft_masq nft_chain_nat nf_nat xt_CT nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_compat nf_tables netconsole coretemp bonding i40e xt_NAT(O) acpi_ipmi ipmi_si ipmi_devintf ipmi_msghandler rtc_cmos
> [35857.548379] CPU: 28 PID: 0 Comm: swapper/28 Tainted: G        W  O      5.19.9 #1
> [35857.548381] Hardware name: Supermicro SYS-5038MR-H8TRF/X10SRD-F, BIOS 3.3 10/28/2020
> [35857.548383] RIP: 0010:skb_release_head_state+0x8d/0xa0
> [35857.548385] Code: 8b bb d8 00 00 00 5b e9 21 e8 ff ff e8 ec 30 08 00 eb d4 be 03 00 00 00 e8 60 b4 d2 ff eb c8 48 83 e7 fe e8 85 e4 01 00 eb cb <0f> 0b eb 94 66 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 40 00 48 85 ff
> [35857.548387] RSP: 0018:ffffb484406c0d30 EFLAGS: 00010206
> [35857.548388] RAX: ffffffffb55b7480 RBX: ffff9f01b19f4800 RCX: 000000000002e288
> [35857.548389] RDX: 00000000000f0000 RSI: 0000000000000001 RDI: 0000000000000000
> [35857.548390] RBP: ffff9f0146a812d0 R08: 0000000000000000 R09: 00000000000000ed
> [35857.548391] R10: 0000000000000001 R11: ffff9f01fdc63710 R12: ffff9f01d6b750e2
> [35857.548392] R13: 0000000000000000 R14: 0000000000000000 R15: ffff9f01d6b750ce
> [35857.548393] FS:  0000000000000000(0000) GS:ffff9f089fd00000(0000) knlGS:0000000000000000
> [35857.548394] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [35857.548395] CR2: 00007f4d25bcb38c CR3: 000000010dd1a005 CR4: 00000000003706e0
> [35857.548396] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [35857.548397] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
> [35857.548398] Call Trace:
> [35857.548400]  <IRQ>
> [35857.548401]  kfree_skb_reason+0x1c/0x70
> [35857.548404]  sk_stream_kill_queues+0x52/0xe0
> [35857.548408]  inet_csk_destroy_sock+0x46/0xf0
> [35857.548410]  tcp_fin+0xdf/0x150
> [35857.548414]  tcp_data_queue+0x374/0x510
> [35857.548417]  tcp_rcv_state_process+0x259/0x6f0
> [35857.548419]  tcp_v4_do_rcv+0xa9/0x1e0
> [35857.548422]  tcp_v4_rcv+0xcb9/0xd60
> [35857.548424]  ip_protocol_deliver_rcu+0x1b/0x1a0
> [35857.548428]  ip_local_deliver_finish+0x68/0x90
> [35857.548431]  ? ip_protocol_deliver_rcu+0x1a0/0x1a0
> [35857.548434]  __netif_receive_skb_one_core+0x3f/0x50
> [35857.548438]  process_backlog+0x7c/0x110
> [35857.548440]  __napi_poll+0x20/0x100
> [35857.548443]  net_rx_action+0x26d/0x330
> [35857.548446]  __do_softirq+0xaf/0x1d7
> [35857.548449]  do_softirq+0x5a/0x80
> [35857.548453]  </IRQ>
> [35857.548453]  <TASK>
> [35857.548454]  flush_smp_call_function_queue+0x3f/0x60
> [35857.548459]  do_idle+0xa6/0xc0
> [35857.548464]  cpu_startup_entry+0x14/0x20
> [35857.548467]  start_secondary+0xd6/0xe0
> [35857.548472]  secondary_startup_64_no_verify+0xd3/0xdb
> [35857.548475]  </TASK>
> [35857.548475] ---[ end trace 0000000000000000 ]—
> 
> 
> 
> 
> [35936.566314] ------------[ cut here ]------------
> [35936.566315] WARNING: CPU: 8 PID: 0 at kernel/time/timer.c:1425 del_timer_sync+0xce/0xe0
> [35936.566324] Modules linked in: nft_limit nf_conntrack_netlink pppoe pppox ppp_generic slhc nft_nat nft_masq nft_chain_nat nf_nat xt_CT nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 nft_compat nf_tables netconsole coretemp bonding i40e xt_NAT(O) acpi_ipmi ipmi_si ipmi_devintf ipmi_msghandler rtc_cmos
> [35936.566341] CPU: 8 PID: 0 Comm: swapper/8 Tainted: G        W  O      5.19.9 #1
> [35936.566343] Hardware name: Supermicro SYS-5038MR-H8TRF/X10SRD-F, BIOS 3.3 10/28/2020
> [35936.566344] RIP: 0010:del_timer_sync+0xce/0xe0
> [35936.566349] Code: 8b 34 24 e8 44 71 6e 00 0f ae e8 e9 6c ff ff ff 48 0f b3 4f 28 c6 47 24 01 48 8b 03 48 8b 53 08 48 89 02 48 85 c0 74 87 eb 81 <0f> 0b e9 4b ff ff ff 66 66 2e 0f 1f 84 00 00 00 00 00 53 48 89 fb
> [35936.566351] RSP: 0018:ffffb48440350d50 EFLAGS: 00010246
> [35936.566353] RAX: 00000000ffffff00 RBX: ffff9f01424beee0 RCX: 0000000000000001
> [35936.566355] RDX: ffffffffb685d680 RSI: ffff9f01424bee50 RDI: ffff9f01424beee0
> [35936.566357] RBP: ffff9f014bc4a200 R08: 000000000000ca34 R09: ffffb48440350d50
> [35936.566358] R10: 0000000000000000 R11: 0000000000000000 R12: ffff9f01be40ea00
> [35936.566360] R13: ffff9f01be40ea00 R14: 0000000000001000 R15: 0000000000001000
> [35936.566362] FS:  0000000000000000(0000) GS:ffff9f089f800000(0000) knlGS:0000000000000000
> [35936.566364] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
> [35936.566365] CR2: 00007f645362a38c CR3: 00000001d77b0001 CR4: 00000000003706e0
> [35936.566366] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
> [35936.566367] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400
> [35936.566368] Call Trace:
> [35936.566369]  <IRQ>
> [35936.566370]  ? inet_ehash_nolisten+0xa/0x60
> [35936.566376]  inet_csk_reqsk_queue_drop+0x5a/0x230
> [35936.566379]  inet_csk_complete_hashdance+0x23/0x3c0
> [35936.566380]  tcp_check_req+0x18f/0x600
> [35936.566384]  tcp_v4_rcv+0x99a/0xd60
> [35936.566386]  ip_protocol_deliver_rcu+0x1b/0x1a0
> [35936.566388]  ip_local_deliver_finish+0x68/0x90
> [35936.566391]  ? ip_protocol_deliver_rcu+0x1a0/0x1a0
> [35936.566393]  __netif_receive_skb_one_core+0x3f/0x50
> [35936.566398]  process_backlog+0x7c/0x110
> [35936.566400]  __napi_poll+0x20/0x100
> [35936.566403]  net_rx_action+0x26d/0x330
> [35936.566405]  __do_softirq+0xaf/0x1d7
> [35936.566409]  do_softirq+0x5a/0x80
> [35936.566412]  </IRQ>
> [35936.566413]  <TASK>
> [35936.566413]  flush_smp_call_function_queue+0x3f/0x60
> [35936.566418]  do_idle+0xa6/0xc0
> [35936.566423]  cpu_startup_entry+0x14/0x20
> [35936.566425]  start_secondary+0xd6/0xe0
> [35936.566430]  secondary_startup_64_no_verify+0xd3/0xdb
> [35936.566433]  </TASK>
> [35936.566433] ---[ end trace 0000000000000000 ]---


^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Bug Report kernel 5.19.9 Networking NAT
  2022-09-17  8:03 Bug Report kernel 5.19.9 Networking NAT Martin Zaharinov
  2022-09-17 20:34 ` Martin Zaharinov
@ 2022-09-18 10:13 ` Greg KH
  2022-09-18 13:49   ` Martin Zaharinov
  2022-09-20 23:19 ` Jakub Kicinski
  2 siblings, 1 reply; 10+ messages in thread
From: Greg KH @ 2022-09-18 10:13 UTC (permalink / raw)
  To: Martin Zaharinov
  Cc: Eric Dumazet, Eric Dumazet, Florian Westphal, netdev, pablo

On Sat, Sep 17, 2022 at 11:03:55AM +0300, Martin Zaharinov wrote:
> HI team
> 
> This is NAT server with 2gb/s traffic have 2x 10Gb 82599 in Bonding 
> 
> one report if find any solution write me :

Is this new?  If so, can you use 'git bisect' to find the problem?  Or
has this always been there?

thanks,

greg k-h

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Bug Report kernel 5.19.9 Networking NAT
  2022-09-18 10:13 ` Greg KH
@ 2022-09-18 13:49   ` Martin Zaharinov
  2022-09-18 14:28     ` Greg KH
  0 siblings, 1 reply; 10+ messages in thread
From: Martin Zaharinov @ 2022-09-18 13:49 UTC (permalink / raw)
  To: Greg KH; +Cc: Eric Dumazet, Eric Dumazet, Florian Westphal, netdev, pablo

Hi Greg

Yes still receive this message in dmesg this is kernel 5.19.9 : 


[139332.936463] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139338.378022] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139343.751591] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139344.298109] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139346.316550] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139352.051963] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139357.313180] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139366.041831] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139369.392042] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139369.754771] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139370.671093] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139373.234022] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139379.207071] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139379.207071] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139390.159412] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139393.027810] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139394.111100] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139399.024882] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139428.527908] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139429.731192] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139432.777940] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139440.371972] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139441.533634] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139448.621347] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139465.020467] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139473.003938] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139477.078950] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139497.013588] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139512.774300] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139522.770475] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139535.346545] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?
[139540.973242] softirq: huh, entered softirq 3 NET_RX 000000001471e2c3 with preempt_count 00000100, exited with 7fffff00?

any idea how to debug and find from where is come ?

Martin

> On 18 Sep 2022, at 13:13, Greg KH <gregkh@linuxfoundation.org> wrote:
> 
> On Sat, Sep 17, 2022 at 11:03:55AM +0300, Martin Zaharinov wrote:
>> HI team
>> 
>> This is NAT server with 2gb/s traffic have 2x 10Gb 82599 in Bonding 
>> 
>> one report if find any solution write me :
> 
> Is this new?  If so, can you use 'git bisect' to find the problem?  Or
> has this always been there?
> 
> thanks,
> 
> greg k-h


^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Bug Report kernel 5.19.9 Networking NAT
  2022-09-18 13:49   ` Martin Zaharinov
@ 2022-09-18 14:28     ` Greg KH
  2022-09-18 14:31       ` Martin Zaharinov
  0 siblings, 1 reply; 10+ messages in thread
From: Greg KH @ 2022-09-18 14:28 UTC (permalink / raw)
  To: Martin Zaharinov
  Cc: Eric Dumazet, Eric Dumazet, Florian Westphal, netdev, pablo

On Sun, Sep 18, 2022 at 04:49:26PM +0300, Martin Zaharinov wrote:
> Hi Greg
> 
> Yes still receive this message in dmesg this is kernel 5.19.9 : 

Wait, but that's not what I asked, I said:

> > Is this new?  If so, can you use 'git bisect' to find the problem?  Or
> > has this always been there?

thanks,

greg k-h

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Bug Report kernel 5.19.9 Networking NAT
  2022-09-18 14:28     ` Greg KH
@ 2022-09-18 14:31       ` Martin Zaharinov
  0 siblings, 0 replies; 10+ messages in thread
From: Martin Zaharinov @ 2022-09-18 14:31 UTC (permalink / raw)
  To: Greg KH; +Cc: Eric Dumazet, Eric Dumazet, Florian Westphal, netdev, pablo

Hi

now it started giving it, I think it was always here
And yes is new for me .

what can cause it?

m.


> On 18 Sep 2022, at 17:28, Greg KH <gregkh@linuxfoundation.org> wrote:
> 
> On Sun, Sep 18, 2022 at 04:49:26PM +0300, Martin Zaharinov wrote:
>> Hi Greg
>> 
>> Yes still receive this message in dmesg this is kernel 5.19.9 : 
> 
> Wait, but that's not what I asked, I said:
> 
>>> Is this new?  If so, can you use 'git bisect' to find the problem?  Or
>>> has this always been there?
> 
> thanks,
> 
> greg k-h


^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Bug Report kernel 5.19.9 Networking NAT
  2022-09-17  8:03 Bug Report kernel 5.19.9 Networking NAT Martin Zaharinov
  2022-09-17 20:34 ` Martin Zaharinov
  2022-09-18 10:13 ` Greg KH
@ 2022-09-20 23:19 ` Jakub Kicinski
  2022-09-21  2:03   ` Stephen Hemminger
  2022-09-21  2:04   ` Stephen Hemminger
  2 siblings, 2 replies; 10+ messages in thread
From: Jakub Kicinski @ 2022-09-20 23:19 UTC (permalink / raw)
  To: Martin Zaharinov
  Cc: Eric Dumazet, Eric Dumazet, Florian Westphal, netdev, Greg KH, pablo

On Sat, 17 Sep 2022 11:03:55 +0300 Martin Zaharinov wrote:
> xt_NAT(O)

What's this? Can you repro on a vanilla kernel?

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Bug Report kernel 5.19.9 Networking NAT
  2022-09-20 23:19 ` Jakub Kicinski
@ 2022-09-21  2:03   ` Stephen Hemminger
  2022-09-21  2:04   ` Stephen Hemminger
  1 sibling, 0 replies; 10+ messages in thread
From: Stephen Hemminger @ 2022-09-21  2:03 UTC (permalink / raw)
  To: Jakub Kicinski
  Cc: Martin Zaharinov, Eric Dumazet, Eric Dumazet, Florian Westphal,
	netdev, Greg KH, pablo

On Tue, 20 Sep 2022 16:19:18 -0700
Jakub Kicinski <kuba@kernel.org> wrote:

> On Sat, 17 Sep 2022 11:03:55 +0300 Martin Zaharinov wrote:
> > xt_NAT(O)  
> 
> What's this? Can you repro on a vanilla kernel?

Looks like a tainted kernel, could you print more of dmesg?

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Bug Report kernel 5.19.9 Networking NAT
  2022-09-20 23:19 ` Jakub Kicinski
  2022-09-21  2:03   ` Stephen Hemminger
@ 2022-09-21  2:04   ` Stephen Hemminger
  2022-09-21  6:13     ` Martin Zaharinov
  1 sibling, 1 reply; 10+ messages in thread
From: Stephen Hemminger @ 2022-09-21  2:04 UTC (permalink / raw)
  To: Jakub Kicinski
  Cc: Martin Zaharinov, Eric Dumazet, Eric Dumazet, Florian Westphal,
	netdev, Greg KH, pablo

On Tue, 20 Sep 2022 16:19:18 -0700
Jakub Kicinski <kuba@kernel.org> wrote:

> On Sat, 17 Sep 2022 11:03:55 +0300 Martin Zaharinov wrote:
> > xt_NAT(O)  
> 
> What's this? Can you repro on a vanilla kernel?


Google says it is out of tree full cone NAT
https://github.com/andrsharaev/xt_NAT

^ permalink raw reply	[flat|nested] 10+ messages in thread

* Re: Bug Report kernel 5.19.9 Networking NAT
  2022-09-21  2:04   ` Stephen Hemminger
@ 2022-09-21  6:13     ` Martin Zaharinov
  0 siblings, 0 replies; 10+ messages in thread
From: Martin Zaharinov @ 2022-09-21  6:13 UTC (permalink / raw)
  To: Stephen Hemminger
  Cc: Jakub Kicinski, Eric Dumazet, Eric Dumazet, Florian Westphal,
	netdev, Greg KH, pablo

Hi All 

Сorry in the first place!

yes load old module xt_NAT i see now .

after reload firewall with netfilter original modul all work fine without any error.

Thanks for responding!


Best regards,
Martin

> On 21 Sep 2022, at 5:04, Stephen Hemminger <stephen@networkplumber.org> wrote:
> 
> On Tue, 20 Sep 2022 16:19:18 -0700
> Jakub Kicinski <kuba@kernel.org> wrote:
> 
>> On Sat, 17 Sep 2022 11:03:55 +0300 Martin Zaharinov wrote:
>>> xt_NAT(O)  
>> 
>> What's this? Can you repro on a vanilla kernel?
> 
> 
> Google says it is out of tree full cone NAT
> https://github.com/andrsharaev/xt_NAT


^ permalink raw reply	[flat|nested] 10+ messages in thread

end of thread, other threads:[~2022-09-21  6:14 UTC | newest]

Thread overview: 10+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2022-09-17  8:03 Bug Report kernel 5.19.9 Networking NAT Martin Zaharinov
2022-09-17 20:34 ` Martin Zaharinov
2022-09-18 10:13 ` Greg KH
2022-09-18 13:49   ` Martin Zaharinov
2022-09-18 14:28     ` Greg KH
2022-09-18 14:31       ` Martin Zaharinov
2022-09-20 23:19 ` Jakub Kicinski
2022-09-21  2:03   ` Stephen Hemminger
2022-09-21  2:04   ` Stephen Hemminger
2022-09-21  6:13     ` Martin Zaharinov

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.