All of lore.kernel.org
 help / color / mirror / Atom feed
* Bridged networking panics
@ 2012-06-28 13:57 Massimo Cetra
  2012-07-04 10:42 ` Massimo Cetra
  0 siblings, 1 reply; 4+ messages in thread
From: Massimo Cetra @ 2012-06-28 13:57 UTC (permalink / raw)
  To: netdev, linux-kernel

[-- Attachment #1: Type: text/plain, Size: 629 bytes --]

Hi all,

i'm attaching 3 panics of a 3.2.X kernel.
The panics were obtained with a 3.2.20 from debian testing and from a 
vanilla compile of 3.2.21.

Those panics have been already posted some months ago [1] but are not fixed.

The problems seems related to bridged networking.
Whenever there is a bridged aliased interface (like br0:1 br0:2 etcc), 
the server will panic after some time. The more the network load, the 
shortest the uptime.
Removing (ifconfig br0:1 down) or adding back an interface seems to help 
the panic to appear.

Any more hints ?

MC

[1] for example http://comments.gmane.org/gmane.linux.network/226912

[-- Attachment #2: 3.2.20.2-1.txt --]
[-- Type: text/plain, Size: 16034 bytes --]

Jun 28 13:18:35 172.30.1.2 [ 295.504843] BUG: unable to handle kernel 
Jun 28 13:18:35 172.30.1.2 [ 295.520628] IP:
Jun 28 13:18:35 172.30.1.2 [ 295.534792] PGD 0 
Jun 28 13:18:35 172.30.1.2 
Jun 28 13:18:35 172.30.1.2 [ 295.538889] Oops: 0000 [#1] 
Jun 28 13:18:35 172.30.1.2 SMP
Jun 28 13:18:35 172.30.1.2 
Jun 28 13:18:35 172.30.1.2 [ 295.545471] CPU 0 
Jun 28 13:18:35 172.30.1.2 
Jun 28 13:18:35 172.30.1.2 [ 295.549169] Modules linked in:
Jun 28 13:18:35 172.30.1.2 
Jun 28 13:18:35 172.30.1.2 [ 295.691502] 
Jun 28 13:18:35 172.30.1.2 [ 295.694506] Pid: 7754, comm: kvm Not tainted 3.2.0-2-amd64 #1
Jun 28 13:18:35 172.30.1.2 /0N051F
Jun 28 13:18:35 172.30.1.2 
Jun 28 13:18:35 172.30.1.2 [ 295.711720] RIP: 0010:[<ffffffffa01c333d>] 
Jun 28 13:18:35 172.30.1.2 [ 295.730738] RSP: 0018:ffff88042fc03b18  EFLAGS: 00010293
Jun 28 13:18:35 172.30.1.2 [ 295.741389] RAX: 0000000000000000 RBX: ffff880411b9eec0 RCX: 00000000fffffba0
Jun 28 13:18:35 172.30.1.2 [ 295.755682] RDX: ffffffffa01c330f RSI: 0000000000000282 RDI: ffff880411b9eec0
Jun 28 13:18:35 172.30.1.2 [ 295.769975] RBP: ffff880226688000 R08: 0000000000000000 R09: ffff88042fc03ad0
Jun 28 13:18:35 172.30.1.2 [ 295.784268] R10: ffffffff8165ab00 R11: ffffffff8165ab00 R12: 0000000000000000
Jun 28 13:18:35 172.30.1.2 [ 295.798561] R13: ffff880225bec002 R14: ffff8804131987c0 R15: ffff880225bec000
Jun 28 13:18:35 172.30.1.2 [ 295.812854] FS:  00007fc06177d900(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000
Jun 28 13:18:35 172.30.1.2 [ 295.829070] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 28 13:18:35 172.30.1.2 [ 295.840587] CR2: 0000000000000018 CR3: 0000000409d7b000 CR4: 00000000000026e0
Jun 28 13:18:35 172.30.1.2 [ 295.854880] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jun 28 13:18:35 172.30.1.2 [ 295.869175] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jun 28 13:18:35 172.30.1.2 [ 295.883469] Process kvm (pid: 7754, threadinfo ffff88040bcc6000, task ffff880424ca2100)
Jun 28 13:18:35 172.30.1.2 [ 295.899512] Stack:
Jun 28 13:18:35 172.30.1.2 [ 295.903571]  ffffffff80000000
Jun 28 13:18:35 172.30.1.2 
Jun 28 13:18:35 172.30.1.2 [ 295.918613]  ffff880425367000
Jun 28 13:18:35 172.30.1.2 
Jun 28 13:18:35 172.30.1.2 [ 295.933657]  ffff880411b9eec0
Jun 28 13:18:35 172.30.1.2 
Jun 28 13:18:35 172.30.1.2 [ 295.948699] Call Trace:
Jun 28 13:18:35 172.30.1.2 [ 295.953626]  <IRQ> 
Jun 28 13:18:35 172.30.1.2 
Jun 28 13:18:35 172.30.1.2 [ 295.957918]  [<ffffffffa01c3714>] ? br_parse_ip_options+0x3d/0x19a [bridge]
Jun 28 13:18:35 172.30.1.2 [ 295.971866]  [<ffffffffa01c3aa0>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 295.985469]  [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77
Jun 28 13:18:36 172.30.1.2 [ 295.996123]  [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.008687]  [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.021245]  [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101
Jun 28 13:18:36 172.30.1.2 [ 296.032418]  [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.044981]  [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.058757]  [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.071319]  [<ffffffffa01be887>] ? NF_HOOK.constprop.10+0x3c/0x56 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.085267]  [<ffffffffa01bea1b>] ? br_forward+0x16/0x5a [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.097480]  [<ffffffffa01bf543>] ? br_handle_frame_finish+0x1a1/0x20f [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.112141]  [<ffffffffa01c3638>] ? br_nf_pre_routing_finish+0x1ee/0x1fb [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.127146]  [<ffffffffa01c2ff7>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.140055]  [<ffffffffa01c3f91>] ? br_nf_pre_routing+0x3e8/0x3f5 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.153828]  [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77
Jun 28 13:18:36 172.30.1.2 [ 296.164482]  [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.178255]  [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101
Jun 28 13:18:36 172.30.1.2 [ 296.189430]  [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.203206]  [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.216982]  [<ffffffffa01bf388>] ? NF_HOOK.constprop.4+0x3c/0x56 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.230757]  [<ffffffff810135ad>] ? paravirt_read_tsc+0x5/0x8
Jun 28 13:18:36 172.30.1.2 [ 296.242274]  [<ffffffff81013622>] ? read_tsc+0x5/0x14
Jun 28 13:18:36 172.30.1.2 [ 296.252409]  [<ffffffffa01bf764>] ? br_handle_frame+0x1b3/0x1cb [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.265837]  [<ffffffffa01bf5b1>] ? br_handle_frame_finish+0x20f/0x20f [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.280498]  [<ffffffff8128a306>] ? __netif_receive_skb+0x324/0x41f
Jun 28 13:18:36 172.30.1.2 [ 296.293058]  [<ffffffff8128a46d>] ? process_backlog+0x6c/0x123
Jun 28 13:18:36 172.30.1.2 [ 296.304751]  [<ffffffff8128c351>] ? net_rx_action+0xa1/0x1af
Jun 28 13:18:36 172.30.1.2 [ 296.316098]  [<ffffffff8103703b>] ? test_tsk_need_resched+0xa/0x13
Jun 28 13:18:36 172.30.1.2 [ 296.328486]  [<ffffffff8104bee4>] ? __do_softirq+0xb9/0x177
Jun 28 13:18:36 172.30.1.2 [ 296.339662]  [<ffffffff8135162c>] ? call_softirq+0x1c/0x30
Jun 28 13:18:36 172.30.1.2 [ 296.350656]  <EOI> 
Jun 28 13:18:36 172.30.1.2 
Jun 28 13:18:36 172.30.1.2 [ 296.354946]  [<ffffffff8100f8e5>] ? do_softirq+0x3c/0x7b
Jun 28 13:18:36 172.30.1.2 [ 296.365597]  [<ffffffff8128c641>] ? netif_rx_ni+0x1e/0x27
Jun 28 13:18:36 172.30.1.2 [ 296.376425]  [<ffffffffa028b721>] ? tun_get_user+0x39a/0x3c2 [tun]
Jun 28 13:18:36 172.30.1.2 [ 296.388811]  [<ffffffffa028ba66>] ? tun_chr_poll+0xcd/0xcd [tun]
Jun 28 13:18:36 172.30.1.2 [ 296.400851]  [<ffffffffa028bac4>] ? tun_chr_aio_write+0x5e/0x79 [tun]
Jun 28 13:18:36 172.30.1.2 [ 296.413760]  [<ffffffff810f97f8>] ? do_sync_readv_writev+0x9a/0xd7
Jun 28 13:18:36 172.30.1.2 [ 296.426145]  [<ffffffff81036457>] ? should_resched+0x5/0x23
Jun 28 13:18:36 172.30.1.2 [ 296.437316]  [<ffffffff81036457>] ? should_resched+0x5/0x23
Jun 28 13:18:36 172.30.1.2 [ 296.448491]  [<ffffffff81162ea1>] ? security_file_permission+0x16/0x2d
Jun 28 13:18:36 172.30.1.2 [ 296.461569]  [<ffffffff810f9a5c>] ? do_readv_writev+0xaf/0x11c
Jun 28 13:18:36 172.30.1.2 [ 296.473266]  [<ffffffff8112aebe>] ? eventfd_ctx_read+0x162/0x174
Jun 28 13:18:36 172.30.1.2 [ 296.485310]  [<ffffffff8103f48f>] ? try_to_wake_up+0x197/0x197
Jun 28 13:18:36 172.30.1.2 [ 296.497001]  [<ffffffff810f9c31>] ? sys_writev+0x45/0x90
Jun 28 13:18:36 172.30.1.2 [ 296.507653]  [<ffffffff8134f3d2>] ? system_call_fastpath+0x16/0x1b
Jun 28 13:18:36 172.30.1.2 [ 296.520038] Code: 
Jun 28 13:18:36 172.30.1.2 53
Jun 28 13:18:36 172.30.1.2 48
Jun 28 13:18:36 172.30.1.2 89
Jun 28 13:18:36 172.30.1.2 fb
Jun 28 13:18:36 172.30.1.2 48
Jun 28 13:18:36 172.30.1.2 83
Jun 28 13:18:36 172.30.1.2 ec
Jun 28 13:18:36 172.30.1.2 10
Jun 28 13:18:36 172.30.1.2 66
Jun 28 13:18:36 172.30.1.2 81
Jun 28 13:18:36 172.30.1.2 7f
Jun 28 13:18:36 172.30.1.2 7e
Jun 28 13:18:36 172.30.1.2 08
Jun 28 13:18:36 172.30.1.2 06
Jun 28 13:18:36 172.30.1.2 4c
Jun 28 13:18:36 172.30.1.2 8b
Jun 28 13:18:36 172.30.1.2 a7
Jun 28 13:18:36 172.30.1.2 98
Jun 28 13:18:36 172.30.1.2 00
Jun 28 13:18:36 172.30.1.2 00
Jun 28 13:18:36 172.30.1.2 00
Jun 28 13:18:36 172.30.1.2 74
Jun 28 13:18:36 172.30.1.2 3d
Jun 28 13:18:36 172.30.1.2 e8
Jun 28 13:18:36 172.30.1.2 07
Jun 28 13:18:36 172.30.1.2 fe
Jun 28 13:18:36 172.30.1.2 ff
Jun 28 13:18:36 172.30.1.2 ff
Jun 28 13:18:36 172.30.1.2 66
Jun 28 13:18:36 172.30.1.2 3d
Jun 28 13:18:36 172.30.1.2 08
Jun 28 13:18:36 172.30.1.2 06
Jun 28 13:18:36 172.30.1.2 75
Jun 28 13:18:36 172.30.1.2 09
Jun 28 13:18:36 172.30.1.2 83
Jun 28 13:18:36 172.30.1.2 3d
Jun 28 13:18:36 172.30.1.2 91
Jun 28 13:18:36 172.30.1.2 6a
Jun 28 13:18:36 172.30.1.2 00
Jun 28 13:18:36 172.30.1.2 00
Jun 28 13:18:36 172.30.1.2 00
Jun 28 13:18:36 172.30.1.2 75
Jun 28 13:18:36 172.30.1.2 29
Jun 28 13:18:36 172.30.1.2 
Jun 28 13:18:36 172.30.1.2 f6
Jun 28 13:18:36 172.30.1.2 44
Jun 28 13:18:36 172.30.1.2 24
Jun 28 13:18:36 172.30.1.2 18
Jun 28 13:18:36 172.30.1.2 01
Jun 28 13:18:36 172.30.1.2 49
Jun 28 13:18:36 172.30.1.2 8b
Jun 28 13:18:36 172.30.1.2 6c
Jun 28 13:18:36 172.30.1.2 24
Jun 28 13:18:36 172.30.1.2 08
Jun 28 13:18:36 172.30.1.2 74
Jun 28 13:18:36 172.30.1.2 12
Jun 28 13:18:36 172.30.1.2 8a
Jun 28 13:18:36 172.30.1.2 43
Jun 28 13:18:36 172.30.1.2 7d
Jun 28 13:18:36 172.30.1.2 83
Jun 28 13:18:36 172.30.1.2 e0
Jun 28 13:18:36 172.30.1.2 f8
Jun 28 13:18:36 172.30.1.2 83
Jun 28 13:18:36 172.30.1.2 c8
Jun 28 13:18:36 172.30.1.2 
Jun 28 13:18:36 172.30.1.2 [ 296.561479] RIP 
Jun 28 13:18:36 172.30.1.2 [ 296.575830]  RSP <ffff88042fc03b18>
Jun 28 13:18:36 172.30.1.2 [ 296.582838] CR2: 0000000000000018
Jun 28 13:18:36 172.30.1.2 [ 296.589912] ---[ end trace c5e13ce92514d70f ]---
Jun 28 13:18:36 172.30.1.2 [ 296.599302] Kernel panic - not syncing: Fatal exception in interrupt
Jun 28 13:18:36 172.30.1.2 [ 296.612171] Pid: 7754, comm: kvm Tainted: G      D      3.2.0-2-amd64 #1
Jun 28 13:18:36 172.30.1.2 [ 296.625731] Call Trace:
Jun 28 13:18:36 172.30.1.2 [ 296.630786]  <IRQ> 
Jun 28 13:18:36 172.30.1.2 [ 296.642245]  [<ffffffff8134b246>] ? oops_end+0xa9/0xb6
Jun 28 13:18:36 172.30.1.2 [ 296.652680]  [<ffffffff8134362d>] ? no_context+0x1ff/0x20e
Jun 28 13:18:36 172.30.1.2 [ 296.663873]  [<ffffffff81052316>] ? __mod_timer+0x139/0x14b
Jun 28 13:18:36 172.30.1.2 [ 296.675175]  [<ffffffff8134d259>] ? do_page_fault+0x1a8/0x337
Jun 28 13:18:36 172.30.1.2 [ 296.686892]  [<ffffffffa03caf06>] ? ip_vs_conn_put+0x28/0x32 [ip_vs]
Jun 28 13:18:36 172.30.1.2 [ 296.699794]  [<ffffffffa03cd0e0>] ? ip_vs_out+0x2bd/0x432 [ip_vs]
Jun 28 13:18:36 172.30.1.2 [ 296.712179]  [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101
Jun 28 13:18:36 172.30.1.2 [ 296.723614]  [<ffffffff8134a9b5>] ? page_fault+0x25/0x30
Jun 28 13:18:36 172.30.1.2 [ 296.734519]  [<ffffffffa01c330f>] ? nf_bridge_update_protocol+0x20/0x20 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.749474]  [<ffffffffa01c333d>] ? br_nf_forward_finish+0x2e/0x95 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.763549]  [<ffffffffa01c332e>] ? br_nf_forward_finish+0x1f/0x95 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.777632]  [<ffffffffa01c3714>] ? br_parse_ip_options+0x3d/0x19a [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.791715]  [<ffffffffa01c3aa0>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.805450]  [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77
Jun 28 13:18:36 172.30.1.2 [ 296.816247]  [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.829003]  [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.841695]  [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101
Jun 28 13:18:36 172.30.1.2 [ 296.852992]  [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.865687]  [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.879725]  [<ffffffffa01be941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.892411]  [<ffffffffa01be887>] ? NF_HOOK.constprop.10+0x3c/0x56 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.906483]  [<ffffffffa01bea1b>] ? br_forward+0x16/0x5a [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.918889]  [<ffffffffa01bf543>] ? br_handle_frame_finish+0x1a1/0x20f [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.933723]  [<ffffffffa01c3638>] ? br_nf_pre_routing_finish+0x1ee/0x1fb [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.948918]  [<ffffffffa01c2ff7>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.962024]  [<ffffffffa01c3f91>] ? br_nf_pre_routing+0x3e8/0x3f5 [bridge]
Jun 28 13:18:36 172.30.1.2 [ 296.975994]  [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77
Jun 28 13:18:37 172.30.1.2 [ 296.986837]  [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 13:18:37 172.30.1.2 [ 297.000802]  [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101
Jun 28 13:18:37 172.30.1.2 [ 297.012107]  [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 13:18:37 172.30.1.2 [ 297.026146]  [<ffffffffa01bf3a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 13:18:37 172.30.1.2 [ 297.040021]  [<ffffffffa01bf388>] ? NF_HOOK.constprop.4+0x3c/0x56 [bridge]
Jun 28 13:18:37 172.30.1.2 [ 297.053999]  [<ffffffff810135ad>] ? paravirt_read_tsc+0x5/0x8
Jun 28 13:18:37 172.30.1.2 [ 297.065638]  [<ffffffff81013622>] ? read_tsc+0x5/0x14
Jun 28 13:18:37 172.30.1.2 [ 297.075900]  [<ffffffffa01bf764>] ? br_handle_frame+0x1b3/0x1cb [bridge]
Jun 28 13:18:37 172.30.1.2 [ 297.089449]  [<ffffffffa01bf5b1>] ? br_handle_frame_finish+0x20f/0x20f [bridge]
Jun 28 13:18:37 172.30.1.2 [ 297.104301]  [<ffffffff8128a306>] ? __netif_receive_skb+0x324/0x41f
Jun 28 13:18:37 172.30.1.2 [ 297.116984]  [<ffffffff8128a46d>] ? process_backlog+0x6c/0x123
Jun 28 13:18:37 172.30.1.2 [ 297.128799]  [<ffffffff8128c351>] ? net_rx_action+0xa1/0x1af
Jun 28 13:18:37 172.30.1.2 [ 297.140267]  [<ffffffff8103703b>] ? test_tsk_need_resched+0xa/0x13
Jun 28 13:18:37 172.30.1.2 [ 297.152847]  [<ffffffff8104bee4>] ? __do_softirq+0xb9/0x177
Jun 28 13:18:37 172.30.1.2 [ 297.164227]  [<ffffffff8135162c>] ? call_softirq+0x1c/0x30
Jun 28 13:18:37 172.30.1.2 [ 297.175344]  <EOI> 
Jun 28 13:18:37 172.30.1.2 [ 297.187521]  [<ffffffff8128c641>] ? netif_rx_ni+0x1e/0x27
Jun 28 13:18:37 172.30.1.2 [ 297.198537]  [<ffffffffa028b721>] ? tun_get_user+0x39a/0x3c2 [tun]
Jun 28 13:18:37 172.30.1.2 [ 297.211100]  [<ffffffffa028ba66>] ? tun_chr_poll+0xcd/0xcd [tun]
Jun 28 13:18:37 172.30.1.2 [ 297.223376]  [<ffffffffa028bac4>] ? tun_chr_aio_write+0x5e/0x79 [tun]
Jun 28 13:18:37 172.30.1.2 [ 297.236417]  [<ffffffff810f97f8>] ? do_sync_readv_writev+0x9a/0xd7
Jun 28 13:18:37 172.30.1.2 [ 297.248994]  [<ffffffff81036457>] ? should_resched+0x5/0x23
Jun 28 13:18:37 172.30.1.2 [ 297.260291]  [<ffffffff81036457>] ? should_resched+0x5/0x23
Jun 28 13:18:37 172.30.1.2 [ 297.271594]  [<ffffffff81162ea1>] ? security_file_permission+0x16/0x2d
Jun 28 13:18:37 172.30.1.2 [ 297.284804]  [<ffffffff810f9a5c>] ? do_readv_writev+0xaf/0x11c
Jun 28 13:18:37 172.30.1.2 [ 297.296692]  [<ffffffff8112aebe>] ? eventfd_ctx_read+0x162/0x174
Jun 28 13:18:37 172.30.1.2 [ 297.308933]  [<ffffffff8103f48f>] ? try_to_wake_up+0x197/0x197
Jun 28 13:18:37 172.30.1.2 [ 297.320754]  [<ffffffff810f9c31>] ? sys_writev+0x45/0x90
Jun 28 13:18:37 172.30.1.2 [ 297.331532]  [<ffffffff8134f3d2>] ? system_call_fastpath+0x16/0x1b
Jun 28 13:18:37 mork mach_down[22201]: [22388]: info: Taking over resource group 172.30.1.99/24/br1/172.30.1.255
Jun 28 13:18:37 mork ResourceManager[22392]: [22414]: info: Acquiring resource group: mindy 172.30.1.99/24/br1/172.30.1.255
Jun 28 13:19:24 mork mon[12667]: failure for mail2 mxmon 1340882364 172.30.1.22
Jun 28 13:19:24 mork mon[12667]: calling alert marksolmail.down.alert for mail2/mxmon (/usr/lib/mon/alert.d/marksolmail.down.alert,-h) 172.30.1.22
Jun 28 13:20:25 mork mon[12667]: failure for mail2 mxmon 1340882425 172.30.1.22
Jun 28 13:21:25 mork mon[12667]: failure for mail2 mxmon 1340882485 172.30.1.22
Jun 28 13:22:25 mork mon[12667]: failure for mail2 mxmon 1340882545 172.30.1.22
Jun 28 13:23:12 mork ResourceManager[22956]: [22966]: info: Releasing resource group: mindy 172.30.1.99/24/br1/172.30.1.255
Jun 28 13:23:12 mork ResourceManager[22956]: [22983]: info: Running /etc/ha.d/resource.d/IPaddr 172.30.1.99/24/br1/172.30.1.255 stop
Jun 28 13:23:12 mork ResourceManager[22956]: [22984]: debug: Starting /etc/ha.d/resource.d/IPaddr 172.30.1.99/24/br1/172.30.1.255 stop
Jun 28 13:23:12 mork ResourceManager[22956]: [23030]: debug: /etc/ha.d/resource.d/IPaddr 172.30.1.99/24/br1/172.30.1.255 stop done. RC=0
Jun 28 13:23:25 mork mon[12667]: failure for mail2 mxmon 1340882605 172.30.1.22

[-- Attachment #3: 3.2.20.2-2.txt --]
[-- Type: text/plain, Size: 17032 bytes --]

Jun 28 14:16:03 172.30.1.2 [ 3193.846371] BUG: unable to handle kernel 
Jun 28 14:16:03 172.30.1.2 [ 3193.862035] IP:
Jun 28 14:16:03 172.30.1.2 [ 3193.876118] PGD 0 
Jun 28 14:16:03 172.30.1.2 
Jun 28 14:16:03 172.30.1.2 [ 3193.880134] Oops: 0000 [#1] 
Jun 28 14:16:03 172.30.1.2 SMP
Jun 28 14:16:03 172.30.1.2 
Jun 28 14:16:03 172.30.1.2 [ 3193.886590] CPU 0 
Jun 28 14:16:03 172.30.1.2 
Jun 28 14:16:03 172.30.1.2 [ 3193.890246] Modules linked in:
Jun 28 14:16:03 172.30.1.2 
Jun 28 14:16:03 172.30.1.2 [ 3194.029137] 
Jun 28 14:16:03 172.30.1.2 [ 3194.032099] Pid: 0, comm: swapper/0 Not tainted 3.2.0-2-amd64 #1
Jun 28 14:16:03 172.30.1.2 /0N051F
Jun 28 14:16:03 172.30.1.2 
Jun 28 14:16:03 172.30.1.2 [ 3194.049664] RIP: 0010:[<ffffffffa01dc33d>] 
Jun 28 14:16:03 172.30.1.2 [ 3194.068599] RSP: 0018:ffff88042fc039b0  EFLAGS: 00010293
Jun 28 14:16:03 172.30.1.2 [ 3194.079206] RAX: 0000000000000000 RBX: ffff8802f335f980 RCX: 0000000000000006
Jun 28 14:16:03 172.30.1.2 [ 3194.093456] RDX: ffffffffa01dc30f RSI: 00000001000b4640 RDI: ffff8802f335f980
Jun 28 14:16:03 172.30.1.2 [ 3194.107706] RBP: ffff880424ce6000 R08: 0000000000000000 R09: ffff88042fc03968
Jun 28 14:16:03 172.30.1.2 [ 3194.121957] R10: ffffffff8165ab00 R11: ffffffff8165ab00 R12: 0000000000000000
Jun 28 14:16:03 172.30.1.2 [ 3194.136206] R13: ffff880426cc1002 R14: ffff8802e094f140 R15: ffff880426cc1000
Jun 28 14:16:03 172.30.1.2 [ 3194.150456] FS:  0000000000000000(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000
Jun 28 14:16:03 172.30.1.2 [ 3194.166629] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jun 28 14:16:03 172.30.1.2 [ 3194.178104] CR2: 0000000000000018 CR3: 00000001c304d000 CR4: 00000000000026e0
Jun 28 14:16:03 172.30.1.2 [ 3194.192353] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jun 28 14:16:03 172.30.1.2 [ 3194.206602] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jun 28 14:16:03 172.30.1.2 [ 3194.220852] Process swapper/0 (pid: 0, threadinfo ffffffff81600000, task ffffffff8160d020)
Jun 28 14:16:03 172.30.1.2 [ 3194.237370] Stack:
Jun 28 14:16:03 172.30.1.2 [ 3194.241387]  ffffffff80000000
Jun 28 14:16:03 172.30.1.2 
Jun 28 14:16:03 172.30.1.2 [ 3194.256222]  ffff880424d4c000
Jun 28 14:16:03 172.30.1.2 
Jun 28 14:16:03 172.30.1.2 [ 3194.271056]  ffff8802f335f980
Jun 28 14:16:03 172.30.1.2 
Jun 28 14:16:03 172.30.1.2 [ 3194.285891] Call Trace:
Jun 28 14:16:03 172.30.1.2 [ 3194.290776]  <IRQ> 
Jun 28 14:16:03 172.30.1.2 
Jun 28 14:16:03 172.30.1.2 [ 3194.294987]  [<ffffffffa01dc714>] ? br_parse_ip_options+0x3d/0x19a [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.308893]  [<ffffffffa01dcaa0>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.322456]  [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77
Jun 28 14:16:03 172.30.1.2 [ 3194.333067]  [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.345586]  [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.358104]  [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101
Jun 28 14:16:03 172.30.1.2 [ 3194.369235]  [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.381756]  [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.395489]  [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.408007]  [<ffffffffa01d7887>] ? NF_HOOK.constprop.10+0x3c/0x56 [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.421913]  [<ffffffffa01d7a1b>] ? br_forward+0x16/0x5a [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.434086]  [<ffffffffa01d8543>] ? br_handle_frame_finish+0x1a1/0x20f [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.448703]  [<ffffffffa01dc638>] ? br_nf_pre_routing_finish+0x1ee/0x1fb [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.463664]  [<ffffffffa01dbff7>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.476529]  [<ffffffffa01dcf91>] ? br_nf_pre_routing+0x3e8/0x3f5 [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.490260]  [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77
Jun 28 14:16:03 172.30.1.2 [ 3194.500871]  [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.514600]  [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101
Jun 28 14:16:03 172.30.1.2 [ 3194.525732]  [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.539466]  [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.553200]  [<ffffffffa01d8388>] ? NF_HOOK.constprop.4+0x3c/0x56 [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.566933]  [<ffffffff812bd793>] ? tcp_gro_receive+0x83/0x1d8
Jun 28 14:16:03 172.30.1.2 [ 3194.578586]  [<ffffffffa01d8764>] ? br_handle_frame+0x1b3/0x1cb [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.591971]  [<ffffffffa01d85b1>] ? br_handle_frame_finish+0x20f/0x20f [bridge]
Jun 28 14:16:03 172.30.1.2 [ 3194.606588]  [<ffffffff8128a306>] ? __netif_receive_skb+0x324/0x41f
Jun 28 14:16:03 172.30.1.2 [ 3194.619106]  [<ffffffff8128bd61>] ? netif_receive_skb+0x63/0x69
Jun 28 14:16:03 172.30.1.2 [ 3194.630927]  [<ffffffff8128c233>] ? napi_gro_receive+0x1d/0x2b
Jun 28 14:16:03 172.30.1.2 [ 3194.642577]  [<ffffffff8128bddd>] ? napi_skb_finish+0x1c/0x31
Jun 28 14:16:03 172.30.1.2 [ 3194.654057]  [<ffffffffa00b6460>] ? bnx2_poll_work+0x84a/0x95d [bnx2]
Jun 28 14:16:03 172.30.1.2 [ 3194.666926]  [<ffffffff8103f47f>] ? try_to_wake_up+0x187/0x197
Jun 28 14:16:03 172.30.1.2 [ 3194.678579]  [<ffffffffa00b6716>] ? bnx2_poll+0xf6/0x1c4 [bnx2]
Jun 28 14:16:03 172.30.1.2 [ 3194.690402]  [<ffffffff8128c351>] ? net_rx_action+0xa1/0x1af
Jun 28 14:16:03 172.30.1.2 [ 3194.701706]  [<ffffffff81037d6e>] ? __wake_up+0x35/0x46
Jun 28 14:16:03 172.30.1.2 [ 3194.712143]  [<ffffffff8104bee4>] ? __do_softirq+0xb9/0x177
Jun 28 14:16:03 172.30.1.2 [ 3194.723276]  [<ffffffff8106a8e7>] ? clockevents_program_event+0xaa/0xce
Jun 28 14:16:04 172.30.1.2 [ 3194.736491]  [<ffffffff8135162c>] ? call_softirq+0x1c/0x30
Jun 28 14:16:04 172.30.1.2 [ 3194.747450]  [<ffffffff8100f8e5>] ? do_softirq+0x3c/0x7b
Jun 28 14:16:04 172.30.1.2 [ 3194.758059]  [<ffffffff8104c14c>] ? irq_exit+0x3c/0x9a
Jun 28 14:16:04 172.30.1.2 [ 3194.768320]  [<ffffffff8100f615>] ? do_IRQ+0x82/0x98
Jun 28 14:16:04 172.30.1.2 [ 3194.778239]  [<ffffffff8134a6ee>] ? common_interrupt+0x6e/0x6e
Jun 28 14:16:04 172.30.1.2 [ 3194.789886]  <EOI> 
Jun 28 14:16:04 172.30.1.2 
Jun 28 14:16:04 172.30.1.2 [ 3194.794091]  [<ffffffff811aed74>] ? timerqueue_add+0x80/0xa0
Jun 28 14:16:04 172.30.1.2 [ 3194.805397]  [<ffffffff811ec569>] ? intel_idle+0xea/0x119
Jun 28 14:16:04 172.30.1.2 [ 3194.816179]  [<ffffffff811ec548>] ? intel_idle+0xc9/0x119
Jun 28 14:16:04 172.30.1.2 [ 3194.826966]  [<ffffffff8126c573>] ? cpuidle_idle_call+0xec/0x179
Jun 28 14:16:04 172.30.1.2 [ 3194.838963]  [<ffffffff8100d248>] ? cpu_idle+0xa5/0xf2
Jun 28 14:16:04 172.30.1.2 [ 3194.849225]  [<ffffffff816aab33>] ? start_kernel+0x3b3/0x3be
Jun 28 14:16:04 172.30.1.2 [ 3194.860528]  [<ffffffff816aa140>] ? early_idt_handlers+0x140/0x140
Jun 28 14:16:04 172.30.1.2 [ 3194.872870]  [<ffffffff816aa3c4>] ? x86_64_start_kernel+0x104/0x111
Jun 28 14:16:04 172.30.1.2 [ 3194.885386] Code: 
Jun 28 14:16:04 172.30.1.2 53
Jun 28 14:16:04 172.30.1.2 48
Jun 28 14:16:04 172.30.1.2 89
Jun 28 14:16:04 172.30.1.2 fb
Jun 28 14:16:04 172.30.1.2 48
Jun 28 14:16:04 172.30.1.2 83
Jun 28 14:16:04 172.30.1.2 ec
Jun 28 14:16:04 172.30.1.2 10
Jun 28 14:16:04 172.30.1.2 66
Jun 28 14:16:04 172.30.1.2 81
Jun 28 14:16:04 172.30.1.2 7f
Jun 28 14:16:04 172.30.1.2 7e
Jun 28 14:16:04 172.30.1.2 08
Jun 28 14:16:04 172.30.1.2 06
Jun 28 14:16:04 172.30.1.2 4c
Jun 28 14:16:04 172.30.1.2 8b
Jun 28 14:16:04 172.30.1.2 a7
Jun 28 14:16:04 172.30.1.2 98
Jun 28 14:16:04 172.30.1.2 00
Jun 28 14:16:04 172.30.1.2 00
Jun 28 14:16:04 172.30.1.2 00
Jun 28 14:16:04 172.30.1.2 74
Jun 28 14:16:04 172.30.1.2 3d
Jun 28 14:16:04 172.30.1.2 e8
Jun 28 14:16:04 172.30.1.2 07
Jun 28 14:16:04 172.30.1.2 fe
Jun 28 14:16:04 172.30.1.2 ff
Jun 28 14:16:04 172.30.1.2 ff
Jun 28 14:16:04 172.30.1.2 66
Jun 28 14:16:04 172.30.1.2 3d
Jun 28 14:16:04 172.30.1.2 08
Jun 28 14:16:04 172.30.1.2 06
Jun 28 14:16:04 172.30.1.2 75
Jun 28 14:16:04 172.30.1.2 09
Jun 28 14:16:04 172.30.1.2 83
Jun 28 14:16:04 172.30.1.2 3d
Jun 28 14:16:04 172.30.1.2 91
Jun 28 14:16:04 172.30.1.2 6a
Jun 28 14:16:04 172.30.1.2 00
Jun 28 14:16:04 172.30.1.2 00
Jun 28 14:16:04 172.30.1.2 00
Jun 28 14:16:04 172.30.1.2 75
Jun 28 14:16:04 172.30.1.2 29
Jun 28 14:16:04 172.30.1.2 
Jun 28 14:16:04 172.30.1.2 f6
Jun 28 14:16:04 172.30.1.2 44
Jun 28 14:16:04 172.30.1.2 24
Jun 28 14:16:04 172.30.1.2 18
Jun 28 14:16:04 172.30.1.2 01
Jun 28 14:16:04 172.30.1.2 49
Jun 28 14:16:04 172.30.1.2 8b
Jun 28 14:16:04 172.30.1.2 6c
Jun 28 14:16:04 172.30.1.2 24
Jun 28 14:16:04 172.30.1.2 08
Jun 28 14:16:04 172.30.1.2 74
Jun 28 14:16:04 172.30.1.2 12
Jun 28 14:16:04 172.30.1.2 8a
Jun 28 14:16:04 172.30.1.2 43
Jun 28 14:16:04 172.30.1.2 7d
Jun 28 14:16:04 172.30.1.2 83
Jun 28 14:16:04 172.30.1.2 e0
Jun 28 14:16:04 172.30.1.2 f8
Jun 28 14:16:04 172.30.1.2 83
Jun 28 14:16:04 172.30.1.2 c8
Jun 28 14:16:04 172.30.1.2 
Jun 28 14:16:04 172.30.1.2 [ 3194.924067] RIP 
Jun 28 14:16:04 172.30.1.2 [ 3194.938333]  RSP <ffff88042fc039b0>
Jun 28 14:16:04 172.30.1.2 [ 3194.945299] CR2: 0000000000000018
Jun 28 14:16:04 172.30.1.2 [ 3194.952668] ---[ end trace c28d39074732fa49 ]---
Jun 28 14:16:04 172.30.1.2 [ 3194.962197] Kernel panic - not syncing: Fatal exception in interrupt
Jun 28 14:16:04 172.30.1.2 [ 3194.975155] Pid: 0, comm: swapper/0 Tainted: G      D      3.2.0-2-amd64 #1
Jun 28 14:16:04 172.30.1.2 [ 3194.989324] Call Trace:
Jun 28 14:16:04 172.30.1.2 [ 3194.994443]  <IRQ> 
Jun 28 14:16:04 172.30.1.2 [ 3195.006177]  [<ffffffff8134b246>] ? oops_end+0xa9/0xb6
Jun 28 14:16:04 172.30.1.2 [ 3195.016744]  [<ffffffff8134362d>] ? no_context+0x1ff/0x20e
Jun 28 14:16:04 172.30.1.2 [ 3195.028010]  [<ffffffff810e9e7c>] ? virt_to_slab+0x6/0x16
Jun 28 14:16:04 172.30.1.2 [ 3195.039098]  [<ffffffff810e9f1f>] ? __cache_free.isra.41+0x3d/0x198
Jun 28 14:16:04 172.30.1.2 [ 3195.051922]  [<ffffffff8134d259>] ? do_page_fault+0x1a8/0x337
Jun 28 14:16:04 172.30.1.2 [ 3195.063621]  [<ffffffffa03cbf06>] ? ip_vs_conn_put+0x28/0x32 [ip_vs]
Jun 28 14:16:04 172.30.1.2 [ 3195.076593]  [<ffffffffa03ce0e0>] ? ip_vs_out+0x2bd/0x432 [ip_vs]
Jun 28 14:16:04 172.30.1.2 [ 3195.089052]  [<ffffffffa01d7847>] ? br_dev_queue_push_xmit+0x9b/0x9f [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.103656]  [<ffffffff8134a9b5>] ? page_fault+0x25/0x30
Jun 28 14:16:04 172.30.1.2 [ 3195.114563]  [<ffffffffa01dc30f>] ? nf_bridge_update_protocol+0x20/0x20 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.129719]  [<ffffffffa01dc33d>] ? br_nf_forward_finish+0x2e/0x95 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.143939]  [<ffffffffa01dc714>] ? br_parse_ip_options+0x3d/0x19a [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.158197]  [<ffffffffa01dcaa0>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.172126]  [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77
Jun 28 14:16:04 172.30.1.2 [ 3195.183162]  [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.195973]  [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.208757]  [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101
Jun 28 14:16:04 172.30.1.2 [ 3195.220300]  [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.233150]  [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.247306]  [<ffffffffa01d7941>] ? __br_deliver+0xa0/0xa0 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.260078]  [<ffffffffa01d7887>] ? NF_HOOK.constprop.10+0x3c/0x56 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.274354]  [<ffffffffa01d7a1b>] ? br_forward+0x16/0x5a [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.286828]  [<ffffffffa01d8543>] ? br_handle_frame_finish+0x1a1/0x20f [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.301718]  [<ffffffffa01dc638>] ? br_nf_pre_routing_finish+0x1ee/0x1fb [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.317041]  [<ffffffffa01dbff7>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.330274]  [<ffffffffa01dcf91>] ? br_nf_pre_routing+0x3e8/0x3f5 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.344275]  [<ffffffff812ad0ed>] ? nf_iterate+0x41/0x77
Jun 28 14:16:04 172.30.1.2 [ 3195.355232]  [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.369214]  [<ffffffff812ad18b>] ? nf_hook_slow+0x68/0x101
Jun 28 14:16:04 172.30.1.2 [ 3195.380687]  [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.394806]  [<ffffffffa01d83a2>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.408906]  [<ffffffffa01d8388>] ? NF_HOOK.constprop.4+0x3c/0x56 [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.423003]  [<ffffffff812bd793>] ? tcp_gro_receive+0x83/0x1d8
Jun 28 14:16:04 172.30.1.2 [ 3195.434976]  [<ffffffffa01d8764>] ? br_handle_frame+0x1b3/0x1cb [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.448742]  [<ffffffffa01d85b1>] ? br_handle_frame_finish+0x20f/0x20f [bridge]
Jun 28 14:16:04 172.30.1.2 [ 3195.463742]  [<ffffffff8128a306>] ? __netif_receive_skb+0x324/0x41f
Jun 28 14:16:04 172.30.1.2 [ 3195.476522]  [<ffffffff8128bd61>] ? netif_receive_skb+0x63/0x69
Jun 28 14:16:04 172.30.1.2 [ 3195.488591]  [<ffffffff8128c233>] ? napi_gro_receive+0x1d/0x2b
Jun 28 14:16:04 172.30.1.2 [ 3195.500581]  [<ffffffff8128bddd>] ? napi_skb_finish+0x1c/0x31
Jun 28 14:16:04 172.30.1.2 [ 3195.512350]  [<ffffffffa00b6460>] ? bnx2_poll_work+0x84a/0x95d [bnx2]
Jun 28 14:16:04 172.30.1.2 [ 3195.525547]  [<ffffffff8103f47f>] ? try_to_wake_up+0x187/0x197
Jun 28 14:16:04 172.30.1.2 [ 3195.537480]  [<ffffffffa00b6716>] ? bnx2_poll+0xf6/0x1c4 [bnx2]
Jun 28 14:16:04 172.30.1.2 [ 3195.549671]  [<ffffffff8128c351>] ? net_rx_action+0xa1/0x1af
Jun 28 14:16:04 172.30.1.2 [ 3195.561264]  [<ffffffff81037d6e>] ? __wake_up+0x35/0x46
Jun 28 14:16:04 172.30.1.2 [ 3195.572052]  [<ffffffff8104bee4>] ? __do_softirq+0xb9/0x177
Jun 28 14:16:04 172.30.1.2 [ 3195.583508]  [<ffffffff8106a8e7>] ? clockevents_program_event+0xaa/0xce
Jun 28 14:16:04 172.30.1.2 [ 3195.597050]  [<ffffffff8135162c>] ? call_softirq+0x1c/0x30
Jun 28 14:16:04 172.30.1.2 [ 3195.608366]  [<ffffffff8100f8e5>] ? do_softirq+0x3c/0x7b
Jun 28 14:16:04 172.30.1.2 [ 3195.619247]  [<ffffffff8104c14c>] ? irq_exit+0x3c/0x9a
Jun 28 14:16:04 172.30.1.2 [ 3195.629829]  [<ffffffff8100f615>] ? do_IRQ+0x82/0x98
Jun 28 14:16:04 172.30.1.2 [ 3195.640035]  [<ffffffff8134a6ee>] ? common_interrupt+0x6e/0x6e
Jun 28 14:16:04 172.30.1.2 [ 3195.652030]  <EOI> 
Jun 28 14:16:04 172.30.1.2 [ 3195.665050]  [<ffffffff811ec569>] ? intel_idle+0xea/0x119
Jun 28 14:16:04 172.30.1.2 [ 3195.676195]  [<ffffffff811ec548>] ? intel_idle+0xc9/0x119
Jun 28 14:16:04 172.30.1.2 [ 3195.687278]  [<ffffffff8126c573>] ? cpuidle_idle_call+0xec/0x179
Jun 28 14:16:04 172.30.1.2 [ 3195.699551]  [<ffffffff8100d248>] ? cpu_idle+0xa5/0xf2
Jun 28 14:16:04 172.30.1.2 [ 3195.710072]  [<ffffffff816aab33>] ? start_kernel+0x3b3/0x3be
Jun 28 14:16:04 172.30.1.2 [ 3195.721740]  [<ffffffff816aa140>] ? early_idt_handlers+0x140/0x140
Jun 28 14:16:05 172.30.1.2 [ 3195.734358]  [<ffffffff816aa3c4>] ? x86_64_start_kernel+0x104/0x111
Jun 28 14:16:05 172.30.1.2 [ 3195.747405] ------------[ cut here ]------------
Jun 28 14:16:05 172.30.1.2 [ 3195.756678] WARNING: at /build/buildd-linux_3.2.20-1-amd64-lTzScn/linux-3.2.20/arch/x86/kernel/smp.c:119 try_to_wake_up+0x158/0x197()
Jun 28 14:16:05 172.30.1.2 [ 3195.780697] Hardware name: PowerEdge R410
Jun 28 14:16:05 172.30.1.2 [ 3195.788744] Modules linked in:
Jun 28 14:16:05 172.30.1.2 
Jun 28 14:16:05 172.30.1.2 [ 3195.930822] Pid: 4659, comm: kvm Tainted: G      D      3.2.0-2-amd64 #1
Jun 28 14:16:05 172.30.1.2 [ 3195.944245] Call Trace:
Jun 28 14:16:05 172.30.1.2 [ 3195.949175]  [<ffffffff810468fd>] ? warn_slowpath_common+0x78/0x8c
Jun 28 14:16:05 172.30.1.2 [ 3195.961562]  [<ffffffff8103f450>] ? try_to_wake_up+0x158/0x197
Jun 28 14:16:05 172.30.1.2 [ 3195.973256]  [<ffffffff811071e2>] ? pollwake+0x4d/0x52
Jun 28 14:16:05 172.30.1.2 [ 3195.983560]  [<ffffffff8103f48f>] ? try_to_wake_up+0x197/0x197
Jun 28 14:16:05 172.30.1.2 [ 3195.995254]  [<ffffffff810360b2>] ? __wake_up_common+0x40/0x77
Jun 28 14:16:05 172.30.1.2 [ 3196.006949]  [<ffffffff8112ad43>] ? eventfd_write+0x1a3/0x1bc
Jun 28 14:16:05 172.30.1.2 [ 3196.018467]  [<ffffffff8103f48f>] ? try_to_wake_up+0x197/0x197
Jun 28 14:16:05 172.30.1.2 [ 3196.030162]  [<ffffffff810f947f>] ? vfs_write+0xa2/0xe9
Jun 28 14:16:05 172.30.1.2 [ 3196.040649]  [<ffffffffa022a5fb>] ? kvm_on_user_return+0x36/0x5c [kvm]
Jun 28 14:16:05 172.30.1.2 [ 3196.053728]  [<ffffffff810f965c>] ? sys_write+0x45/0x6b
Jun 28 14:16:05 172.30.1.2 [ 3196.064206]  [<ffffffff8134f3d2>] ? system_call_fastpath+0x16/0x1b
Jun 28 14:16:05 172.30.1.2 [ 3196.076589] ---[ end trace c28d39074732fa4a ]---

[-- Attachment #4: 3.2.21-1.txt --]
[-- Type: text/plain, Size: 23789 bytes --]

Jun 28 15:29:19 172.30.1.2 [ 304.578777] BUG: unable to handle kernel 
Jun 28 15:29:19 172.30.1.2 [ 304.594562] IP:
Jun 28 15:29:19 172.30.1.2 [ 304.608732] PGD 0 
Jun 28 15:29:19 172.30.1.2 
Jun 28 15:29:19 172.30.1.2 [ 304.612831] Oops: 0000 [#1] 
Jun 28 15:29:19 172.30.1.2 SMP
Jun 28 15:29:19 172.30.1.2 
Jun 28 15:29:19 172.30.1.2 [ 304.619414] CPU 0 
Jun 28 15:29:19 172.30.1.2 
Jun 28 15:29:19 172.30.1.2 [ 304.623112] Modules linked in:
Jun 28 15:29:19 172.30.1.2 
Jun 28 15:29:19 172.30.1.2 [ 304.765458] 
Jun 28 15:29:19 172.30.1.2 [ 304.768463] Pid: 4486, comm: kvm Not tainted 3.2.21 #1
Jun 28 15:29:19 172.30.1.2 /0N051F
Jun 28 15:29:19 172.30.1.2 
Jun 28 15:29:19 172.30.1.2 [ 304.784464] RIP: 0010:[<ffffffffa01d09d0>] 
Jun 28 15:29:19 172.30.1.2 [ 304.803483] RSP: 0018:ffff88042fc03960  EFLAGS: 00010287
Jun 28 15:29:19 172.30.1.2 [ 304.814133] RAX: 0000000000000008 RBX: ffff880422148d80 RCX: ffff88042fc03706
Jun 28 15:29:19 172.30.1.2 [ 304.828426] RDX: 0000000000000000 RSI: 0000000100003f40 RDI: ffff880422148d80
Jun 28 15:29:19 172.30.1.2 [ 304.842719] RBP: ffff880221d2c000 R08: 0000000000000000 R09: ffff88042fc03918
Jun 28 15:29:19 172.30.1.2 [ 304.857012] R10: ffffffff8180b240 R11: ffff880422148d80 R12: ffff880221bc8000
Jun 28 15:29:19 172.30.1.2 [ 304.871303] R13: ffff880418d91500 R14: ffff880221bc8002 R15: ffff880420cdf000
Jun 28 15:29:19 172.30.1.2 [ 304.885595] FS:  00007f8d47807900(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000
Jun 28 15:29:19 172.30.1.2 [ 304.901811] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Jun 28 15:29:19 172.30.1.2 [ 304.913328] CR2: 0000000000000018 CR3: 000000041c3d1000 CR4: 00000000000026e0
Jun 28 15:29:19 172.30.1.2 [ 304.927620] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jun 28 15:29:19 172.30.1.2 [ 304.941912] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jun 28 15:29:19 172.30.1.2 [ 304.956205] Process kvm (pid: 4486, threadinfo ffff88040f24e000, task ffff8804215f9510)
Jun 28 15:29:19 172.30.1.2 [ 304.972247] Stack:
Jun 28 15:29:19 172.30.1.2 [ 304.976307]  0000000080000000
Jun 28 15:29:19 172.30.1.2 
Jun 28 15:29:19 172.30.1.2 [ 304.991349]  ffff880221d2c000
Jun 28 15:29:19 172.30.1.2 
Jun 28 15:29:19 172.30.1.2 [ 305.006392]  ffff880422148d80
Jun 28 15:29:19 172.30.1.2 
Jun 28 15:29:19 172.30.1.2 [ 305.021434] Call Trace:
Jun 28 15:29:19 172.30.1.2 [ 305.026360]  <IRQ> 
Jun 28 15:29:19 172.30.1.2 
Jun 28 15:29:19 172.30.1.2 [ 305.030651]  [<ffffffffa01d0c91>] ? br_nf_forward_ip+0x214/0x231 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.044255]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jun 28 15:29:19 172.30.1.2 [ 305.054909]  [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.067122]  [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.079336]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jun 28 15:29:19 172.30.1.2 [ 305.090336]  [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.102552]  [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.113898]  [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.126113]  [<ffffffffa01cb96e>] ? T.963+0x3c/0x56 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.137460]  [<ffffffffa01ca753>] ? __br_fdb_get+0x10/0x83 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.150021]  [<ffffffffa01cc61d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.164680]  [<ffffffffa01d1598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.179685]  [<ffffffffa01d03b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.192593]  [<ffffffffa01d135b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.206366]  [<ffffffff812ce172>] ? T.1028+0x4f/0x4f
Jun 28 15:29:19 172.30.1.2 [ 305.216322]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jun 28 15:29:19 172.30.1.2 [ 305.226975]  [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.238320]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jun 28 15:29:19 172.30.1.2 [ 305.249320]  [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.260669]  [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.272015]  [<ffffffffa01cc45c>] ? T.947+0x3c/0x56 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.283363]  [<ffffffffa01cc84a>] ? br_handle_frame+0x1c3/0x1d9 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.296790]  [<ffffffffa01cc687>] ? br_handle_frame_finish+0x211/0x211 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.311448]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jun 28 15:29:19 172.30.1.2 [ 305.324009]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jun 28 15:29:19 172.30.1.2 [ 305.334139]  [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d
Jun 28 15:29:19 172.30.1.2 [ 305.346005]  [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d
Jun 28 15:29:19 172.30.1.2 [ 305.357697]  [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31
Jun 28 15:29:19 172.30.1.2 [ 305.369220]  [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2]
Jun 28 15:29:19 172.30.1.2 [ 305.382128]  [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2]
Jun 28 15:29:19 172.30.1.2 [ 305.395036]  [<ffffffffa01cc45c>] ? T.947+0x3c/0x56 [bridge]
Jun 28 15:29:19 172.30.1.2 [ 305.406383]  [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2]
Jun 28 15:29:19 172.30.1.2 [ 305.418421]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jun 28 15:29:19 172.30.1.2 [ 305.430980]  [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207
Jun 28 15:29:19 172.30.1.2 [ 305.442327]  [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a
Jun 28 15:29:19 172.30.1.2 [ 305.455060]  [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0
Jun 28 15:29:19 172.30.1.2 [ 305.466234]  [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184
Jun 28 15:29:19 172.30.1.2 [ 305.479490]  [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30
Jun 28 15:29:19 172.30.1.2 [ 305.490492]  [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79
Jun 28 15:29:19 172.30.1.2 [ 305.501142]  [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5
Jun 28 15:29:19 172.30.1.2 [ 305.511446]  [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa
Jun 28 15:29:19 172.30.1.2 [ 305.521407]  [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e
Jun 28 15:29:19 172.30.1.2 [ 305.533098]  <EOI> 
Jun 28 15:29:19 172.30.1.2 
Jun 28 15:29:20 172.30.1.2 [ 305.537386]  [<ffffffff81364498>] ? _raw_spin_unlock_irqrestore+0xb/0x11
Jun 28 15:29:20 172.30.1.2 [ 305.550816]  [<ffffffff81045f07>] ? try_to_wake_up+0x181/0x190
Jun 28 15:29:20 172.30.1.2 [ 305.562510]  [<ffffffff81071764>] ? wake_futex+0x2b/0x47
Jun 28 15:29:20 172.30.1.2 [ 305.573161]  [<ffffffff81073949>] ? do_futex+0x3de/0x84a
Jun 28 15:29:20 172.30.1.2 [ 305.583814]  [<ffffffff810dfff1>] ? do_brk+0x2ca/0x326
Jun 28 15:29:20 172.30.1.2 [ 305.594119]  [<ffffffff81073ee4>] ? sys_futex+0x12f/0x147
Jun 28 15:29:20 172.30.1.2 [ 305.604945]  [<ffffffff81369b12>] ? system_call_fastpath+0x16/0x1b
Jun 28 15:29:20 172.30.1.2 [ 305.617329] Code: 
Jun 28 15:29:20 172.30.1.2 00
Jun 28 15:29:20 172.30.1.2 00
Jun 28 15:29:20 172.30.1.2 00
Jun 28 15:29:20 172.30.1.2 10
Jun 28 15:29:20 172.30.1.2 75
Jun 28 15:29:20 172.30.1.2 25
Jun 28 15:29:20 172.30.1.2 66
Jun 28 15:29:20 172.30.1.2 3d
Jun 28 15:29:20 172.30.1.2 81
Jun 28 15:29:20 172.30.1.2 00
Jun 28 15:29:20 172.30.1.2 75
Jun 28 15:29:20 172.30.1.2 1f
Jun 28 15:29:20 172.30.1.2 8b
Jun 28 15:29:20 172.30.1.2 87
Jun 28 15:29:20 172.30.1.2 c8
Jun 28 15:29:20 172.30.1.2 00
Jun 28 15:29:20 172.30.1.2 00
Jun 28 15:29:20 172.30.1.2 00
Jun 28 15:29:20 172.30.1.2 48
Jun 28 15:29:20 172.30.1.2 8b
Jun 28 15:29:20 172.30.1.2 8f
Jun 28 15:29:20 172.30.1.2 d8
Jun 28 15:29:20 172.30.1.2 00
Jun 28 15:29:20 172.30.1.2 00
Jun 28 15:29:20 172.30.1.2 00
Jun 28 15:29:20 172.30.1.2 66
Jun 28 15:29:20 172.30.1.2 81
Jun 28 15:29:20 172.30.1.2 7c
Jun 28 15:29:20 172.30.1.2 01
Jun 28 15:29:20 172.30.1.2 10
Jun 28 15:29:20 172.30.1.2 08
Jun 28 15:29:20 172.30.1.2 06
Jun 28 15:29:20 172.30.1.2 75
Jun 28 15:29:20 172.30.1.2 09
Jun 28 15:29:20 172.30.1.2 83
Jun 28 15:29:20 172.30.1.2 3d
Jun 28 15:29:20 172.30.1.2 f2
Jun 28 15:29:20 172.30.1.2 63
Jun 28 15:29:20 172.30.1.2 00
Jun 28 15:29:20 172.30.1.2 00
Jun 28 15:29:20 172.30.1.2 00
Jun 28 15:29:20 172.30.1.2 75
Jun 28 15:29:20 172.30.1.2 3c
Jun 28 15:29:20 172.30.1.2 f6>
Jun 28 15:29:20 172.30.1.2 42
Jun 28 15:29:20 172.30.1.2 18
Jun 28 15:29:20 172.30.1.2 01
Jun 28 15:29:20 172.30.1.2 48
Jun 28 15:29:20 172.30.1.2 8b
Jun 28 15:29:20 172.30.1.2 6a
Jun 28 15:29:20 172.30.1.2 08
Jun 28 15:29:20 172.30.1.2 74
Jun 28 15:29:20 172.30.1.2 10
Jun 28 15:29:20 172.30.1.2 8a
Jun 28 15:29:20 172.30.1.2 
Jun 28 15:29:20 172.30.1.2 [ 305.652454] ------------[ cut here ]------------
Jun 28 15:29:20 172.30.1.2 [ 305.652457] WARNING: at kernel/softirq.c:159 _local_bh_enable_ip+0x41/0x8b()
Jun 28 15:29:20 172.30.1.2 [ 305.652459] Hardware name: PowerEdge R410
Jun 28 15:29:20 172.30.1.2 [ 305.652460] Modules linked in: ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 ip6table_filter ip6_tables iptable_filter ip_tables x_tables ip_vs_rr ip_vs nf_conntrack crc32c libcrc32c drbd lru_cache cn tun virtio_net virtio_blk virtio_rng rng_core virtio_pci virtio_ring virtio kvm_intel kvm ipmi_devintf ipmi_poweroff ipmi_si ipmi_watchdog ipmi_msghandler netconsole configfs loop bridge stp snd_pcm i7core_edac dcdbas edac_core iTCO_wdt iTCO_vendor_support processor psmouse snd_timer snd soundcore snd_page_alloc pcspkr serio_raw joydev thermal_sys button evdev ext3 mbcache jbd dm_mod sr_mod cdrom sd_mod ses usbhid hid crc_t10dif enclosure ata_generic uhci_hcd ata_piix ehci_hcd libata megaraid_sas usbcore scsi_mod usb_common bnx2 [last unloaded: scsi_wait_scan]
Jun 28 15:29:20 172.30.1.2 [ 305.652495] Pid: 4486, comm: kvm Not tainted 3.2.21 #1
Jun 28 15:29:20 172.30.1.2 [ 305.652496] Call Trace:
Jun 28 15:29:20 172.30.1.2 [ 305.652497]  <IRQ>  [<ffffffff81049810>] ? warn_slowpath_common+0x78/0x8c
Jun 28 15:29:20 172.30.1.2 [ 305.652503]  [<ffffffff8104efa0>] ? _local_bh_enable_ip+0x41/0x8b
Jun 28 15:29:20 172.30.1.2 [ 305.652508]  [<ffffffffa0000648>] ? bnx2_reg_rd_ind+0x31/0x38 [bnx2]
Jun 28 15:29:20 172.30.1.2 [ 305.652514]  [<ffffffffa0009dc8>] ? bnx2_poll+0x1e2/0x1f2 [bnx2]
Jun 28 15:29:20 172.30.1.2 [ 305.652520]  [<ffffffff812b6b62>] ? netpoll_poll_dev+0xab/0x4ad
Jun 28 15:29:20 172.30.1.2 [ 305.652525]  [<ffffffffa0006ba0>] ? bnx2_start_xmit+0x411/0x55d [bnx2]
Jun 28 15:29:20 172.30.1.2 [ 305.652531]  [<ffffffff810f693e>] ? ____cache_alloc+0xc6/0x20d
Jun 28 15:29:20 172.30.1.2 [ 305.652535]  [<ffffffff812b7075>] ? netpoll_send_skb_on_dev+0x111/0x215
Jun 28 15:29:20 172.30.1.2 [ 305.652541]  [<ffffffffa01ca6d2>] ? br_dev_xmit+0x136/0x150 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652544]  [<ffffffff812b7033>] ? netpoll_send_skb_on_dev+0xcf/0x215
Jun 28 15:29:20 172.30.1.2 [ 305.652551]  [<ffffffff811c3157>] ? delay_tsc+0x2b/0x74
Jun 28 15:29:20 172.30.1.2 [ 305.652555]  [<ffffffffa0167272>] ? write_msg+0x9f/0x102 [netconsole]
Jun 28 15:29:20 172.30.1.2 [ 305.652558]  [<ffffffff810499e6>] ? __call_console_drivers+0x75/0x86
Jun 28 15:29:20 172.30.1.2 [ 305.652561]  [<ffffffff8104a084>] ? console_unlock+0x13d/0x1e8
Jun 28 15:29:20 172.30.1.2 [ 305.652564]  [<ffffffff8104a707>] ? vprintk+0x39e/0x3e5
Jun 28 15:29:20 172.30.1.2 [ 305.652570]  [<ffffffffa01d09db>] ? br_nf_forward_finish+0x53/0xc0 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652576]  [<ffffffffa01d09a5>] ? br_nf_forward_finish+0x1d/0xc0 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652579]  [<ffffffff81362842>] ? printk+0x40/0x46
Jun 28 15:29:20 172.30.1.2 [ 305.652583]  [<ffffffff8100fff9>] ? show_registers+0x1e2/0x211
Jun 28 15:29:20 172.30.1.2 [ 305.652586]  [<ffffffff813652dd>] ? __die+0x8e/0xc9
Jun 28 15:29:20 172.30.1.2 [ 305.652589]  [<ffffffff8102fcd0>] ? no_context+0x1d6/0x20c
Jun 28 15:29:20 172.30.1.2 [ 305.652592]  [<ffffffff810f53c3>] ? virt_to_slab+0x9/0x3c
Jun 28 15:29:20 172.30.1.2 [ 305.652595]  [<ffffffff81367534>] ? do_page_fault+0x1ad/0x34c
Jun 28 15:29:20 172.30.1.2 [ 305.652601]  [<ffffffffa03fcd93>] ? ip_vs_notrack+0x6e/0xa6 [ip_vs]
Jun 28 15:29:20 172.30.1.2 [ 305.652606]  [<ffffffffa03fbdec>] ? ip_vs_conn_put+0x29/0x2f [ip_vs]
Jun 28 15:29:20 172.30.1.2 [ 305.652610]  [<ffffffffa03fde1a>] ? ip_vs_out+0x33c/0x49d [ip_vs]
Jun 28 15:29:20 172.30.1.2 [ 305.652613]  [<ffffffff812a896b>] ? dev_hard_start_xmit+0x3fd/0x571
Jun 28 15:29:20 172.30.1.2 [ 305.652617]  [<ffffffff81364ab5>] ? page_fault+0x25/0x30
Jun 28 15:29:20 172.30.1.2 [ 305.652623]  [<ffffffffa01d09d0>] ? br_nf_forward_finish+0x48/0xc0 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652628]  [<ffffffffa01d0c91>] ? br_nf_forward_ip+0x214/0x231 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652631]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jun 28 15:29:20 172.30.1.2 [ 305.652636]  [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652641]  [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652644]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jun 28 15:29:20 172.30.1.2 [ 305.652648]  [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652654]  [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652658]  [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652663]  [<ffffffffa01cb96e>] ? T.963+0x3c/0x56 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652668]  [<ffffffffa01ca753>] ? __br_fdb_get+0x10/0x83 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652673]  [<ffffffffa01cc61d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652678]  [<ffffffffa01d1598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652684]  [<ffffffffa01d03b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652689]  [<ffffffffa01d135b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652692]  [<ffffffff812ce172>] ? T.1028+0x4f/0x4f
Jun 28 15:29:20 172.30.1.2 [ 305.652695]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jun 28 15:29:20 172.30.1.2 [ 305.652700]  [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652703]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jun 28 15:29:20 172.30.1.2 [ 305.652708]  [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652713]  [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652718]  [<ffffffffa01cc45c>] ? T.947+0x3c/0x56 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652723]  [<ffffffffa01cc84a>] ? br_handle_frame+0x1c3/0x1d9 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652728]  [<ffffffffa01cc687>] ? br_handle_frame_finish+0x211/0x211 [bridge]
Jun 28 15:29:20 172.30.1.2 [ 305.652731]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jun 28 15:29:20 172.30.1.2 [ 305.652734]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jun 28 15:29:20 172.30.1.2 [ 305.652736]  [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d
Jun 28 15:29:20 172.30.1.2 [ 305.652739]  [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d
Jun 28 15:29:20 172.30.1.2 [ 305.652742]  [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31
Jun 28 15:29:21 172.30.1.2 [ 305.652747]  [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2]
Jun 28 15:29:21 172.30.1.2 [ 305.652752]  [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2]
Jun 28 15:29:21 172.30.1.2 [ 305.652757]  [<ffffffffa01cc45c>] ? T.947+0x3c/0x56 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 305.652762]  [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2]
Jun 28 15:29:21 172.30.1.2 [ 305.652765]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jun 28 15:29:21 172.30.1.2 [ 305.652768]  [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207
Jun 28 15:29:21 172.30.1.2 [ 305.652771]  [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a
Jun 28 15:29:21 172.30.1.2 [ 305.652774]  [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0
Jun 28 15:29:21 172.30.1.2 [ 305.652776]  [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184
Jun 28 15:29:21 172.30.1.2 [ 305.652780]  [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30
Jun 28 15:29:21 172.30.1.2 [ 305.652782]  [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79
Jun 28 15:29:21 172.30.1.2 [ 305.652785]  [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5
Jun 28 15:29:21 172.30.1.2 [ 305.652787]  [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa
Jun 28 15:29:21 172.30.1.2 [ 305.652790]  [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e
Jun 28 15:29:21 172.30.1.2 [ 305.652792]  <EOI>  [<ffffffff81364498>] ? _raw_spin_unlock_irqrestore+0xb/0x11
Jun 28 15:29:21 172.30.1.2 [ 305.652797]  [<ffffffff81045f07>] ? try_to_wake_up+0x181/0x190
Jun 28 15:29:21 172.30.1.2 [ 305.652799]  [<ffffffff81071764>] ? wake_futex+0x2b/0x47
Jun 28 15:29:21 172.30.1.2 [ 305.652802]  [<ffffffff81073949>] ? do_futex+0x3de/0x84a
Jun 28 15:29:21 172.30.1.2 [ 305.652804]  [<ffffffff810dfff1>] ? do_brk+0x2ca/0x326
Jun 28 15:29:21 172.30.1.2 [ 305.652807]  [<ffffffff81073ee4>] ? sys_futex+0x12f/0x147
Jun 28 15:29:21 172.30.1.2 [ 305.652810]  [<ffffffff81369b12>] ? system_call_fastpath+0x16/0x1b
Jun 28 15:29:21 172.30.1.2 [ 305.652812] ---[ end trace 33ba304ebe73322b ]---
Jun 28 15:29:21 172.30.1.2 [ 306.782187] 43 
Jun 28 15:29:21 172.30.1.2 7d
Jun 28 15:29:21 172.30.1.2 83
Jun 28 15:29:21 172.30.1.2 e0
Jun 28 15:29:21 172.30.1.2 f8
Jun 28 15:29:21 172.30.1.2 83
Jun 28 15:29:21 172.30.1.2 c8
Jun 28 15:29:21 172.30.1.2 03
Jun 28 15:29:21 172.30.1.2 88
Jun 28 15:29:21 172.30.1.2 43
Jun 28 15:29:21 172.30.1.2 
Jun 28 15:29:21 172.30.1.2 [ 306.790953] RIP 
Jun 28 15:29:21 172.30.1.2 [ 306.805304]  RSP <ffff88042fc03960>
Jun 28 15:29:21 172.30.1.2 [ 306.817583] CR2: 0000000000000018
Jun 28 15:29:21 172.30.1.2 [ 306.824706] ---[ end trace 33ba304ebe73322c ]---
Jun 28 15:29:21 172.30.1.2 [ 306.834283] Kernel panic - not syncing: Fatal exception in interrupt
Jun 28 15:29:21 172.30.1.2 [ 306.847312] Pid: 4486, comm: kvm Tainted: G      D W    3.2.21 #1
Jun 28 15:29:21 172.30.1.2 [ 306.859837] Call Trace:
Jun 28 15:29:21 172.30.1.2 [ 306.865093]  <IRQ> 
Jun 28 15:29:21 172.30.1.2 [ 306.876993]  [<ffffffff81049da9>] ? kmsg_dump+0xb2/0xdd
Jun 28 15:29:21 172.30.1.2 [ 306.887798]  [<ffffffff813653c1>] ? oops_end+0xa9/0xb6
Jun 28 15:29:21 172.30.1.2 [ 306.898438]  [<ffffffff8102fcf9>] ? no_context+0x1ff/0x20c
Jun 28 15:29:21 172.30.1.2 [ 306.909769]  [<ffffffff810f53c3>] ? virt_to_slab+0x9/0x3c
Jun 28 15:29:21 172.30.1.2 [ 306.920924]  [<ffffffff81367534>] ? do_page_fault+0x1ad/0x34c
Jun 28 15:29:21 172.30.1.2 [ 306.932780]  [<ffffffffa03fcd93>] ? ip_vs_notrack+0x6e/0xa6 [ip_vs]
Jun 28 15:29:21 172.30.1.2 [ 306.945675]  [<ffffffffa03fbdec>] ? ip_vs_conn_put+0x29/0x2f [ip_vs]
Jun 28 15:29:21 172.30.1.2 [ 306.958743]  [<ffffffffa03fde1a>] ? ip_vs_out+0x33c/0x49d [ip_vs]
Jun 28 15:29:21 172.30.1.2 [ 306.971339]  [<ffffffff812a896b>] ? dev_hard_start_xmit+0x3fd/0x571
Jun 28 15:29:21 172.30.1.2 [ 306.984312]  [<ffffffff81364ab5>] ? page_fault+0x25/0x30
Jun 28 15:29:21 172.30.1.2 [ 306.995300]  [<ffffffffa01d09d0>] ? br_nf_forward_finish+0x48/0xc0 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.009564]  [<ffffffffa01d0c91>] ? br_nf_forward_ip+0x214/0x231 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.023567]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jun 28 15:29:21 172.30.1.2 [ 307.034624]  [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.047239]  [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.059782]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jun 28 15:29:21 172.30.1.2 [ 307.071240]  [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.083788]  [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.095464]  [<ffffffffa01cba5a>] ? br_deliver+0x2d/0x2d [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.108227]  [<ffffffffa01cb96e>] ? T.963+0x3c/0x56 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.119901]  [<ffffffffa01ca753>] ? __br_fdb_get+0x10/0x83 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.132796]  [<ffffffffa01cc61d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.147785]  [<ffffffffa01d1598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.163124]  [<ffffffffa01d03b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.176369]  [<ffffffffa01d135b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.190541]  [<ffffffff812ce172>] ? T.1028+0x4f/0x4f
Jun 28 15:29:21 172.30.1.2 [ 307.200832]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jun 28 15:29:21 172.30.1.2 [ 307.211813]  [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.223490]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jun 28 15:29:21 172.30.1.2 [ 307.234827]  [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.246623]  [<ffffffffa01cc476>] ? T.947+0x56/0x56 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.258233]  [<ffffffffa01cc45c>] ? T.947+0x3c/0x56 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.269846]  [<ffffffffa01cc84a>] ? br_handle_frame+0x1c3/0x1d9 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.283539]  [<ffffffffa01cc687>] ? br_handle_frame_finish+0x211/0x211 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.298466]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jun 28 15:29:21 172.30.1.2 [ 307.311298]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jun 28 15:29:21 172.30.1.2 [ 307.321743]  [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d
Jun 28 15:29:21 172.30.1.2 [ 307.334023]  [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d
Jun 28 15:29:21 172.30.1.2 [ 307.346044]  [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31
Jun 28 15:29:21 172.30.1.2 [ 307.357884]  [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2]
Jun 28 15:29:21 172.30.1.2 [ 307.371057]  [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2]
Jun 28 15:29:21 172.30.1.2 [ 307.384236]  [<ffffffffa01cc45c>] ? T.947+0x3c/0x56 [bridge]
Jun 28 15:29:21 172.30.1.2 [ 307.395847]  [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2]
Jun 28 15:29:21 172.30.1.2 [ 307.408147]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jun 28 15:29:21 172.30.1.2 [ 307.421034]  [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207
Jun 28 15:29:21 172.30.1.2 [ 307.432644]  [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a
Jun 28 15:29:21 172.30.1.2 [ 307.445688]  [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0
Jun 28 15:29:21 172.30.1.2 [ 307.457118]  [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184
Jun 28 15:29:21 172.30.1.2 [ 307.470749]  [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30
Jun 28 15:29:21 172.30.1.2 [ 307.482114]  [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79
Jun 28 15:29:21 172.30.1.2 [ 307.493077]  [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5
Jun 28 15:29:21 172.30.1.2 [ 307.503654]  [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa
Jun 28 15:29:21 172.30.1.2 [ 307.513875]  [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e
Jun 28 15:29:21 172.30.1.2 [ 307.525807]  <EOI> 
Jun 28 15:29:22 172.30.1.2 [ 307.541012]  [<ffffffff81045f07>] ? try_to_wake_up+0x181/0x190
Jun 28 15:29:22 172.30.1.2 [ 307.552919]  [<ffffffff81071764>] ? wake_futex+0x2b/0x47
Jun 28 15:29:22 172.30.1.2 [ 307.563873]  [<ffffffff81073949>] ? do_futex+0x3de/0x84a
Jun 28 15:29:22 172.30.1.2 [ 307.574792]  [<ffffffff810dfff1>] ? do_brk+0x2ca/0x326
Jun 28 15:29:22 172.30.1.2 [ 307.585363]  [<ffffffff81073ee4>] ? sys_futex+0x12f/0x147
Jun 28 15:29:22 172.30.1.2 [ 307.596418]  [<ffffffff81369b12>] ? system_call_fastpath+0x16/0x1b

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Bridged networking panics
  2012-06-28 13:57 Bridged networking panics Massimo Cetra
@ 2012-07-04 10:42 ` Massimo Cetra
  2012-07-04 13:24   ` Eric Dumazet
  0 siblings, 1 reply; 4+ messages in thread
From: Massimo Cetra @ 2012-07-04 10:42 UTC (permalink / raw)
  To: netdev; +Cc: linux-kernel

[-- Attachment #1: Type: text/plain, Size: 1111 bytes --]

On 28/06/2012 15:57, Massimo Cetra wrote:
> Hi all,
>
> i'm attaching 3 panics of a 3.2.X kernel.
> The panics were obtained with a 3.2.20 from debian testing and from a
> vanilla compile of 3.2.21.
>
> Those panics have been already posted some months ago [1] but are not
> fixed.
>
> The problems seems related to bridged networking.
> Whenever there is a bridged aliased interface (like br0:1 br0:2 etcc),
> the server will panic after some time. The more the network load, the
> shortest the uptime.
> Removing (ifconfig br0:1 down) or adding back an interface seems to help
> the panic to appear.

Ok, waiting for an answer (sincerely i don't understand why no ones 
cares for months) i'm attaching 3 more panics happened this morning on a 
vanilla 3.2.21.

The problem is related to heavy network traffic.

I'm not a kernel hacker but I see that net_rx_action() is in the backtrace.
So (probably reaching wrong conclusions) if those panics are triggered 
by incoming network traffic, can an attacker use this to crash a machine ?

Anyone willing to reply or at least tell me what's going on ?

Thanks

MC

[-- Attachment #2: more-panics-1.txt --]
[-- Type: text/plain, Size: 57265 bytes --]


*************************  PANIC 1

Jul  4 09:50:25 172.30.1.2 [  97.644194] BUG: unable to handle kernel 
Jul  4 09:50:25 172.30.1.2 [  97.659980] IP:
Jul  4 09:50:25 172.30.1.2 [  97.674146] PGD 0 
Jul  4 09:50:25 172.30.1.2 
Jul  4 09:50:25 172.30.1.2 [  97.678245] Oops: 0000 [#1] 
Jul  4 09:50:25 172.30.1.2 SMP
Jul  4 09:50:25 172.30.1.2 
Jul  4 09:50:25 172.30.1.2 [  97.684824] CPU 0 
Jul  4 09:50:25 172.30.1.2 
Jul  4 09:50:25 172.30.1.2 [  97.688522] Modules linked in:
Jul  4 09:50:26 172.30.1.2 
Jul  4 09:50:26 172.30.1.2 [  97.830819] 
Jul  4 09:50:26 172.30.1.2 [  97.833823] Pid: 0, comm: swapper/0 Not tainted 3.2.21 #1
Jul  4 09:50:26 172.30.1.2 /0N051F
Jul  4 09:50:26 172.30.1.2 
Jul  4 09:50:26 172.30.1.2 [  97.850339] RIP: 0010:[<ffffffffa01c89d0>] 
Jul  4 09:50:26 172.30.1.2 [  97.869355] RSP: 0018:ffff88042fc03960  EFLAGS: 00010287
Jul  4 09:50:26 172.30.1.2 [  97.880006] RAX: 0000000000000008 RBX: ffff880421ea6980 RCX: ffff88042fc03708
Jul  4 09:50:26 172.30.1.2 [  97.894295] RDX: 0000000000000000 RSI: 00000000ffff7500 RDI: ffff880421ea6980
Jul  4 09:50:26 172.30.1.2 [  97.908586] RBP: ffff880420d88000 R08: 0000000000000000 R09: ffff88042fc03918
Jul  4 09:50:26 172.30.1.2 [  97.922876] R10: ffffffff8180b240 R11: ffff880421ea6980 R12: ffff8804215b0000
Jul  4 09:50:26 172.30.1.2 [  97.937166] R13: ffff8804217a1fc0 R14: ffff8804215b0002 R15: ffff880223a19000
Jul  4 09:50:26 172.30.1.2 [  97.951459] FS:  0000000000000000(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000
Jul  4 09:50:26 172.30.1.2 [  97.967673] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jul  4 09:50:26 172.30.1.2 [  97.979187] CR2: 0000000000000018 CR3: 00000002239eb000 CR4: 00000000000026e0
Jul  4 09:50:26 172.30.1.2 [  97.993479] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jul  4 09:50:26 172.30.1.2 [  98.007769] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jul  4 09:50:26 172.30.1.2 [  98.022061] Process swapper/0 (pid: 0, threadinfo ffffffff81600000, task ffffffff8160d020)
Jul  4 09:50:26 172.30.1.2 [  98.038621] Stack:
Jul  4 09:50:26 172.30.1.2 [  98.042680]  0000000080000000
Jul  4 09:50:26 172.30.1.2 
Jul  4 09:50:26 172.30.1.2 [  98.057721]  ffff880420d88000
Jul  4 09:50:26 172.30.1.2 
Jul  4 09:50:26 172.30.1.2 [  98.072764]  ffff880421ea6980
Jul  4 09:50:26 172.30.1.2 
Jul  4 09:50:26 172.30.1.2 [  98.087804] Call Trace:
Jul  4 09:50:26 172.30.1.2 [  98.092730]  <IRQ> 
Jul  4 09:50:26 172.30.1.2 
Jul  4 09:50:26 172.30.1.2 [  98.097020]  [<ffffffffa01c8c91>] ? br_nf_forward_ip+0x214/0x231 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.110621]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 09:50:26 172.30.1.2 [  98.121274]  [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.133488]  [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.145699]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 09:50:26 172.30.1.2 [  98.156696]  [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.168911]  [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.180258]  [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.192471]  [<ffffffffa01c396e>] ? T.963+0x3c/0x56 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.203817]  [<ffffffffa01c2753>] ? __br_fdb_get+0x10/0x83 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.216376]  [<ffffffffa01c461d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.231035]  [<ffffffffa01c9598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.246038]  [<ffffffffa01c83b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.258945]  [<ffffffffa01c935b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.272715]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 09:50:26 172.30.1.2 [  98.283365]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 09:50:26 172.30.1.2 [  98.294016]  [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.305360]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 09:50:26 172.30.1.2 [  98.316360]  [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.327706]  [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.339053]  [<ffffffffa01c445c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.350399]  [<ffffffffa01c484a>] ? br_handle_frame+0x1c3/0x1d9 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.363828]  [<ffffffffa01c4687>] ? br_handle_frame_finish+0x211/0x211 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.378483]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 09:50:26 172.30.1.2 [  98.391043]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jul  4 09:50:26 172.30.1.2 [  98.401171]  [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d
Jul  4 09:50:26 172.30.1.2 [  98.413037]  [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d
Jul  4 09:50:26 172.30.1.2 [  98.424728]  [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31
Jul  4 09:50:26 172.30.1.2 [  98.436249]  [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2]
Jul  4 09:50:26 172.30.1.2 [  98.449156]  [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2]
Jul  4 09:50:26 172.30.1.2 [  98.462066]  [<ffffffffa01c445c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 09:50:26 172.30.1.2 [  98.473413]  [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2]
Jul  4 09:50:26 172.30.1.2 [  98.485451]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 09:50:26 172.30.1.2 [  98.498007]  [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207
Jul  4 09:50:26 172.30.1.2 [  98.509356]  [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a
Jul  4 09:50:26 172.30.1.2 [  98.522089]  [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0
Jul  4 09:50:26 172.30.1.2 [  98.533260]  [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184
Jul  4 09:50:26 172.30.1.2 [  98.546511]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jul  4 09:50:26 172.30.1.2 [  98.556648]  [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30
Jul  4 09:50:26 172.30.1.2 [  98.567647]  [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79
Jul  4 09:50:26 172.30.1.2 [  98.578295]  [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5
Jul  4 09:50:26 172.30.1.2 [  98.588597]  [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa
Jul  4 09:50:26 172.30.1.2 [  98.598555]  [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e
Jul  4 09:50:26 172.30.1.2 [  98.610244]  <EOI> 
Jul  4 09:50:26 172.30.1.2 
Jul  4 09:50:26 172.30.1.2 [  98.614533]  [<ffffffff8106f2f0>] ? clockevents_program_event+0x99/0xb8
Jul  4 09:50:26 172.30.1.2 [  98.627789]  [<ffffffff811ffdb3>] ? intel_idle+0xdd/0x117
Jul  4 09:50:26 172.30.1.2 [  98.638611]  [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117
Jul  4 09:50:26 172.30.1.2 [  98.649437]  [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af
Jul  4 09:50:26 172.30.1.2 [  98.661474]  [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef
Jul  4 09:50:26 172.30.1.2 [  98.671777]  [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd
Jul  4 09:50:26 172.30.1.2 [  98.683121]  [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f
Jul  4 09:50:26 172.30.1.2 [  98.695677] Code: 
Jul  4 09:50:26 172.30.1.2 00
Jul  4 09:50:26 172.30.1.2 00
Jul  4 09:50:26 172.30.1.2 00
Jul  4 09:50:26 172.30.1.2 10
Jul  4 09:50:26 172.30.1.2 75
Jul  4 09:50:26 172.30.1.2 25
Jul  4 09:50:26 172.30.1.2 66
Jul  4 09:50:26 172.30.1.2 3d
Jul  4 09:50:26 172.30.1.2 81
Jul  4 09:50:26 172.30.1.2 00
Jul  4 09:50:26 172.30.1.2 75
Jul  4 09:50:26 172.30.1.2 1f
Jul  4 09:50:26 172.30.1.2 8b
Jul  4 09:50:26 172.30.1.2 87
Jul  4 09:50:26 172.30.1.2 c8
Jul  4 09:50:26 172.30.1.2 00
Jul  4 09:50:26 172.30.1.2 00
Jul  4 09:50:26 172.30.1.2 00
Jul  4 09:50:26 172.30.1.2 48
Jul  4 09:50:26 172.30.1.2 8b
Jul  4 09:50:26 172.30.1.2 8f
Jul  4 09:50:26 172.30.1.2 d8
Jul  4 09:50:26 172.30.1.2 00
Jul  4 09:50:26 172.30.1.2 00
Jul  4 09:50:26 172.30.1.2 00
Jul  4 09:50:26 172.30.1.2 66
Jul  4 09:50:26 172.30.1.2 81
Jul  4 09:50:26 172.30.1.2 7c
Jul  4 09:50:26 172.30.1.2 01
Jul  4 09:50:26 172.30.1.2 10
Jul  4 09:50:26 172.30.1.2 08
Jul  4 09:50:26 172.30.1.2 06
Jul  4 09:50:26 172.30.1.2 75
Jul  4 09:50:26 172.30.1.2 09
Jul  4 09:50:26 172.30.1.2 83
Jul  4 09:50:26 172.30.1.2 3d
Jul  4 09:50:26 172.30.1.2 f2
Jul  4 09:50:26 172.30.1.2 63
Jul  4 09:50:26 172.30.1.2 00
Jul  4 09:50:26 172.30.1.2 00
Jul  4 09:50:26 172.30.1.2 00
Jul  4 09:50:26 172.30.1.2 75
Jul  4 09:50:26 172.30.1.2 3c
Jul  4 09:50:26 172.30.1.2 f6>
Jul  4 09:50:26 172.30.1.2 42
Jul  4 09:50:26 172.30.1.2 18
Jul  4 09:50:26 172.30.1.2 01
Jul  4 09:50:26 172.30.1.2 48
Jul  4 09:50:26 172.30.1.2 8b
Jul  4 09:50:26 172.30.1.2 6a
Jul  4 09:50:26 172.30.1.2 08
Jul  4 09:50:26 172.30.1.2 74
Jul  4 09:50:26 172.30.1.2 10
Jul  4 09:50:26 172.30.1.2 8a
Jul  4 09:50:26 172.30.1.2 43
Jul  4 09:50:26 172.30.1.2 7d
Jul  4 09:50:26 172.30.1.2 83
Jul  4 09:50:26 172.30.1.2 e0
Jul  4 09:50:26 172.30.1.2 f8
Jul  4 09:50:26 172.30.1.2 83
Jul  4 09:50:26 172.30.1.2 c8
Jul  4 09:50:26 172.30.1.2 03
Jul  4 09:50:26 172.30.1.2 88
Jul  4 09:50:26 172.30.1.2 43
Jul  4 09:50:26 172.30.1.2 
Jul  4 09:50:26 172.30.1.2 [  98.737065] RIP 
Jul  4 09:50:27 172.30.1.2 [  98.751412]  RSP <ffff88042fc03960>
Jul  4 09:50:27 172.30.1.2 [  98.758419] CR2: 0000000000000018
Jul  4 09:50:27 172.30.1.2 [  98.765491] ---[ end trace 2dcc1511ba6f55d2 ]---
Jul  4 09:50:27 172.30.1.2 [  98.774916] Kernel panic - not syncing: Fatal exception in interrupt
Jul  4 09:50:27 172.30.1.2 [  98.787814] Pid: 0, comm: swapper/0 Tainted: G      D      3.2.21 #1
Jul  4 09:50:27 172.30.1.2 [  98.800748] Call Trace:
Jul  4 09:50:27 172.30.1.2 [  98.805850]  <IRQ> 
Jul  4 09:50:27 172.30.1.2 [  98.817329]  [<ffffffff81049da9>] ? kmsg_dump+0xb2/0xdd
Jul  4 09:50:27 172.30.1.2 [  98.827875]  [<ffffffff813653c1>] ? oops_end+0xa9/0xb6
Jul  4 09:50:27 172.30.1.2 [  98.838246]  [<ffffffff8102fcf9>] ? no_context+0x1ff/0x20c
Jul  4 09:50:27 172.30.1.2 [  98.849321]  [<ffffffff810f53c3>] ? virt_to_slab+0x9/0x3c
Jul  4 09:50:27 172.30.1.2 [  98.860218]  [<ffffffff81367534>] ? do_page_fault+0x1ad/0x34c
Jul  4 09:50:27 172.30.1.2 [  98.871813]  [<ffffffffa03ead93>] ? ip_vs_notrack+0x6e/0xa6 [ip_vs]
Jul  4 09:50:27 172.30.1.2 [  98.884441]  [<ffffffffa03e9dec>] ? ip_vs_conn_put+0x29/0x2f [ip_vs]
Jul  4 09:50:27 172.30.1.2 [  98.897309]  [<ffffffffa03ebe1a>] ? ip_vs_out+0x33c/0x49d [ip_vs]
Jul  4 09:50:27 172.30.1.2 [  98.909584]  [<ffffffff81364ab5>] ? page_fault+0x25/0x30
Jul  4 09:50:27 172.30.1.2 [  98.920311]  [<ffffffffa01c89d0>] ? br_nf_forward_finish+0x48/0xc0 [bridge]
Jul  4 09:50:27 172.30.1.2 [  98.934330]  [<ffffffffa01c8c91>] ? br_nf_forward_ip+0x214/0x231 [bridge]
Jul  4 09:50:27 172.30.1.2 [  98.948181]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 09:50:27 172.30.1.2 [  98.958965]  [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 09:50:27 172.30.1.2 [  98.971248]  [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 09:50:27 172.30.1.2 [  98.983586]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 09:50:27 172.30.1.2 [  98.994652]  [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.006931]  [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.018347]  [<ffffffffa01c3a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.030633]  [<ffffffffa01c396e>] ? T.963+0x3c/0x56 [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.042045]  [<ffffffffa01c2753>] ? __br_fdb_get+0x10/0x83 [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.054673]  [<ffffffffa01c461d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.069397]  [<ffffffffa01c9598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.084472]  [<ffffffffa01c83b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.097508]  [<ffffffffa01c935b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.111348]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 09:50:27 172.30.1.2 [  99.122074]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 09:50:27 172.30.1.2 [  99.132792]  [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.144191]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 09:50:27 172.30.1.2 [  99.155263]  [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.166871]  [<ffffffffa01c4476>] ? T.947+0x56/0x56 [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.178287]  [<ffffffffa01c445c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.189827]  [<ffffffffa01c484a>] ? br_handle_frame+0x1c3/0x1d9 [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.203365]  [<ffffffffa01c4687>] ? br_handle_frame_finish+0x211/0x211 [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.218150]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 09:50:27 172.30.1.2 [  99.230775]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jul  4 09:50:27 172.30.1.2 [  99.240975]  [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d
Jul  4 09:50:27 172.30.1.2 [  99.252906]  [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d
Jul  4 09:50:27 172.30.1.2 [  99.264639]  [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31
Jul  4 09:50:27 172.30.1.2 [  99.276297]  [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2]
Jul  4 09:50:27 172.30.1.2 [  99.289333]  [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2]
Jul  4 09:50:27 172.30.1.2 [  99.302373]  [<ffffffffa01c445c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 09:50:27 172.30.1.2 [  99.313851]  [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2]
Jul  4 09:50:27 172.30.1.2 [  99.326024]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 09:50:27 172.30.1.2 [  99.338653]  [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207
Jul  4 09:50:27 172.30.1.2 [  99.350072]  [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a
Jul  4 09:50:27 172.30.1.2 [  99.362877]  [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0
Jul  4 09:50:27 172.30.1.2 [  99.374116]  [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184
Jul  4 09:50:27 172.30.1.2 [  99.387434]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jul  4 09:50:27 172.30.1.2 [  99.397635]  [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30
Jul  4 09:50:27 172.30.1.2 [  99.408705]  [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79
Jul  4 09:50:27 172.30.1.2 [  99.419425]  [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5
Jul  4 09:50:27 172.30.1.2 [  99.429857]  [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa
Jul  4 09:50:27 172.30.1.2 [  99.439903]  [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e
Jul  4 09:50:27 172.30.1.2 [  99.451662]  <EOI> 
Jul  4 09:50:27 172.30.1.2 [  99.466410]  [<ffffffff811ffdb3>] ? intel_idle+0xdd/0x117
Jul  4 09:50:27 172.30.1.2 [  99.477365]  [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117
Jul  4 09:50:27 172.30.1.2 [  99.488261]  [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af
Jul  4 09:50:27 172.30.1.2 [  99.500367]  [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef
Jul  4 09:50:27 172.30.1.2 [  99.510737]  [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd
Jul  4 09:50:27 172.30.1.2 [  99.522158]  [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f









*************************  PANIC 2

Jul  4 10:16:32 172.30.1.2 [ 1229.844850] BUG: unable to handle kernel 
Jul  4 10:16:32 172.30.1.2 [ 1229.860508] IP:
Jul  4 10:16:32 172.30.1.2 [ 1229.874590] PGD 0 
Jul  4 10:16:32 172.30.1.2 
Jul  4 10:16:32 172.30.1.2 [ 1229.878604] Oops: 0000 [#1] 
Jul  4 10:16:32 172.30.1.2 SMP
Jul  4 10:16:32 172.30.1.2 
Jul  4 10:16:32 172.30.1.2 [ 1229.885057] CPU 0 
Jul  4 10:16:32 172.30.1.2 
Jul  4 10:16:32 172.30.1.2 [ 1229.888712] Modules linked in:
Jul  4 10:16:32 172.30.1.2 
Jul  4 10:16:32 172.30.1.2 [ 1230.027585] 
Jul  4 10:16:32 172.30.1.2 [ 1230.030548] Pid: 0, comm: swapper/0 Not tainted 3.2.21 #1
Jul  4 10:16:32 172.30.1.2 /0N051F
Jul  4 10:16:32 172.30.1.2 
Jul  4 10:16:32 172.30.1.2 [ 1230.046900] RIP: 0010:[<ffffffffa01bf9d0>] 
Jul  4 10:16:32 172.30.1.2 [ 1230.065834] RSP: 0018:ffff88042fc03960  EFLAGS: 00010287
Jul  4 10:16:32 172.30.1.2 [ 1230.076441] RAX: 0000000000000008 RBX: ffff8804215fa180 RCX: ffff88042fc03706
Jul  4 10:16:32 172.30.1.2 [ 1230.090691] RDX: 0000000000000000 RSI: 000000010003c740 RDI: ffff8804215fa180
Jul  4 10:16:32 172.30.1.2 [ 1230.104941] RBP: ffff880421d52000 R08: 0000000000000000 R09: ffff88042fc03918
Jul  4 10:16:32 172.30.1.2 [ 1230.119191] R10: ffffffff8180b240 R11: ffff8804215fa180 R12: ffff8804210d8000
Jul  4 10:16:32 172.30.1.2 [ 1230.133441] R13: ffff880406031300 R14: ffff8804210d8002 R15: ffff8804225bb000
Jul  4 10:16:32 172.30.1.2 [ 1230.147692] FS:  0000000000000000(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000
Jul  4 10:16:32 172.30.1.2 [ 1230.163863] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jul  4 10:16:32 172.30.1.2 [ 1230.175338] CR2: 0000000000000018 CR3: 00000001efa5a000 CR4: 00000000000026e0
Jul  4 10:16:32 172.30.1.2 [ 1230.189586] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jul  4 10:16:32 172.30.1.2 [ 1230.203835] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jul  4 10:16:32 172.30.1.2 [ 1230.218084] Process swapper/0 (pid: 0, threadinfo ffffffff81600000, task ffffffff8160d020)
Jul  4 10:16:32 172.30.1.2 [ 1230.234604] Stack:
Jul  4 10:16:32 172.30.1.2 [ 1230.238620]  0000000080000000
Jul  4 10:16:32 172.30.1.2 
Jul  4 10:16:32 172.30.1.2 [ 1230.253452]  ffff880421d52000
Jul  4 10:16:32 172.30.1.2 
Jul  4 10:16:32 172.30.1.2 [ 1230.268289]  ffff8804215fa180
Jul  4 10:16:32 172.30.1.2 
Jul  4 10:16:32 172.30.1.2 [ 1230.283123] Call Trace:
Jul  4 10:16:32 172.30.1.2 [ 1230.288006]  <IRQ> 
Jul  4 10:16:32 172.30.1.2 
Jul  4 10:16:32 172.30.1.2 [ 1230.292217]  [<ffffffffa01bfc91>] ? br_nf_forward_ip+0x214/0x231 [bridge]
Jul  4 10:16:32 172.30.1.2 [ 1230.305777]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 10:16:32 172.30.1.2 [ 1230.316390]  [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 10:16:32 172.30.1.2 [ 1230.328560]  [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 10:16:32 172.30.1.2 [ 1230.340728]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 10:16:32 172.30.1.2 [ 1230.351686]  [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 10:16:32 172.30.1.2 [ 1230.363857]  [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge]
Jul  4 10:16:32 172.30.1.2 [ 1230.375161]  [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 10:16:32 172.30.1.2 [ 1230.387332]  [<ffffffffa01ba96e>] ? T.963+0x3c/0x56 [bridge]
Jul  4 10:16:32 172.30.1.2 [ 1230.398638]  [<ffffffffa01b9753>] ? __br_fdb_get+0x10/0x83 [bridge]
Jul  4 10:16:32 172.30.1.2 [ 1230.411155]  [<ffffffffa01bb61d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge]
Jul  4 10:16:32 172.30.1.2 [ 1230.425771]  [<ffffffffa01c0598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge]
Jul  4 10:16:32 172.30.1.2 [ 1230.440732]  [<ffffffffa01bf3b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jul  4 10:16:32 172.30.1.2 [ 1230.453598]  [<ffffffffa01c035b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge]
Jul  4 10:16:32 172.30.1.2 [ 1230.467328]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 10:16:32 172.30.1.2 [ 1230.477936]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 10:16:32 172.30.1.2 [ 1230.488548]  [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.499850]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 10:16:33 172.30.1.2 [ 1230.510807]  [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.522111]  [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.533415]  [<ffffffffa01bb45c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.544720]  [<ffffffffa01bb84a>] ? br_handle_frame+0x1c3/0x1d9 [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.558107]  [<ffffffffa01bb687>] ? br_handle_frame_finish+0x211/0x211 [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.572722]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 10:16:33 172.30.1.2 [ 1230.585240]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jul  4 10:16:33 172.30.1.2 [ 1230.595328]  [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d
Jul  4 10:16:33 172.30.1.2 [ 1230.607151]  [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d
Jul  4 10:16:33 172.30.1.2 [ 1230.618800]  [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31
Jul  4 10:16:33 172.30.1.2 [ 1230.630280]  [<ffffffffa0046a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2]
Jul  4 10:16:33 172.30.1.2 [ 1230.643146]  [<ffffffffa00462f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2]
Jul  4 10:16:33 172.30.1.2 [ 1230.656012]  [<ffffffffa01bb45c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.667316]  [<ffffffffa0046cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2]
Jul  4 10:16:33 172.30.1.2 [ 1230.679313]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 10:16:33 172.30.1.2 [ 1230.691827]  [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207
Jul  4 10:16:33 172.30.1.2 [ 1230.703130]  [<ffffffff812a76f4>] ? process_backlog+0xec/0x1c7
Jul  4 10:16:33 172.30.1.2 [ 1230.714780]  [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0
Jul  4 10:16:33 172.30.1.2 [ 1230.725912]  [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184
Jul  4 10:16:33 172.30.1.2 [ 1230.739127]  [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30
Jul  4 10:16:33 172.30.1.2 [ 1230.750085]  [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79
Jul  4 10:16:33 172.30.1.2 [ 1230.760693]  [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5
Jul  4 10:16:33 172.30.1.2 [ 1230.770954]  [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa
Jul  4 10:16:33 172.30.1.2 [ 1230.780871]  [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e
Jul  4 10:16:33 172.30.1.2 [ 1230.792517]  <EOI> 
Jul  4 10:16:33 172.30.1.2 
Jul  4 10:16:33 172.30.1.2 [ 1230.796721]  [<ffffffff810665a4>] ? enqueue_hrtimer+0x43/0x6a
Jul  4 10:16:33 172.30.1.2 [ 1230.808200]  [<ffffffff811ffdb3>] ? intel_idle+0xdd/0x117
Jul  4 10:16:33 172.30.1.2 [ 1230.818982]  [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117
Jul  4 10:16:33 172.30.1.2 [ 1230.829765]  [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af
Jul  4 10:16:33 172.30.1.2 [ 1230.841761]  [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef
Jul  4 10:16:33 172.30.1.2 [ 1230.852023]  [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd
Jul  4 10:16:33 172.30.1.2 [ 1230.863324]  [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f
Jul  4 10:16:33 172.30.1.2 [ 1230.875840] Code: 
Jul  4 10:16:33 172.30.1.2 00
Jul  4 10:16:33 172.30.1.2 00
Jul  4 10:16:33 172.30.1.2 00
Jul  4 10:16:33 172.30.1.2 10
Jul  4 10:16:33 172.30.1.2 75
Jul  4 10:16:33 172.30.1.2 25
Jul  4 10:16:33 172.30.1.2 66
Jul  4 10:16:33 172.30.1.2 3d
Jul  4 10:16:33 172.30.1.2 81
Jul  4 10:16:33 172.30.1.2 00
Jul  4 10:16:33 172.30.1.2 75
Jul  4 10:16:33 172.30.1.2 1f
Jul  4 10:16:33 172.30.1.2 8b
Jul  4 10:16:33 172.30.1.2 87
Jul  4 10:16:33 172.30.1.2 c8
Jul  4 10:16:33 172.30.1.2 00
Jul  4 10:16:33 172.30.1.2 00
Jul  4 10:16:33 172.30.1.2 00
Jul  4 10:16:33 172.30.1.2 48
Jul  4 10:16:33 172.30.1.2 8b
Jul  4 10:16:33 172.30.1.2 8f
Jul  4 10:16:33 172.30.1.2 d8
Jul  4 10:16:33 172.30.1.2 00
Jul  4 10:16:33 172.30.1.2 00
Jul  4 10:16:33 172.30.1.2 00
Jul  4 10:16:33 172.30.1.2 66
Jul  4 10:16:33 172.30.1.2 81
Jul  4 10:16:33 172.30.1.2 7c
Jul  4 10:16:33 172.30.1.2 01
Jul  4 10:16:33 172.30.1.2 10
Jul  4 10:16:33 172.30.1.2 08
Jul  4 10:16:33 172.30.1.2 06
Jul  4 10:16:33 172.30.1.2 75
Jul  4 10:16:33 172.30.1.2 09
Jul  4 10:16:33 172.30.1.2 83
Jul  4 10:16:33 172.30.1.2 3d
Jul  4 10:16:33 172.30.1.2 f2
Jul  4 10:16:33 172.30.1.2 63
Jul  4 10:16:33 172.30.1.2 00
Jul  4 10:16:33 172.30.1.2 00
Jul  4 10:16:33 172.30.1.2 00
Jul  4 10:16:33 172.30.1.2 75
Jul  4 10:16:33 172.30.1.2 3c
Jul  4 10:16:33 172.30.1.2 f6>
Jul  4 10:16:33 172.30.1.2 42
Jul  4 10:16:33 172.30.1.2 18
Jul  4 10:16:33 172.30.1.2 01
Jul  4 10:16:33 172.30.1.2 48
Jul  4 10:16:33 172.30.1.2 8b
Jul  4 10:16:33 172.30.1.2 6a
Jul  4 10:16:33 172.30.1.2 08
Jul  4 10:16:33 172.30.1.2 74
Jul  4 10:16:33 172.30.1.2 10
Jul  4 10:16:33 172.30.1.2 8a
Jul  4 10:16:33 172.30.1.2 43
Jul  4 10:16:33 172.30.1.2 
Jul  4 10:16:33 172.30.1.2 [ 1230.909204] ------------[ cut here ]------------
Jul  4 10:16:33 172.30.1.2 [ 1230.909207] WARNING: at kernel/softirq.c:159 _local_bh_enable_ip+0x41/0x8b()
Jul  4 10:16:33 172.30.1.2 [ 1230.909208] Hardware name: PowerEdge R410
Jul  4 10:16:33 172.30.1.2 [ 1230.909209] Modules linked in: ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 ip6table_filter ip6_tables iptable_filter ip_tables x_tables ip_vs_rr ip_vs nf_conntrack crc32c libcrc32c drbd lru_cache cn tun virtio_net virtio_blk virtio_rng rng_core virtio_pci virtio_ring virtio kvm_intel kvm ipmi_devintf ipmi_poweroff ipmi_si ipmi_watchdog ipmi_msghandler netconsole configfs loop snd_pcm bridge stp snd_timer i7core_edac edac_core dcdbas snd joydev psmouse iTCO_wdt iTCO_vendor_support soundcore snd_page_alloc pcspkr serio_raw processor evdev button thermal_sys ext3 mbcache jbd dm_mod usbhid hid sr_mod cdrom sd_mod ses crc_t10dif enclosure ata_generic uhci_hcd ata_piix libata ehci_hcd usbcore usb_common megaraid_sas scsi_mod bnx2 [last unloaded: scsi_wait_scan]
Jul  4 10:16:33 172.30.1.2 [ 1230.909244] Pid: 0, comm: swapper/0 Not tainted 3.2.21 #1
Jul  4 10:16:33 172.30.1.2 [ 1230.909245] Call Trace:
Jul  4 10:16:33 172.30.1.2 [ 1230.909246]  <IRQ>  [<ffffffff81049810>] ? warn_slowpath_common+0x78/0x8c
Jul  4 10:16:33 172.30.1.2 [ 1230.909253]  [<ffffffff8104efa0>] ? _local_bh_enable_ip+0x41/0x8b
Jul  4 10:16:33 172.30.1.2 [ 1230.909259]  [<ffffffffa003d648>] ? bnx2_reg_rd_ind+0x31/0x38 [bnx2]
Jul  4 10:16:33 172.30.1.2 [ 1230.909264]  [<ffffffffa0046dc8>] ? bnx2_poll+0x1e2/0x1f2 [bnx2]
Jul  4 10:16:33 172.30.1.2 [ 1230.909270]  [<ffffffff812b6b62>] ? netpoll_poll_dev+0xab/0x4ad
Jul  4 10:16:33 172.30.1.2 [ 1230.909275]  [<ffffffffa0043ba0>] ? bnx2_start_xmit+0x411/0x55d [bnx2]
Jul  4 10:16:33 172.30.1.2 [ 1230.909282]  [<ffffffff810f693e>] ? ____cache_alloc+0xc6/0x20d
Jul  4 10:16:33 172.30.1.2 [ 1230.909286]  [<ffffffff812b7075>] ? netpoll_send_skb_on_dev+0x111/0x215
Jul  4 10:16:33 172.30.1.2 [ 1230.909292]  [<ffffffffa01b96d2>] ? br_dev_xmit+0x136/0x150 [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.909295]  [<ffffffff812b7033>] ? netpoll_send_skb_on_dev+0xcf/0x215
Jul  4 10:16:33 172.30.1.2 [ 1230.909301]  [<ffffffff811c3157>] ? delay_tsc+0x2b/0x74
Jul  4 10:16:33 172.30.1.2 [ 1230.909305]  [<ffffffffa01a3272>] ? write_msg+0x9f/0x102 [netconsole]
Jul  4 10:16:33 172.30.1.2 [ 1230.909309]  [<ffffffff810499e6>] ? __call_console_drivers+0x75/0x86
Jul  4 10:16:33 172.30.1.2 [ 1230.909312]  [<ffffffff8104a084>] ? console_unlock+0x13d/0x1e8
Jul  4 10:16:33 172.30.1.2 [ 1230.909315]  [<ffffffff8104a707>] ? vprintk+0x39e/0x3e5
Jul  4 10:16:33 172.30.1.2 [ 1230.909321]  [<ffffffffa01bf9dc>] ? br_nf_forward_finish+0x54/0xc0 [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.909326]  [<ffffffffa01bf9a5>] ? br_nf_forward_finish+0x1d/0xc0 [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.909330]  [<ffffffff81362842>] ? printk+0x40/0x46
Jul  4 10:16:33 172.30.1.2 [ 1230.909333]  [<ffffffff8100fff9>] ? show_registers+0x1e2/0x211
Jul  4 10:16:33 172.30.1.2 [ 1230.909336]  [<ffffffff813652dd>] ? __die+0x8e/0xc9
Jul  4 10:16:33 172.30.1.2 [ 1230.909339]  [<ffffffff8102fcd0>] ? no_context+0x1d6/0x20c
Jul  4 10:16:33 172.30.1.2 [ 1230.909342]  [<ffffffff810f53c3>] ? virt_to_slab+0x9/0x3c
Jul  4 10:16:33 172.30.1.2 [ 1230.909345]  [<ffffffff81367534>] ? do_page_fault+0x1ad/0x34c
Jul  4 10:16:33 172.30.1.2 [ 1230.909351]  [<ffffffffa03f4d93>] ? ip_vs_notrack+0x6e/0xa6 [ip_vs]
Jul  4 10:16:33 172.30.1.2 [ 1230.909355]  [<ffffffffa03f3dec>] ? ip_vs_conn_put+0x29/0x2f [ip_vs]
Jul  4 10:16:33 172.30.1.2 [ 1230.909360]  [<ffffffffa03f5e1a>] ? ip_vs_out+0x33c/0x49d [ip_vs]
Jul  4 10:16:33 172.30.1.2 [ 1230.909364]  [<ffffffff81364ab5>] ? page_fault+0x25/0x30
Jul  4 10:16:33 172.30.1.2 [ 1230.909369]  [<ffffffffa01bf9d0>] ? br_nf_forward_finish+0x48/0xc0 [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.909375]  [<ffffffffa01bfc91>] ? br_nf_forward_ip+0x214/0x231 [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.909378]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 10:16:33 172.30.1.2 [ 1230.909383]  [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.909388]  [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 10:16:33 172.30.1.2 [ 1230.909391]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 10:16:33 172.30.1.2 [ 1230.909395]  [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909401]  [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909405]  [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909410]  [<ffffffffa01ba96e>] ? T.963+0x3c/0x56 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909415]  [<ffffffffa01b9753>] ? __br_fdb_get+0x10/0x83 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909420]  [<ffffffffa01bb61d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909425]  [<ffffffffa01c0598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909431]  [<ffffffffa01bf3b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909436]  [<ffffffffa01c035b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909439]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 10:16:34 172.30.1.2 [ 1230.909442]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 10:16:34 172.30.1.2 [ 1230.909448]  [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909450]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 10:16:34 172.30.1.2 [ 1230.909455]  [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909461]  [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909466]  [<ffffffffa01bb45c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909471]  [<ffffffffa01bb84a>] ? br_handle_frame+0x1c3/0x1d9 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909476]  [<ffffffffa01bb687>] ? br_handle_frame_finish+0x211/0x211 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909479]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 10:16:34 172.30.1.2 [ 1230.909482]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jul  4 10:16:34 172.30.1.2 [ 1230.909485]  [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d
Jul  4 10:16:34 172.30.1.2 [ 1230.909487]  [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d
Jul  4 10:16:34 172.30.1.2 [ 1230.909490]  [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31
Jul  4 10:16:34 172.30.1.2 [ 1230.909495]  [<ffffffffa0046a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2]
Jul  4 10:16:34 172.30.1.2 [ 1230.909500]  [<ffffffffa00462f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2]
Jul  4 10:16:34 172.30.1.2 [ 1230.909506]  [<ffffffffa01bb45c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1230.909511]  [<ffffffffa0046cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2]
Jul  4 10:16:34 172.30.1.2 [ 1230.909514]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 10:16:34 172.30.1.2 [ 1230.909517]  [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207
Jul  4 10:16:34 172.30.1.2 [ 1230.909519]  [<ffffffff812a76f4>] ? process_backlog+0xec/0x1c7
Jul  4 10:16:34 172.30.1.2 [ 1230.909522]  [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0
Jul  4 10:16:34 172.30.1.2 [ 1230.909525]  [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184
Jul  4 10:16:34 172.30.1.2 [ 1230.909528]  [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30
Jul  4 10:16:34 172.30.1.2 [ 1230.909531]  [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79
Jul  4 10:16:34 172.30.1.2 [ 1230.909533]  [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5
Jul  4 10:16:34 172.30.1.2 [ 1230.909535]  [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa
Jul  4 10:16:34 172.30.1.2 [ 1230.909538]  [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e
Jul  4 10:16:34 172.30.1.2 [ 1230.909540]  <EOI>  [<ffffffff810665a4>] ? enqueue_hrtimer+0x43/0x6a
Jul  4 10:16:34 172.30.1.2 [ 1230.909545]  [<ffffffff811ffdb3>] ? intel_idle+0xdd/0x117
Jul  4 10:16:34 172.30.1.2 [ 1230.909547]  [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117
Jul  4 10:16:34 172.30.1.2 [ 1230.909550]  [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af
Jul  4 10:16:34 172.30.1.2 [ 1230.909552]  [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef
Jul  4 10:16:34 172.30.1.2 [ 1230.909555]  [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd
Jul  4 10:16:34 172.30.1.2 [ 1230.909557]  [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f
Jul  4 10:16:34 172.30.1.2 [ 1230.909559] ---[ end trace fc194823a33da07a ]---
Jul  4 10:16:34 172.30.1.2 [ 1232.022328] 7d 
Jul  4 10:16:34 172.30.1.2 83
Jul  4 10:16:34 172.30.1.2 e0
Jul  4 10:16:34 172.30.1.2 f8
Jul  4 10:16:34 172.30.1.2 83
Jul  4 10:16:34 172.30.1.2 c8
Jul  4 10:16:34 172.30.1.2 03
Jul  4 10:16:34 172.30.1.2 88
Jul  4 10:16:34 172.30.1.2 43
Jul  4 10:16:34 172.30.1.2 
Jul  4 10:16:34 172.30.1.2 [ 1232.030096] RIP 
Jul  4 10:16:34 172.30.1.2 [ 1232.044362]  RSP <ffff88042fc03960>
Jul  4 10:16:34 172.30.1.2 [ 1232.051328] CR2: 0000000000000018
Jul  4 10:16:34 172.30.1.2 [ 1232.058766] ---[ end trace fc194823a33da07b ]---
Jul  4 10:16:34 172.30.1.2 [ 1232.073596] Kernel panic - not syncing: Fatal exception in interrupt
Jul  4 10:16:34 172.30.1.2 [ 1232.086687] Pid: 0, comm: swapper/0 Tainted: G      D W    3.2.21 #1
Jul  4 10:16:34 172.30.1.2 [ 1232.099762] Call Trace:
Jul  4 10:16:34 172.30.1.2 [ 1232.104997]  <IRQ> 
Jul  4 10:16:34 172.30.1.2 [ 1232.116921]  [<ffffffff81049da9>] ? kmsg_dump+0xb2/0xdd
Jul  4 10:16:34 172.30.1.2 [ 1232.127737]  [<ffffffff813653c1>] ? oops_end+0xa9/0xb6
Jul  4 10:16:34 172.30.1.2 [ 1232.138297]  [<ffffffff8102fcf9>] ? no_context+0x1ff/0x20c
Jul  4 10:16:34 172.30.1.2 [ 1232.149634]  [<ffffffff810f53c3>] ? virt_to_slab+0x9/0x3c
Jul  4 10:16:34 172.30.1.2 [ 1232.160799]  [<ffffffff81367534>] ? do_page_fault+0x1ad/0x34c
Jul  4 10:16:34 172.30.1.2 [ 1232.172660]  [<ffffffffa03f4d93>] ? ip_vs_notrack+0x6e/0xa6 [ip_vs]
Jul  4 10:16:34 172.30.1.2 [ 1232.185561]  [<ffffffffa03f3dec>] ? ip_vs_conn_put+0x29/0x2f [ip_vs]
Jul  4 10:16:34 172.30.1.2 [ 1232.198619]  [<ffffffffa03f5e1a>] ? ip_vs_out+0x33c/0x49d [ip_vs]
Jul  4 10:16:34 172.30.1.2 [ 1232.211157]  [<ffffffff81364ab5>] ? page_fault+0x25/0x30
Jul  4 10:16:34 172.30.1.2 [ 1232.222227]  [<ffffffffa01bf9d0>] ? br_nf_forward_finish+0x48/0xc0 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.236573]  [<ffffffffa01bfc91>] ? br_nf_forward_ip+0x214/0x231 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.250640]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 10:16:34 172.30.1.2 [ 1232.261680]  [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.274300]  [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.286840]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 10:16:34 172.30.1.2 [ 1232.298164]  [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.310775]  [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.322461]  [<ffffffffa01baa5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.335018]  [<ffffffffa01ba96e>] ? T.963+0x3c/0x56 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.346693]  [<ffffffffa01b9753>] ? __br_fdb_get+0x10/0x83 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.359583]  [<ffffffffa01bb61d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.374567]  [<ffffffffa01c0598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.389895]  [<ffffffffa01bf3b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.403127]  [<ffffffffa01c035b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.417307]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 10:16:34 172.30.1.2 [ 1232.428288]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 10:16:34 172.30.1.2 [ 1232.439232]  [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.450848]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 10:16:34 172.30.1.2 [ 1232.462237]  [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.473984]  [<ffffffffa01bb476>] ? T.947+0x56/0x56 [bridge]
Jul  4 10:16:34 172.30.1.2 [ 1232.485708]  [<ffffffffa01bb45c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 10:16:35 172.30.1.2 [ 1232.497434]  [<ffffffffa01bb84a>] ? br_handle_frame+0x1c3/0x1d9 [bridge]
Jul  4 10:16:35 172.30.1.2 [ 1232.511205]  [<ffffffffa01bb687>] ? br_handle_frame_finish+0x211/0x211 [bridge]
Jul  4 10:16:35 172.30.1.2 [ 1232.526211]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 10:16:35 172.30.1.2 [ 1232.539100]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jul  4 10:16:35 172.30.1.2 [ 1232.549564]  [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d
Jul  4 10:16:35 172.30.1.2 [ 1232.561885]  [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d
Jul  4 10:16:35 172.30.1.2 [ 1232.573955]  [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31
Jul  4 10:16:35 172.30.1.2 [ 1232.585819]  [<ffffffffa0046a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2]
Jul  4 10:16:35 172.30.1.2 [ 1232.599057]  [<ffffffffa00462f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2]
Jul  4 10:16:35 172.30.1.2 [ 1232.612295]  [<ffffffffa01bb45c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 10:16:35 172.30.1.2 [ 1232.624033]  [<ffffffffa0046cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2]
Jul  4 10:16:35 172.30.1.2 [ 1232.636400]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 10:16:35 172.30.1.2 [ 1232.649290]  [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207
Jul  4 10:16:35 172.30.1.2 [ 1232.660969]  [<ffffffff812a76f4>] ? process_backlog+0xec/0x1c7
Jul  4 10:16:35 172.30.1.2 [ 1232.673051]  [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0
Jul  4 10:16:35 172.30.1.2 [ 1232.684544]  [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184
Jul  4 10:16:35 172.30.1.2 [ 1232.698181]  [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30
Jul  4 10:16:35 172.30.1.2 [ 1232.709517]  [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79
Jul  4 10:16:35 172.30.1.2 [ 1232.720570]  [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5
Jul  4 10:16:35 172.30.1.2 [ 1232.731213]  [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa
Jul  4 10:16:35 172.30.1.2 [ 1232.741520]  [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e
Jul  4 10:16:35 172.30.1.2 [ 1232.753540]  <EOI> 
Jul  4 10:16:35 172.30.1.2 [ 1232.766995]  [<ffffffff811ffdb3>] ? intel_idle+0xdd/0x117
Jul  4 10:16:35 172.30.1.2 [ 1232.778212]  [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117
Jul  4 10:16:35 172.30.1.2 [ 1232.789365]  [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af
Jul  4 10:16:35 172.30.1.2 [ 1232.801743]  [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef
Jul  4 10:16:35 172.30.1.2 [ 1232.812429]  [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd
Jul  4 10:16:35 172.30.1.2 [ 1232.824103]  [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f
Jul  4 10:16:35 172.30.1.2 [ 1232.837153] ------------[ cut here ]------------
Jul  4 10:16:35 172.30.1.2 [ 1232.846424] WARNING: at arch/x86/kernel/smp.c:119 try_to_wake_up+0x152/0x190()
Jul  4 10:16:35 172.30.1.2 [ 1232.860904] Hardware name: PowerEdge R410
Jul  4 10:16:35 172.30.1.2 [ 1232.868951] Modules linked in:
Jul  4 10:16:35 172.30.1.2 
Jul  4 10:16:35 172.30.1.2 [ 1233.011185] Pid: 5081, comm: kvm Tainted: G      D W    3.2.21 #1
Jul  4 10:16:35 172.30.1.2 [ 1233.023394] Call Trace:
Jul  4 10:16:35 172.30.1.2 [ 1233.028322]  [<ffffffff81049810>] ? warn_slowpath_common+0x78/0x8c
Jul  4 10:16:35 172.30.1.2 [ 1233.040707]  [<ffffffff81045ed8>] ? try_to_wake_up+0x152/0x190
Jul  4 10:16:35 172.30.1.2 [ 1233.052400]  [<ffffffff81063786>] ? autoremove_wake_function+0x9/0x2a
Jul  4 10:16:35 172.30.1.2 [ 1233.065304]  [<ffffffff8103878a>] ? __wake_up_common+0x41/0x78
Jul  4 10:16:35 172.30.1.2 [ 1233.076998]  [<ffffffff8103dbbb>] ? __wake_up+0x35/0x46
Jul  4 10:16:35 172.30.1.2 [ 1233.087485]  [<ffffffffa024866c>] ? kvm_vcpu_kick+0x31/0x82 [kvm]
Jul  4 10:16:35 172.30.1.2 [ 1233.099699]  [<ffffffff81113d58>] ? __pollwait+0xd0/0xd0
Jul  4 10:16:35 172.30.1.2 [ 1233.110355]  [<ffffffffa0261978>] ? __apic_accept_irq+0x1c1/0x1e4 [kvm]
Jul  4 10:16:35 172.30.1.2 [ 1233.123613]  [<ffffffffa023f4ee>] ? ioapic_service+0x9a/0xb8 [kvm]
Jul  4 10:16:35 172.30.1.2 [ 1233.136002]  [<ffffffffa023f87c>] ? kvm_ioapic_set_irq+0x7d/0xd1 [kvm]
Jul  4 10:16:35 172.30.1.2 [ 1233.149084]  [<ffffffffa02401f5>] ? kvm_set_irq+0xae/0xd7 [kvm]
Jul  4 10:16:35 172.30.1.2 [ 1233.160953]  [<ffffffffa023fce7>] ? kvm_free_irq_routing+0x11/0x11 [kvm]
Jul  4 10:16:35 172.30.1.2 [ 1233.174384]  [<ffffffffa023fd28>] ? kvm_set_ioapic_irq+0x41/0x41 [kvm]
Jul  4 10:16:35 172.30.1.2 [ 1233.187464]  [<ffffffff812a83c3>] ? netif_rx_ni+0x1e/0x27
Jul  4 10:16:35 172.30.1.2 [ 1233.198292]  [<ffffffffa024c566>] ? kvm_arch_vm_ioctl+0x391/0x8b5 [kvm]
Jul  4 10:16:35 172.30.1.2 [ 1233.211545]  [<ffffffffa02b7e40>] ? tun_sendmsg+0x23/0x23 [tun]
Jul  4 10:16:35 172.30.1.2 [ 1233.223409]  [<ffffffffa02b7eac>] ? tun_chr_aio_write+0x6c/0x7f [tun]
Jul  4 10:16:35 172.30.1.2 [ 1233.236315]  [<ffffffff81105818>] ? do_sync_readv_writev+0x9a/0xd5
Jul  4 10:16:35 172.30.1.2 [ 1233.248701]  [<ffffffff81132c72>] ? fsnotify+0x24b/0x278
Jul  4 10:16:35 172.30.1.2 [ 1233.259357]  [<ffffffffa023e2e4>] ? kvm_vm_ioctl+0x358/0x39a [kvm]
Jul  4 10:16:35 172.30.1.2 [ 1233.271742]  [<ffffffff81105ec3>] ? do_readv_writev+0x110/0x125
Jul  4 10:16:35 172.30.1.2 [ 1233.283608]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jul  4 10:16:35 172.30.1.2 [ 1233.293739]  [<ffffffff811134f7>] ? do_vfs_ioctl+0x464/0x4b1
Jul  4 10:16:35 172.30.1.2 [ 1233.305082]  [<ffffffff8111358f>] ? sys_ioctl+0x4b/0x70
Jul  4 10:16:35 172.30.1.2 [ 1233.315558]  [<ffffffff8110601d>] ? sys_writev+0x62/0x93
Jul  4 10:16:35 172.30.1.2 [ 1233.326208]  [<ffffffff81369b12>] ? system_call_fastpath+0x16/0x1b
Jul  4 10:16:35 172.30.1.2 [ 1233.338592] ---[ end trace fc194823a33da07c ]---



*************************  PANIC 3

Jul  4 12:02:44 172.30.1.2 [ 4919.504700] BUG: unable to handle kernel 
Jul  4 12:02:44 172.30.1.2 [ 4919.520358] IP:
Jul  4 12:02:44 172.30.1.2 [ 4919.534442] PGD 0 
Jul  4 12:02:44 172.30.1.2 
Jul  4 12:02:44 172.30.1.2 [ 4919.538456] Oops: 0000 [#1] 
Jul  4 12:02:44 172.30.1.2 SMP
Jul  4 12:02:44 172.30.1.2 
Jul  4 12:02:44 172.30.1.2 [ 4919.544912] CPU 0 
Jul  4 12:02:44 172.30.1.2 
Jul  4 12:02:44 172.30.1.2 [ 4919.548565] Modules linked in:
Jul  4 12:02:44 172.30.1.2 
Jul  4 12:02:44 172.30.1.2 [ 4919.687452] 
Jul  4 12:02:44 172.30.1.2 [ 4919.690415] Pid: 0, comm: swapper/0 Not tainted 3.2.21 #1
Jul  4 12:02:44 172.30.1.2 /0N051F
Jul  4 12:02:44 172.30.1.2 
Jul  4 12:02:44 172.30.1.2 [ 4919.706766] RIP: 0010:[<ffffffffa018d9d0>] 
Jul  4 12:02:44 172.30.1.2 [ 4919.725700] RSP: 0018:ffff88042fc03960  EFLAGS: 00010287
Jul  4 12:02:44 172.30.1.2 [ 4919.736310] RAX: 0000000000000008 RBX: ffff88040cf5a7c0 RCX: ffff88042fc03707
Jul  4 12:02:44 172.30.1.2 [ 4919.750561] RDX: 0000000000000000 RSI: 000000010011dc80 RDI: ffff88040cf5a7c0
Jul  4 12:02:44 172.30.1.2 [ 4919.764809] RBP: ffff88042164a000 R08: 0000000000000000 R09: ffff88042fc03918
Jul  4 12:02:44 172.30.1.2 [ 4919.779057] R10: ffffffff8180b240 R11: ffff88040cf5a7c0 R12: ffff880221038000
Jul  4 12:02:44 172.30.1.2 [ 4919.793305] R13: ffff8803f58eb1c0 R14: ffff880221038002 R15: ffff880223a61000
Jul  4 12:02:44 172.30.1.2 [ 4919.807555] FS:  0000000000000000(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000
Jul  4 12:02:44 172.30.1.2 [ 4919.823728] CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Jul  4 12:02:44 172.30.1.2 [ 4919.835204] CR2: 0000000000000018 CR3: 0000000001605000 CR4: 00000000000026e0
Jul  4 12:02:44 172.30.1.2 [ 4919.849453] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Jul  4 12:02:44 172.30.1.2 [ 4919.863703] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Jul  4 12:02:44 172.30.1.2 [ 4919.877952] Process swapper/0 (pid: 0, threadinfo ffffffff81600000, task ffffffff8160d020)
Jul  4 12:02:44 172.30.1.2 [ 4919.894470] Stack:
Jul  4 12:02:44 172.30.1.2 [ 4919.898488]  0000000080000000
Jul  4 12:02:44 172.30.1.2 
Jul  4 12:02:44 172.30.1.2 [ 4919.913320]  ffff88042164a000
Jul  4 12:02:44 172.30.1.2 
Jul  4 12:02:44 172.30.1.2 [ 4919.928150]  ffff88040cf5a7c0
Jul  4 12:02:44 172.30.1.2 
Jul  4 12:02:44 172.30.1.2 [ 4919.942983] Call Trace:
Jul  4 12:02:44 172.30.1.2 [ 4919.947869]  <IRQ> 
Jul  4 12:02:44 172.30.1.2 
Jul  4 12:02:44 172.30.1.2 [ 4919.952076]  [<ffffffffa018dc91>] ? br_nf_forward_ip+0x214/0x231 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4919.965638]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 12:02:44 172.30.1.2 [ 4919.976250]  [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4919.988421]  [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.000591]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 12:02:44 172.30.1.2 [ 4920.011549]  [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.023721]  [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.035025]  [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.047197]  [<ffffffffa018896e>] ? T.963+0x3c/0x56 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.058501]  [<ffffffffa0187753>] ? __br_fdb_get+0x10/0x83 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.071019]  [<ffffffffa018961d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.085635]  [<ffffffffa018e598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.100597]  [<ffffffffa018d3b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.113463]  [<ffffffffa018e35b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.127192]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 12:02:44 172.30.1.2 [ 4920.137804]  [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.149107]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 12:02:44 172.30.1.2 [ 4920.160065]  [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.171370]  [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.182674]  [<ffffffffa018945c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.193979]  [<ffffffffa018984a>] ? br_handle_frame+0x1c3/0x1d9 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.207365]  [<ffffffffa0189687>] ? br_handle_frame_finish+0x211/0x211 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.221979]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 12:02:44 172.30.1.2 [ 4920.234498]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jul  4 12:02:44 172.30.1.2 [ 4920.244587]  [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d
Jul  4 12:02:44 172.30.1.2 [ 4920.256409]  [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d
Jul  4 12:02:44 172.30.1.2 [ 4920.268056]  [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31
Jul  4 12:02:44 172.30.1.2 [ 4920.279537]  [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2]
Jul  4 12:02:44 172.30.1.2 [ 4920.292403]  [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2]
Jul  4 12:02:44 172.30.1.2 [ 4920.305268]  [<ffffffffa018945c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 12:02:44 172.30.1.2 [ 4920.316576]  [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2]
Jul  4 12:02:44 172.30.1.2 [ 4920.328573]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 12:02:44 172.30.1.2 [ 4920.341089]  [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207
Jul  4 12:02:44 172.30.1.2 [ 4920.352394]  [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a
Jul  4 12:02:44 172.30.1.2 [ 4920.365085]  [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0
Jul  4 12:02:44 172.30.1.2 [ 4920.376214]  [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184
Jul  4 12:02:44 172.30.1.2 [ 4920.389425]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jul  4 12:02:44 172.30.1.2 [ 4920.399518]  [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30
Jul  4 12:02:44 172.30.1.2 [ 4920.410477]  [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79
Jul  4 12:02:44 172.30.1.2 [ 4920.421086]  [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5
Jul  4 12:02:45 172.30.1.2 [ 4920.431348]  [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa
Jul  4 12:02:45 172.30.1.2 [ 4920.441265]  [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e
Jul  4 12:02:45 172.30.1.2 [ 4920.452913]  <EOI> 
Jul  4 12:02:45 172.30.1.2 
Jul  4 12:02:45 172.30.1.2 [ 4920.457120]  [<ffffffff811ffdb3>] ? intel_idle+0xdd/0x117
Jul  4 12:02:45 172.30.1.2 [ 4920.467900]  [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117
Jul  4 12:02:45 172.30.1.2 [ 4920.478683]  [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af
Jul  4 12:02:45 172.30.1.2 [ 4920.490679]  [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef
Jul  4 12:02:45 172.30.1.2 [ 4920.500941]  [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd
Jul  4 12:02:45 172.30.1.2 [ 4920.512242]  [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f
Jul  4 12:02:45 172.30.1.2 [ 4920.524758] Code: 
Jul  4 12:02:45 172.30.1.2 00
Jul  4 12:02:45 172.30.1.2 00
Jul  4 12:02:45 172.30.1.2 00
Jul  4 12:02:45 172.30.1.2 10
Jul  4 12:02:45 172.30.1.2 75
Jul  4 12:02:45 172.30.1.2 25
Jul  4 12:02:45 172.30.1.2 66
Jul  4 12:02:45 172.30.1.2 3d
Jul  4 12:02:45 172.30.1.2 81
Jul  4 12:02:45 172.30.1.2 00
Jul  4 12:02:45 172.30.1.2 75
Jul  4 12:02:45 172.30.1.2 1f
Jul  4 12:02:45 172.30.1.2 8b
Jul  4 12:02:45 172.30.1.2 87
Jul  4 12:02:45 172.30.1.2 c8
Jul  4 12:02:45 172.30.1.2 00
Jul  4 12:02:45 172.30.1.2 00
Jul  4 12:02:45 172.30.1.2 00
Jul  4 12:02:45 172.30.1.2 48
Jul  4 12:02:45 172.30.1.2 8b
Jul  4 12:02:45 172.30.1.2 8f
Jul  4 12:02:45 172.30.1.2 d8
Jul  4 12:02:45 172.30.1.2 00
Jul  4 12:02:45 172.30.1.2 00
Jul  4 12:02:45 172.30.1.2 00
Jul  4 12:02:45 172.30.1.2 66
Jul  4 12:02:45 172.30.1.2 81
Jul  4 12:02:45 172.30.1.2 7c
Jul  4 12:02:45 172.30.1.2 01
Jul  4 12:02:45 172.30.1.2 10
Jul  4 12:02:45 172.30.1.2 08
Jul  4 12:02:45 172.30.1.2 06
Jul  4 12:02:45 172.30.1.2 75
Jul  4 12:02:45 172.30.1.2 09
Jul  4 12:02:45 172.30.1.2 83
Jul  4 12:02:45 172.30.1.2 3d
Jul  4 12:02:45 172.30.1.2 f2
Jul  4 12:02:45 172.30.1.2 63
Jul  4 12:02:45 172.30.1.2 00
Jul  4 12:02:45 172.30.1.2 00
Jul  4 12:02:45 172.30.1.2 00
Jul  4 12:02:45 172.30.1.2 75
Jul  4 12:02:45 172.30.1.2 3c
Jul  4 12:02:45 172.30.1.2 f6>
Jul  4 12:02:45 172.30.1.2 42
Jul  4 12:02:45 172.30.1.2 18
Jul  4 12:02:45 172.30.1.2 01
Jul  4 12:02:45 172.30.1.2 48
Jul  4 12:02:45 172.30.1.2 8b
Jul  4 12:02:45 172.30.1.2 6a
Jul  4 12:02:45 172.30.1.2 08
Jul  4 12:02:45 172.30.1.2 74
Jul  4 12:02:45 172.30.1.2 10
Jul  4 12:02:45 172.30.1.2 8a
Jul  4 12:02:45 172.30.1.2 43
Jul  4 12:02:45 172.30.1.2 7d
Jul  4 12:02:45 172.30.1.2 83
Jul  4 12:02:45 172.30.1.2 e0
Jul  4 12:02:45 172.30.1.2 f8
Jul  4 12:02:45 172.30.1.2 83
Jul  4 12:02:45 172.30.1.2 c8
Jul  4 12:02:45 172.30.1.2 03
Jul  4 12:02:45 172.30.1.2 88
Jul  4 12:02:45 172.30.1.2 43
Jul  4 12:02:45 172.30.1.2 
Jul  4 12:02:45 172.30.1.2 [ 4920.563389] RIP 
Jul  4 12:02:45 172.30.1.2 [ 4920.577654]  RSP <ffff88042fc03960>
Jul  4 12:02:45 172.30.1.2 [ 4920.584619] CR2: 0000000000000018
Jul  4 12:02:45 172.30.1.2 [ 4920.592042] ---[ end trace 805a74073bda97f9 ]---
Jul  4 12:02:45 172.30.1.2 [ 4920.601505] Kernel panic - not syncing: Fatal exception in interrupt
Jul  4 12:02:45 172.30.1.2 [ 4920.614475] Pid: 0, comm: swapper/0 Tainted: G      D      3.2.21 #1
Jul  4 12:02:45 172.30.1.2 [ 4920.627702] Call Trace:
Jul  4 12:02:45 172.30.1.2 [ 4920.633035]  <IRQ> 
Jul  4 12:02:45 172.30.1.2 [ 4920.644916]  [<ffffffff81049da9>] ? kmsg_dump+0xb2/0xdd
Jul  4 12:02:45 172.30.1.2 [ 4920.655929]  [<ffffffff813653c1>] ? oops_end+0xa9/0xb6
Jul  4 12:02:45 172.30.1.2 [ 4920.666668]  [<ffffffff8102fcf9>] ? no_context+0x1ff/0x20c
Jul  4 12:02:45 172.30.1.2 [ 4920.678144]  [<ffffffff810f53c3>] ? virt_to_slab+0x9/0x3c
Jul  4 12:02:45 172.30.1.2 [ 4920.689436]  [<ffffffff81367534>] ? do_page_fault+0x1ad/0x34c
Jul  4 12:02:45 172.30.1.2 [ 4920.701419]  [<ffffffffa037fd93>] ? ip_vs_notrack+0x6e/0xa6 [ip_vs]
Jul  4 12:02:45 172.30.1.2 [ 4920.714461]  [<ffffffffa037edec>] ? ip_vs_conn_put+0x29/0x2f [ip_vs]
Jul  4 12:02:45 172.30.1.2 [ 4920.727675]  [<ffffffffa0380e1a>] ? ip_vs_out+0x33c/0x49d [ip_vs]
Jul  4 12:02:45 172.30.1.2 [ 4920.740372]  [<ffffffff81364ab5>] ? page_fault+0x25/0x30
Jul  4 12:02:45 172.30.1.2 [ 4920.751466]  [<ffffffffa018d9d0>] ? br_nf_forward_finish+0x48/0xc0 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.765898]  [<ffffffffa018dc91>] ? br_nf_forward_ip+0x214/0x231 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.779982]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 12:02:45 172.30.1.2 [ 4920.791169]  [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.803865]  [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.816556]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 12:02:45 172.30.1.2 [ 4920.828013]  [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.840706]  [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.852517]  [<ffffffffa0188a5a>] ? br_deliver+0x2d/0x2d [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.865188]  [<ffffffffa018896e>] ? T.963+0x3c/0x56 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.877086]  [<ffffffffa0187753>] ? __br_fdb_get+0x10/0x83 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.890132]  [<ffffffffa018961d>] ? br_handle_frame_finish+0x1a7/0x211 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.905258]  [<ffffffffa018e598>] ? br_nf_pre_routing_finish+0x222/0x22f [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.920749]  [<ffffffffa018d3b5>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.934195]  [<ffffffffa018e35b>] ? br_nf_pre_routing+0x4fc/0x517 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.948452]  [<ffffffff812c7de1>] ? nf_iterate+0x41/0x77
Jul  4 12:02:45 172.30.1.2 [ 4920.959567]  [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.971398]  [<ffffffff812c7f3a>] ? nf_hook_slow+0x68/0xfd
Jul  4 12:02:45 172.30.1.2 [ 4920.982865]  [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4920.994697]  [<ffffffffa0189476>] ? T.947+0x56/0x56 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4921.006530]  [<ffffffffa018945c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4921.018419]  [<ffffffffa018984a>] ? br_handle_frame+0x1c3/0x1d9 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4921.032318]  [<ffffffffa0189687>] ? br_handle_frame_finish+0x211/0x211 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4921.047475]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 12:02:45 172.30.1.2 [ 4921.060525]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jul  4 12:02:45 172.30.1.2 [ 4921.071137]  [<ffffffff812a799f>] ? netif_receive_skb+0x67/0x6d
Jul  4 12:02:45 172.30.1.2 [ 4921.083469]  [<ffffffff812a7f0b>] ? napi_gro_receive+0x1f/0x2d
Jul  4 12:02:45 172.30.1.2 [ 4921.095625]  [<ffffffff812a7a79>] ? napi_skb_finish+0x1c/0x31
Jul  4 12:02:45 172.30.1.2 [ 4921.107617]  [<ffffffffa0009a21>] ? bnx2_poll_work+0x8db/0x9f4 [bnx2]
Jul  4 12:02:45 172.30.1.2 [ 4921.120997]  [<ffffffffa00092f4>] ? bnx2_poll_work+0x1ae/0x9f4 [bnx2]
Jul  4 12:02:45 172.30.1.2 [ 4921.134376]  [<ffffffffa018945c>] ? T.947+0x3c/0x56 [bridge]
Jul  4 12:02:45 172.30.1.2 [ 4921.146099]  [<ffffffffa0009cfc>] ? bnx2_poll+0x116/0x1f2 [bnx2]
Jul  4 12:02:45 172.30.1.2 [ 4921.158667]  [<ffffffff812a74f2>] ? __netif_receive_skb+0x37a/0x490
Jul  4 12:02:45 172.30.1.2 [ 4921.171708]  [<ffffffff812a8038>] ? net_rx_action+0xa8/0x207
Jul  4 12:02:45 172.30.1.2 [ 4921.183521]  [<ffffffff8106637e>] ? hrtimer_get_next_event+0x7f/0x9a
Jul  4 12:02:45 172.30.1.2 [ 4921.196735]  [<ffffffff8104f11e>] ? __do_softirq+0xc4/0x1a0
Jul  4 12:02:45 172.30.1.2 [ 4921.208397]  [<ffffffff81097905>] ? handle_irq_event_percpu+0x166/0x184
Jul  4 12:02:45 172.30.1.2 [ 4921.222112]  [<ffffffff81013a01>] ? read_tsc+0x5/0x16
Jul  4 12:02:45 172.30.1.2 [ 4921.232737]  [<ffffffff8136bd6c>] ? call_softirq+0x1c/0x30
Jul  4 12:02:45 172.30.1.2 [ 4921.244138]  [<ffffffff8100fa3f>] ? do_softirq+0x3f/0x79
Jul  4 12:02:45 172.30.1.2 [ 4921.255184]  [<ffffffff8104eeee>] ? irq_exit+0x44/0xb5
Jul  4 12:02:45 172.30.1.2 [ 4921.265887]  [<ffffffff8100f38a>] ? do_IRQ+0x94/0xaa
Jul  4 12:02:45 172.30.1.2 [ 4921.276237]  [<ffffffff813647ee>] ? common_interrupt+0x6e/0x6e
Jul  4 12:02:45 172.30.1.2 [ 4921.288328]  <EOI> 
Jul  4 12:02:45 172.30.1.2 [ 4921.301304]  [<ffffffff811ffd96>] ? intel_idle+0xc0/0x117
Jul  4 12:02:45 172.30.1.2 [ 4921.312527]  [<ffffffff8128530e>] ? cpuidle_idle_call+0xf9/0x1af
Jul  4 12:02:45 172.30.1.2 [ 4921.324969]  [<ffffffff8100dde2>] ? cpu_idle+0xaf/0xef
Jul  4 12:02:45 172.30.1.2 [ 4921.335671]  [<ffffffff816aac3b>] ? start_kernel+0x3c2/0x3cd
Jul  4 12:02:45 172.30.1.2 [ 4921.347411]  [<ffffffff816aa3c8>] ? x86_64_start_kernel+0x102/0x10f

^ permalink raw reply	[flat|nested] 4+ messages in thread

* Re: Bridged networking panics
  2012-07-04 10:42 ` Massimo Cetra
@ 2012-07-04 13:24   ` Eric Dumazet
  2012-07-04 13:50     ` Massimo Cetra
  0 siblings, 1 reply; 4+ messages in thread
From: Eric Dumazet @ 2012-07-04 13:24 UTC (permalink / raw)
  To: Massimo Cetra; +Cc: netdev, linux-kernel

On Wed, 2012-07-04 at 12:42 +0200, Massimo Cetra wrote:

> Ok, waiting for an answer (sincerely i don't understand why no ones 
> cares for months) i'm attaching 3 more panics happened this morning on a 
> vanilla 3.2.21.
> 
> The problem is related to heavy network traffic.
> 
> I'm not a kernel hacker but I see that net_rx_action() is in the backtrace.
> So (probably reaching wrong conclusions) if those panics are triggered 
> by incoming network traffic, can an attacker use this to crash a machine ?
> 
> Anyone willing to reply or at least tell me what's going on ?

Posting a bug report is not enough to get people working for free on the
problem.

Apparently your configuration is kind of special if nobody but you hits
the problem so often.

So it would help if you can reproduce the bug using current kernel and
provide all necessary steps to reproduce the bug. Ideally a script.sh
file doing all the configuration you use to trigger the bug, assuming
a basic machine freshly booted with no special config already done.

The panics dont happen in the bridge code itself, but in the
BRIDGE_NETFILTER one. Do you need it, and why ?

Are you using vlans ?

Please try following patch

 net/bridge/br_netfilter.c |   20 +++++++++++++++-----
 1 file changed, 15 insertions(+), 5 deletions(-)

diff --git a/net/bridge/br_netfilter.c b/net/bridge/br_netfilter.c
index e41456b..a73a8cb 100644
--- a/net/bridge/br_netfilter.c
+++ b/net/bridge/br_netfilter.c
@@ -173,9 +173,13 @@ static inline struct rtable *bridge_parent_rtable(const struct net_device *dev)
 static inline struct net_device *bridge_parent(const struct net_device *dev)
 {
 	struct net_bridge_port *port;
+	struct net_device *parent;
 
 	port = br_port_get_rcu(dev);
-	return port ? port->br->dev : NULL;
+	parent = port ? port->br->dev : NULL;
+	if (parent && !(parent->flags & IFF_UP))
+		parent = NULL;
+	return parent;
 }
 
 static inline struct nf_bridge_info *nf_bridge_alloc(struct sk_buff *skb)
@@ -510,6 +514,8 @@ static struct net_device *brnf_get_logical_dev(struct sk_buff *skb, const struct
 	struct net_device *vlan, *br;
 
 	br = bridge_parent(dev);
+	if (!br)
+		return NULL;
 	if (brnf_pass_vlan_indev == 0 || !vlan_tx_tag_present(skb))
 		return br;
 
@@ -748,7 +754,7 @@ static unsigned int br_nf_forward_ip(unsigned int hook, struct sk_buff *skb,
 				     int (*okfn)(struct sk_buff *))
 {
 	struct nf_bridge_info *nf_bridge;
-	struct net_device *parent;
+	struct net_device *parent, *ldev;
 	u_int8_t pf;
 
 	if (!skb->nf_bridge)
@@ -789,8 +795,11 @@ static unsigned int br_nf_forward_ip(unsigned int hook, struct sk_buff *skb,
 	else
 		skb->protocol = htons(ETH_P_IPV6);
 
-	NF_HOOK(pf, NF_INET_FORWARD, skb, brnf_get_logical_dev(skb, in), parent,
-		br_nf_forward_finish);
+	ldev = brnf_get_logical_dev(skb, in);
+	if (!ldev)
+		return NF_DROP;
+
+	NF_HOOK(pf, NF_INET_FORWARD, skb, ldev, parent, br_nf_forward_finish);
 
 	return NF_STOLEN;
 }
@@ -861,12 +870,13 @@ static unsigned int br_nf_post_routing(unsigned int hook, struct sk_buff *skb,
 				       int (*okfn)(struct sk_buff *))
 {
 	struct nf_bridge_info *nf_bridge = skb->nf_bridge;
-	struct net_device *realoutdev = bridge_parent(skb->dev);
+	struct net_device *realoutdev;
 	u_int8_t pf;
 
 	if (!nf_bridge || !(nf_bridge->mask & BRNF_BRIDGED))
 		return NF_ACCEPT;
 
+	realoutdev = bridge_parent(skb->dev);
 	if (!realoutdev)
 		return NF_DROP;
 



^ permalink raw reply related	[flat|nested] 4+ messages in thread

* Re: Bridged networking panics
  2012-07-04 13:24   ` Eric Dumazet
@ 2012-07-04 13:50     ` Massimo Cetra
  0 siblings, 0 replies; 4+ messages in thread
From: Massimo Cetra @ 2012-07-04 13:50 UTC (permalink / raw)
  To: Eric Dumazet; +Cc: Massimo Cetra, netdev, linux-kernel

On 04/07/2012 15:24, Eric Dumazet wrote:

> Posting a bug report is not enough to get people working for free on the
> problem.

Thanks for the reply.

I'd like to point out that without a reply of what is need of what i'm 
doing wrong i cannot provide anything useful.

> Apparently your configuration is kind of special if nobody but you hits
> the problem so often.

> So it would help if you can reproduce the bug using current kernel and
> provide all necessary steps to reproduce the bug. Ideally a script.sh
> file doing all the configuration you use to trigger the bug, assuming
> a basic machine freshly booted with no special config already done.

I can try to setup a fresh KVM image and see if the bug is reproduceable 
there. Would it be ok ?

> The panics dont happen in the bridge code itself, but in the
> BRIDGE_NETFILTER one. Do you need it, and why ?
>
> Are you using vlans ?

No, no VLANS.

I have 2 real network cards (Broadcom Corporation NetXtreme II BCM5716) 
configured as bridges.

Each bridge (br0 and br1) has an ip address which is fixed (does never 
change).

The server(s) run KVM machines which are attached to tun interfaces 
(created with "vde_tunctl -u $user -t $IFACE)

Each virtual KVM server has an IP address that is forwarded through the 
bridge and has as gateway the router of the main server.

Up to this point there is nothing strange in the configuration and if 
the system is used this way, there are no panics.


The (maybe) peculiar configs are:

1) heartbeat is installed and creates alias interfaces for the bridge 
and assigns them an IP address. So the server has br0:1 and br1:1 that 
are associated with a couple of IP addresses.

2) the server runs ipvs (to redirect HTTP requests to two KVM servers 
that are natted behind the br0:1 br1:1 addresses).


IF i remove the br0:1 and br1:1 interfaces (that are configured with the 
ip addresses used by IPVS i don't have any single problem and the crash 
(at least with 3.2.21) doesn't happen.

So, if i turn off heartbeat (and the alias ip addresses used by IPVSare 
switched to the other host) there are no panics.

The more the traffic, the quicker the panic happens.

Note that up to 2.6.36 this configuration was working without problems.

Ah, the last setting that i modified is disabling tcp_sack in sysctl.conf.

> Please try following patch

I will try on the latest 3.2.y for now, trying to replicate the problem.

Thanks again,

MC

^ permalink raw reply	[flat|nested] 4+ messages in thread

end of thread, other threads:[~2012-07-04 13:56 UTC | newest]

Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2012-06-28 13:57 Bridged networking panics Massimo Cetra
2012-07-04 10:42 ` Massimo Cetra
2012-07-04 13:24   ` Eric Dumazet
2012-07-04 13:50     ` Massimo Cetra

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.