* Kernel panic with bridge networking
@ 2012-04-12 12:30 Massimo Cetra
2012-04-12 12:52 ` Eric Dumazet
0 siblings, 1 reply; 4+ messages in thread
From: Massimo Cetra @ 2012-04-12 12:30 UTC (permalink / raw)
To: netdev
[-- Attachment #1: Type: text/plain, Size: 729 bytes --]
Hello,
i am experiencing a panic whose logs are attached (grabbed with netconsole).
They look quite similar to what has been described here
http://www.spinics.net/lists/linux-net/msg17689.html
The patch proposed as the solution (commit
6b1e960fdbd75dcd9bcc3ba5ff8898ff1ad30b6e) seems to be applied (even with
small differences) but the problem persists.
The kernel is a debian linux-image-3.2.0-2-amd64 version 3.2.12-1
Any hint ?
I have checked the changelog of 3.2.13 and 3.2.14 and it doesn't seems
to be any commit regarding such problems.
Massimo Cetra
P.S.1: Please CC me as i'm not subscribed.
P.S.2: this bug has been submitted to debian as well
http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=668511
[-- Attachment #2: BUG1.txt --]
[-- Type: text/plain, Size: 25653 bytes --]
Apr 12 12:10:08 lamu [71020.539961] BUG: unable to handle kernel
Apr 12 12:10:08 NULL pointer dereference
Apr 12 12:10:08 lamu at 0000000000000018
Apr 12 12:10:08 lamu [71020.555654] IP:
Apr 12 12:10:08 lamu [<ffffffffa02e9336>] br_nf_forward_finish+0x2e/0x95 [bridge]
Apr 12 12:10:08 lamu [71020.569755] PGD 0
Apr 12 12:10:08 lamu
Apr 12 12:10:08 lamu [71020.573785] Oops: 0000 [#1]
Apr 12 12:10:08 SMP
Apr 12 12:10:08 lamu
Apr 12 12:10:08 lamu [71020.580257] CPU 0
Apr 12 12:10:08 lamu
Apr 12 12:10:08 lamu [71020.583912] Modules linked in:
Apr 12 12:10:08 lamu ipt_MASQUERADE
Apr 12 12:10:08 lamu iptable_nat
Apr 12 12:10:08 lamu nf_nat
Apr 12 12:10:08 lamu nf_conntrack_ipv4
Apr 12 12:10:08 lamu nf_defrag_ipv4
Apr 12 12:10:08 lamu ip_vs_rr
Apr 12 12:10:08 lamu ip_vs
Apr 12 12:10:08 lamu nf_conntrack
Apr 12 12:10:08 lamu libcrc32c
Apr 12 12:10:08 lamu ip6table_filter
Apr 12 12:10:08 lamu ip6_tables
Apr 12 12:10:08 lamu iptable_filter
Apr 12 12:10:08 lamu ip_tables
Apr 12 12:10:08 lamu ebtable_nat
Apr 12 12:10:08 lamu ebtables
Apr 12 12:10:08 lamu x_tables
Apr 12 12:10:08 lamu crc32c
Apr 12 12:10:08 lamu drbd
Apr 12 12:10:08 lamu lru_cache
Apr 12 12:10:08 lamu cn
Apr 12 12:10:08 lamu sit
Apr 12 12:10:08 lamu tunnel4
Apr 12 12:10:08 lamu tun
Apr 12 12:10:08 lamu bridge
Apr 12 12:10:08 lamu stp
Apr 12 12:10:08 lamu virtio_net
Apr 12 12:10:08 lamu virtio_blk
Apr 12 12:10:08 lamu virtio_rng
Apr 12 12:10:08 lamu rng_core
Apr 12 12:10:08 lamu virtio_pci
Apr 12 12:10:08 lamu virtio_ring
Apr 12 12:10:08 lamu virtio
Apr 12 12:10:08 lamu kvm_intel
Apr 12 12:10:08 lamu kvm
Apr 12 12:10:08 lamu ipmi_devintf
Apr 12 12:10:08 lamu ipmi_poweroff
Apr 12 12:10:08 lamu ipmi_si
Apr 12 12:10:08 lamu ipmi_watchdog
Apr 12 12:10:08 lamu ipmi_msghandler
Apr 12 12:10:08 lamu netconsole
Apr 12 12:10:08 lamu configfs
Apr 12 12:10:08 lamu loop
Apr 12 12:10:08 lamu option
Apr 12 12:10:08 lamu usb_wwan
Apr 12 12:10:08 lamu usbserial
Apr 12 12:10:08 lamu uas
Apr 12 12:10:08 lamu snd_pcm
Apr 12 12:10:08 lamu snd_page_alloc
Apr 12 12:10:08 lamu snd_timer
Apr 12 12:10:08 lamu snd
Apr 12 12:10:08 lamu iTCO_wdt
Apr 12 12:10:08 lamu iTCO_vendor_support
Apr 12 12:10:08 lamu psmouse
Apr 12 12:10:08 lamu i7core_edac
Apr 12 12:10:08 lamu edac_core
Apr 12 12:10:08 lamu processor
Apr 12 12:10:08 lamu button
Apr 12 12:10:08 lamu soundcore
Apr 12 12:10:08 lamu joydev
Apr 12 12:10:08 lamu serio_raw
Apr 12 12:10:08 lamu pcspkr
Apr 12 12:10:08 lamu evdev
Apr 12 12:10:08 lamu dcdbas
Apr 12 12:10:08 lamu thermal_sys
Apr 12 12:10:08 lamu ext3
Apr 12 12:10:08 lamu mbcache
Apr 12 12:10:08 lamu jbd
Apr 12 12:10:08 lamu dm_mod
Apr 12 12:10:08 lamu sr_mod
Apr 12 12:10:08 lamu cdrom
Apr 12 12:10:08 lamu ses
Apr 12 12:10:08 lamu sd_mod
Apr 12 12:10:08 lamu usbhid
Apr 12 12:10:08 lamu hid
Apr 12 12:10:08 lamu crc_t10dif
Apr 12 12:10:08 lamu enclosure
Apr 12 12:10:08 lamu ata_generic
Apr 12 12:10:08 lamu uhci_hcd
Apr 12 12:10:08 lamu ata_piix
Apr 12 12:10:08 lamu ehci_hcd
Apr 12 12:10:08 lamu libata
Apr 12 12:10:08 lamu usbcore
Apr 12 12:10:08 lamu megaraid_sas
Apr 12 12:10:08 lamu scsi_mod
Apr 12 12:10:08 lamu usb_common
Apr 12 12:10:08 lamu bnx2
Apr 12 12:10:08 lamu [last unloaded: usb_storage]
Apr 12 12:10:08 lamu
Apr 12 12:10:08 lamu [71020.733498]
Apr 12 12:10:08 lamu [71020.736475] Pid: 6997, comm: kvm Not tainted 3.2.0-2-amd64 #1
Apr 12 12:10:08 lamu Dell Inc. PowerEdge R410
Apr 12 12:10:08 lamu /0N051F
Apr 12 12:10:08 lamu
Apr 12 12:10:08 lamu [71020.753554] RIP: 0010:[<ffffffffa02e9336>]
Apr 12 12:10:08 lamu [<ffffffffa02e9336>] br_nf_forward_finish+0x2e/0x95 [bridge]
Apr 12 12:10:08 lamu [71020.772519] RSP: 0018:ffff88042fc03b18 EFLAGS: 00010293
Apr 12 12:10:08 lamu [71020.783126] RAX: 0000000000000000 RBX: ffff8802c3f911c0 RCX: 00000001010dee01
Apr 12 12:10:08 lamu [71020.797376] RDX: ffffffffa02e9308 RSI: 0000000000000282 RDI: ffff8802c3f911c0
Apr 12 12:10:08 lamu [71020.811629] RBP: ffff8802269c0000 R08: 0000000000000000 R09: ffff88042fc03ad0
Apr 12 12:10:08 lamu [71020.825878] R10: ffffffff8165aac0 R11: ffffffff8165aac0 R12: 0000000000000000
Apr 12 12:10:08 lamu [71020.840127] R13: ffff880424a40002 R14: ffff8802ca545c00 R15: ffff880424a40000
Apr 12 12:10:08 lamu [71020.854379] FS: 00007f7e7613d900(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000
Apr 12 12:10:08 lamu [71020.870553] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Apr 12 12:10:08 lamu [71020.882027] CR2: 0000000000000018 CR3: 00000003e0369000 CR4: 00000000000026e0
Apr 12 12:10:08 lamu [71020.896276] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Apr 12 12:10:08 lamu [71020.910527] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Apr 12 12:10:08 lamu [71020.924778] Process kvm (pid: 6997, threadinfo ffff8803d1f1e000, task ffff88042707c040)
Apr 12 12:10:08 lamu [71020.940776] Stack:
Apr 12 12:10:08 lamu [71020.944796] ffffffff80000000
Apr 12 12:10:08 lamu ffffffffa02e96db
Apr 12 12:10:08 lamu ffff8802c3f911c0
Apr 12 12:10:08 lamu ffff8802269c0000
Apr 12 12:10:08 lamu
Apr 12 12:10:08 lamu [71020.959629] ffff88022799c000
Apr 12 12:10:08 lamu ffffffffa02e9a67
Apr 12 12:10:08 lamu ffff880480000000
Apr 12 12:10:08 lamu 0000000280000000
Apr 12 12:10:08 lamu
Apr 12 12:10:08 lamu [71020.974464] ffff8802c3f911c0
Apr 12 12:10:08 lamu ffffffffa02efcd0
Apr 12 12:10:08 lamu ffffffff81691190
Apr 12 12:10:08 lamu 0000000000000002
Apr 12 12:10:08 lamu
Apr 12 12:10:08 lamu [71020.989299] Call Trace:
Apr 12 12:10:08 lamu [71020.994185] <IRQ>
Apr 12 12:10:08 lamu
Apr 12 12:10:08 lamu [71020.998394] [<ffffffffa02e96db>] ? br_parse_ip_options+0x3d/0x19a [bridge]
Apr 12 12:10:08 lamu [71021.012302] [<ffffffffa02e9a67>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge]
Apr 12 12:10:08 lamu [71021.025863] [<ffffffff812abe4d>] ? nf_iterate+0x41/0x77
Apr 12 12:10:08 lamu [71021.036474] [<ffffffffa02e4918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 12:10:08 lamu [71021.048994] [<ffffffffa02e4918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 12:10:08 lamu [71021.061510] [<ffffffff812abeeb>] ? nf_hook_slow+0x68/0x101
Apr 12 12:10:08 lamu [71021.072643] [<ffffffffa02e4918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 12:10:08 lamu [71021.085162] [<ffffffffa02e537a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 12:10:08 lamu [71021.098894] [<ffffffffa02e4918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 12:10:08 lamu [71021.111413] [<ffffffffa02e485e>] ? NF_HOOK.constprop.8+0x3c/0x56 [bridge]
Apr 12 12:10:08 lamu [71021.125144] [<ffffffffa02e49f2>] ? br_forward+0x16/0x5a [bridge]
Apr 12 12:10:08 lamu [71021.137318] [<ffffffffa02e551b>] ? br_handle_frame_finish+0x1a1/0x20f [bridge]
Apr 12 12:10:08 lamu [71021.151934] [<ffffffffa02e95ff>] ? br_nf_pre_routing_finish+0x1d0/0x1dd [bridge]
Apr 12 12:10:08 lamu [71021.166896] [<ffffffffa02e8ff0>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Apr 12 12:10:08 lamu [71021.179764] [<ffffffffa02e9f58>] ? br_nf_pre_routing+0x3e8/0x3f5 [bridge]
Apr 12 12:10:08 lamu [71021.193495] [<ffffffff812abe4d>] ? nf_iterate+0x41/0x77
Apr 12 12:10:08 lamu [71021.204106] [<ffffffffa02e537a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 12:10:08 lamu [71021.217837] [<ffffffff812abeeb>] ? nf_hook_slow+0x68/0x101
Apr 12 12:10:08 lamu [71021.228967] [<ffffffffa02e537a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 12:10:08 lamu [71021.242700] [<ffffffffa02e537a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 12:10:08 lamu [71021.256433] [<ffffffffa02e5360>] ? NF_HOOK.constprop.4+0x3c/0x56 [bridge]
Apr 12 12:10:08 lamu [71021.270165] [<ffffffff810135ad>] ? paravirt_read_tsc+0x5/0x8
Apr 12 12:10:08 lamu [71021.281642] [<ffffffff81013622>] ? read_tsc+0x5/0x14
Apr 12 12:10:08 lamu [71021.291733] [<ffffffffa02e573c>] ? br_handle_frame+0x1b3/0x1cb [bridge]
Apr 12 12:10:08 lamu [71021.305120] [<ffffffffa02e5589>] ? br_handle_frame_finish+0x20f/0x20f [bridge]
Apr 12 12:10:08 lamu [71021.319736] [<ffffffff812890cd>] ? __netif_receive_skb+0x324/0x41f
Apr 12 12:10:08 lamu [71021.332251] [<ffffffff81289234>] ? process_backlog+0x6c/0x123
Apr 12 12:10:08 lamu [71021.343901] [<ffffffff8128b11a>] ? net_rx_action+0xa1/0x1af
Apr 12 12:10:08 lamu [71021.355206] [<ffffffff81037013>] ? test_tsk_need_resched+0xa/0x13
Apr 12 12:10:08 lamu [71021.367552] [<ffffffff8104be98>] ? __do_softirq+0xb9/0x177
Apr 12 12:10:08 lamu [71021.378685] [<ffffffff8135026c>] ? call_softirq+0x1c/0x30
Apr 12 12:10:08 lamu [71021.389640] <EOI>
Apr 12 12:10:08 lamu
Apr 12 12:10:08 lamu [71021.393845] [<ffffffff8100f8e5>] ? do_softirq+0x3c/0x7b
Apr 12 12:10:08 lamu [71021.404454] [<ffffffff8128b40a>] ? netif_rx_ni+0x1e/0x27
Apr 12 12:10:08 lamu [71021.415239] [<ffffffffa02f6721>] ? tun_get_user+0x39a/0x3c2 [tun]
Apr 12 12:10:09 lamu [71021.427583] [<ffffffffa02f6a66>] ? tun_chr_poll+0xcd/0xcd [tun]
Apr 12 12:10:09 lamu [71021.439579] [<ffffffffa02f6ac4>] ? tun_chr_aio_write+0x5e/0x79 [tun]
Apr 12 12:10:09 lamu [71021.452445] [<ffffffff810f95d4>] ? do_sync_readv_writev+0x9a/0xd7
Apr 12 12:10:09 lamu [71021.464788] [<ffffffff8103642f>] ? should_resched+0x5/0x23
Apr 12 12:10:09 lamu [71021.475917] [<ffffffff810f8c56>] ? do_sync_read+0xab/0xe3
Apr 12 12:10:09 lamu [71021.486875] [<ffffffff81061a94>] ? enqueue_hrtimer+0x43/0x6a
Apr 12 12:10:09 lamu [71021.498350] [<ffffffff8103642f>] ? should_resched+0x5/0x23
Apr 12 12:10:09 lamu [71021.509483] [<ffffffff81162569>] ? security_file_permission+0x16/0x2d
Apr 12 12:10:09 lamu [71021.522520] [<ffffffff810f9838>] ? do_readv_writev+0xaf/0x11c
Apr 12 12:10:09 lamu [71021.534173] [<ffffffff8112abb6>] ? eventfd_ctx_read+0x162/0x174
Apr 12 12:10:09 lamu [71021.546174] [<ffffffff8103f467>] ? try_to_wake_up+0x197/0x197
Apr 12 12:10:09 lamu [71021.557825] [<ffffffff810f9a0d>] ? sys_writev+0x45/0x90
Apr 12 12:10:09 lamu [71021.568437] [<ffffffff8134e012>] ? system_call_fastpath+0x16/0x1b
Apr 12 12:10:09 lamu [71021.580778] Code:
Apr 12 12:10:09 53
Apr 12 12:10:09 48
Apr 12 12:10:09 89
Apr 12 12:10:09 fb
Apr 12 12:10:09 48
Apr 12 12:10:09 83
Apr 12 12:10:09 ec
Apr 12 12:10:09 10
Apr 12 12:10:09 66
Apr 12 12:10:09 81
Apr 12 12:10:09 7f
Apr 12 12:10:09 7e
Apr 12 12:10:09 08
Apr 12 12:10:09 06
Apr 12 12:10:09 4c
Apr 12 12:10:09 8b
Apr 12 12:10:09 a7
Apr 12 12:10:09 98
Apr 12 12:10:09 00
Apr 12 12:10:09 00
Apr 12 12:10:09 00
Apr 12 12:10:09 74
Apr 12 12:10:09 3d
Apr 12 12:10:09 e8
Apr 12 12:10:09 07
Apr 12 12:10:09 fe
Apr 12 12:10:09 ff
Apr 12 12:10:09 ff
Apr 12 12:10:09 66
Apr 12 12:10:09 3d
Apr 12 12:10:09 08
Apr 12 12:10:09 06
Apr 12 12:10:09 75
Apr 12 12:10:09 09
Apr 12 12:10:09 83
Apr 12 12:10:09 3d
Apr 12 12:10:09 98
Apr 12 12:10:09 6a
Apr 12 12:10:09 00
Apr 12 12:10:09 00
Apr 12 12:10:09 00
Apr 12 12:10:09 75
Apr 12 12:10:09 29
Apr 12 12:10:09 lamu
Apr 12 12:10:09 f6
Apr 12 12:10:09 44
Apr 12 12:10:09 24
Apr 12 12:10:09 18
Apr 12 12:10:09 lamu
Apr 12 12:10:09 lamu [71021.610392] ------------[ cut here ]------------
Apr 12 12:10:09 lamu [71021.610395] WARNING: at /build/buildd-linux-2.6_3.2.12-1-amd64-FiPNYf/linux-2.6-3.2.12/debian/build/source_amd64_none/kernel/softirq.c:159 _local_bh_enable_ip.isra.11+0x3d/0x88()
Apr 12 12:10:09 lamu [71021.610398] Hardware name: PowerEdge R410
Apr 12 12:10:09 lamu [71021.610399] Modules linked in: ipt_MASQUERADE iptable_nat nf_nat nf_conntrack_ipv4 nf_defrag_ipv4 ip_vs_rr ip_vs nf_conntrack libcrc32c ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_tables crc32c drbd lru_cache cn sit tunnel4 tun bridge stp virtio_net virtio_blk virtio_rng rng_core virtio_pci virtio_ring virtio kvm_intel kvm ipmi_devintf ipmi_poweroff ipmi_si ipmi_watchdog ipmi_msghandler netconsole configfs loop option usb_wwan usbserial uas snd_pcm snd_page_alloc snd_timer snd iTCO_wdt iTCO_vendor_support psmouse i7core_edac edac_core processor button soundcore joydev serio_raw pcspkr evdev dcdbas thermal_sys ext3 mbcache jbd dm_mod sr_mod cdrom ses sd_mod usbhid hid crc_t10dif enclosure ata_generic uhci_hcd ata_piix ehci_hcd libata usbcore megaraid_sas scsi_mod usb_common bnx2 [last unloaded: usb_storage]
Apr 12 12:10:09 lamu [71021.610438] Pid: 6997, comm: kvm Not tainted 3.2.0-2-amd64 #1
Apr 12 12:10:09 lamu [71021.610439] Call Trace:
Apr 12 12:10:09 lamu [71021.610440] <IRQ> [<ffffffff81046879>] ? warn_slowpath_common+0x78/0x8c
Apr 12 12:10:09 lamu [71021.610447] [<ffffffff8104bd8a>] ? _local_bh_enable_ip.isra.11+0x3d/0x88
Apr 12 12:10:09 lamu [71021.610454] [<ffffffffa003d748>] ? bnx2_reg_rd_ind+0x31/0x38 [bnx2]
Apr 12 12:10:09 lamu [71021.610460] [<ffffffffa00467d7>] ? bnx2_poll+0x1b7/0x1c4 [bnx2]
Apr 12 12:10:09 lamu [71021.610466] [<ffffffff8129af69>] ? netpoll_poll_dev.part.16+0x9b/0x499
Apr 12 12:10:09 lamu [71021.610475] [<ffffffffa02e331a>] ? br_dev_xmit+0x12e/0x142 [bridge]
Apr 12 12:10:09 lamu [71021.610478] [<ffffffff8129b432>] ? netpoll_send_skb_on_dev+0xcb/0x201
Apr 12 12:10:09 lamu [71021.610483] [<ffffffffa021325c>] ? write_msg+0x98/0xf3 [netconsole]
Apr 12 12:10:09 lamu [71021.610487] [<ffffffff810469c2>] ? __call_console_drivers+0x72/0x83
Apr 12 12:10:09 lamu [71021.610490] [<ffffffff8104708e>] ? console_unlock+0x144/0x1e8
Apr 12 12:10:09 lamu [71021.610493] [<ffffffff810475b1>] ? vprintk+0x396/0x3d9
Apr 12 12:10:09 lamu [71021.610499] [<ffffffffa02e933b>] ? br_nf_forward_finish+0x33/0x95 [bridge]
Apr 12 12:10:09 lamu [71021.610504] [<ffffffffa02e930b>] ? br_nf_forward_finish+0x3/0x95 [bridge]
Apr 12 12:10:09 lamu [71021.610510] [<ffffffff81342a83>] ? printk+0x43/0x48
Apr 12 12:10:09 lamu [71021.610513] [<ffffffff8100fe6a>] ? show_registers+0x1de/0x20a
Apr 12 12:10:09 lamu [71021.610517] [<ffffffff81349f1e>] ? __die+0x8b/0xc8
Apr 12 12:10:09 lamu [71021.610520] [<ffffffff81342253>] ? no_context+0x1d6/0x20e
Apr 12 12:10:09 lamu [71021.610523] [<ffffffff810522ca>] ? __mod_timer+0x139/0x14b
Apr 12 12:10:09 lamu [71021.610526] [<ffffffff8134be99>] ? do_page_fault+0x1a8/0x337
Apr 12 12:10:09 lamu [71021.610531] [<ffffffffa03bef06>] ? ip_vs_conn_put+0x28/0x32 [ip_vs]
Apr 12 12:10:09 lamu [71021.610536] [<ffffffffa03c10e0>] ? ip_vs_out+0x2bd/0x432 [ip_vs]
Apr 12 12:10:09 lamu [71021.610539] [<ffffffff8128beef>] ? dev_hard_start_xmit+0x3fc/0x543
Apr 12 12:10:09 lamu [71021.610542] [<ffffffff813495f5>] ? page_fault+0x25/0x30
Apr 12 12:10:09 lamu [71021.610548] [<ffffffffa02e9308>] ? nf_bridge_update_protocol+0x20/0x20 [bridge]
Apr 12 12:10:09 lamu [71021.610554] [<ffffffffa02e9336>] ? br_nf_forward_finish+0x2e/0x95 [bridge]
Apr 12 12:10:09 lamu [71021.610559] [<ffffffffa02e9327>] ? br_nf_forward_finish+0x1f/0x95 [bridge]
Apr 12 12:10:09 lamu [71021.610565] [<ffffffffa02e96db>] ? br_parse_ip_options+0x3d/0x19a [bridge]
Apr 12 12:10:09 lamu [71021.610570] [<ffffffffa02e9a67>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge]
Apr 12 12:10:09 lamu [71021.610573] [<ffffffff812abe4d>] ? nf_iterate+0x41/0x77
Apr 12 12:10:09 lamu [71021.610578] [<ffffffffa02e4918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 12:10:09 lamu [71021.610582] [<ffffffffa02e4918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 12:10:09 lamu [71021.610585] [<ffffffff812abeeb>] ? nf_hook_slow+0x68/0x101
Apr 12 12:10:09 lamu [71021.610590] [<ffffffffa02e4918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 12:10:09 lamu [71021.610595] [<ffffffffa02e537a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 12:10:09 lamu [71021.610599] [<ffffffffa02e4918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 12:10:09 lamu [71021.610604] [<ffffffffa02e485e>] ? NF_HOOK.constprop.8+0x3c/0x56 [bridge]
Apr 12 12:10:09 lamu [71021.610608] [<ffffffffa02e49f2>] ? br_forward+0x16/0x5a [bridge]
Apr 12 12:10:09 lamu [71021.610613] [<ffffffffa02e551b>] ? br_handle_frame_finish+0x1a1/0x20f [bridge]
Apr 12 12:10:09 lamu [71021.610619] [<ffffffffa02e95ff>] ? br_nf_pre_routing_finish+0x1d0/0x1dd [bridge]
Apr 12 12:10:09 lamu [71021.610624] [<ffffffffa02e8ff0>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Apr 12 12:10:09 lamu [71021.610630] [<ffffffffa02e9f58>] ? br_nf_pre_routing+0x3e8/0x3f5 [bridge]
Apr 12 12:10:09 lamu [71021.610633] [<ffffffff812abe4d>] ? nf_iterate+0x41/0x77
Apr 12 12:10:09 lamu [71021.610638] [<ffffffffa02e537a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 12:10:09 lamu [71021.610641] [<ffffffff812abeeb>] ? nf_hook_slow+0x68/0x101
Apr 12 12:10:09 lamu [71021.610646] [<ffffffffa02e537a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 12:10:09 lamu [71021.610651] [<ffffffffa02e537a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 12:10:09 lamu [71021.610656] [<ffffffffa02e5360>] ? NF_HOOK.constprop.4+0x3c/0x56 [bridge]
Apr 12 12:10:10 lamu [71021.610659] [<ffffffff810135ad>] ? paravirt_read_tsc+0x5/0x8
Apr 12 12:10:10 lamu [71021.610661] [<ffffffff81013622>] ? read_tsc+0x5/0x14
Apr 12 12:10:10 lamu [71021.610666] [<ffffffffa02e573c>] ? br_handle_frame+0x1b3/0x1cb [bridge]
Apr 12 12:10:10 lamu [71021.610671] [<ffffffffa02e5589>] ? br_handle_frame_finish+0x20f/0x20f [bridge]
Apr 12 12:10:10 lamu [71021.610674] [<ffffffff812890cd>] ? __netif_receive_skb+0x324/0x41f
Apr 12 12:10:10 lamu [71021.610677] [<ffffffff81289234>] ? process_backlog+0x6c/0x123
Apr 12 12:10:10 lamu [71021.610681] [<ffffffff8128b11a>] ? net_rx_action+0xa1/0x1af
Apr 12 12:10:10 lamu [71021.610683] [<ffffffff81037013>] ? test_tsk_need_resched+0xa/0x13
Apr 12 12:10:10 lamu [71021.610686] [<ffffffff8104be98>] ? __do_softirq+0xb9/0x177
Apr 12 12:10:10 lamu [71021.610689] [<ffffffff8135026c>] ? call_softirq+0x1c/0x30
Apr 12 12:10:10 lamu [71021.610691] <EOI> [<ffffffff8100f8e5>] ? do_softirq+0x3c/0x7b
Apr 12 12:10:10 lamu [71021.610696] [<ffffffff8128b40a>] ? netif_rx_ni+0x1e/0x27
Apr 12 12:10:10 lamu [71021.610699] [<ffffffffa02f6721>] ? tun_get_user+0x39a/0x3c2 [tun]
Apr 12 12:10:10 lamu [71021.610703] [<ffffffffa02f6a66>] ? tun_chr_poll+0xcd/0xcd [tun]
Apr 12 12:10:10 lamu [71021.610707] [<ffffffffa02f6ac4>] ? tun_chr_aio_write+0x5e/0x79 [tun]
Apr 12 12:10:10 lamu [71021.610710] [<ffffffff810f95d4>] ? do_sync_readv_writev+0x9a/0xd7
Apr 12 12:10:10 lamu [71021.610712] [<ffffffff8103642f>] ? should_resched+0x5/0x23
Apr 12 12:10:10 lamu [71021.610715] [<ffffffff810f8c56>] ? do_sync_read+0xab/0xe3
Apr 12 12:10:10 lamu [71021.610718] [<ffffffff81061a94>] ? enqueue_hrtimer+0x43/0x6a
Apr 12 12:10:10 lamu [71021.610720] [<ffffffff8103642f>] ? should_resched+0x5/0x23
Apr 12 12:10:10 lamu [71021.610723] [<ffffffff81162569>] ? security_file_permission+0x16/0x2d
Apr 12 12:10:10 lamu [71021.610726] [<ffffffff810f9838>] ? do_readv_writev+0xaf/0x11c
Apr 12 12:10:10 lamu [71021.610729] [<ffffffff8112abb6>] ? eventfd_ctx_read+0x162/0x174
Apr 12 12:10:10 lamu [71021.610732] [<ffffffff8103f467>] ? try_to_wake_up+0x197/0x197
Apr 12 12:10:10 lamu [71021.610735] [<ffffffff810f9a0d>] ? sys_writev+0x45/0x90
Apr 12 12:10:10 lamu [71021.610738] [<ffffffff8134e012>] ? system_call_fastpath+0x16/0x1b
Apr 12 12:10:10 lamu [71021.610740] ---[ end trace 8375ccada030e5cf ]---
Apr 12 12:10:10 lamu [71022.752807] 01
Apr 12 12:10:10 49
Apr 12 12:10:10 8b
Apr 12 12:10:10 6c
Apr 12 12:10:10 24
Apr 12 12:10:10 08
Apr 12 12:10:10 74
Apr 12 12:10:10 12
Apr 12 12:10:10 8a
Apr 12 12:10:10 43
Apr 12 12:10:10 7d
Apr 12 12:10:10 83
Apr 12 12:10:10 e0
Apr 12 12:10:10 f8
Apr 12 12:10:10 83
Apr 12 12:10:10 c8
Apr 12 12:10:10 lamu
Apr 12 12:10:10 lamu [71022.764300] RIP
Apr 12 12:10:10 lamu [<ffffffffa02e9336>] br_nf_forward_finish+0x2e/0x95 [bridge]
Apr 12 12:10:10 lamu [71022.778567] RSP <ffff88042fc03b18>
Apr 12 12:10:10 lamu [71022.785531] CR2: 0000000000000018
Apr 12 12:10:10 lamu [71022.792904] ---[ end trace 8375ccada030e5d0 ]---
Apr 12 12:10:10 lamu [71022.802344] Kernel panic - not syncing: Fatal exception in interrupt
Apr 12 12:10:10 lamu [71022.815396] Pid: 6997, comm: kvm Tainted: G D W 3.2.0-2-amd64 #1
Apr 12 12:10:10 lamu [71022.829110] Call Trace:
Apr 12 12:10:10 lamu [71022.834258] <IRQ>
Apr 12 12:10:10 lamu [<ffffffff81342930>] ? panic+0x95/0x1a5
Apr 12 12:10:10 lamu [71022.845768] [<ffffffff81349e86>] ? oops_end+0xa9/0xb6
Apr 12 12:10:10 lamu [71022.856213] [<ffffffff8134227c>] ? no_context+0x1ff/0x20e
Apr 12 12:10:10 lamu [71022.867373] [<ffffffff810522ca>] ? __mod_timer+0x139/0x14b
Apr 12 12:10:10 lamu [71022.878693] [<ffffffff8134be99>] ? do_page_fault+0x1a8/0x337
Apr 12 12:10:10 lamu [71022.890360] [<ffffffffa03bef06>] ? ip_vs_conn_put+0x28/0x32 [ip_vs]
Apr 12 12:10:10 lamu [71022.903203] [<ffffffffa03c10e0>] ? ip_vs_out+0x2bd/0x432 [ip_vs]
Apr 12 12:10:10 lamu [71022.915544] [<ffffffff8128beef>] ? dev_hard_start_xmit+0x3fc/0x543
Apr 12 12:10:10 lamu [71022.928295] [<ffffffff813495f5>] ? page_fault+0x25/0x30
Apr 12 12:10:10 lamu [71022.939318] [<ffffffffa02e9308>] ? nf_bridge_update_protocol+0x20/0x20 [bridge]
Apr 12 12:10:10 lamu [71022.954340] [<ffffffffa02e9336>] ? br_nf_forward_finish+0x2e/0x95 [bridge]
Apr 12 12:10:10 lamu [71022.968527] [<ffffffffa02e9327>] ? br_nf_forward_finish+0x1f/0x95 [bridge]
Apr 12 12:10:10 lamu [71022.982717] [<ffffffffa02e96db>] ? br_parse_ip_options+0x3d/0x19a [bridge]
Apr 12 12:10:10 lamu [71022.996993] [<ffffffffa02e9a67>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge]
Apr 12 12:10:10 lamu [71023.010841] [<ffffffff812abe4d>] ? nf_iterate+0x41/0x77
Apr 12 12:10:10 lamu [71023.021812] [<ffffffffa02e4918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 12:10:10 lamu [71023.034570] [<ffffffffa02e4918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 12:10:10 lamu [71023.047401] [<ffffffff812abeeb>] ? nf_hook_slow+0x68/0x101
Apr 12 12:10:10 lamu [71023.058757] [<ffffffffa02e4918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 12:10:10 lamu [71023.071501] [<ffffffffa02e537a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 12:10:10 lamu [71023.085667] [<ffffffffa02e4918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 12:10:10 lamu [71023.098483] [<ffffffffa02e485e>] ? NF_HOOK.constprop.8+0x3c/0x56 [bridge]
Apr 12 12:10:10 lamu [71023.112500] [<ffffffffa02e49f2>] ? br_forward+0x16/0x5a [bridge]
Apr 12 12:10:10 lamu [71023.124825] [<ffffffffa02e551b>] ? br_handle_frame_finish+0x1a1/0x20f [bridge]
Apr 12 12:10:10 lamu [71023.139763] [<ffffffffa02e95ff>] ? br_nf_pre_routing_finish+0x1d0/0x1dd [bridge]
Apr 12 12:10:10 lamu [71023.154965] [<ffffffffa02e8ff0>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Apr 12 12:10:10 lamu [71023.168151] [<ffffffffa02e9f58>] ? br_nf_pre_routing+0x3e8/0x3f5 [bridge]
Apr 12 12:10:10 lamu [71023.182191] [<ffffffff812abe4d>] ? nf_iterate+0x41/0x77
Apr 12 12:10:10 lamu [71023.193200] [<ffffffffa02e537a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 12:10:10 lamu [71023.207169] [<ffffffff812abeeb>] ? nf_hook_slow+0x68/0x101
Apr 12 12:10:10 lamu [71023.218614] [<ffffffffa02e537a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 12:10:10 lamu [71023.232581] [<ffffffffa02e537a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 12:10:10 lamu [71023.246548] [<ffffffffa02e5360>] ? NF_HOOK.constprop.4+0x3c/0x56 [bridge]
Apr 12 12:10:10 lamu [71023.260552] [<ffffffff810135ad>] ? paravirt_read_tsc+0x5/0x8
Apr 12 12:10:10 lamu [71023.272274] [<ffffffff81013622>] ? read_tsc+0x5/0x14
Apr 12 12:10:10 lamu [71023.282710] [<ffffffffa02e573c>] ? br_handle_frame+0x1b3/0x1cb [bridge]
Apr 12 12:10:10 lamu [71023.296308] [<ffffffffa02e5589>] ? br_handle_frame_finish+0x20f/0x20f [bridge]
Apr 12 12:10:10 lamu [71023.296338] block drbd4: PingAck did not arrive in time.
Apr 12 12:10:10 lamu [71023.296347] block drbd4: peer( Secondary -> Unknown ) conn( Connected -> NetworkFailure ) pdsk( UpToDate -> DUnknown )
Apr 12 12:10:10 lamu [71023.343474] [<ffffffff812890cd>] ? __netif_receive_skb+0x324/0x41f
Apr 12 12:10:10 lamu [71023.356221] [<ffffffff81289234>] ? process_backlog+0x6c/0x123
Apr 12 12:10:10 lamu [71023.368057] [<ffffffff8128b11a>] ? net_rx_action+0xa1/0x1af
Apr 12 12:10:10 lamu [71023.379483] [<ffffffff81037013>] ? test_tsk_need_resched+0xa/0x13
Apr 12 12:10:10 lamu [71023.391998] [<ffffffff8104be98>] ? __do_softirq+0xb9/0x177
Apr 12 12:10:10 lamu [71023.403332] [<ffffffff8135026c>] ? call_softirq+0x1c/0x30
Apr 12 12:10:10 lamu [71023.414444] <EOI>
Apr 12 12:10:10 lamu [<ffffffff8100f8e5>] ? do_softirq+0x3c/0x7b
Apr 12 12:10:11 lamu [71023.426647] [<ffffffff8128b40a>] ? netif_rx_ni+0x1e/0x27
Apr 12 12:10:11 lamu [71023.437640] [<ffffffffa02f6721>] ? tun_get_user+0x39a/0x3c2 [tun]
Apr 12 12:10:11 lamu [71023.450264] [<ffffffffa02f6a66>] ? tun_chr_poll+0xcd/0xcd [tun]
Apr 12 12:10:11 lamu [71023.462501] [<ffffffffa02f6ac4>] ? tun_chr_aio_write+0x5e/0x79 [tun]
Apr 12 12:10:11 lamu [71023.475526] [<ffffffff810f95d4>] ? do_sync_readv_writev+0x9a/0xd7
Apr 12 12:10:11 lamu [71023.488074] [<ffffffff8103642f>] ? should_resched+0x5/0x23
Apr 12 12:10:11 lamu [71023.499357] [<ffffffff810f8c56>] ? do_sync_read+0xab/0xe3
Apr 12 12:10:11 lamu [71023.510429] [<ffffffff81061a94>] ? enqueue_hrtimer+0x43/0x6a
Apr 12 12:10:11 lamu [71023.522066] [<ffffffff8103642f>] ? should_resched+0x5/0x23
Apr 12 12:10:11 lamu [71023.533310] [<ffffffff81162569>] ? security_file_permission+0x16/0x2d
Apr 12 12:10:11 lamu [71023.546463] [<ffffffff810f9838>] ? do_readv_writev+0xaf/0x11c
Apr 12 12:10:11 lamu [71023.558352] [<ffffffff8112abb6>] ? eventfd_ctx_read+0x162/0x174
Apr 12 12:10:11 lamu [71023.570467] [<ffffffff8103f467>] ? try_to_wake_up+0x197/0x197
Apr 12 12:10:11 lamu [71023.582316] [<ffffffff810f9a0d>] ? sys_writev+0x45/0x90
Apr 12 12:10:11 lamu [71023.593177] [<ffffffff8134e012>] ? system_call_fastpath+0x16/0x1b
[-- Attachment #3: BUG2.txt --]
[-- Type: text/plain, Size: 17365 bytes --]
Apr 12 13:22:05 lamu [ 4116.902924] BUG: unable to handle kernel
Apr 12 13:22:05 NULL pointer dereference
Apr 12 13:22:05 lamu at 0000000000000018
Apr 12 13:22:05 lamu [ 4116.918581] IP:
Apr 12 13:22:05 lamu [<ffffffffa02d2336>] br_nf_forward_finish+0x2e/0x95 [bridge]
Apr 12 13:22:05 lamu [ 4116.932666] PGD 0
Apr 12 13:22:05 lamu
Apr 12 13:22:05 lamu [ 4116.936681] Oops: 0000 [#1]
Apr 12 13:22:05 SMP
Apr 12 13:22:05 lamu
Apr 12 13:22:05 lamu [ 4116.943136] CPU 0
Apr 12 13:22:05 lamu
Apr 12 13:22:05 lamu [ 4116.946792] Modules linked in:
Apr 12 13:22:05 lamu option
Apr 12 13:22:05 lamu usb_wwan
Apr 12 13:22:05 lamu usbserial
Apr 12 13:22:05 lamu usb_storage
Apr 12 13:22:05 lamu uas
Apr 12 13:22:05 lamu ipt_MASQUERADE
Apr 12 13:22:05 lamu iptable_nat
Apr 12 13:22:05 lamu nf_nat
Apr 12 13:22:05 lamu nf_conntrack_ipv4
Apr 12 13:22:05 lamu nf_defrag_ipv4
Apr 12 13:22:05 lamu ip_vs_rr
Apr 12 13:22:05 lamu ip_vs
Apr 12 13:22:05 lamu nf_conntrack
Apr 12 13:22:05 lamu libcrc32c
Apr 12 13:22:05 lamu ip6table_filter
Apr 12 13:22:05 lamu ip6_tables
Apr 12 13:22:05 lamu iptable_filter
Apr 12 13:22:05 lamu ip_tables
Apr 12 13:22:05 lamu ebtable_nat
Apr 12 13:22:05 lamu ebtables
Apr 12 13:22:05 lamu x_tables
Apr 12 13:22:05 lamu crc32c
Apr 12 13:22:05 lamu drbd
Apr 12 13:22:05 lamu lru_cache
Apr 12 13:22:05 lamu cn
Apr 12 13:22:05 lamu sit
Apr 12 13:22:05 lamu tunnel4
Apr 12 13:22:05 lamu tun
Apr 12 13:22:05 lamu bridge
Apr 12 13:22:05 lamu stp
Apr 12 13:22:05 lamu virtio_net
Apr 12 13:22:05 lamu virtio_blk
Apr 12 13:22:05 lamu virtio_rng
Apr 12 13:22:05 lamu rng_core
Apr 12 13:22:05 lamu virtio_pci
Apr 12 13:22:05 lamu virtio_ring
Apr 12 13:22:05 lamu virtio
Apr 12 13:22:05 lamu kvm_intel
Apr 12 13:22:05 lamu kvm
Apr 12 13:22:05 lamu ipmi_devintf
Apr 12 13:22:05 lamu ipmi_poweroff
Apr 12 13:22:05 lamu ipmi_si
Apr 12 13:22:05 lamu ipmi_watchdog
Apr 12 13:22:05 lamu ipmi_msghandler
Apr 12 13:22:05 lamu netconsole
Apr 12 13:22:05 lamu configfs
Apr 12 13:22:05 lamu loop
Apr 12 13:22:05 lamu snd_pcm
Apr 12 13:22:05 lamu snd_page_alloc
Apr 12 13:22:05 lamu iTCO_wdt
Apr 12 13:22:05 lamu snd_timer
Apr 12 13:22:05 lamu snd
Apr 12 13:22:05 lamu processor
Apr 12 13:22:05 lamu button
Apr 12 13:22:05 lamu iTCO_vendor_support
Apr 12 13:22:05 lamu joydev
Apr 12 13:22:05 lamu i7core_edac
Apr 12 13:22:05 lamu edac_core
Apr 12 13:22:05 lamu soundcore
Apr 12 13:22:05 lamu pcspkr
Apr 12 13:22:05 lamu psmouse
Apr 12 13:22:05 lamu serio_raw
Apr 12 13:22:05 lamu evdev
Apr 12 13:22:05 lamu thermal_sys
Apr 12 13:22:05 lamu dcdbas
Apr 12 13:22:05 lamu ext3
Apr 12 13:22:05 lamu mbcache
Apr 12 13:22:05 lamu jbd
Apr 12 13:22:05 lamu dm_mod
Apr 12 13:22:05 lamu sr_mod
Apr 12 13:22:05 lamu cdrom
Apr 12 13:22:05 lamu sd_mod
Apr 12 13:22:05 lamu ses
Apr 12 13:22:05 lamu usbhid
Apr 12 13:22:05 lamu hid
Apr 12 13:22:05 lamu enclosure
Apr 12 13:22:05 lamu crc_t10dif
Apr 12 13:22:05 lamu ata_generic
Apr 12 13:22:05 lamu ata_piix
Apr 12 13:22:05 lamu uhci_hcd
Apr 12 13:22:05 lamu libata
Apr 12 13:22:05 lamu ehci_hcd
Apr 12 13:22:05 lamu megaraid_sas
Apr 12 13:22:05 lamu usbcore
Apr 12 13:22:05 lamu scsi_mod
Apr 12 13:22:05 lamu usb_common
Apr 12 13:22:05 lamu bnx2
Apr 12 13:22:05 lamu [last unloaded: scsi_wait_scan]
Apr 12 13:22:05 lamu
Apr 12 13:22:05 lamu [ 4117.098774]
Apr 12 13:22:05 lamu [ 4117.101737] Pid: 5417, comm: kvm Not tainted 3.2.0-2-amd64 #1
Apr 12 13:22:05 lamu Dell Inc. PowerEdge R410
Apr 12 13:22:05 lamu /0N051F
Apr 12 13:22:05 lamu
Apr 12 13:22:05 lamu [ 4117.118781] RIP: 0010:[<ffffffffa02d2336>]
Apr 12 13:22:05 lamu [<ffffffffa02d2336>] br_nf_forward_finish+0x2e/0x95 [bridge]
Apr 12 13:22:05 lamu [ 4117.137734] RSP: 0018:ffff88042fc03b18 EFLAGS: 00010293
Apr 12 13:22:05 lamu [ 4117.148342] RAX: 0000000000000000 RBX: ffff88041a59cc80 RCX: 0000000000000006
Apr 12 13:22:05 lamu [ 4117.162591] RDX: ffffffffa02d2308 RSI: 00000001000ecc40 RDI: ffff88041a59cc80
Apr 12 13:22:05 lamu [ 4117.176840] RBP: ffff880424574000 R08: 0000000000000000 R09: ffff88042fc03ad0
Apr 12 13:22:05 lamu [ 4117.191088] R10: ffffffff8165aac0 R11: ffffffff8165aac0 R12: 0000000000000000
Apr 12 13:22:05 lamu [ 4117.205338] R13: ffff880225b90002 R14: ffff88042543c8c0 R15: ffff880225b90000
Apr 12 13:22:05 lamu [ 4117.219589] FS: 00007f673f979900(0000) GS:ffff88042fc00000(0000) knlGS:0000000000000000
Apr 12 13:22:05 lamu [ 4117.235765] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
Apr 12 13:22:05 lamu [ 4117.247239] CR2: 0000000000000018 CR3: 00000001be517000 CR4: 00000000000026e0
Apr 12 13:22:05 lamu [ 4117.261488] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Apr 12 13:22:05 lamu [ 4117.275738] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Apr 12 13:22:05 lamu [ 4117.289988] Process kvm (pid: 5417, threadinfo ffff8801be51e000, task ffff880226aea240)
Apr 12 13:22:05 lamu [ 4117.305985] Stack:
Apr 12 13:22:05 lamu [ 4117.310002] ffffffff80000000
Apr 12 13:22:05 lamu ffffffffa02d26db
Apr 12 13:22:05 lamu ffff88041a59cc80
Apr 12 13:22:05 lamu ffff880424574000
Apr 12 13:22:05 lamu
Apr 12 13:22:05 lamu [ 4117.324838] ffff880424411000
Apr 12 13:22:05 lamu ffffffffa02d2a67
Apr 12 13:22:05 lamu ffff880480000000
Apr 12 13:22:05 lamu 0000000200000000
Apr 12 13:22:05 lamu
Apr 12 13:22:05 lamu [ 4117.339670] ffff88041a59cc80
Apr 12 13:22:05 lamu ffffffffa02d8cd0
Apr 12 13:22:05 lamu ffffffff81691190
Apr 12 13:22:05 lamu 0000000000000002
Apr 12 13:22:05 lamu
Apr 12 13:22:05 lamu [ 4117.354501] Call Trace:
Apr 12 13:22:05 lamu [ 4117.359386] <IRQ>
Apr 12 13:22:05 lamu
Apr 12 13:22:05 lamu [ 4117.363594] [<ffffffffa02d26db>] ? br_parse_ip_options+0x3d/0x19a [bridge]
Apr 12 13:22:05 lamu [ 4117.377501] [<ffffffffa02d2a67>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge]
Apr 12 13:22:05 lamu [ 4117.391063] [<ffffffff812abe4d>] ? nf_iterate+0x41/0x77
Apr 12 13:22:05 lamu [ 4117.401673] [<ffffffffa02cd918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 13:22:05 lamu [ 4117.414191] [<ffffffffa02cd918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 13:22:05 lamu [ 4117.426708] [<ffffffff812abeeb>] ? nf_hook_slow+0x68/0x101
Apr 12 13:22:05 lamu [ 4117.437839] [<ffffffffa02cd918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 13:22:05 lamu [ 4117.450358] [<ffffffffa02ce37a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 13:22:05 lamu [ 4117.464092] [<ffffffffa02cd918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 13:22:05 lamu [ 4117.476612] [<ffffffffa02cd85e>] ? NF_HOOK.constprop.8+0x3c/0x56 [bridge]
Apr 12 13:22:05 lamu [ 4117.490345] [<ffffffffa02cd9f2>] ? br_forward+0x16/0x5a [bridge]
Apr 12 13:22:05 lamu [ 4117.502517] [<ffffffffa02ce51b>] ? br_handle_frame_finish+0x1a1/0x20f [bridge]
Apr 12 13:22:05 lamu [ 4117.517132] [<ffffffffa02d25ff>] ? br_nf_pre_routing_finish+0x1d0/0x1dd [bridge]
Apr 12 13:22:05 lamu [ 4117.532096] [<ffffffffa02d1ff0>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Apr 12 13:22:05 lamu [ 4117.544963] [<ffffffffa02d2f58>] ? br_nf_pre_routing+0x3e8/0x3f5 [bridge]
Apr 12 13:22:05 lamu [ 4117.558695] [<ffffffff812abe4d>] ? nf_iterate+0x41/0x77
Apr 12 13:22:05 lamu [ 4117.569309] [<ffffffff8128affc>] ? napi_gro_receive+0x1d/0x2b
Apr 12 13:22:05 lamu [ 4117.580957] [<ffffffff8128aba6>] ? napi_skb_finish+0x1c/0x31
Apr 12 13:22:05 lamu [ 4117.592436] [<ffffffffa02ce37a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 13:22:05 lamu [ 4117.606167] [<ffffffff812abeeb>] ? nf_hook_slow+0x68/0x101
Apr 12 13:22:05 lamu [ 4117.617298] [<ffffffffa02ce37a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 13:22:05 lamu [ 4117.631033] [<ffffffffa02ce37a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 13:22:05 lamu [ 4117.644766] [<ffffffffa02ce360>] ? NF_HOOK.constprop.4+0x3c/0x56 [bridge]
Apr 12 13:22:05 lamu [ 4117.658498] [<ffffffff8128b06a>] ? napi_complete+0x28/0x37
Apr 12 13:22:05 lamu [ 4117.669629] [<ffffffffa02ce73c>] ? br_handle_frame+0x1b3/0x1cb [bridge]
Apr 12 13:22:05 lamu [ 4117.683016] [<ffffffffa02ce589>] ? br_handle_frame_finish+0x20f/0x20f [bridge]
Apr 12 13:22:05 lamu [ 4117.697630] [<ffffffff812890cd>] ? __netif_receive_skb+0x324/0x41f
Apr 12 13:22:05 lamu [ 4117.710146] [<ffffffff81289234>] ? process_backlog+0x6c/0x123
Apr 12 13:22:06 lamu [ 4117.721797] [<ffffffff8128b11a>] ? net_rx_action+0xa1/0x1af
Apr 12 13:22:06 lamu [ 4117.733102] [<ffffffff81037013>] ? test_tsk_need_resched+0xa/0x13
Apr 12 13:22:06 lamu [ 4117.745446] [<ffffffff8104be98>] ? __do_softirq+0xb9/0x177
Apr 12 13:22:06 lamu [ 4117.756579] [<ffffffff8135026c>] ? call_softirq+0x1c/0x30
Apr 12 13:22:06 lamu [ 4117.767535] <EOI>
Apr 12 13:22:06 lamu
Apr 12 13:22:06 lamu [ 4117.771741] [<ffffffff8100f8e5>] ? do_softirq+0x3c/0x7b
Apr 12 13:22:06 lamu [ 4117.782350] [<ffffffff8128b40a>] ? netif_rx_ni+0x1e/0x27
Apr 12 13:22:06 lamu [ 4117.793134] [<ffffffffa025b721>] ? tun_get_user+0x39a/0x3c2 [tun]
Apr 12 13:22:06 lamu [ 4117.805477] [<ffffffffa025ba66>] ? tun_chr_poll+0xcd/0xcd [tun]
Apr 12 13:22:06 lamu [ 4117.817475] [<ffffffffa025bac4>] ? tun_chr_aio_write+0x5e/0x79 [tun]
Apr 12 13:22:06 lamu [ 4117.830342] [<ffffffff810f95d4>] ? do_sync_readv_writev+0x9a/0xd7
Apr 12 13:22:06 lamu [ 4117.842686] [<ffffffff8103642f>] ? should_resched+0x5/0x23
Apr 12 13:22:06 lamu [ 4117.853817] [<ffffffff810f8c56>] ? do_sync_read+0xab/0xe3
Apr 12 13:22:06 lamu [ 4117.864772] [<ffffffff8103642f>] ? should_resched+0x5/0x23
Apr 12 13:22:06 lamu [ 4117.875906] [<ffffffff81162569>] ? security_file_permission+0x16/0x2d
Apr 12 13:22:06 lamu [ 4117.888942] [<ffffffff810f9838>] ? do_readv_writev+0xaf/0x11c
Apr 12 13:22:06 lamu [ 4117.900596] [<ffffffff8112abb6>] ? eventfd_ctx_read+0x162/0x174
Apr 12 13:22:06 lamu [ 4117.912597] [<ffffffff8103f467>] ? try_to_wake_up+0x197/0x197
Apr 12 13:22:06 lamu [ 4117.924248] [<ffffffff810f9a0d>] ? sys_writev+0x45/0x90
Apr 12 13:22:06 lamu [ 4117.934859] [<ffffffff8134e012>] ? system_call_fastpath+0x16/0x1b
Apr 12 13:22:06 lamu [ 4117.947201] Code:
Apr 12 13:22:06 53
Apr 12 13:22:06 48
Apr 12 13:22:06 89
Apr 12 13:22:06 fb
Apr 12 13:22:06 48
Apr 12 13:22:06 83
Apr 12 13:22:06 ec
Apr 12 13:22:06 10
Apr 12 13:22:06 66
Apr 12 13:22:06 81
Apr 12 13:22:06 7f
Apr 12 13:22:06 7e
Apr 12 13:22:06 08
Apr 12 13:22:06 06
Apr 12 13:22:06 4c
Apr 12 13:22:06 8b
Apr 12 13:22:06 a7
Apr 12 13:22:06 98
Apr 12 13:22:06 00
Apr 12 13:22:06 00
Apr 12 13:22:06 00
Apr 12 13:22:06 74
Apr 12 13:22:06 3d
Apr 12 13:22:06 e8
Apr 12 13:22:06 07
Apr 12 13:22:06 fe
Apr 12 13:22:06 ff
Apr 12 13:22:06 ff
Apr 12 13:22:06 66
Apr 12 13:22:06 3d
Apr 12 13:22:06 08
Apr 12 13:22:06 06
Apr 12 13:22:06 75
Apr 12 13:22:06 09
Apr 12 13:22:06 83
Apr 12 13:22:06 3d
Apr 12 13:22:06 98
Apr 12 13:22:06 6a
Apr 12 13:22:06 00
Apr 12 13:22:06 00
Apr 12 13:22:06 00
Apr 12 13:22:06 75
Apr 12 13:22:06 29
Apr 12 13:22:06 lamu
Apr 12 13:22:06 f6
Apr 12 13:22:06 44
Apr 12 13:22:06 24
Apr 12 13:22:06 18
Apr 12 13:22:06 01
Apr 12 13:22:06 49
Apr 12 13:22:06 8b
Apr 12 13:22:06 6c
Apr 12 13:22:06 24
Apr 12 13:22:06 08
Apr 12 13:22:06 74
Apr 12 13:22:06 12
Apr 12 13:22:06 8a
Apr 12 13:22:06 43
Apr 12 13:22:06 7d
Apr 12 13:22:06 83
Apr 12 13:22:06 e0
Apr 12 13:22:06 f8
Apr 12 13:22:06 83
Apr 12 13:22:06 c8
Apr 12 13:22:06 lamu
Apr 12 13:22:06 lamu [ 4117.985837] RIP
Apr 12 13:22:06 lamu [<ffffffffa02d2336>] br_nf_forward_finish+0x2e/0x95 [bridge]
Apr 12 13:22:06 lamu [ 4118.000102] RSP <ffff88042fc03b18>
Apr 12 13:22:06 lamu [ 4118.007067] CR2: 0000000000000018
Apr 12 13:22:06 lamu [ 4118.014273] ---[ end trace c19a5656967502d9 ]---
Apr 12 13:22:06 lamu [ 4118.023651] Kernel panic - not syncing: Fatal exception in interrupt
Apr 12 13:22:06 lamu [ 4118.036551] Pid: 5417, comm: kvm Tainted: G D 3.2.0-2-amd64 #1
Apr 12 13:22:06 lamu [ 4118.050125] Call Trace:
Apr 12 13:22:06 lamu [ 4118.055141] <IRQ>
Apr 12 13:22:06 lamu [<ffffffff81342930>] ? panic+0x95/0x1a5
Apr 12 13:22:06 lamu [ 4118.066812] [<ffffffff81349e86>] ? oops_end+0xa9/0xb6
Apr 12 13:22:06 lamu [ 4118.077374] [<ffffffff8134227c>] ? no_context+0x1ff/0x20e
Apr 12 13:22:06 lamu [ 4118.088585] [<ffffffff810e9cd8>] ? virt_to_slab+0x6/0x16
Apr 12 13:22:06 lamu [ 4118.099505] [<ffffffff8134be99>] ? do_page_fault+0x1a8/0x337
Apr 12 13:22:06 lamu [ 4118.111234] [<ffffffffa03b4f06>] ? ip_vs_conn_put+0x28/0x32 [ip_vs]
Apr 12 13:22:06 lamu [ 4118.124097] [<ffffffffa03b70e0>] ? ip_vs_out+0x2bd/0x432 [ip_vs]
Apr 12 13:22:06 lamu [ 4118.136534] [<ffffffff812abeeb>] ? nf_hook_slow+0x68/0x101
Apr 12 13:22:06 lamu [ 4118.147846] [<ffffffff813495f5>] ? page_fault+0x25/0x30
Apr 12 13:22:06 lamu [ 4118.158871] [<ffffffffa02d2308>] ? nf_bridge_update_protocol+0x20/0x20 [bridge]
Apr 12 13:22:06 lamu [ 4118.173852] [<ffffffffa02d2336>] ? br_nf_forward_finish+0x2e/0x95 [bridge]
Apr 12 13:22:06 lamu [ 4118.187919] [<ffffffffa02d2327>] ? br_nf_forward_finish+0x1f/0x95 [bridge]
Apr 12 13:22:06 lamu [ 4118.202024] [<ffffffffa02d26db>] ? br_parse_ip_options+0x3d/0x19a [bridge]
Apr 12 13:22:06 lamu [ 4118.216187] [<ffffffffa02d2a67>] ? br_nf_forward_ip+0x1c0/0x1d4 [bridge]
Apr 12 13:22:06 lamu [ 4118.230137] [<ffffffff812abe4d>] ? nf_iterate+0x41/0x77
Apr 12 13:22:06 lamu [ 4118.241005] [<ffffffffa02cd918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 13:22:06 lamu [ 4118.253701] [<ffffffffa02cd918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 13:22:06 lamu [ 4118.266471] [<ffffffff812abeeb>] ? nf_hook_slow+0x68/0x101
Apr 12 13:22:06 lamu [ 4118.277931] [<ffffffffa02cd918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 13:22:06 lamu [ 4118.290618] [<ffffffffa02ce37a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 13:22:06 lamu [ 4118.304695] [<ffffffffa02cd918>] ? __br_deliver+0xa0/0xa0 [bridge]
Apr 12 13:22:06 lamu [ 4118.317523] [<ffffffffa02cd85e>] ? NF_HOOK.constprop.8+0x3c/0x56 [bridge]
Apr 12 13:22:06 lamu [ 4118.331508] [<ffffffffa02cd9f2>] ? br_forward+0x16/0x5a [bridge]
Apr 12 13:22:06 lamu [ 4118.343911] [<ffffffffa02ce51b>] ? br_handle_frame_finish+0x1a1/0x20f [bridge]
Apr 12 13:22:06 lamu [ 4118.358880] [<ffffffffa02d25ff>] ? br_nf_pre_routing_finish+0x1d0/0x1dd [bridge]
Apr 12 13:22:06 lamu [ 4118.374318] [<ffffffffa02d1ff0>] ? NF_HOOK_THRESH+0x3b/0x55 [bridge]
Apr 12 13:22:06 lamu [ 4118.387534] [<ffffffffa02d2f58>] ? br_nf_pre_routing+0x3e8/0x3f5 [bridge]
Apr 12 13:22:06 lamu [ 4118.401597] [<ffffffff812abe4d>] ? nf_iterate+0x41/0x77
Apr 12 13:22:06 lamu [ 4118.412543] [<ffffffff8128affc>] ? napi_gro_receive+0x1d/0x2b
Apr 12 13:22:06 lamu [ 4118.424529] [<ffffffff8128aba6>] ? napi_skb_finish+0x1c/0x31
Apr 12 13:22:06 lamu [ 4118.436261] [<ffffffffa02ce37a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 13:22:06 lamu [ 4118.450326] [<ffffffff812abeeb>] ? nf_hook_slow+0x68/0x101
Apr 12 13:22:06 lamu [ 4118.461719] [<ffffffffa02ce37a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 13:22:06 lamu [ 4118.475801] [<ffffffffa02ce37a>] ? NF_HOOK.constprop.4+0x56/0x56 [bridge]
Apr 12 13:22:06 lamu [ 4118.489866] [<ffffffffa02ce360>] ? NF_HOOK.constprop.4+0x3c/0x56 [bridge]
Apr 12 13:22:06 lamu [ 4118.503947] [<ffffffff8128b06a>] ? napi_complete+0x28/0x37
Apr 12 13:22:06 lamu [ 4118.515485] [<ffffffffa02ce73c>] ? br_handle_frame+0x1b3/0x1cb [bridge]
Apr 12 13:22:06 lamu [ 4118.529269] [<ffffffffa02ce589>] ? br_handle_frame_finish+0x20f/0x20f [bridge]
Apr 12 13:22:06 lamu [ 4118.544220] [<ffffffff812890cd>] ? __netif_receive_skb+0x324/0x41f
Apr 12 13:22:06 lamu [ 4118.557192] [<ffffffff81289234>] ? process_backlog+0x6c/0x123
Apr 12 13:22:06 lamu [ 4118.569098] [<ffffffff8128b11a>] ? net_rx_action+0xa1/0x1af
Apr 12 13:22:06 lamu [ 4118.580632] [<ffffffff81037013>] ? test_tsk_need_resched+0xa/0x13
Apr 12 13:22:06 lamu [ 4118.593292] [<ffffffff8104be98>] ? __do_softirq+0xb9/0x177
Apr 12 13:22:06 lamu [ 4118.604759] [<ffffffff8135026c>] ? call_softirq+0x1c/0x30
Apr 12 13:22:06 lamu [ 4118.616040] <EOI>
Apr 12 13:22:06 lamu [<ffffffff8100f8e5>] ? do_softirq+0x3c/0x7b
Apr 12 13:22:06 lamu [ 4118.628382] [<ffffffff8128b40a>] ? netif_rx_ni+0x1e/0x27
Apr 12 13:22:06 lamu [ 4118.639571] [<ffffffffa025b721>] ? tun_get_user+0x39a/0x3c2 [tun]
Apr 12 13:22:06 lamu [ 4118.652220] [<ffffffffa025ba66>] ? tun_chr_poll+0xcd/0xcd [tun]
Apr 12 13:22:06 lamu [ 4118.664445] [<ffffffffa025bac4>] ? tun_chr_aio_write+0x5e/0x79 [tun]
Apr 12 13:22:06 lamu [ 4118.677553] [<ffffffff810f95d4>] ? do_sync_readv_writev+0x9a/0xd7
Apr 12 13:22:06 lamu [ 4118.690220] [<ffffffff8103642f>] ? should_resched+0x5/0x23
Apr 12 13:22:06 lamu [ 4118.701591] [<ffffffff810f8c56>] ? do_sync_read+0xab/0xe3
Apr 12 13:22:06 lamu [ 4118.712765] [<ffffffff8103642f>] ? should_resched+0x5/0x23
Apr 12 13:22:07 lamu [ 4118.724209] [<ffffffff81162569>] ? security_file_permission+0x16/0x2d
Apr 12 13:22:07 lamu [ 4118.737632] [<ffffffff810f9838>] ? do_readv_writev+0xaf/0x11c
Apr 12 13:22:07 lamu [ 4118.749500] [<ffffffff8112abb6>] ? eventfd_ctx_read+0x162/0x174
Apr 12 13:22:07 lamu [ 4118.761817] [<ffffffff8103f467>] ? try_to_wake_up+0x197/0x197
Apr 12 13:22:07 lamu [ 4118.773669] [<ffffffff810f9a0d>] ? sys_writev+0x45/0x90
Apr 12 13:22:07 lamu [ 4118.784671] [<ffffffff8134e012>] ? system_call_fastpath+0x16/0x1b
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Kernel panic with bridge networking
2012-04-12 12:30 Kernel panic with bridge networking Massimo Cetra
@ 2012-04-12 12:52 ` Eric Dumazet
2012-04-12 14:57 ` Massimo cetra
2012-04-13 2:45 ` Peter Huang (Peng)
0 siblings, 2 replies; 4+ messages in thread
From: Eric Dumazet @ 2012-04-12 12:52 UTC (permalink / raw)
To: Massimo Cetra; +Cc: netdev, Peter Huang (Peng)
On Thu, 2012-04-12 at 14:30 +0200, Massimo Cetra wrote:
> Hello,
>
> i am experiencing a panic whose logs are attached (grabbed with netconsole).
>
> They look quite similar to what has been described here
> http://www.spinics.net/lists/linux-net/msg17689.html
>
> The patch proposed as the solution (commit
> 6b1e960fdbd75dcd9bcc3ba5ff8898ff1ad30b6e) seems to be applied (even with
> small differences) but the problem persists.
>
> The kernel is a debian linux-image-3.2.0-2-amd64 version 3.2.12-1
>
> Any hint ?
> I have checked the changelog of 3.2.13 and 3.2.14 and it doesn't seems
> to be any commit regarding such problems.
>
> Massimo Cetra
>
> P.S.1: Please CC me as i'm not subscribed.
> P.S.2: this bug has been submitted to debian as well
> http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=668511
>
Known issue, and we are waiting from a fix from Peter.
https://lkml.org/lkml/2012/3/31/17
Peter, any progress on your side ?
Thanks
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Kernel panic with bridge networking
2012-04-12 12:52 ` Eric Dumazet
@ 2012-04-12 14:57 ` Massimo cetra
2012-04-13 2:45 ` Peter Huang (Peng)
1 sibling, 0 replies; 4+ messages in thread
From: Massimo cetra @ 2012-04-12 14:57 UTC (permalink / raw)
To: Eric Dumazet; +Cc: netdev, Peter Huang (Peng)
On 12/04/2012 14:52, Eric Dumazet wrote:
> On Thu, 2012-04-12 at 14:30 +0200, Massimo Cetra wrote:
>> Hello,
>>
>> i am experiencing a panic whose logs are attached (grabbed with netconsole).
>>
> Known issue, and we are waiting from a fix from Peter.
>
> https://lkml.org/lkml/2012/3/31/17
>
> Peter, any progress on your side ?
>
Thanks Eric,
is there a way to prvent those panics, meanwhile ?
I mean: i don't understand if it depends strictly on IPv6 or it has
other causes.
The same kernel with ipv6 enabled but without ipv6 is not actually
panic-ing ...
And thanks to Peter as well.
Massimo
^ permalink raw reply [flat|nested] 4+ messages in thread
* Re: Kernel panic with bridge networking
2012-04-12 12:52 ` Eric Dumazet
2012-04-12 14:57 ` Massimo cetra
@ 2012-04-13 2:45 ` Peter Huang (Peng)
1 sibling, 0 replies; 4+ messages in thread
From: Peter Huang (Peng) @ 2012-04-13 2:45 UTC (permalink / raw)
To: 'Eric Dumazet', 'Massimo Cetra'; +Cc: netdev
Hi, Eric
Sorry for delayed reply.
I will send the patch out until tomorrow .
--------------------------------
Peter Huang(peng)
> On Thu, 2012-04-12 at 14:30 +0200, Massimo Cetra wrote:
> > Hello,
> >
> > i am experiencing a panic whose logs are attached (grabbed with netconsole).
> >
> > They look quite similar to what has been described here
> > http://www.spinics.net/lists/linux-net/msg17689.html
> >
> > The patch proposed as the solution (commit
> > 6b1e960fdbd75dcd9bcc3ba5ff8898ff1ad30b6e) seems to be applied (even with
> > small differences) but the problem persists.
> >
> > The kernel is a debian linux-image-3.2.0-2-amd64 version 3.2.12-1
> >
> > Any hint ?
> > I have checked the changelog of 3.2.13 and 3.2.14 and it doesn't seems
> > to be any commit regarding such problems.
> >
> > Massimo Cetra
> >
> > P.S.1: Please CC me as i'm not subscribed.
> > P.S.2: this bug has been submitted to debian as well
> > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=668511
> >
>
> Known issue, and we are waiting from a fix from Peter.
>
> https://lkml.org/lkml/2012/3/31/17
>
> Peter, any progress on your side ?
>
> Thanks
^ permalink raw reply [flat|nested] 4+ messages in thread
end of thread, other threads:[~2012-04-13 2:45 UTC | newest]
Thread overview: 4+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2012-04-12 12:30 Kernel panic with bridge networking Massimo Cetra
2012-04-12 12:52 ` Eric Dumazet
2012-04-12 14:57 ` Massimo cetra
2012-04-13 2:45 ` Peter Huang (Peng)
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.