* [AX25] kernel panic
@ 2008-03-18 10:44 Bernard Pidoux F6BVP
2008-03-18 21:25 ` Francois Romieu
0 siblings, 1 reply; 39+ messages in thread
From: Bernard Pidoux F6BVP @ 2008-03-18 10:44 UTC (permalink / raw)
To: Linux Netdev List
Hi,
I used netconsole to document a kernel panic related to AX25 on one of
my systems.
This occurs systematically as soon as I close an AX25 session
established through a level 3 ROSE network (FPAC) via AXUDP link (ax25ipd).
It is not triggered when connecting locally or via AX25 call through LAN.
This is observed with kernel-2.6.24.2 and -3 with most recent AX25
patches applied.
Bernard Pidoux
BUG: unable to handle kernel paging request at virtual address 6b6b6c2b
printing eip: c0139585 *pde = 00000000
Oops: 0002 [#1]
Modules linked in: netconsole configfs rose netrom mkiss crc16 ax25 mga
drm nfsd exportfs nfs lockd nfs_acl sunrpc af_packet ipv6 snd_seq_dummy
snd_seq_oss snd_seq_midi_event snd_seq snd_pcm_oss snd_mixer_oss
binfmt_misc loop floppy usbhid snd_ens1371 snd_rawmidi snd_seq_device
snd_ac97_codec snd_pcm uhci_hcd snd_timer snd soundcore snd_page_alloc
usbcore ne2k_pci intel_agp ac97_bus ide_cd 8390 agpgart ext3 jbd
ide_disk piix ide_core
Pid: 3527, comm: ax25ipd Not tainted (2.6.24.2 #2)
EIP: 0060:[<c0139585>] EFLAGS: 00010012 CPU: 0
EIP is at __lock_acquire+0x65/0x11d0
EAX: 00000012 EBX: 00000001 ECX: c7670068 EDX: 00000002
ESI: 00000000 EDI: 6b6b6b6b EBP: c6bf5bc0 ESP: c6bf5b38
DS: 007b ES: 007b FS: 0000 GS: 0033 SS: 0068
Process ax25ipd (pid: 3527, ti=c6bf4000 task=c60251d0 task.ti=c6bf4000)
Stack: 0000580b 00000000 02c059e8 00000000 c04f73d8 02c059e8 00000000
c6bf5be4
c01397d8 00000001 c017ecc0 00000000 00000002 00000000 c7670068
c60251d0
0000580b 00000000 02c059d1 00000000 c04f3ce0 00000002 00000000
c75290f8
Call Trace:
[<c010513a>] show_trace_log_lvl+0x1a/0x30
[<c01051f9>] show_stack_log_lvl+0xa9/0xd0
[<c01052e6>] show_registers+0xc6/0x1b0
[<c01054b5>] die+0xe5/0x220
[<c011244f>] do_page_fault+0x15f/0x610
[<c02c2cfa>] error_code+0x6a/0x70
[<c013a773>] lock_acquire+0x83/0xa0
[<c02c2abe>] _spin_lock_irqsave+0x3e/0x70
[<c011458b>] __wake_up+0x1b/0x50
[<c024d56c>] sock_def_write_space+0x9c/0xc0
[<c024d96a>] sock_wfree+0x3a/0x40
[<c024fb61>] skb_release_all+0x51/0x120
[<c024f30b>] __kfree_skb+0xb/0x90
[<c024f3a9>] kfree_skb+0x19/0x30
[<c8c19e03>] ax25_frames_acked+0x43/0x70 [ax25]
[<c8c17a10>] ax25_check_iframes_acked+0x40/0x60 [ax25]
[<c8c1946f>] ax25_std_frame_in+0x6af/0x890 [ax25]
[<c8c16dba>] ax25_kiss_rcv+0x2ba/0x7b0 [ax25]
[<c0254e89>] netif_receive_skb+0x379/0x470
[<c0257a85>] process_backlog+0x75/0xe0
[<c025759b>] net_rx_action+0x12b/0x1d0
[<c011d595>] __do_softirq+0x55/0xc0
[<c011d647>] do_softirq+0x47/0x50
[<c011d9f5>] local_bh_enable_ip+0x95/0xe0
[<c02c24b5>] _spin_unlock_bh+0x25/0x30
[<c8c0c6b0>] mkiss_receive_buf+0x360/0x420 [mkiss]
[<c020e077>] pty_write+0x47/0x60
[<c020b642>] write_chan+0x222/0x330
[<c0208d06>] tty_write+0x126/0x1b0
[<c01727ff>] vfs_write+0xaf/0x120
[<c0172d4d>] sys_write+0x3d/0x70
[<c010412a>] sysenter_past_esp+0x5f/0xa5
=======================
Code: 00 9c 58 f6 c4 02 0f 85 52 06 00 00 83 fe 07 0f 87 7b 06 00 00 85
f6 0f 85 fe 03 00 00 8b 4d b0 8b 79 04 85 ff 0f 84 f0 03 00 00 <ff> 87
c0 00 00 00 89 f8 e8 ce c9 ff ff 85 c0 0f 85 d6 02 00 00
EIP: [<c0139585>] __lock_acquire+0x65/0x11d0 SS:ESP 0068:c6bf5b38
Kernel panic - not syncing: Fatal exception in interrupt
^ permalink raw reply [flat|nested] 39+ messages in thread* Re: [AX25] kernel panic 2008-03-18 10:44 [AX25] kernel panic Bernard Pidoux F6BVP @ 2008-03-18 21:25 ` Francois Romieu 2008-03-19 7:36 ` Bernard Pidoux F6BVP 0 siblings, 1 reply; 39+ messages in thread From: Francois Romieu @ 2008-03-18 21:25 UTC (permalink / raw) To: Bernard Pidoux F6BVP; +Cc: Linux Netdev List Bernard Pidoux F6BVP <f6bvp@free.fr> : [...] > I used netconsole to document a kernel panic related to AX25 on one of my > systems. > This occurs systematically as soon as I close an AX25 session established > through a level 3 ROSE network (FPAC) via AXUDP link (ax25ipd). > It is not triggered when connecting locally or via AX25 call through LAN. May be replacing netif_rx() in drivers/net/hamradio/mkiss.c::ax_bump() by netif_receive_skb() ? -- Ueimor ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-18 21:25 ` Francois Romieu @ 2008-03-19 7:36 ` Bernard Pidoux F6BVP 2008-03-19 20:57 ` Bernard Pidoux 0 siblings, 1 reply; 39+ messages in thread From: Bernard Pidoux F6BVP @ 2008-03-19 7:36 UTC (permalink / raw) To: Francois Romieu; +Cc: Linux Netdev List Francois Romieu wrote: > Bernard Pidoux F6BVP <f6bvp@free.fr> : > [...] >> I used netconsole to document a kernel panic related to AX25 on one of my >> systems. >> This occurs systematically as soon as I close an AX25 session established >> through a level 3 ROSE network (FPAC) via AXUDP link (ax25ipd). >> It is not triggered when connecting locally or via AX25 call through LAN. > > May be replacing netif_rx() in drivers/net/hamradio/mkiss.c::ax_bump() > by netif_receive_skb() ? > Sorry, this does not made it. I replaced netif_rx() by netif_receive_skb(skb) but this gives a worst situation : system is frozen. Thank you for the suggestion. ======================= BUG: soft lockup - CPU#0 stuck for 11s! [ax25ipd:3584] Pid: 3584, comm: ax25ipd Not tainted (2.6.24.3 #7) EIP: 0060:[<c01ed892>] EFLAGS: 00000246 CPU: 0 EIP is at delay_tsc+0x12/0x20 EAX: 7752234b EBX: 00000001 ECX: 7752234b EDX: 00000016 ESI: 087022c8 EDI: 00000000 EBP: c6bb5bc0 ESP: c6bb5bbc DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 CR0: 8005003b CR2: b7dd86f8 CR3: 07960000 CR4: 000000d0 DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 DR6: ffff0ff0 DR7: 00000400 [<c010535a>] show_trace_log_lvl+0x1a/0x30 [<c0105d82>] show_trace+0x12/0x20 [<c01024cc>] show_regs+0x1c/0x20 [<c015555b>] softlockup_tick+0x11b/0x150 [<c0126c12>] run_local_timers+0x12/0x20 [<c012708f>] update_process_times+0x2f/0x60 [<c013a355>] tick_periodic+0x25/0x80 [<c013a3c9>] tick_handle_periodic+0x19/0x80 [<c0107aca>] timer_interrupt+0x4a/0x60 [<c0155928>] handle_IRQ_event+0x28/0x60 [<c015725f>] handle_level_irq+0x7f/0xf0 [<c0106e68>] do_IRQ+0x48/0xa0 [<c0104d16>] common_interrupt+0x2e/0x34 [<c01ed839>] __delay+0x9/0x10 [<c01f15f2>] _raw_spin_lock+0xb2/0x140 [<c02cd350>] _spin_lock_bh+0x50/0x60 [<c8c59e72>] ax_xmit+0x112/0x370 [mkiss] [<c025e947>] dev_hard_start_xmit+0x207/0x270 [<c026f454>] __qdisc_run+0x54/0x1b0 [<c0261226>] dev_queue_xmit+0x266/0x340 [<c8c27a87>] ax25_queue_xmit+0x47/0x70 [ax25] [<c8c27b77>] ax25_transmit_buffer+0xc7/0x110 [ax25] [<c8c27c3d>] ax25_send_iframe+0x7d/0x110 [ax25] [<c8c27d80>] ax25_kick+0xb0/0x1b0 [ax25] [<c8c28e49>] ax25_std_frame_in+0x69/0x890 [ax25] [<c8c26dbb>] ax25_kiss_rcv+0x2bb/0x7c0 [ax25] [<c025e24a>] netif_receive_skb+0x38a/0x480 [<c8c596ab>] mkiss_receive_buf+0x34b/0x420 [mkiss] [<c0219457>] pty_write+0x47/0x60 [<c0216a19>] write_chan+0x229/0x330 [<c021407b>] tty_write+0x12b/0x1c0 [<c017b66f>] vfs_write+0xaf/0x120 [<c017bcbd>] sys_write+0x3d/0x70 [<c010427e>] sysenter_past_esp+0x5f/0xa5 ======================= Regards, Bernard Pidoux ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-19 7:36 ` Bernard Pidoux F6BVP @ 2008-03-19 20:57 ` Bernard Pidoux 2008-03-20 7:30 ` Jarek Poplawski 0 siblings, 1 reply; 39+ messages in thread From: Bernard Pidoux @ 2008-03-19 20:57 UTC (permalink / raw) To: Bernard Pidoux F6BVP; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Bernard Pidoux F6BVP wrote: > > Francois Romieu wrote: >> Bernard Pidoux F6BVP <f6bvp@free.fr> : >> [...] >>> I used netconsole to document a kernel panic related to AX25 on one >>> of my systems. >>> This occurs systematically as soon as I close an AX25 session >>> established through a level 3 ROSE network (FPAC) via AXUDP link >>> (ax25ipd). >>> It is not triggered when connecting locally or via AX25 call through >>> LAN. >> >> May be replacing netif_rx() in drivers/net/hamradio/mkiss.c::ax_bump() >> by netif_receive_skb() ? >> > > Sorry, this does not made it. > I replaced netif_rx() by netif_receive_skb(skb) > but this gives a worst situation : system is frozen. > Thank you for the suggestion. > > ======================= > BUG: soft lockup - CPU#0 stuck for 11s! [ax25ipd:3584] > > Pid: 3584, comm: ax25ipd Not tainted (2.6.24.3 #7) > EIP: 0060:[<c01ed892>] EFLAGS: 00000246 CPU: 0 > EIP is at delay_tsc+0x12/0x20 > EAX: 7752234b EBX: 00000001 ECX: 7752234b EDX: 00000016 > ESI: 087022c8 EDI: 00000000 EBP: c6bb5bc0 ESP: c6bb5bbc > DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 > CR0: 8005003b CR2: b7dd86f8 CR3: 07960000 CR4: 000000d0 > DR0: 00000000 DR1: 00000000 DR2: 00000000 DR3: 00000000 > DR6: ffff0ff0 DR7: 00000400 > [<c010535a>] show_trace_log_lvl+0x1a/0x30 > [<c0105d82>] show_trace+0x12/0x20 > [<c01024cc>] show_regs+0x1c/0x20 > [<c015555b>] softlockup_tick+0x11b/0x150 > [<c0126c12>] run_local_timers+0x12/0x20 > [<c012708f>] update_process_times+0x2f/0x60 > [<c013a355>] tick_periodic+0x25/0x80 > [<c013a3c9>] tick_handle_periodic+0x19/0x80 > [<c0107aca>] timer_interrupt+0x4a/0x60 > [<c0155928>] handle_IRQ_event+0x28/0x60 > [<c015725f>] handle_level_irq+0x7f/0xf0 > [<c0106e68>] do_IRQ+0x48/0xa0 > [<c0104d16>] common_interrupt+0x2e/0x34 > [<c01ed839>] __delay+0x9/0x10 > [<c01f15f2>] _raw_spin_lock+0xb2/0x140 > [<c02cd350>] _spin_lock_bh+0x50/0x60 > [<c8c59e72>] ax_xmit+0x112/0x370 [mkiss] > [<c025e947>] dev_hard_start_xmit+0x207/0x270 > [<c026f454>] __qdisc_run+0x54/0x1b0 > [<c0261226>] dev_queue_xmit+0x266/0x340 > [<c8c27a87>] ax25_queue_xmit+0x47/0x70 [ax25] > [<c8c27b77>] ax25_transmit_buffer+0xc7/0x110 [ax25] > [<c8c27c3d>] ax25_send_iframe+0x7d/0x110 [ax25] > [<c8c27d80>] ax25_kick+0xb0/0x1b0 [ax25] > [<c8c28e49>] ax25_std_frame_in+0x69/0x890 [ax25] > [<c8c26dbb>] ax25_kiss_rcv+0x2bb/0x7c0 [ax25] > [<c025e24a>] netif_receive_skb+0x38a/0x480 > [<c8c596ab>] mkiss_receive_buf+0x34b/0x420 [mkiss] > [<c0219457>] pty_write+0x47/0x60 > [<c0216a19>] write_chan+0x229/0x330 > [<c021407b>] tty_write+0x12b/0x1c0 > [<c017b66f>] vfs_write+0xaf/0x120 > [<c017bcbd>] sys_write+0x3d/0x70 > [<c010427e>] sysenter_past_esp+0x5f/0xa5 > ======================= > > Regards, > > Bernard Pidoux > -- > To unsubscribe from this list: send the line "unsubscribe netdev" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > > I also tried to revert Jarek's mkiss ax_bump() patch, but this did not prevent kernel lockup, although this time swapper is involved and not ax25ipd. Bernard Pidoux BUG: unable to handle kernel paging request at virtual address 6b6b6c2b printing eip: c013fc67 *pde = 00000000 Oops: 0002 [#1] SMP Modules linked in: rose netrom mkiss crc16 ax25 mga netconsole drm configfs nfsd exportfs nfs lockd nfs_acl sunrpc af_packet ipv6 snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_pcm_oss snd_mixer_oss binfmt_misc loop usb_storage scsi_mod floppy usbhid snd_ens1371 snd_rawmidi snd_seq_device snd_ac97_codec snd_pcm snd_timer snd uhci_hcd soundcore usbcore snd_page_alloc ne2k_pci ide_cd ac97_bus intel_agp 8390 agpgart genrtc ext3 jbd ide_disk piix ide_core Pid: 0, comm: swapper Not tainted (2.6.24.3 #7) EIP: 0060:[<c013fc67>] EFLAGS: 00010012 CPU: 0 EIP is at __lock_acquire+0x67/0x1170 EAX: 00000002 EBX: 00000001 ECX: c7657030 EDX: 00000002 ESI: 6b6b6b6b EDI: 00000000 EBP: c0395c84 ESP: c0395c00 DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 Process swapper (pid: 0, ti=c0394000 task=c036a3c0 task.ti=c0394000) Stack: 0000600c 00000000 030061f9 00000000 c0514298 030061f9 00000000 c0395ca8 c013fe71 c0395cb0 c013fe71 00000001 000001e2 00000000 00000002 00000000 c7657030 c036a3c0 030061e2 00000000 c0510ba8 030061e2 000001f9 00000002 Call Trace: [<c010535a>] show_trace_log_lvl+0x1a/0x30 [<c0105419>] show_stack_log_lvl+0xa9/0xd0 [<c0105507>] show_registers+0xc7/0x1b0 [<c01056fa>] die+0x10a/0x230 [<c01146f0>] do_page_fault+0x160/0x630 [<c02cdaea>] error_code+0x72/0x78 [<c0140df5>] lock_acquire+0x85/0xa0 [<c02cd79e>] _spin_lock_irqsave+0x3e/0x70 [<c0117c4b>] __wake_up+0x1b/0x50 [<c025689c>] sock_def_write_space+0x9c/0xc0 [<c0256c9c>] sock_wfree+0x3c/0x50 [<c0258ef7>] skb_release_all+0x57/0x130 [<c025868b>] __kfree_skb+0xb/0x90 [<c0258729>] kfree_skb+0x19/0x40 [<c8cc1e23>] ax25_frames_acked+0x43/0x70 [ax25] [<c8cc11db>] ax25_std_frame_in+0x3fb/0x890 [ax25] [<c8cbedbb>] ax25_kiss_rcv+0x2bb/0x7c0 [ax25] [<c025e24a>] netif_receive_skb+0x38a/0x480 [<c0260e9b>] process_backlog+0x7b/0xf0 [<c02609a7>] net_rx_action+0x167/0x210 [<c0122da3>] __do_softirq+0x93/0x120 [<c0122e87>] do_softirq+0x57/0x60 [<c0123235>] irq_exit+0x85/0x90 [<c0106e6d>] do_IRQ+0x4d/0xa0 [<c0104d16>] common_interrupt+0x2e/0x34 [<c0102606>] cpu_idle+0x76/0xa0 [<c02ca6a9>] rest_init+0x49/0x50 [<c0399d75>] start_kernel+0x2d5/0x360 [<00000000>] 0x0 ======================= Code: 9c 58 f6 c4 02 0f 85 ff 05 00 00 83 ff 07 0f 87 28 06 00 00 85 ff 0f 85 ac 03 00 00 8b 4d bc 8b 71 04 85 f6 0f 84 9e 03 00 00 90 <ff> 86 c0 00 00 00 89 f0 e8 bc c8 ff ff 85 c0 0f 85 84 02 00 00 EIP: [<c013fc67>] __lock_acquire+0x67/0x1170 SS:ESP 0068:c0395c00 Kernel panic - not syncing: Fatal exception in interrupt ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-19 20:57 ` Bernard Pidoux @ 2008-03-20 7:30 ` Jarek Poplawski 2008-03-20 22:58 ` Bernard Pidoux 0 siblings, 1 reply; 39+ messages in thread From: Jarek Poplawski @ 2008-03-20 7:30 UTC (permalink / raw) To: Bernard Pidoux Cc: Bernard Pidoux F6BVP, Francois Romieu, Linux Netdev List, Jarek Poplawski On Wed, Mar 19, 2008 at 09:57:18PM +0100, Bernard Pidoux wrote: ... > I also tried to revert Jarek's mkiss ax_bump() patch, but this did not > prevent > kernel lockup, although this time swapper is involved and not ax25ipd. ... > BUG: unable to handle kernel paging request at virtual address 6b6b6c2b > printing eip: c013fc67 *pde = 00000000 > Oops: 0002 [#1] SMP Well, the rest looks very similarly and not trivial... Probably a socket is destructed too soon (or something...). Could you try to reproduce this with some debugging turned off, e.g.: CONFIG_DEBUG_LOCK_ALLOC, CONFIG_DEBUG_PAGEALLOC, (CONFIG_SLUB_DEBUG?). Regards, Jarek P. ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-20 7:30 ` Jarek Poplawski @ 2008-03-20 22:58 ` Bernard Pidoux 2008-03-21 0:28 ` Jarek Poplawski ` (2 more replies) 0 siblings, 3 replies; 39+ messages in thread From: Bernard Pidoux @ 2008-03-20 22:58 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Jarek Poplawski wrote: > On Wed, Mar 19, 2008 at 09:57:18PM +0100, Bernard Pidoux wrote: > ... >> I also tried to revert Jarek's mkiss ax_bump() patch, but this did not >> prevent >> kernel lockup, although this time swapper is involved and not ax25ipd. > ... >> BUG: unable to handle kernel paging request at virtual address 6b6b6c2b >> printing eip: c013fc67 *pde = 00000000 >> Oops: 0002 [#1] SMP > > Well, the rest looks very similarly and not trivial... Probably a > socket is destructed too soon (or something...). Could you try to > reproduce this with some debugging turned off, e.g.: > CONFIG_DEBUG_LOCK_ALLOC, CONFIG_DEBUG_PAGEALLOC, (CONFIG_SLUB_DEBUG?). > > Regards, > Jarek P. I recompiled the kernel after turning off the above options. However there is still a kernel panic documented below. Does it help ? Bernard Pidoux BUG: spinlock bad magic on CPU#0, swapper/0 BUG: unable to handle kernel paging request at virtual address 6b6b6c2f printing eip: c01e730b *pde = 00000000 Oops: 0000 [#1] SMP Modules linked in: rose netrom mkiss crc16 ax25 mga drm netconsole configfs nfsd exportfs nfs lockd nfs_acl sunrpc af_packet ipv6 snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_pcm_oss snd_mixer_oss binfmt_misc loop usb_storage scsi_mod floppy usbhid snd_ens1371 snd_rawmidi snd_seq_device snd_ac97_codec snd_pcm snd_timer snd uhci_hcd intel_agp ne2k_pci ide_cd usbcore soundcore snd_page_alloc ac97_bus 8390 agpgart genrtc ext3 jbd ide_disk piix ide_core Pid: 0, comm: swapper Not tainted (2.6.24.3 #8) EIP: 0060:[<c01e730b>] EFLAGS: 00010002 CPU: 0 EIP is at spin_bug+0xdb/0xf0 EAX: 0000002f EBX: 6b6b6b6b ECX: 6b6b6b6b EDX: 00000082 ESI: c07e5a38 EDI: c0333633 EBP: c0379c78 ESP: c0379c54 DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 Process swapper (pid: 0, ti=c0378000 task=c0353340 task.ti=c0378000) Stack: c0333724 c0333633 00000000 c0353509 00000000 00000010 c07e5a38 00000001 c7b8abb8 c0379cb0 c01e7409 c11448c8 c1147740 00000000 c11448c0 c0379cb8 c114775c c11448c8 c1147740 00000000 00000282 00000001 c7b8abb8 c0379cbc Call Trace: [<c010527a>] show_trace_log_lvl+0x1a/0x30 [<c0105339>] show_stack_log_lvl+0xa9/0xd0 [<c0105427>] show_registers+0xc7/0x1b0 [<c010561a>] die+0x10a/0x230 [<c0114855>] do_page_fault+0x2f5/0x600 [<c02c039a>] error_code+0x72/0x78 [<c01e7409>] _raw_spin_lock+0x69/0x140 [<c02c01cc>] _spin_lock_irqsave+0xc/0x20 [<c0117c9b>] __wake_up+0x1b/0x50 [<c024badc>] sock_def_write_space+0x9c/0xc0 [<c024bdcc>] sock_wfree+0x3c/0x50 [<c024dfc7>] skb_release_all+0x57/0x130 [<c024d75b>] __kfree_skb+0xb/0x90 [<c024d7f9>] kfree_skb+0x19/0x40 [<c8c49e33>] ax25_frames_acked+0x43/0x70 [ax25] [<c8c47a30>] ax25_check_iframes_acked+0x40/0x60 [ax25] [<c8c4949f>] ax25_std_frame_in+0x6af/0x890 [ax25] [<c8c46dbb>] ax25_kiss_rcv+0x2bb/0x7c0 [ax25] [<c02531eb>] netif_receive_skb+0x33b/0x420 [<c0255c1b>] process_backlog+0x6b/0xd0 [<c025573f>] net_rx_action+0xff/0x1a0 [<c0122864>] __do_softirq+0x84/0x100 [<c012291b>] do_softirq+0x3b/0x50 [<c0122b69>] irq_exit+0x79/0x90 [<c0106d46>] do_IRQ+0x46/0x80 [<c0104c67>] common_interrupt+0x23/0x28 [<c01025f6>] cpu_idle+0x76/0xa0 [<c02bd8e9>] rest_init+0x49/0x50 [<c037dd55>] start_kernel+0x2b5/0x330 [<00000000>] 0x0 ======================= Code: 00 64 8b 0d 08 f0 3a c0 89 44 24 0c 89 4c 24 08 89 54 24 10 89 7c 24 04 c7 04 24 24 37 33 c0 e8 5c 6f f3 ff 85 db 8b 4e 08 74 83 <8b> 93 c4 00 00 00 8d 83 c9 01 00 00 e9 7c ff ff ff 8d 74 26 00 EIP: [<c01e730b>] spin_bug+0xdb/0xf0 SS:ESP 0068:c0379c54 Kernel panic - not syncing: Fatal exception in interrupt ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-20 22:58 ` Bernard Pidoux @ 2008-03-21 0:28 ` Jarek Poplawski 2008-03-21 9:52 ` Bernard Pidoux 2008-03-21 9:40 ` Bernard Pidoux 2008-03-22 11:36 ` Jarek Poplawski 2 siblings, 1 reply; 39+ messages in thread From: Jarek Poplawski @ 2008-03-21 0:28 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Thu, Mar 20, 2008 at 11:58:35PM +0100, Bernard Pidoux wrote: ... > I recompiled the kernel after turning off the above options. > However there is still a kernel panic documented below. > Does it help ? I wanted to see something more on the stack than lockdep's code only. Will see... It seems some memory debugging is still on and doing this poisoning with '6b', but I can't check now what it is. (Sometimes this could omit some warnings). Thanks, Jarek P. ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-21 0:28 ` Jarek Poplawski @ 2008-03-21 9:52 ` Bernard Pidoux 2008-03-21 11:22 ` Jarek Poplawski 0 siblings, 1 reply; 39+ messages in thread From: Bernard Pidoux @ 2008-03-21 9:52 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Jarek Poplawski wrote: > On Thu, Mar 20, 2008 at 11:58:35PM +0100, Bernard Pidoux wrote: > ... >> I recompiled the kernel after turning off the above options. >> However there is still a kernel panic documented below. >> Does it help ? > > I wanted to see something more on the stack than lockdep's code only. > Will see... It seems some memory debugging is still on and doing this > poisoning with '6b', but I can't check now what it is. (Sometimes this > could omit some warnings). > > Thanks, > Jarek P. The only difference I can see compared to the original spinlock report is this line : [<c01e7409>] _raw_spin_lock+0x69/0x140 Regards, Bernard P. BUG: spinlock bad magic on CPU#0, ax25ipd/3648 BUG: unable to handle kernel paging request at virtual address 6b6b6c2f printing eip: c01e730b *pde = 00000000 Oops: 0000 [#1] SMP Modules linked in: rose netrom mkiss crc16 ax25 mga drm netconsole configfs nfsd exportfs nfs lockd nfs_acl sunrpc af_packet ipv6 snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_pcm_oss snd_mixer_oss binfmt_misc loop usb_storage scsi_mod floppy usbhid snd_ens1371 snd_rawmidi snd_seq_device snd_ac97_codec snd_pcm snd_timer snd uhci_hcd soundcore snd_page_alloc usbcore ne2k_pci ide_cd 8390 ac97_bus intel_agp agpgart genrtc ext3 jbd ide_disk piix ide_core Pid: 3648, comm: ax25ipd Not tainted (2.6.24.3 #8) EIP: 0060:[<c01e730b>] EFLAGS: 00010002 CPU: 0 EIP is at spin_bug+0xdb/0xf0 EAX: 00000032 EBX: 6b6b6b6b ECX: 6b6b6b6b EDX: 00000096 ESI: c0e4bc30 EDI: c0333633 EBP: c5c7bbc4 ESP: c5c7bba0 DS: 007b ES: 007b FS: 00d8 GS: 0033 SS: 0068 Process ax25ipd (pid: 3648, ti=c5c7a000 task=c6abec90 task.ti=c5c7a000) Stack: c0333724 c0333633 00000000 c6abee59 00000e40 00000007 c0e4bc30 00000001 c697ebf8 c5c7bbfc c01e7409 00000000 00000001 c0180640 00000000 00000000 00000003 c0a320b8 00000000 c6abec90 00000282 00000001 c697ebf8 c5c7bc08 Call Trace: [<c010527a>] show_trace_log_lvl+0x1a/0x30 [<c0105339>] show_stack_log_lvl+0xa9/0xd0 [<c0105427>] show_registers+0xc7/0x1b0 [<c010561a>] die+0x10a/0x230 [<c0114855>] do_page_fault+0x2f5/0x600 [<c02c039a>] error_code+0x72/0x78 [<c01e7409>] _raw_spin_lock+0x69/0x140 [<c02c01cc>] _spin_lock_irqsave+0xc/0x20 [<c0117c9b>] __wake_up+0x1b/0x50 [<c024badc>] sock_def_write_space+0x9c/0xc0 [<c024bdcc>] sock_wfree+0x3c/0x50 [<c024dfc7>] skb_release_all+0x57/0x130 [<c024d75b>] __kfree_skb+0xb/0x90 [<c024d7f9>] kfree_skb+0x19/0x40 [<c8c49e33>] ax25_frames_acked+0x43/0x70 [ax25] [<c8c47a30>] ax25_check_iframes_acked+0x40/0x60 [ax25] [<c8c4949f>] ax25_std_frame_in+0x6af/0x890 [ax25] [<c8c46dbb>] ax25_kiss_rcv+0x2bb/0x7c0 [ax25] [<c02531eb>] netif_receive_skb+0x33b/0x420 [<c0255c1b>] process_backlog+0x6b/0xd0 [<c025573f>] net_rx_action+0xff/0x1a0 [<c0122864>] __do_softirq+0x84/0x100 [<c012291b>] do_softirq+0x3b/0x50 [<c0122ae5>] local_bh_enable_ip+0x45/0x50 [<c02c0050>] _spin_unlock_bh+0x10/0x20 [<c8c396ca>] mkiss_receive_buf+0x36a/0x420 [mkiss] [<c020f037>] pty_write+0x47/0x60 [<c020c5f9>] write_chan+0x229/0x330 [<c0209c98>] tty_write+0x128/0x1c0 [<c017346f>] vfs_write+0xaf/0x120 [<c0173aad>] sys_write+0x3d/0x70 [<c0104256>] sysenter_past_esp+0x5f/0x85 ======================= Code: 00 64 8b 0d 08 f0 3a c0 89 44 24 0c 89 4c 24 08 89 54 24 10 89 7c 24 04 c7 04 24 24 37 33 c0 e8 5c 6f f3 ff 85 db 8b 4e 08 74 83 <8b> 93 c4 00 00 00 8d 83 c9 01 00 00 e9 7c ff ff ff 8d 74 26 00 EIP: [<c01e730b>] spin_bug+0xdb/0xf0 SS:ESP 0068:c5c7bba0 Kernel panic - not syncing: Fatal exception in interrupt ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-21 9:52 ` Bernard Pidoux @ 2008-03-21 11:22 ` Jarek Poplawski 0 siblings, 0 replies; 39+ messages in thread From: Jarek Poplawski @ 2008-03-21 11:22 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Fri, Mar 21, 2008 at 10:52:27AM +0100, Bernard Pidoux wrote: ... > The only difference I can see compared to the original spinlock report > is this line : > > [<c01e7409>] _raw_spin_lock+0x69/0x140 Bernard, thanks for these reports. I simply need more time to find various places in ax25 which could matter here. Of course any additional information could help, but these reports mostly repeat the same. BTW, I wonder if it's possible to run this command for closing the session which causes the bug with strace?: strace -o strace.log a_command Regards, Jarek P. ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-20 22:58 ` Bernard Pidoux 2008-03-21 0:28 ` Jarek Poplawski @ 2008-03-21 9:40 ` Bernard Pidoux 2008-03-22 11:36 ` Jarek Poplawski 2 siblings, 0 replies; 39+ messages in thread From: Bernard Pidoux @ 2008-03-21 9:40 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Hi Jarek, Please ignore the spinlock report I sent in this previous message. I simply forgot to apply back your mkiss ax_bump() patch when doing some trials. After applying again your patch and turning off the debug you asked for, I observe exactly the same spinlock I first reported i.e. involving ax25ipd. Sorry for the confusion. Regards, Bernard Bernard Pidoux wrote: > > Jarek Poplawski wrote: >> On Wed, Mar 19, 2008 at 09:57:18PM +0100, Bernard Pidoux wrote: >> ... >>> I also tried to revert Jarek's mkiss ax_bump() patch, but this did >>> not prevent >>> kernel lockup, although this time swapper is involved and not ax25ipd. >> ... >>> BUG: unable to handle kernel paging request at virtual address 6b6b6c2b >>> printing eip: c013fc67 *pde = 00000000 >>> Oops: 0002 [#1] SMP >> >> Well, the rest looks very similarly and not trivial... Probably a >> socket is destructed too soon (or something...). Could you try to >> reproduce this with some debugging turned off, e.g.: >> CONFIG_DEBUG_LOCK_ALLOC, CONFIG_DEBUG_PAGEALLOC, (CONFIG_SLUB_DEBUG?). >> >> Regards, >> Jarek P. > > I recompiled the kernel after turning off the above options. > However there is still a kernel panic documented below. > Does it help ? > > Bernard Pidoux > > > > BUG: spinlock bad magic on CPU#0, swapper/0 > BUG: unable to handle kernel paging request at virtual address 6b6b6c2f > printing eip: c01e730b *pde = 00000000 > Oops: 0000 [#1] SMP > Modules linked in: rose netrom mkiss crc16 ax25 mga drm netconsole > configfs nfsd exportfs nfs lockd nfs_acl sunrpc af_packet ipv6 > snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_pcm_oss > snd_mixer_oss binfmt_misc loop usb_storage scsi_mod floppy usbhid > snd_ens1371 snd_rawmidi snd_seq_device snd_ac97_codec snd_pcm snd_timer > snd uhci_hcd intel_agp ne2k_pci ide_cd usbcore soundcore snd_page_alloc > ac97_bus 8390 agpgart genrtc ext3 jbd ide_disk piix ide_core > > Pid: 0, comm: swapper Not tainted (2.6.24.3 #8) > EIP: 0060:[<c01e730b>] EFLAGS: 00010002 CPU: 0 > EIP is at spin_bug+0xdb/0xf0 > EAX: 0000002f EBX: 6b6b6b6b ECX: 6b6b6b6b EDX: 00000082 > ESI: c07e5a38 EDI: c0333633 EBP: c0379c78 ESP: c0379c54 > DS: 007b ES: 007b FS: 00d8 GS: 0000 SS: 0068 > Process swapper (pid: 0, ti=c0378000 task=c0353340 task.ti=c0378000) > Stack: c0333724 c0333633 00000000 c0353509 00000000 00000010 c07e5a38 > 00000001 > c7b8abb8 c0379cb0 c01e7409 c11448c8 c1147740 00000000 c11448c0 > c0379cb8 > c114775c c11448c8 c1147740 00000000 00000282 00000001 c7b8abb8 > c0379cbc > Call Trace: > [<c010527a>] show_trace_log_lvl+0x1a/0x30 > [<c0105339>] show_stack_log_lvl+0xa9/0xd0 > [<c0105427>] show_registers+0xc7/0x1b0 > [<c010561a>] die+0x10a/0x230 > [<c0114855>] do_page_fault+0x2f5/0x600 > [<c02c039a>] error_code+0x72/0x78 > [<c01e7409>] _raw_spin_lock+0x69/0x140 > [<c02c01cc>] _spin_lock_irqsave+0xc/0x20 > [<c0117c9b>] __wake_up+0x1b/0x50 > [<c024badc>] sock_def_write_space+0x9c/0xc0 > [<c024bdcc>] sock_wfree+0x3c/0x50 > [<c024dfc7>] skb_release_all+0x57/0x130 > [<c024d75b>] __kfree_skb+0xb/0x90 > [<c024d7f9>] kfree_skb+0x19/0x40 > [<c8c49e33>] ax25_frames_acked+0x43/0x70 [ax25] > [<c8c47a30>] ax25_check_iframes_acked+0x40/0x60 [ax25] > [<c8c4949f>] ax25_std_frame_in+0x6af/0x890 [ax25] > [<c8c46dbb>] ax25_kiss_rcv+0x2bb/0x7c0 [ax25] > [<c02531eb>] netif_receive_skb+0x33b/0x420 > [<c0255c1b>] process_backlog+0x6b/0xd0 > [<c025573f>] net_rx_action+0xff/0x1a0 > [<c0122864>] __do_softirq+0x84/0x100 > [<c012291b>] do_softirq+0x3b/0x50 > [<c0122b69>] irq_exit+0x79/0x90 > [<c0106d46>] do_IRQ+0x46/0x80 > [<c0104c67>] common_interrupt+0x23/0x28 > [<c01025f6>] cpu_idle+0x76/0xa0 > [<c02bd8e9>] rest_init+0x49/0x50 > [<c037dd55>] start_kernel+0x2b5/0x330 > [<00000000>] 0x0 > ======================= > Code: 00 64 8b 0d 08 f0 3a c0 89 44 24 0c 89 4c 24 08 89 54 24 10 89 7c > 24 04 c7 04 24 24 37 33 c0 e8 5c 6f f3 ff 85 db 8b 4e 08 74 83 <8b> 93 > c4 00 00 00 8d 83 c9 01 00 00 e9 7c ff ff ff 8d 74 26 00 > EIP: [<c01e730b>] spin_bug+0xdb/0xf0 SS:ESP 0068:c0379c54 > Kernel panic - not syncing: Fatal exception in interrupt > > > -- > To unsubscribe from this list: send the line "unsubscribe netdev" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > > ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-20 22:58 ` Bernard Pidoux 2008-03-21 0:28 ` Jarek Poplawski 2008-03-21 9:40 ` Bernard Pidoux @ 2008-03-22 11:36 ` Jarek Poplawski 2008-03-23 17:00 ` Bernard Pidoux 2 siblings, 1 reply; 39+ messages in thread From: Jarek Poplawski @ 2008-03-22 11:36 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Thu, Mar 20, 2008 at 11:58:35PM +0100, Bernard Pidoux wrote: ... > BUG: spinlock bad magic on CPU#0, swapper/0 > BUG: unable to handle kernel paging request at virtual address 6b6b6c2f > printing eip: c01e730b *pde = 00000000 > Oops: 0000 [#1] SMP ... > Pid: 0, comm: swapper Not tainted (2.6.24.3 #8) > EIP: 0060:[<c01e730b>] EFLAGS: 00010002 CPU: 0 > EIP is at spin_bug+0xdb/0xf0 ... Hi, Bernard, could you try this debugging patch? Thanks, Jarek P. --- diff -Nurp 2.6.24.3-/net/core/sock.c 2.6.24.3+/net/core/sock.c --- 2.6.24.3-/net/core/sock.c 2008-01-24 23:58:37.000000000 +0100 +++ 2.6.24.3+/net/core/sock.c 2008-03-22 12:10:10.000000000 +0100 @@ -1517,14 +1517,21 @@ static void sock_def_write_space(struct * progress. --DaveM */ if ((atomic_read(&sk->sk_wmem_alloc) << 1) <= sk->sk_sndbuf) { - if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) + if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) { + if (!sk->sk_socket || sk->sk_socket->sk != sk) { + WARN_ON_ONCE(1); + sk->sk_socket = NULL; + sk->sk_sleep = NULL; + goto out; + } wake_up_interruptible(sk->sk_sleep); + } /* Should agree with poll, otherwise some programs break */ if (sock_writeable(sk)) sk_wake_async(sk, 2, POLL_OUT); } - +out: read_unlock(&sk->sk_callback_lock); } ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-22 11:36 ` Jarek Poplawski @ 2008-03-23 17:00 ` Bernard Pidoux 2008-03-24 20:51 ` Jarek Poplawski 0 siblings, 1 reply; 39+ messages in thread From: Bernard Pidoux @ 2008-03-23 17:00 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Jarek Poplawski wrote: > On Thu, Mar 20, 2008 at 11:58:35PM +0100, Bernard Pidoux wrote: > ... >> BUG: spinlock bad magic on CPU#0, swapper/0 >> BUG: unable to handle kernel paging request at virtual address 6b6b6c2f >> printing eip: c01e730b *pde = 00000000 >> Oops: 0000 [#1] SMP > ... >> Pid: 0, comm: swapper Not tainted (2.6.24.3 #8) >> EIP: 0060:[<c01e730b>] EFLAGS: 00010002 CPU: 0 >> EIP is at spin_bug+0xdb/0xf0 > ... > > Hi, > > Bernard, could you try this debugging patch? > > Thanks, > Jarek P. > > --- > > diff -Nurp 2.6.24.3-/net/core/sock.c 2.6.24.3+/net/core/sock.c > --- 2.6.24.3-/net/core/sock.c 2008-01-24 23:58:37.000000000 +0100 > +++ 2.6.24.3+/net/core/sock.c 2008-03-22 12:10:10.000000000 +0100 > @@ -1517,14 +1517,21 @@ static void sock_def_write_space(struct > * progress. --DaveM > */ > if ((atomic_read(&sk->sk_wmem_alloc) << 1) <= sk->sk_sndbuf) { > - if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) > + if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) { > + if (!sk->sk_socket || sk->sk_socket->sk != sk) { > + WARN_ON_ONCE(1); > + sk->sk_socket = NULL; > + sk->sk_sleep = NULL; > + goto out; > + } > wake_up_interruptible(sk->sk_sleep); > + } > > /* Should agree with poll, otherwise some programs break */ > if (sock_writeable(sk)) > sk_wake_async(sk, 2, POLL_OUT); > } > - > +out: > read_unlock(&sk->sk_callback_lock); > } > Hi Jarek, Here is the result of your patch : WARNING: at net/core/sock.c:1522 sock_def_write_space() Pid: 3452, comm: mkiss Not tainted 2.6.24.3 #2 [<c010513a>] show_trace_log_lvl+0x1a/0x30 [<c0105b52>] show_trace+0x12/0x20 [<c01064ac>] dump_stack+0x6c/0x80 [<c024d54b>] sock_def_write_space+0x10b/0x120 [<c024d93a>] sock_wfree+0x3a/0x40 [<c024fafd>] skb_release_all+0x4d/0xf0 [<c024f2ab>] __kfree_skb+0xb/0x90 [<c024f349>] kfree_skb+0x19/0x30 [<c8cb5e37>] ax_xmit+0xf7/0x360 [mkiss] [<c0255367>] dev_hard_start_xmit+0x207/0x270 [<c02657f4>] __qdisc_run+0x54/0x1a0 [<c0257bac>] dev_queue_xmit+0x25c/0x330 [<c8cc8a77>] ax25_queue_xmit+0x47/0x70 [ax25] [<c8cc8b65>] ax25_transmit_buffer+0xc5/0x110 [ax25] [<c8cc8c2d>] ax25_send_iframe+0x7d/0x110 [ax25] [<c8cc8d70>] ax25_kick+0xb0/0x1b0 [ax25] [<c8cc9e29>] ax25_std_frame_in+0x69/0x890 [ax25] [<c8cc7dba>] ax25_kiss_rcv+0x2ba/0x7b0 [ax25] [<c0254cc4>] netif_receive_skb+0x244/0x2e0 [<c0257835>] process_backlog+0x75/0xe0 [<c025734b>] net_rx_action+0x12b/0x1d0 [<c011d595>] __do_softirq+0x55/0xc0 [<c011d647>] do_softirq+0x47/0x50 [<c011d9f5>] local_bh_enable_ip+0x95/0xe0 [<c02babe5>] _spin_unlock_bh+0x25/0x30 [<c8cb56b0>] mkiss_receive_buf+0x360/0x420 [mkiss] [<c020dfe7>] pty_write+0x47/0x60 [<c020b5b2>] write_chan+0x222/0x330 [<c0208c76>] tty_write+0x126/0x1b0 [<c01728df>] vfs_write+0xaf/0x120 [<c0172e2d>] sys_write+0x3d/0x70 [<c010412a>] sysenter_past_esp+0x5f/0xa5 ======================= Happy Easter, Bernard Pidoux ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-23 17:00 ` Bernard Pidoux @ 2008-03-24 20:51 ` Jarek Poplawski 2008-03-25 13:23 ` Bernard Pidoux 0 siblings, 1 reply; 39+ messages in thread From: Jarek Poplawski @ 2008-03-24 20:51 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Sun, Mar 23, 2008 at 06:00:17PM +0100, Bernard Pidoux wrote: ... > Here is the result of your patch : > > > WARNING: at net/core/sock.c:1522 sock_def_write_space() > Pid: 3452, comm: mkiss Not tainted 2.6.24.3 #2 ... Thanks. Here is one more (to apply after the previous one). Happy Holidays... Jarek P. --- diff -Nurp 2.6.24.3-with1/include/net/sock.h 2.6.24.3-with2/include/net/sock.h --- 2.6.24.3-with1/include/net/sock.h 2008-01-24 23:58:37.000000000 +0100 +++ 2.6.24.3-with2/include/net/sock.h 2008-03-24 21:14:43.000000000 +0100 @@ -263,6 +263,7 @@ struct sock { int (*sk_backlog_rcv)(struct sock *sk, struct sk_buff *skb); void (*sk_destruct)(struct sock *sk); + int sk_ax25_debug; }; /* diff -Nurp 2.6.24.3-with1/net/ax25/af_ax25.c 2.6.24.3-with2/net/ax25/af_ax25.c --- 2.6.24.3-with1/net/ax25/af_ax25.c 2008-01-24 23:58:37.000000000 +0100 +++ 2.6.24.3-with2/net/ax25/af_ax25.c 2008-03-23 00:53:51.000000000 +0100 @@ -936,6 +936,7 @@ struct sock *ax25_make_new(struct sock * } sk->sk_protinfo = ax25; + sk->sk_ax25_debug = 1; ax25->sk = sk; return sk; diff -Nurp 2.6.24.3-with1/net/core/sock.c 2.6.24.3-with2/net/core/sock.c --- 2.6.24.3-with1/net/core/sock.c 2008-03-22 12:10:10.000000000 +0100 +++ 2.6.24.3-with2/net/core/sock.c 2008-03-24 21:43:46.000000000 +0100 @@ -1519,6 +1519,9 @@ static void sock_def_write_space(struct if ((atomic_read(&sk->sk_wmem_alloc) << 1) <= sk->sk_sndbuf) { if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) { if (!sk->sk_socket || sk->sk_socket->sk != sk) { + if (net_ratelimit()) + printk(KERN_INFO "sk_ax25_debug = %d, %p\n", + sk->sk_ax25_debug, sk->sk_socket); WARN_ON_ONCE(1); sk->sk_socket = NULL; sk->sk_sleep = NULL; ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-24 20:51 ` Jarek Poplawski @ 2008-03-25 13:23 ` Bernard Pidoux 2008-03-25 20:51 ` Jarek Poplawski 2008-03-26 18:35 ` Jarek Poplawski 0 siblings, 2 replies; 39+ messages in thread From: Bernard Pidoux @ 2008-03-25 13:23 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Jarek Poplawski wrote: > On Sun, Mar 23, 2008 at 06:00:17PM +0100, Bernard Pidoux wrote: > ... >> Here is the result of your patch : >> >> >> WARNING: at net/core/sock.c:1522 sock_def_write_space() >> Pid: 3452, comm: mkiss Not tainted 2.6.24.3 #2 > ... > > Thanks. Here is one more (to apply after the previous one). > > Happy Holidays... > Jarek P. > > --- > > diff -Nurp 2.6.24.3-with1/include/net/sock.h 2.6.24.3-with2/include/net/sock.h > --- 2.6.24.3-with1/include/net/sock.h 2008-01-24 23:58:37.000000000 +0100 > +++ 2.6.24.3-with2/include/net/sock.h 2008-03-24 21:14:43.000000000 +0100 > @@ -263,6 +263,7 @@ struct sock { > int (*sk_backlog_rcv)(struct sock *sk, > struct sk_buff *skb); > void (*sk_destruct)(struct sock *sk); > + int sk_ax25_debug; > }; > > /* > diff -Nurp 2.6.24.3-with1/net/ax25/af_ax25.c 2.6.24.3-with2/net/ax25/af_ax25.c > --- 2.6.24.3-with1/net/ax25/af_ax25.c 2008-01-24 23:58:37.000000000 +0100 > +++ 2.6.24.3-with2/net/ax25/af_ax25.c 2008-03-23 00:53:51.000000000 +0100 > @@ -936,6 +936,7 @@ struct sock *ax25_make_new(struct sock * > } > > sk->sk_protinfo = ax25; > + sk->sk_ax25_debug = 1; > ax25->sk = sk; > > return sk; > diff -Nurp 2.6.24.3-with1/net/core/sock.c 2.6.24.3-with2/net/core/sock.c > --- 2.6.24.3-with1/net/core/sock.c 2008-03-22 12:10:10.000000000 +0100 > +++ 2.6.24.3-with2/net/core/sock.c 2008-03-24 21:43:46.000000000 +0100 > @@ -1519,6 +1519,9 @@ static void sock_def_write_space(struct > if ((atomic_read(&sk->sk_wmem_alloc) << 1) <= sk->sk_sndbuf) { > if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) { > if (!sk->sk_socket || sk->sk_socket->sk != sk) { > + if (net_ratelimit()) > + printk(KERN_INFO "sk_ax25_debug = %d, %p\n", > + sk->sk_ax25_debug, sk->sk_socket); > WARN_ON_ONCE(1); > sk->sk_socket = NULL; > sk->sk_sleep = NULL; > > After applying this patch I did not see any sk_ax25_debug = 1 into /var/log/messages. It was always = 0. Mar 25 12:03:07 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 12:11:55 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 12:13:07 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 12:16:39 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Mar 25 12:18:57 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Mar 25 12:23:12 f6bvp-9 kernel: sk_ax25_debug = 0, c08de580 Mar 25 12:26:50 f6bvp-9 kernel: sk_ax25_debug = 0, c08de580 Mar 25 12:32:34 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Mar 25 12:33:14 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 12:33:57 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Mar 25 12:36:56 f6bvp-9 kernel: sk_ax25_debug = 0, c08de580 Mar 25 12:43:16 f6bvp-9 kernel: sk_ax25_debug = 0, c08de580 Mar 25 12:48:34 f6bvp-9 kernel: sk_ax25_debug = 0, c08de580 Mar 25 12:48:57 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Mar 25 12:53:10 f6bvp-9 kernel: sk_ax25_debug = 0, c08de580 Mar 25 13:00:31 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 13:03:24 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 13:03:56 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Mar 25 13:10:52 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 13:13:22 f6bvp-9 kernel: sk_ax25_debug = 0, c08de040 Here is an extract of /var/log/kernel/warnings.log Mar 25 11:54:04 f6bvp-9 kernel: NET: Registered protocol family 3 Mar 25 11:54:04 f6bvp-9 kernel: mkiss: AX.25 Multikiss, Hans Albas PE1AYX Mar 25 11:54:04 f6bvp-9 mkiss[3443]: starting Mar 25 11:54:04 f6bvp-9 kernel: mkiss: ax0: crc mode is auto. Mar 25 11:54:04 f6bvp-9 kernel: ADDRCONF(NETDEV_CHANGE): ax0: link becomes ready Mar 25 11:54:04 f6bvp-9 kernel: mkiss: ax1: crc mode is auto. Mar 25 11:54:04 f6bvp-9 kernel: ADDRCONF(NETDEV_CHANGE): ax1: link becomes ready Mar 25 11:54:05 f6bvp-9 mkiss[3455]: starting Mar 25 11:54:05 f6bvp-9 kernel: mkiss: ax2: crc mode is auto. Mar 25 11:54:05 f6bvp-9 kernel: ADDRCONF(NETDEV_CHANGE): ax2: link becomes ready Mar 25 11:54:05 f6bvp-9 kernel: mkiss: ax3: crc mode is auto. Mar 25 11:54:05 f6bvp-9 kernel: ADDRCONF(NETDEV_CHANGE): ax3: link becomes ready Mar 25 11:54:11 f6bvp-9 kdm_greet[3470]: Can't open default user face Mar 25 11:54:22 f6bvp-9 kernel: mkiss: ax4: crc mode is auto. Mar 25 11:54:22 f6bvp-9 kernel: ADDRCONF(NETDEV_CHANGE): ax4: link becomes ready Mar 25 11:54:22 f6bvp-9 kissattach[3510]: AX.25 port 4 bound to device ax4 Mar 25 11:54:22 f6bvp-9 ax25ipd: Current configuration: Mar 25 11:54:22 f6bvp-9 ax25ipd: socket udp on port 10093 Mar 25 11:54:22 f6bvp-9 ax25ipd: mode tnc Mar 25 11:54:22 f6bvp-9 ax25ipd: device /dev/ttyq1 Mar 25 11:54:22 f6bvp-9 ax25ipd: speed 115200 Mar 25 11:54:22 f6bvp-9 ax25ipd: loglevel 2 Mar 25 11:54:22 f6bvp-9 ax25ipd: 6 active routes. Mar 25 11:54:22 f6bvp-9 ax25ipd: F6BVP-11 192.168.0.66 udp 10093 0 Mar 25 11:54:22 f6bvp-9 ax25ipd: F6BVP-10 192.168.0.66 udp 10093 1 Mar 25 11:54:22 f6bvp-9 ax25ipd: F6BVP-7 192.168.0.103 udp 10093 0 Mar 25 11:54:22 f6bvp-9 ax25ipd: F6BVP-6 192.168.0.103 udp 10093 1 Mar 25 11:54:22 f6bvp-9 ax25ipd: F6BVP-12 192.168.0.66 udp 10093 0 Mar 25 11:54:22 f6bvp-9 ax25ipd: VA2BBS 216.239.82.253 udp 10093 1 va2bbs.homeip.net Mar 25 11:54:22 f6bvp-9 ax25ipd: 0 parameters Mar 25 11:54:26 f6bvp-9 kernel: NET: Registered protocol family 6 Mar 25 11:54:27 f6bvp-9 kernel: netromd uses obsolete (PF_INET,SOCK_PACKET) Mar 25 11:54:27 f6bvp-9 netromd[3553]: starting -- Mar 25 12:03:07 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 12:03:07 f6bvp-9 kernel: WARNING: at net/core/sock.c:1559 sock_def_write_space() Mar 25 12:03:07 f6bvp-9 kernel: Pid: 3443, comm: mkiss Not tainted 2.6.24.3 #3 Mar 25 12:03:07 f6bvp-9 kernel: [<c010513a>] show_trace_log_lvl+0x1a/0x30 Mar 25 12:03:07 f6bvp-9 kernel: [<c0105b52>] show_trace+0x12/0x20 Mar 25 12:03:07 f6bvp-9 kernel: [<c01064ac>] dump_stack+0x6c/0x80 Mar 25 12:03:07 f6bvp-9 kernel: [<c024d5d0>] sock_def_write_space+0x150/0x160 Mar 25 12:03:07 f6bvp-9 kernel: [<c024d9ba>] sock_wfree+0x3a/0x40 Mar 25 12:03:07 f6bvp-9 kernel: [<c024fb7d>] skb_release_all+0x4d/0xf0 Mar 25 12:03:07 f6bvp-9 kernel: [<c024f32b>] __kfree_skb+0xb/0x90 Mar 25 12:03:07 f6bvp-9 kernel: [<c024f3c9>] kfree_skb+0x19/0x30 Mar 25 12:03:07 f6bvp-9 kernel: [<c8c79e03>] ax25_frames_acked+0x43/0x70 [ax25] Mar 25 12:03:07 f6bvp-9 kernel: [<c8c77a10>] ax25_check_iframes_acked+0x40/0x60 [ax25] Mar 25 12:03:07 f6bvp-9 kernel: [<c8c7946f>] ax25_std_frame_in+0x6af/0x890 [ax25] Mar 25 12:03:07 f6bvp-9 kernel: [<c8c76dba>] ax25_kiss_rcv+0x2ba/0x7b0 [ax25] Mar 25 12:03:07 f6bvp-9 kernel: [<c0254d44>] netif_receive_skb+0x244/0x2e0 Mar 25 12:03:07 f6bvp-9 kernel: [<c02578b5>] process_backlog+0x75/0xe0 Mar 25 12:03:07 f6bvp-9 kernel: [<c02573cb>] net_rx_action+0x12b/0x1d0 Mar 25 12:03:07 f6bvp-9 kernel: [<c011d595>] __do_softirq+0x55/0xc0 Mar 25 12:03:07 f6bvp-9 kernel: [<c011d647>] do_softirq+0x47/0x50 Mar 25 12:03:07 f6bvp-9 kernel: [<c011d9f5>] local_bh_enable_ip+0x95/0xe0 Mar 25 12:03:07 f6bvp-9 kernel: [<c02bac55>] _spin_unlock_bh+0x25/0x30 Mar 25 12:03:07 f6bvp-9 kernel: [<c8c696b0>] mkiss_receive_buf+0x360/0x420 [mkiss] Mar 25 12:03:07 f6bvp-9 kernel: [<c020dfe7>] pty_write+0x47/0x60 Mar 25 12:03:07 f6bvp-9 kernel: [<c020b5b2>] write_chan+0x222/0x330 Mar 25 12:03:07 f6bvp-9 kernel: [<c0208c76>] tty_write+0x126/0x1b0 Mar 25 12:03:07 f6bvp-9 kernel: [<c01728df>] vfs_write+0xaf/0x120 Mar 25 12:03:07 f6bvp-9 kernel: [<c0172e2d>] sys_write+0x3d/0x70 Mar 25 12:03:07 f6bvp-9 kernel: [<c010412a>] sysenter_past_esp+0x5f/0xa5 Mar 25 12:03:07 f6bvp-9 kernel: ======================= Mar 25 12:09:01 f6bvp-9 crond[3928]: (root) CMD ([ -d /var/lib/php ] && find /var/lib/php/ -type f -mmin +$(/usr/lib/php/maxlifetime) -print0 | xargs -r -0 rm) Mar 25 12:11:55 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 Mar 25 12:13:07 f6bvp-9 kernel: sk_ax25_debug = 0, c08de2e0 I forgot to mention an obvious thing : since the WARN_ON_ONCE patch there is no more kernel panic. But you knew that of course. Many thanks for your help. I am prepared for the next step you probably want to explore. If it is easier for you, to prepare a patch, I can upgrade to 2.6.24.4. Best regards, Bernard P. ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-25 13:23 ` Bernard Pidoux @ 2008-03-25 20:51 ` Jarek Poplawski 2008-03-26 18:35 ` Jarek Poplawski 1 sibling, 0 replies; 39+ messages in thread From: Jarek Poplawski @ 2008-03-25 20:51 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Tue, Mar 25, 2008 at 02:23:46PM +0100, Bernard Pidoux wrote: ... > I am prepared for the next step you probably want to explore. > > If it is easier for you, to prepare a patch, I can upgrade to 2.6.24.4. I need some time yet; it looks like 2.6.24.4 doesn't collide with these patches, but upgrade could be reasonable for other reasons. Best regards, Jarek P. ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-25 13:23 ` Bernard Pidoux 2008-03-25 20:51 ` Jarek Poplawski @ 2008-03-26 18:35 ` Jarek Poplawski 2008-03-28 8:24 ` Bernard Pidoux ` (2 more replies) 1 sibling, 3 replies; 39+ messages in thread From: Jarek Poplawski @ 2008-03-26 18:35 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Tue, Mar 25, 2008 at 02:23:46PM +0100, Bernard Pidoux wrote: ... > I am prepared for the next step you probably want to explore. ... OK, here is the next try. (Apply after all previous patches to any 2.6.24.x; there would be more noise, so revert it after catching some data.) Thanks, Jarek P. (debugging patch #3) --- diff -Nurp 2.6.24.3-with2/include/net/sock.h 2.6.24.3-with3/include/net/sock.h --- 2.6.24.3-with2/include/net/sock.h 2008-03-24 21:14:43.000000000 +0100 +++ 2.6.24.3-with3/include/net/sock.h 2008-03-26 19:10:33.000000000 +0100 @@ -1414,4 +1414,20 @@ extern int sysctl_optmem_max; extern __u32 sysctl_wmem_default; extern __u32 sysctl_rmem_default; +static inline int sock_debug_ax25(struct sk_buff *skb, struct sock *ax25_sk) +{ + struct sock *sk = skb->sk; + + if (sk && sk->sk_socket && sk->sk_socket->sk != sk) { + if (net_ratelimit()) + printk(KERN_INFO "AX25: %s, %d, %p, %p, %p, %p, %p\n", + __FUNCTION__, __LINE__, sk, sk->sk_socket, + sk->sk_socket->sk, ax25_sk, + ax25_sk == NULL ? NULL : ax25_sk->sk_socket); + skb->destructor = NULL; + return 1; + } + return 0; +} + #endif /* _SOCK_H */ diff -Nurp 2.6.24.3-with2/net/ax25/af_ax25.c 2.6.24.3-with3/net/ax25/af_ax25.c --- 2.6.24.3-with2/net/ax25/af_ax25.c 2008-03-23 00:53:51.000000000 +0100 +++ 2.6.24.3-with3/net/ax25/af_ax25.c 2008-03-26 18:52:54.000000000 +0100 @@ -952,6 +952,8 @@ static int ax25_release(struct socket *s sock_hold(sk); sock_orphan(sk); + if (net_ratelimit()) + printk(KERN_INFO "AX25- %s, %d, %p, %p\n", __FUNCTION__, __LINE__, sk, sock); lock_sock(sk); ax25 = ax25_sk(sk); @@ -1372,12 +1374,16 @@ static int ax25_accept(struct socket *so newsk = skb->sk; newsk->sk_socket = newsock; newsk->sk_sleep = &newsock->wait; + newsk->sk_ax25_debug = 2; /* Now attach up the new socket */ kfree_skb(skb); sk->sk_ack_backlog--; newsock->sk = newsk; newsock->state = SS_CONNECTED; + if (net_ratelimit()) + printk(KERN_INFO "AX25= %s, %d, %p, %p, %p\n", + __FUNCTION__, __LINE__, newsk, sock, newsock); out: release_sock(sk); diff -Nurp 2.6.24.3-with2/net/ax25/ax25_out.c 2.6.24.3-with3/net/ax25/ax25_out.c --- 2.6.24.3-with2/net/ax25/ax25_out.c 2008-03-26 16:38:23.000000000 +0100 +++ 2.6.24.3-with3/net/ax25/ax25_out.c 2008-03-26 18:54:47.000000000 +0100 @@ -98,6 +98,7 @@ ax25_cb *ax25_send_frame(struct sk_buff ax25_start_heartbeat(ax25); + sock_debug_ax25(skb, ax25->sk); ax25_output(ax25, paclen, skb); return ax25; /* We had to create it */ @@ -176,11 +177,13 @@ void ax25_output(ax25_cb *ax25, int pacl } skb_pull(skb, len); + sock_debug_ax25(skbn, ax25->sk); skb_queue_tail(&ax25->write_queue, skbn); /* Throw it on the queue */ } kfree_skb(skb); } else { + sock_debug_ax25(skb, ax25->sk); skb_queue_tail(&ax25->write_queue, skb); /* Throw it on the queue */ } @@ -274,6 +277,8 @@ void ax25_kick(ax25_cb *ax25) ax25->vs = start; do { + sock_debug_ax25(skb, ax25->sk); + if ((skbn = skb_clone(skb, GFP_ATOMIC)) == NULL) { skb_queue_head(&ax25->write_queue, skb); break; @@ -308,6 +313,8 @@ void ax25_kick(ax25_cb *ax25) /* * Requeue the original data frame. */ + + sock_debug_ax25(skb, ax25->sk); skb_queue_tail(&ax25->ack_queue, skb); } while (!last && (skb = skb_dequeue(&ax25->write_queue)) != NULL); diff -Nurp 2.6.24.3-with2/net/ax25/ax25_subr.c 2.6.24.3-with3/net/ax25/ax25_subr.c --- 2.6.24.3-with2/net/ax25/ax25_subr.c 2008-01-24 23:58:37.000000000 +0100 +++ 2.6.24.3-with3/net/ax25/ax25_subr.c 2008-03-26 19:23:03.000000000 +0100 @@ -56,6 +56,7 @@ void ax25_frames_acked(ax25_cb *ax25, un if (ax25->va != nr) { while (skb_peek(&ax25->ack_queue) != NULL && ax25->va != nr) { skb = skb_dequeue(&ax25->ack_queue); + sock_debug_ax25(skb, ax25->sk); kfree_skb(skb); ax25->va = (ax25->va + 1) % ax25->modulus; } diff -Nurp 2.6.24.3-with2/net/core/sock.c 2.6.24.3-with3/net/core/sock.c --- 2.6.24.3-with2/net/core/sock.c 2008-03-24 21:43:46.000000000 +0100 +++ 2.6.24.3-with3/net/core/sock.c 2008-03-26 19:14:37.000000000 +0100 @@ -1520,8 +1520,10 @@ static void sock_def_write_space(struct if (sk->sk_sleep && waitqueue_active(sk->sk_sleep)) { if (!sk->sk_socket || sk->sk_socket->sk != sk) { if (net_ratelimit()) - printk(KERN_INFO "sk_ax25_debug = %d, %p\n", - sk->sk_ax25_debug, sk->sk_socket); + printk(KERN_INFO "sk_ax25_debug = %d, %d, %d, %d, %p, %p, %p\n", + sk->sk_ax25_debug, sk->sk_family, + (int)sk->sk_protocol, sk->sk_type, sk->sk_socket, + sk->sk_socket == NULL ? NULL : sk->sk_socket->sk, sk); WARN_ON_ONCE(1); sk->sk_socket = NULL; sk->sk_sleep = NULL; ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-26 18:35 ` Jarek Poplawski @ 2008-03-28 8:24 ` Bernard Pidoux 2008-03-28 8:27 ` Bernard Pidoux 2008-03-28 12:07 ` Jarek Poplawski 2 siblings, 0 replies; 39+ messages in thread From: Bernard Pidoux @ 2008-03-28 8:24 UTC (permalink / raw) To: Linux Netdev List Hi Jarek, Thank you for the new debugging patch. I think I have collected enough data for you to make some interesting deductions. Here are the data collected and filtered with cat /var/log/kernel/info.log | grep AX25 I have noticed that there is no AX25= result, although the system ran a few hours. Mar 27 15:50:49 f6bvp-9 kernel: AX25- ax25_release, 952, c340fad0, c513a820 Mar 27 15:50:54 f6bvp-9 kernel: AX25- ax25_release, 952, c0f07b10, c0cc0820 Mar 27 15:50:55 f6bvp-9 kernel: AX25- ax25_release, 952, c34676d8, c0cc0d60 Mar 27 15:50:55 f6bvp-9 kernel: AX25- ax25_release, 952, c340e240, c0cc0820 Mar 27 15:50:55 f6bvp-9 kernel: AX25- ax25_release, 952, c0f07b10, c0cc02e0 Mar 27 15:50:55 f6bvp-9 kernel: AX25- ax25_release, 952, c0f07b10, c0cc0d60 Mar 27 15:50:55 f6bvp-9 kernel: AX25- ax25_release, 952, c0f07b10, c0cc02e0 Mar 27 15:51:17 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c148aac0 Mar 27 15:51:22 f6bvp-9 kernel: AX25- ax25_release, 952, c0d482c0, c148a2e0 Mar 27 15:51:22 f6bvp-9 kernel: AX25- ax25_release, 952, c0805758, c148a580 Mar 27 15:51:22 f6bvp-9 kernel: AX25- ax25_release, 952, c0804f28, c148a820 Mar 27 15:51:22 f6bvp-9 kernel: AX25- ax25_release, 952, c08046f8, c0cfdd60 Mar 27 15:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0804f28, c148a820 Mar 27 15:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d48af0, c148a820 Mar 27 15:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c148aac0 Mar 27 15:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0804f28, c148a820 Mar 27 15:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0804f28, c148a040 Mar 27 15:51:37 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c148aac0 Mar 27 15:51:47 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c148aac0 Mar 27 15:51:47 f6bvp-9 kernel: AX25- ax25_release, 952, c0d486d8, c0cfdd60 Mar 27 15:52:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d486d8, c0cfdd60 Mar 27 15:52:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d486d8, c0cfdd60 Mar 27 15:53:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c0cfd820 Mar 27 15:53:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c0cfd820 Mar 27 15:54:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c0cfdd60 Mar 27 15:54:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0fc4ad0, c0cfdd60 Mar 27 15:55:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 15:55:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 15:56:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c0892580 Mar 27 15:57:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c0892580 Mar 27 15:58:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 15:58:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 15:58:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 15:58:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 15:59:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c0892580 Mar 27 16:02:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 16:02:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 16:03:07 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bb7640, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 16:03:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d28718, c08922e0 Mar 27 16:03:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d28718, c08922e0 Mar 27 16:04:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c0892040 Mar 27 16:04:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c0892040 Mar 27 16:05:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 16:06:27 f6bvp-9 kernel: AX25- ax25_release, 952, c0d49738, c08922e0 Mar 27 16:07:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:07:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:08:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:08:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:09:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c0892580 Mar 27 16:09:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c0892580 Mar 27 16:10:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2758, c0892580 Mar 27 16:11:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2758, c0892580 Mar 27 16:12:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:13:21 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bb6610, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 16:13:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c08922e0 Mar 27 16:13:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c08922e0 Mar 27 16:14:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:14:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:15:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:16:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:16:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bb6e28, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 16:17:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:17:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:18:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 16:18:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 16:19:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c56c8f68, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 16:19:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 16:20:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 16:21:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 16:21:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 16:22:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 16:22:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 16:23:03 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c56c9780, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 16:23:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:23:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:24:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 16:24:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 16:25:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:28:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:28:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:29:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:29:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:30:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:30:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:31:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:32:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:33:05 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7790190, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 16:33:07 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77989c8, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 16:33:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 16:34:06 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77991e0, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 16:34:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:35:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:36:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 16:37:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 16:38:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:39:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:40:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:41:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:41:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:42:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:42:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:43:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c2180510, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 16:43:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:43:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 16:44:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:44:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:45:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:46:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:47:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 16:48:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:48:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:48:56 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77981b0, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 16:49:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c2181540, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 16:49:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:49:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Mar 27 16:50:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:50:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d798, c08922e0 Mar 27 16:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d798, c08922e0 Mar 27 16:51:33 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:52:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d798, c08922e0 Mar 27 16:52:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d798, c08922e0 Mar 27 16:52:48 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:53:10 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77909a8, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 16:53:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:53:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:54:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892040 Mar 27 16:55:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 16:55:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 16:56:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:57:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 16:58:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:58:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:59:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892580 Mar 27 16:59:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c0892580 Mar 27 17:00:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 17:00:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 17:00:56 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77911c0, c50c2d60, 6b6b6b6b, 00000000, 00000000 Mar 27 17:01:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c50c2d60 Mar 27 17:02:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c50c2d60 Mar 27 17:03:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3432c88, c50c2d60, 6b6b6b6b, 00000000, 00000000 Mar 27 17:03:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:03:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:04:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3432470, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 17:04:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:04:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:05:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892040 Mar 27 17:05:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892040 Mar 27 17:06:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:06:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:07:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:10:19 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c2180d28, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:10:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:10:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:11:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:11:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:12:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:12:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:13:08 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c0894770, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:13:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:13:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c0892580 Mar 27 17:14:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:14:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2b70, c08922e0 Mar 27 17:15:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:16:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:16:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:16:56 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c56c8750, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:17:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:17:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:18:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:18:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:19:03 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c695b440, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 17:19:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:19:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:20:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:20:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:21:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:21:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:22:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:23:01 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c695a410, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:23:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:23:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:24:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:24:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:25:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:25:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:26:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:26:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:27:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:28:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:29:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:30:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:30:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:31:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:31:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 17:32:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:32:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:32:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c67b34c0, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:33:05 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c695ac28, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 17:33:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:33:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:34:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c67b2490, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 17:34:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:34:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:35:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 17:37:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:37:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:38:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 17:38:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 17:39:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:39:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:40:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:40:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:41:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:41:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:41:46 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c67b2ca8, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 17:42:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:42:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:43:08 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bcb520, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 17:43:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:44:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:45:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:45:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:46:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:46:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 17:47:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:47:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 17:48:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:48:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:48:56 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bcad08, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 17:49:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bca4f0, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:49:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:49:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:50:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:51:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c08922e0 Mar 27 17:51:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c08922e0 Mar 27 17:51:34 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:52:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892580 Mar 27 17:52:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892580 Mar 27 17:52:49 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:53:02 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bc35a0, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 17:53:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:54:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:55:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:55:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:56:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:58:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 17:59:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 17:59:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 18:00:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:00:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:00:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bc2570, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 18:01:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:01:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:02:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 18:02:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 18:03:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bc2d88, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 18:03:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 18:03:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 18:04:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c6a3d5e0, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 18:04:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 18:05:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892040 Mar 27 18:06:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:06:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:07:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 18:07:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 18:08:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:11:27 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 18:12:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:12:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:13:07 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c6a3c5b0, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 18:13:11 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c6a3cdc8, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 18:13:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:13:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c0892580 Mar 27 18:14:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 18:14:28 f6bvp-9 kernel: AX25- ax25_release, 952, c340ea70, c08922e0 Mar 27 18:15:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892580 Mar 27 18:15:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892580 Mar 27 18:16:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:16:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:16:56 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bc5660, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 18:17:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:17:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:18:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:19:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bc4630, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 18:19:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:20:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:21:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 18:21:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 18:22:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:22:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:23:14 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bc4e48, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 18:23:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:23:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:24:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:26:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:26:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:27:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:28:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:29:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892580 Mar 27 18:30:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892580 Mar 27 18:31:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:31:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:32:27 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892580 Mar 27 18:32:59 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bd0ee8, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 18:33:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bd1700, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 18:33:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:36:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:37:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:38:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:40:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:40:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:41:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:41:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:42:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:42:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:43:12 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bd06d0, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 18:43:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:43:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:44:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:45:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:46:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 18:47:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:47:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 18:48:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:48:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:48:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c67bb7a0, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 18:49:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:50:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:51:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c08922e0 Mar 27 18:51:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c08922e0 Mar 27 18:51:36 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:52:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892580 Mar 27 18:52:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892580 Mar 27 18:52:51 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:53:02 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c67ba770, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 18:53:27 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:54:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:54:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:55:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:56:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:57:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:58:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c08922e0 Mar 27 18:59:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 18:59:28 f6bvp-9 kernel: AX25- ax25_release, 952, c34672c0, c0892040 Mar 27 19:00:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c50c2d60 Mar 27 19:00:58 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c0a43080, c50c2d60, 6b6b6b6b, 00000000, 00000000 Mar 27 19:01:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c50c2d60 Mar 27 19:02:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c50c2d60 Mar 27 19:03:05 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c0a42868, c50c2d60, 6b6b6b6b, 00000000, 00000000 Mar 27 19:03:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 19:03:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 19:04:05 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c0a42050, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 19:04:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 19:04:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 19:05:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 19:05:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 19:06:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:06:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:07:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 19:08:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:09:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:10:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 19:13:08 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c67baf88, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 19:13:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 19:13:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892580 Mar 27 19:14:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:15:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 19:16:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 19:16:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bb3140, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 19:17:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 19:17:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892580 Mar 27 19:18:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 19:18:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 19:19:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bb2110, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 19:19:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 19:19:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 19:20:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:22:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:23:20 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7bb2928, c08922e0, 6b6b6b6b, 00000000, 00000000 Mar 27 19:23:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:23:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:24:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 19:24:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 19:25:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c08922e0 Mar 27 19:28:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 19:29:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3467af0, c0892040 Mar 27 19:30:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 19:30:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c0892040 Mar 27 19:31:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:31:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 19:32:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:32:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:32:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c6a9a9c8, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 19:33:01 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c6a9b1e0, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 19:33:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:33:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:34:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c6a9a1b0, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 19:34:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:34:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:35:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 19:36:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:37:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 19:38:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 19:38:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 19:39:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 19:39:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 19:40:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:40:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:41:23 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bd3240, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 19:41:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:43:13 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bd2a28, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 19:43:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:44:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Mar 27 19:45:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892040 Mar 27 19:45:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892040 Mar 27 19:46:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 19:46:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 19:47:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892580 Mar 27 19:47:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c0892580 Mar 27 19:48:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 19:48:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 19:48:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c3bd2210, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 19:49:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a032a0, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 19:49:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 19:50:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:50:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:51:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c509c2e0 Mar 27 19:51:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c509c2e0 Mar 27 19:51:37 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:52:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c509c2e0 Mar 27 19:52:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8d380, c509c2e0 Mar 27 19:52:52 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:53:11 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a02a88, c509c2e0, 6b6b6b6b, 00000000, 00000000 Mar 27 19:53:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:53:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:54:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 19:54:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 19:55:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:55:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 19:56:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 19:57:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 20:00:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 20:00:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 20:00:57 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a02270, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 20:01:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 20:01:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 20:02:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 20:02:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892580 Mar 27 20:03:03 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a05320, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 20:03:27 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 20:04:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a042f0, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 20:04:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 20:04:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 20:05:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c040 Mar 27 20:08:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 20:08:28 f6bvp-9 kernel: AX25- ax25_release, 952, c3466ea8, c509c2e0 Mar 27 20:09:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 20:09:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 20:10:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c040 Mar 27 20:11:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 20:11:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 20:11:42 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a04b08, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 20:12:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 20:12:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c509c2e0 Mar 27 20:13:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cf68, c0892580 Mar 27 20:13:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cf68, c0892580 Mar 27 20:14:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cf68, c0892040 Mar 27 20:14:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cf68, c0892040 Mar 27 20:15:16 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a18370, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 20:15:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2758, c509c040 Mar 27 20:16:28 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa2758, c509c040 Mar 27 20:17:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa37b8, c0892580 Mar 27 20:17:46 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c1a18b88, c509c040, 6b6b6b6b, 00000000, 00000000 Mar 27 20:18:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7b28d48, c0892580 Mar 27 20:18:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7b28d48, c0892580 Mar 27 20:19:04 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c7b9d400, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 20:19:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 20:19:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 20:20:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7b28d48, c0892040 Mar 27 20:20:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7b28d48, c0892040 Mar 27 20:21:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 20:21:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892580 Mar 27 20:22:28 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8c738, c0892040 Regards, Bernard P. ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-26 18:35 ` Jarek Poplawski 2008-03-28 8:24 ` Bernard Pidoux @ 2008-03-28 8:27 ` Bernard Pidoux 2008-03-28 12:07 ` Jarek Poplawski 2 siblings, 0 replies; 39+ messages in thread From: Bernard Pidoux @ 2008-03-28 8:27 UTC (permalink / raw) To: Linux Netdev List Hi Jarek, Here is the result of cat /var/log/messages | grep -B1 -A50 core/sock No event was detected before 16:33. -- Mar 27 16:33:05 f6bvp-9 kernel: sk_ax25_debug = 0, 11, 0, 5, c08922e0, 6b6b6b6b, c7790190 Mar 27 16:33:05 f6bvp-9 kernel: WARNING: at net/core/sock.c:1561 sock_def_write_space() Mar 27 16:33:05 f6bvp-9 kernel: Pid: 3454, comm: mkiss Not tainted 2.6.24.4 #4 Mar 27 16:33:05 f6bvp-9 kernel: [<c010513a>] show_trace_log_lvl+0x1a/0x30 Mar 27 16:33:05 f6bvp-9 kernel: [<c0105b52>] show_trace+0x12/0x20 Mar 27 16:33:05 f6bvp-9 kernel: [<c01064ac>] dump_stack+0x6c/0x80 Mar 27 16:33:05 f6bvp-9 kernel: [<c024d68b>] sock_def_write_space+0x17b/0x190 Mar 27 16:33:05 f6bvp-9 kernel: [<c024da7a>] sock_wfree+0x3a/0x40 Mar 27 16:33:05 f6bvp-9 kernel: [<c024fc3d>] skb_release_all+0x4d/0xf0 Mar 27 16:33:05 f6bvp-9 kernel: [<c024f3eb>] __kfree_skb+0xb/0x90 Mar 27 16:33:05 f6bvp-9 kernel: [<c024f489>] kfree_skb+0x19/0x30 Mar 27 16:33:05 f6bvp-9 kernel: [<c8cbfe37>] ax_xmit+0xf7/0x360 [mkiss] Mar 27 16:33:05 f6bvp-9 kernel: [<c02554a7>] dev_hard_start_xmit+0x207/0x270 Mar 27 16:33:05 f6bvp-9 kernel: [<c0265934>] __qdisc_run+0x54/0x1a0 Mar 27 16:33:05 f6bvp-9 kernel: [<c0257cec>] dev_queue_xmit+0x25c/0x330 Mar 27 16:33:05 f6bvp-9 kernel: [<c8befa77>] ax25_queue_xmit+0x47/0x70 [ax25] Mar 27 16:33:05 f6bvp-9 kernel: [<c8befb65>] ax25_transmit_buffer+0xc5/0x110 [ax25] Mar 27 16:33:05 f6bvp-9 kernel: [<c8befc2d>] ax25_send_iframe+0x7d/0x110 [ax25] Mar 27 16:33:06 f6bvp-9 kernel: [<c8befd70>] ax25_kick+0xb0/0x2b0 [ax25] Mar 27 16:33:06 f6bvp-9 kernel: [<c8bf10c9>] ax25_std_frame_in+0x69/0x890 [ax25] Mar 27 16:33:06 f6bvp-9 kernel: [<c8beedba>] ax25_kiss_rcv+0x2ba/0x7b0 [ax25] Mar 27 16:33:06 f6bvp-9 kernel: [<c0254e04>] netif_receive_skb+0x244/0x2e0 Mar 27 16:33:06 f6bvp-9 kernel: [<c0257975>] process_backlog+0x75/0xe0 Mar 27 16:33:06 f6bvp-9 kernel: [<c025748b>] net_rx_action+0x12b/0x1d0 Mar 27 16:33:06 f6bvp-9 kernel: [<c011d5c5>] __do_softirq+0x55/0xc0 Mar 27 16:33:06 f6bvp-9 kernel: [<c011d677>] do_softirq+0x47/0x50 Mar 27 16:33:06 f6bvp-9 kernel: [<c011da25>] local_bh_enable_ip+0x95/0xe0 Mar 27 16:33:06 f6bvp-9 kernel: [<c02bad05>] _spin_unlock_bh+0x25/0x30 Mar 27 16:33:06 f6bvp-9 kernel: [<c8cbf6b0>] mkiss_receive_buf+0x360/0x420 [mkiss] Mar 27 16:33:06 f6bvp-9 kernel: [<c020e097>] pty_write+0x47/0x60 Mar 27 16:33:06 f6bvp-9 kernel: [<c020b662>] write_chan+0x222/0x330 Mar 27 16:33:06 f6bvp-9 kernel: [<c0208d26>] tty_write+0x126/0x1b0 Mar 27 16:33:06 f6bvp-9 kernel: [<c017298f>] vfs_write+0xaf/0x120 Mar 27 16:33:06 f6bvp-9 kernel: [<c0172edd>] sys_write+0x3d/0x70 Mar 27 16:33:06 f6bvp-9 kernel: [<c010412a>] sysenter_past_esp+0x5f/0xa5 Mar 27 16:33:06 f6bvp-9 kernel: ======================= Mar 27 16:33:07 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77989c8, c0892580, 6b6b6b6b, 00000000, 00000000 Mar 27 16:33:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8cb50, c08922e0 Mar 27 16:33:27 f6bvp-9 last message repeated 3 times Mar 27 16:34:06 f6bvp-9 kernel: AX25: sock_debug_ax25, 1424, c77991e0, c0892040, 6b6b6b6b, 00000000, 00000000 Mar 27 16:34:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:35:27 f6bvp-9 last message repeated 2 times Mar 27 16:35:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c08922e0 Mar 27 16:36:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 16:37:27 f6bvp-9 last message repeated 2 times Mar 27 16:37:27 f6bvp-9 kernel: AX25- ax25_release, 952, c6aa33a0, c0892040 Mar 27 16:38:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:38:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:39:01 f6bvp-9 crond[4300]: (root) CMD ([ -d /var/lib/php ] && find /var/lib/php/ -type f -mmin +$(/usr/lib/php/maxlifetime) -print0 | xargs -r -0 rm) Mar 27 16:39:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:39:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c0892040 Mar 27 16:40:27 f6bvp-9 kernel: AX25- ax25_release, 952, c7d8dbb0, c08922e0 Regards, Bernard P. ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-26 18:35 ` Jarek Poplawski 2008-03-28 8:24 ` Bernard Pidoux 2008-03-28 8:27 ` Bernard Pidoux @ 2008-03-28 12:07 ` Jarek Poplawski 2008-03-29 12:04 ` Bernard Pidoux 2 siblings, 1 reply; 39+ messages in thread From: Jarek Poplawski @ 2008-03-28 12:07 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Wed, Mar 26, 2008 at 07:35:38PM +0100, Jarek Poplawski wrote: ... > OK, here is the next try. (Apply after all previous patches to any 2.6.24.x; > there would be more noise, so revert it after catching some data.) Bernard, I fucked it up with this #3: (changed macro to function at the last minute). I'm currently reading this, and maybe I'll figure out something, but if it's not a big problem for you to repeat this after adding this #4 (after all previous) it should be 'a bit' easier. (But no need to hurry.) Very sorry, Jarek P. (debugging patch #4) --- diff -Nurp 2.6.24.3-with3/include/net/sock.h 2.6.24.3-with4/include/net/sock.h --- 2.6.24.3-with3/include/net/sock.h 2008-03-26 19:10:33.000000000 +0100 +++ 2.6.24.3-with4/include/net/sock.h 2008-03-28 12:42:19.000000000 +0100 @@ -1414,20 +1414,18 @@ extern int sysctl_optmem_max; extern __u32 sysctl_wmem_default; extern __u32 sysctl_rmem_default; -static inline int sock_debug_ax25(struct sk_buff *skb, struct sock *ax25_sk) -{ - struct sock *sk = skb->sk; - - if (sk && sk->sk_socket && sk->sk_socket->sk != sk) { - if (net_ratelimit()) - printk(KERN_INFO "AX25: %s, %d, %p, %p, %p, %p, %p\n", - __FUNCTION__, __LINE__, sk, sk->sk_socket, - sk->sk_socket->sk, ax25_sk, - ax25_sk == NULL ? NULL : ax25_sk->sk_socket); - skb->destructor = NULL; - return 1; - } - return 0; -} +#define sock_debug_ax25(__skb, __ax25_sk) \ +({ \ + struct sock *__sk = __skb->sk; \ + \ + if (__sk && __sk->sk_socket && __sk->sk_socket->sk != __sk) { \ + if (net_ratelimit()) \ + printk(KERN_INFO "AX25: %s, %d, %p, %p, %p, %p, %p\n", \ + __FUNCTION__, __LINE__, __sk, __sk->sk_socket, \ + __sk->sk_socket->sk, __ax25_sk, \ + __ax25_sk == NULL ? NULL : __ax25_sk->sk_socket); \ + __skb->destructor = NULL; \ + } \ +}) #endif /* _SOCK_H */ diff -Nurp 2.6.24.3-with3/net/ax25/af_ax25.c 2.6.24.3-with4/net/ax25/af_ax25.c --- 2.6.24.3-with3/net/ax25/af_ax25.c 2008-03-26 18:52:54.000000000 +0100 +++ 2.6.24.3-with4/net/ax25/af_ax25.c 2008-03-28 12:50:35.000000000 +0100 @@ -866,6 +866,9 @@ static int ax25_create(struct net *net, ax25->sk = sk; + if (net_ratelimit()) + printk(KERN_INFO "AX25+ %s, %d, %p, %p\n", __FUNCTION__, __LINE__, sk, sock); + return 0; } @@ -939,6 +942,10 @@ struct sock *ax25_make_new(struct sock * sk->sk_ax25_debug = 1; ax25->sk = sk; + if (net_ratelimit()) + printk(KERN_INFO "AX25; %s, %d, %p, %p\n", + __FUNCTION__, __LINE__, sk, sk->sk_socket); + return sk; } ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-28 12:07 ` Jarek Poplawski @ 2008-03-29 12:04 ` Bernard Pidoux 2008-03-29 12:24 ` Jarek Poplawski 0 siblings, 1 reply; 39+ messages in thread From: Bernard Pidoux @ 2008-03-29 12:04 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Jarek Poplawski wrote: > On Wed, Mar 26, 2008 at 07:35:38PM +0100, Jarek Poplawski wrote: > ... >> OK, here is the next try. (Apply after all previous patches to any 2.6.24.x; >> there would be more noise, so revert it after catching some data.) > > Bernard, I fucked it up with this #3: (changed macro to function at > the last minute). I'm currently reading this, and maybe I'll figure > out something, but if it's not a big problem for you to repeat this > after adding this #4 (after all previous) it should be 'a bit' easier. > (But no need to hurry.) > > Very sorry, > Jarek P. > > (debugging patch #4) Please find below an extract of /var/log/messages The time of interest is around 12:03 Mar 29 11:52:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a820 Mar 29 11:52:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f0a820 Mar 29 11:52:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a820 Mar 29 11:52:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f0a820 Mar 29 11:52:59 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c6ae2bc8, c0f0a040, 6b6b6b6b, 00000000, 00000000 Mar 29 11:53:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a580 Mar 29 11:53:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f0a580 Mar 29 11:53:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a580 Mar 29 11:53:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f0a580 Mar 29 11:54:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a580 Mar 29 11:54:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f0a580 Mar 29 11:54:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a580 Mar 29 11:54:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f0a580 Mar 29 11:55:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:55:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:55:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:55:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:56:52 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:56:52 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:56:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:56:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:56:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:56:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:56:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:56:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:57:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:57:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:57:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:57:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:58:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:58:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:58:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:58:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:59:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:59:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 11:59:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 11:59:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 12:00:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d58040 Mar 29 12:00:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d58040 Mar 29 12:00:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d58040 Mar 29 12:00:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d58040 Mar 29 12:01:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d58040 Mar 29 12:01:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d58040 Mar 29 12:01:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d58040 Mar 29 12:01:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d58040 Mar 29 12:02:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 12:02:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 12:02:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f60820 Mar 29 12:02:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0f60820 Mar 29 12:03:07 f6bvp-9 kernel: AX25: ax25_kick, 279, c65e43f0, c0d58040, 6b6b6b6b, 00000000, 00000000 Mar 29 12:03:07 f6bvp-9 kernel: sk_ax25_debug = 0, 11, 0, 5, c0d58040, 6b6b6b6b, c65e43f0 Mar 29 12:03:07 f6bvp-9 kernel: WARNING: at net/core/sock.c:1561 sock_def_write_space() Mar 29 12:03:07 f6bvp-9 kernel: Pid: 3447, comm: mkiss Not tainted 2.6.24.4 #6 Mar 29 12:03:07 f6bvp-9 kernel: [<c010513a>] show_trace_log_lvl+0x1a/0x30 Mar 29 12:03:07 f6bvp-9 kernel: [<c0105b52>] show_trace+0x12/0x20 Mar 29 12:03:07 f6bvp-9 kernel: [<c01064ac>] dump_stack+0x6c/0x80 Mar 29 12:03:07 f6bvp-9 kernel: [<c024d68b>] sock_def_write_space+0x17b/0x190 Mar 29 12:03:07 f6bvp-9 kernel: [<c024da7a>] sock_wfree+0x3a/0x40 Mar 29 12:03:07 f6bvp-9 kernel: [<c024fc3d>] skb_release_all+0x4d/0xf0 Mar 29 12:03:07 f6bvp-9 kernel: [<c024f3eb>] __kfree_skb+0xb/0x90 Mar 29 12:03:07 f6bvp-9 kernel: [<c024f489>] kfree_skb+0x19/0x30 Mar 29 12:03:07 f6bvp-9 kernel: [<c8c6ae37>] ax_xmit+0xf7/0x360 [mkiss] Mar 29 12:03:07 f6bvp-9 kernel: [<c0255497>] dev_hard_start_xmit+0x207/0x270 Mar 29 12:03:07 f6bvp-9 kernel: [<c0265924>] __qdisc_run+0x54/0x1a0 Mar 29 12:03:07 f6bvp-9 kernel: [<c0257cdc>] dev_queue_xmit+0x25c/0x330 Mar 29 12:03:07 f6bvp-9 kernel: [<c8c77a77>] ax25_queue_xmit+0x47/0x70 [ax25] Mar 29 12:03:07 f6bvp-9 kernel: [<c8c77b65>] ax25_transmit_buffer+0xc5/0x110 [ax25] Mar 29 12:03:07 f6bvp-9 kernel: [<c8c77c2d>] ax25_send_iframe+0x7d/0x110 [ax25] Mar 29 12:03:07 f6bvp-9 kernel: [<c8c77d70>] ax25_kick+0xb0/0x2a0 [ax25] Mar 29 12:03:07 f6bvp-9 kernel: [<c8c790a9>] ax25_std_frame_in+0x69/0x890 [ax25] Mar 29 12:03:07 f6bvp-9 kernel: [<c8c76dba>] ax25_kiss_rcv+0x2ba/0x7b0 [ax25] Mar 29 12:03:07 f6bvp-9 kernel: [<c0254df4>] netif_receive_skb+0x244/0x2e0 Mar 29 12:03:07 f6bvp-9 kernel: [<c0257965>] process_backlog+0x75/0xe0 Mar 29 12:03:07 f6bvp-9 kernel: [<c025747b>] net_rx_action+0x12b/0x1d0 Mar 29 12:03:07 f6bvp-9 kernel: [<c011d5c5>] __do_softirq+0x55/0xc0 Mar 29 12:03:07 f6bvp-9 kernel: [<c011d677>] do_softirq+0x47/0x50 Mar 29 12:03:07 f6bvp-9 kernel: [<c011da25>] local_bh_enable_ip+0x95/0xe0 Mar 29 12:03:07 f6bvp-9 kernel: [<c02bace5>] _spin_unlock_bh+0x25/0x30 Mar 29 12:03:07 f6bvp-9 kernel: [<c8c6a6b0>] mkiss_receive_buf+0x360/0x420 [mkiss] Mar 29 12:03:07 f6bvp-9 kernel: [<c020e097>] pty_write+0x47/0x60 Mar 29 12:03:07 f6bvp-9 kernel: [<c020b662>] write_chan+0x222/0x330 Mar 29 12:03:07 f6bvp-9 kernel: [<c0208d26>] tty_write+0x126/0x1b0 Mar 29 12:03:07 f6bvp-9 kernel: [<c017298f>] vfs_write+0xaf/0x120 Mar 29 12:03:07 f6bvp-9 kernel: [<c0172edd>] sys_write+0x3d/0x70 Mar 29 12:03:07 f6bvp-9 kernel: [<c010412a>] sysenter_past_esp+0x5f/0xa5 Mar 29 12:03:07 f6bvp-9 kernel: ======================= Mar 29 12:03:52 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:03:52 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:03:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:03:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:03:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:03:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:03:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:03:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:04:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:04:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:04:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:04:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:05:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:05:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:05:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:05:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:06:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:06:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:06:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:06:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:07:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:07:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:07:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:07:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:08:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:08:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:08:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:08:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:09:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:09:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:09:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d58040 Mar 29 12:09:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d58040 Mar 29 12:10:52 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:10:52 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:10:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:10:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:10:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:10:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:10:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:10:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:11:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:11:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:11:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c64f5a90, c0d582e0 Mar 29 12:11:53 f6bvp-9 kernel: AX25- ax25_release, 959, c64f5a90, c0d582e0 Mar 29 12:11:59 f6bvp-9 netromd[3557]: netromr: SIOCADDRT: Invalid argument Mar 29 12:12:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d582e0 Mar 29 12:12:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d582e0 Mar 29 12:12:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d582e0 Mar 29 12:12:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d582e0 Mar 29 12:12:55 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c65e4c08, c0d58040, 6b6b6b6b, 00000000, 00000000 Mar 29 12:12:57 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c7ba74a0, c0d582e0, 6b6b6b6b, 00000000, 00000000 Mar 29 12:13:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0d582e0 Mar 29 12:13:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, c0d582e0 Regards, Bernard P. ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-29 12:04 ` Bernard Pidoux @ 2008-03-29 12:24 ` Jarek Poplawski 2008-03-30 8:43 ` Bernard Pidoux ` (2 more replies) 0 siblings, 3 replies; 39+ messages in thread From: Jarek Poplawski @ 2008-03-29 12:24 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Sat, Mar 29, 2008 at 01:04:16PM +0100, Bernard Pidoux wrote: ... > Please find below an extract of /var/log/messages > The time of interest is around 12:03 > > > Mar 29 11:52:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a820 > Mar 29 11:52:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, > c0f0a820 > Mar 29 11:52:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c15602e0, c0f0a820 > Mar 29 11:52:53 f6bvp-9 kernel: AX25- ax25_release, 959, c15602e0, > c0f0a820 > Mar 29 11:52:59 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c6ae2bc8, > c0f0a040, 6b6b6b6b, 00000000, 00000000 ... Thanks Bernard! ...On the other hand, if you could hold these patches a while yet and maybe find more of these "AX25:" it should be very helpful (of course with other AX25* lines). Regards, Jarek P. ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-29 12:24 ` Jarek Poplawski @ 2008-03-30 8:43 ` Bernard Pidoux 2008-03-30 9:16 ` Jarek Poplawski 2008-03-30 9:00 ` Bernard Pidoux [not found] ` <47EE38BA.9090500@free.fr> 2 siblings, 1 reply; 39+ messages in thread From: Bernard Pidoux @ 2008-03-30 8:43 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski [-- Attachment #1: Type: text/plain, Size: 140 bytes --] Hi Jarek, please find attached another collection of data from /var/log/kernel/info.log that I bziped for it is rather large. Bernard [-- Attachment #2: AX25_kernel_debug_info.bz2 --] [-- Type: application/x-bzip, Size: 4904 bytes --] ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-30 8:43 ` Bernard Pidoux @ 2008-03-30 9:16 ` Jarek Poplawski 2008-03-30 17:38 ` Bernard Pidoux 0 siblings, 1 reply; 39+ messages in thread From: Jarek Poplawski @ 2008-03-30 9:16 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Sun, Mar 30, 2008 at 10:43:07AM +0200, Bernard Pidoux wrote: > Hi Jarek, Hi Bernard, > > please find attached another collection of data from > /var/log/kernel/info.log that I bziped for it is rather large. Thanks again. It looks like ROSE sockets aren't released properly. Here is a try to fix this. Could you test it with all previous patches present? Regards, Jarek P. (patch #5) --- diff -Nurp 2.6.24.4-/net/rose/af_rose.c 2.6.24.4+/net/rose/af_rose.c --- 2.6.24.4-/net/rose/af_rose.c 2008-01-24 23:58:37.000000000 +0100 +++ 2.6.24.4+/net/rose/af_rose.c 2008-03-30 10:53:19.000000000 +0200 @@ -599,17 +599,24 @@ static int rose_release(struct socket *s if (sk == NULL) return 0; + sock_hold(sk); + sock_orphan(sk); + lock_sock(sk); rose = rose_sk(sk); switch (rose->state) { case ROSE_STATE_0: + release_sock(sk); rose_disconnect(sk, 0, -1, -1); + lock_sock(sk); rose_destroy_socket(sk); break; case ROSE_STATE_2: rose->neighbour->use--; + release_sock(sk); rose_disconnect(sk, 0, -1, -1); + lock_sock(sk); rose_destroy_socket(sk); break; @@ -634,6 +641,8 @@ static int rose_release(struct socket *s } sock->sk = NULL; + release_sock(sk); + sock_put(sk); return 0; } ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-30 9:16 ` Jarek Poplawski @ 2008-03-30 17:38 ` Bernard Pidoux 2008-03-30 18:49 ` Jarek Poplawski 0 siblings, 1 reply; 39+ messages in thread From: Bernard Pidoux @ 2008-03-30 17:38 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski [-- Attachment #1: Type: text/plain, Size: 2588 bytes --] Jarek Poplawski wrote: > On Sun, Mar 30, 2008 at 10:43:07AM +0200, Bernard Pidoux wrote: >> Hi Jarek, > > Hi Bernard, >> please find attached another collection of data from >> /var/log/kernel/info.log that I bziped for it is rather large. > > Thanks again. It looks like ROSE sockets aren't released properly. > Here is a try to fix this. Could you test it with all previous patches > present? > > Regards, > Jarek P. > > (patch #5) > --- > > diff -Nurp 2.6.24.4-/net/rose/af_rose.c 2.6.24.4+/net/rose/af_rose.c > --- 2.6.24.4-/net/rose/af_rose.c 2008-01-24 23:58:37.000000000 +0100 > +++ 2.6.24.4+/net/rose/af_rose.c 2008-03-30 10:53:19.000000000 +0200 > @@ -599,17 +599,24 @@ static int rose_release(struct socket *s > > if (sk == NULL) return 0; > > + sock_hold(sk); > + sock_orphan(sk); > + lock_sock(sk); > rose = rose_sk(sk); > > switch (rose->state) { > case ROSE_STATE_0: > + release_sock(sk); > rose_disconnect(sk, 0, -1, -1); > + lock_sock(sk); > rose_destroy_socket(sk); > break; > > case ROSE_STATE_2: > rose->neighbour->use--; > + release_sock(sk); > rose_disconnect(sk, 0, -1, -1); > + lock_sock(sk); > rose_destroy_socket(sk); > break; > > @@ -634,6 +641,8 @@ static int rose_release(struct socket *s > } > > sock->sk = NULL; > + release_sock(sk); > + sock_put(sk); > > return 0; > } > -- Jarek, It looks like you hit the right target ! There is no more warnings and no more ax25_frames_acked or sk_ax25_debug. We only get ax25_create and ax25_release data, plus ax25_make_new when there is an AX25 connexion. cat /var/log/messages | grep 'Mar 30 17' | grep AX... Mar 30 17:00:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6738, c3300040 Mar 30 17:00:58 f6bvp-9 kernel: AX25- ax25_release, 959, c73a6738, c3300040 Mar 30 17:00:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6738, c3300040 Mar 30 17:00:58 f6bvp-9 kernel: AX25- ax25_release, 959, c73a6738, c3300040 Mar 30 17:01:23 f6bvp-9 kernel: AX25; ax25_make_new, 943, c73a6738, c762a820 Mar 30 17:01:23 f6bvp-9 kernel: AX25= ax25_accept, 1386, c73a6738, c762a820, c3300040 Mar 30 17:01:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6f68, c7673ac0 Mar 30 17:01:58 f6bvp-9 kernel: AX25- ax25_release, 959, c73a6f68, c7673ac0 Mar 30 17:01:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6f68, c7673ac0 Please excuse the following questions if you find they are too naive. Could you tell us how did you suspect ROSE socket from the data collected ? and why improperly released ROSE sockets could interfere with AX25 ? Regards, Bernard P. [-- Attachment #2: AX25.kernel.debug5.bz2 --] [-- Type: application/x-bzip, Size: 869 bytes --] ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-30 17:38 ` Bernard Pidoux @ 2008-03-30 18:49 ` Jarek Poplawski 0 siblings, 0 replies; 39+ messages in thread From: Jarek Poplawski @ 2008-03-30 18:49 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski On Sun, Mar 30, 2008 at 07:38:51PM +0200, Bernard Pidoux wrote: ... > There is no more warnings and no more ax25_frames_acked or > sk_ax25_debug. > > We only get ax25_create and ax25_release data, plus ax25_make_new when > there is an AX25 connexion. > > cat /var/log/messages | grep 'Mar 30 17' | grep AX... > Mar 30 17:00:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6738, c3300040 > Mar 30 17:00:58 f6bvp-9 kernel: AX25- ax25_release, 959, c73a6738, c3300040 > Mar 30 17:00:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6738, c3300040 > Mar 30 17:00:58 f6bvp-9 kernel: AX25- ax25_release, 959, c73a6738, c3300040 > Mar 30 17:01:23 f6bvp-9 kernel: AX25; ax25_make_new, 943, c73a6738, c762a820 > Mar 30 17:01:23 f6bvp-9 kernel: AX25= ax25_accept, 1386, c73a6738, > c762a820, c3300040 > Mar 30 17:01:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6f68, c7673ac0 > Mar 30 17:01:58 f6bvp-9 kernel: AX25- ax25_release, 959, c73a6f68, c7673ac0 > Mar 30 17:01:58 f6bvp-9 kernel: AX25+ ax25_create, 866, c73a6f68, c7673ac0 Yes, if it's only like this, it's OK. > > > Please excuse the following questions if you find they are too naive. > Could you tell us how did you suspect ROSE socket from the data > collected ? and why improperly released ROSE sockets could interfere > with AX25 ? No problem! Patch #3 added to "sk_ax25_debug =" sk->sk_family as the 2nd number, and 11 according to include/linux/socket.h means AF_ROSE. sock_def_write() function in net/core/sock.c where the OOPs triggered runs some cleaning on sockets when their skbs are kfreed, but this shouldn't be done after socket had been closed (sock_orphan() removes some pointers). When ROSE sends it's skbs with ax25_send_frame(), they are added to AX25 queues, and kfreed after transmitting. If it's after ROSE socket had been released, but not properly updated, the cleaning is done on kfreed memory not used by the socket anymore. Cheers, Jarek P. ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2008-03-29 12:24 ` Jarek Poplawski 2008-03-30 8:43 ` Bernard Pidoux @ 2008-03-30 9:00 ` Bernard Pidoux [not found] ` <47EE38BA.9090500@free.fr> 2 siblings, 0 replies; 39+ messages in thread From: Bernard Pidoux @ 2008-03-30 9:00 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Francois Romieu, Linux Netdev List, Jarek Poplawski Jarek, I enlarged grep filter in order to grab AX.25 data that might be interesting too. And this is the result : # cat /var/log/kernel/info.log | grep AX... Mar 30 10:19:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c74322e0 Mar 30 10:19:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c74322e0 Mar 30 10:19:13 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c2aa4130, c74322e0, 6b6b6b6b, 00000000, 00000000 Mar 30 10:19:59 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7a70, c74322e0 Mar 30 10:19:59 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7a70, c74322e0 Mar 30 10:20:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7a70, c74322e0 Mar 30 10:20:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7a70, c74322e0 Mar 30 10:20:59 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c74322e0 Mar 30 10:20:59 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c74322e0 Mar 30 10:21:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c74322e0 Mar 30 10:21:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c74322e0 Mar 30 10:21:59 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c74322e0 Mar 30 10:21:59 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c74322e0 Mar 30 10:22:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c74322e0 Mar 30 10:22:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c74322e0 Mar 30 10:22:37 f6bvp-9 kernel: AX25; ax25_make_new, 943, c14e7a70, c51ad820 Mar 30 10:22:37 f6bvp-9 kernel: AX25= ax25_accept, 1386, c14e7a70, c51ad820, c74322e0 Mar 30 10:22:38 f6bvp-9 kernel: AX.25: sendto: Addresses built. Mar 30 10:22:38 f6bvp-9 kernel: AX.25: sendto: building packet. Mar 30 10:22:38 f6bvp-9 kernel: AX.25: Appending user data Mar 30 10:22:38 f6bvp-9 kernel: AX.25: Transmitting buffer Mar 30 10:22:39 f6bvp-9 kernel: AX.25: sendto: Addresses built. Mar 30 10:22:39 f6bvp-9 kernel: AX.25: sendto: building packet. Mar 30 10:22:39 f6bvp-9 kernel: AX.25: Appending user data Mar 30 10:22:39 f6bvp-9 kernel: AX.25: Transmitting buffer Mar 30 10:22:39 f6bvp-9 kernel: AX.25: sendto: Addresses built. Mar 30 10:22:39 f6bvp-9 kernel: AX.25: sendto: building packet. Mar 30 10:22:39 f6bvp-9 kernel: AX.25: Appending user data Mar 30 10:22:39 f6bvp-9 kernel: AX.25: Transmitting buffer Mar 30 10:22:48 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c0f72290, c744a580, 6b6b6b6b, 00000000, 00000000 Mar 30 10:22:59 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7658, c744a580 Mar 30 10:22:59 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7658, c744a580 Mar 30 10:23:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7658, c744a580 Mar 30 10:23:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7658, c744a580 Mar 30 10:23:59 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6a10, c744a580 Mar 30 10:24:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6a10, c744a580 Mar 30 10:24:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6a10, c744a580 Mar 30 10:24:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6a10, c744a580 Mar 30 10:24:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7658, c744a580 Mar 30 10:24:53 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7658, c744a580 Mar 30 10:24:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7658, c744a580 Mar 30 10:24:53 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7658, c744a580 Mar 30 10:25:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7658, c744a580 Mar 30 10:25:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7658, c744a580 Mar 30 10:25:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e7658, c744a580 Mar 30 10:25:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7658, c744a580 Mar 30 10:26:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c744a580 Mar 30 10:26:00 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c744a580 Mar 30 10:26:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c744a580 Mar 30 10:26:00 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c744a580 Mar 30 10:27:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c744a580 Mar 30 10:27:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c744a580 Mar 30 10:27:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c744a580 Mar 30 10:27:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c744a580 Mar 30 10:28:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6a10, c744a580 Mar 30 10:28:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6a10, c744a580 Mar 30 10:28:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6a10, c744a580 Mar 30 10:28:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6a10, c744a580 Mar 30 10:29:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c744a580 Mar 30 10:29:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c744a580 Mar 30 10:29:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c744a580 Mar 30 10:29:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c744a580 Mar 30 10:30:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6e28, c77bd040 Mar 30 10:30:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6e28, c77bd040 Mar 30 10:30:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c7527040 Mar 30 10:30:00 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c7527040 Mar 30 10:31:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6a10, c744a580 Mar 30 10:31:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6a10, c744a580 Mar 30 10:31:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c14e6a10, c744a580 Mar 30 10:31:00 f6bvp-9 kernel: AX25- ax25_release, 959, c14e6a10, c744a580 Mar 30 10:31:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c744a580 Mar 30 10:31:53 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c744a580 Mar 30 10:31:53 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c744a580 Mar 30 10:31:53 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c744a580 Mar 30 10:32:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c744a580 Mar 30 10:32:00 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c744a580 Mar 30 10:32:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c744a580 Mar 30 10:32:00 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c744a580 Mar 30 10:32:38 f6bvp-9 kernel: AX.25: sendto: Addresses built. Mar 30 10:32:38 f6bvp-9 kernel: AX.25: sendto: building packet. Mar 30 10:32:38 f6bvp-9 kernel: AX.25: Appending user data Mar 30 10:32:38 f6bvp-9 kernel: AX.25: Transmitting buffer Mar 30 10:32:39 f6bvp-9 kernel: AX25- ax25_release, 959, c14e7a70, c74322e0 Mar 30 10:32:52 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c0f72aa8, c74322e0, 6b6b6b6b, 00000000, 00000000 Mar 30 10:32:52 f6bvp-9 kernel: AX25: ax25_frames_acked, 59, c0f732c0, c779cd60, 6b6b6b6b, 00000000, 00000000 Mar 30 10:33:00 f6bvp-9 kernel: AX25+ ax25_create, 866, c5afc8b0, c779cd60 Mar 30 10:33:00 f6bvp-9 kernel: AX25- ax25_release, 959, c5afc8b0, c779cd60 # Regards, Bernard ^ permalink raw reply [flat|nested] 39+ messages in thread
[parent not found: <47EE38BA.9090500@free.fr>]
[parent not found: <20080329130451.GC3407@ami.dom.local>]
[parent not found: <47EF6479.7030702@free.fr>]
[parent not found: <20080330115958.GA4975@ami.dom.local>]
* Re: [AX25] kernel panic [not found] ` <20080330115958.GA4975@ami.dom.local> @ 2008-04-01 20:37 ` Bernard Pidoux 2008-04-02 6:41 ` [ROSE/AX25] af_rose: rose_release() fix Jarek Poplawski 0 siblings, 1 reply; 39+ messages in thread From: Bernard Pidoux @ 2008-04-01 20:37 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Jarek Poplawski, Linux Netdev List, Ralf Baechle DL5RB Jarek Poplawski wrote: > On Sun, Mar 30, 2008 at 11:59:21AM +0200, Bernard Pidoux wrote: > ... >> I would not be surprised if ROSE was involved as, remember, I first >> found the bug when I closed an AX25 session established through a level >> 3 ROSE network (FPAC) via AXUDP link (ax25ipd). As I said in my first >> bug report, the bug is not triggered when connecting locally or via AX25 >> call through LAN. Thus ROSE level is involved. >> >> However, I guess that lower layer (AX25) should stand a possible error >> in the upper layer protocol (ROSE). > > I think ROSE breaks some general rules here: bugs trigger in sock.c > code when ROSE packets are destroyed after closing its sockets, but > without proper information on this. > >> ROSE is actually an AX25 packet routing protocol with only three byte >> offset added to AX25 frames (encapsulation). Of course it has its own >> bugs... > > Probably... BTW, my today's patch adds some locking, so there is always > some risk of a lockup or some new lockdep warning. And if accidentally > it works, after testing with these debugging patches there would be > needed later a test of this #5 alone, as well. > > Thanks, > Jarek P. > > I did what you suggested and reversed your patches #2,#3 and #4 to verify that there was no system incompatibilities with the new locks you introduced into rose_release(). Patch #1 has also been removed on another machine running a 64 bit Core2 duo CPU. Three Linux boxes have been are running for more than 24 hours now with only patch #5. They handled a lot of AX25 connections with no problems. Thus, we can reasonably expect that things are going to stay stable. If you want to commit patch#5 I will sustain it very much. I hope that it will be accepted quickly in order to make a coherent system with AX25 patches already applied or not yet applied (if any). Thank you very much Jarek for this very nice job. Best regards, Bernard Pidoux, F6BVP ^ permalink raw reply [flat|nested] 39+ messages in thread
* [ROSE/AX25] af_rose: rose_release() fix 2008-04-01 20:37 ` Bernard Pidoux @ 2008-04-02 6:41 ` Jarek Poplawski 2008-04-02 6:56 ` David Miller 0 siblings, 1 reply; 39+ messages in thread From: Jarek Poplawski @ 2008-04-02 6:41 UTC (permalink / raw) To: David S. Miller; +Cc: Bernard Pidoux, Ralf Baechle DL5RB, Linux Netdev List On Tue, Apr 01, 2008 at 10:37:02PM +0200, Bernard Pidoux wrote: ... > Three Linux boxes have been are running for more than 24 hours now with > only patch #5. They handled a lot of AX25 connections with no problems. > > Thus, we can reasonably expect that things are going to stay stable. > > If you want to commit patch#5 I will sustain it very much. > > I hope that it will be accepted quickly in order to make a coherent > system with AX25 patches already applied or not yet applied (if any). > > Thank you very much Jarek for this very nice job. The same to you Bernard! David & Ralf: Here I resend the testing patch #5 from this thread: (the only change - it's against current netdev tree, so 1 line offset added). Thanks, Jarek P. --------------------> Subject: [ROSE/AX25] af_rose: rose_release() fix rose_release() doesn't release sockets properly, e.g. it skips sock_orphan(), so OOPSes are triggered in sock_def_write_space(), which was observed especially while ROSE skbs were kfreed from ax25_frames_acked(). There is also sock_hold() and lock_sock() added - similarly to ax25_release(). Thanks to Bernard Pidoux for substantial help in debugging this problem. Signed-off-by: Jarek Poplawski <jarkao2@gmail.com> Reported-and-tested-by: Bernard Pidoux <bpidoux@free.fr> Cc: Ralf Baechle DL5RB <ralf@linux-mips.org> --- net/rose/af_rose.c | 9 +++++++++ 1 files changed, 9 insertions(+), 0 deletions(-) diff --git a/net/rose/af_rose.c b/net/rose/af_rose.c index 92d85c3..d1ff3f8 100644 --- a/net/rose/af_rose.c +++ b/net/rose/af_rose.c @@ -598,17 +598,24 @@ static int rose_release(struct socket *sock) if (sk == NULL) return 0; + sock_hold(sk); + sock_orphan(sk); + lock_sock(sk); rose = rose_sk(sk); switch (rose->state) { case ROSE_STATE_0: + release_sock(sk); rose_disconnect(sk, 0, -1, -1); + lock_sock(sk); rose_destroy_socket(sk); break; case ROSE_STATE_2: rose->neighbour->use--; + release_sock(sk); rose_disconnect(sk, 0, -1, -1); + lock_sock(sk); rose_destroy_socket(sk); break; @@ -633,6 +640,8 @@ static int rose_release(struct socket *sock) } sock->sk = NULL; + release_sock(sk); + sock_put(sk); return 0; } ^ permalink raw reply related [flat|nested] 39+ messages in thread
* Re: [ROSE/AX25] af_rose: rose_release() fix 2008-04-02 6:41 ` [ROSE/AX25] af_rose: rose_release() fix Jarek Poplawski @ 2008-04-02 6:56 ` David Miller 0 siblings, 0 replies; 39+ messages in thread From: David Miller @ 2008-04-02 6:56 UTC (permalink / raw) To: jarkao2; +Cc: bpidoux, ralf, netdev From: Jarek Poplawski <jarkao2@gmail.com> Date: Wed, 2 Apr 2008 06:41:07 +0000 > Here I resend the testing patch #5 from this thread: (the only change > - it's against current netdev tree, so 1 line offset added). > } Thanks so much for fixing this bug, applied to net-2.6 ^ permalink raw reply [flat|nested] 39+ messages in thread
* [AX25] kernel panic
@ 2009-09-09 22:28 Bernard Pidoux
2009-09-11 19:21 ` Jarek Poplawski
[not found] ` <20090910142436.GB10547@linux-mips.org>
0 siblings, 2 replies; 39+ messages in thread
From: Bernard Pidoux @ 2009-09-09 22:28 UTC (permalink / raw)
To: Ralf Baechle DL5RB; +Cc: Linux Netdev List, linux-hams
[-- Attachment #1: Type: text/plain, Size: 141 bytes --]
Hi Ralf,
Here is a set of not so frequent kernel panics captured via netconsole
that seem related to AX25 timer.
Regards,
Bernard Pidoux
[-- Attachment #2: kernel_panic_AX25 --]
[-- Type: text/plain, Size: 33053 bytes --]
------------------------
sam. août 8 22:08:26 CEST 2009
------------------------
BUG: unable to handle kernel paging request at ffff880004c90648
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 206063 PMD 7e2067 PTE 4c90160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/devices/system/cpu/cpu0/cpufreq/scaling_cur_freq
CPU 0
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm i2c_viapro snd_timer snd_page_alloc snd_mixer_oss snd i2c_core soundcore sr_mod 8139cp 8139too mii shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table floppy sg rtc_cmos thermal via_agp processor evdev button pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 0, comm: swapper Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>] [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0018:ffffffff80717e00 EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff880004c90400 RCX: 0000000000000058
RDX: ffffe200009cb3d8 RSI: ffffffff8067f060 RDI: ffff880004c90618
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 0000000000000490
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff880004c90618
R13: ffff880004c90400 R14: 0000000000000000 R15: ffffffff80717ed0
FS: 0000000000000000(0000) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: ffff880004c90648 CR3: 0000000074843000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffffffff8068c000, task ffffffff80632360)
Stack:
ffff880004c90400 ffff880004c90400 ffff880004c90400 ffffffffa035bb30
ffffffff80717e30 ffffffffa035b850 ffffffff80717e60 ffffffffa035edb4
ffff880004c90400 ffff880004c90400 0000000000000000 ffffffffa035bb30
Call Trace:
<IRQ> <0> [<ffffffffa035bb30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa035b850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
[<ffffffffa035edb4>] ax25_destroy_socket+0x64/0x210 [ax25]
[<ffffffffa035bb30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa035b045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
[<ffffffff80217c56>] ? read_tsc+0x16/0x40
[<ffffffffa035bb55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
[<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
[<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
[<ffffffff8024506c>] __do_softirq+0x7c/0x110
[<ffffffff8021271c>] call_softirq+0x1c/0x30
[<ffffffff8021407d>] do_softirq+0x5d/0xa0
[<ffffffff80244c95>] irq_exit+0x45/0x50
[<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
[<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
<EOI> <0> [<ffffffff80218afd>] ? mwait_idle+0x5d/0x70
[<ffffffff8020fdd2>] ? enter_idle+0x22/0x30
[<ffffffff8020fe2e>] ? cpu_idle+0x4e/0x80
[<ffffffff804eb5cd>] ? rest_init+0x5d/0x70
Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00
RIP [<ffffffff80249451>] del_timer+0x11/0xb0
RSP <ffffffff80717e00>
CR2: ffff880004c90648
---[ end trace 366e8cf762bbf316 ]---
Kernel panic - not syncing: Fatal exception in interrupt
Rebooting in 60 seconds..BUG: unable to handle kernel paging request at ffff88001bbee248
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 206063 PMD 899067 PTE 1bbee160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/devices/system/cpu/cpu0/cpufreq/scaling_cur_freq
CPU 0
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm 8139cp snd_timer snd_page_alloc snd_mixer_oss snd soundcore sr_mod 8139too mii i2c_viapro i2c_core shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table thermal processor floppy rtc_cmos via_agp button sg evdev pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 0, comm: swapper Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>] [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0018:ffffffff80717e00 EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff88001bbee000 RCX: 0000000000000058
RDX: ffffe2000060cbb8 RSI: ffffffff8067f060 RDI: ffff88001bbee218
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 00000000000003ee
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff88001bbee218
R13: ffff88001bbee000 R14: 0000000000000000 R15: ffffffff80717ed0
FS: 0000000000000000(0000) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: ffff88001bbee248 CR3: 00000000296e7000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffffffff8068c000, task ffffffff80632360)
Stack:
ffff88001bbee000 ffff88001bbee000 ffff88001bbee000 ffffffffa0355b30
ffffffff80717e30 ffffffffa0355850 ffffffff80717e60 ffffffffa0358db4
ffff88001bbee000 ffff88001bbee000 0000000000000000 ffffffffa0355b30
Call Trace:
<IRQ> <0> [<ffffffffa0355b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa0355850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
[<ffffffffa0358db4>] ax25_destroy_socket+0x64/0x210 [ax25]
[<ffffffffa0355b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa0355045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
[<ffffffff80217c56>] ? read_tsc+0x16/0x40
[<ffffffffa0355b55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
[<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
[<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
[<ffffffff8024506c>] __do_softirq+0x7c/0x110
[<ffffffff8021271c>] call_softirq+0x1c/0x30
[<ffffffff8021407d>] do_softirq+0x5d/0xa0
[<ffffffff80244c95>] irq_exit+0x45/0x50
[<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
[<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
<EOI> <0> [<ffffffff80218afd>] ? mwait_idle+0x5d/0x70
[<ffffffff8020fdd2>] ? enter_idle+0x22/0x30
[<ffffffff8020fe2e>] ? cpu_idle+0x4e/0x80
[<ffffffff804eb5cd>] ? rest_init+0x5d/0x70
Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00
RIP [<ffffffff80249451>] del_timer+0x11/0xb0
RSP <ffffffff80717e00>
CR2: ffff88001bbee248
---[ end trace b7e0c620509cd638 ]---
Kernel panic - not syncing: Fatal exception in interrupt
Rebooting in 60 seconds..------------------------
jeu. août 13 00:13:13 CEST 2009
------------------------
BUG: unable to handle kernel paging request at ffff880071c80e48
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 9bc067 PMD b4b067 PTE 71c80160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/devices/system/cpu/cpu0/cpufreq/scaling_cur_freq
CPU 0
Modules linked in: loop netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss 8139cp i2c_viapro snd soundcore sr_mod 8139too i2c_core mii shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table thermal floppy rtc_cmos processor via_agp button sg evdev pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 0, comm: swapper Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>] [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0018:ffffffff80717e00 EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff880071c80c00 RCX: 0000000000000058
RDX: ffffe200010313d8 RSI: ffffffff8067f060 RDI: ffff880071c80e18
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 0000000000000480
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff880071c80e18
R13: ffff880071c80c00 R14: 0000000000000000 R15: ffffffff80717ed0
FS: 0000000000000000(0000) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: ffff880071c80e48 CR3: 000000007a11c000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffffffff8068c000, task ffffffff80632360)
Stack:
ffff880071c80c00 ffff880071c80c00 ffff880071c80c00 ffffffffa0358b30
ffffffff80717e30 ffffffffa0358850 ffffffff80717e60 ffffffffa035bdb4
ffff880071c80c00 ffff880071c80c00 0000000000000000 ffffffffa0358b30
Call Trace:
<IRQ> <0> [<ffffffffa0358b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa0358850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
[<ffffffffa035bdb4>] ax25_destroy_socket+0x64/0x210 [ax25]
[<ffffffffa0358b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa0358045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
[<ffffffff80217c56>] ? read_tsc+0x16/0x40
[<ffffffffa0358b55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
[<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
[<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
[<ffffffff8024506c>] __do_softirq+0x7c/0x110
[<ffffffff8021271c>] call_softirq+0x1c/0x30
[<ffffffff8021407d>] do_softirq+0x5d/0xa0
[<ffffffff80244c95>] irq_exit+0x45/0x50
[<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
[<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
<EOI> <0> [<ffffffff80218afd>] ? mwait_idle+0x5d/0x70
[<ffffffff8020fdd2>] ? enter_idle+0x22/0x30
[<ffffffff8020fe2e>] ? cpu_idle+0x4e/0x80
[<ffffffff804eb5cd>] ? rest_init+0x5d/0x70
Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00
RIP [<ffffffff80249451>] del_timer+0x11/0xb0
RSP <ffffffff80717e00>
CR2: ffff880071c80e48
---[ end trace d516331eccbfb939 ]---
Kernel panic - not syncing: Fatal exception in interrupt
Rebooting in 60 seconds..------------------------
sam. août 15 10:15:34 CEST 2009
------------------------
------------------------
sam. août 15 10:16:32 CEST 2009
------------------------
-------------------------------
sam. août 15 13:11:53 CEST 2009
-------------------------------
-------------------------------
sam. août 15 13:16:21 CEST 2009
-------------------------------
-------------------------------
sam. août 15 14:36:50 CEST 2009
-------------------------------
-------------------------------
Sun Aug 16 04:03:12 CEST 2009
-------------------------------
-------------------------------
Mon Aug 17 04:03:21 CEST 2009
-------------------------------
-------------------------------
lun. août 17 12:43:33 CEST 2009
-------------------------------
-------------------------------
lun. août 17 14:03:50 CEST 2009
-------------------------------
-------------------------------
Tue Aug 18 04:03:17 CEST 2009
-------------------------------
-------------------------------
Wed Aug 19 04:03:22 CEST 2009
-------------------------------
-------------------------------
Thu Aug 20 04:03:24 CEST 2009
-------------------------------
-------------------------------
jeu. août 20 14:21:57 CEST 2009
-------------------------------
-------------------------------
jeu. août 20 15:42:15 CEST 2009
-------------------------------
general protection fault: 0000 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/class/vc/vcsa6/dev
CPU 0
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc i2c_viapro snd_mixer_oss snd i2c_core soundcore sr_mod 8139too mii shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table floppy sg rtc_cmos via_agp thermal evdev processor button pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 30904, comm: astropulse_5.06 Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffffa034fb3d>] [<ffffffffa034fb3d>] ax25_heartbeat_expiry+0xd/0x60 [ax25]
RSP: 0000:ffffffff80717ea0 EFLAGS: 00010206
RAX: ffff880061829fd8 RBX: ffff88006f59b000 RCX: ffffffffa034fb30
RDX: 6e75203a7473696c RSI: 0000000000000e3f RDI: ffff88006f59b000
RBP: ffffffff80717ea0 R08: ffff88006f59b250 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000100
R13: ffffffff8075a600 R14: ffffffffa034fb30 R15: ffffffff80717ed0
FS: 0000000001493860(0063) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007f771ebbd000 CR3: 000000006b867000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process astropulse_5.06 (pid: 30904, threadinfo ffff880061828000, task ffff8800618641a0)
Stack:
ffffffff80717f10 ffffffff8024976c ffffffff8075c210 ffffffff8075be10
ffffffff8075ba10 ffffffff8075b610 ffff88006f512970 ffff88006f512970
ffffffff8025f8ff 0000000000000008 0000000000000001 0000000000000100
Call Trace:
<IRQ> <0> [<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
[<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
[<ffffffff8024506c>] __do_softirq+0x7c/0x110
[<ffffffff8021271c>] call_softirq+0x1c/0x30
[<ffffffff8021407d>] do_softirq+0x5d/0xa0
[<ffffffff80244c95>] irq_exit+0x45/0x50
[<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
[<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
<EOI> <0>Code: 80 7a 58 00 66 90 74 da c9 0f 1f 44 00 00 c3 66 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 8b 57 28 48 89 e5 48 85 d2 74 0c <8b> 42 50 85 c0 78 11 83 f8 01 7f 17 0f 1f 80 00 00 00 00 e8 fb
RIP [<ffffffffa034fb3d>] ax25_heartbeat_expiry+0xd/0x60 [ax25]
RSP <ffffffff80717ea0>
---[ end trace 0dee287bd3d290a3 ]---
Kernel panic - not syncing: Fatal exception in interrupt
Rebooting in 60 seconds..
-------------------------------
Fri Aug 21 04:03:18 CEST 2009
-------------------------------
-------------------------------
Sat Aug 22 04:03:24 CEST 2009
-------------------------------
-------------------------------
Sun Aug 23 04:03:27 CEST 2009
-------------------------------
-------------------------------
Mon Aug 24 04:03:26 CEST 2009
-------------------------------
-------------------------------
Tue Aug 25 04:03:23 CEST 2009
-------------------------------
-------------------------------
Wed Aug 26 04:03:25 CEST 2009
-------------------------------
general protection fault: 0000 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/class/vc/vcsa12/dev
CPU 0
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd 8139too mii i2c_viapro soundcore i2c_core sr_mod shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table floppy sg rtc_cmos via_agp thermal evdev processor button pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 28253, comm: astropulse_5.06 Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffffa0342ae8>] [<ffffffffa0342ae8>] ax25_t1timer_expiry+0x8/0x50 [ax25]
RSP: 0000:ffffffff80717ea0 EFLAGS: 00010246
RAX: ffff880074023fd8 RBX: ffff88007bc90000 RCX: ffffffffa0342ae0
RDX: a86496acda711900 RSI: 0000000000000000 RDI: ffff88007bc90000
RBP: ffffffff80717ea0 R08: ffff88007bc90078 R09: 0000000000000000
R10: 0000000000000001 R11: 0000000000000000 R12: 0000000000000100
R13: ffffffff8075a600 R14: ffffffffa0342ae0 R15: ffffffff80717ed0
FS: 000000000224b860(0063) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: 00007fa029a4e000 CR3: 000000007e8e9000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process astropulse_5.06 (pid: 28253, threadinfo ffff880074022000, task ffff8800714c2bc0)
Stack:
ffffffff80717f10 ffffffff8024976c ffffffff8075c210 ffffffff8075be10
ffffffff8075ba10 ffffffff8075b610 ffffffff80717ed0 ffffffff80717ed0
ffffffff8025f8ff 0000000000000008 0000000000000001 0000000000000100
Call Trace:
<IRQ> <0> [<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
[<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
[<ffffffff8024506c>] __do_softirq+0x7c/0x110
[<ffffffff8021271c>] call_softirq+0x1c/0x30
[<ffffffff8021407d>] do_softirq+0x5d/0xa0
[<ffffffff80244c95>] irq_exit+0x45/0x50
[<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
[<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
<EOI> <0>Code: 44 00 00 75 e7 80 7a 58 00 66 90 74 da c9 0f 1f 44 00 00 c3 66 66 66 66 66 66 2e 0f 1f 84 00 00 00 00 00 55 48 8b 57 28 48 89 e5 <8b> 42 50 85 c0 78 0a 83 f8 01 7f 14 e8 e7 f1 ff ff c9 66 0f 1f
RIP [<ffffffffa0342ae8>] ax25_t1timer_expiry+0x8/0x50 [ax25]
RSP <ffffffff80717ea0>
---[ end trace 963e5b19794631dc ]---
Kernel panic - not syncing: Fatal exception in interrupt
Rebooting in 60 seconds..
-------------------------------
Thu Aug 27 04:03:22 CEST 2009
-------------------------------
-------------------------------
Fri Aug 28 04:03:26 CEST 2009
-------------------------------
BUG: unable to handle kernel paging request at ffff880077ca0e48
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 9bc067 PMD b7b067 PTE 77ca0160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/class/vc/vcsa6/dev
CPU 0
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd i2c_viapro soundcore i2c_core sr_mod 8139too mii shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table floppy sg rtc_cmos via_agp thermal evdev processor button pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 30841, comm: setiathome-5.28 Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>] [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0000:ffffffff80717e00 EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff880077ca0c00 RCX: 0000000000000058
RDX: ffffe20001a29a48 RSI: ffffffff8067f060 RDI: ffff880077ca0e18
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 00000000000004a0
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff880077ca0e18
R13: ffff880077ca0c00 R14: 0000000000000000 R15: ffffffff80717ed0
FS: 0000000041b93940(0063) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffff880077ca0e48 CR3: 000000006e1fc000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process setiathome-5.28 (pid: 30841, threadinfo ffff88007957c000, task ffff8800750cabc0)
Stack:
ffff880077ca0c00 ffff880077ca0c00 ffff880077ca0c00 ffffffffa034fb30
ffffffff80717e30 ffffffffa034f850 ffffffff80717e60 ffffffffa0352db4
ffff880077ca0c00 ffff880077ca0c00 0000000000000000 ffffffffa034fb30
Call Trace:
<IRQ> <0> [<ffffffffa034fb30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa034f850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
[<ffffffffa0352db4>] ax25_destroy_socket+0x64/0x210 [ax25]
[<ffffffffa034fb30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa034f045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
[<ffffffff80217c56>] ? read_tsc+0x16/0x40
[<ffffffffa034fb55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
[<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
[<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
[<ffffffff8024506c>] __do_softirq+0x7c/0x110
[<ffffffff8021271c>] call_softirq+0x1c/0x30
[<ffffffff8021407d>] do_softirq+0x5d/0xa0
[<ffffffff80244c95>] irq_exit+0x45/0x50
[<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
[<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
<EOI> <0>Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00
RIP [<ffffffff80249451>] del_timer+0x11/0xb0
RSP <ffffffff80717e00>
CR2: ffff880077ca0e48
---[ end trace 2278e28e8ee624db ]---
Kernel panic - not syncing: Fatal exception in interrupt
Rebooting in 60 seconds..
-------------------------------
Sat Aug 29 04:03:23 CEST 2009
-------------------------------
-------------------------------
Sun Aug 30 04:03:21 CEST 2009
-------------------------------
-------------------------------
Mon Aug 31 04:03:24 CEST 2009
-------------------------------
BUG: unable to handle kernel paging request at ffff88006eca8a48
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 9bc067 PMD b33067 PTE 6eca8160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/devices/system/cpu/cpu0/cpufreq/scaling_cur_freq
CPU 0
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd i2c_viapro 8139too i2c_core soundcore sr_mod mii shpchp pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table via_agp rtc_cmos floppy thermal processor button sg evdev pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 0, comm: swapper Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>] [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0018:ffffffff80717e00 EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff88006eca8800 RCX: 0000000000000058
RDX: ffffe200017e8f68 RSI: ffffffff8067f060 RDI: ffff88006eca8a18
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 00000000000004a8
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff88006eca8a18
R13: ffff88006eca8800 R14: 0000000000000000 R15: ffffffff80717ed0
FS: 0000000000000000(0000) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: ffff88006eca8a48 CR3: 000000006e00b000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffffffff8068c000, task ffffffff80632360)
Stack:
ffff88006eca8800 ffff88006eca8800 ffff88006eca8800 ffffffffa0345b30
ffffffff80717e30 ffffffffa0345850 ffffffff80717e60 ffffffffa0348db4
ffff88006eca8800 ffff88006eca8800 0000000000000000 ffffffffa0345b30
Call Trace:
<IRQ> <0> [<ffffffffa0345b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa0345850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
[<ffffffffa0348db4>] ax25_destroy_socket+0x64/0x210 [ax25]
[<ffffffffa0345b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa0345045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
[<ffffffff80217c56>] ? read_tsc+0x16/0x40
[<ffffffffa0345b55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
[<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
[<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
[<ffffffff8024506c>] __do_softirq+0x7c/0x110
[<ffffffff8021271c>] call_softirq+0x1c/0x30
[<ffffffff8021407d>] do_softirq+0x5d/0xa0
[<ffffffff80244c95>] irq_exit+0x45/0x50
[<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
[<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
<EOI> <0> [<ffffffff80218afd>] ? mwait_idle+0x5d/0x70
[<ffffffff8020fdd2>] ? enter_idle+0x22/0x30
[<ffffffff8020fe2e>] ? cpu_idle+0x4e/0x80
[<ffffffff804eb5cd>] ? rest_init+0x5d/0x70
Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00
RIP [<ffffffff80249451>] del_timer+0x11/0xb0
RSP <ffffffff80717e00>
CR2: ffff88006eca8a48
---[ end trace 62fd644f9e0af320 ]---
Kernel panic - not syncing: Fatal exception in interrupt
Rebooting in 60 seconds..
-------------------------------
Tue Sep 1 04:03:25 CEST 2009
-------------------------------
BUG: unable to handle kernel paging request at ffff88000ad0a248
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 206063 PMD 812067 PTE ad0a160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/class/vc/vcsa5/dev
CPU 0
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd soundcore i2c_viapro i2c_core sr_mod 8139too mii shpchp pci_hotplug binfmt_misc ext3 jbd rtc_cmos floppy thermal button cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table processor via_agp evdev sg pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 0, comm: swapper Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>] [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0018:ffffffff80717e00 EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff88000ad0a000 RCX: 0000000000000058
RDX: ffffe200019d57a8 RSI: ffffffff8067f060 RDI: ffff88000ad0a218
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 000000000000050a
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff88000ad0a218
R13: ffff88000ad0a000 R14: 0000000000000000 R15: ffffffff80717ed0
FS: 0000000000000000(0000) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: ffff88000ad0a248 CR3: 00000000751da000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffffffff8068c000, task ffffffff80632360)
Stack:
ffff88000ad0a000 ffff88000ad0a000 ffff88000ad0a000 ffffffffa0350b30
ffffffff80717e30 ffffffffa0350850 ffffffff80717e60 ffffffffa0353db4
ffff88000ad0a000 ffff88000ad0a000 0000000000000000 ffffffffa0350b30
Call Trace:
<IRQ> <0> [<ffffffffa0350b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa0350850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
[<ffffffffa0353db4>] ax25_destroy_socket+0x64/0x210 [ax25]
[<ffffffffa0350b30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa0350045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
[<ffffffffa0350b55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
[<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
[<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
[<ffffffff8024506c>] __do_softirq+0x7c/0x110
[<ffffffff8021271c>] call_softirq+0x1c/0x30
[<ffffffff8021407d>] do_softirq+0x5d/0xa0
[<ffffffff80244c95>] irq_exit+0x45/0x50
[<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
[<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
<EOI> <0> [<ffffffff80218afd>] ? mwait_idle+0x5d/0x70
[<ffffffff8020fdd2>] ? enter_idle+0x22/0x30
[<ffffffff8020fe2e>] ? cpu_idle+0x4e/0x80
[<ffffffff804eb5cd>] ? rest_init+0x5d/0x70
Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00
RIP [<ffffffff80249451>] del_timer+0x11/0xb0
RSP <ffffffff80717e00>
CR2: ffff88000ad0a248
---[ end trace 8cace7d340707eda ]---
Kernel panic - not syncing: Fatal exception in interrupt
Rebooting in 60 seconds..
-------------------------------
Wed Sep 2 04:03:25 CEST 2009
-------------------------------
-------------------------------
Thu Sep 3 04:03:19 CEST 2009
-------------------------------
-------------------------------
Fri Sep 4 04:03:21 CEST 2009
-------------------------------
BUG: unable to handle kernel paging request at ffff8800141b6a48
IP: [<ffffffff80249451>] del_timer+0x11/0xb0
PGD 202063 PUD 206063 PMD 85c067 PTE 141b6160
Oops: 0002 [#1] DEBUG_PAGEALLOC
last sysfs file: /sys/class/vc/vcsa6/dev
CPU 0
Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd shpchp i2c_viapro 8139too pci_hotplug soundcore i2c_core sr_mod mii binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table via_agp floppy sg rtc_cmos thermal evdev processor button pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif
Pid: 32129, comm: setiathome-5.28 Not tainted 2.6.29.6-nosmp #8 MS-7258
RIP: 0010:[<ffffffff80249451>] [<ffffffff80249451>] del_timer+0x11/0xb0
RSP: 0000:ffffffff80717e00 EFLAGS: 00010246
RAX: ffffffff8067f0b8 RBX: ffff8800141b6800 RCX: 0000000000000058
RDX: ffffe200004610c8 RSI: ffffffff8067f060 RDI: ffff8800141b6a18
RBP: ffffffff80717e20 R08: 0000000000000001 R09: 00000000000001b6
R10: 0000000000000002 R11: ffffffff8067f008 R12: ffff8800141b6a18
R13: ffff8800141b6800 R14: 0000000000000000 R15: ffffffff80717ed0
FS: 0000000041ee4940(0063) GS:ffffffff80720000(0000) knlGS:0000000000000000
CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
CR2: ffff8800141b6a48 CR3: 00000000781d5000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process setiathome-5.28 (pid: 32129, threadinfo ffff8800781e2000, task ffff8800183641a0)
Stack:
ffff8800141b6800 ffff8800141b6800 ffff8800141b6800 ffffffffa034ab30
ffffffff80717e30 ffffffffa034a850 ffffffff80717e60 ffffffffa034ddb4
ffff8800141b6800 ffff8800141b6800 0000000000000000 ffffffffa034ab30
Call Trace:
<IRQ> <0> [<ffffffffa034ab30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa034a850>] ax25_stop_heartbeat+0x10/0x20 [ax25]
[<ffffffffa034ddb4>] ax25_destroy_socket+0x64/0x210 [ax25]
[<ffffffffa034ab30>] ? ax25_heartbeat_expiry+0x0/0x60 [ax25]
[<ffffffffa034a045>] ax25_std_heartbeat_expiry+0xf5/0x100 [ax25]
[<ffffffff80217c56>] ? read_tsc+0x16/0x40
[<ffffffffa034ab55>] ax25_heartbeat_expiry+0x25/0x60 [ax25]
[<ffffffff8024976c>] run_timer_softirq+0x15c/0x230
[<ffffffff8025f8ff>] ? clockevents_program_event+0x4f/0x90
[<ffffffff8024506c>] __do_softirq+0x7c/0x110
[<ffffffff8021271c>] call_softirq+0x1c/0x30
[<ffffffff8021407d>] do_softirq+0x5d/0xa0
[<ffffffff80244c95>] irq_exit+0x45/0x50
[<ffffffff80223e85>] smp_apic_timer_interrupt+0x55/0x90
[<ffffffff80212253>] apic_timer_interrupt+0x13/0x20
<EOI> <0>Code: 10 18 00 00 eb a6 0f 1f 40 00 48 0f b6 c2 48 c1 e0 04 48 8d 54 07 10 eb 93 90 55 48 89 e5 41 56 45 31 f6 41 55 41 54 49 89 fc 53 <48> c7 47 30 00 00 00 00 48 83 3f 00 75 16 eb 76 0f 1f 80 00 00
RIP [<ffffffff80249451>] del_timer+0x11/0xb0
RSP <ffffffff80717e00>
CR2: ffff8800141b6a48
---[ end trace 469a474dc114bf10 ]---
Kernel panic - not syncing: Fatal exception in interrupt
Rebooting in 60 seconds..
-------------------------------
Sat Sep 5 04:03:26 CEST 2009
-------------------------------
-------------------------------
Sun Sep 6 04:03:11 CEST 2009
-------------------------------
-------------------------------
Mon Sep 7 04:03:20 CEST 2009
-------------------------------
^ permalink raw reply [flat|nested] 39+ messages in thread* Re: [AX25] kernel panic 2009-09-09 22:28 [AX25] kernel panic Bernard Pidoux @ 2009-09-11 19:21 ` Jarek Poplawski 2009-09-15 10:16 ` Bernard Pidoux [not found] ` <20090910142436.GB10547@linux-mips.org> 1 sibling, 1 reply; 39+ messages in thread From: Jarek Poplawski @ 2009-09-11 19:21 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Ralf Baechle DL5RB, Linux Netdev List, linux-hams Bernard Pidoux wrote, On 09/10/2009 12:28 AM: > Hi Ralf, > > Here is a set of not so frequent kernel panics captured via netconsole > that seem related to AX25 timer. > > Regards, > > Bernard Pidoux > Hi Bernard, Could/did you try to turn on this debugging option below, btw? Regards, Jarek P. CONFIG_DEBUG_OBJECTS_TIMERS: ? ? ? If you say Y here, additional code will be inserted into the ? ? timer routines to track the life time of timer objects and ? ? validate the timer operations. ? ? ? ? Symbol: DEBUG_OBJECTS_TIMERS [=y] ? ? Prompt: Debug timer objects ? ? Defined at lib/Kconfig.debug:247 ? ? Depends on: DEBUG_OBJECTS ? ? Location: ? ? -> Kernel hacking ? ? -> Kernel debugging (DEBUG_KERNEL [=y]) ? ? -> Debug object operations (DEBUG_OBJECTS [=y]) ? ? ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2009-09-11 19:21 ` Jarek Poplawski @ 2009-09-15 10:16 ` Bernard Pidoux 0 siblings, 0 replies; 39+ messages in thread From: Bernard Pidoux @ 2009-09-15 10:16 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Ralf Baechle DL5RB, Linux Netdev List, linux-hams Hi Jarek, I was not aware of this debug option and will turn it ON. Thanks for the suggestion. Bernard Jarek Poplawski a écrit : > Bernard Pidoux wrote, On 09/10/2009 12:28 AM: > > >> Hi Ralf, >> >> Here is a set of not so frequent kernel panics captured via netconsole >> that seem related to AX25 timer. >> >> Regards, >> >> Bernard Pidoux >> >> > > Hi Bernard, > > Could/did you try to turn on this debugging option below, btw? > > Regards, > Jarek P. > > CONFIG_DEBUG_OBJECTS_TIMERS: > ? ? > ? If you say Y here, additional code will be inserted into the ? > ? timer routines to track the life time of timer objects and ? > ? validate the timer operations. ? > ? ? > ? Symbol: DEBUG_OBJECTS_TIMERS [=y] ? > ? Prompt: Debug timer objects ? > ? Defined at lib/Kconfig.debug:247 ? > ? Depends on: DEBUG_OBJECTS ? > ? Location: ? > ? -> Kernel hacking ? > ? -> Kernel debugging (DEBUG_KERNEL [=y]) ? > ? -> Debug object operations (DEBUG_OBJECTS [=y]) ? > ? > > -- To unsubscribe from this list: send the line "unsubscribe linux-hams" in the body of a message to majordomo@vger.kernel.org More majordomo info at http://vger.kernel.org/majordomo-info.html ^ permalink raw reply [flat|nested] 39+ messages in thread
[parent not found: <20090910142436.GB10547@linux-mips.org>]
[parent not found: <4AA9288B.2070205@upmc.fr>]
[parent not found: <20090911120557.GA12175@linux-mips.org>]
* Re: [AX25] kernel panic [not found] ` <20090911120557.GA12175@linux-mips.org> @ 2009-09-20 8:42 ` Bernard Pidoux 2009-09-20 9:09 ` f8arr 2009-09-20 21:02 ` Jarek Poplawski 0 siblings, 2 replies; 39+ messages in thread From: Bernard Pidoux @ 2009-09-20 8:42 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Ralf Baechle DL5RB, Linux Netdev List, linux-hams [-- Attachment #1: Type: text/plain, Size: 174 bytes --] Hi, Here are the first events noticed since I turned on CONFIG_DEBUG_OBJECTS_TIMERS option. First a kernel BUG, second a kernel panic. Best regards, Bernard Pidoux [-- Attachment #2: kernel_bug --] [-- Type: text/plain, Size: 4116 bytes --] ------------[ cut here ]------------ kernel BUG at kernel/timer.c:913! invalid opcode: 0000 [#1] last sysfs file: /sys/devices/system/cpu/cpu0/cpufreq/scaling_cur_freq CPU 0 Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 binfmt_misc loop ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd soundcore shpchp pci_hotplug i2c_viapro i2c_core via_agp floppy 8139cp 8139too mii sg sr_mod processor rtc_cmos button thermal evdev pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif Pid: 24497, comm: astropulse_5.06 Not tainted 2.6.31-nosmp #3 MS-7258 RIP: 0010:[<ffffffff81061412>] [<ffffffff81061412>] cascade+0xb2/0xc0 RSP: 0000:ffffffff8155be00 EFLAGS: 00010082 RAX: 0000000000000000 RBX: ffff880050c4c218 RCX: 0000000104445204 RDX: ffffffff8132b3d0 RSI: ffff880050c4c218 RDI: ffffffff81673540 RBP: ffffffff8155be40 R08: 0000000000000004 R09: ffffffff81568bc0 R10: ffffffff8155be28 R11: 0000000000000001 R12: ffffffff81673540 R13: ffffffff8155be00 R14: 0000000000000012 R15: 0000000000000001 FS: 00000000016e2860(0063) GS:ffffffff81558000(0000) knlGS:0000000000000000 CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 CR2: 00007fe3eb15029c CR3: 000000007ecff000 CR4: 00000000000006f0 DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 DR3: 0000000000000000 DR6: 00000000ffff4ff0 DR7: 0000000000000400 Process astropulse_5.06 (pid: 24497, threadinfo ffff88005807a000, task ffff880049588000) Stack: ffff8800445748e0 ffff88007e86ab98 ffffffff8155be88 000000008c85481d <0> 0000000000000000 ffffffff81673540 ffffffff8155be70 0000000000000081 <0> ffffffff8155bec0 ffffffff81061613 ffffffff81675150 ffffffff81674d50 Call Trace: <IRQ> [<ffffffff81061613>] run_timer_softirq+0xf3/0x250 [<ffffffff8102d0db>] ? lapic_next_event+0x2b/0x50 [<ffffffff8107fc42>] ? clockevents_program_event+0x62/0xc0 [<ffffffff8105b242>] __do_softirq+0xe2/0x1d0 [<ffffffff8101414a>] call_softirq+0x1a/0x30 [<ffffffff810162c5>] do_softirq+0x75/0xc0 [<ffffffff8105ac45>] irq_exit+0x65/0x80 [<ffffffff8102ddb5>] smp_apic_timer_interrupt+0x65/0xb0 [<ffffffff81013c73>] apic_timer_interrupt+0x13/0x20 <EOI> Code: 45 fe ff ff 4c 39 eb 48 8b 13 75 dd 48 8b 55 d8 65 48 33 14 25 28 00 00 00 44 89 f0 75 11 48 83 c4 20 5b 41 5c 41 5d 41 5e c9 c3 <0f> 0b eb fe e8 c5 29 ff ff 0f 1f 44 00 00 55 48 89 e5 48 83 ec RIP [<ffffffff81061412>] cascade+0xb2/0xc0 RSP <ffffffff8155be00> ---[ end trace 2efb8d4aaedbf503 ]--- Kernel panic - not syncing: Fatal exception in interrupt Pid: 24497, comm: astropulse_5.06 Tainted: G D 2.6.31-nosmp #3 Call Trace: <IRQ> [<ffffffff813d5e52>] panic+0xb2/0x180 [<ffffffff8132f8ff>] ? __kfree_skb+0x6f/0xe0 [<ffffffff810549bd>] ? console_unblank+0x8d/0xd0 [<ffffffff812bdcee>] ? unblank_screen+0x1e/0x40 [<ffffffff81053a36>] ? oops_exit+0x36/0x60 [<ffffffff81017947>] oops_end+0xe7/0x100 [<ffffffff810179bd>] ? oops_begin+0x5d/0x80 [<ffffffff81017b52>] die+0x62/0xa0 [<ffffffff81014e86>] do_trap+0x166/0x190 [<ffffffff8107715d>] ? notify_die+0x3d/0x60 [<ffffffff810153a5>] do_invalid_op+0xa5/0xd0 [<ffffffff81061412>] ? cascade+0xb2/0xc0 [<ffffffff8104dcde>] ? wake_up_state+0x1e/0x40 [<ffffffff81013ddb>] invalid_op+0x1b/0x20 [<ffffffff8132b3d0>] ? sock_def_write_space+0x0/0xb0 [<ffffffff81061412>] ? cascade+0xb2/0xc0 [<ffffffff81061613>] run_timer_softirq+0xf3/0x250 [<ffffffff8102d0db>] ? lapic_next_event+0x2b/0x50 [<ffffffff8107fc42>] ? clockevents_program_event+0x62/0xc0 [<ffffffff8105b242>] __do_softirq+0xe2/0x1d0 [<ffffffff8101414a>] call_softirq+0x1a/0x30 [<ffffffff810162c5>] do_softirq+0x75/0xc0 [<ffffffff8105ac45>] irq_exit+0x65/0x80 [<ffffffff8102ddb5>] smp_apic_timer_interrupt+0x65/0xb0 [<ffffffff81013c73>] apic_timer_interrupt+0x13/0x20 <EOI> Rebooting in 60 seconds..[root@f6bvp-9 bernard]# ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2009-09-20 8:42 ` Bernard Pidoux @ 2009-09-20 9:09 ` f8arr 2009-09-20 21:02 ` Jarek Poplawski 1 sibling, 0 replies; 39+ messages in thread From: f8arr @ 2009-09-20 9:09 UTC (permalink / raw) To: Bernard Pidoux Cc: Jarek Poplawski, Ralf Baechle DL5RB, Linux Netdev List, linux-hams hi Bernard, My problem wasn't exactly the same has your. But ! Doing a boot with the kernel option "nosmp" wasn't suffisant... it seemed to load the smp and then, while reading the boot option, unsetting them... but it was too late. (I saw that looking the dmesg). My solution has been to compile a kernel without smp to be sure that nothing goes up... and it worked ! Regards f8arr Bernard Pidoux a écrit : > Hi, > > Here are the first events noticed since I turned on > CONFIG_DEBUG_OBJECTS_TIMERS option. > > First a kernel BUG, second a kernel panic. > > Best regards, > > Bernard Pidoux > > > > > ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2009-09-20 8:42 ` Bernard Pidoux 2009-09-20 9:09 ` f8arr @ 2009-09-20 21:02 ` Jarek Poplawski 2009-09-21 8:44 ` Bernard Pidoux 1 sibling, 1 reply; 39+ messages in thread From: Jarek Poplawski @ 2009-09-20 21:02 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Ralf Baechle DL5RB, Linux Netdev List, linux-hams On Sun, Sep 20, 2009 at 10:42:13AM +0200, Bernard Pidoux wrote: > Hi, > > Here are the first events noticed since I turned on > CONFIG_DEBUG_OBJECTS_TIMERS option. > > First a kernel BUG, second a kernel panic. ... > ------------[ cut here ]------------ > kernel BUG at kernel/timer.c:913! Alas this BUG doesn't show much (this new debugging didn't trigger here). Maybe the patch below will be luckier. Best regards, Jarek P. --- include/net/ax25.h | 36 ++++++++++++++++++++++++++++++++++++ net/ax25/af_ax25.c | 3 +++ 2 files changed, 39 insertions(+), 0 deletions(-) diff --git a/include/net/ax25.h b/include/net/ax25.h index 717e219..e8f6e33 100644 --- a/include/net/ax25.h +++ b/include/net/ax25.h @@ -252,9 +252,45 @@ typedef struct ax25_cb { #define ax25_cb_hold(__ax25) \ atomic_inc(&((__ax25)->refcount)) +static __inline__ int ax25_timers_warn(ax25_cb *ax25) +{ + int err = 0; + + if (del_timer(&ax25->timer)) { + WARN_ON_ONCE(1); + err = 1; + } + if (del_timer(&ax25->t1timer)) { + WARN_ON_ONCE(1); + err += 2; + } + if (del_timer(&ax25->t2timer)) { + WARN_ON_ONCE(1); + err += 4; + } + if (del_timer(&ax25->t3timer)) { + WARN_ON_ONCE(1); + err += 8; + } + if (del_timer(&ax25->idletimer)) { + WARN_ON_ONCE(1); + err += 16; + } + if (del_timer(&ax25->dtimer)) { + WARN_ON_ONCE(1); + err += 32; + } + if (err) + printk(KERN_WARNING "AX25_DBG: %d %p %u\n", err, ax25, + ax25->state); + + return err; +} + static __inline__ void ax25_cb_put(ax25_cb *ax25) { if (atomic_dec_and_test(&ax25->refcount)) { + ax25_timers_warn(ax25); kfree(ax25->digipeat); kfree(ax25); } diff --git a/net/ax25/af_ax25.c b/net/ax25/af_ax25.c index da0f64f..f443fe0 100644 --- a/net/ax25/af_ax25.c +++ b/net/ax25/af_ax25.c @@ -58,6 +58,9 @@ static const struct proto_ops ax25_proto_ops; static void ax25_free_sock(struct sock *sk) { + if (ax25_timers_warn(ax25_sk(sk))) + printk(KERN_WARNING "AX25_DBG: %p %u %u %u\n", sk, + sk->sk_family, sk->sk_type, sk->sk_protocol); ax25_cb_put(ax25_sk(sk)); } ^ permalink raw reply related [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2009-09-20 21:02 ` Jarek Poplawski @ 2009-09-21 8:44 ` Bernard Pidoux 0 siblings, 0 replies; 39+ messages in thread From: Bernard Pidoux @ 2009-09-21 8:44 UTC (permalink / raw) To: Jarek Poplawski; +Cc: Ralf Baechle DL5RB, Linux Netdev List, linux-hams Hi Jarek, Good fishing ! During the night I catched the following two identical AX25_DBG messages with netconsole sending already reported message: kernel BUG at kernel/timer.c:913! and followed by kernel panics and the machine rebooting. Sep 21 03:24:06 f6bvp-11 klogd: ------------[ cut here ]------------ Sep 21 03:24:06 f6bvp-11 klogd: WARNING: at include/net/ax25.h:260 ax25_kiss_rcv+0x650/0xab0 [ax25]() Sep 21 03:24:06 f6bvp-11 klogd: Hardware name: MS-7258 Sep 21 03:24:06 f6bvp-11 klogd: Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl aut h_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss i2c_viapro snd i2c _core soundcore 8139cp 8139too shpchp pci_hotplug mii sr_mod binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table floppy rtc_cmos processor thermal button via_agp sg evdev pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif Sep 21 03:24:06 f6bvp-11 klogd: Pid: 5, comm: events/0 Not tainted 2.6.31-nosmp #3 Sep 21 03:24:06 f6bvp-11 klogd: Call Trace: Sep 21 03:24:06 f6bvp-11 klogd: <IRQ> [<ffffffffa03ab750>] ? ax25_kiss_rcv+0x650/0xab0 [ax25] Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff81053b90>] warn_slowpath_common+0x80/0xe0 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff81053c12>] warn_slowpath_null+0x22/0x40 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffffa03ab750>] ax25_kiss_rcv+0x650/0xab0 [ax25] Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff8132b4bd>] ? sock_def_readable+0x3d/0x80 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff8132c96d>] ? sock_queue_rcv_skb+0x12d/0x160 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff8133a831>] netif_receive_skb+0x351/0x5f0 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff81061699>] ? run_timer_softirq+0x179/0x250 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff8133ab50>] process_backlog+0x80/0xe0 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff8133b4a4>] net_rx_action+0xf4/0x220 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff8105b242>] __do_softirq+0xe2/0x1d0 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff8101414a>] call_softirq+0x1a/0x30 Sep 21 03:24:06 f6bvp-11 klogd: <EOI> [<ffffffff810162c5>] do_softirq+0x75/0xc0 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff8105b094>] local_bh_enable+0xc4/0xd0 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffffa03cd798>] mkiss_receive_buf+0x3a8/0x460 [mkiss] Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff8104b864>] ? finish_task_switch+0x44/0xe0 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff812af800>] flush_to_ldisc+0x110/0x1f0 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff812af6f0>] ? flush_to_ldisc+0x0/0x1f0 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff8106c263>] worker_thread+0x173/0x260 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff81071be0>] ? autoremove_wake_function+0x0/0x60 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff8106c0f0>] ? worker_thread+0x0/0x260 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff8107149e>] kthread+0xae/0xc0 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff8101404a>] child_rip+0xa/0x20 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff810713f0>] ? kthread+0x0/0xc0 Sep 21 03:24:06 f6bvp-11 klogd: [<ffffffff81014040>] ? child_rip+0x0/0x20 Sep 21 03:24:06 f6bvp-11 klogd: ---[ end trace cea93cec47668ffd ]--- Sep 21 03:24:06 f6bvp-11 klogd: AX25_DBG: 1 ffff88005a127c00 0 Sep 21 04:30:40 f6bvp-11 klogd: ------------[ cut here ]------------ Sep 21 04:30:40 f6bvp-11 klogd: WARNING: at include/net/ax25.h:260 ax25_kiss_rcv+0x650/0xab0 [ax25]() Sep 21 04:30:40 f6bvp-11 klogd: Hardware name: MS-7258 Sep 21 04:30:40 f6bvp-11 klogd: Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs lockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_rawmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc snd_mixer_oss snd 8139cp i2c_viapro 8139too soundcore i2c_core shpchp sr_mod mii pci_hotplug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_table processor rtc_cmos floppy button thermal via_agp evdev sg pata_via ata_generic ide_pci_generic pata_acpi sata_via libata sd_mod scsi_mod crc_t10dif Sep 21 04:30:40 f6bvp-11 klogd: Pid: 5, comm: events/0 Not tainted 2.6.31-nosmp #3 Sep 21 04:30:40 f6bvp-11 klogd: Call Trace: Sep 21 04:30:40 f6bvp-11 klogd: <IRQ> [<ffffffffa03ab750>] ? ax25_kiss_rcv+0x650/0xab0 [ax25] Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff81053b90>] warn_slowpath_common+0x80/0xe0 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff81053c12>] warn_slowpath_null+0x22/0x40 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffffa03ab750>] ax25_kiss_rcv+0x650/0xab0 [ax25] Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8132b4bd>] ? sock_def_readable+0x3d/0x80 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8132c96d>] ? sock_queue_rcv_skb+0x12d/0x160 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8133a831>] netif_receive_skb+0x351/0x5f0 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff81061699>] ? run_timer_softirq+0x179/0x250 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8133ab50>] process_backlog+0x80/0xe0 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8133b4a4>] net_rx_action+0xf4/0x220 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8105b242>] __do_softirq+0xe2/0x1d0 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8101414a>] call_softirq+0x1a/0x30 Sep 21 04:30:40 f6bvp-11 klogd: <EOI> [<ffffffff810162c5>] do_softirq+0x75/0xc0 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8105b094>] local_bh_enable+0xc4/0xd0 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffffa03cd798>] mkiss_receive_buf+0x3a8/0x460 [mkiss] Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8104b864>] ? finish_task_switch+0x44/0xe0 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff812af800>] flush_to_ldisc+0x110/0x1f0 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8106c71c>] ? schedule_delayed_work+0x2c/0x50 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff812af6f0>] ? flush_to_ldisc+0x0/0x1f0 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8106c263>] worker_thread+0x173/0x260 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff81071be0>] ? autoremove_wake_function+0x0/0x60 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8106c0f0>] ? worker_thread+0x0/0x260 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8107149e>] kthread+0xae/0xc0 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff8101404a>] child_rip+0xa/0x20 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff810713f0>] ? kthread+0x0/0xc0 Sep 21 04:30:40 f6bvp-11 klogd: [<ffffffff81014040>] ? child_rip+0x0/0x20 Sep 21 04:30:40 f6bvp-11 klogd: ---[ end trace 5e079e87d8b30365 ]--- Sep 21 04:30:40 f6bvp-11 klogd: AX25_DBG: 1 ffff880064471c00 0 Regards, Bernard ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic @ 2009-09-21 20:11 Jarek Poplawski 2009-09-23 21:17 ` Bernard Pidoux F6BVP 0 siblings, 1 reply; 39+ messages in thread From: Jarek Poplawski @ 2009-09-21 20:11 UTC (permalink / raw) To: Bernard Pidoux; +Cc: Ralf Baechle DL5RB, Linux Netdev List, linux-hams <20090910142436.GB10547@linux-mips.org> <4AA9288B.2070205@upmc.fr> <20090911120557.GA12175@linux-mips.org> <4AB5EAE5.6070605@upmc.fr> <20090920210242.GA9804@del.dom.local> <4AB73CDE.4030709@upmc.fr> In-Reply-To: <4AB73CDE.4030709@upmc.fr> Bernard Pidoux wrote, On 09/21/2009 10:44 AM: > Hi Jarek, > > Good fishing ! > > During the night I catched the following two identical AX25_DBG > messages with netconsole > sending already reported message: kernel BUG at kernel/timer.c:913! > and followed by kernel > panics and the machine rebooting. > > > Sep 21 03:24:06 f6bvp-11 klogd: ------------[ cut here ]------------ > Sep 21 03:24:06 f6bvp-11 klogd: WARNING: at include/net/ax25.h:260 > ax25_kiss_rcv+0x650/0xab0 [ax25]() Thanks for testing. Alas I don't get how it's possible at this place (unless I miss the place), especially with a nosmp kernel. So here is take 2 (to apply after reverting the previous one). Regards, Jarek P. --- (debugging patch, take 2) include/net/ax25.h | 36 ++++++++++++++++++++++++++++++++++++ net/ax25/af_ax25.c | 12 ++++++++++++ 2 files changed, 48 insertions(+), 0 deletions(-) diff --git a/include/net/ax25.h b/include/net/ax25.h index 717e219..7fefbb0 100644 --- a/include/net/ax25.h +++ b/include/net/ax25.h @@ -252,9 +252,45 @@ typedef struct ax25_cb { #define ax25_cb_hold(__ax25) \ atomic_inc(&((__ax25)->refcount)) +static __inline__ int ax25_timers_warn(ax25_cb *ax25) +{ + int err = 0; + + if (del_timer(&ax25->timer)) { + WARN_ON_ONCE(1); + err = 1; + } + if (del_timer(&ax25->t1timer)) { + WARN_ON_ONCE(1); + err += 2; + } + if (del_timer(&ax25->t2timer)) { + WARN_ON_ONCE(1); + err += 4; + } + if (del_timer(&ax25->t3timer)) { + WARN_ON_ONCE(1); + err += 8; + } + if (del_timer(&ax25->idletimer)) { + WARN_ON_ONCE(1); + err += 16; + } + if (del_timer(&ax25->dtimer)) { + WARN_ON_ONCE(1); + err += 32; + } + if (err) + printk(KERN_WARNING "AX25_DBG: %d %p %u %s %d\n", err, ax25, + ax25->state, __func__, __LINE__); + + return err; +} + static __inline__ void ax25_cb_put(ax25_cb *ax25) { if (atomic_dec_and_test(&ax25->refcount)) { + ax25_timers_warn(ax25); kfree(ax25->digipeat); kfree(ax25); } diff --git a/net/ax25/af_ax25.c b/net/ax25/af_ax25.c index da0f64f..f1f515c 100644 --- a/net/ax25/af_ax25.c +++ b/net/ax25/af_ax25.c @@ -58,6 +58,9 @@ static const struct proto_ops ax25_proto_ops; static void ax25_free_sock(struct sock *sk) { + if (ax25_timers_warn(ax25_sk(sk))) + printk(KERN_WARNING "AX25_DBG: %p %u %u %u\n", sk, + sk->sk_family, sk->sk_type, sk->sk_protocol); ax25_cb_put(ax25_sk(sk)); } @@ -222,6 +225,8 @@ ax25_cb *ax25_find_cb(ax25_address *src_addr, ax25_address *dest_addr, if (s->ax25_dev == NULL) continue; if (ax25cmp(&s->source_addr, src_addr) == 0 && ax25cmp(&s->dest_addr, dest_addr) == 0 && s->ax25_dev->dev == dev) { + int ref; + if (digi != NULL && digi->ndigi != 0) { if (s->digipeat == NULL) continue; @@ -231,6 +236,13 @@ ax25_cb *ax25_find_cb(ax25_address *src_addr, ax25_address *dest_addr, if (s->digipeat != NULL && s->digipeat->ndigi != 0) continue; } + ref = atomic_read(&s->refcount); + if (ref < 2) { + WARN_ON_ONCE(1); + printk(KERN_WARNING "AX25_DBG: %d %p %d %s\n", + ref, s, s->state, __func__); + } + ax25_cb_hold(s); spin_unlock_bh(&ax25_list_lock); ^ permalink raw reply related [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2009-09-21 20:11 Jarek Poplawski @ 2009-09-23 21:17 ` Bernard Pidoux F6BVP 2009-09-24 8:07 ` Jarek Poplawski 0 siblings, 1 reply; 39+ messages in thread From: Bernard Pidoux F6BVP @ 2009-09-23 21:17 UTC (permalink / raw) To: Jarek Poplawski Cc: Bernard Pidoux, Ralf Baechle DL5RB, Linux Netdev List, linux-hams Hi Jarek, After applying your second patch I had to wait until today before I catched these kernel messages. The last three ones where single lines. There was no kernel panic. Sep 23 10:13:53 f6bvp-11 klogd: ------------[ cut here ]------------ Sep 23 10:13:53 f6bvp-11 klogd: WARNING: at net/ax25/af_ax25.c:241 ax25_find_cb+0x170/0x1a0 [ax25]() Sep 23 10:13:53 f6bvp-11 klogd: Hardware name: MS-7258 Sep 23 10:13:53 f6bvp-11 klogd: Modules linked in: netconsole netrom mkiss rose ax25 nfsd exportfs nfs l ockd nfs_acl auth_rpcgss sunrpc af_packet ipv6 snd_via82xx snd_ac97_codec ac97_bus snd_mpu401_uart snd_r awmidi snd_seq_dummy snd_seq_oss snd_seq_midi_event snd_seq snd_seq_device snd_pcm_oss snd_pcm snd_timer snd_page_alloc 8139cp snd_mixer_oss 8139too snd i2c_viapro i2c_core soundcore shpchp sr_mod mii pci_hot plug binfmt_misc ext3 jbd cpufreq_ondemand cpufreq_conservative cpufreq_powersave acpi_cpufreq freq_tabl e processor floppy sg rtc_cmos evdev button thermal via_agp pata_via ata_generic ide_pci_generic pata_ac pi sata_via libata sd_mod scsi_mod crc_t10dif Sep 23 10:13:53 f6bvp-11 klogd: Pid: 5, comm: events/0 Not tainted 2.6.31-nosmp #3 Sep 23 10:13:53 f6bvp-11 klogd: Call Trace: Sep 23 10:13:53 f6bvp-11 klogd: <IRQ> [<ffffffffa03b40d0>] ? ax25_find_cb+0x170/0x1a0 [ax25] Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff81053b90>] warn_slowpath_common+0x80/0xe0 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff81053c12>] warn_slowpath_null+0x22/0x40 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffffa03b40d0>] ax25_find_cb+0x170/0x1a0 [ax25] Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffffa03aced5>] ? ax25_listen_mine+0x95/0xb0 [ax25] Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffffa03ad299>] ax25_kiss_rcv+0x199/0xac0 [ax25] Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8132b4bd>] ? sock_def_readable+0x3d/0x80 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8132c96d>] ? sock_queue_rcv_skb+0x12d/0x160 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8133a831>] netif_receive_skb+0x351/0x5f0 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff81061699>] ? run_timer_softirq+0x179/0x250 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8133ab50>] process_backlog+0x80/0xe0 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8133b4a4>] net_rx_action+0xf4/0x220 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8105b242>] __do_softirq+0xe2/0x1d0 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8101414a>] call_softirq+0x1a/0x30 Sep 23 10:13:53 f6bvp-11 klogd: <EOI> [<ffffffff810162c5>] do_softirq+0x75/0xc0 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8105b094>] local_bh_enable+0xc4/0xd0 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffffa03cf798>] mkiss_receive_buf+0x3a8/0x460 [mkiss] Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8104b864>] ? finish_task_switch+0x44/0xe0 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff812af800>] flush_to_ldisc+0x110/0x1f0 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8106c71c>] ? schedule_delayed_work+0x2c/0x50 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff812af6f0>] ? flush_to_ldisc+0x0/0x1f0 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8106c263>] worker_thread+0x173/0x260 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff81071be0>] ? autoremove_wake_function+0x0/0x60 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8106c0f0>] ? worker_thread+0x0/0x260 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8107149e>] kthread+0xae/0xc0 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff8101404a>] child_rip+0xa/0x20 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff810713f0>] ? kthread+0x0/0xc0 Sep 23 10:13:53 f6bvp-11 klogd: [<ffffffff81014040>] ? child_rip+0x0/0x20 Sep 23 10:13:53 f6bvp-11 klogd: ---[ end trace 422da9fe354a7ce3 ]--- Sep 23 10:13:53 f6bvp-11 klogd: AX25_DBG: 1 ffff880003c80000 0 ax25_find_cb Sep 23 10:13:53 f6bvp-11 last message repeated 2 times ----- Sep 23 14:26:56 f6bvp-11 klogd: AX25_DBG: 1 ffff88005247b000 0 ax25_find_cb Sep 23 14:26:56 f6bvp-11 klogd: AX25_DBG: 1 ffff88005247b000 0 ax25_find_cb Sep 23 14:26:56 f6bvp-11 klogd: AX25_DBG: 1 ffff88005247b000 0 ax25_find_cb ----- Regards, Bernard Jarek Poplawski a e'crit : > <20090910142436.GB10547@linux-mips.org> <4AA9288B.2070205@upmc.fr> > <20090911120557.GA12175@linux-mips.org> <4AB5EAE5.6070605@upmc.fr> > <20090920210242.GA9804@del.dom.local> <4AB73CDE.4030709@upmc.fr> > In-Reply-To: <4AB73CDE.4030709@upmc.fr> > > Bernard Pidoux wrote, On 09/21/2009 10:44 AM: > >> Hi Jarek, >> >> Good fishing ! >> >> During the night I catched the following two identical AX25_DBG >> messages with netconsole >> sending already reported message: kernel BUG at kernel/timer.c:913! >> and followed by kernel >> panics and the machine rebooting. >> >> >> Sep 21 03:24:06 f6bvp-11 klogd: ------------[ cut here ]------------ >> Sep 21 03:24:06 f6bvp-11 klogd: WARNING: at include/net/ax25.h:260 >> ax25_kiss_rcv+0x650/0xab0 [ax25]() > > Thanks for testing. Alas I don't get how it's possible at this place > (unless I miss the place), especially with a nosmp kernel. So here is > take 2 (to apply after reverting the previous one). > > Regards, > Jarek P. > --- (debugging patch, take 2) > > include/net/ax25.h | 36 ++++++++++++++++++++++++++++++++++++ > net/ax25/af_ax25.c | 12 ++++++++++++ > 2 files changed, 48 insertions(+), 0 deletions(-) > > diff --git a/include/net/ax25.h b/include/net/ax25.h > index 717e219..7fefbb0 100644 > --- a/include/net/ax25.h > +++ b/include/net/ax25.h > @@ -252,9 +252,45 @@ typedef struct ax25_cb { > #define ax25_cb_hold(__ax25) \ > atomic_inc(&((__ax25)->refcount)) > > +static __inline__ int ax25_timers_warn(ax25_cb *ax25) > +{ > + int err = 0; > + > + if (del_timer(&ax25->timer)) { > + WARN_ON_ONCE(1); > + err = 1; > + } > + if (del_timer(&ax25->t1timer)) { > + WARN_ON_ONCE(1); > + err += 2; > + } > + if (del_timer(&ax25->t2timer)) { > + WARN_ON_ONCE(1); > + err += 4; > + } > + if (del_timer(&ax25->t3timer)) { > + WARN_ON_ONCE(1); > + err += 8; > + } > + if (del_timer(&ax25->idletimer)) { > + WARN_ON_ONCE(1); > + err += 16; > + } > + if (del_timer(&ax25->dtimer)) { > + WARN_ON_ONCE(1); > + err += 32; > + } > + if (err) > + printk(KERN_WARNING "AX25_DBG: %d %p %u %s %d\n", err, ax25, > + ax25->state, __func__, __LINE__); > + > + return err; > +} > + > static __inline__ void ax25_cb_put(ax25_cb *ax25) > { > if (atomic_dec_and_test(&ax25->refcount)) { > + ax25_timers_warn(ax25); > kfree(ax25->digipeat); > kfree(ax25); > } > diff --git a/net/ax25/af_ax25.c b/net/ax25/af_ax25.c > index da0f64f..f1f515c 100644 > --- a/net/ax25/af_ax25.c > +++ b/net/ax25/af_ax25.c > @@ -58,6 +58,9 @@ static const struct proto_ops ax25_proto_ops; > > static void ax25_free_sock(struct sock *sk) > { > + if (ax25_timers_warn(ax25_sk(sk))) > + printk(KERN_WARNING "AX25_DBG: %p %u %u %u\n", sk, > + sk->sk_family, sk->sk_type, sk->sk_protocol); > ax25_cb_put(ax25_sk(sk)); > } > > @@ -222,6 +225,8 @@ ax25_cb *ax25_find_cb(ax25_address *src_addr, ax25_address *dest_addr, > if (s->ax25_dev == NULL) > continue; > if (ax25cmp(&s->source_addr, src_addr) == 0 && ax25cmp(&s->dest_addr, dest_addr) == 0 && s->ax25_dev->dev == dev) { > + int ref; > + > if (digi != NULL && digi->ndigi != 0) { > if (s->digipeat == NULL) > continue; > @@ -231,6 +236,13 @@ ax25_cb *ax25_find_cb(ax25_address *src_addr, ax25_address *dest_addr, > if (s->digipeat != NULL && s->digipeat->ndigi != 0) > continue; > } > + ref = atomic_read(&s->refcount); > + if (ref < 2) { > + WARN_ON_ONCE(1); > + printk(KERN_WARNING "AX25_DBG: %d %p %d %s\n", > + ref, s, s->state, __func__); > + } > + > ax25_cb_hold(s); > spin_unlock_bh(&ax25_list_lock); > > > -- > To unsubscribe from this list: send the line "unsubscribe linux-hams" in > the body of a message to majordomo@vger.kernel.org > More majordomo info at http://vger.kernel.org/majordomo-info.html > > ^ permalink raw reply [flat|nested] 39+ messages in thread
* Re: [AX25] kernel panic 2009-09-23 21:17 ` Bernard Pidoux F6BVP @ 2009-09-24 8:07 ` Jarek Poplawski 0 siblings, 0 replies; 39+ messages in thread From: Jarek Poplawski @ 2009-09-24 8:07 UTC (permalink / raw) To: Bernard Pidoux F6BVP Cc: Bernard Pidoux, Ralf Baechle DL5RB, Linux Netdev List, linux-hams On Wed, Sep 23, 2009 at 11:17:12PM +0200, Bernard Pidoux F6BVP wrote: > Hi Jarek, Hi Bernard, > > After applying your second patch I had to wait until today before I catched > these kernel messages. > The last three ones where single lines. > There was no kernel panic. Probably you didn't hit the some kind of traffic/problems, because there was only some additional reporting in this patch vs. take 1. In the meantime I found some strangeness in refcounting around ax25_send_frame, and below is a patch which IMHO should fix it. I don't know if it matters in your case (the previous report suggested there should be something more), but let's try. Please, don't remove the previous debugging patch yet, while testing this one. Thanks, Jarek P. --- (ax25_send_frame patch take 1 for testing) include/net/netrom.h | 2 ++ net/ax25/ax25_out.c | 6 ++++++ net/netrom/nr_route.c | 11 ++++++----- net/rose/rose_link.c | 8 ++++++++ net/rose/rose_route.c | 5 +++++ 5 files changed, 27 insertions(+), 5 deletions(-) diff --git a/include/net/netrom.h b/include/net/netrom.h index 15696b1..ab170a6 100644 --- a/include/net/netrom.h +++ b/include/net/netrom.h @@ -132,6 +132,8 @@ static __inline__ void nr_node_put(struct nr_node *nr_node) static __inline__ void nr_neigh_put(struct nr_neigh *nr_neigh) { if (atomic_dec_and_test(&nr_neigh->refcount)) { + if (nr_neigh->ax25) + ax25_cb_put(nr_neigh->ax25); kfree(nr_neigh->digipeat); kfree(nr_neigh); } diff --git a/net/ax25/ax25_out.c b/net/ax25/ax25_out.c index bf706f8..1491260 100644 --- a/net/ax25/ax25_out.c +++ b/net/ax25/ax25_out.c @@ -92,6 +92,12 @@ ax25_cb *ax25_send_frame(struct sk_buff *skb, int paclen, ax25_address *src, ax2 #endif } + /* + * There is one ref for the state machine; a caller needs + * one more to put it back, just like with the existing one. + */ + ax25_cb_hold(ax25); + ax25_cb_add(ax25); ax25->state = AX25_STATE_1; diff --git a/net/netrom/nr_route.c b/net/netrom/nr_route.c index 4eb1ac9..850ffc0 100644 --- a/net/netrom/nr_route.c +++ b/net/netrom/nr_route.c @@ -842,12 +842,13 @@ int nr_route_frame(struct sk_buff *skb, ax25_cb *ax25) dptr = skb_push(skb, 1); *dptr = AX25_P_NETROM; - ax25s = ax25_send_frame(skb, 256, (ax25_address *)dev->dev_addr, &nr_neigh->callsign, nr_neigh->digipeat, nr_neigh->dev); - if (nr_neigh->ax25 && ax25s) { - /* We were already holding this ax25_cb */ + ax25s = nr_neigh->ax25; + nr_neigh->ax25 = ax25_send_frame(skb, 256, + (ax25_address *)dev->dev_addr, + &nr_neigh->callsign, + nr_neigh->digipeat, nr_neigh->dev); + if (ax25s) ax25_cb_put(ax25s); - } - nr_neigh->ax25 = ax25s; dev_put(dev); ret = (nr_neigh->ax25 != NULL); diff --git a/net/rose/rose_link.c b/net/rose/rose_link.c index bd86a63..5ef5f69 100644 --- a/net/rose/rose_link.c +++ b/net/rose/rose_link.c @@ -101,13 +101,17 @@ static void rose_t0timer_expiry(unsigned long param) static int rose_send_frame(struct sk_buff *skb, struct rose_neigh *neigh) { ax25_address *rose_call; + ax25_cb *ax25s; if (ax25cmp(&rose_callsign, &null_ax25_address) == 0) rose_call = (ax25_address *)neigh->dev->dev_addr; else rose_call = &rose_callsign; + ax25s = neigh->ax25; neigh->ax25 = ax25_send_frame(skb, 260, rose_call, &neigh->callsign, neigh->digipeat, neigh->dev); + if (ax25s) + ax25_cb_put(ax25s); return (neigh->ax25 != NULL); } @@ -120,13 +124,17 @@ static int rose_send_frame(struct sk_buff *skb, struct rose_neigh *neigh) static int rose_link_up(struct rose_neigh *neigh) { ax25_address *rose_call; + ax25_cb *ax25s; if (ax25cmp(&rose_callsign, &null_ax25_address) == 0) rose_call = (ax25_address *)neigh->dev->dev_addr; else rose_call = &rose_callsign; + ax25s = neigh->ax25; neigh->ax25 = ax25_find_cb(rose_call, &neigh->callsign, neigh->digipeat, neigh->dev); + if (ax25s) + ax25_cb_put(ax25s); return (neigh->ax25 != NULL); } diff --git a/net/rose/rose_route.c b/net/rose/rose_route.c index 9478d9b..8e5d5ac 100644 --- a/net/rose/rose_route.c +++ b/net/rose/rose_route.c @@ -234,6 +234,8 @@ static void rose_remove_neigh(struct rose_neigh *rose_neigh) if ((s = rose_neigh_list) == rose_neigh) { rose_neigh_list = rose_neigh->next; + if (rose_neigh->ax25) + ax25_cb_put(rose_neigh->ax25); kfree(rose_neigh->digipeat); kfree(rose_neigh); return; @@ -242,6 +244,8 @@ static void rose_remove_neigh(struct rose_neigh *rose_neigh) while (s != NULL && s->next != NULL) { if (s->next == rose_neigh) { s->next = rose_neigh->next; + if (rose_neigh->ax25) + ax25_cb_put(rose_neigh->ax25); kfree(rose_neigh->digipeat); kfree(rose_neigh); return; @@ -814,6 +818,7 @@ void rose_link_failed(ax25_cb *ax25, int reason) if (rose_neigh != NULL) { rose_neigh->ax25 = NULL; + ax25_cb_put(ax25); rose_del_route_by_neigh(rose_neigh); rose_kill_by_neigh(rose_neigh); ^ permalink raw reply related [flat|nested] 39+ messages in thread
end of thread, other threads:[~2009-09-24 8:07 UTC | newest]
Thread overview: 39+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2008-03-18 10:44 [AX25] kernel panic Bernard Pidoux F6BVP
2008-03-18 21:25 ` Francois Romieu
2008-03-19 7:36 ` Bernard Pidoux F6BVP
2008-03-19 20:57 ` Bernard Pidoux
2008-03-20 7:30 ` Jarek Poplawski
2008-03-20 22:58 ` Bernard Pidoux
2008-03-21 0:28 ` Jarek Poplawski
2008-03-21 9:52 ` Bernard Pidoux
2008-03-21 11:22 ` Jarek Poplawski
2008-03-21 9:40 ` Bernard Pidoux
2008-03-22 11:36 ` Jarek Poplawski
2008-03-23 17:00 ` Bernard Pidoux
2008-03-24 20:51 ` Jarek Poplawski
2008-03-25 13:23 ` Bernard Pidoux
2008-03-25 20:51 ` Jarek Poplawski
2008-03-26 18:35 ` Jarek Poplawski
2008-03-28 8:24 ` Bernard Pidoux
2008-03-28 8:27 ` Bernard Pidoux
2008-03-28 12:07 ` Jarek Poplawski
2008-03-29 12:04 ` Bernard Pidoux
2008-03-29 12:24 ` Jarek Poplawski
2008-03-30 8:43 ` Bernard Pidoux
2008-03-30 9:16 ` Jarek Poplawski
2008-03-30 17:38 ` Bernard Pidoux
2008-03-30 18:49 ` Jarek Poplawski
2008-03-30 9:00 ` Bernard Pidoux
[not found] ` <47EE38BA.9090500@free.fr>
[not found] ` <20080329130451.GC3407@ami.dom.local>
[not found] ` <47EF6479.7030702@free.fr>
[not found] ` <20080330115958.GA4975@ami.dom.local>
2008-04-01 20:37 ` Bernard Pidoux
2008-04-02 6:41 ` [ROSE/AX25] af_rose: rose_release() fix Jarek Poplawski
2008-04-02 6:56 ` David Miller
2009-09-09 22:28 [AX25] kernel panic Bernard Pidoux
2009-09-11 19:21 ` Jarek Poplawski
2009-09-15 10:16 ` Bernard Pidoux
[not found] ` <20090910142436.GB10547@linux-mips.org>
[not found] ` <4AA9288B.2070205@upmc.fr>
[not found] ` <20090911120557.GA12175@linux-mips.org>
2009-09-20 8:42 ` Bernard Pidoux
2009-09-20 9:09 ` f8arr
2009-09-20 21:02 ` Jarek Poplawski
2009-09-21 8:44 ` Bernard Pidoux
2009-09-21 20:11 Jarek Poplawski
2009-09-23 21:17 ` Bernard Pidoux F6BVP
2009-09-24 8:07 ` Jarek Poplawski
This is an external index of several public inboxes, see mirroring instructions on how to clone and mirror all data and code used by this external index.