All of lore.kernel.org
 help / color / mirror / Atom feed
* 2.6.31-rc4-rt1: BUG: panic in requeue_pi test case
@ 2009-08-04 14:37 ` Darren Hart
  0 siblings, 0 replies; 2+ messages in thread
From: Darren Hart @ 2009-08-04 14:37 UTC (permalink / raw)
  To: linux-rt-users, lkml, ,
	Thomas Gleixner, Peter Zijlstra, Ingo Molnar,
	Dinakar Guniguntala

Using a slightly modified version of pthread_cond_many from 
ltp/testcases/realtime/perf/latency I tripped over the following crash 
while using a patched glibc to make use of the new futex requeue_pi 
syscalls.  The changes to the test boil down to making the "child_mutex" 
PI aware.  The unmodified test ran for 10 hours using the old futex 
behavior (stock glibc).  I'll do some more investigation and see if I 
can reproduce on mainline, or on a 2.6.29 rt kernel.


Kernel panic - not syncing: softlockup: hung tasks
BUG: soft lockup - CPU#5 stuck for 61s! [pthread_cond_ma:30534]
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap 
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs 
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss 
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon 
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt 
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c 
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash 
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase 
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd 
ohci_hcd ehci_hcd
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap 
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs 
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss 
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon 
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt 
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c 
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash 
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase 
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd 
ohci_hcd ehci_hcd
Call Trace:
  [<ffffffff813fe78a>] ? rt_spin_lock_slowlock+0xdb/0x1b9
  [<ffffffff813fe6af>] ? rt_spin_lock_slowlock+0x0/0x1b9
  [<ffffffff8108de6d>] ? rt_spin_lock_fastlock+0x77/0x93
  [<ffffffff813feddf>] ? rt_spin_lock+0x28/0x3e
  [<ffffffff8108a6c8>] ? queue_lock+0x46/0x66
  [<ffffffff8108bcc0>] ? futex_lock_pi+0xf9/0x2c1
  [<ffffffff8113a59b>] ? __pollwait+0x0/0x107
  [<ffffffff813ff581>] ? _atomic_spin_unlock_irqrestore+0x49/0x68
  [<ffffffff8108e296>] ? rt_mutex_adjust_prio+0x49/0x68
  [<ffffffff8108ddc5>] ? rt_spin_lock_fastunlock+0x54/0x85
  [<ffffffff8108cc43>] ? do_futex+0x7e2/0xb41
  [<ffffffff810421a0>] ? pick_next_task_idle+0x2b/0x4d
  [<ffffffff81060809>] ? timespec_add_safe+0x4b/0x94
  [<ffffffff8100cdde>] ? apic_timer_interrupt+0xe/0x20
  [<ffffffff8108d0c7>] ? sys_futex+0x125/0x157
  [<ffffffff8100c29b>] ? system_call_fastpath+0x16/0x1b
Kernel panic - not syncing: softlockup: hung tasks
BUG: soft lockup - CPU#6 stuck for 61s! [pthread_cond_ma:30536]
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap 
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs 
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss 
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon 
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt 
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c 
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash 
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase 
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd 
ohci_hcd ehci_hcd
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap 
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs 
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss 
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon 
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt 
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c 
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash 
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase 
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd 
ohci_hcd ehci_hcd
Call Trace:
  [<ffffffff813fe78a>] ? rt_spin_lock_slowlock+0xdb/0x1b9
  [<ffffffff813fe6af>] ? rt_spin_lock_slowlock+0x0/0x1b9
  [<ffffffff8108de6d>] ? rt_spin_lock_fastlock+0x77/0x93
  [<ffffffff813feddf>] ? rt_spin_lock+0x28/0x3e
  [<ffffffff8108a6c8>] ? queue_lock+0x46/0x66
  [<ffffffff8108bcc0>] ? futex_lock_pi+0xf9/0x2c1
  [<ffffffff8113a59b>] ? __pollwait+0x0/0x107
  [<ffffffff8108e296>] ? rt_mutex_adjust_prio+0x49/0x68
  [<ffffffff813fe692>] ? rt_spin_lock_slowunlock+0x6f/0x8c
  [<ffffffff813fe623>] ? rt_spin_lock_slowunlock+0x0/0x8c
  [<ffffffff8108ddd9>] ? rt_spin_lock_fastunlock+0x68/0x85
  [<ffffffff8108cc43>] ? do_futex+0x7e2/0xb41
  [<ffffffff810421a0>] ? pick_next_task_idle+0x2b/0x4d
  [<ffffffff81060809>] ? timespec_add_safe+0x4b/0x94
  [<ffffffff8100cdde>] ? apic_timer_interrupt+0xe/0x20
  [<ffffffff8108d0c7>] ? sys_futex+0x125/0x157
  [<ffffffff8100c29b>] ? system_call_fastpath+0x16/0x1b
Kernel panic - not syncing: softlockup: hung tasks
BUG: soft lockup - CPU#7 stuck for 61s! [pthread_cond_ma:30537]
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap 
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs 
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss 
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon 
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt 
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c 
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash 
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase 
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd 
ohci_hcd ehci_hcd
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap 
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs 
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss 
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon 
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt 
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c 
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash 
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase 
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd 
ohci_hcd ehci_hcd
Call Trace:
  [<ffffffff813fe78a>] ? rt_spin_lock_slowlock+0xdb/0x1b9
  [<ffffffff813fe6af>] ? rt_spin_lock_slowlock+0x0/0x1b9
  [<ffffffff8108de6d>] ? rt_spin_lock_fastlock+0x77/0x93
  [<ffffffff813feddf>] ? rt_spin_lock+0x28/0x3e
  [<ffffffff8108a6c8>] ? queue_lock+0x46/0x66
  [<ffffffff8108bcc0>] ? futex_lock_pi+0xf9/0x2c1
  [<ffffffff8113a59b>] ? __pollwait+0x0/0x107
  [<ffffffff8108e296>] ? rt_mutex_adjust_prio+0x49/0x68
  [<ffffffff813fe692>] ? rt_spin_lock_slowunlock+0x6f/0x8c
  [<ffffffff813fe623>] ? rt_spin_lock_slowunlock+0x0/0x8c
  [<ffffffff8108ddd9>] ? rt_spin_lock_fastunlock+0x68/0x85
  [<ffffffff8108cc43>] ? do_futex+0x7e2/0xb41
  [<ffffffff810421a0>] ? pick_next_task_idle+0x2b/0x4d
  [<ffffffff81060809>] ? timespec_add_safe+0x4b/0x94
  [<ffffffff8108d0c7>] ? sys_futex+0x125/0x157
  [<ffffffff8100c29b>] ? system_call_fastpath+0x16/0x1b
Kernel panic - not syncing: softlockup: hung tasks


-- 
Darren Hart
IBM Linux Technology Center
Real-Time Linux Team

^ permalink raw reply	[flat|nested] 2+ messages in thread

* 2.6.31-rc4-rt1: BUG: panic in requeue_pi test case
@ 2009-08-04 14:37 ` Darren Hart
  0 siblings, 0 replies; 2+ messages in thread
From: Darren Hart @ 2009-08-04 14:37 UTC (permalink / raw)
  To: linux-rt-users, lkml, , Thomas Gleixner, Peter Zijlstra, Ingo Molnar

Using a slightly modified version of pthread_cond_many from 
ltp/testcases/realtime/perf/latency I tripped over the following crash 
while using a patched glibc to make use of the new futex requeue_pi 
syscalls.  The changes to the test boil down to making the "child_mutex" 
PI aware.  The unmodified test ran for 10 hours using the old futex 
behavior (stock glibc).  I'll do some more investigation and see if I 
can reproduce on mainline, or on a 2.6.29 rt kernel.


Kernel panic - not syncing: softlockup: hung tasks
BUG: soft lockup - CPU#5 stuck for 61s! [pthread_cond_ma:30534]
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap 
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs 
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss 
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon 
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt 
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c 
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash 
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase 
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd 
ohci_hcd ehci_hcd
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap 
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs 
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss 
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon 
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt 
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c 
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash 
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase 
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd 
ohci_hcd ehci_hcd
Call Trace:
  [<ffffffff813fe78a>] ? rt_spin_lock_slowlock+0xdb/0x1b9
  [<ffffffff813fe6af>] ? rt_spin_lock_slowlock+0x0/0x1b9
  [<ffffffff8108de6d>] ? rt_spin_lock_fastlock+0x77/0x93
  [<ffffffff813feddf>] ? rt_spin_lock+0x28/0x3e
  [<ffffffff8108a6c8>] ? queue_lock+0x46/0x66
  [<ffffffff8108bcc0>] ? futex_lock_pi+0xf9/0x2c1
  [<ffffffff8113a59b>] ? __pollwait+0x0/0x107
  [<ffffffff813ff581>] ? _atomic_spin_unlock_irqrestore+0x49/0x68
  [<ffffffff8108e296>] ? rt_mutex_adjust_prio+0x49/0x68
  [<ffffffff8108ddc5>] ? rt_spin_lock_fastunlock+0x54/0x85
  [<ffffffff8108cc43>] ? do_futex+0x7e2/0xb41
  [<ffffffff810421a0>] ? pick_next_task_idle+0x2b/0x4d
  [<ffffffff81060809>] ? timespec_add_safe+0x4b/0x94
  [<ffffffff8100cdde>] ? apic_timer_interrupt+0xe/0x20
  [<ffffffff8108d0c7>] ? sys_futex+0x125/0x157
  [<ffffffff8100c29b>] ? system_call_fastpath+0x16/0x1b
Kernel panic - not syncing: softlockup: hung tasks
BUG: soft lockup - CPU#6 stuck for 61s! [pthread_cond_ma:30536]
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap 
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs 
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss 
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon 
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt 
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c 
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash 
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase 
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd 
ohci_hcd ehci_hcd
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap 
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs 
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss 
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon 
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt 
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c 
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash 
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase 
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd 
ohci_hcd ehci_hcd
Call Trace:
  [<ffffffff813fe78a>] ? rt_spin_lock_slowlock+0xdb/0x1b9
  [<ffffffff813fe6af>] ? rt_spin_lock_slowlock+0x0/0x1b9
  [<ffffffff8108de6d>] ? rt_spin_lock_fastlock+0x77/0x93
  [<ffffffff813feddf>] ? rt_spin_lock+0x28/0x3e
  [<ffffffff8108a6c8>] ? queue_lock+0x46/0x66
  [<ffffffff8108bcc0>] ? futex_lock_pi+0xf9/0x2c1
  [<ffffffff8113a59b>] ? __pollwait+0x0/0x107
  [<ffffffff8108e296>] ? rt_mutex_adjust_prio+0x49/0x68
  [<ffffffff813fe692>] ? rt_spin_lock_slowunlock+0x6f/0x8c
  [<ffffffff813fe623>] ? rt_spin_lock_slowunlock+0x0/0x8c
  [<ffffffff8108ddd9>] ? rt_spin_lock_fastunlock+0x68/0x85
  [<ffffffff8108cc43>] ? do_futex+0x7e2/0xb41
  [<ffffffff810421a0>] ? pick_next_task_idle+0x2b/0x4d
  [<ffffffff81060809>] ? timespec_add_safe+0x4b/0x94
  [<ffffffff8100cdde>] ? apic_timer_interrupt+0xe/0x20
  [<ffffffff8108d0c7>] ? sys_futex+0x125/0x157
  [<ffffffff8100c29b>] ? system_call_fastpath+0x16/0x1b
Kernel panic - not syncing: softlockup: hung tasks
BUG: soft lockup - CPU#7 stuck for 61s! [pthread_cond_ma:30537]
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap 
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs 
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss 
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon 
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt 
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c 
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash 
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase 
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd 
ohci_hcd ehci_hcd
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap 
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs 
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss 
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon 
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt 
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c 
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash 
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase 
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd 
ohci_hcd ehci_hcd
Call Trace:
  [<ffffffff813fe78a>] ? rt_spin_lock_slowlock+0xdb/0x1b9
  [<ffffffff813fe6af>] ? rt_spin_lock_slowlock+0x0/0x1b9
  [<ffffffff8108de6d>] ? rt_spin_lock_fastlock+0x77/0x93
  [<ffffffff813feddf>] ? rt_spin_lock+0x28/0x3e
  [<ffffffff8108a6c8>] ? queue_lock+0x46/0x66
  [<ffffffff8108bcc0>] ? futex_lock_pi+0xf9/0x2c1
  [<ffffffff8113a59b>] ? __pollwait+0x0/0x107
  [<ffffffff8108e296>] ? rt_mutex_adjust_prio+0x49/0x68
  [<ffffffff813fe692>] ? rt_spin_lock_slowunlock+0x6f/0x8c
  [<ffffffff813fe623>] ? rt_spin_lock_slowunlock+0x0/0x8c
  [<ffffffff8108ddd9>] ? rt_spin_lock_fastunlock+0x68/0x85
  [<ffffffff8108cc43>] ? do_futex+0x7e2/0xb41
  [<ffffffff810421a0>] ? pick_next_task_idle+0x2b/0x4d
  [<ffffffff81060809>] ? timespec_add_safe+0x4b/0x94
  [<ffffffff8108d0c7>] ? sys_futex+0x125/0x157
  [<ffffffff8100c29b>] ? system_call_fastpath+0x16/0x1b
Kernel panic - not syncing: softlockup: hung tasks


-- 
Darren Hart
IBM Linux Technology Center
Real-Time Linux Team

^ permalink raw reply	[flat|nested] 2+ messages in thread

end of thread, other threads:[~2009-08-04 14:38 UTC | newest]

Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2009-08-04 14:37 2.6.31-rc4-rt1: BUG: panic in requeue_pi test case Darren Hart
2009-08-04 14:37 ` Darren Hart

This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.