* 2.6.31-rc4-rt1: BUG: panic in requeue_pi test case
@ 2009-08-04 14:37 ` Darren Hart
0 siblings, 0 replies; 2+ messages in thread
From: Darren Hart @ 2009-08-04 14:37 UTC (permalink / raw)
To: linux-rt-users, lkml, ,
Thomas Gleixner, Peter Zijlstra, Ingo Molnar,
Dinakar Guniguntala
Using a slightly modified version of pthread_cond_many from
ltp/testcases/realtime/perf/latency I tripped over the following crash
while using a patched glibc to make use of the new futex requeue_pi
syscalls. The changes to the test boil down to making the "child_mutex"
PI aware. The unmodified test ran for 10 hours using the old futex
behavior (stock glibc). I'll do some more investigation and see if I
can reproduce on mainline, or on a 2.6.29 rt kernel.
Kernel panic - not syncing: softlockup: hung tasks
BUG: soft lockup - CPU#5 stuck for 61s! [pthread_cond_ma:30534]
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd
ohci_hcd ehci_hcd
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd
ohci_hcd ehci_hcd
Call Trace:
[<ffffffff813fe78a>] ? rt_spin_lock_slowlock+0xdb/0x1b9
[<ffffffff813fe6af>] ? rt_spin_lock_slowlock+0x0/0x1b9
[<ffffffff8108de6d>] ? rt_spin_lock_fastlock+0x77/0x93
[<ffffffff813feddf>] ? rt_spin_lock+0x28/0x3e
[<ffffffff8108a6c8>] ? queue_lock+0x46/0x66
[<ffffffff8108bcc0>] ? futex_lock_pi+0xf9/0x2c1
[<ffffffff8113a59b>] ? __pollwait+0x0/0x107
[<ffffffff813ff581>] ? _atomic_spin_unlock_irqrestore+0x49/0x68
[<ffffffff8108e296>] ? rt_mutex_adjust_prio+0x49/0x68
[<ffffffff8108ddc5>] ? rt_spin_lock_fastunlock+0x54/0x85
[<ffffffff8108cc43>] ? do_futex+0x7e2/0xb41
[<ffffffff810421a0>] ? pick_next_task_idle+0x2b/0x4d
[<ffffffff81060809>] ? timespec_add_safe+0x4b/0x94
[<ffffffff8100cdde>] ? apic_timer_interrupt+0xe/0x20
[<ffffffff8108d0c7>] ? sys_futex+0x125/0x157
[<ffffffff8100c29b>] ? system_call_fastpath+0x16/0x1b
Kernel panic - not syncing: softlockup: hung tasks
BUG: soft lockup - CPU#6 stuck for 61s! [pthread_cond_ma:30536]
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd
ohci_hcd ehci_hcd
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd
ohci_hcd ehci_hcd
Call Trace:
[<ffffffff813fe78a>] ? rt_spin_lock_slowlock+0xdb/0x1b9
[<ffffffff813fe6af>] ? rt_spin_lock_slowlock+0x0/0x1b9
[<ffffffff8108de6d>] ? rt_spin_lock_fastlock+0x77/0x93
[<ffffffff813feddf>] ? rt_spin_lock+0x28/0x3e
[<ffffffff8108a6c8>] ? queue_lock+0x46/0x66
[<ffffffff8108bcc0>] ? futex_lock_pi+0xf9/0x2c1
[<ffffffff8113a59b>] ? __pollwait+0x0/0x107
[<ffffffff8108e296>] ? rt_mutex_adjust_prio+0x49/0x68
[<ffffffff813fe692>] ? rt_spin_lock_slowunlock+0x6f/0x8c
[<ffffffff813fe623>] ? rt_spin_lock_slowunlock+0x0/0x8c
[<ffffffff8108ddd9>] ? rt_spin_lock_fastunlock+0x68/0x85
[<ffffffff8108cc43>] ? do_futex+0x7e2/0xb41
[<ffffffff810421a0>] ? pick_next_task_idle+0x2b/0x4d
[<ffffffff81060809>] ? timespec_add_safe+0x4b/0x94
[<ffffffff8100cdde>] ? apic_timer_interrupt+0xe/0x20
[<ffffffff8108d0c7>] ? sys_futex+0x125/0x157
[<ffffffff8100c29b>] ? system_call_fastpath+0x16/0x1b
Kernel panic - not syncing: softlockup: hung tasks
BUG: soft lockup - CPU#7 stuck for 61s! [pthread_cond_ma:30537]
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd
ohci_hcd ehci_hcd
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd
ohci_hcd ehci_hcd
Call Trace:
[<ffffffff813fe78a>] ? rt_spin_lock_slowlock+0xdb/0x1b9
[<ffffffff813fe6af>] ? rt_spin_lock_slowlock+0x0/0x1b9
[<ffffffff8108de6d>] ? rt_spin_lock_fastlock+0x77/0x93
[<ffffffff813feddf>] ? rt_spin_lock+0x28/0x3e
[<ffffffff8108a6c8>] ? queue_lock+0x46/0x66
[<ffffffff8108bcc0>] ? futex_lock_pi+0xf9/0x2c1
[<ffffffff8113a59b>] ? __pollwait+0x0/0x107
[<ffffffff8108e296>] ? rt_mutex_adjust_prio+0x49/0x68
[<ffffffff813fe692>] ? rt_spin_lock_slowunlock+0x6f/0x8c
[<ffffffff813fe623>] ? rt_spin_lock_slowunlock+0x0/0x8c
[<ffffffff8108ddd9>] ? rt_spin_lock_fastunlock+0x68/0x85
[<ffffffff8108cc43>] ? do_futex+0x7e2/0xb41
[<ffffffff810421a0>] ? pick_next_task_idle+0x2b/0x4d
[<ffffffff81060809>] ? timespec_add_safe+0x4b/0x94
[<ffffffff8108d0c7>] ? sys_futex+0x125/0x157
[<ffffffff8100c29b>] ? system_call_fastpath+0x16/0x1b
Kernel panic - not syncing: softlockup: hung tasks
--
Darren Hart
IBM Linux Technology Center
Real-Time Linux Team
^ permalink raw reply [flat|nested] 2+ messages in thread
* 2.6.31-rc4-rt1: BUG: panic in requeue_pi test case
@ 2009-08-04 14:37 ` Darren Hart
0 siblings, 0 replies; 2+ messages in thread
From: Darren Hart @ 2009-08-04 14:37 UTC (permalink / raw)
To: linux-rt-users, lkml, , Thomas Gleixner, Peter Zijlstra, Ingo Molnar
Using a slightly modified version of pthread_cond_many from
ltp/testcases/realtime/perf/latency I tripped over the following crash
while using a patched glibc to make use of the new futex requeue_pi
syscalls. The changes to the test boil down to making the "child_mutex"
PI aware. The unmodified test ran for 10 hours using the old futex
behavior (stock glibc). I'll do some more investigation and see if I
can reproduce on mainline, or on a 2.6.29 rt kernel.
Kernel panic - not syncing: softlockup: hung tasks
BUG: soft lockup - CPU#5 stuck for 61s! [pthread_cond_ma:30534]
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd
ohci_hcd ehci_hcd
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd
ohci_hcd ehci_hcd
Call Trace:
[<ffffffff813fe78a>] ? rt_spin_lock_slowlock+0xdb/0x1b9
[<ffffffff813fe6af>] ? rt_spin_lock_slowlock+0x0/0x1b9
[<ffffffff8108de6d>] ? rt_spin_lock_fastlock+0x77/0x93
[<ffffffff813feddf>] ? rt_spin_lock+0x28/0x3e
[<ffffffff8108a6c8>] ? queue_lock+0x46/0x66
[<ffffffff8108bcc0>] ? futex_lock_pi+0xf9/0x2c1
[<ffffffff8113a59b>] ? __pollwait+0x0/0x107
[<ffffffff813ff581>] ? _atomic_spin_unlock_irqrestore+0x49/0x68
[<ffffffff8108e296>] ? rt_mutex_adjust_prio+0x49/0x68
[<ffffffff8108ddc5>] ? rt_spin_lock_fastunlock+0x54/0x85
[<ffffffff8108cc43>] ? do_futex+0x7e2/0xb41
[<ffffffff810421a0>] ? pick_next_task_idle+0x2b/0x4d
[<ffffffff81060809>] ? timespec_add_safe+0x4b/0x94
[<ffffffff8100cdde>] ? apic_timer_interrupt+0xe/0x20
[<ffffffff8108d0c7>] ? sys_futex+0x125/0x157
[<ffffffff8100c29b>] ? system_call_fastpath+0x16/0x1b
Kernel panic - not syncing: softlockup: hung tasks
BUG: soft lockup - CPU#6 stuck for 61s! [pthread_cond_ma:30536]
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd
ohci_hcd ehci_hcd
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd
ohci_hcd ehci_hcd
Call Trace:
[<ffffffff813fe78a>] ? rt_spin_lock_slowlock+0xdb/0x1b9
[<ffffffff813fe6af>] ? rt_spin_lock_slowlock+0x0/0x1b9
[<ffffffff8108de6d>] ? rt_spin_lock_fastlock+0x77/0x93
[<ffffffff813feddf>] ? rt_spin_lock+0x28/0x3e
[<ffffffff8108a6c8>] ? queue_lock+0x46/0x66
[<ffffffff8108bcc0>] ? futex_lock_pi+0xf9/0x2c1
[<ffffffff8113a59b>] ? __pollwait+0x0/0x107
[<ffffffff8108e296>] ? rt_mutex_adjust_prio+0x49/0x68
[<ffffffff813fe692>] ? rt_spin_lock_slowunlock+0x6f/0x8c
[<ffffffff813fe623>] ? rt_spin_lock_slowunlock+0x0/0x8c
[<ffffffff8108ddd9>] ? rt_spin_lock_fastunlock+0x68/0x85
[<ffffffff8108cc43>] ? do_futex+0x7e2/0xb41
[<ffffffff810421a0>] ? pick_next_task_idle+0x2b/0x4d
[<ffffffff81060809>] ? timespec_add_safe+0x4b/0x94
[<ffffffff8100cdde>] ? apic_timer_interrupt+0xe/0x20
[<ffffffff8108d0c7>] ? sys_futex+0x125/0x157
[<ffffffff8100c29b>] ? system_call_fastpath+0x16/0x1b
Kernel panic - not syncing: softlockup: hung tasks
BUG: soft lockup - CPU#7 stuck for 61s! [pthread_cond_ma:30537]
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd
ohci_hcd ehci_hcd
Modules linked in: ipv6 autofs4 i2c_dev i2c_core hidp rfcomm l2cap
bluetooth rfkill sunrpc dm_mirror dm_multipath scsi_dh video output sbs
sbshc battery ac parport_pc lp parport sg snd_seq_dummy snd_seq_oss
button serio_raw bnx2 bnx2x snd_seq_midi_event snd_seq i5k_amb hwmon
crc32c snd_seq_device i5000_edac pata_acpi snd_pcm_oss iTCO_wdt
ata_generic snd_mixer_oss edac_core iTCO_vendor_support libcrc32c
snd_pcm snd_timer snd soundcore snd_page_alloc pcspkr dm_region_hash
dm_log dm_mod ata_piix libata shpchp mptsas mptscsih mptbase
scsi_transport_sas sd_mod scsi_mod crc_t10dif ext3 jbd mbcache uhci_hcd
ohci_hcd ehci_hcd
Call Trace:
[<ffffffff813fe78a>] ? rt_spin_lock_slowlock+0xdb/0x1b9
[<ffffffff813fe6af>] ? rt_spin_lock_slowlock+0x0/0x1b9
[<ffffffff8108de6d>] ? rt_spin_lock_fastlock+0x77/0x93
[<ffffffff813feddf>] ? rt_spin_lock+0x28/0x3e
[<ffffffff8108a6c8>] ? queue_lock+0x46/0x66
[<ffffffff8108bcc0>] ? futex_lock_pi+0xf9/0x2c1
[<ffffffff8113a59b>] ? __pollwait+0x0/0x107
[<ffffffff8108e296>] ? rt_mutex_adjust_prio+0x49/0x68
[<ffffffff813fe692>] ? rt_spin_lock_slowunlock+0x6f/0x8c
[<ffffffff813fe623>] ? rt_spin_lock_slowunlock+0x0/0x8c
[<ffffffff8108ddd9>] ? rt_spin_lock_fastunlock+0x68/0x85
[<ffffffff8108cc43>] ? do_futex+0x7e2/0xb41
[<ffffffff810421a0>] ? pick_next_task_idle+0x2b/0x4d
[<ffffffff81060809>] ? timespec_add_safe+0x4b/0x94
[<ffffffff8108d0c7>] ? sys_futex+0x125/0x157
[<ffffffff8100c29b>] ? system_call_fastpath+0x16/0x1b
Kernel panic - not syncing: softlockup: hung tasks
--
Darren Hart
IBM Linux Technology Center
Real-Time Linux Team
^ permalink raw reply [flat|nested] 2+ messages in thread
end of thread, other threads:[~2009-08-04 14:38 UTC | newest]
Thread overview: 2+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2009-08-04 14:37 2.6.31-rc4-rt1: BUG: panic in requeue_pi test case Darren Hart
2009-08-04 14:37 ` Darren Hart
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.