* BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
@ 2010-05-24 3:03 Piotr Hosowicz
2010-05-24 17:22 ` Piotr Hosowicz
2010-05-25 8:50 ` Peter Zijlstra
0 siblings, 2 replies; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-24 3:03 UTC (permalink / raw)
To: linux-kernel
[-- Attachment #1: Type: text/plain, Size: 432 bytes --]
Hello,
I had this error in linux-next and reported it, but nobody answered :-(
Now it's here, in fresh git source built kernel. After I boot the screen
becomes cluttered with messages as in subject line. I attach dmesg and
cpuinfo.
Regards,
Piotr Hosowicz
--
TV: "Filimonow jest cudownie miękki, wspaniale pracuje udami."
NP: Slash - Paradise City (Feat. Fergie And Cypress Hill) (Australian Bonus)
NB: 2.6.34-20100524-0407
[-- Attachment #2: cpuinfo.txt --]
[-- Type: text/plain, Size: 2884 bytes --]
processor : 0
vendor_id : GenuineIntel
cpu family : 6
model : 23
model name : Intel(R) Core(TM)2 Quad CPU Q8200 @ 2.33GHz
stepping : 7
cpu MHz : 2333.377
cache size : 2048 KB
physical id : 0
siblings : 4
core id : 0
cpu cores : 4
apicid : 0
initial apicid : 0
fpu : yes
fpu_exception : yes
cpuid level : 10
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good aperfmperf pni dtes64 monitor ds_cpl est tm2 ssse3 cx16 xtpr pdcm sse4_1 lahf_lm
bogomips : 4666.75
clflush size : 64
cache_alignment : 64
address sizes : 36 bits physical, 48 bits virtual
power management:
processor : 1
vendor_id : GenuineIntel
cpu family : 6
model : 23
model name : Intel(R) Core(TM)2 Quad CPU Q8200 @ 2.33GHz
stepping : 7
cpu MHz : 2333.377
cache size : 2048 KB
physical id : 0
siblings : 4
core id : 3
cpu cores : 4
apicid : 3
initial apicid : 3
fpu : yes
fpu_exception : yes
cpuid level : 10
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good aperfmperf pni dtes64 monitor ds_cpl est tm2 ssse3 cx16 xtpr pdcm sse4_1 lahf_lm
bogomips : 4666.11
clflush size : 64
cache_alignment : 64
address sizes : 36 bits physical, 48 bits virtual
power management:
processor : 2
vendor_id : GenuineIntel
cpu family : 6
model : 23
model name : Intel(R) Core(TM)2 Quad CPU Q8200 @ 2.33GHz
stepping : 7
cpu MHz : 2333.377
cache size : 2048 KB
physical id : 0
siblings : 4
core id : 1
cpu cores : 4
apicid : 1
initial apicid : 1
fpu : yes
fpu_exception : yes
cpuid level : 10
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good aperfmperf pni dtes64 monitor ds_cpl est tm2 ssse3 cx16 xtpr pdcm sse4_1 lahf_lm
bogomips : 4677.65
clflush size : 64
cache_alignment : 64
address sizes : 36 bits physical, 48 bits virtual
power management:
processor : 3
vendor_id : GenuineIntel
cpu family : 6
model : 23
model name : Intel(R) Core(TM)2 Quad CPU Q8200 @ 2.33GHz
stepping : 7
cpu MHz : 2333.377
cache size : 2048 KB
physical id : 0
siblings : 4
core id : 2
cpu cores : 4
apicid : 2
initial apicid : 2
fpu : yes
fpu_exception : yes
cpuid level : 10
wp : yes
flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm pbe syscall nx lm constant_tsc arch_perfmon pebs bts rep_good aperfmperf pni dtes64 monitor ds_cpl est tm2 ssse3 cx16 xtpr pdcm sse4_1 lahf_lm
bogomips : 4666.09
clflush size : 64
cache_alignment : 64
address sizes : 36 bits physical, 48 bits virtual
power management:
[-- Attachment #3: dmesg.txt --]
[-- Type: text/plain, Size: 125360 bytes --]
t+0x1bf/0x2c7
[ 720.313420] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 720.313426] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 720.313430] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 720.313435] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 720.313440] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 720.313447] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 720.313458] [<ffffffffa01862b8>] ? ext4_get_block+0xa7/0xe8 [ext4]
[ 720.313462] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 720.313466] [<ffffffff81114e8f>] do_mpage_readpage+0x355/0x47e
[ 720.313472] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 720.313476] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 720.313480] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 720.313485] [<ffffffff811150ec>] mpage_readpages+0xd7/0x11b
[ 720.313496] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 720.313507] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 720.313521] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 720.313526] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 720.313533] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 720.313537] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 720.313541] [<ffffffff81044dd1>] ? current_fs_time+0x22/0x29
[ 720.313547] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 720.313551] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 720.313555] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 720.313563] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 720.313567] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 720.313574] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 720.313579] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 720.313583] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 720.313588] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 720.313593] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 720.313607] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
[ 720.313612] caller is native_sched_clock+0x3c/0x68
[ 720.313616] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
[ 720.313618] Call Trace:
[ 720.313624] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 720.313629] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 720.313634] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 720.313637] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 720.313641] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 720.313646] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 720.313651] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 720.313656] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 720.313661] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 720.313666] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 720.313672] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 720.313684] [<ffffffffa01862b8>] ? ext4_get_block+0xa7/0xe8 [ext4]
[ 720.313689] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 720.313693] [<ffffffff81114e8f>] do_mpage_readpage+0x355/0x47e
[ 720.313698] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 720.313702] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 720.313707] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 720.313712] [<ffffffff811150ec>] mpage_readpages+0xd7/0x11b
[ 720.313723] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 720.313734] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 720.313748] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 720.313752] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 720.313758] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 720.313763] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 720.313767] [<ffffffff81044dd1>] ? current_fs_time+0x22/0x29
[ 720.313773] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 720.313778] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 720.313783] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 720.313790] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 720.313794] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 720.313801] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 720.313806] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 720.313810] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 720.313814] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 720.313819] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 727.343086] debug_smp_processor_id: 469 callbacks suppressed
[ 727.343090] BUG: using smp_processor_id() in preemptible [00000000] code: mocp/5600
[ 727.343097] caller is native_sched_clock+0x3c/0x68
[ 727.343101] Pid: 5600, comm: mocp Tainted: P 2.6.34-20100524-0407 #1
[ 727.343103] Call Trace:
[ 727.343111] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 727.343114] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 727.343118] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 727.343121] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 727.343125] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 727.343128] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 727.343133] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 727.343135] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 727.343139] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 727.343142] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 727.343146] [<ffffffff81114f03>] ? do_mpage_readpage+0x3c9/0x47e
[ 727.343150] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 727.343153] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 727.343156] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 727.343159] [<ffffffff8111511c>] mpage_readpages+0x107/0x11b
[ 727.343184] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 727.343194] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 727.343204] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 727.343208] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 727.343211] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 727.343214] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 727.343218] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 727.343221] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 727.343225] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 727.343229] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 727.343233] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 727.343237] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 727.343241] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 727.343244] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 727.343247] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 727.343250] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 727.343254] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 727.344496] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 727.344501] caller is native_sched_clock+0x3c/0x68
[ 727.344503] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 727.344505] Call Trace:
[ 727.344510] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 727.344514] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 727.344517] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 727.344520] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 727.344523] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 727.344526] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 727.344530] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 727.344533] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 727.344536] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 727.344539] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 727.344542] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 727.344546] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 727.344550] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 727.344554] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 727.344557] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 727.344572] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 727.344576] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.344579] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.344589] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 727.344593] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 727.344596] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 727.344606] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 727.344609] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 727.344613] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 727.344616] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 727.344620] [<ffffffff81039c4c>] ? update_curr+0x104/0x10d
[ 727.344623] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 727.344626] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 727.344634] [<ffffffffa0155320>] journal_submit_data_buffers+0x104/0x171 [jbd2]
[ 727.344641] [<ffffffffa0155a00>] jbd2_journal_commit_transaction+0x4a8/0x14c4 [jbd2]
[ 727.344646] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 727.344650] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 727.344658] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 727.344661] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 727.344669] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 727.344672] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 727.344675] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 727.344678] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 727.344681] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 727.344701] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 727.344705] caller is native_sched_clock+0x3c/0x68
[ 727.344707] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 727.344709] Call Trace:
[ 727.344713] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 727.344716] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 727.344719] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 727.344722] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 727.344725] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 727.344729] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 727.344733] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 727.344736] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 727.344740] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 727.344743] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 727.344747] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 727.344751] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 727.344754] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 727.344764] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 727.344768] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.344771] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.344781] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 727.344785] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 727.344788] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 727.344798] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 727.344801] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 727.344805] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 727.344808] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 727.344811] [<ffffffff81039c4c>] ? update_curr+0x104/0x10d
[ 727.344814] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 727.344818] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 727.344824] [<ffffffffa0155320>] journal_submit_data_buffers+0x104/0x171 [jbd2]
[ 727.344832] [<ffffffffa0155a00>] jbd2_journal_commit_transaction+0x4a8/0x14c4 [jbd2]
[ 727.344836] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 727.344839] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 727.344846] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 727.344850] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 727.344857] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 727.344860] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 727.344864] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 727.344867] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 727.344869] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 727.344898] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 727.344902] caller is native_sched_clock+0x3c/0x68
[ 727.344904] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 727.344906] Call Trace:
[ 727.344910] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 727.344913] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 727.344916] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 727.344919] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 727.344923] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 727.344926] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 727.344929] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 727.344933] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 727.344936] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 727.344939] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 727.344946] [<ffffffffa0153277>] ? jbd_unlock_bh_state+0x13/0x2e [jbd2]
[ 727.344950] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 727.344953] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 727.344960] [<ffffffffa0155f44>] jbd2_journal_commit_transaction+0x9ec/0x14c4 [jbd2]
[ 727.344964] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 727.344972] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 727.344975] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 727.344982] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 727.344986] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 727.344989] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 727.344992] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 727.344995] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 727.350885] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 727.350890] caller is native_sched_clock+0x3c/0x68
[ 727.350893] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 727.350895] Call Trace:
[ 727.350901] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 727.350905] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 727.350908] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 727.350912] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 727.350915] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 727.350918] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 727.350922] [<ffffffff810b8293>] ? __alloc_pages_nodemask+0xf3/0x60c
[ 727.350926] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 727.350929] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 727.350933] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 727.350936] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 727.350939] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 727.350943] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 727.350947] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 727.350956] [<ffffffffa0155484>] journal_submit_commit_record+0xf7/0x16b [jbd2]
[ 727.350963] [<ffffffffa015638b>] jbd2_journal_commit_transaction+0xe33/0x14c4 [jbd2]
[ 727.350968] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 727.350977] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 727.350980] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 727.350988] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 727.350991] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 727.350995] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 727.350998] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 727.351001] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 727.809030] BUG: using smp_processor_id() in preemptible [00000000] code: flush-8:0/2328
[ 727.809038] caller is native_sched_clock+0x3c/0x68
[ 727.809041] Pid: 2328, comm: flush-8:0 Tainted: P 2.6.34-20100524-0407 #1
[ 727.809044] Call Trace:
[ 727.809051] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 727.809055] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 727.809058] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 727.809062] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 727.809066] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 727.809069] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 727.809073] [<ffffffff81183c9a>] ? generic_make_request+0x249/0x2be
[ 727.809077] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 727.809081] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 727.809084] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 727.809088] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 727.809092] [<ffffffff8119b147>] ? radix_tree_gang_lookup_tag_slot+0x84/0xa9
[ 727.809096] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 727.809100] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 727.809104] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 727.809108] [<ffffffff81111a39>] ? blkdev_get_block+0x0/0x5e
[ 727.809111] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.809115] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.809118] [<ffffffff81111a39>] ? blkdev_get_block+0x0/0x5e
[ 727.809122] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 727.809125] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 727.809129] [<ffffffff81112896>] blkdev_writepage+0x13/0x15
[ 727.809133] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 727.809137] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 727.809140] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 727.809144] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 727.809147] [<ffffffff810b9f64>] do_writepages+0x1c/0x25
[ 727.809152] [<ffffffff811077ac>] writeback_single_inode+0xde/0x300
[ 727.809156] [<ffffffff811080fb>] writeback_inodes_wb+0x429/0x530
[ 727.809160] [<ffffffff8110834b>] wb_writeback+0x149/0x1d0
[ 727.809165] [<ffffffff811085a3>] wb_do_writeback+0x1b9/0x1cf
[ 727.809169] [<ffffffff8104d043>] ? process_timeout+0x0/0xb
[ 727.809173] [<ffffffff811085f7>] bdi_writeback_task+0x3e/0x117
[ 727.809177] [<ffffffff8105a516>] ? bit_waitqueue+0x12/0xa4
[ 727.809181] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 727.809185] [<ffffffff810c6abf>] bdi_start_fn+0x71/0xd5
[ 727.809188] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 727.809191] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 727.809195] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 727.809199] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 727.809202] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 727.809230] BUG: using smp_processor_id() in preemptible [00000000] code: flush-8:0/2328
[ 727.809234] caller is native_sched_clock+0x3c/0x68
[ 727.809236] Pid: 2328, comm: flush-8:0 Tainted: P 2.6.34-20100524-0407 #1
[ 727.809238] Call Trace:
[ 727.809242] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 727.809246] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 727.809249] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 727.809252] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 727.809255] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 727.809259] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 727.809263] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 727.809267] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 727.809270] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 727.809274] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 727.809278] [<ffffffff8119b147>] ? radix_tree_gang_lookup_tag_slot+0x84/0xa9
[ 727.809282] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 727.809285] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 727.809289] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 727.809292] [<ffffffff81111a39>] ? blkdev_get_block+0x0/0x5e
[ 727.809296] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.809299] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.809303] [<ffffffff81111a39>] ? blkdev_get_block+0x0/0x5e
[ 727.809306] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 727.809310] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 727.809314] [<ffffffff81112896>] blkdev_writepage+0x13/0x15
[ 727.809317] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 727.809320] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 727.809323] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 727.809328] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 727.809331] [<ffffffff810b9f64>] do_writepages+0x1c/0x25
[ 727.809335] [<ffffffff811077ac>] writeback_single_inode+0xde/0x300
[ 727.809338] [<ffffffff811080fb>] writeback_inodes_wb+0x429/0x530
[ 727.809342] [<ffffffff8110834b>] wb_writeback+0x149/0x1d0
[ 727.809347] [<ffffffff811085a3>] wb_do_writeback+0x1b9/0x1cf
[ 727.809350] [<ffffffff8104d043>] ? process_timeout+0x0/0xb
[ 727.809355] [<ffffffff811085f7>] bdi_writeback_task+0x3e/0x117
[ 727.809358] [<ffffffff8105a516>] ? bit_waitqueue+0x12/0xa4
[ 727.809362] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 727.809365] [<ffffffff810c6abf>] bdi_start_fn+0x71/0xd5
[ 727.809368] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 727.809371] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 727.809375] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 727.809378] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 727.809381] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 727.809388] BUG: using smp_processor_id() in preemptible [00000000] code: flush-8:0/2328
[ 727.809391] caller is native_sched_clock+0x3c/0x68
[ 727.809394] Pid: 2328, comm: flush-8:0 Tainted: P 2.6.34-20100524-0407 #1
[ 727.809396] Call Trace:
[ 727.809400] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 727.809403] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 727.809407] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 727.809409] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 727.809412] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 727.809416] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 727.809419] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 727.809423] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 727.809426] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 727.809430] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 727.809433] [<ffffffff8119b147>] ? radix_tree_gang_lookup_tag_slot+0x84/0xa9
[ 727.809437] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 727.809441] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 727.809444] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 727.809448] [<ffffffff81111a39>] ? blkdev_get_block+0x0/0x5e
[ 727.809451] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.809455] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.809459] [<ffffffff81111a39>] ? blkdev_get_block+0x0/0x5e
[ 727.809462] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 727.809466] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 727.809469] [<ffffffff81112896>] blkdev_writepage+0x13/0x15
[ 727.809472] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 727.809476] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 727.809479] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 727.809484] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 727.809487] [<ffffffff810b9f64>] do_writepages+0x1c/0x25
[ 727.809491] [<ffffffff811077ac>] writeback_single_inode+0xde/0x300
[ 727.809495] [<ffffffff811080fb>] writeback_inodes_wb+0x429/0x530
[ 727.809499] [<ffffffff8110834b>] wb_writeback+0x149/0x1d0
[ 727.809503] [<ffffffff811085a3>] wb_do_writeback+0x1b9/0x1cf
[ 727.809507] [<ffffffff8104d043>] ? process_timeout+0x0/0xb
[ 727.809511] [<ffffffff811085f7>] bdi_writeback_task+0x3e/0x117
[ 727.809514] [<ffffffff8105a516>] ? bit_waitqueue+0x12/0xa4
[ 727.809518] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 727.809521] [<ffffffff810c6abf>] bdi_start_fn+0x71/0xd5
[ 727.809524] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 727.809527] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 727.809531] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 727.809534] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 727.809537] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 727.809546] BUG: using smp_processor_id() in preemptible [00000000] code: flush-8:0/2328
[ 727.809550] caller is native_sched_clock+0x3c/0x68
[ 727.809552] Pid: 2328, comm: flush-8:0 Tainted: P 2.6.34-20100524-0407 #1
[ 727.809554] Call Trace:
[ 727.809558] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 727.809561] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 727.809565] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 727.809568] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 727.809571] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 727.809575] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 727.809579] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 727.809582] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 727.809586] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 727.809590] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 727.809593] [<ffffffff8119b147>] ? radix_tree_gang_lookup_tag_slot+0x84/0xa9
[ 727.809597] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 727.809600] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 727.809604] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 727.809607] [<ffffffff81111a39>] ? blkdev_get_block+0x0/0x5e
[ 727.809611] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.809614] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.809618] [<ffffffff81111a39>] ? blkdev_get_block+0x0/0x5e
[ 727.809621] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 727.809625] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 727.809629] [<ffffffff81112896>] blkdev_writepage+0x13/0x15
[ 727.809631] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 727.809635] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 727.809638] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 727.809642] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 727.809645] [<ffffffff810b9f64>] do_writepages+0x1c/0x25
[ 727.809649] [<ffffffff811077ac>] writeback_single_inode+0xde/0x300
[ 727.809653] [<ffffffff811080fb>] writeback_inodes_wb+0x429/0x530
[ 727.809657] [<ffffffff8110834b>] wb_writeback+0x149/0x1d0
[ 727.809661] [<ffffffff811085a3>] wb_do_writeback+0x1b9/0x1cf
[ 727.809664] [<ffffffff8104d043>] ? process_timeout+0x0/0xb
[ 727.809668] [<ffffffff811085f7>] bdi_writeback_task+0x3e/0x117
[ 727.809671] [<ffffffff8105a516>] ? bit_waitqueue+0x12/0xa4
[ 727.809675] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 727.809678] [<ffffffff810c6abf>] bdi_start_fn+0x71/0xd5
[ 727.809682] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 727.809685] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 727.809688] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 727.809691] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 727.809694] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 727.809789] BUG: using smp_processor_id() in preemptible [00000000] code: flush-8:0/2328
[ 727.809793] caller is native_sched_clock+0x3c/0x68
[ 727.809796] Pid: 2328, comm: flush-8:0 Tainted: P 2.6.34-20100524-0407 #1
[ 727.809798] Call Trace:
[ 727.809802] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 727.809805] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 727.809809] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 727.809811] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 727.809814] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 727.809818] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 727.809821] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 727.809825] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 727.809828] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 727.809832] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 727.809835] [<ffffffff8119b147>] ? radix_tree_gang_lookup_tag_slot+0x84/0xa9
[ 727.809839] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 727.809843] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 727.809847] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 727.809850] [<ffffffff81111a39>] ? blkdev_get_block+0x0/0x5e
[ 727.809854] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.809857] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 727.809861] [<ffffffff81111a39>] ? blkdev_get_block+0x0/0x5e
[ 727.809864] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 727.809868] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 727.809871] [<ffffffff81112896>] blkdev_writepage+0x13/0x15
[ 727.809875] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 727.809878] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 727.809881] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 727.809886] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 727.809889] [<ffffffff810b9f64>] do_writepages+0x1c/0x25
[ 727.809983] [<ffffffff811077ac>] writeback_single_inode+0xde/0x300
[ 727.809987] [<ffffffff811080fb>] writeback_inodes_wb+0x429/0x530
[ 727.809991] [<ffffffff8110834b>] wb_writeback+0x149/0x1d0
[ 727.809996] [<ffffffff811085a3>] wb_do_writeback+0x1b9/0x1cf
[ 727.810000] [<ffffffff8104d043>] ? process_timeout+0x0/0xb
[ 727.810003] [<ffffffff811085f7>] bdi_writeback_task+0x3e/0x117
[ 727.810007] [<ffffffff8105a516>] ? bit_waitqueue+0x12/0xa4
[ 727.810010] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 727.810014] [<ffffffff810c6abf>] bdi_start_fn+0x71/0xd5
[ 727.810016] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 727.810019] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 727.810023] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 727.810026] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 727.810030] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 732.509939] debug_smp_processor_id: 480 callbacks suppressed
[ 732.509942] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
[ 732.509949] caller is native_sched_clock+0x3c/0x68
[ 732.509952] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
[ 732.509954] Call Trace:
[ 732.509961] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 732.509964] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 732.509967] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 732.509970] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 732.509973] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 732.509977] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 732.509981] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 732.509984] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 732.509987] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 732.509990] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 732.509993] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 732.510008] [<ffffffffa01862b8>] ? ext4_get_block+0xa7/0xe8 [ext4]
[ 732.510012] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 732.510015] [<ffffffff81114e8f>] do_mpage_readpage+0x355/0x47e
[ 732.510019] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.510022] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 732.510026] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 732.510029] [<ffffffff811150ec>] mpage_readpages+0xd7/0x11b
[ 732.510038] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.510048] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.510059] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 732.510062] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 732.510066] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 732.510069] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 732.510073] [<ffffffff81044dd1>] ? current_fs_time+0x22/0x29
[ 732.510076] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 732.510080] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 732.510084] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 732.510088] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 732.510091] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.510095] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 732.510098] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 732.510101] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 732.510104] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 732.510108] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 732.510118] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
[ 732.510121] caller is native_sched_clock+0x3c/0x68
[ 732.510124] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
[ 732.510125] Call Trace:
[ 732.510129] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 732.510132] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 732.510135] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 732.510138] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 732.510140] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 732.510144] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 732.510147] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 732.510150] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 732.510153] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 732.510156] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 732.510160] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 732.510170] [<ffffffffa01862b8>] ? ext4_get_block+0xa7/0xe8 [ext4]
[ 732.510173] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 732.510176] [<ffffffff81114e8f>] do_mpage_readpage+0x355/0x47e
[ 732.510179] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.510182] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 732.510185] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 732.510188] [<ffffffff811150ec>] mpage_readpages+0xd7/0x11b
[ 732.510198] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.510208] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.510218] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 732.510221] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 732.510225] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 732.510228] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 732.510231] [<ffffffff81044dd1>] ? current_fs_time+0x22/0x29
[ 732.510234] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 732.510237] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 732.510241] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 732.510244] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 732.510247] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.510251] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 732.510254] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 732.510257] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 732.510260] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 732.510263] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 732.510270] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
[ 732.510273] caller is native_sched_clock+0x3c/0x68
[ 732.510276] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
[ 732.510278] Call Trace:
[ 732.510281] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 732.510285] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 732.510288] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 732.510290] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 732.510293] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 732.510296] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 732.510300] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 732.510303] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 732.510306] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 732.510309] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 732.510313] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 732.510322] [<ffffffffa01862b8>] ? ext4_get_block+0xa7/0xe8 [ext4]
[ 732.510326] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 732.510328] [<ffffffff81114e8f>] do_mpage_readpage+0x355/0x47e
[ 732.510332] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.510335] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 732.510338] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 732.510341] [<ffffffff811150ec>] mpage_readpages+0xd7/0x11b
[ 732.510351] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.510361] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.510371] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 732.510374] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 732.510378] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 732.510381] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 732.510384] [<ffffffff81044dd1>] ? current_fs_time+0x22/0x29
[ 732.510387] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 732.510390] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 732.510393] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 732.510397] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 732.510400] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.510404] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 732.510407] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 732.510410] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 732.510413] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 732.510416] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 732.510425] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
[ 732.510428] caller is native_sched_clock+0x3c/0x68
[ 732.510431] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
[ 732.510432] Call Trace:
[ 732.510436] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 732.510439] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 732.510442] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 732.510445] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 732.510447] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 732.510451] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 732.510454] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 732.510457] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 732.510460] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 732.510464] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 732.510467] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 732.510477] [<ffffffffa01862b8>] ? ext4_get_block+0xa7/0xe8 [ext4]
[ 732.510480] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 732.510483] [<ffffffff81114e8f>] do_mpage_readpage+0x355/0x47e
[ 732.510486] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.510489] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 732.510492] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 732.510495] [<ffffffff811150ec>] mpage_readpages+0xd7/0x11b
[ 732.510504] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.510514] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.510524] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 732.510528] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 732.510531] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 732.510534] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 732.510537] [<ffffffff81044dd1>] ? current_fs_time+0x22/0x29
[ 732.510541] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 732.510544] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 732.510547] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 732.510551] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 732.510554] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.510558] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 732.510561] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 732.510564] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 732.510567] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 732.510570] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 732.510577] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
[ 732.510580] caller is native_sched_clock+0x3c/0x68
[ 732.510583] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
[ 732.510584] Call Trace:
[ 732.510588] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 732.510591] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 732.510594] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 732.510597] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 732.510599] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 732.510603] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 732.510606] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 732.510609] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 732.510612] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 732.510615] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 732.510619] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 732.510628] [<ffffffffa01862b8>] ? ext4_get_block+0xa7/0xe8 [ext4]
[ 732.510631] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 732.510634] [<ffffffff81114e8f>] do_mpage_readpage+0x355/0x47e
[ 732.510638] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.510640] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 732.510644] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 732.510647] [<ffffffff811150ec>] mpage_readpages+0xd7/0x11b
[ 732.510656] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.510666] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.510676] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 732.510679] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 732.510683] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 732.510686] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 732.510689] [<ffffffff81044dd1>] ? current_fs_time+0x22/0x29
[ 732.510692] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 732.510695] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 732.510699] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 732.510703] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 732.510705] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.510709] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 732.510712] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 732.510715] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 732.510718] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 732.510722] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 732.510728] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
[ 732.510731] caller is native_sched_clock+0x3c/0x68
[ 732.510734] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
[ 732.510735] Call Trace:
[ 732.510739] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 732.510742] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 732.510745] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 732.510748] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 732.510751] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 732.510754] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 732.510757] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 732.510760] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 732.510764] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 732.510767] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 732.510770] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 732.510780] [<ffffffffa01862b8>] ? ext4_get_block+0xa7/0xe8 [ext4]
[ 732.510783] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 732.510786] [<ffffffff81114e8f>] do_mpage_readpage+0x355/0x47e
[ 732.510789] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.510792] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 732.510796] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 732.510798] [<ffffffff811150ec>] mpage_readpages+0xd7/0x11b
[ 732.510808] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.510818] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.510828] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 732.510832] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 732.510835] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 732.510843] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 732.510846] [<ffffffff81044dd1>] ? current_fs_time+0x22/0x29
[ 732.510849] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 732.510852] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 732.510856] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 732.510859] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 732.510862] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.510866] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 732.510869] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 732.510872] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 732.510875] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 732.510878] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 732.511008] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
[ 732.511011] caller is native_sched_clock+0x3c/0x68
[ 732.511014] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
[ 732.511016] Call Trace:
[ 732.511020] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 732.511023] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 732.511026] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 732.511029] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 732.511032] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 732.511035] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 732.511038] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 732.511041] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 732.511044] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 732.511047] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 732.511051] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 732.511061] [<ffffffffa01862b8>] ? ext4_get_block+0xa7/0xe8 [ext4]
[ 732.511065] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 732.511068] [<ffffffff81114e8f>] do_mpage_readpage+0x355/0x47e
[ 732.511071] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.511074] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 732.511077] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 732.511080] [<ffffffff811150ec>] mpage_readpages+0xd7/0x11b
[ 732.511090] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.511100] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.511110] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 732.511113] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 732.511116] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 732.511119] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 732.511122] [<ffffffff81044dd1>] ? current_fs_time+0x22/0x29
[ 732.511126] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 732.511129] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 732.511133] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 732.511136] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 732.511139] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.511143] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 732.511146] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 732.511149] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 732.511152] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 732.511155] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 732.511164] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
[ 732.511167] caller is native_sched_clock+0x3c/0x68
[ 732.511169] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
[ 732.511171] Call Trace:
[ 732.511175] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 732.511178] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 732.511181] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 732.511184] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 732.511186] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 732.511190] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 732.511193] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 732.511196] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 732.511199] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 732.511202] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 732.511206] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 732.511215] [<ffffffffa01862b8>] ? ext4_get_block+0xa7/0xe8 [ext4]
[ 732.511218] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 732.511221] [<ffffffff81114e8f>] do_mpage_readpage+0x355/0x47e
[ 732.511225] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.511228] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 732.511231] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 732.511234] [<ffffffff811150ec>] mpage_readpages+0xd7/0x11b
[ 732.511244] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.511254] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.511264] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 732.511267] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 732.511271] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 732.511274] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 732.511277] [<ffffffff81044dd1>] ? current_fs_time+0x22/0x29
[ 732.511280] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 732.511284] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 732.511287] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 732.511291] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 732.511294] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.511298] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 732.511301] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 732.511304] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 732.511307] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 732.511310] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 732.511317] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
[ 732.511320] caller is native_sched_clock+0x3c/0x68
[ 732.511322] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
[ 732.511324] Call Trace:
[ 732.511328] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 732.511331] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 732.511334] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 732.511337] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 732.511339] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 732.511342] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 732.511346] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 732.511349] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 732.511352] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 732.511355] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 732.511359] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 732.511369] [<ffffffffa01862b8>] ? ext4_get_block+0xa7/0xe8 [ext4]
[ 732.511372] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 732.511375] [<ffffffff81114e8f>] do_mpage_readpage+0x355/0x47e
[ 732.511378] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.511381] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 732.511384] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 732.511387] [<ffffffff811150ec>] mpage_readpages+0xd7/0x11b
[ 732.511397] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.511407] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.511417] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 732.511420] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 732.511424] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 732.511427] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 732.511430] [<ffffffff81044dd1>] ? current_fs_time+0x22/0x29
[ 732.511433] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 732.511437] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 732.511440] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 732.511444] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 732.511447] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.511451] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 732.511454] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 732.511457] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 732.511459] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 732.511463] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 732.511469] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
[ 732.511472] caller is native_sched_clock+0x3c/0x68
[ 732.511475] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
[ 732.511476] Call Trace:
[ 732.511480] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 732.511483] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 732.511486] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 732.511489] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 732.511492] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 732.511495] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 732.511498] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 732.511501] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 732.511504] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 732.511508] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 732.511511] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 732.511521] [<ffffffffa01862b8>] ? ext4_get_block+0xa7/0xe8 [ext4]
[ 732.511524] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 732.511527] [<ffffffff81114e8f>] do_mpage_readpage+0x355/0x47e
[ 732.511530] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.511533] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 732.511536] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 732.511539] [<ffffffff811150ec>] mpage_readpages+0xd7/0x11b
[ 732.511549] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.511559] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 732.511569] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 732.511573] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 732.511576] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 732.511579] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 732.511582] [<ffffffff81044dd1>] ? current_fs_time+0x22/0x29
[ 732.511586] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 732.511589] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 732.511592] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 732.511596] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 732.511599] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 732.511603] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 732.511606] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 732.511609] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 732.511612] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 732.511615] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 739.793567] debug_smp_processor_id: 161 callbacks suppressed
[ 739.793571] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 739.793578] caller is native_sched_clock+0x3c/0x68
[ 739.793582] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 739.793585] Call Trace:
[ 739.793592] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 739.793596] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 739.793600] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 739.793604] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 739.793607] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 739.793611] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 739.793615] [<ffffffff810e4e4f>] ? ____cache_alloc+0x1c/0x264
[ 739.793620] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 739.793624] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 739.793627] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 739.793631] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 739.793635] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 739.793640] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 739.793644] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 739.793668] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 739.793672] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 739.793675] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 739.793685] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 739.793689] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 739.793693] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 739.793704] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 739.793708] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 739.793712] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 739.793716] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 739.793720] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 739.793723] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 739.793731] [<ffffffffa0155320>] journal_submit_data_buffers+0x104/0x171 [jbd2]
[ 739.793739] [<ffffffffa0155a00>] jbd2_journal_commit_transaction+0x4a8/0x14c4 [jbd2]
[ 739.793744] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 739.793748] [<ffffffff8130e64b>] ? _raw_spin_unlock_irqrestore+0x32/0x3d
[ 739.793752] [<ffffffff8104cf98>] ? try_to_del_timer_sync+0x76/0x84
[ 739.793761] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 739.793765] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 739.793773] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 739.793776] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 739.793780] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 739.793784] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 739.793787] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 739.793807] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 739.793810] caller is native_sched_clock+0x3c/0x68
[ 739.793813] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 739.793815] Call Trace:
[ 739.793820] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 739.793824] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 739.793828] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 739.793831] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 739.793834] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 739.793837] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 739.793842] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 739.793846] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 739.793849] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 739.793853] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 739.793857] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 739.793862] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 739.793866] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 739.793876] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 739.793880] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 739.793884] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 739.793894] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 739.793898] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 739.793902] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 739.793912] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 739.793916] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 739.793919] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 739.793923] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 739.793927] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 739.793931] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 739.793937] [<ffffffffa0155320>] journal_submit_data_buffers+0x104/0x171 [jbd2]
[ 739.793945] [<ffffffffa0155a00>] jbd2_journal_commit_transaction+0x4a8/0x14c4 [jbd2]
[ 739.793950] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 739.793954] [<ffffffff8130e64b>] ? _raw_spin_unlock_irqrestore+0x32/0x3d
[ 739.793958] [<ffffffff8104cf98>] ? try_to_del_timer_sync+0x76/0x84
[ 739.793965] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 739.793969] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 739.793977] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 739.793980] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 739.793984] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 739.793988] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 739.793991] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 739.794031] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 739.794034] caller is native_sched_clock+0x3c/0x68
[ 739.794037] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 739.794039] Call Trace:
[ 739.794043] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 739.794047] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 739.794050] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 739.794054] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 739.794057] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 739.794061] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 739.794065] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 739.794068] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 739.794071] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 739.794075] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 739.794082] [<ffffffffa0153277>] ? jbd_unlock_bh_state+0x13/0x2e [jbd2]
[ 739.794086] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 739.794090] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 739.794097] [<ffffffffa0155f44>] jbd2_journal_commit_transaction+0x9ec/0x14c4 [jbd2]
[ 739.794101] [<ffffffff8130e64b>] ? _raw_spin_unlock_irqrestore+0x32/0x3d
[ 739.794105] [<ffffffff8104cf98>] ? try_to_del_timer_sync+0x76/0x84
[ 739.794113] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 739.794117] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 739.794125] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 739.794128] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 739.794132] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 739.794135] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 739.794139] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 739.795054] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 739.795059] caller is native_sched_clock+0x3c/0x68
[ 739.795062] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 739.795065] Call Trace:
[ 739.795069] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 739.795073] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 739.795076] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 739.795080] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 739.795083] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 739.795087] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 739.795091] [<ffffffff810b8293>] ? __alloc_pages_nodemask+0xf3/0x60c
[ 739.795095] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 739.795098] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 739.795102] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 739.795106] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 739.795109] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 739.795113] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 739.795116] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 739.795127] [<ffffffffa0155484>] journal_submit_commit_record+0xf7/0x16b [jbd2]
[ 739.795135] [<ffffffffa015638b>] jbd2_journal_commit_transaction+0xe33/0x14c4 [jbd2]
[ 739.795139] [<ffffffff8130e64b>] ? _raw_spin_unlock_irqrestore+0x32/0x3d
[ 739.795143] [<ffffffff8104cf98>] ? try_to_del_timer_sync+0x76/0x84
[ 739.795151] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 739.795156] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 739.795163] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 739.795166] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 739.795170] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 739.795174] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 739.795177] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 740.250278] BUG: using smp_processor_id() in preemptible [00000000] code: mocp/5600
[ 740.250285] caller is native_sched_clock+0x3c/0x68
[ 740.250288] Pid: 5600, comm: mocp Tainted: P 2.6.34-20100524-0407 #1
[ 740.250290] Call Trace:
[ 740.250297] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 740.250300] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 740.250304] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 740.250307] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 740.250310] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 740.250313] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 740.250317] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 740.250320] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 740.250323] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 740.250327] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 740.250330] [<ffffffff81114f03>] ? do_mpage_readpage+0x3c9/0x47e
[ 740.250334] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 740.250338] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 740.250341] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 740.250344] [<ffffffff8111511c>] mpage_readpages+0x107/0x11b
[ 740.250365] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 740.250375] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 740.250385] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 740.250389] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 740.250393] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 740.250396] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 740.250399] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 740.250402] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 740.250406] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 740.250409] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 740.250414] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 740.250417] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 740.250422] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 740.250425] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 740.250428] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 740.250430] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 740.250434] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 744.133760] BUG: using smp_processor_id() in preemptible [00000000] code: postgres/2357
[ 744.133767] caller is native_sched_clock+0x3c/0x68
[ 744.133770] Pid: 2357, comm: postgres Tainted: P 2.6.34-20100524-0407 #1
[ 744.133773] Call Trace:
[ 744.133781] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 744.133784] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 744.133788] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 744.133791] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 744.133794] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 744.133798] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 744.133801] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 744.133805] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 744.133808] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 744.133811] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 744.133815] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 744.133819] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 744.133823] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 744.133845] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 744.133848] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 744.133852] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 744.133862] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 744.133866] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 744.133869] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 744.133879] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 744.133889] [<ffffffffa01832e5>] mpage_da_submit_io+0xea/0x165 [ext4]
[ 744.133900] [<ffffffffa0185dbe>] ext4_da_writepages+0x363/0x574 [ext4]
[ 744.133904] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 744.133909] [<ffffffff810b9f64>] do_writepages+0x1c/0x25
[ 744.133913] [<ffffffff810b280d>] __filemap_fdatawrite_range+0x4b/0x4d
[ 744.133916] [<ffffffff810b2cff>] filemap_flush+0x17/0x19
[ 744.133926] [<ffffffffa01834e2>] ext4_alloc_da_blocks+0x6b/0x70 [ext4]
[ 744.133936] [<ffffffffa018bddb>] ext4_rename+0x633/0x64f [ext4]
[ 744.133941] [<ffffffff810f5c54>] vfs_rename+0x21c/0x3c0
[ 744.133944] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 744.133948] [<ffffffff810f7527>] sys_renameat+0x1a1/0x25c
[ 744.133952] [<ffffffff810e3f87>] ? __cache_free+0x1c/0x1a4
[ 744.133955] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 744.133959] [<ffffffff810ce163>] ? remove_vma+0x69/0x71
[ 744.133962] [<ffffffff810cf2b4>] ? do_munmap+0x30b/0x32d
[ 744.133966] [<ffffffff810f75f8>] sys_rename+0x16/0x18
[ 744.133970] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 744.145536] BUG: using smp_processor_id() in preemptible [00000000] code: postgres/2357
[ 744.145544] caller is native_sched_clock+0x3c/0x68
[ 744.145548] Pid: 2357, comm: postgres Tainted: P 2.6.34-20100524-0407 #1
[ 744.145551] Call Trace:
[ 744.145559] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 744.145562] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 744.145566] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 744.145569] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 744.145573] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 744.145576] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 744.145580] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 744.145583] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 744.145586] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 744.145589] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 744.145593] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 744.145597] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 744.145601] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 744.145626] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 744.145630] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 744.145633] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 744.145643] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 744.145647] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 744.145651] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 744.145661] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 744.145671] [<ffffffffa01832e5>] mpage_da_submit_io+0xea/0x165 [ext4]
[ 744.145681] [<ffffffffa0185dbe>] ext4_da_writepages+0x363/0x574 [ext4]
[ 744.145685] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 744.145690] [<ffffffff810b9f64>] do_writepages+0x1c/0x25
[ 744.145694] [<ffffffff810b280d>] __filemap_fdatawrite_range+0x4b/0x4d
[ 744.145697] [<ffffffff810b2cff>] filemap_flush+0x17/0x19
[ 744.145707] [<ffffffffa01834e2>] ext4_alloc_da_blocks+0x6b/0x70 [ext4]
[ 744.145717] [<ffffffffa018bddb>] ext4_rename+0x633/0x64f [ext4]
[ 744.145722] [<ffffffff810f5c54>] vfs_rename+0x21c/0x3c0
[ 744.145724] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 744.145728] [<ffffffff810f7527>] sys_renameat+0x1a1/0x25c
[ 744.145733] [<ffffffff810e3f87>] ? __cache_free+0x1c/0x1a4
[ 744.145735] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 744.145739] [<ffffffff810ce163>] ? remove_vma+0x69/0x71
[ 744.145742] [<ffffffff810cf2b4>] ? do_munmap+0x30b/0x32d
[ 744.145746] [<ffffffff810f75f8>] sys_rename+0x16/0x18
[ 744.145750] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 744.345656] BUG: using smp_processor_id() in preemptible [00000000] code: mocp/5600
[ 744.345663] caller is native_sched_clock+0x3c/0x68
[ 744.345666] Pid: 5600, comm: mocp Tainted: P 2.6.34-20100524-0407 #1
[ 744.345668] Call Trace:
[ 744.345675] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 744.345678] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 744.345681] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 744.345685] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 744.345688] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 744.345691] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 744.345695] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 744.345698] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 744.345701] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 744.345705] [<ffffffff811148f5>] ? mpage_alloc+0x25/0x7d
[ 744.345708] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 744.345711] [<ffffffff81114f03>] ? do_mpage_readpage+0x3c9/0x47e
[ 744.345714] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 744.345718] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 744.345721] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 744.345724] [<ffffffff8111511c>] mpage_readpages+0x107/0x11b
[ 744.345747] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 744.345757] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 744.345767] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 744.345771] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 744.345774] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 744.345777] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 744.345780] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 744.345783] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 744.345787] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 744.345791] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 744.345795] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 744.345798] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 744.345803] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 744.345806] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 744.345808] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 744.345812] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 744.345815] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 745.075681] BUG: using smp_processor_id() in preemptible [00000000] code: knotify4/4851
[ 745.075688] caller is native_sched_clock+0x3c/0x68
[ 745.075692] Pid: 4851, comm: knotify4 Tainted: P 2.6.34-20100524-0407 #1
[ 745.075694] Call Trace:
[ 745.075703] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 745.075708] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 745.075711] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 745.075714] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 745.075718] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 745.075721] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 745.075726] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 745.075729] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 745.075732] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 745.075735] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 745.075739] [<ffffffff81114f03>] ? do_mpage_readpage+0x3c9/0x47e
[ 745.075743] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 745.075747] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 745.075751] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 745.075754] [<ffffffff8111511c>] mpage_readpages+0x107/0x11b
[ 745.075777] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 745.075787] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 745.075800] [<ffffffffa019dcc0>] ? __ext4_ext_check+0xfa/0x1c4 [ext4]
[ 745.075803] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 745.075813] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 745.075817] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 745.075821] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 745.075824] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 745.075828] [<ffffffff810ba714>] page_cache_sync_readahead+0x38/0x3c
[ 745.075832] [<ffffffff810b3796>] generic_file_aio_read+0x217/0x541
[ 745.075835] [<ffffffff810b8293>] ? __alloc_pages_nodemask+0xf3/0x60c
[ 745.075840] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 745.075843] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 745.075848] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 745.075851] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 745.075855] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 745.075857] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 745.075862] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 745.076529] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 745.076537] caller is native_sched_clock+0x3c/0x68
[ 745.076540] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 745.076543] Call Trace:
[ 745.076549] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 745.076553] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 745.076556] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 745.076559] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 745.076562] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 745.076565] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 745.076569] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 745.076572] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 745.076575] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 745.076578] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 745.076596] [<ffffffffa0153277>] ? jbd_unlock_bh_state+0x13/0x2e [jbd2]
[ 745.076599] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 745.076604] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 745.076610] [<ffffffffa0155f44>] jbd2_journal_commit_transaction+0x9ec/0x14c4 [jbd2]
[ 745.076615] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 745.076622] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 745.076626] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 745.076633] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 745.076636] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 745.076640] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 745.076643] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 745.076645] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 745.098156] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 745.098163] caller is native_sched_clock+0x3c/0x68
[ 745.098167] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 745.098170] Call Trace:
[ 745.098177] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 745.098180] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 745.098184] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 745.098187] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 745.098190] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 745.098193] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 745.098198] [<ffffffff810b8293>] ? __alloc_pages_nodemask+0xf3/0x60c
[ 745.098202] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 745.098205] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 745.098208] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 745.098212] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 745.098215] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 745.098218] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 745.098222] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 745.098231] [<ffffffffa0155484>] journal_submit_commit_record+0xf7/0x16b [jbd2]
[ 745.098238] [<ffffffffa015638b>] jbd2_journal_commit_transaction+0xe33/0x14c4 [jbd2]
[ 745.098243] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 745.098251] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 745.098254] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 745.098262] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 745.098264] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 745.098268] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 745.098271] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 745.098274] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 747.546200] BUG: using smp_processor_id() in preemptible [00000000] code: mocp/5600
[ 747.546207] caller is native_sched_clock+0x3c/0x68
[ 747.546210] Pid: 5600, comm: mocp Tainted: P 2.6.34-20100524-0407 #1
[ 747.546212] Call Trace:
[ 747.546219] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 747.546223] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 747.546226] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 747.546229] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 747.546232] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 747.546235] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 747.546239] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 747.546242] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 747.546245] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 747.546249] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 747.546252] [<ffffffff81114f03>] ? do_mpage_readpage+0x3c9/0x47e
[ 747.546255] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 747.546259] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 747.546262] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 747.546265] [<ffffffff8111511c>] mpage_readpages+0x107/0x11b
[ 747.546287] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 747.546290] [<ffffffff81039ebb>] ? dequeue_entity+0x1b/0x115
[ 747.546300] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 747.546310] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 747.546314] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 747.546318] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 747.546321] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 747.546324] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 747.546327] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 747.546331] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 747.546334] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 747.546339] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 747.546341] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 747.546346] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 747.546349] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 747.546352] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 747.546355] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 747.546359] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 747.808091] BUG: using smp_processor_id() in preemptible [00000000] code: flush-8:0/2328
[ 747.808099] caller is native_sched_clock+0x3c/0x68
[ 747.808102] Pid: 2328, comm: flush-8:0 Tainted: P 2.6.34-20100524-0407 #1
[ 747.808104] Call Trace:
[ 747.808111] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 747.808115] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 747.808118] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 747.808122] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 747.808125] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 747.808129] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 747.808151] [<ffffffffa0181afc>] ? ext4_mark_inode_dirty+0x179/0x1ac [ext4]
[ 747.808156] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 747.808159] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 747.808162] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 747.808166] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 747.808169] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 747.808173] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 747.808176] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 747.808181] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 747.808184] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 747.808195] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 747.808198] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 747.808202] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 747.808212] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 747.808216] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 747.808220] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 747.808230] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 747.808240] [<ffffffffa01832e5>] mpage_da_submit_io+0xea/0x165 [ext4]
[ 747.808251] [<ffffffffa0185dbe>] ext4_da_writepages+0x363/0x574 [ext4]
[ 747.808255] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 747.808259] [<ffffffff810b9f64>] do_writepages+0x1c/0x25
[ 747.808263] [<ffffffff811077ac>] writeback_single_inode+0xde/0x300
[ 747.808267] [<ffffffff811080fb>] writeback_inodes_wb+0x429/0x530
[ 747.808271] [<ffffffff8110834b>] wb_writeback+0x149/0x1d0
[ 747.808275] [<ffffffff811085a3>] wb_do_writeback+0x1b9/0x1cf
[ 747.808279] [<ffffffff8104d043>] ? process_timeout+0x0/0xb
[ 747.808283] [<ffffffff811085f7>] bdi_writeback_task+0x3e/0x117
[ 747.808287] [<ffffffff8105a516>] ? bit_waitqueue+0x12/0xa4
[ 747.808291] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 747.808294] [<ffffffff810c6abf>] bdi_start_fn+0x71/0xd5
[ 747.808298] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 747.808301] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 747.808304] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 747.808308] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 747.808311] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 747.808407] BUG: using smp_processor_id() in preemptible [00000000] code: flush-8:0/2328
[ 747.808410] caller is native_sched_clock+0x3c/0x68
[ 747.808413] Pid: 2328, comm: flush-8:0 Tainted: P 2.6.34-20100524-0407 #1
[ 747.808414] Call Trace:
[ 747.808419] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 747.808423] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 747.808426] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 747.808429] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 747.808432] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 747.808436] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 747.808440] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 747.808444] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 747.808448] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 747.808451] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 747.808455] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 747.808459] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 747.808463] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 747.808473] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 747.808476] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 747.808480] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 747.808491] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 747.808495] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 747.808498] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 747.808509] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 747.808519] [<ffffffffa01832e5>] mpage_da_submit_io+0xea/0x165 [ext4]
[ 747.808530] [<ffffffffa0185dbe>] ext4_da_writepages+0x363/0x574 [ext4]
[ 747.808534] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 747.808538] [<ffffffff810b9f64>] do_writepages+0x1c/0x25
[ 747.808541] [<ffffffff811077ac>] writeback_single_inode+0xde/0x300
[ 747.808545] [<ffffffff811080fb>] writeback_inodes_wb+0x429/0x530
[ 747.808549] [<ffffffff8110834b>] wb_writeback+0x149/0x1d0
[ 747.808553] [<ffffffff811085a3>] wb_do_writeback+0x1b9/0x1cf
[ 747.808557] [<ffffffff8104d043>] ? process_timeout+0x0/0xb
[ 747.808560] [<ffffffff811085f7>] bdi_writeback_task+0x3e/0x117
[ 747.808564] [<ffffffff8105a516>] ? bit_waitqueue+0x12/0xa4
[ 747.808567] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 747.808570] [<ffffffff810c6abf>] bdi_start_fn+0x71/0xd5
[ 747.808574] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 747.808576] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 747.808580] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 747.808583] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 747.808587] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 747.808670] BUG: using smp_processor_id() in preemptible [00000000] code: flush-8:0/2328
[ 747.808674] caller is native_sched_clock+0x3c/0x68
[ 747.808676] Pid: 2328, comm: flush-8:0 Tainted: P 2.6.34-20100524-0407 #1
[ 747.808678] Call Trace:
[ 747.808682] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 747.808686] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 747.808689] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 747.808693] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 747.808695] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 747.808699] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 747.808703] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 747.808707] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 747.808710] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 747.808713] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 747.808717] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 747.808721] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 747.808724] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 747.808735] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 747.808738] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 747.808742] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 747.808752] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 747.808756] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 747.808760] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 747.808770] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 747.808780] [<ffffffffa01832e5>] mpage_da_submit_io+0xea/0x165 [ext4]
[ 747.808791] [<ffffffffa0185dbe>] ext4_da_writepages+0x363/0x574 [ext4]
[ 747.808795] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 747.808799] [<ffffffff810b9f64>] do_writepages+0x1c/0x25
[ 747.808803] [<ffffffff811077ac>] writeback_single_inode+0xde/0x300
[ 747.808806] [<ffffffff811080fb>] writeback_inodes_wb+0x429/0x530
[ 747.808810] [<ffffffff8110834b>] wb_writeback+0x149/0x1d0
[ 747.808815] [<ffffffff811085a3>] wb_do_writeback+0x1b9/0x1cf
[ 747.808818] [<ffffffff8104d043>] ? process_timeout+0x0/0xb
[ 747.808822] [<ffffffff811085f7>] bdi_writeback_task+0x3e/0x117
[ 747.808825] [<ffffffff8105a516>] ? bit_waitqueue+0x12/0xa4
[ 747.808829] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 747.808832] [<ffffffff810c6abf>] bdi_start_fn+0x71/0xd5
[ 747.808836] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 747.808838] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 747.808842] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 747.808846] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 747.808848] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 750.748232] BUG: using smp_processor_id() in preemptible [00000000] code: mocp/5600
[ 750.748239] caller is native_sched_clock+0x3c/0x68
[ 750.748243] Pid: 5600, comm: mocp Tainted: P 2.6.34-20100524-0407 #1
[ 750.748245] Call Trace:
[ 750.748252] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 750.748255] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 750.748258] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 750.748262] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 750.748265] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 750.748268] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 750.748272] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 750.748275] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 750.748278] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 750.748282] [<ffffffff811148f5>] ? mpage_alloc+0x25/0x7d
[ 750.748285] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 750.748288] [<ffffffff81114f03>] ? do_mpage_readpage+0x3c9/0x47e
[ 750.748291] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 750.748295] [<ffffffff810bad46>] ? __lru_cache_add+0x73/0x91
[ 750.748297] [<ffffffff8111496f>] mpage_bio_submit+0x22/0x26
[ 750.748300] [<ffffffff8111511c>] mpage_readpages+0x107/0x11b
[ 750.748323] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 750.748334] [<ffffffffa0186211>] ? ext4_get_block+0x0/0xe8 [ext4]
[ 750.748344] [<ffffffffa0182ee8>] ext4_readpages+0x18/0x1a [ext4]
[ 750.748349] [<ffffffff810ba19b>] __do_page_cache_readahead+0x128/0x1be
[ 750.748353] [<ffffffff810ba24d>] ra_submit+0x1c/0x20
[ 750.748356] [<ffffffff810ba62d>] ondemand_readahead+0x1b1/0x1c4
[ 750.748359] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 750.748363] [<ffffffff810ba6b6>] page_cache_async_readahead+0x76/0x9c
[ 750.748367] [<ffffffff810b2178>] ? find_get_page+0x7b/0x87
[ 750.748371] [<ffffffff810b37d3>] generic_file_aio_read+0x254/0x541
[ 750.748380] [<ffffffff810ec6cc>] do_sync_read+0xc6/0x103
[ 750.748383] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 750.748388] [<ffffffff81155d8e>] ? security_file_permission+0x11/0x13
[ 750.748391] [<ffffffff810ecce2>] vfs_read+0xa6/0x103
[ 750.748394] [<ffffffff810ed80e>] ? fget_light+0xa0/0xac
[ 750.748397] [<ffffffff810ecdf5>] sys_read+0x45/0x69
[ 750.748401] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 750.749925] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 750.749929] caller is native_sched_clock+0x3c/0x68
[ 750.749932] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 750.749934] Call Trace:
[ 750.749938] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 750.749941] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 750.749945] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 750.749947] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 750.749950] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 750.749954] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 750.749958] [<ffffffff810e4e4f>] ? ____cache_alloc+0x1c/0x264
[ 750.749961] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 750.749965] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 750.749967] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 750.749971] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 750.749975] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 750.749979] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 750.749982] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 750.749993] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 750.749996] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 750.749999] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 750.750010] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 750.750013] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 750.750017] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 750.750027] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 750.750031] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 750.750034] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 750.750038] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 750.750041] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 750.750045] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 750.750052] [<ffffffffa0155320>] journal_submit_data_buffers+0x104/0x171 [jbd2]
[ 750.750059] [<ffffffffa0155a00>] jbd2_journal_commit_transaction+0x4a8/0x14c4 [jbd2]
[ 750.750063] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 750.750068] [<ffffffff8130e64b>] ? _raw_spin_unlock_irqrestore+0x32/0x3d
[ 750.750072] [<ffffffff8104cf98>] ? try_to_del_timer_sync+0x76/0x84
[ 750.750080] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 750.750084] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 750.750091] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 750.750094] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 750.750097] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 750.750101] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 750.750104] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 750.750124] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 750.750127] caller is native_sched_clock+0x3c/0x68
[ 750.750130] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 750.750132] Call Trace:
[ 750.750136] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 750.750139] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 750.750142] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 750.750145] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 750.750148] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 750.750151] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 750.750156] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 750.750159] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 750.750162] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 750.750166] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 750.750170] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 750.750173] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 750.750176] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 750.750187] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 750.750190] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 750.750194] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 750.750204] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 750.750208] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 750.750211] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 750.750221] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 750.750224] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 750.750227] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 750.750231] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 750.750234] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 750.750238] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 750.750244] [<ffffffffa0155320>] journal_submit_data_buffers+0x104/0x171 [jbd2]
[ 750.750251] [<ffffffffa0155a00>] jbd2_journal_commit_transaction+0x4a8/0x14c4 [jbd2]
[ 750.750256] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 750.750259] [<ffffffff8130e64b>] ? _raw_spin_unlock_irqrestore+0x32/0x3d
[ 750.750262] [<ffffffff8104cf98>] ? try_to_del_timer_sync+0x76/0x84
[ 750.750270] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 750.750273] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 750.750280] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 750.750284] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 750.750287] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 750.750290] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 750.750294] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 750.750305] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 750.750308] caller is native_sched_clock+0x3c/0x68
[ 750.750311] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 750.750313] Call Trace:
[ 750.750316] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 750.750320] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 750.750323] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 750.750326] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 750.750329] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 750.750332] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 750.750337] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 750.750340] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 750.750343] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 750.750346] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 750.750350] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 750.750354] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 750.750357] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 750.750367] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 750.750370] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 750.750374] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 750.750384] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 750.750388] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 750.750392] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 750.750401] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 750.750405] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 750.750409] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 750.750411] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 750.750416] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 750.750420] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 750.750426] [<ffffffffa0155320>] journal_submit_data_buffers+0x104/0x171 [jbd2]
[ 750.750434] [<ffffffffa0155a00>] jbd2_journal_commit_transaction+0x4a8/0x14c4 [jbd2]
[ 750.750438] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 750.750441] [<ffffffff8130e64b>] ? _raw_spin_unlock_irqrestore+0x32/0x3d
[ 750.750444] [<ffffffff8104cf98>] ? try_to_del_timer_sync+0x76/0x84
[ 750.750452] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 750.750456] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 750.750463] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 750.750466] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 750.750470] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 750.750473] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 750.750476] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 750.750486] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 750.750489] caller is native_sched_clock+0x3c/0x68
[ 750.750491] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 750.750494] Call Trace:
[ 750.750497] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 750.750501] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 750.750504] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 750.750507] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 750.750510] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 750.750513] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 750.750517] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 750.750520] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 750.750524] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 750.750527] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 750.750531] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 750.750535] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 750.750538] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 750.750549] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 750.750552] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 750.750556] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 750.750566] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 750.750569] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 750.750573] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 750.750583] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 750.750586] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 750.750589] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 750.750593] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 750.750596] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 750.750600] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 750.750606] [<ffffffffa0155320>] journal_submit_data_buffers+0x104/0x171 [jbd2]
[ 750.750614] [<ffffffffa0155a00>] jbd2_journal_commit_transaction+0x4a8/0x14c4 [jbd2]
[ 750.750618] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 750.750621] [<ffffffff8130e64b>] ? _raw_spin_unlock_irqrestore+0x32/0x3d
[ 750.750624] [<ffffffff8104cf98>] ? try_to_del_timer_sync+0x76/0x84
[ 750.750632] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 750.750635] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 750.750643] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 750.750646] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 750.750649] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 750.750652] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 750.750655] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 750.750698] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 750.750701] caller is native_sched_clock+0x3c/0x68
[ 750.750704] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 750.750706] Call Trace:
[ 750.750710] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 750.750714] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 750.750717] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 750.750719] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 750.750722] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 750.750725] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 750.750729] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 750.750732] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 750.750736] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 750.750739] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 750.750746] [<ffffffffa0153277>] ? jbd_unlock_bh_state+0x13/0x2e [jbd2]
[ 750.750749] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 750.750752] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 750.750759] [<ffffffffa0155f44>] jbd2_journal_commit_transaction+0x9ec/0x14c4 [jbd2]
[ 750.750763] [<ffffffff8130e64b>] ? _raw_spin_unlock_irqrestore+0x32/0x3d
[ 750.750767] [<ffffffff8104cf98>] ? try_to_del_timer_sync+0x76/0x84
[ 750.750774] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 750.750778] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 750.750785] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 750.750788] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 750.750791] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 750.750795] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 750.750797] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 750.760626] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 750.760630] caller is native_sched_clock+0x3c/0x68
[ 750.760632] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 750.760634] Call Trace:
[ 750.760637] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 750.760641] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 750.760644] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 750.760646] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 750.760649] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 750.760652] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 750.760655] [<ffffffff810b8293>] ? __alloc_pages_nodemask+0xf3/0x60c
[ 750.760659] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 750.760661] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 750.760665] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 750.760668] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 750.760671] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 750.760674] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 750.760677] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 750.760684] [<ffffffffa0155484>] journal_submit_commit_record+0xf7/0x16b [jbd2]
[ 750.760691] [<ffffffffa015638b>] jbd2_journal_commit_transaction+0xe33/0x14c4 [jbd2]
[ 750.760695] [<ffffffff8130e64b>] ? _raw_spin_unlock_irqrestore+0x32/0x3d
[ 750.760698] [<ffffffff8104cf98>] ? try_to_del_timer_sync+0x76/0x84
[ 750.760706] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 750.760709] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 750.760716] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 750.760719] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 750.760722] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 750.760725] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 750.760728] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 751.619027] BUG: using smp_processor_id() in preemptible [00000000] code: choosesig.pl/5975
[ 751.619034] caller is native_sched_clock+0x3c/0x68
[ 751.619038] Pid: 5975, comm: choosesig.pl Tainted: P 2.6.34-20100524-0407 #1
[ 751.619040] Call Trace:
[ 751.619047] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 751.619051] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 751.619054] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 751.619058] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 751.619061] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 751.619064] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 751.619088] [<ffffffffa0181afc>] ? ext4_mark_inode_dirty+0x179/0x1ac [ext4]
[ 751.619092] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 751.619095] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 751.619098] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 751.619101] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 751.619104] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 751.619108] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 751.619112] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 751.619116] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 751.619120] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 751.619130] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 751.619134] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 751.619137] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 751.619147] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 751.619151] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 751.619155] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 751.619165] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 751.619175] [<ffffffffa01832e5>] mpage_da_submit_io+0xea/0x165 [ext4]
[ 751.619186] [<ffffffffa0185dbe>] ext4_da_writepages+0x363/0x574 [ext4]
[ 751.619191] [<ffffffff810e3f87>] ? __cache_free+0x1c/0x1a4
[ 751.619195] [<ffffffff810b9f64>] do_writepages+0x1c/0x25
[ 751.619200] [<ffffffff810b280d>] __filemap_fdatawrite_range+0x4b/0x4d
[ 751.619204] [<ffffffff810b2cff>] filemap_flush+0x17/0x19
[ 751.619213] [<ffffffffa01834e2>] ext4_alloc_da_blocks+0x6b/0x70 [ext4]
[ 751.619222] [<ffffffffa017e771>] ext4_release_file+0x25/0xa0 [ext4]
[ 751.619226] [<ffffffff810ed989>] __fput+0xf9/0x1a3
[ 751.619229] [<ffffffff810eda48>] fput+0x15/0x17
[ 751.619232] [<ffffffff810eaed5>] filp_close+0x63/0x6d
[ 751.619236] [<ffffffff8104247a>] put_files_struct+0x6f/0xc7
[ 751.619239] [<ffffffff81042518>] exit_files+0x46/0x4e
[ 751.619241] [<ffffffff81043d73>] do_exit+0x281/0x74e
[ 751.619245] [<ffffffff81026c05>] ? do_page_fault+0x212/0x241
[ 751.619248] [<ffffffff810442b3>] do_group_exit+0x73/0x9c
[ 751.619252] [<ffffffff810442ee>] sys_exit_group+0x12/0x16
[ 751.619256] [<ffffffff81002b02>] system_call_fastpath+0x16/0x1b
[ 752.810185] BUG: using smp_processor_id() in preemptible [00000000] code: flush-8:0/2328
[ 752.810192] caller is native_sched_clock+0x3c/0x68
[ 752.810196] Pid: 2328, comm: flush-8:0 Tainted: P 2.6.34-20100524-0407 #1
[ 752.810198] Call Trace:
[ 752.810205] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 752.810209] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 752.810212] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 752.810216] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 752.810219] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 752.810223] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 752.810226] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 752.810230] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 752.810233] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 752.810235] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 752.810239] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 752.810242] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 752.810246] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 752.810250] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 752.810254] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 752.810277] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 752.810281] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 752.810284] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 752.810294] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 752.810297] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 752.810301] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 752.810311] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 752.810321] [<ffffffffa01832e5>] mpage_da_submit_io+0xea/0x165 [ext4]
[ 752.810332] [<ffffffffa01860b5>] __mpage_da_writepage+0x44/0x14b [ext4]
[ 752.810336] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 752.810344] [<ffffffffa01547de>] ? start_this_handle+0x566/0x58e [jbd2]
[ 752.810353] [<ffffffffa0186071>] ? __mpage_da_writepage+0x0/0x14b [ext4]
[ 752.810364] [<ffffffffa0185d95>] ext4_da_writepages+0x33a/0x574 [ext4]
[ 752.810368] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 752.810372] [<ffffffff810b9f64>] do_writepages+0x1c/0x25
[ 752.810376] [<ffffffff811077ac>] writeback_single_inode+0xde/0x300
[ 752.810379] [<ffffffff811080fb>] writeback_inodes_wb+0x429/0x530
[ 752.810383] [<ffffffff8110834b>] wb_writeback+0x149/0x1d0
[ 752.810387] [<ffffffff811085a3>] wb_do_writeback+0x1b9/0x1cf
[ 752.810391] [<ffffffff8104d043>] ? process_timeout+0x0/0xb
[ 752.810395] [<ffffffff811085f7>] bdi_writeback_task+0x3e/0x117
[ 752.810398] [<ffffffff8105a516>] ? bit_waitqueue+0x12/0xa4
[ 752.810402] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 752.810406] [<ffffffff810c6abf>] bdi_start_fn+0x71/0xd5
[ 752.810409] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 752.810412] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 752.810416] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 752.810419] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 752.810422] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 752.810442] BUG: using smp_processor_id() in preemptible [00000000] code: flush-8:0/2328
[ 752.810445] caller is native_sched_clock+0x3c/0x68
[ 752.810448] Pid: 2328, comm: flush-8:0 Tainted: P 2.6.34-20100524-0407 #1
[ 752.810450] Call Trace:
[ 752.810454] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 752.810457] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 752.810460] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 752.810463] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 752.810466] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 752.810469] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 752.810473] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 752.810477] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 752.810480] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 752.810484] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 752.810487] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 752.810491] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 752.810494] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 752.810505] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 752.810508] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 752.810512] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 752.810522] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 752.810525] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 752.810529] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 752.810539] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 752.810549] [<ffffffffa01832e5>] mpage_da_submit_io+0xea/0x165 [ext4]
[ 752.810559] [<ffffffffa01860b5>] __mpage_da_writepage+0x44/0x14b [ext4]
[ 752.810563] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 752.810569] [<ffffffffa01547de>] ? start_this_handle+0x566/0x58e [jbd2]
[ 752.810579] [<ffffffffa0186071>] ? __mpage_da_writepage+0x0/0x14b [ext4]
[ 752.810590] [<ffffffffa0185d95>] ext4_da_writepages+0x33a/0x574 [ext4]
[ 752.810594] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 752.810597] [<ffffffff810b9f64>] do_writepages+0x1c/0x25
[ 752.810601] [<ffffffff811077ac>] writeback_single_inode+0xde/0x300
[ 752.810605] [<ffffffff811080fb>] writeback_inodes_wb+0x429/0x530
[ 752.810608] [<ffffffff8110834b>] wb_writeback+0x149/0x1d0
[ 752.810613] [<ffffffff811085a3>] wb_do_writeback+0x1b9/0x1cf
[ 752.810616] [<ffffffff8104d043>] ? process_timeout+0x0/0xb
[ 752.810620] [<ffffffff811085f7>] bdi_writeback_task+0x3e/0x117
[ 752.810623] [<ffffffff8105a516>] ? bit_waitqueue+0x12/0xa4
[ 752.810626] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 752.810629] [<ffffffff810c6abf>] bdi_start_fn+0x71/0xd5
[ 752.810632] [<ffffffff810c6a4e>] ? bdi_start_fn+0x0/0xd5
[ 752.810635] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 752.810638] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 752.810642] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 752.810644] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 755.826679] debug_smp_processor_id: 6 callbacks suppressed
[ 755.826682] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 755.826688] caller is native_sched_clock+0x3c/0x68
[ 755.826691] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 755.826694] Call Trace:
[ 755.826700] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 755.826704] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 755.826707] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 755.826710] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 755.826713] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 755.826717] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 755.826721] [<ffffffff810e4e4f>] ? ____cache_alloc+0x1c/0x264
[ 755.826724] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 755.826728] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 755.826731] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 755.826734] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 755.826737] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 755.826741] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 755.826745] [<ffffffff8110f7ed>] __block_write_full_page+0x1cd/0x2a8
[ 755.826763] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 755.826767] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 755.826770] [<ffffffff8110e651>] ? end_buffer_async_write+0x0/0x136
[ 755.826780] [<ffffffffa01861bc>] ? noalloc_get_block_write+0x0/0x55 [ext4]
[ 755.826783] [<ffffffff8110f94c>] block_write_full_page_endio+0x84/0x90
[ 755.826787] [<ffffffff8110f968>] block_write_full_page+0x10/0x12
[ 755.826797] [<ffffffffa0184375>] ext4_writepage+0x38d/0x3d4 [ext4]
[ 755.826801] [<ffffffff810b8c2c>] __writepage+0x12/0x2b
[ 755.826804] [<ffffffff810b9df8>] write_cache_pages+0x1f5/0x324
[ 755.826807] [<ffffffff810b8c1a>] ? __writepage+0x0/0x2b
[ 755.826811] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 755.826814] [<ffffffff810b9f46>] generic_writepages+0x1f/0x21
[ 755.826821] [<ffffffffa0155320>] journal_submit_data_buffers+0x104/0x171 [jbd2]
[ 755.826829] [<ffffffffa0155a00>] jbd2_journal_commit_transaction+0x4a8/0x14c4 [jbd2]
[ 755.826832] [<ffffffff8103733d>] ? sub_preempt_count+0x92/0xa6
[ 755.826837] [<ffffffff8130e64b>] ? _raw_spin_unlock_irqrestore+0x32/0x3d
[ 755.826840] [<ffffffff8104cf98>] ? try_to_del_timer_sync+0x76/0x84
[ 755.826848] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 755.826852] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 755.826860] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 755.826863] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 755.826866] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 755.826870] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 755.826872] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 755.826946] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 755.826949] caller is native_sched_clock+0x3c/0x68
[ 755.826952] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 755.826954] Call Trace:
[ 755.826957] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 755.826960] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 755.826963] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 755.826966] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 755.826969] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 755.826972] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 755.826976] [<ffffffff8119443f>] ? cfq_merge+0x74/0xa0
[ 755.826980] [<ffffffff8117f240>] ? elv_merge+0x166/0x19e
[ 755.826983] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 755.826986] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 755.826993] [<ffffffffa0153277>] ? jbd_unlock_bh_state+0x13/0x2e [jbd2]
[ 755.826996] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 755.826999] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 755.827006] [<ffffffffa0155f44>] jbd2_journal_commit_transaction+0x9ec/0x14c4 [jbd2]
[ 755.827010] [<ffffffff8130e64b>] ? _raw_spin_unlock_irqrestore+0x32/0x3d
[ 755.827013] [<ffffffff8104cf98>] ? try_to_del_timer_sync+0x76/0x84
[ 755.827021] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 755.827024] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 755.827032] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 755.827034] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 755.827038] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 755.827041] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 755.827044] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
[ 755.828245] BUG: using smp_processor_id() in preemptible [00000000] code: jbd2/sda2-8/1372
[ 755.828249] caller is native_sched_clock+0x3c/0x68
[ 755.828251] Pid: 1372, comm: jbd2/sda2-8 Tainted: P 2.6.34-20100524-0407 #1
[ 755.828253] Call Trace:
[ 755.828256] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
[ 755.828260] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
[ 755.828263] [<ffffffff81009a4d>] sched_clock+0x9/0xd
[ 755.828265] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
[ 755.828268] [<ffffffff81184227>] get_request+0x1bf/0x2c7
[ 755.828271] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
[ 755.828274] [<ffffffff810b8293>] ? __alloc_pages_nodemask+0xf3/0x60c
[ 755.828278] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 755.828280] [<ffffffff810373fe>] ? add_preempt_count+0xad/0xb2
[ 755.828283] [<ffffffff811849b8>] __make_request+0x32b/0x44e
[ 755.828287] [<ffffffff81183c9a>] generic_make_request+0x249/0x2be
[ 755.828290] [<ffffffff81035856>] ? get_parent_ip+0x11/0x41
[ 755.828293] [<ffffffff81183ddc>] submit_bio+0xcd/0xea
[ 755.828297] [<ffffffff8110cf60>] submit_bh+0xef/0x111
[ 755.828304] [<ffffffffa0155484>] journal_submit_commit_record+0xf7/0x16b [jbd2]
[ 755.828310] [<ffffffffa015638b>] jbd2_journal_commit_transaction+0xe33/0x14c4 [jbd2]
[ 755.828314] [<ffffffff8130e64b>] ? _raw_spin_unlock_irqrestore+0x32/0x3d
[ 755.828318] [<ffffffff8104cf98>] ? try_to_del_timer_sync+0x76/0x84
[ 755.828325] [<ffffffffa015b65c>] kjournald2+0x138/0x365 [jbd2]
[ 755.828328] [<ffffffff8105a5fb>] ? autoremove_wake_function+0x0/0x34
[ 755.828335] [<ffffffffa015b524>] ? kjournald2+0x0/0x365 [jbd2]
[ 755.828338] [<ffffffff8105a15f>] kthread+0x7a/0x82
[ 755.828341] [<ffffffff81003924>] kernel_thread_helper+0x4/0x10
[ 755.828344] [<ffffffff8105a0e5>] ? kthread+0x0/0x82
[ 755.828347] [<ffffffff81003920>] ? kernel_thread_helper+0x0/0x10
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-24 3:03 BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449 Piotr Hosowicz
@ 2010-05-24 17:22 ` Piotr Hosowicz
2010-05-25 8:50 ` Peter Zijlstra
1 sibling, 0 replies; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-24 17:22 UTC (permalink / raw)
To: LKML; +Cc: piotr
On 24.05.2010 05:03, Piotr Hosowicz wrote:
> I had this error in linux-next and reported it, but nobody answered :-(
> Now it's here, in fresh git source built kernel. After I boot the screen
> becomes cluttered with messages as in subject line. I attach dmesg and
> cpuinfo.
I've just git pulled latest kernel source, built the kernel, but the
problem still persists.
Cheers,
Piotr Hosowicz
--
TV: "Jeszcze trzy ruchy i Otylia będzie szczęśliwa."
NP: Slash - Ghost (Feat. Ian Astbury)
NB: 2.6.34-20100524-1752
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-24 3:03 BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449 Piotr Hosowicz
2010-05-24 17:22 ` Piotr Hosowicz
@ 2010-05-25 8:50 ` Peter Zijlstra
2010-05-25 9:42 ` Piotr Hosowicz
` (4 more replies)
1 sibling, 5 replies; 45+ messages in thread
From: Peter Zijlstra @ 2010-05-25 8:50 UTC (permalink / raw)
To: piotr; +Cc: linux-kernel, Jens Axboe, Divyesh Shah
On Mon, 2010-05-24 at 05:03 +0200, Piotr Hosowicz wrote:
> [ 720.313607] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
> [ 720.313612] caller is native_sched_clock+0x3c/0x68
> [ 720.313616] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
> [ 720.313618] Call Trace:
> [ 720.313624] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
> [ 720.313629] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
> [ 720.313634] [<ffffffff81009a4d>] sched_clock+0x9/0xd
> [ 720.313637] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
> [ 720.313641] [<ffffffff81184227>] get_request+0x1bf/0x2c7
> [ 720.313646] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
This comes from wreckage in the blk tree..
---
commit 9195291e5f05e01d67f9a09c756b8aca8f009089
Author: Divyesh Shah <dpshah@google.com>
Date: Thu Apr 1 15:01:41 2010 -0700
blkio: Increment the blkio cgroup stats for real now
We also add start_time_ns and io_start_time_ns fields to struct request
here to record the time when a request is created and when it is
dispatched to device. We use ns uints here as ms and jiffies are
not very useful for non-rotational media.
Signed-off-by: Divyesh Shah<dpshah@google.com>
Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
---
+#ifdef CONFIG_BLK_CGROUP
+static inline void set_start_time_ns(struct request *req)
+{
+ req->start_time_ns = sched_clock();
+}
+
+static inline void set_io_start_time_ns(struct request *req)
+{
+ req->io_start_time_ns = sched_clock();
+}
+#else
+static inline void set_start_time_ns(struct request *req) {}
+static inline void set_io_start_time_ns(struct request *req) {}
+#endif
---
Clearly nobody tested this, and its terribly broken to boot.
I guess they want something like:
---
Subject: sched_clock: Add local_clock()
From: Peter Zijlstra <a.p.zijlstra@chello.nl>
Date: Tue May 25 10:48:51 CEST 2010
For people who otherwise get to write: cpu_clock(smp_processor_id()),
there is now: local_clock().
Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl>
LKML-Reference: <new-submission>
---
Index: linux-2.6/arch/parisc/kernel/ftrace.c
===================================================================
--- linux-2.6.orig/arch/parisc/kernel/ftrace.c
+++ linux-2.6/arch/parisc/kernel/ftrace.c
@@ -82,7 +82,7 @@ unsigned long ftrace_return_to_handler(u
unsigned long ret;
pop_return_trace(&trace, &ret);
- trace.rettime = cpu_clock(raw_smp_processor_id());
+ trace.rettime = local_clock();
ftrace_graph_return(&trace);
if (unlikely(!ret)) {
@@ -126,7 +126,7 @@ void prepare_ftrace_return(unsigned long
return;
}
- calltime = cpu_clock(raw_smp_processor_id());
+ calltime = local_clock();
if (push_return_trace(old, calltime,
self_addr, &trace.depth) == -EBUSY) {
Index: linux-2.6/include/linux/blkdev.h
===================================================================
--- linux-2.6.orig/include/linux/blkdev.h
+++ linux-2.6/include/linux/blkdev.h
@@ -1213,12 +1213,12 @@ int kblockd_schedule_work(struct request
#ifdef CONFIG_BLK_CGROUP
static inline void set_start_time_ns(struct request *req)
{
- req->start_time_ns = sched_clock();
+ req->start_time_ns = local_clock();
}
static inline void set_io_start_time_ns(struct request *req)
{
- req->io_start_time_ns = sched_clock();
+ req->io_start_time_ns = local_clock();
}
static inline uint64_t rq_start_time_ns(struct request *req)
Index: linux-2.6/include/linux/sched.h
===================================================================
--- linux-2.6.orig/include/linux/sched.h
+++ linux-2.6/include/linux/sched.h
@@ -1822,6 +1822,7 @@ extern void sched_clock_idle_wakeup_even
* clock constructed from sched_clock():
*/
extern unsigned long long cpu_clock(int cpu);
+extern unsigned long long local_clock(void);
extern unsigned long long
task_sched_runtime(struct task_struct *task);
Index: linux-2.6/kernel/lockdep.c
===================================================================
--- linux-2.6.orig/kernel/lockdep.c
+++ linux-2.6/kernel/lockdep.c
@@ -146,7 +146,7 @@ static DEFINE_PER_CPU(struct lock_class_
static inline u64 lockstat_clock(void)
{
- return cpu_clock(smp_processor_id());
+ return local_clock();
}
static int lock_point(unsigned long points[], unsigned long ip)
Index: linux-2.6/kernel/perf_event.c
===================================================================
--- linux-2.6.orig/kernel/perf_event.c
+++ linux-2.6/kernel/perf_event.c
@@ -214,7 +214,7 @@ static void perf_unpin_context(struct pe
static inline u64 perf_clock(void)
{
- return cpu_clock(raw_smp_processor_id());
+ return local_clock();
}
/*
Index: linux-2.6/kernel/rcutorture.c
===================================================================
--- linux-2.6.orig/kernel/rcutorture.c
+++ linux-2.6/kernel/rcutorture.c
@@ -239,8 +239,7 @@ static unsigned long
rcu_random(struct rcu_random_state *rrsp)
{
if (--rrsp->rrs_count < 0) {
- rrsp->rrs_state +=
- (unsigned long)cpu_clock(raw_smp_processor_id());
+ rrsp->rrs_state += (unsigned long)local_clock();
rrsp->rrs_count = RCU_RANDOM_REFRESH;
}
rrsp->rrs_state = rrsp->rrs_state * RCU_RANDOM_MULT + RCU_RANDOM_ADD;
Index: linux-2.6/kernel/sched.c
===================================================================
--- linux-2.6.orig/kernel/sched.c
+++ linux-2.6/kernel/sched.c
@@ -1670,7 +1670,7 @@ static void update_shares(struct sched_d
if (root_task_group_empty())
return;
- now = cpu_clock(raw_smp_processor_id());
+ now = local_clock();
elapsed = now - sd->last_update;
if (elapsed >= (s64)(u64)sysctl_sched_shares_ratelimit) {
Index: linux-2.6/kernel/sched_clock.c
===================================================================
--- linux-2.6.orig/kernel/sched_clock.c
+++ linux-2.6/kernel/sched_clock.c
@@ -249,6 +249,18 @@ unsigned long long cpu_clock(int cpu)
return clock;
}
+unsigned long long local_clock(void)
+{
+ unsigned long long clock;
+ unsigned long flags;
+
+ local_irq_save(flags);
+ clock = sched_clock_cpu(smp_processor_id());
+ local_irq_restore(flags);
+
+ return clock;
+}
+
#else /* CONFIG_HAVE_UNSTABLE_SCHED_CLOCK */
void sched_clock_init(void)
@@ -264,12 +276,17 @@ u64 sched_clock_cpu(int cpu)
return sched_clock();
}
-
unsigned long long cpu_clock(int cpu)
{
return sched_clock_cpu(cpu);
}
+unsigned long long local_clock(void)
+{
+ return sched_clock_cpu(0);
+}
+
#endif /* CONFIG_HAVE_UNSTABLE_SCHED_CLOCK */
EXPORT_SYMBOL_GPL(cpu_clock);
+EXPORT_SYMBOL_GPL(local_clock);
Index: linux-2.6/kernel/trace/trace_clock.c
===================================================================
--- linux-2.6.orig/kernel/trace/trace_clock.c
+++ linux-2.6/kernel/trace/trace_clock.c
@@ -56,7 +56,7 @@ u64 notrace trace_clock_local(void)
*/
u64 notrace trace_clock(void)
{
- return cpu_clock(raw_smp_processor_id());
+ return local_clock();
}
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 8:50 ` Peter Zijlstra
@ 2010-05-25 9:42 ` Piotr Hosowicz
2010-05-25 9:45 ` Peter Zijlstra
2010-05-25 9:43 ` Ingo Molnar
` (3 subsequent siblings)
4 siblings, 1 reply; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-25 9:42 UTC (permalink / raw)
To: Peter Zijlstra; +Cc: linux-kernel, Jens Axboe, Divyesh Shah
On 25.05.2010 10:50, Peter Zijlstra wrote:
> Clearly nobody tested this, and its terribly broken to boot.
>
> I guess they want something like:
Patch applied, building now. Why don't you merge this into the kernel
tree? Or should I apply this patch each time manually?
Thanks, regards,
Piotr Hosowicz
--
Z Allegro: PRZEDMIOTEM AUKCJI JEST NOKIA 6210, ODDAŁEM JA SPEC-
JALISCIE DO WGRANIA JAKIEGOS SOFTU Z NOWYMI BAJERAMI, NO I MAM
BAJER NA WYŚWIETLACZU W POSTACI NAPISU "CONTACT SERVICE".
NP: Chickenfoot - Down The Drain
NB: 2.6.34-20100524-1752
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 8:50 ` Peter Zijlstra
2010-05-25 9:42 ` Piotr Hosowicz
@ 2010-05-25 9:43 ` Ingo Molnar
2010-05-25 9:47 ` Peter Zijlstra
2010-05-25 9:57 ` Piotr Hosowicz
2010-05-25 18:07 ` Divyesh Shah
` (2 subsequent siblings)
4 siblings, 2 replies; 45+ messages in thread
From: Ingo Molnar @ 2010-05-25 9:43 UTC (permalink / raw)
To: Peter Zijlstra
Cc: piotr, linux-kernel, Jens Axboe, Divyesh Shah, Andrew Morton
* Peter Zijlstra <peterz@infradead.org> wrote:
> On Mon, 2010-05-24 at 05:03 +0200, Piotr Hosowicz wrote:
> > [ 720.313607] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
> > [ 720.313612] caller is native_sched_clock+0x3c/0x68
> > [ 720.313616] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
> > [ 720.313618] Call Trace:
> > [ 720.313624] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
> > [ 720.313629] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
> > [ 720.313634] [<ffffffff81009a4d>] sched_clock+0x9/0xd
> > [ 720.313637] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
> > [ 720.313641] [<ffffffff81184227>] get_request+0x1bf/0x2c7
> > [ 720.313646] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
>
> This comes from wreckage in the blk tree..
>
> ---
> commit 9195291e5f05e01d67f9a09c756b8aca8f009089
> Author: Divyesh Shah <dpshah@google.com>
> Date: Thu Apr 1 15:01:41 2010 -0700
>
> blkio: Increment the blkio cgroup stats for real now
>
> We also add start_time_ns and io_start_time_ns fields to struct request
> here to record the time when a request is created and when it is
> dispatched to device. We use ns uints here as ms and jiffies are
> not very useful for non-rotational media.
>
> Signed-off-by: Divyesh Shah<dpshah@google.com>
> Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
> ---
>
> +#ifdef CONFIG_BLK_CGROUP
> +static inline void set_start_time_ns(struct request *req)
> +{
> + req->start_time_ns = sched_clock();
> +}
> +
> +static inline void set_io_start_time_ns(struct request *req)
> +{
> + req->io_start_time_ns = sched_clock();
> +}
> +#else
> +static inline void set_start_time_ns(struct request *req) {}
> +static inline void set_io_start_time_ns(struct request *req) {}
> +#endif
>
> ---
>
> Clearly nobody tested this, and its terribly broken to boot.
>
> I guess they want something like:
>
> ---
> Subject: sched_clock: Add local_clock()
> From: Peter Zijlstra <a.p.zijlstra@chello.nl>
> Date: Tue May 25 10:48:51 CEST 2010
>
> For people who otherwise get to write: cpu_clock(smp_processor_id()),
> there is now: local_clock().
This doesnt fix the whole issue. cpu_clock() is local, while the measurements
done in the blk code are global ...
While the warning is fixed this way, the far more serious issue is still
there: time can go backwards if two points of time measurement are on
different CPUs and can mess up the statistics with negative values, etc...
Ingo
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 9:42 ` Piotr Hosowicz
@ 2010-05-25 9:45 ` Peter Zijlstra
0 siblings, 0 replies; 45+ messages in thread
From: Peter Zijlstra @ 2010-05-25 9:45 UTC (permalink / raw)
To: piotr; +Cc: linux-kernel, Jens Axboe, Divyesh Shah
On Tue, 2010-05-25 at 11:42 +0200, Piotr Hosowicz wrote:
> On 25.05.2010 10:50, Peter Zijlstra wrote:
>
> > Clearly nobody tested this, and its terribly broken to boot.
> >
> > I guess they want something like:
>
> Patch applied, building now. Why don't you merge this into the kernel
> tree? Or should I apply this patch each time manually?
It should appear in a tree near you 'soon' :-)
The way things work I don't actually have commit access to Linus' tree,
but I'll pass the patch to Ingo, who will put it in -tip, which will
then be send Linus wards.
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 9:43 ` Ingo Molnar
@ 2010-05-25 9:47 ` Peter Zijlstra
2010-05-25 9:51 ` Peter Zijlstra
2010-05-25 9:57 ` Piotr Hosowicz
1 sibling, 1 reply; 45+ messages in thread
From: Peter Zijlstra @ 2010-05-25 9:47 UTC (permalink / raw)
To: Ingo Molnar; +Cc: piotr, linux-kernel, Jens Axboe, Divyesh Shah, Andrew Morton
On Tue, 2010-05-25 at 11:43 +0200, Ingo Molnar wrote:
> > Subject: sched_clock: Add local_clock()
> > From: Peter Zijlstra <a.p.zijlstra@chello.nl>
> > Date: Tue May 25 10:48:51 CEST 2010
> >
> > For people who otherwise get to write: cpu_clock(smp_processor_id()),
> > there is now: local_clock().
>
> This doesnt fix the whole issue. cpu_clock() is local, while the measurements
> done in the blk code are global ...
>
> While the warning is fixed this way, the far more serious issue is still
> there: time can go backwards if two points of time measurement are on
> different CPUs and can mess up the statistics with negative values, etc...
cpu_clock() is synced on each tick, so the inter-cpu-drift should not
exceed 2 jiffies.
But yeah, if they want anything better, they'll have to start caring on
what cpu which timestamp got taken and use cpu_clock().
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 9:47 ` Peter Zijlstra
@ 2010-05-25 9:51 ` Peter Zijlstra
0 siblings, 0 replies; 45+ messages in thread
From: Peter Zijlstra @ 2010-05-25 9:51 UTC (permalink / raw)
To: Ingo Molnar; +Cc: piotr, linux-kernel, Jens Axboe, Divyesh Shah, Andrew Morton
On Tue, 2010-05-25 at 11:47 +0200, Peter Zijlstra wrote:
> On Tue, 2010-05-25 at 11:43 +0200, Ingo Molnar wrote:
> > > Subject: sched_clock: Add local_clock()
> > > From: Peter Zijlstra <a.p.zijlstra@chello.nl>
> > > Date: Tue May 25 10:48:51 CEST 2010
> > >
> > > For people who otherwise get to write: cpu_clock(smp_processor_id()),
> > > there is now: local_clock().
> >
> > This doesnt fix the whole issue. cpu_clock() is local, while the measurements
> > done in the blk code are global ...
> >
> > While the warning is fixed this way, the far more serious issue is still
> > there: time can go backwards if two points of time measurement are on
> > different CPUs and can mess up the statistics with negative values, etc...
>
> cpu_clock() is synced on each tick, so the inter-cpu-drift should not
> exceed 2 jiffies.
>
> But yeah, if they want anything better, they'll have to start caring on
> what cpu which timestamp got taken and use cpu_clock().
For completeness, the previously used sched_clock() isn't synced between
cores at all, and can exhibit unbounded drift.
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 9:43 ` Ingo Molnar
2010-05-25 9:47 ` Peter Zijlstra
@ 2010-05-25 9:57 ` Piotr Hosowicz
2010-05-25 10:00 ` Peter Zijlstra
1 sibling, 1 reply; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-25 9:57 UTC (permalink / raw)
To: Ingo Molnar
Cc: Peter Zijlstra, linux-kernel, Jens Axboe, Divyesh Shah, Andrew Morton
On 25.05.2010 11:43, Ingo Molnar wrote:
> This doesnt fix the whole issue. cpu_clock() is local, while the measurements
> done in the blk code are global ...
>
> While the warning is fixed this way, the far more serious issue is still
> there: time can go backwards if two points of time measurement are on
> different CPUs and can mess up the statistics with negative values, etc...
How serious is this? Can it damage my data? I ask because the machine is
my private computer, not any test machine.
Regards,
Piotr Hosowicz
--
Babcia rox! :
alek: przyszli do mnie jechowi dzisiaj, otworzyła babcia
pate_q: i co?
alek: po 30 minutach rozmowy chcieli przejść na chrześcijaństwo
NP: Alice In Chains - All Secrets Known
NB: 2.6.34-20100524-1752
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 9:57 ` Piotr Hosowicz
@ 2010-05-25 10:00 ` Peter Zijlstra
2010-05-25 10:05 ` Piotr Hosowicz
0 siblings, 1 reply; 45+ messages in thread
From: Peter Zijlstra @ 2010-05-25 10:00 UTC (permalink / raw)
To: piotr; +Cc: Ingo Molnar, linux-kernel, Jens Axboe, Divyesh Shah, Andrew Morton
On Tue, 2010-05-25 at 11:57 +0200, Piotr Hosowicz wrote:
> On 25.05.2010 11:43, Ingo Molnar wrote:
>
> > This doesnt fix the whole issue. cpu_clock() is local, while the measurements
> > done in the blk code are global ...
> >
> > While the warning is fixed this way, the far more serious issue is still
> > there: time can go backwards if two points of time measurement are on
> > different CPUs and can mess up the statistics with negative values, etc...
>
> How serious is this? Can it damage my data? I ask because the machine is
> my private computer, not any test machine.
I'm not sure, since I didn't really look what they use the timestamps
for, but a guess would say your data is safe, it might schedule the io
funny, but it should not compromise integrity. At best its used purely
for statistics and not even behaviour is affected.
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 10:00 ` Peter Zijlstra
@ 2010-05-25 10:05 ` Piotr Hosowicz
2010-05-25 10:29 ` Piotr Hosowicz
0 siblings, 1 reply; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-25 10:05 UTC (permalink / raw)
To: Peter Zijlstra
Cc: Ingo Molnar, linux-kernel, Jens Axboe, Divyesh Shah, Andrew Morton
On 25.05.2010 12:00, Peter Zijlstra wrote:
> On Tue, 2010-05-25 at 11:57 +0200, Piotr Hosowicz wrote:
>> On 25.05.2010 11:43, Ingo Molnar wrote:
>>
>>> This doesnt fix the whole issue. cpu_clock() is local, while the measurements
>>> done in the blk code are global ...
>>>
>>> While the warning is fixed this way, the far more serious issue is still
>>> there: time can go backwards if two points of time measurement are on
>>> different CPUs and can mess up the statistics with negative values, etc...
>>
>> How serious is this? Can it damage my data? I ask because the machine is
>> my private computer, not any test machine.
>
> I'm not sure, since I didn't really look what they use the timestamps
> for, but a guess would say your data is safe, it might schedule the io
> funny, but it should not compromise integrity. At best its used purely
> for statistics and not even behaviour is affected.
Thanks.
Cheers,
Piotr Hosowicz
--
"Wiedza to władza. Ale niewiedza, niestety, nie oznacza jeszcze
braku władzy." Niels Bohr
NP: Black Stone Cherry - Reverend Wrinkle
NB: 2.6.34-20100524-1752
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 10:05 ` Piotr Hosowicz
@ 2010-05-25 10:29 ` Piotr Hosowicz
2010-05-25 14:13 ` Piotr Hosowicz
0 siblings, 1 reply; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-25 10:29 UTC (permalink / raw)
To: piotr
Cc: Peter Zijlstra, Ingo Molnar, linux-kernel, Jens Axboe,
Divyesh Shah, Andrew Morton
On 25.05.2010 12:05, Piotr Hosowicz wrote:
> On 25.05.2010 12:00, Peter Zijlstra wrote:
>> On Tue, 2010-05-25 at 11:57 +0200, Piotr Hosowicz wrote:
>>> On 25.05.2010 11:43, Ingo Molnar wrote:
>>>
>>>> This doesnt fix the whole issue. cpu_clock() is local, while the
>>>> measurements
>>>> done in the blk code are global ...
>>>>
>>>> While the warning is fixed this way, the far more serious issue is
>>>> still
>>>> there: time can go backwards if two points of time measurement are on
>>>> different CPUs and can mess up the statistics with negative values,
>>>> etc...
>>>
>>> How serious is this? Can it damage my data? I ask because the machine is
>>> my private computer, not any test machine.
>>
>> I'm not sure, since I didn't really look what they use the timestamps
>> for, but a guess would say your data is safe, it might schedule the io
>> funny, but it should not compromise integrity. At best its used purely
>> for statistics and not even behaviour is affected.
>
> Thanks.
Seems to work like a charm. I ask my question anew - shall I have to
apply the patch each time I update my kernel tree?
Regards,
Piotr Hosowicz
--
Janusz Korwin-Mikke:
"Idiota z dyplomem to taki sam idiota,
jak przedtem - tylko z pretensjami."
NP: Slash - Ghost (Feat. Ian Astbury)
NB: 2.6.34-20100524-1752-patched
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 10:29 ` Piotr Hosowicz
@ 2010-05-25 14:13 ` Piotr Hosowicz
2010-05-25 14:34 ` Piotr Hosowicz
0 siblings, 1 reply; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-25 14:13 UTC (permalink / raw)
To: piotr
Cc: Peter Zijlstra, Ingo Molnar, linux-kernel, Jens Axboe,
Divyesh Shah, Andrew Morton
On 25.05.2010 12:29, Piotr Hosowicz wrote:
> On 25.05.2010 12:05, Piotr Hosowicz wrote:
>> On 25.05.2010 12:00, Peter Zijlstra wrote:
>>> On Tue, 2010-05-25 at 11:57 +0200, Piotr Hosowicz wrote:
>>>> On 25.05.2010 11:43, Ingo Molnar wrote:
>>>>
>>>>> This doesnt fix the whole issue. cpu_clock() is local, while the
>>>>> measurements
>>>>> done in the blk code are global ...
>>>>>
>>>>> While the warning is fixed this way, the far more serious issue is
>>>>> still
>>>>> there: time can go backwards if two points of time measurement are on
>>>>> different CPUs and can mess up the statistics with negative values,
>>>>> etc...
>>>>
>>>> How serious is this? Can it damage my data? I ask because the
>>>> machine is
>>>> my private computer, not any test machine.
>>>
>>> I'm not sure, since I didn't really look what they use the timestamps
>>> for, but a guess would say your data is safe, it might schedule the io
>>> funny, but it should not compromise integrity. At best its used purely
>>> for statistics and not even behaviour is affected.
>>
>> Thanks.
>
> Seems to work like a charm.
Not exactly. I looked into the syslog. I's much better, but I rebooted
to single user mode to rebuild nvidia driver (new beta version) and I
see same error (BUG ... code: ???) on shuting down, mentioning sync,
umount and finally shutdown.
Anyway it's much more comfortable to build nvidia drivers in the console
because previously the BUG lines cluttered all the console.
Regards,
Piotr Hosowicz
--
Z cyklu "Uroki demokracji", czyli pytania i odpowiedzi w teledurniejach:
- Co wydarzyło się w Dallas 22 listopada 1963 roku?
- Nie wiem, wtedy nie oglądałem.
NP: Slash - Paradise City (Feat. Fergie And Cypress Hill) (Australian Bonus)
NB: 2.6.34-20100524-1752-patched
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 14:13 ` Piotr Hosowicz
@ 2010-05-25 14:34 ` Piotr Hosowicz
2010-05-25 14:36 ` Peter Zijlstra
0 siblings, 1 reply; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-25 14:34 UTC (permalink / raw)
To: piotr
Cc: Peter Zijlstra, Ingo Molnar, linux-kernel, Jens Axboe,
Divyesh Shah, Andrew Morton
On 25.05.2010 16:13, Piotr Hosowicz wrote:
> On 25.05.2010 12:29, Piotr Hosowicz wrote:
>> On 25.05.2010 12:05, Piotr Hosowicz wrote:
>>> On 25.05.2010 12:00, Peter Zijlstra wrote:
>>>> On Tue, 2010-05-25 at 11:57 +0200, Piotr Hosowicz wrote:
>>>>> On 25.05.2010 11:43, Ingo Molnar wrote:
>>>>>
>>>>>> This doesnt fix the whole issue. cpu_clock() is local, while the
>>>>>> measurements
>>>>>> done in the blk code are global ...
>>>>>>
>>>>>> While the warning is fixed this way, the far more serious issue is
>>>>>> still
>>>>>> there: time can go backwards if two points of time measurement are on
>>>>>> different CPUs and can mess up the statistics with negative values,
>>>>>> etc...
>>>>>
>>>>> How serious is this? Can it damage my data? I ask because the
>>>>> machine is
>>>>> my private computer, not any test machine.
>>>>
>>>> I'm not sure, since I didn't really look what they use the timestamps
>>>> for, but a guess would say your data is safe, it might schedule the io
>>>> funny, but it should not compromise integrity. At best its used purely
>>>> for statistics and not even behaviour is affected.
>>>
>>> Thanks.
>>
>> Seems to work like a charm.
>
> Not exactly. I looked into the syslog. I's much better, but I rebooted
> to single user mode to rebuild nvidia driver (new beta version) and I
> see same error (BUG ... code: ???) on shuting down, mentioning sync,
> umount and finally shutdown.
Sorry, reversed order - shutdown, umount, finally sync.
--
- Czy jest cukier w kostkach ?
- Nie ma.
- A jakas inna tania bombonierka? Dla tesciowej.
NP: Chickenfoot - Soap On A Rope
NB: 2.6.34-20100524-1752-patched
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 14:34 ` Piotr Hosowicz
@ 2010-05-25 14:36 ` Peter Zijlstra
2010-05-25 14:48 ` Piotr Hosowicz
0 siblings, 1 reply; 45+ messages in thread
From: Peter Zijlstra @ 2010-05-25 14:36 UTC (permalink / raw)
To: piotr; +Cc: Ingo Molnar, linux-kernel, Jens Axboe, Divyesh Shah, Andrew Morton
On Tue, 2010-05-25 at 16:34 +0200, Piotr Hosowicz wrote:
> > Not exactly. I looked into the syslog. I's much better, but I rebooted
> > to single user mode to rebuild nvidia driver (new beta version) and I
> > see same error (BUG ... code: ???) on shuting down, mentioning sync,
> > umount and finally shutdown.
>
> Sorry, reversed order - shutdown, umount, finally sync.
Could you post the full splat?
I'd be very surprised if its the same thing.
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 14:36 ` Peter Zijlstra
@ 2010-05-25 14:48 ` Piotr Hosowicz
2010-05-25 16:15 ` Peter Zijlstra
0 siblings, 1 reply; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-25 14:48 UTC (permalink / raw)
To: Peter Zijlstra
Cc: Ingo Molnar, linux-kernel, Jens Axboe, Divyesh Shah, Andrew Morton
On 25.05.2010 16:36, Peter Zijlstra wrote:
> On Tue, 2010-05-25 at 16:34 +0200, Piotr Hosowicz wrote:
>>> Not exactly. I looked into the syslog. I's much better, but I rebooted
>>> to single user mode to rebuild nvidia driver (new beta version) and I
>>> see same error (BUG ... code: ???) on shuting down, mentioning sync,
>>> umount and finally shutdown.
>>
>> Sorry, reversed order - shutdown, umount, finally sync.
>
> Could you post the full splat?
Here you are:
May 25 15:04:35 aapi205 shutdown[16256]: shutting down for system reboot
May 25 15:04:35 aapi205 kernel: [ 9694.523288] BUG: using
smp_processor_id() in preemptible [00000000] code: shutdown/16256
May 25 15:04:35 aapi205 kernel: [ 9694.523296] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:35 aapi205 kernel: [ 9694.523299] Pid: 16256, comm:
shutdown Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:35 aapi205 kernel: [ 9694.523301] Call Trace:
May 25 15:04:35 aapi205 kernel: [ 9694.523308] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:35 aapi205 kernel: [ 9694.523311] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:35 aapi205 kernel: [ 9694.523314] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:35 aapi205 kernel: [ 9694.523319] [<ffffffff8103bf21>] ?
wake_up_process+0x10/0x12
May 25 15:04:35 aapi205 kernel: [ 9694.523323] [<ffffffff81107ad4>] ?
bdi_queue_work+0x9d/0xb3
May 25 15:04:35 aapi205 kernel: [ 9694.523326] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:35 aapi205 kernel: [ 9694.523329] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:35 aapi205 kernel: [ 9694.523332] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:35 aapi205 kernel: [ 9694.523335] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:35 aapi205 kernel: [ 9694.523339] [<ffffffff8110bc16>]
sys_sync+0x2a/0x57
May 25 15:04:35 aapi205 kernel: [ 9694.523343] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:35 aapi205 kernel: [ 9694.523898] BUG: using
smp_processor_id() in preemptible [00000000] code: shutdown/16256
May 25 15:04:35 aapi205 kernel: [ 9694.523902] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:35 aapi205 kernel: [ 9694.523905] Pid: 16256, comm:
shutdown Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:35 aapi205 kernel: [ 9694.523907] Call Trace:
May 25 15:04:35 aapi205 kernel: [ 9694.523911] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:35 aapi205 kernel: [ 9694.523915] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:35 aapi205 kernel: [ 9694.523918] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:35 aapi205 kernel: [ 9694.523922] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:35 aapi205 kernel: [ 9694.523925] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:35 aapi205 kernel: [ 9694.523928] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:35 aapi205 kernel: [ 9694.523931] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:35 aapi205 kernel: [ 9694.523934] [<ffffffff8110bc16>]
sys_sync+0x2a/0x57
May 25 15:04:35 aapi205 kernel: [ 9694.523938] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:35 aapi205 kernel: [ 9694.523952] BUG: using
smp_processor_id() in preemptible [00000000] code: shutdown/16256
May 25 15:04:35 aapi205 kernel: [ 9694.523956] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:35 aapi205 kernel: [ 9694.523958] Pid: 16256, comm:
shutdown Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:35 aapi205 kernel: [ 9694.523960] Call Trace:
May 25 15:04:35 aapi205 kernel: [ 9694.523963] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:35 aapi205 kernel: [ 9694.523967] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:35 aapi205 kernel: [ 9694.523970] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:35 aapi205 kernel: [ 9694.523974] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:35 aapi205 kernel: [ 9694.523977] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:35 aapi205 kernel: [ 9694.523980] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:35 aapi205 kernel: [ 9694.523983] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:35 aapi205 kernel: [ 9694.523986] [<ffffffff8110bc2c>]
sys_sync+0x40/0x57
May 25 15:04:35 aapi205 kernel: [ 9694.523989] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:36 aapi205 kernel: [ 9695.865459] BUG: using
smp_processor_id() in preemptible [00000000] code: shutdown/16256
May 25 15:04:36 aapi205 kernel: [ 9695.865466] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:36 aapi205 kernel: [ 9695.865470] Pid: 16256, comm:
shutdown Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:36 aapi205 kernel: [ 9695.865473] Call Trace:
May 25 15:04:36 aapi205 kernel: [ 9695.865479] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:36 aapi205 kernel: [ 9695.865483] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:36 aapi205 kernel: [ 9695.865487] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:36 aapi205 kernel: [ 9695.865491] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:36 aapi205 kernel: [ 9695.865513] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:36 aapi205 kernel: [ 9695.865516] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:36 aapi205 kernel: [ 9695.865519] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:36 aapi205 kernel: [ 9695.865524] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:36 aapi205 kernel: [ 9695.865528] [<ffffffff8110bc2c>]
sys_sync+0x40/0x57
May 25 15:04:36 aapi205 kernel: [ 9695.865533] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:36 aapi205 init: Switching to runlevel: 6
May 25 15:04:36 aapi205 kernel: [ 9696.142724] ALSA
sound/pci/hda/hda_intel.c:1665: azx_pcm_prepare: bufsize=0x10000,
format=0x31
May 25 15:04:36 aapi205 kernel: [ 9696.142740] ALSA
sound/pci/hda/hda_codec.c:1158: hda_codec_setup_stream: NID=0x6,
stream=0x5, channel=0, format=0x31
May 25 15:04:36 aapi205 kernel: [ 9696.148528] ALSA
sound/pci/hda/hda_codec.c:1158: hda_codec_setup_stream: NID=0x2,
stream=0x5, channel=0, format=0x31
May 25 15:04:36 aapi205 kernel: [ 9696.156527] ALSA
sound/pci/hda/hda_codec.c:1158: hda_codec_setup_stream: NID=0x3,
stream=0x5, channel=0, format=0x31
May 25 15:04:36 aapi205 kernel: [ 9696.164525] ALSA
sound/pci/hda/hda_codec.c:1158: hda_codec_setup_stream: NID=0x4,
stream=0x5, channel=0, format=0x31
May 25 15:04:36 aapi205 kernel: [ 9696.172525] ALSA
sound/pci/hda/hda_codec.c:1158: hda_codec_setup_stream: NID=0x5,
stream=0x5, channel=0, format=0x31
May 25 15:04:37 aapi205 kernel: [ 9697.255097] ALSA
sound/pci/hda/hda_codec.c:1176: hda_codec_cleanup_stream: NID=0x2
May 25 15:04:37 aapi205 kernel: [ 9697.255106] ALSA
sound/pci/hda/hda_codec.c:1176: hda_codec_cleanup_stream: NID=0x3
May 25 15:04:37 aapi205 kernel: [ 9697.255112] ALSA
sound/pci/hda/hda_codec.c:1176: hda_codec_cleanup_stream: NID=0x4
May 25 15:04:37 aapi205 kernel: [ 9697.255118] ALSA
sound/pci/hda/hda_codec.c:1176: hda_codec_cleanup_stream: NID=0x5
May 25 15:04:37 aapi205 kernel: [ 9697.255123] ALSA
sound/pci/hda/hda_codec.c:1176: hda_codec_cleanup_stream: NID=0x6
May 25 15:04:40 aapi205 innd: ctlinnd command q:rc.news stop
May 25 15:04:40 aapi205 innd: SERVER shutdown rc.news stop
May 25 15:04:40 aapi205 innd: controlchan! closed
May 25 15:04:40 aapi205 innd: control:12 closed
May 25 15:04:40 aapi205 innd: localconn:14 closed
May 25 15:04:40 aapi205 innd: remconn:15 closed
May 25 15:04:40 aapi205 innd: remconn:17 closed
May 25 15:04:40 aapi205 innd: SERVER perl filtering disabled
May 25 15:04:40 aapi205 innd: SERVER shutdown rc.news stop
May 25 15:04:45 aapi205 xinetd[2822]: Exiting...
May 25 15:04:48 aapi205 kernel: [ 9707.903818] BUG: using
smp_processor_id() in preemptible [00000000] code: umount/16455
May 25 15:04:48 aapi205 kernel: [ 9707.905420] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:48 aapi205 kernel: [ 9707.905423] Pid: 16455, comm: umount
Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:48 aapi205 kernel: [ 9707.905426] Call Trace:
May 25 15:04:48 aapi205 kernel: [ 9707.905432] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:48 aapi205 kernel: [ 9707.905436] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:48 aapi205 kernel: [ 9707.905439] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:48 aapi205 kernel: [ 9707.905444] [<ffffffff8103bf21>] ?
wake_up_process+0x10/0x12
May 25 15:04:48 aapi205 kernel: [ 9707.905448] [<ffffffff81107ad4>] ?
bdi_queue_work+0x9d/0xb3
May 25 15:04:48 aapi205 kernel: [ 9707.905452] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:48 aapi205 kernel: [ 9707.905455] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:48 aapi205 kernel: [ 9707.905458] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:48 aapi205 kernel: [ 9707.905462] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:48 aapi205 kernel: [ 9707.905465] [<ffffffff8110bc16>]
sys_sync+0x2a/0x57
May 25 15:04:48 aapi205 kernel: [ 9707.905470] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:48 aapi205 kernel: [ 9707.918645] BUG: using
smp_processor_id() in preemptible [00000000] code: umount/16455
May 25 15:04:48 aapi205 kernel: [ 9707.920227] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:48 aapi205 kernel: [ 9707.920230] Pid: 16455, comm: umount
Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:48 aapi205 kernel: [ 9707.920232] Call Trace:
May 25 15:04:48 aapi205 kernel: [ 9707.920237] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:48 aapi205 kernel: [ 9707.920241] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:48 aapi205 kernel: [ 9707.920244] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:48 aapi205 kernel: [ 9707.920248] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:48 aapi205 kernel: [ 9707.920251] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:48 aapi205 kernel: [ 9707.920254] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:48 aapi205 kernel: [ 9707.920257] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:48 aapi205 kernel: [ 9707.920260] [<ffffffff8110bc16>]
sys_sync+0x2a/0x57
May 25 15:04:48 aapi205 kernel: [ 9707.920264] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:48 aapi205 kernel: [ 9707.920286] BUG: using
smp_processor_id() in preemptible [00000000] code: umount/16455
May 25 15:04:48 aapi205 kernel: [ 9707.921976] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:48 aapi205 kernel: [ 9707.921979] Pid: 16455, comm: umount
Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:48 aapi205 kernel: [ 9707.921982] Call Trace:
May 25 15:04:48 aapi205 kernel: [ 9707.921985] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:48 aapi205 kernel: [ 9707.921988] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:48 aapi205 kernel: [ 9707.921992] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:48 aapi205 kernel: [ 9707.921996] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:48 aapi205 kernel: [ 9707.921998] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:48 aapi205 kernel: [ 9707.922002] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:48 aapi205 kernel: [ 9707.922006] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:48 aapi205 kernel: [ 9707.922011] [<ffffffff8110bc2c>]
sys_sync+0x40/0x57
May 25 15:04:48 aapi205 kernel: [ 9707.922016] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:49 aapi205 kernel: [ 9708.697931] BUG: using
smp_processor_id() in preemptible [00000000] code: umount/16455
May 25 15:04:49 aapi205 kernel: [ 9708.699421] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:49 aapi205 kernel: [ 9708.699424] Pid: 16455, comm: umount
Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:49 aapi205 kernel: [ 9708.699427] Call Trace:
May 25 15:04:49 aapi205 kernel: [ 9708.699433] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:49 aapi205 kernel: [ 9708.699436] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:49 aapi205 kernel: [ 9708.699440] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:49 aapi205 kernel: [ 9708.699444] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:49 aapi205 kernel: [ 9708.699447] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:49 aapi205 kernel: [ 9708.699450] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:49 aapi205 kernel: [ 9708.699453] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:49 aapi205 kernel: [ 9708.699457] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:49 aapi205 kernel: [ 9708.699460] [<ffffffff8110bc2c>]
sys_sync+0x40/0x57
May 25 15:04:49 aapi205 kernel: [ 9708.699464] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:49 aapi205 kernel: [ 9708.706412] BUG: using
smp_processor_id() in preemptible [00000000] code: umount/16456
May 25 15:04:49 aapi205 kernel: [ 9708.707918] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:49 aapi205 kernel: [ 9708.707921] Pid: 16456, comm: umount
Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:49 aapi205 kernel: [ 9708.707924] Call Trace:
May 25 15:04:49 aapi205 kernel: [ 9708.707929] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:49 aapi205 kernel: [ 9708.707932] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:49 aapi205 kernel: [ 9708.707936] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:49 aapi205 kernel: [ 9708.707940] [<ffffffff8103bf21>] ?
wake_up_process+0x10/0x12
May 25 15:04:49 aapi205 kernel: [ 9708.707945] [<ffffffff81107ad4>] ?
bdi_queue_work+0x9d/0xb3
May 25 15:04:49 aapi205 kernel: [ 9708.707948] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:49 aapi205 kernel: [ 9708.707952] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:49 aapi205 kernel: [ 9708.707955] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:49 aapi205 kernel: [ 9708.707958] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:49 aapi205 kernel: [ 9708.707961] [<ffffffff8110bc16>]
sys_sync+0x2a/0x57
May 25 15:04:49 aapi205 kernel: [ 9708.707965] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:49 aapi205 kernel: [ 9708.708035] BUG: using
smp_processor_id() in preemptible [00000000] code: umount/16456
May 25 15:04:49 aapi205 kernel: [ 9708.709679] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:49 aapi205 kernel: [ 9708.709683] Pid: 16456, comm: umount
Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:49 aapi205 kernel: [ 9708.709685] Call Trace:
May 25 15:04:49 aapi205 kernel: [ 9708.709690] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:49 aapi205 kernel: [ 9708.709694] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:49 aapi205 kernel: [ 9708.709698] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:49 aapi205 kernel: [ 9708.709704] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:49 aapi205 kernel: [ 9708.709708] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:49 aapi205 kernel: [ 9708.709713] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:49 aapi205 kernel: [ 9708.709717] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:49 aapi205 kernel: [ 9708.709721] [<ffffffff8110bc16>]
sys_sync+0x2a/0x57
May 25 15:04:49 aapi205 kernel: [ 9708.709726] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:49 aapi205 kernel: [ 9708.709752] BUG: using
smp_processor_id() in preemptible [00000000] code: umount/16456
May 25 15:04:49 aapi205 kernel: [ 9708.711428] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:49 aapi205 kernel: [ 9708.711431] Pid: 16456, comm: umount
Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:49 aapi205 kernel: [ 9708.711434] Call Trace:
May 25 15:04:49 aapi205 kernel: [ 9708.711437] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:49 aapi205 kernel: [ 9708.711441] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:49 aapi205 kernel: [ 9708.711445] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:49 aapi205 kernel: [ 9708.711448] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:49 aapi205 kernel: [ 9708.711452] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:49 aapi205 kernel: [ 9708.711455] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:49 aapi205 kernel: [ 9708.711458] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:49 aapi205 kernel: [ 9708.711461] [<ffffffff8110bc2c>]
sys_sync+0x40/0x57
May 25 15:04:49 aapi205 kernel: [ 9708.711465] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:49 aapi205 kernel: [ 9709.009589] BUG: using
smp_processor_id() in preemptible [00000000] code: umount/16456
May 25 15:04:49 aapi205 kernel: [ 9709.011130] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:49 aapi205 kernel: [ 9709.011134] Pid: 16456, comm: umount
Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:49 aapi205 kernel: [ 9709.011136] Call Trace:
May 25 15:04:49 aapi205 kernel: [ 9709.011142] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:49 aapi205 kernel: [ 9709.011146] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:49 aapi205 kernel: [ 9709.011149] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:49 aapi205 kernel: [ 9709.011153] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:49 aapi205 kernel: [ 9709.011156] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:49 aapi205 kernel: [ 9709.011159] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:49 aapi205 kernel: [ 9709.011163] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:49 aapi205 kernel: [ 9709.011166] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:49 aapi205 kernel: [ 9709.011170] [<ffffffff8110bc2c>]
sys_sync+0x40/0x57
May 25 15:04:49 aapi205 kernel: [ 9709.011174] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:49 aapi205 kernel: [ 9709.058654] fuse exit
May 25 15:04:50 aapi205 bluetoothd[3086]: bridge pan0 removed
May 25 15:04:51 aapi205 bluetoothd[3086]: Stopping SDP server
May 25 15:04:51 aapi205 bluetoothd[3086]: Exit
May 25 15:04:51 aapi205 kernel: [ 9710.493142] BUG: using
smp_processor_id() in preemptible [00000000] code: sync/16494
May 25 15:04:51 aapi205 kernel: [ 9710.494737] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:51 aapi205 kernel: [ 9710.494741] Pid: 16494, comm: sync
Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:51 aapi205 kernel: [ 9710.494743] Call Trace:
May 25 15:04:51 aapi205 kernel: [ 9710.494749] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:51 aapi205 kernel: [ 9710.494753] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:51 aapi205 kernel: [ 9710.494756] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:51 aapi205 kernel: [ 9710.494761] [<ffffffff8103bf21>] ?
wake_up_process+0x10/0x12
May 25 15:04:51 aapi205 kernel: [ 9710.494766] [<ffffffff81107ad4>] ?
bdi_queue_work+0x9d/0xb3
May 25 15:04:51 aapi205 kernel: [ 9710.494770] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:51 aapi205 kernel: [ 9710.494773] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:51 aapi205 kernel: [ 9710.494776] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:51 aapi205 kernel: [ 9710.494780] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:51 aapi205 kernel: [ 9710.494783] [<ffffffff8110bc16>]
sys_sync+0x2a/0x57
May 25 15:04:51 aapi205 kernel: [ 9710.494787] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:51 aapi205 kernel: [ 9710.494813] BUG: using
smp_processor_id() in preemptible [00000000] code: sync/16494
May 25 15:04:51 aapi205 kernel: [ 9710.496416] caller is
dqstats_inc+0x19/0x2c
May 25 15:04:51 aapi205 kernel: [ 9710.496418] Pid: 16494, comm: sync
Tainted: P W 2.6.34-20100524-1752-patched #1
May 25 15:04:51 aapi205 kernel: [ 9710.496420] Call Trace:
May 25 15:04:51 aapi205 kernel: [ 9710.496424] [<ffffffff811a537b>]
debug_smp_processor_id+0xc7/0xe0
May 25 15:04:51 aapi205 kernel: [ 9710.496428] [<ffffffff8112c0ad>]
dqstats_inc+0x19/0x2c
May 25 15:04:51 aapi205 kernel: [ 9710.496431] [<ffffffff8112ee66>]
vfs_quota_sync+0x1b1/0x293
May 25 15:04:51 aapi205 kernel: [ 9710.496435] [<ffffffff8110bbcf>] ?
sync_one_sb+0x0/0x1d
May 25 15:04:51 aapi205 kernel: [ 9710.496438] [<ffffffff8110bb8b>]
__sync_filesystem+0x3a/0x7e
May 25 15:04:51 aapi205 kernel: [ 9710.496441] [<ffffffff8110bbea>]
sync_one_sb+0x1b/0x1d
May 25 15:04:51 aapi205 kernel: [ 9710.496444] [<ffffffff810ee399>]
iterate_supers+0x6d/0xb2
May 25 15:04:51 aapi205 kernel: [ 9710.496447] [<ffffffff8110bc16>]
sys_sync+0x2a/0x57
May 25 15:04:51 aapi205 kernel: [ 9710.496451] [<ffffffff81002b02>]
system_call_fastpath+0x16/0x1b
May 25 15:04:51 aapi205 acpid: exiting
Cheers,
Piotr Hosowicz
--
Nie pytaj co rząd może zrobić dla ciebie. Pytaj, jak możesz temu zapobiec.
NP: Chickenfoot - Down The Drain
NB: 2.6.34-20100524-1752-patched
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 14:48 ` Piotr Hosowicz
@ 2010-05-25 16:15 ` Peter Zijlstra
2010-05-25 16:47 ` Piotr Hosowicz
0 siblings, 1 reply; 45+ messages in thread
From: Peter Zijlstra @ 2010-05-25 16:15 UTC (permalink / raw)
To: piotr; +Cc: Ingo Molnar, linux-kernel, Jens Axboe, Divyesh Shah, Andrew Morton
On Tue, 2010-05-25 at 16:48 +0200, Piotr Hosowicz wrote:
> May 25 15:04:35 aapi205 kernel: [ 9694.523288] BUG: using smp_processor_id() in preemptible [00000000] code: shutdown/16256
> May 25 15:04:35 aapi205 kernel: [ 9694.523296] caller is dqstats_inc+0x19/0x2c
> May 25 15:04:35 aapi205 kernel: [ 9694.523299] Pid: 16256, comm: shutdown Tainted: P W 2.6.34-20100524-1752-patched #1
> May 25 15:04:35 aapi205 kernel: [ 9694.523301] Call Trace:
> May 25 15:04:35 aapi205 kernel: [ 9694.523308] [<ffffffff811a537b>] debug_smp_processor_id+0xc7/0xe0
> May 25 15:04:35 aapi205 kernel: [ 9694.523311] [<ffffffff8112c0ad>] dqstats_inc+0x19/0x2c
> May 25 15:04:35 aapi205 kernel: [ 9694.523314] [<ffffffff8112ee66>] vfs_quota_sync+0x1b1/0x293
> May 25 15:04:35 aapi205 kernel: [ 9694.523319] [<ffffffff8103bf21>] ? wake_up_process+0x10/0x12
That's a different issue, see:
http://lkml.org/lkml/2010/5/22/164
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 16:15 ` Peter Zijlstra
@ 2010-05-25 16:47 ` Piotr Hosowicz
2010-05-26 2:06 ` Piotr Hosowicz
0 siblings, 1 reply; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-25 16:47 UTC (permalink / raw)
To: Peter Zijlstra
Cc: Ingo Molnar, linux-kernel, Jens Axboe, Divyesh Shah, Andrew Morton
On 25.05.2010 18:15, Peter Zijlstra wrote:
> On Tue, 2010-05-25 at 16:48 +0200, Piotr Hosowicz wrote:
>> May 25 15:04:35 aapi205 kernel: [ 9694.523288] BUG: using smp_processor_id() in preemptible [00000000] code: shutdown/16256
>> May 25 15:04:35 aapi205 kernel: [ 9694.523296] caller is dqstats_inc+0x19/0x2c
>> May 25 15:04:35 aapi205 kernel: [ 9694.523299] Pid: 16256, comm: shutdown Tainted: P W 2.6.34-20100524-1752-patched #1
>> May 25 15:04:35 aapi205 kernel: [ 9694.523301] Call Trace:
>> May 25 15:04:35 aapi205 kernel: [ 9694.523308] [<ffffffff811a537b>] debug_smp_processor_id+0xc7/0xe0
>> May 25 15:04:35 aapi205 kernel: [ 9694.523311] [<ffffffff8112c0ad>] dqstats_inc+0x19/0x2c
>> May 25 15:04:35 aapi205 kernel: [ 9694.523314] [<ffffffff8112ee66>] vfs_quota_sync+0x1b1/0x293
>> May 25 15:04:35 aapi205 kernel: [ 9694.523319] [<ffffffff8103bf21>] ? wake_up_process+0x10/0x12
>
> That's a different issue, see:
>
> http://lkml.org/lkml/2010/5/22/164
I do not understand fully - does that mean I have to revert commit
a7cf4145b? And how to do it? Let's assume I git-pulled the source. What
should be next steps.
Regards and thanks,
Piotr Hosowicz
--
Nie pytaj co rząd może zrobić dla ciebie. Pytaj, jak możesz temu zapobiec.
NP: Black Stone Cherry - Reverend Wrinkle
NB: 2.6.34-20100524-1752-patched
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 8:50 ` Peter Zijlstra
2010-05-25 9:42 ` Piotr Hosowicz
2010-05-25 9:43 ` Ingo Molnar
@ 2010-05-25 18:07 ` Divyesh Shah
2010-05-25 18:15 ` Piotr Hosowicz
2010-05-25 21:35 ` Peter Zijlstra
2010-05-26 23:02 ` Andrew Morton
2010-06-01 6:41 ` BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449 Ingo Molnar
4 siblings, 2 replies; 45+ messages in thread
From: Divyesh Shah @ 2010-05-25 18:07 UTC (permalink / raw)
To: Peter Zijlstra; +Cc: piotr, linux-kernel, Jens Axboe
On Tue, May 25, 2010 at 1:50 AM, Peter Zijlstra <peterz@infradead.org> wrote:
> On Mon, 2010-05-24 at 05:03 +0200, Piotr Hosowicz wrote:
>> [ 720.313607] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
>> [ 720.313612] caller is native_sched_clock+0x3c/0x68
>> [ 720.313616] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
>> [ 720.313618] Call Trace:
>> [ 720.313624] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
>> [ 720.313629] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
>> [ 720.313634] [<ffffffff81009a4d>] sched_clock+0x9/0xd
>> [ 720.313637] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
>> [ 720.313641] [<ffffffff81184227>] get_request+0x1bf/0x2c7
>> [ 720.313646] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
>
> This comes from wreckage in the blk tree..
>
> ---
> commit 9195291e5f05e01d67f9a09c756b8aca8f009089
> Author: Divyesh Shah <dpshah@google.com>
> Date: Thu Apr 1 15:01:41 2010 -0700
>
> blkio: Increment the blkio cgroup stats for real now
>
> We also add start_time_ns and io_start_time_ns fields to struct request
> here to record the time when a request is created and when it is
> dispatched to device. We use ns uints here as ms and jiffies are
> not very useful for non-rotational media.
>
> Signed-off-by: Divyesh Shah<dpshah@google.com>
> Signed-off-by: Jens Axboe <jens.axboe@oracle.com>
> ---
>
> +#ifdef CONFIG_BLK_CGROUP
> +static inline void set_start_time_ns(struct request *req)
> +{
> + req->start_time_ns = sched_clock();
> +}
> +
> +static inline void set_io_start_time_ns(struct request *req)
> +{
> + req->io_start_time_ns = sched_clock();
> +}
> +#else
> +static inline void set_start_time_ns(struct request *req) {}
> +static inline void set_io_start_time_ns(struct request *req) {}
> +#endif
>
> ---
>
> Clearly nobody tested this, and its terribly broken to boot.
@Piotr, do you have kernel pre-emption enabled?
@Peter, I did test the change and its been running on our systems for
a while now but we have pre-emption disabled. I'm not sure if a
pre-emptive kernel is what tickled this, but if it is then we know
where the lapse in testing was. Either way, apologies for the
breakage.
Peter, this only affects some stats collection and no scheduling
behavior should be affected by this. Besides this call at rq_init() to
sched_clock() there are other calls in the request dispatch and the
request completion path. Not sure if those are problematic too.
@Ingo, about your concern of time going backwards. This could happen
with sched_clock() as well when successive measurements were made on
different cpus which are slightly out of sync. This case is handled
well in all places where this was used.
>
> I guess they want something like:
>
> ---
> Subject: sched_clock: Add local_clock()
> From: Peter Zijlstra <a.p.zijlstra@chello.nl>
> Date: Tue May 25 10:48:51 CEST 2010
>
> For people who otherwise get to write: cpu_clock(smp_processor_id()),
> there is now: local_clock().
>
> Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl>
> LKML-Reference: <new-submission>
> ---
> Index: linux-2.6/arch/parisc/kernel/ftrace.c
> ===================================================================
> --- linux-2.6.orig/arch/parisc/kernel/ftrace.c
> +++ linux-2.6/arch/parisc/kernel/ftrace.c
> @@ -82,7 +82,7 @@ unsigned long ftrace_return_to_handler(u
> unsigned long ret;
>
> pop_return_trace(&trace, &ret);
> - trace.rettime = cpu_clock(raw_smp_processor_id());
> + trace.rettime = local_clock();
> ftrace_graph_return(&trace);
>
> if (unlikely(!ret)) {
> @@ -126,7 +126,7 @@ void prepare_ftrace_return(unsigned long
> return;
> }
>
> - calltime = cpu_clock(raw_smp_processor_id());
> + calltime = local_clock();
>
> if (push_return_trace(old, calltime,
> self_addr, &trace.depth) == -EBUSY) {
> Index: linux-2.6/include/linux/blkdev.h
> ===================================================================
> --- linux-2.6.orig/include/linux/blkdev.h
> +++ linux-2.6/include/linux/blkdev.h
> @@ -1213,12 +1213,12 @@ int kblockd_schedule_work(struct request
> #ifdef CONFIG_BLK_CGROUP
> static inline void set_start_time_ns(struct request *req)
> {
> - req->start_time_ns = sched_clock();
> + req->start_time_ns = local_clock();
> }
>
> static inline void set_io_start_time_ns(struct request *req)
> {
> - req->io_start_time_ns = sched_clock();
> + req->io_start_time_ns = local_clock();
> }
>
> static inline uint64_t rq_start_time_ns(struct request *req)
> Index: linux-2.6/include/linux/sched.h
> ===================================================================
> --- linux-2.6.orig/include/linux/sched.h
> +++ linux-2.6/include/linux/sched.h
> @@ -1822,6 +1822,7 @@ extern void sched_clock_idle_wakeup_even
> * clock constructed from sched_clock():
> */
> extern unsigned long long cpu_clock(int cpu);
> +extern unsigned long long local_clock(void);
>
> extern unsigned long long
> task_sched_runtime(struct task_struct *task);
> Index: linux-2.6/kernel/lockdep.c
> ===================================================================
> --- linux-2.6.orig/kernel/lockdep.c
> +++ linux-2.6/kernel/lockdep.c
> @@ -146,7 +146,7 @@ static DEFINE_PER_CPU(struct lock_class_
>
> static inline u64 lockstat_clock(void)
> {
> - return cpu_clock(smp_processor_id());
> + return local_clock();
> }
>
> static int lock_point(unsigned long points[], unsigned long ip)
> Index: linux-2.6/kernel/perf_event.c
> ===================================================================
> --- linux-2.6.orig/kernel/perf_event.c
> +++ linux-2.6/kernel/perf_event.c
> @@ -214,7 +214,7 @@ static void perf_unpin_context(struct pe
>
> static inline u64 perf_clock(void)
> {
> - return cpu_clock(raw_smp_processor_id());
> + return local_clock();
> }
>
> /*
> Index: linux-2.6/kernel/rcutorture.c
> ===================================================================
> --- linux-2.6.orig/kernel/rcutorture.c
> +++ linux-2.6/kernel/rcutorture.c
> @@ -239,8 +239,7 @@ static unsigned long
> rcu_random(struct rcu_random_state *rrsp)
> {
> if (--rrsp->rrs_count < 0) {
> - rrsp->rrs_state +=
> - (unsigned long)cpu_clock(raw_smp_processor_id());
> + rrsp->rrs_state += (unsigned long)local_clock();
> rrsp->rrs_count = RCU_RANDOM_REFRESH;
> }
> rrsp->rrs_state = rrsp->rrs_state * RCU_RANDOM_MULT + RCU_RANDOM_ADD;
> Index: linux-2.6/kernel/sched.c
> ===================================================================
> --- linux-2.6.orig/kernel/sched.c
> +++ linux-2.6/kernel/sched.c
> @@ -1670,7 +1670,7 @@ static void update_shares(struct sched_d
> if (root_task_group_empty())
> return;
>
> - now = cpu_clock(raw_smp_processor_id());
> + now = local_clock();
> elapsed = now - sd->last_update;
>
> if (elapsed >= (s64)(u64)sysctl_sched_shares_ratelimit) {
> Index: linux-2.6/kernel/sched_clock.c
> ===================================================================
> --- linux-2.6.orig/kernel/sched_clock.c
> +++ linux-2.6/kernel/sched_clock.c
> @@ -249,6 +249,18 @@ unsigned long long cpu_clock(int cpu)
> return clock;
> }
>
> +unsigned long long local_clock(void)
> +{
> + unsigned long long clock;
> + unsigned long flags;
> +
> + local_irq_save(flags);
> + clock = sched_clock_cpu(smp_processor_id());
> + local_irq_restore(flags);
> +
> + return clock;
> +}
> +
> #else /* CONFIG_HAVE_UNSTABLE_SCHED_CLOCK */
>
> void sched_clock_init(void)
> @@ -264,12 +276,17 @@ u64 sched_clock_cpu(int cpu)
> return sched_clock();
> }
>
> -
> unsigned long long cpu_clock(int cpu)
> {
> return sched_clock_cpu(cpu);
> }
>
> +unsigned long long local_clock(void)
> +{
> + return sched_clock_cpu(0);
> +}
> +
> #endif /* CONFIG_HAVE_UNSTABLE_SCHED_CLOCK */
>
> EXPORT_SYMBOL_GPL(cpu_clock);
> +EXPORT_SYMBOL_GPL(local_clock);
> Index: linux-2.6/kernel/trace/trace_clock.c
> ===================================================================
> --- linux-2.6.orig/kernel/trace/trace_clock.c
> +++ linux-2.6/kernel/trace/trace_clock.c
> @@ -56,7 +56,7 @@ u64 notrace trace_clock_local(void)
> */
> u64 notrace trace_clock(void)
> {
> - return cpu_clock(raw_smp_processor_id());
> + return local_clock();
> }
>
>
>
>
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 18:07 ` Divyesh Shah
@ 2010-05-25 18:15 ` Piotr Hosowicz
2010-05-25 21:35 ` Peter Zijlstra
1 sibling, 0 replies; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-25 18:15 UTC (permalink / raw)
To: Divyesh Shah; +Cc: Peter Zijlstra, linux-kernel, Jens Axboe
On 25.05.2010 20:07, Divyesh Shah wrote:
> On Tue, May 25, 2010 at 1:50 AM, Peter Zijlstra<peterz@infradead.org> wrote:
>> On Mon, 2010-05-24 at 05:03 +0200, Piotr Hosowicz wrote:
>>> [ 720.313607] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
>>> [ 720.313612] caller is native_sched_clock+0x3c/0x68
>>> [ 720.313616] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
>>> [ 720.313618] Call Trace:
>>> [ 720.313624] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
>>> [ 720.313629] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
>>> [ 720.313634] [<ffffffff81009a4d>] sched_clock+0x9/0xd
>>> [ 720.313637] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
>>> [ 720.313641] [<ffffffff81184227>] get_request+0x1bf/0x2c7
>>> [ 720.313646] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
>>
>> This comes from wreckage in the blk tree..
>>
>> ---
>> commit 9195291e5f05e01d67f9a09c756b8aca8f009089
>> Author: Divyesh Shah<dpshah@google.com>
>> Date: Thu Apr 1 15:01:41 2010 -0700
>>
>> blkio: Increment the blkio cgroup stats for real now
>>
>> We also add start_time_ns and io_start_time_ns fields to struct request
>> here to record the time when a request is created and when it is
>> dispatched to device. We use ns uints here as ms and jiffies are
>> not very useful for non-rotational media.
>>
>> Signed-off-by: Divyesh Shah<dpshah@google.com>
>> Signed-off-by: Jens Axboe<jens.axboe@oracle.com>
>> ---
>>
>> +#ifdef CONFIG_BLK_CGROUP
>> +static inline void set_start_time_ns(struct request *req)
>> +{
>> + req->start_time_ns = sched_clock();
>> +}
>> +
>> +static inline void set_io_start_time_ns(struct request *req)
>> +{
>> + req->io_start_time_ns = sched_clock();
>> +}
>> +#else
>> +static inline void set_start_time_ns(struct request *req) {}
>> +static inline void set_io_start_time_ns(struct request *req) {}
>> +#endif
>>
>> ---
>>
>> Clearly nobody tested this, and its terribly broken to boot.
>
> @Piotr, do you have kernel pre-emption enabled?
Yes.
Regards,
Piotr Hosowicz
--
Janusz Korwin-Mikke:
"Dyktatury dzielą się na dobre i złe. Demokracja jest zawsze głupia."
NP: -
NB: 2.6.34-20100525-1754-patched
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 18:07 ` Divyesh Shah
2010-05-25 18:15 ` Piotr Hosowicz
@ 2010-05-25 21:35 ` Peter Zijlstra
1 sibling, 0 replies; 45+ messages in thread
From: Peter Zijlstra @ 2010-05-25 21:35 UTC (permalink / raw)
To: Divyesh Shah; +Cc: piotr, linux-kernel, Jens Axboe
On Tue, 2010-05-25 at 11:07 -0700, Divyesh Shah wrote:
> Peter, this only affects some stats collection and no scheduling
> behavior should be affected by this. Besides this call at rq_init() to
> sched_clock() there are other calls in the request dispatch and the
> request completion path. Not sure if those are problematic too.
>
> @Ingo, about your concern of time going backwards. This could happen
> with sched_clock() as well when successive measurements were made on
> different cpus which are slightly out of sync. This case is handled
> well in all places where this was used.
You really shouldn't be using sched_clock(), that thing can exhibit
unbounded drift between cpus.
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 16:47 ` Piotr Hosowicz
@ 2010-05-26 2:06 ` Piotr Hosowicz
2010-05-26 2:51 ` Piotr Hosowicz
0 siblings, 1 reply; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-26 2:06 UTC (permalink / raw)
To: piotr
Cc: Peter Zijlstra, Ingo Molnar, linux-kernel, Jens Axboe,
Divyesh Shah, Andrew Morton
On 25.05.2010 18:47, Piotr Hosowicz wrote:
> On 25.05.2010 18:15, Peter Zijlstra wrote:
>> On Tue, 2010-05-25 at 16:48 +0200, Piotr Hosowicz wrote:
>>> May 25 15:04:35 aapi205 kernel: [ 9694.523288] BUG: using
>>> smp_processor_id() in preemptible [00000000] code: shutdown/16256
>>> May 25 15:04:35 aapi205 kernel: [ 9694.523296] caller is
>>> dqstats_inc+0x19/0x2c
>>> May 25 15:04:35 aapi205 kernel: [ 9694.523299] Pid: 16256, comm:
>>> shutdown Tainted: P W 2.6.34-20100524-1752-patched #1
>>> May 25 15:04:35 aapi205 kernel: [ 9694.523301] Call Trace:
>>> May 25 15:04:35 aapi205 kernel: [ 9694.523308] [<ffffffff811a537b>]
>>> debug_smp_processor_id+0xc7/0xe0
>>> May 25 15:04:35 aapi205 kernel: [ 9694.523311] [<ffffffff8112c0ad>]
>>> dqstats_inc+0x19/0x2c
>>> May 25 15:04:35 aapi205 kernel: [ 9694.523314] [<ffffffff8112ee66>]
>>> vfs_quota_sync+0x1b1/0x293
>>> May 25 15:04:35 aapi205 kernel: [ 9694.523319] [<ffffffff8103bf21>] ?
>>> wake_up_process+0x10/0x12
>>
>> That's a different issue, see:
>>
>> http://lkml.org/lkml/2010/5/22/164
>
> I do not understand fully - does that mean I have to revert commit
> a7cf4145b? And how to do it? Let's assume I git-pulled the source. What
> should be next steps.
Ok, my fault, now I know how to revert. But I still do not know if this
is the right solution you meant. In the meantime I build the kernel
after revert.
Regards and sorry for the noise.
Piotr Hosowicz
--
> Jeden z powodów, dla których KRK nie był skłonny do
> oddawania Biblii w ręce pospólstwa. Po rozmowie z
> Jehowitami często można zrozumieć, dlaczego.
Tak. Ja na przykład zrozumiałem że Jan Chrzciciel był
kolejarzem - bo: "z kolei udał się nad Jordan".
NP: Patrick O'Hearn - Magnificent River
NB: 2.6.34-20100525-1754-patched
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-26 2:06 ` Piotr Hosowicz
@ 2010-05-26 2:51 ` Piotr Hosowicz
0 siblings, 0 replies; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-26 2:51 UTC (permalink / raw)
To: piotr
Cc: Peter Zijlstra, Ingo Molnar, linux-kernel, Jens Axboe,
Divyesh Shah, Andrew Morton
On 26.05.2010 04:06, Piotr Hosowicz wrote:
> On 25.05.2010 18:47, Piotr Hosowicz wrote:
>> On 25.05.2010 18:15, Peter Zijlstra wrote:
>>> On Tue, 2010-05-25 at 16:48 +0200, Piotr Hosowicz wrote:
>>>> May 25 15:04:35 aapi205 kernel: [ 9694.523288] BUG: using
>>>> smp_processor_id() in preemptible [00000000] code: shutdown/16256
>>>> May 25 15:04:35 aapi205 kernel: [ 9694.523296] caller is
>>>> dqstats_inc+0x19/0x2c
>>>> May 25 15:04:35 aapi205 kernel: [ 9694.523299] Pid: 16256, comm:
>>>> shutdown Tainted: P W 2.6.34-20100524-1752-patched #1
>>>> May 25 15:04:35 aapi205 kernel: [ 9694.523301] Call Trace:
>>>> May 25 15:04:35 aapi205 kernel: [ 9694.523308] [<ffffffff811a537b>]
>>>> debug_smp_processor_id+0xc7/0xe0
>>>> May 25 15:04:35 aapi205 kernel: [ 9694.523311] [<ffffffff8112c0ad>]
>>>> dqstats_inc+0x19/0x2c
>>>> May 25 15:04:35 aapi205 kernel: [ 9694.523314] [<ffffffff8112ee66>]
>>>> vfs_quota_sync+0x1b1/0x293
>>>> May 25 15:04:35 aapi205 kernel: [ 9694.523319] [<ffffffff8103bf21>] ?
>>>> wake_up_process+0x10/0x12
>>>
>>> That's a different issue, see:
>>>
>>> http://lkml.org/lkml/2010/5/22/164
>>
>> I do not understand fully - does that mean I have to revert commit
>> a7cf4145b? And how to do it? Let's assume I git-pulled the source. What
>> should be next steps.
>
> Ok, my fault, now I know how to revert. But I still do not know if this
> is the right solution you meant. In the meantime I build the kernel
> after revert.
Ok, I reverted the commit, built the kernel and rebooted - the problem
is still the same during shutdown.
Regards,
Piotr Hosowicz
--
- No wiesz, pijany i o trzeciej nad ranem wracasz do domu!?
- A kto powiedział, że wracam? Po gitarę tylko przyszedłem.
NP: Slash - Ghost (Feat. Ian Astbury)
NB: 2.6.34-20100526-0324-pchd-and-revtd
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 8:50 ` Peter Zijlstra
` (2 preceding siblings ...)
2010-05-25 18:07 ` Divyesh Shah
@ 2010-05-26 23:02 ` Andrew Morton
2010-05-27 6:46 ` Peter Zijlstra
2010-06-01 6:41 ` BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449 Ingo Molnar
4 siblings, 1 reply; 45+ messages in thread
From: Andrew Morton @ 2010-05-26 23:02 UTC (permalink / raw)
To: Peter Zijlstra; +Cc: piotr, linux-kernel, Jens Axboe, Divyesh Shah
On Tue, 25 May 2010 10:50:22 +0200
Peter Zijlstra <peterz@infradead.org> wrote:
> On Mon, 2010-05-24 at 05:03 +0200, Piotr Hosowicz wrote:
> > [ 720.313607] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
> > [ 720.313612] caller is native_sched_clock+0x3c/0x68
> > [ 720.313616] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
> > [ 720.313618] Call Trace:
> > [ 720.313624] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
> > [ 720.313629] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
> > [ 720.313634] [<ffffffff81009a4d>] sched_clock+0x9/0xd
> > [ 720.313637] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
> > [ 720.313641] [<ffffffff81184227>] get_request+0x1bf/0x2c7
> > [ 720.313646] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
>
> This comes from wreckage in the blk tree..
>
>
>
>
> +unsigned long long local_clock(void)
> +{
> + unsigned long long clock;
> + unsigned long flags;
> +
> + local_irq_save(flags);
> + clock = sched_clock_cpu(smp_processor_id());
> + local_irq_restore(flags);
> +
> + return clock;
> +}
> +
NAK NAK NAK NAK! QAK! HAK! Crap code! Stop adding undocumented
interfaces. Just stop it. Now. Geeze.
How is anyone supposed to use this? What are the semantics of this
thing? What are the units of its return value? What is the base value
of its return value? Does it return different times on different CPUs?
I assume so, otherwise why does sched_clock_cpu() exist? <looks at
the sched_clock_cpu() documentation, collapses in giggles>
Because if it does return different times on different CPUs then any
and all of the sites which use it are going to need to cope with
time-going-backwards and I'm not at all confident that they get this
right.
Also, all these interfaces use a random mixture of `u64' and `unsigned
long long', but that's a far less serious problem.
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-26 23:02 ` Andrew Morton
@ 2010-05-27 6:46 ` Peter Zijlstra
2010-05-27 6:51 ` Andrew Morton
0 siblings, 1 reply; 45+ messages in thread
From: Peter Zijlstra @ 2010-05-27 6:46 UTC (permalink / raw)
To: Andrew Morton; +Cc: piotr, linux-kernel, Jens Axboe, Divyesh Shah
On Wed, 2010-05-26 at 16:02 -0700, Andrew Morton wrote:
> How is anyone supposed to use this? What are the semantics of this
> thing? What are the units of its return value? What is the base value
> of its return value? Does it return different times on different CPUs?
> I assume so, otherwise why does sched_clock_cpu() exist? <looks at
> the sched_clock_cpu() documentation, collapses in giggles>
The point of the whole sched_clock_cpu() thing is to provide a fairly
high resolution clock with bounded drift between cpus.
It also promises to be monotonic per cpu argument, that is,
sched_clock_cpu(j) will, for a constant j always return a monotonic
increasing timestamp.
It doesn't make much promises about its base (although people tend to
want it to start at 0 on boot, but the users really shouldn't care).
sched_clock() doesn't promise either bounded drift between cpus nor
monotonicity.
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-27 6:46 ` Peter Zijlstra
@ 2010-05-27 6:51 ` Andrew Morton
[not found] ` <1274945751.27810.3765.camel@twins>
0 siblings, 1 reply; 45+ messages in thread
From: Andrew Morton @ 2010-05-27 6:51 UTC (permalink / raw)
To: Peter Zijlstra; +Cc: piotr, linux-kernel, Jens Axboe, Divyesh Shah
On Thu, 27 May 2010 08:46:38 +0200 Peter Zijlstra <peterz@infradead.org> wrote:
> On Wed, 2010-05-26 at 16:02 -0700, Andrew Morton wrote:
>
> > How is anyone supposed to use this? What are the semantics of this
> > thing? What are the units of its return value? What is the base value
> > of its return value? Does it return different times on different CPUs?
> > I assume so, otherwise why does sched_clock_cpu() exist? <looks at
> > the sched_clock_cpu() documentation, collapses in giggles>
>
> The point of the whole sched_clock_cpu() thing is to provide a fairly
> high resolution clock with bounded drift between cpus.
>
> It also promises to be monotonic per cpu argument, that is,
> sched_clock_cpu(j) will, for a constant j always return a monotonic
> increasing timestamp.
>
> It doesn't make much promises about its base (although people tend to
> want it to start at 0 on boot, but the users really shouldn't care).
>
> sched_clock() doesn't promise either bounded drift between cpus nor
> monotonicity.
>
OK, well please document these subtleties things in a very obvious place.
Right now the code is a landmine. Some poor innocent drivers/foo/
developer can use them and add fantastically subtle
once-per-million-machine-year lockup-causing bugs which he'll never be
able to diagnose.
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: [PATCH] sched_clock: Provide local_clock() and improve documentation
[not found] ` <20100527113340.d4afb8fc.akpm@linux-foundation.org>
@ 2010-05-28 13:13 ` Peter Zijlstra
2010-05-28 13:42 ` Johannes Stezenbach
` (3 more replies)
0 siblings, 4 replies; 45+ messages in thread
From: Peter Zijlstra @ 2010-05-28 13:13 UTC (permalink / raw)
To: Andrew Morton; +Cc: Jens Axboe, Divyesh Shah, Ingo Molnar, LKML
On Thu, 2010-05-27 at 11:33 -0700, Andrew Morton wrote:
> Cool, thanks. You didn't Cc a mailing list :(
Oops, must have managed to wreck the CC list somewhere, restored LKML.
How does the below look?
---
Subject: sched_clock: Add local_clock() and improve documentation
From: Peter Zijlstra <a.p.zijlstra@chello.nl>
Date: Tue May 25 10:48:51 CEST 2010
For people who otherwise get to write: cpu_clock(smp_processor_id()),
there is now: local_clock().
Also, as per suggestion from Andrew, provide some documentation on
the various clock interfaces, and minimize the unsigned long long vs
u64 mess.
Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl>
---
arch/parisc/kernel/ftrace.c | 4 -
include/linux/sched.h | 37 +++++++++--------
kernel/lockdep.c | 2
kernel/perf_event.c | 2
kernel/rcutorture.c | 3 -
kernel/sched.c | 2
kernel/sched_clock.c | 95 +++++++++++++++++++++++++++++++++++++++-----
kernel/trace/trace_clock.c | 2
8 files changed, 113 insertions(+), 34 deletions(-)
Index: linux-2.6/arch/parisc/kernel/ftrace.c
===================================================================
--- linux-2.6.orig/arch/parisc/kernel/ftrace.c
+++ linux-2.6/arch/parisc/kernel/ftrace.c
@@ -82,7 +82,7 @@ unsigned long ftrace_return_to_handler(u
unsigned long ret;
pop_return_trace(&trace, &ret);
- trace.rettime = cpu_clock(raw_smp_processor_id());
+ trace.rettime = local_clock();
ftrace_graph_return(&trace);
if (unlikely(!ret)) {
@@ -126,7 +126,7 @@ void prepare_ftrace_return(unsigned long
return;
}
- calltime = cpu_clock(raw_smp_processor_id());
+ calltime = local_clock();
if (push_return_trace(old, calltime,
self_addr, &trace.depth) == -EBUSY) {
Index: linux-2.6/include/linux/sched.h
===================================================================
--- linux-2.6.orig/include/linux/sched.h
+++ linux-2.6/include/linux/sched.h
@@ -1785,20 +1785,23 @@ static inline int set_cpus_allowed(struc
#endif
/*
- * Architectures can set this to 1 if they have specified
- * CONFIG_HAVE_UNSTABLE_SCHED_CLOCK in their arch Kconfig,
- * but then during bootup it turns out that sched_clock()
- * is reliable after all:
+ * Do not use outside of architecture code which knows its limitations.
+ *
+ * sched_clock() has no promise of monotonicity or bounded drift between
+ * CPUs, use (which you should not) requires disabling IRQs.
+ *
+ * Please use one of the three interfaces below.
*/
-#ifdef CONFIG_HAVE_UNSTABLE_SCHED_CLOCK
-extern int sched_clock_stable;
-#endif
-
-/* ftrace calls sched_clock() directly */
extern unsigned long long notrace sched_clock(void);
+/*
+ * See the comment in kernel/sched_clock.c
+ */
+extern u64 cpu_clock(int cpu);
+extern u64 local_clock(void);
+extern u64 sched_clock_cpu(int cpu);
+
extern void sched_clock_init(void);
-extern u64 sched_clock_cpu(int cpu);
#ifndef CONFIG_HAVE_UNSTABLE_SCHED_CLOCK
static inline void sched_clock_tick(void)
@@ -1813,17 +1816,19 @@ static inline void sched_clock_idle_wake
{
}
#else
+/*
+ * Architectures can set this to 1 if they have specified
+ * CONFIG_HAVE_UNSTABLE_SCHED_CLOCK in their arch Kconfig,
+ * but then during bootup it turns out that sched_clock()
+ * is reliable after all:
+ */
+extern int sched_clock_stable;
+
extern void sched_clock_tick(void);
extern void sched_clock_idle_sleep_event(void);
extern void sched_clock_idle_wakeup_event(u64 delta_ns);
#endif
-/*
- * For kernel-internal use: high-speed (but slightly incorrect) per-cpu
- * clock constructed from sched_clock():
- */
-extern unsigned long long cpu_clock(int cpu);
-
extern unsigned long long
task_sched_runtime(struct task_struct *task);
extern unsigned long long thread_group_sched_runtime(struct task_struct *task);
Index: linux-2.6/kernel/lockdep.c
===================================================================
--- linux-2.6.orig/kernel/lockdep.c
+++ linux-2.6/kernel/lockdep.c
@@ -146,7 +146,7 @@ static DEFINE_PER_CPU(struct lock_class_
static inline u64 lockstat_clock(void)
{
- return cpu_clock(smp_processor_id());
+ return local_clock();
}
static int lock_point(unsigned long points[], unsigned long ip)
Index: linux-2.6/kernel/perf_event.c
===================================================================
--- linux-2.6.orig/kernel/perf_event.c
+++ linux-2.6/kernel/perf_event.c
@@ -214,7 +214,7 @@ static void perf_unpin_context(struct pe
static inline u64 perf_clock(void)
{
- return cpu_clock(raw_smp_processor_id());
+ return local_clock();
}
/*
Index: linux-2.6/kernel/rcutorture.c
===================================================================
--- linux-2.6.orig/kernel/rcutorture.c
+++ linux-2.6/kernel/rcutorture.c
@@ -239,8 +239,7 @@ static unsigned long
rcu_random(struct rcu_random_state *rrsp)
{
if (--rrsp->rrs_count < 0) {
- rrsp->rrs_state +=
- (unsigned long)cpu_clock(raw_smp_processor_id());
+ rrsp->rrs_state += (unsigned long)local_clock();
rrsp->rrs_count = RCU_RANDOM_REFRESH;
}
rrsp->rrs_state = rrsp->rrs_state * RCU_RANDOM_MULT + RCU_RANDOM_ADD;
Index: linux-2.6/kernel/sched.c
===================================================================
--- linux-2.6.orig/kernel/sched.c
+++ linux-2.6/kernel/sched.c
@@ -1671,7 +1671,7 @@ static void update_shares(struct sched_d
if (root_task_group_empty())
return;
- now = cpu_clock(raw_smp_processor_id());
+ now = local_clock();
elapsed = now - sd->last_update;
if (elapsed >= (s64)(u64)sysctl_sched_shares_ratelimit) {
Index: linux-2.6/kernel/sched_clock.c
===================================================================
--- linux-2.6.orig/kernel/sched_clock.c
+++ linux-2.6/kernel/sched_clock.c
@@ -10,19 +10,55 @@
* Ingo Molnar <mingo@redhat.com>
* Guillaume Chazarain <guichaz@gmail.com>
*
- * Create a semi stable clock from a mixture of other events, including:
- * - gtod
+ *
+ * What:
+ *
+ * cpu_clock(i) provides a fast (execution time) high resolution
+ * clock with bounded drift between CPUs. The value of cpu_clock(i)
+ * is monotonic for constant i. The timestamp returned is in nanoseconds.
+ *
+ * ************************* BIG FAT WARNING **************************
+ * * when comparing cpu_clock(i) to cpu_clock(j) for i != j, time can *
+ * * go backwards !! *
+ * ********************************************************************
+ *
+ * There is no strict promise about the base, although it tends to start
+ * at 0 on boot (but people really shouldn't rely on that).
+ *
+ * cpu_clock(i) -- can be used from any context, including NMI.
+ * sched_clock_cpu(i) -- must be used with local IRQs disabled (implied by NMI)
+ * local_clock() -- is cpu_clock() on the current cpu.
+ *
+ * How:
+ *
+ * The implementation either uses sched_clock() when
+ * !CONFIG_HAVE_UNSTABLE_SCHED_CLOCK, which means in that case the
+ * sched_clock() is assumed to provide these properties (mostly it means
+ * the architecture provides a globally synchronized highres time source).
+ *
+ * Otherwise it tries to create a semi stable clock from a mixture of other
+ * clocks, including:
+ *
+ * - GTOD (clock monotomic)
* - sched_clock()
* - explicit idle events
*
- * We use gtod as base and the unstable clock deltas. The deltas are filtered,
- * making it monotonic and keeping it within an expected window.
+ * We use GTOD as base and use sched_clock() deltas to improve resolution. The
+ * deltas are filtered to provide monotonicity and keeping it within an
+ * expected window.
*
* Furthermore, explicit sleep and wakeup hooks allow us to account for time
* that is otherwise invisible (TSC gets stopped).
*
- * The clock: sched_clock_cpu() is monotonic per cpu, and should be somewhat
- * consistent between cpus (never more than 2 jiffies difference).
+ *
+ * Notes:
+ *
+ * The !IRQ-safetly of sched_clock() and sched_clock_cpu() comes from things
+ * like cpufreq interrupts that can change the base clock (TSC) multiplier
+ * and cause funny jumps in time -- although the filtering provided by
+ * sched_clock_cpu() should mitigate serious artifacts we cannot rely on it
+ * in general since for !CONFIG_HAVE_UNSTABLE_SCHED_CLOCK we fully rely on
+ * sched_clock().
*/
#include <linux/spinlock.h>
#include <linux/hardirq.h>
@@ -170,6 +206,11 @@ again:
return val;
}
+/*
+ * Similar to cpu_clock(), but requires local IRQs to be disabled.
+ *
+ * See cpu_clock().
+ */
u64 sched_clock_cpu(int cpu)
{
struct sched_clock_data *scd;
@@ -237,9 +278,19 @@ void sched_clock_idle_wakeup_event(u64 d
}
EXPORT_SYMBOL_GPL(sched_clock_idle_wakeup_event);
-unsigned long long cpu_clock(int cpu)
+/*
+ * As outlined at the top, provides a fast, high resolution, nanosecond
+ * time source that is monotonic per cpu argument and has bounded drift
+ * between cpus.
+ *
+ * ************************* BIG FAT WARNING **************************
+ * * when comparing cpu_clock(i) to cpu_clock(j) for i != j, time can *
+ * * go backwards !! *
+ * ********************************************************************
+ */
+u64 cpu_clock(int cpu)
{
- unsigned long long clock;
+ u64 clock;
unsigned long flags;
local_irq_save(flags);
@@ -249,6 +300,25 @@ unsigned long long cpu_clock(int cpu)
return clock;
}
+/*
+ * Similar to cpu_clock() for the current cpu. Time will only be observed
+ * to be monotonic if care is taken to only compare timestampt taken on the
+ * same CPU.
+ *
+ * See cpu_clock().
+ */
+u64 local_clock(void)
+{
+ u64 clock;
+ unsigned long flags;
+
+ local_irq_save(flags);
+ clock = sched_clock_cpu(smp_processor_id());
+ local_irq_restore(flags);
+
+ return clock;
+}
+
#else /* CONFIG_HAVE_UNSTABLE_SCHED_CLOCK */
void sched_clock_init(void)
@@ -264,12 +334,17 @@ u64 sched_clock_cpu(int cpu)
return sched_clock();
}
-
-unsigned long long cpu_clock(int cpu)
+u64 cpu_clock(int cpu)
{
return sched_clock_cpu(cpu);
}
+u64 local_clock(void)
+{
+ return sched_clock_cpu(0);
+}
+
#endif /* CONFIG_HAVE_UNSTABLE_SCHED_CLOCK */
EXPORT_SYMBOL_GPL(cpu_clock);
+EXPORT_SYMBOL_GPL(local_clock);
Index: linux-2.6/kernel/trace/trace_clock.c
===================================================================
--- linux-2.6.orig/kernel/trace/trace_clock.c
+++ linux-2.6/kernel/trace/trace_clock.c
@@ -56,7 +56,7 @@ u64 notrace trace_clock_local(void)
*/
u64 notrace trace_clock(void)
{
- return cpu_clock(raw_smp_processor_id());
+ return local_clock();
}
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: [PATCH] sched_clock: Provide local_clock() and improve documentation
2010-05-28 13:13 ` [PATCH] sched_clock: Provide local_clock() and improve documentation Peter Zijlstra
@ 2010-05-28 13:42 ` Johannes Stezenbach
2010-05-28 15:08 ` Peter Zijlstra
2010-05-28 14:15 ` Piotr Hosowicz
` (2 subsequent siblings)
3 siblings, 1 reply; 45+ messages in thread
From: Johannes Stezenbach @ 2010-05-28 13:42 UTC (permalink / raw)
To: Peter Zijlstra; +Cc: Andrew Morton, Jens Axboe, Divyesh Shah, Ingo Molnar, LKML
On Fri, May 28, 2010 at 03:13:34PM +0200, Peter Zijlstra wrote:
> + * The !IRQ-safetly of sched_clock() and sched_clock_cpu() comes from things
typo ^
Thank you for adding documentation. I have one additional
question regarding wrapping of sched_clock(). I know it is
used for timestamps in ftrace and printk, so it's desirable
that it never wraps. But on several embedded systems
it wraps after a few hours. Bug or just a minor flaw?
If someone knows it would be nice to get that documented, too.
See also
http://lkml.org/lkml/2010/4/26/340
Johannes
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: [PATCH] sched_clock: Provide local_clock() and improve documentation
2010-05-28 13:13 ` [PATCH] sched_clock: Provide local_clock() and improve documentation Peter Zijlstra
2010-05-28 13:42 ` Johannes Stezenbach
@ 2010-05-28 14:15 ` Piotr Hosowicz
2010-05-28 14:22 ` Piotr Hosowicz
2010-05-28 18:11 ` Chad Talbott
2010-06-09 10:13 ` [tip:sched/core] sched_clock: Add local_clock() API " tip-bot for Peter Zijlstra
3 siblings, 1 reply; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-28 14:15 UTC (permalink / raw)
To: Peter Zijlstra
Cc: Andrew Morton, Jens Axboe, Divyesh Shah, Ingo Molnar, LKML,
Piotr Hosowicz
On 28.05.2010 15:13, Peter Zijlstra wrote:
> On Thu, 2010-05-27 at 11:33 -0700, Andrew Morton wrote:
>
>> Cool, thanks. You didn't Cc a mailing list :(
>
> Oops, must have managed to wreck the CC list somewhere, restored LKML.
>
> How does the below look?
Earlier someone (you? I didn't write down) has published such a patch:
f4b87dee9
Index: linux-2.6/arch/parisc/kernel/ftrace.c
===================================================================
--- linux-2.6.orig/arch/parisc/kernel/ftrace.c
+++ linux-2.6/arch/parisc/kernel/ftrace.c
@@ -82,7 +82,7 @@ unsigned long ftrace_return_to_handler(u
unsigned long ret;
pop_return_trace(&trace, &ret);
- trace.rettime = cpu_clock(raw_smp_processor_id());
+ trace.rettime = local_clock();
ftrace_graph_return(&trace);
if (unlikely(!ret)) {
@@ -126,7 +126,7 @@ void prepare_ftrace_return(unsigned long
return;
}
- calltime = cpu_clock(raw_smp_processor_id());
+ calltime = local_clock();
if (push_return_trace(old, calltime,
self_addr, &trace.depth) == -EBUSY) {
Index: linux-2.6/include/linux/blkdev.h
===================================================================
--- linux-2.6.orig/include/linux/blkdev.h
+++ linux-2.6/include/linux/blkdev.h
@@ -1213,12 +1213,12 @@ int kblockd_schedule_work(struct request
#ifdef CONFIG_BLK_CGROUP
static inline void set_start_time_ns(struct request *req)
{
- req->start_time_ns = sched_clock();
+ req->start_time_ns = local_clock();
}
static inline void set_io_start_time_ns(struct request *req)
{
- req->io_start_time_ns = sched_clock();
+ req->io_start_time_ns = local_clock();
}
static inline uint64_t rq_start_time_ns(struct request *req)
Index: linux-2.6/include/linux/sched.h
===================================================================
--- linux-2.6.orig/include/linux/sched.h
+++ linux-2.6/include/linux/sched.h
@@ -1822,6 +1822,7 @@ extern void sched_clock_idle_wakeup_even
* clock constructed from sched_clock():
*/
extern unsigned long long cpu_clock(int cpu);
+extern unsigned long long local_clock(void);
extern unsigned long long
task_sched_runtime(struct task_struct *task);
Index: linux-2.6/kernel/lockdep.c
===================================================================
--- linux-2.6.orig/kernel/lockdep.c
+++ linux-2.6/kernel/lockdep.c
@@ -146,7 +146,7 @@ static DEFINE_PER_CPU(struct lock_class_
static inline u64 lockstat_clock(void)
{
- return cpu_clock(smp_processor_id());
+ return local_clock();
}
static int lock_point(unsigned long points[], unsigned long ip)
Index: linux-2.6/kernel/perf_event.c
===================================================================
--- linux-2.6.orig/kernel/perf_event.c
+++ linux-2.6/kernel/perf_event.c
@@ -214,7 +214,7 @@ static void perf_unpin_context(struct pe
static inline u64 perf_clock(void)
{
- return cpu_clock(raw_smp_processor_id());
+ return local_clock();
}
/*
Index: linux-2.6/kernel/rcutorture.c
===================================================================
--- linux-2.6.orig/kernel/rcutorture.c
+++ linux-2.6/kernel/rcutorture.c
@@ -239,8 +239,7 @@ static unsigned long
rcu_random(struct rcu_random_state *rrsp)
{
if (--rrsp->rrs_count < 0) {
- rrsp->rrs_state +=
- (unsigned long)cpu_clock(raw_smp_processor_id());
+ rrsp->rrs_state += (unsigned long)local_clock();
rrsp->rrs_count = RCU_RANDOM_REFRESH;
}
rrsp->rrs_state = rrsp->rrs_state * RCU_RANDOM_MULT + RCU_RANDOM_ADD;
Index: linux-2.6/kernel/sched.c
===================================================================
--- linux-2.6.orig/kernel/sched.c
+++ linux-2.6/kernel/sched.c
@@ -1670,7 +1670,7 @@ static void update_shares(struct sched_d
if (root_task_group_empty())
return;
- now = cpu_clock(raw_smp_processor_id());
+ now = local_clock();
elapsed = now - sd->last_update;
if (elapsed >= (s64)(u64)sysctl_sched_shares_ratelimit) {
Index: linux-2.6/kernel/sched_clock.c
===================================================================
--- linux-2.6.orig/kernel/sched_clock.c
+++ linux-2.6/kernel/sched_clock.c
@@ -249,6 +249,18 @@ unsigned long long cpu_clock(int cpu)
return clock;
}
+unsigned long long local_clock(void)
+{
+ unsigned long long clock;
+ unsigned long flags;
+
+ local_irq_save(flags);
+ clock = sched_clock_cpu(smp_processor_id());
+ local_irq_restore(flags);
+
+ return clock;
+}
+
#else /* CONFIG_HAVE_UNSTABLE_SCHED_CLOCK */
void sched_clock_init(void)
@@ -264,12 +276,17 @@ u64 sched_clock_cpu(int cpu)
return sched_clock();
}
-
unsigned long long cpu_clock(int cpu)
{
return sched_clock_cpu(cpu);
}
+unsigned long long local_clock(void)
+{
+ return sched_clock_cpu(0);
+}
+
#endif /* CONFIG_HAVE_UNSTABLE_SCHED_CLOCK */
EXPORT_SYMBOL_GPL(cpu_clock);
+EXPORT_SYMBOL_GPL(local_clock);
Index: linux-2.6/kernel/trace/trace_clock.c
===================================================================
--- linux-2.6.orig/kernel/trace/trace_clock.c
+++ linux-2.6/kernel/trace/trace_clock.c
@@ -56,7 +56,7 @@ u64 notrace trace_clock_local(void)
*/
u64 notrace trace_clock(void)
{
- return cpu_clock(raw_smp_processor_id());
+ return local_clock();
}
Should I apply it first and then your today's patch or only the today's
patch?
Regards,
Piotr Hosowicz
--
Szef TVN24 do dziennikarzy: Kochani, przez dwa lata waliliśmy w obóz
rządzący. Tak dalej byc nie może. Jesteśmy telewizją niezależną i to
zobowiązuje. Teraz będziemy kopać w opozycję.
NP: Mark Knopfler - Hard Shoulder
NB: 2.6.34-20100527-2020-gitt-revtd
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: [PATCH] sched_clock: Provide local_clock() and improve documentation
2010-05-28 14:15 ` Piotr Hosowicz
@ 2010-05-28 14:22 ` Piotr Hosowicz
0 siblings, 0 replies; 45+ messages in thread
From: Piotr Hosowicz @ 2010-05-28 14:22 UTC (permalink / raw)
To: piotr
Cc: Peter Zijlstra, Andrew Morton, Jens Axboe, Divyesh Shah,
Ingo Molnar, LKML
On 28.05.2010 16:15, Piotr Hosowicz wrote:
> On 28.05.2010 15:13, Peter Zijlstra wrote:
>> On Thu, 2010-05-27 at 11:33 -0700, Andrew Morton wrote:
>>
>>> Cool, thanks. You didn't Cc a mailing list :(
>>
>> Oops, must have managed to wreck the CC list somewhere, restored LKML.
>>
>> How does the below look?
>
> Earlier someone (you? I didn't write down) has published such a patch:
(cut patch)
> Should I apply it first and then your today's patch or only the today's
> patch?
Sorry, no question, today's patch must have been incorporated in the git
repo, I see it fails to apply again. And the earlier one also.
But what about commit f4b87dee9 - should I revert it before build?
Regards and sorry for the noise.
Piotr Hosowicz
--
- No wiesz, pijany i o trzeciej nad ranem wracasz do domu!?
- A kto powiedział, że wracam? Po gitarę tylko przyszedłem.
NP: Mark Knopfler - Before Gas & TV
NB: 2.6.34-20100527-2020-gitt-revtd
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: [PATCH] sched_clock: Provide local_clock() and improve documentation
2010-05-28 13:42 ` Johannes Stezenbach
@ 2010-05-28 15:08 ` Peter Zijlstra
0 siblings, 0 replies; 45+ messages in thread
From: Peter Zijlstra @ 2010-05-28 15:08 UTC (permalink / raw)
To: Johannes Stezenbach
Cc: Andrew Morton, Jens Axboe, Divyesh Shah, Ingo Molnar, LKML
On Fri, 2010-05-28 at 15:42 +0200, Johannes Stezenbach wrote:
> On Fri, May 28, 2010 at 03:13:34PM +0200, Peter Zijlstra wrote:
> > + * The !IRQ-safetly of sched_clock() and sched_clock_cpu() comes from things
>
> typo ^
>
> Thank you for adding documentation. I have one additional
> question regarding wrapping of sched_clock(). I know it is
> used for timestamps in ftrace and printk, so it's desirable
> that it never wraps. But on several embedded systems
> it wraps after a few hours. Bug or just a minor flaw?
> If someone knows it would be nice to get that documented, too.
The scheduler assumes it wraps at u64, however since we mostly use it to
compute a time deltas it mostly works, even when it wraps sooner, its
just that we get large jumps once in a while when it does wraps, due to
(s64)(new - old) not ending up being a proper s64.
If you have CONFIG_HAVE_UNSTABLE_SCHED_CLOCK, these jumps will be
filtered out and polished over.
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: [PATCH] sched_clock: Provide local_clock() and improve documentation
2010-05-28 13:13 ` [PATCH] sched_clock: Provide local_clock() and improve documentation Peter Zijlstra
2010-05-28 13:42 ` Johannes Stezenbach
2010-05-28 14:15 ` Piotr Hosowicz
@ 2010-05-28 18:11 ` Chad Talbott
2010-05-28 18:22 ` Peter Zijlstra
2010-06-09 10:13 ` [tip:sched/core] sched_clock: Add local_clock() API " tip-bot for Peter Zijlstra
3 siblings, 1 reply; 45+ messages in thread
From: Chad Talbott @ 2010-05-28 18:11 UTC (permalink / raw)
To: Peter Zijlstra; +Cc: Andrew Morton, Jens Axboe, Divyesh Shah, Ingo Molnar, LKML
On Fri, May 28, 2010 at 6:13 AM, Peter Zijlstra <peterz@infradead.org> wrote:
> + * local_clock() -- is cpu_clock() on the current cpu.
Pretty sure this should read, "is cpu_clock() on *some* cpu," since
there is no guarantee in a preemptible kernel that local_clock()
returns on the same CPU that it was called from. The caller has to do
the preempt protection itself.
The function could be written as follows (thanks Salman Qazi):
u64 local_clock(unsigned int *where)
{
u64 clock;
unsigned long flags;
local_irq_save(flags);
*where = smp_processor_id();
clock = sched_clock_cpu(*where);
local_irq_restore(flags);
return clock;
}
but I don't see the utility of the resulting routine.
Chad
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: [PATCH] sched_clock: Provide local_clock() and improve documentation
2010-05-28 18:11 ` Chad Talbott
@ 2010-05-28 18:22 ` Peter Zijlstra
0 siblings, 0 replies; 45+ messages in thread
From: Peter Zijlstra @ 2010-05-28 18:22 UTC (permalink / raw)
To: Chad Talbott; +Cc: Andrew Morton, Jens Axboe, Divyesh Shah, Ingo Molnar, LKML
On Fri, 2010-05-28 at 11:11 -0700, Chad Talbott wrote:
> On Fri, May 28, 2010 at 6:13 AM, Peter Zijlstra <peterz@infradead.org> wrote:
> > + * local_clock() -- is cpu_clock() on the current cpu.
>
> Pretty sure this should read, "is cpu_clock() on *some* cpu," since
> there is no guarantee in a preemptible kernel that local_clock()
> returns on the same CPU that it was called from. The caller has to do
> the preempt protection itself.
Current cpu simply has no meaning if preemption isn't disabled. If it
is, it has and the result is useful.
Some of the local_clock() users are strictly per-cpu (and clearly have
preemption disabled), for some there simply is no better clock and
simply cope with the small incoherency in time.
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-05-25 8:50 ` Peter Zijlstra
` (3 preceding siblings ...)
2010-05-26 23:02 ` Andrew Morton
@ 2010-06-01 6:41 ` Ingo Molnar
2010-06-01 6:47 ` Jens Axboe
4 siblings, 1 reply; 45+ messages in thread
From: Ingo Molnar @ 2010-06-01 6:41 UTC (permalink / raw)
To: Peter Zijlstra, Jens Axboe; +Cc: piotr, linux-kernel, Divyesh Shah
* Peter Zijlstra <peterz@infradead.org> wrote:
> On Mon, 2010-05-24 at 05:03 +0200, Piotr Hosowicz wrote:
> > [ 720.313607] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
> > [ 720.313612] caller is native_sched_clock+0x3c/0x68
> > [ 720.313616] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
> > [ 720.313618] Call Trace:
> > [ 720.313624] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
> > [ 720.313629] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
> > [ 720.313634] [<ffffffff81009a4d>] sched_clock+0x9/0xd
> > [ 720.313637] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
> > [ 720.313641] [<ffffffff81184227>] get_request+0x1bf/0x2c7
> > [ 720.313646] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
>
> This comes from wreckage in the blk tree..
>
> ---
> commit 9195291e5f05e01d67f9a09c756b8aca8f009089
> Author: Divyesh Shah <dpshah@google.com>
> Date: Thu Apr 1 15:01:41 2010 -0700
>
> blkio: Increment the blkio cgroup stats for real now
Jens, this regression is still in .35-rc1 and triggers in about 25% of all
-tip boot tests.
The above commit is using sched_clock() in an unsafe way - please fix it or
revert it.
The local_clock() changes PeterZ is working on are still WIP, it's not sure
we'll have it before .36.
Thanks,
Ingo
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-06-01 6:41 ` BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449 Ingo Molnar
@ 2010-06-01 6:47 ` Jens Axboe
2010-06-01 6:55 ` Ingo Molnar
0 siblings, 1 reply; 45+ messages in thread
From: Jens Axboe @ 2010-06-01 6:47 UTC (permalink / raw)
To: Ingo Molnar; +Cc: Peter Zijlstra, piotr, linux-kernel, Divyesh Shah
On Tue, Jun 01 2010, Ingo Molnar wrote:
>
> * Peter Zijlstra <peterz@infradead.org> wrote:
>
> > On Mon, 2010-05-24 at 05:03 +0200, Piotr Hosowicz wrote:
> > > [ 720.313607] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
> > > [ 720.313612] caller is native_sched_clock+0x3c/0x68
> > > [ 720.313616] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
> > > [ 720.313618] Call Trace:
> > > [ 720.313624] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
> > > [ 720.313629] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
> > > [ 720.313634] [<ffffffff81009a4d>] sched_clock+0x9/0xd
> > > [ 720.313637] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
> > > [ 720.313641] [<ffffffff81184227>] get_request+0x1bf/0x2c7
> > > [ 720.313646] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
> >
> > This comes from wreckage in the blk tree..
> >
> > ---
> > commit 9195291e5f05e01d67f9a09c756b8aca8f009089
> > Author: Divyesh Shah <dpshah@google.com>
> > Date: Thu Apr 1 15:01:41 2010 -0700
> >
> > blkio: Increment the blkio cgroup stats for real now
>
> Jens, this regression is still in .35-rc1 and triggers in about 25% of all
> -tip boot tests.
>
> The above commit is using sched_clock() in an unsafe way - please fix it or
> revert it.
>
> The local_clock() changes PeterZ is working on are still WIP, it's not sure
> we'll have it before .36.
OK, I guess we'll have to solve this differently for .35 - I'll cook up
something simple, if need be revert the change.
--
Jens Axboe
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-06-01 6:47 ` Jens Axboe
@ 2010-06-01 6:55 ` Ingo Molnar
2010-06-01 7:53 ` Jens Axboe
2010-06-02 11:16 ` blkiocg_update_io_add_stats(): INFO: trying to register non-static key Ingo Molnar
0 siblings, 2 replies; 45+ messages in thread
From: Ingo Molnar @ 2010-06-01 6:55 UTC (permalink / raw)
To: Jens Axboe; +Cc: Peter Zijlstra, piotr, linux-kernel, Divyesh Shah
* Jens Axboe <axboe@kernel.dk> wrote:
> On Tue, Jun 01 2010, Ingo Molnar wrote:
> >
> > * Peter Zijlstra <peterz@infradead.org> wrote:
> >
> > > On Mon, 2010-05-24 at 05:03 +0200, Piotr Hosowicz wrote:
> > > > [ 720.313607] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
> > > > [ 720.313612] caller is native_sched_clock+0x3c/0x68
> > > > [ 720.313616] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
> > > > [ 720.313618] Call Trace:
> > > > [ 720.313624] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
> > > > [ 720.313629] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
> > > > [ 720.313634] [<ffffffff81009a4d>] sched_clock+0x9/0xd
> > > > [ 720.313637] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
> > > > [ 720.313641] [<ffffffff81184227>] get_request+0x1bf/0x2c7
> > > > [ 720.313646] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
> > >
> > > This comes from wreckage in the blk tree..
> > >
> > > ---
> > > commit 9195291e5f05e01d67f9a09c756b8aca8f009089
> > > Author: Divyesh Shah <dpshah@google.com>
> > > Date: Thu Apr 1 15:01:41 2010 -0700
> > >
> > > blkio: Increment the blkio cgroup stats for real now
> >
> > Jens, this regression is still in .35-rc1 and triggers in about 25% of all
> > -tip boot tests.
> >
> > The above commit is using sched_clock() in an unsafe way - please fix it or
> > revert it.
> >
> > The local_clock() changes PeterZ is working on are still WIP, it's not sure
> > we'll have it before .36.
>
> OK, I guess we'll have to solve this differently for .35 - I'll cook up
> something simple, if need be revert the change.
I suspect you can put get_cpu/put_cpu around it and use cpu_clock(). The
cross-CPU effects will still be there and there might be weird stats.
Ingo
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-06-01 6:55 ` Ingo Molnar
@ 2010-06-01 7:53 ` Jens Axboe
2010-06-12 1:54 ` Divyesh Shah
2010-06-02 11:16 ` blkiocg_update_io_add_stats(): INFO: trying to register non-static key Ingo Molnar
1 sibling, 1 reply; 45+ messages in thread
From: Jens Axboe @ 2010-06-01 7:53 UTC (permalink / raw)
To: Ingo Molnar; +Cc: Peter Zijlstra, piotr, linux-kernel, Divyesh Shah
On Tue, Jun 01 2010, Ingo Molnar wrote:
>
> * Jens Axboe <axboe@kernel.dk> wrote:
>
> > On Tue, Jun 01 2010, Ingo Molnar wrote:
> > >
> > > * Peter Zijlstra <peterz@infradead.org> wrote:
> > >
> > > > On Mon, 2010-05-24 at 05:03 +0200, Piotr Hosowicz wrote:
> > > > > [ 720.313607] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
> > > > > [ 720.313612] caller is native_sched_clock+0x3c/0x68
> > > > > [ 720.313616] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
> > > > > [ 720.313618] Call Trace:
> > > > > [ 720.313624] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
> > > > > [ 720.313629] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
> > > > > [ 720.313634] [<ffffffff81009a4d>] sched_clock+0x9/0xd
> > > > > [ 720.313637] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
> > > > > [ 720.313641] [<ffffffff81184227>] get_request+0x1bf/0x2c7
> > > > > [ 720.313646] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
> > > >
> > > > This comes from wreckage in the blk tree..
> > > >
> > > > ---
> > > > commit 9195291e5f05e01d67f9a09c756b8aca8f009089
> > > > Author: Divyesh Shah <dpshah@google.com>
> > > > Date: Thu Apr 1 15:01:41 2010 -0700
> > > >
> > > > blkio: Increment the blkio cgroup stats for real now
> > >
> > > Jens, this regression is still in .35-rc1 and triggers in about 25% of all
> > > -tip boot tests.
> > >
> > > The above commit is using sched_clock() in an unsafe way - please fix it or
> > > revert it.
> > >
> > > The local_clock() changes PeterZ is working on are still WIP, it's not sure
> > > we'll have it before .36.
> >
> > OK, I guess we'll have to solve this differently for .35 - I'll cook up
> > something simple, if need be revert the change.
>
> I suspect you can put get_cpu/put_cpu around it and use cpu_clock(). The
> cross-CPU effects will still be there and there might be weird stats.
It'll shut it up at least, which is the primary concern at this point.
--
Jens Axboe
^ permalink raw reply [flat|nested] 45+ messages in thread
* blkiocg_update_io_add_stats(): INFO: trying to register non-static key
2010-06-01 6:55 ` Ingo Molnar
2010-06-01 7:53 ` Jens Axboe
@ 2010-06-02 11:16 ` Ingo Molnar
2010-06-02 13:04 ` Jens Axboe
1 sibling, 1 reply; 45+ messages in thread
From: Ingo Molnar @ 2010-06-02 11:16 UTC (permalink / raw)
To: Jens Axboe; +Cc: Peter Zijlstra, piotr, linux-kernel, Divyesh Shah
btw., there's another warning triggered by the new blk-cgroups stats code:
sda:INFO: trying to register non-static key.
the code is fine but needs lockdep annotation.
turning off the locking correctness validator.
Pid: 81, comm: async/2 Not tainted 2.6.35-rc1-tip-01073-gd2f7698-dirty #6765
Call Trace:
[<ffffffff81065d6d>] register_lock_class+0x15f/0x365
[<ffffffff8105c426>] ? sched_clock_local+0x1d/0x83
[<ffffffff8105c557>] ? sched_clock_cpu+0xcb/0xd9
[<ffffffff81067184>] __lock_acquire+0x97/0x481
[<ffffffff810088d4>] ? native_sched_clock+0x37/0x6d
[<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
[<ffffffff81067644>] lock_acquire+0xd6/0xfd
[<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
[<ffffffff81850859>] _raw_spin_lock_irqsave+0x47/0x82
[<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
[<ffffffff81321b74>] blkiocg_update_io_add_stats+0x32/0x12e
[<ffffffff81325048>] cfq_insert_request+0xdd/0x47c
[<ffffffff813135b9>] elv_insert+0x12a/0x1f4
[<ffffffff8131371c>] __elv_add_request+0x99/0xa1
[<ffffffff8131817a>] __make_request+0x3e2/0x45f
[<ffffffff8131736e>] generic_make_request+0x2a0/0x316
[<ffffffff8185405e>] ? sub_preempt_count+0xf/0xb7
[<ffffffff8131749c>] submit_bio+0xb8/0xd6
[<ffffffff81117e1b>] submit_bh+0xf5/0x117
[<ffffffff8111b36e>] block_read_full_page+0x1f2/0x214
[<ffffffff8111ce86>] ? blkdev_get_block+0x0/0x66
[<ffffffff8185405e>] ? sub_preempt_count+0xf/0xb7
[<ffffffff8185405e>] ? sub_preempt_count+0xf/0xb7
[<ffffffff810c6ddd>] ? __lru_cache_add+0x79/0x97
[<ffffffff8111de4d>] blkdev_readpage+0x18/0x1a
[<ffffffff810becb0>] do_read_cache_page+0x95/0x128
[<ffffffff8111de35>] ? blkdev_readpage+0x0/0x1a
[<ffffffff810bed87>] read_cache_page_async+0x1c/0x1e
[<ffffffff810bed97>] read_cache_page+0xe/0x18
[<ffffffff8114698f>] read_dev_sector+0x33/0xbe
[<ffffffff8114797d>] adfspart_check_EESOX+0x59/0x1e7
[<ffffffff8185405e>] ? sub_preempt_count+0xf/0xb7
[<ffffffff8185405e>] ? sub_preempt_count+0xf/0xb7
[<ffffffff8185405e>] ? sub_preempt_count+0xf/0xb7
[<ffffffff8103dede>] ? vprintk+0x395/0x3f0
[<ffffffff811472f0>] ? kzalloc.clone.1+0x13/0x15
[<ffffffff8184dfe5>] ? printk+0x69/0x6b
[<ffffffff8114771d>] rescan_partitions+0x186/0x38d
[<ffffffff81513cfb>] ? sd_open+0xf1/0x1bd
[<ffffffff8111e512>] __blkdev_get+0x291/0x372
[<ffffffff8132a4ba>] ? kobject_put+0x48/0x4c
[<ffffffff8111e603>] blkdev_get+0x10/0x12
[<ffffffff81146bcd>] register_disk+0xb9/0x11d
[<ffffffff8131f3c4>] add_disk+0xb0/0x10c
[<ffffffff81515d4c>] sd_probe_async+0x12a/0x200
[<ffffffff8105f4a4>] ? ktime_get+0x65/0xbe
[<ffffffff8105d742>] async_thread+0x10e/0x21c
[<ffffffff81039390>] ? default_wake_function+0x0/0x14
[<ffffffff8105d634>] ? async_thread+0x0/0x21c
[<ffffffff81056c01>] kthread+0x9b/0xa3
[<ffffffff810030f4>] kernel_thread_helper+0x4/0x10
[<ffffffff81056b66>] ? kthread+0x0/0xa3
[<ffffffff810030f0>] ? kernel_thread_helper+0x0/0x10
sda1 sda2 sda3 < sda5 sda6 sda7 sda8 sda9 sda10 >
device: 'sda1': device_add
PM: Adding info for No Bus:sda1
seems to be a lock taken by:
[<ffffffff81321b74>] blkiocg_update_io_add_stats+0x32/0x12e
Ingo
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: blkiocg_update_io_add_stats(): INFO: trying to register non-static key
2010-06-02 11:16 ` blkiocg_update_io_add_stats(): INFO: trying to register non-static key Ingo Molnar
@ 2010-06-02 13:04 ` Jens Axboe
2010-06-11 1:33 ` Divyesh Shah
2010-06-11 7:15 ` Peter Zijlstra
0 siblings, 2 replies; 45+ messages in thread
From: Jens Axboe @ 2010-06-02 13:04 UTC (permalink / raw)
To: Ingo Molnar; +Cc: Peter Zijlstra, piotr, linux-kernel, Divyesh Shah
On Wed, Jun 02 2010, Ingo Molnar wrote:
>
> btw., there's another warning triggered by the new blk-cgroups stats code:
>
> sda:INFO: trying to register non-static key.
> the code is fine but needs lockdep annotation.
> turning off the locking correctness validator.
> Pid: 81, comm: async/2 Not tainted 2.6.35-rc1-tip-01073-gd2f7698-dirty #6765
> Call Trace:
> [<ffffffff81065d6d>] register_lock_class+0x15f/0x365
> [<ffffffff8105c426>] ? sched_clock_local+0x1d/0x83
> [<ffffffff8105c557>] ? sched_clock_cpu+0xcb/0xd9
> [<ffffffff81067184>] __lock_acquire+0x97/0x481
> [<ffffffff810088d4>] ? native_sched_clock+0x37/0x6d
> [<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
> [<ffffffff81067644>] lock_acquire+0xd6/0xfd
> [<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
> [<ffffffff81850859>] _raw_spin_lock_irqsave+0x47/0x82
> [<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
> [<ffffffff81321b74>] blkiocg_update_io_add_stats+0x32/0x12e
So that's blkg->stats_lock - help me out, what is lockdep complaining
about? The lock is initialized, what kind of lockdep annotation magic do
we need to sprinkle on it?
--
Jens Axboe
^ permalink raw reply [flat|nested] 45+ messages in thread
* [tip:sched/core] sched_clock: Add local_clock() API and improve documentation
2010-05-28 13:13 ` [PATCH] sched_clock: Provide local_clock() and improve documentation Peter Zijlstra
` (2 preceding siblings ...)
2010-05-28 18:11 ` Chad Talbott
@ 2010-06-09 10:13 ` tip-bot for Peter Zijlstra
3 siblings, 0 replies; 45+ messages in thread
From: tip-bot for Peter Zijlstra @ 2010-06-09 10:13 UTC (permalink / raw)
To: linux-tip-commits
Cc: linux-kernel, hpa, mingo, torvalds, a.p.zijlstra, akpm, tglx,
jaxboe, mingo
Commit-ID: c676329abb2b8359d9a5d734dec0c81779823fd6
Gitweb: http://git.kernel.org/tip/c676329abb2b8359d9a5d734dec0c81779823fd6
Author: Peter Zijlstra <a.p.zijlstra@chello.nl>
AuthorDate: Tue, 25 May 2010 10:48:51 +0200
Committer: Ingo Molnar <mingo@elte.hu>
CommitDate: Wed, 9 Jun 2010 10:34:49 +0200
sched_clock: Add local_clock() API and improve documentation
For people who otherwise get to write: cpu_clock(smp_processor_id()),
there is now: local_clock().
Also, as per suggestion from Andrew, provide some documentation on
the various clock interfaces, and minimize the unsigned long long vs
u64 mess.
Signed-off-by: Peter Zijlstra <a.p.zijlstra@chello.nl>
Cc: Andrew Morton <akpm@linux-foundation.org>
Cc: Linus Torvalds <torvalds@linux-foundation.org>
Cc: Jens Axboe <jaxboe@fusionio.com>
LKML-Reference: <1275052414.1645.52.camel@laptop>
Signed-off-by: Ingo Molnar <mingo@elte.hu>
---
arch/parisc/kernel/ftrace.c | 4 +-
include/linux/sched.h | 37 +++++++++-------
kernel/lockdep.c | 2 +-
kernel/perf_event.c | 2 +-
kernel/rcutorture.c | 3 +-
kernel/sched.c | 2 +-
kernel/sched_clock.c | 95 ++++++++++++++++++++++++++++++++++++++-----
kernel/trace/trace_clock.c | 2 +-
8 files changed, 113 insertions(+), 34 deletions(-)
diff --git a/arch/parisc/kernel/ftrace.c b/arch/parisc/kernel/ftrace.c
index 9877372..5beb97b 100644
--- a/arch/parisc/kernel/ftrace.c
+++ b/arch/parisc/kernel/ftrace.c
@@ -82,7 +82,7 @@ unsigned long ftrace_return_to_handler(unsigned long retval0,
unsigned long ret;
pop_return_trace(&trace, &ret);
- trace.rettime = cpu_clock(raw_smp_processor_id());
+ trace.rettime = local_clock();
ftrace_graph_return(&trace);
if (unlikely(!ret)) {
@@ -126,7 +126,7 @@ void prepare_ftrace_return(unsigned long *parent, unsigned long self_addr)
return;
}
- calltime = cpu_clock(raw_smp_processor_id());
+ calltime = local_clock();
if (push_return_trace(old, calltime,
self_addr, &trace.depth) == -EBUSY) {
diff --git a/include/linux/sched.h b/include/linux/sched.h
index edc3dd1..c2d4316 100644
--- a/include/linux/sched.h
+++ b/include/linux/sched.h
@@ -1791,20 +1791,23 @@ static inline int set_cpus_allowed(struct task_struct *p, cpumask_t new_mask)
#endif
/*
- * Architectures can set this to 1 if they have specified
- * CONFIG_HAVE_UNSTABLE_SCHED_CLOCK in their arch Kconfig,
- * but then during bootup it turns out that sched_clock()
- * is reliable after all:
+ * Do not use outside of architecture code which knows its limitations.
+ *
+ * sched_clock() has no promise of monotonicity or bounded drift between
+ * CPUs, use (which you should not) requires disabling IRQs.
+ *
+ * Please use one of the three interfaces below.
*/
-#ifdef CONFIG_HAVE_UNSTABLE_SCHED_CLOCK
-extern int sched_clock_stable;
-#endif
-
-/* ftrace calls sched_clock() directly */
extern unsigned long long notrace sched_clock(void);
+/*
+ * See the comment in kernel/sched_clock.c
+ */
+extern u64 cpu_clock(int cpu);
+extern u64 local_clock(void);
+extern u64 sched_clock_cpu(int cpu);
+
extern void sched_clock_init(void);
-extern u64 sched_clock_cpu(int cpu);
#ifndef CONFIG_HAVE_UNSTABLE_SCHED_CLOCK
static inline void sched_clock_tick(void)
@@ -1819,17 +1822,19 @@ static inline void sched_clock_idle_wakeup_event(u64 delta_ns)
{
}
#else
+/*
+ * Architectures can set this to 1 if they have specified
+ * CONFIG_HAVE_UNSTABLE_SCHED_CLOCK in their arch Kconfig,
+ * but then during bootup it turns out that sched_clock()
+ * is reliable after all:
+ */
+extern int sched_clock_stable;
+
extern void sched_clock_tick(void);
extern void sched_clock_idle_sleep_event(void);
extern void sched_clock_idle_wakeup_event(u64 delta_ns);
#endif
-/*
- * For kernel-internal use: high-speed (but slightly incorrect) per-cpu
- * clock constructed from sched_clock():
- */
-extern unsigned long long cpu_clock(int cpu);
-
extern unsigned long long
task_sched_runtime(struct task_struct *task);
extern unsigned long long thread_group_sched_runtime(struct task_struct *task);
diff --git a/kernel/lockdep.c b/kernel/lockdep.c
index 5428679..f2852a5 100644
--- a/kernel/lockdep.c
+++ b/kernel/lockdep.c
@@ -146,7 +146,7 @@ static DEFINE_PER_CPU(struct lock_class_stats[MAX_LOCKDEP_KEYS],
static inline u64 lockstat_clock(void)
{
- return cpu_clock(smp_processor_id());
+ return local_clock();
}
static int lock_point(unsigned long points[], unsigned long ip)
diff --git a/kernel/perf_event.c b/kernel/perf_event.c
index 31d6afe..109c5ec 100644
--- a/kernel/perf_event.c
+++ b/kernel/perf_event.c
@@ -214,7 +214,7 @@ static void perf_unpin_context(struct perf_event_context *ctx)
static inline u64 perf_clock(void)
{
- return cpu_clock(raw_smp_processor_id());
+ return local_clock();
}
/*
diff --git a/kernel/rcutorture.c b/kernel/rcutorture.c
index 6535ac8..2e2726d 100644
--- a/kernel/rcutorture.c
+++ b/kernel/rcutorture.c
@@ -239,8 +239,7 @@ static unsigned long
rcu_random(struct rcu_random_state *rrsp)
{
if (--rrsp->rrs_count < 0) {
- rrsp->rrs_state +=
- (unsigned long)cpu_clock(raw_smp_processor_id());
+ rrsp->rrs_state += (unsigned long)local_clock();
rrsp->rrs_count = RCU_RANDOM_REFRESH;
}
rrsp->rrs_state = rrsp->rrs_state * RCU_RANDOM_MULT + RCU_RANDOM_ADD;
diff --git a/kernel/sched.c b/kernel/sched.c
index 8f351c5..3abd8f7 100644
--- a/kernel/sched.c
+++ b/kernel/sched.c
@@ -1647,7 +1647,7 @@ static void update_shares(struct sched_domain *sd)
if (root_task_group_empty())
return;
- now = cpu_clock(raw_smp_processor_id());
+ now = local_clock();
elapsed = now - sd->last_update;
if (elapsed >= (s64)(u64)sysctl_sched_shares_ratelimit) {
diff --git a/kernel/sched_clock.c b/kernel/sched_clock.c
index 906a0f7..52f1a14 100644
--- a/kernel/sched_clock.c
+++ b/kernel/sched_clock.c
@@ -10,19 +10,55 @@
* Ingo Molnar <mingo@redhat.com>
* Guillaume Chazarain <guichaz@gmail.com>
*
- * Create a semi stable clock from a mixture of other events, including:
- * - gtod
+ *
+ * What:
+ *
+ * cpu_clock(i) provides a fast (execution time) high resolution
+ * clock with bounded drift between CPUs. The value of cpu_clock(i)
+ * is monotonic for constant i. The timestamp returned is in nanoseconds.
+ *
+ * ######################### BIG FAT WARNING ##########################
+ * # when comparing cpu_clock(i) to cpu_clock(j) for i != j, time can #
+ * # go backwards !! #
+ * ####################################################################
+ *
+ * There is no strict promise about the base, although it tends to start
+ * at 0 on boot (but people really shouldn't rely on that).
+ *
+ * cpu_clock(i) -- can be used from any context, including NMI.
+ * sched_clock_cpu(i) -- must be used with local IRQs disabled (implied by NMI)
+ * local_clock() -- is cpu_clock() on the current cpu.
+ *
+ * How:
+ *
+ * The implementation either uses sched_clock() when
+ * !CONFIG_HAVE_UNSTABLE_SCHED_CLOCK, which means in that case the
+ * sched_clock() is assumed to provide these properties (mostly it means
+ * the architecture provides a globally synchronized highres time source).
+ *
+ * Otherwise it tries to create a semi stable clock from a mixture of other
+ * clocks, including:
+ *
+ * - GTOD (clock monotomic)
* - sched_clock()
* - explicit idle events
*
- * We use gtod as base and the unstable clock deltas. The deltas are filtered,
- * making it monotonic and keeping it within an expected window.
+ * We use GTOD as base and use sched_clock() deltas to improve resolution. The
+ * deltas are filtered to provide monotonicity and keeping it within an
+ * expected window.
*
* Furthermore, explicit sleep and wakeup hooks allow us to account for time
* that is otherwise invisible (TSC gets stopped).
*
- * The clock: sched_clock_cpu() is monotonic per cpu, and should be somewhat
- * consistent between cpus (never more than 2 jiffies difference).
+ *
+ * Notes:
+ *
+ * The !IRQ-safetly of sched_clock() and sched_clock_cpu() comes from things
+ * like cpufreq interrupts that can change the base clock (TSC) multiplier
+ * and cause funny jumps in time -- although the filtering provided by
+ * sched_clock_cpu() should mitigate serious artifacts we cannot rely on it
+ * in general since for !CONFIG_HAVE_UNSTABLE_SCHED_CLOCK we fully rely on
+ * sched_clock().
*/
#include <linux/spinlock.h>
#include <linux/hardirq.h>
@@ -170,6 +206,11 @@ again:
return val;
}
+/*
+ * Similar to cpu_clock(), but requires local IRQs to be disabled.
+ *
+ * See cpu_clock().
+ */
u64 sched_clock_cpu(int cpu)
{
struct sched_clock_data *scd;
@@ -237,9 +278,19 @@ void sched_clock_idle_wakeup_event(u64 delta_ns)
}
EXPORT_SYMBOL_GPL(sched_clock_idle_wakeup_event);
-unsigned long long cpu_clock(int cpu)
+/*
+ * As outlined at the top, provides a fast, high resolution, nanosecond
+ * time source that is monotonic per cpu argument and has bounded drift
+ * between cpus.
+ *
+ * ######################### BIG FAT WARNING ##########################
+ * # when comparing cpu_clock(i) to cpu_clock(j) for i != j, time can #
+ * # go backwards !! #
+ * ####################################################################
+ */
+u64 cpu_clock(int cpu)
{
- unsigned long long clock;
+ u64 clock;
unsigned long flags;
local_irq_save(flags);
@@ -249,6 +300,25 @@ unsigned long long cpu_clock(int cpu)
return clock;
}
+/*
+ * Similar to cpu_clock() for the current cpu. Time will only be observed
+ * to be monotonic if care is taken to only compare timestampt taken on the
+ * same CPU.
+ *
+ * See cpu_clock().
+ */
+u64 local_clock(void)
+{
+ u64 clock;
+ unsigned long flags;
+
+ local_irq_save(flags);
+ clock = sched_clock_cpu(smp_processor_id());
+ local_irq_restore(flags);
+
+ return clock;
+}
+
#else /* CONFIG_HAVE_UNSTABLE_SCHED_CLOCK */
void sched_clock_init(void)
@@ -264,12 +334,17 @@ u64 sched_clock_cpu(int cpu)
return sched_clock();
}
-
-unsigned long long cpu_clock(int cpu)
+u64 cpu_clock(int cpu)
{
return sched_clock_cpu(cpu);
}
+u64 local_clock(void)
+{
+ return sched_clock_cpu(0);
+}
+
#endif /* CONFIG_HAVE_UNSTABLE_SCHED_CLOCK */
EXPORT_SYMBOL_GPL(cpu_clock);
+EXPORT_SYMBOL_GPL(local_clock);
diff --git a/kernel/trace/trace_clock.c b/kernel/trace/trace_clock.c
index 9d589d8..1723e2b 100644
--- a/kernel/trace/trace_clock.c
+++ b/kernel/trace/trace_clock.c
@@ -56,7 +56,7 @@ u64 notrace trace_clock_local(void)
*/
u64 notrace trace_clock(void)
{
- return cpu_clock(raw_smp_processor_id());
+ return local_clock();
}
^ permalink raw reply related [flat|nested] 45+ messages in thread
* Re: blkiocg_update_io_add_stats(): INFO: trying to register non-static key
2010-06-02 13:04 ` Jens Axboe
@ 2010-06-11 1:33 ` Divyesh Shah
2010-06-11 7:15 ` Peter Zijlstra
1 sibling, 0 replies; 45+ messages in thread
From: Divyesh Shah @ 2010-06-11 1:33 UTC (permalink / raw)
To: Jens Axboe; +Cc: Ingo Molnar, Peter Zijlstra, piotr, linux-kernel
On Wed, Jun 2, 2010 at 6:04 AM, Jens Axboe <jaxboe@fusionio.com> wrote:
> On Wed, Jun 02 2010, Ingo Molnar wrote:
>>
>> btw., there's another warning triggered by the new blk-cgroups stats code:
>>
>> sda:INFO: trying to register non-static key.
>> the code is fine but needs lockdep annotation.
>> turning off the locking correctness validator.
>> Pid: 81, comm: async/2 Not tainted 2.6.35-rc1-tip-01073-gd2f7698-dirty #6765
>> Call Trace:
>> [<ffffffff81065d6d>] register_lock_class+0x15f/0x365
>> [<ffffffff8105c426>] ? sched_clock_local+0x1d/0x83
>> [<ffffffff8105c557>] ? sched_clock_cpu+0xcb/0xd9
>> [<ffffffff81067184>] __lock_acquire+0x97/0x481
>> [<ffffffff810088d4>] ? native_sched_clock+0x37/0x6d
>> [<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
>> [<ffffffff81067644>] lock_acquire+0xd6/0xfd
>> [<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
>> [<ffffffff81850859>] _raw_spin_lock_irqsave+0x47/0x82
>> [<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
>> [<ffffffff81321b74>] blkiocg_update_io_add_stats+0x32/0x12e
>
> So that's blkg->stats_lock - help me out, what is lockdep complaining
> about? The lock is initialized, what kind of lockdep annotation magic do
> we need to sprinkle on it?
Jens,
Were you able to figure out what annotation magic is needed here.
I remember we had fixed another similar warning that Gui reported, but
that was because the root cfqg didn't have the stats_lock initialized
as expected. I'm not sure what needs to be done here either.
-Divyesh
>
> --
> Jens Axboe
>
>
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: blkiocg_update_io_add_stats(): INFO: trying to register non-static key
2010-06-02 13:04 ` Jens Axboe
2010-06-11 1:33 ` Divyesh Shah
@ 2010-06-11 7:15 ` Peter Zijlstra
2010-06-11 8:34 ` Jens Axboe
1 sibling, 1 reply; 45+ messages in thread
From: Peter Zijlstra @ 2010-06-11 7:15 UTC (permalink / raw)
To: Jens Axboe; +Cc: Ingo Molnar, piotr, linux-kernel, Divyesh Shah
On Wed, 2010-06-02 at 15:04 +0200, Jens Axboe wrote:
> On Wed, Jun 02 2010, Ingo Molnar wrote:
> >
> > btw., there's another warning triggered by the new blk-cgroups stats code:
> >
> > sda:INFO: trying to register non-static key.
> > the code is fine but needs lockdep annotation.
> > turning off the locking correctness validator.
> > Pid: 81, comm: async/2 Not tainted 2.6.35-rc1-tip-01073-gd2f7698-dirty #6765
> > Call Trace:
> > [<ffffffff81065d6d>] register_lock_class+0x15f/0x365
> > [<ffffffff8105c426>] ? sched_clock_local+0x1d/0x83
> > [<ffffffff8105c557>] ? sched_clock_cpu+0xcb/0xd9
> > [<ffffffff81067184>] __lock_acquire+0x97/0x481
> > [<ffffffff810088d4>] ? native_sched_clock+0x37/0x6d
> > [<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
> > [<ffffffff81067644>] lock_acquire+0xd6/0xfd
> > [<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
> > [<ffffffff81850859>] _raw_spin_lock_irqsave+0x47/0x82
> > [<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
> > [<ffffffff81321b74>] blkiocg_update_io_add_stats+0x32/0x12e
>
> So that's blkg->stats_lock - help me out, what is lockdep complaining
> about? The lock is initialized, what kind of lockdep annotation magic do
> we need to sprinkle on it?
It basically says its lock instance isn't properly initialised. Usually
spin_lock_init() will set lock->dep_map->key, for static locks,
initialised with __SPIN_LOCK_UNLOCKED() ->key doesn't get set and we use
the lock's address as key.
Now lockdep requires the key to be in static storage, so if you try to
used __SPIN_LOCK_UNLOCKED() on dynamically allocated locks (the most
common form is using static forms like DEFINE_foo() on stack variables),
things go bang.
That said, the block_cgroup.c code seems to use spin_lock_init() so it
_should_ all work out. Use before init/after free perhaps?
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: blkiocg_update_io_add_stats(): INFO: trying to register non-static key
2010-06-11 7:15 ` Peter Zijlstra
@ 2010-06-11 8:34 ` Jens Axboe
0 siblings, 0 replies; 45+ messages in thread
From: Jens Axboe @ 2010-06-11 8:34 UTC (permalink / raw)
To: Peter Zijlstra; +Cc: Ingo Molnar, piotr, linux-kernel, Divyesh Shah
On 2010-06-11 09:15, Peter Zijlstra wrote:
> On Wed, 2010-06-02 at 15:04 +0200, Jens Axboe wrote:
>> On Wed, Jun 02 2010, Ingo Molnar wrote:
>>>
>>> btw., there's another warning triggered by the new blk-cgroups stats code:
>>>
>>> sda:INFO: trying to register non-static key.
>>> the code is fine but needs lockdep annotation.
>>> turning off the locking correctness validator.
>>> Pid: 81, comm: async/2 Not tainted 2.6.35-rc1-tip-01073-gd2f7698-dirty #6765
>>> Call Trace:
>>> [<ffffffff81065d6d>] register_lock_class+0x15f/0x365
>>> [<ffffffff8105c426>] ? sched_clock_local+0x1d/0x83
>>> [<ffffffff8105c557>] ? sched_clock_cpu+0xcb/0xd9
>>> [<ffffffff81067184>] __lock_acquire+0x97/0x481
>>> [<ffffffff810088d4>] ? native_sched_clock+0x37/0x6d
>>> [<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
>>> [<ffffffff81067644>] lock_acquire+0xd6/0xfd
>>> [<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
>>> [<ffffffff81850859>] _raw_spin_lock_irqsave+0x47/0x82
>>> [<ffffffff81321b74>] ? blkiocg_update_io_add_stats+0x32/0x12e
>>> [<ffffffff81321b74>] blkiocg_update_io_add_stats+0x32/0x12e
>>
>> So that's blkg->stats_lock - help me out, what is lockdep complaining
>> about? The lock is initialized, what kind of lockdep annotation magic do
>> we need to sprinkle on it?
>
> It basically says its lock instance isn't properly initialised. Usually
> spin_lock_init() will set lock->dep_map->key, for static locks,
> initialised with __SPIN_LOCK_UNLOCKED() ->key doesn't get set and we use
> the lock's address as key.
>
> Now lockdep requires the key to be in static storage, so if you try to
> used __SPIN_LOCK_UNLOCKED() on dynamically allocated locks (the most
> common form is using static forms like DEFINE_foo() on stack variables),
> things go bang.
>
> That said, the block_cgroup.c code seems to use spin_lock_init() so it
> _should_ all work out. Use before init/after free perhaps?
Exactly, I did double check that. But yes, could be a bug where it's
used before being initialized, though it seems to do that when the
struct is allocated. So perhaps user-after-free indeed, but it happened
at boot.
--
Jens Axboe
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-06-01 7:53 ` Jens Axboe
@ 2010-06-12 1:54 ` Divyesh Shah
2010-06-12 9:42 ` Peter Zijlstra
0 siblings, 1 reply; 45+ messages in thread
From: Divyesh Shah @ 2010-06-12 1:54 UTC (permalink / raw)
To: Jens Axboe; +Cc: Ingo Molnar, Peter Zijlstra, piotr, linux-kernel
On Tue, Jun 1, 2010 at 12:53 AM, Jens Axboe <axboe@kernel.dk> wrote:
> On Tue, Jun 01 2010, Ingo Molnar wrote:
>>
>> * Jens Axboe <axboe@kernel.dk> wrote:
>>
>> > On Tue, Jun 01 2010, Ingo Molnar wrote:
>> > >
>> > > * Peter Zijlstra <peterz@infradead.org> wrote:
>> > >
>> > > > On Mon, 2010-05-24 at 05:03 +0200, Piotr Hosowicz wrote:
>> > > > > [ 720.313607] BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
>> > > > > [ 720.313612] caller is native_sched_clock+0x3c/0x68
>> > > > > [ 720.313616] Pid: 5449, comm: icedove-bin Tainted: P 2.6.34-20100524-0407 #1
>> > > > > [ 720.313618] Call Trace:
>> > > > > [ 720.313624] [<ffffffff811a533b>] debug_smp_processor_id+0xc7/0xe0
>> > > > > [ 720.313629] [<ffffffff81009b87>] native_sched_clock+0x3c/0x68
>> > > > > [ 720.313634] [<ffffffff81009a4d>] sched_clock+0x9/0xd
>> > > > > [ 720.313637] [<ffffffff811823ec>] blk_rq_init+0x92/0x9d
>> > > > > [ 720.313641] [<ffffffff81184227>] get_request+0x1bf/0x2c7
>> > > > > [ 720.313646] [<ffffffff8118435c>] get_request_wait+0x2d/0x19d
>> > > >
>> > > > This comes from wreckage in the blk tree..
>> > > >
>> > > > ---
>> > > > commit 9195291e5f05e01d67f9a09c756b8aca8f009089
>> > > > Author: Divyesh Shah <dpshah@google.com>
>> > > > Date: Thu Apr 1 15:01:41 2010 -0700
>> > > >
>> > > > blkio: Increment the blkio cgroup stats for real now
>> > >
>> > > Jens, this regression is still in .35-rc1 and triggers in about 25% of all
>> > > -tip boot tests.
>> > >
>> > > The above commit is using sched_clock() in an unsafe way - please fix it or
>> > > revert it.
>> > >
>> > > The local_clock() changes PeterZ is working on are still WIP, it's not sure
>> > > we'll have it before .36.
>> >
>> > OK, I guess we'll have to solve this differently for .35 - I'll cook up
>> > something simple, if need be revert the change.
>>
>> I suspect you can put get_cpu/put_cpu around it and use cpu_clock(). The
>> cross-CPU effects will still be there and there might be weird stats.
>
> It'll shut it up at least, which is the primary concern at this point.
Jens,
Thanks for the temporary fix (adding preempt_enable/disable()
calls). I was able to repro the issue and and have a patch that
replaces use of sched_clock() in block layer w/
ktime_to_ns(ktime_get()). We will lose resolution when running w/o
highres timers but should be better than unbounded drift between cpus.
I'll send the patch next.
-Divyesh
>
> --
> Jens Axboe
>
>
^ permalink raw reply [flat|nested] 45+ messages in thread
* Re: BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449
2010-06-12 1:54 ` Divyesh Shah
@ 2010-06-12 9:42 ` Peter Zijlstra
0 siblings, 0 replies; 45+ messages in thread
From: Peter Zijlstra @ 2010-06-12 9:42 UTC (permalink / raw)
To: Divyesh Shah; +Cc: Jens Axboe, Ingo Molnar, piotr, linux-kernel
On Fri, 2010-06-11 at 18:54 -0700, Divyesh Shah wrote:
> I was able to repro the issue and and have a patch that
> replaces use of sched_clock() in block layer w/
> ktime_to_ns(ktime_get()).
You know ktime_get() is terrifyingly expensive, right?
^ permalink raw reply [flat|nested] 45+ messages in thread
end of thread, other threads:[~2010-06-12 9:42 UTC | newest]
Thread overview: 45+ messages (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2010-05-24 3:03 BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449 Piotr Hosowicz
2010-05-24 17:22 ` Piotr Hosowicz
2010-05-25 8:50 ` Peter Zijlstra
2010-05-25 9:42 ` Piotr Hosowicz
2010-05-25 9:45 ` Peter Zijlstra
2010-05-25 9:43 ` Ingo Molnar
2010-05-25 9:47 ` Peter Zijlstra
2010-05-25 9:51 ` Peter Zijlstra
2010-05-25 9:57 ` Piotr Hosowicz
2010-05-25 10:00 ` Peter Zijlstra
2010-05-25 10:05 ` Piotr Hosowicz
2010-05-25 10:29 ` Piotr Hosowicz
2010-05-25 14:13 ` Piotr Hosowicz
2010-05-25 14:34 ` Piotr Hosowicz
2010-05-25 14:36 ` Peter Zijlstra
2010-05-25 14:48 ` Piotr Hosowicz
2010-05-25 16:15 ` Peter Zijlstra
2010-05-25 16:47 ` Piotr Hosowicz
2010-05-26 2:06 ` Piotr Hosowicz
2010-05-26 2:51 ` Piotr Hosowicz
2010-05-25 18:07 ` Divyesh Shah
2010-05-25 18:15 ` Piotr Hosowicz
2010-05-25 21:35 ` Peter Zijlstra
2010-05-26 23:02 ` Andrew Morton
2010-05-27 6:46 ` Peter Zijlstra
2010-05-27 6:51 ` Andrew Morton
[not found] ` <1274945751.27810.3765.camel@twins>
[not found] ` <20100527113340.d4afb8fc.akpm@linux-foundation.org>
2010-05-28 13:13 ` [PATCH] sched_clock: Provide local_clock() and improve documentation Peter Zijlstra
2010-05-28 13:42 ` Johannes Stezenbach
2010-05-28 15:08 ` Peter Zijlstra
2010-05-28 14:15 ` Piotr Hosowicz
2010-05-28 14:22 ` Piotr Hosowicz
2010-05-28 18:11 ` Chad Talbott
2010-05-28 18:22 ` Peter Zijlstra
2010-06-09 10:13 ` [tip:sched/core] sched_clock: Add local_clock() API " tip-bot for Peter Zijlstra
2010-06-01 6:41 ` BUG: using smp_processor_id() in preemptible [00000000] code: icedove-bin/5449 Ingo Molnar
2010-06-01 6:47 ` Jens Axboe
2010-06-01 6:55 ` Ingo Molnar
2010-06-01 7:53 ` Jens Axboe
2010-06-12 1:54 ` Divyesh Shah
2010-06-12 9:42 ` Peter Zijlstra
2010-06-02 11:16 ` blkiocg_update_io_add_stats(): INFO: trying to register non-static key Ingo Molnar
2010-06-02 13:04 ` Jens Axboe
2010-06-11 1:33 ` Divyesh Shah
2010-06-11 7:15 ` Peter Zijlstra
2010-06-11 8:34 ` Jens Axboe
This is an external index of several public inboxes,
see mirroring instructions on how to clone and mirror
all data and code used by this external index.