From: Kamalesh Babulal <kamalesh@linux.vnet.ibm.com>
To: Andrew Morton <akpm@linux-foundation.org>
Cc: linux-kernel@vger.kernel.org, Ingo Molnar <mingo@elte.hu>,
Thomas Gleixner <tglx@linutronix.de>,
Andy Whitcroft <apw@shadowen.org>,
Dave Hansen <haveblue@us.ibm.com>, Christoph Hellwig <hch@lst.de>
Subject: Re: 2.6.25-rc2-mm1
Date: Sun, 17 Feb 2008 13:06:25 +0530 [thread overview]
Message-ID: <47B7E3F9.7080208@linux.vnet.ibm.com> (raw)
In-Reply-To: <20080216212446.0713aeae.akpm@linux-foundation.org>
Andrew Morton wrote:
> On Sun, 17 Feb 2008 10:38:12 +0530 Kamalesh Babulal <kamalesh@linux.vnet.ibm.com> wrote:
>
>> The 2.6.25-rc2-mm1 kernel oopses, followed by softlockup several times (have pasted
>> only some of them) on the x86_64 machine. The machine has 4 cpu(s).
>>
>> BUG: unable to handle kernel NULL pointer dereference at 0000000000000219
>> IP: [<ffffffff802ee99a>] security_inode_getattr+0x4/0x21
>> PGD 1da947067 PUD 1e1803067 PMD 0
>> Oops: 0000 [1] SMP
>> last sysfs file: /sys/devices/system/cpu/cpu1/cpufreq/scaling_setspeed
>> CPU 2
>> Modules linked in: auth_rpcgss exportfs autofs4 hidp rfcomm l2cap bluetooth sunrpc ipv6 acpi_cpufreq dm_mirror dm_mod video output sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy tg3 button ide_cd_mod cdrom serio_raw i2c_i801 pcspkr e752x_edac edac_core shpchp i2c_core aic79xx scsi_transport_spi sd_mod scsi_mod ext3 jbd ehci_hcd ohci_hcd uhci_hcd [last unloaded: microcode]
>> Pid: 3069, comm: modprobe Not tainted 2.6.25-rc2-mm1-autotest #1
>> RIP: 0010:[<ffffffff802ee99a>] [<ffffffff802ee99a>] security_inode_getattr+0x4/0x21
>> RSP: 0018:ffff8101da9e9ea0 EFLAGS: 00010286
>> RAX: 0000000000000000 RBX: ffff8101e1cd7a40 RCX: 0000000000000001
>> RDX: ffff8101da9e9ef8 RSI: ffff8101e1cd7a40 RDI: ffff8101e5946dc0
>> RBP: 00000000fffffff7 R08: 0000000000000002 R09: 0000000000000002
>> R10: 0000000000000002 R11: 0000000000000246 R12: 0000000000000000
>> R13: ffff8101da9e9ef8 R14: ffff8101e5946dc0 R15: 000000000061a660
>> FS: 00007fc33bc746f0(0000) GS:ffff8101e714de40(0000) knlGS:0000000000000000
>> CS: 0010 DS: 0000 ES: 0000 CR0: 000000008005003b
>> CR2: 0000000000000219 CR3: 00000001da894000 CR4: 00000000000006e0
>> DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
>> DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
>> Process modprobe (pid: 3069, threadinfo ffff8101da9e8000, task ffff8101e51975e0)
>> Stack: ffffffff8028e55d ffff8101e7111300 00000000fffffff7 ffff8101da9e9ef8
>> 0000000000000003 0000000000000001 ffffffff8028e5ca 00007fff43c90120
>> 0000000000618e40 0000000000000000 ffffffff8028e5ec ffffffff8025b7e3
>> Call Trace:
>> [<ffffffff8028e55d>] vfs_getattr+0x1a/0x5e
>> [<ffffffff8028e5ca>] vfs_fstat+0x29/0x3a
>> [<ffffffff8028e5ec>] sys_newfstat+0x11/0x29
>> [<ffffffff8025b7e3>] audit_syscall_exit+0x2e4/0x303
>> [<ffffffff8020bf6e>] tracesys+0x71/0xe1
>> [<ffffffff8020bfd9>] tracesys+0xdc/0xe1
>>
>>
>> Code: 8b 98 a8 01 00 00 41 ff e3 31 c0 c3 f6 87 19 02 00 00 02 75 11 48 8b 05 7d 0d 64 00 4c 8b 98 a0 01 00 00 41 ff e3 c3 48 8b 46 10 <f6> 80 19 02 00 00 02 75 11 48 8b 05 5e 0d 64 00 4c 8b 98 98 01
>
> Beats me. Looks like we somehow passed a garbage dentry* into
> security_inode_getattr(). But 0x219? That could be an offset from an
> accidentally IS_ERR pointer, but sizeof(struct dentry) is only 0xa0 here,
> so the pointer would have to have a value of -0x139 or less, and that's
> outside the range of any sane errnos.
>
> If it's reproducible then a bisection search would be great, please.
Hi Andrew,
I tried reproducing this panic, but was unsuccessful is reproducing it even after four rounds of
try, One of those round i had the following kernel panic
BUG: unable to handle kernel paging request at 000000000508fffe
IP: [<ffff8101e5d15e44>]
PGD 1e382b067 PUD 1e38a9067 PMD 0
Oops: 0002 [1] SMP
last sysfs file: /sys/block/hda/removable
CPU 3
Modules linked in: dm_mirror dm_mod video output sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy tg3 ide_cd_mod button cdrom serio_raw i2c_i801 e752x_edac shpchp edac_core i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ehci_hcd ohci_hcd uhci_hcd
Pid: 0, comm: swapper Not tainted 2.6.25-rc2-mm1-autotest #1
RIP: 0010:[<ffff8101e5d15e44>] [<ffff8101e5d15e44>]
RSP: 0018:ffff8101e71dbf08 EFLAGS: 00010282
RAX: ffff8101e408cb00 RBX: ffff81000104175f RCX: ffffffffffffffff
RDX: 0000000000000060 RSI: 7fffffffffffffff RDI: ffff8101e408cb00
RBP: ffff8101e5839680 R08: 0000000000000004 R09: 000000000000003c
R10: ffff8101e711a4c8 R11: ffff8101e71dbf10 R12: 0000000000000002
R13: 0000000000000003 R14: 0000000000000000 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff8101e714d640(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 000000000508fffe CR3: 00000001e5cbf000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffff8101e71d2000, task ffff8101e71cea70)
Stack: ffffffff80260a4c 0000000000000001 ffffffff806800f0 000000000000000a
ffffffff80260ada ffffffff806800e0 ffffffff80236f33 ffff8101e71d3e88
0000000000000046 ffff8101e71dbf78 0000000000000000 0000000000000000
Call Trace:
<IRQ> [<ffffffff80260a4c>] __rcu_process_callbacks+0x10f/0x17a
[<ffffffff80260ada>] rcu_process_callbacks+0x23/0x43
[<ffffffff80236f33>] __do_softirq+0x55/0xc4
[<ffffffff8020cfec>] call_softirq+0x1c/0x28
[<ffffffff8020e677>] do_softirq+0x2c/0x68
[<ffffffff8021bb1b>] smp_apic_timer_interrupt+0x8a/0xa3
[<ffffffff8020ca96>] apic_timer_interrupt+0x66/0x70
<EOI> [<ffffffff8020adc7>] default_idle+0x31/0x55
[<ffffffff8020adc2>] default_idle+0x2c/0x55
[<ffffffff8020ad96>] default_idle+0x0/0x55
[<ffffffff8020ae75>] cpu_idle+0x8a/0xac
Code: 00 00 00 00 00 00 00 20 5e d1 e5 01 81 ff ff 20 5e d1 e5 01 81 ff ff 00 00 00 00 00 00 00 00 20 62 cf e6 01 81 ff ff e0 0e ca e5 <01> 81 ff ff d8 c2 28 80 ff ff ff ff 00 00 00 00 00 00 00 00 00
RIP [<ffff8101e5d15e44>]
RSP <ffff8101e71dbf08>
CR2: 000000000508fffe
BUG: unable to handle kernel <4>---[ end trace b5676e22cd1a5a92 ]---
Kernel panic - not syncing: Aiee, killing interrupt handler!
paging request at 0000000005090005
IP: [<ffff8101e5d15e44>]
PGD 0
Oops: 0002 [2] SMP
last sysfs file: /sys/block/hda/removable
CPU 1
Modules linked in: dm_mirror dm_mod video output sbs sbshc battery acpi_memhotplug ac parport_pc lp parport sg floppy tg3 ide_cd_mod button cdrom serio_raw i2c_i801 e752x_edac shpchp edac_core i2c_core pcspkr aic79xx scsi_transport_spi sd_mod scsi_mod ehci_hcd ohci_hcd uhci_hcd
Pid: 0, comm: swapper Tainted: G D 2.6.25-rc2-mm1-autotest #1
RIP: 0010:[<ffff8101e5d15e44>] [<ffff8101e5d15e44>]
RSP: 0018:ffff8101e716bf08 EFLAGS: 00010282
RAX: ffff8101e408cb00 RBX: ffff81000101f766 RCX: 0000000000000006
RDX: 000000000000004c RSI: 0000000000000030 RDI: ffff8101e408cb00
RBP: ffff8101e5839680 R08: 0000000000000010 R09: 0000000000000004
R10: 0000000000000000 R11: ffff8101e716bf10 R12: 0000000000000004
R13: 0000000000000001 R14: 0000000000000000 R15: 0000000000000000
FS: 0000000000000000(0000) GS:ffff8101e710b6c0(0000) knlGS:0000000000000000
CS: 0010 DS: 0018 ES: 0018 CR0: 000000008005003b
CR2: 0000000005090005 CR3: 0000000000201000 CR4: 00000000000006e0
DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Process swapper (pid: 0, threadinfo ffff8101e7164000, task ffff8101e715c0c0)
Stack: ffffffff80260a4c 0000000000000001 ffffffff806800f0 000000000000000a
ffffffff80260ada 000000000000000a ffffffff80236f33 ffff8101e7165e88
0000000000000046 ffff8101e716bf78 0000000000000000 0000000000000000
Call Trace:
<IRQ> [<ffffffff80260a4c>] __rcu_process_callbacks+0x10f/0x17a
[<ffffffff80260ada>] rcu_process_callbacks+0x23/0x43
[<ffffffff80236f33>] __do_softirq+0x55/0xc4
[<ffffffff8020cfec>] call_softirq+0x1c/0x28
[<ffffffff8020e677>] do_softirq+0x2c/0x68
[<ffffffff8021bb1b>] smp_apic_timer_interrupt+0x8a/0xa3
[<ffffffff8020ca96>] apic_timer_interrupt+0x66/0x70
<EOI> [<ffffffff8020adc7>] default_idle+0x31/0x55
[<ffffffff8020adc2>] default_idle+0x2c/0x55
[<ffffffff8020ad96>] default_idle+0x0/0x55
[<ffffffff8020ae75>] cpu_idle+0x8a/0xac
Code: 00 00 00 00 00 00 00 20 5e d1 e5 01 81 ff ff 20 5e d1 e5 01 81 ff ff 00 00 00 00 00 00 00 00 20 62 cf e6 01 81 ff ff e0 0e ca e5 <01> 81 ff ff d8 c2 28 80 ff ff ff ff 00 00 00 00 00 00 00 00 00
RIP [<ffff8101e5d15e44>]
RSP <ffff8101e716bf08>
CR2: 0000000005090005
--
Thanks & Regards,
Kamalesh Babulal,
Linux Technology Center,
IBM, ISTL.
next prev parent reply other threads:[~2008-02-17 7:37 UTC|newest]
Thread overview: 134+ messages / expand[flat|nested] mbox.gz Atom feed top
2008-02-16 8:25 2.6.25-rc2-mm1 Andrew Morton
2008-02-16 10:59 ` 2.6.25-rc2-mm1: build failure (x86) Marcin Slusarz
2008-02-16 11:09 ` Andrew Morton
2008-02-16 11:37 ` Marcin Slusarz
2008-02-17 0:22 ` Rafael J. Wysocki
2008-02-17 9:54 ` Marcin Slusarz
2008-02-17 1:37 ` Rafael J. Wysocki
2008-02-17 9:56 ` Marcin Slusarz
2008-02-19 18:51 ` Russell Leidich
2008-02-16 16:15 ` [BUG] 2.6.25-rc2-mm1 - kernel oops while bootup on s390x Kamalesh Babulal
2008-02-16 19:45 ` Andrew Morton
2008-02-16 19:49 ` Thomas Gleixner
2008-02-16 19:50 ` Thomas Gleixner
2008-02-17 3:40 ` Kamalesh Babulal
2008-02-17 9:06 ` Heiko Carstens
2008-02-18 14:08 ` Kamalesh Babulal
2008-02-16 17:21 ` 2.6.25-rc2-mm1 Randy Dunlap
2008-02-16 17:31 ` [PATCH]2.6.25-rc2-mm1 - Build Failure at security/keys/compat.c on powerpc Kamalesh Babulal
2008-02-16 17:48 ` 2.6.25-rc2-mm1 (wakeup) Randy Dunlap
2008-02-17 1:18 ` Rafael J. Wysocki
2008-02-17 1:22 ` H. Peter Anvin
2008-02-17 2:19 ` Randy Dunlap
2008-02-17 3:58 ` H. Peter Anvin
2008-02-17 4:38 ` [PATCH v2] " Randy Dunlap
2008-02-17 4:35 ` H. Peter Anvin
2008-02-17 4:47 ` Randy Dunlap
2008-02-17 20:40 ` Rafael J. Wysocki
2008-02-17 21:07 ` Sam Ravnborg
2008-02-17 21:21 ` H. Peter Anvin
2008-02-17 21:28 ` Sam Ravnborg
2008-02-17 21:31 ` H. Peter Anvin
2008-02-17 21:46 ` Sam Ravnborg
2008-02-17 21:20 ` H. Peter Anvin
2008-02-16 19:47 ` [BUILD_FAILURE] 2.6.25-rc2-mm1 - Build Failure at acpi_os Kamalesh Babulal
2008-02-16 20:01 ` Laura Garcia
2008-02-21 7:08 ` Len Brown
2008-02-21 18:54 ` Nish Aravamudan
2008-02-21 22:22 ` Sam Ravnborg
2008-02-22 1:38 ` Nish Aravamudan
2008-02-22 18:08 ` Sam Ravnborg
2008-02-22 18:12 ` Nish Aravamudan
2008-02-22 18:13 ` Randy Dunlap
2008-02-22 18:21 ` Nish Aravamudan
2008-02-22 18:27 ` Sam Ravnborg
2008-02-22 18:29 ` Randy Dunlap
2008-02-22 18:56 ` Sam Ravnborg
2008-02-22 19:25 ` [PATCH] " Randy Dunlap
2008-02-23 5:41 ` Len Brown
2008-02-23 15:33 ` Kamalesh Babulal
2008-02-16 21:27 ` 2.6.25-rc2-mm1: WARNING at arch/x86/mm/ioremap.c:129 Laurent Riffard
2008-02-16 21:52 ` Arjan van de Ven
2008-02-18 4:58 ` Brown, Len
2008-02-18 5:18 ` Arjan van de Ven
2008-02-18 19:35 ` Arjan van de Ven
2008-02-18 21:05 ` Laurent Riffard
2008-02-18 21:12 ` Arjan van de Ven
2008-02-24 0:44 ` Gabriel C
2008-02-24 2:50 ` Arjan van de Ven
2008-02-25 16:31 ` Gabriel C
2008-02-25 22:44 ` Arjan van de Ven
2008-02-25 23:33 ` Gabriel C
2008-02-25 23:59 ` Gabriel C
2008-03-01 15:40 ` Mirco Tischler
2008-03-02 15:53 ` Fabio Checconi
2008-03-02 16:58 ` Arjan van de Ven
2008-03-03 8:46 ` Ingo Molnar
2008-03-03 8:47 ` Ingo Molnar
2008-03-03 10:21 ` Fabio Checconi
2008-03-02 20:40 ` Laurent Riffard
2008-03-02 23:35 ` Mirco Tischler
2008-02-17 4:10 ` [BUG] 2.6.25-rc2-mm1 - Kernel panic while bootup caused by signal_group_exit() Kamalesh Babulal
2008-02-17 4:50 ` Andrew Morton
2008-02-17 5:02 ` Kamalesh Babulal
2008-02-17 12:41 ` Oleg Nesterov
2008-02-20 19:34 ` Rik van Riel
2008-02-20 20:04 ` Oleg Nesterov
2008-02-20 22:53 ` Rik van Riel
2008-02-28 13:13 ` Cedric Le Goater
2008-02-20 20:07 ` Alan Cox
2008-02-17 5:08 ` 2.6.25-rc2-mm1 Kamalesh Babulal
2008-02-17 5:24 ` 2.6.25-rc2-mm1 Andrew Morton
2008-02-17 7:36 ` Kamalesh Babulal [this message]
2008-02-17 5:16 ` 2.6.25-rc2-mm1 (x64 thermal build failure) Randy Dunlap
2008-02-17 5:44 ` Andrew Morton
2008-02-18 10:15 ` Thomas Petazzoni
2008-02-18 12:13 ` Andrew Morton
2008-02-19 15:55 ` Thomas Petazzoni
2008-02-19 17:41 ` Randy Dunlap
2008-02-19 22:00 ` Thomas Petazzoni
2008-02-19 22:05 ` Randy Dunlap
2008-02-19 23:21 ` Andrew Morton
2008-02-20 7:21 ` Thomas Petazzoni
2008-02-20 9:55 ` Andrew Morton
2008-02-17 5:32 ` 2.6.25-rc2-mm1 (build failure) Randy Dunlap
2008-02-17 5:46 ` Andrew Morton
2008-02-17 19:52 ` Pavel Machek
2008-02-17 20:12 ` Rafael J. Wysocki
2008-02-17 11:23 ` Rafael J. Wysocki
2008-02-17 17:54 ` Randy Dunlap
2008-02-17 6:25 ` 2.6.25-rc2-mm1 Joel Becker
2008-02-17 6:32 ` 2.6.25-rc2-mm1 Joel Becker
2008-02-17 6:51 ` 2.6.25-rc2-mm1 Andrew Morton
2008-02-17 10:50 ` 2.6.25-rc2-mm1: new create_proc_entry() users Alexey Dobriyan
2008-02-18 13:01 ` Andrew Morton
2008-02-18 16:13 ` Daniel Walker
2008-02-19 22:25 ` Miller, Mike (OS Dev)
2008-02-19 23:59 ` Andrew Morton
2008-02-18 0:14 ` 2.6.25-rc2-mm1 (cifs build errs) Randy Dunlap
2008-02-18 4:10 ` Steve French
2008-02-18 0:16 ` 2.6.25-rc2-mm1 Randy Dunlap
2008-02-18 9:34 ` 2.6.25-rc2-mm1 Andrew Morton
2008-02-18 5:17 ` 2.6.25-rc2-mm1 (x86 MCE build error) Randy Dunlap
2008-02-18 6:03 ` Yinghai Lu
2008-02-18 13:31 ` Adrian Bunk
2008-02-18 17:13 ` 2.6.25-rc2-mm1 (cciss " Randy Dunlap
2008-02-19 0:08 ` 2.6.25-rc2-mm1 Kevin Winchester
2008-02-19 0:15 ` 2.6.25-rc2-mm1 Andrew Morton
2008-02-19 0:22 ` 2.6.25-rc2-mm1 Steven Rostedt
2008-02-19 1:15 ` 2.6.25-rc2-mm1 Kevin Winchester
2008-02-20 21:14 ` 2.6.25-rc2-mm1 - several bugs and a crash Tilman Schmidt
2008-02-20 21:50 ` Patrick McHardy
2008-02-21 11:28 ` Patrick McHardy
2008-02-21 16:32 ` Stephen Hemminger
2008-02-21 16:34 ` Patrick McHardy
2008-02-22 0:40 ` Tilman Schmidt
2008-02-22 0:52 ` Tilman Schmidt
2008-02-22 17:09 ` Paul E. McKenney
2008-02-25 8:54 ` Tilman Schmidt
2008-02-27 16:37 ` nf_conntrack fix smp_processor_id() in preemptible code (was: 2.6.25-rc2-mm1 - several bugs and a crash) Tilman Schmidt
2008-02-27 16:47 ` nf_conntrack fix smp_processor_id() in preemptible code Patrick McHardy
2008-02-21 12:38 ` 2.6.25-rc2-mm1 - several bugs and a crash Andrew Morton
2008-02-21 16:46 ` Christoph Hellwig
2008-02-22 0:10 ` Tilman Schmidt
2008-02-21 19:36 ` Dave Hansen
Reply instructions:
You may reply publicly to this message via plain-text email
using any one of the following methods:
* Save the following mbox file, import it into your mail client,
and reply-to-all from there: mbox
Avoid top-posting and favor interleaved quoting:
https://en.wikipedia.org/wiki/Posting_style#Interleaved_style
* Reply using the --to, --cc, and --in-reply-to
switches of git-send-email(1):
git send-email \
--in-reply-to=47B7E3F9.7080208@linux.vnet.ibm.com \
--to=kamalesh@linux.vnet.ibm.com \
--cc=akpm@linux-foundation.org \
--cc=apw@shadowen.org \
--cc=haveblue@us.ibm.com \
--cc=hch@lst.de \
--cc=linux-kernel@vger.kernel.org \
--cc=mingo@elte.hu \
--cc=tglx@linutronix.de \
/path/to/YOUR_REPLY
https://kernel.org/pub/software/scm/git/docs/git-send-email.html
* If your mail client supports setting the In-Reply-To header
via mailto: links, try the mailto: link
Be sure your reply has a Subject: header at the top and a blank line
before the message body.
This is a public inbox, see mirroring instructions
for how to clone and mirror all data and code used for this inbox;
as well as URLs for NNTP newsgroup(s).